-- Logs begin at Thu 2022-09-08 11:50:12 UTC, end at Thu 2022-09-08 14:36:44 UTC. -- Sep 08 12:26:07.308463 n-d-852084-10 systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 12:26:07.317971 n-d-852084-10 devstack@n-api.service[106623]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 12:26:07 2022] *** Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: nodename: n-d-852084-10 Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: machine: x86_64 Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: clock source: unix Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: pcre jit disabled Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: detected number of CPU cores: 4 Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: current working directory: / Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: detected binary path: /usr/bin/uwsgi-core Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: your processes number limit is 47680 Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: your memory page size is 4096 bytes Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: detected max file descriptor number: 2048 Sep 08 12:26:07.320088 n-d-852084-10 devstack@n-api.service[106623]: lock engine: pthread robust mutexes Sep 08 12:26:07.321776 n-d-852084-10 devstack@n-api.service[106623]: thunder lock: enabled Sep 08 12:26:07.321776 n-d-852084-10 devstack@n-api.service[106623]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 12:26:07.321776 n-d-852084-10 devstack@n-api.service[106623]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 12:26:07.361058 n-d-852084-10 devstack@n-api.service[106623]: Python main interpreter initialized at 0x5591f4a729c0 Sep 08 12:26:07.361058 n-d-852084-10 devstack@n-api.service[106623]: python threads support enabled Sep 08 12:26:07.361058 n-d-852084-10 devstack@n-api.service[106623]: your server socket listen backlog is limited to 100 connections Sep 08 12:26:07.361058 n-d-852084-10 devstack@n-api.service[106623]: your mercy for graceful operations on workers is 90 seconds Sep 08 12:26:07.361644 n-d-852084-10 devstack@n-api.service[106623]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 12:26:07.361644 n-d-852084-10 devstack@n-api.service[106623]: *** Operational MODE: preforking *** Sep 08 12:26:07.361908 n-d-852084-10 devstack@n-api.service[106623]: *** uWSGI is running in multiple interpreter mode *** Sep 08 12:26:07.361908 n-d-852084-10 devstack@n-api.service[106623]: spawned uWSGI master process (pid: 106623) Sep 08 12:26:07.362018 n-d-852084-10 systemd[1]: Started Devstack devstack@n-api.service. Sep 08 12:26:07.362863 n-d-852084-10 devstack@n-api.service[106623]: spawned uWSGI worker 1 (pid: 106624, cores: 1) Sep 08 12:26:07.365616 n-d-852084-10 devstack@n-api.service[106623]: spawned uWSGI worker 2 (pid: 106625, cores: 1) Sep 08 12:26:07.365616 n-d-852084-10 devstack@n-api.service[106623]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 12:26:08.097759 n-d-852084-10 devstack@n-api.service[106625]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 12:26:08.279542 n-d-852084-10 devstack@n-api.service[106624]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 12:26:09.257306 n-d-852084-10 devstack@n-api.service[106625]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 12:26:09.257306 n-d-852084-10 devstack@n-api.service[106625]: from cryptography.utils import int_from_bytes Sep 08 12:26:09.258031 n-d-852084-10 devstack@n-api.service[106625]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 12:26:09.258031 n-d-852084-10 devstack@n-api.service[106625]: from cryptography.utils import int_from_bytes Sep 08 12:26:09.414028 n-d-852084-10 devstack@n-api.service[106624]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 12:26:09.414028 n-d-852084-10 devstack@n-api.service[106624]: from cryptography.utils import int_from_bytes Sep 08 12:26:09.414924 n-d-852084-10 devstack@n-api.service[106624]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 12:26:09.414924 n-d-852084-10 devstack@n-api.service[106624]: from cryptography.utils import int_from_bytes Sep 08 12:26:11.934264 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 12:26:11.935143 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 12:26:11.935143 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 12:26:11.935605 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 12:26:11.935764 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 12:26:11.936027 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 12:26:11.936614 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 12:26:11.936772 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.936772 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.937063 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 12:26:11.937230 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.937374 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 12:26:11.937533 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.937712 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 12:26:11.937861 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.938131 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.938283 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.938446 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.938651 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.938845 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.939089 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.939315 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.939469 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.939693 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.939867 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.940029 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852084-10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.940259 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.940415 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.940686 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.940842 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.941111 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.941284 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.941450 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.941730 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.941899 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.942060 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.942359 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.942541 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.942740 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.943016 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.944960 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.945119 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.945281 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852084-10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.945448 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.945593 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.946260 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.946415 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.946554 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.946703 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.946858 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.947005 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.947142 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.947266 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.947418 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.947418 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.947714 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.947925 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.948122 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.948317 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.948534 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.948770 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852084-10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.948967 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.949162 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.949359 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.949560 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.949772 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.949942 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.950136 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.950463 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.950657 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.950870 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.951109 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.951367 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.951571 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.951769 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.951980 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.952182 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.952389 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.952590 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.952883 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.953106 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.953106 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.953450 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852084-10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.953657 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.953848 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.954038 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.954234 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.954390 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.954516 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.954649 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.954802 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.954991 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.955182 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.955385 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.955527 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.955668 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.955793 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.955916 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.956038 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.956161 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.956293 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.956418 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.956541 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.956664 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.956795 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.956925 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.957047 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.957171 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.957310 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.957441 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.957441 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.957797 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.957923 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.958091 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.958288 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.958485 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.958680 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.958885 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.959079 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.959327 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.959527 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.959746 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.959746 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.960131 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.960327 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.960546 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.960742 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.960936 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.961145 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.961865 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.962062 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.962255 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.962427 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.962597 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.962895 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.963099 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.963302 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.963539 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.963732 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.963947 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.964151 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.964358 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.964506 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.964506 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.964780 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.964780 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.965165 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.965369 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.965575 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.965766 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.965970 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.966197 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.966398 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.966591 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.966784 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.966784 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.967167 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.967407 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.967407 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.967801 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.968011 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.968217 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.968414 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.968414 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.968823 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.969039 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.969248 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.969452 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.969757 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.969969 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.969969 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.970336 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.970535 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.970535 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.970923 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.971122 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.971345 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.971477 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.971477 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.971855 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.972075 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.972268 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.972476 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.972476 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.972832 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.973029 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.973246 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.973457 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.973457 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.973829 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.974014 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.974225 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.974425 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.974425 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.974803 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.975008 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.975008 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.975420 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.975647 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.975852 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.976054 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.976054 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.976436 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.976668 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.977486 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.977683 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.977683 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.978047 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.978239 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.978445 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.978642 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.978642 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.979003 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.979199 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.979503 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.979808 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.979808 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.980181 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.980380 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.980576 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.980784 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.980966 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.981161 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.981161 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.981558 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.981755 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.981965 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.982161 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.982161 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.982510 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.982695 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.982695 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.983056 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.983279 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.983471 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.983683 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.983683 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.984052 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.984261 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.984457 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.984653 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.984653 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.985024 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.985218 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.985423 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.985611 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.985611 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.985974 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.986167 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.986360 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.986565 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.986565 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.986946 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.987088 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.987088 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.987511 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.987724 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.987932 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.988125 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.988125 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.988491 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.988628 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.988628 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.988923 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.989111 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.989111 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.989498 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.989702 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.989895 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.990091 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.990091 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.990351 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.990520 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.990728 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.990920 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.990920 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.991369 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.991567 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.991567 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.991965 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.992167 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.992365 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.992588 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.992588 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.993002 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.993215 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.993215 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.993598 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.993796 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.993992 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.994205 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.994205 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.994578 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.994773 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.994773 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.995148 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.995432 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.995432 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.995820 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.996267 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.996466 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.996662 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.996882 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.997081 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.997281 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.997486 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.997684 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:26:11.997902 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.998110 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.998305 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.998502 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.998711 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.998909 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.999308 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.999533 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.999706 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:11.999900 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.000094 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.000289 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.000289 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.000684 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.000876 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.001064 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.001259 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.001443 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.001649 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.001847 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.002044 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.002044 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.002421 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.002615 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.002827 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.003020 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.003214 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.003455 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.003640 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.003839 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.003839 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.004226 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.004226 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.004611 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.004809 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.005037 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.005234 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.005234 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.005597 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.005597 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.005967 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.006176 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.006368 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.006368 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.006716 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.006916 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.007111 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.007403 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.007613 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.007808 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.008015 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.008327 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.008543 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.008543 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.008926 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.009130 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.009321 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.009512 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.009712 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.009897 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.009897 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.010256 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.010449 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.010639 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.010847 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.011042 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.011260 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.011456 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.011618 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.011618 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.011870 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.011996 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.012121 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.012245 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.012382 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.012577 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.012783 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.012975 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.012975 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.013339 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.013543 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.013725 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.013914 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.014124 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.014322 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.014516 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.014708 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.014708 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.015089 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.015322 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.015515 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.015697 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.015893 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.016096 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.016096 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.016485 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.016689 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.016884 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.017077 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.017077 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.017479 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.017672 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.017876 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.018064 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.018064 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.018472 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.018669 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.018864 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.019060 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.019335 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.019547 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.019547 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.019914 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.020108 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.020294 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.020491 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.020697 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.020902 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.020902 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.021238 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.021365 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.021499 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.021708 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.021905 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.022099 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.022099 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.022478 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.022673 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.022885 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.023075 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.023289 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.023487 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.023487 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.024412 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.024601 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.024797 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.024993 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.025190 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.025322 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.025322 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.025643 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.025849 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.026052 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.026259 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.026466 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.026676 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.026676 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.027050 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.027285 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.027485 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.027656 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.027805 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.027987 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.027987 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.028351 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.028544 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.028753 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.028947 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.029128 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.029305 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.029496 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.029701 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.029701 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.030085 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.030312 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.030495 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.030702 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.030702 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.031099 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.031334 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.031527 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.031716 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.031900 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.032094 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.032290 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.032489 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.032489 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.032828 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.033001 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.033321 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.033519 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.033519 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.033895 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.034102 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.034310 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.034518 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.034700 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.034886 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.034886 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.035146 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.035392 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.035608 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.035806 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.036012 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.036202 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.036202 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.036559 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.036766 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.036965 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.037162 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.037306 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.037472 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.037472 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.037862 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.038053 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.038247 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.038436 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.038629 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.038833 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.038833 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.039204 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.039999 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.040197 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.040383 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.040599 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.040777 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.040777 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.041143 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.041336 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.041546 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.041760 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.041902 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.042035 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.042035 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.042381 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.042577 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.042785 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.042974 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.043165 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.043453 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.043453 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.043849 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.044057 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.044254 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.044448 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.044448 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.044809 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.045002 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.045209 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.045403 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.045403 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.045778 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.045980 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.046192 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.046386 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.046386 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.046762 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.046951 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.047144 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.047390 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.047517 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.047642 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.047805 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.048003 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.048003 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.048387 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.048577 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.048772 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.048966 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.049160 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.049363 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.049363 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.049725 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.049922 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.050129 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.050321 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.050537 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.050731 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.050731 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.051106 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.051360 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.051556 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.051764 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.051764 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.052127 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.052306 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.052487 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.052678 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.052859 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.053052 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.053052 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.053294 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.053476 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.053694 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.053889 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.053889 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.054285 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.054478 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.054619 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.054757 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.054880 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.055073 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.055073 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.055513 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.055703 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.055903 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.056096 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.056287 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.056479 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.056672 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.056867 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.056867 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.057256 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.057445 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.057638 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.057870 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.058157 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.058363 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.058363 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.058743 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.058936 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.059148 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.059438 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.059632 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.059837 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.059837 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.060212 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.060407 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.060618 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.060943 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.061126 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.061324 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.061519 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.061710 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.061710 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.062120 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.062274 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.062425 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.062584 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.062757 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.062908 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.062908 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.063246 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.063419 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.063647 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.063848 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.063848 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.064172 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.064339 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.064339 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.064660 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.064838 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.065004 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.065167 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.065324 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.065490 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.065672 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.065856 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.065856 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.066194 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.066378 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.066558 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.066720 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.066880 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.067045 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.067217 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.067489 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.067661 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.067845 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.067845 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.068195 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.068377 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.068560 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.068753 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.068753 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.069122 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.069315 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.069508 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.069697 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.069870 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.070042 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.070042 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.070392 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.070606 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.070777 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.070945 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.071109 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.071288 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.071288 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.071615 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.071793 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.071979 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.072189 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.072382 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.072584 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.072584 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.072941 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.073120 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.073325 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.073527 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.073527 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.073886 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.074079 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.074283 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.074495 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.074689 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.074893 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.074893 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.075307 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.075491 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.075702 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.075893 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.076086 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.076276 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.076276 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.076653 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.076840 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.077038 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.077243 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.077243 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.077243 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.077875 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.078076 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.078280 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.078470 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.078657 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.078845 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.078845 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.079216 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.079435 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.079649 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.079754 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.079754 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.080001 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.080121 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.080253 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.080384 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.080540 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.080695 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.080695 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.080948 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.081072 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.081193 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.081307 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.081431 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.081556 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.081556 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.081797 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.081919 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.082067 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.082194 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.082332 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.082472 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.082472 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.082745 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.082868 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.083000 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.083191 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.083361 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.083486 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.083486 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.083786 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.083967 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.084114 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.084250 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.084385 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.084509 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.084633 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.084764 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.084764 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.085015 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.085140 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.085264 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.085394 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.085576 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.085700 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.085823 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.085946 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.085946 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.086841 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.087050 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.087300 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.087490 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.087490 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.087741 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.087867 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.088059 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.088255 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.088450 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.088652 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.088652 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.089034 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.089244 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.089431 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.089621 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.089821 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.090016 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.090016 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.090418 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.090615 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.090816 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.091026 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.091026 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.091512 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.091713 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.091926 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.092124 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.092124 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.092493 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.092700 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.092918 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.093107 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.093107 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.093490 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.093700 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.093899 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.094096 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.094096 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.094474 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.094669 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.094877 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.095074 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.095074 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.095463 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.095650 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.095837 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.096112 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.096312 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.096508 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.096706 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.096899 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.097117 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.097334 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.097542 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.097733 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.097733 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.098120 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.098321 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.098545 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.098745 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.098745 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.099113 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.099439 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.099657 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.099867 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.100063 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.100239 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.100239 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.100604 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.100816 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.101013 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.101213 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.101409 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.101606 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.101851 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.102579 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.102579 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.102981 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.103134 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.103301 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.103494 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.103681 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.103891 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.103891 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.104329 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.104534 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.104734 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.104940 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.105140 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.105335 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.105335 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.105720 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.105940 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.106098 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.106304 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.106504 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.106710 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.106905 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.107115 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.107115 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.107552 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.107742 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.107938 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.108155 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.108387 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.108662 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.108862 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.109058 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.109058 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.109425 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.109555 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.109722 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.109912 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.109912 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.110288 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.110509 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.110723 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.110894 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.110894 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.111209 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.111431 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.111649 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.111842 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.112041 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.112233 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.112233 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.112622 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.112838 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.113038 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.113250 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.113451 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.113657 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.113657 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.114047 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.114232 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.114427 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.114626 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.114824 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.115042 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.115279 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.115412 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.115564 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.115761 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.115953 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.116161 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.116161 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.116534 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.116733 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.116919 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.117126 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.117126 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.117547 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.117746 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.117945 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.118150 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.118388 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.118593 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.118790 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.118982 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.119206 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.119453 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.119666 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.119875 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.120071 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.120260 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.120260 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.120640 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.121097 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.121297 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.121506 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.121715 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.121921 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.121921 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.122247 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.122402 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.122551 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.122695 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.122893 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.123045 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.123174 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.123356 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.123356 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.123690 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.123887 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.124094 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.124290 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.124492 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.124684 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.124684 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.125047 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.125259 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.125452 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.125646 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.125846 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.126039 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.126039 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.126403 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.126609 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.126803 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.127001 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.127201 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.127468 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.127668 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.127865 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.127865 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.128236 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.128431 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.128644 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.128844 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.128989 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.129124 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.129124 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.129365 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.129500 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.129624 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.129812 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.130008 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.130214 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.130214 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.130606 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.130814 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.131010 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.131291 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.131488 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.131710 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.131710 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.132088 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.132282 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.132474 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.132683 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.132683 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.133183 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.133379 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.133574 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.133770 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.133963 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.134162 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.134357 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.134357 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.134784 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.134995 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.135191 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.135441 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.135634 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.135841 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.136042 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.136233 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.136405 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.136591 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.136787 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.136999 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.137193 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.137397 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.137593 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.137593 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.137986 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.138183 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.138345 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.138472 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.138472 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.138709 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.138914 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.139123 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.139342 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.139539 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.139735 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.139735 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.140131 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.140327 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.140516 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.140718 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.140911 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.141112 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.141112 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.141505 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.141702 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.141849 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.141975 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.141975 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.142226 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.142333 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.142463 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.142665 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.142871 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.143080 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.143080 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.143475 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.143675 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.143893 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.144090 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.144303 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.144504 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.144504 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.144782 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.144976 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.145172 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.145482 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.145683 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.145878 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.145878 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.146244 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.146438 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.146646 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.146842 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.146842 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.147216 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.147459 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.147678 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.147877 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.147877 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.148260 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.148462 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.148621 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.149280 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.149475 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.149673 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.149673 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.150046 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.150254 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.150468 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.150680 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.150680 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.150935 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.151084 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.151324 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.151523 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.151523 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.151897 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.152094 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.152293 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.152497 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.152699 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.152899 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.153097 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.153308 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.153506 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.153738 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.153738 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.154114 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.154311 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.154511 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.154693 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.154693 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.155077 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.155297 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.155495 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.155691 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.155913 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.156058 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.156236 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.156437 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.156437 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.156801 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.157015 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.157212 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.157409 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.157618 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.157815 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.157815 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.158203 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.158382 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.158560 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.158741 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.158741 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.159115 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.159397 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.159587 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.159766 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.159964 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.160177 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.160177 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.160562 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.160770 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.160973 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.161116 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.161243 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.161435 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.161435 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.161805 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.162041 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.162248 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.162458 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.162660 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.162866 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.163059 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.163354 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.163354 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.163768 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.163975 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.164185 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.164437 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.165114 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.165313 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.165526 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.165709 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.165885 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.166090 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.166090 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.166495 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.166691 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.166882 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.167047 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.167188 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.167341 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.167537 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.167730 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.167926 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.168124 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.168124 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.168505 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.168722 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.168921 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.169125 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.169332 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.169529 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.169727 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.169903 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.170051 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.170247 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.170446 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.170644 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.170644 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.171022 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.171242 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.171441 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.171651 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.171651 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.172031 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.172231 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.172432 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.172633 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.172852 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.173048 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.173261 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.173458 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.173658 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.173849 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.174041 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.174233 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.174233 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.174611 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.174805 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.174996 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.175187 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.175483 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.175687 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.175687 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.176054 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.176264 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.176476 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.176702 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.176702 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.177024 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.177207 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.177402 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.177598 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.177821 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.178019 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.178019 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.178403 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.178592 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.178739 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.178876 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.178876 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.179115 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.179266 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.179266 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.179675 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.179675 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.179675 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.180329 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.180524 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.180717 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.180717 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.181080 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.181277 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.181470 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.181663 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.181663 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.182151 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.182345 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.182536 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.182740 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.182924 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.183119 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.183403 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.183600 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.183600 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.183965 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.184159 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.184364 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.184576 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.184576 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.184946 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.185146 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.185354 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.185559 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.185559 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.185928 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.186126 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.186319 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.186512 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.186725 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.186917 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.186917 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.187275 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.187407 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.187550 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.187762 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.187762 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.188148 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.188345 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.188542 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.188762 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.188957 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.189152 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.189352 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.189560 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.189759 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.189977 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.190176 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.190374 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.190527 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.190663 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.190663 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.191042 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.191324 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.191324 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.191699 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.191898 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.191898 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.192264 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.192466 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.192662 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.192870 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.193058 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.193278 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.193278 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.193656 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.193853 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.194049 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.194246 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.194465 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.194661 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.194862 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.195068 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.195068 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.195468 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.195717 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.195930 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.196088 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.196245 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.196442 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.196442 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.196840 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.197035 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.197233 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.197432 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.197622 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.197836 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.198040 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.198238 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.198238 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.198632 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.198830 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.199041 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.199308 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.199308 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.199685 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.199888 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.200099 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.200299 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.200299 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.200672 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.200881 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.201081 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.201300 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.201515 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.201695 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.201904 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.202105 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.202317 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.202524 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.202722 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.202986 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.202986 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.203352 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.203583 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.203779 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.203992 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.204188 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.204391 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.204587 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.204798 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.204798 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.205181 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.205378 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.205575 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.205783 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.205982 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.206182 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.206182 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.206568 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.206768 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.206978 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.207172 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.207418 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.207596 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.207596 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.207966 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.208187 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.208332 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.208465 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.208652 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.208841 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.208841 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.209364 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.209560 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.209560 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.209940 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.210158 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.210158 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.210532 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.210742 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.210940 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.211137 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.211881 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.212101 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.212101 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.212414 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.212586 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.212782 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.212978 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.213192 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.213395 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.213395 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.213710 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.213880 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.214041 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.214253 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.214452 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.214666 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.214666 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.215049 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.215337 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.215535 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.215732 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.215910 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.216083 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.216083 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.216479 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.216681 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.216878 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.217072 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.217271 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.217411 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.217411 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.217705 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.217919 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.218119 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.218330 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.218330 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.218814 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.219017 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.219220 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.219457 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.219457 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.219835 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.220045 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.220244 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.220445 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.220657 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.220858 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.221071 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.221271 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.221271 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.221656 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.221858 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.222053 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.222267 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.222267 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.222647 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.222848 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.223046 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.223337 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.223556 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.223765 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.223968 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.224163 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.224163 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.224554 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.224755 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.224957 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.225163 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.225368 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.225562 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.225770 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.225979 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.225979 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.226345 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.226541 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.226755 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.227582 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.227780 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.227959 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.227959 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.228340 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.228561 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.228755 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.228950 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.229155 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.229353 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.229550 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.229767 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.229767 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.230142 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.230342 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.230535 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.230712 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.230926 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.231109 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.231109 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.231487 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.231675 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.231887 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.232087 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.232267 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.232408 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.232553 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.232709 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.232709 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233000 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233144 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233285 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233419 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233567 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233719 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 12:26:12.233862 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233862 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233862 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233862 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233862 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233862 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233862 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.233862 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.235148 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.235148 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.235148 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.235148 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.235148 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.235148 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.235148 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.235148 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.236256 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.236256 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.236256 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.236256 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.236256 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.236256 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.236256 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.236256 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.237233 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.237233 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.237233 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.237233 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.237233 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.237233 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.237233 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.237233 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.238332 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.238332 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.238332 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.238332 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.238332 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.238332 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.238332 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.238332 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.239284 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.239284 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.239284 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.239284 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.239284 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.239284 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.239284 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.239284 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.240614 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.240614 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.240614 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.240614 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.240614 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.240614 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.240614 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.240614 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.242056 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.242056 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.242056 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.242056 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.242056 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.242056 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.242056 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.242056 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.243622 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.243622 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.243622 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.243622 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.243622 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.243622 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.243622 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.243622 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.245005 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.245005 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.245005 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.245005 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.245005 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.245005 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.245005 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.245005 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.246984 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.246984 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.246984 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.246984 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.246984 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.246984 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.246984 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.246984 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.248167 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.248167 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.248167 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.248167 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.248167 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.248751 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.248905 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.249291 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.249648 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.250019 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.250390 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.250761 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.251207 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.251695 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.252097 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.252466 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.252887 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.253243 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.253605 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.253966 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.254428 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.254811 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.255173 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.255607 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.255966 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.256348 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.256713 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.257068 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.257442 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.257797 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.258807 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.259248 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.259640 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.260053 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.260452 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.260845 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.261205 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.261567 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.261933 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.262347 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.262775 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.263158 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.263581 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.264025 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.264418 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.264848 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.265251 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.265623 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.265991 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.266344 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.266809 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:26:12.267009 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106624) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 12:26:12.365754 n-d-852084-10 devstack@n-api.service[106625]: INFO dbcounter [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Registered counter for database nova_api Sep 08 12:26:12.390213 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_db.sqlalchemy.engines [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:26:12.397097 n-d-852084-10 devstack@n-api.service[106625]: DEBUG dbcounter [-] [106625] Writer thread running {{(pid=106625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:26:12.454782 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.context [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) {{(pid=106625) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 12:26:12.458611 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:26:12.459085 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:26:12.460738 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:26:12.462048 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:26:12.462485 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:26:12.464577 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:26:12.466816 n-d-852084-10 devstack@n-api.service[106625]: INFO dbcounter [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Registered counter for database nova_cell0 Sep 08 12:26:12.469954 n-d-852084-10 devstack@n-api.service[106624]: INFO dbcounter [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Registered counter for database nova_api Sep 08 12:26:12.471319 n-d-852084-10 devstack@n-api.service[106625]: INFO dbcounter [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Registered counter for database nova_cell1 Sep 08 12:26:12.481970 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_db.sqlalchemy.engines [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:26:12.482865 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_db.sqlalchemy.engines [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:26:12.487608 n-d-852084-10 devstack@n-api.service[106625]: DEBUG dbcounter [-] [106625] Writer thread running {{(pid=106625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:26:12.494690 n-d-852084-10 devstack@n-api.service[106625]: DEBUG dbcounter [-] [106625] Writer thread running {{(pid=106625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:26:12.503861 n-d-852084-10 devstack@n-api.service[106624]: DEBUG oslo_db.sqlalchemy.engines [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:26:12.514147 n-d-852084-10 devstack@n-api.service[106624]: DEBUG dbcounter [-] [106624] Writer thread running {{(pid=106624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:26:12.583041 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.context [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) {{(pid=106624) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 12:26:12.588251 n-d-852084-10 devstack@n-api.service[106624]: DEBUG oslo_concurrency.lockutils [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:26:12.588752 n-d-852084-10 devstack@n-api.service[106624]: DEBUG oslo_concurrency.lockutils [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:26:12.590461 n-d-852084-10 devstack@n-api.service[106624]: DEBUG oslo_concurrency.lockutils [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:26:12.591247 n-d-852084-10 devstack@n-api.service[106624]: DEBUG oslo_concurrency.lockutils [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:26:12.591796 n-d-852084-10 devstack@n-api.service[106624]: DEBUG oslo_concurrency.lockutils [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:26:12.594043 n-d-852084-10 devstack@n-api.service[106624]: DEBUG oslo_concurrency.lockutils [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106624) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:26:12.596241 n-d-852084-10 devstack@n-api.service[106624]: INFO dbcounter [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Registered counter for database nova_cell0 Sep 08 12:26:12.601068 n-d-852084-10 devstack@n-api.service[106624]: INFO dbcounter [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Registered counter for database nova_cell1 Sep 08 12:26:12.613940 n-d-852084-10 devstack@n-api.service[106624]: DEBUG oslo_db.sqlalchemy.engines [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:26:12.615851 n-d-852084-10 devstack@n-api.service[106624]: DEBUG oslo_db.sqlalchemy.engines [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:26:12.624114 n-d-852084-10 devstack@n-api.service[106624]: DEBUG dbcounter [-] [106624] Writer thread running {{(pid=106624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:26:12.626168 n-d-852084-10 devstack@n-api.service[106624]: DEBUG dbcounter [-] [106624] Writer thread running {{(pid=106624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:26:12.660209 n-d-852084-10 devstack@n-api.service[106625]: INFO dbcounter [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Registered counter for database nova_cell0 Sep 08 12:26:12.669578 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_db.sqlalchemy.engines [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:26:12.675008 n-d-852084-10 devstack@n-api.service[106625]: DEBUG dbcounter [-] [106625] Writer thread running {{(pid=106625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:26:12.790852 n-d-852084-10 devstack@n-api.service[106624]: INFO dbcounter [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Registered counter for database nova_cell0 Sep 08 12:26:12.801935 n-d-852084-10 devstack@n-api.service[106624]: DEBUG oslo_db.sqlalchemy.engines [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106624) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:26:12.810047 n-d-852084-10 devstack@n-api.service[106624]: DEBUG dbcounter [-] [106624] Writer thread running {{(pid=106624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:26:13.035726 n-d-852084-10 devstack@n-api.service[106625]: WARNING keystonemiddleware.auth_token [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 12:26:13.045809 n-d-852084-10 devstack@n-api.service[106625]: WARNING keystonemiddleware.auth_token [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 12:26:13.410878 n-d-852084-10 devstack@n-api.service[106625]: WARNING keystonemiddleware.auth_token [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 12:26:13.418135 n-d-852084-10 devstack@n-api.service[106625]: WARNING keystonemiddleware.auth_token [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 12:26:13.423527 n-d-852084-10 devstack@n-api.service[106625]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5591f4a729c0 pid: 106625 (default app) Sep 08 12:26:13.425777 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:26:13.426977 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001880 Sep 08 12:26:13.427166 n-d-852084-10 devstack@n-api.service[106624]: WARNING keystonemiddleware.auth_token [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 12:26:13.427664 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Thu Sep 8 12:26:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:26:13.440247 n-d-852084-10 devstack@n-api.service[106624]: WARNING keystonemiddleware.auth_token [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 12:26:14.053623 n-d-852084-10 devstack@n-api.service[106624]: WARNING keystonemiddleware.auth_token [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 12:26:14.065689 n-d-852084-10 devstack@n-api.service[106624]: WARNING keystonemiddleware.auth_token [None req-690d3c51-5fb3-4813-b1bd-60cd781c4a89 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 12:26:14.077093 n-d-852084-10 devstack@n-api.service[106624]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5591f4a729c0 pid: 106624 (default app) Sep 08 12:27:48.260303 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:27:48.262169 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002375 Sep 08 12:27:48.268220 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:27:48 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:27:48.285610 n-d-852084-10 devstack@n-api.service[106624]: DEBUG dbcounter [-] [106624] Writing DB stats nova_api:SELECT=3 {{(pid=106624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:27:48.286529 n-d-852084-10 devstack@n-api.service[106624]: DEBUG dbcounter [-] [106624] Writing DB stats nova_cell0:SELECT=3 {{(pid=106624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:27:48.287418 n-d-852084-10 devstack@n-api.service[106624]: DEBUG dbcounter [-] [106624] Writing DB stats nova_cell1:SELECT=3 {{(pid=106624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:27:48.288218 n-d-852084-10 devstack@n-api.service[106624]: DEBUG dbcounter [-] [106624] Writing DB stats nova_cell0:SELECT=3 {{(pid=106624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:27:49.201371 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-39b86716-34e2-4664-bc53-fa72aabafbec admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:27:49.234825 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-39b86716-34e2-4664-bc53-fa72aabafbec admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.959719 Sep 08 12:27:49.235667 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Sep 8 12:27:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:27:52.110260 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:27:52.111317 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-67044283-cb0c-4ecc-8b1d-de26b364a10f None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Sep 08 12:27:52.111965 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:27:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:27:52.587240 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-d82dc1b8-0c70-4acb-982c-5abb28dd566e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "c1", "swap": 0, "vcpus": 1, "disk": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:27:52.635809 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-d82dc1b8-0c70-4acb-982c-5abb28dd566e admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.516511 Sep 08 12:27:52.636376 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Sep 8 12:27:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:27:52.651609 n-d-852084-10 devstack@n-api.service[106625]: DEBUG dbcounter [-] [106625] Writing DB stats nova_api:SELECT=3 {{(pid=106625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:27:52.652527 n-d-852084-10 devstack@n-api.service[106625]: DEBUG dbcounter [-] [106625] Writing DB stats nova_cell0:SELECT=3 {{(pid=106625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:27:52.652854 n-d-852084-10 devstack@n-api.service[106625]: DEBUG dbcounter [-] [106625] Writing DB stats nova_cell1:SELECT=3 {{(pid=106625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:27:52.653857 n-d-852084-10 devstack@n-api.service[106625]: DEBUG dbcounter [-] [106625] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:27:52.860465 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-076c541f-697d-4d81-a618-aa99a1b17499 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:27:52.931443 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-076c541f-697d-4d81-a618-aa99a1b17499 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.286106 Sep 08 12:27:52.932040 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1336 bytes} [Thu Sep 8 12:27:52 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:27:55.725072 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-d82dc1b8-0c70-4acb-982c-5abb28dd566e admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:27:55.727259 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-d82dc1b8-0c70-4acb-982c-5abb28dd566e admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002611 Sep 08 12:27:55.735137 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:27:56.704056 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-66035f5d-12aa-4ea4-b49d-4989a1581888 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "id": "d1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:27:56.755732 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-66035f5d-12aa-4ea4-b49d-4989a1581888 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.019196 Sep 08 12:27:56.757996 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Sep 8 12:27:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:27:56.770156 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-e7088e73-6376-4c3d-85b9-6607a9217943 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:27:56.861822 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-e7088e73-6376-4c3d-85b9-6607a9217943 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095103 Sep 08 12:27:56.867989 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1336 bytes} [Thu Sep 8 12:27:56 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:28:00.203219 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-66035f5d-12aa-4ea4-b49d-4989a1581888 admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:00.204269 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-66035f5d-12aa-4ea4-b49d-4989a1581888 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 08 12:28:00.204682 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:28:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:28:00.785353 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-155bf861-0092-42cc-99b8-ccc2e60570c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "name": "ds1G"}} {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:00.806995 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-155bf861-0092-42cc-99b8-ccc2e60570c8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.594889 Sep 08 12:28:00.807541 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Sep 8 12:28:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 12:28:00.820827 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-15aed67d-c539-4388-b0cb-3afcdfff8d07 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:00.854430 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-15aed67d-c539-4388-b0cb-3afcdfff8d07 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038252 Sep 08 12:28:00.855344 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1336 bytes} [Thu Sep 8 12:28:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:28:04.097283 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-155bf861-0092-42cc-99b8-ccc2e60570c8 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:04.098330 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-155bf861-0092-42cc-99b8-ccc2e60570c8 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 08 12:28:04.099089 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:28:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:28:04.701999 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-26fc0485-58d0-4fda-816f-6110a0a0bbee admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "disk": 10, "ram": 2048, "id": "d3", "vcpus": 2, "name": "ds2G"}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:04.732628 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-26fc0485-58d0-4fda-816f-6110a0a0bbee admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.625457 Sep 08 12:28:04.732868 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Sep 8 12:28:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:28:04.746945 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-1f6cc654-5d7a-4b99-bdca-546db65454d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:04.791976 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-1f6cc654-5d7a-4b99-bdca-546db65454d5 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049616 Sep 08 12:28:04.793056 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1336 bytes} [Thu Sep 8 12:28:04 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:28:07.894823 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-26fc0485-58d0-4fda-816f-6110a0a0bbee admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:07.896601 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-26fc0485-58d0-4fda-816f-6110a0a0bbee admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002147 Sep 08 12:28:07.903091 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:28:07 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:28:08.460807 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-bf084f55-c986-4d97-8c19-8cf90eb8e772 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 4096, "id": "d4", "swap": 0, "disk": 20, "vcpus": 4, "name": "ds4G"}} {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:08.489782 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-bf084f55-c986-4d97-8c19-8cf90eb8e772 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.585185 Sep 08 12:28:08.504694 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Sep 8 12:28:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:28:08.515562 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-a68b5568-24c8-4fc0-a518-6b31458cb419 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:08.566851 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-a68b5568-24c8-4fc0-a518-6b31458cb419 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059198 Sep 08 12:28:08.568263 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1336 bytes} [Thu Sep 8 12:28:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:28:11.415973 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-bf084f55-c986-4d97-8c19-8cf90eb8e772 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:11.417341 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-bf084f55-c986-4d97-8c19-8cf90eb8e772 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001945 Sep 08 12:28:11.417831 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:28:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:28:11.899314 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-227c6824-2105-44e1-ae47-3d595216a9fc admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:11.927119 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-227c6824-2105-44e1-ae47-3d595216a9fc admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.502933 Sep 08 12:28:11.927687 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Sep 8 12:28:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:28:14.999813 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-bf084f55-c986-4d97-8c19-8cf90eb8e772 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:15.000832 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-bf084f55-c986-4d97-8c19-8cf90eb8e772 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001766 Sep 08 12:28:15.001242 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:28:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:28:15.506233 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-d7cdccfe-b7a3-44d0-ab7c-5992720479ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:15.528550 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-d7cdccfe-b7a3-44d0-ab7c-5992720479ef admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.520833 Sep 08 12:28:15.529273 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Sep 8 12:28:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:28:15.544717 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-06a84f22-dc62-441d-b062-7b688a914ed1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:15.576489 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-06a84f22-dc62-441d-b062-7b688a914ed1 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035486 Sep 08 12:28:15.577093 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1333 bytes} [Thu Sep 8 12:28:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:28:18.364400 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-d7cdccfe-b7a3-44d0-ab7c-5992720479ef admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:18.365327 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-d7cdccfe-b7a3-44d0-ab7c-5992720479ef admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 08 12:28:18.365728 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:28:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:28:18.805582 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-4ad1acd4-623a-4a52-b4b2-ce590a8c5186 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:18.811508 n-d-852084-10 devstack@n-api.service[106624]: DEBUG dbcounter [-] [106624] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:28:18.828101 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-4ad1acd4-623a-4a52-b4b2-ce590a8c5186 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.455780 Sep 08 12:28:18.828662 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Sep 8 12:28:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 12:28:18.840777 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-f4e12fe0-fa3c-4b69-b165-0bb79643ffed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:18.866355 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-f4e12fe0-fa3c-4b69-b165-0bb79643ffed admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029221 Sep 08 12:28:18.867486 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1333 bytes} [Thu Sep 8 12:28:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:28:21.538784 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-4ad1acd4-623a-4a52-b4b2-ce590a8c5186 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:21.539796 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-4ad1acd4-623a-4a52-b4b2-ce590a8c5186 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002020 Sep 08 12:28:21.540375 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:28:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:28:21.962069 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-93ed49c8-5273-4ae8-b9cb-6754d3fc44f2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "vcpus": 2}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:21.983511 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-93ed49c8-5273-4ae8-b9cb-6754d3fc44f2 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.436706 Sep 08 12:28:21.984478 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Sep 8 12:28:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:28:21.998450 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-169e2060-4201-4eb8-ba30-a13a7ee059a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:22.029396 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-169e2060-4201-4eb8-ba30-a13a7ee059a8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035767 Sep 08 12:28:22.030000 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1333 bytes} [Thu Sep 8 12:28:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:28:24.771132 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-93ed49c8-5273-4ae8-b9cb-6754d3fc44f2 admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:24.772413 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-93ed49c8-5273-4ae8-b9cb-6754d3fc44f2 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001737 Sep 08 12:28:24.773303 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:28:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:28:25.267942 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-4154ba52-7b84-4a8a-a5d7-8ff44f664291 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 80, "swap": 0, "id": "4", "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large"}} {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:25.290887 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-4154ba52-7b84-4a8a-a5d7-8ff44f664291 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.509660 Sep 08 12:28:25.291613 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Sep 8 12:28:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:28:25.305608 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-d60ac0ff-957a-4359-b3fd-6f30dcbb6d5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:25.310815 n-d-852084-10 devstack@n-api.service[106625]: DEBUG dbcounter [-] [106625] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=106625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:28:25.333873 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-d60ac0ff-957a-4359-b3fd-6f30dcbb6d5c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033354 Sep 08 12:28:25.334470 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1333 bytes} [Thu Sep 8 12:28:25 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:28:28.032953 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-4154ba52-7b84-4a8a-a5d7-8ff44f664291 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:28.034023 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-4154ba52-7b84-4a8a-a5d7-8ff44f664291 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 08 12:28:28.034412 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:28:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:28:28.575119 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-6c8d5d8e-5db8-4426-ade9-d45e989ab92f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 160, "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384, "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5"}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:28.600108 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-6c8d5d8e-5db8-4426-ade9-d45e989ab92f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.559157 Sep 08 12:28:28.608240 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Sep 8 12:28:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:28:28.617448 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-ca890a2b-b5b2-4199-94ec-8a7ae61d4ccb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:28:28.656724 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-ca890a2b-b5b2-4199-94ec-8a7ae61d4ccb admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046769 Sep 08 12:28:28.657332 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1333 bytes} [Thu Sep 8 12:28:28 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:28:51.008964 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-6c8d5d8e-5db8-4426-ade9-d45e989ab92f admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:51.009992 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-6c8d5d8e-5db8-4426-ade9-d45e989ab92f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 08 12:28:51.010452 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:28:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:28:51.023024 n-d-852084-10 devstack@n-api.service[106624]: DEBUG dbcounter [-] [106624] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=106624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:28:51.534898 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-efff85fe-4ada-4abc-9d6d-5dc5751546d9 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:51.555615 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-efff85fe-4ada-4abc-9d6d-5dc5751546d9 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.537739 Sep 08 12:28:51.556311 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Sep 8 12:28:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:28:53.146818 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-6c8d5d8e-5db8-4426-ade9-d45e989ab92f admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:53.148537 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-6c8d5d8e-5db8-4426-ade9-d45e989ab92f admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001676 Sep 08 12:28:53.149006 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Sep 8 12:28:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:28:53.868647 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-0fa37513-15bc-41c3-a2bf-489c2b22397b admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:53.874965 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.wsgi [None req-0fa37513-15bc-41c3-a2bf-489c2b22397b admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-0fa37513-15bc-41c3-a2bf-489c2b22397b admin admin] Request method failure captured: Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: Accept: application/json Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: Accept-Encoding: gzip, deflate Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: Connection: keep-alive Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: Content-Length: 0 Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: Host: 10.222.0.78 Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: Openstack-Api-Version: compute 2.92 Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: Openstack-System-Scope: None Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: User-Agent: python-novaclient Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: X-Auth-Token: gAAAAABjGeAFpxa7_yK8lI0v3sjilG9bNwAQq6lq9Agq12kaGiQ5sjwh_s0YZnOjqK__ZtObp0P2yKFTnazhMMkMPUw_J13kL0Fc-OMVD4DUYdKgHQcfiZHIi9BAkT7PupZfVZLjh_6F2jijezG3j141CprU9RU2dFzDEu5kzviPQue8aiuhoo4 Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: X-Domain-Id: None Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: X-Domain-Name: None Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: X-Identity-Status: Confirmed Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: X-Is-Admin-Project: True Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: X-Project-Domain-Id: default Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: X-Project-Domain-Name: Default Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: X-Project-Id: 70689ac52c1a4e92be686f8f1bbef4c0 Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: X-Project-Name: admin Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: X-Role: member,admin,reader Sep 08 12:28:53.878749 n-d-852084-10 devstack@n-api.service[106624]: X-Roles: member,admin,reader Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: X-Tenant: admin Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: X-Tenant-Id: 70689ac52c1a4e92be686f8f1bbef4c0 Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: X-Tenant-Name: admin Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: X-User: admin Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: X-User-Domain-Id: default Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: X-User-Domain-Name: Default Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: X-User-Id: 9ceb1616373f4117a0704781378db565 Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: X-User-Name: admin Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: method: > Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: exception: Flavor 42 could not be found. Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: action_args: {'id': '42'} Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:28:53.881394 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:28:53.883687 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:53.886536 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-0fa37513-15bc-41c3-a2bf-489c2b22397b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:28:53.889298 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-0fa37513-15bc-41c3-a2bf-489c2b22397b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.567008 Sep 08 12:28:53.889298 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Sep 8 12:28:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 569 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:28:53.896483 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-b5278fc6-7e77-4acb-8e07-5ceabb48a8d3 admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:53.902228 n-d-852084-10 devstack@n-api.service[106625]: DEBUG dbcounter [-] [106625] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=106625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:28:53.925391 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-b5278fc6-7e77-4acb-8e07-5ceabb48a8d3 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.033080 Sep 08 12:28:53.926002 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Thu Sep 8 12:28:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:28:53.953150 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-1a7b9749-0f6c-41cb-b521-1c1e95615c99 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:53.979373 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-1a7b9749-0f6c-41cb-b521-1c1e95615c99 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030706 Sep 08 12:28:53.980088 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Thu Sep 8 12:28:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:28:53.996225 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-a1ad1752-9920-4bee-ab0f-ab11b2c412ec admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:54.006473 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.wsgi [None req-a1ad1752-9920-4bee-ab0f-ab11b2c412ec admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-a1ad1752-9920-4bee-ab0f-ab11b2c412ec admin admin] Request method failure captured: Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: Accept: application/json Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: Accept-Encoding: gzip, deflate Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: Connection: keep-alive Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: Content-Length: 0 Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: Host: 10.222.0.78 Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: Openstack-Api-Version: compute 2.92 Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: Openstack-System-Scope: None Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: User-Agent: python-novaclient Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: X-Auth-Token: gAAAAABjGeAFpxa7_yK8lI0v3sjilG9bNwAQq6lq9Agq12kaGiQ5sjwh_s0YZnOjqK__ZtObp0P2yKFTnazhMMkMPUw_J13kL0Fc-OMVD4DUYdKgHQcfiZHIi9BAkT7PupZfVZLjh_6F2jijezG3j141CprU9RU2dFzDEu5kzviPQue8aiuhoo4 Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: X-Domain-Id: None Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: X-Domain-Name: None Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: X-Identity-Status: Confirmed Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: X-Is-Admin-Project: True Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: X-Project-Domain-Id: default Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: X-Project-Domain-Name: Default Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: X-Project-Id: 70689ac52c1a4e92be686f8f1bbef4c0 Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: X-Project-Name: admin Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: X-Role: member,admin,reader Sep 08 12:28:54.012693 n-d-852084-10 devstack@n-api.service[106625]: X-Roles: member,admin,reader Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: X-Tenant: admin Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: X-Tenant-Id: 70689ac52c1a4e92be686f8f1bbef4c0 Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: X-Tenant-Name: admin Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: X-User: admin Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: X-User-Domain-Id: default Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: X-User-Domain-Name: Default Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: X-User-Id: 9ceb1616373f4117a0704781378db565 Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: X-User-Name: admin Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: method: > Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: exception: Flavor 42 could not be found. Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: action_args: {'id': '42'} Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:28:54.014308 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:28:54.015418 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:54.016522 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-a1ad1752-9920-4bee-ab0f-ab11b2c412ec admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:28:54.017517 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-a1ad1752-9920-4bee-ab0f-ab11b2c412ec admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.024094 Sep 08 12:28:54.017517 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Sep 8 12:28:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:28:55.525075 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-1a7b9749-0f6c-41cb-b521-1c1e95615c99 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:55.526531 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-1a7b9749-0f6c-41cb-b521-1c1e95615c99 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002138 Sep 08 12:28:55.527193 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Sep 8 12:28:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:28:56.241787 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-70a5fc37-c64d-468c-916c-b2058e912b80 admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:56.247357 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.wsgi [None req-70a5fc37-c64d-468c-916c-b2058e912b80 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-70a5fc37-c64d-468c-916c-b2058e912b80 admin admin] Request method failure captured: Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: Accept: application/json Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: Accept-Encoding: gzip, deflate Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: Connection: keep-alive Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: Content-Length: 0 Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: Host: 10.222.0.78 Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: Openstack-Api-Version: compute 2.92 Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: Openstack-System-Scope: None Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: User-Agent: python-novaclient Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: X-Auth-Token: gAAAAABjGeAHRVQc5go14VdQYjprRCWmz2aVGxDnGOSW02fo9WiIiJalVR5BVrGMP4eqVlooR4vvd1DclrB0l1lWMRCQBJsKtmIpQwsAqAHdQ9RXFbz7VXN6AOj2wKUnvsfFYB65YaWXcO4wB43ORkz1TPELqT0O-ivllwZIVA2gD8Tpj1n4RZ4 Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: X-Domain-Id: None Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: X-Domain-Name: None Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: X-Identity-Status: Confirmed Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: X-Is-Admin-Project: True Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: X-Project-Domain-Id: default Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: X-Project-Domain-Name: Default Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: X-Project-Id: 70689ac52c1a4e92be686f8f1bbef4c0 Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: X-Project-Name: admin Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: X-Role: member,admin,reader Sep 08 12:28:56.248935 n-d-852084-10 devstack@n-api.service[106625]: X-Roles: member,admin,reader Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: X-Tenant: admin Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: X-Tenant-Id: 70689ac52c1a4e92be686f8f1bbef4c0 Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: X-Tenant-Name: admin Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: X-User: admin Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: X-User-Domain-Id: default Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: X-User-Domain-Name: Default Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: X-User-Id: 9ceb1616373f4117a0704781378db565 Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: X-User-Name: admin Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: method: > Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: exception: Flavor 84 could not be found. Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: action_args: {'id': '84'} Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:28:56.251729 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:28:56.253295 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:56.256078 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-70a5fc37-c64d-468c-916c-b2058e912b80 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:28:56.259037 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-70a5fc37-c64d-468c-916c-b2058e912b80 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.567815 Sep 08 12:28:56.259037 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Sep 8 12:28:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 570 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:28:56.267866 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-a6f3ceb8-ba4f-4b81-97ca-de8e5d0013ce admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:56.287923 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-a6f3ceb8-ba4f-4b81-97ca-de8e5d0013ce admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.024691 Sep 08 12:28:56.289165 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Thu Sep 8 12:28:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:28:56.306384 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-29195a26-7a69-4d54-9838-1478ba191370 admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:56.331582 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-29195a26-7a69-4d54-9838-1478ba191370 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.031515 Sep 08 12:28:56.332287 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Thu Sep 8 12:28:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:28:56.344120 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-d09a9536-3ea4-45d2-8a4e-5205cddd417f admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:56.349499 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.wsgi [None req-d09a9536-3ea4-45d2-8a4e-5205cddd417f admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-d09a9536-3ea4-45d2-8a4e-5205cddd417f admin admin] Request method failure captured: Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: Accept: application/json Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: Accept-Encoding: gzip, deflate Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: Connection: keep-alive Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: Content-Length: 0 Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: Host: 10.222.0.78 Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: Openstack-Api-Version: compute 2.92 Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: Openstack-System-Scope: None Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: User-Agent: python-novaclient Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: X-Auth-Token: gAAAAABjGeAHRVQc5go14VdQYjprRCWmz2aVGxDnGOSW02fo9WiIiJalVR5BVrGMP4eqVlooR4vvd1DclrB0l1lWMRCQBJsKtmIpQwsAqAHdQ9RXFbz7VXN6AOj2wKUnvsfFYB65YaWXcO4wB43ORkz1TPELqT0O-ivllwZIVA2gD8Tpj1n4RZ4 Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: X-Domain-Id: None Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: X-Domain-Name: None Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: X-Identity-Status: Confirmed Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: X-Is-Admin-Project: True Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: X-Project-Domain-Id: default Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: X-Project-Domain-Name: Default Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: X-Project-Id: 70689ac52c1a4e92be686f8f1bbef4c0 Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: X-Project-Name: admin Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: X-Role: member,admin,reader Sep 08 12:28:56.352040 n-d-852084-10 devstack@n-api.service[106624]: X-Roles: member,admin,reader Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: X-Tenant: admin Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: X-Tenant-Id: 70689ac52c1a4e92be686f8f1bbef4c0 Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: X-Tenant-Name: admin Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: X-User: admin Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: X-User-Domain-Id: default Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: X-User-Domain-Name: Default Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: X-User-Id: 9ceb1616373f4117a0704781378db565 Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: X-User-Name: admin Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: method: > Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: exception: Flavor 84 could not be found. Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: action_args: {'id': '84'} Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:28:56.354296 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:28:56.355280 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:56.356633 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-d09a9536-3ea4-45d2-8a4e-5205cddd417f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:28:56.357976 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-d09a9536-3ea4-45d2-8a4e-5205cddd417f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.014053 Sep 08 12:28:56.357976 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Sep 8 12:28:56 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:28:57.779783 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-29195a26-7a69-4d54-9838-1478ba191370 admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:57.780833 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-29195a26-7a69-4d54-9838-1478ba191370 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001566 Sep 08 12:28:57.781200 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Sep 8 12:28:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:28:58.429179 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-b7efc019-0a1d-4e33-a892-3d102b534a37 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:58.436485 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.wsgi [None req-b7efc019-0a1d-4e33-a892-3d102b534a37 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-b7efc019-0a1d-4e33-a892-3d102b534a37 admin admin] Request method failure captured: Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: Accept: application/json Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: Accept-Encoding: gzip, deflate Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: Connection: keep-alive Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: Content-Length: 0 Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: Host: 10.222.0.78 Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: Openstack-Api-Version: compute 2.92 Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: Openstack-System-Scope: None Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: User-Agent: python-novaclient Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: X-Auth-Token: gAAAAABjGeAJikzvbQCPXQTl7CcGqFWeWtSQKdaeqgjjaBztrzG2f3NxUXN7nk3HHLkGKiQF9_5N4hQvJYRkNL9JgBMH4FVshZfToe_ZH8hBL-E4baLoeKAK_4CNvJZBSc07zjkD1K8VJl1w0Sstu8CEhgAksuPC33NH9XayiMHMNoOxOTuZBtM Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: X-Domain-Id: None Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: X-Domain-Name: None Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: X-Identity-Status: Confirmed Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: X-Is-Admin-Project: True Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: X-Project-Domain-Id: default Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: X-Project-Domain-Name: Default Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: X-Project-Id: 70689ac52c1a4e92be686f8f1bbef4c0 Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: X-Project-Name: admin Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: X-Role: member,admin,reader Sep 08 12:28:58.438157 n-d-852084-10 devstack@n-api.service[106624]: X-Roles: member,admin,reader Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: X-Tenant: admin Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: X-Tenant-Id: 70689ac52c1a4e92be686f8f1bbef4c0 Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: X-Tenant-Name: admin Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: X-User: admin Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: X-User-Domain-Id: default Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: X-User-Domain-Name: Default Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: X-User-Id: 9ceb1616373f4117a0704781378db565 Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: X-User-Name: admin Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: method: > Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: exception: Flavor 451 could not be found. Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: action_args: {'id': '451'} Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:28:58.440924 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:28:58.442744 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: ERROR nova.api.openstack.wsgi Sep 08 12:28:58.445934 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-b7efc019-0a1d-4e33-a892-3d102b534a37 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106624) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:28:58.447971 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-b7efc019-0a1d-4e33-a892-3d102b534a37 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.519788 Sep 08 12:28:58.447971 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Sep 8 12:28:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 521 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:28:58.453128 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-ebd63fe5-9852-4a9c-9990-d5012d3ae8a4 admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:58.469693 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-ebd63fe5-9852-4a9c-9990-d5012d3ae8a4 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020255 Sep 08 12:28:58.470279 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Thu Sep 8 12:28:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:28:58.480650 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:58.499778 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.021162 Sep 08 12:28:58.499778 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Thu Sep 8 12:28:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:28:58.512643 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-81ba7555-09c4-46df-b186-41460717edc7 admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:58.518096 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.wsgi [None req-81ba7555-09c4-46df-b186-41460717edc7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-81ba7555-09c4-46df-b186-41460717edc7 admin admin] Request method failure captured: Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: Accept: application/json Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: Accept-Encoding: gzip, deflate Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: Connection: keep-alive Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: Content-Length: 0 Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: Host: 10.222.0.78 Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: Openstack-Api-Version: compute 2.92 Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: Openstack-System-Scope: None Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: User-Agent: python-novaclient Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: X-Auth-Token: gAAAAABjGeAJikzvbQCPXQTl7CcGqFWeWtSQKdaeqgjjaBztrzG2f3NxUXN7nk3HHLkGKiQF9_5N4hQvJYRkNL9JgBMH4FVshZfToe_ZH8hBL-E4baLoeKAK_4CNvJZBSc07zjkD1K8VJl1w0Sstu8CEhgAksuPC33NH9XayiMHMNoOxOTuZBtM Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: X-Domain-Id: None Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: X-Domain-Name: None Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: X-Identity-Status: Confirmed Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: X-Is-Admin-Project: True Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: X-Openstack-Nova-Api-Version: 2.92 Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: X-Project-Domain-Id: default Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: X-Project-Domain-Name: Default Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: X-Project-Id: 70689ac52c1a4e92be686f8f1bbef4c0 Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: X-Project-Name: admin Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: X-Role: member,admin,reader Sep 08 12:28:58.519832 n-d-852084-10 devstack@n-api.service[106625]: X-Roles: member,admin,reader Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/70689ac52c1a4e92be686f8f1bbef4c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: X-Tenant: admin Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: X-Tenant-Id: 70689ac52c1a4e92be686f8f1bbef4c0 Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: X-Tenant-Name: admin Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: X-User: admin Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: X-User-Domain-Id: default Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: X-User-Domain-Name: Default Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: X-User-Id: 9ceb1616373f4117a0704781378db565 Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: X-User-Name: admin Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: method: > Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: exception: Flavor 451 could not be found. Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: action_args: {'id': '451'} Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:28:58.522139 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:28:58.523653 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: ERROR nova.api.openstack.wsgi Sep 08 12:28:58.524874 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-81ba7555-09c4-46df-b186-41460717edc7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106625) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:28:58.526356 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-81ba7555-09c4-46df-b186-41460717edc7 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.014871 Sep 08 12:28:58.526356 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Sep 8 12:28:58 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:28:59.887741 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:28:59.888806 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Sep 08 12:28:59.894098 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Sep 8 12:28:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:29:00.565367 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-780b76ec-98cf-4d45-9c2b-c5c7b808fc4c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:29:00.594153 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-780b76ec-98cf-4d45-9c2b-c5c7b808fc4c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.541652 Sep 08 12:29:00.594864 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Thu Sep 8 12:29:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 12:29:01.954907 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:29:01.956063 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001668 Sep 08 12:29:01.956526 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Sep 8 12:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:29:02.586748 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-fbc4d9be-6916-47f3-83af-f1483c8c6094 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:29:02.606652 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-fbc4d9be-6916-47f3-83af-f1483c8c6094 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.493808 Sep 08 12:29:02.607290 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Thu Sep 8 12:29:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:29:03.981457 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:29:03.982467 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 08 12:29:03.982876 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Sep 8 12:29:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:29:04.707520 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-9e93ca7a-2211-4ad8-888a-2810a2587aa6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:29:04.729881 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-9e93ca7a-2211-4ad8-888a-2810a2587aa6 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.591961 Sep 08 12:29:04.730445 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Thu Sep 8 12:29:04 2022] POST /compute/v2.1/flavors => generated 407 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:29:06.188135 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:29:06.190245 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003522 Sep 08 12:29:06.191087 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Sep 8 12:29:06 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:29:06.951003 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-cfbc55c1-9221-40d7-86cf-a682fc9c70fc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:29:06.975551 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-cfbc55c1-9221-40d7-86cf-a682fc9c70fc admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.634499 Sep 08 12:29:06.976290 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Thu Sep 8 12:29:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:29:08.353841 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:29:08.355558 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 Sep 08 12:29:08.356302 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Sep 8 12:29:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:29:09.093688 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-25d26135-cd3e-45c0-a97d-685a51b367e0 admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:29:09.116129 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-25d26135-cd3e-45c0-a97d-685a51b367e0 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.620398 Sep 08 12:29:09.116675 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Thu Sep 8 12:29:08 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:30:11.502247 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:30:11.503569 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-b0c5ced9-e3a9-4289-9d73-3c28cd3eac76 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001714 Sep 08 12:30:11.503978 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 931 bytes} [Thu Sep 8 12:30:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:30:11.512265 n-d-852084-10 devstack@n-api.service[106625]: DEBUG dbcounter [-] [106625] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:30:11.958713 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-5d12d392-9aa7-4d9c-b204-14cdd41b6790 admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:30:11.980379 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-5d12d392-9aa7-4d9c-b204-14cdd41b6790 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.469629 Sep 08 12:30:11.980928 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Sep 8 12:30:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:30:12.008225 n-d-852084-10 devstack@n-api.service[106624]: DEBUG dbcounter [-] [106624] Writing DB stats nova_api:SELECT=14 {{(pid=106624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:30:12.008225 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-fc9fa1fa-9c32-4de3-97f6-a77257998c9c admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:30:12.015319 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-fc9fa1fa-9c32-4de3-97f6-a77257998c9c admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013623 Sep 08 12:30:12.015895 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1283 bytes} [Thu Sep 8 12:30:12 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:30:12.028943 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-e55d0f18-807a-4c1c-a37e-80c9fe782d6a admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:30:12.038365 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-e55d0f18-807a-4c1c-a37e-80c9fe782d6a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012609 Sep 08 12:30:12.039101 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1286 bytes} [Thu Sep 8 12:30:12 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:30:12.051970 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-83c2e176-9ce6-46d9-bc9b-d943b01c86c5 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:30:12.061311 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-83c2e176-9ce6-46d9-bc9b-d943b01c86c5 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012725 Sep 08 12:30:12.062009 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1286 bytes} [Thu Sep 8 12:30:12 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:30:12.074816 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-bc5a1e3a-43ff-426f-9ad1-82184fb43601 admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:30:12.082722 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-bc5a1e3a-43ff-426f-9ad1-82184fb43601 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011742 Sep 08 12:30:12.083299 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1283 bytes} [Thu Sep 8 12:30:12 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:35:46.132064 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-83c2e176-9ce6-46d9-bc9b-d943b01c86c5 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:35:46.133099 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-83c2e176-9ce6-46d9-bc9b-d943b01c86c5 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Sep 08 12:35:46.133500 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Sep 8 12:35:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:35:46.275122 n-d-852084-10 devstack@n-api.service[106625]: DEBUG dbcounter [-] [106625] Writing DB stats nova_api:SELECT=6 {{(pid=106625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:35:46.426752 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-e4363083-5b0e-417f-a63e-e31713a8f7ca admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:35:46.431725 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-e4363083-5b0e-417f-a63e-e31713a8f7ca admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:35:46.432194 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-e4363083-5b0e-417f-a63e-e31713a8f7ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:35:46.432614 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-e4363083-5b0e-417f-a63e-e31713a8f7ca admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:35:46.433317 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-e4363083-5b0e-417f-a63e-e31713a8f7ca admin admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:35:46.433755 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-e4363083-5b0e-417f-a63e-e31713a8f7ca admin admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:35:46.434166 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-e4363083-5b0e-417f-a63e-e31713a8f7ca admin admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:35:46.478284 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-e4363083-5b0e-417f-a63e-e31713a8f7ca admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.203605 Sep 08 12:35:46.479063 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Sep 8 12:35:46 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:35:47.656669 n-d-852084-10 devstack@n-api.service[106624]: DEBUG nova.api.openstack.wsgi [None req-83c2e176-9ce6-46d9-bc9b-d943b01c86c5 admin admin] Calling method '>' {{(pid=106624) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:35:47.657692 n-d-852084-10 devstack@n-api.service[106624]: INFO nova.api.openstack.requestlog [None req-83c2e176-9ce6-46d9-bc9b-d943b01c86c5 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Sep 08 12:35:47.658091 n-d-852084-10 devstack@n-api.service[106624]: [pid: 106624|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Sep 8 12:35:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:35:47.909852 n-d-852084-10 devstack@n-api.service[106625]: DEBUG nova.api.openstack.wsgi [None req-f4c03dff-f0f6-4f9b-ae04-c78a9c9dbcce admin admin] Calling method '>' {{(pid=106625) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:35:47.914032 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-f4c03dff-f0f6-4f9b-ae04-c78a9c9dbcce admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:35:47.914512 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-f4c03dff-f0f6-4f9b-ae04-c78a9c9dbcce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:35:47.915648 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-f4c03dff-f0f6-4f9b-ae04-c78a9c9dbcce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:35:47.916266 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-f4c03dff-f0f6-4f9b-ae04-c78a9c9dbcce admin admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:35:47.916710 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-f4c03dff-f0f6-4f9b-ae04-c78a9c9dbcce admin admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:35:47.917126 n-d-852084-10 devstack@n-api.service[106625]: DEBUG oslo_concurrency.lockutils [None req-f4c03dff-f0f6-4f9b-ae04-c78a9c9dbcce admin admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106625) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:35:47.940528 n-d-852084-10 devstack@n-api.service[106625]: INFO nova.api.openstack.requestlog [None req-f4c03dff-f0f6-4f9b-ae04-c78a9c9dbcce admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.92 time: 0.104632 Sep 08 12:35:47.941112 n-d-852084-10 devstack@n-api.service[106625]: [pid: 106625|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Sep 8 12:35:47 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:36:33.405108 n-d-852084-10 devstack@n-api.service[106623]: Thu Sep 8 12:36:33 2022 - graceful shutdown triggered... Sep 08 12:36:33.405224 n-d-852084-10 systemd[1]: Stopping Devstack devstack@n-api.service... Sep 08 12:36:33.406702 n-d-852084-10 devstack@n-api.service[106624]: Gracefully killing worker 1 (pid: 106624)... Sep 08 12:36:33.407378 n-d-852084-10 devstack@n-api.service[106625]: Gracefully killing worker 2 (pid: 106625)... Sep 08 12:36:33.539770 n-d-852084-10 devstack@n-api.service[106624]: DEBUG dbcounter [-] [106624] Writing DB stats nova_api:SELECT=4 {{(pid=106624) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:36:34.407798 n-d-852084-10 devstack@n-api.service[106623]: worker 1 buried after 1 seconds Sep 08 12:36:34.407798 n-d-852084-10 devstack@n-api.service[106623]: worker 2 buried after 1 seconds Sep 08 12:36:34.407798 n-d-852084-10 devstack@n-api.service[106623]: goodbye to uWSGI. Sep 08 12:36:34.409700 n-d-852084-10 systemd[1]: devstack@n-api.service: Succeeded. Sep 08 12:36:34.410326 n-d-852084-10 systemd[1]: Stopped Devstack devstack@n-api.service. Sep 08 12:36:34.413352 n-d-852084-10 systemd[1]: Starting Devstack devstack@n-api.service... Sep 08 12:36:34.432646 n-d-852084-10 devstack@n-api.service[128955]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 8 12:36:34 2022] *** Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: nodename: n-d-852084-10 Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: machine: x86_64 Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: clock source: unix Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: pcre jit disabled Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: detected number of CPU cores: 4 Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: current working directory: / Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: detected binary path: /usr/bin/uwsgi-core Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: your processes number limit is 47680 Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: your memory page size is 4096 bytes Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: detected max file descriptor number: 2048 Sep 08 12:36:34.457744 n-d-852084-10 devstack@n-api.service[128955]: lock engine: pthread robust mutexes Sep 08 12:36:34.459670 n-d-852084-10 devstack@n-api.service[128955]: thunder lock: enabled Sep 08 12:36:34.459670 n-d-852084-10 devstack@n-api.service[128955]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 08 12:36:34.459670 n-d-852084-10 devstack@n-api.service[128955]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 08 12:36:34.498785 n-d-852084-10 devstack@n-api.service[128955]: Python main interpreter initialized at 0x560c70f1b9c0 Sep 08 12:36:34.498785 n-d-852084-10 devstack@n-api.service[128955]: python threads support enabled Sep 08 12:36:34.498785 n-d-852084-10 devstack@n-api.service[128955]: your server socket listen backlog is limited to 100 connections Sep 08 12:36:34.498785 n-d-852084-10 devstack@n-api.service[128955]: your mercy for graceful operations on workers is 90 seconds Sep 08 12:36:34.499287 n-d-852084-10 devstack@n-api.service[128955]: mapped 403077 bytes (393 KB) for 2 cores Sep 08 12:36:34.499287 n-d-852084-10 devstack@n-api.service[128955]: *** Operational MODE: preforking *** Sep 08 12:36:34.499581 n-d-852084-10 devstack@n-api.service[128955]: *** uWSGI is running in multiple interpreter mode *** Sep 08 12:36:34.499581 n-d-852084-10 devstack@n-api.service[128955]: spawned uWSGI master process (pid: 128955) Sep 08 12:36:34.499829 n-d-852084-10 systemd[1]: Started Devstack devstack@n-api.service. Sep 08 12:36:34.500433 n-d-852084-10 devstack@n-api.service[128955]: spawned uWSGI worker 1 (pid: 128970, cores: 1) Sep 08 12:36:34.500823 n-d-852084-10 devstack@n-api.service[128955]: spawned uWSGI worker 2 (pid: 128971, cores: 1) Sep 08 12:36:34.501024 n-d-852084-10 devstack@n-api.service[128955]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 08 12:36:35.198902 n-d-852084-10 devstack@n-api.service[128970]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 12:36:35.204265 n-d-852084-10 devstack@n-api.service[128971]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 08 12:36:36.429844 n-d-852084-10 devstack@n-api.service[128971]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 12:36:36.429844 n-d-852084-10 devstack@n-api.service[128971]: from cryptography.utils import int_from_bytes Sep 08 12:36:36.430933 n-d-852084-10 devstack@n-api.service[128971]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 12:36:36.430933 n-d-852084-10 devstack@n-api.service[128971]: from cryptography.utils import int_from_bytes Sep 08 12:36:36.467803 n-d-852084-10 devstack@n-api.service[128970]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 12:36:36.467803 n-d-852084-10 devstack@n-api.service[128970]: from cryptography.utils import int_from_bytes Sep 08 12:36:36.468801 n-d-852084-10 devstack@n-api.service[128970]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 08 12:36:36.468801 n-d-852084-10 devstack@n-api.service[128970]: from cryptography.utils import int_from_bytes Sep 08 12:36:38.982623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 12:36:38.983199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 12:36:38.983457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 12:36:38.983826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 12:36:38.984077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 12:36:38.984464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.984792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.985114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.985433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.985757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.986066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.986384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.986705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.987030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.987321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.987640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.987963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852084-10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.988297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.988609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.988916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.989230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.989535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.989854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.990170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.990668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.991089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.991438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.991749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.992086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.992403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.992716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.993034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.993346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.993668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.993992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.994383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852084-10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.994693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.995009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.995336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.995767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.996077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.996385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.996703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.997024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.997379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.997689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.998008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.998322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.998640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.998940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.999259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.999572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:38.999883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.000187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.000489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.000739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.001046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.001396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.001691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.002007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.002256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.002503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.002829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.003137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.003490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.003770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.004075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.004375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.004678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.004981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.005284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.005586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.005903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.006212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.006530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.006835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.007151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.007578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.007825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.008131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.008463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.008778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.009085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.009401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.009720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.010023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.010328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.010630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.010946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.011304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.011611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.011861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.012161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.012462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.012777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.013107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.013410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.013711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.014009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.023296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.023296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.023296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.023296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.023296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.023296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.023296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.023296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.024627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.025262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.025262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.025262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.025262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.025262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.025262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.025262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.025262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.026100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.026100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.026100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.026100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.026100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.026100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.026100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.026100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.026711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.026711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.026976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.027316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.027771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.027771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.029257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.029257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.029640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.029956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.030451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.030764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.031083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.031450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.031775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.032085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.032394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.032710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.033024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.033354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.033682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.034006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.034335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.034646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.034955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.035300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.035629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.035939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.036281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.036625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.036937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.037259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.037582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.037893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.038220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.038525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.038870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.039180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.039513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.039830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.040145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.040467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.040776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.041086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.041397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.041713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.042021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.042354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.042666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.042985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.043321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.043670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.043986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.044860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.045172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.045480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.045785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.046088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.046389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.046696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.047000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.047341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.047668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.048002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.048303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.048609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.048919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.049228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.049550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.049854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.050166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.050483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.050782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.051100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.051435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.051748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.052084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.052386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.052691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.053005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.053313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.053625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.053996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.054247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.054569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.054880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.055193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.055559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.055903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.056214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.056542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.056867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.057185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.057493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.057899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.058183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.058420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.058725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.059037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.059365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.059676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.060019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.060322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.060633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.060949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.061260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.061565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.061873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.062176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.062526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.062834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.063177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.063550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.063873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.064197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.064509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.064827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.065139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.065451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.065763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.066072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.066392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.066704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.067025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.067360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.067692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.068001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.068331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.068637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.068955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.069303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.069649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.069962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.070287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.070619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.070918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.071247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.071568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.071881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.072191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.072512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.072825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.073165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.073477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.073816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.074127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.074448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.074755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.075069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.075489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.075827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.076136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.076462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.076760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.077073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.077387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.077699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.078006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.078312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.078920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.078920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.079451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.079706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.079983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.080234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.080474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.080713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.081148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.081405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.081655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.081946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.082268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.082592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.082896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.083197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.083535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.083849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.084152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.084456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.084756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.085108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.085418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.085723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.086041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.086360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.086664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.086982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.087315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.087633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.087960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.088272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.088580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.089044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.089303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.089549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.089831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.090104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.090416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.090724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.091672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.091929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.092184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.092492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.093088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.093417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.093730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.094051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.094396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.094711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.095043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.095378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.095694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.096002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.096323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.096631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.096933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.097249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.097555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.097861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.098168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.098481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.098785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.099208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.099494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.099743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.100011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.100300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.100613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.100917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.101242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.101557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.101993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.102230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.102466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.102781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.103092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.103455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.103787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.104124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.104428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.104729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.105053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.105356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.105658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.105967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.106272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.107271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.107592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.107910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.108221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.108612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.108925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.109353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.113307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.113750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.114028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.114365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.114700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.116105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.116546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.116801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.117125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.117572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.117777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.118120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.118433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.118744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.119066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.119544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.119770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.120043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.120412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.120731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.121043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.121361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.121676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.121991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.122402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.122635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.122965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.123320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.123631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.123954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.124263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.124597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.124884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.125201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.125502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.125847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.126104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.126530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.126738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.127047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.127393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.127705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.128013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.128435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.128699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.129012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.129385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.130199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.130199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.130668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.130668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.131089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.131297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.131536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.131855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.132169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.132490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.132801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.133111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.133567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.133768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.134089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.134407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.134739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.135062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.135400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.135718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.136032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.136346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.136741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.136970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.137275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.137585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.137585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.137585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.137585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.137585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.137585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.137585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.137585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.147010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.147010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.147010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.147010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.147010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.147010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.147010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.147010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.148160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.148160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.148160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.148160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.148160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.150271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.150618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.150951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.151452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.151784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.152112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.152535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.152909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.153269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.154178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.154550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.154886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.155218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.155568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.155918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.156246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.156660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.157293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.157657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.157986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.158426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.158770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.159094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.159535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.159880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.160226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.160548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.160878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.161207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.161551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.161888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.162215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.162553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.162869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.163210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.163570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.163895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.164233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.164668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.165003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.165327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.165663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.166001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.166319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.166634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.166963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.167299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.167615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.167952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.168267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.168589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.168907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.169255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.169563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.169877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.170209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.170524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.170857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.171181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.171540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.171870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.172085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 08 12:36:39.172585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.172758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 08 12:36:39.172924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.172924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.173233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 08 12:36:39.173387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.173577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 08 12:36:39.173746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.173908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 08 12:36:39.174069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.174240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.174393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.174554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.174706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.174878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.175033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.175191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.175379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.175545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.175720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.175901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.176139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.176309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.176471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.176624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.176783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.176952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.177119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.177272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.177507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.177671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.177826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.177987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-852084-10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.178139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.178290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.178465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.178619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.178821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.178993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.179166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.179363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.179532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.179685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.179838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.179989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.180140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.180301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.180461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.180461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.180761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.180931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.180931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.181236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.181236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.181533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.181693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.181845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.181845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.182216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.182389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.182543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.182694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.182852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.183018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.183179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.183374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.183527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.183678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.183840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.184005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.184166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.184319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.184485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-852084-10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.184637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.184801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.184960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.185113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.185273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.185433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.185585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.185750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.185903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.186062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.186319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.186497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.186665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.186825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.186992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.187156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.187350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.187513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.187675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.187828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.187987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.188140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.188299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.188460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.188643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.188805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.188967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.189126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.189126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.189431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.189599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.189759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.189912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.190071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.190230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.190392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.190556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.190708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.190859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.191009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.191168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.191401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.191556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.191714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.191868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.192034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.192194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.192194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.192514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.192668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.192828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.193032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.193204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.193366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.193521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.193682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.193682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.193986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.194147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.194307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.194479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.194639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.194799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.194960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.195122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.195292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.195483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.195647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.195813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.195965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.196125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.196305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.196569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.196726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.196893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.197065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.197220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.197372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.197534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.197696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.197864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.198017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.198177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.198331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.198492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.198657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.198818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.198973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.199134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.199334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.199496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.199661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.199814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.199968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.200119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.200278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.200931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.201109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.201276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.201436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.201596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.201749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.201987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.201987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.202299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.202460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.202621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.202774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.202774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.203142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.203333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.203498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.203659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.203818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.203980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.204140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.204293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.204293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.204590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.204741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.204901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.205053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.205215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.205384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.205543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.205696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.205856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.206009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.206159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.206319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.206471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.206741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.206912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.207085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.207284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.207457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.207610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.207773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.207925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.208077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.208236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.208390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.208543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.208704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.208865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.209018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.209018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.209324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.209497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.209657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.209819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.209981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.210147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.210300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.210461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.210621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.210773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.210925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.211086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.211264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.211425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.211589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.211752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.211912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.212079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.212232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.212393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.212556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.212709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.212882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.213035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.213187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.213346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.213506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.213670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.213835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.213998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.214158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.214311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.214469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.214624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.214785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.214938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.215097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.215325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.215497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.215663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.215828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.216052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.216714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.216957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.217123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.217291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.217291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.217598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.217751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.217904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.218064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.218225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.218397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.218557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.218719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.218880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.219033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.219199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.219402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 08 12:36:39.219568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.219722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.219882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.220035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.220200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.220200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.220505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.220505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.220812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.220980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.221136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.221288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.221439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.221599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.221751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.221913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.222067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.222226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.222380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.222380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.222691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.222691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.222999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.223160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.223346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.223511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.223674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.223827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.223979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.224131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.224283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.224446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.224607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.224767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.224767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.225058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.225218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.225371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.225532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.225724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.225885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.226063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.226229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.226390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.226573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.226735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.226903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.227174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.227174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.227554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.227708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.227860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.228012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.228171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.228324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.228486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.228650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.228811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.228970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.229122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.229276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.229437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.229596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.229757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.229909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.230068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.230220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.230383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.230681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.230849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.231050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.231213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.231410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.231628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.231790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.231950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.232104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.232257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.232424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.232587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.232740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.232893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.233054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.233241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.233488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.233670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.233839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.233993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.234147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.234308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.234461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.234614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.234614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.234902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.234902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.235215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.235507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.235661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.235821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.235973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.236125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.236285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.236453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.236610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.236763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.236922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.237082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.237380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.237380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.237682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.237835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.237987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.238149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.238302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.238454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.238605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.238758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.238910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.239071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.239249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.239432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.239594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.239756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.239910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.240074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.240236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.240387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.240553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.240713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.240873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.241039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.241191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.241353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.241506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.241664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.241830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.241991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.242182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.242345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.242530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.242716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.242884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.243038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.243198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.243391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.243585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.243746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.243938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.244103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.244256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.244415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.244577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.244743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.244905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.245067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.245253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.245421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.245591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.245752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.245936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.245936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.246240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.246400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.246560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.246721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.246873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.247024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.247207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.247557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.247727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.247907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.248069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.248224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.248224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.248514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.248680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.248842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.249003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.249163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.249318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.249476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.249476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.249782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.249957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.250118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.250280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.250443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.250605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.250766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.250929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.251095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.251283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.251452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.251606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.251759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.251961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.252129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.252296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.252450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.252612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.252773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.252936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.253097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.253263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.253417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.253569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.253720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.253880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.254052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.254259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.254427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.254589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.254749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.254903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.255064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.255217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.255410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.255574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.255727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.255900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.256133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.256299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.256457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.256618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.256779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.256939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.257105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.257279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.257433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.257695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.257863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.258038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.258192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.258352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.258523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.258678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.258838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.258999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.259159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.259352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.259508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.259668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.283214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.283469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.283628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.283754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.283905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.284158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.284422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.284644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.284763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.284882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.285231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.285340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.285433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.285539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.285632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.285733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.285826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.285919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.286010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.286102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.286193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.286291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.286384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.286477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.286570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.286690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.286893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.287018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.287137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.287271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.287389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.287523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.287637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.287747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.287856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.287965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.288075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.288075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.288306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.288451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.288577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.288699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.288817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.288947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128971) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 12:36:39.289178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.289178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.289178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.289178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.289178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.289178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.289178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.289178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.290331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.290331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.290331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.290331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.290331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.290331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.290331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.290331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.291327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.291327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.291327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.291327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.291327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.291327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.291327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.291327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.292366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.292366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.292366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.292366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.292366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.292366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.292366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.292366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.293428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.293428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.293428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.293428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.293428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.293428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.293428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.293428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.294655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.294655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.294655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.294655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.294655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.294655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.294655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.294655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.296992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.297840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.297840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.299644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.300174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.300674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.301965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.302486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.302907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.303310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.303683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.304104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.304475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.304832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.305206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.305565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.305957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.306434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.306834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.307488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.308052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.308480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.308849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.309196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.309712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.310215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.310580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.311120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.311561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.311925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.312248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.312646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.312910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.313233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.313552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.313898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.314193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.314514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.314881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.315275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.315503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.315840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.316153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.316471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.316794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.317105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.317435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.317756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.318071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.318386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.318708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.319033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.319376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.319699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.320012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.320340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.320654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.320968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.321282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.321604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.321930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.322236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.322586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.322913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.323267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.323572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.323894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.324209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.324522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.324842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.325179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.326397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.326397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.326845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.327122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.327572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.327893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.328215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.328635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.328971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.329363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.329681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.329998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.330339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.330663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.330982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.331368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.331604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.331979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.332364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.332655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.332972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.333296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.333627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.333951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.334269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.334596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.334912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.335250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.335587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.335911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.336223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.336538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.336880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.337202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.337522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.337856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.338186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.338519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.338831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.339154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.339495 n-d-852084-10 devstack@n-api.service[128971]: INFO dbcounter [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Registered counter for database nova_api Sep 08 12:36:39.339580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.339814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.340135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.340454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.340775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.341663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.341980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.342303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.342619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.342939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.343279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.343603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.343924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.344269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.344589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.344913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.345232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.345546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.345868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.346182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.346655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.347012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.347302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.347593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.347917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.348236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.348562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.348887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.349202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.349635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.349956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.350276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.350599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.350915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.351258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.351570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.352014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.352237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.352551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.352838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.353280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.353483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.353985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.356815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.356815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.356815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.356815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.356815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.356815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.356815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.356815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.357598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.357598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.357807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.357973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.358490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.358914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.359270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.359604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.359939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.360256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.360595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.360920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.361252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.361690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.362036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.362355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.362696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.363021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.363363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.363685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.364006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.364331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.364647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.364980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.365429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.365704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_db.sqlalchemy.engines [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:36:39.365939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.365939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.366402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.366614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.366826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.367121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.367459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.367785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.368106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.368438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.368773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.369090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.369426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.369743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.370169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.370521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.370930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.371313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.371635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.371970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.372352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.372689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.373011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.373353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.373647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writer thread running {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:36:39.373732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.374029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.374349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.374680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.375013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.375351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.375664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.375986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.376301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.376614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.377043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.377241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.377540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.377851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.378304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.378649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.379067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.379439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.379765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.380081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.380399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.380713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.381070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.381456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.381721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.382176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.382529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.382858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.383248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.383541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.384040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.384239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.384638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.384812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.385109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.385436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.385762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.386089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.386930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.387151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.387557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.388459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.388791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.389120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.389714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.390040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.390364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.390688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.391014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.391383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.391718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.392058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.392615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.392785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.393050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.393408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.393694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.394188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.394384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.394701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.395027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.395381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.395716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.396052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.396356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.396681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.397134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.397338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.397677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.397957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.398278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.398615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.398962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.399315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.399638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.399968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.400292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.401061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.401327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.401675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.402200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.402589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.403377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.404531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.404886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.405464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.405564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.405921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.406260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.406579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.406917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.407253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.407587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.407971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.408228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.408865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.409229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.409556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.409896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.410229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.410552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.410868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.411200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.411555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.411870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.412196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.412521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.412910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.413157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.413483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.413798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.414111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.414437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.414745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.415081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.415430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.415749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.416064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.416387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.416704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.417027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.417346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.417656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.417985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.418295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.418609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.418923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.419316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.419684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.420005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.420321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.420658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.420971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.421286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.421623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.421939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.422272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.422594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.422917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.423295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.423632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.424222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.424567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.424877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.425233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.425579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.426647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.426647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.426647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.427044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.427173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.427566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.427799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.428121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.428437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.428749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.429153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.429449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.429703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.430023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.430339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.430659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.431054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.431403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.431737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.432087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.432417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.432747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.433085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.433396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.433724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.434049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.434368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.434713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.435042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.435409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.435736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.436052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.436392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.context [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) {{(pid=128971) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 12:36:39.436518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.436806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.437194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.437816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.437816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.438097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.438431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.438791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.439417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.439417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.439774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.440096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.440434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.440770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.441083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.441202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:36:39.441397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.441598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:36:39.441771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.442015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.442343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.442668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.442981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.443538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:36:39.443895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.443895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.444201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.444375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:36:39.444550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.444696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:36:39.444968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.444968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.445304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.445454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.445725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.446035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.446346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.446545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:36:39.446687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.446952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.447287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.447600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.447910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.448218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.448528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.448678 n-d-852084-10 devstack@n-api.service[128971]: INFO dbcounter [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Registered counter for database nova_cell0 Sep 08 12:36:39.448821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.449168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.449510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.449827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.450155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.450998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.451428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.452324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.452324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.452643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.452773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.453033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.453383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.453707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.454092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.454353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.454676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.454853 n-d-852084-10 devstack@n-api.service[128971]: INFO dbcounter [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Registered counter for database nova_cell1 Sep 08 12:36:39.455114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.455328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.455672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.456008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.456323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.456658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.457236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.457388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.457707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.458135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.458370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.458672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.458997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.459414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.459725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.460042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.460372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.460689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.461007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.461333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.461659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.462027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.462334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.462655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.462848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_db.sqlalchemy.engines [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:36:39.463133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.463340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.463703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.464027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.464381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.464718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.465041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.465303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_db.sqlalchemy.engines [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:36:39.465445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.465660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 08 12:36:39.465910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128970) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 08 12:36:39.473552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writer thread running {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:36:39.475150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writer thread running {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:36:39.541770 n-d-852084-10 devstack@n-api.service[128970]: INFO dbcounter [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Registered counter for database nova_api Sep 08 12:36:39.563658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_db.sqlalchemy.engines [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:36:39.571367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writer thread running {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:36:39.632251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.context [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) {{(pid=128970) load_cells /opt/stack/nova/nova/context.py:464}} Sep 08 12:36:39.636101 n-d-852084-10 devstack@n-api.service[128971]: INFO dbcounter [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Registered counter for database nova_cell0 Sep 08 12:36:39.637182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:36:39.637680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:36:39.643590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:36:39.643590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:36:39.643590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:36:39.644279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:36:39.644565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_db.sqlalchemy.engines [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128971) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:36:39.646372 n-d-852084-10 devstack@n-api.service[128970]: INFO dbcounter [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Registered counter for database nova_cell0 Sep 08 12:36:39.649746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writer thread running {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:36:39.652218 n-d-852084-10 devstack@n-api.service[128970]: INFO dbcounter [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Registered counter for database nova_cell1 Sep 08 12:36:39.659989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_db.sqlalchemy.engines [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:36:39.665819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writer thread running {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:36:39.670394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_db.sqlalchemy.engines [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:36:39.823041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writer thread running {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:36:39.833374 n-d-852084-10 devstack@n-api.service[128970]: INFO dbcounter [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Registered counter for database nova_cell0 Sep 08 12:36:39.841010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_db.sqlalchemy.engines [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128970) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 08 12:36:39.846886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writer thread running {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 08 12:36:39.984114 n-d-852084-10 devstack@n-api.service[128971]: WARNING keystonemiddleware.auth_token [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 12:36:39.991760 n-d-852084-10 devstack@n-api.service[128971]: WARNING keystonemiddleware.auth_token [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 12:36:40.186950 n-d-852084-10 devstack@n-api.service[128970]: WARNING keystonemiddleware.auth_token [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 12:36:40.195414 n-d-852084-10 devstack@n-api.service[128970]: WARNING keystonemiddleware.auth_token [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 12:36:40.340614 n-d-852084-10 devstack@n-api.service[128971]: WARNING keystonemiddleware.auth_token [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 12:36:40.347595 n-d-852084-10 devstack@n-api.service[128971]: WARNING keystonemiddleware.auth_token [None req-89750f7a-414a-4557-ab6e-c4ad6284783a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 12:36:40.353326 n-d-852084-10 devstack@n-api.service[128971]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560c70f1b9c0 pid: 128971 (default app) Sep 08 12:36:40.544012 n-d-852084-10 devstack@n-api.service[128970]: WARNING keystonemiddleware.auth_token [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 08 12:36:40.550856 n-d-852084-10 devstack@n-api.service[128970]: WARNING keystonemiddleware.auth_token [None req-07729919-8cda-4526-b2c7-188b05718ad1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 08 12:36:40.556091 n-d-852084-10 devstack@n-api.service[128970]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560c70f1b9c0 pid: 128970 (default app) Sep 08 12:37:20.898814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:20.899763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:20.900690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:20.901492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:22.510766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9f78be49-99eb-466c-9050-9d7ab1723639 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '.version_select at 0x7fdb3c9d5b80>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:22.518844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9f78be49-99eb-466c-9050-9d7ab1723639 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) {{(pid=128971) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 08 12:37:22.519985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f78be49-99eb-466c-9050-9d7ab1723639 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:22.520661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f78be49-99eb-466c-9050-9d7ab1723639 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:22.521288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f78be49-99eb-466c-9050-9d7ab1723639 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:22.553641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f78be49-99eb-466c-9050-9d7ab1723639 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:22.554480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f78be49-99eb-466c-9050-9d7ab1723639 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:22.555115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f78be49-99eb-466c-9050-9d7ab1723639 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:22.570155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f78be49-99eb-466c-9050-9d7ab1723639 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:22.571062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f78be49-99eb-466c-9050-9d7ab1723639 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:22.571736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f78be49-99eb-466c-9050-9d7ab1723639 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:22.580656 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9f78be49-99eb-466c-9050-9d7ab1723639 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 1.691550 Sep 08 12:37:22.582084 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1/1] 10.222.0.78 () {58 vars in 1167 bytes} [Thu Sep 8 12:37:20 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 1694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:22.608045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:22.609734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:22.610491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:22.614235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:22.884470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d99fd011-68ef-41d8-90a2-fad2003c75cd tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-159101892", "name": "tempest-test_aggregate-222116165"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:22.923037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.aggregate [None req-d99fd011-68ef-41d8-90a2-fad2003c75cd tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Generated uuid e58cafbe-052e-47e0-a24b-5a3a1572ab24 for aggregate {{(pid=128970) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:37:23.061015 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d99fd011-68ef-41d8-90a2-fad2003c75cd tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.459804 Sep 08 12:37:23.061973 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1/2] 10.222.0.78 () {60 vars in 1165 bytes} [Thu Sep 8 12:37:22 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:23.073005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-65aa86c9-a202-4d84-b32a-6e1ee0c0aef6 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:23.101329 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-65aa86c9-a202-4d84-b32a-6e1ee0c0aef6 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 300 microversion: 2.1 time: 0.031986 Sep 08 12:37:23.102401 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2/3] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 12:37:23 2022] GET /compute/v2.1/os-aggregates => generated 300 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:23.115145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6b5b4c0b-3946-4924-92fc-d2c7f3a12a67 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-10"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:23.165005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b5b4c0b-3946-4924-92fc-d2c7f3a12a67 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:23.166203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b5b4c0b-3946-4924-92fc-d2c7f3a12a67 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:23.168363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b5b4c0b-3946-4924-92fc-d2c7f3a12a67 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:23.905518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-07c18e01-9847-4050-8f74-0f295e7663df tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Calling method '.version_select at 0x7fdb3c87bc10>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:23.913592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c18e01-9847-4050-8f74-0f295e7663df tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:23.917463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c18e01-9847-4050-8f74-0f295e7663df tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:23.918127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c18e01-9847-4050-8f74-0f295e7663df tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:23.969011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c18e01-9847-4050-8f74-0f295e7663df tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:23.970079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c18e01-9847-4050-8f74-0f295e7663df tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:23.970715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c18e01-9847-4050-8f74-0f295e7663df tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:23.998851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c18e01-9847-4050-8f74-0f295e7663df tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:24.000571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c18e01-9847-4050-8f74-0f295e7663df tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:24.001973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c18e01-9847-4050-8f74-0f295e7663df tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:24.015780 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-07c18e01-9847-4050-8f74-0f295e7663df tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 0.626668 Sep 08 12:37:24.017343 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3/4] 10.222.0.78 () {60 vars in 1208 bytes} [Thu Sep 8 12:37:23 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:37:24.722964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e073682d-2fda-4967-9069-96c18e7c65ee tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Calling method '.version_select at 0x7fdb3c819dc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:24.744460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e073682d-2fda-4967-9069-96c18e7c65ee tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:24.744987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e073682d-2fda-4967-9069-96c18e7c65ee tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:24.745506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e073682d-2fda-4967-9069-96c18e7c65ee tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:24.747238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e073682d-2fda-4967-9069-96c18e7c65ee tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:24.748703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e073682d-2fda-4967-9069-96c18e7c65ee tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:24.752592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e073682d-2fda-4967-9069-96c18e7c65ee tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:24.795976 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6b5b4c0b-3946-4924-92fc-d2c7f3a12a67 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.1 time: 1.685591 Sep 08 12:37:24.810077 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2/5] 10.222.0.78 () {60 vars in 1191 bytes} [Thu Sep 8 12:37:23 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:24.870297 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e073682d-2fda-4967-9069-96c18e7c65ee tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 402 microversion: 2.1 time: 0.814066 Sep 08 12:37:24.873898 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 4/6] 10.222.0.78 () {58 vars in 1128 bytes} [Thu Sep 8 12:37:24 2022] GET /compute/v2.1/os-hosts => generated 402 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:24.888176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-58568984-4f3e-41c7-9130-886de5c8c301 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Calling method '.version_select at 0x7fdb37f4f9d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:24.892764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58568984-4f3e-41c7-9130-886de5c8c301 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:24.894456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58568984-4f3e-41c7-9130-886de5c8c301 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:24.896567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58568984-4f3e-41c7-9130-886de5c8c301 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:24.898320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58568984-4f3e-41c7-9130-886de5c8c301 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:24.899182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58568984-4f3e-41c7-9130-886de5c8c301 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:24.901232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58568984-4f3e-41c7-9130-886de5c8c301 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:24.971936 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-58568984-4f3e-41c7-9130-886de5c8c301 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 402 microversion: 2.1 time: 0.084171 Sep 08 12:37:24.973333 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3/7] 10.222.0.78 () {58 vars in 1139 bytes} [Thu Sep 8 12:37:24 2022] GET /compute/v2.1/os-hosts?zone= => generated 402 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:24.983985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5df72b00-35de-4afe-b6b4-abeb4dd81a77 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Calling method '.version_select at 0x7fdb3c847f70>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:24.987683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5df72b00-35de-4afe-b6b4-abeb4dd81a77 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:24.988248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5df72b00-35de-4afe-b6b4-abeb4dd81a77 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:24.988597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5df72b00-35de-4afe-b6b4-abeb4dd81a77 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:24.989333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5df72b00-35de-4afe-b6b4-abeb4dd81a77 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:24.989783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5df72b00-35de-4afe-b6b4-abeb4dd81a77 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:24.990205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5df72b00-35de-4afe-b6b4-abeb4dd81a77 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:25.097118 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5df72b00-35de-4afe-b6b4-abeb4dd81a77 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.113735 Sep 08 12:37:25.098769 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 5/8] 10.222.0.78 () {58 vars in 1145 bytes} [Thu Sep 8 12:37:24 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:37:25.970922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ba42dfb9-4b23-438b-8267-19346c9a1e1b tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:25.987581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba42dfb9-4b23-438b-8267-19346c9a1e1b tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:25.988894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba42dfb9-4b23-438b-8267-19346c9a1e1b tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:25.990171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba42dfb9-4b23-438b-8267-19346c9a1e1b tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:25.991672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba42dfb9-4b23-438b-8267-19346c9a1e1b tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:25.993781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba42dfb9-4b23-438b-8267-19346c9a1e1b tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:25.998207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-682406992", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "availability_zone": "tempest-test_az-159101892"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:25.999424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba42dfb9-4b23-438b-8267-19346c9a1e1b tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:26.070036 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ba42dfb9-4b23-438b-8267-19346c9a1e1b tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 403 microversion: 2.1 time: 1.048800 Sep 08 12:37:26.092191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:26.092666 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 4/9] 10.222.0.78 () {58 vars in 1176 bytes} [Thu Sep 8 12:37:25 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 403 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:26.092791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:26.093104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:26.093840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:26.094290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:26.094707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:26.553528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ea970ab3-e858-4d07-9155-b99b092b9866 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1180533780", "id": 182747877, "os-flavor-access:is_public": "False"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:26.660550 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ea970ab3-e858-4d07-9155-b99b092b9866 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.441334 Sep 08 12:37:26.662291 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 5/10] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:37:26 2022] POST /compute/v2.1/flavors => generated 436 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:26.678546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-17dcd036-4c4f-4788-9d0c-7a83d064dc91 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2b54bb4065a044779b278f816f07a399"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:26.981554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:37:27.369341 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-17dcd036-4c4f-4788-9d0c-7a83d064dc91 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/182747877/action" status: 200 len: 96 microversion: 2.1 time: 0.685443 Sep 08 12:37:27.371720 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 6/11] 10.222.0.78 () {60 vars in 1197 bytes} [Thu Sep 8 12:37:26 2022] POST /compute/v2.1/flavors/182747877/action => generated 96 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:37:27.393055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-827dc234-263b-401e-a7d4-26400a1eb0c0 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2b54bb4065a044779b278f816f07a399"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:27.702161 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-827dc234-263b-401e-a7d4-26400a1eb0c0 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] HTTP exception thrown: Flavor access already exists for flavor 15 and project 2b54bb4065a044779b278f816f07a399 combination. Sep 08 12:37:27.729226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:37:27.729737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:37:27.730114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:37:27.730519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:37:27.730937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-827dc234-263b-401e-a7d4-26400a1eb0c0 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Request method failure captured: Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/flavors/182747877/action HTTP/1.1 Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 67 Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIELu-8aq7_mqPuaByfwVdkcqZeC137RP1KPOxJbQYDT_W6ymLlcW0A8cpSVjljlQR7DmakWEOaA1J3UIwwOEdQClJMmqUSNi5gGeOT1adbyMSGlcibdYhg5WCo_g7RZdB7XTg3MiTw6vvBNXfQaxQnach0w_oaCYY_AOJ_L0s6Bk4 Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a39c331e1bbe442ba11776e4ab96caac Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1561618955 Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:37:27.743828 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:37:27.745261 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a39c331e1bbe442ba11776e4ab96caac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a39c331e1bbe442ba11776e4ab96caac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a39c331e1bbe442ba11776e4ab96caac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a39c331e1bbe442ba11776e4ab96caac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:27.745261 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1561618955 Sep 08 12:37:27.745261 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a39c331e1bbe442ba11776e4ab96caac Sep 08 12:37:27.745261 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1561618955 Sep 08 12:37:27.745261 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin Sep 08 12:37:27.745261 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:37:27.745261 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:37:27.745261 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: f217374fc4ee4709ab5865c3254b6d4c Sep 08 12:37:27.745261 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin Sep 08 12:37:27.745261 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:37:27.745261 n-d-852084-10 devstack@n-api.service[128970]: {"addTenantAccess": {"tenant": "2b54bb4065a044779b278f816f07a399"}} Sep 08 12:37:27.745261 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: exception: Flavor access already exists for flavor 15 and project 2b54bb4065a044779b278f816f07a399 combination. Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '182747877', 'body': {'addTenantAccess': {'tenant': '2b54bb4065a044779b278f816f07a399'}}} Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result.read() Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 12:37:27.745879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '15-2b54bb4065a044779b278f816f07a399' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi project.save(context.session) Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi session.flush() Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 12:37:27.746811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 12:37:27.748315 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 12:37:27.749232 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result.read() Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '15-2b54bb4065a044779b278f816f07a399' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 8, 12, 37, 27, 689821), 'updated_at': None, 'flavor_id': 15, 'project_id': '2b54bb4065a044779b278f816f07a399'}] Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:27.750099 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 15 and project 2b54bb4065a044779b278f816f07a399 combination. Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:27.752681 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 15 and project 2b54bb4065a044779b278f816f07a399 combination. Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:37:27.755486 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:37:27.759732 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 15 and project 2b54bb4065a044779b278f816f07a399 combination. Sep 08 12:37:27.759732 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:27.759732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-827dc234-263b-401e-a7d4-26400a1eb0c0 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Returning 409 to user: Flavor access already exists for flavor 15 and project 2b54bb4065a044779b278f816f07a399 combination. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:27.759732 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-827dc234-263b-401e-a7d4-26400a1eb0c0 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/182747877/action" status: 409 len: 152 microversion: 2.1 time: 0.370418 Sep 08 12:37:27.759732 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 7/12] 10.222.0.78 () {60 vars in 1197 bytes} [Thu Sep 8 12:37:27 2022] POST /compute/v2.1/flavors/182747877/action => generated 152 bytes in 376 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:37:27.762579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:27.763015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:27.763484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:27.764242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:27.767456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60f62cdf-b391-4ce7-ae9e-36d4dfc07b6b tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2b54bb4065a044779b278f816f07a399"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:27.775657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:27.776219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:27.818882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Getting quotas for project e7f5e5869f2c493d92f38d20f8291c21. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:37:27.828224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Getting quotas for user 1e50364fb741400ea5db073dce8e39ca and project e7f5e5869f2c493d92f38d20f8291c21. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:37:27.854767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:37:27.858282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:37:27.980386 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-41f076fa-e263-4b90-bbe6-a801312b4120 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.754546 Sep 08 12:37:27.981050 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 6/13] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:37:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 2756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 12:37:27.994575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ded4ea36-0877-4254-8ff3-487f91964796 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:27.995485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ded4ea36-0877-4254-8ff3-487f91964796 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:28.152584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ded4ea36-0877-4254-8ff3-487f91964796 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:28.175620 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ded4ea36-0877-4254-8ff3-487f91964796 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1241 microversion: 2.1 time: 0.186757 Sep 08 12:37:28.176696 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 7/14] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:27 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1241 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:37:28.360664 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-60f62cdf-b391-4ce7-ae9e-36d4dfc07b6b tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/182747877/action" status: 200 len: 21 microversion: 2.1 time: 0.605099 Sep 08 12:37:28.361904 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 8/15] 10.222.0.78 () {60 vars in 1197 bytes} [Thu Sep 8 12:37:27 2022] POST /compute/v2.1/flavors/182747877/action => generated 21 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:37:28.373460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-55927ef6-dcb0-4b43-adcb-6d92b6e7ae63 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:28.449244 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-55927ef6-dcb0-4b43-adcb-6d92b6e7ae63 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/182747877" status: 202 len: 0 microversion: 2.1 time: 0.080618 Sep 08 12:37:28.450848 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 8/16] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:37:28 2022] DELETE /compute/v2.1/flavors/182747877 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:37:28.458393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-af4061eb-59cb-4588-94c6-d6cb60ab9d56 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:28.558141 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-af4061eb-59cb-4588-94c6-d6cb60ab9d56 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.103274 Sep 08 12:37:28.559945 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 9/17] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:37:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:28.580434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5f331045-de57-44ba-b4a3-0ed731fca026 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-946943091", "id": 1006586559, "os-flavor-access:is_public": "True"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:28.657338 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5f331045-de57-44ba-b4a3-0ed731fca026 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.080850 Sep 08 12:37:28.661115 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 9/18] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:37:28 2022] POST /compute/v2.1/flavors => generated 437 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:28.674270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-19a5c87b-9fd6-4a26-b514-7dbda420a8a7 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:28.696058 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-19a5c87b-9fd6-4a26-b514-7dbda420a8a7 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] HTTP exception thrown: Access list not available for public flavors. Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-19a5c87b-9fd6-4a26-b514-7dbda420a8a7 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Request method failure captured: Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/flavors/1006586559/os-flavor-access HTTP/1.1 Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIELu-8aq7_mqPuaByfwVdkcqZeC137RP1KPOxJbQYDT_W6ymLlcW0A8cpSVjljlQR7DmakWEOaA1J3UIwwOEdQClJMmqUSNi5gGeOT1adbyMSGlcibdYhg5WCo_g7RZdB7XTg3MiTw6vvBNXfQaxQnach0w_oaCYY_AOJ_L0s6Bk4 Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a39c331e1bbe442ba11776e4ab96caac Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1561618955 Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:37:28.702283 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:37:28.703639 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a39c331e1bbe442ba11776e4ab96caac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a39c331e1bbe442ba11776e4ab96caac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a39c331e1bbe442ba11776e4ab96caac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a39c331e1bbe442ba11776e4ab96caac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:28.703639 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1561618955 Sep 08 12:37:28.703639 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a39c331e1bbe442ba11776e4ab96caac Sep 08 12:37:28.703639 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1561618955 Sep 08 12:37:28.703639 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin Sep 08 12:37:28.703639 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:37:28.703639 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:37:28.703639 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: f217374fc4ee4709ab5865c3254b6d4c Sep 08 12:37:28.703639 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin Sep 08 12:37:28.703639 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:37:28.703639 n-d-852084-10 devstack@n-api.service[128970]: exception: Access list not available for public flavors. Sep 08 12:37:28.703639 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'flavor_id': '1006586559'} Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Sep 08 12:37:28.704404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:28.706853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-19a5c87b-9fd6-4a26-b514-7dbda420a8a7 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:28.708837 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-19a5c87b-9fd6-4a26-b514-7dbda420a8a7 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/1006586559/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.038874 Sep 08 12:37:28.710120 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 10/19] 10.222.0.78 () {58 vars in 1209 bytes} [Thu Sep 8 12:37:28 2022] GET /compute/v2.1/flavors/1006586559/os-flavor-access => generated 91 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:37:28.726289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cdf9fc12-dfd0-45ca-87ab-58f490a0de70 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:28.757706 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cdf9fc12-dfd0-45ca-87ab-58f490a0de70 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1006586559" status: 202 len: 0 microversion: 2.1 time: 0.037565 Sep 08 12:37:28.761669 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 11/20] 10.222.0.78 () {58 vars in 1161 bytes} [Thu Sep 8 12:37:28 2022] DELETE /compute/v2.1/flavors/1006586559 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 12:37:28.767291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9618fb21-c8a6-4ddf-b9cf-f3e0768f00aa tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:28.827374 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9618fb21-c8a6-4ddf-b9cf-f3e0768f00aa tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062282 Sep 08 12:37:28.830019 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 12/21] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:37:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:28.853032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5d269b73-d8c2-4425-84ae-6abea23409f5 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-652877450", "id": 333844621, "os-flavor-access:is_public": "False"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:28.925722 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5d269b73-d8c2-4425-84ae-6abea23409f5 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.077252 Sep 08 12:37:28.929054 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 13/22] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:37:28 2022] POST /compute/v2.1/flavors => generated 435 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 08 12:37:28.963720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a2e723bc-c720-448a-9400-0ee2d44de6bb tempest-FlavorMetadataValidation-390798310 tempest-FlavorMetadataValidation-390798310-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-629758667", "id": 1973904275, "os-flavor-access:is_public": "True"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:29.012285 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a2e723bc-c720-448a-9400-0ee2d44de6bb tempest-FlavorMetadataValidation-390798310 tempest-FlavorMetadataValidation-390798310-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.318158 Sep 08 12:37:29.030586 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 10/23] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 12:37:28 2022] POST /compute/v2.1/flavors => generated 470 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:37:29.055175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-57123318-4817-4f74-a02b-621af9f843ad tempest-FlavorMetadataValidation-390798310 tempest-FlavorMetadataValidation-390798310-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:29.187775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae538454-5640-4a1a-8c22-4131abaab66e tempest-FlavorsAccessNegativeTestJSON-1905015800 tempest-FlavorsAccessNegativeTestJSON-1905015800-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2b54bb4065a044779b278f816f07a399"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:29.195804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ae538454-5640-4a1a-8c22-4131abaab66e tempest-FlavorsAccessNegativeTestJSON-1905015800 tempest-FlavorsAccessNegativeTestJSON-1905015800-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'eaa7cb9c544346f3bf18d1713f61fef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b54bb4065a044779b278f816f07a399', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae538454-5640-4a1a-8c22-4131abaab66e tempest-FlavorsAccessNegativeTestJSON-1905015800 tempest-FlavorsAccessNegativeTestJSON-1905015800-project] Request method failure captured: Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/flavors/333844621/action HTTP/1.1 Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 67 Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIBYe6tcmdu7Yw2ME2j4m4gv11vCaKe6E-1-U3L6mF7n4KXU18CP15JjrEald1MPmWtjbehybFFDOTmiXP5Qw09h21cl51hx0TophbVVBdoM4o3rT5bpwGOZ5XmGsSpNqzrWpWmG4m85Jhttr-CRYRKh2yVWmlY9b4KLd0yPEyz2wI Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 2b54bb4065a044779b278f816f07a399 Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1905015800 Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:37:29.210863 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:37:29.212158 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b54bb4065a044779b278f816f07a399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b54bb4065a044779b278f816f07a399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b54bb4065a044779b278f816f07a399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b54bb4065a044779b278f816f07a399"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:29.212158 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1905015800 Sep 08 12:37:29.212158 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 2b54bb4065a044779b278f816f07a399 Sep 08 12:37:29.212158 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1905015800 Sep 08 12:37:29.212158 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-FlavorsAccessNegativeTestJSON-1905015800-project Sep 08 12:37:29.212158 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:37:29.212158 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:37:29.212158 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: eaa7cb9c544346f3bf18d1713f61fef4 Sep 08 12:37:29.212158 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1905015800-project Sep 08 12:37:29.212158 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:37:29.212158 n-d-852084-10 devstack@n-api.service[128970]: {"addTenantAccess": {"tenant": "2b54bb4065a044779b278f816f07a399"}} Sep 08 12:37:29.212158 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '333844621', 'body': {'addTenantAccess': {'tenant': '2b54bb4065a044779b278f816f07a399'}}} Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:37:29.213058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Sep 08 12:37:29.214179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:29.217134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae538454-5640-4a1a-8c22-4131abaab66e tempest-FlavorsAccessNegativeTestJSON-1905015800 tempest-FlavorsAccessNegativeTestJSON-1905015800-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:29.218302 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ae538454-5640-4a1a-8c22-4131abaab66e tempest-FlavorsAccessNegativeTestJSON-1905015800 tempest-FlavorsAccessNegativeTestJSON-1905015800-project] 10.222.0.78 "POST /compute/v2.1/flavors/333844621/action" status: 403 len: 130 microversion: 2.1 time: 0.279683 Sep 08 12:37:29.220741 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 14/24] 10.222.0.78 () {60 vars in 1197 bytes} [Thu Sep 8 12:37:28 2022] POST /compute/v2.1/flavors/333844621/action => generated 130 bytes in 283 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 12:37:29.226274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-852f4212-cc7c-45ef-9213-1f8721df3361 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:29.244146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-852f4212-cc7c-45ef-9213-1f8721df3361 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:29.414745 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-57123318-4817-4f74-a02b-621af9f843ad tempest-FlavorMetadataValidation-390798310 tempest-FlavorMetadataValidation-390798310-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1973904275/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.369879 Sep 08 12:37:29.421539 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 11/25] 10.222.0.78 () {62 vars in 1265 bytes} [Thu Sep 8 12:37:29 2022] POST /compute/v2.1/flavors/1973904275/os-extra_specs => generated 62 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:29.430366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f09c7c01-d804-4c39-a9ec-0c1cede79d16 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:29.453633 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f09c7c01-d804-4c39-a9ec-0c1cede79d16 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/333844621" status: 202 len: 0 microversion: 2.1 time: 0.029063 Sep 08 12:37:29.459110 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 12/26] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:37:29 2022] DELETE /compute/v2.1/flavors/333844621 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:37:29.464648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-057360ac-cbcc-48c5-ae2c-0bdd754d8231 tempest-FlavorMetadataValidation-390798310 tempest-FlavorMetadataValidation-390798310-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:29.487322 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-057360ac-cbcc-48c5-ae2c-0bdd754d8231 tempest-FlavorMetadataValidation-390798310 tempest-FlavorMetadataValidation-390798310-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1973904275" status: 202 len: 0 microversion: 2.86 time: 0.026267 Sep 08 12:37:29.488294 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 13/27] 10.222.0.78 () {60 vars in 1202 bytes} [Thu Sep 8 12:37:29 2022] DELETE /compute/v2.1/flavors/1973904275 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:37:29.502782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-99f44be3-d70c-4d88-8864-392b10c39dc5 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:29.552251 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-99f44be3-d70c-4d88-8864-392b10c39dc5 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058451 Sep 08 12:37:29.553122 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 14/28] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:37:29 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:29.576426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6ed51802-e36c-4840-8663-633fbd9d916b tempest-FlavorMetadataValidation-390798310 tempest-FlavorMetadataValidation-390798310-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:29.623370 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6ed51802-e36c-4840-8663-633fbd9d916b tempest-FlavorMetadataValidation-390798310 tempest-FlavorMetadataValidation-390798310-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.059800 Sep 08 12:37:29.624493 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 15/29] 10.222.0.78 () {60 vars in 1187 bytes} [Thu Sep 8 12:37:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:37:29.629343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6312ef45-a399-4064-8bcc-d2a01146e028 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1305795771", "id": 1176762774, "os-flavor-access:is_public": "False"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:29.684054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-852f4212-cc7c-45ef-9213-1f8721df3361 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:29.715105 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-852f4212-cc7c-45ef-9213-1f8721df3361 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1241 microversion: 2.1 time: 0.493008 Sep 08 12:37:29.716672 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 15/30] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:29 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1241 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:29.722727 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6312ef45-a399-4064-8bcc-d2a01146e028 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.096773 Sep 08 12:37:29.723673 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 16/31] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:37:29 2022] POST /compute/v2.1/flavors => generated 439 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:29.736549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2d9e34c2-1a2e-4ed5-b6a7-83e53ab2ed87 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "2b54bb4065a044779b278f816f07a399"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:30.029281 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2d9e34c2-1a2e-4ed5-b6a7-83e53ab2ed87 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1176762774/action" status: 200 len: 97 microversion: 2.1 time: 0.294472 Sep 08 12:37:30.034867 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 16/32] 10.222.0.78 () {60 vars in 1200 bytes} [Thu Sep 8 12:37:29 2022] POST /compute/v2.1/flavors/1176762774/action => generated 97 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:37:30.041354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7a16e092-5b60-45ba-ac08-8fa22ca5e036 tempest-FlavorsAccessNegativeTestJSON-1905015800 tempest-FlavorsAccessNegativeTestJSON-1905015800-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2b54bb4065a044779b278f816f07a399"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:30.045755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7a16e092-5b60-45ba-ac08-8fa22ca5e036 tempest-FlavorsAccessNegativeTestJSON-1905015800 tempest-FlavorsAccessNegativeTestJSON-1905015800-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'eaa7cb9c544346f3bf18d1713f61fef4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b54bb4065a044779b278f816f07a399', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7a16e092-5b60-45ba-ac08-8fa22ca5e036 tempest-FlavorsAccessNegativeTestJSON-1905015800 tempest-FlavorsAccessNegativeTestJSON-1905015800-project] Request method failure captured: Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/flavors/1176762774/action HTTP/1.1 Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 70 Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIBYe6tcmdu7Yw2ME2j4m4gv11vCaKe6E-1-U3L6mF7n4KXU18CP15JjrEald1MPmWtjbehybFFDOTmiXP5Qw09h21cl51hx0TophbVVBdoM4o3rT5bpwGOZ5XmGsSpNqzrWpWmG4m85Jhttr-CRYRKh2yVWmlY9b4KLd0yPEyz2wI Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 2b54bb4065a044779b278f816f07a399 Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1905015800 Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:37:30.052509 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:37:30.053655 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2b54bb4065a044779b278f816f07a399"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2b54bb4065a044779b278f816f07a399"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b54bb4065a044779b278f816f07a399"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2b54bb4065a044779b278f816f07a399"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:30.053655 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1905015800 Sep 08 12:37:30.053655 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 2b54bb4065a044779b278f816f07a399 Sep 08 12:37:30.053655 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1905015800 Sep 08 12:37:30.053655 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FlavorsAccessNegativeTestJSON-1905015800-project Sep 08 12:37:30.053655 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:37:30.053655 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:37:30.053655 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: eaa7cb9c544346f3bf18d1713f61fef4 Sep 08 12:37:30.053655 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1905015800-project Sep 08 12:37:30.053655 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:37:30.053655 n-d-852084-10 devstack@n-api.service[128971]: {"removeTenantAccess": {"tenant": "2b54bb4065a044779b278f816f07a399"}} Sep 08 12:37:30.053655 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '1176762774', 'body': {'removeTenantAccess': {'tenant': '2b54bb4065a044779b278f816f07a399'}}} Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can( Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:37:30.054254 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Sep 08 12:37:30.055202 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:30.056153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7a16e092-5b60-45ba-ac08-8fa22ca5e036 tempest-FlavorsAccessNegativeTestJSON-1905015800 tempest-FlavorsAccessNegativeTestJSON-1905015800-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:30.056153 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7a16e092-5b60-45ba-ac08-8fa22ca5e036 tempest-FlavorsAccessNegativeTestJSON-1905015800 tempest-FlavorsAccessNegativeTestJSON-1905015800-project] 10.222.0.78 "POST /compute/v2.1/flavors/1176762774/action" status: 403 len: 133 microversion: 2.1 time: 0.016709 Sep 08 12:37:30.056153 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 17/33] 10.222.0.78 () {60 vars in 1200 bytes} [Thu Sep 8 12:37:30 2022] POST /compute/v2.1/flavors/1176762774/action => generated 133 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:37:30.063774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4c57ace9-bc3c-4ea8-a4ea-bb2df6493662 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "2b54bb4065a044779b278f816f07a399"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:30.572266 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4c57ace9-bc3c-4ea8-a4ea-bb2df6493662 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/1176762774/action" status: 200 len: 21 microversion: 2.1 time: 0.513123 Sep 08 12:37:30.579646 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 17/34] 10.222.0.78 () {60 vars in 1200 bytes} [Thu Sep 8 12:37:30 2022] POST /compute/v2.1/flavors/1176762774/action => generated 21 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:37:30.611733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-93ccacce-1279-4401-93ab-5ced9a827221 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:30.681035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=8,nova_api:DELETE=12,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:30.697081 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-93ccacce-1279-4401-93ab-5ced9a827221 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1176762774" status: 202 len: 0 microversion: 2.1 time: 0.107442 Sep 08 12:37:30.698671 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 18/35] 10.222.0.78 () {58 vars in 1161 bytes} [Thu Sep 8 12:37:30 2022] DELETE /compute/v2.1/flavors/1176762774 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:37:30.712057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44d02543-6b9f-4580-809f-788adf66404f tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:30.741112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d2aeeb23-1a60-4438-9bcf-43ba8ad7c176 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:30.741777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d2aeeb23-1a60-4438-9bcf-43ba8ad7c176 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:30.767207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2aeeb23-1a60-4438-9bcf-43ba8ad7c176 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:30.772024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2aeeb23-1a60-4438-9bcf-43ba8ad7c176 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:30.776624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2aeeb23-1a60-4438-9bcf-43ba8ad7c176 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:30.777553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2aeeb23-1a60-4438-9bcf-43ba8ad7c176 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:30.778380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2aeeb23-1a60-4438-9bcf-43ba8ad7c176 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:30.778995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2aeeb23-1a60-4438-9bcf-43ba8ad7c176 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:30.788539 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44d02543-6b9f-4580-809f-788adf66404f tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.083149 Sep 08 12:37:30.811389 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 18/36] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:37:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:30.830517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e85e6caa-24f6-4fea-85d3-3e6696f956f8 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1363897485", "id": 2050015489, "os-flavor-access:is_public": "False"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:30.881506 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e85e6caa-24f6-4fea-85d3-3e6696f956f8 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.058465 Sep 08 12:37:30.897095 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 19/37] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:37:30 2022] POST /compute/v2.1/flavors => generated 439 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:37:30.917146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4d2c9c5-4142-407a-8e4e-1924c97bf1a7 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1199a0a395034fa9a499040e0b12a11c"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:31.071433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d2aeeb23-1a60-4438-9bcf-43ba8ad7c176 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:31.094409 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d2aeeb23-1a60-4438-9bcf-43ba8ad7c176 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1233 microversion: 2.1 time: 0.359117 Sep 08 12:37:31.095533 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 19/38] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:30 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1233 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:31.140442 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e4d2c9c5-4142-407a-8e4e-1924c97bf1a7 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] HTTP exception thrown: Flavor access not found for 20 / 1199a0a395034fa9a499040e0b12a11c combination. Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4d2c9c5-4142-407a-8e4e-1924c97bf1a7 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Request method failure captured: Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/flavors/2050015489/action HTTP/1.1 Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 70 Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIELu-8aq7_mqPuaByfwVdkcqZeC137RP1KPOxJbQYDT_W6ymLlcW0A8cpSVjljlQR7DmakWEOaA1J3UIwwOEdQClJMmqUSNi5gGeOT1adbyMSGlcibdYhg5WCo_g7RZdB7XTg3MiTw6vvBNXfQaxQnach0w_oaCYY_AOJ_L0s6Bk4 Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a39c331e1bbe442ba11776e4ab96caac Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1561618955 Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:37:31.143928 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:37:31.145019 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a39c331e1bbe442ba11776e4ab96caac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a39c331e1bbe442ba11776e4ab96caac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a39c331e1bbe442ba11776e4ab96caac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a39c331e1bbe442ba11776e4ab96caac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:31.145019 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1561618955 Sep 08 12:37:31.145019 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a39c331e1bbe442ba11776e4ab96caac Sep 08 12:37:31.145019 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1561618955 Sep 08 12:37:31.145019 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin Sep 08 12:37:31.145019 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:37:31.145019 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:37:31.145019 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: f217374fc4ee4709ab5865c3254b6d4c Sep 08 12:37:31.145019 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin Sep 08 12:37:31.145019 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:37:31.145019 n-d-852084-10 devstack@n-api.service[128970]: {"removeTenantAccess": {"tenant": "1199a0a395034fa9a499040e0b12a11c"}} Sep 08 12:37:31.145019 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: exception: Flavor access not found for 20 / 1199a0a395034fa9a499040e0b12a11c combination. Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '2050015489', 'body': {'removeTenantAccess': {'tenant': '1199a0a395034fa9a499040e0b12a11c'}}} Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Sep 08 12:37:31.145658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 20 / 1199a0a395034fa9a499040e0b12a11c combination. Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 20 / 1199a0a395034fa9a499040e0b12a11c combination. Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:31.146527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:31.147521 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:31.147521 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:31.147521 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:37:31.147521 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:37:31.147521 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 20 / 1199a0a395034fa9a499040e0b12a11c combination. Sep 08 12:37:31.147521 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:31.147521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4d2c9c5-4142-407a-8e4e-1924c97bf1a7 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Returning 404 to user: Flavor access not found for 20 / 1199a0a395034fa9a499040e0b12a11c combination. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:31.147521 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e4d2c9c5-4142-407a-8e4e-1924c97bf1a7 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/2050015489/action" status: 404 len: 124 microversion: 2.1 time: 0.240920 Sep 08 12:37:31.158151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ade62654-ec72-4acd-9b5e-b8c1a097ee7e tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:31.163857 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 20/39] 10.222.0.78 () {60 vars in 1200 bytes} [Thu Sep 8 12:37:30 2022] POST /compute/v2.1/flavors/2050015489/action => generated 124 bytes in 260 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:37:31.201561 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ade62654-ec72-4acd-9b5e-b8c1a097ee7e tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2050015489" status: 202 len: 0 microversion: 2.1 time: 0.046800 Sep 08 12:37:31.203472 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 20/40] 10.222.0.78 () {58 vars in 1161 bytes} [Thu Sep 8 12:37:31 2022] DELETE /compute/v2.1/flavors/2050015489 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:37:31.244887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4b737689-73ed-475c-97f3-5631de8bc861 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:31.343841 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4b737689-73ed-475c-97f3-5631de8bc861 tempest-FlavorsAccessNegativeTestJSON-1561618955 tempest-FlavorsAccessNegativeTestJSON-1561618955-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.129589 Sep 08 12:37:31.359274 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 21/41] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:37:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:32.134696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1f5622e0-ba1a-447d-ab8f-d5e4d44c7066 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:32.135369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1f5622e0-ba1a-447d-ab8f-d5e4d44c7066 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:32.152783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f5622e0-ba1a-447d-ab8f-d5e4d44c7066 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:32.153881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f5622e0-ba1a-447d-ab8f-d5e4d44c7066 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:32.154341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f5622e0-ba1a-447d-ab8f-d5e4d44c7066 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:32.155097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f5622e0-ba1a-447d-ab8f-d5e4d44c7066 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:32.155594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f5622e0-ba1a-447d-ab8f-d5e4d44c7066 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:32.164895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f5622e0-ba1a-447d-ab8f-d5e4d44c7066 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:32.451778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f5622e0-ba1a-447d-ab8f-d5e4d44c7066 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:32.461081 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1f5622e0-ba1a-447d-ab8f-d5e4d44c7066 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1295 microversion: 2.1 time: 0.331096 Sep 08 12:37:32.461601 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 21/42] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:32 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1295 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:33.486556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bd2f7bf7-5af6-4ec1-a7a2-e2d8186f01f4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:33.488325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bd2f7bf7-5af6-4ec1-a7a2-e2d8186f01f4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:33.506163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd2f7bf7-5af6-4ec1-a7a2-e2d8186f01f4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:33.507538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd2f7bf7-5af6-4ec1-a7a2-e2d8186f01f4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:33.515306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd2f7bf7-5af6-4ec1-a7a2-e2d8186f01f4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:33.516956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd2f7bf7-5af6-4ec1-a7a2-e2d8186f01f4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:33.518237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd2f7bf7-5af6-4ec1-a7a2-e2d8186f01f4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:33.529923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd2f7bf7-5af6-4ec1-a7a2-e2d8186f01f4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:34.320497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bd2f7bf7-5af6-4ec1-a7a2-e2d8186f01f4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:34.359420 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bd2f7bf7-5af6-4ec1-a7a2-e2d8186f01f4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1295 microversion: 2.1 time: 0.876952 Sep 08 12:37:34.361981 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 22/43] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:33 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1295 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:35.394091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-52186362-2e08-4e64-99ef-c51452e810b4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:35.395543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-52186362-2e08-4e64-99ef-c51452e810b4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:35.405509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52186362-2e08-4e64-99ef-c51452e810b4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:35.406052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52186362-2e08-4e64-99ef-c51452e810b4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:35.406532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52186362-2e08-4e64-99ef-c51452e810b4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:35.423271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52186362-2e08-4e64-99ef-c51452e810b4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:35.424151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52186362-2e08-4e64-99ef-c51452e810b4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:35.424728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52186362-2e08-4e64-99ef-c51452e810b4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:35.667827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-52186362-2e08-4e64-99ef-c51452e810b4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:35.693102 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-52186362-2e08-4e64-99ef-c51452e810b4 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1295 microversion: 2.1 time: 0.308025 Sep 08 12:37:35.698579 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 22/44] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:35 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1295 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:36.721021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-51b8ec76-37b7-409a-9dac-48e8c73688b5 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:36.721670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-51b8ec76-37b7-409a-9dac-48e8c73688b5 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:36.732359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:36.745492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51b8ec76-37b7-409a-9dac-48e8c73688b5 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:36.747254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51b8ec76-37b7-409a-9dac-48e8c73688b5 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:36.747973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51b8ec76-37b7-409a-9dac-48e8c73688b5 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:36.749402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51b8ec76-37b7-409a-9dac-48e8c73688b5 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:36.750435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51b8ec76-37b7-409a-9dac-48e8c73688b5 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:36.751136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51b8ec76-37b7-409a-9dac-48e8c73688b5 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:37.594676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-51b8ec76-37b7-409a-9dac-48e8c73688b5 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:37.623189 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-51b8ec76-37b7-409a-9dac-48e8c73688b5 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 0.902325 Sep 08 12:37:37.652902 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 23/45] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:36 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:38.664695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5159524e-e387-4c87-b87e-bbbe4c2e6089 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:38.666617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5159524e-e387-4c87-b87e-bbbe4c2e6089 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:38.672422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:38.676795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:38.742513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5159524e-e387-4c87-b87e-bbbe4c2e6089 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:38.746046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5159524e-e387-4c87-b87e-bbbe4c2e6089 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:38.748069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5159524e-e387-4c87-b87e-bbbe4c2e6089 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:38.749245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5159524e-e387-4c87-b87e-bbbe4c2e6089 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:38.768533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5159524e-e387-4c87-b87e-bbbe4c2e6089 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:38.769853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5159524e-e387-4c87-b87e-bbbe4c2e6089 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:39.422434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5159524e-e387-4c87-b87e-bbbe4c2e6089 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:39.476379 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5159524e-e387-4c87-b87e-bbbe4c2e6089 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 0.813096 Sep 08 12:37:39.477803 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 23/46] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:38 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:39.806832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:40.072749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b9c76e47-d6ca-4d6a-b4a3-d256a882c58e tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Calling method '.version_select at 0x7fdb37cecd30>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:40.086887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b9c76e47-d6ca-4d6a-b4a3-d256a882c58e tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) {{(pid=128970) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 08 12:37:40.087835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9c76e47-d6ca-4d6a-b4a3-d256a882c58e tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.088463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9c76e47-d6ca-4d6a-b4a3-d256a882c58e tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.089188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9c76e47-d6ca-4d6a-b4a3-d256a882c58e tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:40.126848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=9,nova_api:DELETE=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:40.133212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9c76e47-d6ca-4d6a-b4a3-d256a882c58e tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.134099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9c76e47-d6ca-4d6a-b4a3-d256a882c58e tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.134757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9c76e47-d6ca-4d6a-b4a3-d256a882c58e tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:40.187922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9c76e47-d6ca-4d6a-b4a3-d256a882c58e tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.188373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9c76e47-d6ca-4d6a-b4a3-d256a882c58e tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.188821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9c76e47-d6ca-4d6a-b4a3-d256a882c58e tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:40.211384 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b9c76e47-d6ca-4d6a-b4a3-d256a882c58e tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.406268 Sep 08 12:37:40.215785 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 24/47] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:37:39 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:40.227143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-017e9ace-d64d-4063-95c0-49ed27d2270d tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Calling method '.version_select at 0x7fdb3bd373a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:40.229663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017e9ace-d64d-4063-95c0-49ed27d2270d tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.230713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017e9ace-d64d-4063-95c0-49ed27d2270d tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.233558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017e9ace-d64d-4063-95c0-49ed27d2270d tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:40.266583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017e9ace-d64d-4063-95c0-49ed27d2270d tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.267262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017e9ace-d64d-4063-95c0-49ed27d2270d tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.267702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017e9ace-d64d-4063-95c0-49ed27d2270d tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:40.314225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017e9ace-d64d-4063-95c0-49ed27d2270d tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.316785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017e9ace-d64d-4063-95c0-49ed27d2270d tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.318489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017e9ace-d64d-4063-95c0-49ed27d2270d tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:40.329828 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-017e9ace-d64d-4063-95c0-49ed27d2270d tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/n-h2-852084-10/servers" status: 200 len: 197 microversion: 2.1 time: 0.106305 Sep 08 12:37:40.331064 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 24/48] 10.222.0.78 () {58 vars in 1215 bytes} [Thu Sep 8 12:37:40 2022] GET /compute/v2.1/os-hypervisors/n-h2-852084-10/servers => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:40.344306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c0c93582-7375-4f09-a924-249f6593a468 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Calling method '.version_select at 0x7fdb37c5e790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:40.346429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0c93582-7375-4f09-a924-249f6593a468 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.347261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0c93582-7375-4f09-a924-249f6593a468 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.348060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0c93582-7375-4f09-a924-249f6593a468 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:40.367552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0c93582-7375-4f09-a924-249f6593a468 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.368560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0c93582-7375-4f09-a924-249f6593a468 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.369480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0c93582-7375-4f09-a924-249f6593a468 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:40.386668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0c93582-7375-4f09-a924-249f6593a468 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.387602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0c93582-7375-4f09-a924-249f6593a468 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.388255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0c93582-7375-4f09-a924-249f6593a468 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:40.401980 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c0c93582-7375-4f09-a924-249f6593a468 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.060775 Sep 08 12:37:40.405410 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 25/49] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:37:40 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:40.419934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-845aa214-d100-429f-88b6-0eaed09b80b9 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Calling method '.version_select at 0x7fdb3bd378b0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:40.422351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-845aa214-d100-429f-88b6-0eaed09b80b9 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.423075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-845aa214-d100-429f-88b6-0eaed09b80b9 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.423875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-845aa214-d100-429f-88b6-0eaed09b80b9 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:40.444924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-845aa214-d100-429f-88b6-0eaed09b80b9 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.445670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-845aa214-d100-429f-88b6-0eaed09b80b9 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.446466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-845aa214-d100-429f-88b6-0eaed09b80b9 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:40.457246 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-845aa214-d100-429f-88b6-0eaed09b80b9 tempest-HypervisorAdminUnderV252Test-617949727 tempest-HypervisorAdminUnderV252Test-617949727-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/n-h2-852084-10/search" status: 200 len: 105 microversion: 2.1 time: 0.043833 Sep 08 12:37:40.458895 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 25/50] 10.222.0.78 () {58 vars in 1212 bytes} [Thu Sep 8 12:37:40 2022] GET /compute/v2.1/os-hypervisors/n-h2-852084-10/search => generated 105 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:40.509029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-06247f76-d534-4c5a-b21f-b4a3cb7af7ee tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:40.509839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-06247f76-d534-4c5a-b21f-b4a3cb7af7ee tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:40.527209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06247f76-d534-4c5a-b21f-b4a3cb7af7ee tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.530723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06247f76-d534-4c5a-b21f-b4a3cb7af7ee tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.531850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06247f76-d534-4c5a-b21f-b4a3cb7af7ee tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:40.535192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06247f76-d534-4c5a-b21f-b4a3cb7af7ee tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:40.535976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06247f76-d534-4c5a-b21f-b4a3cb7af7ee tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:40.539525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06247f76-d534-4c5a-b21f-b4a3cb7af7ee tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:41.043251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-06247f76-d534-4c5a-b21f-b4a3cb7af7ee tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:41.063276 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-06247f76-d534-4c5a-b21f-b4a3cb7af7ee tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 0.559184 Sep 08 12:37:41.081150 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 26/51] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:40 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:42.091907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-848ef714-dfc6-47c8-b03b-80dddb9dd196 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:42.093583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-848ef714-dfc6-47c8-b03b-80dddb9dd196 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:42.101569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-848ef714-dfc6-47c8-b03b-80dddb9dd196 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:42.102467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-848ef714-dfc6-47c8-b03b-80dddb9dd196 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:42.103960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-848ef714-dfc6-47c8-b03b-80dddb9dd196 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:42.105033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-848ef714-dfc6-47c8-b03b-80dddb9dd196 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:42.105766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-848ef714-dfc6-47c8-b03b-80dddb9dd196 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:42.107015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-848ef714-dfc6-47c8-b03b-80dddb9dd196 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:42.866680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7647b1ef-a5e1-459d-b91a-080131a46377 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Calling method '.version_select at 0x7fdb37ba13a0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:42.868963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7647b1ef-a5e1-459d-b91a-080131a46377 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'cd9bdecae95543a5a7a637de016c73d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32c08f85151425baf5eca1d5352a22b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7647b1ef-a5e1-459d-b91a-080131a46377 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Request method failure captured: Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIVfaQ_qovm0bgIH4UncXT7EjJaKeTA2h3w8uV711AAO0sKRXIjk0KMEXDEeMoN3xaFAiuP0G08lW2ciB-lCWwBBdZjEgTI4nc8JEyM02cm0OCJbmaziMkCY5DZJ-Fkwgt_7nPbW9WgTwORtJlMTE265TB7EFz99GIO3r_b1-xQw0U Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b32c08f85151425baf5eca1d5352a22b Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:37:42.871191 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b32c08f85151425baf5eca1d5352a22b Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HypervisorAdminNegativeTestJSON-650948298-project Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: cd9bdecae95543a5a7a637de016c73d3 Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-650948298-project Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: action_args: {} Sep 08 12:37:42.873013 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._detail(req) Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:37:42.873770 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Sep 08 12:37:42.874936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:42.876039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7647b1ef-a5e1-459d-b91a-080131a46377 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:42.876039 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7647b1ef-a5e1-459d-b91a-080131a46377 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.387302 Sep 08 12:37:42.886575 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 27/52] 10.222.0.78 () {58 vars in 1167 bytes} [Thu Sep 8 12:37:42 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 402 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:37:42.894384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-68099907-0a3d-4b88-9726-e324da3e92a7 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Calling method '.version_select at 0x7fdb37c99700>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:42.898088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-68099907-0a3d-4b88-9726-e324da3e92a7 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'cd9bdecae95543a5a7a637de016c73d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32c08f85151425baf5eca1d5352a22b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-68099907-0a3d-4b88-9726-e324da3e92a7 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Request method failure captured: Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIVfaQ_qovm0bgIH4UncXT7EjJaKeTA2h3w8uV711AAO0sKRXIjk0KMEXDEeMoN3xaFAiuP0G08lW2ciB-lCWwBBdZjEgTI4nc8JEyM02cm0OCJbmaziMkCY5DZJ-Fkwgt_7nPbW9WgTwORtJlMTE265TB7EFz99GIO3r_b1-xQw0U Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b32c08f85151425baf5eca1d5352a22b Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:37:42.900252 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b32c08f85151425baf5eca1d5352a22b Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HypervisorAdminNegativeTestJSON-650948298-project Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: cd9bdecae95543a5a7a637de016c73d3 Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-650948298-project Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: action_args: {} Sep 08 12:37:42.901674 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:37:42.902455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Sep 08 12:37:42.903743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:42.907859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-68099907-0a3d-4b88-9726-e324da3e92a7 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:42.909221 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-68099907-0a3d-4b88-9726-e324da3e92a7 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.020503 Sep 08 12:37:42.914804 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 28/53] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:37:42 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:37:42.923794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b85550c5-02ea-40e3-9a78-939469c209c1 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Calling method '.version_select at 0x7fdb37b55040>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:42.926454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b85550c5-02ea-40e3-9a78-939469c209c1 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'cd9bdecae95543a5a7a637de016c73d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32c08f85151425baf5eca1d5352a22b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b85550c5-02ea-40e3-9a78-939469c209c1 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Request method failure captured: Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIVfaQ_qovm0bgIH4UncXT7EjJaKeTA2h3w8uV711AAO0sKRXIjk0KMEXDEeMoN3xaFAiuP0G08lW2ciB-lCWwBBdZjEgTI4nc8JEyM02cm0OCJbmaziMkCY5DZJ-Fkwgt_7nPbW9WgTwORtJlMTE265TB7EFz99GIO3r_b1-xQw0U Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b32c08f85151425baf5eca1d5352a22b Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:37:42.929257 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b32c08f85151425baf5eca1d5352a22b Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HypervisorAdminNegativeTestJSON-650948298-project Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: cd9bdecae95543a5a7a637de016c73d3 Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-650948298-project Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: action_args: {} Sep 08 12:37:42.930567 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:37:42.931504 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Sep 08 12:37:42.933156 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:42.935777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b85550c5-02ea-40e3-9a78-939469c209c1 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:42.938291 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b85550c5-02ea-40e3-9a78-939469c209c1 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.020681 Sep 08 12:37:42.944221 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 29/54] 10.222.0.78 () {58 vars in 1179 bytes} [Thu Sep 8 12:37:42 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:37:43.083343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d826396f-f6de-4be6-8e06-8cd8f81dc8d4 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Calling method '.version_select at 0x7fdb37b410d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:43.087408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d826396f-f6de-4be6-8e06-8cd8f81dc8d4 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:43.090515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d826396f-f6de-4be6-8e06-8cd8f81dc8d4 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:43.093038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d826396f-f6de-4be6-8e06-8cd8f81dc8d4 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:43.143684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d826396f-f6de-4be6-8e06-8cd8f81dc8d4 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:43.144649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d826396f-f6de-4be6-8e06-8cd8f81dc8d4 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:43.145300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d826396f-f6de-4be6-8e06-8cd8f81dc8d4 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:43.201088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d826396f-f6de-4be6-8e06-8cd8f81dc8d4 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:43.203081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d826396f-f6de-4be6-8e06-8cd8f81dc8d4 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:43.203770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d826396f-f6de-4be6-8e06-8cd8f81dc8d4 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:43.238647 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d826396f-f6de-4be6-8e06-8cd8f81dc8d4 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.287425 Sep 08 12:37:43.255374 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 30/55] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:37:42 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:43.391950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-67788269-90d6-41ee-96a7-dd8c2da4ee9f req-75c23732-8ec2-4c61-85fd-1dedd9f51078 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "262b5661-21ae-42a9-8102-c088ff2868e2", "tag": "6b93304d-8fe4-4dc9-89b3-3515fa282a3a"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:43.395666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-848ef714-dfc6-47c8-b03b-80dddb9dd196 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:43.415488 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-848ef714-dfc6-47c8-b03b-80dddb9dd196 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 1.318800 Sep 08 12:37:43.417031 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 26/56] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:42 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:43.429406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5ed1541-ef68-42dc-8968-abf949577cf8 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Calling method '.version_select at 0x7fdb3bd08700>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:43.431844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c5ed1541-ef68-42dc-8968-abf949577cf8 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'cd9bdecae95543a5a7a637de016c73d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32c08f85151425baf5eca1d5352a22b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5ed1541-ef68-42dc-8968-abf949577cf8 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Request method failure captured: Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIVfaQ_qovm0bgIH4UncXT7EjJaKeTA2h3w8uV711AAO0sKRXIjk0KMEXDEeMoN3xaFAiuP0G08lW2ciB-lCWwBBdZjEgTI4nc8JEyM02cm0OCJbmaziMkCY5DZJ-Fkwgt_7nPbW9WgTwORtJlMTE265TB7EFz99GIO3r_b1-xQw0U Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b32c08f85151425baf5eca1d5352a22b Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:37:43.436209 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b32c08f85151425baf5eca1d5352a22b Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-HypervisorAdminNegativeTestJSON-650948298-project Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: cd9bdecae95543a5a7a637de016c73d3 Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-650948298-project Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '1'} Sep 08 12:37:43.437632 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:37:43.438449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Sep 08 12:37:43.439418 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.440429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-67788269-90d6-41ee-96a7-dd8c2da4ee9f req-75c23732-8ec2-4c61-85fd-1dedd9f51078 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:43.440429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-67788269-90d6-41ee-96a7-dd8c2da4ee9f req-75c23732-8ec2-4c61-85fd-1dedd9f51078 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:43.440429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-67788269-90d6-41ee-96a7-dd8c2da4ee9f req-75c23732-8ec2-4c61-85fd-1dedd9f51078 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:43.452249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5ed1541-ef68-42dc-8968-abf949577cf8 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:43.453505 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c5ed1541-ef68-42dc-8968-abf949577cf8 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.035173 Sep 08 12:37:43.454431 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 27/57] 10.222.0.78 () {58 vars in 1173 bytes} [Thu Sep 8 12:37:43 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 37 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:37:43.464307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4c97e766-fb8b-4d77-b25f-6ff6e41b61b6 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Calling method '.version_select at 0x7fdb3bcc5430>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:43.467276 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-4c97e766-fb8b-4d77-b25f-6ff6e41b61b6 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] HTTP exception thrown: Hypervisor with ID '771cc378-cc5d-44d5-9aab-deb11e04db78' could not be found. Sep 08 12:37:43.472923 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-67788269-90d6-41ee-96a7-dd8c2da4ee9f req-75c23732-8ec2-4c61-85fd-1dedd9f51078 service nova] Creating event network-changed:6b93304d-8fe4-4dc9-89b3-3515fa282a3a for instance 262b5661-21ae-42a9-8102-c088ff2868e2 on n-h2-852084-10 Sep 08 12:37:43.473505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-67788269-90d6-41ee-96a7-dd8c2da4ee9f req-75c23732-8ec2-4c61-85fd-1dedd9f51078 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 12:37:43.473902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-67788269-90d6-41ee-96a7-dd8c2da4ee9f req-75c23732-8ec2-4c61-85fd-1dedd9f51078 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 12:37:43.475287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba8525c9-0c1c-453b-95d2-ed1d92f17dc0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:43.475923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba8525c9-0c1c-453b-95d2-ed1d92f17dc0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:43.476351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba8525c9-0c1c-453b-95d2-ed1d92f17dc0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:43.477129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba8525c9-0c1c-453b-95d2-ed1d92f17dc0 None None] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:43.477594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba8525c9-0c1c-453b-95d2-ed1d92f17dc0 None None] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:43.478063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba8525c9-0c1c-453b-95d2-ed1d92f17dc0 None None] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4c97e766-fb8b-4d77-b25f-6ff6e41b61b6 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Request method failure captured: Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-hypervisors/771cc378-cc5d-44d5-9aab-deb11e04db78/uptime HTTP/1.1 Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIWw2OVANKrqcLPbTFlebZPeIky0_9jvaapLVZfab-vxVkZG7CseibMVlvgB2bfHBafjNCFSfrKr8Yrmp-z-aoP998XyNjYh-tD0ZDtqcEdZdlDpbylMt3NKoJMbjTWsJgJCPD4MCQRyHYeDAFEcUny2UCLFP5O3p6Eiit1z0CZYCA Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 9ffba47cefe94122be3dce8a72c0a4f9 Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-326629491 Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:37:43.479004 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:37:43.480131 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9ffba47cefe94122be3dce8a72c0a4f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9ffba47cefe94122be3dce8a72c0a4f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9ffba47cefe94122be3dce8a72c0a4f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9ffba47cefe94122be3dce8a72c0a4f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:43.480131 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-326629491 Sep 08 12:37:43.480131 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 9ffba47cefe94122be3dce8a72c0a4f9 Sep 08 12:37:43.480131 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-326629491 Sep 08 12:37:43.480131 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin Sep 08 12:37:43.480131 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:37:43.480131 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:37:43.480131 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 0fc60d81f7e3471097d3a9792ac3bfbc Sep 08 12:37:43.480131 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin Sep 08 12:37:43.480131 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:37:43.480131 n-d-852084-10 devstack@n-api.service[128971]: exception: Hypervisor with ID '771cc378-cc5d-44d5-9aab-deb11e04db78' could not be found. Sep 08 12:37:43.480131 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '771cc378-cc5d-44d5-9aab-deb11e04db78'} Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '771cc378-cc5d-44d5-9aab-deb11e04db78' Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 08 12:37:43.480770 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '771cc378-cc5d-44d5-9aab-deb11e04db78' could not be found. Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:43.482543 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.483668 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.483668 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:43.483668 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:43.483668 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:37:43.483668 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:37:43.483668 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '771cc378-cc5d-44d5-9aab-deb11e04db78' could not be found. Sep 08 12:37:43.483668 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.487882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4c97e766-fb8b-4d77-b25f-6ff6e41b61b6 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Returning 404 to user: Hypervisor with ID '771cc378-cc5d-44d5-9aab-deb11e04db78' could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:43.488981 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4c97e766-fb8b-4d77-b25f-6ff6e41b61b6 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/771cc378-cc5d-44d5-9aab-deb11e04db78/uptime" status: 404 len: 123 microversion: 2.1 time: 0.029137 Sep 08 12:37:43.490093 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 28/58] 10.222.0.78 () {58 vars in 1278 bytes} [Thu Sep 8 12:37:43 2022] GET /compute/v2.1/os-hypervisors/771cc378-cc5d-44d5-9aab-deb11e04db78/uptime => generated 123 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 12:37:43.495811 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.compute.rpcapi [None req-ba8525c9-0c1c-453b-95d2-ed1d92f17dc0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 12:37:43.497736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba8525c9-0c1c-453b-95d2-ed1d92f17dc0 None None] Releasing lock "compute-rpcapi-router" {{(pid=128970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 12:37:43.502990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b2064e6d-b3f5-4a66-bff2-ff1e8dd4f203 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Calling method '.version_select at 0x7fdb3bd378b0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:43.505075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2064e6d-b3f5-4a66-bff2-ff1e8dd4f203 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:43.511103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2064e6d-b3f5-4a66-bff2-ff1e8dd4f203 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:43.512153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2064e6d-b3f5-4a66-bff2-ff1e8dd4f203 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:43.519334 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ba8525c9-0c1c-453b-95d2-ed1d92f17dc0 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.260998 Sep 08 12:37:43.520878 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 31/59] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:43.553797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2064e6d-b3f5-4a66-bff2-ff1e8dd4f203 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:43.554531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2064e6d-b3f5-4a66-bff2-ff1e8dd4f203 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:43.555763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2064e6d-b3f5-4a66-bff2-ff1e8dd4f203 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:43.583936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2064e6d-b3f5-4a66-bff2-ff1e8dd4f203 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:43.584727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2064e6d-b3f5-4a66-bff2-ff1e8dd4f203 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:43.585338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2064e6d-b3f5-4a66-bff2-ff1e8dd4f203 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:43.604961 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b2064e6d-b3f5-4a66-bff2-ff1e8dd4f203 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.108139 Sep 08 12:37:43.606712 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 29/60] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:37:43 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:37:43.628184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eb9b1b0b-2e0a-426c-86d4-8770a2a3b716 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Calling method '.version_select at 0x7fdb37b41430>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:43.631654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eb9b1b0b-2e0a-426c-86d4-8770a2a3b716 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'cd9bdecae95543a5a7a637de016c73d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b32c08f85151425baf5eca1d5352a22b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eb9b1b0b-2e0a-426c-86d4-8770a2a3b716 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Request method failure captured: Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIVfaQ_qovm0bgIH4UncXT7EjJaKeTA2h3w8uV711AAO0sKRXIjk0KMEXDEeMoN3xaFAiuP0G08lW2ciB-lCWwBBdZjEgTI4nc8JEyM02cm0OCJbmaziMkCY5DZJ-Fkwgt_7nPbW9WgTwORtJlMTE265TB7EFz99GIO3r_b1-xQw0U Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b32c08f85151425baf5eca1d5352a22b Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:37:43.636806 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b32c08f85151425baf5eca1d5352a22b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b32c08f85151425baf5eca1d5352a22b Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-650948298 Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HypervisorAdminNegativeTestJSON-650948298-project Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: cd9bdecae95543a5a7a637de016c73d3 Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-650948298-project Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '1'} Sep 08 12:37:43.638641 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:37:43.639464 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Sep 08 12:37:43.640648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.644506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eb9b1b0b-2e0a-426c-86d4-8770a2a3b716 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:43.651861 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eb9b1b0b-2e0a-426c-86d4-8770a2a3b716 tempest-HypervisorAdminNegativeTestJSON-650948298 tempest-HypervisorAdminNegativeTestJSON-650948298-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.035399 Sep 08 12:37:43.658613 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 32/61] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:37:43 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:37:43.663085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d149119d-0a3f-4006-8d6f-435608ffcd42 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Calling method '.version_select at 0x7fdb3bd19280>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:43.664711 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-d149119d-0a3f-4006-8d6f-435608ffcd42 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] HTTP exception thrown: Hypervisor with ID '87904f88-3439-4393-a9c7-01cfaafc7cd1' could not be found. Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d149119d-0a3f-4006-8d6f-435608ffcd42 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Request method failure captured: Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-hypervisors/87904f88-3439-4393-a9c7-01cfaafc7cd1 HTTP/1.1 Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIWw2OVANKrqcLPbTFlebZPeIky0_9jvaapLVZfab-vxVkZG7CseibMVlvgB2bfHBafjNCFSfrKr8Yrmp-z-aoP998XyNjYh-tD0ZDtqcEdZdlDpbylMt3NKoJMbjTWsJgJCPD4MCQRyHYeDAFEcUny2UCLFP5O3p6Eiit1z0CZYCA Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 9ffba47cefe94122be3dce8a72c0a4f9 Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-326629491 Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:37:43.666374 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:37:43.667718 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9ffba47cefe94122be3dce8a72c0a4f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9ffba47cefe94122be3dce8a72c0a4f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9ffba47cefe94122be3dce8a72c0a4f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9ffba47cefe94122be3dce8a72c0a4f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:43.667718 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-326629491 Sep 08 12:37:43.667718 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 9ffba47cefe94122be3dce8a72c0a4f9 Sep 08 12:37:43.667718 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-326629491 Sep 08 12:37:43.667718 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin Sep 08 12:37:43.667718 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:37:43.667718 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:37:43.667718 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 0fc60d81f7e3471097d3a9792ac3bfbc Sep 08 12:37:43.667718 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin Sep 08 12:37:43.667718 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:37:43.667718 n-d-852084-10 devstack@n-api.service[128971]: exception: Hypervisor with ID '87904f88-3439-4393-a9c7-01cfaafc7cd1' could not be found. Sep 08 12:37:43.667718 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '87904f88-3439-4393-a9c7-01cfaafc7cd1'} Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi value = int(str(value)) Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '87904f88-3439-4393-a9c7-01cfaafc7cd1' Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Sep 08 12:37:43.668429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 12:37:43.669888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '87904f88-3439-4393-a9c7-01cfaafc7cd1' could not be found. Sep 08 12:37:43.671434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.671434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:43.671434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.671434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:43.671434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:43.671434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:43.671434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:37:43.671434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:37:43.671434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '87904f88-3439-4393-a9c7-01cfaafc7cd1' could not be found. Sep 08 12:37:43.671434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:43.673065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d149119d-0a3f-4006-8d6f-435608ffcd42 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] Returning 404 to user: Hypervisor with ID '87904f88-3439-4393-a9c7-01cfaafc7cd1' could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:43.676995 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d149119d-0a3f-4006-8d6f-435608ffcd42 tempest-HypervisorAdminNegativeTestJSON-326629491 tempest-HypervisorAdminNegativeTestJSON-326629491-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/87904f88-3439-4393-a9c7-01cfaafc7cd1" status: 404 len: 123 microversion: 2.1 time: 0.017980 Sep 08 12:37:43.683987 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 30/62] 10.222.0.78 () {58 vars in 1257 bytes} [Thu Sep 8 12:37:43 2022] GET /compute/v2.1/os-hypervisors/87904f88-3439-4393-a9c7-01cfaafc7cd1 => generated 123 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 12:37:44.450568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a1cc4ec5-4bcc-42dc-9b06-b7d8f3b92e88 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:44.452211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a1cc4ec5-4bcc-42dc-9b06-b7d8f3b92e88 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:44.489206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1cc4ec5-4bcc-42dc-9b06-b7d8f3b92e88 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:44.490125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1cc4ec5-4bcc-42dc-9b06-b7d8f3b92e88 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:44.490992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1cc4ec5-4bcc-42dc-9b06-b7d8f3b92e88 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:44.492615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1cc4ec5-4bcc-42dc-9b06-b7d8f3b92e88 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:44.493257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1cc4ec5-4bcc-42dc-9b06-b7d8f3b92e88 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:44.494048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1cc4ec5-4bcc-42dc-9b06-b7d8f3b92e88 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:45.881253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a1cc4ec5-4bcc-42dc-9b06-b7d8f3b92e88 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:45.890672 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a1cc4ec5-4bcc-42dc-9b06-b7d8f3b92e88 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 1.453960 Sep 08 12:37:45.895895 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 33/63] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:44 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:46.927492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1bd365e7-860a-4744-986b-aad214d1409e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:46.928539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1bd365e7-860a-4744-986b-aad214d1409e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:46.947984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd365e7-860a-4744-986b-aad214d1409e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:46.952186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd365e7-860a-4744-986b-aad214d1409e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:46.955706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd365e7-860a-4744-986b-aad214d1409e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:46.958543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd365e7-860a-4744-986b-aad214d1409e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:46.962092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd365e7-860a-4744-986b-aad214d1409e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:46.962615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd365e7-860a-4744-986b-aad214d1409e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:47.948636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1bd365e7-860a-4744-986b-aad214d1409e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:47.967099 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1bd365e7-860a-4744-986b-aad214d1409e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 1.046868 Sep 08 12:37:47.968525 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 31/64] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:46 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:48.991723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-afcbbcd3-d4ff-49a3-8ae1-cc2573b08535 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:48.992770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-afcbbcd3-d4ff-49a3-8ae1-cc2573b08535 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:49.005436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afcbbcd3-d4ff-49a3-8ae1-cc2573b08535 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:49.005938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afcbbcd3-d4ff-49a3-8ae1-cc2573b08535 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:49.014970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afcbbcd3-d4ff-49a3-8ae1-cc2573b08535 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:49.015782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afcbbcd3-d4ff-49a3-8ae1-cc2573b08535 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:49.016512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afcbbcd3-d4ff-49a3-8ae1-cc2573b08535 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:49.016943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afcbbcd3-d4ff-49a3-8ae1-cc2573b08535 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:49.519398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-afcbbcd3-d4ff-49a3-8ae1-cc2573b08535 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:49.537045 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-afcbbcd3-d4ff-49a3-8ae1-cc2573b08535 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 0.549544 Sep 08 12:37:49.540168 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 34/65] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:48 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:50.563316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-562eff24-0cf7-40e5-86a2-675d0f362c7e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:50.565527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-562eff24-0cf7-40e5-86a2-675d0f362c7e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:50.574674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-562eff24-0cf7-40e5-86a2-675d0f362c7e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:50.575845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-562eff24-0cf7-40e5-86a2-675d0f362c7e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:50.576466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-562eff24-0cf7-40e5-86a2-675d0f362c7e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:50.577403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-562eff24-0cf7-40e5-86a2-675d0f362c7e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:50.578091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-562eff24-0cf7-40e5-86a2-675d0f362c7e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:50.578819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-562eff24-0cf7-40e5-86a2-675d0f362c7e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:51.020251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-562eff24-0cf7-40e5-86a2-675d0f362c7e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:51.031944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=79 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:51.054889 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-562eff24-0cf7-40e5-86a2-675d0f362c7e tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 0.493889 Sep 08 12:37:51.056107 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 32/66] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:50 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:51.957401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-432940000", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:52.082710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-83d49519-38d0-4a1e-87f8-dbda0eea7fd1 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:52.089100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-83d49519-38d0-4a1e-87f8-dbda0eea7fd1 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:52.101794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:37:52.120042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d49519-38d0-4a1e-87f8-dbda0eea7fd1 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:52.120555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d49519-38d0-4a1e-87f8-dbda0eea7fd1 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:52.121002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d49519-38d0-4a1e-87f8-dbda0eea7fd1 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:52.121766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d49519-38d0-4a1e-87f8-dbda0eea7fd1 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:52.122228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d49519-38d0-4a1e-87f8-dbda0eea7fd1 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:52.122650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d49519-38d0-4a1e-87f8-dbda0eea7fd1 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:52.996382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:37:52.997859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:37:52.998483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:37:52.999055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:37:52.999660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:37:53.016959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-83d49519-38d0-4a1e-87f8-dbda0eea7fd1 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:53.024819 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-83d49519-38d0-4a1e-87f8-dbda0eea7fd1 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 0.947079 Sep 08 12:37:53.034525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:53.037347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:53.039166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:53.041892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:53.043492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:53.044441 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 33/67] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:52 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:53.046655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:53.070638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=61 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:37:53.092662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Getting quotas for project 8c3e5d96296342eb8a99953dec8747c0. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:37:53.105579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Getting quotas for user 81af813dbf5340d0a3d9d4bf0cff3da7 and project 8c3e5d96296342eb8a99953dec8747c0. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:37:53.137078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:37:53.140024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:37:53.247256 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f98ce063-11be-4ff3-8d47-52efe49cac38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.474152 Sep 08 12:37:53.247941 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:37:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:37:53.268245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-062165fe-ef20-4460-840f-281daba5bbba tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:53.268871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-062165fe-ef20-4460-840f-281daba5bbba tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:53.286667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6ea88280-5c9c-4d05-aec8-c7764b8b4ffe tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Calling method '.version_select at 0x7fdb3bc8b4c0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:53.288451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ea88280-5c9c-4d05-aec8-c7764b8b4ffe tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:53.288932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ea88280-5c9c-4d05-aec8-c7764b8b4ffe tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:53.289536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ea88280-5c9c-4d05-aec8-c7764b8b4ffe tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:53.328705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ea88280-5c9c-4d05-aec8-c7764b8b4ffe tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:53.329202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ea88280-5c9c-4d05-aec8-c7764b8b4ffe tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:53.329646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ea88280-5c9c-4d05-aec8-c7764b8b4ffe tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:53.377138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ea88280-5c9c-4d05-aec8-c7764b8b4ffe tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:53.377634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ea88280-5c9c-4d05-aec8-c7764b8b4ffe tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:53.379012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ea88280-5c9c-4d05-aec8-c7764b8b4ffe tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:53.388230 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6ea88280-5c9c-4d05-aec8-c7764b8b4ffe tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.340050 Sep 08 12:37:53.396559 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 34/69] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:37:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:53.439756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-062165fe-ef20-4460-840f-281daba5bbba tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:53.447649 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-062165fe-ef20-4460-840f-281daba5bbba tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1212 microversion: 2.1 time: 0.186764 Sep 08 12:37:53.471268 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 36/70] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:53 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1212 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:37:53.778606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-820e01b0-225b-4958-af8b-8d3f605f05fc tempest-HypervisorAdminNegativeUnderV252Test-1201106041 tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project] Calling method '.version_select at 0x7fdb3bce1f70>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:53.781156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-820e01b0-225b-4958-af8b-8d3f605f05fc tempest-HypervisorAdminNegativeUnderV252Test-1201106041 tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'be1baa1ae8fa45778d1a8756ba40cba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22542de6ebf40beafd0d0613f4cf64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-820e01b0-225b-4958-af8b-8d3f605f05fc tempest-HypervisorAdminNegativeUnderV252Test-1201106041 tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project] Request method failure captured: Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-hypervisors/n-h2-852084-10/search HTTP/1.1 Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIeewwDatar1TFVrb3hHTeeCQoT-32NtZTqMLECREAZQi5sT0MYpCR_LSMP1ltICWcTPH7eF8LvgcuzCjv7IK9K_uJ8UL3T-wVnBEGnEmg_5OLGj66A2kgPewKpT0fbjQ6cfbSEB7AkJGZllwspSbqcXOOgf0Yi4hJrzwSGEiWFV_4 Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b22542de6ebf40beafd0d0613f4cf64c Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1201106041 Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:37:53.782742 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:37:53.784221 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b22542de6ebf40beafd0d0613f4cf64c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b22542de6ebf40beafd0d0613f4cf64c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b22542de6ebf40beafd0d0613f4cf64c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b22542de6ebf40beafd0d0613f4cf64c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:53.784221 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1201106041 Sep 08 12:37:53.784221 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b22542de6ebf40beafd0d0613f4cf64c Sep 08 12:37:53.784221 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1201106041 Sep 08 12:37:53.784221 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project Sep 08 12:37:53.784221 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:37:53.784221 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:37:53.784221 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: be1baa1ae8fa45778d1a8756ba40cba0 Sep 08 12:37:53.784221 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project Sep 08 12:37:53.784221 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:37:53.784221 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 08 12:37:53.784221 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'n-h2-852084-10'} Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:37:53.784985 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Sep 08 12:37:53.786030 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:53.789819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-820e01b0-225b-4958-af8b-8d3f605f05fc tempest-HypervisorAdminNegativeUnderV252Test-1201106041 tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:53.789819 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-820e01b0-225b-4958-af8b-8d3f605f05fc tempest-HypervisorAdminNegativeUnderV252Test-1201106041 tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/n-h2-852084-10/search" status: 403 len: 117 microversion: 2.1 time: 0.384847 Sep 08 12:37:53.791612 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 35/71] 10.222.0.78 () {58 vars in 1212 bytes} [Thu Sep 8 12:37:53 2022] GET /compute/v2.1/os-hypervisors/n-h2-852084-10/search => generated 117 bytes in 394 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:37:53.795816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0614aa47-99f2-4d27-8264-1b3cd3f109a6 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Calling method '.version_select at 0x7fdb37a4d3a0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:53.797677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0614aa47-99f2-4d27-8264-1b3cd3f109a6 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:53.798343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0614aa47-99f2-4d27-8264-1b3cd3f109a6 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:53.798887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0614aa47-99f2-4d27-8264-1b3cd3f109a6 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:53.835661 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-0614aa47-99f2-4d27-8264-1b3cd3f109a6 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0614aa47-99f2-4d27-8264-1b3cd3f109a6 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Request method failure captured: Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIgCtOEcl1C4osNvQsSU1qtv7f_WNVJAg9JrzdwdAnFgZtu8Et9jVYWmgxO2AVv-YFB4oH631CU6wk-m7rWI4A3lr5DENtpNOB6h8EZzxokf-2C9An996oNg3Ytv1j82rsH3HS47pdKEA2itE_XgJl0zWOvckfORsLk9H6cWvtfoSY Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f251af34e6454ef4a140c7f2f9e68290 Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2112724340 Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:37:53.837934 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:37:53.840111 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f251af34e6454ef4a140c7f2f9e68290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f251af34e6454ef4a140c7f2f9e68290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f251af34e6454ef4a140c7f2f9e68290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f251af34e6454ef4a140c7f2f9e68290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:53.840111 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2112724340 Sep 08 12:37:53.840111 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f251af34e6454ef4a140c7f2f9e68290 Sep 08 12:37:53.840111 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2112724340 Sep 08 12:37:53.840111 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin Sep 08 12:37:53.840111 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:37:53.840111 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:37:53.840111 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b1f2083ff9894eca834f1002117c8648 Sep 08 12:37:53.840111 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin Sep 08 12:37:53.840111 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:37:53.840111 n-d-852084-10 devstack@n-api.service[128970]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 08 12:37:53.840111 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'nonexistent_hypervisor_name'} Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:53.841127 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:53.842229 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:53.842229 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:37:53.842229 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:37:53.842229 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Sep 08 12:37:53.842229 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:37:53.845237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0614aa47-99f2-4d27-8264-1b3cd3f109a6 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:53.847965 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0614aa47-99f2-4d27-8264-1b3cd3f109a6 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.056319 Sep 08 12:37:53.856161 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 37/72] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Sep 8 12:37:53 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:37:53.859918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ee6dda6e-e06a-468b-b64f-df47f78738e7 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Calling method '.version_select at 0x7fdb3bc83310>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:53.862243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6dda6e-e06a-468b-b64f-df47f78738e7 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:53.862735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6dda6e-e06a-468b-b64f-df47f78738e7 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:53.863166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6dda6e-e06a-468b-b64f-df47f78738e7 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:53.913766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6dda6e-e06a-468b-b64f-df47f78738e7 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:53.915905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6dda6e-e06a-468b-b64f-df47f78738e7 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:53.917252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6dda6e-e06a-468b-b64f-df47f78738e7 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:53.954772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6dda6e-e06a-468b-b64f-df47f78738e7 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:53.957568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6dda6e-e06a-468b-b64f-df47f78738e7 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:53.958107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6dda6e-e06a-468b-b64f-df47f78738e7 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:53.981904 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ee6dda6e-e06a-468b-b64f-df47f78738e7 tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.125959 Sep 08 12:37:53.990074 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 36/73] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:37:53 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:37:54.003638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0742d40b-eccf-4f03-be10-565f509ce9d9 tempest-HypervisorAdminNegativeUnderV252Test-1201106041 tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project] Calling method '.version_select at 0x7fdb3bce1dc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:54.010841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0742d40b-eccf-4f03-be10-565f509ce9d9 tempest-HypervisorAdminNegativeUnderV252Test-1201106041 tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'be1baa1ae8fa45778d1a8756ba40cba0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b22542de6ebf40beafd0d0613f4cf64c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0742d40b-eccf-4f03-be10-565f509ce9d9 tempest-HypervisorAdminNegativeUnderV252Test-1201106041 tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project] Request method failure captured: Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIeewwDatar1TFVrb3hHTeeCQoT-32NtZTqMLECREAZQi5sT0MYpCR_LSMP1ltICWcTPH7eF8LvgcuzCjv7IK9K_uJ8UL3T-wVnBEGnEmg_5OLGj66A2kgPewKpT0fbjQ6cfbSEB7AkJGZllwspSbqcXOOgf0Yi4hJrzwSGEiWFV_4 Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b22542de6ebf40beafd0d0613f4cf64c Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1201106041 Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:37:54.020218 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:37:54.021377 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b22542de6ebf40beafd0d0613f4cf64c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b22542de6ebf40beafd0d0613f4cf64c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b22542de6ebf40beafd0d0613f4cf64c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b22542de6ebf40beafd0d0613f4cf64c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:54.021377 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1201106041 Sep 08 12:37:54.021377 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b22542de6ebf40beafd0d0613f4cf64c Sep 08 12:37:54.021377 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1201106041 Sep 08 12:37:54.021377 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project Sep 08 12:37:54.021377 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:37:54.021377 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:37:54.021377 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: be1baa1ae8fa45778d1a8756ba40cba0 Sep 08 12:37:54.021377 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project Sep 08 12:37:54.021377 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:37:54.021377 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 08 12:37:54.021377 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '1'} Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:37:54.022143 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Sep 08 12:37:54.025551 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:54.026506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0742d40b-eccf-4f03-be10-565f509ce9d9 tempest-HypervisorAdminNegativeUnderV252Test-1201106041 tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:54.026506 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0742d40b-eccf-4f03-be10-565f509ce9d9 tempest-HypervisorAdminNegativeUnderV252Test-1201106041 tempest-HypervisorAdminNegativeUnderV252Test-1201106041-project] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.030661 Sep 08 12:37:54.030818 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 37/74] 10.222.0.78 () {58 vars in 1176 bytes} [Thu Sep 8 12:37:53 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:37:54.040045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71a18710-2829-4a99-8bf6-08d436f70cdc tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Calling method '.version_select at 0x7fdb3bc83280>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:54.048842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71a18710-2829-4a99-8bf6-08d436f70cdc tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:54.049431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71a18710-2829-4a99-8bf6-08d436f70cdc tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:54.049996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71a18710-2829-4a99-8bf6-08d436f70cdc tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:54.070521 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-71a18710-2829-4a99-8bf6-08d436f70cdc tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] HTTP exception thrown: No hypervisor matching 'fef09711-5846-4e1a-8095-a149b321de1e' could be found. Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71a18710-2829-4a99-8bf6-08d436f70cdc tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Request method failure captured: Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-hypervisors/fef09711-5846-4e1a-8095-a149b321de1e/servers HTTP/1.1 Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIgCtOEcl1C4osNvQsSU1qtv7f_WNVJAg9JrzdwdAnFgZtu8Et9jVYWmgxO2AVv-YFB4oH631CU6wk-m7rWI4A3lr5DENtpNOB6h8EZzxokf-2C9An996oNg3Ytv1j82rsH3HS47pdKEA2itE_XgJl0zWOvckfORsLk9H6cWvtfoSY Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: f251af34e6454ef4a140c7f2f9e68290 Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2112724340 Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:37:54.073953 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:37:54.075845 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f251af34e6454ef4a140c7f2f9e68290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f251af34e6454ef4a140c7f2f9e68290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f251af34e6454ef4a140c7f2f9e68290"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f251af34e6454ef4a140c7f2f9e68290"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:37:54.075845 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2112724340 Sep 08 12:37:54.075845 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: f251af34e6454ef4a140c7f2f9e68290 Sep 08 12:37:54.075845 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2112724340 Sep 08 12:37:54.075845 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin Sep 08 12:37:54.075845 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:37:54.075845 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:37:54.075845 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b1f2083ff9894eca834f1002117c8648 Sep 08 12:37:54.075845 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin Sep 08 12:37:54.075845 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:37:54.075845 n-d-852084-10 devstack@n-api.service[128971]: exception: No hypervisor matching 'fef09711-5846-4e1a-8095-a149b321de1e' could be found. Sep 08 12:37:54.075845 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'fef09711-5846-4e1a-8095-a149b321de1e'} Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'fef09711-5846-4e1a-8095-a149b321de1e' could be found. Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:54.076466 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:37:54.077753 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:37:54.077753 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:37:54.077753 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:37:54.077753 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:37:54.077753 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'fef09711-5846-4e1a-8095-a149b321de1e' could be found. Sep 08 12:37:54.077753 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:37:54.082227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71a18710-2829-4a99-8bf6-08d436f70cdc tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] Returning 404 to user: No hypervisor matching 'fef09711-5846-4e1a-8095-a149b321de1e' could be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:37:54.085043 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-71a18710-2829-4a99-8bf6-08d436f70cdc tempest-HypervisorAdminNegativeUnderV252Test-2112724340 tempest-HypervisorAdminNegativeUnderV252Test-2112724340-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/fef09711-5846-4e1a-8095-a149b321de1e/servers" status: 404 len: 123 microversion: 2.1 time: 0.053076 Sep 08 12:37:54.086789 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 38/75] 10.222.0.78 () {58 vars in 1281 bytes} [Thu Sep 8 12:37:54 2022] GET /compute/v2.1/os-hypervisors/fef09711-5846-4e1a-8095-a149b321de1e/servers => generated 123 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:37:54.104902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ac4d909f-6a83-455e-8de6-66ddc3a7656a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:54.105193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ac4d909f-6a83-455e-8de6-66ddc3a7656a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:54.126761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac4d909f-6a83-455e-8de6-66ddc3a7656a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:54.127195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac4d909f-6a83-455e-8de6-66ddc3a7656a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:54.127658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac4d909f-6a83-455e-8de6-66ddc3a7656a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:54.128369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac4d909f-6a83-455e-8de6-66ddc3a7656a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:54.128826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac4d909f-6a83-455e-8de6-66ddc3a7656a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:54.129247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac4d909f-6a83-455e-8de6-66ddc3a7656a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:54.221396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-27a29941-6ac9-452a-8a8e-e40c953791bc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:54.246365 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-27a29941-6ac9-452a-8a8e-e40c953791bc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.353508 Sep 08 12:37:54.266055 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 38/76] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:37:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:54.447290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-de33083f-3613-4ac2-a9ef-c9707563d0c7 tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1852671357", "id": 734329767, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:54.495537 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-de33083f-3613-4ac2-a9ef-c9707563d0c7 tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 0.225375 Sep 08 12:37:54.497680 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 39/77] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:37:54 2022] POST /compute/v2.1/flavors => generated 422 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:54.501658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ac4d909f-6a83-455e-8de6-66ddc3a7656a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:54.504571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4dcc3fc7-2c5b-44c4-8d63-9c237c9a496e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:54.506457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4dcc3fc7-2c5b-44c4-8d63-9c237c9a496e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:54.520534 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ac4d909f-6a83-455e-8de6-66ddc3a7656a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 0.431225 Sep 08 12:37:54.521872 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 39/78] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:54 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:54.541845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a45ece5f-9b09-4e21-b706-9dbbadd11efc tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:54.573647 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a45ece5f-9b09-4e21-b706-9dbbadd11efc tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.050363 Sep 08 12:37:54.574650 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 40/79] 10.222.0.78 () {58 vars in 1182 bytes} [Thu Sep 8 12:37:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:37:54.585396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-28a2dd8b-955e-4d5e-9cce-16e3aea6214d tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-78365609", "id": 1695999658, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:54.629138 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-28a2dd8b-955e-4d5e-9cce-16e3aea6214d tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.047424 Sep 08 12:37:54.631034 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 41/80] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:37:54 2022] POST /compute/v2.1/flavors => generated 423 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:54.646771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fefa0e7d-7ace-4805-a20c-76ff067adac4 tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:54.661317 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fefa0e7d-7ace-4805-a20c-76ff067adac4 tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021650 Sep 08 12:37:54.671392 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 42/81] 10.222.0.78 () {58 vars in 1182 bytes} [Thu Sep 8 12:37:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 12:37:54.687254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c374552b-9842-4e0c-9d6c-3242ea717eed tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Action: 'create', calling method: .version_select at 0x7fdb3bcc5e50>, body: {"keypair": {"name": "tempest-keypair-467201876", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfZN1RSImoyDk3+88YSlRjLGvfdlj5FYcr0zN2lj9ojFNs95qWztmcGhkMcLUZYARZZkoJghZdAFFNdwu2feKMBoPJf6MahVRA3F9x3IMeJNgvskJA5B0Np/TggRpFIIA=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:54.718223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4dcc3fc7-2c5b-44c4-8d63-9c237c9a496e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:54.731850 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4dcc3fc7-2c5b-44c4-8d63-9c237c9a496e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1212 microversion: 2.1 time: 0.232023 Sep 08 12:37:54.735497 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 40/82] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:54 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1212 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:54.755367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c374552b-9842-4e0c-9d6c-3242ea717eed tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Getting quotas for project 6b81715e5ed745b5915844c61a40a017. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:37:54.769046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c374552b-9842-4e0c-9d6c-3242ea717eed tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Getting quotas for user b76b0c59e23f4b20b356562bb75fe393 and project 6b81715e5ed745b5915844c61a40a017. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:37:54.866876 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c374552b-9842-4e0c-9d6c-3242ea717eed tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.193324 Sep 08 12:37:54.867822 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 43/83] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:37:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:55.550170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-edfbce86-98bb-476c-af5e-a5eb07ab66d6 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:55.551875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-edfbce86-98bb-476c-af5e-a5eb07ab66d6 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:55.562875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edfbce86-98bb-476c-af5e-a5eb07ab66d6 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:55.563892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edfbce86-98bb-476c-af5e-a5eb07ab66d6 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:55.565539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edfbce86-98bb-476c-af5e-a5eb07ab66d6 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:55.566569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edfbce86-98bb-476c-af5e-a5eb07ab66d6 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:55.567304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edfbce86-98bb-476c-af5e-a5eb07ab66d6 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:55.567985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edfbce86-98bb-476c-af5e-a5eb07ab66d6 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:55.761757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b11ccbe8-8aec-4b24-8c1c-039756218534 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:55.763077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b11ccbe8-8aec-4b24-8c1c-039756218534 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:55.784827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b11ccbe8-8aec-4b24-8c1c-039756218534 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:55.785873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b11ccbe8-8aec-4b24-8c1c-039756218534 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:55.786699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b11ccbe8-8aec-4b24-8c1c-039756218534 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:55.787606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b11ccbe8-8aec-4b24-8c1c-039756218534 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:55.788212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b11ccbe8-8aec-4b24-8c1c-039756218534 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:55.788786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b11ccbe8-8aec-4b24-8c1c-039756218534 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:55.987255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-edfbce86-98bb-476c-af5e-a5eb07ab66d6 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:55.994993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b11ccbe8-8aec-4b24-8c1c-039756218534 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:55.997707 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-edfbce86-98bb-476c-af5e-a5eb07ab66d6 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 0.450960 Sep 08 12:37:55.998317 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 41/84] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:55 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:56.007822 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b11ccbe8-8aec-4b24-8c1c-039756218534 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1264 microversion: 2.1 time: 0.250293 Sep 08 12:37:56.008932 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 44/85] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:55 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:37:57.028939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6abdfc81-d610-4b8c-bddf-cc92c56655ef tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:57.044515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eac68543-5c8d-4052-bac0-7b8dffebbd36 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:57.045679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eac68543-5c8d-4052-bac0-7b8dffebbd36 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:57.046417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6abdfc81-d610-4b8c-bddf-cc92c56655ef tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:57.068606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6abdfc81-d610-4b8c-bddf-cc92c56655ef tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:57.069207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6abdfc81-d610-4b8c-bddf-cc92c56655ef tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:57.069687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6abdfc81-d610-4b8c-bddf-cc92c56655ef tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:57.070440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6abdfc81-d610-4b8c-bddf-cc92c56655ef tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:57.072976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eac68543-5c8d-4052-bac0-7b8dffebbd36 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:57.073317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eac68543-5c8d-4052-bac0-7b8dffebbd36 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:57.073988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eac68543-5c8d-4052-bac0-7b8dffebbd36 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:57.075328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eac68543-5c8d-4052-bac0-7b8dffebbd36 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:57.076008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eac68543-5c8d-4052-bac0-7b8dffebbd36 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:57.076223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6abdfc81-d610-4b8c-bddf-cc92c56655ef tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:57.076930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6abdfc81-d610-4b8c-bddf-cc92c56655ef tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:57.077718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eac68543-5c8d-4052-bac0-7b8dffebbd36 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:57.464824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eac68543-5c8d-4052-bac0-7b8dffebbd36 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:57.475701 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eac68543-5c8d-4052-bac0-7b8dffebbd36 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1270 microversion: 2.1 time: 0.445091 Sep 08 12:37:57.505262 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 45/86] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:57 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1270 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:57.659071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-6975ee0f-2f02-4c80-ab6a-319e559bd178 req-0b18b3cd-71a1-41a7-9fb2-6bf7935c2fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262b5661-21ae-42a9-8102-c088ff2868e2", "name": "network-vif-plugged", "status": "completed", "tag": "6b93304d-8fe4-4dc9-89b3-3515fa282a3a"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:57.677971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6975ee0f-2f02-4c80-ab6a-319e559bd178 req-0b18b3cd-71a1-41a7-9fb2-6bf7935c2fa4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:57.678753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6975ee0f-2f02-4c80-ab6a-319e559bd178 req-0b18b3cd-71a1-41a7-9fb2-6bf7935c2fa4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:57.703586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6975ee0f-2f02-4c80-ab6a-319e559bd178 req-0b18b3cd-71a1-41a7-9fb2-6bf7935c2fa4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:57.780444 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-6975ee0f-2f02-4c80-ab6a-319e559bd178 req-0b18b3cd-71a1-41a7-9fb2-6bf7935c2fa4 service nova] Creating event network-vif-plugged:6b93304d-8fe4-4dc9-89b3-3515fa282a3a for instance 262b5661-21ae-42a9-8102-c088ff2868e2 on n-h2-852084-10 Sep 08 12:37:57.782391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6975ee0f-2f02-4c80-ab6a-319e559bd178 req-0b18b3cd-71a1-41a7-9fb2-6bf7935c2fa4 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 12:37:57.783016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6975ee0f-2f02-4c80-ab6a-319e559bd178 req-0b18b3cd-71a1-41a7-9fb2-6bf7935c2fa4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 12:37:57.790757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-347eda94-4d0d-4187-b367-2c17ab4f0f13 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:57.791274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-347eda94-4d0d-4187-b367-2c17ab4f0f13 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:57.793532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-347eda94-4d0d-4187-b367-2c17ab4f0f13 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:57.795574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-347eda94-4d0d-4187-b367-2c17ab4f0f13 None None] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:57.796061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-347eda94-4d0d-4187-b367-2c17ab4f0f13 None None] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:57.796499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-347eda94-4d0d-4187-b367-2c17ab4f0f13 None None] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:57.829046 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.compute.rpcapi [None req-347eda94-4d0d-4187-b367-2c17ab4f0f13 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 08 12:37:57.832206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-347eda94-4d0d-4187-b367-2c17ab4f0f13 None None] Releasing lock "compute-rpcapi-router" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 12:37:57.877061 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-347eda94-4d0d-4187-b367-2c17ab4f0f13 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.370012 Sep 08 12:37:57.877863 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 46/87] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:37:57.988325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6abdfc81-d610-4b8c-bddf-cc92c56655ef tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:57.999976 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6abdfc81-d610-4b8c-bddf-cc92c56655ef tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 0.981456 Sep 08 12:37:58.001060 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 42/88] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:57 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:58.298092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1087357968", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "1695999658", "adminPass": "***", "networks": [{"uuid": "aaf5857a-8225-4252-ae8f-71a477deabc7"}], "security_groups": [{"name": "tempest-securitygroup--120913648"}], "key_name": "tempest-keypair-467201876", "user_data": "}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:37:58.515984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c6e9f211-7a08-4b74-ab59-579394738166 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:58.517076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c6e9f211-7a08-4b74-ab59-579394738166 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:58.541678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6e9f211-7a08-4b74-ab59-579394738166 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:58.542179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6e9f211-7a08-4b74-ab59-579394738166 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:58.549782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6e9f211-7a08-4b74-ab59-579394738166 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:58.550562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6e9f211-7a08-4b74-ab59-579394738166 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:58.551041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6e9f211-7a08-4b74-ab59-579394738166 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:58.551501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6e9f211-7a08-4b74-ab59-579394738166 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:58.561082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] validate_networks() for [('aaf5857a-8225-4252-ae8f-71a477deabc7', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:37:58.948220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c6e9f211-7a08-4b74-ab59-579394738166 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:58.962672 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c6e9f211-7a08-4b74-ab59-579394738166 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1270 microversion: 2.1 time: 0.449300 Sep 08 12:37:58.980673 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 43/89] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:58 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1270 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:59.024289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4a7e670-6071-4941-940d-83721660be2f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:59.026114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a4a7e670-6071-4941-940d-83721660be2f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:37:59.033885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4a7e670-6071-4941-940d-83721660be2f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:59.034540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4a7e670-6071-4941-940d-83721660be2f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:59.035309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4a7e670-6071-4941-940d-83721660be2f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:59.036515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4a7e670-6071-4941-940d-83721660be2f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:37:59.037646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4a7e670-6071-4941-940d-83721660be2f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:37:59.038558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4a7e670-6071-4941-940d-83721660be2f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:37:59.572261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4a7e670-6071-4941-940d-83721660be2f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:37:59.581726 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a4a7e670-6071-4941-940d-83721660be2f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1337 microversion: 2.1 time: 0.561301 Sep 08 12:37:59.583740 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 44/90] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:59 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1337 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:37:59.989365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-61eab148-8950-44f8-8baf-65e7dccf9d3b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:37:59.991259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-61eab148-8950-44f8-8baf-65e7dccf9d3b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:00.000060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61eab148-8950-44f8-8baf-65e7dccf9d3b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:00.001168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61eab148-8950-44f8-8baf-65e7dccf9d3b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:00.002414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61eab148-8950-44f8-8baf-65e7dccf9d3b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:00.003835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61eab148-8950-44f8-8baf-65e7dccf9d3b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:00.004577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61eab148-8950-44f8-8baf-65e7dccf9d3b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:00.005525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61eab148-8950-44f8-8baf-65e7dccf9d3b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:00.103242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-61eab148-8950-44f8-8baf-65e7dccf9d3b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:00.117179 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-61eab148-8950-44f8-8baf-65e7dccf9d3b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1270 microversion: 2.1 time: 0.132160 Sep 08 12:38:00.135933 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 45/91] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:37:59 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:00.158393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:38:00.158879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:38:00.160372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:38:00.160713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:38:00.161128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:38:00.187596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:00.188102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:00.188548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:00.189291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:00.189746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:00.190977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:00.256457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Getting quotas for project 6b81715e5ed745b5915844c61a40a017. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:00.264760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Getting quotas for user b76b0c59e23f4b20b356562bb75fe393 and project 6b81715e5ed745b5915844c61a40a017. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:00.285413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:38:00.296919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:38:00.407527 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-14618f5a-7351-4915-bc0b-ae7f7e826f26 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.123107 Sep 08 12:38:00.415390 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 47/92] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:37:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:38:00.420638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-40016466-ab87-4c65-8485-b0b4316baf68 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:00.421253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-40016466-ab87-4c65-8485-b0b4316baf68 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:00.536925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40016466-ab87-4c65-8485-b0b4316baf68 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:00.549102 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-40016466-ab87-4c65-8485-b0b4316baf68 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1264 microversion: 2.1 time: 0.132453 Sep 08 12:38:00.571358 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 46/93] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:00 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:00.609456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a24a91b-9843-4c20-bc7e-619e8575412f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:00.610501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2a24a91b-9843-4c20-bc7e-619e8575412f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:00.636095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a24a91b-9843-4c20-bc7e-619e8575412f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:00.638159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a24a91b-9843-4c20-bc7e-619e8575412f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:00.638651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a24a91b-9843-4c20-bc7e-619e8575412f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:00.644954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a24a91b-9843-4c20-bc7e-619e8575412f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:00.645458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a24a91b-9843-4c20-bc7e-619e8575412f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:00.646080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a24a91b-9843-4c20-bc7e-619e8575412f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:00.978136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2a24a91b-9843-4c20-bc7e-619e8575412f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:00.998650 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a24a91b-9843-4c20-bc7e-619e8575412f tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1487 microversion: 2.1 time: 0.395871 Sep 08 12:38:00.999257 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 48/94] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:00 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1487 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:01.024646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8c91514-8dfc-4873-892c-3e68625a148f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:01.025278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b8c91514-8dfc-4873-892c-3e68625a148f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:01.035974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8c91514-8dfc-4873-892c-3e68625a148f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:01.036910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8c91514-8dfc-4873-892c-3e68625a148f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:01.037399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8c91514-8dfc-4873-892c-3e68625a148f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:01.038108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8c91514-8dfc-4873-892c-3e68625a148f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:01.040714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8c91514-8dfc-4873-892c-3e68625a148f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:01.043072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8c91514-8dfc-4873-892c-3e68625a148f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:01.151900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-021ea967-0723-47e1-b178-1bacba8d0196 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:01.153195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-021ea967-0723-47e1-b178-1bacba8d0196 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:01.155561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=3,nova_api:INSERT=5 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:01.170638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-021ea967-0723-47e1-b178-1bacba8d0196 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:01.172313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-021ea967-0723-47e1-b178-1bacba8d0196 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:01.176801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-021ea967-0723-47e1-b178-1bacba8d0196 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:01.177854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-021ea967-0723-47e1-b178-1bacba8d0196 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:01.178538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-021ea967-0723-47e1-b178-1bacba8d0196 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:01.179261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-021ea967-0723-47e1-b178-1bacba8d0196 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:01.359682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-021ea967-0723-47e1-b178-1bacba8d0196 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:01.377582 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-021ea967-0723-47e1-b178-1bacba8d0196 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1270 microversion: 2.1 time: 0.231384 Sep 08 12:38:01.407879 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 49/95] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:01 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1270 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:01.742907 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8c91514-8dfc-4873-892c-3e68625a148f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1640 microversion: 2.1 time: 0.723305 Sep 08 12:38:01.746981 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 47/96] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:01 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1640 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:01.751894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-033c6a04-b2d0-4c10-8923-bbacaaa84416 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:01.752625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-033c6a04-b2d0-4c10-8923-bbacaaa84416 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:01.767206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-033c6a04-b2d0-4c10-8923-bbacaaa84416 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:01.767635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-033c6a04-b2d0-4c10-8923-bbacaaa84416 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:01.768094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-033c6a04-b2d0-4c10-8923-bbacaaa84416 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:01.768843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-033c6a04-b2d0-4c10-8923-bbacaaa84416 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:01.769304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-033c6a04-b2d0-4c10-8923-bbacaaa84416 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:01.772266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-033c6a04-b2d0-4c10-8923-bbacaaa84416 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:01.778922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-59fc1c37-beaa-42ba-9208-87f7e93dc4d7 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3d1ba040>, body: {"quota_set": {"ram": "5120"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:01.856026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-033c6a04-b2d0-4c10-8923-bbacaaa84416 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:01.868674 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-033c6a04-b2d0-4c10-8923-bbacaaa84416 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1281 microversion: 2.1 time: 0.120410 Sep 08 12:38:01.878836 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 48/97] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:01 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1281 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:01.893544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-77166eb5-33c2-457f-99c9-122f8cb6763a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:01.894223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-77166eb5-33c2-457f-99c9-122f8cb6763a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:01.910952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77166eb5-33c2-457f-99c9-122f8cb6763a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:01.912020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77166eb5-33c2-457f-99c9-122f8cb6763a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:01.912976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77166eb5-33c2-457f-99c9-122f8cb6763a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:01.914827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77166eb5-33c2-457f-99c9-122f8cb6763a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:01.915904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77166eb5-33c2-457f-99c9-122f8cb6763a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:01.916994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77166eb5-33c2-457f-99c9-122f8cb6763a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:01.925371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59fc1c37-beaa-42ba-9208-87f7e93dc4d7 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:01.925923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59fc1c37-beaa-42ba-9208-87f7e93dc4d7 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:01.926561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59fc1c37-beaa-42ba-9208-87f7e93dc4d7 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:01.928372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59fc1c37-beaa-42ba-9208-87f7e93dc4d7 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:01.929490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59fc1c37-beaa-42ba-9208-87f7e93dc4d7 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:01.930126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59fc1c37-beaa-42ba-9208-87f7e93dc4d7 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:01.967871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-77166eb5-33c2-457f-99c9-122f8cb6763a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:38:02.033740 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-59fc1c37-beaa-42ba-9208-87f7e93dc4d7 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/7aa3d612101841bbb3d91fd16f0ed80a" status: 200 len: 240 microversion: 2.36 time: 0.624157 Sep 08 12:38:02.035450 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 50/98] 10.222.0.78 () {62 vars in 1303 bytes} [Thu Sep 8 12:38:01 2022] PUT /compute/v2.1/os-quota-sets/7aa3d612101841bbb3d91fd16f0ed80a => generated 240 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:38:02.063256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1010a64c-4d08-49db-91c2-31399750bdc8 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Calling method '.version_select at 0x7fdb3bd19280>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:02.250780 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-77166eb5-33c2-457f-99c9-122f8cb6763a tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "DELETE /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 204 len: 0 microversion: 2.1 time: 0.371783 Sep 08 12:38:02.254856 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 49/99] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:38:01 2022] DELETE /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:38:02.259573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1010a64c-4d08-49db-91c2-31399750bdc8 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:02.260305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1010a64c-4d08-49db-91c2-31399750bdc8 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:02.260482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1010a64c-4d08-49db-91c2-31399750bdc8 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:02.261370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1010a64c-4d08-49db-91c2-31399750bdc8 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:02.261987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1010a64c-4d08-49db-91c2-31399750bdc8 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:02.263129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1010a64c-4d08-49db-91c2-31399750bdc8 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:02.270240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b3a619ac-05cb-4ebe-963e-1eeb292c5a44 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:02.271755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b3a619ac-05cb-4ebe-963e-1eeb292c5a44 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:02.286547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3a619ac-05cb-4ebe-963e-1eeb292c5a44 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:02.287485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3a619ac-05cb-4ebe-963e-1eeb292c5a44 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:02.288146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3a619ac-05cb-4ebe-963e-1eeb292c5a44 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:02.289175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3a619ac-05cb-4ebe-963e-1eeb292c5a44 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:02.290165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3a619ac-05cb-4ebe-963e-1eeb292c5a44 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:02.290804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3a619ac-05cb-4ebe-963e-1eeb292c5a44 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:02.302351 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1010a64c-4d08-49db-91c2-31399750bdc8 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/7aa3d612101841bbb3d91fd16f0ed80a/detail" status: 200 len: 672 microversion: 2.36 time: 0.251899 Sep 08 12:38:02.312259 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 51/100] 10.222.0.78 () {60 vars in 1304 bytes} [Thu Sep 8 12:38:02 2022] GET /compute/v2.1/os-quota-sets/7aa3d612101841bbb3d91fd16f0ed80a/detail => generated 672 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:38:02.406555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-af9e62f1-8b29-4408-baab-92ff977695bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:02.407190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-af9e62f1-8b29-4408-baab-92ff977695bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:02.422697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af9e62f1-8b29-4408-baab-92ff977695bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:02.423560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af9e62f1-8b29-4408-baab-92ff977695bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:02.424134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af9e62f1-8b29-4408-baab-92ff977695bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:02.425006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af9e62f1-8b29-4408-baab-92ff977695bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:02.425595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af9e62f1-8b29-4408-baab-92ff977695bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:02.426130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af9e62f1-8b29-4408-baab-92ff977695bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:02.569077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-af9e62f1-8b29-4408-baab-92ff977695bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:02.580347 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-af9e62f1-8b29-4408-baab-92ff977695bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1270 microversion: 2.1 time: 0.177825 Sep 08 12:38:02.587578 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 52/101] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:02 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1270 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:02.589904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b3a619ac-05cb-4ebe-963e-1eeb292c5a44 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:02.605556 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b3a619ac-05cb-4ebe-963e-1eeb292c5a44 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1493 microversion: 2.1 time: 0.345591 Sep 08 12:38:02.606914 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 50/102] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:02 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1493 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:02.608141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3bbc4670>, body: {"quota_set": {"ram": "2048"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:02.672561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:02.673043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:02.673512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:02.674233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:02.674687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:02.675108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:02.715941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:02.716295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:02.716891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:02.717758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:02.718227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:02.718807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:02.788675 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e9fc0a9f-ff15-435f-8258-7b1ed74b9245 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/7aa3d612101841bbb3d91fd16f0ed80a?user_id=a32147df26514338bfa2fbd8882740d8" status: 200 len: 240 microversion: 2.36 time: 0.184666 Sep 08 12:38:02.796547 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 53/103] 10.222.0.78 () {62 vars in 1384 bytes} [Thu Sep 8 12:38:02 2022] PUT /compute/v2.1/os-quota-sets/7aa3d612101841bbb3d91fd16f0ed80a?user_id=a32147df26514338bfa2fbd8882740d8 => generated 240 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:38:02.802267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cce31c94-7d97-43b1-ae16-984957b22554 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] Calling method '.version_select at 0x7fdb37a5a820>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:02.911204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d75f0367-c073-4707-931f-31510bb5f08c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:02.911818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d75f0367-c073-4707-931f-31510bb5f08c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:02.915893 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cce31c94-7d97-43b1-ae16-984957b22554 tempest-QuotasAdminTestV236-191872883 tempest-QuotasAdminTestV236-191872883-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/7aa3d612101841bbb3d91fd16f0ed80a?user_id=a32147df26514338bfa2fbd8882740d8" status: 200 len: 282 microversion: 2.36 time: 0.117789 Sep 08 12:38:02.916955 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 51/104] 10.222.0.78 () {60 vars in 1364 bytes} [Thu Sep 8 12:38:02 2022] GET /compute/v2.1/os-quota-sets/7aa3d612101841bbb3d91fd16f0ed80a?user_id=a32147df26514338bfa2fbd8882740d8 => generated 282 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 12:38:02.928682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d75f0367-c073-4707-931f-31510bb5f08c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:02.930008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d75f0367-c073-4707-931f-31510bb5f08c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:02.930732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d75f0367-c073-4707-931f-31510bb5f08c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:02.931902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d75f0367-c073-4707-931f-31510bb5f08c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:02.932516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d75f0367-c073-4707-931f-31510bb5f08c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:02.933222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d75f0367-c073-4707-931f-31510bb5f08c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:03.031820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d75f0367-c073-4707-931f-31510bb5f08c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:03.041437 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d75f0367-c073-4707-931f-31510bb5f08c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1337 microversion: 2.1 time: 0.136343 Sep 08 12:38:03.042282 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 54/105] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:02 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1337 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:03.610535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-09876021-24d8-4c5e-a0e3-9cd735d5c98e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:03.611153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-09876021-24d8-4c5e-a0e3-9cd735d5c98e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:03.613392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:03.623673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09876021-24d8-4c5e-a0e3-9cd735d5c98e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:03.625590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09876021-24d8-4c5e-a0e3-9cd735d5c98e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:03.639026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6277d321-8384-44d8-8a94-eaf48acf37a2 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:03.640381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6277d321-8384-44d8-8a94-eaf48acf37a2 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:03.644601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09876021-24d8-4c5e-a0e3-9cd735d5c98e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:03.650230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6277d321-8384-44d8-8a94-eaf48acf37a2 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:03.657593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09876021-24d8-4c5e-a0e3-9cd735d5c98e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:03.659427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09876021-24d8-4c5e-a0e3-9cd735d5c98e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:03.660085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09876021-24d8-4c5e-a0e3-9cd735d5c98e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:03.665455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6277d321-8384-44d8-8a94-eaf48acf37a2 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:03.667046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6277d321-8384-44d8-8a94-eaf48acf37a2 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:03.676827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6277d321-8384-44d8-8a94-eaf48acf37a2 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:03.678515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6277d321-8384-44d8-8a94-eaf48acf37a2 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:03.680030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6277d321-8384-44d8-8a94-eaf48acf37a2 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:04.464294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6277d321-8384-44d8-8a94-eaf48acf37a2 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:04.473900 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6277d321-8384-44d8-8a94-eaf48acf37a2 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1493 microversion: 2.1 time: 0.845589 Sep 08 12:38:04.474836 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 55/106] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:03 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1493 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:04.500570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-66dd308a-4192-427f-8201-6917b4e67db1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:04.501397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-66dd308a-4192-427f-8201-6917b4e67db1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:04.511454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66dd308a-4192-427f-8201-6917b4e67db1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:04.512362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66dd308a-4192-427f-8201-6917b4e67db1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:04.513174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66dd308a-4192-427f-8201-6917b4e67db1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:04.514150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66dd308a-4192-427f-8201-6917b4e67db1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:04.514822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66dd308a-4192-427f-8201-6917b4e67db1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:04.515519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66dd308a-4192-427f-8201-6917b4e67db1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:04.601159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-09876021-24d8-4c5e-a0e3-9cd735d5c98e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:04.610115 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-09876021-24d8-4c5e-a0e3-9cd735d5c98e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1312 microversion: 2.1 time: 1.003803 Sep 08 12:38:04.610922 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 52/107] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:03 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1312 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:04.634869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-66dd308a-4192-427f-8201-6917b4e67db1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:04.647014 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-66dd308a-4192-427f-8201-6917b4e67db1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1343 microversion: 2.1 time: 0.151915 Sep 08 12:38:04.648665 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 56/108] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:04 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1343 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:05.499467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-41538682-f22d-4481-9fc1-e52738c7c33d tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:05.500098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-41538682-f22d-4481-9fc1-e52738c7c33d tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:05.508548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41538682-f22d-4481-9fc1-e52738c7c33d tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:05.511877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41538682-f22d-4481-9fc1-e52738c7c33d tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:05.512763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41538682-f22d-4481-9fc1-e52738c7c33d tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:05.517012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41538682-f22d-4481-9fc1-e52738c7c33d tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:05.517738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41538682-f22d-4481-9fc1-e52738c7c33d tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:05.518363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41538682-f22d-4481-9fc1-e52738c7c33d tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:05.635316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-81d79ca4-7c6d-4179-a3cc-ec1664602a13 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:05.636065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-81d79ca4-7c6d-4179-a3cc-ec1664602a13 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:05.643419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-41538682-f22d-4481-9fc1-e52738c7c33d tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e50364fb741400ea5db073dce8e39ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7f5e5869f2c493d92f38d20f8291c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:05.653480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81d79ca4-7c6d-4179-a3cc-ec1664602a13 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:05.654552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81d79ca4-7c6d-4179-a3cc-ec1664602a13 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:05.655018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81d79ca4-7c6d-4179-a3cc-ec1664602a13 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:05.655984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81d79ca4-7c6d-4179-a3cc-ec1664602a13 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:05.656619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81d79ca4-7c6d-4179-a3cc-ec1664602a13 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:05.657228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81d79ca4-7c6d-4179-a3cc-ec1664602a13 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:05.664650 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-41538682-f22d-4481-9fc1-e52738c7c33d tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 200 len: 1322 microversion: 2.1 time: 0.161713 Sep 08 12:38:05.667190 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 53/109] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:05 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:05.686210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26ccd2c3-69e6-463d-ab2f-1707f15adf16 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:05.691318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-26ccd2c3-69e6-463d-ab2f-1707f15adf16 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:05.713553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26ccd2c3-69e6-463d-ab2f-1707f15adf16 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:05.714701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26ccd2c3-69e6-463d-ab2f-1707f15adf16 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:05.715666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26ccd2c3-69e6-463d-ab2f-1707f15adf16 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:05.716907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26ccd2c3-69e6-463d-ab2f-1707f15adf16 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:05.718803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26ccd2c3-69e6-463d-ab2f-1707f15adf16 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:05.720515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26ccd2c3-69e6-463d-ab2f-1707f15adf16 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:06.187843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-81d79ca4-7c6d-4179-a3cc-ec1664602a13 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:06.196979 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-81d79ca4-7c6d-4179-a3cc-ec1664602a13 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1312 microversion: 2.1 time: 0.566787 Sep 08 12:38:06.211736 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 57/110] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:05 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1312 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:06.262908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26ccd2c3-69e6-463d-ab2f-1707f15adf16 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:06.279546 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-26ccd2c3-69e6-463d-ab2f-1707f15adf16 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1410 microversion: 2.1 time: 0.609200 Sep 08 12:38:06.280183 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 54/111] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:05 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1410 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:06.507152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-cec75974-daab-4b96-a2ca-8c94990927e0 req-024152d4-c68f-41df-b3a0-8c764a3206db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "262b5661-21ae-42a9-8102-c088ff2868e2", "name": "network-vif-deleted", "tag": "6b93304d-8fe4-4dc9-89b3-3515fa282a3a"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:06.531131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cec75974-daab-4b96-a2ca-8c94990927e0 req-024152d4-c68f-41df-b3a0-8c764a3206db service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:06.532327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cec75974-daab-4b96-a2ca-8c94990927e0 req-024152d4-c68f-41df-b3a0-8c764a3206db service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:06.532864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cec75974-daab-4b96-a2ca-8c94990927e0 req-024152d4-c68f-41df-b3a0-8c764a3206db service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:06.548060 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-cec75974-daab-4b96-a2ca-8c94990927e0 req-024152d4-c68f-41df-b3a0-8c764a3206db service nova] Creating event network-vif-deleted:6b93304d-8fe4-4dc9-89b3-3515fa282a3a for instance 262b5661-21ae-42a9-8102-c088ff2868e2 on n-h2-852084-10 Sep 08 12:38:06.555159 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-cec75974-daab-4b96-a2ca-8c94990927e0 req-024152d4-c68f-41df-b3a0-8c764a3206db service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.341526 Sep 08 12:38:06.556268 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 58/112] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:06.697857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-415711ef-e4df-4361-8532-4502e911c0a3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:06.699023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-415711ef-e4df-4361-8532-4502e911c0a3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:06.707677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-415711ef-e4df-4361-8532-4502e911c0a3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:06.708494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-415711ef-e4df-4361-8532-4502e911c0a3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:06.708870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-415711ef-e4df-4361-8532-4502e911c0a3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:06.710361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-415711ef-e4df-4361-8532-4502e911c0a3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:06.710803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-415711ef-e4df-4361-8532-4502e911c0a3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:06.711417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-415711ef-e4df-4361-8532-4502e911c0a3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:06.729773 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-415711ef-e4df-4361-8532-4502e911c0a3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] HTTP exception thrown: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-415711ef-e4df-4361-8532-4502e911c0a3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Request method failure captured: Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 HTTP/1.1 Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeH-srrMghV2FJ-8yzErrLul4RubY0vh6-5W132685C9jDqAoxfnwTLQT6x7855tPzbFyaln8amDAkWHZ6DMPuMW9DF0Zdwm--Cmufo99xXS5WIOM3pvubSyr1ryVQrsgAFk_zdzw4vQJzBVleo8pG4ZcgPFZe1u95ItWhBiGhLvoKM Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: e7f5e5869f2c493d92f38d20f8291c21 Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AggregatesAdminTestJSON-979723651 Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:06.735177 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:06.736438 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e7f5e5869f2c493d92f38d20f8291c21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e7f5e5869f2c493d92f38d20f8291c21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e7f5e5869f2c493d92f38d20f8291c21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e7f5e5869f2c493d92f38d20f8291c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:06.736438 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AggregatesAdminTestJSON-979723651 Sep 08 12:38:06.736438 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: e7f5e5869f2c493d92f38d20f8291c21 Sep 08 12:38:06.736438 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-979723651 Sep 08 12:38:06.736438 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AggregatesAdminTestJSON-979723651-project Sep 08 12:38:06.736438 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:06.736438 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:06.736438 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 1e50364fb741400ea5db073dce8e39ca Sep 08 12:38:06.736438 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AggregatesAdminTestJSON-979723651-project Sep 08 12:38:06.736438 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:38:06.736438 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:06.736438 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '262b5661-21ae-42a9-8102-c088ff2868e2'} Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:06.737189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:06.740136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:06.742559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-415711ef-e4df-4361-8532-4502e911c0a3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Returning 404 to user: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:06.742559 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-415711ef-e4df-4361-8532-4502e911c0a3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 404 len: 111 microversion: 2.1 time: 0.044672 Sep 08 12:38:06.742559 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 55/113] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:06 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:06.747730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ebe2fc80-bf85-4412-bba0-9720e8183e07 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-10"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:06.763395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebe2fc80-bf85-4412-bba0-9720e8183e07 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:06.763891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebe2fc80-bf85-4412-bba0-9720e8183e07 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:06.764637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebe2fc80-bf85-4412-bba0-9720e8183e07 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:06.768499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:07.092141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-19d1cce3-4f64-4e95-86fa-22a5a4771aea req-d212c77c-74a7-4b26-9651-1a748e30a953 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164b7ad7-b8db-4492-a973-c90ee923e01b", "tag": "e3298c03-e65b-4468-977e-c289c1d17507"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:07.120544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-19d1cce3-4f64-4e95-86fa-22a5a4771aea req-d212c77c-74a7-4b26-9651-1a748e30a953 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:07.122274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-19d1cce3-4f64-4e95-86fa-22a5a4771aea req-d212c77c-74a7-4b26-9651-1a748e30a953 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:07.124019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-19d1cce3-4f64-4e95-86fa-22a5a4771aea req-d212c77c-74a7-4b26-9651-1a748e30a953 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:07.161387 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-19d1cce3-4f64-4e95-86fa-22a5a4771aea req-d212c77c-74a7-4b26-9651-1a748e30a953 service nova] Creating event network-changed:e3298c03-e65b-4468-977e-c289c1d17507 for instance 164b7ad7-b8db-4492-a973-c90ee923e01b on n-h2-852084-10 Sep 08 12:38:07.175676 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-19d1cce3-4f64-4e95-86fa-22a5a4771aea req-d212c77c-74a7-4b26-9651-1a748e30a953 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085786 Sep 08 12:38:07.177008 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 56/114] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:38:07.223261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b6723d17-14e1-4ded-80ff-2a45d3664502 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:07.223988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b6723d17-14e1-4ded-80ff-2a45d3664502 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:07.241250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6723d17-14e1-4ded-80ff-2a45d3664502 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:07.241755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6723d17-14e1-4ded-80ff-2a45d3664502 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:07.242188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6723d17-14e1-4ded-80ff-2a45d3664502 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:07.243100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6723d17-14e1-4ded-80ff-2a45d3664502 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:07.243733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6723d17-14e1-4ded-80ff-2a45d3664502 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:07.244307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6723d17-14e1-4ded-80ff-2a45d3664502 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:07.257490 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ebe2fc80-bf85-4412-bba0-9720e8183e07 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 297 microversion: 2.1 time: 0.514056 Sep 08 12:38:07.259264 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 59/115] 10.222.0.78 () {60 vars in 1191 bytes} [Thu Sep 8 12:38:06 2022] POST /compute/v2.1/os-aggregates/1/action => generated 297 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:38:07.277164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6947f001-4591-4a99-a4c2-dc169001a996 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:07.328426 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6947f001-4591-4a99-a4c2-dc169001a996 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.060771 Sep 08 12:38:07.330564 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 60/116] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:07 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:07.345256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54189c9e-6e97-4be0-b1cf-dd8a87845985 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:07.346237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54189c9e-6e97-4be0-b1cf-dd8a87845985 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:07.360131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54189c9e-6e97-4be0-b1cf-dd8a87845985 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:07.360924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54189c9e-6e97-4be0-b1cf-dd8a87845985 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:07.361765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54189c9e-6e97-4be0-b1cf-dd8a87845985 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:07.362722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54189c9e-6e97-4be0-b1cf-dd8a87845985 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:07.363352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54189c9e-6e97-4be0-b1cf-dd8a87845985 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:07.364518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54189c9e-6e97-4be0-b1cf-dd8a87845985 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:07.580256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b6723d17-14e1-4ded-80ff-2a45d3664502 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:07.589518 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b6723d17-14e1-4ded-80ff-2a45d3664502 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1312 microversion: 2.1 time: 0.370399 Sep 08 12:38:07.590886 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 57/117] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:07 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1312 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:07.597580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bff591be-7f02-47ee-af8a-e5ea00cf4fe0 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-676757245"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:07.604947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.aggregate [None req-bff591be-7f02-47ee-af8a-e5ea00cf4fe0 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Generated uuid 7b12d1f1-63c7-4a22-a5aa-b3c3f8a62ad8 for aggregate {{(pid=128970) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:07.640662 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bff591be-7f02-47ee-af8a-e5ea00cf4fe0 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.048424 Sep 08 12:38:07.641535 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 58/118] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:07 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:07.656423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9a906fdc-3e11-4fd8-8775-52cbe3c33e92 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-10"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:07.671964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:07.672631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54189c9e-6e97-4be0-b1cf-dd8a87845985 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:07.674334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a906fdc-3e11-4fd8-8775-52cbe3c33e92 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:07.675313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a906fdc-3e11-4fd8-8775-52cbe3c33e92 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:07.676136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a906fdc-3e11-4fd8-8775-52cbe3c33e92 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:07.689200 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54189c9e-6e97-4be0-b1cf-dd8a87845985 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1389 microversion: 2.1 time: 0.357098 Sep 08 12:38:07.690746 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 61/119] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:07 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1389 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:07.853390 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9a906fdc-3e11-4fd8-8775-52cbe3c33e92 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 242 microversion: 2.1 time: 0.202280 Sep 08 12:38:07.854261 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 59/120] 10.222.0.78 () {60 vars in 1191 bytes} [Thu Sep 8 12:38:07 2022] POST /compute/v2.1/os-aggregates/2/action => generated 242 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:07.871010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8a461abc-6fce-4225-a6c0-a8350b9aa982 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:07.883652 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8a461abc-6fce-4225-a6c0-a8350b9aa982 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/2" status: 200 len: 242 microversion: 2.1 time: 0.016624 Sep 08 12:38:07.884234 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 62/121] 10.222.0.78 () {58 vars in 1149 bytes} [Thu Sep 8 12:38:07 2022] GET /compute/v2.1/os-aggregates/2 => generated 242 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:07.896819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-42d62b09-c5e8-49b8-8613-f6077fb57704 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-10"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:07.913536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42d62b09-c5e8-49b8-8613-f6077fb57704 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:07.914214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42d62b09-c5e8-49b8-8613-f6077fb57704 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:07.914655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42d62b09-c5e8-49b8-8613-f6077fb57704 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:07.920480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:08.067219 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-42d62b09-c5e8-49b8-8613-f6077fb57704 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 226 microversion: 2.1 time: 0.175154 Sep 08 12:38:08.068240 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 60/122] 10.222.0.78 () {60 vars in 1191 bytes} [Thu Sep 8 12:38:07 2022] POST /compute/v2.1/os-aggregates/2/action => generated 226 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:38:08.083368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a0e4940b-ee2d-4084-923d-7cc8a59ee63c tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:08.112934 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a0e4940b-ee2d-4084-923d-7cc8a59ee63c tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.033395 Sep 08 12:38:08.113773 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 63/123] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:08 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:08.127672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fdc9c422-c6b0-4e2a-b180-251946952a13 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1583168743"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:08.133508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.aggregate [None req-fdc9c422-c6b0-4e2a-b180-251946952a13 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Generated uuid 974aec08-84b7-4253-b5d9-ec249973794d for aggregate {{(pid=128970) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:08.163755 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fdc9c422-c6b0-4e2a-b180-251946952a13 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.041546 Sep 08 12:38:08.164952 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 61/124] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:08 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:08.176840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fb3027f6-7b0a-4dd0-b2b8-ff7d96b684f9 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-10"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:08.191120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb3027f6-7b0a-4dd0-b2b8-ff7d96b684f9 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:08.191738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb3027f6-7b0a-4dd0-b2b8-ff7d96b684f9 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:08.192554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb3027f6-7b0a-4dd0-b2b8-ff7d96b684f9 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:08.334307 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fb3027f6-7b0a-4dd0-b2b8-ff7d96b684f9 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.161143 Sep 08 12:38:08.335124 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 64/125] 10.222.0.78 () {60 vars in 1191 bytes} [Thu Sep 8 12:38:08 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:08.346964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c9ebb292-578f-44fc-98d9-7ed0a2bb4923 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:08.358132 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c9ebb292-578f-44fc-98d9-7ed0a2bb4923 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.015514 Sep 08 12:38:08.358712 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 62/126] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 12:38:08 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:38:08.370847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e324018-26bb-4e47-899a-7c48895fb571 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-10"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:08.385899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e324018-26bb-4e47-899a-7c48895fb571 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:08.385899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e324018-26bb-4e47-899a-7c48895fb571 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:08.386270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e324018-26bb-4e47-899a-7c48895fb571 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:08.521374 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e324018-26bb-4e47-899a-7c48895fb571 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.154821 Sep 08 12:38:08.522065 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 65/127] 10.222.0.78 () {60 vars in 1191 bytes} [Thu Sep 8 12:38:08 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:08.533968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-685ba694-149e-4efa-8114-c01d6a616b62 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:08.561417 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-685ba694-149e-4efa-8114-c01d6a616b62 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.031416 Sep 08 12:38:08.562579 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 63/128] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:08 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:08.572768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b366d118-fb2d-4b79-92de-606226491df1 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-829371827"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:08.585327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.aggregate [None req-b366d118-fb2d-4b79-92de-606226491df1 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Generated uuid 703ce472-75c5-4ba7-9eaa-a079aa921822 for aggregate {{(pid=128971) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:08.601605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-8af4ce85-c475-4b31-8af8-3a34839e8a0e req-60181f00-b0dd-4369-8258-a281dceb14f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f08576a-9db5-42b3-967c-2b64c7b70d35", "tag": "c0202d88-6f01-4f52-9d83-e48a31f22c1d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:08.621247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8af4ce85-c475-4b31-8af8-3a34839e8a0e req-60181f00-b0dd-4369-8258-a281dceb14f9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:08.622507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:08.623592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8af4ce85-c475-4b31-8af8-3a34839e8a0e req-60181f00-b0dd-4369-8258-a281dceb14f9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:08.624627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8af4ce85-c475-4b31-8af8-3a34839e8a0e req-60181f00-b0dd-4369-8258-a281dceb14f9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:08.635516 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b366d118-fb2d-4b79-92de-606226491df1 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.066315 Sep 08 12:38:08.637271 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 66/129] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:08 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:08.644322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eeb8a60b-5385-4697-9b30-ccd877d5cb09 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:08.645344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eeb8a60b-5385-4697-9b30-ccd877d5cb09 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:08.653236 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-8af4ce85-c475-4b31-8af8-3a34839e8a0e req-60181f00-b0dd-4369-8258-a281dceb14f9 service nova] Creating event network-changed:c0202d88-6f01-4f52-9d83-e48a31f22c1d for instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 on n-h1-852084-10 Sep 08 12:38:08.654328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eeb8a60b-5385-4697-9b30-ccd877d5cb09 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:08.655051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eeb8a60b-5385-4697-9b30-ccd877d5cb09 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:08.655740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eeb8a60b-5385-4697-9b30-ccd877d5cb09 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:08.657019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eeb8a60b-5385-4697-9b30-ccd877d5cb09 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:08.657689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eeb8a60b-5385-4697-9b30-ccd877d5cb09 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:08.658103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eeb8a60b-5385-4697-9b30-ccd877d5cb09 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:08.662679 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-8af4ce85-c475-4b31-8af8-3a34839e8a0e req-60181f00-b0dd-4369-8258-a281dceb14f9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064596 Sep 08 12:38:08.664088 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 64/130] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:38:08.672132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dea06aab-b138-475d-818e-eb60913ceb69 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-10"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:08.688032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dea06aab-b138-475d-818e-eb60913ceb69 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:08.688539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dea06aab-b138-475d-818e-eb60913ceb69 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:08.689000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dea06aab-b138-475d-818e-eb60913ceb69 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:08.926931 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dea06aab-b138-475d-818e-eb60913ceb69 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.260696 Sep 08 12:38:08.928793 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 65/131] 10.222.0.78 () {60 vars in 1191 bytes} [Thu Sep 8 12:38:08 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:08.934158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca27b5ee-a3c2-4870-bdca-6574744362a8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:08.935264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ca27b5ee-a3c2-4870-bdca-6574744362a8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:08.952897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca27b5ee-a3c2-4870-bdca-6574744362a8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:08.953906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca27b5ee-a3c2-4870-bdca-6574744362a8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:08.954655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca27b5ee-a3c2-4870-bdca-6574744362a8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:08.955850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca27b5ee-a3c2-4870-bdca-6574744362a8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:08.956595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca27b5ee-a3c2-4870-bdca-6574744362a8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:08.958098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca27b5ee-a3c2-4870-bdca-6574744362a8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:09.314301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eeb8a60b-5385-4697-9b30-ccd877d5cb09 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:09.326788 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eeb8a60b-5385-4697-9b30-ccd877d5cb09 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1312 microversion: 2.1 time: 0.688201 Sep 08 12:38:09.332474 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 67/132] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:08 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1312 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:09.351638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8b684a03-c5cc-4206-bc8d-2d8522f4db4f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-10"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:09.372156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b684a03-c5cc-4206-bc8d-2d8522f4db4f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:09.372576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b684a03-c5cc-4206-bc8d-2d8522f4db4f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:09.373015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b684a03-c5cc-4206-bc8d-2d8522f4db4f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:09.532592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ca27b5ee-a3c2-4870-bdca-6574744362a8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:09.542321 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca27b5ee-a3c2-4870-bdca-6574744362a8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1389 microversion: 2.1 time: 0.612134 Sep 08 12:38:09.549734 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8b684a03-c5cc-4206-bc8d-2d8522f4db4f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.215949 Sep 08 12:38:09.551180 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 68/133] 10.222.0.78 () {60 vars in 1191 bytes} [Thu Sep 8 12:38:09 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:09.557845 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 66/134] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:08 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1389 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:09.563695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1941cdcc-f89d-4852-821d-f43e27ca6510 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:09.605568 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1941cdcc-f89d-4852-821d-f43e27ca6510 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.045977 Sep 08 12:38:09.611857 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 67/135] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:09 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:09.772071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-83f4bff0-c21a-45c0-b318-31940418dc15 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Calling method '.version_select at 0x7fdb37878040>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:09.792759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-526746083", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:09.843767 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-83f4bff0-c21a-45c0-b318-31940418dc15 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/b2b770283b9c484c8dcdf57719db81bd" status: 200 len: 371 microversion: 2.1 time: 0.230608 Sep 08 12:38:09.844457 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 68/136] 10.222.0.78 () {58 vars in 1242 bytes} [Thu Sep 8 12:38:09 2022] GET /compute/v2.1/os-quota-sets/b2b770283b9c484c8dcdf57719db81bd => generated 371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:09.849087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-028db6ae-8f12-4c15-a598-9f1c126a1eb6 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1508200441"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:09.852397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.aggregate [None req-028db6ae-8f12-4c15-a598-9f1c126a1eb6 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Generated uuid 74a2bda6-855e-4b82-a953-b41377fb2fbd for aggregate {{(pid=128970) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:09.860765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:38:09.878807 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-028db6ae-8f12-4c15-a598-9f1c126a1eb6 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.033021 Sep 08 12:38:09.879896 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 69/137] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:09.884893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26fdaa17-fe44-45c5-a014-e6b948a4e62a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1388478648"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:09.889173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.aggregate [None req-26fdaa17-fe44-45c5-a014-e6b948a4e62a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Generated uuid ca61f59d-a433-4c7e-8a00-a010ad5d6dbc for aggregate {{(pid=128970) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:09.910555 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-26fdaa17-fe44-45c5-a014-e6b948a4e62a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.029352 Sep 08 12:38:09.912262 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 70/138] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:09.922680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-59a9c9fd-3d5e-4be5-89cd-f6ba42a8fd76 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Action: 'update', calling method: .version_select at 0x7fdb379261f0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:09.989309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59a9c9fd-3d5e-4be5-89cd-f6ba42a8fd76 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:09.989921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59a9c9fd-3d5e-4be5-89cd-f6ba42a8fd76 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:09.990123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59a9c9fd-3d5e-4be5-89cd-f6ba42a8fd76 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:09.990828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59a9c9fd-3d5e-4be5-89cd-f6ba42a8fd76 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:09.991294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59a9c9fd-3d5e-4be5-89cd-f6ba42a8fd76 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:09.991710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59a9c9fd-3d5e-4be5-89cd-f6ba42a8fd76 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:10.050543 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-59a9c9fd-3d5e-4be5-89cd-f6ba42a8fd76 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/b2b770283b9c484c8dcdf57719db81bd" status: 200 len: 328 microversion: 2.1 time: 0.136905 Sep 08 12:38:10.051182 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 71/139] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 12:38:09 2022] PUT /compute/v2.1/os-quota-sets/b2b770283b9c484c8dcdf57719db81bd => generated 328 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:10.055678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e160049-2221-4dfd-add3-e9e9a436095f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:10.079055 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8e160049-2221-4dfd-add3-e9e9a436095f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.026782 Sep 08 12:38:10.079850 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 72/140] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:10.086427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-25ba140c-5a7b-4319-baaa-be84fa0947fa tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-10"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:10.097879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25ba140c-5a7b-4319-baaa-be84fa0947fa tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:10.098022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:38:10.098382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:38:10.098484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25ba140c-5a7b-4319-baaa-be84fa0947fa tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:10.098855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:38:10.098980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25ba140c-5a7b-4319-baaa-be84fa0947fa tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:10.099306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:38:10.099734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:38:10.109043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:10.109523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:10.109983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:10.110701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:10.111149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:10.111610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:10.129861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:10.133988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:10.146586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:38:10.149002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:38:10.196375 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d41a6d58-aa38-4e49-830d-044262493b82 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643888 Sep 08 12:38:10.203646 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 69/141] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:38:10.204156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-11dcf1cd-f484-4c78-a290-dff9a1f5580c tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:10.221572 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-25ba140c-5a7b-4319-baaa-be84fa0947fa tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 243 microversion: 2.1 time: 0.140380 Sep 08 12:38:10.222368 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 73/142] 10.222.0.78 () {60 vars in 1191 bytes} [Thu Sep 8 12:38:10 2022] POST /compute/v2.1/os-aggregates/6/action => generated 243 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:10.229314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-707328ec-1095-4ded-a625-9b48044a6576 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:10.229624 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-11dcf1cd-f484-4c78-a290-dff9a1f5580c tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-quota-sets/b2b770283b9c484c8dcdf57719db81bd" status: 202 len: 0 microversion: 2.1 time: 0.029587 Sep 08 12:38:10.230308 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 70/143] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:38:10 2022] DELETE /compute/v2.1/os-quota-sets/b2b770283b9c484c8dcdf57719db81bd => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:10.236823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9682e5be-e3b1-4ebc-81c9-0543f6937a80 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:10.237733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9682e5be-e3b1-4ebc-81c9-0543f6937a80 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:10.242985 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-707328ec-1095-4ded-a625-9b48044a6576 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-707328ec-1095-4ded-a625-9b48044a6576 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Request method failure captured: Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-aggregates/5 HTTP/1.1 Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIAy9FzJ9FoZC9keAo5-3UuGTAl3uwvaAzQnh9v6QKnEIQFBrFNmee9j0QBD-Ah22sBebNp55gnUWzd9movfS_3zS0LypKMYucFJN367BvBKvpeJxPTKg4B9HvgqbEV1pF-YWBTn34QYlTz4cyRARUp9322p3y8394m9p2o4v2cyTk Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 1b8cde8151cf4f6191f94e6c9df5583b Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AggregatesAdminTestJSON-1149384044 Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:38:10.247928 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AggregatesAdminTestJSON-1149384044 Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 1b8cde8151cf4f6191f94e6c9df5583b Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1149384044 Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AggregatesAdminTestJSON-1149384044-project-admin Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b50a1f003f0c48369987207becbb9f59 Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AggregatesAdminTestJSON-1149384044-project-admin Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: exception: Aggregate 5 could not be found. Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '5'} Sep 08 12:38:10.249374 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:10.250272 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Sep 08 12:38:10.251610 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.254736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-707328ec-1095-4ded-a625-9b48044a6576 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:10.255861 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-707328ec-1095-4ded-a625-9b48044a6576 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.032316 Sep 08 12:38:10.256432 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 74/144] 10.222.0.78 () {58 vars in 1149 bytes} [Thu Sep 8 12:38:10 2022] GET /compute/v2.1/os-aggregates/5 => generated 77 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:10.261506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-460d503a-9ce7-4c77-bb89-0975fa6d5fc2 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-10"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:10.274238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-460d503a-9ce7-4c77-bb89-0975fa6d5fc2 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:10.274735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-460d503a-9ce7-4c77-bb89-0975fa6d5fc2 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:10.275365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-460d503a-9ce7-4c77-bb89-0975fa6d5fc2 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:10.309452 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-460d503a-9ce7-4c77-bb89-0975fa6d5fc2 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] HTTP exception thrown: Aggregate 6 already has host n-h2-852084-10. Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-460d503a-9ce7-4c77-bb89-0975fa6d5fc2 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Request method failure captured: Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-aggregates/6/action HTTP/1.1 Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 40 Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIE78lwh1WFhydqnHe6RvHBB1xFasLQLOsU4FeGvox4-JQmuLU6NqqyB2Ds6syp55T8IDtvQW3ZGjIjXTwPMqNFZm-ZpnOu8JjDNplrcaLaF_G6lv6xSjMmlVfqxGPfTQWOfDRqKv2IIEroHTnBpVo48kmP4l3jKkuP1DdHH253USo Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:38:10.313318 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 8b746b15dbf34e238da3fd392ef748f2 Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: {"add_host": {"host": "n-h2-852084-10"}} Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:38:10.314624 n-d-852084-10 devstack@n-api.service[128970]: exception: Aggregate 6 already has host n-h2-852084-10. Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '6', 'body': {'add_host': {'host': 'n-h2-852084-10'}}} Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result.read() Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 12:38:10.318991 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-852084-10-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi session.flush() Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 12:38:10.320160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 12:38:10.321437 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 12:38:10.322894 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result.read() Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-852084-10-6' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 8, 12, 38, 10, 296195), 'updated_at': None, 'host': 'n-h2-852084-10', 'aggregate_id': 6}] Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:10.324734 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 6 already has host n-h2-852084-10. Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.327136 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 6 already has host n-h2-852084-10. Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:10.329528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:10.332041 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 already has host n-h2-852084-10. Sep 08 12:38:10.332041 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.332041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-460d503a-9ce7-4c77-bb89-0975fa6d5fc2 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Returning 409 to user: Aggregate 6 already has host n-h2-852084-10. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:10.332041 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-460d503a-9ce7-4c77-bb89-0975fa6d5fc2 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/6/action" status: 409 len: 96 microversion: 2.1 time: 0.057424 Sep 08 12:38:10.332041 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 75/145] 10.222.0.78 () {60 vars in 1191 bytes} [Thu Sep 8 12:38:10 2022] POST /compute/v2.1/os-aggregates/6/action => generated 96 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Sep 08 12:38:10.333062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9682e5be-e3b1-4ebc-81c9-0543f6937a80 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:10.333732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c3ef19a9-91c8-400b-b3d5-c4f240c07792 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Calling method '.version_select at 0x7fdb379263a0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:10.334115 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9682e5be-e3b1-4ebc-81c9-0543f6937a80 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1216 microversion: 2.1 time: 0.093686 Sep 08 12:38:10.337428 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 71/146] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:10 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1216 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:10.341797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5664d59b-deef-4eae-9310-2472f907df0f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:10.359209 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-5664d59b-deef-4eae-9310-2472f907df0f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] HTTP exception thrown: Aggregate 5 could not be found. Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5664d59b-deef-4eae-9310-2472f907df0f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Request method failure captured: Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-aggregates/5 HTTP/1.1 Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIAy9FzJ9FoZC9keAo5-3UuGTAl3uwvaAzQnh9v6QKnEIQFBrFNmee9j0QBD-Ah22sBebNp55gnUWzd9movfS_3zS0LypKMYucFJN367BvBKvpeJxPTKg4B9HvgqbEV1pF-YWBTn34QYlTz4cyRARUp9322p3y8394m9p2o4v2cyTk Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 1b8cde8151cf4f6191f94e6c9df5583b Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AggregatesAdminTestJSON-1149384044 Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:38:10.365041 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AggregatesAdminTestJSON-1149384044 Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 1b8cde8151cf4f6191f94e6c9df5583b Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1149384044 Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AggregatesAdminTestJSON-1149384044-project-admin Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b50a1f003f0c48369987207becbb9f59 Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AggregatesAdminTestJSON-1149384044-project-admin Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: exception: Aggregate 5 could not be found. Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '5'} Sep 08 12:38:10.366207 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:10.366947 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 5 could not be found. Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 5 could not be found. Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:10.368855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:10.371300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:10.371300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:10.371300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:10.371300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 5 could not be found. Sep 08 12:38:10.371300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:10.371300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5664d59b-deef-4eae-9310-2472f907df0f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Returning 404 to user: Aggregate 5 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:10.371300 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5664d59b-deef-4eae-9310-2472f907df0f tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/5" status: 404 len: 77 microversion: 2.1 time: 0.029955 Sep 08 12:38:10.371300 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 72/147] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:10 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 77 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:10.372329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eedeeb85-5918-40f8-b5a4-dd1f362a21d3 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-10"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:10.383617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eedeeb85-5918-40f8-b5a4-dd1f362a21d3 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:10.384078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eedeeb85-5918-40f8-b5a4-dd1f362a21d3 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:10.384610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eedeeb85-5918-40f8-b5a4-dd1f362a21d3 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:10.409729 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c3ef19a9-91c8-400b-b3d5-c4f240c07792 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/b2b770283b9c484c8dcdf57719db81bd" status: 200 len: 371 microversion: 2.1 time: 0.093237 Sep 08 12:38:10.410473 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 76/148] 10.222.0.78 () {58 vars in 1242 bytes} [Thu Sep 8 12:38:10 2022] GET /compute/v2.1/os-quota-sets/b2b770283b9c484c8dcdf57719db81bd => generated 371 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:10.416755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-172d2095-c160-4a52-87c3-b843b8c3195d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:10.417462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-172d2095-c160-4a52-87c3-b843b8c3195d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:10.424456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-172d2095-c160-4a52-87c3-b843b8c3195d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:10.425186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-172d2095-c160-4a52-87c3-b843b8c3195d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:10.425629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-172d2095-c160-4a52-87c3-b843b8c3195d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:10.426812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-172d2095-c160-4a52-87c3-b843b8c3195d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:10.427433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-172d2095-c160-4a52-87c3-b843b8c3195d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:10.428021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-172d2095-c160-4a52-87c3-b843b8c3195d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:10.534929 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eedeeb85-5918-40f8-b5a4-dd1f362a21d3 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/6/action" status: 200 len: 227 microversion: 2.1 time: 0.166722 Sep 08 12:38:10.536003 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 73/149] 10.222.0.78 () {60 vars in 1191 bytes} [Thu Sep 8 12:38:10 2022] POST /compute/v2.1/os-aggregates/6/action => generated 227 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:10.540733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-efac5ffe-e324-49c6-9223-8c10cd8b698d tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2075857076", "name": "tempest-test_aggregate-1096575975"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:10.570034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.aggregate [None req-efac5ffe-e324-49c6-9223-8c10cd8b698d tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Generated uuid a954acfc-4ef1-407f-bceb-88373809e034 for aggregate {{(pid=128971) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:10.609834 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-efac5ffe-e324-49c6-9223-8c10cd8b698d tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.072680 Sep 08 12:38:10.610539 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 74/150] 10.222.0.78 () {60 vars in 1165 bytes} [Thu Sep 8 12:38:10 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:10.623388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-40814712-4eb3-4df9-bc88-c4945bab2826 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:10.628374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-172d2095-c160-4a52-87c3-b843b8c3195d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:10.638138 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-172d2095-c160-4a52-87c3-b843b8c3195d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1312 microversion: 2.1 time: 0.225137 Sep 08 12:38:10.638961 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 77/151] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:10 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1312 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:10.654149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1592cbe5-18c5-43d1-83c2-b3e3c7951337 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:10.654812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1592cbe5-18c5-43d1-83c2-b3e3c7951337 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:10.660724 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-40814712-4eb3-4df9-bc88-c4945bab2826 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.042272 Sep 08 12:38:10.661465 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 75/152] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:10 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:10.667017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=8,nova_api:DELETE=7 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:10.669641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a64f3edd-87c3-4aa5-88df-680632830405 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Calling method '.version_select at 0x7fdb3bb6aca0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:10.676497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1592cbe5-18c5-43d1-83c2-b3e3c7951337 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:10.677520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1592cbe5-18c5-43d1-83c2-b3e3c7951337 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:10.678556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1592cbe5-18c5-43d1-83c2-b3e3c7951337 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:10.678848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1592cbe5-18c5-43d1-83c2-b3e3c7951337 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:10.679338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1592cbe5-18c5-43d1-83c2-b3e3c7951337 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:10.679769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1592cbe5-18c5-43d1-83c2-b3e3c7951337 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:10.927966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1592cbe5-18c5-43d1-83c2-b3e3c7951337 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:10.935924 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a64f3edd-87c3-4aa5-88df-680632830405 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/6c57cd7e30ad4e21915e4827a5974ffc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.273294 Sep 08 12:38:10.936660 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 76/153] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 12:38:10 2022] GET /compute/v2.1/os-quota-sets/6c57cd7e30ad4e21915e4827a5974ffc/defaults => generated 371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:10.939315 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1592cbe5-18c5-43d1-83c2-b3e3c7951337 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1389 microversion: 2.1 time: 0.290151 Sep 08 12:38:10.939970 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 78/154] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:10 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1389 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:10.942776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9ab0e510-4f7b-4cdd-8f79-e2982631294b tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:10.963454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0a2c1f65-0106-4b74-ad3c-4f9ff93bd86c tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1868055376"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:10.974682 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9ab0e510-4f7b-4cdd-8f79-e2982631294b tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.036748 Sep 08 12:38:10.975733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.aggregate [None req-0a2c1f65-0106-4b74-ad3c-4f9ff93bd86c tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Generated uuid ffce91dc-872b-4b19-93c7-aef4c6e629de for aggregate {{(pid=128970) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:10.979519 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 77/155] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:10 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:10.985177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0ff6bac5-56bd-42ea-8a57-ca5b59a5cf37 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1040125957"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:10.989698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.aggregate [None req-0ff6bac5-56bd-42ea-8a57-ca5b59a5cf37 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Generated uuid cef4ce47-5959-44ec-aef1-c83aebf25500 for aggregate {{(pid=128971) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:11.008733 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0a2c1f65-0106-4b74-ad3c-4f9ff93bd86c tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.054221 Sep 08 12:38:11.018053 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 79/156] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:10 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:11.022231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a6535aa8-da3b-4a98-b5cb-b4d5579c46fe tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:11.043016 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0ff6bac5-56bd-42ea-8a57-ca5b59a5cf37 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.062206 Sep 08 12:38:11.046670 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 78/157] 10.222.0.78 () {62 vars in 1205 bytes} [Thu Sep 8 12:38:10 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:38:11.049517 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-a6535aa8-da3b-4a98-b5cb-b4d5579c46fe tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a6535aa8-da3b-4a98-b5cb-b4d5579c46fe tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Request method failure captured: Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIAy9FzJ9FoZC9keAo5-3UuGTAl3uwvaAzQnh9v6QKnEIQFBrFNmee9j0QBD-Ah22sBebNp55gnUWzd9movfS_3zS0LypKMYucFJN367BvBKvpeJxPTKg4B9HvgqbEV1pF-YWBTn34QYlTz4cyRARUp9322p3y8394m9p2o4v2cyTk Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 1b8cde8151cf4f6191f94e6c9df5583b Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AggregatesAdminTestJSON-1149384044 Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:38:11.051682 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AggregatesAdminTestJSON-1149384044 Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 1b8cde8151cf4f6191f94e6c9df5583b Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1149384044 Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AggregatesAdminTestJSON-1149384044-project-admin Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b50a1f003f0c48369987207becbb9f59 Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AggregatesAdminTestJSON-1149384044-project-admin Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: exception: Aggregate 7 could not be found. Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '7'} Sep 08 12:38:11.052925 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.053601 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 08 12:38:11.054567 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.055564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a6535aa8-da3b-4a98-b5cb-b4d5579c46fe tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:11.055564 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a6535aa8-da3b-4a98-b5cb-b4d5579c46fe tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.041315 Sep 08 12:38:11.055564 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 80/158] 10.222.0.78 () {58 vars in 1149 bytes} [Thu Sep 8 12:38:11 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:11.066941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3a50c8b5-b409-47cd-b4b4-0771a7144d25 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1937385573"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:11.213868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f68cafd6-fd84-4430-b758-8f6ab2fceccc tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-10"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:11.217777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f68cafd6-fd84-4430-b758-8f6ab2fceccc tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '9a9e0600db7d4271aa8fccbec650e3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc25558a747b4c368cd6fe59699f12b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f68cafd6-fd84-4430-b758-8f6ab2fceccc tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Request method failure captured: Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/os-aggregates/8/action HTTP/1.1 Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 40 Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIBhNGNoSOy15qig-HsGir3BrDZ-bYCjRr61wsWCGDjvLFPzg6YJXRYSPvGjM0SiGzFGftALHCgbEkRYCHgJZPqMGKolaqWycs60GLgEp7Y3BaZ1A5mCSZpEhsV6_SAsAnoDwNYF_mm4tWtwem6yhRmhgFolYf5KjMeJgbmsQOOmSI Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: cc25558a747b4c368cd6fe59699f12b6 Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:38:11.219924 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: cc25558a747b4c368cd6fe59699f12b6 Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AggregatesAdminNegativeTestJSON-1659174776-project Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9a9e0600db7d4271aa8fccbec650e3bf Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776-project Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: {"add_host": {"host": "n-h2-852084-10"}} Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:11.221397 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '8', 'body': {'add_host': {'host': 'n-h2-852084-10'}}} Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:11.222300 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Sep 08 12:38:11.223748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.225237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f68cafd6-fd84-4430-b758-8f6ab2fceccc tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:11.225952 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f68cafd6-fd84-4430-b758-8f6ab2fceccc tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates/8/action" status: 403 len: 118 microversion: 2.1 time: 0.177833 Sep 08 12:38:11.226779 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 79/159] 10.222.0.78 () {60 vars in 1191 bytes} [Thu Sep 8 12:38:11 2022] POST /compute/v2.1/os-aggregates/8/action => generated 118 bytes in 179 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:11.231548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-013025be-2715-4524-9e44-43de7083cd86 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:11.244304 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-013025be-2715-4524-9e44-43de7083cd86 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-013025be-2715-4524-9e44-43de7083cd86 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Request method failure captured: Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIAy9FzJ9FoZC9keAo5-3UuGTAl3uwvaAzQnh9v6QKnEIQFBrFNmee9j0QBD-Ah22sBebNp55gnUWzd9movfS_3zS0LypKMYucFJN367BvBKvpeJxPTKg4B9HvgqbEV1pF-YWBTn34QYlTz4cyRARUp9322p3y8394m9p2o4v2cyTk Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 1b8cde8151cf4f6191f94e6c9df5583b Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AggregatesAdminTestJSON-1149384044 Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:38:11.247432 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1b8cde8151cf4f6191f94e6c9df5583b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AggregatesAdminTestJSON-1149384044 Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 1b8cde8151cf4f6191f94e6c9df5583b Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1149384044 Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AggregatesAdminTestJSON-1149384044-project-admin Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b50a1f003f0c48369987207becbb9f59 Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AggregatesAdminTestJSON-1149384044-project-admin Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: exception: Aggregate 7 could not be found. Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '7'} Sep 08 12:38:11.248889 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:11.249834 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.251072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:11.252463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:11.252463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:11.252463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:11.252463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Sep 08 12:38:11.252463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.253823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-013025be-2715-4524-9e44-43de7083cd86 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:11.254955 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-013025be-2715-4524-9e44-43de7083cd86 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.027122 Sep 08 12:38:11.255781 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 80/160] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:11 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:11.263464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ccb93fb2-f3f5-4566-9b45-b3810335edfc tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:11.300271 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ccb93fb2-f3f5-4566-9b45-b3810335edfc tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.039964 Sep 08 12:38:11.301769 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 81/161] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:11 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:11.312038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-15bf217e-94f4-4695-8f4f-3eb24f2bcca4 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1209475954"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:11.319326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.aggregate [None req-15bf217e-94f4-4695-8f4f-3eb24f2bcca4 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Generated uuid 469bc527-1c5f-4fa6-943b-38695a564fa5 for aggregate {{(pid=128971) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:11.353109 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-15bf217e-94f4-4695-8f4f-3eb24f2bcca4 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.045407 Sep 08 12:38:11.353812 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 82/162] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:11 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:11.361228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6d7bbc92-8452-4651-9507-5d19ea9931fa tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1199473732"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:11.365559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.aggregate [None req-6d7bbc92-8452-4651-9507-5d19ea9931fa tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Generated uuid 1f716edd-b042-497b-af10-e8dd1a1a2775 for aggregate {{(pid=128971) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:11.368842 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3a50c8b5-b409-47cd-b4b4-0771a7144d25 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 299 microversion: 2.41 time: 0.305623 Sep 08 12:38:11.369917 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 81/163] 10.222.0.78 () {62 vars in 1210 bytes} [Thu Sep 8 12:38:11 2022] PUT /compute/v2.1/os-aggregates/9 => generated 299 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:38:11.384382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f5f24470-d00a-49fe-9f03-4fa2787e9c3b tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3791f790>, body: {"quota_set": {"ram": "5120"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:11.393610 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6d7bbc92-8452-4651-9507-5d19ea9931fa tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.038099 Sep 08 12:38:11.394928 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 83/164] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:11 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:11.408473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a9c97739-071c-498c-97bd-e4660daf5255 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:11.409837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a9c97739-071c-498c-97bd-e4660daf5255 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:11.422068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9c97739-071c-498c-97bd-e4660daf5255 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:11.422875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9c97739-071c-498c-97bd-e4660daf5255 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:11.423696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9c97739-071c-498c-97bd-e4660daf5255 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:11.424960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9c97739-071c-498c-97bd-e4660daf5255 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:11.425793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9c97739-071c-498c-97bd-e4660daf5255 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:11.426580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9c97739-071c-498c-97bd-e4660daf5255 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:11.514743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a9c97739-071c-498c-97bd-e4660daf5255 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:11.525261 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a9c97739-071c-498c-97bd-e4660daf5255 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1268 microversion: 2.1 time: 0.128882 Sep 08 12:38:11.525806 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 84/165] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:11 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1268 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:11.531443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-967d9dca-ba33-45fe-9248-1bb6dcacab9d tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:11.545469 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-967d9dca-ba33-45fe-9248-1bb6dcacab9d tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 228 microversion: 2.1 time: 0.018677 Sep 08 12:38:11.546055 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 85/166] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:11 2022] GET /compute/v2.1/os-aggregates/10 => generated 228 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:11.550759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c6192b63-bb4e-4678-b318-2bde768cfca9 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:11.559344 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c6192b63-bb4e-4678-b318-2bde768cfca9 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/9" status: 200 len: 299 microversion: 2.41 time: 0.012206 Sep 08 12:38:11.560100 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 86/167] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Sep 8 12:38:11 2022] GET /compute/v2.1/os-aggregates/9 => generated 299 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:38:11.568199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-094090b6-53fa-4c2d-bfe1-06f59663a54a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-134981826"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:11.584895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5f24470-d00a-49fe-9f03-4fa2787e9c3b tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:11.585383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5f24470-d00a-49fe-9f03-4fa2787e9c3b tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:11.585679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-094090b6-53fa-4c2d-bfe1-06f59663a54a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:11.585863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5f24470-d00a-49fe-9f03-4fa2787e9c3b tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:11.586196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-094090b6-53fa-4c2d-bfe1-06f59663a54a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:11.586549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5f24470-d00a-49fe-9f03-4fa2787e9c3b tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:11.586754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-094090b6-53fa-4c2d-bfe1-06f59663a54a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:11.587189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5f24470-d00a-49fe-9f03-4fa2787e9c3b tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:11.587656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5f24470-d00a-49fe-9f03-4fa2787e9c3b tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:11.595311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-094090b6-53fa-4c2d-bfe1-06f59663a54a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:11.596151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-094090b6-53fa-4c2d-bfe1-06f59663a54a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:11.597293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-094090b6-53fa-4c2d-bfe1-06f59663a54a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:11.607333 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-094090b6-53fa-4c2d-bfe1-06f59663a54a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-134981826 could not be found. Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-094090b6-53fa-4c2d-bfe1-06f59663a54a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Request method failure captured: Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 57 Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIE78lwh1WFhydqnHe6RvHBB1xFasLQLOsU4FeGvox4-JQmuLU6NqqyB2Ds6syp55T8IDtvQW3ZGjIjXTwPMqNFZm-ZpnOu8JjDNplrcaLaF_G6lv6xSjMmlVfqxGPfTQWOfDRqKv2IIEroHTnBpVo48kmP4l3jKkuP1DdHH253USo Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:38:11.609774 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 8b746b15dbf34e238da3fd392ef748f2 Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: {"add_host": {"host": "tempest-nonexist_host-134981826"}} Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:11.611008 n-d-852084-10 devstack@n-api.service[128971]: exception: Compute host tempest-nonexist_host-134981826 could not be found. Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '11', 'body': {'add_host': {'host': 'tempest-nonexist_host-134981826'}}} Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-134981826' is not mapped to any cell Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.611735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Sep 08 12:38:11.612738 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-134981826 could not be found. Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-134981826 could not be found. Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:11.613796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.615020 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.615020 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:11.615020 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:11.615020 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:11.615020 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:11.615020 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-134981826 could not be found. Sep 08 12:38:11.615020 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.615020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-094090b6-53fa-4c2d-bfe1-06f59663a54a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-134981826 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:11.615020 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-094090b6-53fa-4c2d-bfe1-06f59663a54a tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/11/action" status: 404 len: 110 microversion: 2.1 time: 0.047539 Sep 08 12:38:11.615020 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 87/168] 10.222.0.78 () {60 vars in 1194 bytes} [Thu Sep 8 12:38:11 2022] POST /compute/v2.1/os-aggregates/11/action => generated 110 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:11.620122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-70113406-7881-43c5-b013-5c44d83d0823 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:11.654937 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-70113406-7881-43c5-b013-5c44d83d0823 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 266 microversion: 2.1 time: 0.041285 Sep 08 12:38:11.655912 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 88/169] 10.222.0.78 () {60 vars in 1194 bytes} [Thu Sep 8 12:38:11 2022] POST /compute/v2.1/os-aggregates/10/action => generated 266 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:11.659686 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f5f24470-d00a-49fe-9f03-4fa2787e9c3b tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/900af1bcbdf4460893a531d8664813ee" status: 200 len: 328 microversion: 2.1 time: 0.287406 Sep 08 12:38:11.660390 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 82/170] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 12:38:11 2022] PUT /compute/v2.1/os-quota-sets/900af1bcbdf4460893a531d8664813ee => generated 328 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:11.661911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6da69831-e7a0-4777-b86c-af34dbd14864 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-10"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:11.673688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7aa763e9-21b0-4d13-82bd-0bdbc7b9b7bb tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:11.682159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6da69831-e7a0-4777-b86c-af34dbd14864 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:11.682726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6da69831-e7a0-4777-b86c-af34dbd14864 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:11.683172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6da69831-e7a0-4777-b86c-af34dbd14864 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:11.695719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=10,nova_api:INSERT=9 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:11.714389 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7aa763e9-21b0-4d13-82bd-0bdbc7b9b7bb tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.052460 Sep 08 12:38:11.715432 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 83/171] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:11 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:11.726533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-795c6226-5a96-4d01-bc64-a1cb2ad99b85 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:11.738460 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-795c6226-5a96-4d01-bc64-a1cb2ad99b85 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/10" status: 200 len: 242 microversion: 2.1 time: 0.021288 Sep 08 12:38:11.739520 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 84/172] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:11 2022] GET /compute/v2.1/os-aggregates/10 => generated 242 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:11.745266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1a7af33b-e921-4050-a2cf-ce9ade1544c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:11.746232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1a7af33b-e921-4050-a2cf-ce9ade1544c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:11.754101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a7af33b-e921-4050-a2cf-ce9ade1544c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:11.754599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a7af33b-e921-4050-a2cf-ce9ade1544c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:11.755090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a7af33b-e921-4050-a2cf-ce9ade1544c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:11.755825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a7af33b-e921-4050-a2cf-ce9ade1544c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:11.756283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a7af33b-e921-4050-a2cf-ce9ade1544c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:11.756709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a7af33b-e921-4050-a2cf-ce9ade1544c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:11.850440 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6da69831-e7a0-4777-b86c-af34dbd14864 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 315 microversion: 2.41 time: 0.193714 Sep 08 12:38:11.851077 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 89/173] 10.222.0.78 () {62 vars in 1232 bytes} [Thu Sep 8 12:38:11 2022] POST /compute/v2.1/os-aggregates/9/action => generated 315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:38:11.858702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62abc562-5f79-44b4-83ed-3bab890cafbe tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Calling method '.version_select at 0x7fdb3bb6a550>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:11.932380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62abc562-5f79-44b4-83ed-3bab890cafbe tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:11.932870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62abc562-5f79-44b4-83ed-3bab890cafbe tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:11.933305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62abc562-5f79-44b4-83ed-3bab890cafbe tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:11.935009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62abc562-5f79-44b4-83ed-3bab890cafbe tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:11.935509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62abc562-5f79-44b4-83ed-3bab890cafbe tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:11.935939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62abc562-5f79-44b4-83ed-3bab890cafbe tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:11.958019 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62abc562-5f79-44b4-83ed-3bab890cafbe tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/900af1bcbdf4460893a531d8664813ee/detail" status: 200 len: 916 microversion: 2.1 time: 0.105144 Sep 08 12:38:11.958897 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 90/174] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:38:11 2022] GET /compute/v2.1/os-quota-sets/900af1bcbdf4460893a531d8664813ee/detail => generated 916 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:11.976439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f408d775-9fb6-4f06-aaab-e8f4776659c1 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:11.985174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a7af33b-e921-4050-a2cf-ce9ade1544c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:11.993972 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1a7af33b-e921-4050-a2cf-ce9ade1544c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1312 microversion: 2.1 time: 0.253031 Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f408d775-9fb6-4f06-aaab-e8f4776659c1 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Request method failure captured: Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 283 Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIE78lwh1WFhydqnHe6RvHBB1xFasLQLOsU4FeGvox4-JQmuLU6NqqyB2Ds6syp55T8IDtvQW3ZGjIjXTwPMqNFZm-ZpnOu8JjDNplrcaLaF_G6lv6xSjMmlVfqxGPfTQWOfDRqKv2IIEroHTnBpVo48kmP4l3jKkuP1DdHH253USo Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:38:11.994211 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:38:11.995707 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:11.995707 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:11.995707 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:11.995707 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:11.995707 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:11.995707 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:11.995707 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:11.995707 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 8b746b15dbf34e238da3fd392ef748f2 Sep 08 12:38:11.995707 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:11.995707 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:38:11.996270 n-d-852084-10 devstack@n-api.service[128971]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 08 12:38:11.996270 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:11.996270 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 12:38:11.996270 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 08 12:38:11.996270 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:11.996270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.996270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:38:11.996270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:38:11.996270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:38:11.996270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:11.996871 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:11.997772 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:11.999566 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:38:11.999566 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:38:11.999566 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 12:38:11.999566 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:11.999566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f408d775-9fb6-4f06-aaab-e8f4776659c1 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:12.000182 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f408d775-9fb6-4f06-aaab-e8f4776659c1 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.038198 Sep 08 12:38:12.006198 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 91/175] 10.222.0.78 () {60 vars in 1165 bytes} [Thu Sep 8 12:38:11 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:38:12.012025 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 85/176] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:11 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1312 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:12.012906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-53917030-6f0d-46cf-96d0-20fd8cfef054 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:12.023667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c2fee1e6-1f71-4617-b5e8-c13c4063c12c tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-10"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:12.050924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2fee1e6-1f71-4617-b5e8-c13c4063c12c tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.051700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2fee1e6-1f71-4617-b5e8-c13c4063c12c tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.051936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2fee1e6-1f71-4617-b5e8-c13c4063c12c tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.052527 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-53917030-6f0d-46cf-96d0-20fd8cfef054 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.044836 Sep 08 12:38:12.054499 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 92/177] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:12 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:12.064505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-73d27209-98e1-4c04-ba1e-5b7706d3fb90 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:12.066091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-73d27209-98e1-4c04-ba1e-5b7706d3fb90 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:12.074860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73d27209-98e1-4c04-ba1e-5b7706d3fb90 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.075892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73d27209-98e1-4c04-ba1e-5b7706d3fb90 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.076347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73d27209-98e1-4c04-ba1e-5b7706d3fb90 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.077119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73d27209-98e1-4c04-ba1e-5b7706d3fb90 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.077582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73d27209-98e1-4c04-ba1e-5b7706d3fb90 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.078011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73d27209-98e1-4c04-ba1e-5b7706d3fb90 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.235462 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c2fee1e6-1f71-4617-b5e8-c13c4063c12c tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 299 microversion: 2.41 time: 0.221977 Sep 08 12:38:12.236472 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 86/178] 10.222.0.78 () {62 vars in 1232 bytes} [Thu Sep 8 12:38:12 2022] POST /compute/v2.1/os-aggregates/9/action => generated 299 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:38:12.241685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cb23998c-e595-41cf-851d-c75003410aee tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cb23998c-e595-41cf-851d-c75003410aee tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Request method failure captured: Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 27 Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIE78lwh1WFhydqnHe6RvHBB1xFasLQLOsU4FeGvox4-JQmuLU6NqqyB2Ds6syp55T8IDtvQW3ZGjIjXTwPMqNFZm-ZpnOu8JjDNplrcaLaF_G6lv6xSjMmlVfqxGPfTQWOfDRqKv2IIEroHTnBpVo48kmP4l3jKkuP1DdHH253USo Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:38:12.246622 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 8b746b15dbf34e238da3fd392ef748f2 Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: {"aggregate": {"name": ""}} Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:38:12.247835 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'aggregate': {'name': ''}}} Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi '' Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:12.248517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 08 12:38:12.249692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.250717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cb23998c-e595-41cf-851d-c75003410aee tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:12.250717 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cb23998c-e595-41cf-851d-c75003410aee tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.011143 Sep 08 12:38:12.250717 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 87/179] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:12 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:38:12.263172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fa40fbbb-bba1-40c9-a9c3-8e0e2b65d2af tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1348138917", "availability_zone": "tempest-test_az-127267877"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:12.268699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.aggregate [None req-fa40fbbb-bba1-40c9-a9c3-8e0e2b65d2af tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Generated uuid add0253d-2dad-41ee-b593-f2401952886a for aggregate {{(pid=128970) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:12.305346 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fa40fbbb-bba1-40c9-a9c3-8e0e2b65d2af tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.052779 Sep 08 12:38:12.306839 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 88/180] 10.222.0.78 () {60 vars in 1165 bytes} [Thu Sep 8 12:38:12 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:12.318455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3787b040>, body: {"quota_set": {"ram": "2048"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:12.384170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-73d27209-98e1-4c04-ba1e-5b7706d3fb90 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:12.393558 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-73d27209-98e1-4c04-ba1e-5b7706d3fb90 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1389 microversion: 2.1 time: 0.337760 Sep 08 12:38:12.394300 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 93/181] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:12 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1389 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:12.398995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38ace865-03ac-4aca-9481-0b050bcf4c67 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:12.405044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.405535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.405968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.406699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.407156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.407601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.425939 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38ace865-03ac-4aca-9481-0b050bcf4c67 tempest-AggregatesAdminTestV241-1877393582 tempest-AggregatesAdminTestV241-1877393582-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.41 time: 0.030674 Sep 08 12:38:12.426533 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 94/182] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Sep 8 12:38:12 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:12.431265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a3a8b26b-3444-43e4-8761-78eea5ef299b tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1634804247"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:12.434757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a3a8b26b-3444-43e4-8761-78eea5ef299b tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '9a9e0600db7d4271aa8fccbec650e3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc25558a747b4c368cd6fe59699f12b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a3a8b26b-3444-43e4-8761-78eea5ef299b tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Request method failure captured: Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 60 Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIBhNGNoSOy15qig-HsGir3BrDZ-bYCjRr61wsWCGDjvLFPzg6YJXRYSPvGjM0SiGzFGftALHCgbEkRYCHgJZPqMGKolaqWycs60GLgEp7Y3BaZ1A5mCSZpEhsV6_SAsAnoDwNYF_mm4tWtwem6yhRmhgFolYf5KjMeJgbmsQOOmSI Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: cc25558a747b4c368cd6fe59699f12b6 Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:38:12.436464 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: cc25558a747b4c368cd6fe59699f12b6 Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AggregatesAdminNegativeTestJSON-1659174776-project Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9a9e0600db7d4271aa8fccbec650e3bf Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776-project Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: {"aggregate": {"name": "tempest-test_aggregate-1634804247"}} Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:12.437948 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1634804247'}}} Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:12.438785 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:12.439868 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Sep 08 12:38:12.442765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.442765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a3a8b26b-3444-43e4-8761-78eea5ef299b tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:12.442765 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a3a8b26b-3444-43e4-8761-78eea5ef299b tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.010320 Sep 08 12:38:12.442765 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 95/183] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:12 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:12.448457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a57de264-b08a-4d0f-afa1-4e9d27e1a835 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1348138917_new", "availability_zone": "tempest-test_az-127267877_new"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:12.489441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.493628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.497624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.497624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.497829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.502803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.574138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a57de264-b08a-4d0f-afa1-4e9d27e1a835 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.574646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a57de264-b08a-4d0f-afa1-4e9d27e1a835 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.575661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a57de264-b08a-4d0f-afa1-4e9d27e1a835 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.625015 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a57de264-b08a-4d0f-afa1-4e9d27e1a835 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/12" status: 200 len: 335 microversion: 2.1 time: 0.185609 Sep 08 12:38:12.625640 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 96/184] 10.222.0.78 () {60 vars in 1173 bytes} [Thu Sep 8 12:38:12 2022] PUT /compute/v2.1/os-aggregates/12 => generated 335 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:12.640818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b26a2ac7-4b76-4bf0-8d7c-fa425bdbf1c1 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1496731473"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:12.647832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.aggregate [None req-b26a2ac7-4b76-4bf0-8d7c-fa425bdbf1c1 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Generated uuid 18d0de0f-1757-4f77-b3a3-8d3c620ab4e8 for aggregate {{(pid=128971) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:12.650083 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f43e3c84-a638-4985-86bb-ca1a70993d24 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/900af1bcbdf4460893a531d8664813ee?user_id=c5b210384af14fde9c22f3fe5098994a" status: 200 len: 328 microversion: 2.1 time: 0.341743 Sep 08 12:38:12.652818 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 89/185] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 12:38:12 2022] PUT /compute/v2.1/os-quota-sets/900af1bcbdf4460893a531d8664813ee?user_id=c5b210384af14fde9c22f3fe5098994a => generated 328 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:12.665620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c10318ec-943f-40a9-ab60-3e4607d7daeb tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Calling method '.version_select at 0x7fdb379261f0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:12.670135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c10318ec-943f-40a9-ab60-3e4607d7daeb tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.670719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c10318ec-943f-40a9-ab60-3e4607d7daeb tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.671715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c10318ec-943f-40a9-ab60-3e4607d7daeb tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.672551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c10318ec-943f-40a9-ab60-3e4607d7daeb tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.673195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c10318ec-943f-40a9-ab60-3e4607d7daeb tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.674322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c10318ec-943f-40a9-ab60-3e4607d7daeb tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.682790 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b26a2ac7-4b76-4bf0-8d7c-fa425bdbf1c1 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.055584 Sep 08 12:38:12.690860 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 97/186] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:12 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:12.702550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fb5ce91f-081c-43fc-aef1-f80bc5ca2a09 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:12.703207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fb5ce91f-081c-43fc-aef1-f80bc5ca2a09 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:12.724327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb5ce91f-081c-43fc-aef1-f80bc5ca2a09 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.724559 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c10318ec-943f-40a9-ab60-3e4607d7daeb tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.070041 Sep 08 12:38:12.724813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb5ce91f-081c-43fc-aef1-f80bc5ca2a09 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.725188 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 90/187] 10.222.0.78 () {58 vars in 1128 bytes} [Thu Sep 8 12:38:12 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:12.725295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb5ce91f-081c-43fc-aef1-f80bc5ca2a09 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.725939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb5ce91f-081c-43fc-aef1-f80bc5ca2a09 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.726963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb5ce91f-081c-43fc-aef1-f80bc5ca2a09 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.727377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb5ce91f-081c-43fc-aef1-f80bc5ca2a09 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.731590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00ce422b-99b5-4724-8ab4-53b0df441968 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:12.740853 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00ce422b-99b5-4724-8ab4-53b0df441968 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 553 microversion: 2.1 time: 0.014617 Sep 08 12:38:12.741763 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 91/188] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 12:38:12 2022] GET /compute/v2.1/os-aggregates => generated 553 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:12.746366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8106560d-f2fd-4565-9ae7-a28e06447b7b tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Calling method '.version_select at 0x7fdb3787b0d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:12.851288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fb5ce91f-081c-43fc-aef1-f80bc5ca2a09 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:12.866413 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fb5ce91f-081c-43fc-aef1-f80bc5ca2a09 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1274 microversion: 2.1 time: 0.173895 Sep 08 12:38:12.879396 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 98/189] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:12 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1274 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:12.879396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec550b86-4699-4b0a-8c4c-8d55452c7840 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1496731473"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:12.879396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.aggregate [None req-ec550b86-4699-4b0a-8c4c-8d55452c7840 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Generated uuid b23d1bd0-cf2a-4ed2-9a36-f032155070da for aggregate {{(pid=128971) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:12.903897 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-ec550b86-4699-4b0a-8c4c-8d55452c7840 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1496731473 already exists. Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec550b86-4699-4b0a-8c4c-8d55452c7840 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Request method failure captured: Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 60 Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIE78lwh1WFhydqnHe6RvHBB1xFasLQLOsU4FeGvox4-JQmuLU6NqqyB2Ds6syp55T8IDtvQW3ZGjIjXTwPMqNFZm-ZpnOu8JjDNplrcaLaF_G6lv6xSjMmlVfqxGPfTQWOfDRqKv2IIEroHTnBpVo48kmP4l3jKkuP1DdHH253USo Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:38:12.906283 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 8b746b15dbf34e238da3fd392ef748f2 Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: {"aggregate": {"name": "tempest-test_aggregate-1496731473"}} Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:12.907773 n-d-852084-10 devstack@n-api.service[128971]: exception: Aggregate tempest-test_aggregate-1496731473 already exists. Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1496731473'}}} Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi aggregate.create() Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Sep 08 12:38:12.908630 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1496731473 already exists. Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:12.909958 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Sep 08 12:38:12.911757 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Sep 08 12:38:12.911757 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1496731473 already exists. Sep 08 12:38:12.911757 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.911757 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:12.911757 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.911757 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:12.911757 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:12.911757 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:12.911757 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:12.911757 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:12.911757 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1496731473 already exists. Sep 08 12:38:12.911757 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:12.914516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec550b86-4699-4b0a-8c4c-8d55452c7840 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1496731473 already exists. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:12.915773 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ec550b86-4699-4b0a-8c4c-8d55452c7840 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.046937 Sep 08 12:38:12.921140 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 99/190] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:12 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 53 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:12.931043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0d82aa2-ed37-4384-b7dd-65ffe6165fe3 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Calling method '.version_select at 0x7fdb3bad74c0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:12.936466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0d82aa2-ed37-4384-b7dd-65ffe6165fe3 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.937707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0d82aa2-ed37-4384-b7dd-65ffe6165fe3 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.938339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0d82aa2-ed37-4384-b7dd-65ffe6165fe3 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.939518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0d82aa2-ed37-4384-b7dd-65ffe6165fe3 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:12.940186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0d82aa2-ed37-4384-b7dd-65ffe6165fe3 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:12.940797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0d82aa2-ed37-4384-b7dd-65ffe6165fe3 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:12.991032 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0d82aa2-ed37-4384-b7dd-65ffe6165fe3 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.066758 Sep 08 12:38:12.994413 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 100/191] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:12 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:13.006273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92a78010-9a43-4a4e-81b9-5c7e5b233809 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:13.043905 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92a78010-9a43-4a4e-81b9-5c7e5b233809 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.046933 Sep 08 12:38:13.044558 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 101/192] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:12 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:13.055865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b9b9eb3b-e904-4ffe-8215-920197c812a8 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:13.214270 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8106560d-f2fd-4565-9ae7-a28e06447b7b tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/900af1bcbdf4460893a531d8664813ee?user_id=c5b210384af14fde9c22f3fe5098994a" status: 200 len: 370 microversion: 2.1 time: 0.471385 Sep 08 12:38:13.216737 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 92/193] 10.222.0.78 () {58 vars in 1323 bytes} [Thu Sep 8 12:38:12 2022] GET /compute/v2.1/os-quota-sets/900af1bcbdf4460893a531d8664813ee?user_id=c5b210384af14fde9c22f3fe5098994a => generated 370 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:13.238590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f0b2667-f785-42f4-a667-048df75ea6a4 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Calling method '.version_select at 0x7fdb3d1ee790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:13.243605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f0b2667-f785-42f4-a667-048df75ea6a4 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:13.250322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f0b2667-f785-42f4-a667-048df75ea6a4 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:13.252887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f0b2667-f785-42f4-a667-048df75ea6a4 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:13.257381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f0b2667-f785-42f4-a667-048df75ea6a4 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:13.258672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f0b2667-f785-42f4-a667-048df75ea6a4 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:13.261332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f0b2667-f785-42f4-a667-048df75ea6a4 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:13.280338 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b9b9eb3b-e904-4ffe-8215-920197c812a8 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.229356 Sep 08 12:38:13.282422 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 102/194] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:13 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:13.297894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b223eb7-538f-4772-9a7d-651fb1a7c34f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:13.298829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5b223eb7-538f-4772-9a7d-651fb1a7c34f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:13.310267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b223eb7-538f-4772-9a7d-651fb1a7c34f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:13.311420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b223eb7-538f-4772-9a7d-651fb1a7c34f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:13.314386 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f0b2667-f785-42f4-a667-048df75ea6a4 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.095687 Sep 08 12:38:13.315014 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 93/195] 10.222.0.78 () {58 vars in 1128 bytes} [Thu Sep 8 12:38:13 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:13.315173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b223eb7-538f-4772-9a7d-651fb1a7c34f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:13.316003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b223eb7-538f-4772-9a7d-651fb1a7c34f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:13.316485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b223eb7-538f-4772-9a7d-651fb1a7c34f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:13.316940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b223eb7-538f-4772-9a7d-651fb1a7c34f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:13.321355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-cc249d39-0ec7-4def-8295-c74ef7326f9f req-62fdce5a-94b4-4571-9cf0-73a4e26a5bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f08576a-9db5-42b3-967c-2b64c7b70d35", "name": "network-vif-plugged", "status": "completed", "tag": "c0202d88-6f01-4f52-9d83-e48a31f22c1d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:13.332827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cc249d39-0ec7-4def-8295-c74ef7326f9f req-62fdce5a-94b4-4571-9cf0-73a4e26a5bc3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:13.333536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cc249d39-0ec7-4def-8295-c74ef7326f9f req-62fdce5a-94b4-4571-9cf0-73a4e26a5bc3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:13.334208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cc249d39-0ec7-4def-8295-c74ef7326f9f req-62fdce5a-94b4-4571-9cf0-73a4e26a5bc3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:13.350432 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-cc249d39-0ec7-4def-8295-c74ef7326f9f req-62fdce5a-94b4-4571-9cf0-73a4e26a5bc3 service nova] Creating event network-vif-plugged:c0202d88-6f01-4f52-9d83-e48a31f22c1d for instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 on n-h1-852084-10 Sep 08 12:38:13.357896 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-cc249d39-0ec7-4def-8295-c74ef7326f9f req-62fdce5a-94b4-4571-9cf0-73a4e26a5bc3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040338 Sep 08 12:38:13.359297 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 94/196] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:13.367877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b3c7a794-1dd7-4376-b8c3-20d7dbdd9e47 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1106647236"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:13.373399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.aggregate [None req-b3c7a794-1dd7-4376-b8c3-20d7dbdd9e47 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Generated uuid 3f29f723-d014-42df-9fc5-a42e05983f12 for aggregate {{(pid=128970) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:13.407063 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b3c7a794-1dd7-4376-b8c3-20d7dbdd9e47 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.044353 Sep 08 12:38:13.415420 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 95/197] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:13 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:13.426635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5dac6113-585a-44c2-b6f1-55e9f0f459c7 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-842301639"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:13.437147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.aggregate [None req-5dac6113-585a-44c2-b6f1-55e9f0f459c7 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Generated uuid cb7e9888-96c5-45a9-a83f-2b483dc94af0 for aggregate {{(pid=128970) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:13.455930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:13.482155 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5dac6113-585a-44c2-b6f1-55e9f0f459c7 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063110 Sep 08 12:38:13.483309 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 96/198] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:13 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:13.490222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-166e718b-114a-415f-86b5-c175e2ee6b34 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Calling method '.version_select at 0x7fdb3787b1f0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:13.501433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-166e718b-114a-415f-86b5-c175e2ee6b34 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:13.501933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-166e718b-114a-415f-86b5-c175e2ee6b34 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:13.502366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-166e718b-114a-415f-86b5-c175e2ee6b34 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:13.520239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-166e718b-114a-415f-86b5-c175e2ee6b34 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:13.520725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-166e718b-114a-415f-86b5-c175e2ee6b34 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:13.521156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-166e718b-114a-415f-86b5-c175e2ee6b34 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:13.559028 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-166e718b-114a-415f-86b5-c175e2ee6b34 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-h2-852084-10" status: 200 len: 603 microversion: 2.1 time: 0.074475 Sep 08 12:38:13.560068 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 97/199] 10.222.0.78 () {58 vars in 1173 bytes} [Thu Sep 8 12:38:13 2022] GET /compute/v2.1/os-hosts/n-h2-852084-10 => generated 603 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:13.565675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bfcab3b6-fa72-4ab0-9c19-286ed4e115df tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:13.566413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bfcab3b6-fa72-4ab0-9c19-286ed4e115df tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:13.586540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfcab3b6-fa72-4ab0-9c19-286ed4e115df tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:13.587257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfcab3b6-fa72-4ab0-9c19-286ed4e115df tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:13.587722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfcab3b6-fa72-4ab0-9c19-286ed4e115df tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:13.588460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfcab3b6-fa72-4ab0-9c19-286ed4e115df tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:13.588896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfcab3b6-fa72-4ab0-9c19-286ed4e115df tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:13.589344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfcab3b6-fa72-4ab0-9c19-286ed4e115df tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:13.851154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5b223eb7-538f-4772-9a7d-651fb1a7c34f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:13.859187 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5b223eb7-538f-4772-9a7d-651fb1a7c34f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1312 microversion: 2.1 time: 0.575723 Sep 08 12:38:13.859846 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 103/200] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:13 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1312 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:13.877445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-490c478f-439c-4791-9bcd-0eedcf936fd1 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:13.888670 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-490c478f-439c-4791-9bcd-0eedcf936fd1 tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 445 microversion: 2.1 time: 0.027766 Sep 08 12:38:13.889259 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 104/201] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 12:38:13 2022] GET /compute/v2.1/os-aggregates => generated 445 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:13.900606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f3ba14f5-8af8-4781-9119-9563a9548b94 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:13.902116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f3ba14f5-8af8-4781-9119-9563a9548b94 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '9a9e0600db7d4271aa8fccbec650e3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc25558a747b4c368cd6fe59699f12b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f3ba14f5-8af8-4781-9119-9563a9548b94 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Request method failure captured: Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIBhNGNoSOy15qig-HsGir3BrDZ-bYCjRr61wsWCGDjvLFPzg6YJXRYSPvGjM0SiGzFGftALHCgbEkRYCHgJZPqMGKolaqWycs60GLgEp7Y3BaZ1A5mCSZpEhsV6_SAsAnoDwNYF_mm4tWtwem6yhRmhgFolYf5KjMeJgbmsQOOmSI Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: cc25558a747b4c368cd6fe59699f12b6 Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:38:13.904361 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:38:13.906373 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:13.906373 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:13.906373 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: cc25558a747b4c368cd6fe59699f12b6 Sep 08 12:38:13.906373 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:13.906373 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AggregatesAdminNegativeTestJSON-1659174776-project Sep 08 12:38:13.906373 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:13.906373 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:13.906373 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9a9e0600db7d4271aa8fccbec650e3bf Sep 08 12:38:13.906373 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776-project Sep 08 12:38:13.906373 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:13.906373 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 08 12:38:13.906373 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '15'} Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:13.907410 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:13.911411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f3ba14f5-8af8-4781-9119-9563a9548b94 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:13.913756 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f3ba14f5-8af8-4781-9119-9563a9548b94 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.015545 Sep 08 12:38:13.913756 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 105/202] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:13 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:13.913756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c738e2cb-b897-4f35-8c18-bcc25a88b406 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Calling method '.version_select at 0x7fdb3bad7040>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:13.919908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bfcab3b6-fa72-4ab0-9c19-286ed4e115df tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:13.920650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c738e2cb-b897-4f35-8c18-bcc25a88b406 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:13.921144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c738e2cb-b897-4f35-8c18-bcc25a88b406 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:13.921959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c738e2cb-b897-4f35-8c18-bcc25a88b406 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:13.932045 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bfcab3b6-fa72-4ab0-9c19-286ed4e115df tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1389 microversion: 2.1 time: 0.370846 Sep 08 12:38:13.940926 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 98/203] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:13 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1389 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:13.941218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c738e2cb-b897-4f35-8c18-bcc25a88b406 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:13.941218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c738e2cb-b897-4f35-8c18-bcc25a88b406 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:13.941218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c738e2cb-b897-4f35-8c18-bcc25a88b406 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:13.944622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8d1229b7-8df9-4dd7-b1a4-c5a96b3716c6 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Calling method '.version_select at 0x7fdb3d1eee50>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:13.977331 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c738e2cb-b897-4f35-8c18-bcc25a88b406 tempest-HostsAdminTestJSON-798018267 tempest-HostsAdminTestJSON-798018267-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-h1-852084-10" status: 200 len: 471 microversion: 2.1 time: 0.069374 Sep 08 12:38:13.987127 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 106/204] 10.222.0.78 () {58 vars in 1173 bytes} [Thu Sep 8 12:38:13 2022] GET /compute/v2.1/os-hosts/n-h1-852084-10 => generated 471 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:13.998053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3f859ab6-66ad-4011-8be0-9abe48d01bf5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:13.998679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3f859ab6-66ad-4011-8be0-9abe48d01bf5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:14.011769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f859ab6-66ad-4011-8be0-9abe48d01bf5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:14.012905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f859ab6-66ad-4011-8be0-9abe48d01bf5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:14.013349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f859ab6-66ad-4011-8be0-9abe48d01bf5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:14.020831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f859ab6-66ad-4011-8be0-9abe48d01bf5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:14.021404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f859ab6-66ad-4011-8be0-9abe48d01bf5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:14.022179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f859ab6-66ad-4011-8be0-9abe48d01bf5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:14.310799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3f859ab6-66ad-4011-8be0-9abe48d01bf5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:14.325907 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3f859ab6-66ad-4011-8be0-9abe48d01bf5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1316 microversion: 2.1 time: 0.337564 Sep 08 12:38:14.326781 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 107/205] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:13 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1316 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:14.331460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ac3d4460-6b9a-4056-ac23-7bfe6bb64ffa tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:14.370141 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ac3d4460-6b9a-4056-ac23-7bfe6bb64ffa tempest-AggregatesAdminTestJSON-1149384044 tempest-AggregatesAdminTestJSON-1149384044-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.041921 Sep 08 12:38:14.372680 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 108/206] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:14 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:14.379994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0060a2ac-e11a-4631-96c2-5e0e0a6a87ac tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:14.395266 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8d1229b7-8df9-4dd7-b1a4-c5a96b3716c6 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/6c57cd7e30ad4e21915e4827a5974ffc/defaults" status: 200 len: 371 microversion: 2.1 time: 0.460973 Sep 08 12:38:14.406398 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 99/207] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 12:38:13 2022] GET /compute/v2.1/os-quota-sets/6c57cd7e30ad4e21915e4827a5974ffc/defaults => generated 371 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:14.412230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f1111c4-465b-4e0f-a401-563fd54f0973 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:14.415527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f1111c4-465b-4e0f-a401-563fd54f0973 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:14.419331 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0060a2ac-e11a-4631-96c2-5e0e0a6a87ac tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.043061 Sep 08 12:38:14.425251 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 109/208] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:14 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:14.430721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bb3d1b9b-51ac-4c8b-af3f-41f49de15200 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3ba153a0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:14.435382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f1111c4-465b-4e0f-a401-563fd54f0973 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:14.436645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f1111c4-465b-4e0f-a401-563fd54f0973 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:14.437751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f1111c4-465b-4e0f-a401-563fd54f0973 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:14.440266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f1111c4-465b-4e0f-a401-563fd54f0973 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:14.443723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f1111c4-465b-4e0f-a401-563fd54f0973 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:14.445028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f1111c4-465b-4e0f-a401-563fd54f0973 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:14.467367 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6f1111c4-465b-4e0f-a401-563fd54f0973 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] HTTP exception thrown: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f1111c4-465b-4e0f-a401-563fd54f0973 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Request method failure captured: Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 HTTP/1.1 Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeH-srrMghV2FJ-8yzErrLul4RubY0vh6-5W132685C9jDqAoxfnwTLQT6x7855tPzbFyaln8amDAkWHZ6DMPuMW9DF0Zdwm--Cmufo99xXS5WIOM3pvubSyr1ryVQrsgAFk_zdzw4vQJzBVleo8pG4ZcgPFZe1u95ItWhBiGhLvoKM Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: e7f5e5869f2c493d92f38d20f8291c21 Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AggregatesAdminTestJSON-979723651 Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:14.469449 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:14.470676 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e7f5e5869f2c493d92f38d20f8291c21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e7f5e5869f2c493d92f38d20f8291c21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e7f5e5869f2c493d92f38d20f8291c21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e7f5e5869f2c493d92f38d20f8291c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:14.470676 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AggregatesAdminTestJSON-979723651 Sep 08 12:38:14.470676 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: e7f5e5869f2c493d92f38d20f8291c21 Sep 08 12:38:14.470676 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-979723651 Sep 08 12:38:14.470676 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AggregatesAdminTestJSON-979723651-project Sep 08 12:38:14.470676 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:14.470676 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:14.470676 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 1e50364fb741400ea5db073dce8e39ca Sep 08 12:38:14.470676 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AggregatesAdminTestJSON-979723651-project Sep 08 12:38:14.470676 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:38:14.470676 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:14.470676 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '262b5661-21ae-42a9-8102-c088ff2868e2'} Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:14.471471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:14.472598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.475522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f1111c4-465b-4e0f-a401-563fd54f0973 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Returning 404 to user: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:14.476706 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f1111c4-465b-4e0f-a401-563fd54f0973 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "DELETE /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 404 len: 111 microversion: 2.1 time: 0.069172 Sep 08 12:38:14.477455 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 100/209] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:38:14 2022] DELETE /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:14.482714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-06d1b4de-35fd-41dd-86c3-a4875685b48c tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:14.497820 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-06d1b4de-35fd-41dd-86c3-a4875685b48c tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-06d1b4de-35fd-41dd-86c3-a4875685b48c tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Request method failure captured: Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIE78lwh1WFhydqnHe6RvHBB1xFasLQLOsU4FeGvox4-JQmuLU6NqqyB2Ds6syp55T8IDtvQW3ZGjIjXTwPMqNFZm-ZpnOu8JjDNplrcaLaF_G6lv6xSjMmlVfqxGPfTQWOfDRqKv2IIEroHTnBpVo48kmP4l3jKkuP1DdHH253USo Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:38:14.499809 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:38:14.501310 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:14.501310 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:14.501310 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:14.501310 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:14.501310 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:14.501310 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:14.501310 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:14.501310 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 8b746b15dbf34e238da3fd392ef748f2 Sep 08 12:38:14.501310 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:14.501310 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:38:14.501310 n-d-852084-10 devstack@n-api.service[128970]: exception: Aggregate -1 could not be found. Sep 08 12:38:14.501310 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '-1'} Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 12:38:14.502100 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.503123 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.504273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:14.504273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:14.504273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:14.504273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:14.504273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 08 12:38:14.504273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.507389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-06d1b4de-35fd-41dd-86c3-a4875685b48c tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:14.508621 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-06d1b4de-35fd-41dd-86c3-a4875685b48c tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.030069 Sep 08 12:38:14.509299 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 101/210] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:14 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:14.519587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a47cb9fc-21be-42b1-aab1-e72ecb3474fd req-1d471afc-925e-4c0b-b6b4-90b88919e3f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970bb882-462b-4430-a3ae-e76024ca8892", "tag": "705e0576-9031-4c37-af92-e4df93acfac3"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:14.537248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a47cb9fc-21be-42b1-aab1-e72ecb3474fd req-1d471afc-925e-4c0b-b6b4-90b88919e3f0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:14.537737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a47cb9fc-21be-42b1-aab1-e72ecb3474fd req-1d471afc-925e-4c0b-b6b4-90b88919e3f0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:14.538236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a47cb9fc-21be-42b1-aab1-e72ecb3474fd req-1d471afc-925e-4c0b-b6b4-90b88919e3f0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:14.551482 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a47cb9fc-21be-42b1-aab1-e72ecb3474fd req-1d471afc-925e-4c0b-b6b4-90b88919e3f0 service nova] Creating event network-changed:705e0576-9031-4c37-af92-e4df93acfac3 for instance 970bb882-462b-4430-a3ae-e76024ca8892 on n-h2-852084-10 Sep 08 12:38:14.557188 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a47cb9fc-21be-42b1-aab1-e72ecb3474fd req-1d471afc-925e-4c0b-b6b4-90b88919e3f0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046605 Sep 08 12:38:14.560812 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 102/211] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:14.567479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-496ff205-c484-4f84-95d0-88e12b5d7ce3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:14.568277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-496ff205-c484-4f84-95d0-88e12b5d7ce3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] [instance: 262b5661-21ae-42a9-8102-c088ff2868e2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:14.576790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-496ff205-c484-4f84-95d0-88e12b5d7ce3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:14.577499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-496ff205-c484-4f84-95d0-88e12b5d7ce3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:14.578140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-496ff205-c484-4f84-95d0-88e12b5d7ce3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:14.581297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-496ff205-c484-4f84-95d0-88e12b5d7ce3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:14.582226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-496ff205-c484-4f84-95d0-88e12b5d7ce3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:14.582699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-496ff205-c484-4f84-95d0-88e12b5d7ce3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:14.598992 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-496ff205-c484-4f84-95d0-88e12b5d7ce3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] HTTP exception thrown: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-496ff205-c484-4f84-95d0-88e12b5d7ce3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Request method failure captured: Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 HTTP/1.1 Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeH-srrMghV2FJ-8yzErrLul4RubY0vh6-5W132685C9jDqAoxfnwTLQT6x7855tPzbFyaln8amDAkWHZ6DMPuMW9DF0Zdwm--Cmufo99xXS5WIOM3pvubSyr1ryVQrsgAFk_zdzw4vQJzBVleo8pG4ZcgPFZe1u95ItWhBiGhLvoKM Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: e7f5e5869f2c493d92f38d20f8291c21 Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AggregatesAdminTestJSON-979723651 Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:14.601048 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:14.602425 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e7f5e5869f2c493d92f38d20f8291c21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e7f5e5869f2c493d92f38d20f8291c21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e7f5e5869f2c493d92f38d20f8291c21"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e7f5e5869f2c493d92f38d20f8291c21"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:14.602425 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AggregatesAdminTestJSON-979723651 Sep 08 12:38:14.602425 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: e7f5e5869f2c493d92f38d20f8291c21 Sep 08 12:38:14.602425 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-979723651 Sep 08 12:38:14.602425 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AggregatesAdminTestJSON-979723651-project Sep 08 12:38:14.602425 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:14.602425 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:14.602425 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 1e50364fb741400ea5db073dce8e39ca Sep 08 12:38:14.602425 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AggregatesAdminTestJSON-979723651-project Sep 08 12:38:14.602425 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:38:14.602425 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:14.602425 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '262b5661-21ae-42a9-8102-c088ff2868e2'} Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:14.603370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. Sep 08 12:38:14.604405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.606932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-496ff205-c484-4f84-95d0-88e12b5d7ce3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] Returning 404 to user: Instance 262b5661-21ae-42a9-8102-c088ff2868e2 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:14.607964 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-496ff205-c484-4f84-95d0-88e12b5d7ce3 tempest-AggregatesAdminTestJSON-979723651 tempest-AggregatesAdminTestJSON-979723651-project] 10.222.0.78 "GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2" status: 404 len: 111 microversion: 2.1 time: 0.045065 Sep 08 12:38:14.608839 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 103/212] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:14 2022] GET /compute/v2.1/servers/262b5661-21ae-42a9-8102-c088ff2868e2 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:14.622619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2dc70007-c7af-4bec-8a4f-c94ff3427ea0 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1410588896"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:14.631450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.aggregate [None req-2dc70007-c7af-4bec-8a4f-c94ff3427ea0 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Generated uuid 4830426d-44b4-4772-ae46-a80be7f213cf for aggregate {{(pid=128970) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:14.673216 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2dc70007-c7af-4bec-8a4f-c94ff3427ea0 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060184 Sep 08 12:38:14.673676 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 104/213] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:14.694423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c02a3ef2-f643-4a93-9db5-72dbdb9bf309 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:14.697042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c02a3ef2-f643-4a93-9db5-72dbdb9bf309 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '9a9e0600db7d4271aa8fccbec650e3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc25558a747b4c368cd6fe59699f12b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c02a3ef2-f643-4a93-9db5-72dbdb9bf309 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Request method failure captured: Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIBhNGNoSOy15qig-HsGir3BrDZ-bYCjRr61wsWCGDjvLFPzg6YJXRYSPvGjM0SiGzFGftALHCgbEkRYCHgJZPqMGKolaqWycs60GLgEp7Y3BaZ1A5mCSZpEhsV6_SAsAnoDwNYF_mm4tWtwem6yhRmhgFolYf5KjMeJgbmsQOOmSI Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: cc25558a747b4c368cd6fe59699f12b6 Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:14.698884 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:14.700537 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:14.700537 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:14.700537 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: cc25558a747b4c368cd6fe59699f12b6 Sep 08 12:38:14.700537 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:14.700537 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AggregatesAdminNegativeTestJSON-1659174776-project Sep 08 12:38:14.700537 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:14.700537 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:14.700537 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 9a9e0600db7d4271aa8fccbec650e3bf Sep 08 12:38:14.700537 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776-project Sep 08 12:38:14.700537 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:38:14.700537 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 08 12:38:14.700537 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '16'} Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:14.701398 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.703305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c02a3ef2-f643-4a93-9db5-72dbdb9bf309 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:14.704425 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c02a3ef2-f643-4a93-9db5-72dbdb9bf309 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] 10.222.0.78 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.020328 Sep 08 12:38:14.706958 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 105/214] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:14 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:14.715096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eaad70b1-e868-45a8-9065-48ab416d8c70 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:14.744223 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eaad70b1-e868-45a8-9065-48ab416d8c70 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.035764 Sep 08 12:38:14.744876 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 106/215] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:14 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:14.757687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b5d6f6a3-69a7-472f-952c-da475dd5db48 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:14.765551 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-b5d6f6a3-69a7-472f-952c-da475dd5db48 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b5d6f6a3-69a7-472f-952c-da475dd5db48 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Request method failure captured: Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIE78lwh1WFhydqnHe6RvHBB1xFasLQLOsU4FeGvox4-JQmuLU6NqqyB2Ds6syp55T8IDtvQW3ZGjIjXTwPMqNFZm-ZpnOu8JjDNplrcaLaF_G6lv6xSjMmlVfqxGPfTQWOfDRqKv2IIEroHTnBpVo48kmP4l3jKkuP1DdHH253USo Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:38:14.767546 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:38:14.769075 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:14.769075 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:14.769075 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:14.769075 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:14.769075 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:14.769075 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:14.769075 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:14.769075 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 8b746b15dbf34e238da3fd392ef748f2 Sep 08 12:38:14.769075 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:14.769075 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:38:14.769075 n-d-852084-10 devstack@n-api.service[128970]: exception: Aggregate -1 could not be found. Sep 08 12:38:14.769075 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '-1'} Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.769795 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Sep 08 12:38:14.771039 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.772149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b5d6f6a3-69a7-472f-952c-da475dd5db48 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:14.772149 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b5d6f6a3-69a7-472f-952c-da475dd5db48 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.015504 Sep 08 12:38:14.772149 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 107/216] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:14 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:14.779890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-54cc8674-645c-4317-8a95-de938ca99857 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:14.782794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-54cc8674-645c-4317-8a95-de938ca99857 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '9a9e0600db7d4271aa8fccbec650e3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc25558a747b4c368cd6fe59699f12b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-54cc8674-645c-4317-8a95-de938ca99857 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Request method failure captured: Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIBhNGNoSOy15qig-HsGir3BrDZ-bYCjRr61wsWCGDjvLFPzg6YJXRYSPvGjM0SiGzFGftALHCgbEkRYCHgJZPqMGKolaqWycs60GLgEp7Y3BaZ1A5mCSZpEhsV6_SAsAnoDwNYF_mm4tWtwem6yhRmhgFolYf5KjMeJgbmsQOOmSI Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: cc25558a747b4c368cd6fe59699f12b6 Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:14.786641 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:14.788275 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:14.788275 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:14.788275 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: cc25558a747b4c368cd6fe59699f12b6 Sep 08 12:38:14.788275 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:14.788275 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AggregatesAdminNegativeTestJSON-1659174776-project Sep 08 12:38:14.788275 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:14.788275 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:14.788275 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 9a9e0600db7d4271aa8fccbec650e3bf Sep 08 12:38:14.788275 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776-project Sep 08 12:38:14.788275 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:38:14.788275 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 08 12:38:14.788275 n-d-852084-10 devstack@n-api.service[128970]: action_args: {} Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:14.788934 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:14.790374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-54cc8674-645c-4317-8a95-de938ca99857 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:14.801413 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-54cc8674-645c-4317-8a95-de938ca99857 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.026298 Sep 08 12:38:14.814889 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 108/217] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 12:38:14 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:14.825182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0d0dd4c3-c76b-4fb8-a035-799adb0891e7 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1676507638"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:14.831151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.aggregate [None req-0d0dd4c3-c76b-4fb8-a035-799adb0891e7 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Generated uuid 44277326-f9f2-4c97-8d87-626c3ca8feec for aggregate {{(pid=128970) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:14.881842 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0d0dd4c3-c76b-4fb8-a035-799adb0891e7 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064490 Sep 08 12:38:14.889855 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 109/218] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:14 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:14.905773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-065ad066-d434-4ce8-a5ce-c3cdce81b2a0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:14.910562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-065ad066-d434-4ce8-a5ce-c3cdce81b2a0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:14.917364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-065ad066-d434-4ce8-a5ce-c3cdce81b2a0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:14.917867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-065ad066-d434-4ce8-a5ce-c3cdce81b2a0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:14.918319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-065ad066-d434-4ce8-a5ce-c3cdce81b2a0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:14.920453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-065ad066-d434-4ce8-a5ce-c3cdce81b2a0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:14.920766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-065ad066-d434-4ce8-a5ce-c3cdce81b2a0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:14.921198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-065ad066-d434-4ce8-a5ce-c3cdce81b2a0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:15.109605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb3d1b9b-51ac-4c8b-af3f-41f49de15200 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:15.110777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb3d1b9b-51ac-4c8b-af3f-41f49de15200 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:15.111765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb3d1b9b-51ac-4c8b-af3f-41f49de15200 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:15.112898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb3d1b9b-51ac-4c8b-af3f-41f49de15200 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:15.113945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb3d1b9b-51ac-4c8b-af3f-41f49de15200 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:15.114624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb3d1b9b-51ac-4c8b-af3f-41f49de15200 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:15.198731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-065ad066-d434-4ce8-a5ce-c3cdce81b2a0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:15.211889 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-065ad066-d434-4ce8-a5ce-c3cdce81b2a0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1312 microversion: 2.1 time: 0.316370 Sep 08 12:38:15.227300 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 110/219] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:14 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1312 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:15.227300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0d6dd7f3-12d0-4024-abef-b0c445e36329 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-10"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:15.243557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d6dd7f3-12d0-4024-abef-b0c445e36329 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:15.245229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d6dd7f3-12d0-4024-abef-b0c445e36329 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:15.247553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d6dd7f3-12d0-4024-abef-b0c445e36329 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:15.285835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=9,nova_api:DELETE=12,nova_api:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:15.398454 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0d6dd7f3-12d0-4024-abef-b0c445e36329 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.184085 Sep 08 12:38:15.399053 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 111/220] 10.222.0.78 () {60 vars in 1194 bytes} [Thu Sep 8 12:38:15 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:15.404516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-282d0ee2-0528-4a18-bcb1-c2e00cb4b258 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:15.405141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-282d0ee2-0528-4a18-bcb1-c2e00cb4b258 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:15.417630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-282d0ee2-0528-4a18-bcb1-c2e00cb4b258 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:15.418130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-282d0ee2-0528-4a18-bcb1-c2e00cb4b258 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:15.418847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-282d0ee2-0528-4a18-bcb1-c2e00cb4b258 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:15.419645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-282d0ee2-0528-4a18-bcb1-c2e00cb4b258 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:15.420119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-282d0ee2-0528-4a18-bcb1-c2e00cb4b258 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:15.420541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-282d0ee2-0528-4a18-bcb1-c2e00cb4b258 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:15.431420 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bb3d1b9b-51ac-4c8b-af3f-41f49de15200 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/6c57cd7e30ad4e21915e4827a5974ffc" status: 200 len: 329 microversion: 2.1 time: 1.006680 Sep 08 12:38:15.432506 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 110/221] 10.222.0.78 () {60 vars in 1263 bytes} [Thu Sep 8 12:38:14 2022] PUT /compute/v2.1/os-quota-sets/6c57cd7e30ad4e21915e4827a5974ffc => generated 329 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:15.446799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-baf4b3f1-9f4d-4c05-be8c-91082f8126a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:15.447504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-baf4b3f1-9f4d-4c05-be8c-91082f8126a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:15.455801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf4b3f1-9f4d-4c05-be8c-91082f8126a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:15.456295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf4b3f1-9f4d-4c05-be8c-91082f8126a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:15.456733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf4b3f1-9f4d-4c05-be8c-91082f8126a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:15.457437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf4b3f1-9f4d-4c05-be8c-91082f8126a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:15.457990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf4b3f1-9f4d-4c05-be8c-91082f8126a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:15.458592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf4b3f1-9f4d-4c05-be8c-91082f8126a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:15.704822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-baf4b3f1-9f4d-4c05-be8c-91082f8126a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:15.706667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-282d0ee2-0528-4a18-bcb1-c2e00cb4b258 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:15.722039 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-baf4b3f1-9f4d-4c05-be8c-91082f8126a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1316 microversion: 2.1 time: 0.288183 Sep 08 12:38:15.725317 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 111/222] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:15 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:15.729196 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-282d0ee2-0528-4a18-bcb1-c2e00cb4b258 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1389 microversion: 2.1 time: 0.320061 Sep 08 12:38:15.731589 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 112/223] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:15 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1389 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:15.734364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bb48115b-6916-44af-b6ea-ff78f930b3b5 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-10"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:15.738035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bb48115b-6916-44af-b6ea-ff78f930b3b5 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '9a9e0600db7d4271aa8fccbec650e3bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc25558a747b4c368cd6fe59699f12b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bb48115b-6916-44af-b6ea-ff78f930b3b5 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Request method failure captured: Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 43 Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIBhNGNoSOy15qig-HsGir3BrDZ-bYCjRr61wsWCGDjvLFPzg6YJXRYSPvGjM0SiGzFGftALHCgbEkRYCHgJZPqMGKolaqWycs60GLgEp7Y3BaZ1A5mCSZpEhsV6_SAsAnoDwNYF_mm4tWtwem6yhRmhgFolYf5KjMeJgbmsQOOmSI Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: cc25558a747b4c368cd6fe59699f12b6 Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:38:15.740128 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cc25558a747b4c368cd6fe59699f12b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: cc25558a747b4c368cd6fe59699f12b6 Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776 Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AggregatesAdminNegativeTestJSON-1659174776-project Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9a9e0600db7d4271aa8fccbec650e3bf Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1659174776-project Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: {"remove_host": {"host": "n-h2-852084-10"}} Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:15.741371 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-852084-10'}}} Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:15.742153 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Sep 08 12:38:15.743515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:15.744720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bb48115b-6916-44af-b6ea-ff78f930b3b5 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:15.744720 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bb48115b-6916-44af-b6ea-ff78f930b3b5 tempest-AggregatesAdminNegativeTestJSON-1659174776 tempest-AggregatesAdminNegativeTestJSON-1659174776-project] 10.222.0.78 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.014731 Sep 08 12:38:15.744720 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 112/224] 10.222.0.78 () {60 vars in 1194 bytes} [Thu Sep 8 12:38:15 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:15.749033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b1efc409-b84b-4912-8916-0631f0bbf1e6 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Action: 'update', calling method: .version_select at 0x7fdb377b7b80>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:15.749866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-cdfd4268-aa95-4f38-a6cf-da2ec843c487 req-53ef7db4-46b8-4772-bf0d-108e8f811e39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164b7ad7-b8db-4492-a973-c90ee923e01b", "name": "network-vif-plugged", "status": "completed", "tag": "e3298c03-e65b-4468-977e-c289c1d17507"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:15.777135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cdfd4268-aa95-4f38-a6cf-da2ec843c487 req-53ef7db4-46b8-4772-bf0d-108e8f811e39 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:15.778690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cdfd4268-aa95-4f38-a6cf-da2ec843c487 req-53ef7db4-46b8-4772-bf0d-108e8f811e39 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:15.779599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cdfd4268-aa95-4f38-a6cf-da2ec843c487 req-53ef7db4-46b8-4772-bf0d-108e8f811e39 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:15.805000 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-cdfd4268-aa95-4f38-a6cf-da2ec843c487 req-53ef7db4-46b8-4772-bf0d-108e8f811e39 service nova] Creating event network-vif-plugged:e3298c03-e65b-4468-977e-c289c1d17507 for instance 164b7ad7-b8db-4492-a973-c90ee923e01b on n-h2-852084-10 Sep 08 12:38:15.817823 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-cdfd4268-aa95-4f38-a6cf-da2ec843c487 req-53ef7db4-46b8-4772-bf0d-108e8f811e39 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071346 Sep 08 12:38:15.821677 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 113/225] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:15.834701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5a4842ea-8977-44ee-8c05-2ad09c591136 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-10"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:15.861995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a4842ea-8977-44ee-8c05-2ad09c591136 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:15.862609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a4842ea-8977-44ee-8c05-2ad09c591136 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:15.863066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a4842ea-8977-44ee-8c05-2ad09c591136 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:16.095139 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5a4842ea-8977-44ee-8c05-2ad09c591136 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.268204 Sep 08 12:38:16.100113 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 114/226] 10.222.0.78 () {60 vars in 1194 bytes} [Thu Sep 8 12:38:15 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:16.112377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8947e643-8657-4676-bcce-49749b55e354 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:16.173602 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8947e643-8657-4676-bcce-49749b55e354 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.066027 Sep 08 12:38:16.174210 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 115/227] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:16 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 08 12:38:16.188502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bbf4ec6f-b8e3-4a9d-a6b9-6d1b740b9d59 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1923697691"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:16.199047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.aggregate [None req-bbf4ec6f-b8e3-4a9d-a6b9-6d1b740b9d59 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Generated uuid 5d5d70bd-b673-4c04-8034-bae939c55be7 for aggregate {{(pid=128971) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 12:38:16.213923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1efc409-b84b-4912-8916-0631f0bbf1e6 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:16.214538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1efc409-b84b-4912-8916-0631f0bbf1e6 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:16.214984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1efc409-b84b-4912-8916-0631f0bbf1e6 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:16.221620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1efc409-b84b-4912-8916-0631f0bbf1e6 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:16.225086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1efc409-b84b-4912-8916-0631f0bbf1e6 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:16.226086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1efc409-b84b-4912-8916-0631f0bbf1e6 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:16.253427 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bbf4ec6f-b8e3-4a9d-a6b9-6d1b740b9d59 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.069451 Sep 08 12:38:16.264354 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 116/228] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 12:38:16 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:16.270947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3778e6de-6e10-4d96-bde6-8655b388dfd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:16.274276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3778e6de-6e10-4d96-bde6-8655b388dfd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:16.284083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3778e6de-6e10-4d96-bde6-8655b388dfd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:16.285590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3778e6de-6e10-4d96-bde6-8655b388dfd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:16.286378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3778e6de-6e10-4d96-bde6-8655b388dfd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:16.287756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3778e6de-6e10-4d96-bde6-8655b388dfd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:16.288533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3778e6de-6e10-4d96-bde6-8655b388dfd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:16.289148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3778e6de-6e10-4d96-bde6-8655b388dfd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:16.585275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3778e6de-6e10-4d96-bde6-8655b388dfd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:16.588839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:16.609970 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3778e6de-6e10-4d96-bde6-8655b388dfd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1462 microversion: 2.1 time: 0.343674 Sep 08 12:38:16.610758 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 117/229] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:16 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1462 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:16.633713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-32df8d65-ec55-4594-ba2a-9d2403018648 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:16.635675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=14,nova_api:DELETE=2,nova_api:UPDATE=10 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:16.648114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32df8d65-ec55-4594-ba2a-9d2403018648 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:16.648800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32df8d65-ec55-4594-ba2a-9d2403018648 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:16.649084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32df8d65-ec55-4594-ba2a-9d2403018648 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:16.657697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32df8d65-ec55-4594-ba2a-9d2403018648 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:16.658516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32df8d65-ec55-4594-ba2a-9d2403018648 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:16.659527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32df8d65-ec55-4594-ba2a-9d2403018648 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:16.672721 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.compute.aggregates [None req-32df8d65-ec55-4594-ba2a-9d2403018648 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 08 12:38:16.673245 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-32df8d65-ec55-4594-ba2a-9d2403018648 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-32df8d65-ec55-4594-ba2a-9d2403018648 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Request method failure captured: Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 42 Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIE78lwh1WFhydqnHe6RvHBB1xFasLQLOsU4FeGvox4-JQmuLU6NqqyB2Ds6syp55T8IDtvQW3ZGjIjXTwPMqNFZm-ZpnOu8JjDNplrcaLaF_G6lv6xSjMmlVfqxGPfTQWOfDRqKv2IIEroHTnBpVo48kmP4l3jKkuP1DdHH253USo Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:38:16.675296 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d76386cee6bd48f9a185432cf2f4b0c3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d76386cee6bd48f9a185432cf2f4b0c3 Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-497978407 Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 8b746b15dbf34e238da3fd392ef748f2 Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: {"remove_host": {"host": "nonexist_host"}} Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:16.676593 n-d-852084-10 devstack@n-api.service[128971]: exception: Cannot remove host nonexist_host in aggregate 18 Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Sep 08 12:38:16.677368 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Sep 08 12:38:16.678548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:16.679671 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:16.680922 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:16.680922 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:16.680922 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:16.680922 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:16.680922 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Sep 08 12:38:16.680922 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:16.680922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-32df8d65-ec55-4594-ba2a-9d2403018648 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:16.680922 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-32df8d65-ec55-4594-ba2a-9d2403018648 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.052689 Sep 08 12:38:16.680922 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 118/230] 10.222.0.78 () {60 vars in 1194 bytes} [Thu Sep 8 12:38:16 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:16.793876 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b1efc409-b84b-4912-8916-0631f0bbf1e6 tempest-QuotasAdminTestJSON-507655074 tempest-QuotasAdminTestJSON-507655074-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/6c57cd7e30ad4e21915e4827a5974ffc" status: 200 len: 329 microversion: 2.1 time: 1.059613 Sep 08 12:38:16.794486 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 113/231] 10.222.0.78 () {60 vars in 1263 bytes} [Thu Sep 8 12:38:15 2022] PUT /compute/v2.1/os-quota-sets/6c57cd7e30ad4e21915e4827a5974ffc => generated 329 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:16.813406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f0b7a5d2-d7ef-4723-b477-c723b26fe399 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:16.854957 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f0b7a5d2-d7ef-4723-b477-c723b26fe399 tempest-AggregatesAdminNegativeTestJSON-497978407 tempest-AggregatesAdminNegativeTestJSON-497978407-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.048817 Sep 08 12:38:16.859546 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 114/232] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:16 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:38:16.865237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ead5adc5-c7a3-4941-a84c-cb003bc98c53 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:16.866037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ead5adc5-c7a3-4941-a84c-cb003bc98c53 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:16.874054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ead5adc5-c7a3-4941-a84c-cb003bc98c53 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:16.874704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ead5adc5-c7a3-4941-a84c-cb003bc98c53 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:16.875569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ead5adc5-c7a3-4941-a84c-cb003bc98c53 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:16.876115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ead5adc5-c7a3-4941-a84c-cb003bc98c53 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:16.876671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ead5adc5-c7a3-4941-a84c-cb003bc98c53 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:16.877195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ead5adc5-c7a3-4941-a84c-cb003bc98c53 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:17.064952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-500503d0-1114-4348-8052-0ac15e7f9bc6 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:17.065593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-500503d0-1114-4348-8052-0ac15e7f9bc6 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:17.078061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-500503d0-1114-4348-8052-0ac15e7f9bc6 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:17.080359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-500503d0-1114-4348-8052-0ac15e7f9bc6 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:17.081116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-500503d0-1114-4348-8052-0ac15e7f9bc6 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:17.082462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-500503d0-1114-4348-8052-0ac15e7f9bc6 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:17.083154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-500503d0-1114-4348-8052-0ac15e7f9bc6 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:17.083966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-500503d0-1114-4348-8052-0ac15e7f9bc6 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:17.256089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ead5adc5-c7a3-4941-a84c-cb003bc98c53 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:17.260833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:17.275637 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ead5adc5-c7a3-4941-a84c-cb003bc98c53 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1316 microversion: 2.1 time: 0.418322 Sep 08 12:38:17.298716 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 115/233] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:16 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1316 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:17.322429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8b37a752-fd2c-4054-ad88-ca3e67726df5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:17.325896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8b37a752-fd2c-4054-ad88-ca3e67726df5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:17.347111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b37a752-fd2c-4054-ad88-ca3e67726df5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:17.353494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b37a752-fd2c-4054-ad88-ca3e67726df5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:17.354242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b37a752-fd2c-4054-ad88-ca3e67726df5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:17.355492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b37a752-fd2c-4054-ad88-ca3e67726df5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:17.356606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b37a752-fd2c-4054-ad88-ca3e67726df5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:17.357225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b37a752-fd2c-4054-ad88-ca3e67726df5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:17.637585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8b37a752-fd2c-4054-ad88-ca3e67726df5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:17.647813 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8b37a752-fd2c-4054-ad88-ca3e67726df5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1389 microversion: 2.1 time: 0.347681 Sep 08 12:38:17.648231 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-500503d0-1114-4348-8052-0ac15e7f9bc6 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1615 microversion: 2.1 time: 0.965994 Sep 08 12:38:17.648853 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 119/234] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:16 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1615 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:17.665676 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 116/235] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:17 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1389 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:17.671684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cf40215e-e3e1-4db2-8c1b-1345c6fdbe6d tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:17.672274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cf40215e-e3e1-4db2-8c1b-1345c6fdbe6d tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:17.679091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf40215e-e3e1-4db2-8c1b-1345c6fdbe6d tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:17.679776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf40215e-e3e1-4db2-8c1b-1345c6fdbe6d tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:17.680253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf40215e-e3e1-4db2-8c1b-1345c6fdbe6d tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:17.681133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf40215e-e3e1-4db2-8c1b-1345c6fdbe6d tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:17.687402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf40215e-e3e1-4db2-8c1b-1345c6fdbe6d tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:17.688284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf40215e-e3e1-4db2-8c1b-1345c6fdbe6d tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:17.786235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cf40215e-e3e1-4db2-8c1b-1345c6fdbe6d tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '74c643246dd84fab86e1f771cdc6dcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de55f3095a54139b6025010d04c71e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:17.787061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cf40215e-e3e1-4db2-8c1b-1345c6fdbe6d tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] flavor_id is None. Assuming migration. {{(pid=128971) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 08 12:38:17.787517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cf40215e-e3e1-4db2-8c1b-1345c6fdbe6d tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128971) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 12:38:17.998292 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cf40215e-e3e1-4db2-8c1b-1345c6fdbe6d tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35/action" status: 202 len: 0 microversion: 2.1 time: 0.330748 Sep 08 12:38:17.999348 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 120/236] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:38:17 2022] POST /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:18.009429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee4d79d7-6a9f-4709-bc9c-9fa8892e47ab tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:18.010163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ee4d79d7-6a9f-4709-bc9c-9fa8892e47ab tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:18.020879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee4d79d7-6a9f-4709-bc9c-9fa8892e47ab tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:18.022474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee4d79d7-6a9f-4709-bc9c-9fa8892e47ab tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:18.022924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee4d79d7-6a9f-4709-bc9c-9fa8892e47ab tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:18.024345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee4d79d7-6a9f-4709-bc9c-9fa8892e47ab tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:18.027352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee4d79d7-6a9f-4709-bc9c-9fa8892e47ab tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:18.027890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee4d79d7-6a9f-4709-bc9c-9fa8892e47ab tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:18.306783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1438ff41-7903-4db4-b81f-5a49fd647a6e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:18.308841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1438ff41-7903-4db4-b81f-5a49fd647a6e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:18.330383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ee4d79d7-6a9f-4709-bc9c-9fa8892e47ab tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:18.330820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1438ff41-7903-4db4-b81f-5a49fd647a6e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:18.332219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1438ff41-7903-4db4-b81f-5a49fd647a6e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:18.334314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1438ff41-7903-4db4-b81f-5a49fd647a6e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:18.337737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1438ff41-7903-4db4-b81f-5a49fd647a6e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:18.338253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1438ff41-7903-4db4-b81f-5a49fd647a6e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:18.339034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1438ff41-7903-4db4-b81f-5a49fd647a6e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:18.342852 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee4d79d7-6a9f-4709-bc9c-9fa8892e47ab tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1471 microversion: 2.1 time: 0.339072 Sep 08 12:38:18.345643 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 117/237] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:18 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1471 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:18.674089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a31e1dd6-7e08-459d-87fe-085862602d2e tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:18.675807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a31e1dd6-7e08-459d-87fe-085862602d2e tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:18.682926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a31e1dd6-7e08-459d-87fe-085862602d2e tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:18.684442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a31e1dd6-7e08-459d-87fe-085862602d2e tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:18.685188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a31e1dd6-7e08-459d-87fe-085862602d2e tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:18.686453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a31e1dd6-7e08-459d-87fe-085862602d2e tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:18.687409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a31e1dd6-7e08-459d-87fe-085862602d2e tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:18.688209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a31e1dd6-7e08-459d-87fe-085862602d2e tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:18.738744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1438ff41-7903-4db4-b81f-5a49fd647a6e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:18.747957 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1438ff41-7903-4db4-b81f-5a49fd647a6e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1316 microversion: 2.1 time: 0.449584 Sep 08 12:38:18.763689 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 121/238] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:18 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:18.926062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a31e1dd6-7e08-459d-87fe-085862602d2e tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:18.935672 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a31e1dd6-7e08-459d-87fe-085862602d2e tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1587 microversion: 2.1 time: 0.267133 Sep 08 12:38:18.937309 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 118/239] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:18 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1587 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:18.961744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-87e6e0fe-dde0-41e7-8d0b-6c73e9f94cd5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:18.962623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-87e6e0fe-dde0-41e7-8d0b-6c73e9f94cd5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:18.968664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87e6e0fe-dde0-41e7-8d0b-6c73e9f94cd5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:18.969454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87e6e0fe-dde0-41e7-8d0b-6c73e9f94cd5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:18.970340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87e6e0fe-dde0-41e7-8d0b-6c73e9f94cd5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:18.971969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87e6e0fe-dde0-41e7-8d0b-6c73e9f94cd5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:18.972967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87e6e0fe-dde0-41e7-8d0b-6c73e9f94cd5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:18.975108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87e6e0fe-dde0-41e7-8d0b-6c73e9f94cd5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:19.127270 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-87e6e0fe-dde0-41e7-8d0b-6c73e9f94cd5 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.168949 Sep 08 12:38:19.128652 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 122/240] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 12:38:18 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:19.377046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d55a0ae1-3e9e-44bc-98fa-2f61519d9c80 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:19.377992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d55a0ae1-3e9e-44bc-98fa-2f61519d9c80 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:19.386680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d55a0ae1-3e9e-44bc-98fa-2f61519d9c80 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:19.388205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d55a0ae1-3e9e-44bc-98fa-2f61519d9c80 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:19.388971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d55a0ae1-3e9e-44bc-98fa-2f61519d9c80 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:19.390120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d55a0ae1-3e9e-44bc-98fa-2f61519d9c80 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:19.390803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d55a0ae1-3e9e-44bc-98fa-2f61519d9c80 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:19.391767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d55a0ae1-3e9e-44bc-98fa-2f61519d9c80 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:19.670450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d55a0ae1-3e9e-44bc-98fa-2f61519d9c80 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:19.688988 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d55a0ae1-3e9e-44bc-98fa-2f61519d9c80 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1471 microversion: 2.1 time: 0.314915 Sep 08 12:38:19.690905 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 119/241] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:19 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1471 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:19.774077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6fe14a52-9557-430e-b78d-e0488e725d6b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:19.774690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6fe14a52-9557-430e-b78d-e0488e725d6b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:19.784568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6fe14a52-9557-430e-b78d-e0488e725d6b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:19.787157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6fe14a52-9557-430e-b78d-e0488e725d6b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:19.789990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6fe14a52-9557-430e-b78d-e0488e725d6b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:19.790961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6fe14a52-9557-430e-b78d-e0488e725d6b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:19.792718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6fe14a52-9557-430e-b78d-e0488e725d6b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:19.793507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6fe14a52-9557-430e-b78d-e0488e725d6b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:20.030886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6fe14a52-9557-430e-b78d-e0488e725d6b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:20.039837 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6fe14a52-9557-430e-b78d-e0488e725d6b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1316 microversion: 2.1 time: 0.269592 Sep 08 12:38:20.057321 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 123/242] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:19 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:20.317895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9d299bb2-4238-4aa4-9541-041ebc61a6fd req-49276ddd-b0cd-48bb-8522-592f799e038a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970bb882-462b-4430-a3ae-e76024ca8892", "name": "network-vif-plugged", "status": "completed", "tag": "705e0576-9031-4c37-af92-e4df93acfac3"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:20.339285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9d299bb2-4238-4aa4-9541-041ebc61a6fd req-49276ddd-b0cd-48bb-8522-592f799e038a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:20.340263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9d299bb2-4238-4aa4-9541-041ebc61a6fd req-49276ddd-b0cd-48bb-8522-592f799e038a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:20.341230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9d299bb2-4238-4aa4-9541-041ebc61a6fd req-49276ddd-b0cd-48bb-8522-592f799e038a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:20.363166 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9d299bb2-4238-4aa4-9541-041ebc61a6fd req-49276ddd-b0cd-48bb-8522-592f799e038a service nova] Creating event network-vif-plugged:705e0576-9031-4c37-af92-e4df93acfac3 for instance 970bb882-462b-4430-a3ae-e76024ca8892 on n-h2-852084-10 Sep 08 12:38:20.369472 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9d299bb2-4238-4aa4-9541-041ebc61a6fd req-49276ddd-b0cd-48bb-8522-592f799e038a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055097 Sep 08 12:38:20.370692 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 124/243] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:20.465925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6b40313-d953-493b-b60c-4e917bd3830b tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:20.467770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6b40313-d953-493b-b60c-4e917bd3830b tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:20.469205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6b40313-d953-493b-b60c-4e917bd3830b tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:20.469659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6b40313-d953-493b-b60c-4e917bd3830b tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:20.470559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6b40313-d953-493b-b60c-4e917bd3830b tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:20.474174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6b40313-d953-493b-b60c-4e917bd3830b tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:20.475402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6b40313-d953-493b-b60c-4e917bd3830b tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:20.537146 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f6b40313-d953-493b-b60c-4e917bd3830b tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.676230 Sep 08 12:38:20.549789 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 120/244] 10.222.0.78 () {58 vars in 1164 bytes} [Thu Sep 8 12:38:19 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:38:20.553730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-69e34484-2ea9-44b2-9beb-5549e5d65217 tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:20.555786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69e34484-2ea9-44b2-9beb-5549e5d65217 tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:20.556325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69e34484-2ea9-44b2-9beb-5549e5d65217 tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:20.556816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69e34484-2ea9-44b2-9beb-5549e5d65217 tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:20.557585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69e34484-2ea9-44b2-9beb-5549e5d65217 tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:20.560083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69e34484-2ea9-44b2-9beb-5549e5d65217 tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:20.560720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69e34484-2ea9-44b2-9beb-5549e5d65217 tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:20.592469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=26 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:20.634983 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-69e34484-2ea9-44b2-9beb-5549e5d65217 tempest-AZAdminV2TestJSON-1311304662 tempest-AZAdminV2TestJSON-1311304662-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.087203 Sep 08 12:38:20.635648 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 125/245] 10.222.0.78 () {58 vars in 1185 bytes} [Thu Sep 8 12:38:20 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:20.714498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d8d94565-3fad-48b7-b7db-f07337638340 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:20.715146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d8d94565-3fad-48b7-b7db-f07337638340 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:20.721479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8d94565-3fad-48b7-b7db-f07337638340 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:20.721954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8d94565-3fad-48b7-b7db-f07337638340 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:20.722543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8d94565-3fad-48b7-b7db-f07337638340 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:20.723511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8d94565-3fad-48b7-b7db-f07337638340 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:20.724176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8d94565-3fad-48b7-b7db-f07337638340 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:20.724846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8d94565-3fad-48b7-b7db-f07337638340 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:20.921360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d8d94565-3fad-48b7-b7db-f07337638340 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:20.933393 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d8d94565-3fad-48b7-b7db-f07337638340 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1471 microversion: 2.1 time: 0.221952 Sep 08 12:38:20.933487 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 121/246] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:20 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1471 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:21.088156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d54965e5-e185-4a86-b0bf-657263b2f070 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:21.089771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d54965e5-e185-4a86-b0bf-657263b2f070 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:21.098221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d54965e5-e185-4a86-b0bf-657263b2f070 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:21.099089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d54965e5-e185-4a86-b0bf-657263b2f070 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:21.100098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d54965e5-e185-4a86-b0bf-657263b2f070 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:21.101394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d54965e5-e185-4a86-b0bf-657263b2f070 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:21.102098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d54965e5-e185-4a86-b0bf-657263b2f070 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:21.102667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d54965e5-e185-4a86-b0bf-657263b2f070 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:21.257746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-57631def-4593-4103-96a9-12a74787bbb9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:21.258894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-57631def-4593-4103-96a9-12a74787bbb9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:21.273666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57631def-4593-4103-96a9-12a74787bbb9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:21.276210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57631def-4593-4103-96a9-12a74787bbb9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:21.278546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57631def-4593-4103-96a9-12a74787bbb9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:21.280487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57631def-4593-4103-96a9-12a74787bbb9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:21.286099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57631def-4593-4103-96a9-12a74787bbb9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:21.286850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57631def-4593-4103-96a9-12a74787bbb9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:21.291644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d54965e5-e185-4a86-b0bf-657263b2f070 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:21.305258 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d54965e5-e185-4a86-b0bf-657263b2f070 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1316 microversion: 2.1 time: 0.224470 Sep 08 12:38:21.321383 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 126/247] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:21 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:21.334406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-388733a2-6c17-4faa-9cc2-e5b0a25b9a4c req-e0b31b3c-033f-4937-8b2a-8f088fc66c84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "164b7ad7-b8db-4492-a973-c90ee923e01b", "tag": "e3298c03-e65b-4468-977e-c289c1d17507"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:21.373558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-388733a2-6c17-4faa-9cc2-e5b0a25b9a4c req-e0b31b3c-033f-4937-8b2a-8f088fc66c84 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:21.381937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-388733a2-6c17-4faa-9cc2-e5b0a25b9a4c req-e0b31b3c-033f-4937-8b2a-8f088fc66c84 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:21.382722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-388733a2-6c17-4faa-9cc2-e5b0a25b9a4c req-e0b31b3c-033f-4937-8b2a-8f088fc66c84 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:21.415789 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-388733a2-6c17-4faa-9cc2-e5b0a25b9a4c req-e0b31b3c-033f-4937-8b2a-8f088fc66c84 service nova] Creating event network-changed:e3298c03-e65b-4468-977e-c289c1d17507 for instance 164b7ad7-b8db-4492-a973-c90ee923e01b on n-h2-852084-10 Sep 08 12:38:21.429470 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-388733a2-6c17-4faa-9cc2-e5b0a25b9a4c req-e0b31b3c-033f-4937-8b2a-8f088fc66c84 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105732 Sep 08 12:38:21.430391 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 127/248] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:21.614079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-57631def-4593-4103-96a9-12a74787bbb9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:21.625565 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-57631def-4593-4103-96a9-12a74787bbb9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 200 len: 1587 microversion: 2.1 time: 0.372610 Sep 08 12:38:21.626646 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 122/249] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:21 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 1587 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:21.962094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3b646122-ed09-460b-824a-90444ea018c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:21.963009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3b646122-ed09-460b-824a-90444ea018c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:21.983761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b646122-ed09-460b-824a-90444ea018c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:21.984664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b646122-ed09-460b-824a-90444ea018c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:21.986440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b646122-ed09-460b-824a-90444ea018c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:21.988344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b646122-ed09-460b-824a-90444ea018c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:21.989680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b646122-ed09-460b-824a-90444ea018c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:21.990419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b646122-ed09-460b-824a-90444ea018c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:22.328661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b646122-ed09-460b-824a-90444ea018c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:22.330025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2afcddb0-8f15-4f95-a98b-cd2f914734d4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:22.331109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2afcddb0-8f15-4f95-a98b-cd2f914734d4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:22.338606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2afcddb0-8f15-4f95-a98b-cd2f914734d4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:22.339433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2afcddb0-8f15-4f95-a98b-cd2f914734d4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:22.340720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2afcddb0-8f15-4f95-a98b-cd2f914734d4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:22.342190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2afcddb0-8f15-4f95-a98b-cd2f914734d4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:22.342759 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3b646122-ed09-460b-824a-90444ea018c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1471 microversion: 2.1 time: 0.385436 Sep 08 12:38:22.343172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2afcddb0-8f15-4f95-a98b-cd2f914734d4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:22.348754 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 128/250] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:21 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1471 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:22.353539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2afcddb0-8f15-4f95-a98b-cd2f914734d4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:22.733119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2afcddb0-8f15-4f95-a98b-cd2f914734d4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:22.761355 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2afcddb0-8f15-4f95-a98b-cd2f914734d4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1466 microversion: 2.1 time: 0.435315 Sep 08 12:38:22.762704 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 123/251] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:22 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1466 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:23.082706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-693cb51e-18e4-4e87-b96f-a7c9cca07c00 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:23.083369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-693cb51e-18e4-4e87-b96f-a7c9cca07c00 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:23.093794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-693cb51e-18e4-4e87-b96f-a7c9cca07c00 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:23.094288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-693cb51e-18e4-4e87-b96f-a7c9cca07c00 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:23.094723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-693cb51e-18e4-4e87-b96f-a7c9cca07c00 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:23.095473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-693cb51e-18e4-4e87-b96f-a7c9cca07c00 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:23.095933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-693cb51e-18e4-4e87-b96f-a7c9cca07c00 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:23.096360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-693cb51e-18e4-4e87-b96f-a7c9cca07c00 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:23.449534 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-693cb51e-18e4-4e87-b96f-a7c9cca07c00 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1619 microversion: 2.1 time: 0.666781 Sep 08 12:38:23.451020 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 129/252] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:22 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1619 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:23.474682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0507b64a-2bb1-4a39-a3d0-e2d9a1353105 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:23.475406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0507b64a-2bb1-4a39-a3d0-e2d9a1353105 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:23.483295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0507b64a-2bb1-4a39-a3d0-e2d9a1353105 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:23.484109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0507b64a-2bb1-4a39-a3d0-e2d9a1353105 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:23.484727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0507b64a-2bb1-4a39-a3d0-e2d9a1353105 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:23.485616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0507b64a-2bb1-4a39-a3d0-e2d9a1353105 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:23.486305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0507b64a-2bb1-4a39-a3d0-e2d9a1353105 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:23.486950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0507b64a-2bb1-4a39-a3d0-e2d9a1353105 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:23.660679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0507b64a-2bb1-4a39-a3d0-e2d9a1353105 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:23.670585 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0507b64a-2bb1-4a39-a3d0-e2d9a1353105 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1471 microversion: 2.1 time: 0.199777 Sep 08 12:38:23.671180 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 130/253] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:23 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1471 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:23.676508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-495b2f4a-1dc3-4caf-a426-7b6f0d2b38b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Action: 'create', calling method: .version_select at 0x7fdb3b7ef4c0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-912559757", "policies": ["affinity"]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:23.693739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=77 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:23.696947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-495b2f4a-1dc3-4caf-a426-7b6f0d2b38b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:23.702943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-495b2f4a-1dc3-4caf-a426-7b6f0d2b38b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:23.714529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4d95d6ad-edb6-489f-a71f-283e471394b7 tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-602618453", "id": 297878231, "os-flavor-access:is_public": "False"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:23.742580 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4d95d6ad-edb6-489f-a71f-283e471394b7 tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.468997 Sep 08 12:38:23.747386 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 124/254] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:23 2022] POST /compute/v2.1/flavors => generated 427 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:23.780444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-495b2f4a-1dc3-4caf-a426-7b6f0d2b38b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:23.793190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-495b2f4a-1dc3-4caf-a426-7b6f0d2b38b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:23.808215 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-495b2f4a-1dc3-4caf-a426-7b6f0d2b38b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.135645 Sep 08 12:38:23.808864 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 131/255] 10.222.0.78 () {60 vars in 1174 bytes} [Thu Sep 8 12:38:23 2022] POST /compute/v2.1/os-server-groups => generated 187 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:23.813813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4b25d178-1b4d-4f0c-8de6-2fddb3d19d89 tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "48ec6d4ace7e4969acd95d79931dbbae"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:24.038983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b4ccae14-27e7-4a31-a892-e0eae58938ec tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Calling method '.version_select at 0x7fdb377abee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:24.043089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4ccae14-27e7-4a31-a892-e0eae58938ec tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:24.044764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4ccae14-27e7-4a31-a892-e0eae58938ec tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:24.045424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4ccae14-27e7-4a31-a892-e0eae58938ec tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:24.046426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4ccae14-27e7-4a31-a892-e0eae58938ec tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:24.047097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4ccae14-27e7-4a31-a892-e0eae58938ec tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:24.048184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4ccae14-27e7-4a31-a892-e0eae58938ec tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:24.077333 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b4ccae14-27e7-4a31-a892-e0eae58938ec tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.328232 Sep 08 12:38:24.078652 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 125/256] 10.222.0.78 () {58 vars in 1128 bytes} [Thu Sep 8 12:38:23 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:24.335366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:INSERT=10,nova_api:SELECT=87,nova_api:DELETE=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:24.353178 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4b25d178-1b4d-4f0c-8de6-2fddb3d19d89 tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/297878231/action" status: 200 len: 96 microversion: 2.1 time: 0.543048 Sep 08 12:38:24.353920 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 132/257] 10.222.0.78 () {60 vars in 1197 bytes} [Thu Sep 8 12:38:23 2022] POST /compute/v2.1/flavors/297878231/action => generated 96 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:38:24.364048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-65641ccf-62ba-4a7a-8467-9fbb7eeab5ca tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Calling method '.version_select at 0x7fdb3d1eeee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:24.365675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1973599560", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4bc5fef3-8020-4e3b-9c5f-f4d3053e177f"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:24.369960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-65641ccf-62ba-4a7a-8467-9fbb7eeab5ca tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': 'fc94f046b6ae4822872277eb50bc8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fc527efbb46f2a1c7d52d637c79ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-65641ccf-62ba-4a7a-8467-9fbb7eeab5ca tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Request method failure captured: Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeI82XTUvqlktJMFOVxTPYvm2IO7974qd1EVp01vW6x0JnxFPWmryfOQ1rxcuc5k0UHLpUrktOOnJQr3oBctSZXTNTmVszzWxgNuaMkCAZTv55J0BKJ9kT_2BvveRuTFS3CuC_1fz7Uizpkyg3f3rnvUXiPDhRNCbUiuop6VHlDAe8o Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: e65fc527efbb46f2a1c7d52d637c79ce Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:24.373658 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: e65fc527efbb46f2a1c7d52d637c79ce Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HostsAdminNegativeTestJSON-1360240659-project Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: fc94f046b6ae4822872277eb50bc8bc6 Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1360240659-project Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: action_args: {} Sep 08 12:38:24.374909 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:24.375666 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Sep 08 12:38:24.376716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:24.380389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-65641ccf-62ba-4a7a-8467-9fbb7eeab5ca tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:24.380389 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-65641ccf-62ba-4a7a-8467-9fbb7eeab5ca tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] 10.222.0.78 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.289101 Sep 08 12:38:24.380389 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 126/258] 10.222.0.78 () {58 vars in 1128 bytes} [Thu Sep 8 12:38:24 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 291 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 12:38:24.434238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:38:24.675728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:38:24.676628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:38:24.677552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:38:24.678052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:38:24.678977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:38:24.711579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:24.712073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:24.712509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:24.713235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:24.713687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:24.714119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:24.732389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:24.737237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:24.751641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Going to run 2 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:38:24.754019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: d348606f-4433-463c-b587-79f3f2e1fec1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:38:24.796013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128971) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 08 12:38:24.815431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:24.820254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:24.851819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e8f713f-ef31-43ac-b106-43fee82c84e4 tempest-FlavorsAccessTestJSON-2110980950 tempest-FlavorsAccessTestJSON-2110980950-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:24.869336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:24.874088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:24.888698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=d348606f-4433-463c-b587-79f3f2e1fec1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:38:24.900831 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3e8f713f-ef31-43ac-b106-43fee82c84e4 tempest-FlavorsAccessTestJSON-2110980950 tempest-FlavorsAccessTestJSON-2110980950-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6233 microversion: 2.1 time: 0.523632 Sep 08 12:38:24.901833 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 127/259] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:24 2022] GET /compute/v2.1/flavors/detail => generated 6233 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:24.907041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79bd1601-64c8-4aa9-a847-9de00079966e tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Calling method '.version_select at 0x7fdb377ab940>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:24.909161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-79bd1601-64c8-4aa9-a847-9de00079966e tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': 'fc94f046b6ae4822872277eb50bc8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fc527efbb46f2a1c7d52d637c79ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79bd1601-64c8-4aa9-a847-9de00079966e tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Request method failure captured: Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hosts/n-d-852084-10/reboot HTTP/1.1 Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeI82XTUvqlktJMFOVxTPYvm2IO7974qd1EVp01vW6x0JnxFPWmryfOQ1rxcuc5k0UHLpUrktOOnJQr3oBctSZXTNTmVszzWxgNuaMkCAZTv55J0BKJ9kT_2BvveRuTFS3CuC_1fz7Uizpkyg3f3rnvUXiPDhRNCbUiuop6VHlDAe8o Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: e65fc527efbb46f2a1c7d52d637c79ce Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:24.911023 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: e65fc527efbb46f2a1c7d52d637c79ce Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HostsAdminNegativeTestJSON-1360240659-project Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: fc94f046b6ae4822872277eb50bc8bc6 Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1360240659-project Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'n-d-852084-10'} Sep 08 12:38:24.912442 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:24.913415 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Sep 08 12:38:24.914973 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:24.917116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79bd1601-64c8-4aa9-a847-9de00079966e tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:24.919089 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-79bd1601-64c8-4aa9-a847-9de00079966e tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-852084-10/reboot" status: 403 len: 111 microversion: 2.1 time: 0.015235 Sep 08 12:38:24.920089 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 128/260] 10.222.0.78 () {58 vars in 1191 bytes} [Thu Sep 8 12:38:24 2022] GET /compute/v2.1/os-hosts/n-d-852084-10/reboot => generated 111 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:24.929214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da365899-90a6-4acc-9f61-92768c3c0c48 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:24.930202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-da365899-90a6-4acc-9f61-92768c3c0c48 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:24.939479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da365899-90a6-4acc-9f61-92768c3c0c48 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:24.939972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da365899-90a6-4acc-9f61-92768c3c0c48 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:24.940524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da365899-90a6-4acc-9f61-92768c3c0c48 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:24.941314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da365899-90a6-4acc-9f61-92768c3c0c48 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:24.941908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da365899-90a6-4acc-9f61-92768c3c0c48 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:24.942367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da365899-90a6-4acc-9f61-92768c3c0c48 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:24.956335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:24.961493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:25.015432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:25.021760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:25.080649 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d9769a47-0cd7-4930-863c-0a4077e4778a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.718886 Sep 08 12:38:25.081733 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 133/261] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:24 2022] POST /compute/v2.1/servers => generated 32 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 08 12:38:25.088081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d7749299-ac22-413e-8f1e-3bb999e24190 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Calling method '.version_select at 0x7fdb3ba158b0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:25.098000 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-d7749299-ac22-413e-8f1e-3bb999e24190 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d7749299-ac22-413e-8f1e-3bb999e24190 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Request method failure captured: Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeI_pix4ehT8wU68yG_MPNn4U9BZrDVRHU8Svc5oDghVhgXTYmv-7eSqUtP2r4Mv8S91oVxu9aJ_CypZrWxR5dEZvQs4PaW5vwqcmZVXhCBvVfCjmrHHL_dm9dUDFobIHkGcWz4D4woO5QZGzzAcCGimnA4C1S7K0H3IJFbsm3Mf_VM Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:38:25.100718 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 839a68d84d3c433d8ff2692e4cfd6b1d Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'nonexistent_hostname'} Sep 08 12:38:25.102052 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:25.102795 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 08 12:38:25.103850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:25.105203 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.105203 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.105203 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.105203 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.105203 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.105203 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.105203 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.105203 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:25.105203 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:25.105203 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.105203 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.119529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d7749299-ac22-413e-8f1e-3bb999e24190 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:25.120911 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d7749299-ac22-413e-8f1e-3bb999e24190 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.037830 Sep 08 12:38:25.122391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-da365899-90a6-4acc-9f61-92768c3c0c48 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:25.131264 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 134/262] 10.222.0.78 () {58 vars in 1212 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:25.137002 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-da365899-90a6-4acc-9f61-92768c3c0c48 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.215423 Sep 08 12:38:25.137520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b2909de7-28cd-4ed5-9c44-bc53eafc197d tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "48ec6d4ace7e4969acd95d79931dbbae"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:25.157263 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 129/263] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:24 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:25.163826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e9b080c4-3b27-4517-a8e9-84a3ad91cc4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:25.172315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e9b080c4-3b27-4517-a8e9-84a3ad91cc4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:25.174308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e9b080c4-3b27-4517-a8e9-84a3ad91cc4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Searching by: {'deleted': False, 'project_id': '5be40b5c51b9493d85c199b11a32726e'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:38:25.211495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9b080c4-3b27-4517-a8e9-84a3ad91cc4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:25.212234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9b080c4-3b27-4517-a8e9-84a3ad91cc4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:25.212906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9b080c4-3b27-4517-a8e9-84a3ad91cc4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:25.214138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9b080c4-3b27-4517-a8e9-84a3ad91cc4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:25.214733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9b080c4-3b27-4517-a8e9-84a3ad91cc4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:25.215342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9b080c4-3b27-4517-a8e9-84a3ad91cc4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:25.332726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-e9b080c4-3b27-4517-a8e9-84a3ad91cc4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:38:25.460979 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e9b080c4-3b27-4517-a8e9-84a3ad91cc4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.301902 Sep 08 12:38:25.461959 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 130/264] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/servers => generated 1003 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:25.468717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e20533b4-b4a1-4657-a725-eded6beff1b5 tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Calling method '.version_select at 0x7fdb377b7ca0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:25.470668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e20533b4-b4a1-4657-a725-eded6beff1b5 tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': 'fc94f046b6ae4822872277eb50bc8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fc527efbb46f2a1c7d52d637c79ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e20533b4-b4a1-4657-a725-eded6beff1b5 tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Request method failure captured: Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hosts/n-d-852084-10 HTTP/1.1 Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeI82XTUvqlktJMFOVxTPYvm2IO7974qd1EVp01vW6x0JnxFPWmryfOQ1rxcuc5k0UHLpUrktOOnJQr3oBctSZXTNTmVszzWxgNuaMkCAZTv55J0BKJ9kT_2BvveRuTFS3CuC_1fz7Uizpkyg3f3rnvUXiPDhRNCbUiuop6VHlDAe8o Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: e65fc527efbb46f2a1c7d52d637c79ce Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:25.472589 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: e65fc527efbb46f2a1c7d52d637c79ce Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HostsAdminNegativeTestJSON-1360240659-project Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: fc94f046b6ae4822872277eb50bc8bc6 Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1360240659-project Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'n-d-852084-10'} Sep 08 12:38:25.474057 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:25.474926 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Sep 08 12:38:25.476629 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.477758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e20533b4-b4a1-4657-a725-eded6beff1b5 tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:25.477758 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e20533b4-b4a1-4657-a725-eded6beff1b5 tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-852084-10" status: 403 len: 109 microversion: 2.1 time: 0.012897 Sep 08 12:38:25.478546 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 131/265] 10.222.0.78 () {58 vars in 1170 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/os-hosts/n-d-852084-10 => generated 109 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:25.486980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6a59d080-641f-484a-b470-f47b60e5d23d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:25.488294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6a59d080-641f-484a-b470-f47b60e5d23d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:25.547703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6a59d080-641f-484a-b470-f47b60e5d23d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:25.553453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=87 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:25.556876 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6a59d080-641f-484a-b470-f47b60e5d23d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1219 microversion: 2.1 time: 0.077174 Sep 08 12:38:25.557736 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 132/266] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1219 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:25.572356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cb27fa43-e695-4368-9c28-dbb84ef0c69d tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Calling method '.version_select at 0x7fdb377ab280>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:25.579133 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-cb27fa43-e695-4368-9c28-dbb84ef0c69d tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cb27fa43-e695-4368-9c28-dbb84ef0c69d tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Request method failure captured: Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeI_pix4ehT8wU68yG_MPNn4U9BZrDVRHU8Svc5oDghVhgXTYmv-7eSqUtP2r4Mv8S91oVxu9aJ_CypZrWxR5dEZvQs4PaW5vwqcmZVXhCBvVfCjmrHHL_dm9dUDFobIHkGcWz4D4woO5QZGzzAcCGimnA4C1S7K0H3IJFbsm3Mf_VM Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:38:25.581008 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 839a68d84d3c433d8ff2692e4cfd6b1d Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'nonexistent_hostname'} Sep 08 12:38:25.582390 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.583257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.584353 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.585893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cb27fa43-e695-4368-9c28-dbb84ef0c69d tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:25.586783 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cb27fa43-e695-4368-9c28-dbb84ef0c69d tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.027315 Sep 08 12:38:25.587688 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 133/267] 10.222.0.78 () {58 vars in 1191 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:25.598770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60928906-956a-4d12-8de6-cae9fe6e0eb0 tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Calling method '.version_select at 0x7fdb377b7040>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:25.601392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-60928906-956a-4d12-8de6-cae9fe6e0eb0 tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': 'fc94f046b6ae4822872277eb50bc8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fc527efbb46f2a1c7d52d637c79ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60928906-956a-4d12-8de6-cae9fe6e0eb0 tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Request method failure captured: Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hosts/n-d-852084-10/shutdown HTTP/1.1 Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeI82XTUvqlktJMFOVxTPYvm2IO7974qd1EVp01vW6x0JnxFPWmryfOQ1rxcuc5k0UHLpUrktOOnJQr3oBctSZXTNTmVszzWxgNuaMkCAZTv55J0BKJ9kT_2BvveRuTFS3CuC_1fz7Uizpkyg3f3rnvUXiPDhRNCbUiuop6VHlDAe8o Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: e65fc527efbb46f2a1c7d52d637c79ce Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:25.603313 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: e65fc527efbb46f2a1c7d52d637c79ce Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HostsAdminNegativeTestJSON-1360240659-project Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: fc94f046b6ae4822872277eb50bc8bc6 Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1360240659-project Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'n-d-852084-10'} Sep 08 12:38:25.604488 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:25.605181 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Sep 08 12:38:25.606998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.608045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60928906-956a-4d12-8de6-cae9fe6e0eb0 tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:25.608045 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-60928906-956a-4d12-8de6-cae9fe6e0eb0 tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-852084-10/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.010960 Sep 08 12:38:25.608045 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 134/268] 10.222.0.78 () {58 vars in 1197 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/os-hosts/n-d-852084-10/shutdown => generated 113 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:25.616777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6a32c9aa-1b3f-4807-94f3-250d7522f793 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Calling method '.version_select at 0x7fdb377b7040>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:25.626325 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6a32c9aa-1b3f-4807-94f3-250d7522f793 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6a32c9aa-1b3f-4807-94f3-250d7522f793 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Request method failure captured: Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeI_pix4ehT8wU68yG_MPNn4U9BZrDVRHU8Svc5oDghVhgXTYmv-7eSqUtP2r4Mv8S91oVxu9aJ_CypZrWxR5dEZvQs4PaW5vwqcmZVXhCBvVfCjmrHHL_dm9dUDFobIHkGcWz4D4woO5QZGzzAcCGimnA4C1S7K0H3IJFbsm3Mf_VM Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:38:25.628737 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 839a68d84d3c433d8ff2692e4cfd6b1d Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'nonexistent_hostname'} Sep 08 12:38:25.629970 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:25.630733 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 08 12:38:25.631790 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6a32c9aa-1b3f-4807-94f3-250d7522f793 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6a32c9aa-1b3f-4807-94f3-250d7522f793 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.018518 Sep 08 12:38:25.632836 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 135/269] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:25.641150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c5700e22-8e7d-42ed-91cc-8715499c49ba tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Calling method '.version_select at 0x7fdb377ab5e0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:25.643541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c5700e22-8e7d-42ed-91cc-8715499c49ba tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': 'fc94f046b6ae4822872277eb50bc8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fc527efbb46f2a1c7d52d637c79ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c5700e22-8e7d-42ed-91cc-8715499c49ba tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Request method failure captured: Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hosts/n-d-852084-10/startup HTTP/1.1 Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeI82XTUvqlktJMFOVxTPYvm2IO7974qd1EVp01vW6x0JnxFPWmryfOQ1rxcuc5k0UHLpUrktOOnJQr3oBctSZXTNTmVszzWxgNuaMkCAZTv55J0BKJ9kT_2BvveRuTFS3CuC_1fz7Uizpkyg3f3rnvUXiPDhRNCbUiuop6VHlDAe8o Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: e65fc527efbb46f2a1c7d52d637c79ce Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:25.645864 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: e65fc527efbb46f2a1c7d52d637c79ce Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HostsAdminNegativeTestJSON-1360240659-project Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: fc94f046b6ae4822872277eb50bc8bc6 Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1360240659-project Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'n-d-852084-10'} Sep 08 12:38:25.647385 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:25.648083 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Sep 08 12:38:25.649076 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.649994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c5700e22-8e7d-42ed-91cc-8715499c49ba tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:25.649994 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c5700e22-8e7d-42ed-91cc-8715499c49ba tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] 10.222.0.78 "GET /compute/v2.1/os-hosts/n-d-852084-10/startup" status: 403 len: 110 microversion: 2.1 time: 0.012181 Sep 08 12:38:25.649994 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 136/270] 10.222.0.78 () {58 vars in 1194 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/os-hosts/n-d-852084-10/startup => generated 110 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 12:38:25.661234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-741fbc53-442f-46c3-9093-a4a6dd9d3ad8 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Calling method '.version_select at 0x7fdb377ea700>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:25.671912 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-741fbc53-442f-46c3-9093-a4a6dd9d3ad8 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-741fbc53-442f-46c3-9093-a4a6dd9d3ad8 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Request method failure captured: Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeI_pix4ehT8wU68yG_MPNn4U9BZrDVRHU8Svc5oDghVhgXTYmv-7eSqUtP2r4Mv8S91oVxu9aJ_CypZrWxR5dEZvQs4PaW5vwqcmZVXhCBvVfCjmrHHL_dm9dUDFobIHkGcWz4D4woO5QZGzzAcCGimnA4C1S7K0H3IJFbsm3Mf_VM Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:38:25.673940 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 839a68d84d3c433d8ff2692e4cfd6b1d Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'nonexistent_hostname'} Sep 08 12:38:25.675265 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:25.676226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Sep 08 12:38:25.677648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-741fbc53-442f-46c3-9093-a4a6dd9d3ad8 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-741fbc53-442f-46c3-9093-a4a6dd9d3ad8 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.019475 Sep 08 12:38:25.678817 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 137/271] 10.222.0.78 () {58 vars in 1215 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:25.692360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-45526fec-7d8e-4283-88b3-9484a211380d tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Action: 'update', calling method: .version_select at 0x7fdb377eaca0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-45526fec-7d8e-4283-88b3-9484a211380d tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Request method failure captured: Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/os-hosts/n-d-852084-10 HTTP/1.1 Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 51 Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeI_pix4ehT8wU68yG_MPNn4U9BZrDVRHU8Svc5oDghVhgXTYmv-7eSqUtP2r4Mv8S91oVxu9aJ_CypZrWxR5dEZvQs4PaW5vwqcmZVXhCBvVfCjmrHHL_dm9dUDFobIHkGcWz4D4woO5QZGzzAcCGimnA4C1S7K0H3IJFbsm3Mf_VM Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:38:25.706325 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 839a68d84d3c433d8ff2692e4cfd6b1d Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: {"status": "enable", "maintenance_mode": "invalid"} Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:25.707785 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'n-d-852084-10', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'disable', Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'Enable', Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'Disable', Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance: Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'invalid' Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.708647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.710082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.711086 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.711086 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:38:25.711086 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:38:25.711086 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 12:38:25.711086 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.711086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-45526fec-7d8e-4283-88b3-9484a211380d tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:25.711086 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-45526fec-7d8e-4283-88b3-9484a211380d tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-852084-10" status: 400 len: 199 microversion: 2.1 time: 0.022130 Sep 08 12:38:25.717186 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 138/272] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Sep 8 12:38:25 2022] PUT /compute/v2.1/os-hosts/n-d-852084-10 => generated 199 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:38:25.723045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e9ee8617-6f25-4f9c-a95f-a96bcd4719b3 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Action: 'update', calling method: .version_select at 0x7fdb377b78b0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e9ee8617-6f25-4f9c-a95f-a96bcd4719b3 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Request method failure captured: Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/os-hosts/n-d-852084-10 HTTP/1.1 Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 51 Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeI_pix4ehT8wU68yG_MPNn4U9BZrDVRHU8Svc5oDghVhgXTYmv-7eSqUtP2r4Mv8S91oVxu9aJ_CypZrWxR5dEZvQs4PaW5vwqcmZVXhCBvVfCjmrHHL_dm9dUDFobIHkGcWz4D4woO5QZGzzAcCGimnA4C1S7K0H3IJFbsm3Mf_VM Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:38:25.727014 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 839a68d84d3c433d8ff2692e4cfd6b1d Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: {"status": "invalid", "maintenance_mode": "enable"} Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:25.728237 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'n-d-852084-10', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'disable', Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'Enable', Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'Disable', Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance: Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'invalid' Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.728937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.730260 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.731391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.731391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:38:25.731391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:38:25.731391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Sep 08 12:38:25.731391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.731391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e9ee8617-6f25-4f9c-a95f-a96bcd4719b3 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:25.731391 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e9ee8617-6f25-4f9c-a95f-a96bcd4719b3 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-852084-10" status: 400 len: 189 microversion: 2.1 time: 0.010240 Sep 08 12:38:25.735621 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 139/273] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Sep 8 12:38:25 2022] PUT /compute/v2.1/os-hosts/n-d-852084-10 => generated 189 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:38:25.741048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e7f00f53-1f7c-4c2c-afd0-76dc1c58239c tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Action: 'update', calling method: .version_select at 0x7fdb37772ca0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:25.745755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e7f00f53-1f7c-4c2c-afd0-76dc1c58239c tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': 'fc94f046b6ae4822872277eb50bc8bc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e65fc527efbb46f2a1c7d52d637c79ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e7f00f53-1f7c-4c2c-afd0-76dc1c58239c tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Request method failure captured: Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/os-hosts/n-d-852084-10 HTTP/1.1 Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 50 Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeI82XTUvqlktJMFOVxTPYvm2IO7974qd1EVp01vW6x0JnxFPWmryfOQ1rxcuc5k0UHLpUrktOOnJQr3oBctSZXTNTmVszzWxgNuaMkCAZTv55J0BKJ9kT_2BvveRuTFS3CuC_1fz7Uizpkyg3f3rnvUXiPDhRNCbUiuop6VHlDAe8o Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: e65fc527efbb46f2a1c7d52d637c79ce Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:25.748773 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e65fc527efbb46f2a1c7d52d637c79ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: e65fc527efbb46f2a1c7d52d637c79ce Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1360240659 Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-HostsAdminNegativeTestJSON-1360240659-project Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: fc94f046b6ae4822872277eb50bc8bc6 Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1360240659-project Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: {"status": "enable", "maintenance_mode": "enable"} Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 08 12:38:25.750002 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'n-d-852084-10', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:25.750866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Sep 08 12:38:25.752094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.755944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e7f00f53-1f7c-4c2c-afd0-76dc1c58239c tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:25.757663 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e7f00f53-1f7c-4c2c-afd0-76dc1c58239c tempest-HostsAdminNegativeTestJSON-1360240659 tempest-HostsAdminNegativeTestJSON-1360240659-project] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-852084-10" status: 403 len: 111 microversion: 2.1 time: 0.020706 Sep 08 12:38:25.758847 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 140/274] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Sep 8 12:38:25 2022] PUT /compute/v2.1/os-hosts/n-d-852084-10 => generated 111 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:25.812440 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b2909de7-28cd-4ed5-9c44-bc53eafc197d tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/297878231/action" status: 200 len: 21 microversion: 2.1 time: 0.677295 Sep 08 12:38:25.813140 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 135/275] 10.222.0.78 () {60 vars in 1197 bytes} [Thu Sep 8 12:38:25 2022] POST /compute/v2.1/flavors/297878231/action => generated 21 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:38:25.823614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-888da483-1ca7-460e-acbb-8dda9541f722 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3b7244c0>, body: {"status": null, "maintenance_mode": null} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-888da483-1ca7-460e-acbb-8dda9541f722 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Request method failure captured: Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: request: PUT /compute/v2.1/os-hosts/n-d-852084-10 HTTP/1.1 Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 42 Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeI_pix4ehT8wU68yG_MPNn4U9BZrDVRHU8Svc5oDghVhgXTYmv-7eSqUtP2r4Mv8S91oVxu9aJ_CypZrWxR5dEZvQs4PaW5vwqcmZVXhCBvVfCjmrHHL_dm9dUDFobIHkGcWz4D4woO5QZGzzAcCGimnA4C1S7K0H3IJFbsm3Mf_VM Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:38:25.828510 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 839a68d84d3c433d8ff2692e4cfd6b1d Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: {"status": null, "maintenance_mode": null} Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 08 12:38:25.829946 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'n-d-852084-10', 'body': {'status': None, 'maintenance_mode': None}} Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'disable', Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'Enable', Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'Disable', Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'ENABLE', Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'DISABLE'], Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance: Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi None Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.831376 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.833107 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.834562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:38:25.834562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:38:25.834562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Sep 08 12:38:25.834562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.834562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-888da483-1ca7-460e-acbb-8dda9541f722 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:25.834562 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-888da483-1ca7-460e-acbb-8dda9541f722 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/n-d-852084-10" status: 400 len: 127 microversion: 2.1 time: 0.011621 Sep 08 12:38:25.834562 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 136/276] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Sep 8 12:38:25 2022] PUT /compute/v2.1/os-hosts/n-d-852084-10 => generated 127 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:38:25.835331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a9a0a955-c89b-4988-9e30-ae0fe415a237 tempest-FlavorsAccessTestJSON-2110980950 tempest-FlavorsAccessTestJSON-2110980950-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:25.875024 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a9a0a955-c89b-4988-9e30-ae0fe415a237 tempest-FlavorsAccessTestJSON-2110980950 tempest-FlavorsAccessTestJSON-2110980950-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.043312 Sep 08 12:38:25.876081 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 137/277] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:25.882029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8089580f-9e76-4265-9ee8-1925af1e6c47 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3ba15af0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:25.885717 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.hosts [None req-8089580f-9e76-4265-9ee8-1925af1e6c47 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Enabling host nonexistent_hostname. Sep 08 12:38:25.898849 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-8089580f-9e76-4265-9ee8-1925af1e6c47 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8089580f-9e76-4265-9ee8-1925af1e6c47 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Request method failure captured: Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 50 Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeI_pix4ehT8wU68yG_MPNn4U9BZrDVRHU8Svc5oDghVhgXTYmv-7eSqUtP2r4Mv8S91oVxu9aJ_CypZrWxR5dEZvQs4PaW5vwqcmZVXhCBvVfCjmrHHL_dm9dUDFobIHkGcWz4D4woO5QZGzzAcCGimnA4C1S7K0H3IJFbsm3Mf_VM Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:38:25.900653 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f2f622017efa453c80a6c8bb8d011233"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: f2f622017efa453c80a6c8bb8d011233 Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1470802881 Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 839a68d84d3c433d8ff2692e4cfd6b1d Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1470802881-project-admin Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: {"status": "enable", "maintenance_mode": "enable"} Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: exception: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.901809 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Sep 08 12:38:25.902641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:25.908801 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:25.911106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8089580f-9e76-4265-9ee8-1925af1e6c47 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:25.913738 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8089580f-9e76-4265-9ee8-1925af1e6c47 tempest-HostsAdminNegativeTestJSON-1470802881 tempest-HostsAdminNegativeTestJSON-1470802881-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.025146 Sep 08 12:38:25.913738 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 138/278] 10.222.0.78 () {60 vars in 1211 bytes} [Thu Sep 8 12:38:25 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:38:25.913738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8ac7c02d-ce0e-4024-a16e-0edd9d94ae68 tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:25.932539 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8ac7c02d-ce0e-4024-a16e-0edd9d94ae68 tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/297878231" status: 202 len: 0 microversion: 2.1 time: 0.027818 Sep 08 12:38:25.933683 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 139/279] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:38:25 2022] DELETE /compute/v2.1/flavors/297878231 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:25.947072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0343a479-975e-42ce-afbd-5aad042be532 tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:25.972777 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0343a479-975e-42ce-afbd-5aad042be532 tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.034614 Sep 08 12:38:25.974916 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 140/280] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:26.122134 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-039dfbb8-d1fb-44a0-8a9e-ab8841f78e3a tempest-TenantUsagesNegativeTestJSON-912406645 tempest-TenantUsagesNegativeTestJSON-912406645-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-07T12%3A38%3A25.746203&end=2022-09-09T12%3A38%3A25.746203" status: 404 len: 112 microversion: - time: 0.361112 Sep 08 12:38:26.123830 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 141/281] 10.222.0.78 () {58 vars in 1316 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-09-07T12%3A38%3A25.746203&end=2022-09-09T12%3A38%3A25.746203 => generated 112 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 12:38:26.138176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-02622fa8-2588-4920-b9dc-4000598aece5 tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-933252790", "id": 907371964, "os-flavor-access:is_public": "False"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:26.176848 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-02622fa8-2588-4920-b9dc-4000598aece5 tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.044057 Sep 08 12:38:26.179170 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 142/282] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:26 2022] POST /compute/v2.1/flavors => generated 427 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:26.187770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ce76b01-be2d-487f-9fd5-0472302cfbde tempest-TenantUsagesNegativeTestJSON-912406645 tempest-TenantUsagesNegativeTestJSON-912406645-project-admin] Calling method '.version_select at 0x7fdb377ea4c0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:26.194788 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-1ce76b01-be2d-487f-9fd5-0472302cfbde tempest-TenantUsagesNegativeTestJSON-912406645 tempest-TenantUsagesNegativeTestJSON-912406645-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ce76b01-be2d-487f-9fd5-0472302cfbde tempest-TenantUsagesNegativeTestJSON-912406645 tempest-TenantUsagesNegativeTestJSON-912406645-project-admin] Request method failure captured: Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-simple-tenant-usage/b85e615d8dc74dbf9c285644ae4b27bd?start=2022-09-09T12%3A38%3A25.746203&end=2022-09-07T12%3A38%3A25.746203 HTTP/1.1 Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJBnTIzA2OElLt5T58qcFtIlzjB8ScIsd9yh-JkriAkrg12AHwimt-vDDTZoN72PWFuFmM3Sa0eQJ7Oc-4DsgtXLWJ_KCd2GeDLMMFHscogRw018B3WL0pT_0feMO-2Zksdmtx5Irwre6X08t6qNg_0btS9uWcKKvV2cUBBqHsYpGI Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 5272c83e75914b98a22a974b9612982d Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-912406645 Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:38:26.197278 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:38:26.198481 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5272c83e75914b98a22a974b9612982d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5272c83e75914b98a22a974b9612982d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5272c83e75914b98a22a974b9612982d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5272c83e75914b98a22a974b9612982d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:26.198481 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-912406645 Sep 08 12:38:26.198481 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 5272c83e75914b98a22a974b9612982d Sep 08 12:38:26.198481 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-912406645 Sep 08 12:38:26.198481 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TenantUsagesNegativeTestJSON-912406645-project-admin Sep 08 12:38:26.198481 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:26.198481 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:26.198481 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: ff25e8cdc0a64f3abe851ee2f72ca010 Sep 08 12:38:26.198481 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-912406645-project-admin Sep 08 12:38:26.198481 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:26.198481 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid start time. The start time cannot occur after the end time. Sep 08 12:38:26.198481 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'b85e615d8dc74dbf9c285644ae4b27bd'} Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._show(req, id) Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 08 12:38:26.199155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Sep 08 12:38:26.200784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:26.200784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:26.200784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:26.200784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:26.200784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:26.200784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:26.200784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:26.200784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:26.200784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Sep 08 12:38:26.200784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:26.202377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ce76b01-be2d-487f-9fd5-0472302cfbde tempest-TenantUsagesNegativeTestJSON-912406645 tempest-TenantUsagesNegativeTestJSON-912406645-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:26.203425 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1ce76b01-be2d-487f-9fd5-0472302cfbde tempest-TenantUsagesNegativeTestJSON-912406645 tempest-TenantUsagesNegativeTestJSON-912406645-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/b85e615d8dc74dbf9c285644ae4b27bd?start=2022-09-09T12%3A38%3A25.746203&end=2022-09-07T12%3A38%3A25.746203" status: 400 len: 111 microversion: 2.1 time: 0.022693 Sep 08 12:38:26.204157 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 143/283] 10.222.0.78 () {58 vars in 1412 bytes} [Thu Sep 8 12:38:26 2022] GET /compute/v2.1/os-simple-tenant-usage/b85e615d8dc74dbf9c285644ae4b27bd?start=2022-09-09T12%3A38%3A25.746203&end=2022-09-07T12%3A38%3A25.746203 => generated 111 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:38:26.214322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f3b810fe-baf5-4cfc-9cea-1689fe967407 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:26.215671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f3b810fe-baf5-4cfc-9cea-1689fe967407 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:26.225589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3b810fe-baf5-4cfc-9cea-1689fe967407 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:26.226620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3b810fe-baf5-4cfc-9cea-1689fe967407 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:26.227511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3b810fe-baf5-4cfc-9cea-1689fe967407 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:26.228676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3b810fe-baf5-4cfc-9cea-1689fe967407 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:26.229652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3b810fe-baf5-4cfc-9cea-1689fe967407 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:26.230832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3b810fe-baf5-4cfc-9cea-1689fe967407 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:26.380817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e4bee15f-9fb5-4925-ba4b-8d5b8f28e9ce tempest-AZAdminNegativeTestJSON-1887740663 tempest-AZAdminNegativeTestJSON-1887740663-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:26.392223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e4bee15f-9fb5-4925-ba4b-8d5b8f28e9ce tempest-AZAdminNegativeTestJSON-1887740663 tempest-AZAdminNegativeTestJSON-1887740663-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '03d558bfdd2c43768c104c588c29f02c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66ec68e93dae4f079e1294cc095812c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e4bee15f-9fb5-4925-ba4b-8d5b8f28e9ce tempest-AZAdminNegativeTestJSON-1887740663 tempest-AZAdminNegativeTestJSON-1887740663-project] Request method failure captured: Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeJAWDceqRGS3Bw5C_GOJPfsPjG2tkcbN2t0WCj9A1xOyuNg34_shpv52LNXflI8RiqMBeWIn5xeEdF4cSrljxFAk2viLWyoeyiNd1T56Un5MoIQi4EsORwmQfBrDaYaMTylHjTz8OQF5x-eYgzKPk4nPad0lGZzWIt7jSHwQ2Eqb1U Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 66ec68e93dae4f079e1294cc095812c8 Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1887740663 Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:38:26.398056 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:38:26.399587 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_66ec68e93dae4f079e1294cc095812c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/66ec68e93dae4f079e1294cc095812c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66ec68e93dae4f079e1294cc095812c8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/66ec68e93dae4f079e1294cc095812c8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:26.399587 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AZAdminNegativeTestJSON-1887740663 Sep 08 12:38:26.399587 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 66ec68e93dae4f079e1294cc095812c8 Sep 08 12:38:26.399587 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1887740663 Sep 08 12:38:26.399587 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AZAdminNegativeTestJSON-1887740663-project Sep 08 12:38:26.399587 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:26.399587 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:26.399587 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 03d558bfdd2c43768c104c588c29f02c Sep 08 12:38:26.399587 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AZAdminNegativeTestJSON-1887740663-project Sep 08 12:38:26.399587 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:26.399587 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 08 12:38:26.399587 n-d-852084-10 devstack@n-api.service[128971]: action_args: {} Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:26.400337 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:26.401548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e4bee15f-9fb5-4925-ba4b-8d5b8f28e9ce tempest-AZAdminNegativeTestJSON-1887740663 tempest-AZAdminNegativeTestJSON-1887740663-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:26.402617 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e4bee15f-9fb5-4925-ba4b-8d5b8f28e9ce tempest-AZAdminNegativeTestJSON-1887740663 tempest-AZAdminNegativeTestJSON-1887740663-project] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.423371 Sep 08 12:38:26.402617 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 141/284] 10.222.0.78 () {58 vars in 1185 bytes} [Thu Sep 8 12:38:25 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 424 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:26.410956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-35ff3716-ca8b-4d26-973d-3b2633ff85bf tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:26.412804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f3b810fe-baf5-4cfc-9cea-1689fe967407 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:26.423460 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f3b810fe-baf5-4cfc-9cea-1689fe967407 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.216599 Sep 08 12:38:26.424483 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 144/285] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:26 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:26.433413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:INSERT=9,nova_api:SELECT=87,nova_api:DELETE=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:26.436173 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-35ff3716-ca8b-4d26-973d-3b2633ff85bf tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/907371964/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.035156 Sep 08 12:38:26.437983 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 142/286] 10.222.0.78 () {58 vars in 1206 bytes} [Thu Sep 8 12:38:26 2022] GET /compute/v2.1/flavors/907371964/os-flavor-access => generated 21 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:38:26.448297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-60ad67de-10ff-4c96-aa14-a65f0dbebc93 tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:26.472342 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-60ad67de-10ff-4c96-aa14-a65f0dbebc93 tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/907371964" status: 202 len: 0 microversion: 2.1 time: 0.028192 Sep 08 12:38:26.473174 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 143/287] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:38:26 2022] DELETE /compute/v2.1/flavors/907371964 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 12:38:26.482277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d557dfbf-aac0-4f27-80f5-2cc55ec3e22d tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:26.507709 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d557dfbf-aac0-4f27-80f5-2cc55ec3e22d tempest-FlavorsAccessTestJSON-861060502 tempest-FlavorsAccessTestJSON-861060502-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.029932 Sep 08 12:38:26.508628 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 144/288] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:26 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:26.581873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fc6a590-4bba-46a1-8ce6-606c45e74fa1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:26.583460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1fc6a590-4bba-46a1-8ce6-606c45e74fa1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:26.589773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc6a590-4bba-46a1-8ce6-606c45e74fa1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:26.590714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc6a590-4bba-46a1-8ce6-606c45e74fa1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:26.592319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc6a590-4bba-46a1-8ce6-606c45e74fa1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:26.593425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc6a590-4bba-46a1-8ce6-606c45e74fa1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:26.594701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc6a590-4bba-46a1-8ce6-606c45e74fa1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:26.595305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc6a590-4bba-46a1-8ce6-606c45e74fa1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:26.669019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1fc6a590-4bba-46a1-8ce6-606c45e74fa1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:26.681146 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1fc6a590-4bba-46a1-8ce6-606c45e74fa1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1215 microversion: 2.1 time: 0.103737 Sep 08 12:38:26.683276 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 145/289] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:26 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1215 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:26.830147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2ee5a91b-c20e-4f38-859d-a107c753b28e tempest-TenantUsagesNegativeTestJSON-87875692 tempest-TenantUsagesNegativeTestJSON-87875692-project] Calling method '.version_select at 0x7fdb377ab790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:26.834070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2ee5a91b-c20e-4f38-859d-a107c753b28e tempest-TenantUsagesNegativeTestJSON-87875692 tempest-TenantUsagesNegativeTestJSON-87875692-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '7482ad0df2224f31b60cbb341bbb44f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b85e615d8dc74dbf9c285644ae4b27bd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2ee5a91b-c20e-4f38-859d-a107c753b28e tempest-TenantUsagesNegativeTestJSON-87875692 tempest-TenantUsagesNegativeTestJSON-87875692-project] Request method failure captured: Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T12%3A38%3A25.746203&end=2022-09-09T12%3A38%3A25.746203&detailed=1 HTTP/1.1 Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJApfIe2kaHI4DzDjzGhT6xD4rQS7RhN2VzBXdpajKkGHsuJzfJMx97adtqeqndA_Rajdf6O99cedLrm0OHvDqHz8Kp4txj1RyuyehwCyx4T3l4tmVMbSVTyiBW5-zMBxGEYXJULNIc2L05QrZDkuftNwZCv5Y_3s4Z8uwMpZELP_8 Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b85e615d8dc74dbf9c285644ae4b27bd Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-87875692 Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:26.835756 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b85e615d8dc74dbf9c285644ae4b27bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b85e615d8dc74dbf9c285644ae4b27bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b85e615d8dc74dbf9c285644ae4b27bd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b85e615d8dc74dbf9c285644ae4b27bd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-87875692 Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b85e615d8dc74dbf9c285644ae4b27bd Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-87875692 Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TenantUsagesNegativeTestJSON-87875692-project Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7482ad0df2224f31b60cbb341bbb44f4 Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-87875692-project Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: action_args: {} Sep 08 12:38:26.837221 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._index(req) Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:26.838121 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:26.839557 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:26.842155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Sep 08 12:38:26.842155 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:26.842155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2ee5a91b-c20e-4f38-859d-a107c753b28e tempest-TenantUsagesNegativeTestJSON-87875692 tempest-TenantUsagesNegativeTestJSON-87875692-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:26.842155 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2ee5a91b-c20e-4f38-859d-a107c753b28e tempest-TenantUsagesNegativeTestJSON-87875692 tempest-TenantUsagesNegativeTestJSON-87875692-project] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T12%3A38%3A25.746203&end=2022-09-09T12%3A38%3A25.746203&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.411731 Sep 08 12:38:26.848003 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 145/290] 10.222.0.78 () {58 vars in 1335 bytes} [Thu Sep 8 12:38:26 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T12%3A38%3A25.746203&end=2022-09-09T12%3A38%3A25.746203&detailed=1 => generated 123 bytes in 423 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:27.451469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc116b86-e11e-46bf-ba80-3bb614932954 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:27.453002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cc116b86-e11e-46bf-ba80-3bb614932954 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:27.466860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc116b86-e11e-46bf-ba80-3bb614932954 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:27.468497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc116b86-e11e-46bf-ba80-3bb614932954 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:27.469279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc116b86-e11e-46bf-ba80-3bb614932954 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:27.470198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc116b86-e11e-46bf-ba80-3bb614932954 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:27.471127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc116b86-e11e-46bf-ba80-3bb614932954 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:27.471795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc116b86-e11e-46bf-ba80-3bb614932954 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:27.708278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-40acd5e0-5527-4428-aa77-b32f092c7b3a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:27.708887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-40acd5e0-5527-4428-aa77-b32f092c7b3a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:27.718896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40acd5e0-5527-4428-aa77-b32f092c7b3a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:27.720967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40acd5e0-5527-4428-aa77-b32f092c7b3a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:27.724661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40acd5e0-5527-4428-aa77-b32f092c7b3a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:27.726081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40acd5e0-5527-4428-aa77-b32f092c7b3a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:27.728076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40acd5e0-5527-4428-aa77-b32f092c7b3a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:27.728743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40acd5e0-5527-4428-aa77-b32f092c7b3a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:27.754429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cc116b86-e11e-46bf-ba80-3bb614932954 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:27.763253 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cc116b86-e11e-46bf-ba80-3bb614932954 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.317189 Sep 08 12:38:27.763842 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 146/291] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:27 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:27.867651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40acd5e0-5527-4428-aa77-b32f092c7b3a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:27.877830 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-40acd5e0-5527-4428-aa77-b32f092c7b3a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1279 microversion: 2.1 time: 0.173117 Sep 08 12:38:27.885533 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 146/292] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:27 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:28.795061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ef1fb396-a720-4fe2-9d7e-e6eba0ea8303 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:28.795739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ef1fb396-a720-4fe2-9d7e-e6eba0ea8303 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:28.806240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef1fb396-a720-4fe2-9d7e-e6eba0ea8303 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:28.806741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef1fb396-a720-4fe2-9d7e-e6eba0ea8303 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:28.807717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef1fb396-a720-4fe2-9d7e-e6eba0ea8303 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:28.808780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef1fb396-a720-4fe2-9d7e-e6eba0ea8303 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:28.809551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef1fb396-a720-4fe2-9d7e-e6eba0ea8303 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:28.810854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef1fb396-a720-4fe2-9d7e-e6eba0ea8303 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:28.968916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1484585912", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:29.066072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:38:29.553584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ef1fb396-a720-4fe2-9d7e-e6eba0ea8303 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:29.583296 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ef1fb396-a720-4fe2-9d7e-e6eba0ea8303 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.791897 Sep 08 12:38:29.588080 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 147/293] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:28 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:29.599597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b50ef207-53be-4f95-92cb-285014f0aa64 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:29.600226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b50ef207-53be-4f95-92cb-285014f0aa64 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:29.616117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b50ef207-53be-4f95-92cb-285014f0aa64 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:29.619038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b50ef207-53be-4f95-92cb-285014f0aa64 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:29.622292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b50ef207-53be-4f95-92cb-285014f0aa64 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:29.623313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b50ef207-53be-4f95-92cb-285014f0aa64 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:29.624783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b50ef207-53be-4f95-92cb-285014f0aa64 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:29.626441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b50ef207-53be-4f95-92cb-285014f0aa64 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:29.776527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:38:29.777166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:38:29.778342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:38:29.778904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:38:29.779490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:38:29.802689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:29.803179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:29.803827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:29.804754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:29.805380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:29.805963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:29.850133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Getting quotas for project 4172137f3aa447edafafae76e41ef499. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:29.858977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Getting quotas for user c646b5da6995488db0ce3f405741b296 and project 4172137f3aa447edafafae76e41ef499. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:29.891902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:38:29.895004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:38:29.939186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b50ef207-53be-4f95-92cb-285014f0aa64 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:29.951085 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b50ef207-53be-4f95-92cb-285014f0aa64 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1319 microversion: 2.1 time: 0.361652 Sep 08 12:38:29.954582 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 148/294] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:29 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:30.029252 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ec04731f-3831-422d-96e6-b2394121c047 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.554400 Sep 08 12:38:30.037556 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 147/295] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1563 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:38:30.044761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28240ae2-e345-49e3-a28a-3de4a3608ba5 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:30.045324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-28240ae2-e345-49e3-a28a-3de4a3608ba5 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:30.177855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-28240ae2-e345-49e3-a28a-3de4a3608ba5 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:30.198119 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-28240ae2-e345-49e3-a28a-3de4a3608ba5 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1220 microversion: 2.1 time: 0.158853 Sep 08 12:38:30.202779 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 149/296] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:30 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1220 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:30.616208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-badaee42-3767-479d-91d7-14c04ba75848 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:30.627166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-badaee42-3767-479d-91d7-14c04ba75848 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:30.648694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-badaee42-3767-479d-91d7-14c04ba75848 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:30.653777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-badaee42-3767-479d-91d7-14c04ba75848 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:30.655106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-badaee42-3767-479d-91d7-14c04ba75848 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:30.656749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-badaee42-3767-479d-91d7-14c04ba75848 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:30.657560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-badaee42-3767-479d-91d7-14c04ba75848 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:30.658584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-badaee42-3767-479d-91d7-14c04ba75848 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:30.816461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-63d47144-2083-4a5d-ac25-dc1304bc23b3 req-9dfe6a93-77b3-40e3-ba16-c7d8968ca9ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d348606f-4433-463c-b587-79f3f2e1fec1", "tag": "c1ad86c3-77fd-45a8-95f2-dbd5b219161a"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:30.844995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-63d47144-2083-4a5d-ac25-dc1304bc23b3 req-9dfe6a93-77b3-40e3-ba16-c7d8968ca9ad service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:30.846436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-63d47144-2083-4a5d-ac25-dc1304bc23b3 req-9dfe6a93-77b3-40e3-ba16-c7d8968ca9ad service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:30.847366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-63d47144-2083-4a5d-ac25-dc1304bc23b3 req-9dfe6a93-77b3-40e3-ba16-c7d8968ca9ad service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:30.868045 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-63d47144-2083-4a5d-ac25-dc1304bc23b3 req-9dfe6a93-77b3-40e3-ba16-c7d8968ca9ad service nova] Creating event network-changed:c1ad86c3-77fd-45a8-95f2-dbd5b219161a for instance d348606f-4433-463c-b587-79f3f2e1fec1 on n-h1-852084-10 Sep 08 12:38:30.878892 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-63d47144-2083-4a5d-ac25-dc1304bc23b3 req-9dfe6a93-77b3-40e3-ba16-c7d8968ca9ad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067438 Sep 08 12:38:30.880262 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 150/297] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:38:30.983894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ec86a57-8deb-4fff-b375-0dc182b57c7c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:30.985332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6ec86a57-8deb-4fff-b375-0dc182b57c7c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:31.010832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ec86a57-8deb-4fff-b375-0dc182b57c7c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:31.012692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ec86a57-8deb-4fff-b375-0dc182b57c7c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:31.014052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ec86a57-8deb-4fff-b375-0dc182b57c7c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:31.016942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ec86a57-8deb-4fff-b375-0dc182b57c7c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:31.019588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ec86a57-8deb-4fff-b375-0dc182b57c7c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:31.021634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ec86a57-8deb-4fff-b375-0dc182b57c7c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:31.057598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-badaee42-3767-479d-91d7-14c04ba75848 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:31.095833 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-badaee42-3767-479d-91d7-14c04ba75848 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.479695 Sep 08 12:38:31.117321 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 148/298] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:30 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:31.231553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fadcd989-85f5-4729-ac13-a8219545b836 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:31.232789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fadcd989-85f5-4729-ac13-a8219545b836 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:31.247434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fadcd989-85f5-4729-ac13-a8219545b836 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:31.249732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fadcd989-85f5-4729-ac13-a8219545b836 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:31.250434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fadcd989-85f5-4729-ac13-a8219545b836 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:31.254874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fadcd989-85f5-4729-ac13-a8219545b836 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:31.255764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fadcd989-85f5-4729-ac13-a8219545b836 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:31.257164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fadcd989-85f5-4729-ac13-a8219545b836 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:31.385674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fadcd989-85f5-4729-ac13-a8219545b836 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:31.397453 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fadcd989-85f5-4729-ac13-a8219545b836 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1224 microversion: 2.1 time: 0.171697 Sep 08 12:38:31.415283 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 149/299] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:31 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1224 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:31.445821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6ec86a57-8deb-4fff-b375-0dc182b57c7c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:31.463850 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6ec86a57-8deb-4fff-b375-0dc182b57c7c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1319 microversion: 2.1 time: 0.487099 Sep 08 12:38:31.466348 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 151/300] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:30 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1319 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:32.122730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4313b056-f386-47ee-884d-a28cd798f55e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:32.123451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4313b056-f386-47ee-884d-a28cd798f55e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:32.136365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4313b056-f386-47ee-884d-a28cd798f55e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:32.137031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4313b056-f386-47ee-884d-a28cd798f55e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:32.137986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4313b056-f386-47ee-884d-a28cd798f55e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:32.139853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4313b056-f386-47ee-884d-a28cd798f55e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:32.140317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4313b056-f386-47ee-884d-a28cd798f55e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:32.140743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4313b056-f386-47ee-884d-a28cd798f55e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:32.149409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:32.423742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3176478-31f0-49d1-a7c1-33112f53f31b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:32.425010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e3176478-31f0-49d1-a7c1-33112f53f31b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:32.431578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3176478-31f0-49d1-a7c1-33112f53f31b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:32.432359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3176478-31f0-49d1-a7c1-33112f53f31b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:32.432996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3176478-31f0-49d1-a7c1-33112f53f31b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:32.434511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3176478-31f0-49d1-a7c1-33112f53f31b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:32.446611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3176478-31f0-49d1-a7c1-33112f53f31b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:32.447326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3176478-31f0-49d1-a7c1-33112f53f31b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:32.476496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4313b056-f386-47ee-884d-a28cd798f55e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:32.491367 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4313b056-f386-47ee-884d-a28cd798f55e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.372944 Sep 08 12:38:32.493076 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 150/301] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:32 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:32.503465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eec3083f-6d96-4503-902d-8d3bbcb28ca0 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:32.504916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eec3083f-6d96-4503-902d-8d3bbcb28ca0 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:32.511659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eec3083f-6d96-4503-902d-8d3bbcb28ca0 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:32.512641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eec3083f-6d96-4503-902d-8d3bbcb28ca0 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:32.513130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eec3083f-6d96-4503-902d-8d3bbcb28ca0 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:32.513849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eec3083f-6d96-4503-902d-8d3bbcb28ca0 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:32.514317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eec3083f-6d96-4503-902d-8d3bbcb28ca0 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:32.514752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eec3083f-6d96-4503-902d-8d3bbcb28ca0 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:32.587685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e3176478-31f0-49d1-a7c1-33112f53f31b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:32.597096 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e3176478-31f0-49d1-a7c1-33112f53f31b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1278 microversion: 2.1 time: 0.178596 Sep 08 12:38:32.597694 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 152/302] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:32 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:32.888207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eec3083f-6d96-4503-902d-8d3bbcb28ca0 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:32.900795 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eec3083f-6d96-4503-902d-8d3bbcb28ca0 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1319 microversion: 2.1 time: 0.402927 Sep 08 12:38:32.901843 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 151/303] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:32 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1319 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:32.948455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e0eaf8e1-60ad-48e3-9887-e781422421f8 req-f029e834-11e1-4ca1-acd8-73a49bce4bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8f483b-fdbc-4f92-abfc-28462d1441fc", "tag": "7cc8a47e-aa65-487a-a02a-c5e2e89d3886"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:32.974784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e0eaf8e1-60ad-48e3-9887-e781422421f8 req-f029e834-11e1-4ca1-acd8-73a49bce4bc5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:32.975374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e0eaf8e1-60ad-48e3-9887-e781422421f8 req-f029e834-11e1-4ca1-acd8-73a49bce4bc5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:32.975985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e0eaf8e1-60ad-48e3-9887-e781422421f8 req-f029e834-11e1-4ca1-acd8-73a49bce4bc5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:32.987349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:33.003340 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e0eaf8e1-60ad-48e3-9887-e781422421f8 req-f029e834-11e1-4ca1-acd8-73a49bce4bc5 service nova] Creating event network-changed:7cc8a47e-aa65-487a-a02a-c5e2e89d3886 for instance 2e8f483b-fdbc-4f92-abfc-28462d1441fc on n-h1-852084-10 Sep 08 12:38:33.019260 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e0eaf8e1-60ad-48e3-9887-e781422421f8 req-f029e834-11e1-4ca1-acd8-73a49bce4bc5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075700 Sep 08 12:38:33.022952 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 153/304] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:33.521647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-325d2c16-ef2d-4109-9d60-24bae4863a17 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:33.522267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-325d2c16-ef2d-4109-9d60-24bae4863a17 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:33.532632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-325d2c16-ef2d-4109-9d60-24bae4863a17 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:33.536947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-325d2c16-ef2d-4109-9d60-24bae4863a17 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:33.537928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-325d2c16-ef2d-4109-9d60-24bae4863a17 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:33.538673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-325d2c16-ef2d-4109-9d60-24bae4863a17 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:33.540915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-325d2c16-ef2d-4109-9d60-24bae4863a17 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:33.541527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-325d2c16-ef2d-4109-9d60-24bae4863a17 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:33.623356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f7c2caf-ce0f-4ecc-a24d-87eb68fff268 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:33.624621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8f7c2caf-ce0f-4ecc-a24d-87eb68fff268 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:33.632052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:UPDATE=4,nova_api:DELETE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:33.634082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f7c2caf-ce0f-4ecc-a24d-87eb68fff268 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:33.634843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f7c2caf-ce0f-4ecc-a24d-87eb68fff268 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:33.635832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f7c2caf-ce0f-4ecc-a24d-87eb68fff268 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:33.636901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f7c2caf-ce0f-4ecc-a24d-87eb68fff268 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:33.638614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f7c2caf-ce0f-4ecc-a24d-87eb68fff268 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:33.639429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f7c2caf-ce0f-4ecc-a24d-87eb68fff268 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:33.822701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8f7c2caf-ce0f-4ecc-a24d-87eb68fff268 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:33.831385 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f7c2caf-ce0f-4ecc-a24d-87eb68fff268 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1278 microversion: 2.1 time: 0.212958 Sep 08 12:38:33.848111 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 154/305] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:33 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1278 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:33.998896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-325d2c16-ef2d-4109-9d60-24bae4863a17 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:34.021463 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-325d2c16-ef2d-4109-9d60-24bae4863a17 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.503253 Sep 08 12:38:34.022962 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 152/306] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:33 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:34.029173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d0927ce-5b16-480c-a68b-268958e4b1ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:34.030124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1d0927ce-5b16-480c-a68b-268958e4b1ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:34.044509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d0927ce-5b16-480c-a68b-268958e4b1ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.044996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d0927ce-5b16-480c-a68b-268958e4b1ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.046453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d0927ce-5b16-480c-a68b-268958e4b1ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.047409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d0927ce-5b16-480c-a68b-268958e4b1ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.048027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d0927ce-5b16-480c-a68b-268958e4b1ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.048664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d0927ce-5b16-480c-a68b-268958e4b1ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.381280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-73cf21b4-b59d-4b6a-8728-d81609de363f tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Calling method '.version_select at 0x7fdb377eaee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:34.383167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73cf21b4-b59d-4b6a-8728-d81609de363f tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.383742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73cf21b4-b59d-4b6a-8728-d81609de363f tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.384183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73cf21b4-b59d-4b6a-8728-d81609de363f tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.410982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73cf21b4-b59d-4b6a-8728-d81609de363f tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.413433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73cf21b4-b59d-4b6a-8728-d81609de363f tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.414982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73cf21b4-b59d-4b6a-8728-d81609de363f tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.437161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73cf21b4-b59d-4b6a-8728-d81609de363f tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.438363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73cf21b4-b59d-4b6a-8728-d81609de363f tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.439018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73cf21b4-b59d-4b6a-8728-d81609de363f tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.449338 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-73cf21b4-b59d-4b6a-8728-d81609de363f tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.537405 Sep 08 12:38:34.450726 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 155/307] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:33 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:38:34.555793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1d0927ce-5b16-480c-a68b-268958e4b1ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:34.559796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cda7611d-2083-4b60-a151-8507cee63ec3 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-957727579", "id": 914006032, "os-flavor-access:is_public": "True"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:34.574168 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1d0927ce-5b16-480c-a68b-268958e4b1ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1319 microversion: 2.1 time: 0.549760 Sep 08 12:38:34.588818 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 153/308] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:34 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1319 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:34.614016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5bdca66a-a201-49a2-aee5-7fabcf2da104 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Calling method '.version_select at 0x7fdb3b79a1f0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:34.624524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bdca66a-a201-49a2-aee5-7fabcf2da104 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.625609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bdca66a-a201-49a2-aee5-7fabcf2da104 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.626568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bdca66a-a201-49a2-aee5-7fabcf2da104 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.627976 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cda7611d-2083-4b60-a151-8507cee63ec3 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.166553 Sep 08 12:38:34.633933 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 156/309] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:34 2022] POST /compute/v2.1/flavors => generated 426 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:34.656174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e5aa911-b924-4d10-a41e-cb9cf5b34fc7 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:34.700225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bdca66a-a201-49a2-aee5-7fabcf2da104 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.701187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bdca66a-a201-49a2-aee5-7fabcf2da104 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.701837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bdca66a-a201-49a2-aee5-7fabcf2da104 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.712287 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3e5aa911-b924-4d10-a41e-cb9cf5b34fc7 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/914006032" status: 202 len: 0 microversion: 2.1 time: 0.063106 Sep 08 12:38:34.713293 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 157/310] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:38:34 2022] DELETE /compute/v2.1/flavors/914006032 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 12:38:34.723112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eba02bf7-9dc5-46fd-9fa9-0eb726f3c68e tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:34.734562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bdca66a-a201-49a2-aee5-7fabcf2da104 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.735452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bdca66a-a201-49a2-aee5-7fabcf2da104 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.736161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bdca66a-a201-49a2-aee5-7fabcf2da104 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.750706 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5bdca66a-a201-49a2-aee5-7fabcf2da104 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.157472 Sep 08 12:38:34.765772 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 154/311] 10.222.0.78 () {58 vars in 1167 bytes} [Thu Sep 8 12:38:34 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:34.771803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6c3701ba-3945-4bd5-aee5-da7d649115fd tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Calling method '.version_select at 0x7fdb3b7efe50>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:34.773806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3701ba-3945-4bd5-aee5-da7d649115fd tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.774464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3701ba-3945-4bd5-aee5-da7d649115fd tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.775205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3701ba-3945-4bd5-aee5-da7d649115fd tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.787241 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eba02bf7-9dc5-46fd-9fa9-0eb726f3c68e tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.068259 Sep 08 12:38:34.792213 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 158/312] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:34 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:34.814711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89d69c04-fef7-4804-a3bf-805434a622bf tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-83150392", "id": 217261075, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:34.815793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3701ba-3945-4bd5-aee5-da7d649115fd tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.817759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3701ba-3945-4bd5-aee5-da7d649115fd tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.818414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3701ba-3945-4bd5-aee5-da7d649115fd tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.839592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3701ba-3945-4bd5-aee5-da7d649115fd tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.841724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3701ba-3945-4bd5-aee5-da7d649115fd tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.842549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3701ba-3945-4bd5-aee5-da7d649115fd tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.848911 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-89d69c04-fef7-4804-a3bf-805434a622bf tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.033634 Sep 08 12:38:34.849937 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 159/313] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:34 2022] POST /compute/v2.1/flavors => generated 412 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:38:34.856122 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6c3701ba-3945-4bd5-aee5-da7d649115fd tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.087723 Sep 08 12:38:34.859574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-15e6bc80-d4b5-4459-a2ff-e4a411b019c7 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:34.863351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-15e6bc80-d4b5-4459-a2ff-e4a411b019c7 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:34.864615 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 155/314] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:34 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:34.871831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a6c97fd9-00b2-4911-84f2-af78f616b982 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:34.878290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15e6bc80-d4b5-4459-a2ff-e4a411b019c7 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.878790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15e6bc80-d4b5-4459-a2ff-e4a411b019c7 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.881989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15e6bc80-d4b5-4459-a2ff-e4a411b019c7 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.882775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15e6bc80-d4b5-4459-a2ff-e4a411b019c7 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.883270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15e6bc80-d4b5-4459-a2ff-e4a411b019c7 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.883705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15e6bc80-d4b5-4459-a2ff-e4a411b019c7 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.901841 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a6c97fd9-00b2-4911-84f2-af78f616b982 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.036017 Sep 08 12:38:34.903673 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 156/315] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:34 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:34.909185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fa8b47d2-c63b-48df-807c-467d5d8b709b tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Calling method '.version_select at 0x7fdb3b73a820>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:34.911206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fa8b47d2-c63b-48df-807c-467d5d8b709b tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.911861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fa8b47d2-c63b-48df-807c-467d5d8b709b tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.912495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fa8b47d2-c63b-48df-807c-467d5d8b709b tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.931124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fa8b47d2-c63b-48df-807c-467d5d8b709b tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.931959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fa8b47d2-c63b-48df-807c-467d5d8b709b tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.932562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fa8b47d2-c63b-48df-807c-467d5d8b709b tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:34.942159 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fa8b47d2-c63b-48df-807c-467d5d8b709b tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.036460 Sep 08 12:38:34.953875 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 157/316] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:34 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:34.958202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-74ce5107-2d71-461d-94a2-faedcffa6efd tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:34.979687 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-74ce5107-2d71-461d-94a2-faedcffa6efd tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/217261075" status: 202 len: 0 microversion: 2.1 time: 0.030964 Sep 08 12:38:34.980714 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 158/317] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:38:34 2022] DELETE /compute/v2.1/flavors/217261075 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:34.987399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e9c4f16e-30cd-4db1-9155-11f046258093 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Calling method '.version_select at 0x7fdb3b73adc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:34.989477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9c4f16e-30cd-4db1-9155-11f046258093 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:34.990666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9c4f16e-30cd-4db1-9155-11f046258093 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:34.991108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9c4f16e-30cd-4db1-9155-11f046258093 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.014256 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e9c4f16e-30cd-4db1-9155-11f046258093 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.032080 Sep 08 12:38:35.023290 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 159/318] 10.222.0.78 () {58 vars in 1179 bytes} [Thu Sep 8 12:38:34 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:35.029147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f50d1e95-6ebd-45ee-a2f1-1a257614847a tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:35.057359 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f50d1e95-6ebd-45ee-a2f1-1a257614847a tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.040342 Sep 08 12:38:35.058377 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 160/319] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:35 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:35.064065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8ae4f3e4-32d3-473c-a6bb-7c92933a2dd2 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Calling method '.version_select at 0x7fdb3bc2f430>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:35.066621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ae4f3e4-32d3-473c-a6bb-7c92933a2dd2 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.067487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ae4f3e4-32d3-473c-a6bb-7c92933a2dd2 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.067932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ae4f3e4-32d3-473c-a6bb-7c92933a2dd2 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.090850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ae4f3e4-32d3-473c-a6bb-7c92933a2dd2 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.091902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ae4f3e4-32d3-473c-a6bb-7c92933a2dd2 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.091902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ae4f3e4-32d3-473c-a6bb-7c92933a2dd2 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.107735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ae4f3e4-32d3-473c-a6bb-7c92933a2dd2 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.108802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ae4f3e4-32d3-473c-a6bb-7c92933a2dd2 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.109895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ae4f3e4-32d3-473c-a6bb-7c92933a2dd2 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.136712 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8ae4f3e4-32d3-473c-a6bb-7c92933a2dd2 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.075939 Sep 08 12:38:35.138188 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 161/320] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:35 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:35.151052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc45e1b6-96ff-4ffb-a0d5-0c07e18f9a9a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:35.152424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fc45e1b6-96ff-4ffb-a0d5-0c07e18f9a9a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:35.160741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc45e1b6-96ff-4ffb-a0d5-0c07e18f9a9a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.161480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc45e1b6-96ff-4ffb-a0d5-0c07e18f9a9a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.162207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc45e1b6-96ff-4ffb-a0d5-0c07e18f9a9a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.163064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc45e1b6-96ff-4ffb-a0d5-0c07e18f9a9a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.163694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc45e1b6-96ff-4ffb-a0d5-0c07e18f9a9a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.164299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc45e1b6-96ff-4ffb-a0d5-0c07e18f9a9a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.259195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=21 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:35.596964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fc45e1b6-96ff-4ffb-a0d5-0c07e18f9a9a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:35.606979 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fc45e1b6-96ff-4ffb-a0d5-0c07e18f9a9a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.466673 Sep 08 12:38:35.607963 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 162/321] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:35 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:35.624721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0971cc71-6d6e-4c91-b87e-2d7fe4e65720 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1593594438", "id": 648104030, "os-flavor-access:is_public": "True"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:35.648503 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0971cc71-6d6e-4c91-b87e-2d7fe4e65720 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.039205 Sep 08 12:38:35.658188 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 163/322] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:35 2022] POST /compute/v2.1/flavors => generated 426 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:35.670061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4809438a-7806-439a-a1d6-61add9fb742e tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Calling method '.version_select at 0x7fdb3b8f7310>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:35.674294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4809438a-7806-439a-a1d6-61add9fb742e tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.675003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4809438a-7806-439a-a1d6-61add9fb742e tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.675824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4809438a-7806-439a-a1d6-61add9fb742e tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.695035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4809438a-7806-439a-a1d6-61add9fb742e tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.696002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4809438a-7806-439a-a1d6-61add9fb742e tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.696673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4809438a-7806-439a-a1d6-61add9fb742e tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.706033 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4809438a-7806-439a-a1d6-61add9fb742e tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.046036 Sep 08 12:38:35.707269 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 164/323] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:35.720492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5a83dc72-f020-4763-84b1-25e52b1a5da8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:35.722330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5a83dc72-f020-4763-84b1-25e52b1a5da8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:35.734952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a83dc72-f020-4763-84b1-25e52b1a5da8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.735716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a83dc72-f020-4763-84b1-25e52b1a5da8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.736365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a83dc72-f020-4763-84b1-25e52b1a5da8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.737279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a83dc72-f020-4763-84b1-25e52b1a5da8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.738453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a83dc72-f020-4763-84b1-25e52b1a5da8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.739163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a83dc72-f020-4763-84b1-25e52b1a5da8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.739928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-15e6bc80-d4b5-4459-a2ff-e4a411b019c7 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:35.759393 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-15e6bc80-d4b5-4459-a2ff-e4a411b019c7 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1320 microversion: 2.1 time: 0.903908 Sep 08 12:38:35.764941 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 160/324] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:34 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1320 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:35.776032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9277d7bf-c31b-410c-b356-4130fce57db6 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:35.826394 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9277d7bf-c31b-410c-b356-4130fce57db6 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/648104030" status: 202 len: 0 microversion: 2.1 time: 0.059589 Sep 08 12:38:35.827249 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 161/325] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:38:35 2022] DELETE /compute/v2.1/flavors/648104030 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:35.843451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d04aca37-9b46-42e0-817a-ab4ab9e50e56 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Calling method '.version_select at 0x7fdb377ea670>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:35.845741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d04aca37-9b46-42e0-817a-ab4ab9e50e56 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.846235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d04aca37-9b46-42e0-817a-ab4ab9e50e56 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.846681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d04aca37-9b46-42e0-817a-ab4ab9e50e56 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.875536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d04aca37-9b46-42e0-817a-ab4ab9e50e56 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.876542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d04aca37-9b46-42e0-817a-ab4ab9e50e56 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.877456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d04aca37-9b46-42e0-817a-ab4ab9e50e56 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.890642 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d04aca37-9b46-42e0-817a-ab4ab9e50e56 tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.061948 Sep 08 12:38:35.891659 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 162/326] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:38:35 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:35.897645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a5ed8291-971d-49c8-990e-62364c27ad05 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:35.937198 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a5ed8291-971d-49c8-990e-62364c27ad05 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.043781 Sep 08 12:38:35.938052 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 163/327] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:35 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:35.956098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6dde7b3b-3620-4e64-b44d-129154706bdc tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Calling method '.version_select at 0x7fdb377723a0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:35.957984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6dde7b3b-3620-4e64-b44d-129154706bdc tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.958468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6dde7b3b-3620-4e64-b44d-129154706bdc tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.958897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6dde7b3b-3620-4e64-b44d-129154706bdc tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:35.984743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6dde7b3b-3620-4e64-b44d-129154706bdc tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:35.987544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6dde7b3b-3620-4e64-b44d-129154706bdc tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:35.988120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6dde7b3b-3620-4e64-b44d-129154706bdc tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:36.005209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6dde7b3b-3620-4e64-b44d-129154706bdc tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:36.006257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6dde7b3b-3620-4e64-b44d-129154706bdc tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:36.007058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6dde7b3b-3620-4e64-b44d-129154706bdc tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:36.055537 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6dde7b3b-3620-4e64-b44d-129154706bdc tempest-HypervisorAdminTestJSON-218114747 tempest-HypervisorAdminTestJSON-218114747-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.114957 Sep 08 12:38:36.057533 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 164/328] 10.222.0.78 () {58 vars in 1173 bytes} [Thu Sep 8 12:38:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:36.070262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f4faa346-5b9f-46fd-af7e-004da066bffd tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1859627836", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:36.184730 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f4faa346-5b9f-46fd-af7e-004da066bffd tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.122060 Sep 08 12:38:36.185718 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 165/329] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:36 2022] POST /compute/v2.1/flavors => generated 507 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:36.201697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b15b3c38-ec7d-4f70-a97e-2748c555868c tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:36.249646 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b15b3c38-ec7d-4f70-a97e-2748c555868c tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2917f6f3-a070-4c64-bab6-d426fa88dc13" status: 202 len: 0 microversion: 2.1 time: 0.055027 Sep 08 12:38:36.251256 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 166/330] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:38:36 2022] DELETE /compute/v2.1/flavors/2917f6f3-a070-4c64-bab6-d426fa88dc13 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:36.264776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7622eb87-f795-4598-b016-ebd15564e85d tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:36.306070 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7622eb87-f795-4598-b016-ebd15564e85d tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.050318 Sep 08 12:38:36.307128 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 167/331] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:36 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:36.318597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5a83dc72-f020-4763-84b1-25e52b1a5da8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:36.328191 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5a83dc72-f020-4763-84b1-25e52b1a5da8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1319 microversion: 2.1 time: 0.619412 Sep 08 12:38:36.331798 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 165/332] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:35 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1319 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:36.334494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8bcf79a9-8952-40e4-b104-cc611583fac9 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-87367409", "id": "92a00b6e-9353-4cf5-be1f-5e137c42679c", "os-flavor-access:is_public": "True"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:36.386291 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8bcf79a9-8952-40e4-b104-cc611583fac9 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 505 microversion: 2.1 time: 0.057124 Sep 08 12:38:36.391969 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 168/333] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:36 2022] POST /compute/v2.1/flavors => generated 505 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:36.405390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d4a8fae-b66d-4159-abe7-64f567af7341 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:36.439161 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d4a8fae-b66d-4159-abe7-64f567af7341 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/92a00b6e-9353-4cf5-be1f-5e137c42679c" status: 202 len: 0 microversion: 2.1 time: 0.037932 Sep 08 12:38:36.440114 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 166/334] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:38:36 2022] DELETE /compute/v2.1/flavors/92a00b6e-9353-4cf5-be1f-5e137c42679c => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:36.447896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-244d4cc6-a954-45cc-8ccd-179b348b2ad8 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:36.498520 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-244d4cc6-a954-45cc-8ccd-179b348b2ad8 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.054066 Sep 08 12:38:36.500642 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 169/335] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:36 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:36.521498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e974e7e8-3966-413e-8cc6-d4bcb787049e tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1298744719", "id": 1729567639, "os-flavor-access:is_public": "True"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:36.548603 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e974e7e8-3966-413e-8cc6-d4bcb787049e tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.031164 Sep 08 12:38:36.553745 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 167/336] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:36 2022] POST /compute/v2.1/flavors => generated 414 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:36.562410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-363bf335-f1c8-4b37-bcb4-e370d2c2ed7b tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:36.573151 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-363bf335-f1c8-4b37-bcb4-e370d2c2ed7b tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/1729567639" status: 200 len: 414 microversion: 2.1 time: 0.013750 Sep 08 12:38:36.580666 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 170/337] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:38:36 2022] GET /compute/v2.1/flavors/1729567639 => generated 414 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:36.635348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cd4f4d2d-b9b4-4e4d-b7c5-3b8dabdbc0e6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:36.636388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cd4f4d2d-b9b4-4e4d-b7c5-3b8dabdbc0e6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:36.654229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd4f4d2d-b9b4-4e4d-b7c5-3b8dabdbc0e6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:36.654671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd4f4d2d-b9b4-4e4d-b7c5-3b8dabdbc0e6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:36.655112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd4f4d2d-b9b4-4e4d-b7c5-3b8dabdbc0e6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:36.655861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd4f4d2d-b9b4-4e4d-b7c5-3b8dabdbc0e6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:36.656318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd4f4d2d-b9b4-4e4d-b7c5-3b8dabdbc0e6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:36.656736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd4f4d2d-b9b4-4e4d-b7c5-3b8dabdbc0e6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:36.873237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-83d819ec-6432-4b49-a8d3-992bbef210b6 tempest-FlavorsAdminTestJSON-1706524856 tempest-FlavorsAdminTestJSON-1706524856-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:36.941544 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-83d819ec-6432-4b49-a8d3-992bbef210b6 tempest-FlavorsAdminTestJSON-1706524856 tempest-FlavorsAdminTestJSON-1706524856-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.358111 Sep 08 12:38:36.956179 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 168/338] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:36 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:36.968039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-69022254-6afa-4468-af2e-2d1aedb01916 req-6fb1ac4d-2c2d-4741-a41f-83debf6c343b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aee5557d-0174-4b4d-8a43-38266c51a8c9", "tag": "a7aea69f-64f7-447f-b791-e469320f5ca6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:36.984115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-69022254-6afa-4468-af2e-2d1aedb01916 req-6fb1ac4d-2c2d-4741-a41f-83debf6c343b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:36.985083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-69022254-6afa-4468-af2e-2d1aedb01916 req-6fb1ac4d-2c2d-4741-a41f-83debf6c343b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:36.985719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-69022254-6afa-4468-af2e-2d1aedb01916 req-6fb1ac4d-2c2d-4741-a41f-83debf6c343b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:36.999573 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-69022254-6afa-4468-af2e-2d1aedb01916 req-6fb1ac4d-2c2d-4741-a41f-83debf6c343b service nova] Creating event network-changed:a7aea69f-64f7-447f-b791-e469320f5ca6 for instance aee5557d-0174-4b4d-8a43-38266c51a8c9 on n-h2-852084-10 Sep 08 12:38:37.005185 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-69022254-6afa-4468-af2e-2d1aedb01916 req-6fb1ac4d-2c2d-4741-a41f-83debf6c343b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047383 Sep 08 12:38:37.007054 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 169/339] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:37.020429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-51a7ab4a-c4c6-41ff-ad7e-8291a4d9d76f tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:37.021450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-51a7ab4a-c4c6-41ff-ad7e-8291a4d9d76f tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:37.030907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51a7ab4a-c4c6-41ff-ad7e-8291a4d9d76f tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:37.032547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51a7ab4a-c4c6-41ff-ad7e-8291a4d9d76f tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:37.033246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51a7ab4a-c4c6-41ff-ad7e-8291a4d9d76f tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:37.034643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51a7ab4a-c4c6-41ff-ad7e-8291a4d9d76f tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:37.035359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51a7ab4a-c4c6-41ff-ad7e-8291a4d9d76f tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:37.036588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51a7ab4a-c4c6-41ff-ad7e-8291a4d9d76f tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:37.265050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cd4f4d2d-b9b4-4e4d-b7c5-3b8dabdbc0e6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:37.275150 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cd4f4d2d-b9b4-4e4d-b7c5-3b8dabdbc0e6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.644608 Sep 08 12:38:37.292438 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 171/340] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:36 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:37.307830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6fafe889-c6d2-4213-b120-84aa67fad5b1 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:37.344895 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6fafe889-c6d2-4213-b120-84aa67fad5b1 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1729567639" status: 202 len: 0 microversion: 2.1 time: 0.047566 Sep 08 12:38:37.346073 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 172/341] 10.222.0.78 () {58 vars in 1161 bytes} [Thu Sep 8 12:38:37 2022] DELETE /compute/v2.1/flavors/1729567639 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:37.357633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-68c64ee3-e617-43e9-a145-615d9481e947 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:37.403608 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-68c64ee3-e617-43e9-a145-615d9481e947 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.052797 Sep 08 12:38:37.406394 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 173/342] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:37 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:37.412457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd7aa772-6776-4ea3-a519-500baafea091 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:37.413586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dd7aa772-6776-4ea3-a519-500baafea091 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:37.427823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-51a7ab4a-c4c6-41ff-ad7e-8291a4d9d76f tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:37.438785 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-51a7ab4a-c4c6-41ff-ad7e-8291a4d9d76f tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1320 microversion: 2.1 time: 0.430039 Sep 08 12:38:37.444685 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 170/343] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:37 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1320 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:37.446309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd7aa772-6776-4ea3-a519-500baafea091 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:37.447009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd7aa772-6776-4ea3-a519-500baafea091 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:37.447827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd7aa772-6776-4ea3-a519-500baafea091 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:37.448697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd7aa772-6776-4ea3-a519-500baafea091 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:37.449298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd7aa772-6776-4ea3-a519-500baafea091 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:37.449985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd7aa772-6776-4ea3-a519-500baafea091 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:37.458596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7b37584a-24f0-46bb-a680-da6ab03cbfec tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-208828724", "id": 49495566, "os-flavor-access:is_public": "False"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:37.500442 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7b37584a-24f0-46bb-a680-da6ab03cbfec tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.054560 Sep 08 12:38:37.503410 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 171/344] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:37 2022] POST /compute/v2.1/flavors => generated 423 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:37.525833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b52f342-463e-485d-9a54-9f26f815fd2a tempest-FlavorsAdminTestJSON-1706524856 tempest-FlavorsAdminTestJSON-1706524856-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "49495566"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:37.551618 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1b52f342-463e-485d-9a54-9f26f815fd2a tempest-FlavorsAdminTestJSON-1706524856 tempest-FlavorsAdminTestJSON-1706524856-project] HTTP exception thrown: Flavor 49495566 could not be found. Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b52f342-463e-485d-9a54-9f26f815fd2a tempest-FlavorsAdminTestJSON-1706524856 tempest-FlavorsAdminTestJSON-1706524856-project] Request method failure captured: Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 105 Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeJIRHm0SARZZR8n5XLSUC7KICc_55V-QDck7f1o48R8gS70U98dTYoJNyLKI_qUPWDeRAYXlGv7eEd5olX1hjpkA8WDrdz4LWAhfvRRZi15FGF4kGbYH_vL86SnmR8I1NZNg66g90pGGvnTj6QJHdgz6qr7TUt4T9yBbZC9GNHUaTU Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 5295d3f2fea44ded822387f85298a420 Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FlavorsAdminTestJSON-1706524856 Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:38:37.555645 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5295d3f2fea44ded822387f85298a420"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5295d3f2fea44ded822387f85298a420"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5295d3f2fea44ded822387f85298a420"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5295d3f2fea44ded822387f85298a420"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FlavorsAdminTestJSON-1706524856 Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 5295d3f2fea44ded822387f85298a420 Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1706524856 Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FlavorsAdminTestJSON-1706524856-project Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9632c90332374a6399b3d13f8a6493bc Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FlavorsAdminTestJSON-1706524856-project Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: {"server": {"name": "test", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "49495566"}} Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:37.557195 n-d-852084-10 devstack@n-api.service[128971]: exception: Flavor 49495566 could not be found. Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '49495566'}}} Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 49495566 could not be found. Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:37.558205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 49495566 could not be found. Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:37.559662 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:37.561127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:37.561127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:37.561127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:37.561127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 49495566 could not be found. Sep 08 12:38:37.561127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:37.562923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b52f342-463e-485d-9a54-9f26f815fd2a tempest-FlavorsAdminTestJSON-1706524856 tempest-FlavorsAdminTestJSON-1706524856-project] Returning 400 to user: Flavor 49495566 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:37.564507 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1b52f342-463e-485d-9a54-9f26f815fd2a tempest-FlavorsAdminTestJSON-1706524856 tempest-FlavorsAdminTestJSON-1706524856-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 79 microversion: 2.1 time: 0.048493 Sep 08 12:38:37.568816 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 172/345] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:37 2022] POST /compute/v2.1/servers => generated 79 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:38:37.576553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e6520d9-e37f-4136-9c7c-edd4312f3943 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:37.594335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:37.600468 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e6520d9-e37f-4136-9c7c-edd4312f3943 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/49495566" status: 202 len: 0 microversion: 2.1 time: 0.030124 Sep 08 12:38:37.610771 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 173/346] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:38:37 2022] DELETE /compute/v2.1/flavors/49495566 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:37.616742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-713c9307-b6cd-45fa-9517-3a010fc3994c tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:37.648128 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-713c9307-b6cd-45fa-9517-3a010fc3994c tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.035506 Sep 08 12:38:37.649385 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 174/347] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:37 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:37.654968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b0c797ca-846c-453b-a6c2-d7380aa2661d req-4484059d-8169-4680-bed9-5e9e1bab2072 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d348606f-4433-463c-b587-79f3f2e1fec1", "name": "network-vif-plugged", "status": "completed", "tag": "c1ad86c3-77fd-45a8-95f2-dbd5b219161a"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:37.674334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b0c797ca-846c-453b-a6c2-d7380aa2661d req-4484059d-8169-4680-bed9-5e9e1bab2072 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:37.675056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b0c797ca-846c-453b-a6c2-d7380aa2661d req-4484059d-8169-4680-bed9-5e9e1bab2072 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:37.676180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b0c797ca-846c-453b-a6c2-d7380aa2661d req-4484059d-8169-4680-bed9-5e9e1bab2072 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:37.704462 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b0c797ca-846c-453b-a6c2-d7380aa2661d req-4484059d-8169-4680-bed9-5e9e1bab2072 service nova] Creating event network-vif-plugged:c1ad86c3-77fd-45a8-95f2-dbd5b219161a for instance d348606f-4433-463c-b587-79f3f2e1fec1 on n-h1-852084-10 Sep 08 12:38:37.710120 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b0c797ca-846c-453b-a6c2-d7380aa2661d req-4484059d-8169-4680-bed9-5e9e1bab2072 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059027 Sep 08 12:38:37.711651 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 175/348] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:37.717797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3142194d-1dd6-45a2-b60f-1d3db9c0f507 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1736566778", "id": 108940463, "os-flavor-access:is_public": "False"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:37.757083 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3142194d-1dd6-45a2-b60f-1d3db9c0f507 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.043794 Sep 08 12:38:37.758331 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 176/349] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:37 2022] POST /compute/v2.1/flavors => generated 412 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:37.782418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-74eb30a4-df1f-43d0-ac5f-884d3c8ef3b2 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1564518894", "id": 101101960, "os-flavor-access:is_public": "True"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:37.809285 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-74eb30a4-df1f-43d0-ac5f-884d3c8ef3b2 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.037205 Sep 08 12:38:37.810419 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 177/350] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:37 2022] POST /compute/v2.1/flavors => generated 411 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:37.821733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4265cf9-6ded-42ac-9e24-dc160c38339d tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:37.857745 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b4265cf9-6ded-42ac-9e24-dc160c38339d tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.039619 Sep 08 12:38:37.859039 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 178/351] 10.222.0.78 () {58 vars in 1169 bytes} [Thu Sep 8 12:38:37 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:37.872770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-30306e69-99ec-44ee-bcbe-fe726b73a1a1 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:37.888938 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-30306e69-99ec-44ee-bcbe-fe726b73a1a1 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 415 microversion: 2.1 time: 0.020903 Sep 08 12:38:37.891400 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 179/352] 10.222.0.78 () {58 vars in 1177 bytes} [Thu Sep 8 12:38:37 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 415 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:38:37.907931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dd7aa772-6776-4ea3-a519-500baafea091 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:37.913782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-24144783-f34e-46f0-b7a9-5581d2e21047 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:37.916938 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dd7aa772-6776-4ea3-a519-500baafea091 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1319 microversion: 2.1 time: 0.509077 Sep 08 12:38:37.921543 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 174/353] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:37 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1319 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:37.937513 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-24144783-f34e-46f0-b7a9-5581d2e21047 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 415 microversion: 2.1 time: 0.038535 Sep 08 12:38:37.938104 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 180/354] 10.222.0.78 () {58 vars in 1171 bytes} [Thu Sep 8 12:38:37 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 415 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:38:37.952886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e19c44f5-7f4c-4e05-a46c-75ebaf097161 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:37.982572 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e19c44f5-7f4c-4e05-a46c-75ebaf097161 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 415 microversion: 2.1 time: 0.033337 Sep 08 12:38:37.984335 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 175/355] 10.222.0.78 () {58 vars in 1169 bytes} [Thu Sep 8 12:38:37 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 415 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:37.998080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e7604843-f986-469a-b48e-1a93b37373f6 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.025109 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e7604843-f986-469a-b48e-1a93b37373f6 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6217 microversion: 2.1 time: 0.030818 Sep 08 12:38:38.037732 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 181/356] 10.222.0.78 () {58 vars in 1169 bytes} [Thu Sep 8 12:38:37 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6217 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:38.046249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-369d6bc5-09a5-4c4b-9ef5-edf31b52260e tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.070892 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-369d6bc5-09a5-4c4b-9ef5-edf31b52260e tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6217 microversion: 2.1 time: 0.029136 Sep 08 12:38:38.084639 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 176/357] 10.222.0.78 () {58 vars in 1175 bytes} [Thu Sep 8 12:38:38 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6217 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:38.101870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-27382b2c-0183-4849-a4a6-ba63949c5090 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.132470 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-27382b2c-0183-4849-a4a6-ba63949c5090 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6217 microversion: 2.1 time: 0.040582 Sep 08 12:38:38.133566 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 182/358] 10.222.0.78 () {58 vars in 1173 bytes} [Thu Sep 8 12:38:38 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6217 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:38.153367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0dafea13-d2da-465c-9668-3d3d7cf5c524 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.213833 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0dafea13-d2da-465c-9668-3d3d7cf5c524 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6217 microversion: 2.1 time: 0.064730 Sep 08 12:38:38.229309 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 177/359] 10.222.0.78 () {58 vars in 1169 bytes} [Thu Sep 8 12:38:38 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6217 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:38.238946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fcf5cd54-8562-4e2a-98ea-5d731a1a25ff tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.281695 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fcf5cd54-8562-4e2a-98ea-5d731a1a25ff tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/101101960" status: 202 len: 0 microversion: 2.1 time: 0.047227 Sep 08 12:38:38.282766 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 183/360] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:38:38 2022] DELETE /compute/v2.1/flavors/101101960 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:38.290697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-16bad4fc-3700-45e4-a275-3bb772baa668 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.305820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c11cbd04-7390-46c1-b53b-cb1808daeda9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.306853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c11cbd04-7390-46c1-b53b-cb1808daeda9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:38.331883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c11cbd04-7390-46c1-b53b-cb1808daeda9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:38.332877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c11cbd04-7390-46c1-b53b-cb1808daeda9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:38.333512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c11cbd04-7390-46c1-b53b-cb1808daeda9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:38.334382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c11cbd04-7390-46c1-b53b-cb1808daeda9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:38.339121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c11cbd04-7390-46c1-b53b-cb1808daeda9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:38.339840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c11cbd04-7390-46c1-b53b-cb1808daeda9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:38.347675 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-16bad4fc-3700-45e4-a275-3bb772baa668 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.060891 Sep 08 12:38:38.348499 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 178/361] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:38 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:38.369417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e45cc232-2ef8-45cc-8b09-8a0f18e3c7a9 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.389512 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e45cc232-2ef8-45cc-8b09-8a0f18e3c7a9 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/108940463" status: 202 len: 0 microversion: 2.1 time: 0.024576 Sep 08 12:38:38.390446 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 179/362] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:38:38 2022] DELETE /compute/v2.1/flavors/108940463 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:38.401421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4a70716c-8c9e-4b10-9fec-d29978c72936 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.438977 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4a70716c-8c9e-4b10-9fec-d29978c72936 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.042382 Sep 08 12:38:38.454575 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 180/363] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:38 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:38.484004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c961df8c-651d-4542-8b8e-b971095d9945 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.488086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c961df8c-651d-4542-8b8e-b971095d9945 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:38.509614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c961df8c-651d-4542-8b8e-b971095d9945 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:38.510272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c961df8c-651d-4542-8b8e-b971095d9945 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:38.516598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c961df8c-651d-4542-8b8e-b971095d9945 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:38.517532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c961df8c-651d-4542-8b8e-b971095d9945 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:38.519281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c961df8c-651d-4542-8b8e-b971095d9945 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:38.519763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c961df8c-651d-4542-8b8e-b971095d9945 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:38.695629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c11cbd04-7390-46c1-b53b-cb1808daeda9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:38.709076 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c11cbd04-7390-46c1-b53b-cb1808daeda9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.404234 Sep 08 12:38:38.709938 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 184/364] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:38 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:38.725998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dbe0c40f-3893-4eda-a155-10cad1ac6606 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1096542895", "id": 939932129, "os-flavor-access:is_public": "False"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:38.754869 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dbe0c40f-3893-4eda-a155-10cad1ac6606 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.039192 Sep 08 12:38:38.759605 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 185/365] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:38 2022] POST /compute/v2.1/flavors => generated 412 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:38.768235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c961df8c-651d-4542-8b8e-b971095d9945 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:38.777186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-61e582f6-84bd-4d6f-8a8c-21f76877e363 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.791793 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c961df8c-651d-4542-8b8e-b971095d9945 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1320 microversion: 2.1 time: 0.316700 Sep 08 12:38:38.793467 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 181/366] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:38 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:38.810549 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-61e582f6-84bd-4d6f-8a8c-21f76877e363 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.039087 Sep 08 12:38:38.811942 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 186/367] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:38 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:38.834106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-94f231d9-f6a5-4b97-adee-fb90ae6feaa3 tempest-FlavorsAdminTestJSON-1706524856 tempest-FlavorsAdminTestJSON-1706524856-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.859646 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-94f231d9-f6a5-4b97-adee-fb90ae6feaa3 tempest-FlavorsAdminTestJSON-1706524856 tempest-FlavorsAdminTestJSON-1706524856-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.029837 Sep 08 12:38:38.860853 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 182/368] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:38 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:38.887739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71ecefec-09f8-4d8d-abaa-371cc416d648 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.921684 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-71ecefec-09f8-4d8d-abaa-371cc416d648 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/939932129" status: 202 len: 0 microversion: 2.1 time: 0.039392 Sep 08 12:38:38.922736 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 187/369] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:38:38 2022] DELETE /compute/v2.1/flavors/939932129 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:38.931179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1c185788-2ba3-47c9-9507-216ce4bb165c tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.948971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-12715e2a-e863-4b98-a22d-d6677e23da0f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:38.951977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-12715e2a-e863-4b98-a22d-d6677e23da0f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:38.971956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12715e2a-e863-4b98-a22d-d6677e23da0f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:38.973628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12715e2a-e863-4b98-a22d-d6677e23da0f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:38.975038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12715e2a-e863-4b98-a22d-d6677e23da0f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:38.976797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12715e2a-e863-4b98-a22d-d6677e23da0f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:38.980173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12715e2a-e863-4b98-a22d-d6677e23da0f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:38.980997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12715e2a-e863-4b98-a22d-d6677e23da0f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:38.988956 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1c185788-2ba3-47c9-9507-216ce4bb165c tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.061414 Sep 08 12:38:38.989571 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 183/370] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:38 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:39.014704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-350f7997-7343-424a-aec5-50c2d41f1127 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-219309073", "id": 885979614, "os-flavor-access:is_public": "True"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:39.047121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=5,nova_api:DELETE=15 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:39.054477 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-350f7997-7343-424a-aec5-50c2d41f1127 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.043947 Sep 08 12:38:39.056052 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 184/371] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:39 2022] POST /compute/v2.1/flavors => generated 410 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:38:39.069310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-280c70bd-2be7-42b2-b692-b5623856b5cb tempest-FlavorsAdminTestJSON-1706524856 tempest-FlavorsAdminTestJSON-1706524856-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:39.125570 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-280c70bd-2be7-42b2-b692-b5623856b5cb tempest-FlavorsAdminTestJSON-1706524856 tempest-FlavorsAdminTestJSON-1706524856-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6216 microversion: 2.1 time: 0.061221 Sep 08 12:38:39.129128 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 185/372] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:39 2022] GET /compute/v2.1/flavors/detail => generated 6216 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:39.151876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1848ba4d-411b-4d01-b375-5d444f1f2754 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:39.202294 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1848ba4d-411b-4d01-b375-5d444f1f2754 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/885979614" status: 202 len: 0 microversion: 2.1 time: 0.053911 Sep 08 12:38:39.204714 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 186/373] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:38:39 2022] DELETE /compute/v2.1/flavors/885979614 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:38:39.215916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9830070b-1520-4137-a418-b733b2e8ffd0 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:39.241451 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9830070b-1520-4137-a418-b733b2e8ffd0 tempest-FlavorsAdminTestJSON-32912378 tempest-FlavorsAdminTestJSON-32912378-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.032160 Sep 08 12:38:39.242734 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 187/374] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:38:39 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:39.392556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-12715e2a-e863-4b98-a22d-d6677e23da0f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:39.405169 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-12715e2a-e863-4b98-a22d-d6677e23da0f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1319 microversion: 2.1 time: 0.461947 Sep 08 12:38:39.409567 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 188/375] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:38 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:39.735800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-93ddb1b2-a3b6-4ded-abad-f60479e72103 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:39.737007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-93ddb1b2-a3b6-4ded-abad-f60479e72103 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:39.750938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ddb1b2-a3b6-4ded-abad-f60479e72103 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:39.754334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ddb1b2-a3b6-4ded-abad-f60479e72103 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:39.755087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ddb1b2-a3b6-4ded-abad-f60479e72103 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:39.757761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ddb1b2-a3b6-4ded-abad-f60479e72103 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:39.759273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ddb1b2-a3b6-4ded-abad-f60479e72103 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:39.759961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ddb1b2-a3b6-4ded-abad-f60479e72103 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:39.814459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-59db970b-416f-4fa4-904b-b3d083d58fca tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:39.815076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-59db970b-416f-4fa4-904b-b3d083d58fca tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:39.817116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=5 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:39.829166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59db970b-416f-4fa4-904b-b3d083d58fca tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:39.829673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59db970b-416f-4fa4-904b-b3d083d58fca tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:39.830145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59db970b-416f-4fa4-904b-b3d083d58fca tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:39.830827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59db970b-416f-4fa4-904b-b3d083d58fca tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:39.831305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59db970b-416f-4fa4-904b-b3d083d58fca tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:39.831736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59db970b-416f-4fa4-904b-b3d083d58fca tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:39.892275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=35 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:40.187168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:40.597378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-93ddb1b2-a3b6-4ded-abad-f60479e72103 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:40.613411 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-93ddb1b2-a3b6-4ded-abad-f60479e72103 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.881458 Sep 08 12:38:40.615541 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 188/376] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:39 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:40.622542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-09e3281d-5a4b-4bc2-a2c8-2f9c0fe73eb1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:40.629615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-09e3281d-5a4b-4bc2-a2c8-2f9c0fe73eb1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:40.645157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09e3281d-5a4b-4bc2-a2c8-2f9c0fe73eb1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:40.647728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09e3281d-5a4b-4bc2-a2c8-2f9c0fe73eb1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:40.648335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09e3281d-5a4b-4bc2-a2c8-2f9c0fe73eb1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:40.652161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09e3281d-5a4b-4bc2-a2c8-2f9c0fe73eb1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:40.655964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09e3281d-5a4b-4bc2-a2c8-2f9c0fe73eb1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:40.656668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09e3281d-5a4b-4bc2-a2c8-2f9c0fe73eb1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:40.835857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-59db970b-416f-4fa4-904b-b3d083d58fca tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:40.849836 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-59db970b-416f-4fa4-904b-b3d083d58fca tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1320 microversion: 2.1 time: 1.039137 Sep 08 12:38:40.850990 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 189/377] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:39 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1320 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:41.095718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-09e3281d-5a4b-4bc2-a2c8-2f9c0fe73eb1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:41.104148 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-09e3281d-5a4b-4bc2-a2c8-2f9c0fe73eb1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1319 microversion: 2.1 time: 0.487314 Sep 08 12:38:41.104732 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 189/378] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:40 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1319 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:41.641018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6efa6f0c-d7af-4db9-b759-4678b3acdfbd tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:41.641700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6efa6f0c-d7af-4db9-b759-4678b3acdfbd tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:41.660381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6efa6f0c-d7af-4db9-b759-4678b3acdfbd tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:41.660983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6efa6f0c-d7af-4db9-b759-4678b3acdfbd tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:41.662977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6efa6f0c-d7af-4db9-b759-4678b3acdfbd tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:41.673646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6efa6f0c-d7af-4db9-b759-4678b3acdfbd tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:41.674536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6efa6f0c-d7af-4db9-b759-4678b3acdfbd tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:41.679929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6efa6f0c-d7af-4db9-b759-4678b3acdfbd tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:41.874518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-536ad844-14cb-46d3-9c4c-9fec033fcc6d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:41.875710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-536ad844-14cb-46d3-9c4c-9fec033fcc6d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:41.892025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-536ad844-14cb-46d3-9c4c-9fec033fcc6d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:41.895844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-536ad844-14cb-46d3-9c4c-9fec033fcc6d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:41.896689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-536ad844-14cb-46d3-9c4c-9fec033fcc6d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:41.897719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-536ad844-14cb-46d3-9c4c-9fec033fcc6d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:41.905786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-536ad844-14cb-46d3-9c4c-9fec033fcc6d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:41.908861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-536ad844-14cb-46d3-9c4c-9fec033fcc6d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:42.337837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6efa6f0c-d7af-4db9-b759-4678b3acdfbd tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:42.348147 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6efa6f0c-d7af-4db9-b759-4678b3acdfbd tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.711802 Sep 08 12:38:42.367368 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 190/379] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:41 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:42.378615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-353df7e4-a737-42e4-a87a-e08ec7dc0e54 req-eb7bf4ab-d202-4776-b423-554a6ff2820e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8f483b-fdbc-4f92-abfc-28462d1441fc", "name": "network-vif-plugged", "status": "completed", "tag": "7cc8a47e-aa65-487a-a02a-c5e2e89d3886"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:42.401509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-353df7e4-a737-42e4-a87a-e08ec7dc0e54 req-eb7bf4ab-d202-4776-b423-554a6ff2820e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:42.408019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-353df7e4-a737-42e4-a87a-e08ec7dc0e54 req-eb7bf4ab-d202-4776-b423-554a6ff2820e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:42.408777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-353df7e4-a737-42e4-a87a-e08ec7dc0e54 req-eb7bf4ab-d202-4776-b423-554a6ff2820e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:42.428533 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-353df7e4-a737-42e4-a87a-e08ec7dc0e54 req-eb7bf4ab-d202-4776-b423-554a6ff2820e service nova] Creating event network-vif-plugged:7cc8a47e-aa65-487a-a02a-c5e2e89d3886 for instance 2e8f483b-fdbc-4f92-abfc-28462d1441fc on n-h1-852084-10 Sep 08 12:38:42.445493 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-353df7e4-a737-42e4-a87a-e08ec7dc0e54 req-eb7bf4ab-d202-4776-b423-554a6ff2820e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076401 Sep 08 12:38:42.446434 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 191/380] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:42.466815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38af7cb3-f27b-478e-a34a-90cb0d2ca4b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:42.467499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-38af7cb3-f27b-478e-a34a-90cb0d2ca4b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:42.481919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38af7cb3-f27b-478e-a34a-90cb0d2ca4b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:42.482618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38af7cb3-f27b-478e-a34a-90cb0d2ca4b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:42.483250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38af7cb3-f27b-478e-a34a-90cb0d2ca4b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:42.484129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38af7cb3-f27b-478e-a34a-90cb0d2ca4b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:42.484956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38af7cb3-f27b-478e-a34a-90cb0d2ca4b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:42.485715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38af7cb3-f27b-478e-a34a-90cb0d2ca4b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:42.490774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:42.600354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-536ad844-14cb-46d3-9c4c-9fec033fcc6d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:42.621984 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-536ad844-14cb-46d3-9c4c-9fec033fcc6d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1320 microversion: 2.1 time: 0.750915 Sep 08 12:38:42.624757 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 190/381] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:41 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1320 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:42.983827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38af7cb3-f27b-478e-a34a-90cb0d2ca4b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:42.996029 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38af7cb3-f27b-478e-a34a-90cb0d2ca4b4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1319 microversion: 2.1 time: 0.548193 Sep 08 12:38:43.002089 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 192/382] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:42 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1319 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:43.374382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f8483936-af4d-4951-b9c2-11b1af912904 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:43.375165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f8483936-af4d-4951-b9c2-11b1af912904 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:43.383476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8483936-af4d-4951-b9c2-11b1af912904 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:43.390762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8483936-af4d-4951-b9c2-11b1af912904 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:43.391408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8483936-af4d-4951-b9c2-11b1af912904 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:43.392281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8483936-af4d-4951-b9c2-11b1af912904 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:43.396130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8483936-af4d-4951-b9c2-11b1af912904 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:43.398275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8483936-af4d-4951-b9c2-11b1af912904 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:43.740610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Calling method '.version_select at 0x7fdb3bc83ee0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:43.744183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:43.747982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:43.748708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:43.782357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:43.787205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:43.787874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:43.849905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f8483936-af4d-4951-b9c2-11b1af912904 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:43.864060 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f8483936-af4d-4951-b9c2-11b1af912904 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.493391 Sep 08 12:38:43.864662 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 191/383] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:43 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:43.891500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bd27aec5-c795-442b-a74a-df0fb41bab98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:43.892281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bd27aec5-c795-442b-a74a-df0fb41bab98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:43.898420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:43.900839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:43.901825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:43.918378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd27aec5-c795-442b-a74a-df0fb41bab98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:43.918888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd27aec5-c795-442b-a74a-df0fb41bab98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:43.921118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd27aec5-c795-442b-a74a-df0fb41bab98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:43.925495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd27aec5-c795-442b-a74a-df0fb41bab98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:43.928307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd27aec5-c795-442b-a74a-df0fb41bab98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:43.931513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd27aec5-c795-442b-a74a-df0fb41bab98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:43.938360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:43.940265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:43.943053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:44.030365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:44.031555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:44.033719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:44.051564 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-67e72544-7b2e-471e-b22c-f33590885999 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 2077 microversion: 2.53 time: 0.602886 Sep 08 12:38:44.056994 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 193/384] 10.222.0.78 () {60 vars in 1243 bytes} [Thu Sep 8 12:38:43 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 2077 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:38:44.073332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9450c12f-ab32-4675-9dec-fc01894f8f4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:44.075414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9450c12f-ab32-4675-9dec-fc01894f8f4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:44.095539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9450c12f-ab32-4675-9dec-fc01894f8f4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:44.097825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9450c12f-ab32-4675-9dec-fc01894f8f4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:44.100071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9450c12f-ab32-4675-9dec-fc01894f8f4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:44.103397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9450c12f-ab32-4675-9dec-fc01894f8f4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:44.105433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9450c12f-ab32-4675-9dec-fc01894f8f4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:44.107593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9450c12f-ab32-4675-9dec-fc01894f8f4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:44.822793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bd27aec5-c795-442b-a74a-df0fb41bab98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:44.837081 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bd27aec5-c795-442b-a74a-df0fb41bab98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1320 microversion: 2.1 time: 0.964188 Sep 08 12:38:44.838280 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 192/385] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:43 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1320 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:44.843667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Calling method '.version_select at 0x7fdb377abc10>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:44.849554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:44.850443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:44.851846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:44.873018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:44.873646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:44.874311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:44.921927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:44.924335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:44.924778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:44.949156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:44.949688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:44.954928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:44.977466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9450c12f-ab32-4675-9dec-fc01894f8f4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:44.994493 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9450c12f-ab32-4675-9dec-fc01894f8f4c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1319 microversion: 2.1 time: 0.930400 Sep 08 12:38:44.996575 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 194/386] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:44 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1319 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:45.006303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fdc17256-4c04-4eec-acf3-36703d6f426d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:45.010332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fdc17256-4c04-4eec-acf3-36703d6f426d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:45.028146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:45.028560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:45.029009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:45.030781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdc17256-4c04-4eec-acf3-36703d6f426d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:45.037257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdc17256-4c04-4eec-acf3-36703d6f426d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:45.038346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdc17256-4c04-4eec-acf3-36703d6f426d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:45.039757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdc17256-4c04-4eec-acf3-36703d6f426d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:45.040998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdc17256-4c04-4eec-acf3-36703d6f426d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:45.042849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdc17256-4c04-4eec-acf3-36703d6f426d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:45.056235 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1a0c1471-61a3-4e27-a0bf-7a0e1f3d75ea tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 767 microversion: 2.53 time: 0.214800 Sep 08 12:38:45.071425 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 193/387] 10.222.0.78 () {60 vars in 1222 bytes} [Thu Sep 8 12:38:44 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 767 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:38:45.076255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8a003e3c-6d9e-4cd1-ac25-91ee8cffb820 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Calling method '.version_select at 0x7fdb3761ee50>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:45.101282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a003e3c-6d9e-4cd1-ac25-91ee8cffb820 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:45.101950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a003e3c-6d9e-4cd1-ac25-91ee8cffb820 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:45.102388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a003e3c-6d9e-4cd1-ac25-91ee8cffb820 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:45.144216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a003e3c-6d9e-4cd1-ac25-91ee8cffb820 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:45.144788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a003e3c-6d9e-4cd1-ac25-91ee8cffb820 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:45.145389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a003e3c-6d9e-4cd1-ac25-91ee8cffb820 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:45.160549 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8a003e3c-6d9e-4cd1-ac25-91ee8cffb820 tempest-HypervisorAdminV253TestBase-569419470 tempest-HypervisorAdminV253TestBase-569419470-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/74a8a097-a50d-4637-ae8c-d319e6c87c67" status: 200 len: 794 microversion: 2.53 time: 0.087910 Sep 08 12:38:45.163056 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 194/388] 10.222.0.78 () {60 vars in 1298 bytes} [Thu Sep 8 12:38:45 2022] GET /compute/v2.1/os-hypervisors/74a8a097-a50d-4637-ae8c-d319e6c87c67 => generated 794 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:38:45.706723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fdc17256-4c04-4eec-acf3-36703d6f426d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:45.727181 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fdc17256-4c04-4eec-acf3-36703d6f426d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1476 microversion: 2.1 time: 0.728633 Sep 08 12:38:45.730328 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 195/389] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:44 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1476 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:45.860793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-772c7862-7a81-4e1d-be6f-ddc783240140 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:45.861402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-772c7862-7a81-4e1d-be6f-ddc783240140 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:45.872591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-772c7862-7a81-4e1d-be6f-ddc783240140 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:45.877218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-772c7862-7a81-4e1d-be6f-ddc783240140 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:45.878370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-772c7862-7a81-4e1d-be6f-ddc783240140 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:45.880614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-772c7862-7a81-4e1d-be6f-ddc783240140 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:45.883612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-772c7862-7a81-4e1d-be6f-ddc783240140 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:45.885690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-772c7862-7a81-4e1d-be6f-ddc783240140 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:46.018579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8bd8056b-5de4-48fa-acba-5d52ba786bfc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:46.019909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8bd8056b-5de4-48fa-acba-5d52ba786bfc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:46.030699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd8056b-5de4-48fa-acba-5d52ba786bfc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:46.033109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd8056b-5de4-48fa-acba-5d52ba786bfc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:46.034604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd8056b-5de4-48fa-acba-5d52ba786bfc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:46.035403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd8056b-5de4-48fa-acba-5d52ba786bfc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:46.036244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd8056b-5de4-48fa-acba-5d52ba786bfc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:46.036685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd8056b-5de4-48fa-acba-5d52ba786bfc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:47.094843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-772c7862-7a81-4e1d-be6f-ddc783240140 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:47.099343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:47.104650 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-772c7862-7a81-4e1d-be6f-ddc783240140 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1320 microversion: 2.1 time: 1.247642 Sep 08 12:38:47.105895 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 195/390] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:45 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1320 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:47.116681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-63818eb1-7486-48e1-ac4e-2a68b80828be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:47.117448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-63818eb1-7486-48e1-ac4e-2a68b80828be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:47.138592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63818eb1-7486-48e1-ac4e-2a68b80828be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:47.139108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63818eb1-7486-48e1-ac4e-2a68b80828be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:47.139744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63818eb1-7486-48e1-ac4e-2a68b80828be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:47.140383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63818eb1-7486-48e1-ac4e-2a68b80828be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:47.143519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63818eb1-7486-48e1-ac4e-2a68b80828be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:47.144930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63818eb1-7486-48e1-ac4e-2a68b80828be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:47.424430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8bd8056b-5de4-48fa-acba-5d52ba786bfc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:47.441233 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8bd8056b-5de4-48fa-acba-5d52ba786bfc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1469 microversion: 2.1 time: 1.426707 Sep 08 12:38:47.442658 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 196/391] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:46 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1469 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:47.748895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1362903307", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:47.842359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-63818eb1-7486-48e1-ac4e-2a68b80828be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:47.851138 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-63818eb1-7486-48e1-ac4e-2a68b80828be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1475 microversion: 2.1 time: 0.743940 Sep 08 12:38:47.852029 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 196/392] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:47 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1475 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:47.856990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:38:47.872358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-86896a5d-999b-4ca5-8e89-4baefaa57f99 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:47.873100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-86896a5d-999b-4ca5-8e89-4baefaa57f99 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: d348606f-4433-463c-b587-79f3f2e1fec1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:47.903133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86896a5d-999b-4ca5-8e89-4baefaa57f99 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:47.903756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86896a5d-999b-4ca5-8e89-4baefaa57f99 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:47.904203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86896a5d-999b-4ca5-8e89-4baefaa57f99 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:47.904917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86896a5d-999b-4ca5-8e89-4baefaa57f99 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:47.905373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86896a5d-999b-4ca5-8e89-4baefaa57f99 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:47.905793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86896a5d-999b-4ca5-8e89-4baefaa57f99 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:48.818401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-86896a5d-999b-4ca5-8e89-4baefaa57f99 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:48.838635 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-86896a5d-999b-4ca5-8e89-4baefaa57f99 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1" status: 200 len: 1469 microversion: 2.1 time: 0.985156 Sep 08 12:38:48.840528 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 197/393] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:47 2022] GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1 => generated 1469 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:48.870261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-879bc2df-782b-42d6-9f38-5e82b121e559 req-124283af-6eca-4d89-9469-10cee7402ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee5557d-0174-4b4d-8a43-38266c51a8c9", "name": "network-vif-plugged", "status": "completed", "tag": "a7aea69f-64f7-447f-b791-e469320f5ca6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:48.896580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-879bc2df-782b-42d6-9f38-5e82b121e559 req-124283af-6eca-4d89-9469-10cee7402ac0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:48.897063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-879bc2df-782b-42d6-9f38-5e82b121e559 req-124283af-6eca-4d89-9469-10cee7402ac0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:48.899914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-879bc2df-782b-42d6-9f38-5e82b121e559 req-124283af-6eca-4d89-9469-10cee7402ac0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:48.931111 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-879bc2df-782b-42d6-9f38-5e82b121e559 req-124283af-6eca-4d89-9469-10cee7402ac0 service nova] Creating event network-vif-plugged:a7aea69f-64f7-447f-b791-e469320f5ca6 for instance aee5557d-0174-4b4d-8a43-38266c51a8c9 on n-h2-852084-10 Sep 08 12:38:48.947093 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-879bc2df-782b-42d6-9f38-5e82b121e559 req-124283af-6eca-4d89-9469-10cee7402ac0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090220 Sep 08 12:38:48.948253 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 198/394] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:48.961116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fffbbf78-2118-4649-883d-e45ec48d3c3c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:48.962919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fffbbf78-2118-4649-883d-e45ec48d3c3c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:48.975151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fffbbf78-2118-4649-883d-e45ec48d3c3c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:48.995782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fffbbf78-2118-4649-883d-e45ec48d3c3c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:49.000059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fffbbf78-2118-4649-883d-e45ec48d3c3c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:49.001909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fffbbf78-2118-4649-883d-e45ec48d3c3c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:49.002546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fffbbf78-2118-4649-883d-e45ec48d3c3c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:49.005389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fffbbf78-2118-4649-883d-e45ec48d3c3c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:49.187282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:38:49.188130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:38:49.188715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:38:49.189230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:38:49.189746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:38:49.208812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:49.213996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:49.217635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:49.219005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:49.219414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:49.220910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:49.249751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Getting quotas for project 28537d6c3d924d689b4d9a83c74c5a7c. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:49.266989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Getting quotas for user a7202e7b07584b88bc59e2454686fa63 and project 28537d6c3d924d689b4d9a83c74c5a7c. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:49.355460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:38:49.363502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:38:49.544052 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4b605be3-4861-4704-b802-44194a95ed76 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.091057 Sep 08 12:38:49.554698 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 197/395] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2110 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:38:49.574114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fffbbf78-2118-4649-883d-e45ec48d3c3c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:49.592233 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fffbbf78-2118-4649-883d-e45ec48d3c3c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1320 microversion: 2.1 time: 0.642726 Sep 08 12:38:49.607516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2e3c66ec-4032-4a5a-923a-5a1edff4091c req-55f2d9e0-d33c-4c7a-b852-fef7d41ac1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f08576a-9db5-42b3-967c-2b64c7b70d35", "name": "network-vif-unplugged", "status": "completed", "tag": "c0202d88-6f01-4f52-9d83-e48a31f22c1d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:49.619411 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 199/396] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:48 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1320 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:49.626145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:49.637673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:49.644127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Searching by: {'reservation_id': 'r-7r53df4h', 'deleted': False, 'project_id': '5be40b5c51b9493d85c199b11a32726e'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:38:49.650302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2e3c66ec-4032-4a5a-923a-5a1edff4091c req-55f2d9e0-d33c-4c7a-b852-fef7d41ac1f8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:49.650793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2e3c66ec-4032-4a5a-923a-5a1edff4091c req-55f2d9e0-d33c-4c7a-b852-fef7d41ac1f8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:49.651242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2e3c66ec-4032-4a5a-923a-5a1edff4091c req-55f2d9e0-d33c-4c7a-b852-fef7d41ac1f8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:49.671000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:49.672327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:49.673060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:49.674180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:49.674890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:49.675905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:49.710779 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2e3c66ec-4032-4a5a-923a-5a1edff4091c req-55f2d9e0-d33c-4c7a-b852-fef7d41ac1f8 service nova] Creating event network-vif-unplugged:c0202d88-6f01-4f52-9d83-e48a31f22c1d for instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 on n-h2-852084-10 Sep 08 12:38:49.745436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-2e3c66ec-4032-4a5a-923a-5a1edff4091c req-55f2d9e0-d33c-4c7a-b852-fef7d41ac1f8 service nova] Instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:38:49.779011 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2e3c66ec-4032-4a5a-923a-5a1edff4091c req-55f2d9e0-d33c-4c7a-b852-fef7d41ac1f8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.222179 Sep 08 12:38:49.787872 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 198/397] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:49.802870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e1555ce0-86c3-4ac8-9453-39fb266b9326 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:49.805565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e1555ce0-86c3-4ac8-9453-39fb266b9326 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:49.860681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1555ce0-86c3-4ac8-9453-39fb266b9326 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:49.860681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1555ce0-86c3-4ac8-9453-39fb266b9326 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:49.860681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1555ce0-86c3-4ac8-9453-39fb266b9326 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:49.860681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1555ce0-86c3-4ac8-9453-39fb266b9326 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:49.861006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1555ce0-86c3-4ac8-9453-39fb266b9326 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:49.861006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1555ce0-86c3-4ac8-9453-39fb266b9326 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:49.977184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:38:50.244898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:50.252748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:50.253245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:50.253687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:50.882045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e1555ce0-86c3-4ac8-9453-39fb266b9326 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:50.903278 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e1555ce0-86c3-4ac8-9453-39fb266b9326 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1475 microversion: 2.1 time: 1.110388 Sep 08 12:38:50.905392 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 199/398] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:49 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1475 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:50.936006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-351b5f4c-2d7a-4480-9861-2a49c0543cbf tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:50.937126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-351b5f4c-2d7a-4480-9861-2a49c0543cbf tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:50.960211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-351b5f4c-2d7a-4480-9861-2a49c0543cbf tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:50.967480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-351b5f4c-2d7a-4480-9861-2a49c0543cbf tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:50.968546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-351b5f4c-2d7a-4480-9861-2a49c0543cbf tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:50.969311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-351b5f4c-2d7a-4480-9861-2a49c0543cbf tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:50.969947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-351b5f4c-2d7a-4480-9861-2a49c0543cbf tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:50.970526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-351b5f4c-2d7a-4480-9861-2a49c0543cbf tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:51.164103 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2c5d61c1-0fe6-433e-b564-ac61bafd2af1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?reservation_id=r-7r53df4h" status: 200 len: 2931 microversion: 2.1 time: 1.543044 Sep 08 12:38:51.165734 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 200/399] 10.222.0.78 () {58 vars in 1197 bytes} [Thu Sep 8 12:38:49 2022] GET /compute/v2.1/servers/detail?reservation_id=r-7r53df4h => generated 2931 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:51.173387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8062836a-743d-4523-9bb2-a34c9fe62bf6 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:51.174246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8062836a-743d-4523-9bb2-a34c9fe62bf6 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:51.222874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8062836a-743d-4523-9bb2-a34c9fe62bf6 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:51.223409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8062836a-743d-4523-9bb2-a34c9fe62bf6 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:51.223857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8062836a-743d-4523-9bb2-a34c9fe62bf6 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:51.224585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8062836a-743d-4523-9bb2-a34c9fe62bf6 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:51.225046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8062836a-743d-4523-9bb2-a34c9fe62bf6 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:51.225475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8062836a-743d-4523-9bb2-a34c9fe62bf6 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:51.272586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-351b5f4c-2d7a-4480-9861-2a49c0543cbf tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:51.284805 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-351b5f4c-2d7a-4480-9861-2a49c0543cbf tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1210 microversion: 2.1 time: 0.377660 Sep 08 12:38:51.286651 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 200/400] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:50 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1210 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:51.301119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f752b67d-d123-4977-9775-d85edd50f779 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:51.335339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=9,nova_api:INSERT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:51.345595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.compute.server_groups [None req-f752b67d-d123-4977-9775-d85edd50f779 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Querying cell eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) for 2 instances {{(pid=128971) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 12:38:51.346909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f752b67d-d123-4977-9775-d85edd50f779 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:51.347683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f752b67d-d123-4977-9775-d85edd50f779 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:51.348585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f752b67d-d123-4977-9775-d85edd50f779 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:51.401555 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f752b67d-d123-4977-9775-d85edd50f779 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/4bc5fef3-8020-4e3b-9c5f-f4d3053e177f" status: 200 len: 265 microversion: 2.1 time: 0.113298 Sep 08 12:38:51.402556 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 201/401] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:38:51 2022] GET /compute/v2.1/os-server-groups/4bc5fef3-8020-4e3b-9c5f-f4d3053e177f => generated 265 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:51.413678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-91d0b403-dd9d-4c3f-9257-ad8c3489d1e4 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:51.414681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-91d0b403-dd9d-4c3f-9257-ad8c3489d1e4 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:51.439107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91d0b403-dd9d-4c3f-9257-ad8c3489d1e4 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:51.439651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91d0b403-dd9d-4c3f-9257-ad8c3489d1e4 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:51.440098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91d0b403-dd9d-4c3f-9257-ad8c3489d1e4 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:51.440829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91d0b403-dd9d-4c3f-9257-ad8c3489d1e4 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:51.441286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91d0b403-dd9d-4c3f-9257-ad8c3489d1e4 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:51.441709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91d0b403-dd9d-4c3f-9257-ad8c3489d1e4 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:52.051214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8062836a-743d-4523-9bb2-a34c9fe62bf6 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:52.072133 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8062836a-743d-4523-9bb2-a34c9fe62bf6 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1470 microversion: 2.1 time: 0.904921 Sep 08 12:38:52.073605 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 201/402] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:51 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1470 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:52.082076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-316f973f-bbe5-46f0-b91b-3d8e1d1ed0f3 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:52.083018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-316f973f-bbe5-46f0-b91b-3d8e1d1ed0f3 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:52.097601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-316f973f-bbe5-46f0-b91b-3d8e1d1ed0f3 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:52.098298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-316f973f-bbe5-46f0-b91b-3d8e1d1ed0f3 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:52.100957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-316f973f-bbe5-46f0-b91b-3d8e1d1ed0f3 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:52.102144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-316f973f-bbe5-46f0-b91b-3d8e1d1ed0f3 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:52.103617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-316f973f-bbe5-46f0-b91b-3d8e1d1ed0f3 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:52.104813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-316f973f-bbe5-46f0-b91b-3d8e1d1ed0f3 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:52.135776 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-91d0b403-dd9d-4c3f-9257-ad8c3489d1e4 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 200 len: 1622 microversion: 2.1 time: 0.723378 Sep 08 12:38:52.147503 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 202/403] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:51 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 1622 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:52.158915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e7163fdf-d79d-4fdb-8085-2992dd837a12 req-59ec14f5-fa85-4863-bd87-1587a8bdabdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f08576a-9db5-42b3-967c-2b64c7b70d35", "tag": "c0202d88-6f01-4f52-9d83-e48a31f22c1d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:52.184496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e7163fdf-d79d-4fdb-8085-2992dd837a12 req-59ec14f5-fa85-4863-bd87-1587a8bdabdd service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:52.192709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e7163fdf-d79d-4fdb-8085-2992dd837a12 req-59ec14f5-fa85-4863-bd87-1587a8bdabdd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:52.193273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e7163fdf-d79d-4fdb-8085-2992dd837a12 req-59ec14f5-fa85-4863-bd87-1587a8bdabdd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:52.211961 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e7163fdf-d79d-4fdb-8085-2992dd837a12 req-59ec14f5-fa85-4863-bd87-1587a8bdabdd service nova] Creating event network-changed:c0202d88-6f01-4f52-9d83-e48a31f22c1d for instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 on n-h2-852084-10 Sep 08 12:38:52.238872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-e7163fdf-d79d-4fdb-8085-2992dd837a12 req-59ec14f5-fa85-4863-bd87-1587a8bdabdd service nova] Instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:38:52.267909 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e7163fdf-d79d-4fdb-8085-2992dd837a12 req-59ec14f5-fa85-4863-bd87-1587a8bdabdd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127366 Sep 08 12:38:52.270822 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 203/404] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:52.754092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4fcfec3f-8630-41e9-b6fe-63c1fb0fefe1 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:52.754957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4fcfec3f-8630-41e9-b6fe-63c1fb0fefe1 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:52.769982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fcfec3f-8630-41e9-b6fe-63c1fb0fefe1 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:52.772477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fcfec3f-8630-41e9-b6fe-63c1fb0fefe1 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:52.773101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fcfec3f-8630-41e9-b6fe-63c1fb0fefe1 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:52.774010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fcfec3f-8630-41e9-b6fe-63c1fb0fefe1 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:52.774917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fcfec3f-8630-41e9-b6fe-63c1fb0fefe1 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:52.780511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fcfec3f-8630-41e9-b6fe-63c1fb0fefe1 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:52.856849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4fcfec3f-8630-41e9-b6fe-63c1fb0fefe1 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:38:53.317972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-316f973f-bbe5-46f0-b91b-3d8e1d1ed0f3 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:53.321163 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4fcfec3f-8630-41e9-b6fe-63c1fb0fefe1 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 204 len: 0 microversion: 2.1 time: 1.047637 Sep 08 12:38:53.323484 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 204/405] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:38:52 2022] DELETE /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:38:53.331576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b379c370-6a9c-484e-bfdc-247aa99a36ea tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:53.332394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b379c370-6a9c-484e-bfdc-247aa99a36ea tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] [instance: d348606f-4433-463c-b587-79f3f2e1fec1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:53.334540 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-316f973f-bbe5-46f0-b91b-3d8e1d1ed0f3 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1475 microversion: 2.1 time: 1.258907 Sep 08 12:38:53.338368 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 202/406] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:52 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1475 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:53.351726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b379c370-6a9c-484e-bfdc-247aa99a36ea tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:53.351726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b379c370-6a9c-484e-bfdc-247aa99a36ea tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:53.351726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b379c370-6a9c-484e-bfdc-247aa99a36ea tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:53.351726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b379c370-6a9c-484e-bfdc-247aa99a36ea tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:53.352200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b379c370-6a9c-484e-bfdc-247aa99a36ea tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:53.352200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b379c370-6a9c-484e-bfdc-247aa99a36ea tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:53.370032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cf45e52f-2583-4899-b137-2d0f460da1b1 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:53.371062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cf45e52f-2583-4899-b137-2d0f460da1b1 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:53.388188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf45e52f-2583-4899-b137-2d0f460da1b1 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:53.388951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf45e52f-2583-4899-b137-2d0f460da1b1 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:53.390952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf45e52f-2583-4899-b137-2d0f460da1b1 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:53.391953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf45e52f-2583-4899-b137-2d0f460da1b1 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:53.394246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf45e52f-2583-4899-b137-2d0f460da1b1 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:53.395448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf45e52f-2583-4899-b137-2d0f460da1b1 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:53.616728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cf45e52f-2583-4899-b137-2d0f460da1b1 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:53.631790 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cf45e52f-2583-4899-b137-2d0f460da1b1 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1272 microversion: 2.1 time: 0.272232 Sep 08 12:38:53.632819 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 203/407] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:53 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1272 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:53.647872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a04ac8ee-ec6b-403f-92f3-b0f5f140c509 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:53.648822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a04ac8ee-ec6b-403f-92f3-b0f5f140c509 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:53.660596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a04ac8ee-ec6b-403f-92f3-b0f5f140c509 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:53.661712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a04ac8ee-ec6b-403f-92f3-b0f5f140c509 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:53.663979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a04ac8ee-ec6b-403f-92f3-b0f5f140c509 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:53.666258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a04ac8ee-ec6b-403f-92f3-b0f5f140c509 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:53.670363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a04ac8ee-ec6b-403f-92f3-b0f5f140c509 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:53.671016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a04ac8ee-ec6b-403f-92f3-b0f5f140c509 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:53.873958 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b379c370-6a9c-484e-bfdc-247aa99a36ea tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1" status: 200 len: 1622 microversion: 2.1 time: 0.547785 Sep 08 12:38:53.874554 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 205/408] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:53 2022] GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1 => generated 1622 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:53.912651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9246531b-6f25-4426-91dc-9b3b15684e0d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Action: 'create', calling method: .version_select at 0x7fdb3b6fb550>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-470484058", "policies": ["anti-affinity"]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:53.973212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9246531b-6f25-4426-91dc-9b3b15684e0d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:53.982774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9246531b-6f25-4426-91dc-9b3b15684e0d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:54.099894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9246531b-6f25-4426-91dc-9b3b15684e0d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:54.104808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9246531b-6f25-4426-91dc-9b3b15684e0d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:54.128929 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9246531b-6f25-4426-91dc-9b3b15684e0d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.215871 Sep 08 12:38:54.141177 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 206/409] 10.222.0.78 () {60 vars in 1174 bytes} [Thu Sep 8 12:38:53 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:38:54.236055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a04ac8ee-ec6b-403f-92f3-b0f5f140c509 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:54.246784 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a04ac8ee-ec6b-403f-92f3-b0f5f140c509 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1476 microversion: 2.1 time: 0.612440 Sep 08 12:38:54.263889 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 204/410] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:53 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1476 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:54.320722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1831980763", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "a3630ffd-9610-4627-8612-0d59a3877639"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:54.367756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d99277d0-826d-4d32-a767-4985120e8069 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:54.368682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d99277d0-826d-4d32-a767-4985120e8069 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:54.382323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d99277d0-826d-4d32-a767-4985120e8069 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:54.385303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d99277d0-826d-4d32-a767-4985120e8069 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:54.385870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d99277d0-826d-4d32-a767-4985120e8069 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:54.388103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d99277d0-826d-4d32-a767-4985120e8069 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:54.396594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d99277d0-826d-4d32-a767-4985120e8069 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:54.400181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d99277d0-826d-4d32-a767-4985120e8069 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:54.412025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:38:55.105293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d99277d0-826d-4d32-a767-4985120e8069 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:55.114295 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d99277d0-826d-4d32-a767-4985120e8069 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1475 microversion: 2.1 time: 0.750245 Sep 08 12:38:55.114895 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 205/411] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:54 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1475 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:38:55.125703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a337518a-dd91-4d47-8b2e-5588b4bfcd55 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:55.126330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a337518a-dd91-4d47-8b2e-5588b4bfcd55 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:55.152284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a337518a-dd91-4d47-8b2e-5588b4bfcd55 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:55.153328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a337518a-dd91-4d47-8b2e-5588b4bfcd55 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:55.154006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a337518a-dd91-4d47-8b2e-5588b4bfcd55 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:55.154488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a337518a-dd91-4d47-8b2e-5588b4bfcd55 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:55.154923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a337518a-dd91-4d47-8b2e-5588b4bfcd55 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:55.169467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a337518a-dd91-4d47-8b2e-5588b4bfcd55 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:55.723153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:38:55.724124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:38:55.724966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:38:55.725571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:38:55.725950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:38:55.745734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a337518a-dd91-4d47-8b2e-5588b4bfcd55 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:55.756590 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a337518a-dd91-4d47-8b2e-5588b4bfcd55 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1314 microversion: 2.1 time: 0.635147 Sep 08 12:38:55.765460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:55.765957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:55.766398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:55.767136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:55.767621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:55.768056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:55.786891 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 206/412] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:55 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:55.794141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-43f2adb9-9847-4be6-b30c-6299ca222418 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:55.795004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-43f2adb9-9847-4be6-b30c-6299ca222418 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:55.802170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f2adb9-9847-4be6-b30c-6299ca222418 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:55.803087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f2adb9-9847-4be6-b30c-6299ca222418 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:55.803973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f2adb9-9847-4be6-b30c-6299ca222418 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:55.804947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f2adb9-9847-4be6-b30c-6299ca222418 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:55.806253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f2adb9-9847-4be6-b30c-6299ca222418 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:55.807754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f2adb9-9847-4be6-b30c-6299ca222418 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:55.812002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:55.819061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:55.865082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Going to run 2 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:38:55.871770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 953e5b9e-8c65-4892-a558-ec7764a7b037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:38:55.997404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:56.009464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:56.094769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:56.112512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:56.154237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=953e5b9e-8c65-4892-a558-ec7764a7b037,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:38:56.217639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-43f2adb9-9847-4be6-b30c-6299ca222418 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:56.226934 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-43f2adb9-9847-4be6-b30c-6299ca222418 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1476 microversion: 2.1 time: 0.438373 Sep 08 12:38:56.233664 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 207/413] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:55 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1476 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:56.244289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:56.261595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:56.306574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:56.403487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:56.417419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'server_group_members'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:56.533575 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5f59b232-4447-4f57-8e27-4cc96fd0b7c5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 2.216636 Sep 08 12:38:56.537629 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 207/414] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:54 2022] POST /compute/v2.1/servers => generated 32 bytes in 2219 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 08 12:38:56.697103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-898e3e75-2419-42ea-83d7-e3fe1f7ecefa tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546 tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:56.717337 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-898e3e75-2419-42ea-83d7-e3fe1f7ecefa tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546 tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-898e3e75-2419-42ea-83d7-e3fe1f7ecefa tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546 tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546-project-admin] Request method failure captured: Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeJf6jcf-b53uCgnXfR8Vd1YD4_QHYI3zSXmu-VIrzJVw6jiIRPi28P5MYwUksIRfepftqTNNwwCO5R__jzL-Ib-CZX1mUZv2qHFV-G03o4NPtGrQk0M-CeJaooyu5f2dPjmFli9XtOSUrECEh4CZ6pJUq0vaT1o0OJSC87ucZDiGzg Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ebbbe9a499834a6e96d0cb8c04e1417d Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546 Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:38:56.740440 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:38:56.742427 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ebbbe9a499834a6e96d0cb8c04e1417d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ebbbe9a499834a6e96d0cb8c04e1417d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ebbbe9a499834a6e96d0cb8c04e1417d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ebbbe9a499834a6e96d0cb8c04e1417d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:56.742427 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546 Sep 08 12:38:56.742427 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ebbbe9a499834a6e96d0cb8c04e1417d Sep 08 12:38:56.742427 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546 Sep 08 12:38:56.742427 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546-project-admin Sep 08 12:38:56.742427 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:56.742427 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:56.742427 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: ad07103f6b0f4ae2b9650bf38501a890 Sep 08 12:38:56.742427 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546-project-admin Sep 08 12:38:56.742427 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:56.742427 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid timestamp for date invalid_time Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'invalid_time'} Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:56.743343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:56.744765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-898e3e75-2419-42ea-83d7-e3fe1f7ecefa tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546 tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:56.746785 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-898e3e75-2419-42ea-83d7-e3fe1f7ecefa tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546 tempest-InstanceUsageAuditLogNegativeTestJSON-1236671546-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.210092 Sep 08 12:38:56.748073 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 208/415] 10.222.0.78 () {58 vars in 1224 bytes} [Thu Sep 8 12:38:56 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:38:56.764225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3d1486cd-632a-4986-960a-343706c6a447 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:56.766086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3d1486cd-632a-4986-960a-343706c6a447 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:56.778890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-478907635", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "9714d2bd-3c28-4c33-8e0b-3c4e73fb2914"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:56.783553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d1486cd-632a-4986-960a-343706c6a447 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:56.784136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d1486cd-632a-4986-960a-343706c6a447 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:56.784691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d1486cd-632a-4986-960a-343706c6a447 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:56.787792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d1486cd-632a-4986-960a-343706c6a447 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:56.787792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d1486cd-632a-4986-960a-343706c6a447 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:56.787792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d1486cd-632a-4986-960a-343706c6a447 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:56.878478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] validate_networks() for [('9714d2bd-3c28-4c33-8e0b-3c4e73fb2914', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:38:57.733575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3d1486cd-632a-4986-960a-343706c6a447 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:57.748967 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3d1486cd-632a-4986-960a-343706c6a447 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1470 microversion: 2.1 time: 0.998027 Sep 08 12:38:57.751200 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 209/416] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:56 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1470 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:57.764052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-70db200e-9ee4-4aa5-8dc8-46f64606c55c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:57.779122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-70db200e-9ee4-4aa5-8dc8-46f64606c55c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:57.785143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-70db200e-9ee4-4aa5-8dc8-46f64606c55c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Searching by: {'deleted': False, 'project_id': '5be40b5c51b9493d85c199b11a32726e'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:38:57.845942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70db200e-9ee4-4aa5-8dc8-46f64606c55c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:57.848296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70db200e-9ee4-4aa5-8dc8-46f64606c55c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:57.850861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70db200e-9ee4-4aa5-8dc8-46f64606c55c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:57.853375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70db200e-9ee4-4aa5-8dc8-46f64606c55c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:57.856559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70db200e-9ee4-4aa5-8dc8-46f64606c55c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:57.857682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70db200e-9ee4-4aa5-8dc8-46f64606c55c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:58.251161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:38:58.290050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-70db200e-9ee4-4aa5-8dc8-46f64606c55c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Listed batch of 5 results from cell out of 998 limit. Returned 5 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:38:58.621298 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-70db200e-9ee4-4aa5-8dc8-46f64606c55c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1665 microversion: 2.1 time: 0.867725 Sep 08 12:38:58.626192 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 210/417] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 12:38:57 2022] GET /compute/v2.1/servers => generated 1665 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:58.907586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b59fda24-a050-43e9-ab77-9ace99924e67 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:58.910290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b59fda24-a050-43e9-ab77-9ace99924e67 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '67c6c550012a4a18a0d1ef7ff2c8a188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7556655fc9d475f9235c051c72e957c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b59fda24-a050-43e9-ab77-9ace99924e67 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project] Request method failure captured: Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeJeDiKuCu2dnl1VDHgnvz-fl7e5ShkUI9MCJEI8r41IL9lV_v1waRD7CsQkuuOpkhhJeK8qLRmWxxCYeldQ4_6d9lgaeVToWMEbeII0wo2y_jgetyiPikd360XTICyEnFZ0PYPvC7Jt3j6pup4vncFa_y0-ATvnJ3Fz9t0aWAlKJ3I Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d7556655fc9d475f9235c051c72e957c Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:38:58.912957 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:38:58.914533 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d7556655fc9d475f9235c051c72e957c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d7556655fc9d475f9235c051c72e957c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7556655fc9d475f9235c051c72e957c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7556655fc9d475f9235c051c72e957c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:58.914533 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 Sep 08 12:38:58.914533 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d7556655fc9d475f9235c051c72e957c Sep 08 12:38:58.914533 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 Sep 08 12:38:58.914533 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project Sep 08 12:38:58.914533 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:38:58.914533 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:38:58.914533 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 67c6c550012a4a18a0d1ef7ff2c8a188 Sep 08 12:38:58.914533 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project Sep 08 12:38:58.914533 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: action_args: {} Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:58.915349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Sep 08 12:38:58.916787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:38:58.928736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b59fda24-a050-43e9-ab77-9ace99924e67 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:58.931187 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b59fda24-a050-43e9-ab77-9ace99924e67 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.301564 Sep 08 12:38:58.936658 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 211/418] 10.222.0.78 () {58 vars in 1185 bytes} [Thu Sep 8 12:38:58 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 309 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:58.951588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-339e1b54-4d3e-4733-a55a-cdf4990deea9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:58.954253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-339e1b54-4d3e-4733-a55a-cdf4990deea9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:58.978033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-339e1b54-4d3e-4733-a55a-cdf4990deea9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:58.995424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-339e1b54-4d3e-4733-a55a-cdf4990deea9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:58.998831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-339e1b54-4d3e-4733-a55a-cdf4990deea9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.000228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-339e1b54-4d3e-4733-a55a-cdf4990deea9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.002516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-339e1b54-4d3e-4733-a55a-cdf4990deea9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.004118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-339e1b54-4d3e-4733-a55a-cdf4990deea9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.085411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-339e1b54-4d3e-4733-a55a-cdf4990deea9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:38:59.295625 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-339e1b54-4d3e-4733-a55a-cdf4990deea9 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "DELETE /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 204 len: 0 microversion: 2.1 time: 0.337523 Sep 08 12:38:59.299823 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 212/419] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:38:58 2022] DELETE /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:38:59.314317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-49ffd795-9ff9-4625-b8c9-c082fb02120a tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:59.318423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-49ffd795-9ff9-4625-b8c9-c082fb02120a tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:59.339162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ffd795-9ff9-4625-b8c9-c082fb02120a tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.339686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ffd795-9ff9-4625-b8c9-c082fb02120a tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.340156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ffd795-9ff9-4625-b8c9-c082fb02120a tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.340868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ffd795-9ff9-4625-b8c9-c082fb02120a tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.341322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ffd795-9ff9-4625-b8c9-c082fb02120a tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.341742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ffd795-9ff9-4625-b8c9-c082fb02120a tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.553008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:38:59.554193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:38:59.554822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:38:59.555408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:38:59.555994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:38:59.568208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.568967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.571310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.573484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.574438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.575086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.600087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Getting quotas for project 5619e927afd449c4897bd41f96390988. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:38:59.606210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Getting quotas for user c7375a1da7fb43d8a6725f61fa2c7ec9 and project 5619e927afd449c4897bd41f96390988. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:38:59.617080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-49ffd795-9ff9-4625-b8c9-c082fb02120a tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:59.623285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:38:59.627840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:38:59.628781 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-49ffd795-9ff9-4625-b8c9-c082fb02120a tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1314 microversion: 2.1 time: 0.326279 Sep 08 12:38:59.633589 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 213/420] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:59 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:59.641362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:59.642239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:59.664178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.665411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.666228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.667209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.669289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.669741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.705048 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4a53fd4e-950b-4c85-8169-6cac5a733760 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.469947 Sep 08 12:38:59.705750 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 208/421] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 3471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:38:59.716809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-92c3c910-fee0-412e-a140-cf50195a4fe2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:59.717349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-92c3c910-fee0-412e-a140-cf50195a4fe2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:59.721757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.722234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.722831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.723490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lazy-loading 'fault' on Instance uuid aee5557d-0174-4b4d-8a43-38266c51a8c9 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:38:59.723781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92c3c910-fee0-412e-a140-cf50195a4fe2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.724251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92c3c910-fee0-412e-a140-cf50195a4fe2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.724850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92c3c910-fee0-412e-a140-cf50195a4fe2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.726473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92c3c910-fee0-412e-a140-cf50195a4fe2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.727077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92c3c910-fee0-412e-a140-cf50195a4fe2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.727679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92c3c910-fee0-412e-a140-cf50195a4fe2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.801059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:59.809240 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-92c3c910-fee0-412e-a140-cf50195a4fe2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "POST /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35/action" status: 204 len: 0 microversion: 2.1 time: 0.102049 Sep 08 12:38:59.810168 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 209/422] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:38:59 2022] POST /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35/action => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:38:59.810338 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-415f8214-918c-4ec1-800f-0ce41d78be38 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 200 len: 1310 microversion: 2.1 time: 0.179332 Sep 08 12:38:59.811311 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 214/423] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:59 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 1310 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:59.816288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-befe69a0-5e1c-448d-b0f7-5f118c38c122 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:59.817323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-befe69a0-5e1c-448d-b0f7-5f118c38c122 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:38:59.820975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-de93cea6-5549-4521-8dd8-30cfbb4a55c0 req-856e524f-675a-4f38-bfd3-653313a5774f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9cbc9df-d3c4-4ebd-9538-4d6da2305b88", "tag": "e29a856f-a916-456f-a000-39775ffcabdb"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:59.834367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-de93cea6-5549-4521-8dd8-30cfbb4a55c0 req-856e524f-675a-4f38-bfd3-653313a5774f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.834554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-befe69a0-5e1c-448d-b0f7-5f118c38c122 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.834999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-de93cea6-5549-4521-8dd8-30cfbb4a55c0 req-856e524f-675a-4f38-bfd3-653313a5774f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.835504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-de93cea6-5549-4521-8dd8-30cfbb4a55c0 req-856e524f-675a-4f38-bfd3-653313a5774f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.835995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-befe69a0-5e1c-448d-b0f7-5f118c38c122 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.836163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-befe69a0-5e1c-448d-b0f7-5f118c38c122 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.836983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-befe69a0-5e1c-448d-b0f7-5f118c38c122 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:38:59.837945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-befe69a0-5e1c-448d-b0f7-5f118c38c122 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:38:59.838958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-befe69a0-5e1c-448d-b0f7-5f118c38c122 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:38:59.861490 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-de93cea6-5549-4521-8dd8-30cfbb4a55c0 req-856e524f-675a-4f38-bfd3-653313a5774f service nova] Creating event network-changed:e29a856f-a916-456f-a000-39775ffcabdb for instance b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 on n-h1-852084-10 Sep 08 12:38:59.877822 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-de93cea6-5549-4521-8dd8-30cfbb4a55c0 req-856e524f-675a-4f38-bfd3-653313a5774f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060962 Sep 08 12:38:59.881618 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 210/424] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:38:59.890300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1a096ee2-4b3a-42c6-9c11-7f6ebba7c124 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:59.892196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a096ee2-4b3a-42c6-9c11-7f6ebba7c124 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '67c6c550012a4a18a0d1ef7ff2c8a188', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7556655fc9d475f9235c051c72e957c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1a096ee2-4b3a-42c6-9c11-7f6ebba7c124 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project] Request method failure captured: Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08%2012:38:58 HTTP/1.1 Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJeDiKuCu2dnl1VDHgnvz-fl7e5ShkUI9MCJEI8r41IL9lV_v1waRD7CsQkuuOpkhhJeK8qLRmWxxCYeldQ4_6d9lgaeVToWMEbeII0wo2y_jgetyiPikd360XTICyEnFZ0PYPvC7Jt3j6pup4vncFa_y0-ATvnJ3Fz9t0aWAlKJ3I Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d7556655fc9d475f9235c051c72e957c Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:38:59.894381 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:38:59.895779 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d7556655fc9d475f9235c051c72e957c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d7556655fc9d475f9235c051c72e957c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7556655fc9d475f9235c051c72e957c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d7556655fc9d475f9235c051c72e957c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:38:59.895779 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 Sep 08 12:38:59.895779 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d7556655fc9d475f9235c051c72e957c Sep 08 12:38:59.895779 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 Sep 08 12:38:59.895779 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project Sep 08 12:38:59.895779 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:38:59.895779 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:38:59.895779 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 67c6c550012a4a18a0d1ef7ff2c8a188 Sep 08 12:38:59.895779 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project Sep 08 12:38:59.895779 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '2022-09-08 12:38:58'} Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:38:59.896508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Sep 08 12:38:59.897677 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:38:59.898717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1a096ee2-4b3a-42c6-9c11-7f6ebba7c124 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:38:59.898717 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1a096ee2-4b3a-42c6-9c11-7f6ebba7c124 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508 tempest-InstanceUsageAuditLogNegativeTestJSON-2048362508-project] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08 12:38:58" status: 403 len: 128 microversion: 2.1 time: 0.012490 Sep 08 12:38:59.898717 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 211/425] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Sep 8 12:38:59 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08%2012%3A38%3A58 => generated 128 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:38:59.903080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-248097179", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "734329767", "adminPass": "***", "networks": [{"uuid": "aaf5857a-8225-4252-ae8f-71a477deabc7"}], "security_groups": [{"name": "tempest-securitygroup--120913648"}], "key_name": "tempest-keypair-467201876", "user_data": "}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:38:59.962439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-befe69a0-5e1c-448d-b0f7-5f118c38c122 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:38:59.973300 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-befe69a0-5e1c-448d-b0f7-5f118c38c122 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1271 microversion: 2.1 time: 0.160626 Sep 08 12:38:59.973872 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 215/426] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:59 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:38:59.978384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-194ce377-25bd-4c39-8e24-f50f29b69c08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:38:59.979088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-194ce377-25bd-4c39-8e24-f50f29b69c08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:00.083427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-194ce377-25bd-4c39-8e24-f50f29b69c08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:00.093611 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-194ce377-25bd-4c39-8e24-f50f29b69c08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1210 microversion: 2.1 time: 0.118685 Sep 08 12:39:00.094419 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 216/427] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:38:59 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1210 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:00.098989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6007e537-4be4-444e-a185-aff61580ee15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:00.100015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6007e537-4be4-444e-a185-aff61580ee15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:00.102715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] validate_networks() for [('aaf5857a-8225-4252-ae8f-71a477deabc7', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:39:00.114575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6007e537-4be4-444e-a185-aff61580ee15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:00.115580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6007e537-4be4-444e-a185-aff61580ee15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:00.116170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6007e537-4be4-444e-a185-aff61580ee15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:00.116818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6007e537-4be4-444e-a185-aff61580ee15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:00.117278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6007e537-4be4-444e-a185-aff61580ee15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:00.117728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6007e537-4be4-444e-a185-aff61580ee15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:00.492705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6007e537-4be4-444e-a185-aff61580ee15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:00.513301 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6007e537-4be4-444e-a185-aff61580ee15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1470 microversion: 2.1 time: 0.417724 Sep 08 12:39:00.519429 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 217/428] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:00 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1470 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:00.657556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fb5cdf8c-fab8-4509-8795-73ea09565b5c tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:00.658701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fb5cdf8c-fab8-4509-8795-73ea09565b5c tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:00.691366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb5cdf8c-fab8-4509-8795-73ea09565b5c tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:00.692225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb5cdf8c-fab8-4509-8795-73ea09565b5c tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:00.692898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb5cdf8c-fab8-4509-8795-73ea09565b5c tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:00.696692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb5cdf8c-fab8-4509-8795-73ea09565b5c tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:00.700117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb5cdf8c-fab8-4509-8795-73ea09565b5c tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:00.701675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb5cdf8c-fab8-4509-8795-73ea09565b5c tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:01.668921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fb5cdf8c-fab8-4509-8795-73ea09565b5c tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:01.676888 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fb5cdf8c-fab8-4509-8795-73ea09565b5c tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1314 microversion: 2.1 time: 1.024340 Sep 08 12:39:01.677468 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 218/429] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:00 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1314 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:39:01.695758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4dac8c3-9c1b-4ea5-9c45-e32ffa45636e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:01.696775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b4dac8c3-9c1b-4ea5-9c45-e32ffa45636e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:01.717650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4dac8c3-9c1b-4ea5-9c45-e32ffa45636e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:01.724309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:39:01.725298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:39:01.726108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:39:01.726673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:39:01.727305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:39:01.732673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4dac8c3-9c1b-4ea5-9c45-e32ffa45636e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:01.736895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4dac8c3-9c1b-4ea5-9c45-e32ffa45636e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:01.738841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4dac8c3-9c1b-4ea5-9c45-e32ffa45636e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:01.740678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4dac8c3-9c1b-4ea5-9c45-e32ffa45636e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:01.745032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4dac8c3-9c1b-4ea5-9c45-e32ffa45636e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:01.759655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:01.762595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:01.763815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:01.767330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:01.771469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:01.772551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:01.794990 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-b4dac8c3-9c1b-4ea5-9c45-e32ffa45636e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] HTTP exception thrown: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4dac8c3-9c1b-4ea5-9c45-e32ffa45636e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Request method failure captured: Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 HTTP/1.1 Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeJCqVeKon7h6IuUBxhnZCj8060E5V9lurntRdSb6qYNfIlvhdOMd5iZTvF5HH1xvH8yopZtDqx7NWfRYUk3A3uobzMfZ3vZT_P0rnAHEoGR6_bo_LVmuYrTCEtMkOBqihDop3Fu50ue_h29MkI-tVRMcF_C0kJwrtrOhleg8h2SKEM Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4172137f3aa447edafafae76e41ef499 Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:39:01.797025 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:39:01.798468 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4172137f3aa447edafafae76e41ef499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4172137f3aa447edafafae76e41ef499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4172137f3aa447edafafae76e41ef499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4172137f3aa447edafafae76e41ef499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:01.798468 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:01.798468 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4172137f3aa447edafafae76e41ef499 Sep 08 12:39:01.798468 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:01.798468 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersAdminTestJSON-1587185021-project Sep 08 12:39:01.798468 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:01.798468 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:01.798468 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: c646b5da6995488db0ce3f405741b296 Sep 08 12:39:01.798468 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersAdminTestJSON-1587185021-project Sep 08 12:39:01.798468 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:39:01.798468 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:01.798468 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'aee5557d-0174-4b4d-8a43-38266c51a8c9'} Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:01.799413 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:01.800689 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:01.802677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4dac8c3-9c1b-4ea5-9c45-e32ffa45636e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Returning 404 to user: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:01.803790 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b4dac8c3-9c1b-4ea5-9c45-e32ffa45636e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 404 len: 111 microversion: 2.1 time: 0.119687 Sep 08 12:39:01.804526 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 219/430] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:01 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:01.809295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e663157c-e74b-4756-9fe1-1dd7f3671c48 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:01.817513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e663157c-e74b-4756-9fe1-1dd7f3671c48 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:01.825154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Getting quotas for project 6b81715e5ed745b5915844c61a40a017. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:39:01.826709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e663157c-e74b-4756-9fe1-1dd7f3671c48 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:01.832019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e663157c-e74b-4756-9fe1-1dd7f3671c48 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:01.832367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e663157c-e74b-4756-9fe1-1dd7f3671c48 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:01.833112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e663157c-e74b-4756-9fe1-1dd7f3671c48 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:01.833596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e663157c-e74b-4756-9fe1-1dd7f3671c48 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:01.834026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e663157c-e74b-4756-9fe1-1dd7f3671c48 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:01.841445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Getting quotas for user b76b0c59e23f4b20b356562bb75fe393 and project 6b81715e5ed745b5915844c61a40a017. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:39:01.867746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:39:01.871792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:39:01.969709 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f5a8d448-4c40-45d5-9992-5c280138d71c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.071705 Sep 08 12:39:01.970345 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 212/431] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:38:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:39:01.978410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d9c56b3f-a85f-4d1e-9a86-b404df16453c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:01.979547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d9c56b3f-a85f-4d1e-9a86-b404df16453c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:01.994633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9c56b3f-a85f-4d1e-9a86-b404df16453c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:02.005741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9c56b3f-a85f-4d1e-9a86-b404df16453c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:02.016155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9c56b3f-a85f-4d1e-9a86-b404df16453c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:02.016936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9c56b3f-a85f-4d1e-9a86-b404df16453c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:02.017417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9c56b3f-a85f-4d1e-9a86-b404df16453c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:02.017852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9c56b3f-a85f-4d1e-9a86-b404df16453c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:02.040394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e663157c-e74b-4756-9fe1-1dd7f3671c48 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:02.051863 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e663157c-e74b-4756-9fe1-1dd7f3671c48 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1277 microversion: 2.1 time: 0.245826 Sep 08 12:39:02.055582 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 220/432] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:01 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1277 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:02.071800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-519edaa1-b034-4978-997b-1a72fa6ae855 req-a0fdc7f0-26bc-4923-b55a-66b5782dfdc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f08576a-9db5-42b3-967c-2b64c7b70d35", "name": "network-vif-plugged", "status": "completed", "tag": "c0202d88-6f01-4f52-9d83-e48a31f22c1d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:02.086445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-519edaa1-b034-4978-997b-1a72fa6ae855 req-a0fdc7f0-26bc-4923-b55a-66b5782dfdc9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:02.092533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-519edaa1-b034-4978-997b-1a72fa6ae855 req-a0fdc7f0-26bc-4923-b55a-66b5782dfdc9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:02.093232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-519edaa1-b034-4978-997b-1a72fa6ae855 req-a0fdc7f0-26bc-4923-b55a-66b5782dfdc9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:02.117418 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-519edaa1-b034-4978-997b-1a72fa6ae855 req-a0fdc7f0-26bc-4923-b55a-66b5782dfdc9 service nova] Creating event network-vif-plugged:c0202d88-6f01-4f52-9d83-e48a31f22c1d for instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 on n-h2-852084-10 Sep 08 12:39:02.134413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-519edaa1-b034-4978-997b-1a72fa6ae855 req-a0fdc7f0-26bc-4923-b55a-66b5782dfdc9 service nova] Instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:39:02.157375 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-519edaa1-b034-4978-997b-1a72fa6ae855 req-a0fdc7f0-26bc-4923-b55a-66b5782dfdc9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100069 Sep 08 12:39:02.161877 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 221/433] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:02.181534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f559b66-4446-47fc-8f42-c2ecc887fdd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:02.182542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f559b66-4446-47fc-8f42-c2ecc887fdd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:02.190192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f559b66-4446-47fc-8f42-c2ecc887fdd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:02.191056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f559b66-4446-47fc-8f42-c2ecc887fdd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:02.204357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f559b66-4446-47fc-8f42-c2ecc887fdd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:02.205344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f559b66-4446-47fc-8f42-c2ecc887fdd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:02.206318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f559b66-4446-47fc-8f42-c2ecc887fdd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:02.207565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f559b66-4446-47fc-8f42-c2ecc887fdd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:02.263213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d9c56b3f-a85f-4d1e-9a86-b404df16453c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:02.282442 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d9c56b3f-a85f-4d1e-9a86-b404df16453c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1262 microversion: 2.1 time: 0.309160 Sep 08 12:39:02.286057 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 213/434] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:01 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1262 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:02.303984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2d50a370-ac54-4276-978b-28e97cf2c7e3 req-40102d0a-4c85-4e9e-8a84-23ba071a7d12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aee5557d-0174-4b4d-8a43-38266c51a8c9", "name": "network-vif-deleted", "tag": "a7aea69f-64f7-447f-b791-e469320f5ca6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:02.320045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=3,nova_api:INSERT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:02.335159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2d50a370-ac54-4276-978b-28e97cf2c7e3 req-40102d0a-4c85-4e9e-8a84-23ba071a7d12 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:02.335879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2d50a370-ac54-4276-978b-28e97cf2c7e3 req-40102d0a-4c85-4e9e-8a84-23ba071a7d12 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:02.337529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2d50a370-ac54-4276-978b-28e97cf2c7e3 req-40102d0a-4c85-4e9e-8a84-23ba071a7d12 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:02.369791 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2d50a370-ac54-4276-978b-28e97cf2c7e3 req-40102d0a-4c85-4e9e-8a84-23ba071a7d12 service nova] Creating event network-vif-deleted:a7aea69f-64f7-447f-b791-e469320f5ca6 for instance aee5557d-0174-4b4d-8a43-38266c51a8c9 on n-h2-852084-10 Sep 08 12:39:02.385279 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2d50a370-ac54-4276-978b-28e97cf2c7e3 req-40102d0a-4c85-4e9e-8a84-23ba071a7d12 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097427 Sep 08 12:39:02.390100 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 214/435] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:02.397143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-69e89b9b-7e14-48c5-848a-18c1a75c9d3f tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:02.408803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-69e89b9b-7e14-48c5-848a-18c1a75c9d3f tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:02.624889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-69e89b9b-7e14-48c5-848a-18c1a75c9d3f tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:02.637465 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-69e89b9b-7e14-48c5-848a-18c1a75c9d3f tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1261 microversion: 2.1 time: 0.244607 Sep 08 12:39:02.651903 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 215/436] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:02 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1261 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:02.672086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-851667366", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:02.755333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f559b66-4446-47fc-8f42-c2ecc887fdd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:02.764863 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f559b66-4446-47fc-8f42-c2ecc887fdd4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1470 microversion: 2.1 time: 0.601353 Sep 08 12:39:02.767995 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 222/437] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:02 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1470 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:02.776894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-81c27066-0f51-49dc-8ceb-1dda42c68a49 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:02.781882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-81c27066-0f51-49dc-8ceb-1dda42c68a49 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:02.801825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81c27066-0f51-49dc-8ceb-1dda42c68a49 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:02.802650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81c27066-0f51-49dc-8ceb-1dda42c68a49 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:02.803783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81c27066-0f51-49dc-8ceb-1dda42c68a49 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:02.804815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81c27066-0f51-49dc-8ceb-1dda42c68a49 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:02.805487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81c27066-0f51-49dc-8ceb-1dda42c68a49 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:02.807123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81c27066-0f51-49dc-8ceb-1dda42c68a49 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:02.819385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:39:03.346541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-81c27066-0f51-49dc-8ceb-1dda42c68a49 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:03.359371 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-81c27066-0f51-49dc-8ceb-1dda42c68a49 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1314 microversion: 2.1 time: 0.586735 Sep 08 12:39:03.371703 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 223/438] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:02 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:03.385760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-856f11fe-8698-447c-bfca-2db185410ca8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:03.386585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-856f11fe-8698-447c-bfca-2db185410ca8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:03.403070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-856f11fe-8698-447c-bfca-2db185410ca8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:03.412031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-856f11fe-8698-447c-bfca-2db185410ca8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:03.412661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-856f11fe-8698-447c-bfca-2db185410ca8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:03.413570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-856f11fe-8698-447c-bfca-2db185410ca8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:03.414310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-856f11fe-8698-447c-bfca-2db185410ca8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:03.414768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-856f11fe-8698-447c-bfca-2db185410ca8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:03.587870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-856f11fe-8698-447c-bfca-2db185410ca8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:03.597793 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-856f11fe-8698-447c-bfca-2db185410ca8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1277 microversion: 2.1 time: 0.224764 Sep 08 12:39:03.598394 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 224/439] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:03 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1277 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:03.603022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a804fbc6-e955-41cd-8afa-5ee51a58cae5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:03.612815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a804fbc6-e955-41cd-8afa-5ee51a58cae5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:03.640390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a804fbc6-e955-41cd-8afa-5ee51a58cae5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:03.640901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a804fbc6-e955-41cd-8afa-5ee51a58cae5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:03.641501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a804fbc6-e955-41cd-8afa-5ee51a58cae5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:03.642042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a804fbc6-e955-41cd-8afa-5ee51a58cae5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:03.642499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a804fbc6-e955-41cd-8afa-5ee51a58cae5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:03.642926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a804fbc6-e955-41cd-8afa-5ee51a58cae5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:04.182330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:39:04.184883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:39:04.187625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:39:04.188293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:39:04.188874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:39:04.211524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:04.215445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:04.216070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:04.217039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:04.217681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:04.218413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:04.236865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:04.266398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Getting quotas for project 4172137f3aa447edafafae76e41ef499. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:39:04.272778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Getting quotas for user c646b5da6995488db0ce3f405741b296 and project 4172137f3aa447edafafae76e41ef499. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:39:04.294915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a804fbc6-e955-41cd-8afa-5ee51a58cae5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:04.298155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:39:04.302051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:39:04.304195 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a804fbc6-e955-41cd-8afa-5ee51a58cae5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1268 microversion: 2.1 time: 0.704751 Sep 08 12:39:04.321425 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 225/440] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:03 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1268 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:04.333104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-821256cb-a82d-4fa2-ac2d-9cf7918d1de1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:04.339674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-821256cb-a82d-4fa2-ac2d-9cf7918d1de1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:04.360839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-821256cb-a82d-4fa2-ac2d-9cf7918d1de1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:04.361717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-821256cb-a82d-4fa2-ac2d-9cf7918d1de1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:04.362422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-821256cb-a82d-4fa2-ac2d-9cf7918d1de1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:04.363422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-821256cb-a82d-4fa2-ac2d-9cf7918d1de1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:04.364099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-821256cb-a82d-4fa2-ac2d-9cf7918d1de1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:04.364909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-821256cb-a82d-4fa2-ac2d-9cf7918d1de1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:04.458916 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-165bd1ff-8d30-4cff-be4b-8332ea7ca783 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.800052 Sep 08 12:39:04.468490 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 216/441] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:39:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:39:04.478455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e8e7652-327f-491e-a40e-dde8cf0c3297 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:04.478984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6e8e7652-327f-491e-a40e-dde8cf0c3297 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:04.506274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e8e7652-327f-491e-a40e-dde8cf0c3297 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:04.510741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e8e7652-327f-491e-a40e-dde8cf0c3297 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:04.511301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e8e7652-327f-491e-a40e-dde8cf0c3297 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:04.512111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e8e7652-327f-491e-a40e-dde8cf0c3297 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:04.512583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e8e7652-327f-491e-a40e-dde8cf0c3297 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:04.517554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e8e7652-327f-491e-a40e-dde8cf0c3297 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:04.838348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-821256cb-a82d-4fa2-ac2d-9cf7918d1de1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:04.861654 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-821256cb-a82d-4fa2-ac2d-9cf7918d1de1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1321 microversion: 2.1 time: 0.536281 Sep 08 12:39:04.867964 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 226/442] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:04 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1321 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:04.884053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-992c9a82-54c9-4d36-ab8f-f2dea9ffd3ac tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:04.884702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-992c9a82-54c9-4d36-ab8f-f2dea9ffd3ac tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:04.903347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-992c9a82-54c9-4d36-ab8f-f2dea9ffd3ac tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:04.903871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-992c9a82-54c9-4d36-ab8f-f2dea9ffd3ac tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:04.904309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-992c9a82-54c9-4d36-ab8f-f2dea9ffd3ac tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:04.905810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-992c9a82-54c9-4d36-ab8f-f2dea9ffd3ac tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:04.908908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-992c9a82-54c9-4d36-ab8f-f2dea9ffd3ac tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:04.910430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-992c9a82-54c9-4d36-ab8f-f2dea9ffd3ac tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:04.992706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:05.602644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-992c9a82-54c9-4d36-ab8f-f2dea9ffd3ac tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:05.627075 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-992c9a82-54c9-4d36-ab8f-f2dea9ffd3ac tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1314 microversion: 2.1 time: 0.755540 Sep 08 12:39:05.627969 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 227/443] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:04 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:05.633663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9d8bd737-6df5-4702-9ffa-e3f66c0f2fba tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:05.634499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9d8bd737-6df5-4702-9ffa-e3f66c0f2fba tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:05.659327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d8bd737-6df5-4702-9ffa-e3f66c0f2fba tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:05.661840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d8bd737-6df5-4702-9ffa-e3f66c0f2fba tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:05.664833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d8bd737-6df5-4702-9ffa-e3f66c0f2fba tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:05.668999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d8bd737-6df5-4702-9ffa-e3f66c0f2fba tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:05.670835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d8bd737-6df5-4702-9ffa-e3f66c0f2fba tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:05.673277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d8bd737-6df5-4702-9ffa-e3f66c0f2fba tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:06.271746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6e8e7652-327f-491e-a40e-dde8cf0c3297 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:06.288989 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6e8e7652-327f-491e-a40e-dde8cf0c3297 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1470 microversion: 2.1 time: 1.816739 Sep 08 12:39:06.289886 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 217/444] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:04 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1470 bytes in 1821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:06.299098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-973d7fb3-89bd-4349-9829-56dd20f7658f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:06.304241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-973d7fb3-89bd-4349-9829-56dd20f7658f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:06.325071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-973d7fb3-89bd-4349-9829-56dd20f7658f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:06.331006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-973d7fb3-89bd-4349-9829-56dd20f7658f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:06.331709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-973d7fb3-89bd-4349-9829-56dd20f7658f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:06.332575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-973d7fb3-89bd-4349-9829-56dd20f7658f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:06.333299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-973d7fb3-89bd-4349-9829-56dd20f7658f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:06.334249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-973d7fb3-89bd-4349-9829-56dd20f7658f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:06.433868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9d8bd737-6df5-4702-9ffa-e3f66c0f2fba tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:06.443191 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9d8bd737-6df5-4702-9ffa-e3f66c0f2fba tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1271 microversion: 2.1 time: 0.813832 Sep 08 12:39:06.443844 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 228/445] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:05 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1271 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:06.470264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b8de4ca0-c6e8-40a5-a555-e0c9b7066b98 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:06.470887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b8de4ca0-c6e8-40a5-a555-e0c9b7066b98 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:06.490747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8de4ca0-c6e8-40a5-a555-e0c9b7066b98 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:06.497173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8de4ca0-c6e8-40a5-a555-e0c9b7066b98 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:06.497739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8de4ca0-c6e8-40a5-a555-e0c9b7066b98 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:06.498510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8de4ca0-c6e8-40a5-a555-e0c9b7066b98 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:06.498987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8de4ca0-c6e8-40a5-a555-e0c9b7066b98 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:06.499491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8de4ca0-c6e8-40a5-a555-e0c9b7066b98 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:06.650831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-973d7fb3-89bd-4349-9829-56dd20f7658f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:06.660784 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-973d7fb3-89bd-4349-9829-56dd20f7658f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1277 microversion: 2.1 time: 0.369350 Sep 08 12:39:06.665089 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 218/446] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:06 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1277 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:06.680986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-321f3f7f-a98e-400d-8342-e8c11f659eae tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:06.685198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-321f3f7f-a98e-400d-8342-e8c11f659eae tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:06.709250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-321f3f7f-a98e-400d-8342-e8c11f659eae tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:06.709528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-321f3f7f-a98e-400d-8342-e8c11f659eae tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:06.709981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-321f3f7f-a98e-400d-8342-e8c11f659eae tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:06.710742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-321f3f7f-a98e-400d-8342-e8c11f659eae tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:06.711375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-321f3f7f-a98e-400d-8342-e8c11f659eae tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:06.712120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-321f3f7f-a98e-400d-8342-e8c11f659eae tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:06.930141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b8de4ca0-c6e8-40a5-a555-e0c9b7066b98 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:06.957469 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b8de4ca0-c6e8-40a5-a555-e0c9b7066b98 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1268 microversion: 2.1 time: 0.492552 Sep 08 12:39:06.968713 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 229/447] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:06 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1268 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:06.977393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9e792b4c-ccb8-4960-ab61-c08c68b5ddd6 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:06.987536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9e792b4c-ccb8-4960-ab61-c08c68b5ddd6 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:07.009686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e792b4c-ccb8-4960-ab61-c08c68b5ddd6 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:07.009686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e792b4c-ccb8-4960-ab61-c08c68b5ddd6 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:07.011545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e792b4c-ccb8-4960-ab61-c08c68b5ddd6 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:07.016342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e792b4c-ccb8-4960-ab61-c08c68b5ddd6 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:07.016995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e792b4c-ccb8-4960-ab61-c08c68b5ddd6 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:07.017632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e792b4c-ccb8-4960-ab61-c08c68b5ddd6 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:07.973670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:07.976448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-321f3f7f-a98e-400d-8342-e8c11f659eae tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:07.985418 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-321f3f7f-a98e-400d-8342-e8c11f659eae tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1319 microversion: 2.1 time: 1.316993 Sep 08 12:39:07.986000 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 219/448] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:06 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1319 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:08.005857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-808d3365-5da6-4988-b208-84e7cd19bb9b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:08.006473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-808d3365-5da6-4988-b208-84e7cd19bb9b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:08.022062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-808d3365-5da6-4988-b208-84e7cd19bb9b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:08.022815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-808d3365-5da6-4988-b208-84e7cd19bb9b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:08.023568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-808d3365-5da6-4988-b208-84e7cd19bb9b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:08.024531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-808d3365-5da6-4988-b208-84e7cd19bb9b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:08.025230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-808d3365-5da6-4988-b208-84e7cd19bb9b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:08.028479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-808d3365-5da6-4988-b208-84e7cd19bb9b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:08.211774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9e792b4c-ccb8-4960-ab61-c08c68b5ddd6 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:08.221999 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9e792b4c-ccb8-4960-ab61-c08c68b5ddd6 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1314 microversion: 2.1 time: 1.250580 Sep 08 12:39:08.230196 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 230/449] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:06 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1314 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:08.250075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec196e67-e0e2-445a-9b9e-ab716af8998e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:08.250779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ec196e67-e0e2-445a-9b9e-ab716af8998e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:08.275891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec196e67-e0e2-445a-9b9e-ab716af8998e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:08.276482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec196e67-e0e2-445a-9b9e-ab716af8998e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:08.279860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec196e67-e0e2-445a-9b9e-ab716af8998e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:08.282389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec196e67-e0e2-445a-9b9e-ab716af8998e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:08.284490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec196e67-e0e2-445a-9b9e-ab716af8998e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:08.284958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec196e67-e0e2-445a-9b9e-ab716af8998e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:08.617822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ec196e67-e0e2-445a-9b9e-ab716af8998e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:08.632556 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ec196e67-e0e2-445a-9b9e-ab716af8998e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1277 microversion: 2.1 time: 0.400544 Sep 08 12:39:08.651087 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 231/450] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:08 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1277 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:08.664272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-55877541-7cf3-4256-8d36-1e719200f58b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:08.665953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-55877541-7cf3-4256-8d36-1e719200f58b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:08.679558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55877541-7cf3-4256-8d36-1e719200f58b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:08.681355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55877541-7cf3-4256-8d36-1e719200f58b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:08.682050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55877541-7cf3-4256-8d36-1e719200f58b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:08.685826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55877541-7cf3-4256-8d36-1e719200f58b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:08.686641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55877541-7cf3-4256-8d36-1e719200f58b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:08.688245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55877541-7cf3-4256-8d36-1e719200f58b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:09.081759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-55877541-7cf3-4256-8d36-1e719200f58b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:09.094944 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-55877541-7cf3-4256-8d36-1e719200f58b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1277 microversion: 2.1 time: 0.437085 Sep 08 12:39:09.096189 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 232/451] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:08 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1277 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:09.105231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-8c89478b-d973-4faa-9807-f8a04e25a702 req-629a3e15-edb4-41a6-b9b6-7abe7473329d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9cbc9df-d3c4-4ebd-9538-4d6da2305b88", "name": "network-vif-plugged", "status": "completed", "tag": "e29a856f-a916-456f-a000-39775ffcabdb"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:09.126544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8c89478b-d973-4faa-9807-f8a04e25a702 req-629a3e15-edb4-41a6-b9b6-7abe7473329d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:09.129537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-808d3365-5da6-4988-b208-84e7cd19bb9b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:09.142402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8c89478b-d973-4faa-9807-f8a04e25a702 req-629a3e15-edb4-41a6-b9b6-7abe7473329d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:09.142848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8c89478b-d973-4faa-9807-f8a04e25a702 req-629a3e15-edb4-41a6-b9b6-7abe7473329d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:09.144996 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-808d3365-5da6-4988-b208-84e7cd19bb9b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1470 microversion: 2.1 time: 1.137810 Sep 08 12:39:09.145651 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 220/452] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:08 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1470 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:09.174203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e8439265-da4b-47f6-9317-c924db5f4af4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:09.174465 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-8c89478b-d973-4faa-9807-f8a04e25a702 req-629a3e15-edb4-41a6-b9b6-7abe7473329d service nova] Creating event network-vif-plugged:e29a856f-a916-456f-a000-39775ffcabdb for instance b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 on n-h1-852084-10 Sep 08 12:39:09.176762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e8439265-da4b-47f6-9317-c924db5f4af4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:09.180303 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-8c89478b-d973-4faa-9807-f8a04e25a702 req-629a3e15-edb4-41a6-b9b6-7abe7473329d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081213 Sep 08 12:39:09.181133 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 233/453] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:09.189441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-6494544b-2f3e-498d-9c15-5a9399c1b742 req-628a28cf-e5f2-4fe8-a395-97506e3dbce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "164b7ad7-b8db-4492-a973-c90ee923e01b", "name": "network-vif-deleted", "tag": "e3298c03-e65b-4468-977e-c289c1d17507"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:09.205304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8439265-da4b-47f6-9317-c924db5f4af4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:09.213860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8439265-da4b-47f6-9317-c924db5f4af4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:09.214364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8439265-da4b-47f6-9317-c924db5f4af4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:09.215161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8439265-da4b-47f6-9317-c924db5f4af4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:09.217006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8439265-da4b-47f6-9317-c924db5f4af4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:09.220060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8439265-da4b-47f6-9317-c924db5f4af4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:09.226967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6494544b-2f3e-498d-9c15-5a9399c1b742 req-628a28cf-e5f2-4fe8-a395-97506e3dbce1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:09.228902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6494544b-2f3e-498d-9c15-5a9399c1b742 req-628a28cf-e5f2-4fe8-a395-97506e3dbce1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:09.229342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6494544b-2f3e-498d-9c15-5a9399c1b742 req-628a28cf-e5f2-4fe8-a395-97506e3dbce1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:09.262002 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-6494544b-2f3e-498d-9c15-5a9399c1b742 req-628a28cf-e5f2-4fe8-a395-97506e3dbce1 service nova] Creating event network-vif-deleted:e3298c03-e65b-4468-977e-c289c1d17507 for instance 164b7ad7-b8db-4492-a973-c90ee923e01b on n-h2-852084-10 Sep 08 12:39:09.286215 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-6494544b-2f3e-498d-9c15-5a9399c1b742 req-628a28cf-e5f2-4fe8-a395-97506e3dbce1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094470 Sep 08 12:39:09.287109 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 234/454] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:09.292505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-04cda37b-d3a6-40e9-93e0-43206deaaa33 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:09.293824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-04cda37b-d3a6-40e9-93e0-43206deaaa33 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:09.321889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04cda37b-d3a6-40e9-93e0-43206deaaa33 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:09.327941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04cda37b-d3a6-40e9-93e0-43206deaaa33 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:09.329476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04cda37b-d3a6-40e9-93e0-43206deaaa33 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:09.332686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04cda37b-d3a6-40e9-93e0-43206deaaa33 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:09.333425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04cda37b-d3a6-40e9-93e0-43206deaaa33 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:09.334078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04cda37b-d3a6-40e9-93e0-43206deaaa33 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:10.088570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=38 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:10.554937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-04cda37b-d3a6-40e9-93e0-43206deaaa33 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:10.573101 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-04cda37b-d3a6-40e9-93e0-43206deaaa33 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1386 microversion: 2.1 time: 1.284625 Sep 08 12:39:10.576359 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 235/455] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:09 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1386 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:10.584905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f02a2726-9f6f-44b1-a62e-00d2ebde5c04 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:10.589051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f02a2726-9f6f-44b1-a62e-00d2ebde5c04 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:10.614408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f02a2726-9f6f-44b1-a62e-00d2ebde5c04 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:10.617580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f02a2726-9f6f-44b1-a62e-00d2ebde5c04 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:10.618101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f02a2726-9f6f-44b1-a62e-00d2ebde5c04 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:10.618863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f02a2726-9f6f-44b1-a62e-00d2ebde5c04 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:10.624543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f02a2726-9f6f-44b1-a62e-00d2ebde5c04 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:10.625798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f02a2726-9f6f-44b1-a62e-00d2ebde5c04 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:10.734412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e8439265-da4b-47f6-9317-c924db5f4af4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:10.768433 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e8439265-da4b-47f6-9317-c924db5f4af4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1310 microversion: 2.1 time: 1.615134 Sep 08 12:39:10.770648 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 221/456] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:09 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1310 bytes in 1623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:10.804741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a69678fe-8a70-477c-965f-e524066ac775 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:10.816391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a69678fe-8a70-477c-965f-e524066ac775 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:10.830318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a69678fe-8a70-477c-965f-e524066ac775 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:10.831546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a69678fe-8a70-477c-965f-e524066ac775 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:10.832158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a69678fe-8a70-477c-965f-e524066ac775 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:10.833724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a69678fe-8a70-477c-965f-e524066ac775 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:10.835689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a69678fe-8a70-477c-965f-e524066ac775 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:10.836419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a69678fe-8a70-477c-965f-e524066ac775 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:11.071309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a69678fe-8a70-477c-965f-e524066ac775 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:11.102641 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a69678fe-8a70-477c-965f-e524066ac775 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1277 microversion: 2.1 time: 0.319003 Sep 08 12:39:11.104209 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 222/457] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:10 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1277 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:11.133125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e5cd392b-75ad-49b0-ad58-4eb000c90e06 req-b7d3ad68-fbfe-40e8-add4-1b7b7a59bcb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "953e5b9e-8c65-4892-a558-ec7764a7b037", "tag": "ece0ac07-b959-4de4-afa0-16ad3e7f613d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:11.157549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e5cd392b-75ad-49b0-ad58-4eb000c90e06 req-b7d3ad68-fbfe-40e8-add4-1b7b7a59bcb6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:11.159166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e5cd392b-75ad-49b0-ad58-4eb000c90e06 req-b7d3ad68-fbfe-40e8-add4-1b7b7a59bcb6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:11.159981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e5cd392b-75ad-49b0-ad58-4eb000c90e06 req-b7d3ad68-fbfe-40e8-add4-1b7b7a59bcb6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:11.186883 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e5cd392b-75ad-49b0-ad58-4eb000c90e06 req-b7d3ad68-fbfe-40e8-add4-1b7b7a59bcb6 service nova] Creating event network-changed:ece0ac07-b959-4de4-afa0-16ad3e7f613d for instance 953e5b9e-8c65-4892-a558-ec7764a7b037 on n-h2-852084-10 Sep 08 12:39:11.192579 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e5cd392b-75ad-49b0-ad58-4eb000c90e06 req-b7d3ad68-fbfe-40e8-add4-1b7b7a59bcb6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082285 Sep 08 12:39:11.193688 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 223/458] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:11.200198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-863e5345-2b89-4d84-a4de-67517eedb05e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:11.201120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-863e5345-2b89-4d84-a4de-67517eedb05e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:11.210032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-863e5345-2b89-4d84-a4de-67517eedb05e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:11.211505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-863e5345-2b89-4d84-a4de-67517eedb05e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:11.212119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-863e5345-2b89-4d84-a4de-67517eedb05e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:11.213034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-863e5345-2b89-4d84-a4de-67517eedb05e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:11.213649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-863e5345-2b89-4d84-a4de-67517eedb05e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:11.214241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-863e5345-2b89-4d84-a4de-67517eedb05e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:11.459912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f02a2726-9f6f-44b1-a62e-00d2ebde5c04 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:11.473945 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f02a2726-9f6f-44b1-a62e-00d2ebde5c04 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1314 microversion: 2.1 time: 0.896197 Sep 08 12:39:11.479697 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 236/459] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:10 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1314 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:11.508954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01ef818e-5b95-42a0-8b4e-b784b55a2db5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:11.514267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-01ef818e-5b95-42a0-8b4e-b784b55a2db5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:11.535383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01ef818e-5b95-42a0-8b4e-b784b55a2db5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:11.537210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01ef818e-5b95-42a0-8b4e-b784b55a2db5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:11.541067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01ef818e-5b95-42a0-8b4e-b784b55a2db5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:11.542101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01ef818e-5b95-42a0-8b4e-b784b55a2db5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:11.542871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01ef818e-5b95-42a0-8b4e-b784b55a2db5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:11.545077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01ef818e-5b95-42a0-8b4e-b784b55a2db5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:11.760016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-863e5345-2b89-4d84-a4de-67517eedb05e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:11.782563 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-863e5345-2b89-4d84-a4de-67517eedb05e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.587476 Sep 08 12:39:11.789576 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 224/460] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:11 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1319 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:11.801342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8bca6e4b-0d64-422d-83dd-6a448ee23552 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:11.802249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8bca6e4b-0d64-422d-83dd-6a448ee23552 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:11.809372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8bca6e4b-0d64-422d-83dd-6a448ee23552 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:11.810130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8bca6e4b-0d64-422d-83dd-6a448ee23552 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:11.810754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8bca6e4b-0d64-422d-83dd-6a448ee23552 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:11.811667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8bca6e4b-0d64-422d-83dd-6a448ee23552 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:11.812291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8bca6e4b-0d64-422d-83dd-6a448ee23552 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:11.812888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8bca6e4b-0d64-422d-83dd-6a448ee23552 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:12.184953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-01ef818e-5b95-42a0-8b4e-b784b55a2db5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:12.192998 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-01ef818e-5b95-42a0-8b4e-b784b55a2db5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1462 microversion: 2.1 time: 0.712148 Sep 08 12:39:12.194269 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 237/461] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:11 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1462 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:12.348336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8bca6e4b-0d64-422d-83dd-6a448ee23552 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:12.369451 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8bca6e4b-0d64-422d-83dd-6a448ee23552 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1386 microversion: 2.1 time: 0.578060 Sep 08 12:39:12.375999 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 225/462] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:11 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1386 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:12.521966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d0780cbf-73b0-404b-b37f-9e6a67086020 tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Action: 'create', calling method: .version_select at 0x7fdb3b465160>, body: {"keypair": {"name": "tempest-keypair-1744103416", "type": "ssh", "user_id": "0c4ae10336c34e47917235307bac4347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAaxMi2STV97qA5emgRWJIPcvj2xXPbV8+1ltNV5ukjtBovqAM8hs4ecajubIImNlNR2/pMrjDBiuBFcYDe0GMX5k9o0GDgRGm59kh1e1QpBWg/KIXKAqgfqxQVLtmvkKg=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:12.561807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d0780cbf-73b0-404b-b37f-9e6a67086020 tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Getting quotas for project 15c2aef62ca140a1830a0457a2e4a7d2. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:39:12.570087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d0780cbf-73b0-404b-b37f-9e6a67086020 tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Getting quotas for user 958143739b3143ab8fc4d7519f31ca71 and project 15c2aef62ca140a1830a0457a2e4a7d2. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:39:12.612367 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d0780cbf-73b0-404b-b37f-9e6a67086020 tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.416650 Sep 08 12:39:12.613727 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 238/463] 10.222.0.78 () {62 vars in 1200 bytes} [Thu Sep 8 12:39:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 419 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 12:39:12.625797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d588dbd2-85cd-444b-858f-eb35d0397da0 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Action: 'create', calling method: .version_select at 0x7fdb3748fe50>, body: {"keypair": {"name": "tempest-keypair-124175808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwRzkU/3h8DbMPBQhsSs/U3I9CX23ZTcYlx2IjPnosCceCK6w0srPKV4DkO0S6FUEYsiVvJ6JzfTjlFNegKZnR5jbKbUhBhWuV5dOrkaHzghXtpG6R+1ejgU6lkcVwTZg=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:12.634168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0d1c976c-4da7-4c6c-bc5a-b8586e19518a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:12.635400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0d1c976c-4da7-4c6c-bc5a-b8586e19518a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:12.655200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-d588dbd2-85cd-444b-858f-eb35d0397da0 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Getting quotas for project 3dc8fdfffe814f59ad6b22da13094cc9. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:39:12.657266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d1c976c-4da7-4c6c-bc5a-b8586e19518a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:12.657741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d1c976c-4da7-4c6c-bc5a-b8586e19518a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:12.658185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d1c976c-4da7-4c6c-bc5a-b8586e19518a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:12.661221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d1c976c-4da7-4c6c-bc5a-b8586e19518a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:12.661546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-d588dbd2-85cd-444b-858f-eb35d0397da0 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Getting quotas for user 8f1fd37230b4490389ff38162ea813b9 and project 3dc8fdfffe814f59ad6b22da13094cc9. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:39:12.661748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d1c976c-4da7-4c6c-bc5a-b8586e19518a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:12.662193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d1c976c-4da7-4c6c-bc5a-b8586e19518a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:12.714618 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d588dbd2-85cd-444b-858f-eb35d0397da0 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.337864 Sep 08 12:39:12.715321 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 226/464] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:39:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:12.721342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89e7041a-5ebf-4668-b080-21bae4068b98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:12.722284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-89e7041a-5ebf-4668-b080-21bae4068b98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:12.731146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e7041a-5ebf-4668-b080-21bae4068b98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:12.731861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e7041a-5ebf-4668-b080-21bae4068b98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:12.732499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e7041a-5ebf-4668-b080-21bae4068b98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:12.733504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e7041a-5ebf-4668-b080-21bae4068b98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:12.734306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e7041a-5ebf-4668-b080-21bae4068b98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:12.734942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e7041a-5ebf-4668-b080-21bae4068b98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:13.364615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-89e7041a-5ebf-4668-b080-21bae4068b98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:13.367648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0d1c976c-4da7-4c6c-bc5a-b8586e19518a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:13.376560 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-89e7041a-5ebf-4668-b080-21bae4068b98 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1319 microversion: 2.1 time: 0.659811 Sep 08 12:39:13.378663 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 227/465] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:12 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1319 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:13.392010 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0d1c976c-4da7-4c6c-bc5a-b8586e19518a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1310 microversion: 2.1 time: 0.761378 Sep 08 12:39:13.407253 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 239/466] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:12 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1310 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:13.407253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44b0c428-b150-44bb-81cf-7e66335fcacd tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:13.407253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-44b0c428-b150-44bb-81cf-7e66335fcacd tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:13.409312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b0c428-b150-44bb-81cf-7e66335fcacd tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:13.410005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b0c428-b150-44bb-81cf-7e66335fcacd tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:13.410674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b0c428-b150-44bb-81cf-7e66335fcacd tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:13.411607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b0c428-b150-44bb-81cf-7e66335fcacd tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:13.412565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b0c428-b150-44bb-81cf-7e66335fcacd tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:13.413538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b0c428-b150-44bb-81cf-7e66335fcacd tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:13.413971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-252a3556-aff1-4e82-a653-0126b22099c0 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:13.414739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-252a3556-aff1-4e82-a653-0126b22099c0 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:13.429656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252a3556-aff1-4e82-a653-0126b22099c0 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:13.435099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252a3556-aff1-4e82-a653-0126b22099c0 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:13.435099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252a3556-aff1-4e82-a653-0126b22099c0 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:13.441195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252a3556-aff1-4e82-a653-0126b22099c0 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:13.441835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252a3556-aff1-4e82-a653-0126b22099c0 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:13.442371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252a3556-aff1-4e82-a653-0126b22099c0 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:14.237128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:14.409471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-44b0c428-b150-44bb-81cf-7e66335fcacd tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:14.435023 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-44b0c428-b150-44bb-81cf-7e66335fcacd tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1464 microversion: 2.1 time: 1.039025 Sep 08 12:39:14.437024 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 240/467] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:13 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1464 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:14.450617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5c2ddcba-3b38-4b04-926e-a5076bb151db tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Action: 'create', calling method: .version_select at 0x7fdb3b6d6dc0>, body: {"keypair": {"name": "tempest-keypair-1550428318", "type": "ssh", "user_id": "0c4ae10336c34e47917235307bac4347", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2AZSifgvWg3ZvCJK1ftfo4H3ScXjeVgVDt1AW+qH1BYglqRtt7k1qKOGI07ma8ToL423A7fFP2lT13D7vV8AQXh17V7enO5rtR1EmiJ73AD3r8ZxNtmE4OJA3T+eWYzA=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:14.490074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5c2ddcba-3b38-4b04-926e-a5076bb151db tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Getting quotas for project 15c2aef62ca140a1830a0457a2e4a7d2. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:39:14.491704 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-252a3556-aff1-4e82-a653-0126b22099c0 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1615 microversion: 2.1 time: 1.106660 Sep 08 12:39:14.493649 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 228/468] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:13 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1615 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:14.500019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5c2ddcba-3b38-4b04-926e-a5076bb151db tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Getting quotas for user 958143739b3143ab8fc4d7519f31ca71 and project 15c2aef62ca140a1830a0457a2e4a7d2. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:39:14.502240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eba6e261-6898-4db3-9a81-13ca2edc42a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:14.503321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:14.504293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eba6e261-6898-4db3-9a81-13ca2edc42a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:14.511611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eba6e261-6898-4db3-9a81-13ca2edc42a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:14.512434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eba6e261-6898-4db3-9a81-13ca2edc42a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:14.521394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eba6e261-6898-4db3-9a81-13ca2edc42a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:14.521394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eba6e261-6898-4db3-9a81-13ca2edc42a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:14.525131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eba6e261-6898-4db3-9a81-13ca2edc42a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:14.525586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eba6e261-6898-4db3-9a81-13ca2edc42a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:14.562414 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5c2ddcba-3b38-4b04-926e-a5076bb151db tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.121538 Sep 08 12:39:14.563371 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 241/469] 10.222.0.78 () {62 vars in 1200 bytes} [Thu Sep 8 12:39:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 12:39:14.574713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-12cb51cb-e6ae-4b06-bd56-c34a372d3712 req-e1343c44-4dff-42f2-8442-8044fef1b7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b057001-7456-4c05-8f42-f421455b3cdd", "tag": "cdc99e53-9228-4abb-811c-6f214aead362"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:14.604823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-12cb51cb-e6ae-4b06-bd56-c34a372d3712 req-e1343c44-4dff-42f2-8442-8044fef1b7a7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:14.605853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-12cb51cb-e6ae-4b06-bd56-c34a372d3712 req-e1343c44-4dff-42f2-8442-8044fef1b7a7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:14.606421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-12cb51cb-e6ae-4b06-bd56-c34a372d3712 req-e1343c44-4dff-42f2-8442-8044fef1b7a7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:14.634258 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-12cb51cb-e6ae-4b06-bd56-c34a372d3712 req-e1343c44-4dff-42f2-8442-8044fef1b7a7 service nova] Creating event network-changed:cdc99e53-9228-4abb-811c-6f214aead362 for instance 7b057001-7456-4c05-8f42-f421455b3cdd on n-h1-852084-10 Sep 08 12:39:14.648808 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-12cb51cb-e6ae-4b06-bd56-c34a372d3712 req-e1343c44-4dff-42f2-8442-8044fef1b7a7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078564 Sep 08 12:39:14.656396 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 242/470] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:14.661925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6adec8ae-37ef-414d-b966-680edff02350 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:14.662640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6adec8ae-37ef-414d-b966-680edff02350 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:14.686983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6adec8ae-37ef-414d-b966-680edff02350 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:14.688393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6adec8ae-37ef-414d-b966-680edff02350 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:14.689085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6adec8ae-37ef-414d-b966-680edff02350 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:14.690041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6adec8ae-37ef-414d-b966-680edff02350 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:14.693602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6adec8ae-37ef-414d-b966-680edff02350 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:14.694673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6adec8ae-37ef-414d-b966-680edff02350 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:14.835328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eba6e261-6898-4db3-9a81-13ca2edc42a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:14.844833 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eba6e261-6898-4db3-9a81-13ca2edc42a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.349552 Sep 08 12:39:14.847493 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 229/471] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:14 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1319 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:14.854784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-4472c555-c1b9-43af-a8e2-ce186261f65f req-b0834c60-fa90-4d03-8a3a-c3b4482540fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0c4563-36a9-47a0-b7f9-c1b03ca5164e", "tag": "2e3928d3-2252-4d62-8307-217623c31b4e"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:14.887552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4472c555-c1b9-43af-a8e2-ce186261f65f req-b0834c60-fa90-4d03-8a3a-c3b4482540fc service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:14.888046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4472c555-c1b9-43af-a8e2-ce186261f65f req-b0834c60-fa90-4d03-8a3a-c3b4482540fc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:14.888480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4472c555-c1b9-43af-a8e2-ce186261f65f req-b0834c60-fa90-4d03-8a3a-c3b4482540fc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:14.909568 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-4472c555-c1b9-43af-a8e2-ce186261f65f req-b0834c60-fa90-4d03-8a3a-c3b4482540fc service nova] Creating event network-changed:2e3928d3-2252-4d62-8307-217623c31b4e for instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e on n-h2-852084-10 Sep 08 12:39:14.925648 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-4472c555-c1b9-43af-a8e2-ce186261f65f req-b0834c60-fa90-4d03-8a3a-c3b4482540fc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075349 Sep 08 12:39:14.927084 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 230/472] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:14.941511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2335a48b-51bf-45a6-a390-c0ed630f3278 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:14.942232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2335a48b-51bf-45a6-a390-c0ed630f3278 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:14.955047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2335a48b-51bf-45a6-a390-c0ed630f3278 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:14.955574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2335a48b-51bf-45a6-a390-c0ed630f3278 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:14.956547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2335a48b-51bf-45a6-a390-c0ed630f3278 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:14.958034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2335a48b-51bf-45a6-a390-c0ed630f3278 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:14.958670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2335a48b-51bf-45a6-a390-c0ed630f3278 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:14.959116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2335a48b-51bf-45a6-a390-c0ed630f3278 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:15.494107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6adec8ae-37ef-414d-b966-680edff02350 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:15.504212 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6adec8ae-37ef-414d-b966-680edff02350 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1386 microversion: 2.1 time: 0.846427 Sep 08 12:39:15.505087 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 243/473] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:14 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1386 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:15.519263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-74bb13f8-419e-4d77-89e9-c9133c4244f7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:15.519263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-74bb13f8-419e-4d77-89e9-c9133c4244f7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:15.527109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74bb13f8-419e-4d77-89e9-c9133c4244f7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:15.527699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74bb13f8-419e-4d77-89e9-c9133c4244f7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:15.528198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74bb13f8-419e-4d77-89e9-c9133c4244f7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:15.529581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74bb13f8-419e-4d77-89e9-c9133c4244f7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:15.530361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74bb13f8-419e-4d77-89e9-c9133c4244f7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:15.531359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74bb13f8-419e-4d77-89e9-c9133c4244f7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:15.725419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2335a48b-51bf-45a6-a390-c0ed630f3278 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:15.734323 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2335a48b-51bf-45a6-a390-c0ed630f3278 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1319 microversion: 2.1 time: 0.797865 Sep 08 12:39:15.735214 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 231/474] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:14 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1319 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:15.894186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a12b1ed0-6582-48ef-a9be-1faa967ce940 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Calling method '.version_select at 0x7fdb3742c0d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:15.905277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a12b1ed0-6582-48ef-a9be-1faa967ce940 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:15.905833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a12b1ed0-6582-48ef-a9be-1faa967ce940 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:15.906339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a12b1ed0-6582-48ef-a9be-1faa967ce940 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:15.926395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a12b1ed0-6582-48ef-a9be-1faa967ce940 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:15.927206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a12b1ed0-6582-48ef-a9be-1faa967ce940 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:15.927684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a12b1ed0-6582-48ef-a9be-1faa967ce940 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:15.947641 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a12b1ed0-6582-48ef-a9be-1faa967ce940 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/28537d6c3d924d689b4d9a83c74c5a7c?start=2022-09-07T12%3A39%3A14.456685&end=2022-09-09T12%3A39%3A14.456685" status: 200 len: 695 microversion: 2.1 time: 0.211088 Sep 08 12:39:15.948234 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 232/475] 10.222.0.78 () {58 vars in 1412 bytes} [Thu Sep 8 12:39:15 2022] GET /compute/v2.1/os-simple-tenant-usage/28537d6c3d924d689b4d9a83c74c5a7c?start=2022-09-07T12%3A39%3A14.456685&end=2022-09-09T12%3A39%3A14.456685 => generated 695 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:15.953053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6d0794a-ffe5-47fe-a675-28c050b8d0ab tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Calling method '.version_select at 0x7fdb375c7b80>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:15.956987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6d0794a-ffe5-47fe-a675-28c050b8d0ab tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:15.957766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6d0794a-ffe5-47fe-a675-28c050b8d0ab tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:15.958432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6d0794a-ffe5-47fe-a675-28c050b8d0ab tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:15.970069 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f6d0794a-ffe5-47fe-a675-28c050b8d0ab tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 413 microversion: 2.1 time: 0.020580 Sep 08 12:39:15.971091 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 233/476] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 12:39:15 2022] GET /compute/v2.1/os-migrations => generated 413 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:15.975942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d03f7e0e-d3d6-4547-b38b-475bb7636874 tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Calling method '.version_select at 0x7fdb374fdca0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:15.981749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-74bb13f8-419e-4d77-89e9-c9133c4244f7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:15.985760 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d03f7e0e-d3d6-4547-b38b-475bb7636874 tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-1744103416?user_id=0c4ae10336c34e47917235307bac4347" status: 200 len: 512 microversion: 2.10 time: 0.013175 Sep 08 12:39:15.987173 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 234/477] 10.222.0.78 () {60 vars in 1340 bytes} [Thu Sep 8 12:39:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1744103416?user_id=0c4ae10336c34e47917235307bac4347 => generated 512 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:39:15.992479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-234799607", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "2427be19-e512-4963-98e3-67b9c3b83a6d"}], "security_groups": [{"name": "tempest-securitygroup--1230302378"}], "key_name": "tempest-keypair-124175808", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:15.999517 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-74bb13f8-419e-4d77-89e9-c9133c4244f7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1310 microversion: 2.1 time: 0.488596 Sep 08 12:39:16.000273 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 244/478] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:15 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1310 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:16.004748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-64ee2c72-657a-45d7-8ab0-8eb92f9770bb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:16.005367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-64ee2c72-657a-45d7-8ab0-8eb92f9770bb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:16.017602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64ee2c72-657a-45d7-8ab0-8eb92f9770bb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:16.023453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64ee2c72-657a-45d7-8ab0-8eb92f9770bb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:16.024354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64ee2c72-657a-45d7-8ab0-8eb92f9770bb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:16.025847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64ee2c72-657a-45d7-8ab0-8eb92f9770bb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:16.026820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64ee2c72-657a-45d7-8ab0-8eb92f9770bb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:16.027857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64ee2c72-657a-45d7-8ab0-8eb92f9770bb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:16.308585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] validate_networks() for [('2427be19-e512-4963-98e3-67b9c3b83a6d', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:39:16.429342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-64ee2c72-657a-45d7-8ab0-8eb92f9770bb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:16.437318 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-64ee2c72-657a-45d7-8ab0-8eb92f9770bb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.436162 Sep 08 12:39:16.438174 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 245/479] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:16 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1319 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:16.444262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5d3784e4-de4e-4ac8-be45-a06a53b786fe tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '.version_select at 0x7fdb3b47cc10>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:16.459386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d3784e4-de4e-4ac8-be45-a06a53b786fe tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:16.459873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d3784e4-de4e-4ac8-be45-a06a53b786fe tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:16.460306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d3784e4-de4e-4ac8-be45-a06a53b786fe tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:16.477448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d3784e4-de4e-4ac8-be45-a06a53b786fe tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:16.477932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d3784e4-de4e-4ac8-be45-a06a53b786fe tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:16.478366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d3784e4-de4e-4ac8-be45-a06a53b786fe tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:16.496385 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5d3784e4-de4e-4ac8-be45-a06a53b786fe tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage/28537d6c3d924d689b4d9a83c74c5a7c?start=2022-09-07T12%3A39%3A14.456685&end=2022-09-09T12%3A39%3A14.456685" status: 200 len: 695 microversion: 2.1 time: 0.056933 Sep 08 12:39:16.497207 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 246/480] 10.222.0.78 () {58 vars in 1412 bytes} [Thu Sep 8 12:39:16 2022] GET /compute/v2.1/os-simple-tenant-usage/28537d6c3d924d689b4d9a83c74c5a7c?start=2022-09-07T12%3A39%3A14.456685&end=2022-09-09T12%3A39%3A14.456685 => generated 695 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:16.501699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f68bfadd-6ade-45bf-889c-1e5bbb50e043 tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Action: 'create', calling method: .version_select at 0x7fdb3b6d6700>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-653260601", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDEy5CMv6mcgA2sv+jQG6zfehzOBPrNd2rCDzc48gPQc/wxpeNf2KGPJGb5vNlxuRRLb/Ctzpa8VMfofnv+tusIZbu/TfD2XErc5yVcB7EflU6Bnldrzl/e7tX/qi75oiw=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:16.523374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-f68bfadd-6ade-45bf-889c-1e5bbb50e043 tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Getting quotas for project 15c2aef62ca140a1830a0457a2e4a7d2. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:39:16.528259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-f68bfadd-6ade-45bf-889c-1e5bbb50e043 tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Getting quotas for user 958143739b3143ab8fc4d7519f31ca71 and project 15c2aef62ca140a1830a0457a2e4a7d2. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:39:16.554288 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f68bfadd-6ade-45bf-889c-1e5bbb50e043 tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.056018 Sep 08 12:39:16.555180 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 247/481] 10.222.0.78 () {62 vars in 1200 bytes} [Thu Sep 8 12:39:16 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 12:39:16.560433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2032931190", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:16.619380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:39:17.248608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:39:17.249166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:39:17.249505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:39:17.249911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:39:17.250347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:39:17.257263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:39:17.258287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:39:17.258775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:39:17.259440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:39:17.259873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:39:17.260661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:17.261308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:17.262525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:17.263347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:17.263838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:17.264277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:17.275656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:17.276406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:17.277040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:17.278425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:17.279190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:17.279925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:17.286141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Getting quotas for project 3dc8fdfffe814f59ad6b22da13094cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:39:17.290728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Getting quotas for user 8f1fd37230b4490389ff38162ea813b9 and project 3dc8fdfffe814f59ad6b22da13094cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:39:17.320357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:39:17.320796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Getting quotas for project 8c3e5d96296342eb8a99953dec8747c0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:39:17.322708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:39:17.330709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Getting quotas for user 81af813dbf5340d0a3d9d4bf0cff3da7 and project 8c3e5d96296342eb8a99953dec8747c0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:39:17.347578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:39:17.353619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:39:17.380123 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-26db74fb-4f6a-4aa1-bb7e-193122d6a355 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.391210 Sep 08 12:39:17.382452 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 235/482] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:39:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:39:17.388711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8b9ffe74-b900-4ab6-abc7-0effb98738c8 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Calling method '.version_select at 0x7fdb3742cf70>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:17.401319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b9ffe74-b900-4ab6-abc7-0effb98738c8 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:17.401839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b9ffe74-b900-4ab6-abc7-0effb98738c8 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:17.402573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b9ffe74-b900-4ab6-abc7-0effb98738c8 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:17.420198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b9ffe74-b900-4ab6-abc7-0effb98738c8 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:17.420501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b9ffe74-b900-4ab6-abc7-0effb98738c8 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:17.420955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b9ffe74-b900-4ab6-abc7-0effb98738c8 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:17.446105 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9eb98328-3869-411c-840f-dd2ecef5405e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.886869 Sep 08 12:39:17.449764 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 248/483] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:39:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:39:17.461026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5f4103f7-c3bb-48ed-915a-e8a17262cc12 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:17.464618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5f4103f7-c3bb-48ed-915a-e8a17262cc12 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:17.476221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f4103f7-c3bb-48ed-915a-e8a17262cc12 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:17.477001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f4103f7-c3bb-48ed-915a-e8a17262cc12 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:17.477696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f4103f7-c3bb-48ed-915a-e8a17262cc12 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:17.478640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f4103f7-c3bb-48ed-915a-e8a17262cc12 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:17.479253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f4103f7-c3bb-48ed-915a-e8a17262cc12 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:17.479790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f4103f7-c3bb-48ed-915a-e8a17262cc12 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:17.504325 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8b9ffe74-b900-4ab6-abc7-0effb98738c8 tempest-TenantUsagesTestJSON-946084897 tempest-TenantUsagesTestJSON-946084897-project-admin] 10.222.0.78 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T12%3A39%3A14.456685&end=2022-09-09T12%3A39%3A14.456685&detailed=1" status: 200 len: 4941 microversion: 2.1 time: 0.120182 Sep 08 12:39:17.504925 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 236/484] 10.222.0.78 () {58 vars in 1335 bytes} [Thu Sep 8 12:39:17 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-09-07T12%3A39%3A14.456685&end=2022-09-09T12%3A39%3A14.456685&detailed=1 => generated 4941 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:17.517192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e05a2909-21e7-401d-8e79-576239a2837f tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Calling method '.version_select at 0x7fdb375d9700>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:17.528876 n-d-852084-10 devstack@n-api.service[128970]: WARNING oslo_db.sqlalchemy.utils [None req-e05a2909-21e7-401d-8e79-576239a2837f tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 12:39:17.550810 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e05a2909-21e7-401d-8e79-576239a2837f tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] 10.222.0.78 "GET /compute/v2.1/os-keypairs?user_id=0c4ae10336c34e47917235307bac4347" status: 200 len: 726 microversion: 2.10 time: 0.044778 Sep 08 12:39:17.551853 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 237/485] 10.222.0.78 () {60 vars in 1259 bytes} [Thu Sep 8 12:39:17 2022] GET /compute/v2.1/os-keypairs?user_id=0c4ae10336c34e47917235307bac4347 => generated 726 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:39:17.556441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-33285e06-782d-41ea-a446-107d04951c9c req-301ef785-f811-49ca-b0bb-2a9a448bcc56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953e5b9e-8c65-4892-a558-ec7764a7b037", "name": "network-vif-plugged", "status": "completed", "tag": "ece0ac07-b959-4de4-afa0-16ad3e7f613d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:17.568873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-33285e06-782d-41ea-a446-107d04951c9c req-301ef785-f811-49ca-b0bb-2a9a448bcc56 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:17.569720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-33285e06-782d-41ea-a446-107d04951c9c req-301ef785-f811-49ca-b0bb-2a9a448bcc56 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:17.571000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-33285e06-782d-41ea-a446-107d04951c9c req-301ef785-f811-49ca-b0bb-2a9a448bcc56 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:17.595283 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-33285e06-782d-41ea-a446-107d04951c9c req-301ef785-f811-49ca-b0bb-2a9a448bcc56 service nova] Creating event network-vif-plugged:ece0ac07-b959-4de4-afa0-16ad3e7f613d for instance 953e5b9e-8c65-4892-a558-ec7764a7b037 on n-h2-852084-10 Sep 08 12:39:17.610073 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-33285e06-782d-41ea-a446-107d04951c9c req-301ef785-f811-49ca-b0bb-2a9a448bcc56 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056833 Sep 08 12:39:17.610983 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 238/486] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:17.617837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d80cf350-063c-4edd-9562-51d5e956d999 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:17.619310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d80cf350-063c-4edd-9562-51d5e956d999 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:17.631929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d80cf350-063c-4edd-9562-51d5e956d999 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:17.632705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d80cf350-063c-4edd-9562-51d5e956d999 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:17.633846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d80cf350-063c-4edd-9562-51d5e956d999 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:17.634601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d80cf350-063c-4edd-9562-51d5e956d999 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:17.635074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d80cf350-063c-4edd-9562-51d5e956d999 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:17.635569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d80cf350-063c-4edd-9562-51d5e956d999 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:17.941856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5f4103f7-c3bb-48ed-915a-e8a17262cc12 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:17.955673 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5f4103f7-c3bb-48ed-915a-e8a17262cc12 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1386 microversion: 2.1 time: 0.504596 Sep 08 12:39:17.956583 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 249/487] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:17 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1386 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:17.970424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d80cf350-063c-4edd-9562-51d5e956d999 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:17.971838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-4715d619-fbf7-41cb-95d7-90fb40ff0005 req-b81675d5-8833-4745-b67c-1fb9f3ee4ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c952db45-70f9-47b4-9061-490992a347be", "tag": "b98800b6-5185-43d6-b8ad-064fb1654065"}, {"name": "network-changed", "server_uuid": "fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7", "tag": "ce9810f0-c796-4ff9-a520-b7a552ca6832"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:17.981981 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d80cf350-063c-4edd-9562-51d5e956d999 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1319 microversion: 2.1 time: 0.369112 Sep 08 12:39:17.995253 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 239/488] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:17 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:17.995253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-66e736d7-cd11-40f9-a18b-cb3281481058 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:17.995253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-66e736d7-cd11-40f9-a18b-cb3281481058 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:18.001436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4715d619-fbf7-41cb-95d7-90fb40ff0005 req-b81675d5-8833-4745-b67c-1fb9f3ee4ced service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.002291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4715d619-fbf7-41cb-95d7-90fb40ff0005 req-b81675d5-8833-4745-b67c-1fb9f3ee4ced service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.002769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66e736d7-cd11-40f9-a18b-cb3281481058 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.003089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4715d619-fbf7-41cb-95d7-90fb40ff0005 req-b81675d5-8833-4745-b67c-1fb9f3ee4ced service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:18.003443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66e736d7-cd11-40f9-a18b-cb3281481058 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.004275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66e736d7-cd11-40f9-a18b-cb3281481058 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:18.005088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66e736d7-cd11-40f9-a18b-cb3281481058 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.005672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66e736d7-cd11-40f9-a18b-cb3281481058 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.006099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66e736d7-cd11-40f9-a18b-cb3281481058 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:18.019177 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-4715d619-fbf7-41cb-95d7-90fb40ff0005 req-b81675d5-8833-4745-b67c-1fb9f3ee4ced service nova] Creating event network-changed:b98800b6-5185-43d6-b8ad-064fb1654065 for instance c952db45-70f9-47b4-9061-490992a347be on n-h2-852084-10 Sep 08 12:39:18.019884 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-4715d619-fbf7-41cb-95d7-90fb40ff0005 req-b81675d5-8833-4745-b67c-1fb9f3ee4ced service nova] Creating event network-changed:ce9810f0-c796-4ff9-a520-b7a552ca6832 for instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 on n-h1-852084-10 Sep 08 12:39:18.033799 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-4715d619-fbf7-41cb-95d7-90fb40ff0005 req-b81675d5-8833-4745-b67c-1fb9f3ee4ced service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.075351 Sep 08 12:39:18.035110 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 250/489] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:18.043840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-edced9df-d887-436c-b885-c628a43adafa tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:18.044768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-edced9df-d887-436c-b885-c628a43adafa tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:18.133713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-edced9df-d887-436c-b885-c628a43adafa tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:18.142683 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-edced9df-d887-436c-b885-c628a43adafa tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 200 len: 1240 microversion: 2.1 time: 0.106004 Sep 08 12:39:18.144074 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 251/490] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:18 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 1240 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:18.148950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-32d6279a-c6a4-44ed-be58-8dab81316d2b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:18.149761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-32d6279a-c6a4-44ed-be58-8dab81316d2b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:18.156860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32d6279a-c6a4-44ed-be58-8dab81316d2b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.157395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32d6279a-c6a4-44ed-be58-8dab81316d2b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.157777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32d6279a-c6a4-44ed-be58-8dab81316d2b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:18.158979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32d6279a-c6a4-44ed-be58-8dab81316d2b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.159635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32d6279a-c6a4-44ed-be58-8dab81316d2b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.160037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32d6279a-c6a4-44ed-be58-8dab81316d2b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:18.165185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:18.240294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-32d6279a-c6a4-44ed-be58-8dab81316d2b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:18.243735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-66e736d7-cd11-40f9-a18b-cb3281481058 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:18.248725 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-32d6279a-c6a4-44ed-be58-8dab81316d2b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1217 microversion: 2.1 time: 0.103604 Sep 08 12:39:18.249301 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 252/491] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:18 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1217 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:18.251952 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-66e736d7-cd11-40f9-a18b-cb3281481058 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1310 microversion: 2.1 time: 0.267862 Sep 08 12:39:18.252597 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 240/492] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:17 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1310 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:18.254709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cfe69358-a23c-4a5b-8552-9743657a24f8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:18.255697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cfe69358-a23c-4a5b-8552-9743657a24f8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:18.258775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79769ea1-9d0b-48b6-8776-a5e12309982d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:18.259290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-79769ea1-9d0b-48b6-8776-a5e12309982d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:18.268269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79769ea1-9d0b-48b6-8776-a5e12309982d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.269080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfe69358-a23c-4a5b-8552-9743657a24f8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.269205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79769ea1-9d0b-48b6-8776-a5e12309982d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.269627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfe69358-a23c-4a5b-8552-9743657a24f8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.269744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79769ea1-9d0b-48b6-8776-a5e12309982d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:18.270070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfe69358-a23c-4a5b-8552-9743657a24f8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:18.270540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79769ea1-9d0b-48b6-8776-a5e12309982d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.270760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfe69358-a23c-4a5b-8552-9743657a24f8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.271123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79769ea1-9d0b-48b6-8776-a5e12309982d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.271449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfe69358-a23c-4a5b-8552-9743657a24f8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.271661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79769ea1-9d0b-48b6-8776-a5e12309982d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:18.271871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfe69358-a23c-4a5b-8552-9743657a24f8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:18.274797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:18.299581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-79769ea1-9d0b-48b6-8776-a5e12309982d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:39:18.394654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:18.403173 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-79769ea1-9d0b-48b6-8776-a5e12309982d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 204 len: 0 microversion: 2.1 time: 0.147524 Sep 08 12:39:18.403173 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 241/493] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:39:18 2022] DELETE /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:39:18.410350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-145b9122-0adf-4313-856d-6bb8239a2d7a tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Calling method '.version_select at 0x7fdb37451b80>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:18.439121 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-145b9122-0adf-4313-856d-6bb8239a2d7a tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-653260601" status: 204 len: 0 microversion: 2.10 time: 0.034036 Sep 08 12:39:18.443304 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 242/494] 10.222.0.78 () {60 vars in 1322 bytes} [Thu Sep 8 12:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-653260601 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 12:39:18.450605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cfee4a80-54d3-4f54-8336-0af87cf6a58d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:18.451378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cfee4a80-54d3-4f54-8336-0af87cf6a58d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:18.464044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfee4a80-54d3-4f54-8336-0af87cf6a58d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.464616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfee4a80-54d3-4f54-8336-0af87cf6a58d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.465884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfee4a80-54d3-4f54-8336-0af87cf6a58d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:18.466766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfee4a80-54d3-4f54-8336-0af87cf6a58d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.467844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfee4a80-54d3-4f54-8336-0af87cf6a58d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.468289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfee4a80-54d3-4f54-8336-0af87cf6a58d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:18.723741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cfe69358-a23c-4a5b-8552-9743657a24f8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:18.732882 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cfe69358-a23c-4a5b-8552-9743657a24f8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.482373 Sep 08 12:39:18.733470 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 253/495] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:18 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:18.738775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c2bbe237-bb95-4e63-99b1-fb73c3e2826e tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Calling method '.version_select at 0x7fdb3b4e88b0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:18.761320 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c2bbe237-bb95-4e63-99b1-fb73c3e2826e tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550428318?user_id=0c4ae10336c34e47917235307bac4347" status: 204 len: 0 microversion: 2.10 time: 0.026575 Sep 08 12:39:18.762731 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 254/496] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 12:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1550428318?user_id=0c4ae10336c34e47917235307bac4347 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 12:39:18.771484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9c477f91-aff3-4813-849c-c255ce913399 tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] Calling method '.version_select at 0x7fdb3b465670>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:18.796280 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9c477f91-aff3-4813-849c-c255ce913399 tempest-KeyPairsV210TestJSON-715038918 tempest-KeyPairsV210TestJSON-715038918-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744103416?user_id=0c4ae10336c34e47917235307bac4347" status: 204 len: 0 microversion: 2.10 time: 0.029047 Sep 08 12:39:18.796860 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 255/497] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 12:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744103416?user_id=0c4ae10336c34e47917235307bac4347 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 12:39:18.940969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cfee4a80-54d3-4f54-8336-0af87cf6a58d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:18.949833 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cfee4a80-54d3-4f54-8336-0af87cf6a58d tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1470 microversion: 2.1 time: 0.504318 Sep 08 12:39:18.950514 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 243/498] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:18 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1470 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:18.979759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c4bb5394-cdf9-474c-903a-4668c7645e62 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:18.981047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c4bb5394-cdf9-474c-903a-4668c7645e62 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:18.987672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4bb5394-cdf9-474c-903a-4668c7645e62 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.988159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4bb5394-cdf9-474c-903a-4668c7645e62 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.988597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4bb5394-cdf9-474c-903a-4668c7645e62 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:18.989302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4bb5394-cdf9-474c-903a-4668c7645e62 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:18.989753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4bb5394-cdf9-474c-903a-4668c7645e62 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:18.990182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4bb5394-cdf9-474c-903a-4668c7645e62 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.009631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c051a7b3-31ed-4511-b1ce-23997cda139c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:19.010246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c051a7b3-31ed-4511-b1ce-23997cda139c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:19.017619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c051a7b3-31ed-4511-b1ce-23997cda139c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.018361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c051a7b3-31ed-4511-b1ce-23997cda139c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.019437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c051a7b3-31ed-4511-b1ce-23997cda139c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.020843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c051a7b3-31ed-4511-b1ce-23997cda139c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.021646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c051a7b3-31ed-4511-b1ce-23997cda139c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.022242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c051a7b3-31ed-4511-b1ce-23997cda139c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.196119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c4bb5394-cdf9-474c-903a-4668c7645e62 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:19.204959 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c4bb5394-cdf9-474c-903a-4668c7645e62 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1386 microversion: 2.1 time: 0.229035 Sep 08 12:39:19.205535 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 256/499] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:18 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1386 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:19.219239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c051a7b3-31ed-4511-b1ce-23997cda139c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:19.226486 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c051a7b3-31ed-4511-b1ce-23997cda139c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1319 microversion: 2.1 time: 0.221924 Sep 08 12:39:19.226719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e05447f7-eb5c-4d0d-8153-c2b8f2bf6388 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:19.227149 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 244/500] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:19 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1319 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:39:19.227357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e05447f7-eb5c-4d0d-8153-c2b8f2bf6388 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:19.234473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e05447f7-eb5c-4d0d-8153-c2b8f2bf6388 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.234969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e05447f7-eb5c-4d0d-8153-c2b8f2bf6388 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.235434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e05447f7-eb5c-4d0d-8153-c2b8f2bf6388 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.236140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e05447f7-eb5c-4d0d-8153-c2b8f2bf6388 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.236595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e05447f7-eb5c-4d0d-8153-c2b8f2bf6388 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.237016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e05447f7-eb5c-4d0d-8153-c2b8f2bf6388 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.272276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-134a4211-5090-4749-8029-a6a8355d9d5c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:19.272898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-134a4211-5090-4749-8029-a6a8355d9d5c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:19.279980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-134a4211-5090-4749-8029-a6a8355d9d5c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.280461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-134a4211-5090-4749-8029-a6a8355d9d5c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.280896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-134a4211-5090-4749-8029-a6a8355d9d5c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.281833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-134a4211-5090-4749-8029-a6a8355d9d5c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.282026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-134a4211-5090-4749-8029-a6a8355d9d5c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.282503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-134a4211-5090-4749-8029-a6a8355d9d5c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.390640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e05447f7-eb5c-4d0d-8153-c2b8f2bf6388 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:19.405631 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e05447f7-eb5c-4d0d-8153-c2b8f2bf6388 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 200 len: 1236 microversion: 2.1 time: 0.184146 Sep 08 12:39:19.406488 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 257/501] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:19 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 1236 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:19.425083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6bf20646-2ed1-42c2-922e-c973609240e0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:19.426116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6bf20646-2ed1-42c2-922e-c973609240e0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:19.439106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6bf20646-2ed1-42c2-922e-c973609240e0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.439923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6bf20646-2ed1-42c2-922e-c973609240e0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.442505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6bf20646-2ed1-42c2-922e-c973609240e0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.443819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6bf20646-2ed1-42c2-922e-c973609240e0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.445596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6bf20646-2ed1-42c2-922e-c973609240e0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.446190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6bf20646-2ed1-42c2-922e-c973609240e0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.540550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-134a4211-5090-4749-8029-a6a8355d9d5c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:19.551011 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-134a4211-5090-4749-8029-a6a8355d9d5c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1265 microversion: 2.1 time: 0.282655 Sep 08 12:39:19.558229 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 245/502] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:19 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:39:19.641496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-4c39f517-a58d-4218-b587-1b15b6dbf5d0 req-c2c379d9-e223-4a54-aacc-148d5cc8c29d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b057001-7456-4c05-8f42-f421455b3cdd", "name": "network-vif-plugged", "status": "completed", "tag": "cdc99e53-9228-4abb-811c-6f214aead362"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:19.651718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4c39f517-a58d-4218-b587-1b15b6dbf5d0 req-c2c379d9-e223-4a54-aacc-148d5cc8c29d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.652826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4c39f517-a58d-4218-b587-1b15b6dbf5d0 req-c2c379d9-e223-4a54-aacc-148d5cc8c29d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.653576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4c39f517-a58d-4218-b587-1b15b6dbf5d0 req-c2c379d9-e223-4a54-aacc-148d5cc8c29d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.669697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6bf20646-2ed1-42c2-922e-c973609240e0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:19.672967 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-4c39f517-a58d-4218-b587-1b15b6dbf5d0 req-c2c379d9-e223-4a54-aacc-148d5cc8c29d service nova] Creating event network-vif-plugged:cdc99e53-9228-4abb-811c-6f214aead362 for instance 7b057001-7456-4c05-8f42-f421455b3cdd on n-h1-852084-10 Sep 08 12:39:19.678531 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6bf20646-2ed1-42c2-922e-c973609240e0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1310 microversion: 2.1 time: 0.270215 Sep 08 12:39:19.680733 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-4c39f517-a58d-4218-b587-1b15b6dbf5d0 req-c2c379d9-e223-4a54-aacc-148d5cc8c29d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044084 Sep 08 12:39:19.681930 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 246/503] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:39:19.694020 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 258/504] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:19 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1310 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:19.756821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b630c53c-4df2-4693-a7e9-ab2c6ab01a45 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:19.757531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b630c53c-4df2-4693-a7e9-ab2c6ab01a45 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:19.764512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b630c53c-4df2-4693-a7e9-ab2c6ab01a45 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.765092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b630c53c-4df2-4693-a7e9-ab2c6ab01a45 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.765577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b630c53c-4df2-4693-a7e9-ab2c6ab01a45 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.766534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b630c53c-4df2-4693-a7e9-ab2c6ab01a45 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.766997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b630c53c-4df2-4693-a7e9-ab2c6ab01a45 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.767483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b630c53c-4df2-4693-a7e9-ab2c6ab01a45 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.974239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e55f01d2-5515-402e-b1c2-e77d5997c02b tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:19.975150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e55f01d2-5515-402e-b1c2-e77d5997c02b tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:19.982375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e55f01d2-5515-402e-b1c2-e77d5997c02b tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.983069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e55f01d2-5515-402e-b1c2-e77d5997c02b tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.983928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e55f01d2-5515-402e-b1c2-e77d5997c02b tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:19.986127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e55f01d2-5515-402e-b1c2-e77d5997c02b tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:19.987503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e55f01d2-5515-402e-b1c2-e77d5997c02b tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:19.988381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e55f01d2-5515-402e-b1c2-e77d5997c02b tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:20.194900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b630c53c-4df2-4693-a7e9-ab2c6ab01a45 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:20.203788 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b630c53c-4df2-4693-a7e9-ab2c6ab01a45 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.451381 Sep 08 12:39:20.204699 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 247/505] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:19 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1319 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:20.230832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c99b47b-efa8-487e-aa65-b07a7d0d3957 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:20.231676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5c99b47b-efa8-487e-aa65-b07a7d0d3957 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:20.256332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c99b47b-efa8-487e-aa65-b07a7d0d3957 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:20.256970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c99b47b-efa8-487e-aa65-b07a7d0d3957 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:20.257422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c99b47b-efa8-487e-aa65-b07a7d0d3957 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:20.258139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c99b47b-efa8-487e-aa65-b07a7d0d3957 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:20.258596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c99b47b-efa8-487e-aa65-b07a7d0d3957 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:20.259028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c99b47b-efa8-487e-aa65-b07a7d0d3957 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:20.905348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e55f01d2-5515-402e-b1c2-e77d5997c02b tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:20.911382 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e55f01d2-5515-402e-b1c2-e77d5997c02b tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1470 microversion: 2.1 time: 0.939231 Sep 08 12:39:20.927256 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 259/506] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:19 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1470 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:39:20.934226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8818564d-a150-4d17-829c-08d6ae5c3d4b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:20.936305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8818564d-a150-4d17-829c-08d6ae5c3d4b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:20.948105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8818564d-a150-4d17-829c-08d6ae5c3d4b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:20.948624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8818564d-a150-4d17-829c-08d6ae5c3d4b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:20.949141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8818564d-a150-4d17-829c-08d6ae5c3d4b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:20.950185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8818564d-a150-4d17-829c-08d6ae5c3d4b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:20.950834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8818564d-a150-4d17-829c-08d6ae5c3d4b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:20.951442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8818564d-a150-4d17-829c-08d6ae5c3d4b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:21.165028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5c99b47b-efa8-487e-aa65-b07a7d0d3957 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:21.178932 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c99b47b-efa8-487e-aa65-b07a7d0d3957 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1386 microversion: 2.1 time: 0.948842 Sep 08 12:39:21.180369 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 248/507] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:20 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1386 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:39:21.201725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2219c0f4-d4e6-4ae5-98b1-1f96ae9bdb18 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:21.202787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2219c0f4-d4e6-4ae5-98b1-1f96ae9bdb18 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:21.213159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2219c0f4-d4e6-4ae5-98b1-1f96ae9bdb18 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:21.214230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2219c0f4-d4e6-4ae5-98b1-1f96ae9bdb18 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:21.215889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2219c0f4-d4e6-4ae5-98b1-1f96ae9bdb18 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:21.216951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2219c0f4-d4e6-4ae5-98b1-1f96ae9bdb18 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:21.217664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2219c0f4-d4e6-4ae5-98b1-1f96ae9bdb18 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:21.218620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2219c0f4-d4e6-4ae5-98b1-1f96ae9bdb18 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:21.456723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8818564d-a150-4d17-829c-08d6ae5c3d4b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:21.470335 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8818564d-a150-4d17-829c-08d6ae5c3d4b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1319 microversion: 2.1 time: 0.547108 Sep 08 12:39:21.472241 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 260/508] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:20 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1319 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:21.485324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2219c0f4-d4e6-4ae5-98b1-1f96ae9bdb18 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:21.492892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a9621d52-6982-41b9-81ad-c26d16967d96 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:21.494341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a9621d52-6982-41b9-81ad-c26d16967d96 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:21.502103 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2219c0f4-d4e6-4ae5-98b1-1f96ae9bdb18 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 200 len: 1298 microversion: 2.1 time: 0.320063 Sep 08 12:39:21.506621 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 249/509] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:21 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 1298 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:21.508797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9621d52-6982-41b9-81ad-c26d16967d96 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:21.510034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9621d52-6982-41b9-81ad-c26d16967d96 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:21.510666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9621d52-6982-41b9-81ad-c26d16967d96 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:21.513557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9621d52-6982-41b9-81ad-c26d16967d96 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:21.514504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9621d52-6982-41b9-81ad-c26d16967d96 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:21.516756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9621d52-6982-41b9-81ad-c26d16967d96 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:21.523320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4a466e62-c0e5-4275-9fe0-e325151049c0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:21.523944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4a466e62-c0e5-4275-9fe0-e325151049c0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:21.533194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a466e62-c0e5-4275-9fe0-e325151049c0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:21.533681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a466e62-c0e5-4275-9fe0-e325151049c0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:21.534116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a466e62-c0e5-4275-9fe0-e325151049c0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:21.534900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a466e62-c0e5-4275-9fe0-e325151049c0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:21.540522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a466e62-c0e5-4275-9fe0-e325151049c0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:21.541235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a466e62-c0e5-4275-9fe0-e325151049c0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:21.747259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a9621d52-6982-41b9-81ad-c26d16967d96 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:21.762215 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a9621d52-6982-41b9-81ad-c26d16967d96 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1271 microversion: 2.1 time: 0.285495 Sep 08 12:39:21.763914 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 261/510] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:21 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1271 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:21.778815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b79478a6-edfa-4d17-b977-b3664e6389ea tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:21.788344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b79478a6-edfa-4d17-b977-b3664e6389ea tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:21.800415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b79478a6-edfa-4d17-b977-b3664e6389ea tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:21.800906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b79478a6-edfa-4d17-b977-b3664e6389ea tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:21.801395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b79478a6-edfa-4d17-b977-b3664e6389ea tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:21.802659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b79478a6-edfa-4d17-b977-b3664e6389ea tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:21.803452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b79478a6-edfa-4d17-b977-b3664e6389ea tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:21.804119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b79478a6-edfa-4d17-b977-b3664e6389ea tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:21.925536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4a466e62-c0e5-4275-9fe0-e325151049c0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:21.943812 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4a466e62-c0e5-4275-9fe0-e325151049c0 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1310 microversion: 2.1 time: 0.434109 Sep 08 12:39:21.949138 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 250/511] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:21 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1310 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:21.959764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4644d3ff-9006-4ede-b53d-e094248670a3 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:21.960708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4644d3ff-9006-4ede-b53d-e094248670a3 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:21.974978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4644d3ff-9006-4ede-b53d-e094248670a3 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:21.975782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4644d3ff-9006-4ede-b53d-e094248670a3 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:21.976436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4644d3ff-9006-4ede-b53d-e094248670a3 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:21.983417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4644d3ff-9006-4ede-b53d-e094248670a3 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:21.984093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4644d3ff-9006-4ede-b53d-e094248670a3 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:21.984761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4644d3ff-9006-4ede-b53d-e094248670a3 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:22.350493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b79478a6-edfa-4d17-b977-b3664e6389ea tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:22.360992 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b79478a6-edfa-4d17-b977-b3664e6389ea tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1319 microversion: 2.1 time: 0.594366 Sep 08 12:39:22.361954 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 262/512] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:21 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1319 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:22.385543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f4854b15-ac5e-4d63-bc30-b25cf0119dcb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:22.386656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f4854b15-ac5e-4d63-bc30-b25cf0119dcb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:22.416770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4854b15-ac5e-4d63-bc30-b25cf0119dcb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:22.418751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4854b15-ac5e-4d63-bc30-b25cf0119dcb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:22.420693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4854b15-ac5e-4d63-bc30-b25cf0119dcb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:22.424241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4854b15-ac5e-4d63-bc30-b25cf0119dcb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:22.426000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4854b15-ac5e-4d63-bc30-b25cf0119dcb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:22.426833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4854b15-ac5e-4d63-bc30-b25cf0119dcb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:22.483867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4644d3ff-9006-4ede-b53d-e094248670a3 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a7202e7b07584b88bc59e2454686fa63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28537d6c3d924d689b4d9a83c74c5a7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:22.517272 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4644d3ff-9006-4ede-b53d-e094248670a3 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 200 len: 1470 microversion: 2.1 time: 0.566584 Sep 08 12:39:22.518436 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 251/513] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:21 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 1470 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:22.532187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-61426915-6210-497d-9287-01bd04cafaea tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:22.533001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-61426915-6210-497d-9287-01bd04cafaea tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:22.541919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61426915-6210-497d-9287-01bd04cafaea tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:22.542608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61426915-6210-497d-9287-01bd04cafaea tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:22.551981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61426915-6210-497d-9287-01bd04cafaea tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:22.552996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61426915-6210-497d-9287-01bd04cafaea tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:22.553613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61426915-6210-497d-9287-01bd04cafaea tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:22.554405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61426915-6210-497d-9287-01bd04cafaea tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:23.121986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f4854b15-ac5e-4d63-bc30-b25cf0119dcb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:23.135840 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f4854b15-ac5e-4d63-bc30-b25cf0119dcb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1386 microversion: 2.1 time: 0.770068 Sep 08 12:39:23.136182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-61426915-6210-497d-9287-01bd04cafaea tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:23.148382 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-61426915-6210-497d-9287-01bd04cafaea tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1319 microversion: 2.1 time: 0.627608 Sep 08 12:39:23.150914 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 252/514] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:22 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1319 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:23.152602 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 263/515] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:22 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1386 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:23.159530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ddfd2c9f-28ad-4487-a0a9-ed172abcf061 req-262fdd64-2ac1-4ec6-9dc9-57408becc604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9cbc9df-d3c4-4ebd-9538-4d6da2305b88", "name": "network-vif-deleted", "tag": "e29a856f-a916-456f-a000-39775ffcabdb"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:23.174524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ddfd2c9f-28ad-4487-a0a9-ed172abcf061 req-262fdd64-2ac1-4ec6-9dc9-57408becc604 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:23.175370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ddfd2c9f-28ad-4487-a0a9-ed172abcf061 req-262fdd64-2ac1-4ec6-9dc9-57408becc604 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:23.176404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ddfd2c9f-28ad-4487-a0a9-ed172abcf061 req-262fdd64-2ac1-4ec6-9dc9-57408becc604 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:23.183325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-170009ca-c071-4b30-a64b-de13b2ad3845 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:23.187526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-170009ca-c071-4b30-a64b-de13b2ad3845 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:23.194420 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ddfd2c9f-28ad-4487-a0a9-ed172abcf061 req-262fdd64-2ac1-4ec6-9dc9-57408becc604 service nova] Creating event network-vif-deleted:e29a856f-a916-456f-a000-39775ffcabdb for instance b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 on n-h1-852084-10 Sep 08 12:39:23.202170 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ddfd2c9f-28ad-4487-a0a9-ed172abcf061 req-262fdd64-2ac1-4ec6-9dc9-57408becc604 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047747 Sep 08 12:39:23.203058 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 253/516] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:23.209856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-170009ca-c071-4b30-a64b-de13b2ad3845 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:23.212765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-170009ca-c071-4b30-a64b-de13b2ad3845 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:23.215869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-170009ca-c071-4b30-a64b-de13b2ad3845 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:23.216450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-731d2b29-f63a-4672-8ee7-a2b5840fef8c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:23.217410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-731d2b29-f63a-4672-8ee7-a2b5840fef8c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:23.219618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-170009ca-c071-4b30-a64b-de13b2ad3845 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:23.221728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-170009ca-c071-4b30-a64b-de13b2ad3845 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:23.224217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-170009ca-c071-4b30-a64b-de13b2ad3845 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:23.226338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-731d2b29-f63a-4672-8ee7-a2b5840fef8c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:23.227067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-731d2b29-f63a-4672-8ee7-a2b5840fef8c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:23.227707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-731d2b29-f63a-4672-8ee7-a2b5840fef8c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:23.229586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-731d2b29-f63a-4672-8ee7-a2b5840fef8c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:23.230379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-731d2b29-f63a-4672-8ee7-a2b5840fef8c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:23.231768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-731d2b29-f63a-4672-8ee7-a2b5840fef8c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:23.937777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-170009ca-c071-4b30-a64b-de13b2ad3845 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:23.948529 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-170009ca-c071-4b30-a64b-de13b2ad3845 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 200 len: 1366 microversion: 2.1 time: 0.794701 Sep 08 12:39:23.951277 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 264/517] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:23 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 1366 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:23.970454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-731d2b29-f63a-4672-8ee7-a2b5840fef8c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:23.972278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-51e2afb8-0e45-4d7b-a2a8-b88b98f62f71 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:23.973470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-51e2afb8-0e45-4d7b-a2a8-b88b98f62f71 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:23.981561 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-731d2b29-f63a-4672-8ee7-a2b5840fef8c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1313 microversion: 2.1 time: 0.775305 Sep 08 12:39:23.991159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51e2afb8-0e45-4d7b-a2a8-b88b98f62f71 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:23.992118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51e2afb8-0e45-4d7b-a2a8-b88b98f62f71 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:23.992922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51e2afb8-0e45-4d7b-a2a8-b88b98f62f71 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:23.994145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51e2afb8-0e45-4d7b-a2a8-b88b98f62f71 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:23.997724 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 254/518] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:23 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1313 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:23.999818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51e2afb8-0e45-4d7b-a2a8-b88b98f62f71 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:24.000275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51e2afb8-0e45-4d7b-a2a8-b88b98f62f71 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:24.005267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b94b45ae-da9f-420d-ac6a-8c4804282b26 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:24.006249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b94b45ae-da9f-420d-ac6a-8c4804282b26 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:24.015890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b94b45ae-da9f-420d-ac6a-8c4804282b26 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:24.017841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b94b45ae-da9f-420d-ac6a-8c4804282b26 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:24.018483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b94b45ae-da9f-420d-ac6a-8c4804282b26 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:24.019813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b94b45ae-da9f-420d-ac6a-8c4804282b26 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:24.020419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b94b45ae-da9f-420d-ac6a-8c4804282b26 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:24.021284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b94b45ae-da9f-420d-ac6a-8c4804282b26 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:24.442998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b94b45ae-da9f-420d-ac6a-8c4804282b26 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:24.452370 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b94b45ae-da9f-420d-ac6a-8c4804282b26 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1468 microversion: 2.1 time: 0.453472 Sep 08 12:39:24.454112 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 255/519] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:23 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1468 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:24.461060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2ad59b4b-ae86-4756-a4c8-2264206377c0 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:24.462002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2ad59b4b-ae86-4756-a4c8-2264206377c0 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] [instance: b9cbc9df-d3c4-4ebd-9538-4d6da2305b88] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:24.466286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-51e2afb8-0e45-4d7b-a2a8-b88b98f62f71 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:24.471889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ad59b4b-ae86-4756-a4c8-2264206377c0 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:24.472669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ad59b4b-ae86-4756-a4c8-2264206377c0 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:24.473326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ad59b4b-ae86-4756-a4c8-2264206377c0 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:24.474844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ad59b4b-ae86-4756-a4c8-2264206377c0 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:24.475253 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-51e2afb8-0e45-4d7b-a2a8-b88b98f62f71 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1310 microversion: 2.1 time: 0.524666 Sep 08 12:39:24.475457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ad59b4b-ae86-4756-a4c8-2264206377c0 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:24.475855 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 265/520] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:23 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1310 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:24.476340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ad59b4b-ae86-4756-a4c8-2264206377c0 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:24.483064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f9c536c8-6202-4420-9712-bb121b3255ba req-20008840-8866-40c2-a155-e886913d5055 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0c4563-36a9-47a0-b7f9-c1b03ca5164e", "name": "network-vif-plugged", "status": "completed", "tag": "2e3928d3-2252-4d62-8307-217623c31b4e"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:24.492102 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-2ad59b4b-ae86-4756-a4c8-2264206377c0 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] HTTP exception thrown: Instance b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 could not be found. Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2ad59b4b-ae86-4756-a4c8-2264206377c0 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Request method failure captured: Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 HTTP/1.1 Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJV0m8E6HPMTXUgKZhwizh23MoFDVrkU-YsWF8B7ulkBi3dzbP-7ZA2tVlrrOA8GEiUIuSpst9JlX_si0NNEEfywbAQ0bQfFb2Pb0n6eFZ6L0kPOp0a8LY_0EKhS3sgmZA3SPpHgdrRvM-jRwTJ7HrT421QK3-o-yKRKYtQFuZ_s2U Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 28537d6c3d924d689b4d9a83c74c5a7c Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TenantUsagesTestJSON-373097912 Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:39:24.494204 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:39:24.495484 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_28537d6c3d924d689b4d9a83c74c5a7c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/28537d6c3d924d689b4d9a83c74c5a7c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/28537d6c3d924d689b4d9a83c74c5a7c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/28537d6c3d924d689b4d9a83c74c5a7c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:24.495484 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TenantUsagesTestJSON-373097912 Sep 08 12:39:24.495484 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 28537d6c3d924d689b4d9a83c74c5a7c Sep 08 12:39:24.495484 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TenantUsagesTestJSON-373097912 Sep 08 12:39:24.495484 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TenantUsagesTestJSON-373097912-project Sep 08 12:39:24.495484 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:39:24.495484 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:39:24.495484 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: a7202e7b07584b88bc59e2454686fa63 Sep 08 12:39:24.495484 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TenantUsagesTestJSON-373097912-project Sep 08 12:39:24.495484 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:39:24.495484 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 could not be found. Sep 08 12:39:24.495484 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'b9cbc9df-d3c4-4ebd-9538-4d6da2305b88'} Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 could not be found. Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:24.496859 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 could not be found. Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 could not be found. Sep 08 12:39:24.497982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:24.499036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f9c536c8-6202-4420-9712-bb121b3255ba req-20008840-8866-40c2-a155-e886913d5055 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:24.499036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f9c536c8-6202-4420-9712-bb121b3255ba req-20008840-8866-40c2-a155-e886913d5055 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:24.499036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f9c536c8-6202-4420-9712-bb121b3255ba req-20008840-8866-40c2-a155-e886913d5055 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:24.501916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2ad59b4b-ae86-4756-a4c8-2264206377c0 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] Returning 404 to user: Instance b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:24.503084 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2ad59b4b-ae86-4756-a4c8-2264206377c0 tempest-TenantUsagesTestJSON-373097912 tempest-TenantUsagesTestJSON-373097912-project] 10.222.0.78 "GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88" status: 404 len: 111 microversion: 2.1 time: 0.047239 Sep 08 12:39:24.505364 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 256/521] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:24 2022] GET /compute/v2.1/servers/b9cbc9df-d3c4-4ebd-9538-4d6da2305b88 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:24.513388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-397316f6-6cb9-44d5-9f1d-d94422a88a7a tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:24.514099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-397316f6-6cb9-44d5-9f1d-d94422a88a7a tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:24.516002 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f9c536c8-6202-4420-9712-bb121b3255ba req-20008840-8866-40c2-a155-e886913d5055 service nova] Creating event network-vif-plugged:2e3928d3-2252-4d62-8307-217623c31b4e for instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e on n-h2-852084-10 Sep 08 12:39:24.520874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-397316f6-6cb9-44d5-9f1d-d94422a88a7a tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:24.522188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-397316f6-6cb9-44d5-9f1d-d94422a88a7a tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:24.522671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-397316f6-6cb9-44d5-9f1d-d94422a88a7a tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:24.523506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-397316f6-6cb9-44d5-9f1d-d94422a88a7a tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:24.524116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-397316f6-6cb9-44d5-9f1d-d94422a88a7a tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:24.524251 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f9c536c8-6202-4420-9712-bb121b3255ba req-20008840-8866-40c2-a155-e886913d5055 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046113 Sep 08 12:39:24.524635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-397316f6-6cb9-44d5-9f1d-d94422a88a7a tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:24.528695 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 266/522] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:24.536590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3c70f2ae-a149-4d40-bbf0-6faa1617d913 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:24.537559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3c70f2ae-a149-4d40-bbf0-6faa1617d913 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:24.546780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c70f2ae-a149-4d40-bbf0-6faa1617d913 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:24.547415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c70f2ae-a149-4d40-bbf0-6faa1617d913 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:24.548463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c70f2ae-a149-4d40-bbf0-6faa1617d913 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:24.549364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c70f2ae-a149-4d40-bbf0-6faa1617d913 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:24.550144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c70f2ae-a149-4d40-bbf0-6faa1617d913 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:24.550459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c70f2ae-a149-4d40-bbf0-6faa1617d913 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:25.083645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-397316f6-6cb9-44d5-9f1d-d94422a88a7a tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:25.093039 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-397316f6-6cb9-44d5-9f1d-d94422a88a7a tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1386 microversion: 2.1 time: 0.586136 Sep 08 12:39:25.098092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3c70f2ae-a149-4d40-bbf0-6faa1617d913 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:25.108237 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 257/523] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:24 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1386 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:25.119210 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3c70f2ae-a149-4d40-bbf0-6faa1617d913 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1319 microversion: 2.1 time: 0.586700 Sep 08 12:39:25.121506 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 267/524] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:24 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1319 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:25.141045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d1b060ee-7705-4caf-bb77-845098189a5b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:25.141693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d1b060ee-7705-4caf-bb77-845098189a5b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 953e5b9e-8c65-4892-a558-ec7764a7b037] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:25.150196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1b060ee-7705-4caf-bb77-845098189a5b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:25.150777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1b060ee-7705-4caf-bb77-845098189a5b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:25.151833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1b060ee-7705-4caf-bb77-845098189a5b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:25.152687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1b060ee-7705-4caf-bb77-845098189a5b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:25.153421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1b060ee-7705-4caf-bb77-845098189a5b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:25.154116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1b060ee-7705-4caf-bb77-845098189a5b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:25.389398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d1b060ee-7705-4caf-bb77-845098189a5b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:25.403182 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d1b060ee-7705-4caf-bb77-845098189a5b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/953e5b9e-8c65-4892-a558-ec7764a7b037" status: 200 len: 1469 microversion: 2.1 time: 0.278664 Sep 08 12:39:25.404851 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 268/525] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:25 2022] GET /compute/v2.1/servers/953e5b9e-8c65-4892-a558-ec7764a7b037 => generated 1469 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:25.409910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-48e0e999-7306-4e14-b3a1-70846f869eb2 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:25.410805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-48e0e999-7306-4e14-b3a1-70846f869eb2 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:25.419308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48e0e999-7306-4e14-b3a1-70846f869eb2 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:25.421248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48e0e999-7306-4e14-b3a1-70846f869eb2 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:25.422559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48e0e999-7306-4e14-b3a1-70846f869eb2 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:25.424032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48e0e999-7306-4e14-b3a1-70846f869eb2 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:25.425829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48e0e999-7306-4e14-b3a1-70846f869eb2 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:25.426557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48e0e999-7306-4e14-b3a1-70846f869eb2 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:25.483633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-656913568", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:25.550787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:39:25.810339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-48e0e999-7306-4e14-b3a1-70846f869eb2 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:25.820161 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-48e0e999-7306-4e14-b3a1-70846f869eb2 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 200 len: 1366 microversion: 2.1 time: 0.414021 Sep 08 12:39:25.821573 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 269/526] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:25 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:25.847137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8a62dce4-1a14-40b5-bb41-d2c814bbde15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:25.848097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8a62dce4-1a14-40b5-bb41-d2c814bbde15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:25.856574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a62dce4-1a14-40b5-bb41-d2c814bbde15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:25.862848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a62dce4-1a14-40b5-bb41-d2c814bbde15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:25.864357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a62dce4-1a14-40b5-bb41-d2c814bbde15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:25.865142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a62dce4-1a14-40b5-bb41-d2c814bbde15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:25.865611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a62dce4-1a14-40b5-bb41-d2c814bbde15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:25.866038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a62dce4-1a14-40b5-bb41-d2c814bbde15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.071745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:39:26.072168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:39:26.072639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:39:26.074661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:39:26.074661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:39:26.087140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=33 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:26.089918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.090976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.091688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.092645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.093289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.093975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.102076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a62dce4-1a14-40b5-bb41-d2c814bbde15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:26.112407 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8a62dce4-1a14-40b5-bb41-d2c814bbde15 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1313 microversion: 2.1 time: 0.289398 Sep 08 12:39:26.113072 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 270/527] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:25 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:26.125698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-50ba8363-4325-43cf-86e9-04b49eb3fedb req-424ad65a-b9c6-4a8a-8e4f-db646c6c842e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940b9bb1-c58b-464b-a472-03fb6acbe36b", "tag": "79a1be76-7c37-4bba-b881-2e981148c298"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:26.139856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-50ba8363-4325-43cf-86e9-04b49eb3fedb req-424ad65a-b9c6-4a8a-8e4f-db646c6c842e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.140684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-50ba8363-4325-43cf-86e9-04b49eb3fedb req-424ad65a-b9c6-4a8a-8e4f-db646c6c842e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.142036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-50ba8363-4325-43cf-86e9-04b49eb3fedb req-424ad65a-b9c6-4a8a-8e4f-db646c6c842e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.144475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Getting quotas for project 1ecf62bb5fa54e498d4e6561791aa11b. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:39:26.150416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Getting quotas for user 569e4e340357494692da48aabd8d2e16 and project 1ecf62bb5fa54e498d4e6561791aa11b. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:39:26.157158 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-50ba8363-4325-43cf-86e9-04b49eb3fedb req-424ad65a-b9c6-4a8a-8e4f-db646c6c842e service nova] Creating event network-changed:79a1be76-7c37-4bba-b881-2e981148c298 for instance 940b9bb1-c58b-464b-a472-03fb6acbe36b on n-h2-852084-10 Sep 08 12:39:26.162447 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-50ba8363-4325-43cf-86e9-04b49eb3fedb req-424ad65a-b9c6-4a8a-8e4f-db646c6c842e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047379 Sep 08 12:39:26.163617 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 271/528] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:26.164178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:39:26.166852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:39:26.169863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:26.175879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:26.177087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Searching by: {'reservation_id': 'r-ashr7h18', 'deleted': False, 'project_id': '5be40b5c51b9493d85c199b11a32726e'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:39:26.182936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.184194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.184818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.185725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.186330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.186997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.230893 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8d63d576-b8fc-4fc7-ad4a-e9b6c0e83bbc tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.121513 Sep 08 12:39:26.232231 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 258/529] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:39:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1124 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:39:26.237400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-493db5de-5315-4323-a538-817c7dc78461 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:26.238541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-493db5de-5315-4323-a538-817c7dc78461 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:26.247633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-493db5de-5315-4323-a538-817c7dc78461 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.248130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-493db5de-5315-4323-a538-817c7dc78461 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.248575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-493db5de-5315-4323-a538-817c7dc78461 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.249903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-493db5de-5315-4323-a538-817c7dc78461 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.250608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-493db5de-5315-4323-a538-817c7dc78461 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.251206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-493db5de-5315-4323-a538-817c7dc78461 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.308864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:26.336747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:39:26.439666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:26.448011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.448177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.448540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.678013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-493db5de-5315-4323-a538-817c7dc78461 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:26.682056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:26.695111 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-493db5de-5315-4323-a538-817c7dc78461 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1310 microversion: 2.1 time: 0.461166 Sep 08 12:39:26.696721 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 259/530] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:26 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1310 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:26.703753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b2dfea70-5730-415f-bc68-bef1c5a3b085 req-eaf67dff-4047-4f15-805c-6930ec2c3fbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca9ba42-71fb-4d52-a831-4c5e4ac02c81", "tag": "0d33a618-1a67-43bf-9f68-aca849e7e550"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:26.717662 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ee1b6142-11c4-454a-a535-64e86171d469 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?reservation_id=r-ashr7h18" status: 200 len: 2930 microversion: 2.1 time: 0.552409 Sep 08 12:39:26.718877 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 272/531] 10.222.0.78 () {58 vars in 1197 bytes} [Thu Sep 8 12:39:26 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ashr7h18 => generated 2930 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:26.719545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b2dfea70-5730-415f-bc68-bef1c5a3b085 req-eaf67dff-4047-4f15-805c-6930ec2c3fbd service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.720600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b2dfea70-5730-415f-bc68-bef1c5a3b085 req-eaf67dff-4047-4f15-805c-6930ec2c3fbd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.721196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b2dfea70-5730-415f-bc68-bef1c5a3b085 req-eaf67dff-4047-4f15-805c-6930ec2c3fbd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.724696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d459806-d9f8-446d-98be-1655ca2e2822 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:26.725673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1d459806-d9f8-446d-98be-1655ca2e2822 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:26.731977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:26.737716 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b2dfea70-5730-415f-bc68-bef1c5a3b085 req-eaf67dff-4047-4f15-805c-6930ec2c3fbd service nova] Creating event network-changed:0d33a618-1a67-43bf-9f68-aca849e7e550 for instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 on n-h2-852084-10 Sep 08 12:39:26.744921 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b2dfea70-5730-415f-bc68-bef1c5a3b085 req-eaf67dff-4047-4f15-805c-6930ec2c3fbd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046412 Sep 08 12:39:26.745625 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 260/532] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:26.747960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d459806-d9f8-446d-98be-1655ca2e2822 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.748475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d459806-d9f8-446d-98be-1655ca2e2822 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.749273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d459806-d9f8-446d-98be-1655ca2e2822 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.751648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d459806-d9f8-446d-98be-1655ca2e2822 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.752630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d459806-d9f8-446d-98be-1655ca2e2822 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.753753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0fe14b36-5e5e-4fe1-81fd-2692ce41d858 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:26.754328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d459806-d9f8-446d-98be-1655ca2e2822 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.754475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0fe14b36-5e5e-4fe1-81fd-2692ce41d858 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:26.763016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fe14b36-5e5e-4fe1-81fd-2692ce41d858 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.763539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fe14b36-5e5e-4fe1-81fd-2692ce41d858 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.763963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fe14b36-5e5e-4fe1-81fd-2692ce41d858 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:26.764667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fe14b36-5e5e-4fe1-81fd-2692ce41d858 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:26.765118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fe14b36-5e5e-4fe1-81fd-2692ce41d858 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:26.765542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fe14b36-5e5e-4fe1-81fd-2692ce41d858 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:27.167412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1d459806-d9f8-446d-98be-1655ca2e2822 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:27.180885 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1d459806-d9f8-446d-98be-1655ca2e2822 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1386 microversion: 2.1 time: 0.460272 Sep 08 12:39:27.183261 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 273/533] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:26 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1386 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:27.191508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1adef6ab-358d-47ee-96eb-6ec658f2a8b9 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:27.192537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1adef6ab-358d-47ee-96eb-6ec658f2a8b9 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:27.201474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0fe14b36-5e5e-4fe1-81fd-2692ce41d858 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:27.203886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1adef6ab-358d-47ee-96eb-6ec658f2a8b9 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:27.205652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1adef6ab-358d-47ee-96eb-6ec658f2a8b9 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:27.207371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1adef6ab-358d-47ee-96eb-6ec658f2a8b9 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:27.208581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1adef6ab-358d-47ee-96eb-6ec658f2a8b9 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:27.210046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1adef6ab-358d-47ee-96eb-6ec658f2a8b9 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:27.210667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1adef6ab-358d-47ee-96eb-6ec658f2a8b9 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:27.217652 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0fe14b36-5e5e-4fe1-81fd-2692ce41d858 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1319 microversion: 2.1 time: 0.469479 Sep 08 12:39:27.218663 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 261/534] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:26 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:27.236719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-df4353f2-0d4b-4bde-b297-45994a2e23ae req-e7dadf12-ebbb-4d3b-97d0-cab3f39af7d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7", "name": "network-vif-plugged", "status": "completed", "tag": "ce9810f0-c796-4ff9-a520-b7a552ca6832"}, {"server_uuid": "c952db45-70f9-47b4-9061-490992a347be", "name": "network-vif-plugged", "status": "completed", "tag": "b98800b6-5185-43d6-b8ad-064fb1654065"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:27.258749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-df4353f2-0d4b-4bde-b297-45994a2e23ae req-e7dadf12-ebbb-4d3b-97d0-cab3f39af7d5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:27.259661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-df4353f2-0d4b-4bde-b297-45994a2e23ae req-e7dadf12-ebbb-4d3b-97d0-cab3f39af7d5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:27.260275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-df4353f2-0d4b-4bde-b297-45994a2e23ae req-e7dadf12-ebbb-4d3b-97d0-cab3f39af7d5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:27.279013 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-df4353f2-0d4b-4bde-b297-45994a2e23ae req-e7dadf12-ebbb-4d3b-97d0-cab3f39af7d5 service nova] Creating event network-vif-plugged:ce9810f0-c796-4ff9-a520-b7a552ca6832 for instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 on n-h1-852084-10 Sep 08 12:39:27.279517 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-df4353f2-0d4b-4bde-b297-45994a2e23ae req-e7dadf12-ebbb-4d3b-97d0-cab3f39af7d5 service nova] Creating event network-vif-plugged:b98800b6-5185-43d6-b8ad-064fb1654065 for instance c952db45-70f9-47b4-9061-490992a347be on n-h2-852084-10 Sep 08 12:39:27.294200 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-df4353f2-0d4b-4bde-b297-45994a2e23ae req-e7dadf12-ebbb-4d3b-97d0-cab3f39af7d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.073452 Sep 08 12:39:27.294864 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 262/535] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:27.302881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c43953e6-5c09-4fe7-9f49-c80522bd8012 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:27.361547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.compute.server_groups [None req-c43953e6-5c09-4fe7-9f49-c80522bd8012 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Querying cell eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) for 2 instances {{(pid=128970) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 12:39:27.361547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c43953e6-5c09-4fe7-9f49-c80522bd8012 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:27.362210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c43953e6-5c09-4fe7-9f49-c80522bd8012 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:27.362668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c43953e6-5c09-4fe7-9f49-c80522bd8012 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:27.367045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1adef6ab-358d-47ee-96eb-6ec658f2a8b9 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:27.379301 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1adef6ab-358d-47ee-96eb-6ec658f2a8b9 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 200 len: 1270 microversion: 2.1 time: 0.190098 Sep 08 12:39:27.380616 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 274/536] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:27 2022] GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 1270 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:27.392988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-841df40d-17ee-4478-8a20-29854e788010 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:27.393623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-841df40d-17ee-4478-8a20-29854e788010 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:27.400895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-841df40d-17ee-4478-8a20-29854e788010 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:27.401681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-841df40d-17ee-4478-8a20-29854e788010 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:27.402976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-841df40d-17ee-4478-8a20-29854e788010 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:27.404564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-841df40d-17ee-4478-8a20-29854e788010 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:27.405535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-841df40d-17ee-4478-8a20-29854e788010 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:27.406145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-841df40d-17ee-4478-8a20-29854e788010 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:27.435011 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c43953e6-5c09-4fe7-9f49-c80522bd8012 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/a3630ffd-9610-4627-8612-0d59a3877639" status: 200 len: 270 microversion: 2.1 time: 0.138658 Sep 08 12:39:27.438105 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 263/537] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:39:27 2022] GET /compute/v2.1/os-server-groups/a3630ffd-9610-4627-8612-0d59a3877639 => generated 270 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:27.446646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-88a022bb-3445-40cd-854a-3cc0b3d7cb45 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:27.449935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-88a022bb-3445-40cd-854a-3cc0b3d7cb45 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:27.460569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88a022bb-3445-40cd-854a-3cc0b3d7cb45 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:27.461167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88a022bb-3445-40cd-854a-3cc0b3d7cb45 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:27.461683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88a022bb-3445-40cd-854a-3cc0b3d7cb45 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:27.462603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88a022bb-3445-40cd-854a-3cc0b3d7cb45 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:27.463184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88a022bb-3445-40cd-854a-3cc0b3d7cb45 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:27.463712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88a022bb-3445-40cd-854a-3cc0b3d7cb45 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:27.756044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-88a022bb-3445-40cd-854a-3cc0b3d7cb45 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:27.762478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-841df40d-17ee-4478-8a20-29854e788010 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:27.774996 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-88a022bb-3445-40cd-854a-3cc0b3d7cb45 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1313 microversion: 2.1 time: 0.335706 Sep 08 12:39:27.776894 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 264/538] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:27 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:27.781709 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-841df40d-17ee-4478-8a20-29854e788010 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 200 len: 1366 microversion: 2.1 time: 0.397824 Sep 08 12:39:27.783218 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 275/539] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:27 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 1366 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:27.794076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d39683e0-9e15-4d4f-b808-191edb567282 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:27.795036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d39683e0-9e15-4d4f-b808-191edb567282 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:27.797637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-69e4c3b8-9f14-4ba4-9e51-d9fd9be0c453 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:27.798271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-69e4c3b8-9f14-4ba4-9e51-d9fd9be0c453 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:27.811668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d39683e0-9e15-4d4f-b808-191edb567282 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:27.811668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d39683e0-9e15-4d4f-b808-191edb567282 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:27.812455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d39683e0-9e15-4d4f-b808-191edb567282 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:27.812690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69e4c3b8-9f14-4ba4-9e51-d9fd9be0c453 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:27.813730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69e4c3b8-9f14-4ba4-9e51-d9fd9be0c453 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:27.813932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d39683e0-9e15-4d4f-b808-191edb567282 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:27.814166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69e4c3b8-9f14-4ba4-9e51-d9fd9be0c453 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:27.815056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d39683e0-9e15-4d4f-b808-191edb567282 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:27.815750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69e4c3b8-9f14-4ba4-9e51-d9fd9be0c453 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:27.815938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d39683e0-9e15-4d4f-b808-191edb567282 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:27.816330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69e4c3b8-9f14-4ba4-9e51-d9fd9be0c453 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:27.817462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69e4c3b8-9f14-4ba4-9e51-d9fd9be0c453 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:28.048740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d39683e0-9e15-4d4f-b808-191edb567282 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:28.062474 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-69e4c3b8-9f14-4ba4-9e51-d9fd9be0c453 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 200 len: 1621 microversion: 2.1 time: 0.283193 Sep 08 12:39:28.075288 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 265/540] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:27 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 1621 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:28.075721 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d39683e0-9e15-4d4f-b808-191edb567282 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1310 microversion: 2.1 time: 0.283465 Sep 08 12:39:28.075721 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 276/541] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:27 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1310 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:28.104373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9331e446-0a93-4531-b91a-2422ab4f532e tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:28.105049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9331e446-0a93-4531-b91a-2422ab4f532e tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] [instance: 953e5b9e-8c65-4892-a558-ec7764a7b037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:28.115577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9331e446-0a93-4531-b91a-2422ab4f532e tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:28.115933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9331e446-0a93-4531-b91a-2422ab4f532e tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:28.116470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9331e446-0a93-4531-b91a-2422ab4f532e tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:28.117329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9331e446-0a93-4531-b91a-2422ab4f532e tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:28.118181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9331e446-0a93-4531-b91a-2422ab4f532e tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:28.118789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9331e446-0a93-4531-b91a-2422ab4f532e tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:28.208632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3fe7875a-0926-4342-91f9-c58e0ea65503 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:28.210070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3fe7875a-0926-4342-91f9-c58e0ea65503 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:28.228080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3fe7875a-0926-4342-91f9-c58e0ea65503 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:28.229546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3fe7875a-0926-4342-91f9-c58e0ea65503 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:28.230105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3fe7875a-0926-4342-91f9-c58e0ea65503 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:28.231511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3fe7875a-0926-4342-91f9-c58e0ea65503 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:28.232323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3fe7875a-0926-4342-91f9-c58e0ea65503 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:28.232833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3fe7875a-0926-4342-91f9-c58e0ea65503 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:28.706144 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9331e446-0a93-4531-b91a-2422ab4f532e tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/953e5b9e-8c65-4892-a558-ec7764a7b037" status: 200 len: 1622 microversion: 2.1 time: 0.607696 Sep 08 12:39:28.742484 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 266/542] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:28 2022] GET /compute/v2.1/servers/953e5b9e-8c65-4892-a558-ec7764a7b037 => generated 1622 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:28.760483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-767a963f-13d3-46de-8462-a372909da6b2 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:28.760483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-767a963f-13d3-46de-8462-a372909da6b2 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:28.785480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-767a963f-13d3-46de-8462-a372909da6b2 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:28.790237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-767a963f-13d3-46de-8462-a372909da6b2 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:28.791004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-767a963f-13d3-46de-8462-a372909da6b2 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:28.794645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-767a963f-13d3-46de-8462-a372909da6b2 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:28.795688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-767a963f-13d3-46de-8462-a372909da6b2 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:28.796787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-767a963f-13d3-46de-8462-a372909da6b2 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:29.271486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3fe7875a-0926-4342-91f9-c58e0ea65503 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:29.302488 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3fe7875a-0926-4342-91f9-c58e0ea65503 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1585 microversion: 2.1 time: 1.098000 Sep 08 12:39:29.312197 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 277/543] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:28 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1585 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:29.328944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a53b189c-b711-4fd1-9785-49bafcb63d23 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:29.329504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a53b189c-b711-4fd1-9785-49bafcb63d23 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:29.349660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a53b189c-b711-4fd1-9785-49bafcb63d23 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:29.350191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a53b189c-b711-4fd1-9785-49bafcb63d23 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:29.350719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a53b189c-b711-4fd1-9785-49bafcb63d23 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:29.353216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a53b189c-b711-4fd1-9785-49bafcb63d23 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:29.354253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a53b189c-b711-4fd1-9785-49bafcb63d23 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:29.355044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a53b189c-b711-4fd1-9785-49bafcb63d23 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:29.512147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a53b189c-b711-4fd1-9785-49bafcb63d23 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:29.534860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-767a963f-13d3-46de-8462-a372909da6b2 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:29.537597 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a53b189c-b711-4fd1-9785-49bafcb63d23 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 200 len: 1276 microversion: 2.1 time: 0.222077 Sep 08 12:39:29.549588 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 278/544] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:29 2022] GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:29.566270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e78918f5-1497-4c4c-86a1-460fdbc79f4b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:29.566965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e78918f5-1497-4c4c-86a1-460fdbc79f4b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:29.570433 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-767a963f-13d3-46de-8462-a372909da6b2 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1319 microversion: 2.1 time: 0.824755 Sep 08 12:39:29.574557 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 267/545] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:28 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1319 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:29.581790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-305089b1-1f31-459e-90bc-abf119160a25 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:29.582321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-305089b1-1f31-459e-90bc-abf119160a25 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:29.582757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e78918f5-1497-4c4c-86a1-460fdbc79f4b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:29.583571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e78918f5-1497-4c4c-86a1-460fdbc79f4b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:29.584228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e78918f5-1497-4c4c-86a1-460fdbc79f4b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:29.585309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e78918f5-1497-4c4c-86a1-460fdbc79f4b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:29.585791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e78918f5-1497-4c4c-86a1-460fdbc79f4b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:29.586225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e78918f5-1497-4c4c-86a1-460fdbc79f4b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:29.598339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-305089b1-1f31-459e-90bc-abf119160a25 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:29.599459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-305089b1-1f31-459e-90bc-abf119160a25 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:29.602691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-305089b1-1f31-459e-90bc-abf119160a25 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:29.604780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-305089b1-1f31-459e-90bc-abf119160a25 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:29.606132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-305089b1-1f31-459e-90bc-abf119160a25 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:29.606821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-305089b1-1f31-459e-90bc-abf119160a25 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:30.342812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e78918f5-1497-4c4c-86a1-460fdbc79f4b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:30.357402 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e78918f5-1497-4c4c-86a1-460fdbc79f4b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1313 microversion: 2.1 time: 0.804478 Sep 08 12:39:30.359168 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 279/546] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:29 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1313 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:30.373414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-472996994", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "970bb882-462b-4430-a3ae-e76024ca8892"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:30.378886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-305089b1-1f31-459e-90bc-abf119160a25 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:30.396771 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-305089b1-1f31-459e-90bc-abf119160a25 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 200 len: 1366 microversion: 2.1 time: 0.820856 Sep 08 12:39:30.397599 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 268/547] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:29 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 1366 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:30.415262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b3183265-85ca-49d0-bfb8-c10978979879 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:30.423597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b3183265-85ca-49d0-bfb8-c10978979879 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:30.436574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3183265-85ca-49d0-bfb8-c10978979879 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:30.437840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3183265-85ca-49d0-bfb8-c10978979879 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:30.438696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3183265-85ca-49d0-bfb8-c10978979879 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:30.439555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3183265-85ca-49d0-bfb8-c10978979879 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:30.440013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3183265-85ca-49d0-bfb8-c10978979879 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:30.440438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3183265-85ca-49d0-bfb8-c10978979879 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:30.482409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:39:31.118251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b3183265-85ca-49d0-bfb8-c10978979879 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:31.163759 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b3183265-85ca-49d0-bfb8-c10978979879 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1492 microversion: 2.1 time: 0.762650 Sep 08 12:39:31.168823 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 269/548] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:30 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1492 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:31.205171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-754f6f77-382a-4a2a-a70b-72c5b88e358d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:31.207341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-754f6f77-382a-4a2a-a70b-72c5b88e358d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:31.229193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-754f6f77-382a-4a2a-a70b-72c5b88e358d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:31.229769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-754f6f77-382a-4a2a-a70b-72c5b88e358d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:31.230398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-754f6f77-382a-4a2a-a70b-72c5b88e358d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:31.231285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-754f6f77-382a-4a2a-a70b-72c5b88e358d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:31.232060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-754f6f77-382a-4a2a-a70b-72c5b88e358d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:31.232694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-754f6f77-382a-4a2a-a70b-72c5b88e358d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:31.562012 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-754f6f77-382a-4a2a-a70b-72c5b88e358d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.389920 Sep 08 12:39:31.563821 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 270/549] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 12:39:31 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e/os-interface => generated 285 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:31.576715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e5d05fb2-f910-4ec9-bd4f-6cddc03b704e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:31.578390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e5d05fb2-f910-4ec9-bd4f-6cddc03b704e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:31.599477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5d05fb2-f910-4ec9-bd4f-6cddc03b704e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:31.600463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5d05fb2-f910-4ec9-bd4f-6cddc03b704e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:31.601204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5d05fb2-f910-4ec9-bd4f-6cddc03b704e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:31.602162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5d05fb2-f910-4ec9-bd4f-6cddc03b704e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:31.602916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5d05fb2-f910-4ec9-bd4f-6cddc03b704e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:31.603553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5d05fb2-f910-4ec9-bd4f-6cddc03b704e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:32.043713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e5d05fb2-f910-4ec9-bd4f-6cddc03b704e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:32.060791 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e5d05fb2-f910-4ec9-bd4f-6cddc03b704e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 200 len: 1318 microversion: 2.1 time: 0.495566 Sep 08 12:39:32.075279 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 271/550] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:31 2022] GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 1318 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:32.075279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-71d1d5a9-1a76-47ab-9f11-d42319f960fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:32.075279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-71d1d5a9-1a76-47ab-9f11-d42319f960fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:32.077299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:39:32.078074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:39:32.079037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:39:32.079783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:39:32.081353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:39:32.086356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71d1d5a9-1a76-47ab-9f11-d42319f960fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:32.086958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71d1d5a9-1a76-47ab-9f11-d42319f960fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:32.089917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71d1d5a9-1a76-47ab-9f11-d42319f960fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:32.094520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71d1d5a9-1a76-47ab-9f11-d42319f960fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:32.095422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71d1d5a9-1a76-47ab-9f11-d42319f960fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:32.099555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71d1d5a9-1a76-47ab-9f11-d42319f960fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:32.113085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:32.115522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:32.116356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:32.119007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:32.119588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:32.121823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:32.172486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:39:32.187473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:39:32.215315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:39:32.222112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:39:32.369624 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-df95e19d-6624-4c1d-a022-587c4b040e50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.004379 Sep 08 12:39:32.377943 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 280/551] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:39:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:39:32.900896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad557eb3-9dc2-448d-87eb-89984dece6b9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:32.901540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad557eb3-9dc2-448d-87eb-89984dece6b9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:32.912798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad557eb3-9dc2-448d-87eb-89984dece6b9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:32.913299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad557eb3-9dc2-448d-87eb-89984dece6b9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:32.913732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad557eb3-9dc2-448d-87eb-89984dece6b9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:32.920202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad557eb3-9dc2-448d-87eb-89984dece6b9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:32.921301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad557eb3-9dc2-448d-87eb-89984dece6b9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:32.922248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad557eb3-9dc2-448d-87eb-89984dece6b9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:33.526231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-71d1d5a9-1a76-47ab-9f11-d42319f960fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:33.535576 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-71d1d5a9-1a76-47ab-9f11-d42319f960fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1468 microversion: 2.1 time: 1.472494 Sep 08 12:39:33.547764 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 272/552] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:32 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1468 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:33.562305 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad557eb3-9dc2-448d-87eb-89984dece6b9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1645 microversion: 2.1 time: 1.182186 Sep 08 12:39:33.569997 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 281/553] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:32 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1645 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:33.578741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d46bdd1e-b5f2-4a43-babb-ba7ead652653 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:33.580257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d46bdd1e-b5f2-4a43-babb-ba7ead652653 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:33.589321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-34d5adfe-7f65-4694-8435-a495acab4def req-f16b1078-bb61-4830-93f8-c1bdac143bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940b9bb1-c58b-464b-a472-03fb6acbe36b", "name": "network-vif-plugged", "status": "completed", "tag": "79a1be76-7c37-4bba-b881-2e981148c298"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:33.591068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d46bdd1e-b5f2-4a43-babb-ba7ead652653 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:33.592384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d46bdd1e-b5f2-4a43-babb-ba7ead652653 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:33.593148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d46bdd1e-b5f2-4a43-babb-ba7ead652653 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:33.595977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d46bdd1e-b5f2-4a43-babb-ba7ead652653 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:33.597038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d46bdd1e-b5f2-4a43-babb-ba7ead652653 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:33.598545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d46bdd1e-b5f2-4a43-babb-ba7ead652653 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:33.618482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-34d5adfe-7f65-4694-8435-a495acab4def req-f16b1078-bb61-4830-93f8-c1bdac143bd1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:33.624805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-34d5adfe-7f65-4694-8435-a495acab4def req-f16b1078-bb61-4830-93f8-c1bdac143bd1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:33.625565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-34d5adfe-7f65-4694-8435-a495acab4def req-f16b1078-bb61-4830-93f8-c1bdac143bd1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:33.669241 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-34d5adfe-7f65-4694-8435-a495acab4def req-f16b1078-bb61-4830-93f8-c1bdac143bd1 service nova] Creating event network-vif-plugged:79a1be76-7c37-4bba-b881-2e981148c298 for instance 940b9bb1-c58b-464b-a472-03fb6acbe36b on n-h2-852084-10 Sep 08 12:39:33.676915 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-34d5adfe-7f65-4694-8435-a495acab4def req-f16b1078-bb61-4830-93f8-c1bdac143bd1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103441 Sep 08 12:39:33.678228 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 282/554] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:33.720012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2dea08a7-9b8c-4fa0-88bf-dc8bcd986bb4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:33.721384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2dea08a7-9b8c-4fa0-88bf-dc8bcd986bb4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:33.732840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2dea08a7-9b8c-4fa0-88bf-dc8bcd986bb4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:33.733625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2dea08a7-9b8c-4fa0-88bf-dc8bcd986bb4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:33.734407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2dea08a7-9b8c-4fa0-88bf-dc8bcd986bb4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:33.748267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2dea08a7-9b8c-4fa0-88bf-dc8bcd986bb4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:33.749051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2dea08a7-9b8c-4fa0-88bf-dc8bcd986bb4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:33.749774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2dea08a7-9b8c-4fa0-88bf-dc8bcd986bb4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:34.023985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d46bdd1e-b5f2-4a43-babb-ba7ead652653 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:34.040605 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d46bdd1e-b5f2-4a43-babb-ba7ead652653 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1313 microversion: 2.1 time: 0.490483 Sep 08 12:39:34.044502 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 273/555] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:33 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1313 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:34.066309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8386a9d-14a7-4a21-b5bf-c1389806b2eb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:34.068770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b8386a9d-14a7-4a21-b5bf-c1389806b2eb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:34.092805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8386a9d-14a7-4a21-b5bf-c1389806b2eb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:34.095414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8386a9d-14a7-4a21-b5bf-c1389806b2eb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:34.098325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8386a9d-14a7-4a21-b5bf-c1389806b2eb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:34.105922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8386a9d-14a7-4a21-b5bf-c1389806b2eb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:34.108911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8386a9d-14a7-4a21-b5bf-c1389806b2eb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:34.112311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8386a9d-14a7-4a21-b5bf-c1389806b2eb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:34.306773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b8386a9d-14a7-4a21-b5bf-c1389806b2eb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:34.321749 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8386a9d-14a7-4a21-b5bf-c1389806b2eb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 200 len: 1268 microversion: 2.1 time: 0.274881 Sep 08 12:39:34.329278 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 274/556] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:34 2022] GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 1268 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:34.332929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2dea08a7-9b8c-4fa0-88bf-dc8bcd986bb4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:34.346133 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2dea08a7-9b8c-4fa0-88bf-dc8bcd986bb4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 200 len: 1366 microversion: 2.1 time: 0.666150 Sep 08 12:39:34.346726 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 283/557] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:33 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 1366 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:34.348148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a1e00caf-2725-4ee1-88a6-42d205cf3386 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:34.353141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a1e00caf-2725-4ee1-88a6-42d205cf3386 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:34.380354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1e00caf-2725-4ee1-88a6-42d205cf3386 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:34.380940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1e00caf-2725-4ee1-88a6-42d205cf3386 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:34.381352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1e00caf-2725-4ee1-88a6-42d205cf3386 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:34.382103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1e00caf-2725-4ee1-88a6-42d205cf3386 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:34.387262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-20772136-06ed-48e3-ae41-49db90174bf3 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:34.390146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1e00caf-2725-4ee1-88a6-42d205cf3386 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:34.390615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1e00caf-2725-4ee1-88a6-42d205cf3386 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:34.392625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-20772136-06ed-48e3-ae41-49db90174bf3 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:34.412509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20772136-06ed-48e3-ae41-49db90174bf3 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:34.413012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20772136-06ed-48e3-ae41-49db90174bf3 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:34.416716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20772136-06ed-48e3-ae41-49db90174bf3 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:34.418221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20772136-06ed-48e3-ae41-49db90174bf3 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:34.420526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20772136-06ed-48e3-ae41-49db90174bf3 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:34.423350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20772136-06ed-48e3-ae41-49db90174bf3 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:34.680591 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-20772136-06ed-48e3-ae41-49db90174bf3 tempest-DeleteServersAdminTestJSON-830325776 tempest-DeleteServersAdminTestJSON-830325776-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7/action" status: 202 len: 0 microversion: 2.1 time: 0.316121 Sep 08 12:39:34.701392 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 284/558] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:39:34 2022] POST /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:39:34.720831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f8a1b8c0-3187-4cbc-a11e-f25dd947533d tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:34.721777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f8a1b8c0-3187-4cbc-a11e-f25dd947533d tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:34.730118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8a1b8c0-3187-4cbc-a11e-f25dd947533d tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:34.731815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8a1b8c0-3187-4cbc-a11e-f25dd947533d tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:34.733238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8a1b8c0-3187-4cbc-a11e-f25dd947533d tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:34.734579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8a1b8c0-3187-4cbc-a11e-f25dd947533d tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:34.735268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8a1b8c0-3187-4cbc-a11e-f25dd947533d tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:34.736026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8a1b8c0-3187-4cbc-a11e-f25dd947533d tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:34.816467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a1e00caf-2725-4ee1-88a6-42d205cf3386 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:34.838853 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a1e00caf-2725-4ee1-88a6-42d205cf3386 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 200 len: 1318 microversion: 2.1 time: 0.508086 Sep 08 12:39:34.863793 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 275/559] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:34 2022] GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 1318 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:34.885892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-72b00a13-93c3-4567-9de3-0343efe136fa tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:34.887353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-72b00a13-93c3-4567-9de3-0343efe136fa tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:34.896796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b00a13-93c3-4567-9de3-0343efe136fa tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:34.897635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b00a13-93c3-4567-9de3-0343efe136fa tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:34.898332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b00a13-93c3-4567-9de3-0343efe136fa tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:34.899396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b00a13-93c3-4567-9de3-0343efe136fa tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:34.900464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b00a13-93c3-4567-9de3-0343efe136fa tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:34.901367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b00a13-93c3-4567-9de3-0343efe136fa tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:35.168491 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f8a1b8c0-3187-4cbc-a11e-f25dd947533d tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1645 microversion: 2.1 time: 0.465541 Sep 08 12:39:35.175776 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 285/560] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:34 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1645 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:35.189170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7b458b8b-8344-4ac4-8cf0-54ffe036f55a req-4e21e434-4597-4645-a6b1-b1cd961af839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0c4563-36a9-47a0-b7f9-c1b03ca5164e", "tag": "2e3928d3-2252-4d62-8307-217623c31b4e"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:35.220727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7b458b8b-8344-4ac4-8cf0-54ffe036f55a req-4e21e434-4597-4645-a6b1-b1cd961af839 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:35.226930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7b458b8b-8344-4ac4-8cf0-54ffe036f55a req-4e21e434-4597-4645-a6b1-b1cd961af839 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:35.227712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7b458b8b-8344-4ac4-8cf0-54ffe036f55a req-4e21e434-4597-4645-a6b1-b1cd961af839 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:35.252394 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7b458b8b-8344-4ac4-8cf0-54ffe036f55a req-4e21e434-4597-4645-a6b1-b1cd961af839 service nova] Creating event network-changed:2e3928d3-2252-4d62-8307-217623c31b4e for instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e on n-h2-852084-10 Sep 08 12:39:35.265696 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7b458b8b-8344-4ac4-8cf0-54ffe036f55a req-4e21e434-4597-4645-a6b1-b1cd961af839 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088482 Sep 08 12:39:35.267265 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 286/561] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:35.274952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-45defd36-8152-4193-be11-26d9ece67db0 req-bc688e42-7b7a-4688-b1f3-cf7bdd162269 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28fb1363-4800-4df7-ae28-28d51b708679", "tag": "2bdbe47d-9180-4a45-919a-1c7278873487"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:35.286809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-45defd36-8152-4193-be11-26d9ece67db0 req-bc688e42-7b7a-4688-b1f3-cf7bdd162269 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:35.287911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-45defd36-8152-4193-be11-26d9ece67db0 req-bc688e42-7b7a-4688-b1f3-cf7bdd162269 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:35.288525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-45defd36-8152-4193-be11-26d9ece67db0 req-bc688e42-7b7a-4688-b1f3-cf7bdd162269 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:35.313021 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-45defd36-8152-4193-be11-26d9ece67db0 req-bc688e42-7b7a-4688-b1f3-cf7bdd162269 service nova] Creating event network-changed:2bdbe47d-9180-4a45-919a-1c7278873487 for instance 28fb1363-4800-4df7-ae28-28d51b708679 on n-h1-852084-10 Sep 08 12:39:35.326945 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-45defd36-8152-4193-be11-26d9ece67db0 req-bc688e42-7b7a-4688-b1f3-cf7bdd162269 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057795 Sep 08 12:39:35.328694 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 287/562] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:35.334995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:35.336381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:35.348165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:35.349707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:35.350619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:35.352508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:35.353322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:35.354690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:35.412790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:35.439201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:35.440352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:35.441278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lazy-loading 'fault' on Instance uuid fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:39:35.641463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-72b00a13-93c3-4567-9de3-0343efe136fa tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:35.657240 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-72b00a13-93c3-4567-9de3-0343efe136fa tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1585 microversion: 2.1 time: 0.791171 Sep 08 12:39:35.658695 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 276/563] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:34 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1585 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:35.671364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28ce1041-1cd2-4546-a8b3-07a5720943aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:35.673791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-28ce1041-1cd2-4546-a8b3-07a5720943aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:35.716853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28ce1041-1cd2-4546-a8b3-07a5720943aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:35.721218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28ce1041-1cd2-4546-a8b3-07a5720943aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:35.727107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28ce1041-1cd2-4546-a8b3-07a5720943aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:35.728545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28ce1041-1cd2-4546-a8b3-07a5720943aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:35.729341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28ce1041-1cd2-4546-a8b3-07a5720943aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:35.730045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28ce1041-1cd2-4546-a8b3-07a5720943aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:35.971704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:35.988819 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5020117c-deea-4874-8690-5ce61149370b tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1451 microversion: 2.1 time: 0.658456 Sep 08 12:39:35.991882 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 288/564] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:35 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1451 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:36.004652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3113e2e3-b1e6-4ee2-91a2-33ec7023c059 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:36.046323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3113e2e3-b1e6-4ee2-91a2-33ec7023c059 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:36.046938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3113e2e3-b1e6-4ee2-91a2-33ec7023c059 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:36.047709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3113e2e3-b1e6-4ee2-91a2-33ec7023c059 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:36.048655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3113e2e3-b1e6-4ee2-91a2-33ec7023c059 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:36.049441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3113e2e3-b1e6-4ee2-91a2-33ec7023c059 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:36.050647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3113e2e3-b1e6-4ee2-91a2-33ec7023c059 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:36.119370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:36.121801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:36.160417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=5 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:36.164230 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3113e2e3-b1e6-4ee2-91a2-33ec7023c059 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.170003 Sep 08 12:39:36.175531 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 289/565] 10.222.0.78 () {58 vars in 1176 bytes} [Thu Sep 8 12:39:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:36.183575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0403e397-a738-4c3a-bdc7-a9a2af7b85e5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:36.184634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0403e397-a738-4c3a-bdc7-a9a2af7b85e5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:36.206085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0403e397-a738-4c3a-bdc7-a9a2af7b85e5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:36.206968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0403e397-a738-4c3a-bdc7-a9a2af7b85e5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:36.207703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0403e397-a738-4c3a-bdc7-a9a2af7b85e5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:36.209931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-28ce1041-1cd2-4546-a8b3-07a5720943aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:36.210474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0403e397-a738-4c3a-bdc7-a9a2af7b85e5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:36.211454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0403e397-a738-4c3a-bdc7-a9a2af7b85e5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:36.212409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0403e397-a738-4c3a-bdc7-a9a2af7b85e5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:36.220181 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-28ce1041-1cd2-4546-a8b3-07a5720943aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1313 microversion: 2.1 time: 0.558193 Sep 08 12:39:36.229668 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 277/566] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:35 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1313 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:36.267205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9d976af5-f849-4ab8-8745-41f84a29b700 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:36.284469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9d976af5-f849-4ab8-8745-41f84a29b700 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:36.299461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d976af5-f849-4ab8-8745-41f84a29b700 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:36.299974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d976af5-f849-4ab8-8745-41f84a29b700 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:36.300428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d976af5-f849-4ab8-8745-41f84a29b700 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:36.301145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d976af5-f849-4ab8-8745-41f84a29b700 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:36.307858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d976af5-f849-4ab8-8745-41f84a29b700 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:36.308432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d976af5-f849-4ab8-8745-41f84a29b700 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:36.342443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:36.388473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0403e397-a738-4c3a-bdc7-a9a2af7b85e5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:36.403932 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0403e397-a738-4c3a-bdc7-a9a2af7b85e5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 200 len: 1274 microversion: 2.1 time: 0.232086 Sep 08 12:39:36.405209 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 290/567] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:36 2022] GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:36.419609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-299f1173-ca2c-4e6f-ab0b-6f1e21e1cc62 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:36.420647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-299f1173-ca2c-4e6f-ab0b-6f1e21e1cc62 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:36.430341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-299f1173-ca2c-4e6f-ab0b-6f1e21e1cc62 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:36.431269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-299f1173-ca2c-4e6f-ab0b-6f1e21e1cc62 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:36.432350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-299f1173-ca2c-4e6f-ab0b-6f1e21e1cc62 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:36.433373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-299f1173-ca2c-4e6f-ab0b-6f1e21e1cc62 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:36.434520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-299f1173-ca2c-4e6f-ab0b-6f1e21e1cc62 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:36.435128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-299f1173-ca2c-4e6f-ab0b-6f1e21e1cc62 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:37.034025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d976af5-f849-4ab8-8745-41f84a29b700 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:37.050265 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9d976af5-f849-4ab8-8745-41f84a29b700 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 200 len: 1557 microversion: 2.1 time: 0.804730 Sep 08 12:39:37.068735 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 278/568] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:36 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 1557 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:37.080095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-299f1173-ca2c-4e6f-ab0b-6f1e21e1cc62 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:37.084826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a47a3f72-9865-41f4-a4f6-04e52cc03ddc req-2b0818c5-f64b-474b-810c-1f6627ddc4e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9ba42-71fb-4d52-a831-4c5e4ac02c81", "name": "network-vif-plugged", "status": "completed", "tag": "0d33a618-1a67-43bf-9f68-aca849e7e550"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:37.111452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a47a3f72-9865-41f4-a4f6-04e52cc03ddc req-2b0818c5-f64b-474b-810c-1f6627ddc4e1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:37.117176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a47a3f72-9865-41f4-a4f6-04e52cc03ddc req-2b0818c5-f64b-474b-810c-1f6627ddc4e1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:37.120171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a47a3f72-9865-41f4-a4f6-04e52cc03ddc req-2b0818c5-f64b-474b-810c-1f6627ddc4e1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:37.131792 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-299f1173-ca2c-4e6f-ab0b-6f1e21e1cc62 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 200 len: 1318 microversion: 2.1 time: 0.724168 Sep 08 12:39:37.134921 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 291/569] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:36 2022] GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 1318 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:37.141195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8f6c6a07-2147-4c97-9be1-49b3d2c2f1d8 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:37.143603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8f6c6a07-2147-4c97-9be1-49b3d2c2f1d8 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:37.154430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f6c6a07-2147-4c97-9be1-49b3d2c2f1d8 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:37.156775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f6c6a07-2147-4c97-9be1-49b3d2c2f1d8 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:37.157593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f6c6a07-2147-4c97-9be1-49b3d2c2f1d8 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:37.158729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f6c6a07-2147-4c97-9be1-49b3d2c2f1d8 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:37.160343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f6c6a07-2147-4c97-9be1-49b3d2c2f1d8 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:37.164401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f6c6a07-2147-4c97-9be1-49b3d2c2f1d8 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:37.184337 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a47a3f72-9865-41f4-a4f6-04e52cc03ddc req-2b0818c5-f64b-474b-810c-1f6627ddc4e1 service nova] Creating event network-vif-plugged:0d33a618-1a67-43bf-9f68-aca849e7e550 for instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 on n-h2-852084-10 Sep 08 12:39:37.211695 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a47a3f72-9865-41f4-a4f6-04e52cc03ddc req-2b0818c5-f64b-474b-810c-1f6627ddc4e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137515 Sep 08 12:39:37.219796 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 279/570] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:37.243202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-147d7a18-c57f-4df5-87a8-7a5ce747d7cc tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852084-10", "block_migration": true, "disk_over_commit": false}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:37.248246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-147d7a18-c57f-4df5-87a8-7a5ce747d7cc tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:37.272995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8f6c6a07-2147-4c97-9be1-49b3d2c2f1d8 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:39:37.288744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-147d7a18-c57f-4df5-87a8-7a5ce747d7cc tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:37.291669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-147d7a18-c57f-4df5-87a8-7a5ce747d7cc tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:37.292558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-147d7a18-c57f-4df5-87a8-7a5ce747d7cc tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:37.294451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-147d7a18-c57f-4df5-87a8-7a5ce747d7cc tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:37.295392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-147d7a18-c57f-4df5-87a8-7a5ce747d7cc tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:37.296154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-147d7a18-c57f-4df5-87a8-7a5ce747d7cc tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:37.539811 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8f6c6a07-2147-4c97-9be1-49b3d2c2f1d8 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 204 len: 0 microversion: 2.1 time: 0.402281 Sep 08 12:39:37.542095 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 292/571] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:39:37 2022] DELETE /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:39:37.567015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a1a2d5e6-6f5c-48ee-8164-1f8aad51de3b tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:37.570000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a1a2d5e6-6f5c-48ee-8164-1f8aad51de3b tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:37.595864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1a2d5e6-6f5c-48ee-8164-1f8aad51de3b tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:37.597952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1a2d5e6-6f5c-48ee-8164-1f8aad51de3b tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:37.603062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1a2d5e6-6f5c-48ee-8164-1f8aad51de3b tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:37.607140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1a2d5e6-6f5c-48ee-8164-1f8aad51de3b tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:37.607858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1a2d5e6-6f5c-48ee-8164-1f8aad51de3b tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:37.608481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1a2d5e6-6f5c-48ee-8164-1f8aad51de3b tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:37.617835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-147d7a18-c57f-4df5-87a8-7a5ce747d7cc tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lazy-loading 'flavor' on Instance uuid c952db45-70f9-47b4-9061-490992a347be {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:39:37.738302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-147d7a18-c57f-4df5-87a8-7a5ce747d7cc tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: c952db45-70f9-47b4-9061-490992a347be] Going to try to live migrate instance to n-h1-852084-10 {{(pid=128970) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 12:39:38.000913 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a1a2d5e6-6f5c-48ee-8164-1f8aad51de3b tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.455032 Sep 08 12:39:38.001665 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 293/572] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 12:39:37 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-interface => generated 285 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:38.103944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ac399ace-ed3b-453c-a1dd-1fcaf7f0bc07 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Action: 'create', calling method: .version_select at 0x7fdb3b47c4c0>, body: {"pool": null} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:42.169525 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-147d7a18-c57f-4df5-87a8-7a5ce747d7cc tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be/action" status: 202 len: 0 microversion: 2.1 time: 4.945846 Sep 08 12:39:42.177429 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 280/573] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:39:37 2022] POST /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be/action => generated 0 bytes in 4957 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:39:42.188276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c23e9225-248f-4e9b-8728-f3327563073b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:42.189953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c23e9225-248f-4e9b-8728-f3327563073b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:42.202081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:42.206144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c23e9225-248f-4e9b-8728-f3327563073b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:42.207504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c23e9225-248f-4e9b-8728-f3327563073b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:42.207644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=28 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:42.209091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c23e9225-248f-4e9b-8728-f3327563073b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:42.212235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c23e9225-248f-4e9b-8728-f3327563073b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:42.213123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c23e9225-248f-4e9b-8728-f3327563073b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:42.215923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c23e9225-248f-4e9b-8728-f3327563073b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:42.867902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c23e9225-248f-4e9b-8728-f3327563073b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:42.895412 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c23e9225-248f-4e9b-8728-f3327563073b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1463 microversion: 2.1 time: 0.715174 Sep 08 12:39:42.898308 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 281/574] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:42 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1463 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:42.909489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-66b1b5f8-c81a-4757-9eaf-bc4a85e654b8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:42.911470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-66b1b5f8-c81a-4757-9eaf-bc4a85e654b8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:42.926439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66b1b5f8-c81a-4757-9eaf-bc4a85e654b8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:42.927805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66b1b5f8-c81a-4757-9eaf-bc4a85e654b8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:42.928951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66b1b5f8-c81a-4757-9eaf-bc4a85e654b8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:42.930645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66b1b5f8-c81a-4757-9eaf-bc4a85e654b8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:42.932044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66b1b5f8-c81a-4757-9eaf-bc4a85e654b8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:42.933620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66b1b5f8-c81a-4757-9eaf-bc4a85e654b8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:42.949987 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ac399ace-ed3b-453c-a1dd-1fcaf7f0bc07 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.944641 Sep 08 12:39:42.965939 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 294/575] 10.222.0.78 () {60 vars in 1170 bytes} [Thu Sep 8 12:39:38 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:42.971522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:42.973551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:42.987050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:42.987882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:42.988411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:42.989578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:42.990140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:42.990674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:43.034009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:43.034492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:43.035136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:43.035855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lazy-loading 'fault' on Instance uuid fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:39:43.141881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c646b5da6995488db0ce3f405741b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4172137f3aa447edafafae76e41ef499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:43.157470 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8fc54bed-1a58-40a4-926b-8991449b10fa tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 200 len: 1309 microversion: 2.1 time: 0.195239 Sep 08 12:39:43.158371 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 295/576] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:42 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:43.167274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a005aeae-daa5-4d6f-8ed5-8d485e01e23b tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:43.171956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a005aeae-daa5-4d6f-8ed5-8d485e01e23b tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:43.186280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a005aeae-daa5-4d6f-8ed5-8d485e01e23b tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:43.187781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a005aeae-daa5-4d6f-8ed5-8d485e01e23b tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:43.188677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a005aeae-daa5-4d6f-8ed5-8d485e01e23b tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:43.194775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a005aeae-daa5-4d6f-8ed5-8d485e01e23b tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:43.195580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a005aeae-daa5-4d6f-8ed5-8d485e01e23b tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:43.196020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a005aeae-daa5-4d6f-8ed5-8d485e01e23b tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:43.221239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-66b1b5f8-c81a-4757-9eaf-bc4a85e654b8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:43.230642 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-66b1b5f8-c81a-4757-9eaf-bc4a85e654b8 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 200 len: 1316 microversion: 2.1 time: 0.329979 Sep 08 12:39:43.234600 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 282/577] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:42 2022] GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 1316 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:43.244684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-157bda1f-9eab-4607-ae06-9757e31f99cd req-ebecd5e1-76c0-49b4-8650-ed58c09bd6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61574c60-0e9f-46f3-924f-ca5e7e74f04f", "tag": "23905870-8446-4b2e-9ac6-e2812fed241f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:43.267746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-157bda1f-9eab-4607-ae06-9757e31f99cd req-ebecd5e1-76c0-49b4-8650-ed58c09bd6f4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:43.268515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-157bda1f-9eab-4607-ae06-9757e31f99cd req-ebecd5e1-76c0-49b4-8650-ed58c09bd6f4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:43.269233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-157bda1f-9eab-4607-ae06-9757e31f99cd req-ebecd5e1-76c0-49b4-8650-ed58c09bd6f4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:43.291482 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-157bda1f-9eab-4607-ae06-9757e31f99cd req-ebecd5e1-76c0-49b4-8650-ed58c09bd6f4 service nova] Creating event network-changed:23905870-8446-4b2e-9ac6-e2812fed241f for instance 61574c60-0e9f-46f3-924f-ca5e7e74f04f on n-h1-852084-10 Sep 08 12:39:43.309794 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-157bda1f-9eab-4607-ae06-9757e31f99cd req-ebecd5e1-76c0-49b4-8650-ed58c09bd6f4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070228 Sep 08 12:39:43.325997 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 283/578] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:43.339144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f1b20727-afb0-4bc4-898e-ef842746af4b req-cc507ec0-adfb-42f6-bbc0-036f3a328a44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "940b9bb1-c58b-464b-a472-03fb6acbe36b", "tag": "79a1be76-7c37-4bba-b881-2e981148c298"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:43.358361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f1b20727-afb0-4bc4-898e-ef842746af4b req-cc507ec0-adfb-42f6-bbc0-036f3a328a44 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:43.359479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f1b20727-afb0-4bc4-898e-ef842746af4b req-cc507ec0-adfb-42f6-bbc0-036f3a328a44 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:43.360432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f1b20727-afb0-4bc4-898e-ef842746af4b req-cc507ec0-adfb-42f6-bbc0-036f3a328a44 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:43.378175 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f1b20727-afb0-4bc4-898e-ef842746af4b req-cc507ec0-adfb-42f6-bbc0-036f3a328a44 service nova] Creating event network-changed:79a1be76-7c37-4bba-b881-2e981148c298 for instance 940b9bb1-c58b-464b-a472-03fb6acbe36b on n-h2-852084-10 Sep 08 12:39:43.384685 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f1b20727-afb0-4bc4-898e-ef842746af4b req-cc507ec0-adfb-42f6-bbc0-036f3a328a44 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053776 Sep 08 12:39:43.385826 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 284/579] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:43.392183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e116d2e-4c9a-41e9-b081-85db28e69a7a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:43.393101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e116d2e-4c9a-41e9-b081-85db28e69a7a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:43.400650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e116d2e-4c9a-41e9-b081-85db28e69a7a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:43.401379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e116d2e-4c9a-41e9-b081-85db28e69a7a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:43.402106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e116d2e-4c9a-41e9-b081-85db28e69a7a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:43.403036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e116d2e-4c9a-41e9-b081-85db28e69a7a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:43.403735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e116d2e-4c9a-41e9-b081-85db28e69a7a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:43.404376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e116d2e-4c9a-41e9-b081-85db28e69a7a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:44.127263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a005aeae-daa5-4d6f-8ed5-8d485e01e23b tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:44.135452 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a005aeae-daa5-4d6f-8ed5-8d485e01e23b tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 200 len: 1318 microversion: 2.1 time: 0.975697 Sep 08 12:39:44.152958 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 296/580] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:43 2022] GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 1318 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:44.160022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:44.162647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:44.170915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:44.171812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:44.172639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:44.173665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:44.174368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:44.175052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:44.343198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:44.352050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Old instance type m1.heat2, new instance type m1.heat {{(pid=128971) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 12:39:44.359010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e116d2e-4c9a-41e9-b081-85db28e69a7a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:44.361853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:39:44.362367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:39:44.362929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:39:44.363467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:39:44.363951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:39:44.377621 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e116d2e-4c9a-41e9-b081-85db28e69a7a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1502 microversion: 2.1 time: 0.989143 Sep 08 12:39:44.379421 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 285/581] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:43 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1502 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:44.387722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-db0bfade-3e39-40e0-b3ae-63133d5725db tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Calling method '.version_select at 0x7fdb373630d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:44.506306 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8259f614-0491-4746-aa16-ced5fe8d77bb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "POST /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81/action" status: 202 len: 0 microversion: 2.1 time: 0.351906 Sep 08 12:39:44.506932 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 297/582] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:39:44 2022] POST /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:39:44.512079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-70aeedd3-ba85-41e1-99e4-00b80c17ec1c req-a669733f-2d26-4777-9056-7bb44455fc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28fb1363-4800-4df7-ae28-28d51b708679", "name": "network-vif-plugged", "status": "completed", "tag": "2bdbe47d-9180-4a45-919a-1c7278873487"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:44.527988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-70aeedd3-ba85-41e1-99e4-00b80c17ec1c req-a669733f-2d26-4777-9056-7bb44455fc4b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:44.528403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-70aeedd3-ba85-41e1-99e4-00b80c17ec1c req-a669733f-2d26-4777-9056-7bb44455fc4b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:44.528812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-70aeedd3-ba85-41e1-99e4-00b80c17ec1c req-a669733f-2d26-4777-9056-7bb44455fc4b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:44.541763 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-70aeedd3-ba85-41e1-99e4-00b80c17ec1c req-a669733f-2d26-4777-9056-7bb44455fc4b service nova] Creating event network-vif-plugged:2bdbe47d-9180-4a45-919a-1c7278873487 for instance 28fb1363-4800-4df7-ae28-28d51b708679 on n-h1-852084-10 Sep 08 12:39:44.548310 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-70aeedd3-ba85-41e1-99e4-00b80c17ec1c req-a669733f-2d26-4777-9056-7bb44455fc4b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040085 Sep 08 12:39:44.549262 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 298/583] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:44.556142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-857c2f30-995a-4e9e-ae92-5bdca0a785a4 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:44.557420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-857c2f30-995a-4e9e-ae92-5bdca0a785a4 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:44.565315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-857c2f30-995a-4e9e-ae92-5bdca0a785a4 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:44.566078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-857c2f30-995a-4e9e-ae92-5bdca0a785a4 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:44.566742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-857c2f30-995a-4e9e-ae92-5bdca0a785a4 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:44.567721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-857c2f30-995a-4e9e-ae92-5bdca0a785a4 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:44.568368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-857c2f30-995a-4e9e-ae92-5bdca0a785a4 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:44.568953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-857c2f30-995a-4e9e-ae92-5bdca0a785a4 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:44.840570 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-857c2f30-995a-4e9e-ae92-5bdca0a785a4 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] HTTP exception thrown: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-857c2f30-995a-4e9e-ae92-5bdca0a785a4 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Request method failure captured: Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 HTTP/1.1 Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeJCqVeKon7h6IuUBxhnZCj8060E5V9lurntRdSb6qYNfIlvhdOMd5iZTvF5HH1xvH8yopZtDqx7NWfRYUk3A3uobzMfZ3vZT_P0rnAHEoGR6_bo_LVmuYrTCEtMkOBqihDop3Fu50ue_h29MkI-tVRMcF_C0kJwrtrOhleg8h2SKEM Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4172137f3aa447edafafae76e41ef499 Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:39:44.842346 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:39:44.844293 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4172137f3aa447edafafae76e41ef499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4172137f3aa447edafafae76e41ef499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4172137f3aa447edafafae76e41ef499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4172137f3aa447edafafae76e41ef499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:44.844293 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:44.844293 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4172137f3aa447edafafae76e41ef499 Sep 08 12:39:44.844293 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:44.844293 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersAdminTestJSON-1587185021-project Sep 08 12:39:44.844293 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:44.844293 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:44.844293 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: c646b5da6995488db0ce3f405741b296 Sep 08 12:39:44.844293 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersAdminTestJSON-1587185021-project Sep 08 12:39:44.844293 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:39:44.844293 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:44.844293 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7'} Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:44.845243 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:44.846701 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:44.847991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-857c2f30-995a-4e9e-ae92-5bdca0a785a4 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Returning 404 to user: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:44.847991 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-857c2f30-995a-4e9e-ae92-5bdca0a785a4 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 404 len: 111 microversion: 2.1 time: 0.293395 Sep 08 12:39:44.851260 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 299/584] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:44 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 111 bytes in 301 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:44.860621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-519bd5c3-190d-4b69-bb87-1181352de2e2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:44.861687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-519bd5c3-190d-4b69-bb87-1181352de2e2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:44.868783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-519bd5c3-190d-4b69-bb87-1181352de2e2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:44.869541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-519bd5c3-190d-4b69-bb87-1181352de2e2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:44.870255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-519bd5c3-190d-4b69-bb87-1181352de2e2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:44.871428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-519bd5c3-190d-4b69-bb87-1181352de2e2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:44.872034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-519bd5c3-190d-4b69-bb87-1181352de2e2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:44.872709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-519bd5c3-190d-4b69-bb87-1181352de2e2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:45.013909 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-db0bfade-3e39-40e0-b3ae-63133d5725db tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/bb916b83-3bd3-43f4-8a7d-36d1bd8a2806" status: 200 len: 141 microversion: 2.1 time: 0.631665 Sep 08 12:39:45.014785 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 286/585] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:39:44 2022] GET /compute/v2.1/os-floating-ips/bb916b83-3bd3-43f4-8a7d-36d1bd8a2806 => generated 141 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:45.021346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7efb80ba-a6f5-4a22-b1c3-31eeaf20974b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:45.022824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7efb80ba-a6f5-4a22-b1c3-31eeaf20974b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:45.034258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7efb80ba-a6f5-4a22-b1c3-31eeaf20974b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:45.034864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7efb80ba-a6f5-4a22-b1c3-31eeaf20974b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:45.035492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7efb80ba-a6f5-4a22-b1c3-31eeaf20974b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:45.036670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7efb80ba-a6f5-4a22-b1c3-31eeaf20974b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:45.037153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7efb80ba-a6f5-4a22-b1c3-31eeaf20974b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:45.037609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7efb80ba-a6f5-4a22-b1c3-31eeaf20974b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:45.276090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-519bd5c3-190d-4b69-bb87-1181352de2e2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:45.285087 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-519bd5c3-190d-4b69-bb87-1181352de2e2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 200 len: 1316 microversion: 2.1 time: 0.432190 Sep 08 12:39:45.285683 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 300/586] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:44 2022] GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 1316 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:45.290764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e5d30fe-9e10-4733-89cb-594ef96e448c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:45.291539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8e5d30fe-9e10-4733-89cb-594ef96e448c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:45.298326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e5d30fe-9e10-4733-89cb-594ef96e448c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:45.298836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e5d30fe-9e10-4733-89cb-594ef96e448c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:45.299575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e5d30fe-9e10-4733-89cb-594ef96e448c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:45.300692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e5d30fe-9e10-4733-89cb-594ef96e448c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:45.301171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e5d30fe-9e10-4733-89cb-594ef96e448c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:45.301612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e5d30fe-9e10-4733-89cb-594ef96e448c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:45.317912 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-8e5d30fe-9e10-4733-89cb-594ef96e448c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] HTTP exception thrown: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e5d30fe-9e10-4733-89cb-594ef96e448c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Request method failure captured: Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 HTTP/1.1 Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeJCqVeKon7h6IuUBxhnZCj8060E5V9lurntRdSb6qYNfIlvhdOMd5iZTvF5HH1xvH8yopZtDqx7NWfRYUk3A3uobzMfZ3vZT_P0rnAHEoGR6_bo_LVmuYrTCEtMkOBqihDop3Fu50ue_h29MkI-tVRMcF_C0kJwrtrOhleg8h2SKEM Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4172137f3aa447edafafae76e41ef499 Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:39:45.319958 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:39:45.321374 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4172137f3aa447edafafae76e41ef499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4172137f3aa447edafafae76e41ef499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4172137f3aa447edafafae76e41ef499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4172137f3aa447edafafae76e41ef499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:45.321374 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:45.321374 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4172137f3aa447edafafae76e41ef499 Sep 08 12:39:45.321374 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:45.321374 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersAdminTestJSON-1587185021-project Sep 08 12:39:45.321374 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:45.321374 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:45.321374 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: c646b5da6995488db0ce3f405741b296 Sep 08 12:39:45.321374 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersAdminTestJSON-1587185021-project Sep 08 12:39:45.321374 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:39:45.321374 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:45.321374 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7'} Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:45.322221 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:45.323453 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:45.326157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e5d30fe-9e10-4733-89cb-594ef96e448c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Returning 404 to user: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:45.327268 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8e5d30fe-9e10-4733-89cb-594ef96e448c tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 404 len: 111 microversion: 2.1 time: 0.040401 Sep 08 12:39:45.328191 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 301/587] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:39:45 2022] DELETE /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:45.333905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d40502ed-408e-40eb-b16b-5240a333019d tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Calling method '.version_select at 0x7fdb3b430af0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:45.669978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7efb80ba-a6f5-4a22-b1c3-31eeaf20974b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:45.690759 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7efb80ba-a6f5-4a22-b1c3-31eeaf20974b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1472 microversion: 2.1 time: 0.673935 Sep 08 12:39:45.692397 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 287/588] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:45 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1472 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:45.701896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f062036d-6e02-4119-89d2-67643703fcc0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:45.703367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f062036d-6e02-4119-89d2-67643703fcc0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:45.714554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f062036d-6e02-4119-89d2-67643703fcc0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:45.716243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f062036d-6e02-4119-89d2-67643703fcc0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:45.719026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f062036d-6e02-4119-89d2-67643703fcc0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:45.720667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f062036d-6e02-4119-89d2-67643703fcc0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:45.721592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f062036d-6e02-4119-89d2-67643703fcc0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:45.722167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f062036d-6e02-4119-89d2-67643703fcc0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:45.844044 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d40502ed-408e-40eb-b16b-5240a333019d tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.514375 Sep 08 12:39:45.844625 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 302/589] 10.222.0.78 () {58 vars in 1149 bytes} [Thu Sep 8 12:39:45 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:45.850119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc54defe-0848-4a7a-bca5-b726f2ad6172 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:45.850742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fc54defe-0848-4a7a-bca5-b726f2ad6172 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:45.860492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc54defe-0848-4a7a-bca5-b726f2ad6172 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:45.861289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc54defe-0848-4a7a-bca5-b726f2ad6172 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:45.862022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc54defe-0848-4a7a-bca5-b726f2ad6172 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:45.863529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc54defe-0848-4a7a-bca5-b726f2ad6172 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:45.864193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc54defe-0848-4a7a-bca5-b726f2ad6172 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:45.864767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc54defe-0848-4a7a-bca5-b726f2ad6172 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:45.888423 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-fc54defe-0848-4a7a-bca5-b726f2ad6172 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] HTTP exception thrown: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc54defe-0848-4a7a-bca5-b726f2ad6172 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Request method failure captured: Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 HTTP/1.1 Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeJCqVeKon7h6IuUBxhnZCj8060E5V9lurntRdSb6qYNfIlvhdOMd5iZTvF5HH1xvH8yopZtDqx7NWfRYUk3A3uobzMfZ3vZT_P0rnAHEoGR6_bo_LVmuYrTCEtMkOBqihDop3Fu50ue_h29MkI-tVRMcF_C0kJwrtrOhleg8h2SKEM Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4172137f3aa447edafafae76e41ef499 Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:39:45.890409 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:39:45.893325 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4172137f3aa447edafafae76e41ef499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4172137f3aa447edafafae76e41ef499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4172137f3aa447edafafae76e41ef499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4172137f3aa447edafafae76e41ef499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:45.893325 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:45.893325 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4172137f3aa447edafafae76e41ef499 Sep 08 12:39:45.893325 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:45.893325 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersAdminTestJSON-1587185021-project Sep 08 12:39:45.893325 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:45.893325 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:45.893325 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: c646b5da6995488db0ce3f405741b296 Sep 08 12:39:45.893325 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersAdminTestJSON-1587185021-project Sep 08 12:39:45.893325 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:39:45.893325 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:45.893325 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7'} Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:45.895937 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. Sep 08 12:39:45.899666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:45.902142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc54defe-0848-4a7a-bca5-b726f2ad6172 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Returning 404 to user: Instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:45.902142 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fc54defe-0848-4a7a-bca5-b726f2ad6172 tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7" status: 404 len: 111 microversion: 2.1 time: 0.046522 Sep 08 12:39:45.902142 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 303/590] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:45 2022] GET /compute/v2.1/servers/fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:45.902883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-d312a3df-791b-4796-9293-e46ea83fa794 req-eda251c6-1934-4f98-a861-54e179d87d2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7", "name": "network-vif-deleted", "tag": "ce9810f0-c796-4ff9-a520-b7a552ca6832"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:45.918300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d312a3df-791b-4796-9293-e46ea83fa794 req-eda251c6-1934-4f98-a861-54e179d87d2a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:45.919104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d312a3df-791b-4796-9293-e46ea83fa794 req-eda251c6-1934-4f98-a861-54e179d87d2a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:45.919871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d312a3df-791b-4796-9293-e46ea83fa794 req-eda251c6-1934-4f98-a861-54e179d87d2a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:45.944770 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d312a3df-791b-4796-9293-e46ea83fa794 req-eda251c6-1934-4f98-a861-54e179d87d2a service nova] Creating event network-vif-deleted:ce9810f0-c796-4ff9-a520-b7a552ca6832 for instance fa44ebb7-79e3-4d50-b6f1-fbf6c513e1b7 on n-h1-852084-10 Sep 08 12:39:45.955143 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-d312a3df-791b-4796-9293-e46ea83fa794 req-eda251c6-1934-4f98-a861-54e179d87d2a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058382 Sep 08 12:39:45.956844 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 304/591] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:45.972437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3678281b-7522-47b8-ad5d-5eb9bf6b7892 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:45.973973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3678281b-7522-47b8-ad5d-5eb9bf6b7892 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:45.987109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3678281b-7522-47b8-ad5d-5eb9bf6b7892 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:45.988389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3678281b-7522-47b8-ad5d-5eb9bf6b7892 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:45.989122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3678281b-7522-47b8-ad5d-5eb9bf6b7892 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:45.990418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3678281b-7522-47b8-ad5d-5eb9bf6b7892 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:45.991295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3678281b-7522-47b8-ad5d-5eb9bf6b7892 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:45.992078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3678281b-7522-47b8-ad5d-5eb9bf6b7892 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:45.998699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f062036d-6e02-4119-89d2-67643703fcc0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:46.008111 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f062036d-6e02-4119-89d2-67643703fcc0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 200 len: 1318 microversion: 2.1 time: 0.313576 Sep 08 12:39:46.024088 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 288/592] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:45 2022] GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:46.044532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89aa2cf1-4ba5-401b-af34-3ac9705049d2 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Calling method '.version_select at 0x7fdb3722b790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:46.078173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=10 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:46.544044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3678281b-7522-47b8-ad5d-5eb9bf6b7892 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:46.553592 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3678281b-7522-47b8-ad5d-5eb9bf6b7892 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1502 microversion: 2.1 time: 0.594051 Sep 08 12:39:46.554432 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 305/593] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:45 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1502 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:46.559783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-029700f1-11c0-4f2e-875a-643d506d571d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:46.561240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-029700f1-11c0-4f2e-875a-643d506d571d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:46.573571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-029700f1-11c0-4f2e-875a-643d506d571d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:46.575551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-029700f1-11c0-4f2e-875a-643d506d571d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:46.577664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-029700f1-11c0-4f2e-875a-643d506d571d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:46.580937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-029700f1-11c0-4f2e-875a-643d506d571d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:46.582031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-029700f1-11c0-4f2e-875a-643d506d571d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:46.582988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-029700f1-11c0-4f2e-875a-643d506d571d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:46.604863 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-029700f1-11c0-4f2e-875a-643d506d571d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] HTTP exception thrown: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-029700f1-11c0-4f2e-875a-643d506d571d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Request method failure captured: Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 HTTP/1.1 Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeJCqVeKon7h6IuUBxhnZCj8060E5V9lurntRdSb6qYNfIlvhdOMd5iZTvF5HH1xvH8yopZtDqx7NWfRYUk3A3uobzMfZ3vZT_P0rnAHEoGR6_bo_LVmuYrTCEtMkOBqihDop3Fu50ue_h29MkI-tVRMcF_C0kJwrtrOhleg8h2SKEM Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4172137f3aa447edafafae76e41ef499 Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:39:46.607434 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:39:46.610752 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4172137f3aa447edafafae76e41ef499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4172137f3aa447edafafae76e41ef499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4172137f3aa447edafafae76e41ef499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4172137f3aa447edafafae76e41ef499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:46.610752 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:46.610752 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4172137f3aa447edafafae76e41ef499 Sep 08 12:39:46.610752 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:46.610752 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersAdminTestJSON-1587185021-project Sep 08 12:39:46.610752 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:46.610752 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:46.610752 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: c646b5da6995488db0ce3f405741b296 Sep 08 12:39:46.610752 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersAdminTestJSON-1587185021-project Sep 08 12:39:46.610752 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:39:46.610752 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:46.610752 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'aee5557d-0174-4b4d-8a43-38266c51a8c9'} Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:46.613847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:46.617792 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:46.624386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-029700f1-11c0-4f2e-875a-643d506d571d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Returning 404 to user: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:46.624386 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-029700f1-11c0-4f2e-875a-643d506d571d tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 404 len: 111 microversion: 2.1 time: 0.053911 Sep 08 12:39:46.624386 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 306/594] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:39:46 2022] DELETE /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:46.624386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-56ac7222-d0b4-4598-8fb5-3c57fe44c1fb req-a9a9ae00-b0bc-4df8-9f6f-987a314534a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c952db45-70f9-47b4-9061-490992a347be", "name": "network-vif-unplugged", "status": "completed", "tag": "b98800b6-5185-43d6-b8ad-064fb1654065"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:46.628431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-56ac7222-d0b4-4598-8fb5-3c57fe44c1fb req-a9a9ae00-b0bc-4df8-9f6f-987a314534a0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:46.628871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-56ac7222-d0b4-4598-8fb5-3c57fe44c1fb req-a9a9ae00-b0bc-4df8-9f6f-987a314534a0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:46.629310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-56ac7222-d0b4-4598-8fb5-3c57fe44c1fb req-a9a9ae00-b0bc-4df8-9f6f-987a314534a0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:46.645070 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-56ac7222-d0b4-4598-8fb5-3c57fe44c1fb req-a9a9ae00-b0bc-4df8-9f6f-987a314534a0 service nova] Creating event network-vif-unplugged:b98800b6-5185-43d6-b8ad-064fb1654065 for instance c952db45-70f9-47b4-9061-490992a347be on n-h2-852084-10 Sep 08 12:39:46.650934 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-56ac7222-d0b4-4598-8fb5-3c57fe44c1fb req-a9a9ae00-b0bc-4df8-9f6f-987a314534a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038179 Sep 08 12:39:46.651789 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 307/595] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:46.658018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3d81f758-8c5d-4fa8-9149-7a03e8cccdd6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:46.658883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3d81f758-8c5d-4fa8-9149-7a03e8cccdd6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:46.667124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d81f758-8c5d-4fa8-9149-7a03e8cccdd6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:46.668042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d81f758-8c5d-4fa8-9149-7a03e8cccdd6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:46.668607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d81f758-8c5d-4fa8-9149-7a03e8cccdd6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:46.669591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d81f758-8c5d-4fa8-9149-7a03e8cccdd6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:46.670451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d81f758-8c5d-4fa8-9149-7a03e8cccdd6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:46.671272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d81f758-8c5d-4fa8-9149-7a03e8cccdd6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:47.437234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3d81f758-8c5d-4fa8-9149-7a03e8cccdd6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:47.446594 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3d81f758-8c5d-4fa8-9149-7a03e8cccdd6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 200 len: 1316 microversion: 2.1 time: 0.792751 Sep 08 12:39:47.447190 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 308/596] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:46 2022] GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 1316 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:47.470194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-168aa50e-4d43-4e68-a063-eb1b24139e4e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:47.472128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-168aa50e-4d43-4e68-a063-eb1b24139e4e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] [instance: aee5557d-0174-4b4d-8a43-38266c51a8c9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:47.485125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-168aa50e-4d43-4e68-a063-eb1b24139e4e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:47.486356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-168aa50e-4d43-4e68-a063-eb1b24139e4e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:47.487260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-168aa50e-4d43-4e68-a063-eb1b24139e4e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:47.489226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-168aa50e-4d43-4e68-a063-eb1b24139e4e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:47.489568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-168aa50e-4d43-4e68-a063-eb1b24139e4e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:47.490615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-168aa50e-4d43-4e68-a063-eb1b24139e4e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:47.535059 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-168aa50e-4d43-4e68-a063-eb1b24139e4e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] HTTP exception thrown: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-168aa50e-4d43-4e68-a063-eb1b24139e4e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Request method failure captured: Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 HTTP/1.1 Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeJCqVeKon7h6IuUBxhnZCj8060E5V9lurntRdSb6qYNfIlvhdOMd5iZTvF5HH1xvH8yopZtDqx7NWfRYUk3A3uobzMfZ3vZT_P0rnAHEoGR6_bo_LVmuYrTCEtMkOBqihDop3Fu50ue_h29MkI-tVRMcF_C0kJwrtrOhleg8h2SKEM Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4172137f3aa447edafafae76e41ef499 Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:39:47.538470 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:39:47.541341 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4172137f3aa447edafafae76e41ef499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4172137f3aa447edafafae76e41ef499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4172137f3aa447edafafae76e41ef499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4172137f3aa447edafafae76e41ef499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:47.541341 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:47.541341 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4172137f3aa447edafafae76e41ef499 Sep 08 12:39:47.541341 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1587185021 Sep 08 12:39:47.541341 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersAdminTestJSON-1587185021-project Sep 08 12:39:47.541341 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:47.541341 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:47.541341 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: c646b5da6995488db0ce3f405741b296 Sep 08 12:39:47.541341 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersAdminTestJSON-1587185021-project Sep 08 12:39:47.541341 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:39:47.541341 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:47.541341 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'aee5557d-0174-4b4d-8a43-38266c51a8c9'} Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:47.546596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. Sep 08 12:39:47.551166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:47.557589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-168aa50e-4d43-4e68-a063-eb1b24139e4e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] Returning 404 to user: Instance aee5557d-0174-4b4d-8a43-38266c51a8c9 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:47.557589 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-168aa50e-4d43-4e68-a063-eb1b24139e4e tempest-DeleteServersAdminTestJSON-1587185021 tempest-DeleteServersAdminTestJSON-1587185021-project] 10.222.0.78 "GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9" status: 404 len: 111 microversion: 2.1 time: 0.080367 Sep 08 12:39:47.557589 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 309/597] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:47 2022] GET /compute/v2.1/servers/aee5557d-0174-4b4d-8a43-38266c51a8c9 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:47.557589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63ca6512-0e20-4379-a4ad-d2b72580e4b5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:47.559395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-63ca6512-0e20-4379-a4ad-d2b72580e4b5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:47.564355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:47.571682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63ca6512-0e20-4379-a4ad-d2b72580e4b5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:47.572878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63ca6512-0e20-4379-a4ad-d2b72580e4b5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:47.573643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63ca6512-0e20-4379-a4ad-d2b72580e4b5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:47.574966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63ca6512-0e20-4379-a4ad-d2b72580e4b5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:47.575818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63ca6512-0e20-4379-a4ad-d2b72580e4b5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:47.577013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63ca6512-0e20-4379-a4ad-d2b72580e4b5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:48.067648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-63ca6512-0e20-4379-a4ad-d2b72580e4b5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:48.069990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:48.079051 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-63ca6512-0e20-4379-a4ad-d2b72580e4b5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1472 microversion: 2.1 time: 0.530065 Sep 08 12:39:48.079920 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 310/598] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:47 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1472 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:48.094021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bac790af-7bb9-4861-bec9-d4388dfbd002 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:48.095041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bac790af-7bb9-4861-bec9-d4388dfbd002 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:48.104255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac790af-7bb9-4861-bec9-d4388dfbd002 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:48.105188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac790af-7bb9-4861-bec9-d4388dfbd002 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:48.106339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac790af-7bb9-4861-bec9-d4388dfbd002 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:48.107342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac790af-7bb9-4861-bec9-d4388dfbd002 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:48.108039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac790af-7bb9-4861-bec9-d4388dfbd002 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:48.109038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac790af-7bb9-4861-bec9-d4388dfbd002 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:48.328235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bac790af-7bb9-4861-bec9-d4388dfbd002 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:48.336969 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bac790af-7bb9-4861-bec9-d4388dfbd002 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 200 len: 1468 microversion: 2.1 time: 0.255637 Sep 08 12:39:48.337558 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 311/599] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:48 2022] GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 1468 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:48.343750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f122d0a4-c168-42a9-96a1-3dfa9c8cb596 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:48.344645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f122d0a4-c168-42a9-96a1-3dfa9c8cb596 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:48.351295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f122d0a4-c168-42a9-96a1-3dfa9c8cb596 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:48.352180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f122d0a4-c168-42a9-96a1-3dfa9c8cb596 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:48.352820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f122d0a4-c168-42a9-96a1-3dfa9c8cb596 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:48.353733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f122d0a4-c168-42a9-96a1-3dfa9c8cb596 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:48.354355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f122d0a4-c168-42a9-96a1-3dfa9c8cb596 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:48.354787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f122d0a4-c168-42a9-96a1-3dfa9c8cb596 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:48.456839 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-89aa2cf1-4ba5-401b-af34-3ac9705049d2 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/bb916b83-3bd3-43f4-8a7d-36d1bd8a2806" status: 202 len: 0 microversion: 2.1 time: 2.430529 Sep 08 12:39:48.462699 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 289/600] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:39:46 2022] DELETE /compute/v2.1/os-floating-ips/bb916b83-3bd3-43f4-8a7d-36d1bd8a2806 => generated 0 bytes in 2435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:39:48.467744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b2a452e9-ffc5-48e9-bff7-e6dc52335e17 req-2edd1dd3-6225-4178-a513-e6c1805cf708 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61574c60-0e9f-46f3-924f-ca5e7e74f04f", "name": "network-vif-plugged", "status": "completed", "tag": "23905870-8446-4b2e-9ac6-e2812fed241f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:48.478135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b2a452e9-ffc5-48e9-bff7-e6dc52335e17 req-2edd1dd3-6225-4178-a513-e6c1805cf708 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:48.478726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b2a452e9-ffc5-48e9-bff7-e6dc52335e17 req-2edd1dd3-6225-4178-a513-e6c1805cf708 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:48.479261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b2a452e9-ffc5-48e9-bff7-e6dc52335e17 req-2edd1dd3-6225-4178-a513-e6c1805cf708 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:48.492241 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b2a452e9-ffc5-48e9-bff7-e6dc52335e17 req-2edd1dd3-6225-4178-a513-e6c1805cf708 service nova] Creating event network-vif-plugged:23905870-8446-4b2e-9ac6-e2812fed241f for instance 61574c60-0e9f-46f3-924f-ca5e7e74f04f on n-h1-852084-10 Sep 08 12:39:48.498122 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b2a452e9-ffc5-48e9-bff7-e6dc52335e17 req-2edd1dd3-6225-4178-a513-e6c1805cf708 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034638 Sep 08 12:39:48.498813 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 290/601] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:48.718965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f122d0a4-c168-42a9-96a1-3dfa9c8cb596 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:48.737978 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f122d0a4-c168-42a9-96a1-3dfa9c8cb596 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1502 microversion: 2.1 time: 0.398784 Sep 08 12:39:48.739349 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 312/602] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:48 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1502 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:48.746357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d98f04c2-18b3-451f-9982-af5df38bc44e tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Action: 'create', calling method: .version_select at 0x7fdb3b5ed940>, body: {"pool": null} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:48.822887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-473692428", "block_migration": true, "disk_over_commit": false}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:48.826681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:48.834689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:48.835192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:48.835721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:48.836568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:48.837682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:48.838339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:48.872281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lazy-loading 'flavor' on Instance uuid 28fb1363-4800-4df7-ae28-28d51b708679 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:39:48.889794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Going to try to live migrate instance to tempest-host-473692428 {{(pid=128970) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 12:39:48.907183 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] HTTP exception thrown: Compute host tempest-host-473692428 could not be found. Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Request method failure captured: Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679/action HTTP/1.1 Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 106 Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJ8uoieOEjjjlMVuAqr8H-hvqS0zrEUnBNirLo27esLgQCJPzr621iDlXRd4RyODRG6ICpzaRe1DHOwlXqqBBYL994K3T4sjA1v6AL6hdgjL8-bs867B0uWwlBTyuePNkXoZJ8vc-laMEuhmX8s5nyaSO439pOHjzW4f1f_EGuV-2U Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 064b7d22fd8c4e59807a5324b2e93de4 Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-LiveMigrationNegativeTest-1276236943 Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:39:48.913730 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:39:48.915099 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_064b7d22fd8c4e59807a5324b2e93de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/064b7d22fd8c4e59807a5324b2e93de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/064b7d22fd8c4e59807a5324b2e93de4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/064b7d22fd8c4e59807a5324b2e93de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:48.915099 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-LiveMigrationNegativeTest-1276236943 Sep 08 12:39:48.915099 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 064b7d22fd8c4e59807a5324b2e93de4 Sep 08 12:39:48.915099 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1276236943 Sep 08 12:39:48.915099 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-LiveMigrationNegativeTest-1276236943-project-admin Sep 08 12:39:48.915099 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:39:48.915099 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:39:48.915099 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 51b2bea12f2d40d88caaccb5214564a7 Sep 08 12:39:48.915099 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-LiveMigrationNegativeTest-1276236943-project-admin Sep 08 12:39:48.915099 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:39:48.915099 n-d-852084-10 devstack@n-api.service[128970]: {"os-migrateLive": {"host": "tempest-host-473692428", "block_migration": true, "disk_over_commit": false}} Sep 08 12:39:48.915099 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: exception: Compute host tempest-host-473692428 could not be found. Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '28fb1363-4800-4df7-ae28-28d51b708679', 'body': {'os-migrateLive': {'host': 'tempest-host-473692428', 'block_migration': True, 'disk_over_commit': False}}} Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 12:39:48.920270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-473692428 could not be found. Sep 08 12:39:48.922073 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-473692428 could not be found. Sep 08 12:39:48.924699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:48.927485 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:48.927485 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:48.927485 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:48.927485 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:48.927485 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:48.927485 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:48.927485 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:48.927485 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-473692428 could not be found. Sep 08 12:39:48.927485 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:48.927485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Returning 400 to user: Compute host tempest-host-473692428 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:48.927485 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d820df25-7e41-4cd0-a1a5-d71d03c8b4f1 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679/action" status: 400 len: 99 microversion: 2.1 time: 0.412025 Sep 08 12:39:48.927485 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 291/603] 10.222.0.78 () {60 vars in 1279 bytes} [Thu Sep 8 12:39:48 2022] POST /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679/action => generated 99 bytes in 414 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:39:48.931432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d264764d-2727-4d26-ac79-4eb16cff7da2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:48.931432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d264764d-2727-4d26-ac79-4eb16cff7da2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:48.931432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d264764d-2727-4d26-ac79-4eb16cff7da2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:48.931432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d264764d-2727-4d26-ac79-4eb16cff7da2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:48.932314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d264764d-2727-4d26-ac79-4eb16cff7da2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:48.932314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d264764d-2727-4d26-ac79-4eb16cff7da2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:48.932615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d264764d-2727-4d26-ac79-4eb16cff7da2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:48.935679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d264764d-2727-4d26-ac79-4eb16cff7da2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:49.201098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d264764d-2727-4d26-ac79-4eb16cff7da2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:49.219944 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d264764d-2727-4d26-ac79-4eb16cff7da2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 200 len: 1316 microversion: 2.1 time: 0.302490 Sep 08 12:39:49.220528 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 292/604] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:48 2022] GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:49.226974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-15c0e8c7-01ca-4d36-8f0a-ef764cce50a1 req-3366e7c6-30fc-4a64-82b2-072f9af901f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c952db45-70f9-47b4-9061-490992a347be", "tag": "b98800b6-5185-43d6-b8ad-064fb1654065"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:49.243353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-15c0e8c7-01ca-4d36-8f0a-ef764cce50a1 req-3366e7c6-30fc-4a64-82b2-072f9af901f7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:49.244266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-15c0e8c7-01ca-4d36-8f0a-ef764cce50a1 req-3366e7c6-30fc-4a64-82b2-072f9af901f7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:49.244913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-15c0e8c7-01ca-4d36-8f0a-ef764cce50a1 req-3366e7c6-30fc-4a64-82b2-072f9af901f7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:49.260211 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-15c0e8c7-01ca-4d36-8f0a-ef764cce50a1 req-3366e7c6-30fc-4a64-82b2-072f9af901f7 service nova] Creating event network-changed:b98800b6-5185-43d6-b8ad-064fb1654065 for instance c952db45-70f9-47b4-9061-490992a347be on n-h2-852084-10 Sep 08 12:39:49.267108 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-15c0e8c7-01ca-4d36-8f0a-ef764cce50a1 req-3366e7c6-30fc-4a64-82b2-072f9af901f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044050 Sep 08 12:39:49.268687 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 293/605] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:49.276687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4d5450f2-9304-4840-bd6e-a8bffec67253 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:49.278322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4d5450f2-9304-4840-bd6e-a8bffec67253 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:49.287778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d5450f2-9304-4840-bd6e-a8bffec67253 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:49.288636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d5450f2-9304-4840-bd6e-a8bffec67253 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:49.290901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d5450f2-9304-4840-bd6e-a8bffec67253 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:49.292000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d5450f2-9304-4840-bd6e-a8bffec67253 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:49.293568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d5450f2-9304-4840-bd6e-a8bffec67253 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:49.294594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d5450f2-9304-4840-bd6e-a8bffec67253 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:49.630033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4d5450f2-9304-4840-bd6e-a8bffec67253 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:49.641167 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4d5450f2-9304-4840-bd6e-a8bffec67253 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 200 len: 1468 microversion: 2.1 time: 0.370190 Sep 08 12:39:49.641759 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 294/606] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:49 2022] GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 1468 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:49.673068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d9f18e9a-6737-4fb9-8012-5e3c0291b4c9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:49.674152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d9f18e9a-6737-4fb9-8012-5e3c0291b4c9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:49.688192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9f18e9a-6737-4fb9-8012-5e3c0291b4c9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:49.689163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9f18e9a-6737-4fb9-8012-5e3c0291b4c9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:49.689791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9f18e9a-6737-4fb9-8012-5e3c0291b4c9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:49.690703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9f18e9a-6737-4fb9-8012-5e3c0291b4c9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:49.691691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9f18e9a-6737-4fb9-8012-5e3c0291b4c9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:49.692471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9f18e9a-6737-4fb9-8012-5e3c0291b4c9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:50.049278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d9f18e9a-6737-4fb9-8012-5e3c0291b4c9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:50.057869 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d9f18e9a-6737-4fb9-8012-5e3c0291b4c9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.400784 Sep 08 12:39:50.070086 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 295/607] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:49 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:50.079245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-061b3d2c-cb1d-4d58-8a61-618224f9d0be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:50.080288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-061b3d2c-cb1d-4d58-8a61-618224f9d0be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:50.087712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-061b3d2c-cb1d-4d58-8a61-618224f9d0be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:50.088614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-061b3d2c-cb1d-4d58-8a61-618224f9d0be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:50.089269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-061b3d2c-cb1d-4d58-8a61-618224f9d0be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:50.090114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-061b3d2c-cb1d-4d58-8a61-618224f9d0be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:50.095316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-061b3d2c-cb1d-4d58-8a61-618224f9d0be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:50.095316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-061b3d2c-cb1d-4d58-8a61-618224f9d0be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:50.428001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-061b3d2c-cb1d-4d58-8a61-618224f9d0be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:50.438742 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-061b3d2c-cb1d-4d58-8a61-618224f9d0be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1502 microversion: 2.1 time: 0.366742 Sep 08 12:39:50.439602 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 296/608] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:50 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1502 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:50.455709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1502144452", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:50.522771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:39:51.201839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:39:51.202498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:39:51.202724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:39:51.204498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:39:51.205166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:39:51.214855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:51.215385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:51.215829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:51.216560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:51.217206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:51.217627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:51.238748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Getting quotas for project 1ecf62bb5fa54e498d4e6561791aa11b. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:39:51.245428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Getting quotas for user 569e4e340357494692da48aabd8d2e16 and project 1ecf62bb5fa54e498d4e6561791aa11b. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:39:51.260303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:39:51.262985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:39:51.324506 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9bc41c80-43fd-4973-a88b-442ed8cd23af tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.883519 Sep 08 12:39:51.326296 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 297/609] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:39:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:39:51.332029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ffac1f16-438c-433b-9a6c-a41572a65357 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:51.332950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ffac1f16-438c-433b-9a6c-a41572a65357 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:51.340581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffac1f16-438c-433b-9a6c-a41572a65357 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:51.341074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffac1f16-438c-433b-9a6c-a41572a65357 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:51.341524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffac1f16-438c-433b-9a6c-a41572a65357 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:51.342281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffac1f16-438c-433b-9a6c-a41572a65357 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:51.344093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffac1f16-438c-433b-9a6c-a41572a65357 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:51.344093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffac1f16-438c-433b-9a6c-a41572a65357 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:51.524474 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d98f04c2-18b3-451f-9982-af5df38bc44e tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.783449 Sep 08 12:39:51.525417 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 313/610] 10.222.0.78 () {60 vars in 1170 bytes} [Thu Sep 8 12:39:48 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:51.574975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ffac1f16-438c-433b-9a6c-a41572a65357 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:51.577636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:51.587576 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ffac1f16-438c-433b-9a6c-a41572a65357 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 200 len: 1466 microversion: 2.1 time: 0.259798 Sep 08 12:39:51.588941 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 298/611] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:51 2022] GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 1466 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:51.599789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4bc3f505-9946-438c-ad56-c734eeabdbcb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:51.600936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4bc3f505-9946-438c-ad56-c734eeabdbcb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:51.609057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bc3f505-9946-438c-ad56-c734eeabdbcb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:51.609644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bc3f505-9946-438c-ad56-c734eeabdbcb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:51.610212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bc3f505-9946-438c-ad56-c734eeabdbcb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:51.611263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bc3f505-9946-438c-ad56-c734eeabdbcb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:51.611789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bc3f505-9946-438c-ad56-c734eeabdbcb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:51.612275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bc3f505-9946-438c-ad56-c734eeabdbcb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:51.754903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7f28269a-fa1d-456f-92c3-34e1a4ac4113 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-795711199", "ram": 512, "vcpus": 1, "disk": 10, "id": 43080848, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:51.782327 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7f28269a-fa1d-456f-92c3-34e1a4ac4113 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.1 time: 0.255618 Sep 08 12:39:51.783525 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 314/612] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:39:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:51.788788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-593d1951-695b-45f0-8b14-7bf5717f4bb6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:51.789894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-593d1951-695b-45f0-8b14-7bf5717f4bb6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:51.807479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4bc3f505-9946-438c-ad56-c734eeabdbcb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:51.816482 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4bc3f505-9946-438c-ad56-c734eeabdbcb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.225827 Sep 08 12:39:51.817249 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 299/613] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:51 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:51.828396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fbab3d0b-1d09-477e-bb5f-f5f6549686e4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:51.829041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fbab3d0b-1d09-477e-bb5f-f5f6549686e4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:51.839282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbab3d0b-1d09-477e-bb5f-f5f6549686e4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:51.840483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbab3d0b-1d09-477e-bb5f-f5f6549686e4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:51.840946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbab3d0b-1d09-477e-bb5f-f5f6549686e4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:51.841604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbab3d0b-1d09-477e-bb5f-f5f6549686e4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:51.842292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbab3d0b-1d09-477e-bb5f-f5f6549686e4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:51.842464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbab3d0b-1d09-477e-bb5f-f5f6549686e4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:51.855108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-593d1951-695b-45f0-8b14-7bf5717f4bb6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:51.863740 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-593d1951-695b-45f0-8b14-7bf5717f4bb6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1219 microversion: 2.1 time: 0.078748 Sep 08 12:39:51.864334 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 315/614] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:51 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:51.869650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-679f70f8-e8d6-4f8d-aaa8-dce6ae04fd2a tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Calling method '.version_select at 0x7fdb3b430940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:52.119008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fbab3d0b-1d09-477e-bb5f-f5f6549686e4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:52.133129 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fbab3d0b-1d09-477e-bb5f-f5f6549686e4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1502 microversion: 2.1 time: 0.314160 Sep 08 12:39:52.134025 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 300/615] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:51 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1502 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:52.144617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aaa8904a-8920-452a-bbe2-a7f11cbad298 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:52.146541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aaa8904a-8920-452a-bbe2-a7f11cbad298 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:52.162103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aaa8904a-8920-452a-bbe2-a7f11cbad298 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:52.163341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aaa8904a-8920-452a-bbe2-a7f11cbad298 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:52.164355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aaa8904a-8920-452a-bbe2-a7f11cbad298 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:52.166074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aaa8904a-8920-452a-bbe2-a7f11cbad298 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:52.166506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aaa8904a-8920-452a-bbe2-a7f11cbad298 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:52.167604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aaa8904a-8920-452a-bbe2-a7f11cbad298 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:52.484926 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aaa8904a-8920-452a-bbe2-a7f11cbad298 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 200 len: 1619 microversion: 2.1 time: 0.349264 Sep 08 12:39:52.486009 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 301/616] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:52 2022] GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 1619 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:52.692262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-668f6864-3132-4340-ba09-56c11f1ee371 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:52.702988 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-668f6864-3132-4340-ba09-56c11f1ee371 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] HTTP exception thrown: Flavor 43080848 has no extra specs with key hw:cpu_thread_policy. Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-668f6864-3132-4340-ba09-56c11f1ee371 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Request method failure captured: Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/flavors/43080848/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKVOM25nhPvVvm9K6J72a0k_zlS5G8g0Z6C0fDGVkCpXcDPP28IvsOVDOyQanHyq9yPRuDC39xHbIe8EHqvWqZkaIYC6qXnz5y-M8N54UGX7__kPgnZyK8s3mIlkFR8oUzLmhn22bEjw5o21okJ16xYz-a7yDiNsDQMqd968HvPRBE Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: e74c65d5aea444b29f9cd813b79b3670 Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:39:52.704567 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:39:52.706016 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:52.706016 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 Sep 08 12:39:52.706016 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: e74c65d5aea444b29f9cd813b79b3670 Sep 08 12:39:52.706016 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 Sep 08 12:39:52.706016 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project Sep 08 12:39:52.706016 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:39:52.706016 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:39:52.706016 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7d474b3328384d2f932d2a08b67bf278 Sep 08 12:39:52.706016 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project Sep 08 12:39:52.706016 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:39:52.706016 n-d-852084-10 devstack@n-api.service[128970]: exception: Flavor 43080848 has no extra specs with key hw:cpu_thread_policy. Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'flavor_id': '43080848', 'id': 'hw:cpu_thread_policy'} Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 43080848 has no extra specs with key hw:cpu_thread_policy. Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:52.707105 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:52.709555 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:52.709555 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:52.709555 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:52.709555 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:52.709555 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:52.709555 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 43080848 has no extra specs with key hw:cpu_thread_policy. Sep 08 12:39:52.709555 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:52.709555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-668f6864-3132-4340-ba09-56c11f1ee371 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Returning 404 to user: Flavor 43080848 has no extra specs with key hw:cpu_thread_policy. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:52.709555 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-668f6864-3132-4340-ba09-56c11f1ee371 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] 10.222.0.78 "GET /compute/v2.1/flavors/43080848/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.219257 Sep 08 12:39:52.709555 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 302/617] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:39:52 2022] GET /compute/v2.1/flavors/43080848/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:52.713385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-464768013", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["970bb882-462b-4430-a3ae-e76024ca8892"]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:52.772300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:39:52.999618 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-679f70f8-e8d6-4f8d-aaa8-dce6ae04fd2a tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/b8c24b12-d9ad-4955-9b98-44d51188ea3b" status: 202 len: 0 microversion: 2.1 time: 1.133603 Sep 08 12:39:53.000602 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 316/618] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:39:51 2022] DELETE /compute/v2.1/os-floating-ips/b8c24b12-d9ad-4955-9b98-44d51188ea3b => generated 0 bytes in 1135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:39:53.014293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0c9a824d-f4cc-4218-a2de-8d0cd9e6099d tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:53.018071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0c9a824d-f4cc-4218-a2de-8d0cd9e6099d tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '7d474b3328384d2f932d2a08b67bf278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74c65d5aea444b29f9cd813b79b3670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0c9a824d-f4cc-4218-a2de-8d0cd9e6099d tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Request method failure captured: Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/flavors/43080848/os-extra_specs HTTP/1.1 Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 66 Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeKVOM25nhPvVvm9K6J72a0k_zlS5G8g0Z6C0fDGVkCpXcDPP28IvsOVDOyQanHyq9yPRuDC39xHbIe8EHqvWqZkaIYC6qXnz5y-M8N54UGX7__kPgnZyK8s3mIlkFR8oUzLmhn22bEjw5o21okJ16xYz-a7yDiNsDQMqd968HvPRBE Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: e74c65d5aea444b29f9cd813b79b3670 Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:39:53.020599 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:39:53.021892 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:53.021892 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 Sep 08 12:39:53.021892 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: e74c65d5aea444b29f9cd813b79b3670 Sep 08 12:39:53.021892 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 Sep 08 12:39:53.021892 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project Sep 08 12:39:53.021892 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:53.021892 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:53.021892 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 7d474b3328384d2f932d2a08b67bf278 Sep 08 12:39:53.021892 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project Sep 08 12:39:53.021892 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:39:53.021892 n-d-852084-10 devstack@n-api.service[128971]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Sep 08 12:39:53.021892 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'flavor_id': '43080848', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:39:53.022589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Sep 08 12:39:53.023793 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.027616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0c9a824d-f4cc-4218-a2de-8d0cd9e6099d tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:53.028581 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0c9a824d-f4cc-4218-a2de-8d0cd9e6099d tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] 10.222.0.78 "POST /compute/v2.1/flavors/43080848/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.026735 Sep 08 12:39:53.034540 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 317/619] 10.222.0.78 () {60 vars in 1218 bytes} [Thu Sep 8 12:39:53 2022] POST /compute/v2.1/flavors/43080848/os-extra_specs => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:53.037349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8325b04f-5b60-4b01-9e24-0c55e2075f03 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:53.038137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8325b04f-5b60-4b01-9e24-0c55e2075f03 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:53.046065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8325b04f-5b60-4b01-9e24-0c55e2075f03 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:53.046713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8325b04f-5b60-4b01-9e24-0c55e2075f03 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:53.047300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8325b04f-5b60-4b01-9e24-0c55e2075f03 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:53.048123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8325b04f-5b60-4b01-9e24-0c55e2075f03 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:53.048787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8325b04f-5b60-4b01-9e24-0c55e2075f03 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:53.049231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8325b04f-5b60-4b01-9e24-0c55e2075f03 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:53.141592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:39:53.142095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:39:53.142642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:39:53.143119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:39:53.143617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:39:53.154943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:53.155561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:53.156332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:53.157306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:53.157831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:53.158325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:53.178794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:39:53.184232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:39:53.199696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:39:53.202152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:39:53.265218 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eed75380-1588-4760-bccd-d20df511e0ed tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557225 Sep 08 12:39:53.265983 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 303/620] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:39:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:39:53.271265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aee1fe89-61a4-43b5-b3a6-183c2076b1a0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:53.271965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aee1fe89-61a4-43b5-b3a6-183c2076b1a0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:53.279914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aee1fe89-61a4-43b5-b3a6-183c2076b1a0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:53.280718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aee1fe89-61a4-43b5-b3a6-183c2076b1a0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:53.281374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aee1fe89-61a4-43b5-b3a6-183c2076b1a0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:53.282283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aee1fe89-61a4-43b5-b3a6-183c2076b1a0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:53.282990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aee1fe89-61a4-43b5-b3a6-183c2076b1a0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:53.283661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aee1fe89-61a4-43b5-b3a6-183c2076b1a0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:53.309590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8325b04f-5b60-4b01-9e24-0c55e2075f03 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:53.321138 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8325b04f-5b60-4b01-9e24-0c55e2075f03 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.290275 Sep 08 12:39:53.323574 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 318/621] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:53 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:53.336873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36da7393-c1b1-409b-abab-8db1de73c9c7 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Calling method '.version_select at 0x7fdb3b430310>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:53.405329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aee1fe89-61a4-43b5-b3a6-183c2076b1a0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:53.418420 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aee1fe89-61a4-43b5-b3a6-183c2076b1a0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1289 microversion: 2.1 time: 0.151104 Sep 08 12:39:53.419346 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 304/622] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:53 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1289 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:53.424077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e39503c5-4146-475a-a958-54ae588a00f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:53.440381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG neutronclient.v2_0.client [None req-36da7393-c1b1-409b-abab-8db1de73c9c7 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b8c24b12-d9ad-4955-9b98-44d51188ea3b could not be found", "detail": ""}} {{(pid=128971) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:39:53.441063 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-36da7393-c1b1-409b-abab-8db1de73c9c7 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] HTTP exception thrown: Floating IP not found for ID b8c24b12-d9ad-4955-9b98-44d51188ea3b Sep 08 12:39:53.461463 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e39503c5-4146-475a-a958-54ae588a00f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/43080848/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040828 Sep 08 12:39:53.462452 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 305/623] 10.222.0.78 () {60 vars in 1218 bytes} [Thu Sep 8 12:39:53 2022] POST /compute/v2.1/flavors/43080848/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36da7393-c1b1-409b-abab-8db1de73c9c7 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Request method failure captured: Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-floating-ips/b8c24b12-d9ad-4955-9b98-44d51188ea3b HTTP/1.1 Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeKIWKXY4DhK0nWs1fH_pglGCQzUhXcAn_5AqujIASEDyAXkUusgr02bN_z9qiCrBXHAd-uTUqFtruZCrhjHRwMH1WrxJSqqi6K7ZzKjzximgYS-w_hvv0NbjIz_KdE5VwA72J-B3gwWNmRFFmcP0wtNk6trT_v5s7XDFK-zdhJVIt0 Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: e1f38a9cdeb14975aa882e4eea87e91a Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FloatingIPsTestJSON-462849604 Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:39:53.466358 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e1f38a9cdeb14975aa882e4eea87e91a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e1f38a9cdeb14975aa882e4eea87e91a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1f38a9cdeb14975aa882e4eea87e91a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1f38a9cdeb14975aa882e4eea87e91a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FloatingIPsTestJSON-462849604 Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: e1f38a9cdeb14975aa882e4eea87e91a Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FloatingIPsTestJSON-462849604 Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FloatingIPsTestJSON-462849604-project Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: f406d8559fa6404db2c8eb832e12093b Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FloatingIPsTestJSON-462849604-project Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: exception: Floating IP not found for ID b8c24b12-d9ad-4955-9b98-44d51188ea3b Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'b8c24b12-d9ad-4955-9b98-44d51188ea3b'} Sep 08 12:39:53.468113 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:39:53.468952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b8c24b12-d9ad-4955-9b98-44d51188ea3b could not be found Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-245c0d7d-24f2-4123-bfe9-15d369209ee3'] Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b8c24b12-d9ad-4955-9b98-44d51188ea3b. Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.470406 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b8c24b12-d9ad-4955-9b98-44d51188ea3b Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:53.472580 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:53.475266 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b8c24b12-d9ad-4955-9b98-44d51188ea3b Sep 08 12:39:53.475266 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.475266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36da7393-c1b1-409b-abab-8db1de73c9c7 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Returning 404 to user: Floating IP not found for ID b8c24b12-d9ad-4955-9b98-44d51188ea3b {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:53.475266 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36da7393-c1b1-409b-abab-8db1de73c9c7 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/b8c24b12-d9ad-4955-9b98-44d51188ea3b" status: 404 len: 111 microversion: 2.1 time: 0.142671 Sep 08 12:39:53.475266 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 319/624] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:39:53 2022] GET /compute/v2.1/os-floating-ips/b8c24b12-d9ad-4955-9b98-44d51188ea3b => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:53.476010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b095dde4-8a9b-4a4c-ba1d-d68840ddda88 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:53.476010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b095dde4-8a9b-4a4c-ba1d-d68840ddda88 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:53.482026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8530591a-74b9-4d1b-af5e-372034a02ff9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:53.482676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8530591a-74b9-4d1b-af5e-372034a02ff9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:53.483163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b095dde4-8a9b-4a4c-ba1d-d68840ddda88 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:53.483707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b095dde4-8a9b-4a4c-ba1d-d68840ddda88 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:53.484186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b095dde4-8a9b-4a4c-ba1d-d68840ddda88 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:53.485017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b095dde4-8a9b-4a4c-ba1d-d68840ddda88 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:53.485712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b095dde4-8a9b-4a4c-ba1d-d68840ddda88 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:53.486223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b095dde4-8a9b-4a4c-ba1d-d68840ddda88 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:53.567529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8530591a-74b9-4d1b-af5e-372034a02ff9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:53.575321 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8530591a-74b9-4d1b-af5e-372034a02ff9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1216 microversion: 2.1 time: 0.105634 Sep 08 12:39:53.575948 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 320/625] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:53 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1216 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:53.580849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-94b908b5-c091-4954-bd56-0d0d639d216b tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:53.582306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-94b908b5-c091-4954-bd56-0d0d639d216b tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '7d474b3328384d2f932d2a08b67bf278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74c65d5aea444b29f9cd813b79b3670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-94b908b5-c091-4954-bd56-0d0d639d216b tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Request method failure captured: Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/flavors/43080848/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeKVOM25nhPvVvm9K6J72a0k_zlS5G8g0Z6C0fDGVkCpXcDPP28IvsOVDOyQanHyq9yPRuDC39xHbIe8EHqvWqZkaIYC6qXnz5y-M8N54UGX7__kPgnZyK8s3mIlkFR8oUzLmhn22bEjw5o21okJ16xYz-a7yDiNsDQMqd968HvPRBE Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: e74c65d5aea444b29f9cd813b79b3670 Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:39:53.584212 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:39:53.587578 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:53.587578 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 Sep 08 12:39:53.587578 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: e74c65d5aea444b29f9cd813b79b3670 Sep 08 12:39:53.587578 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 Sep 08 12:39:53.587578 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project Sep 08 12:39:53.587578 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:53.587578 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:53.587578 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 7d474b3328384d2f932d2a08b67bf278 Sep 08 12:39:53.587578 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project Sep 08 12:39:53.587578 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:39:53.587578 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'flavor_id': '43080848', 'id': 'hw:numa_nodes'} Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:39:53.588857 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.592039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-94b908b5-c091-4954-bd56-0d0d639d216b tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:53.594789 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-94b908b5-c091-4954-bd56-0d0d639d216b tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] 10.222.0.78 "DELETE /compute/v2.1/flavors/43080848/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.008709 Sep 08 12:39:53.594789 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 321/626] 10.222.0.78 () {58 vars in 1242 bytes} [Thu Sep 8 12:39:53 2022] DELETE /compute/v2.1/flavors/43080848/os-extra_specs/hw:numa_nodes => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:53.596349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fe84bf62-c67a-4300-a0a1-84643d2a4e19 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Calling method '.version_select at 0x7fdb3b1bf790>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:53.665955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG neutronclient.v2_0.client [None req-fe84bf62-c67a-4300-a0a1-84643d2a4e19 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP b8c24b12-d9ad-4955-9b98-44d51188ea3b could not be found", "detail": ""}} {{(pid=128971) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:39:53.666877 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-fe84bf62-c67a-4300-a0a1-84643d2a4e19 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] HTTP exception thrown: Floating IP not found for ID b8c24b12-d9ad-4955-9b98-44d51188ea3b Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fe84bf62-c67a-4300-a0a1-84643d2a4e19 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Request method failure captured: Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-floating-ips/b8c24b12-d9ad-4955-9b98-44d51188ea3b HTTP/1.1 Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeKIWKXY4DhK0nWs1fH_pglGCQzUhXcAn_5AqujIASEDyAXkUusgr02bN_z9qiCrBXHAd-uTUqFtruZCrhjHRwMH1WrxJSqqi6K7ZzKjzximgYS-w_hvv0NbjIz_KdE5VwA72J-B3gwWNmRFFmcP0wtNk6trT_v5s7XDFK-zdhJVIt0 Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: e1f38a9cdeb14975aa882e4eea87e91a Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FloatingIPsTestJSON-462849604 Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:39:53.669670 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e1f38a9cdeb14975aa882e4eea87e91a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e1f38a9cdeb14975aa882e4eea87e91a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1f38a9cdeb14975aa882e4eea87e91a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e1f38a9cdeb14975aa882e4eea87e91a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FloatingIPsTestJSON-462849604 Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: e1f38a9cdeb14975aa882e4eea87e91a Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FloatingIPsTestJSON-462849604 Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FloatingIPsTestJSON-462849604-project Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: f406d8559fa6404db2c8eb832e12093b Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FloatingIPsTestJSON-462849604-project Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: exception: Floating IP not found for ID b8c24b12-d9ad-4955-9b98-44d51188ea3b Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'b8c24b12-d9ad-4955-9b98-44d51188ea3b'} Sep 08 12:39:53.671313 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:39:53.672213 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP b8c24b12-d9ad-4955-9b98-44d51188ea3b could not be found Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7df220d2-594e-40fb-8fdb-025b25ca5af1'] Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID b8c24b12-d9ad-4955-9b98-44d51188ea3b. Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.674695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID b8c24b12-d9ad-4955-9b98-44d51188ea3b Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:53.676264 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:53.677698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID b8c24b12-d9ad-4955-9b98-44d51188ea3b Sep 08 12:39:53.677698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.679515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fe84bf62-c67a-4300-a0a1-84643d2a4e19 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] Returning 404 to user: Floating IP not found for ID b8c24b12-d9ad-4955-9b98-44d51188ea3b {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:53.681330 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fe84bf62-c67a-4300-a0a1-84643d2a4e19 tempest-FloatingIPsTestJSON-462849604 tempest-FloatingIPsTestJSON-462849604-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/b8c24b12-d9ad-4955-9b98-44d51188ea3b" status: 404 len: 111 microversion: 2.1 time: 0.088393 Sep 08 12:39:53.681810 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 322/627] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:39:53 2022] DELETE /compute/v2.1/os-floating-ips/b8c24b12-d9ad-4955-9b98-44d51188ea3b => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:53.703868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3b9e0440-d34b-491a-b184-b4ac4d65dae1 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:53.743511 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3b9e0440-d34b-491a-b184-b4ac4d65dae1 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/43080848/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.059808 Sep 08 12:39:53.744893 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 323/628] 10.222.0.78 () {60 vars in 1218 bytes} [Thu Sep 8 12:39:53 2022] POST /compute/v2.1/flavors/43080848/os-extra_specs => generated 66 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:39:53.758292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c7b56933-ef37-4658-a7a8-6fbaac4f8a97 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:53.764425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c7b56933-ef37-4658-a7a8-6fbaac4f8a97 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '7d474b3328384d2f932d2a08b67bf278', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74c65d5aea444b29f9cd813b79b3670', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c7b56933-ef37-4658-a7a8-6fbaac4f8a97 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Request method failure captured: Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: request: PUT /compute/v2.1/flavors/43080848/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 22 Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeKVOM25nhPvVvm9K6J72a0k_zlS5G8g0Z6C0fDGVkCpXcDPP28IvsOVDOyQanHyq9yPRuDC39xHbIe8EHqvWqZkaIYC6qXnz5y-M8N54UGX7__kPgnZyK8s3mIlkFR8oUzLmhn22bEjw5o21okJ16xYz-a7yDiNsDQMqd968HvPRBE Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: e74c65d5aea444b29f9cd813b79b3670 Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:39:53.766607 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e74c65d5aea444b29f9cd813b79b3670"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: e74c65d5aea444b29f9cd813b79b3670 Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 7d474b3328384d2f932d2a08b67bf278 Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: {"hw:numa_nodes": "1"} Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:39:53.767925 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'flavor_id': '43080848', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:39:53.768699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Sep 08 12:39:53.770173 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.773295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c7b56933-ef37-4658-a7a8-6fbaac4f8a97 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:53.773295 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c7b56933-ef37-4658-a7a8-6fbaac4f8a97 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063 tempest-FlavorsExtraSpecsNegativeTestJSON-732105063-project] 10.222.0.78 "PUT /compute/v2.1/flavors/43080848/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.019120 Sep 08 12:39:53.773295 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 324/629] 10.222.0.78 () {60 vars in 1259 bytes} [Thu Sep 8 12:39:53 2022] PUT /compute/v2.1/flavors/43080848/os-extra_specs/hw:numa_nodes => generated 124 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:53.783452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0f7c1b4-3004-4cb4-ad96-078483b9ebe9 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:53.788750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b095dde4-8a9b-4a4c-ba1d-d68840ddda88 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:53.793359 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-f0f7c1b4-3004-4cb4-ad96-078483b9ebe9 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] HTTP exception thrown: Flavor 43080848 has no extra specs with key hw:cpu_thread_policy. Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0f7c1b4-3004-4cb4-ad96-078483b9ebe9 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Request method failure captured: Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/flavors/43080848/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeKWqwmTSLFbbTvcE7V3qZAayv1ij1ltx-h5i61f-8bsTO9nPlYRfXlYL_s2R0z9ubBY_dRrKRoxqm4xRnXjpLoDwz5bckDM2cXTBB3fc26uJG9lcr0EaL94gZ9s7_kx2VSu2Q_NHrW9If7JhHB8tSwwZ-KOIKGjaGEAK3jkbzcfCQM Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 495303223ed04313b0e53e1feec9a354 Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:39:53.794928 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:39:53.796456 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_495303223ed04313b0e53e1feec9a354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/495303223ed04313b0e53e1feec9a354"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/495303223ed04313b0e53e1feec9a354"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/495303223ed04313b0e53e1feec9a354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:53.796456 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 Sep 08 12:39:53.796456 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 495303223ed04313b0e53e1feec9a354 Sep 08 12:39:53.796456 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 Sep 08 12:39:53.796456 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin Sep 08 12:39:53.796456 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:53.796456 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:53.796456 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 440720ed96e34c179d1c11e8221453e0 Sep 08 12:39:53.796456 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin Sep 08 12:39:53.796456 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:39:53.796456 n-d-852084-10 devstack@n-api.service[128971]: exception: Flavor 43080848 has no extra specs with key hw:cpu_thread_policy. Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'flavor_id': '43080848', 'id': 'hw:cpu_thread_policy'} Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 43080848 has no extra specs with key hw:cpu_thread_policy. Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.797535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.799439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.799439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.799439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.799439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:53.799439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:53.799439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 43080848 has no extra specs with key hw:cpu_thread_policy. Sep 08 12:39:53.799439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.799439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0f7c1b4-3004-4cb4-ad96-078483b9ebe9 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Returning 404 to user: Flavor 43080848 has no extra specs with key hw:cpu_thread_policy. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:53.799439 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0f7c1b4-3004-4cb4-ad96-078483b9ebe9 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/43080848/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 111 microversion: 2.1 time: 0.017371 Sep 08 12:39:53.799439 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 325/630] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:39:53 2022] DELETE /compute/v2.1/flavors/43080848/os-extra_specs/hw:cpu_thread_policy => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:39:53.801504 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b095dde4-8a9b-4a4c-ba1d-d68840ddda88 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1502 microversion: 2.1 time: 0.337908 Sep 08 12:39:53.815674 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 306/631] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:53 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1502 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:53.816099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5a9813a2-8e06-4895-aa07-ed773e721c40 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:53.818953 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-5a9813a2-8e06-4895-aa07-ed773e721c40 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] HTTP exception thrown: Request body and URI mismatch Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5a9813a2-8e06-4895-aa07-ed773e721c40 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Request method failure captured: Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: request: PUT /compute/v2.1/flavors/43080848/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 27 Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeKWqwmTSLFbbTvcE7V3qZAayv1ij1ltx-h5i61f-8bsTO9nPlYRfXlYL_s2R0z9ubBY_dRrKRoxqm4xRnXjpLoDwz5bckDM2cXTBB3fc26uJG9lcr0EaL94gZ9s7_kx2VSu2Q_NHrW9If7JhHB8tSwwZ-KOIKGjaGEAK3jkbzcfCQM Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 495303223ed04313b0e53e1feec9a354 Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:39:53.820455 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_495303223ed04313b0e53e1feec9a354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/495303223ed04313b0e53e1feec9a354"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/495303223ed04313b0e53e1feec9a354"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/495303223ed04313b0e53e1feec9a354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 495303223ed04313b0e53e1feec9a354 Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 440720ed96e34c179d1c11e8221453e0 Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: {"hw:cpu_policy": "shared"} Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:39:53.821769 n-d-852084-10 devstack@n-api.service[128971]: exception: Request body and URI mismatch Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'flavor_id': '43080848', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.822536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.825658 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:39:53.825658 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:39:53.825658 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Sep 08 12:39:53.825658 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.825658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5a9813a2-8e06-4895-aa07-ed773e721c40 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:53.825658 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5a9813a2-8e06-4895-aa07-ed773e721c40 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/43080848/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.015895 Sep 08 12:39:53.829561 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 326/632] 10.222.0.78 () {60 vars in 1259 bytes} [Thu Sep 8 12:39:53 2022] PUT /compute/v2.1/flavors/43080848/os-extra_specs/hw:numa_nodes => generated 73 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 08 12:39:53.835758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fce5a87a-1527-4cf8-ba5c-b49b508c9839 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fce5a87a-1527-4cf8-ba5c-b49b508c9839 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Request method failure captured: Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/flavors/43080848/os-extra_specs/hw:numa_nodes HTTP/1.1 Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 49 Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKWqwmTSLFbbTvcE7V3qZAayv1ij1ltx-h5i61f-8bsTO9nPlYRfXlYL_s2R0z9ubBY_dRrKRoxqm4xRnXjpLoDwz5bckDM2cXTBB3fc26uJG9lcr0EaL94gZ9s7_kx2VSu2Q_NHrW9If7JhHB8tSwwZ-KOIKGjaGEAK3jkbzcfCQM Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 495303223ed04313b0e53e1feec9a354 Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:39:53.843459 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:39:53.844929 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_495303223ed04313b0e53e1feec9a354"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/495303223ed04313b0e53e1feec9a354"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/495303223ed04313b0e53e1feec9a354"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/495303223ed04313b0e53e1feec9a354"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:39:53.844929 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 Sep 08 12:39:53.844929 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 495303223ed04313b0e53e1feec9a354 Sep 08 12:39:53.844929 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 Sep 08 12:39:53.844929 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin Sep 08 12:39:53.844929 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:39:53.844929 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:39:53.844929 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 440720ed96e34c179d1c11e8221453e0 Sep 08 12:39:53.844929 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin Sep 08 12:39:53.844929 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:39:53.844929 n-d-852084-10 devstack@n-api.service[128970]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Sep 08 12:39:53.844929 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'flavor_id': '43080848', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': ['string', Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'number']}}, Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance: Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Sep 08 12:39:53.845647 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.846968 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:39:53.849833 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:39:53.849833 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:39:53.849833 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:39:53.849833 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:39:53.849833 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Sep 08 12:39:53.849833 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:39:53.851421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fce5a87a-1527-4cf8-ba5c-b49b508c9839 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:39:53.852499 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fce5a87a-1527-4cf8-ba5c-b49b508c9839 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/43080848/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.021763 Sep 08 12:39:53.853537 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 307/633] 10.222.0.78 () {60 vars in 1259 bytes} [Thu Sep 8 12:39:53 2022] PUT /compute/v2.1/flavors/43080848/os-extra_specs/hw:numa_nodes => generated 117 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:39:53.862114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e7bcd513-ad41-4f7b-ab1e-81c4197c6646 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:53.892286 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e7bcd513-ad41-4f7b-ab1e-81c4197c6646 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/43080848" status: 202 len: 0 microversion: 2.1 time: 0.033136 Sep 08 12:39:53.892945 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 327/634] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:39:53 2022] DELETE /compute/v2.1/flavors/43080848 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:39:53.904169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-087a44cb-fb52-4801-8ecf-2161070da782 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:53.929458 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-087a44cb-fb52-4801-8ecf-2161070da782 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932 tempest-FlavorsExtraSpecsNegativeTestJSON-1375094932-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.030427 Sep 08 12:39:53.930058 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 308/635] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:39:53 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:54.350183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f3839766-2d4f-4064-a61d-c5e6bb0266b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:54.351021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f3839766-2d4f-4064-a61d-c5e6bb0266b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:54.363445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3839766-2d4f-4064-a61d-c5e6bb0266b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:54.364539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3839766-2d4f-4064-a61d-c5e6bb0266b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:54.365179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3839766-2d4f-4064-a61d-c5e6bb0266b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:54.366502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3839766-2d4f-4064-a61d-c5e6bb0266b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:54.367700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3839766-2d4f-4064-a61d-c5e6bb0266b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:54.368688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3839766-2d4f-4064-a61d-c5e6bb0266b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:54.453940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc3883a4-b082-4a1b-843c-010997a305d7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:54.454614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc3883a4-b082-4a1b-843c-010997a305d7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:54.463564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc3883a4-b082-4a1b-843c-010997a305d7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:54.464549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc3883a4-b082-4a1b-843c-010997a305d7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:54.465273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc3883a4-b082-4a1b-843c-010997a305d7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:54.466573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc3883a4-b082-4a1b-843c-010997a305d7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:54.467468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc3883a4-b082-4a1b-843c-010997a305d7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:54.468173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc3883a4-b082-4a1b-843c-010997a305d7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:54.973229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f3839766-2d4f-4064-a61d-c5e6bb0266b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:54.985136 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f3839766-2d4f-4064-a61d-c5e6bb0266b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.642453 Sep 08 12:39:55.000496 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 328/636] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:54 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:55.007887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-88197de5-5cf4-41c5-9c9e-a3050589acfd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:55.008610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-88197de5-5cf4-41c5-9c9e-a3050589acfd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:55.017068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88197de5-5cf4-41c5-9c9e-a3050589acfd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:55.017622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88197de5-5cf4-41c5-9c9e-a3050589acfd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:55.018313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88197de5-5cf4-41c5-9c9e-a3050589acfd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:55.019259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88197de5-5cf4-41c5-9c9e-a3050589acfd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:55.019795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88197de5-5cf4-41c5-9c9e-a3050589acfd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:55.020616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88197de5-5cf4-41c5-9c9e-a3050589acfd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:55.048137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc3883a4-b082-4a1b-843c-010997a305d7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:55.059081 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc3883a4-b082-4a1b-843c-010997a305d7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1319 microversion: 2.1 time: 0.617249 Sep 08 12:39:55.060987 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 309/637] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:54 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1319 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:55.066877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00dda1ed-540b-428c-ad38-ea9a39b9b3ae tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:55.084144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00dda1ed-540b-428c-ad38-ea9a39b9b3ae tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:55.092427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00dda1ed-540b-428c-ad38-ea9a39b9b3ae tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:55.092921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00dda1ed-540b-428c-ad38-ea9a39b9b3ae tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:55.093354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00dda1ed-540b-428c-ad38-ea9a39b9b3ae tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:55.094096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00dda1ed-540b-428c-ad38-ea9a39b9b3ae tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:55.094546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00dda1ed-540b-428c-ad38-ea9a39b9b3ae tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:55.094997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00dda1ed-540b-428c-ad38-ea9a39b9b3ae tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:55.224011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-88197de5-5cf4-41c5-9c9e-a3050589acfd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:55.235476 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-88197de5-5cf4-41c5-9c9e-a3050589acfd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1268 microversion: 2.1 time: 0.233453 Sep 08 12:39:55.261318 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 329/638] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:55 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1268 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:55.959040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00dda1ed-540b-428c-ad38-ea9a39b9b3ae tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:55.969109 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00dda1ed-540b-428c-ad38-ea9a39b9b3ae tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1502 microversion: 2.1 time: 0.906778 Sep 08 12:39:55.991978 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 310/639] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:55 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1502 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:56.012186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-643646a4-2b0a-4847-a5ec-0e7727ef070c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:56.013430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-643646a4-2b0a-4847-a5ec-0e7727ef070c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:56.021459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-643646a4-2b0a-4847-a5ec-0e7727ef070c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:56.022651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-643646a4-2b0a-4847-a5ec-0e7727ef070c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:56.023541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-643646a4-2b0a-4847-a5ec-0e7727ef070c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:56.024759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-643646a4-2b0a-4847-a5ec-0e7727ef070c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:56.025515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-643646a4-2b0a-4847-a5ec-0e7727ef070c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:56.026264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-643646a4-2b0a-4847-a5ec-0e7727ef070c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:56.092546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ef1f0613-63ae-42b3-a25c-24b80f2a80ba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:56.093190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ef1f0613-63ae-42b3-a25c-24b80f2a80ba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:56.104441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef1f0613-63ae-42b3-a25c-24b80f2a80ba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:56.104937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef1f0613-63ae-42b3-a25c-24b80f2a80ba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:56.106107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef1f0613-63ae-42b3-a25c-24b80f2a80ba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:56.108147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef1f0613-63ae-42b3-a25c-24b80f2a80ba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:56.109589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef1f0613-63ae-42b3-a25c-24b80f2a80ba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:56.110207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef1f0613-63ae-42b3-a25c-24b80f2a80ba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:56.572530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-643646a4-2b0a-4847-a5ec-0e7727ef070c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:56.593644 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-643646a4-2b0a-4847-a5ec-0e7727ef070c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.584839 Sep 08 12:39:56.594313 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 330/640] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:56 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:56.602894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ef1f0613-63ae-42b3-a25c-24b80f2a80ba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:56.617829 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ef1f0613-63ae-42b3-a25c-24b80f2a80ba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1319 microversion: 2.1 time: 0.533394 Sep 08 12:39:56.619130 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 311/641] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:56 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1319 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:56.619313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5c33be20-c1d4-41d2-9b8d-88b298f6339a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:56.620247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5c33be20-c1d4-41d2-9b8d-88b298f6339a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:56.636804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c33be20-c1d4-41d2-9b8d-88b298f6339a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:56.637661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c33be20-c1d4-41d2-9b8d-88b298f6339a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:56.638298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c33be20-c1d4-41d2-9b8d-88b298f6339a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:56.639211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c33be20-c1d4-41d2-9b8d-88b298f6339a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:56.639861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c33be20-c1d4-41d2-9b8d-88b298f6339a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:56.640639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c33be20-c1d4-41d2-9b8d-88b298f6339a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:56.796967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5c33be20-c1d4-41d2-9b8d-88b298f6339a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:56.808987 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5c33be20-c1d4-41d2-9b8d-88b298f6339a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1274 microversion: 2.1 time: 0.202314 Sep 08 12:39:56.831677 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 331/642] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:56 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1274 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:56.997838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dea8cf10-544b-46cf-a1cb-af5fca69f1cc tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:56.999505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dea8cf10-544b-46cf-a1cb-af5fca69f1cc tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:57.011800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dea8cf10-544b-46cf-a1cb-af5fca69f1cc tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:57.013375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dea8cf10-544b-46cf-a1cb-af5fca69f1cc tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:57.014214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dea8cf10-544b-46cf-a1cb-af5fca69f1cc tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:57.015172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dea8cf10-544b-46cf-a1cb-af5fca69f1cc tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:57.015870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dea8cf10-544b-46cf-a1cb-af5fca69f1cc tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:57.021224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dea8cf10-544b-46cf-a1cb-af5fca69f1cc tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:57.460810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dea8cf10-544b-46cf-a1cb-af5fca69f1cc tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:57.476098 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dea8cf10-544b-46cf-a1cb-af5fca69f1cc tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1502 microversion: 2.1 time: 0.484288 Sep 08 12:39:57.491275 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 312/643] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:56 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1502 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:57.681869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8234f2b2-02e9-40c6-b81e-2b9c0091d3ee tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:57.685217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d7c73016-c081-4720-8d64-25f540f1c160 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:57.687613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8234f2b2-02e9-40c6-b81e-2b9c0091d3ee tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:57.689419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d7c73016-c081-4720-8d64-25f540f1c160 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:57.719428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7c73016-c081-4720-8d64-25f540f1c160 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:57.719786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8234f2b2-02e9-40c6-b81e-2b9c0091d3ee tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:57.720596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8234f2b2-02e9-40c6-b81e-2b9c0091d3ee tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:57.723876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8234f2b2-02e9-40c6-b81e-2b9c0091d3ee tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:57.724761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7c73016-c081-4720-8d64-25f540f1c160 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:57.726170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8234f2b2-02e9-40c6-b81e-2b9c0091d3ee tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:57.727549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7c73016-c081-4720-8d64-25f540f1c160 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:57.728240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8234f2b2-02e9-40c6-b81e-2b9c0091d3ee tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:57.729163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7c73016-c081-4720-8d64-25f540f1c160 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:57.731043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8234f2b2-02e9-40c6-b81e-2b9c0091d3ee tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:57.731769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7c73016-c081-4720-8d64-25f540f1c160 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:57.734872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7c73016-c081-4720-8d64-25f540f1c160 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:58.350404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d7c73016-c081-4720-8d64-25f540f1c160 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:58.367674 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d7c73016-c081-4720-8d64-25f540f1c160 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.705301 Sep 08 12:39:58.368291 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 332/644] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:57 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:58.384069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-af3d6426-1f0e-4d07-b0b5-22dce5ec7708 req-f18e02d9-b7cf-40f8-bbbd-494c54a9187a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "008c9433-e7cf-4506-9339-2dd946294037", "tag": "5aad67aa-ba76-429e-9c9b-9bc4ccfc772e"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:58.446264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-af3d6426-1f0e-4d07-b0b5-22dce5ec7708 req-f18e02d9-b7cf-40f8-bbbd-494c54a9187a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:58.452100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-af3d6426-1f0e-4d07-b0b5-22dce5ec7708 req-f18e02d9-b7cf-40f8-bbbd-494c54a9187a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:58.452696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-af3d6426-1f0e-4d07-b0b5-22dce5ec7708 req-f18e02d9-b7cf-40f8-bbbd-494c54a9187a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:58.471513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8234f2b2-02e9-40c6-b81e-2b9c0091d3ee tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:58.486319 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-af3d6426-1f0e-4d07-b0b5-22dce5ec7708 req-f18e02d9-b7cf-40f8-bbbd-494c54a9187a service nova] Creating event network-changed:5aad67aa-ba76-429e-9c9b-9bc4ccfc772e for instance 008c9433-e7cf-4506-9339-2dd946294037 on n-h1-852084-10 Sep 08 12:39:58.491710 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-af3d6426-1f0e-4d07-b0b5-22dce5ec7708 req-f18e02d9-b7cf-40f8-bbbd-494c54a9187a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121886 Sep 08 12:39:58.492217 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8234f2b2-02e9-40c6-b81e-2b9c0091d3ee tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1319 microversion: 2.1 time: 0.823180 Sep 08 12:39:58.492637 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 333/645] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:39:58.493499 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 313/646] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:57 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1319 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:39:58.498465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f1da1caf-2069-423d-9586-fe48a8895ff2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:58.498852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f1da1caf-2069-423d-9586-fe48a8895ff2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:58.511123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1da1caf-2069-423d-9586-fe48a8895ff2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:58.515936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f75ee98-ce9d-42ca-a192-08dac20de665 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:58.516916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8f75ee98-ce9d-42ca-a192-08dac20de665 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:58.523825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1da1caf-2069-423d-9586-fe48a8895ff2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:58.524713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1da1caf-2069-423d-9586-fe48a8895ff2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:58.525720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1da1caf-2069-423d-9586-fe48a8895ff2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:58.526020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1da1caf-2069-423d-9586-fe48a8895ff2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:58.526376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1da1caf-2069-423d-9586-fe48a8895ff2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:58.543441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f75ee98-ce9d-42ca-a192-08dac20de665 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:58.545932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f75ee98-ce9d-42ca-a192-08dac20de665 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:58.547079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f75ee98-ce9d-42ca-a192-08dac20de665 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:58.548339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f75ee98-ce9d-42ca-a192-08dac20de665 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:58.549216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f75ee98-ce9d-42ca-a192-08dac20de665 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:58.549932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f75ee98-ce9d-42ca-a192-08dac20de665 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:58.971155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f1da1caf-2069-423d-9586-fe48a8895ff2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:58.988093 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f1da1caf-2069-423d-9586-fe48a8895ff2 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1316 microversion: 2.1 time: 0.493756 Sep 08 12:39:58.990864 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 334/647] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:58 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1316 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:59.290148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8f75ee98-ce9d-42ca-a192-08dac20de665 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:59.301176 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f75ee98-ce9d-42ca-a192-08dac20de665 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1502 microversion: 2.1 time: 0.797431 Sep 08 12:39:59.302547 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 314/648] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:58 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1502 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:59.406049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-91422741-6ac0-4a37-abe5-b85685b0559c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:59.407324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-91422741-6ac0-4a37-abe5-b85685b0559c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:59.416648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91422741-6ac0-4a37-abe5-b85685b0559c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:59.419422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91422741-6ac0-4a37-abe5-b85685b0559c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:59.420105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91422741-6ac0-4a37-abe5-b85685b0559c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:59.422356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91422741-6ac0-4a37-abe5-b85685b0559c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:59.425072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91422741-6ac0-4a37-abe5-b85685b0559c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:59.425717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91422741-6ac0-4a37-abe5-b85685b0559c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:59.524898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1e7f646a-5ce4-45d5-a5a7-87138e20ae3a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:39:59.525834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1e7f646a-5ce4-45d5-a5a7-87138e20ae3a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:39:59.536872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:39:59.555492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e7f646a-5ce4-45d5-a5a7-87138e20ae3a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:59.558144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e7f646a-5ce4-45d5-a5a7-87138e20ae3a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:59.559638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e7f646a-5ce4-45d5-a5a7-87138e20ae3a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:59.561256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e7f646a-5ce4-45d5-a5a7-87138e20ae3a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:59.565213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e7f646a-5ce4-45d5-a5a7-87138e20ae3a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:59.566550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e7f646a-5ce4-45d5-a5a7-87138e20ae3a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:59.916592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-91422741-6ac0-4a37-abe5-b85685b0559c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:39:59.930249 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-91422741-6ac0-4a37-abe5-b85685b0559c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.531504 Sep 08 12:39:59.931750 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 335/649] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:59 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:39:59.952563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b10c4879-6ff1-4ca2-9dd3-678ff2a6b6b4 req-1b34cc7a-0d45-44e2-8298-db001f6399b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a774146-a939-4912-8b1e-b52822ced599", "tag": "a63ad412-f9c6-450f-b36d-46e365e0d8de"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:39:59.966471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b10c4879-6ff1-4ca2-9dd3-678ff2a6b6b4 req-1b34cc7a-0d45-44e2-8298-db001f6399b1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:39:59.967546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b10c4879-6ff1-4ca2-9dd3-678ff2a6b6b4 req-1b34cc7a-0d45-44e2-8298-db001f6399b1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:39:59.968239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b10c4879-6ff1-4ca2-9dd3-678ff2a6b6b4 req-1b34cc7a-0d45-44e2-8298-db001f6399b1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:39:59.983315 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b10c4879-6ff1-4ca2-9dd3-678ff2a6b6b4 req-1b34cc7a-0d45-44e2-8298-db001f6399b1 service nova] Creating event network-changed:a63ad412-f9c6-450f-b36d-46e365e0d8de for instance 5a774146-a939-4912-8b1e-b52822ced599 on n-h1-852084-10 Sep 08 12:39:59.990581 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b10c4879-6ff1-4ca2-9dd3-678ff2a6b6b4 req-1b34cc7a-0d45-44e2-8298-db001f6399b1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057049 Sep 08 12:39:59.991561 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 336/650] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:00.025240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d099fe43-1cf0-4c58-ae51-9b9a9fa76f05 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:00.026281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d099fe43-1cf0-4c58-ae51-9b9a9fa76f05 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:00.038108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d099fe43-1cf0-4c58-ae51-9b9a9fa76f05 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:00.038796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d099fe43-1cf0-4c58-ae51-9b9a9fa76f05 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:00.039485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d099fe43-1cf0-4c58-ae51-9b9a9fa76f05 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:00.040592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d099fe43-1cf0-4c58-ae51-9b9a9fa76f05 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:00.041521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d099fe43-1cf0-4c58-ae51-9b9a9fa76f05 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:00.042181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d099fe43-1cf0-4c58-ae51-9b9a9fa76f05 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:00.046676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1e7f646a-5ce4-45d5-a5a7-87138e20ae3a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:00.060897 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1e7f646a-5ce4-45d5-a5a7-87138e20ae3a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1319 microversion: 2.1 time: 0.545018 Sep 08 12:40:00.062336 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 315/651] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:39:59 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1319 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:00.331559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e1ea591-95cd-4d36-bc60-2b8035ba64d4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:00.332905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9e1ea591-95cd-4d36-bc60-2b8035ba64d4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:00.342881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e1ea591-95cd-4d36-bc60-2b8035ba64d4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:00.343420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e1ea591-95cd-4d36-bc60-2b8035ba64d4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:00.343999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e1ea591-95cd-4d36-bc60-2b8035ba64d4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:00.344813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e1ea591-95cd-4d36-bc60-2b8035ba64d4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:00.345333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e1ea591-95cd-4d36-bc60-2b8035ba64d4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:00.346236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e1ea591-95cd-4d36-bc60-2b8035ba64d4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:00.628355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d099fe43-1cf0-4c58-ae51-9b9a9fa76f05 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:00.640052 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d099fe43-1cf0-4c58-ae51-9b9a9fa76f05 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1316 microversion: 2.1 time: 0.623076 Sep 08 12:40:00.640850 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 337/652] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:00 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1316 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:00.722686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9e1ea591-95cd-4d36-bc60-2b8035ba64d4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:00.732102 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e1ea591-95cd-4d36-bc60-2b8035ba64d4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1492 microversion: 2.1 time: 0.406906 Sep 08 12:40:00.732700 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 316/653] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:00 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1492 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:00.755343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e4ed892-2776-4c67-a624-b812cd5fb1ec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '.version_select at 0x7fdb37104550>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:00.758765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e4ed892-2776-4c67-a624-b812cd5fb1ec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:00.759269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e4ed892-2776-4c67-a624-b812cd5fb1ec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:00.759711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e4ed892-2776-4c67-a624-b812cd5fb1ec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:00.769031 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e4ed892-2776-4c67-a624-b812cd5fb1ec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1196 microversion: 2.1 time: 0.017324 Sep 08 12:40:00.779287 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 317/654] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 12:40:00 2022] GET /compute/v2.1/os-migrations => generated 1196 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:00.791741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-62abd9ca-dce1-4b5e-b0c6-398cf63ef6e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:00.792378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-62abd9ca-dce1-4b5e-b0c6-398cf63ef6e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:00.799475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62abd9ca-dce1-4b5e-b0c6-398cf63ef6e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:00.799971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62abd9ca-dce1-4b5e-b0c6-398cf63ef6e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:00.800408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62abd9ca-dce1-4b5e-b0c6-398cf63ef6e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:00.801108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62abd9ca-dce1-4b5e-b0c6-398cf63ef6e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:00.801560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62abd9ca-dce1-4b5e-b0c6-398cf63ef6e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:00.801980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62abd9ca-dce1-4b5e-b0c6-398cf63ef6e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:00.866719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-43a18e9d-086c-4034-b699-ed8fe0c5bef4 tempest-FlavorsV261TestJSON-1657821940 tempest-FlavorsV261TestJSON-1657821940-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1235975561", "id": 988972079, "os-flavor-access:is_public": "True"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:00.895679 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-43a18e9d-086c-4034-b699-ed8fe0c5bef4 tempest-FlavorsV261TestJSON-1657821940 tempest-FlavorsV261TestJSON-1657821940-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.213432 Sep 08 12:40:00.897195 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 338/655] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 12:40:00 2022] POST /compute/v2.1/flavors => generated 465 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 12:40:00.998071 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-62abd9ca-dce1-4b5e-b0c6-398cf63ef6e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1645 microversion: 2.1 time: 0.210000 Sep 08 12:40:00.998659 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 318/656] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:00 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1645 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:01.003694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e8c9a0f-dead-4003-a8d9-ea450bb89a38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:01.004392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8e8c9a0f-dead-4003-a8d9-ea450bb89a38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:01.010557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e8c9a0f-dead-4003-a8d9-ea450bb89a38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:01.011113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e8c9a0f-dead-4003-a8d9-ea450bb89a38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:01.012324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e8c9a0f-dead-4003-a8d9-ea450bb89a38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:01.013275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e8c9a0f-dead-4003-a8d9-ea450bb89a38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:01.013814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e8c9a0f-dead-4003-a8d9-ea450bb89a38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:01.014483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e8c9a0f-dead-4003-a8d9-ea450bb89a38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:01.070763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c9d4b1ae-9ebd-464e-bac2-13aad618e069 tempest-FlavorsV261TestJSON-152464977 tempest-FlavorsV261TestJSON-152464977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:01.096423 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c9d4b1ae-9ebd-464e-bac2-13aad618e069 tempest-FlavorsV261TestJSON-152464977 tempest-FlavorsV261TestJSON-152464977-project] 10.222.0.78 "GET /compute/v2.1/flavors/988972079" status: 200 len: 465 microversion: 2.61 time: 0.182725 Sep 08 12:40:01.096990 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 339/657] 10.222.0.78 () {60 vars in 1196 bytes} [Thu Sep 8 12:40:00 2022] GET /compute/v2.1/flavors/988972079 => generated 465 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 12:40:01.101795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db9bc619-1ee7-4697-b171-e4192f686e16 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:01.103372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-db9bc619-1ee7-4697-b171-e4192f686e16 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:01.112647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db9bc619-1ee7-4697-b171-e4192f686e16 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:01.113744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db9bc619-1ee7-4697-b171-e4192f686e16 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:01.114666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db9bc619-1ee7-4697-b171-e4192f686e16 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:01.115708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db9bc619-1ee7-4697-b171-e4192f686e16 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:01.116680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db9bc619-1ee7-4697-b171-e4192f686e16 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:01.117483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db9bc619-1ee7-4697-b171-e4192f686e16 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:01.247576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8e8c9a0f-dead-4003-a8d9-ea450bb89a38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:01.256494 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8e8c9a0f-dead-4003-a8d9-ea450bb89a38 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.256394 Sep 08 12:40:01.257310 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 319/658] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:00 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:01.265691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-94d3525e-976f-40a5-a8e1-c000617bee94 tempest-FlavorsV261TestJSON-1657821940 tempest-FlavorsV261TestJSON-1657821940-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3cd96d30>, body: {"flavor": {"description": "new"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:01.318678 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-94d3525e-976f-40a5-a8e1-c000617bee94 tempest-FlavorsV261TestJSON-1657821940 tempest-FlavorsV261TestJSON-1657821940-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/988972079" status: 200 len: 466 microversion: 2.61 time: 0.057797 Sep 08 12:40:01.319872 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 320/659] 10.222.0.78 () {62 vars in 1216 bytes} [Thu Sep 8 12:40:01 2022] PUT /compute/v2.1/flavors/988972079 => generated 466 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:40:01.327027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-502810778", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "9714d2bd-3c28-4c33-8e0b-3c4e73fb2914"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:01.340733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-db9bc619-1ee7-4697-b171-e4192f686e16 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:01.348823 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-db9bc619-1ee7-4697-b171-e4192f686e16 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1319 microversion: 2.1 time: 0.250612 Sep 08 12:40:01.355531 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 340/660] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:01 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1319 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:01.366452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36df4446-14c6-4a46-bab0-97b567695e32 tempest-FlavorsV261TestJSON-152464977 tempest-FlavorsV261TestJSON-152464977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:01.400763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] validate_networks() for [('9714d2bd-3c28-4c33-8e0b-3c4e73fb2914', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:40:01.405513 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36df4446-14c6-4a46-bab0-97b567695e32 tempest-FlavorsV261TestJSON-152464977 tempest-FlavorsV261TestJSON-152464977-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 7152 microversion: 2.61 time: 0.048070 Sep 08 12:40:01.406217 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 341/661] 10.222.0.78 () {60 vars in 1187 bytes} [Thu Sep 8 12:40:01 2022] GET /compute/v2.1/flavors/detail => generated 7152 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:01.428667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dae34e94-7036-4f80-86e1-82e2d847294b tempest-FlavorsV261TestJSON-152464977 tempest-FlavorsV261TestJSON-152464977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:01.452321 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dae34e94-7036-4f80-86e1-82e2d847294b tempest-FlavorsV261TestJSON-152464977 tempest-FlavorsV261TestJSON-152464977-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 3679 microversion: 2.61 time: 0.027558 Sep 08 12:40:01.459437 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 342/662] 10.222.0.78 () {60 vars in 1166 bytes} [Thu Sep 8 12:40:01 2022] GET /compute/v2.1/flavors => generated 3679 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:01.470524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c14d2599-3304-4341-96db-b6e5ba3edb22 tempest-FlavorsV261TestJSON-1657821940 tempest-FlavorsV261TestJSON-1657821940-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:01.491539 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c14d2599-3304-4341-96db-b6e5ba3edb22 tempest-FlavorsV261TestJSON-1657821940 tempest-FlavorsV261TestJSON-1657821940-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/988972079" status: 202 len: 0 microversion: 2.61 time: 0.025371 Sep 08 12:40:01.492608 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 343/663] 10.222.0.78 () {60 vars in 1199 bytes} [Thu Sep 8 12:40:01 2022] DELETE /compute/v2.1/flavors/988972079 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 12:40:01.502194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-61b58c35-b81a-4100-b238-ab07322d9008 tempest-FlavorsV261TestJSON-1657821940 tempest-FlavorsV261TestJSON-1657821940-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:01.533058 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-61b58c35-b81a-4100-b238-ab07322d9008 tempest-FlavorsV261TestJSON-1657821940 tempest-FlavorsV261TestJSON-1657821940-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 6696 microversion: 2.61 time: 0.035694 Sep 08 12:40:01.535015 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 344/664] 10.222.0.78 () {60 vars in 1187 bytes} [Thu Sep 8 12:40:01 2022] GET /compute/v2.1/flavors/detail => generated 6696 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:01.666683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3fe0e39-6eb2-49b6-a198-0479ee2b968b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:01.667971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d3fe0e39-6eb2-49b6-a198-0479ee2b968b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:01.687471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3fe0e39-6eb2-49b6-a198-0479ee2b968b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:01.691330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3fe0e39-6eb2-49b6-a198-0479ee2b968b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:01.691924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3fe0e39-6eb2-49b6-a198-0479ee2b968b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:01.692837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3fe0e39-6eb2-49b6-a198-0479ee2b968b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:01.693474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3fe0e39-6eb2-49b6-a198-0479ee2b968b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:01.695552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3fe0e39-6eb2-49b6-a198-0479ee2b968b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:02.005009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d3fe0e39-6eb2-49b6-a198-0479ee2b968b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:02.008121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:40:02.008598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:40:02.010225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:40:02.012133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:40:02.012592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:40:02.013466 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3fe0e39-6eb2-49b6-a198-0479ee2b968b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1316 microversion: 2.1 time: 0.353402 Sep 08 12:40:02.014039 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 345/665] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:01 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1316 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:02.037222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:02.038151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:02.039485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:02.040448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:02.040916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:02.041787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:02.066251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Getting quotas for project 5619e927afd449c4897bd41f96390988. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:02.070961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Getting quotas for user c7375a1da7fb43d8a6725f61fa2c7ec9 and project 5619e927afd449c4897bd41f96390988. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:02.088194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:40:02.092728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:40:02.163065 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ff97c84d-21b0-4856-a80a-188d32f269b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.841137 Sep 08 12:40:02.164339 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 321/666] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:40:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 844 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:40:02.177246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4c8ee5fd-c62e-450e-88cf-44e1e01f9318 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:02.177886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4c8ee5fd-c62e-450e-88cf-44e1e01f9318 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:02.282002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae6db6a9-b667-4205-9c0e-1fdd3c664455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:02.282628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ae6db6a9-b667-4205-9c0e-1fdd3c664455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:02.296897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae6db6a9-b667-4205-9c0e-1fdd3c664455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:02.297587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae6db6a9-b667-4205-9c0e-1fdd3c664455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:02.298081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae6db6a9-b667-4205-9c0e-1fdd3c664455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:02.298810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae6db6a9-b667-4205-9c0e-1fdd3c664455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:02.302052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae6db6a9-b667-4205-9c0e-1fdd3c664455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:02.305078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae6db6a9-b667-4205-9c0e-1fdd3c664455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:02.342016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:02.376596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4c8ee5fd-c62e-450e-88cf-44e1e01f9318 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:02.387914 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4c8ee5fd-c62e-450e-88cf-44e1e01f9318 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1210 microversion: 2.1 time: 0.215705 Sep 08 12:40:02.389242 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 346/667] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:02 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1210 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:02.400743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1e240df7-022c-4979-80f9-321238798d2e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:02.403280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1e240df7-022c-4979-80f9-321238798d2e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:02.430201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e240df7-022c-4979-80f9-321238798d2e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:02.431852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e240df7-022c-4979-80f9-321238798d2e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:02.434115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e240df7-022c-4979-80f9-321238798d2e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:02.437755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e240df7-022c-4979-80f9-321238798d2e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:02.438507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e240df7-022c-4979-80f9-321238798d2e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:02.439812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e240df7-022c-4979-80f9-321238798d2e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:02.801257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ae6db6a9-b667-4205-9c0e-1fdd3c664455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:02.820232 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ae6db6a9-b667-4205-9c0e-1fdd3c664455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.543375 Sep 08 12:40:02.820823 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 322/668] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:02 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:02.912520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1e240df7-022c-4979-80f9-321238798d2e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:02.921277 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1e240df7-022c-4979-80f9-321238798d2e tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1319 microversion: 2.1 time: 0.530607 Sep 08 12:40:02.922182 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 347/669] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:02 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:03.039516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-312ce687-3575-4810-bafc-6bf7b54c5973 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:03.040118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-312ce687-3575-4810-bafc-6bf7b54c5973 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:03.046765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-312ce687-3575-4810-bafc-6bf7b54c5973 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:03.047287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-312ce687-3575-4810-bafc-6bf7b54c5973 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:03.048047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-312ce687-3575-4810-bafc-6bf7b54c5973 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:03.049208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-312ce687-3575-4810-bafc-6bf7b54c5973 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:03.050053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-312ce687-3575-4810-bafc-6bf7b54c5973 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:03.050682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-312ce687-3575-4810-bafc-6bf7b54c5973 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:03.227216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-312ce687-3575-4810-bafc-6bf7b54c5973 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:03.237246 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-312ce687-3575-4810-bafc-6bf7b54c5973 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1316 microversion: 2.1 time: 0.202467 Sep 08 12:40:03.237842 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 323/670] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:03 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1316 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:03.413942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ed91e619-bc56-4400-aeef-d9e3146023a3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:03.414577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ed91e619-bc56-4400-aeef-d9e3146023a3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:03.431719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed91e619-bc56-4400-aeef-d9e3146023a3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:03.434189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed91e619-bc56-4400-aeef-d9e3146023a3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:03.435648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed91e619-bc56-4400-aeef-d9e3146023a3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:03.436681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed91e619-bc56-4400-aeef-d9e3146023a3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:03.437383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed91e619-bc56-4400-aeef-d9e3146023a3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:03.438058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed91e619-bc56-4400-aeef-d9e3146023a3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:03.516201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ed91e619-bc56-4400-aeef-d9e3146023a3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:03.533577 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ed91e619-bc56-4400-aeef-d9e3146023a3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1262 microversion: 2.1 time: 0.124639 Sep 08 12:40:03.535017 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 348/671] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:03 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1262 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:03.845247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-159e8390-b6d9-45a9-a8ba-7bea5ec5e286 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:03.845966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-159e8390-b6d9-45a9-a8ba-7bea5ec5e286 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:03.853886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-159e8390-b6d9-45a9-a8ba-7bea5ec5e286 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:03.854576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-159e8390-b6d9-45a9-a8ba-7bea5ec5e286 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:03.855785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-159e8390-b6d9-45a9-a8ba-7bea5ec5e286 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:03.856789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-159e8390-b6d9-45a9-a8ba-7bea5ec5e286 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:03.857492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-159e8390-b6d9-45a9-a8ba-7bea5ec5e286 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:03.858867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-159e8390-b6d9-45a9-a8ba-7bea5ec5e286 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:03.901892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6cecf24b-8574-4023-bcba-df7171f5f4c6 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Calling method '.version_select at 0x7fdb3b22fee0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:03.958292 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6cecf24b-8574-4023-bcba-df7171f5f4c6 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25" status: 200 len: 637 microversion: 2.1 time: 0.063904 Sep 08 12:40:03.958882 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 349/672] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:40:03 2022] GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25 => generated 637 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:03.965595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-10c3a92c-cc68-4216-8df3-dc2ce3f45eba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:03.966689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-10c3a92c-cc68-4216-8df3-dc2ce3f45eba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:03.975440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10c3a92c-cc68-4216-8df3-dc2ce3f45eba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:03.976187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10c3a92c-cc68-4216-8df3-dc2ce3f45eba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:03.976784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10c3a92c-cc68-4216-8df3-dc2ce3f45eba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:03.977647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10c3a92c-cc68-4216-8df3-dc2ce3f45eba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:03.978239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10c3a92c-cc68-4216-8df3-dc2ce3f45eba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:03.978838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10c3a92c-cc68-4216-8df3-dc2ce3f45eba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:04.243139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-159e8390-b6d9-45a9-a8ba-7bea5ec5e286 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:04.252355 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-159e8390-b6d9-45a9-a8ba-7bea5ec5e286 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.411770 Sep 08 12:40:04.253611 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 324/673] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:03 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:04.260532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0e76c1c1-9afd-4dee-984d-80ff64cce17c tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Action: 'update_all', calling method: .version_select at 0x7fdb374a4ca0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:04.307669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-10c3a92c-cc68-4216-8df3-dc2ce3f45eba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:04.315398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:04.323018 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-10c3a92c-cc68-4216-8df3-dc2ce3f45eba tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1319 microversion: 2.1 time: 0.362446 Sep 08 12:40:04.324481 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 350/674] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:03 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:04.329900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad16c721-75b6-4409-80c5-9f37d43a0eb9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:04.330770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad16c721-75b6-4409-80c5-9f37d43a0eb9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:04.339960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad16c721-75b6-4409-80c5-9f37d43a0eb9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:04.340736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad16c721-75b6-4409-80c5-9f37d43a0eb9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:04.341764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad16c721-75b6-4409-80c5-9f37d43a0eb9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:04.342778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad16c721-75b6-4409-80c5-9f37d43a0eb9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:04.343534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad16c721-75b6-4409-80c5-9f37d43a0eb9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:04.344323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad16c721-75b6-4409-80c5-9f37d43a0eb9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:04.367698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-0e76c1c1-9afd-4dee-984d-80ff64cce17c tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:04.373777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-0e76c1c1-9afd-4dee-984d-80ff64cce17c tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for user 9649eaf978a9453987c20570cd55b55a and project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:04.672317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ad16c721-75b6-4409-80c5-9f37d43a0eb9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:04.683975 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad16c721-75b6-4409-80c5-9f37d43a0eb9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1316 microversion: 2.1 time: 0.357466 Sep 08 12:40:04.684593 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 351/675] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:04 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:04.704762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5ea8a12-6952-48f2-9209-da9f052ee9e9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:04.705818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c5ea8a12-6952-48f2-9209-da9f052ee9e9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:04.721029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5ea8a12-6952-48f2-9209-da9f052ee9e9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:04.721607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5ea8a12-6952-48f2-9209-da9f052ee9e9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:04.726665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5ea8a12-6952-48f2-9209-da9f052ee9e9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:04.727630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5ea8a12-6952-48f2-9209-da9f052ee9e9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:04.728427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5ea8a12-6952-48f2-9209-da9f052ee9e9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:04.728898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5ea8a12-6952-48f2-9209-da9f052ee9e9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:04.846451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c5ea8a12-6952-48f2-9209-da9f052ee9e9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:04.858617 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c5ea8a12-6952-48f2-9209-da9f052ee9e9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1268 microversion: 2.1 time: 0.168453 Sep 08 12:40:04.867500 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 352/676] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:04 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:04.883466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3d18d48f-c293-410c-8769-da361101c5a6 req-9632965c-76c1-4968-913f-1d14d3246e38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008c9433-e7cf-4506-9339-2dd946294037", "name": "network-vif-plugged", "status": "completed", "tag": "5aad67aa-ba76-429e-9c9b-9bc4ccfc772e"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:04.886415 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0e76c1c1-9afd-4dee-984d-80ff64cce17c tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.629982 Sep 08 12:40:04.887111 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 325/677] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:40:04 2022] PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 61 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:04.898107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b3397b0a-2ff1-4b87-a411-48e8904adfcc tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Calling method '.version_select at 0x7fdb37363d30>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:04.909735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3d18d48f-c293-410c-8769-da361101c5a6 req-9632965c-76c1-4968-913f-1d14d3246e38 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:04.910226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3d18d48f-c293-410c-8769-da361101c5a6 req-9632965c-76c1-4968-913f-1d14d3246e38 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:04.910721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3d18d48f-c293-410c-8769-da361101c5a6 req-9632965c-76c1-4968-913f-1d14d3246e38 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:04.924697 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3d18d48f-c293-410c-8769-da361101c5a6 req-9632965c-76c1-4968-913f-1d14d3246e38 service nova] Creating event network-vif-plugged:5aad67aa-ba76-429e-9c9b-9bc4ccfc772e for instance 008c9433-e7cf-4506-9339-2dd946294037 on n-h1-852084-10 Sep 08 12:40:04.930024 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3d18d48f-c293-410c-8769-da361101c5a6 req-9632965c-76c1-4968-913f-1d14d3246e38 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060196 Sep 08 12:40:04.930712 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 353/678] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:05.214995 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b3397b0a-2ff1-4b87-a411-48e8904adfcc tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "DELETE /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.321121 Sep 08 12:40:05.215763 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 326/679] 10.222.0.78 () {58 vars in 1296 bytes} [Thu Sep 8 12:40:04 2022] DELETE /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata/os_version => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:40:05.224694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1f2395bc-4bf5-4ca7-b9c2-003deaef2161 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Calling method '.version_select at 0x7fdb3b1c28b0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:05.278418 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1f2395bc-4bf5-4ca7-b9c2-003deaef2161 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 37 microversion: 2.1 time: 0.057999 Sep 08 12:40:05.284801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-916acdc4-bfca-4db0-a188-12380e2da117 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:05.286254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-916acdc4-bfca-4db0-a188-12380e2da117 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:05.287778 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 354/680] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:40:05 2022] GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 37 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:05.298715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-916acdc4-bfca-4db0-a188-12380e2da117 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:05.299360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-916acdc4-bfca-4db0-a188-12380e2da117 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:05.299931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-916acdc4-bfca-4db0-a188-12380e2da117 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:05.301526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-916acdc4-bfca-4db0-a188-12380e2da117 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:05.302462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-916acdc4-bfca-4db0-a188-12380e2da117 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:05.303100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-916acdc4-bfca-4db0-a188-12380e2da117 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:05.303702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b6559d0e-bce3-4dc0-9385-0f41761d446b tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Action: 'update_all', calling method: .version_select at 0x7fdb3b1c2550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:05.397960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b6559d0e-bce3-4dc0-9385-0f41761d446b tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:05.399698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=2,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:05.404993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b6559d0e-bce3-4dc0-9385-0f41761d446b tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for user 9649eaf978a9453987c20570cd55b55a and project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:05.599908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-916acdc4-bfca-4db0-a188-12380e2da117 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:05.609900 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-916acdc4-bfca-4db0-a188-12380e2da117 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.328794 Sep 08 12:40:05.611026 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 327/681] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:05 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:05.632238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-94440c41-e989-475a-8714-e75156036848 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:05.633426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-94440c41-e989-475a-8714-e75156036848 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:05.643903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94440c41-e989-475a-8714-e75156036848 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:05.644394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94440c41-e989-475a-8714-e75156036848 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:05.644850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94440c41-e989-475a-8714-e75156036848 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:05.645858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94440c41-e989-475a-8714-e75156036848 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:05.654498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94440c41-e989-475a-8714-e75156036848 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:05.654961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94440c41-e989-475a-8714-e75156036848 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:05.783122 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b6559d0e-bce3-4dc0-9385-0f41761d446b tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.487477 Sep 08 12:40:05.788777 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 355/682] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:40:05 2022] PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 61 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:05.790566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f990e34d-13a8-40f5-ae93-7ea4172428cb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:05.794053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f990e34d-13a8-40f5-ae93-7ea4172428cb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:05.816400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f990e34d-13a8-40f5-ae93-7ea4172428cb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:05.816925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f990e34d-13a8-40f5-ae93-7ea4172428cb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:05.817582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f990e34d-13a8-40f5-ae93-7ea4172428cb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:05.818517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f990e34d-13a8-40f5-ae93-7ea4172428cb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:05.819159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f990e34d-13a8-40f5-ae93-7ea4172428cb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:05.819671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f990e34d-13a8-40f5-ae93-7ea4172428cb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:05.976314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-94440c41-e989-475a-8714-e75156036848 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:05.992056 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-94440c41-e989-475a-8714-e75156036848 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1319 microversion: 2.1 time: 0.379054 Sep 08 12:40:05.992640 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 328/683] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:05 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:06.005372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-86511737-5b06-4885-8e51-39859b05e46b tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Calling method '.version_select at 0x7fdb37363160>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:06.066344 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-86511737-5b06-4885-8e51-39859b05e46b tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.072632 Sep 08 12:40:06.068514 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 329/684] 10.222.0.78 () {58 vars in 1290 bytes} [Thu Sep 8 12:40:05 2022] GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata/os_distro => generated 33 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:06.079526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d516eb9e-343b-408d-bdf1-7dffc0f5e23a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:06.080777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d516eb9e-343b-408d-bdf1-7dffc0f5e23a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:06.087809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d516eb9e-343b-408d-bdf1-7dffc0f5e23a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:06.088729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d516eb9e-343b-408d-bdf1-7dffc0f5e23a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:06.089881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d516eb9e-343b-408d-bdf1-7dffc0f5e23a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:06.091151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d516eb9e-343b-408d-bdf1-7dffc0f5e23a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:06.092162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d516eb9e-343b-408d-bdf1-7dffc0f5e23a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:06.092748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d516eb9e-343b-408d-bdf1-7dffc0f5e23a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:06.140996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f990e34d-13a8-40f5-ae93-7ea4172428cb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:06.152412 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f990e34d-13a8-40f5-ae93-7ea4172428cb tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1316 microversion: 2.1 time: 0.364779 Sep 08 12:40:06.154023 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 356/685] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:05 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1316 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:06.172716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9f6b63ac-f23e-40f0-93c2-caa41d47954b tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Action: 'update_all', calling method: .version_select at 0x7fdb3b1c2af0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:06.230944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9f6b63ac-f23e-40f0-93c2-caa41d47954b tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:06.235019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9f6b63ac-f23e-40f0-93c2-caa41d47954b tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for user 9649eaf978a9453987c20570cd55b55a and project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:06.363985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d516eb9e-343b-408d-bdf1-7dffc0f5e23a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:06.375086 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d516eb9e-343b-408d-bdf1-7dffc0f5e23a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1310 microversion: 2.1 time: 0.304893 Sep 08 12:40:06.376672 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 330/686] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:06 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1310 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:06.468298 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9f6b63ac-f23e-40f0-93c2-caa41d47954b tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.312967 Sep 08 12:40:06.468864 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 357/687] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:40:06 2022] PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 61 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:06.484367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-201c442a-bdd6-484a-a638-6efa2f865534 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Calling method '.version_select at 0x7fdb3b1c2310>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:06.541193 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-201c442a-bdd6-484a-a638-6efa2f865534 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.062262 Sep 08 12:40:06.542468 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 358/688] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:40:06 2022] GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 61 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:06.560608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-200bdd97-d3f2-4c0a-a220-3eb70190c8be tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Action: 'update_all', calling method: .version_select at 0x7fdb3b1bf4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:06.633403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-200bdd97-d3f2-4c0a-a220-3eb70190c8be tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:06.639474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-200bdd97-d3f2-4c0a-a220-3eb70190c8be tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for user 9649eaf978a9453987c20570cd55b55a and project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:06.684497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1edad620-44ef-427d-b1f8-812103d5393f tempest-InstanceUsageAuditLogTestJSON-891874270 tempest-InstanceUsageAuditLogTestJSON-891874270-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:06.730598 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1edad620-44ef-427d-b1f8-812103d5393f tempest-InstanceUsageAuditLogTestJSON-891874270 tempest-InstanceUsageAuditLogTestJSON-891874270-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08 12:40:06" status: 200 len: 318 microversion: 2.1 time: 0.264166 Sep 08 12:40:06.739140 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 331/689] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Sep 8 12:40:06 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-09-08%2012%3A40%3A06 => generated 318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:40:06.745093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-db75c019-e2d7-442a-ba21-10de12a66869 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:06.746457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-db75c019-e2d7-442a-ba21-10de12a66869 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:06.752847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db75c019-e2d7-442a-ba21-10de12a66869 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:06.753490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db75c019-e2d7-442a-ba21-10de12a66869 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:06.754165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db75c019-e2d7-442a-ba21-10de12a66869 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:06.754942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db75c019-e2d7-442a-ba21-10de12a66869 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:06.755488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db75c019-e2d7-442a-ba21-10de12a66869 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:06.755974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db75c019-e2d7-442a-ba21-10de12a66869 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:06.891648 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-200bdd97-d3f2-4c0a-a220-3eb70190c8be tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.340864 Sep 08 12:40:06.893792 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 359/690] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:40:06 2022] PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 61 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:06.899560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-232a4530-802f-407b-8698-59e2adafd8ab req-9db92c11-7f8c-4265-87f7-da90937f8dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e528819-d8de-43e3-b477-698431023370", "tag": "306af9a9-d6af-4544-81f3-b62d073c0839"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:06.910575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-232a4530-802f-407b-8698-59e2adafd8ab req-9db92c11-7f8c-4265-87f7-da90937f8dce service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:06.911368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-232a4530-802f-407b-8698-59e2adafd8ab req-9db92c11-7f8c-4265-87f7-da90937f8dce service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:06.912114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-232a4530-802f-407b-8698-59e2adafd8ab req-9db92c11-7f8c-4265-87f7-da90937f8dce service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:06.925555 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-232a4530-802f-407b-8698-59e2adafd8ab req-9db92c11-7f8c-4265-87f7-da90937f8dce service nova] Creating event network-changed:306af9a9-d6af-4544-81f3-b62d073c0839 for instance 3e528819-d8de-43e3-b477-698431023370 on n-h2-852084-10 Sep 08 12:40:06.931046 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-232a4530-802f-407b-8698-59e2adafd8ab req-9db92c11-7f8c-4265-87f7-da90937f8dce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035477 Sep 08 12:40:06.932362 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 360/691] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:06.938855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec42f41d-9d5c-4c6b-8f5c-11fe5651156a tempest-InstanceUsageAuditLogTestJSON-891874270 tempest-InstanceUsageAuditLogTestJSON-891874270-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:06.962379 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ec42f41d-9d5c-4c6b-8f5c-11fe5651156a tempest-InstanceUsageAuditLogTestJSON-891874270 tempest-InstanceUsageAuditLogTestJSON-891874270-project-admin] 10.222.0.78 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.027727 Sep 08 12:40:06.963314 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 361/692] 10.222.0.78 () {58 vars in 1185 bytes} [Thu Sep 8 12:40:06 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:06.968804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b22a5163-49e6-4609-88f3-22a19bd4300e tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Action: 'update_all', calling method: .version_select at 0x7fdb3b829ca0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:07.036413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b22a5163-49e6-4609-88f3-22a19bd4300e tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:07.041479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b22a5163-49e6-4609-88f3-22a19bd4300e tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for user 9649eaf978a9453987c20570cd55b55a and project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:07.042965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-db75c019-e2d7-442a-ba21-10de12a66869 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:07.056394 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-db75c019-e2d7-442a-ba21-10de12a66869 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.323499 Sep 08 12:40:07.057177 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 332/693] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:06 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:07.068051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8fe3670d-38dd-4dda-a4fd-06cdc572c4d0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:07.068909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8fe3670d-38dd-4dda-a4fd-06cdc572c4d0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:07.080088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fe3670d-38dd-4dda-a4fd-06cdc572c4d0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:07.080865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fe3670d-38dd-4dda-a4fd-06cdc572c4d0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:07.081607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fe3670d-38dd-4dda-a4fd-06cdc572c4d0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:07.082954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fe3670d-38dd-4dda-a4fd-06cdc572c4d0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:07.084373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fe3670d-38dd-4dda-a4fd-06cdc572c4d0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:07.085228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fe3670d-38dd-4dda-a4fd-06cdc572c4d0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:07.333660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8fe3670d-38dd-4dda-a4fd-06cdc572c4d0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:07.349501 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8fe3670d-38dd-4dda-a4fd-06cdc572c4d0 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1468 microversion: 2.1 time: 0.291132 Sep 08 12:40:07.350771 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 333/694] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:07 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1468 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:07.369135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7c3673b3-24cd-4d31-9931-97e513bfb752 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:07.371174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7c3673b3-24cd-4d31-9931-97e513bfb752 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:07.398236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c3673b3-24cd-4d31-9931-97e513bfb752 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:07.399069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c3673b3-24cd-4d31-9931-97e513bfb752 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:07.402522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c3673b3-24cd-4d31-9931-97e513bfb752 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:07.403930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c3673b3-24cd-4d31-9931-97e513bfb752 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:07.404590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c3673b3-24cd-4d31-9931-97e513bfb752 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:07.405634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c3673b3-24cd-4d31-9931-97e513bfb752 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:07.476893 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b22a5163-49e6-4609-88f3-22a19bd4300e tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 64 microversion: 2.1 time: 0.512143 Sep 08 12:40:07.478147 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 362/695] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:40:06 2022] PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 64 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:07.483673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bcb40ebd-8219-4526-9f0b-e8f7122eed4e tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:07.484571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bcb40ebd-8219-4526-9f0b-e8f7122eed4e tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:07.492130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcb40ebd-8219-4526-9f0b-e8f7122eed4e tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:07.492624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcb40ebd-8219-4526-9f0b-e8f7122eed4e tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:07.493066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcb40ebd-8219-4526-9f0b-e8f7122eed4e tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:07.493779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcb40ebd-8219-4526-9f0b-e8f7122eed4e tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:07.494238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcb40ebd-8219-4526-9f0b-e8f7122eed4e tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:07.494664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcb40ebd-8219-4526-9f0b-e8f7122eed4e tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:07.521448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-bcb40ebd-8219-4526-9f0b-e8f7122eed4e tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lazy-loading 'flavor' on Instance uuid 008c9433-e7cf-4506-9339-2dd946294037 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:40:07.610430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7c3673b3-24cd-4d31-9931-97e513bfb752 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:07.625933 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7c3673b3-24cd-4d31-9931-97e513bfb752 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1316 microversion: 2.1 time: 0.273602 Sep 08 12:40:07.627095 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 334/696] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:07 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1316 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:07.632445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f87a07bd-870a-4eab-afe1-0ecb88ef85eb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:07.633514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f87a07bd-870a-4eab-afe1-0ecb88ef85eb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:07.640614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f87a07bd-870a-4eab-afe1-0ecb88ef85eb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:07.641410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f87a07bd-870a-4eab-afe1-0ecb88ef85eb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:07.642108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f87a07bd-870a-4eab-afe1-0ecb88ef85eb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:07.643173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f87a07bd-870a-4eab-afe1-0ecb88ef85eb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:07.643858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f87a07bd-870a-4eab-afe1-0ecb88ef85eb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:07.644337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f87a07bd-870a-4eab-afe1-0ecb88ef85eb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:07.666782 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bcb40ebd-8219-4526-9f0b-e8f7122eed4e tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037/action" status: 202 len: 0 microversion: 2.1 time: 0.187377 Sep 08 12:40:07.667743 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 363/697] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:40:07 2022] POST /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:07.674204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f059081a-83ab-46b5-ab92-87db00f4f1c6 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Calling method '.version_select at 0x7fdb3b1caca0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:07.727603 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f059081a-83ab-46b5-ab92-87db00f4f1c6 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 64 microversion: 2.1 time: 0.057722 Sep 08 12:40:07.728234 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 364/698] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:40:07 2022] GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 64 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:07.733769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0ff03024-421a-43a6-837f-14bac9da3e82 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:07.734451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0ff03024-421a-43a6-837f-14bac9da3e82 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:07.742288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ff03024-421a-43a6-837f-14bac9da3e82 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:07.742778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ff03024-421a-43a6-837f-14bac9da3e82 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:07.743266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ff03024-421a-43a6-837f-14bac9da3e82 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:07.743971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ff03024-421a-43a6-837f-14bac9da3e82 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:07.744423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ff03024-421a-43a6-837f-14bac9da3e82 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:07.744861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ff03024-421a-43a6-837f-14bac9da3e82 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:07.890230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f87a07bd-870a-4eab-afe1-0ecb88ef85eb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:07.899924 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f87a07bd-870a-4eab-afe1-0ecb88ef85eb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1310 microversion: 2.1 time: 0.271349 Sep 08 12:40:07.900517 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 335/699] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:07 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1310 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:07.919630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f0685c6-3dcd-4f6a-b01c-295562a74ddd tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Action: 'update_all', calling method: .version_select at 0x7fdb37451700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:07.938797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0ff03024-421a-43a6-837f-14bac9da3e82 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:07.948298 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0ff03024-421a-43a6-837f-14bac9da3e82 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1476 microversion: 2.1 time: 0.218322 Sep 08 12:40:07.949702 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 365/700] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:07 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1476 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:07.988438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-8f0685c6-3dcd-4f6a-b01c-295562a74ddd tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:07.992517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-8f0685c6-3dcd-4f6a-b01c-295562a74ddd tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for user 9649eaf978a9453987c20570cd55b55a and project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:08.081851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b3648030-d674-4a7b-9cc3-930ca9b00268 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:08.082577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b3648030-d674-4a7b-9cc3-930ca9b00268 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:08.089966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3648030-d674-4a7b-9cc3-930ca9b00268 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:08.090563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3648030-d674-4a7b-9cc3-930ca9b00268 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:08.091792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3648030-d674-4a7b-9cc3-930ca9b00268 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:08.092615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3648030-d674-4a7b-9cc3-930ca9b00268 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:08.093070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3648030-d674-4a7b-9cc3-930ca9b00268 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:08.093575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3648030-d674-4a7b-9cc3-930ca9b00268 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:08.252373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b3648030-d674-4a7b-9cc3-930ca9b00268 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:08.260443 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b3648030-d674-4a7b-9cc3-930ca9b00268 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.182555 Sep 08 12:40:08.261861 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 366/701] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:08 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:08.508405 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f0685c6-3dcd-4f6a-b01c-295562a74ddd tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.606587 Sep 08 12:40:08.509070 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 336/702] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:40:07 2022] PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 61 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:08.518782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-793a0bf2-5aa9-4d54-b8ea-d9734a92cd31 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Action: 'update', calling method: .version_select at 0x7fdb3b1790d0>, body: {"meta": {"os_version": "alt"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:08.570847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-793a0bf2-5aa9-4d54-b8ea-d9734a92cd31 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:08.575335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-793a0bf2-5aa9-4d54-b8ea-d9734a92cd31 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for user 9649eaf978a9453987c20570cd55b55a and project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:08.654635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c2ef9e01-6895-42bf-8534-a9230d1d70de tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:08.659780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c2ef9e01-6895-42bf-8534-a9230d1d70de tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:08.675318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2ef9e01-6895-42bf-8534-a9230d1d70de tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:08.677211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2ef9e01-6895-42bf-8534-a9230d1d70de tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:08.678701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2ef9e01-6895-42bf-8534-a9230d1d70de tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:08.682553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2ef9e01-6895-42bf-8534-a9230d1d70de tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:08.684708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2ef9e01-6895-42bf-8534-a9230d1d70de tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:08.685972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2ef9e01-6895-42bf-8534-a9230d1d70de tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:08.878246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c2ef9e01-6895-42bf-8534-a9230d1d70de tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:08.886560 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c2ef9e01-6895-42bf-8534-a9230d1d70de tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1316 microversion: 2.1 time: 0.239553 Sep 08 12:40:08.887140 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 337/703] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:08 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1316 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:08.924165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26306415-40ed-4270-a7ed-e8523e63a5ee tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:08.924878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-26306415-40ed-4270-a7ed-e8523e63a5ee tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:08.930942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26306415-40ed-4270-a7ed-e8523e63a5ee tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:08.931626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26306415-40ed-4270-a7ed-e8523e63a5ee tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:08.932169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26306415-40ed-4270-a7ed-e8523e63a5ee tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:08.932960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26306415-40ed-4270-a7ed-e8523e63a5ee tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:08.933545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26306415-40ed-4270-a7ed-e8523e63a5ee tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:08.934046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26306415-40ed-4270-a7ed-e8523e63a5ee tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:08.939718 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-793a0bf2-5aa9-4d54-b8ea-d9734a92cd31 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.424720 Sep 08 12:40:08.940464 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 367/704] 10.222.0.78 () {60 vars in 1313 bytes} [Thu Sep 8 12:40:08 2022] PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata/os_version => generated 31 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:08.950993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b518a7b8-257c-4b25-8de8-414a1a9e072a tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Calling method '.version_select at 0x7fdb3b4651f0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:08.996321 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b518a7b8-257c-4b25-8de8-414a1a9e072a tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 58 microversion: 2.1 time: 0.049851 Sep 08 12:40:08.997197 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 368/705] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:40:08 2022] GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 58 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 12:40:09.011623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cdd2e458-0787-4f67-9245-c28b7d2ffbf7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:09.012268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cdd2e458-0787-4f67-9245-c28b7d2ffbf7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:09.023158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdd2e458-0787-4f67-9245-c28b7d2ffbf7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:09.024650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdd2e458-0787-4f67-9245-c28b7d2ffbf7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:09.025107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdd2e458-0787-4f67-9245-c28b7d2ffbf7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:09.026009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdd2e458-0787-4f67-9245-c28b7d2ffbf7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:09.026480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdd2e458-0787-4f67-9245-c28b7d2ffbf7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:09.027523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdd2e458-0787-4f67-9245-c28b7d2ffbf7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:09.237724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26306415-40ed-4270-a7ed-e8523e63a5ee tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:09.247610 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-26306415-40ed-4270-a7ed-e8523e63a5ee tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1310 microversion: 2.1 time: 0.325434 Sep 08 12:40:09.249481 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 338/706] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:08 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1310 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:09.254263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b1d268bf-1acf-448b-9eb2-827d447f3f35 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Action: 'update_all', calling method: .version_select at 0x7fdb3712d550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:09.335524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cdd2e458-0787-4f67-9245-c28b7d2ffbf7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:09.345790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b1d268bf-1acf-448b-9eb2-827d447f3f35 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:09.348008 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cdd2e458-0787-4f67-9245-c28b7d2ffbf7 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1459 microversion: 2.1 time: 0.343412 Sep 08 12:40:09.351505 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 369/707] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:08 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1459 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:09.352519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b1d268bf-1acf-448b-9eb2-827d447f3f35 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for user 9649eaf978a9453987c20570cd55b55a and project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:09.365959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-19b6ff4f-0485-4a61-b08f-8100a896c165 req-24766285-c9d8-412e-9766-4a63ddfad06c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a774146-a939-4912-8b1e-b52822ced599", "name": "network-vif-plugged", "status": "completed", "tag": "a63ad412-f9c6-450f-b36d-46e365e0d8de"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:09.397420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-19b6ff4f-0485-4a61-b08f-8100a896c165 req-24766285-c9d8-412e-9766-4a63ddfad06c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:09.399486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-19b6ff4f-0485-4a61-b08f-8100a896c165 req-24766285-c9d8-412e-9766-4a63ddfad06c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:09.400063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-19b6ff4f-0485-4a61-b08f-8100a896c165 req-24766285-c9d8-412e-9766-4a63ddfad06c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:09.430154 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-19b6ff4f-0485-4a61-b08f-8100a896c165 req-24766285-c9d8-412e-9766-4a63ddfad06c service nova] Creating event network-vif-plugged:a63ad412-f9c6-450f-b36d-46e365e0d8de for instance 5a774146-a939-4912-8b1e-b52822ced599 on n-h1-852084-10 Sep 08 12:40:09.447777 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-19b6ff4f-0485-4a61-b08f-8100a896c165 req-24766285-c9d8-412e-9766-4a63ddfad06c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091394 Sep 08 12:40:09.448415 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 370/708] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:09.468824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dad86ffd-b8e2-41d2-bb06-b17def699ed0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:09.469727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dad86ffd-b8e2-41d2-bb06-b17def699ed0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:09.477305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dad86ffd-b8e2-41d2-bb06-b17def699ed0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:09.478061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dad86ffd-b8e2-41d2-bb06-b17def699ed0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:09.478664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dad86ffd-b8e2-41d2-bb06-b17def699ed0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:09.479562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dad86ffd-b8e2-41d2-bb06-b17def699ed0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:09.480712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dad86ffd-b8e2-41d2-bb06-b17def699ed0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:09.482064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dad86ffd-b8e2-41d2-bb06-b17def699ed0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:09.709576 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b1d268bf-1acf-448b-9eb2-827d447f3f35 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 61 microversion: 2.1 time: 0.458936 Sep 08 12:40:09.710341 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 339/709] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:40:09 2022] PUT /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 61 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:09.716001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c30d00c-735d-42ac-890f-3ae319c2d26f tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:09.716635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5c30d00c-735d-42ac-890f-3ae319c2d26f tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:09.734143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c30d00c-735d-42ac-890f-3ae319c2d26f tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:09.734645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c30d00c-735d-42ac-890f-3ae319c2d26f tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:09.735088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c30d00c-735d-42ac-890f-3ae319c2d26f tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:09.737638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c30d00c-735d-42ac-890f-3ae319c2d26f tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:09.741364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c30d00c-735d-42ac-890f-3ae319c2d26f tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:09.741951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c30d00c-735d-42ac-890f-3ae319c2d26f tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:10.225062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dad86ffd-b8e2-41d2-bb06-b17def699ed0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:10.234952 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dad86ffd-b8e2-41d2-bb06-b17def699ed0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.784556 Sep 08 12:40:10.236498 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 371/710] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:09 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:10.244856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-960c297c-84f9-4f58-b536-44ca41ce1572 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Action: 'create', calling method: .version_select at 0x7fdb3b465280>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:10.315415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-960c297c-84f9-4f58-b536-44ca41ce1572 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:10.321566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-960c297c-84f9-4f58-b536-44ca41ce1572 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Getting quotas for user 9649eaf978a9453987c20570cd55b55a and project 9449f38124e644ecbcd74a269c40cd54. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:10.547074 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c30d00c-735d-42ac-890f-3ae319c2d26f tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1612 microversion: 2.1 time: 0.835096 Sep 08 12:40:10.551484 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 340/711] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:09 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1612 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:10.570721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-882c4da1-35bd-4cd9-9986-ca3b07e07822 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:10.571956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-882c4da1-35bd-4cd9-9986-ca3b07e07822 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:10.597195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-882c4da1-35bd-4cd9-9986-ca3b07e07822 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:10.601673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-882c4da1-35bd-4cd9-9986-ca3b07e07822 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:10.603422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-882c4da1-35bd-4cd9-9986-ca3b07e07822 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:10.607655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-882c4da1-35bd-4cd9-9986-ca3b07e07822 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:10.609484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-882c4da1-35bd-4cd9-9986-ca3b07e07822 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:10.614530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-882c4da1-35bd-4cd9-9986-ca3b07e07822 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:10.767327 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-960c297c-84f9-4f58-b536-44ca41ce1572 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "POST /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 85 microversion: 2.1 time: 0.529356 Sep 08 12:40:10.768692 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 372/712] 10.222.0.78 () {60 vars in 1281 bytes} [Thu Sep 8 12:40:10 2022] POST /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 85 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:10.774922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-df218264-247f-4678-bb8d-5e6808ed8eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:10.775855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-df218264-247f-4678-bb8d-5e6808ed8eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:10.784698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df218264-247f-4678-bb8d-5e6808ed8eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:10.785728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df218264-247f-4678-bb8d-5e6808ed8eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:10.786792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df218264-247f-4678-bb8d-5e6808ed8eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:10.788258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df218264-247f-4678-bb8d-5e6808ed8eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:10.789015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df218264-247f-4678-bb8d-5e6808ed8eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:10.789965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df218264-247f-4678-bb8d-5e6808ed8eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:10.829980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-882c4da1-35bd-4cd9-9986-ca3b07e07822 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:10.839628 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-882c4da1-35bd-4cd9-9986-ca3b07e07822 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1316 microversion: 2.1 time: 0.286461 Sep 08 12:40:10.848819 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 341/713] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:10 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1316 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:10.856784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b03a3ca-c5fc-44c6-b6bb-13666da7aa39 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:10.860514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b03a3ca-c5fc-44c6-b6bb-13666da7aa39 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:10.861005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b03a3ca-c5fc-44c6-b6bb-13666da7aa39 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:10.861451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b03a3ca-c5fc-44c6-b6bb-13666da7aa39 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:10.862197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b03a3ca-c5fc-44c6-b6bb-13666da7aa39 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:10.862691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b03a3ca-c5fc-44c6-b6bb-13666da7aa39 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:10.863277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b03a3ca-c5fc-44c6-b6bb-13666da7aa39 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:10.921386 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7b03a3ca-c5fc-44c6-b6bb-13666da7aa39 tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.071467 Sep 08 12:40:10.922631 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 342/714] 10.222.0.78 () {58 vars in 1176 bytes} [Thu Sep 8 12:40:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:10.927721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-088c6b40-ab78-4e8c-8d1b-cd2de8be1b01 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] Calling method '.version_select at 0x7fdb371ddee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:10.981544 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-088c6b40-ab78-4e8c-8d1b-cd2de8be1b01 tempest-ImagesMetadataTestJSON-326599777 tempest-ImagesMetadataTestJSON-326599777-project] 10.222.0.78 "GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata" status: 200 len: 85 microversion: 2.1 time: 0.057560 Sep 08 12:40:10.982204 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 343/715] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:40:10 2022] GET /compute/v2.1/images/ef863257-885f-4335-af56-6d7245ab2f25/metadata => generated 85 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:11.002749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852084-10", "block_migration": true, "disk_over_commit": false}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:11.011725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:11.018679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:11.019499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:11.020147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:11.021384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:11.021919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:11.022417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:11.091646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Lazy-loading 'flavor' on Instance uuid 008c9433-e7cf-4506-9339-2dd946294037 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:40:11.114796 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 008c9433-e7cf-4506-9339-2dd946294037 while it is in vm_state suspended Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Request method failure captured: Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037/action HTTP/1.1 Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 98 Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJ8uoieOEjjjlMVuAqr8H-hvqS0zrEUnBNirLo27esLgQCJPzr621iDlXRd4RyODRG6ICpzaRe1DHOwlXqqBBYL994K3T4sjA1v6AL6hdgjL8-bs867B0uWwlBTyuePNkXoZJ8vc-laMEuhmX8s5nyaSO439pOHjzW4f1f_EGuV-2U Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 064b7d22fd8c4e59807a5324b2e93de4 Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-LiveMigrationNegativeTest-1276236943 Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:40:11.117333 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:40:11.118805 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_064b7d22fd8c4e59807a5324b2e93de4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/064b7d22fd8c4e59807a5324b2e93de4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/064b7d22fd8c4e59807a5324b2e93de4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/064b7d22fd8c4e59807a5324b2e93de4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:11.118805 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-LiveMigrationNegativeTest-1276236943 Sep 08 12:40:11.118805 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 064b7d22fd8c4e59807a5324b2e93de4 Sep 08 12:40:11.118805 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-1276236943 Sep 08 12:40:11.118805 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-LiveMigrationNegativeTest-1276236943-project-admin Sep 08 12:40:11.118805 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:11.118805 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:11.118805 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 51b2bea12f2d40d88caaccb5214564a7 Sep 08 12:40:11.118805 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-LiveMigrationNegativeTest-1276236943-project-admin Sep 08 12:40:11.118805 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:40:11.118805 n-d-852084-10 devstack@n-api.service[128970]: {"os-migrateLive": {"host": "n-h2-852084-10", "block_migration": true, "disk_over_commit": false}} Sep 08 12:40:11.118805 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: exception: Cannot 'os-migrateLive' instance 008c9433-e7cf-4506-9339-2dd946294037 while it is in vm_state suspended Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '008c9433-e7cf-4506-9339-2dd946294037', 'body': {'os-migrateLive': {'host': 'n-h2-852084-10', 'block_migration': True, 'disk_over_commit': False}}} Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 08 12:40:11.120024 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 008c9433-e7cf-4506-9339-2dd946294037 in vm_state suspended. Cannot live_migrate while the instance is in this state. Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:40:11.121170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance 008c9433-e7cf-4506-9339-2dd946294037 while it is in vm_state suspended Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance 008c9433-e7cf-4506-9339-2dd946294037 while it is in vm_state suspended Sep 08 12:40:11.129892 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:11.132994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 008c9433-e7cf-4506-9339-2dd946294037 while it is in vm_state suspended {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:11.132994 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-223004ac-ab13-4a73-a55e-e684c6bdcf5d tempest-LiveMigrationNegativeTest-1276236943 tempest-LiveMigrationNegativeTest-1276236943-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037/action" status: 409 len: 155 microversion: 2.1 time: 0.137780 Sep 08 12:40:11.132994 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 344/716] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:40:10 2022] POST /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037/action => generated 155 bytes in 139 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:40:11.135053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-82a6a64f-4be9-44d9-8f33-818029d56bec tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:11.135740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-82a6a64f-4be9-44d9-8f33-818029d56bec tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:11.145967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82a6a64f-4be9-44d9-8f33-818029d56bec tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:11.146467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82a6a64f-4be9-44d9-8f33-818029d56bec tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:11.146906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82a6a64f-4be9-44d9-8f33-818029d56bec tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:11.147653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82a6a64f-4be9-44d9-8f33-818029d56bec tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:11.148459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82a6a64f-4be9-44d9-8f33-818029d56bec tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:11.149084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82a6a64f-4be9-44d9-8f33-818029d56bec tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:11.195149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-df218264-247f-4678-bb8d-5e6808ed8eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:11.208573 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-df218264-247f-4678-bb8d-5e6808ed8eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1310 microversion: 2.1 time: 0.438641 Sep 08 12:40:11.209155 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 373/717] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:10 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1310 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:11.230789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-82a6a64f-4be9-44d9-8f33-818029d56bec tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:40:11.273851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1dd284e7-4d12-40b4-9f02-80df987cece7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:11.274917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1dd284e7-4d12-40b4-9f02-80df987cece7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:11.287729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1dd284e7-4d12-40b4-9f02-80df987cece7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:11.289587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:11.290789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1dd284e7-4d12-40b4-9f02-80df987cece7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:11.292246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1dd284e7-4d12-40b4-9f02-80df987cece7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:11.296230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1dd284e7-4d12-40b4-9f02-80df987cece7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:11.297860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1dd284e7-4d12-40b4-9f02-80df987cece7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:11.300292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1dd284e7-4d12-40b4-9f02-80df987cece7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:11.398633 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-82a6a64f-4be9-44d9-8f33-818029d56bec tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "DELETE /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 204 len: 0 microversion: 2.1 time: 0.268196 Sep 08 12:40:11.401682 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 345/718] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:40:11 2022] DELETE /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:40:11.416297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-63f46605-2a9a-4201-8428-c7eef2ffecdb tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:11.417822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-63f46605-2a9a-4201-8428-c7eef2ffecdb tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:11.432101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63f46605-2a9a-4201-8428-c7eef2ffecdb tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:11.433078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63f46605-2a9a-4201-8428-c7eef2ffecdb tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:11.433969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63f46605-2a9a-4201-8428-c7eef2ffecdb tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:11.435852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63f46605-2a9a-4201-8428-c7eef2ffecdb tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:11.436747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63f46605-2a9a-4201-8428-c7eef2ffecdb tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:11.437487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63f46605-2a9a-4201-8428-c7eef2ffecdb tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:11.875923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1dd284e7-4d12-40b4-9f02-80df987cece7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:11.889931 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1dd284e7-4d12-40b4-9f02-80df987cece7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.625938 Sep 08 12:40:11.891324 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 374/719] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:11 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:11.898674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-da83146d-0fbf-49d5-b2ee-2e4590a02667 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:11.899545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-da83146d-0fbf-49d5-b2ee-2e4590a02667 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:11.908980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da83146d-0fbf-49d5-b2ee-2e4590a02667 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:11.909913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da83146d-0fbf-49d5-b2ee-2e4590a02667 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:11.910520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da83146d-0fbf-49d5-b2ee-2e4590a02667 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:11.911427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da83146d-0fbf-49d5-b2ee-2e4590a02667 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:11.912061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da83146d-0fbf-49d5-b2ee-2e4590a02667 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:11.912488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da83146d-0fbf-49d5-b2ee-2e4590a02667 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:12.041543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-63f46605-2a9a-4201-8428-c7eef2ffecdb tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:12.060325 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-63f46605-2a9a-4201-8428-c7eef2ffecdb tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1465 microversion: 2.1 time: 0.644435 Sep 08 12:40:12.062045 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 346/720] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:11 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1465 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:12.069191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-0fc374d6-a8d9-4df1-813c-91361b30626e req-573c6a3c-0973-4eeb-bacb-31f6223b64f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e528819-d8de-43e3-b477-698431023370", "name": "network-vif-plugged", "status": "completed", "tag": "306af9a9-d6af-4544-81f3-b62d073c0839"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:12.082427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:12.085392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0fc374d6-a8d9-4df1-813c-91361b30626e req-573c6a3c-0973-4eeb-bacb-31f6223b64f0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:12.086162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0fc374d6-a8d9-4df1-813c-91361b30626e req-573c6a3c-0973-4eeb-bacb-31f6223b64f0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:12.087772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0fc374d6-a8d9-4df1-813c-91361b30626e req-573c6a3c-0973-4eeb-bacb-31f6223b64f0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:12.103190 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-0fc374d6-a8d9-4df1-813c-91361b30626e req-573c6a3c-0973-4eeb-bacb-31f6223b64f0 service nova] Creating event network-vif-plugged:306af9a9-d6af-4544-81f3-b62d073c0839 for instance 3e528819-d8de-43e3-b477-698431023370 on n-h2-852084-10 Sep 08 12:40:12.108830 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-0fc374d6-a8d9-4df1-813c-91361b30626e req-573c6a3c-0973-4eeb-bacb-31f6223b64f0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045268 Sep 08 12:40:12.110260 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 347/721] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:12.239772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-341c4417-b9ef-4c13-b5e5-9f9be3cd24bd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:12.240883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-341c4417-b9ef-4c13-b5e5-9f9be3cd24bd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:12.250442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-341c4417-b9ef-4c13-b5e5-9f9be3cd24bd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:12.251051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-341c4417-b9ef-4c13-b5e5-9f9be3cd24bd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:12.251935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-341c4417-b9ef-4c13-b5e5-9f9be3cd24bd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:12.252927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-341c4417-b9ef-4c13-b5e5-9f9be3cd24bd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:12.253633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-341c4417-b9ef-4c13-b5e5-9f9be3cd24bd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:12.254739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-341c4417-b9ef-4c13-b5e5-9f9be3cd24bd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:12.451838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-da83146d-0fbf-49d5-b2ee-2e4590a02667 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:12.468509 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-da83146d-0fbf-49d5-b2ee-2e4590a02667 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1465 microversion: 2.1 time: 0.575410 Sep 08 12:40:12.469474 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 375/722] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:11 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1465 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:12.498440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9efc8108-1a3f-495f-981e-2090fdf617db tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:12.500027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9efc8108-1a3f-495f-981e-2090fdf617db tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:12.515522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9efc8108-1a3f-495f-981e-2090fdf617db tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:12.516458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9efc8108-1a3f-495f-981e-2090fdf617db tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:12.517140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9efc8108-1a3f-495f-981e-2090fdf617db tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:12.519109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9efc8108-1a3f-495f-981e-2090fdf617db tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:12.519864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9efc8108-1a3f-495f-981e-2090fdf617db tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:12.521311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9efc8108-1a3f-495f-981e-2090fdf617db tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:12.794101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-341c4417-b9ef-4c13-b5e5-9f9be3cd24bd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:12.800740 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9efc8108-1a3f-495f-981e-2090fdf617db tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1618 microversion: 2.1 time: 0.307778 Sep 08 12:40:12.801797 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 376/723] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:12 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1618 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:12.816385 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-341c4417-b9ef-4c13-b5e5-9f9be3cd24bd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1310 microversion: 2.1 time: 0.581419 Sep 08 12:40:12.819120 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 348/724] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:12 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1310 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:12.921516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-74c084fb-ac7e-48ae-b583-b0f4dac925c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:12.927837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-74c084fb-ac7e-48ae-b583-b0f4dac925c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:12.951804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74c084fb-ac7e-48ae-b583-b0f4dac925c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:12.952384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74c084fb-ac7e-48ae-b583-b0f4dac925c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:12.952904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74c084fb-ac7e-48ae-b583-b0f4dac925c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:12.953697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74c084fb-ac7e-48ae-b583-b0f4dac925c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:12.954237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74c084fb-ac7e-48ae-b583-b0f4dac925c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:12.954741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74c084fb-ac7e-48ae-b583-b0f4dac925c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:12.986086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1232953268", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "970bb882-462b-4430-a3ae-e76024ca8892"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:13.075545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:40:13.800657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-74c084fb-ac7e-48ae-b583-b0f4dac925c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:13.817449 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-74c084fb-ac7e-48ae-b583-b0f4dac925c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.902739 Sep 08 12:40:13.832726 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 377/725] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:12 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:13.832726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9b253c34-b265-4ccf-986c-8b5ddc2f8d93 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:13.832726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9b253c34-b265-4ccf-986c-8b5ddc2f8d93 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:13.835258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b253c34-b265-4ccf-986c-8b5ddc2f8d93 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:13.836918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b253c34-b265-4ccf-986c-8b5ddc2f8d93 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:13.838311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b253c34-b265-4ccf-986c-8b5ddc2f8d93 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:13.839049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b253c34-b265-4ccf-986c-8b5ddc2f8d93 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:13.839564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b253c34-b265-4ccf-986c-8b5ddc2f8d93 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:13.839998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b253c34-b265-4ccf-986c-8b5ddc2f8d93 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:14.044264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:40:14.045447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:40:14.046231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:40:14.046894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:40:14.047565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:40:14.061650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:14.063341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:14.064668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:14.066121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:14.066825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:14.067610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:14.101350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for project 5be40b5c51b9493d85c199b11a32726e. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:14.107507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Getting quotas for user 7d8ffdbbf2de43b9b4efc89b7fcd4897 and project 5be40b5c51b9493d85c199b11a32726e. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:14.121269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:40:14.123945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:40:14.136436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9b253c34-b265-4ccf-986c-8b5ddc2f8d93 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:14.140315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:14.152823 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9b253c34-b265-4ccf-986c-8b5ddc2f8d93 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1465 microversion: 2.1 time: 0.332945 Sep 08 12:40:14.154800 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 378/726] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:13 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1465 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:14.214435 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e85dc63b-024c-4692-a6df-c4de710874e1 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.232971 Sep 08 12:40:14.223450 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 349/727] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:40:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 12:40:14.230795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fbec8c35-1425-4581-b97f-0b3e46ee29be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:14.231577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fbec8c35-1425-4581-b97f-0b3e46ee29be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:14.240961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbec8c35-1425-4581-b97f-0b3e46ee29be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:14.241703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbec8c35-1425-4581-b97f-0b3e46ee29be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:14.242356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbec8c35-1425-4581-b97f-0b3e46ee29be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:14.243282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbec8c35-1425-4581-b97f-0b3e46ee29be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:14.243950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbec8c35-1425-4581-b97f-0b3e46ee29be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:14.244564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbec8c35-1425-4581-b97f-0b3e46ee29be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:14.329760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6983fd30-45f2-49d2-9c29-089d0f14d5cb tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Calling method '.version_select at 0x7fdb3b1bfe50>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:14.360226 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-6983fd30-45f2-49d2-9c29-089d0f14d5cb tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] HTTP exception thrown: Image not found. Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6983fd30-45f2-49d2-9c29-089d0f14d5cb tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Request method failure captured: Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/images/6108c3d0-1a02-4ba7-bab9-cecd0b4642dc/metadata/os_distro HTTP/1.1 Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeKtClZF1-VcMNgL0YOPLvpOrrDm70IVc7PC1bt39JbTNW-78hyN6HS-mlKNT_qFmyXdyXbcPCOiiv4XkK7ntgCI9TVMsjPJTNxcwfVP-QzozovV_YCChSbhVlOX01ZVWb6tnsdvxLSlE26ENtrW4nFIbmSvmPP4jnfg8vHkyB2WftE Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 94952137ff6f466eb867eac80a782b8d Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:40:14.383209 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_94952137ff6f466eb867eac80a782b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 94952137ff6f466eb867eac80a782b8d Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesMetadataNegativeTestJSON-200511339-project Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 95321604434b4002843462b18214bab4 Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-200511339-project Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: exception: Image not found. Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'image_id': '6108c3d0-1a02-4ba7-bab9-cecd0b4642dc', 'id': 'os_distro'} Sep 08 12:40:14.384690 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:14.385562 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 6108c3d0-1a02-4ba7-bab9-cecd0b4642dc Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:14.387296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6108c3d0-1a02-4ba7-bab9-cecd0b4642dc could not be found. Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:40:14.388477 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.389633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6983fd30-45f2-49d2-9c29-089d0f14d5cb tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Returning 404 to user: Image not found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:14.390725 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6983fd30-45f2-49d2-9c29-089d0f14d5cb tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] 10.222.0.78 "DELETE /compute/v2.1/images/6108c3d0-1a02-4ba7-bab9-cecd0b4642dc/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.226005 Sep 08 12:40:14.390725 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 379/728] 10.222.0.78 () {58 vars in 1293 bytes} [Thu Sep 8 12:40:14 2022] DELETE /compute/v2.1/images/6108c3d0-1a02-4ba7-bab9-cecd0b4642dc/metadata/os_distro => generated 62 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:40:14.399127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-944bce44-d13f-4f47-afdc-143b1bc9a9a6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:14.404751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-944bce44-d13f-4f47-afdc-143b1bc9a9a6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:14.597571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-944bce44-d13f-4f47-afdc-143b1bc9a9a6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:14.599966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=35 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:14.624464 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-944bce44-d13f-4f47-afdc-143b1bc9a9a6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1217 microversion: 2.1 time: 0.233468 Sep 08 12:40:14.625062 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 380/729] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:14 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1217 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:14.650258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d247730e-1907-471d-8378-9579f6518445 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Calling method '.version_select at 0x7fdb3b465670>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:14.690830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fbec8c35-1425-4581-b97f-0b3e46ee29be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:14.702746 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fbec8c35-1425-4581-b97f-0b3e46ee29be tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1492 microversion: 2.1 time: 0.476882 Sep 08 12:40:14.703659 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 350/730] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:14 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1492 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:14.707897 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-d247730e-1907-471d-8378-9579f6518445 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] HTTP exception thrown: Image not found. Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d247730e-1907-471d-8378-9579f6518445 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Request method failure captured: Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/images/a927886c-2a37-4e5d-b074-e97c0b05f5f1/metadata/os_version HTTP/1.1 Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeKtClZF1-VcMNgL0YOPLvpOrrDm70IVc7PC1bt39JbTNW-78hyN6HS-mlKNT_qFmyXdyXbcPCOiiv4XkK7ntgCI9TVMsjPJTNxcwfVP-QzozovV_YCChSbhVlOX01ZVWb6tnsdvxLSlE26ENtrW4nFIbmSvmPP4jnfg8vHkyB2WftE Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 94952137ff6f466eb867eac80a782b8d Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:40:14.710504 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_94952137ff6f466eb867eac80a782b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 94952137ff6f466eb867eac80a782b8d Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesMetadataNegativeTestJSON-200511339-project Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 95321604434b4002843462b18214bab4 Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-200511339-project Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: exception: Image not found. Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'image_id': 'a927886c-2a37-4e5d-b074-e97c0b05f5f1', 'id': 'os_version'} Sep 08 12:40:14.711955 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:14.712787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID a927886c-2a37-4e5d-b074-e97c0b05f5f1 Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:14.715106 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a927886c-2a37-4e5d-b074-e97c0b05f5f1 could not be found. Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:40:14.716391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:40:14.717490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.720725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d247730e-1907-471d-8378-9579f6518445 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Returning 404 to user: Image not found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:14.721869 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d247730e-1907-471d-8378-9579f6518445 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] 10.222.0.78 "GET /compute/v2.1/images/a927886c-2a37-4e5d-b074-e97c0b05f5f1/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.077913 Sep 08 12:40:14.722535 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 381/731] 10.222.0.78 () {58 vars in 1293 bytes} [Thu Sep 8 12:40:14 2022] GET /compute/v2.1/images/a927886c-2a37-4e5d-b074-e97c0b05f5f1/metadata/os_version => generated 62 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:40:14.728825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e64b4756-ebfc-4530-8b99-dfbadb0128ae tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:14.734617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-383a8428-414d-43d2-afb2-73761dcc1d92 req-ff9b6164-1d5a-4834-a214-d0ba61f6c661 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "008c9433-e7cf-4506-9339-2dd946294037", "name": "network-vif-deleted", "tag": "5aad67aa-ba76-429e-9c9b-9bc4ccfc772e"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:14.735728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e64b4756-ebfc-4530-8b99-dfbadb0128ae tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:14.751639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e64b4756-ebfc-4530-8b99-dfbadb0128ae tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:14.755291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e64b4756-ebfc-4530-8b99-dfbadb0128ae tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:14.756070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e64b4756-ebfc-4530-8b99-dfbadb0128ae tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:14.758526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-383a8428-414d-43d2-afb2-73761dcc1d92 req-ff9b6164-1d5a-4834-a214-d0ba61f6c661 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:14.759685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e64b4756-ebfc-4530-8b99-dfbadb0128ae tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:14.760435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e64b4756-ebfc-4530-8b99-dfbadb0128ae tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:14.761217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e64b4756-ebfc-4530-8b99-dfbadb0128ae tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:14.764179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-383a8428-414d-43d2-afb2-73761dcc1d92 req-ff9b6164-1d5a-4834-a214-d0ba61f6c661 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:14.764920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-383a8428-414d-43d2-afb2-73761dcc1d92 req-ff9b6164-1d5a-4834-a214-d0ba61f6c661 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:14.803438 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-383a8428-414d-43d2-afb2-73761dcc1d92 req-ff9b6164-1d5a-4834-a214-d0ba61f6c661 service nova] Creating event network-vif-deleted:5aad67aa-ba76-429e-9c9b-9bc4ccfc772e for instance 008c9433-e7cf-4506-9339-2dd946294037 on n-h1-852084-10 Sep 08 12:40:14.827094 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-383a8428-414d-43d2-afb2-73761dcc1d92 req-ff9b6164-1d5a-4834-a214-d0ba61f6c661 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122001 Sep 08 12:40:14.828157 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 351/732] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:14.833887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-107a7801-7de5-486d-9f16-fe0406bb832f tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Calling method '.version_select at 0x7fdb3730a4c0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:14.876316 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-107a7801-7de5-486d-9f16-fe0406bb832f tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] HTTP exception thrown: Image not found. Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-107a7801-7de5-486d-9f16-fe0406bb832f tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Request method failure captured: Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/images/06e22197-c8b1-42f7-9724-76cf33f82c87/metadata HTTP/1.1 Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKtClZF1-VcMNgL0YOPLvpOrrDm70IVc7PC1bt39JbTNW-78hyN6HS-mlKNT_qFmyXdyXbcPCOiiv4XkK7ntgCI9TVMsjPJTNxcwfVP-QzozovV_YCChSbhVlOX01ZVWb6tnsdvxLSlE26ENtrW4nFIbmSvmPP4jnfg8vHkyB2WftE Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 94952137ff6f466eb867eac80a782b8d Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:14.881812 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_94952137ff6f466eb867eac80a782b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 94952137ff6f466eb867eac80a782b8d Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesMetadataNegativeTestJSON-200511339-project Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 95321604434b4002843462b18214bab4 Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-200511339-project Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: exception: Image not found. Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'image_id': '06e22197-c8b1-42f7-9724-76cf33f82c87'} Sep 08 12:40:14.883201 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:14.884103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 06e22197-c8b1-42f7-9724-76cf33f82c87 Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:14.885473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 06e22197-c8b1-42f7-9724-76cf33f82c87 could not be found. Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:40:14.887944 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:14.892267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-107a7801-7de5-486d-9f16-fe0406bb832f tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Returning 404 to user: Image not found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:14.896007 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-107a7801-7de5-486d-9f16-fe0406bb832f tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] 10.222.0.78 "GET /compute/v2.1/images/06e22197-c8b1-42f7-9724-76cf33f82c87/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055944 Sep 08 12:40:14.896007 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 352/733] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:40:14 2022] GET /compute/v2.1/images/06e22197-c8b1-42f7-9724-76cf33f82c87/metadata => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:40:14.903640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4821be57-95eb-420c-8fa9-93c319a66173 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:14.907558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4821be57-95eb-420c-8fa9-93c319a66173 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:14.918409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4821be57-95eb-420c-8fa9-93c319a66173 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:14.919445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4821be57-95eb-420c-8fa9-93c319a66173 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:14.919901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4821be57-95eb-420c-8fa9-93c319a66173 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:14.920632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4821be57-95eb-420c-8fa9-93c319a66173 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:14.921152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4821be57-95eb-420c-8fa9-93c319a66173 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:14.921590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4821be57-95eb-420c-8fa9-93c319a66173 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.122160 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e64b4756-ebfc-4530-8b99-dfbadb0128ae tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1645 microversion: 2.1 time: 0.397989 Sep 08 12:40:15.136988 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 382/734] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:14 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1645 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:15.148952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4f455241-37d9-4e19-887c-36f3c02cc901 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Action: 'update_all', calling method: .version_select at 0x7fdb3b430790>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:15.197282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4821be57-95eb-420c-8fa9-93c319a66173 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:15.203903 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-4f455241-37d9-4e19-887c-36f3c02cc901 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] HTTP exception thrown: Image not found. Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4f455241-37d9-4e19-887c-36f3c02cc901 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Request method failure captured: Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: request: PUT /compute/v2.1/images/1d6a2edc-709a-436d-b0dc-1dda1afd77fe/metadata HTTP/1.1 Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 57 Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeKtClZF1-VcMNgL0YOPLvpOrrDm70IVc7PC1bt39JbTNW-78hyN6HS-mlKNT_qFmyXdyXbcPCOiiv4XkK7ntgCI9TVMsjPJTNxcwfVP-QzozovV_YCChSbhVlOX01ZVWb6tnsdvxLSlE26ENtrW4nFIbmSvmPP4jnfg8vHkyB2WftE Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 94952137ff6f466eb867eac80a782b8d Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:40:15.206400 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_94952137ff6f466eb867eac80a782b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 94952137ff6f466eb867eac80a782b8d Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesMetadataNegativeTestJSON-200511339-project Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 95321604434b4002843462b18214bab4 Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-200511339-project Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: exception: Image not found. Sep 08 12:40:15.207874 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'image_id': '1d6a2edc-709a-436d-b0dc-1dda1afd77fe', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:15.208728 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 1d6a2edc-709a-436d-b0dc-1dda1afd77fe Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:40:15.210535 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1d6a2edc-709a-436d-b0dc-1dda1afd77fe could not be found. Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:15.213869 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:40:15.216592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.223168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4f455241-37d9-4e19-887c-36f3c02cc901 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Returning 404 to user: Image not found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:15.223168 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4f455241-37d9-4e19-887c-36f3c02cc901 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] 10.222.0.78 "PUT /compute/v2.1/images/1d6a2edc-709a-436d-b0dc-1dda1afd77fe/metadata" status: 404 len: 62 microversion: 2.1 time: 0.069355 Sep 08 12:40:15.223502 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4821be57-95eb-420c-8fa9-93c319a66173 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.315287 Sep 08 12:40:15.223645 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 383/735] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:40:15 2022] PUT /compute/v2.1/images/1d6a2edc-709a-436d-b0dc-1dda1afd77fe/metadata => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:40:15.223777 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 353/736] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:14 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:15.231261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:15.232361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:15.239536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-98de0b82-2149-422c-8d83-78e055c199e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:15.240171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-98de0b82-2149-422c-8d83-78e055c199e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:15.241861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.245093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.245759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.250072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.251854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.252806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.257503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98de0b82-2149-422c-8d83-78e055c199e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.260935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98de0b82-2149-422c-8d83-78e055c199e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.261978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98de0b82-2149-422c-8d83-78e055c199e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.265395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98de0b82-2149-422c-8d83-78e055c199e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.269795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98de0b82-2149-422c-8d83-78e055c199e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.271640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98de0b82-2149-422c-8d83-78e055c199e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.306268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.306780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.307509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.308102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lazy-loading 'fault' on Instance uuid 008c9433-e7cf-4506-9339-2dd946294037 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:40:15.437700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:15.449374 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-94521d26-e1a7-4fe3-8d6c-3b0c478d53c4 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1309 microversion: 2.1 time: 0.232909 Sep 08 12:40:15.450403 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 354/737] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:15 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1309 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:15.468172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f82af03b-edf9-4c62-9354-a6afff8bb653 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Action: 'update', calling method: .version_select at 0x7fdb373a9160>, body: {"meta": {"os_distro": "alt"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:15.504447 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-f82af03b-edf9-4c62-9354-a6afff8bb653 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] HTTP exception thrown: Image not found. Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f82af03b-edf9-4c62-9354-a6afff8bb653 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Request method failure captured: Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/images/8f7b9dc9-19ab-4ee8-84d2-992daf5549ed/metadata/os_distro HTTP/1.1 Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 30 Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKtClZF1-VcMNgL0YOPLvpOrrDm70IVc7PC1bt39JbTNW-78hyN6HS-mlKNT_qFmyXdyXbcPCOiiv4XkK7ntgCI9TVMsjPJTNxcwfVP-QzozovV_YCChSbhVlOX01ZVWb6tnsdvxLSlE26ENtrW4nFIbmSvmPP4jnfg8vHkyB2WftE Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 94952137ff6f466eb867eac80a782b8d Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:15.506803 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_94952137ff6f466eb867eac80a782b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 94952137ff6f466eb867eac80a782b8d Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesMetadataNegativeTestJSON-200511339-project Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 95321604434b4002843462b18214bab4 Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-200511339-project Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: {"meta": {"os_distro": "alt"}} Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: exception: Image not found. Sep 08 12:40:15.508126 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'image_id': '8f7b9dc9-19ab-4ee8-84d2-992daf5549ed', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:15.508961 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8f7b9dc9-19ab-4ee8-84d2-992daf5549ed Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:40:15.510149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f7b9dc9-19ab-4ee8-84d2-992daf5549ed could not be found. Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:15.511887 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:40:15.513079 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.516100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f82af03b-edf9-4c62-9354-a6afff8bb653 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Returning 404 to user: Image not found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:15.516100 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f82af03b-edf9-4c62-9354-a6afff8bb653 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] 10.222.0.78 "PUT /compute/v2.1/images/8f7b9dc9-19ab-4ee8-84d2-992daf5549ed/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.056608 Sep 08 12:40:15.516100 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 355/738] 10.222.0.78 () {60 vars in 1310 bytes} [Thu Sep 8 12:40:15 2022] PUT /compute/v2.1/images/8f7b9dc9-19ab-4ee8-84d2-992daf5549ed/metadata/os_distro => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:40:15.522207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ced9880-68e6-4cef-9832-8a273fca5d77 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Action: 'create', calling method: .version_select at 0x7fdb3716b280>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:15.553752 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-98de0b82-2149-422c-8d83-78e055c199e4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1645 microversion: 2.1 time: 0.328700 Sep 08 12:40:15.557153 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 384/739] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:15 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1645 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:15.579372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-862aa412-3d97-4ea0-b284-094af483da44 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:15.583726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-862aa412-3d97-4ea0-b284-094af483da44 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.584527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-862aa412-3d97-4ea0-b284-094af483da44 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.584969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-862aa412-3d97-4ea0-b284-094af483da44 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.586072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-862aa412-3d97-4ea0-b284-094af483da44 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.586706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-862aa412-3d97-4ea0-b284-094af483da44 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.587314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-862aa412-3d97-4ea0-b284-094af483da44 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.592735 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-8ced9880-68e6-4cef-9832-8a273fca5d77 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] HTTP exception thrown: Image not found. Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ced9880-68e6-4cef-9832-8a273fca5d77 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Request method failure captured: Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/images/0e58933c-e8ba-4ea4-bb25-a9e13d4a1a0b/metadata HTTP/1.1 Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 57 Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKtClZF1-VcMNgL0YOPLvpOrrDm70IVc7PC1bt39JbTNW-78hyN6HS-mlKNT_qFmyXdyXbcPCOiiv4XkK7ntgCI9TVMsjPJTNxcwfVP-QzozovV_YCChSbhVlOX01ZVWb6tnsdvxLSlE26ENtrW4nFIbmSvmPP4jnfg8vHkyB2WftE Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 94952137ff6f466eb867eac80a782b8d Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:15.594984 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_94952137ff6f466eb867eac80a782b8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/94952137ff6f466eb867eac80a782b8d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 94952137ff6f466eb867eac80a782b8d Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-200511339 Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesMetadataNegativeTestJSON-200511339-project Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 95321604434b4002843462b18214bab4 Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-200511339-project Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: exception: Image not found. Sep 08 12:40:15.596288 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'image_id': '0e58933c-e8ba-4ea4-bb25-a9e13d4a1a0b', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:15.597094 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0e58933c-e8ba-4ea4-bb25-a9e13d4a1a0b Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:40:15.598222 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0e58933c-e8ba-4ea4-bb25-a9e13d4a1a0b could not be found. Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:15.599581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:40:15.600670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:15.601866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ced9880-68e6-4cef-9832-8a273fca5d77 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] Returning 404 to user: Image not found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:15.601866 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8ced9880-68e6-4cef-9832-8a273fca5d77 tempest-ImagesMetadataNegativeTestJSON-200511339 tempest-ImagesMetadataNegativeTestJSON-200511339-project] 10.222.0.78 "POST /compute/v2.1/images/0e58933c-e8ba-4ea4-bb25-a9e13d4a1a0b/metadata" status: 404 len: 62 microversion: 2.1 time: 0.081784 Sep 08 12:40:15.601866 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 356/740] 10.222.0.78 () {60 vars in 1281 bytes} [Thu Sep 8 12:40:15 2022] POST /compute/v2.1/images/0e58933c-e8ba-4ea4-bb25-a9e13d4a1a0b/metadata => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:40:15.628040 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-862aa412-3d97-4ea0-b284-094af483da44 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.052282 Sep 08 12:40:15.628766 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 385/741] 10.222.0.78 () {58 vars in 1176 bytes} [Thu Sep 8 12:40:15 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:15.643455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6659144e-b3f2-4f66-8c3c-65a91bcd5acd tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:15.644353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6659144e-b3f2-4f66-8c3c-65a91bcd5acd tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:15.648222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4e7383c-88ce-42b3-b2ef-2f74092d4194 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:15.648838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b4e7383c-88ce-42b3-b2ef-2f74092d4194 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:15.664655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4e7383c-88ce-42b3-b2ef-2f74092d4194 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.665159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4e7383c-88ce-42b3-b2ef-2f74092d4194 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.665601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4e7383c-88ce-42b3-b2ef-2f74092d4194 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.666316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4e7383c-88ce-42b3-b2ef-2f74092d4194 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.666769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4e7383c-88ce-42b3-b2ef-2f74092d4194 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.667343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6659144e-b3f2-4f66-8c3c-65a91bcd5acd tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.667864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6659144e-b3f2-4f66-8c3c-65a91bcd5acd tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.671072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4e7383c-88ce-42b3-b2ef-2f74092d4194 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.675605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6659144e-b3f2-4f66-8c3c-65a91bcd5acd tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.676526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6659144e-b3f2-4f66-8c3c-65a91bcd5acd tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.677024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6659144e-b3f2-4f66-8c3c-65a91bcd5acd tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.677461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6659144e-b3f2-4f66-8c3c-65a91bcd5acd tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.818047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b4e7383c-88ce-42b3-b2ef-2f74092d4194 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:15.825541 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6659144e-b3f2-4f66-8c3c-65a91bcd5acd tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370/action" status: 202 len: 0 microversion: 2.1 time: 0.186649 Sep 08 12:40:15.832069 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 357/742] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:40:15 2022] POST /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:15.837674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ea540051-88c9-46bf-93f8-1ec64957c6d4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:15.844379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ea540051-88c9-46bf-93f8-1ec64957c6d4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:15.850044 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b4e7383c-88ce-42b3-b2ef-2f74092d4194 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1269 microversion: 2.1 time: 0.206008 Sep 08 12:40:15.850857 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 386/743] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:15 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1269 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:15.877747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea540051-88c9-46bf-93f8-1ec64957c6d4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.882186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea540051-88c9-46bf-93f8-1ec64957c6d4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.884843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea540051-88c9-46bf-93f8-1ec64957c6d4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:15.891309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea540051-88c9-46bf-93f8-1ec64957c6d4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:15.892737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea540051-88c9-46bf-93f8-1ec64957c6d4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:15.894351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea540051-88c9-46bf-93f8-1ec64957c6d4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:16.134023 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ea540051-88c9-46bf-93f8-1ec64957c6d4 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1650 microversion: 2.1 time: 0.300228 Sep 08 12:40:16.134890 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 358/744] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:15 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1650 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:16.246916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bee59d9c-8abe-4cd2-9395-8a303eb10896 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:16.247652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bee59d9c-8abe-4cd2-9395-8a303eb10896 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:16.258480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bee59d9c-8abe-4cd2-9395-8a303eb10896 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:16.260324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bee59d9c-8abe-4cd2-9395-8a303eb10896 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:16.261012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bee59d9c-8abe-4cd2-9395-8a303eb10896 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:16.262806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bee59d9c-8abe-4cd2-9395-8a303eb10896 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:16.263721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bee59d9c-8abe-4cd2-9395-8a303eb10896 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:16.264254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bee59d9c-8abe-4cd2-9395-8a303eb10896 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:16.478114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:16.478746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:16.491660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:16.496569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:16.497036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:16.497787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:16.498254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:16.501295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:16.562895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bee59d9c-8abe-4cd2-9395-8a303eb10896 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:16.577298 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bee59d9c-8abe-4cd2-9395-8a303eb10896 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.336238 Sep 08 12:40:16.579568 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 387/745] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:16 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:16.595188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:16.600003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:16.600760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:16.601426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lazy-loading 'fault' on Instance uuid 008c9433-e7cf-4506-9339-2dd946294037 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:40:16.754459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:16.767946 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4ea9ca86-c92f-4966-b932-dd044a686684 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 200 len: 1309 microversion: 2.1 time: 0.291467 Sep 08 12:40:16.770208 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 359/746] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:16 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 1309 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:16.875474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-58d77e20-1101-4a8a-973c-9eb46ceb5056 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:16.876608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-58d77e20-1101-4a8a-973c-9eb46ceb5056 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:16.901075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58d77e20-1101-4a8a-973c-9eb46ceb5056 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:16.903161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58d77e20-1101-4a8a-973c-9eb46ceb5056 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:16.903914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58d77e20-1101-4a8a-973c-9eb46ceb5056 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:16.905769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58d77e20-1101-4a8a-973c-9eb46ceb5056 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:16.906414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58d77e20-1101-4a8a-973c-9eb46ceb5056 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:16.908001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58d77e20-1101-4a8a-973c-9eb46ceb5056 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:17.015024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-58d77e20-1101-4a8a-973c-9eb46ceb5056 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:17.040695 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-58d77e20-1101-4a8a-973c-9eb46ceb5056 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1275 microversion: 2.1 time: 0.170825 Sep 08 12:40:17.041849 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 388/747] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:16 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:17.158021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b9d137b8-85b1-4423-bfb3-ecd8948d2582 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:17.158644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b9d137b8-85b1-4423-bfb3-ecd8948d2582 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:17.170919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9d137b8-85b1-4423-bfb3-ecd8948d2582 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:17.173239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9d137b8-85b1-4423-bfb3-ecd8948d2582 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:17.173892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9d137b8-85b1-4423-bfb3-ecd8948d2582 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:17.180822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9d137b8-85b1-4423-bfb3-ecd8948d2582 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:17.181611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9d137b8-85b1-4423-bfb3-ecd8948d2582 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:17.182245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9d137b8-85b1-4423-bfb3-ecd8948d2582 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:17.565248 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b9d137b8-85b1-4423-bfb3-ecd8948d2582 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1630 microversion: 2.1 time: 0.410560 Sep 08 12:40:17.566893 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 360/748] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:17 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1630 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:17.594305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-73f12992-b891-47ae-baad-9d40590d1d95 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852084-10", "block_migration": true, "disk_over_commit": false}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:17.606705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44ab9bd3-7760-414d-a27d-8c29ec1900d2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:17.607351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-44ab9bd3-7760-414d-a27d-8c29ec1900d2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:17.610177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-73f12992-b891-47ae-baad-9d40590d1d95 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:17.619170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44ab9bd3-7760-414d-a27d-8c29ec1900d2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:17.619473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73f12992-b891-47ae-baad-9d40590d1d95 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:17.619988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73f12992-b891-47ae-baad-9d40590d1d95 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:17.621546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44ab9bd3-7760-414d-a27d-8c29ec1900d2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:17.622239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44ab9bd3-7760-414d-a27d-8c29ec1900d2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:17.623171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44ab9bd3-7760-414d-a27d-8c29ec1900d2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:17.623888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44ab9bd3-7760-414d-a27d-8c29ec1900d2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:17.624551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44ab9bd3-7760-414d-a27d-8c29ec1900d2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:17.624738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73f12992-b891-47ae-baad-9d40590d1d95 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:17.628199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73f12992-b891-47ae-baad-9d40590d1d95 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:17.628708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73f12992-b891-47ae-baad-9d40590d1d95 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:17.629157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73f12992-b891-47ae-baad-9d40590d1d95 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:17.737147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-73f12992-b891-47ae-baad-9d40590d1d95 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lazy-loading 'flavor' on Instance uuid 3e528819-d8de-43e3-b477-698431023370 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:40:17.754139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-73f12992-b891-47ae-baad-9d40590d1d95 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 3e528819-d8de-43e3-b477-698431023370] Going to try to live migrate instance to n-h1-852084-10 {{(pid=128971) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 12:40:17.953934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-44ab9bd3-7760-414d-a27d-8c29ec1900d2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:17.966951 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44ab9bd3-7760-414d-a27d-8c29ec1900d2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.366790 Sep 08 12:40:17.967521 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 361/749] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:17 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:17.979137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c77d71a5-f51d-4d1c-a569-60105f16498a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:17.980566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c77d71a5-f51d-4d1c-a569-60105f16498a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 008c9433-e7cf-4506-9339-2dd946294037] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:17.995155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c77d71a5-f51d-4d1c-a569-60105f16498a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:17.997778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c77d71a5-f51d-4d1c-a569-60105f16498a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:17.999495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c77d71a5-f51d-4d1c-a569-60105f16498a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:18.002160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c77d71a5-f51d-4d1c-a569-60105f16498a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:18.004015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c77d71a5-f51d-4d1c-a569-60105f16498a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:18.005510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c77d71a5-f51d-4d1c-a569-60105f16498a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:18.040693 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-c77d71a5-f51d-4d1c-a569-60105f16498a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] HTTP exception thrown: Instance 008c9433-e7cf-4506-9339-2dd946294037 could not be found. Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c77d71a5-f51d-4d1c-a569-60105f16498a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Request method failure captured: Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 HTTP/1.1 Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJ6EAn-GcdtXiNFjkSqvyfpWkPH4POMWzE05Ls0v2mcTNzZUWgMgNVSpSTTaYJ-wHk1xtijy8eQ-gqLro1cCKJeP21MM5LuzLjeEQBQWmIXpEjEcBDKNP-gLLrQfHm7rN026eJkKqo96mYGqUijbSgP_4QCzY-HpT41g7Y4ko6J4Ho Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 1ecf62bb5fa54e498d4e6561791aa11b Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-LiveMigrationNegativeTest-713949609 Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:18.043026 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:18.044424 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1ecf62bb5fa54e498d4e6561791aa11b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1ecf62bb5fa54e498d4e6561791aa11b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ecf62bb5fa54e498d4e6561791aa11b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ecf62bb5fa54e498d4e6561791aa11b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:18.044424 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-LiveMigrationNegativeTest-713949609 Sep 08 12:40:18.044424 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 1ecf62bb5fa54e498d4e6561791aa11b Sep 08 12:40:18.044424 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-713949609 Sep 08 12:40:18.044424 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-LiveMigrationNegativeTest-713949609-project Sep 08 12:40:18.044424 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:18.044424 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:18.044424 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 569e4e340357494692da48aabd8d2e16 Sep 08 12:40:18.044424 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-LiveMigrationNegativeTest-713949609-project Sep 08 12:40:18.044424 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:40:18.044424 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 008c9433-e7cf-4506-9339-2dd946294037 could not be found. Sep 08 12:40:18.044424 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '008c9433-e7cf-4506-9339-2dd946294037'} Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 008c9433-e7cf-4506-9339-2dd946294037 could not be found. Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:18.045168 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 008c9433-e7cf-4506-9339-2dd946294037 could not be found. Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 008c9433-e7cf-4506-9339-2dd946294037 could not be found. Sep 08 12:40:18.046359 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:18.047481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c77d71a5-f51d-4d1c-a569-60105f16498a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Returning 404 to user: Instance 008c9433-e7cf-4506-9339-2dd946294037 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:18.047481 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c77d71a5-f51d-4d1c-a569-60105f16498a tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037" status: 404 len: 111 microversion: 2.1 time: 0.073464 Sep 08 12:40:18.053657 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 362/750] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:17 2022] GET /compute/v2.1/servers/008c9433-e7cf-4506-9339-2dd946294037 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:40:18.061458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d9d3b9ac-4591-43c2-9f2d-1b56882b502f tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:18.061780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d9d3b9ac-4591-43c2-9f2d-1b56882b502f tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:18.080208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9d3b9ac-4591-43c2-9f2d-1b56882b502f tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:18.080714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9d3b9ac-4591-43c2-9f2d-1b56882b502f tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:18.081154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9d3b9ac-4591-43c2-9f2d-1b56882b502f tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:18.081873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9d3b9ac-4591-43c2-9f2d-1b56882b502f tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:18.082328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9d3b9ac-4591-43c2-9f2d-1b56882b502f tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:18.082753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9d3b9ac-4591-43c2-9f2d-1b56882b502f tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:18.131815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d9d3b9ac-4591-43c2-9f2d-1b56882b502f tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:40:18.326812 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d9d3b9ac-4591-43c2-9f2d-1b56882b502f tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "DELETE /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 204 len: 0 microversion: 2.1 time: 0.271476 Sep 08 12:40:18.327728 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 363/751] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:40:18 2022] DELETE /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:40:18.341072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-081fda06-2c5e-4f72-84ba-da6831ca911a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:18.342063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-081fda06-2c5e-4f72-84ba-da6831ca911a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:18.361226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-081fda06-2c5e-4f72-84ba-da6831ca911a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:18.363059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-081fda06-2c5e-4f72-84ba-da6831ca911a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:18.364984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-081fda06-2c5e-4f72-84ba-da6831ca911a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:18.367164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-081fda06-2c5e-4f72-84ba-da6831ca911a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:18.367911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-081fda06-2c5e-4f72-84ba-da6831ca911a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:18.369094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-081fda06-2c5e-4f72-84ba-da6831ca911a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:18.385245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:18.774181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-081fda06-2c5e-4f72-84ba-da6831ca911a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:18.790506 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-081fda06-2c5e-4f72-84ba-da6831ca911a tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1317 microversion: 2.1 time: 0.457057 Sep 08 12:40:18.793557 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 364/752] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:18 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1317 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:18.811356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e2d24670-2e3f-419a-a27f-bb9e5fac5898 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:18.813160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e2d24670-2e3f-419a-a27f-bb9e5fac5898 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:18.826044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2d24670-2e3f-419a-a27f-bb9e5fac5898 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:18.827060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2d24670-2e3f-419a-a27f-bb9e5fac5898 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:18.827865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2d24670-2e3f-419a-a27f-bb9e5fac5898 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:18.828935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2d24670-2e3f-419a-a27f-bb9e5fac5898 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:18.830814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2d24670-2e3f-419a-a27f-bb9e5fac5898 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:18.831512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2d24670-2e3f-419a-a27f-bb9e5fac5898 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:19.838852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e2d24670-2e3f-419a-a27f-bb9e5fac5898 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:19.849790 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e2d24670-2e3f-419a-a27f-bb9e5fac5898 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 200 len: 1474 microversion: 2.1 time: 1.054814 Sep 08 12:40:19.850376 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 365/753] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:18 2022] GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 1474 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:19.869352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8266845f-4eff-4ff7-9a2a-c4121a158472 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:19.870038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8266845f-4eff-4ff7-9a2a-c4121a158472 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:19.876953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8266845f-4eff-4ff7-9a2a-c4121a158472 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:19.877381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8266845f-4eff-4ff7-9a2a-c4121a158472 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:19.878061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8266845f-4eff-4ff7-9a2a-c4121a158472 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:19.878945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8266845f-4eff-4ff7-9a2a-c4121a158472 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:19.879424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8266845f-4eff-4ff7-9a2a-c4121a158472 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:19.880060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8266845f-4eff-4ff7-9a2a-c4121a158472 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:19.945445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8266845f-4eff-4ff7-9a2a-c4121a158472 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:40:20.093216 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8266845f-4eff-4ff7-9a2a-c4121a158472 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 204 len: 0 microversion: 2.1 time: 0.228626 Sep 08 12:40:20.094534 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 366/754] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:40:19 2022] DELETE /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:40:20.101476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-92f9f823-a1da-434e-90ea-d5522cb04396 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:20.102729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-92f9f823-a1da-434e-90ea-d5522cb04396 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:20.110124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92f9f823-a1da-434e-90ea-d5522cb04396 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:20.110975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92f9f823-a1da-434e-90ea-d5522cb04396 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:20.111638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92f9f823-a1da-434e-90ea-d5522cb04396 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:20.112698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92f9f823-a1da-434e-90ea-d5522cb04396 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:20.113363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92f9f823-a1da-434e-90ea-d5522cb04396 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:20.113945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92f9f823-a1da-434e-90ea-d5522cb04396 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:20.416001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-92f9f823-a1da-434e-90ea-d5522cb04396 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:20.432526 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-92f9f823-a1da-434e-90ea-d5522cb04396 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.336189 Sep 08 12:40:20.436523 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 367/755] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:20 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:20.664035 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d51e3048-25d2-4f8b-8519-b8de168feb2c tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] 10.222.0.78 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.225986 Sep 08 12:40:20.664713 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 368/756] 10.222.0.78 () {58 vars in 1128 bytes} [Thu Sep 8 12:40:20 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 12:40:20.674975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-59342edb-11cf-4eca-b0bf-472986a3e278 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:20.676233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-59342edb-11cf-4eca-b0bf-472986a3e278 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:20.693289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59342edb-11cf-4eca-b0bf-472986a3e278 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:20.696142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59342edb-11cf-4eca-b0bf-472986a3e278 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:20.697621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59342edb-11cf-4eca-b0bf-472986a3e278 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:20.699317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59342edb-11cf-4eca-b0bf-472986a3e278 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:20.700045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59342edb-11cf-4eca-b0bf-472986a3e278 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:20.700698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59342edb-11cf-4eca-b0bf-472986a3e278 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:20.899773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-59342edb-11cf-4eca-b0bf-472986a3e278 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:20.912553 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-59342edb-11cf-4eca-b0bf-472986a3e278 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1317 microversion: 2.1 time: 0.246320 Sep 08 12:40:20.929253 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 369/757] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:20 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1317 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:20.942960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dc88177a-db29-4c1d-bd83-29338cd0befb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:20.943904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dc88177a-db29-4c1d-bd83-29338cd0befb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:20.951298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc88177a-db29-4c1d-bd83-29338cd0befb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:20.952146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc88177a-db29-4c1d-bd83-29338cd0befb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:20.952782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc88177a-db29-4c1d-bd83-29338cd0befb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:20.954148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc88177a-db29-4c1d-bd83-29338cd0befb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:20.954867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc88177a-db29-4c1d-bd83-29338cd0befb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:20.955645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc88177a-db29-4c1d-bd83-29338cd0befb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:21.172531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dc88177a-db29-4c1d-bd83-29338cd0befb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:21.197090 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dc88177a-db29-4c1d-bd83-29338cd0befb tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1710 microversion: 2.1 time: 0.265843 Sep 08 12:40:21.213851 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 370/758] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:20 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1710 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:21.223467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c6c0a307-b373-46ec-8263-c1208de17c5f req-12a11be5-3f23-4d67-887c-74cf1e950ca5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1", "tag": "c8d4e331-8416-4a7a-8ff3-16bef87b33b4"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:21.234994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c6c0a307-b373-46ec-8263-c1208de17c5f req-12a11be5-3f23-4d67-887c-74cf1e950ca5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:21.235791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c6c0a307-b373-46ec-8263-c1208de17c5f req-12a11be5-3f23-4d67-887c-74cf1e950ca5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:21.236381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c6c0a307-b373-46ec-8263-c1208de17c5f req-12a11be5-3f23-4d67-887c-74cf1e950ca5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:21.251688 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c6c0a307-b373-46ec-8263-c1208de17c5f req-12a11be5-3f23-4d67-887c-74cf1e950ca5 service nova] Creating event network-changed:c8d4e331-8416-4a7a-8ff3-16bef87b33b4 for instance 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 on n-h2-852084-10 Sep 08 12:40:21.258454 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c6c0a307-b373-46ec-8263-c1208de17c5f req-12a11be5-3f23-4d67-887c-74cf1e950ca5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041423 Sep 08 12:40:21.264551 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 371/759] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:21.270566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9861026c-7431-4ce4-907b-9d158670a180 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Calling method '.version_select at 0x7fdb3712d820>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:21.329108 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-9861026c-7431-4ce4-907b-9d158670a180 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] HTTP exception thrown: Image not found. Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9861026c-7431-4ce4-907b-9d158670a180 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Request method failure captured: Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKz0tP7-lsXcl86vK-i4swo_Vsq1sR5ttgVVwkcZtAtYebttfJ6H5Regi-krFE6L4D9z5WMacbfx-jkoE-YQMD_zQYAIyXUBx_lXKnnlZpeje9fQvOSHdWURvD59-fB0CUh1uH5_ejOLNnimOVPzW5c4YKNX37EMaC1jf3wLU5sRoI Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0932a7740e2245a1b053a34c67f1b1f0 Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:21.331317 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0932a7740e2245a1b053a34c67f1b1f0 Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesDeleteNegativeTestJSON-1580363957-project Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 571330ccf8db469baa50f963f34b9fe5 Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957-project Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: exception: Image not found. Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '-1'} Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:21.332573 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.333447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:21.334598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9861026c-7431-4ce4-907b-9d158670a180 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Returning 404 to user: Image not found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:21.336114 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9861026c-7431-4ce4-907b-9d158670a180 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] 10.222.0.78 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.066693 Sep 08 12:40:21.337029 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 372/760] 10.222.0.78 () {58 vars in 1134 bytes} [Thu Sep 8 12:40:21 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:40:21.343595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d922bd3c-13b6-4ff3-a429-00bc39cd67bf tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:21.344346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d922bd3c-13b6-4ff3-a429-00bc39cd67bf tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:21.357799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d922bd3c-13b6-4ff3-a429-00bc39cd67bf tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:21.358951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d922bd3c-13b6-4ff3-a429-00bc39cd67bf tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:21.359436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d922bd3c-13b6-4ff3-a429-00bc39cd67bf tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:21.360160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d922bd3c-13b6-4ff3-a429-00bc39cd67bf tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:21.360615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d922bd3c-13b6-4ff3-a429-00bc39cd67bf tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:21.361044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d922bd3c-13b6-4ff3-a429-00bc39cd67bf tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:21.472873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d922bd3c-13b6-4ff3-a429-00bc39cd67bf tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '569e4e340357494692da48aabd8d2e16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ecf62bb5fa54e498d4e6561791aa11b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:21.492171 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d922bd3c-13b6-4ff3-a429-00bc39cd67bf tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 200 len: 1432 microversion: 2.1 time: 0.153963 Sep 08 12:40:21.498015 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 373/761] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:21 2022] GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 1432 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:21.518912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee644bba-2064-4a56-896a-e2a446c0e440 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Calling method '.version_select at 0x7fdb371048b0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:21.594959 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-ee644bba-2064-4a56-896a-e2a446c0e440 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] HTTP exception thrown: Image not found. Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee644bba-2064-4a56-896a-e2a446c0e440 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Request method failure captured: Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/images/1e2d07d7-94a6-48ef-9ac1-7ce83d2ed66j HTTP/1.1 Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKz0tP7-lsXcl86vK-i4swo_Vsq1sR5ttgVVwkcZtAtYebttfJ6H5Regi-krFE6L4D9z5WMacbfx-jkoE-YQMD_zQYAIyXUBx_lXKnnlZpeje9fQvOSHdWURvD59-fB0CUh1uH5_ejOLNnimOVPzW5c4YKNX37EMaC1jf3wLU5sRoI Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0932a7740e2245a1b053a34c67f1b1f0 Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:21.597988 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0932a7740e2245a1b053a34c67f1b1f0 Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesDeleteNegativeTestJSON-1580363957-project Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 571330ccf8db469baa50f963f34b9fe5 Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957-project Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: exception: Image not found. Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '1e2d07d7-94a6-48ef-9ac1-7ce83d2ed66j'} Sep 08 12:40:21.599349 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1e2d07d7-94a6-48ef-9ac1-7ce83d2ed66j to delete Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:21.600143 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1e2d07d7-94a6-48ef-9ac1-7ce83d2ed66j could not be found. Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:21.601230 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:40:21.602426 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:21.605196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee644bba-2064-4a56-896a-e2a446c0e440 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Returning 404 to user: Image not found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:21.607046 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee644bba-2064-4a56-896a-e2a446c0e440 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] 10.222.0.78 "DELETE /compute/v2.1/images/1e2d07d7-94a6-48ef-9ac1-7ce83d2ed66j" status: 404 len: 62 microversion: 2.1 time: 0.107767 Sep 08 12:40:21.608213 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 374/762] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:21 2022] DELETE /compute/v2.1/images/1e2d07d7-94a6-48ef-9ac1-7ce83d2ed66j => generated 62 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:40:21.613779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c5bb47f7-acdd-4218-b3e1-d48821fee816 req-65b053c3-607c-4869-90b9-9ab437318eea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28fb1363-4800-4df7-ae28-28d51b708679", "name": "network-vif-deleted", "tag": "2bdbe47d-9180-4a45-919a-1c7278873487"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:21.628920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c5bb47f7-acdd-4218-b3e1-d48821fee816 req-65b053c3-607c-4869-90b9-9ab437318eea service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:21.629682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c5bb47f7-acdd-4218-b3e1-d48821fee816 req-65b053c3-607c-4869-90b9-9ab437318eea service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:21.630364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c5bb47f7-acdd-4218-b3e1-d48821fee816 req-65b053c3-607c-4869-90b9-9ab437318eea service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:21.646502 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c5bb47f7-acdd-4218-b3e1-d48821fee816 req-65b053c3-607c-4869-90b9-9ab437318eea service nova] Creating event network-vif-deleted:2bdbe47d-9180-4a45-919a-1c7278873487 for instance 28fb1363-4800-4df7-ae28-28d51b708679 on n-h1-852084-10 Sep 08 12:40:21.653139 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c5bb47f7-acdd-4218-b3e1-d48821fee816 req-65b053c3-607c-4869-90b9-9ab437318eea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043447 Sep 08 12:40:21.654469 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 375/763] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:21.661129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9debc8bb-e756-415e-9598-c4bd086db6b9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:21.662341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9debc8bb-e756-415e-9598-c4bd086db6b9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:21.675881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9debc8bb-e756-415e-9598-c4bd086db6b9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:21.677467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9debc8bb-e756-415e-9598-c4bd086db6b9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:21.678686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9debc8bb-e756-415e-9598-c4bd086db6b9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:21.714520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9debc8bb-e756-415e-9598-c4bd086db6b9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:21.715718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9debc8bb-e756-415e-9598-c4bd086db6b9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:21.716545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9debc8bb-e756-415e-9598-c4bd086db6b9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:21.976012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9debc8bb-e756-415e-9598-c4bd086db6b9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:21.985385 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9debc8bb-e756-415e-9598-c4bd086db6b9 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1477 microversion: 2.1 time: 0.329243 Sep 08 12:40:21.987989 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 376/764] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:21 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1477 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:22.001757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc3d1a98-eeef-4713-a05d-bddb8e6f1e1f tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Calling method '.version_select at 0x7fdb372621f0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:22.027126 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-fc3d1a98-eeef-4713-a05d-bddb8e6f1e1f tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] HTTP exception thrown: Image not found. Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc3d1a98-eeef-4713-a05d-bddb8e6f1e1f tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Request method failure captured: Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/images/58bd19a4-a8f7-4367-8bf4-91eea8cd55761 HTTP/1.1 Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKz0tP7-lsXcl86vK-i4swo_Vsq1sR5ttgVVwkcZtAtYebttfJ6H5Regi-krFE6L4D9z5WMacbfx-jkoE-YQMD_zQYAIyXUBx_lXKnnlZpeje9fQvOSHdWURvD59-fB0CUh1uH5_ejOLNnimOVPzW5c4YKNX37EMaC1jf3wLU5sRoI Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0932a7740e2245a1b053a34c67f1b1f0 Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:22.029155 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0932a7740e2245a1b053a34c67f1b1f0 Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesDeleteNegativeTestJSON-1580363957-project Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 571330ccf8db469baa50f963f34b9fe5 Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957-project Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: exception: Image not found. Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '58bd19a4-a8f7-4367-8bf4-91eea8cd55761'} Sep 08 12:40:22.030828 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 58bd19a4-a8f7-4367-8bf4-91eea8cd55761 to delete Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:22.031840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 58bd19a4-a8f7-4367-8bf4-91eea8cd55761 could not be found. Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:22.033432 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:40:22.034809 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.036826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc3d1a98-eeef-4713-a05d-bddb8e6f1e1f tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Returning 404 to user: Image not found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:22.038460 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc3d1a98-eeef-4713-a05d-bddb8e6f1e1f tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] 10.222.0.78 "DELETE /compute/v2.1/images/58bd19a4-a8f7-4367-8bf4-91eea8cd55761" status: 404 len: 62 microversion: 2.1 time: 0.046562 Sep 08 12:40:22.039189 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 377/765] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:40:21 2022] DELETE /compute/v2.1/images/58bd19a4-a8f7-4367-8bf4-91eea8cd55761 => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:40:22.051571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4c1694b2-66c7-4c59-9f58-7643fbd3f31b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:22.052629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4c1694b2-66c7-4c59-9f58-7643fbd3f31b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:22.064648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c1694b2-66c7-4c59-9f58-7643fbd3f31b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:22.065327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c1694b2-66c7-4c59-9f58-7643fbd3f31b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:22.065955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c1694b2-66c7-4c59-9f58-7643fbd3f31b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:22.067134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c1694b2-66c7-4c59-9f58-7643fbd3f31b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:22.067777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c1694b2-66c7-4c59-9f58-7643fbd3f31b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:22.068525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c1694b2-66c7-4c59-9f58-7643fbd3f31b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:22.238926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4c1694b2-66c7-4c59-9f58-7643fbd3f31b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:22.249488 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4c1694b2-66c7-4c59-9f58-7643fbd3f31b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1317 microversion: 2.1 time: 0.203406 Sep 08 12:40:22.250092 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 378/766] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:22 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:22.255527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da7bd1dc-a932-44f6-b808-f921b857a07a tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Calling method '.version_select at 0x7fdb3712d790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:22.282322 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-da7bd1dc-a932-44f6-b808-f921b857a07a tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] HTTP exception thrown: Image not found. Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da7bd1dc-a932-44f6-b808-f921b857a07a tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Request method failure captured: Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/images/tempest-invalid-1369753728 HTTP/1.1 Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKz0tP7-lsXcl86vK-i4swo_Vsq1sR5ttgVVwkcZtAtYebttfJ6H5Regi-krFE6L4D9z5WMacbfx-jkoE-YQMD_zQYAIyXUBx_lXKnnlZpeje9fQvOSHdWURvD59-fB0CUh1uH5_ejOLNnimOVPzW5c4YKNX37EMaC1jf3wLU5sRoI Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0932a7740e2245a1b053a34c67f1b1f0 Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:22.284302 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0932a7740e2245a1b053a34c67f1b1f0 Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesDeleteNegativeTestJSON-1580363957-project Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 571330ccf8db469baa50f963f34b9fe5 Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957-project Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: exception: Image not found. Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'tempest-invalid-1369753728'} Sep 08 12:40:22.285943 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1369753728 to delete Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:22.286829 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1369753728 could not be found. Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:22.288254 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da7bd1dc-a932-44f6-b808-f921b857a07a tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Returning 404 to user: Image not found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:22.289595 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-da7bd1dc-a932-44f6-b808-f921b857a07a tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] 10.222.0.78 "DELETE /compute/v2.1/images/tempest-invalid-1369753728" status: 404 len: 62 microversion: 2.1 time: 0.034174 Sep 08 12:40:22.290642 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 379/767] 10.222.0.78 () {58 vars in 1206 bytes} [Thu Sep 8 12:40:22 2022] DELETE /compute/v2.1/images/tempest-invalid-1369753728 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:40:22.311420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3d35d393-803d-43bf-9449-fc30cbda7354 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:22.312222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3d35d393-803d-43bf-9449-fc30cbda7354 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:22.326566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d35d393-803d-43bf-9449-fc30cbda7354 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:22.327076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d35d393-803d-43bf-9449-fc30cbda7354 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:22.327575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d35d393-803d-43bf-9449-fc30cbda7354 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:22.328303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d35d393-803d-43bf-9449-fc30cbda7354 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:22.328775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d35d393-803d-43bf-9449-fc30cbda7354 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:22.329168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d35d393-803d-43bf-9449-fc30cbda7354 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:23.562599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3d35d393-803d-43bf-9449-fc30cbda7354 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:23.572941 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3d35d393-803d-43bf-9449-fc30cbda7354 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1710 microversion: 2.1 time: 1.285339 Sep 08 12:40:23.573577 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 380/768] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:22 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1710 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:23.597060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f82f6d4-39d3-445f-a1a4-6ea83e3739e4 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Calling method '.version_select at 0x7fdb37123e50>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:23.664062 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-1f82f6d4-39d3-445f-a1a4-6ea83e3739e4 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] HTTP exception thrown: Image not found. Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f82f6d4-39d3-445f-a1a4-6ea83e3739e4 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Request method failure captured: Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/images/c422d624-a9b9-4476-bc37-12912466320e HTTP/1.1 Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKz0tP7-lsXcl86vK-i4swo_Vsq1sR5ttgVVwkcZtAtYebttfJ6H5Regi-krFE6L4D9z5WMacbfx-jkoE-YQMD_zQYAIyXUBx_lXKnnlZpeje9fQvOSHdWURvD59-fB0CUh1uH5_ejOLNnimOVPzW5c4YKNX37EMaC1jf3wLU5sRoI Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0932a7740e2245a1b053a34c67f1b1f0 Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:23.666458 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0932a7740e2245a1b053a34c67f1b1f0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0932a7740e2245a1b053a34c67f1b1f0 Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957 Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesDeleteNegativeTestJSON-1580363957-project Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 571330ccf8db469baa50f963f34b9fe5 Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1580363957-project Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: exception: Image not found. Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c422d624-a9b9-4476-bc37-12912466320e'} Sep 08 12:40:23.668521 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c422d624-a9b9-4476-bc37-12912466320e to delete Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:23.669307 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c422d624-a9b9-4476-bc37-12912466320e could not be found. Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:23.670455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f82f6d4-39d3-445f-a1a4-6ea83e3739e4 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] Returning 404 to user: Image not found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:23.671658 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1f82f6d4-39d3-445f-a1a4-6ea83e3739e4 tempest-ImagesDeleteNegativeTestJSON-1580363957 tempest-ImagesDeleteNegativeTestJSON-1580363957-project] 10.222.0.78 "DELETE /compute/v2.1/images/c422d624-a9b9-4476-bc37-12912466320e" status: 404 len: 62 microversion: 2.1 time: 0.095159 Sep 08 12:40:23.672784 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 381/769] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:23 2022] DELETE /compute/v2.1/images/c422d624-a9b9-4476-bc37-12912466320e => generated 62 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:40:23.680524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae437795-6a3c-4849-8d81-617a2d573cf6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:23.684209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ae437795-6a3c-4849-8d81-617a2d573cf6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] [instance: 28fb1363-4800-4df7-ae28-28d51b708679] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:23.720081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae437795-6a3c-4849-8d81-617a2d573cf6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:23.721135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae437795-6a3c-4849-8d81-617a2d573cf6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:23.722176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae437795-6a3c-4849-8d81-617a2d573cf6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:23.722944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae437795-6a3c-4849-8d81-617a2d573cf6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:23.723606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae437795-6a3c-4849-8d81-617a2d573cf6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:23.724343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae437795-6a3c-4849-8d81-617a2d573cf6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:23.765556 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-ae437795-6a3c-4849-8d81-617a2d573cf6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] HTTP exception thrown: Instance 28fb1363-4800-4df7-ae28-28d51b708679 could not be found. Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae437795-6a3c-4849-8d81-617a2d573cf6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Request method failure captured: Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 HTTP/1.1 Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJ6EAn-GcdtXiNFjkSqvyfpWkPH4POMWzE05Ls0v2mcTNzZUWgMgNVSpSTTaYJ-wHk1xtijy8eQ-gqLro1cCKJeP21MM5LuzLjeEQBQWmIXpEjEcBDKNP-gLLrQfHm7rN026eJkKqo96mYGqUijbSgP_4QCzY-HpT41g7Y4ko6J4Ho Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 1ecf62bb5fa54e498d4e6561791aa11b Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-LiveMigrationNegativeTest-713949609 Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:23.780437 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:23.782624 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1ecf62bb5fa54e498d4e6561791aa11b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1ecf62bb5fa54e498d4e6561791aa11b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ecf62bb5fa54e498d4e6561791aa11b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1ecf62bb5fa54e498d4e6561791aa11b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:23.782624 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-LiveMigrationNegativeTest-713949609 Sep 08 12:40:23.782624 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 1ecf62bb5fa54e498d4e6561791aa11b Sep 08 12:40:23.782624 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-713949609 Sep 08 12:40:23.782624 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-LiveMigrationNegativeTest-713949609-project Sep 08 12:40:23.782624 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:23.782624 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:23.782624 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 569e4e340357494692da48aabd8d2e16 Sep 08 12:40:23.782624 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-LiveMigrationNegativeTest-713949609-project Sep 08 12:40:23.782624 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:40:23.782624 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 28fb1363-4800-4df7-ae28-28d51b708679 could not be found. Sep 08 12:40:23.782624 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '28fb1363-4800-4df7-ae28-28d51b708679'} Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28fb1363-4800-4df7-ae28-28d51b708679 could not be found. Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:23.783869 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28fb1363-4800-4df7-ae28-28d51b708679 could not be found. Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28fb1363-4800-4df7-ae28-28d51b708679 could not be found. Sep 08 12:40:23.785851 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:23.790652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae437795-6a3c-4849-8d81-617a2d573cf6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] Returning 404 to user: Instance 28fb1363-4800-4df7-ae28-28d51b708679 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:23.791877 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ae437795-6a3c-4849-8d81-617a2d573cf6 tempest-LiveMigrationNegativeTest-713949609 tempest-LiveMigrationNegativeTest-713949609-project] 10.222.0.78 "GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679" status: 404 len: 111 microversion: 2.1 time: 0.120372 Sep 08 12:40:23.793302 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 382/770] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:23 2022] GET /compute/v2.1/servers/28fb1363-4800-4df7-ae28-28d51b708679 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:40:23.805111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fa2d103b-cf5a-4ef7-98eb-08f3f6916259 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:23.812633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fa2d103b-cf5a-4ef7-98eb-08f3f6916259 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:23.833908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa2d103b-cf5a-4ef7-98eb-08f3f6916259 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:23.842275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa2d103b-cf5a-4ef7-98eb-08f3f6916259 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:23.843273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa2d103b-cf5a-4ef7-98eb-08f3f6916259 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:23.844699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa2d103b-cf5a-4ef7-98eb-08f3f6916259 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:23.845555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa2d103b-cf5a-4ef7-98eb-08f3f6916259 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:23.846431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa2d103b-cf5a-4ef7-98eb-08f3f6916259 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:24.087748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=10 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:24.117134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=40 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:24.622674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:24.896985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fa2d103b-cf5a-4ef7-98eb-08f3f6916259 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:24.911410 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fa2d103b-cf5a-4ef7-98eb-08f3f6916259 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1476 microversion: 2.1 time: 1.112065 Sep 08 12:40:24.923254 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 383/771] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:23 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1476 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:24.923254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-70f53a1a-d536-4742-a960-d2bb5e9af71f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:24.923254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-70f53a1a-d536-4742-a960-d2bb5e9af71f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:24.931195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f53a1a-d536-4742-a960-d2bb5e9af71f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:24.932157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f53a1a-d536-4742-a960-d2bb5e9af71f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:24.933576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f53a1a-d536-4742-a960-d2bb5e9af71f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:24.934605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f53a1a-d536-4742-a960-d2bb5e9af71f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:24.935357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f53a1a-d536-4742-a960-d2bb5e9af71f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:24.936040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f53a1a-d536-4742-a960-d2bb5e9af71f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:25.338365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-70f53a1a-d536-4742-a960-d2bb5e9af71f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:25.353029 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-70f53a1a-d536-4742-a960-d2bb5e9af71f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1317 microversion: 2.1 time: 0.438948 Sep 08 12:40:25.356034 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 384/772] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:24 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1317 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:25.363000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-72eb79d8-363d-4448-80ab-ab86c001b53e req-cb505752-c17f-48fe-8bce-db2e8280d09c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9ba42-71fb-4d52-a831-4c5e4ac02c81", "name": "network-vif-unplugged", "status": "completed", "tag": "0d33a618-1a67-43bf-9f68-aca849e7e550"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:25.393935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-72eb79d8-363d-4448-80ab-ab86c001b53e req-cb505752-c17f-48fe-8bce-db2e8280d09c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:25.394845 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-73f12992-b891-47ae-baad-9d40590d1d95 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370/action" status: 202 len: 0 microversion: 2.1 time: 7.803404 Sep 08 12:40:25.395516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-72eb79d8-363d-4448-80ab-ab86c001b53e req-cb505752-c17f-48fe-8bce-db2e8280d09c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:25.396193 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 389/773] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:40:17 2022] POST /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370/action => generated 0 bytes in 7806 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:25.397648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-72eb79d8-363d-4448-80ab-ab86c001b53e req-cb505752-c17f-48fe-8bce-db2e8280d09c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:25.406912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b25f71b9-e29d-41de-a5c3-2273eb959330 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:25.421259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b25f71b9-e29d-41de-a5c3-2273eb959330 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:25.445956 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-72eb79d8-363d-4448-80ab-ab86c001b53e req-cb505752-c17f-48fe-8bce-db2e8280d09c service nova] Creating event network-vif-unplugged:0d33a618-1a67-43bf-9f68-aca849e7e550 for instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 on n-h1-852084-10 Sep 08 12:40:25.448036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25f71b9-e29d-41de-a5c3-2273eb959330 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:25.450337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25f71b9-e29d-41de-a5c3-2273eb959330 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:25.452817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25f71b9-e29d-41de-a5c3-2273eb959330 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:25.454405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25f71b9-e29d-41de-a5c3-2273eb959330 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:25.457529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25f71b9-e29d-41de-a5c3-2273eb959330 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:25.458287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25f71b9-e29d-41de-a5c3-2273eb959330 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:25.462012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-72eb79d8-363d-4448-80ab-ab86c001b53e req-cb505752-c17f-48fe-8bce-db2e8280d09c service nova] Instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:40:25.499189 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-72eb79d8-363d-4448-80ab-ab86c001b53e req-cb505752-c17f-48fe-8bce-db2e8280d09c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.140717 Sep 08 12:40:25.500833 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 385/774] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:25.512286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a50a71ec-caf5-4010-a160-16ad6243774f req-bc6b754f-89a8-44fb-baa3-97cced1b722a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0c4563-36a9-47a0-b7f9-c1b03ca5164e", "name": "network-vif-unplugged", "status": "completed", "tag": "2e3928d3-2252-4d62-8307-217623c31b4e"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:25.537900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a50a71ec-caf5-4010-a160-16ad6243774f req-bc6b754f-89a8-44fb-baa3-97cced1b722a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:25.538675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a50a71ec-caf5-4010-a160-16ad6243774f req-bc6b754f-89a8-44fb-baa3-97cced1b722a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:25.540689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a50a71ec-caf5-4010-a160-16ad6243774f req-bc6b754f-89a8-44fb-baa3-97cced1b722a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:25.566581 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a50a71ec-caf5-4010-a160-16ad6243774f req-bc6b754f-89a8-44fb-baa3-97cced1b722a service nova] Creating event network-vif-unplugged:2e3928d3-2252-4d62-8307-217623c31b4e for instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e on n-h2-852084-10 Sep 08 12:40:25.576902 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a50a71ec-caf5-4010-a160-16ad6243774f req-bc6b754f-89a8-44fb-baa3-97cced1b722a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072335 Sep 08 12:40:25.578149 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 386/775] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:25.601351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b3aaf35a-6f06-4e23-a487-09ea580541d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:25.603097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b3aaf35a-6f06-4e23-a487-09ea580541d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:25.606411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:25.617617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3aaf35a-6f06-4e23-a487-09ea580541d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:25.617946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3aaf35a-6f06-4e23-a487-09ea580541d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:25.618451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3aaf35a-6f06-4e23-a487-09ea580541d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:25.634104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3aaf35a-6f06-4e23-a487-09ea580541d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:25.635110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3aaf35a-6f06-4e23-a487-09ea580541d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:25.640135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3aaf35a-6f06-4e23-a487-09ea580541d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:26.074121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b3aaf35a-6f06-4e23-a487-09ea580541d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:26.083551 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b3aaf35a-6f06-4e23-a487-09ea580541d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1502 microversion: 2.1 time: 0.503812 Sep 08 12:40:26.090116 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 387/776] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:25 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1502 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:26.095628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2830ed51-77aa-4710-bc2e-2632d46a64db tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:26.099208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2830ed51-77aa-4710-bc2e-2632d46a64db tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:26.114921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2830ed51-77aa-4710-bc2e-2632d46a64db tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:26.115787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2830ed51-77aa-4710-bc2e-2632d46a64db tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:26.116421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2830ed51-77aa-4710-bc2e-2632d46a64db tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:26.117466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2830ed51-77aa-4710-bc2e-2632d46a64db tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:26.120794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2830ed51-77aa-4710-bc2e-2632d46a64db tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:26.121510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2830ed51-77aa-4710-bc2e-2632d46a64db tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:26.144142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b25f71b9-e29d-41de-a5c3-2273eb959330 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:26.174898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:26.181954 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b25f71b9-e29d-41de-a5c3-2273eb959330 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1710 microversion: 2.1 time: 0.783831 Sep 08 12:40:26.192737 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 390/777] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:25 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1710 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:26.394179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-df8941bf-2d10-4ee6-b554-1ef0c0620886 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:26.399309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-df8941bf-2d10-4ee6-b554-1ef0c0620886 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:26.430201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df8941bf-2d10-4ee6-b554-1ef0c0620886 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:26.431575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df8941bf-2d10-4ee6-b554-1ef0c0620886 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:26.432595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df8941bf-2d10-4ee6-b554-1ef0c0620886 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:26.436769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df8941bf-2d10-4ee6-b554-1ef0c0620886 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:26.445827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df8941bf-2d10-4ee6-b554-1ef0c0620886 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:26.448521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df8941bf-2d10-4ee6-b554-1ef0c0620886 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:27.534126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2830ed51-77aa-4710-bc2e-2632d46a64db tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:27.555697 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2830ed51-77aa-4710-bc2e-2632d46a64db tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1476 microversion: 2.1 time: 1.454727 Sep 08 12:40:27.567263 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 388/778] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:26 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1476 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:27.567263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c6c1d17f-e33d-4de3-b3c8-36827f117330 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:27.567263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c6c1d17f-e33d-4de3-b3c8-36827f117330 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:27.580524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6c1d17f-e33d-4de3-b3c8-36827f117330 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:27.580951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6c1d17f-e33d-4de3-b3c8-36827f117330 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:27.581410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6c1d17f-e33d-4de3-b3c8-36827f117330 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:27.582172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6c1d17f-e33d-4de3-b3c8-36827f117330 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:27.582820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6c1d17f-e33d-4de3-b3c8-36827f117330 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:27.583301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6c1d17f-e33d-4de3-b3c8-36827f117330 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:27.679500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-df8941bf-2d10-4ee6-b554-1ef0c0620886 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:27.724749 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-df8941bf-2d10-4ee6-b554-1ef0c0620886 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1317 microversion: 2.1 time: 1.338570 Sep 08 12:40:27.728640 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 391/779] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:26 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1317 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:27.765726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5afb1914-0796-4795-9fd5-69e05ca08d0d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:27.768547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5afb1914-0796-4795-9fd5-69e05ca08d0d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:27.788151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:27.795523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5afb1914-0796-4795-9fd5-69e05ca08d0d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:27.796980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5afb1914-0796-4795-9fd5-69e05ca08d0d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:27.798033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5afb1914-0796-4795-9fd5-69e05ca08d0d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:27.799878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5afb1914-0796-4795-9fd5-69e05ca08d0d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:27.801477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5afb1914-0796-4795-9fd5-69e05ca08d0d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:27.805833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5afb1914-0796-4795-9fd5-69e05ca08d0d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:28.303114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5afb1914-0796-4795-9fd5-69e05ca08d0d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:28.317797 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5afb1914-0796-4795-9fd5-69e05ca08d0d tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1643 microversion: 2.1 time: 0.586666 Sep 08 12:40:28.341036 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 392/780] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:27 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1643 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:28.352677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-86b4c0e4-c431-4f6e-89b0-d99cb2a04e6c req-79017872-542a-4afd-9051-fe2a041dcfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cca9ba42-71fb-4d52-a831-4c5e4ac02c81", "tag": "0d33a618-1a67-43bf-9f68-aca849e7e550"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:28.391417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-86b4c0e4-c431-4f6e-89b0-d99cb2a04e6c req-79017872-542a-4afd-9051-fe2a041dcfe8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:28.395335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-86b4c0e4-c431-4f6e-89b0-d99cb2a04e6c req-79017872-542a-4afd-9051-fe2a041dcfe8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:28.396446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-86b4c0e4-c431-4f6e-89b0-d99cb2a04e6c req-79017872-542a-4afd-9051-fe2a041dcfe8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:28.416930 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-86b4c0e4-c431-4f6e-89b0-d99cb2a04e6c req-79017872-542a-4afd-9051-fe2a041dcfe8 service nova] Creating event network-changed:0d33a618-1a67-43bf-9f68-aca849e7e550 for instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 on n-h1-852084-10 Sep 08 12:40:28.428118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-86b4c0e4-c431-4f6e-89b0-d99cb2a04e6c req-79017872-542a-4afd-9051-fe2a041dcfe8 service nova] Instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:40:28.445553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c6c1d17f-e33d-4de3-b3c8-36827f117330 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:28.458556 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c6c1d17f-e33d-4de3-b3c8-36827f117330 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1502 microversion: 2.1 time: 0.900638 Sep 08 12:40:28.458975 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-86b4c0e4-c431-4f6e-89b0-d99cb2a04e6c req-79017872-542a-4afd-9051-fe2a041dcfe8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112475 Sep 08 12:40:28.462376 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 393/781] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:28.470727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-11906967-fec8-4100-9098-ebcbd4f2e87f req-0ca07d97-0839-4ea6-8016-ed5c82413fa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0c4563-36a9-47a0-b7f9-c1b03ca5164e", "name": "network-vif-deleted", "tag": "2e3928d3-2252-4d62-8307-217623c31b4e"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:28.483687 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 389/782] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:27 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1502 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:28.504747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-11906967-fec8-4100-9098-ebcbd4f2e87f req-0ca07d97-0839-4ea6-8016-ed5c82413fa0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:28.506687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-11906967-fec8-4100-9098-ebcbd4f2e87f req-0ca07d97-0839-4ea6-8016-ed5c82413fa0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:28.507660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-11906967-fec8-4100-9098-ebcbd4f2e87f req-0ca07d97-0839-4ea6-8016-ed5c82413fa0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:28.566955 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-11906967-fec8-4100-9098-ebcbd4f2e87f req-0ca07d97-0839-4ea6-8016-ed5c82413fa0 service nova] Creating event network-vif-deleted:2e3928d3-2252-4d62-8307-217623c31b4e for instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e on n-h2-852084-10 Sep 08 12:40:28.584080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-36c1fa55-66c5-4784-859b-69cf8bc9f1aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:28.584754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-36c1fa55-66c5-4784-859b-69cf8bc9f1aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:28.585930 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-11906967-fec8-4100-9098-ebcbd4f2e87f req-0ca07d97-0839-4ea6-8016-ed5c82413fa0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118726 Sep 08 12:40:28.587051 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 394/783] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:28.597368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36c1fa55-66c5-4784-859b-69cf8bc9f1aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:28.617535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36c1fa55-66c5-4784-859b-69cf8bc9f1aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:28.620476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36c1fa55-66c5-4784-859b-69cf8bc9f1aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:28.627182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36c1fa55-66c5-4784-859b-69cf8bc9f1aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:28.633383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36c1fa55-66c5-4784-859b-69cf8bc9f1aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:28.634201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36c1fa55-66c5-4784-859b-69cf8bc9f1aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:28.758320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a701095b-3bff-4c26-a401-df92daa28d85 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:28.760687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a701095b-3bff-4c26-a401-df92daa28d85 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:28.782409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a701095b-3bff-4c26-a401-df92daa28d85 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:28.783369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a701095b-3bff-4c26-a401-df92daa28d85 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:28.783925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a701095b-3bff-4c26-a401-df92daa28d85 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:28.784940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a701095b-3bff-4c26-a401-df92daa28d85 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:28.785498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a701095b-3bff-4c26-a401-df92daa28d85 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:28.789288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a701095b-3bff-4c26-a401-df92daa28d85 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:29.560094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-36c1fa55-66c5-4784-859b-69cf8bc9f1aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:29.578228 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-36c1fa55-66c5-4784-859b-69cf8bc9f1aa tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1474 microversion: 2.1 time: 0.998820 Sep 08 12:40:29.606197 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 390/784] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:28 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1474 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:29.618937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:29.619937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:29.639213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:29.647827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:29.648685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:29.649767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:29.652055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:29.653194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:29.654272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:29.872914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:29.873495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:29.880084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:29.882473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lazy-loading 'fault' on Instance uuid 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:40:30.125364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b76b0c59e23f4b20b356562bb75fe393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b81715e5ed745b5915844c61a40a017', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:30.141174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a701095b-3bff-4c26-a401-df92daa28d85 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:30.143317 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ebdf46dd-7ab8-4000-8487-fae7a5646e53 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 200 len: 1351 microversion: 2.1 time: 0.531839 Sep 08 12:40:30.160342 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 391/785] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:29 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 1351 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:30.160930 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a701095b-3bff-4c26-a401-df92daa28d85 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1317 microversion: 2.1 time: 1.407994 Sep 08 12:40:30.175576 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 395/786] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:28 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1317 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:30.178598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9589944a-84f4-4ce1-9307-7170b6b9af8b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:30.179486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9589944a-84f4-4ce1-9307-7170b6b9af8b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:30.202725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9589944a-84f4-4ce1-9307-7170b6b9af8b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:30.203722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9589944a-84f4-4ce1-9307-7170b6b9af8b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:30.210863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9589944a-84f4-4ce1-9307-7170b6b9af8b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:30.230720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9589944a-84f4-4ce1-9307-7170b6b9af8b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:30.242142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9589944a-84f4-4ce1-9307-7170b6b9af8b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:30.243313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9589944a-84f4-4ce1-9307-7170b6b9af8b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:30.618645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-adf1611a-4f19-4f31-8a9a-37b146430783 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:30.621442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-adf1611a-4f19-4f31-8a9a-37b146430783 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:30.664220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-adf1611a-4f19-4f31-8a9a-37b146430783 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:30.664724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-adf1611a-4f19-4f31-8a9a-37b146430783 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:30.665165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-adf1611a-4f19-4f31-8a9a-37b146430783 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:30.665888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-adf1611a-4f19-4f31-8a9a-37b146430783 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:30.666360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-adf1611a-4f19-4f31-8a9a-37b146430783 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:30.666781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-adf1611a-4f19-4f31-8a9a-37b146430783 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:31.326467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9589944a-84f4-4ce1-9307-7170b6b9af8b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:31.357780 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9589944a-84f4-4ce1-9307-7170b6b9af8b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1502 microversion: 2.1 time: 1.194742 Sep 08 12:40:31.359643 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 392/787] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:30 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1502 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:31.405103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-adf1611a-4f19-4f31-8a9a-37b146430783 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:31.423906 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-adf1611a-4f19-4f31-8a9a-37b146430783 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1471 microversion: 2.1 time: 0.808719 Sep 08 12:40:31.436360 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 396/788] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:30 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1471 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:31.444101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-27eaaabf-ca8b-4b36-a72c-3aee1882a561 req-53883b0b-ae5a-46bb-ac2d-80cb7703825f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e528819-d8de-43e3-b477-698431023370", "name": "network-vif-unplugged", "status": "completed", "tag": "306af9a9-d6af-4544-81f3-b62d073c0839"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:31.467174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-27eaaabf-ca8b-4b36-a72c-3aee1882a561 req-53883b0b-ae5a-46bb-ac2d-80cb7703825f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:31.467679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-27eaaabf-ca8b-4b36-a72c-3aee1882a561 req-53883b0b-ae5a-46bb-ac2d-80cb7703825f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:31.469531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-27eaaabf-ca8b-4b36-a72c-3aee1882a561 req-53883b0b-ae5a-46bb-ac2d-80cb7703825f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:31.490341 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-27eaaabf-ca8b-4b36-a72c-3aee1882a561 req-53883b0b-ae5a-46bb-ac2d-80cb7703825f service nova] Creating event network-vif-unplugged:306af9a9-d6af-4544-81f3-b62d073c0839 for instance 3e528819-d8de-43e3-b477-698431023370 on n-h2-852084-10 Sep 08 12:40:31.498642 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-27eaaabf-ca8b-4b36-a72c-3aee1882a561 req-53883b0b-ae5a-46bb-ac2d-80cb7703825f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.067528 Sep 08 12:40:31.499996 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 397/789] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:31.510434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-882f9453-7d8d-4c3b-bfe2-659b86e94ae1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:31.512509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-882f9453-7d8d-4c3b-bfe2-659b86e94ae1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:31.523028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-882f9453-7d8d-4c3b-bfe2-659b86e94ae1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:31.524723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-882f9453-7d8d-4c3b-bfe2-659b86e94ae1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:31.525318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-882f9453-7d8d-4c3b-bfe2-659b86e94ae1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:31.526115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-882f9453-7d8d-4c3b-bfe2-659b86e94ae1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:31.527686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-882f9453-7d8d-4c3b-bfe2-659b86e94ae1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:31.529206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-882f9453-7d8d-4c3b-bfe2-659b86e94ae1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:31.547963 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-882f9453-7d8d-4c3b-bfe2-659b86e94ae1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] HTTP exception thrown: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-882f9453-7d8d-4c3b-bfe2-659b86e94ae1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Request method failure captured: Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e HTTP/1.1 Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIMaBR1h21G-qYFaoLhoCgieaSrcBzA9snEvlBOVtGWyUv2Mm8IAsj3kZOv88FXMiCeFNnAuTgQ-unuSLECMNH5FY1k_Ov27WiBTmUbXYWU2aAzGqBzYZLbhokrgqEOPnHYPh2AUAX05pb_4OOO9vsCQePLZxc_spI5wq17d7aA2Uw Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:40:31.549981 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:40:31.551786 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b81715e5ed745b5915844c61a40a017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:31.551786 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:31.551786 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:31.551786 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:31.551786 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:31.551786 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:40:31.551786 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:40:31.551786 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b76b0c59e23f4b20b356562bb75fe393 Sep 08 12:40:31.551786 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:31.551786 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:40:31.551786 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:31.551786 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '0d0c4563-36a9-47a0-b7f9-c1b03ca5164e'} Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:31.552582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:31.553872 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:31.556253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-882f9453-7d8d-4c3b-bfe2-659b86e94ae1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Returning 404 to user: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:31.562367 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-882f9453-7d8d-4c3b-bfe2-659b86e94ae1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 404 len: 111 microversion: 2.1 time: 0.060915 Sep 08 12:40:31.563008 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 398/790] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:31 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:40:31.574289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7fccbf71-1508-4f95-a3f8-fa25b40c6368 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:31.575167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7fccbf71-1508-4f95-a3f8-fa25b40c6368 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:31.589584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fccbf71-1508-4f95-a3f8-fa25b40c6368 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:31.590357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fccbf71-1508-4f95-a3f8-fa25b40c6368 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:31.591730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fccbf71-1508-4f95-a3f8-fa25b40c6368 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:31.592701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fccbf71-1508-4f95-a3f8-fa25b40c6368 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:31.593317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fccbf71-1508-4f95-a3f8-fa25b40c6368 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:31.594132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fccbf71-1508-4f95-a3f8-fa25b40c6368 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:31.785969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a971cdfd-6421-40e3-93aa-291f18ac413b tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Action: 'create', calling method: .version_select at 0x7fdb374009d0>, body: {"keypair": {"name": "tempest-keypair-1638624999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKY96DTrfGUwI1QH33GIT4jLCuVUcH4ih+/cv2Px+9dbFAembI//DirD2CC0h4Mh56pXTVl7rD7fdpivwDQzE7RijJ9DCEl5ENfucRQd3fEKME18DiTD+aza0Ly5/+qWmg=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:31.807503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a971cdfd-6421-40e3-93aa-291f18ac413b tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Getting quotas for project 07648717580543638a07973ce57048c2. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:31.814535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a971cdfd-6421-40e3-93aa-291f18ac413b tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Getting quotas for user f126377dc0e043b6ab02fb98c33b89f2 and project 07648717580543638a07973ce57048c2. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:31.876114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7fccbf71-1508-4f95-a3f8-fa25b40c6368 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:31.888592 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a971cdfd-6421-40e3-93aa-291f18ac413b tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.524856 Sep 08 12:40:31.892258 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7fccbf71-1508-4f95-a3f8-fa25b40c6368 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1317 microversion: 2.1 time: 0.326687 Sep 08 12:40:31.893135 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 399/791] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:31 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1317 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:31.908191 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 393/792] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:40:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:31.910884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8523850d-fe90-4a3c-86b1-106076fb0465 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:31.914091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8523850d-fe90-4a3c-86b1-106076fb0465 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:31.921139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-07c30ff7-a363-44f3-b9c8-41b7e7fc2ffe tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:31.921581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-07c30ff7-a363-44f3-b9c8-41b7e7fc2ffe tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:31.936111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c30ff7-a363-44f3-b9c8-41b7e7fc2ffe tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:31.938978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c30ff7-a363-44f3-b9c8-41b7e7fc2ffe tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:31.944399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c30ff7-a363-44f3-b9c8-41b7e7fc2ffe tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:31.945308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c30ff7-a363-44f3-b9c8-41b7e7fc2ffe tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:31.945971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c30ff7-a363-44f3-b9c8-41b7e7fc2ffe tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:31.946359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07c30ff7-a363-44f3-b9c8-41b7e7fc2ffe tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:31.949524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8523850d-fe90-4a3c-86b1-106076fb0465 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:31.951010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8523850d-fe90-4a3c-86b1-106076fb0465 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:31.954404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8523850d-fe90-4a3c-86b1-106076fb0465 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:31.958667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8523850d-fe90-4a3c-86b1-106076fb0465 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:31.960879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8523850d-fe90-4a3c-86b1-106076fb0465 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:31.965241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8523850d-fe90-4a3c-86b1-106076fb0465 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:31.984182 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-07c30ff7-a363-44f3-b9c8-41b7e7fc2ffe tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] HTTP exception thrown: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-07c30ff7-a363-44f3-b9c8-41b7e7fc2ffe tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Request method failure captured: Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b HTTP/1.1 Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIMaBR1h21G-qYFaoLhoCgieaSrcBzA9snEvlBOVtGWyUv2Mm8IAsj3kZOv88FXMiCeFNnAuTgQ-unuSLECMNH5FY1k_Ov27WiBTmUbXYWU2aAzGqBzYZLbhokrgqEOPnHYPh2AUAX05pb_4OOO9vsCQePLZxc_spI5wq17d7aA2Uw Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:40:31.986316 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:40:31.988295 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b81715e5ed745b5915844c61a40a017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:31.988295 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:31.988295 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:31.988295 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:31.988295 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:31.988295 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:40:31.988295 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:40:31.988295 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b76b0c59e23f4b20b356562bb75fe393 Sep 08 12:40:31.988295 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:31.988295 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:40:31.988295 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:31.988295 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '164b7ad7-b8db-4492-a973-c90ee923e01b'} Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:31.989076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:31.990381 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:31.991837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-07c30ff7-a363-44f3-b9c8-41b7e7fc2ffe tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Returning 404 to user: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:31.992417 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-07c30ff7-a363-44f3-b9c8-41b7e7fc2ffe tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "DELETE /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 404 len: 111 microversion: 2.1 time: 0.078776 Sep 08 12:40:31.996986 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 400/793] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:40:31 2022] DELETE /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:40:32.011986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f111315-d211-4cff-bd5f-9bda5f945c9a tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Calling method '.version_select at 0x7fdb3b086280>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:32.033054 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f111315-d211-4cff-bd5f-9bda5f945c9a tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-1638624999" status: 200 len: 497 microversion: 2.1 time: 0.034579 Sep 08 12:40:32.035593 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 401/794] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 12:40:31 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1638624999 => generated 497 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:32.048541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1cdffe53-fac7-43c6-a4f7-1c39f97c73b1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:32.051249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1cdffe53-fac7-43c6-a4f7-1c39f97c73b1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:32.071569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cdffe53-fac7-43c6-a4f7-1c39f97c73b1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:32.072279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cdffe53-fac7-43c6-a4f7-1c39f97c73b1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:32.072737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cdffe53-fac7-43c6-a4f7-1c39f97c73b1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:32.074802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cdffe53-fac7-43c6-a4f7-1c39f97c73b1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:32.075530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cdffe53-fac7-43c6-a4f7-1c39f97c73b1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:32.076153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cdffe53-fac7-43c6-a4f7-1c39f97c73b1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:32.084806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:32.132303 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1cdffe53-fac7-43c6-a4f7-1c39f97c73b1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] HTTP exception thrown: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:32.134183 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8523850d-fe90-4a3c-86b1-106076fb0465 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "POST /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81/action" status: 204 len: 0 microversion: 2.1 time: 0.236006 Sep 08 12:40:32.134899 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 394/795] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:40:31 2022] POST /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81/action => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1cdffe53-fac7-43c6-a4f7-1c39f97c73b1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Request method failure captured: Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b HTTP/1.1 Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIMaBR1h21G-qYFaoLhoCgieaSrcBzA9snEvlBOVtGWyUv2Mm8IAsj3kZOv88FXMiCeFNnAuTgQ-unuSLECMNH5FY1k_Ov27WiBTmUbXYWU2aAzGqBzYZLbhokrgqEOPnHYPh2AUAX05pb_4OOO9vsCQePLZxc_spI5wq17d7aA2Uw Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:40:32.137450 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:40:32.138848 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b81715e5ed745b5915844c61a40a017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:32.138848 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:32.138848 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:32.138848 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:32.138848 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:32.138848 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:40:32.138848 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:40:32.138848 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b76b0c59e23f4b20b356562bb75fe393 Sep 08 12:40:32.138848 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:32.138848 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:40:32.138848 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:32.138848 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '164b7ad7-b8db-4492-a973-c90ee923e01b'} Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:32.139991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:32.142590 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:32.150582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1cdffe53-fac7-43c6-a4f7-1c39f97c73b1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Returning 404 to user: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:32.154785 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1cdffe53-fac7-43c6-a4f7-1c39f97c73b1 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 404 len: 111 microversion: 2.1 time: 0.116389 Sep 08 12:40:32.157296 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 402/796] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:32 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:40:32.169640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a5a9c101-6ae1-4de9-9c8c-9a6200df0958 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Calling method '.version_select at 0x7fdb37772af0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:32.201997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fd2c1a82-ee9c-443d-af21-9770613d7a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:32.203518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fd2c1a82-ee9c-443d-af21-9770613d7a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:32.239683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd2c1a82-ee9c-443d-af21-9770613d7a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:32.243160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd2c1a82-ee9c-443d-af21-9770613d7a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:32.243709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd2c1a82-ee9c-443d-af21-9770613d7a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:32.244887 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a5a9c101-6ae1-4de9-9c8c-9a6200df0958 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1638624999" status: 202 len: 0 microversion: 2.1 time: 0.103411 Sep 08 12:40:32.247589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd2c1a82-ee9c-443d-af21-9770613d7a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:32.249018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd2c1a82-ee9c-443d-af21-9770613d7a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:32.253244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd2c1a82-ee9c-443d-af21-9770613d7a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:32.253912 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 395/797] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Sep 8 12:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1638624999 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:32.261257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7bffa188-02cd-4504-94a0-de6a56456b3c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '.version_select at 0x7fdb377b7f70>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:32.311868 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7bffa188-02cd-4504-94a0-de6a56456b3c tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-467201876" status: 202 len: 0 microversion: 2.1 time: 0.056332 Sep 08 12:40:32.319449 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 396/798] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 12:40:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-467201876 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:32.352131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c0b58cf0-b731-4609-893e-437a9a960426 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Action: 'create', calling method: .version_select at 0x7fdb37926280>, body: {"keypair": {"name": "tempest-keypair-219142477", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhzG6pA7mRiWqqfnra9ZCDRd88kNdqYthOpux4C0ZWk5nTMISQkLKnuIy82/XmuIN7B3s/MiYQdq/JjHRSYaqiCPbR8Ime4FjR4gFEtbAVclC5vhDwUYhBFCpTkAq+E6w=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:32.397962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-c0b58cf0-b731-4609-893e-437a9a960426 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Getting quotas for project 07648717580543638a07973ce57048c2. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:32.412444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-c0b58cf0-b731-4609-893e-437a9a960426 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Getting quotas for user f126377dc0e043b6ab02fb98c33b89f2 and project 07648717580543638a07973ce57048c2. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:32.501962 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c0b58cf0-b731-4609-893e-437a9a960426 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.181190 Sep 08 12:40:32.512025 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 397/799] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:40:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:32.528753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e1e988d8-5778-4e4b-8526-89f115a81e3e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:32.532185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e1e988d8-5778-4e4b-8526-89f115a81e3e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:32.560166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1e988d8-5778-4e4b-8526-89f115a81e3e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:32.571905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1e988d8-5778-4e4b-8526-89f115a81e3e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:32.572799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1e988d8-5778-4e4b-8526-89f115a81e3e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:32.574565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1e988d8-5778-4e4b-8526-89f115a81e3e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:32.575407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1e988d8-5778-4e4b-8526-89f115a81e3e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:32.576176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1e988d8-5778-4e4b-8526-89f115a81e3e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:33.067121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fd2c1a82-ee9c-443d-af21-9770613d7a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:33.076617 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fd2c1a82-ee9c-443d-af21-9770613d7a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1471 microversion: 2.1 time: 0.910401 Sep 08 12:40:33.077213 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 403/800] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:32 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1471 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:33.097437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-78cb4d3d-b0f0-4384-9b35-2efbf395d6f6 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Calling method '.version_select at 0x7fdb3b0a34c0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:33.126722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e1e988d8-5778-4e4b-8526-89f115a81e3e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:33.138567 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-78cb4d3d-b0f0-4384-9b35-2efbf395d6f6 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-219142477" status: 202 len: 0 microversion: 2.1 time: 0.049511 Sep 08 12:40:33.147281 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 404/801] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 12:40:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-219142477 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:33.182024 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e1e988d8-5778-4e4b-8526-89f115a81e3e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1502 microversion: 2.1 time: 0.667597 Sep 08 12:40:33.189855 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 398/802] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:32 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1502 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:33.217431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7971fe02-4d55-4724-a700-a9ca787c2df6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f033dd3a-1d90-4801-b984-65a924e8a25e"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:33.222812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7971fe02-4d55-4724-a700-a9ca787c2df6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:33.235779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7971fe02-4d55-4724-a700-a9ca787c2df6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:33.237027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7971fe02-4d55-4724-a700-a9ca787c2df6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:33.238709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7971fe02-4d55-4724-a700-a9ca787c2df6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:33.241131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7971fe02-4d55-4724-a700-a9ca787c2df6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:33.242292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7971fe02-4d55-4724-a700-a9ca787c2df6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:33.243288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7971fe02-4d55-4724-a700-a9ca787c2df6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:33.609377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-764348985", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "d9960f69-c05a-419f-a17a-eee5648ebea7"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:33.821175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] validate_networks() for [('d9960f69-c05a-419f-a17a-eee5648ebea7', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:40:33.848542 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7971fe02-4d55-4724-a700-a9ca787c2df6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "POST /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.654242 Sep 08 12:40:33.872367 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 399/803] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 12:40:33 2022] POST /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments => generated 194 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:33.896663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-24d3fe11-1947-4a7f-b070-1e7eeb494115 req-893dc737-2426-445d-a9d9-176c08fa416b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1", "name": "network-vif-plugged", "status": "completed", "tag": "c8d4e331-8416-4a7a-8ff3-16bef87b33b4"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:33.917140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-24d3fe11-1947-4a7f-b070-1e7eeb494115 req-893dc737-2426-445d-a9d9-176c08fa416b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:33.918159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-24d3fe11-1947-4a7f-b070-1e7eeb494115 req-893dc737-2426-445d-a9d9-176c08fa416b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:33.919727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-24d3fe11-1947-4a7f-b070-1e7eeb494115 req-893dc737-2426-445d-a9d9-176c08fa416b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:33.935006 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-24d3fe11-1947-4a7f-b070-1e7eeb494115 req-893dc737-2426-445d-a9d9-176c08fa416b service nova] Creating event network-vif-plugged:c8d4e331-8416-4a7a-8ff3-16bef87b33b4 for instance 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 on n-h2-852084-10 Sep 08 12:40:33.945034 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-24d3fe11-1947-4a7f-b070-1e7eeb494115 req-893dc737-2426-445d-a9d9-176c08fa416b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068765 Sep 08 12:40:33.946153 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 400/804] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:33.966981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee50e5d4-be59-4f3c-a666-838887bd4c77 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:33.969875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ee50e5d4-be59-4f3c-a666-838887bd4c77 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:33.997435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee50e5d4-be59-4f3c-a666-838887bd4c77 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:34.000580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee50e5d4-be59-4f3c-a666-838887bd4c77 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:34.001804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee50e5d4-be59-4f3c-a666-838887bd4c77 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:34.003557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee50e5d4-be59-4f3c-a666-838887bd4c77 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:34.005413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee50e5d4-be59-4f3c-a666-838887bd4c77 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:34.007079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee50e5d4-be59-4f3c-a666-838887bd4c77 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:34.404746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ee50e5d4-be59-4f3c-a666-838887bd4c77 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:34.420367 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee50e5d4-be59-4f3c-a666-838887bd4c77 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1317 microversion: 2.1 time: 0.468910 Sep 08 12:40:34.423129 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 401/805] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:33 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1317 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:34.439266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ffdee347-fcc2-4cdb-8da9-216b81e096f5 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Action: 'create', calling method: .version_select at 0x7fdb370be820>, body: {"keypair": {"name": "tempest-keypair-782977538", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:34.464425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ffdee347-fcc2-4cdb-8da9-216b81e096f5 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Getting quotas for project 07648717580543638a07973ce57048c2. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:34.471075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ffdee347-fcc2-4cdb-8da9-216b81e096f5 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Getting quotas for user f126377dc0e043b6ab02fb98c33b89f2 and project 07648717580543638a07973ce57048c2. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:34.503256 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ffdee347-fcc2-4cdb-8da9-216b81e096f5 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.077573 Sep 08 12:40:34.508920 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 402/806] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:40:34 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:34.587999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-1163830345", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": "none"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:34.675795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:40:34.676455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:40:34.678297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:40:34.678918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:40:34.679446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:40:34.712014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:34.712632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:34.713166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:34.714215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:34.715670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:34.716314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:34.755829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Getting quotas for project 105d37caed90426aacdeb70033333269. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:34.765106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Getting quotas for user 39fff7dbe63845da84919aca5522e37d and project 105d37caed90426aacdeb70033333269. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:34.814350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:40:34.817411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:40:34.860207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:40:34.860832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:40:34.861143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:40:34.861613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:40:34.862214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:40:34.891752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:34.892967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:34.893773 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3095b986-7d2b-4c82-8e70-a7c314927ead tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.388546 Sep 08 12:40:34.894612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:34.897087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:34.897972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:34.899040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:34.899649 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 403/807] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 12:40:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 395 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 12:40:34.915178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-97323dec-6fc4-4c28-8968-23f27216bca0 req-c8a4139f-8a04-40ce-bce3-bd5b520a9741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e528819-d8de-43e3-b477-698431023370", "tag": "306af9a9-d6af-4544-81f3-b62d073c0839"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:34.937584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97323dec-6fc4-4c28-8968-23f27216bca0 req-c8a4139f-8a04-40ce-bce3-bd5b520a9741 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:34.938168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97323dec-6fc4-4c28-8968-23f27216bca0 req-c8a4139f-8a04-40ce-bce3-bd5b520a9741 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:34.938291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Getting quotas for project df5a27766c1942a8be6a78466f7e7192. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:34.938723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97323dec-6fc4-4c28-8968-23f27216bca0 req-c8a4139f-8a04-40ce-bce3-bd5b520a9741 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:34.944114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Getting quotas for user 8af088dfb51e4f729cc97fc91699a55f and project df5a27766c1942a8be6a78466f7e7192. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:34.953212 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-97323dec-6fc4-4c28-8968-23f27216bca0 req-c8a4139f-8a04-40ce-bce3-bd5b520a9741 service nova] Creating event network-changed:306af9a9-d6af-4544-81f3-b62d073c0839 for instance 3e528819-d8de-43e3-b477-698431023370 on n-h2-852084-10 Sep 08 12:40:34.964251 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-97323dec-6fc4-4c28-8968-23f27216bca0 req-c8a4139f-8a04-40ce-bce3-bd5b520a9741 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061573 Sep 08 12:40:34.965636 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 404/808] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:34.975112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:40:34.981089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c8a58d1-855c-4fe8-bdcc-a803ee875710 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:34.981823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6c8a58d1-855c-4fe8-bdcc-a803ee875710 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:34.984482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:40:34.997307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c8a58d1-855c-4fe8-bdcc-a803ee875710 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:34.998754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c8a58d1-855c-4fe8-bdcc-a803ee875710 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:34.999589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c8a58d1-855c-4fe8-bdcc-a803ee875710 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:35.000859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c8a58d1-855c-4fe8-bdcc-a803ee875710 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:35.002061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c8a58d1-855c-4fe8-bdcc-a803ee875710 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:35.002813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c8a58d1-855c-4fe8-bdcc-a803ee875710 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:35.056129 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8ce962de-d842-44a0-ad85-7fb8b8842a91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.906926 Sep 08 12:40:35.057447 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 405/809] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 12:40:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 12:40:35.069190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4de9ad3-620a-4e45-b52d-7e8227af1f65 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:35.070071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b4de9ad3-620a-4e45-b52d-7e8227af1f65 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:35.082481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4de9ad3-620a-4e45-b52d-7e8227af1f65 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:35.083595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4de9ad3-620a-4e45-b52d-7e8227af1f65 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:35.084786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4de9ad3-620a-4e45-b52d-7e8227af1f65 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:35.086286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4de9ad3-620a-4e45-b52d-7e8227af1f65 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:35.087403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4de9ad3-620a-4e45-b52d-7e8227af1f65 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:35.088463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4de9ad3-620a-4e45-b52d-7e8227af1f65 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:35.474010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b4de9ad3-620a-4e45-b52d-7e8227af1f65 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:35.487101 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b4de9ad3-620a-4e45-b52d-7e8227af1f65 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1502 microversion: 2.1 time: 0.428056 Sep 08 12:40:35.492138 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 406/810] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:35 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1502 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:35.501450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-264616a1-b8de-4917-b5e5-ae9e76177c4f tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:35.554430 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-264616a1-b8de-4917-b5e5-ae9e76177c4f tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/1695999658" status: 202 len: 0 microversion: 2.1 time: 0.060848 Sep 08 12:40:35.555711 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 407/811] 10.222.0.78 () {58 vars in 1161 bytes} [Thu Sep 8 12:40:35 2022] DELETE /compute/v2.1/flavors/1695999658 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:35.568952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e374437-3ee2-4be4-a5a0-635ba3d1378f tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Calling method '.version_select at 0x7fdb3b086d30>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:35.585779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6c8a58d1-855c-4fe8-bdcc-a803ee875710 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:35.599809 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6c8a58d1-855c-4fe8-bdcc-a803ee875710 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1471 microversion: 2.1 time: 0.628887 Sep 08 12:40:35.601072 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 405/812] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:34 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1471 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:35.623867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-058bdfd1-5e13-4503-997d-01d5d5144ef5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:35.626044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-058bdfd1-5e13-4503-997d-01d5d5144ef5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:35.628757 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8e374437-3ee2-4be4-a5a0-635ba3d1378f tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-782977538" status: 202 len: 0 microversion: 2.1 time: 0.070685 Sep 08 12:40:35.630150 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 408/813] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 12:40:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-782977538 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:35.645955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e424e22c-47f3-4afb-b8d1-b4fa3b1e7163 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:35.648182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e424e22c-47f3-4afb-b8d1-b4fa3b1e7163 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:35.776558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-058bdfd1-5e13-4503-997d-01d5d5144ef5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:35.787978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-058bdfd1-5e13-4503-997d-01d5d5144ef5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:35.789474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-058bdfd1-5e13-4503-997d-01d5d5144ef5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:35.798139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e424e22c-47f3-4afb-b8d1-b4fa3b1e7163 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:35.805701 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-058bdfd1-5e13-4503-997d-01d5d5144ef5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1454 microversion: 2.91 time: 0.203249 Sep 08 12:40:35.808569 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 406/814] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:35 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1454 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:35.816768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4cda4d89-0f74-4f76-abd4-9f67dfa80964 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:35.826882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e424e22c-47f3-4afb-b8d1-b4fa3b1e7163 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:35.834647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e424e22c-47f3-4afb-b8d1-b4fa3b1e7163 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:35.836925 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e424e22c-47f3-4afb-b8d1-b4fa3b1e7163 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1261 microversion: 2.25 time: 0.203365 Sep 08 12:40:35.839182 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 409/815] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:35 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1261 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:35.844735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d94357dd-64d5-4989-9cb9-d5229c32f259 tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:35.854574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4cda4d89-0f74-4f76-abd4-9f67dfa80964 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:35.871585 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d94357dd-64d5-4989-9cb9-d5229c32f259 tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.030145 Sep 08 12:40:35.873007 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 410/816] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:40:35 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:35.883012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cda4d89-0f74-4f76-abd4-9f67dfa80964 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:35.883527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cda4d89-0f74-4f76-abd4-9f67dfa80964 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:35.883966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cda4d89-0f74-4f76-abd4-9f67dfa80964 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:35.884659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cda4d89-0f74-4f76-abd4-9f67dfa80964 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:35.885113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cda4d89-0f74-4f76-abd4-9f67dfa80964 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:35.885537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cda4d89-0f74-4f76-abd4-9f67dfa80964 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:35.918397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-31b4f054-5351-4fe0-a5ae-e7a4db7f6c4c tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Action: 'create', calling method: .version_select at 0x7fdb3b430790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1706760993", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKsv3j/1WCtbEqybLUCldovc9SHjS1voiolfReeUqOdO8WbyzI46QcMnOI3shNrxvAxvxJwq1/G9bowW+KS2CDOIt+tVpVjMQ/Tvp2FH9xWNvbekapHW2WHNVQmgpYEbGg=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:35.985941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-31b4f054-5351-4fe0-a5ae-e7a4db7f6c4c tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Getting quotas for project 07648717580543638a07973ce57048c2. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:36.009311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-31b4f054-5351-4fe0-a5ae-e7a4db7f6c4c tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Getting quotas for user f126377dc0e043b6ab02fb98c33b89f2 and project 07648717580543638a07973ce57048c2. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:36.121021 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-31b4f054-5351-4fe0-a5ae-e7a4db7f6c4c tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.246142 Sep 08 12:40:36.153460 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 411/817] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:40:35 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:36.192948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92477783-cf5c-4088-b1e7-c95f7c2d8cee tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:36.271650 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92477783-cf5c-4088-b1e7-c95f7c2d8cee tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/734329767" status: 202 len: 0 microversion: 2.1 time: 0.112130 Sep 08 12:40:36.280703 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 412/818] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:40:36 2022] DELETE /compute/v2.1/flavors/734329767 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:36.289707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4335a20-e39f-460c-b67b-3f5013378179 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Action: 'create', calling method: .version_select at 0x7fdb3b1bf790>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1487572019", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFkuWkqdIQKiRfP06XrWdNR/f1uRCZXUD+PBKE4qjIAApRqrgVkVMeaW9FCTI6zIDvJGymYGb+UjpObp2SKnDdlfpBSyKHp+6pOh/VMPATOOHGbTZc4JvRLc7n59vIs1vw=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:36.348917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b4335a20-e39f-460c-b67b-3f5013378179 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Getting quotas for project 07648717580543638a07973ce57048c2. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:36.363560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b4335a20-e39f-460c-b67b-3f5013378179 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Getting quotas for user f126377dc0e043b6ab02fb98c33b89f2 and project 07648717580543638a07973ce57048c2. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:36.427112 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b4335a20-e39f-460c-b67b-3f5013378179 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.144918 Sep 08 12:40:36.435289 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 413/819] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:40:36 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:36.450738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ee390145-b1a9-4018-851e-85ef34fd1503 tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:36.521432 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ee390145-b1a9-4018-851e-85ef34fd1503 tempest-ServersWithSpecificFlavorTestJSON-557525252 tempest-ServersWithSpecificFlavorTestJSON-557525252-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.089544 Sep 08 12:40:36.526250 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 414/820] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:40:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:36.553948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-35d35305-8450-429b-9b3b-40ff670e0a64 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Action: 'create', calling method: .version_select at 0x7fdb3b465670>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-849340412", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCstr0mLHdns1x7HPizRever8dp+UJzQMyYiU3SYaRkVXjpi2xGlwqeUbyUGeTNBPLQda+n73CB9abacEj4N0wpEZpePsaRbXPkJBJuPYNXyr5Oj5xt4IHOHK3zWIfIvg=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:36.602111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-35d35305-8450-429b-9b3b-40ff670e0a64 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Getting quotas for project 07648717580543638a07973ce57048c2. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:36.609912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=8,nova_api:INSERT=5 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:36.622287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-35d35305-8450-429b-9b3b-40ff670e0a64 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Getting quotas for user f126377dc0e043b6ab02fb98c33b89f2 and project 07648717580543638a07973ce57048c2. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:36.699197 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-35d35305-8450-429b-9b3b-40ff670e0a64 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.170875 Sep 08 12:40:36.703825 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 415/821] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:40:36 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:36.713444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f3191b64-2d79-4b39-be13-d111d076a1b8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:36.715158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f3191b64-2d79-4b39-be13-d111d076a1b8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:36.728863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3191b64-2d79-4b39-be13-d111d076a1b8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:36.730250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3191b64-2d79-4b39-be13-d111d076a1b8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:36.730916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3191b64-2d79-4b39-be13-d111d076a1b8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:36.731904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3191b64-2d79-4b39-be13-d111d076a1b8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:36.732650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3191b64-2d79-4b39-be13-d111d076a1b8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:36.733256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3191b64-2d79-4b39-be13-d111d076a1b8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:36.999025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4cda4d89-0f74-4f76-abd4-9f67dfa80964 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:37.007599 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4cda4d89-0f74-4f76-abd4-9f67dfa80964 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1317 microversion: 2.1 time: 1.197866 Sep 08 12:40:37.008189 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 407/822] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:35 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1317 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:37.016648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7c7ac421-4e5b-487c-8ed1-ffba2766cb22 req-113b8b62-8662-4732-8892-243fcbe9055d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9ba42-71fb-4d52-a831-4c5e4ac02c81", "name": "network-vif-plugged", "status": "completed", "tag": "0d33a618-1a67-43bf-9f68-aca849e7e550"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:37.047072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7c7ac421-4e5b-487c-8ed1-ffba2766cb22 req-113b8b62-8662-4732-8892-243fcbe9055d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.047959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7c7ac421-4e5b-487c-8ed1-ffba2766cb22 req-113b8b62-8662-4732-8892-243fcbe9055d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.048907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7c7ac421-4e5b-487c-8ed1-ffba2766cb22 req-113b8b62-8662-4732-8892-243fcbe9055d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.072513 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7c7ac421-4e5b-487c-8ed1-ffba2766cb22 req-113b8b62-8662-4732-8892-243fcbe9055d service nova] Creating event network-vif-plugged:0d33a618-1a67-43bf-9f68-aca849e7e550 for instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 on n-h1-852084-10 Sep 08 12:40:37.085567 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7c7ac421-4e5b-487c-8ed1-ffba2766cb22 req-113b8b62-8662-4732-8892-243fcbe9055d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071631 Sep 08 12:40:37.087772 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 408/823] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:37.095611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b24d183f-bd11-43cd-8d76-4fe61a77f6cc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:37.097237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b24d183f-bd11-43cd-8d76-4fe61a77f6cc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:37.109028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b24d183f-bd11-43cd-8d76-4fe61a77f6cc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.110753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b24d183f-bd11-43cd-8d76-4fe61a77f6cc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.112061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b24d183f-bd11-43cd-8d76-4fe61a77f6cc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.115217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b24d183f-bd11-43cd-8d76-4fe61a77f6cc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.116575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b24d183f-bd11-43cd-8d76-4fe61a77f6cc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.118387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b24d183f-bd11-43cd-8d76-4fe61a77f6cc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.159669 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-b24d183f-bd11-43cd-8d76-4fe61a77f6cc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] HTTP exception thrown: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b24d183f-bd11-43cd-8d76-4fe61a77f6cc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Request method failure captured: Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e HTTP/1.1 Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIMaBR1h21G-qYFaoLhoCgieaSrcBzA9snEvlBOVtGWyUv2Mm8IAsj3kZOv88FXMiCeFNnAuTgQ-unuSLECMNH5FY1k_Ov27WiBTmUbXYWU2aAzGqBzYZLbhokrgqEOPnHYPh2AUAX05pb_4OOO9vsCQePLZxc_spI5wq17d7aA2Uw Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:37.164486 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:37.168583 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b81715e5ed745b5915844c61a40a017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:37.168583 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:37.168583 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:37.168583 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:37.168583 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:37.168583 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:37.168583 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:37.168583 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b76b0c59e23f4b20b356562bb75fe393 Sep 08 12:40:37.168583 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:37.168583 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:40:37.168583 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:37.168583 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '0d0c4563-36a9-47a0-b7f9-c1b03ca5164e'} Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:37.170219 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:37.173635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.178581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b24d183f-bd11-43cd-8d76-4fe61a77f6cc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Returning 404 to user: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:37.178581 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b24d183f-bd11-43cd-8d76-4fe61a77f6cc tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 404 len: 111 microversion: 2.1 time: 0.083316 Sep 08 12:40:37.178581 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 409/824] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:40:37 2022] DELETE /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:40:37.183023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5b1ecfc7-ee7e-48e1-9f50-4f6245e79987 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:37.183684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5b1ecfc7-ee7e-48e1-9f50-4f6245e79987 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:37.190914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b1ecfc7-ee7e-48e1-9f50-4f6245e79987 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.192034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b1ecfc7-ee7e-48e1-9f50-4f6245e79987 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.192871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b1ecfc7-ee7e-48e1-9f50-4f6245e79987 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.193818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b1ecfc7-ee7e-48e1-9f50-4f6245e79987 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.194126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b1ecfc7-ee7e-48e1-9f50-4f6245e79987 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.194562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b1ecfc7-ee7e-48e1-9f50-4f6245e79987 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.230987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f3191b64-2d79-4b39-be13-d111d076a1b8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:37.241019 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f3191b64-2d79-4b39-be13-d111d076a1b8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1502 microversion: 2.1 time: 0.535397 Sep 08 12:40:37.242075 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 416/825] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:36 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1502 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:37.247341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4f41e954-7601-475c-87cb-9e9d8553c11a tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Calling method '.version_select at 0x7fdb3b086e50>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:37.251921 n-d-852084-10 devstack@n-api.service[128971]: WARNING oslo_db.sqlalchemy.utils [None req-4f41e954-7601-475c-87cb-9e9d8553c11a tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 12:40:37.259443 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4f41e954-7601-475c-87cb-9e9d8553c11a tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1093 microversion: 2.1 time: 0.016234 Sep 08 12:40:37.260292 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 417/826] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:40:37 2022] GET /compute/v2.1/os-keypairs => generated 1093 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:37.266078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e86d9339-3f64-45d9-8b9c-2d7fe1fe579c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:37.267674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e86d9339-3f64-45d9-8b9c-2d7fe1fe579c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:37.280702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e86d9339-3f64-45d9-8b9c-2d7fe1fe579c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.281605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e86d9339-3f64-45d9-8b9c-2d7fe1fe579c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.282243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e86d9339-3f64-45d9-8b9c-2d7fe1fe579c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.283122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e86d9339-3f64-45d9-8b9c-2d7fe1fe579c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.283772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e86d9339-3f64-45d9-8b9c-2d7fe1fe579c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.284365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e86d9339-3f64-45d9-8b9c-2d7fe1fe579c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.477621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e86d9339-3f64-45d9-8b9c-2d7fe1fe579c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:37.513526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e86d9339-3f64-45d9-8b9c-2d7fe1fe579c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:37.520706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e86d9339-3f64-45d9-8b9c-2d7fe1fe579c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:37.546410 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e86d9339-3f64-45d9-8b9c-2d7fe1fe579c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1506 microversion: 2.91 time: 0.283609 Sep 08 12:40:37.550726 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 418/827] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:37 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:37.572068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f404e8f1-6418-4764-8309-90af9c7301ba tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:37.574414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f404e8f1-6418-4764-8309-90af9c7301ba tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:37.590882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f404e8f1-6418-4764-8309-90af9c7301ba tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.592566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f404e8f1-6418-4764-8309-90af9c7301ba tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.593927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f404e8f1-6418-4764-8309-90af9c7301ba tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.595786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f404e8f1-6418-4764-8309-90af9c7301ba tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.597008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f404e8f1-6418-4764-8309-90af9c7301ba tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.598572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f404e8f1-6418-4764-8309-90af9c7301ba tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.628227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5b1ecfc7-ee7e-48e1-9f50-4f6245e79987 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:37.638661 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5b1ecfc7-ee7e-48e1-9f50-4f6245e79987 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1463 microversion: 2.1 time: 0.461025 Sep 08 12:40:37.639288 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 410/828] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:37 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1463 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:37.675881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f64633f0-ebb4-4597-9235-89925a51b072 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:37.677001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f64633f0-ebb4-4597-9235-89925a51b072 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:37.690428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f64633f0-ebb4-4597-9235-89925a51b072 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.691424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f64633f0-ebb4-4597-9235-89925a51b072 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.691877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f64633f0-ebb4-4597-9235-89925a51b072 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.692618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f64633f0-ebb4-4597-9235-89925a51b072 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.693082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f64633f0-ebb4-4597-9235-89925a51b072 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.693512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f64633f0-ebb4-4597-9235-89925a51b072 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.699769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:37.715016 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-f64633f0-ebb4-4597-9235-89925a51b072 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] HTTP exception thrown: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f64633f0-ebb4-4597-9235-89925a51b072 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Request method failure captured: Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e HTTP/1.1 Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIMaBR1h21G-qYFaoLhoCgieaSrcBzA9snEvlBOVtGWyUv2Mm8IAsj3kZOv88FXMiCeFNnAuTgQ-unuSLECMNH5FY1k_Ov27WiBTmUbXYWU2aAzGqBzYZLbhokrgqEOPnHYPh2AUAX05pb_4OOO9vsCQePLZxc_spI5wq17d7aA2Uw Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:37.717061 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:37.718642 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b81715e5ed745b5915844c61a40a017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:37.718642 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:37.718642 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:37.718642 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:37.718642 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:37.718642 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:37.718642 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:37.718642 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b76b0c59e23f4b20b356562bb75fe393 Sep 08 12:40:37.718642 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:37.718642 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:40:37.718642 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:37.718642 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '0d0c4563-36a9-47a0-b7f9-c1b03ca5164e'} Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:37.719549 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. Sep 08 12:40:37.720971 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.723548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f64633f0-ebb4-4597-9235-89925a51b072 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Returning 404 to user: Instance 0d0c4563-36a9-47a0-b7f9-c1b03ca5164e could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:37.724659 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f64633f0-ebb4-4597-9235-89925a51b072 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e" status: 404 len: 111 microversion: 2.1 time: 0.076617 Sep 08 12:40:37.725403 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 411/829] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:37 2022] GET /compute/v2.1/servers/0d0c4563-36a9-47a0-b7f9-c1b03ca5164e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:40:37.731590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-27ab51ba-83af-4b95-8a82-8c3878f49716 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Calling method '.version_select at 0x7fdb37046af0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:37.760848 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-27ab51ba-83af-4b95-8a82-8c3878f49716 tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-849340412" status: 202 len: 0 microversion: 2.1 time: 0.034181 Sep 08 12:40:37.762193 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 412/830] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 12:40:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-849340412 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:37.773016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-59dffdf5-8b0c-4cbd-82ab-23c9bfdc939a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:37.775422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-59dffdf5-8b0c-4cbd-82ab-23c9bfdc939a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:37.786631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:37.798391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59dffdf5-8b0c-4cbd-82ab-23c9bfdc939a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.799121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59dffdf5-8b0c-4cbd-82ab-23c9bfdc939a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.799617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59dffdf5-8b0c-4cbd-82ab-23c9bfdc939a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.800361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59dffdf5-8b0c-4cbd-82ab-23c9bfdc939a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.800805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59dffdf5-8b0c-4cbd-82ab-23c9bfdc939a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.801232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59dffdf5-8b0c-4cbd-82ab-23c9bfdc939a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.844422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f404e8f1-6418-4764-8309-90af9c7301ba tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:37.855743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f404e8f1-6418-4764-8309-90af9c7301ba tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:37.861161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f404e8f1-6418-4764-8309-90af9c7301ba tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:37.864944 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f404e8f1-6418-4764-8309-90af9c7301ba tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1313 microversion: 2.25 time: 0.307944 Sep 08 12:40:37.866166 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 419/831] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:37 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1313 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:37.878644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f94b9740-b98f-4820-9e2a-c8113a6e5ee8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:37.885150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f94b9740-b98f-4820-9e2a-c8113a6e5ee8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:37.896770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f94b9740-b98f-4820-9e2a-c8113a6e5ee8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.897611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f94b9740-b98f-4820-9e2a-c8113a6e5ee8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.899708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f94b9740-b98f-4820-9e2a-c8113a6e5ee8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.903526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f94b9740-b98f-4820-9e2a-c8113a6e5ee8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.904071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f94b9740-b98f-4820-9e2a-c8113a6e5ee8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.904740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f94b9740-b98f-4820-9e2a-c8113a6e5ee8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.928164 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-f94b9740-b98f-4820-9e2a-c8113a6e5ee8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] HTTP exception thrown: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f94b9740-b98f-4820-9e2a-c8113a6e5ee8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Request method failure captured: Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b HTTP/1.1 Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIMaBR1h21G-qYFaoLhoCgieaSrcBzA9snEvlBOVtGWyUv2Mm8IAsj3kZOv88FXMiCeFNnAuTgQ-unuSLECMNH5FY1k_Ov27WiBTmUbXYWU2aAzGqBzYZLbhokrgqEOPnHYPh2AUAX05pb_4OOO9vsCQePLZxc_spI5wq17d7aA2Uw Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:40:37.930200 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:40:37.931803 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b81715e5ed745b5915844c61a40a017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:37.931803 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:37.931803 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:37.931803 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:37.931803 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:37.931803 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:40:37.931803 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:40:37.931803 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b76b0c59e23f4b20b356562bb75fe393 Sep 08 12:40:37.931803 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:37.931803 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:40:37.931803 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:37.931803 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '164b7ad7-b8db-4492-a973-c90ee923e01b'} Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:37.933382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:37.934667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:37.937852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f94b9740-b98f-4820-9e2a-c8113a6e5ee8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Returning 404 to user: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:37.939945 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f94b9740-b98f-4820-9e2a-c8113a6e5ee8 tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "DELETE /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 404 len: 111 microversion: 2.1 time: 0.071218 Sep 08 12:40:37.941646 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 420/832] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:40:37 2022] DELETE /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:40:37.947275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2d6854f6-730a-422f-962f-8168e035f3db tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Calling method '.version_select at 0x7fdb3b0a33a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:37.969625 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2d6854f6-730a-422f-962f-8168e035f3db tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1487572019" status: 202 len: 0 microversion: 2.1 time: 0.026686 Sep 08 12:40:37.970228 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 421/833] 10.222.0.78 () {58 vars in 1278 bytes} [Thu Sep 8 12:40:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1487572019 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:37.975354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e4c6bbfa-f8e4-4a42-9373-943b2d667a9b tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:37.976077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e4c6bbfa-f8e4-4a42-9373-943b2d667a9b tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] [instance: 164b7ad7-b8db-4492-a973-c90ee923e01b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:37.984627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e4c6bbfa-f8e4-4a42-9373-943b2d667a9b tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.984966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e4c6bbfa-f8e4-4a42-9373-943b2d667a9b tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.985539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e4c6bbfa-f8e4-4a42-9373-943b2d667a9b tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:37.986262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e4c6bbfa-f8e4-4a42-9373-943b2d667a9b tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:37.986814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e4c6bbfa-f8e4-4a42-9373-943b2d667a9b tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:37.987334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e4c6bbfa-f8e4-4a42-9373-943b2d667a9b tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:38.005342 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e4c6bbfa-f8e4-4a42-9373-943b2d667a9b tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] HTTP exception thrown: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e4c6bbfa-f8e4-4a42-9373-943b2d667a9b tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Request method failure captured: Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b HTTP/1.1 Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIMaBR1h21G-qYFaoLhoCgieaSrcBzA9snEvlBOVtGWyUv2Mm8IAsj3kZOv88FXMiCeFNnAuTgQ-unuSLECMNH5FY1k_Ov27WiBTmUbXYWU2aAzGqBzYZLbhokrgqEOPnHYPh2AUAX05pb_4OOO9vsCQePLZxc_spI5wq17d7aA2Uw Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:40:38.007632 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:40:38.009259 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6b81715e5ed745b5915844c61a40a017"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6b81715e5ed745b5915844c61a40a017"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:38.009259 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:38.009259 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 6b81715e5ed745b5915844c61a40a017 Sep 08 12:40:38.009259 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611 Sep 08 12:40:38.009259 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:38.009259 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:40:38.009259 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:40:38.009259 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b76b0c59e23f4b20b356562bb75fe393 Sep 08 12:40:38.009259 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-831851611-project Sep 08 12:40:38.009259 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:40:38.009259 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:38.009259 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '164b7ad7-b8db-4492-a973-c90ee923e01b'} Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:38.010150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. Sep 08 12:40:38.011680 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:40:38.014606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e4c6bbfa-f8e4-4a42-9373-943b2d667a9b tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] Returning 404 to user: Instance 164b7ad7-b8db-4492-a973-c90ee923e01b could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:38.016678 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e4c6bbfa-f8e4-4a42-9373-943b2d667a9b tempest-ServersWithSpecificFlavorTestJSON-831851611 tempest-ServersWithSpecificFlavorTestJSON-831851611-project] 10.222.0.78 "GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b" status: 404 len: 111 microversion: 2.1 time: 0.044310 Sep 08 12:40:38.017441 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 422/834] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:37 2022] GET /compute/v2.1/servers/164b7ad7-b8db-4492-a973-c90ee923e01b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:40:38.029934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-354110e9-2040-48eb-b057-f8f0ac19da4a tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] Calling method '.version_select at 0x7fdb3b1bfd30>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:38.056672 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-354110e9-2040-48eb-b057-f8f0ac19da4a tempest-KeyPairsV2TestJSON-356529734 tempest-KeyPairsV2TestJSON-356529734-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1706760993" status: 202 len: 0 microversion: 2.1 time: 0.032270 Sep 08 12:40:38.057578 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 423/835] 10.222.0.78 () {58 vars in 1278 bytes} [Thu Sep 8 12:40:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1706760993 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:38.062979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d24fbf95-9d39-433b-9c39-223e774c5fd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:38.064602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d24fbf95-9d39-433b-9c39-223e774c5fd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:38.072890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d24fbf95-9d39-433b-9c39-223e774c5fd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:38.073718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d24fbf95-9d39-433b-9c39-223e774c5fd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:38.074490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d24fbf95-9d39-433b-9c39-223e774c5fd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:38.075799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d24fbf95-9d39-433b-9c39-223e774c5fd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:38.076456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d24fbf95-9d39-433b-9c39-223e774c5fd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:38.077383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d24fbf95-9d39-433b-9c39-223e774c5fd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:38.228358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-59dffdf5-8b0c-4cbd-82ab-23c9bfdc939a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:38.246843 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-59dffdf5-8b0c-4cbd-82ab-23c9bfdc939a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1463 microversion: 2.1 time: 0.477983 Sep 08 12:40:38.249266 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 413/836] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:37 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1463 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:38.269442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-705eef00-3ae3-4734-b47a-a54db5f0c060 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:38.270278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-705eef00-3ae3-4734-b47a-a54db5f0c060 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:38.282751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-705eef00-3ae3-4734-b47a-a54db5f0c060 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:38.283300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-705eef00-3ae3-4734-b47a-a54db5f0c060 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:38.285706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-705eef00-3ae3-4734-b47a-a54db5f0c060 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:38.286615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-705eef00-3ae3-4734-b47a-a54db5f0c060 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:38.287105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-705eef00-3ae3-4734-b47a-a54db5f0c060 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:38.289623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-705eef00-3ae3-4734-b47a-a54db5f0c060 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:38.795271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d24fbf95-9d39-433b-9c39-223e774c5fd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:38.809280 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d24fbf95-9d39-433b-9c39-223e774c5fd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1466 microversion: 2.1 time: 0.750352 Sep 08 12:40:38.809876 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 424/837] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:38 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1466 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:38.820064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e5514b33-00cb-4b20-9c20-ae745629776c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Action: 'create', calling method: .version_select at 0x7fdb3bb6a790>, body: {"keypair": {"name": "tempest-keypair-2112600229", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOzCGdty1OIS8Aqv0Y2yjyBrafFEJZrD1vRa6O4FQBaoltpHY5NFdH6cEeWBUfcT1655hx4CQGOKEgmpCDgLmLBal9tLfceRLc5gdzrWZ1ovC4IE3T53f1YKoGaJsmLdDg=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:38.840549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-705eef00-3ae3-4734-b47a-a54db5f0c060 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:38.859461 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-705eef00-3ae3-4734-b47a-a54db5f0c060 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1502 microversion: 2.1 time: 0.594608 Sep 08 12:40:38.859724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-e5514b33-00cb-4b20-9c20-ae745629776c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Getting quotas for project 8c3e5d96296342eb8a99953dec8747c0. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:38.861331 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 414/838] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:38 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1502 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:38.870828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-e5514b33-00cb-4b20-9c20-ae745629776c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Getting quotas for user 81af813dbf5340d0a3d9d4bf0cff3da7 and project 8c3e5d96296342eb8a99953dec8747c0. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:38.876987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-31df690c-1d32-4e06-ab06-7c52e1a02ee3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:38.880094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-31df690c-1d32-4e06-ab06-7c52e1a02ee3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:38.888615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31df690c-1d32-4e06-ab06-7c52e1a02ee3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:38.889114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31df690c-1d32-4e06-ab06-7c52e1a02ee3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:38.889767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31df690c-1d32-4e06-ab06-7c52e1a02ee3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:38.890879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31df690c-1d32-4e06-ab06-7c52e1a02ee3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:38.891601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31df690c-1d32-4e06-ab06-7c52e1a02ee3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:38.892948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31df690c-1d32-4e06-ab06-7c52e1a02ee3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:38.924930 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e5514b33-00cb-4b20-9c20-ae745629776c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112895 Sep 08 12:40:38.931805 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 425/839] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:40:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:38.947358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-297195d4-682f-4c48-b89e-166b17a76dc8 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:38.949893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-297195d4-682f-4c48-b89e-166b17a76dc8 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:38.970213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-297195d4-682f-4c48-b89e-166b17a76dc8 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:38.971361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-297195d4-682f-4c48-b89e-166b17a76dc8 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:38.972785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-297195d4-682f-4c48-b89e-166b17a76dc8 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:38.974835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-297195d4-682f-4c48-b89e-166b17a76dc8 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:38.976785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-297195d4-682f-4c48-b89e-166b17a76dc8 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:38.980101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-297195d4-682f-4c48-b89e-166b17a76dc8 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:39.053133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-31df690c-1d32-4e06-ab06-7c52e1a02ee3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:39.063372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-31df690c-1d32-4e06-ab06-7c52e1a02ee3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:39.069772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-31df690c-1d32-4e06-ab06-7c52e1a02ee3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:39.084748 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-31df690c-1d32-4e06-ab06-7c52e1a02ee3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1512 microversion: 2.91 time: 0.220298 Sep 08 12:40:39.086480 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 415/840] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:38 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:39.094641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0ca0751f-d72d-4201-94b3-eb3ad0f6eff6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:39.095666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0ca0751f-d72d-4201-94b3-eb3ad0f6eff6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:39.109519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ca0751f-d72d-4201-94b3-eb3ad0f6eff6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:39.112452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ca0751f-d72d-4201-94b3-eb3ad0f6eff6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:39.113478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ca0751f-d72d-4201-94b3-eb3ad0f6eff6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:39.118846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ca0751f-d72d-4201-94b3-eb3ad0f6eff6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:39.121941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ca0751f-d72d-4201-94b3-eb3ad0f6eff6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:39.122565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ca0751f-d72d-4201-94b3-eb3ad0f6eff6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:39.289395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0ca0751f-d72d-4201-94b3-eb3ad0f6eff6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:39.316298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0ca0751f-d72d-4201-94b3-eb3ad0f6eff6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:39.319043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0ca0751f-d72d-4201-94b3-eb3ad0f6eff6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:39.326404 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0ca0751f-d72d-4201-94b3-eb3ad0f6eff6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1313 microversion: 2.25 time: 0.233871 Sep 08 12:40:39.328245 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 416/841] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:39 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:39.410315 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-297195d4-682f-4c48-b89e-166b17a76dc8 tempest-ServersOnMultiNodesTest-1157799767 tempest-ServersOnMultiNodesTest-1157799767-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1619 microversion: 2.1 time: 0.472736 Sep 08 12:40:39.415295 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 426/842] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:38 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1619 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:39.437781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e5fff3e-e764-42c9-b303-808844122f6d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:39.438475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3e5fff3e-e764-42c9-b303-808844122f6d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:39.447216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e5fff3e-e764-42c9-b303-808844122f6d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:39.448140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e5fff3e-e764-42c9-b303-808844122f6d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:39.449690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e5fff3e-e764-42c9-b303-808844122f6d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:39.451045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e5fff3e-e764-42c9-b303-808844122f6d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:39.451896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e5fff3e-e764-42c9-b303-808844122f6d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:39.452488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e5fff3e-e764-42c9-b303-808844122f6d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:39.500862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3e5fff3e-e764-42c9-b303-808844122f6d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:40:39.711875 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3e5fff3e-e764-42c9-b303-808844122f6d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 204 len: 0 microversion: 2.1 time: 0.277479 Sep 08 12:40:39.713748 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 417/843] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:40:39 2022] DELETE /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:40:39.723003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5acb6c14-834e-4509-9018-1d60a5757561 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:39.723801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5acb6c14-834e-4509-9018-1d60a5757561 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:39.737737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5acb6c14-834e-4509-9018-1d60a5757561 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:39.738207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5acb6c14-834e-4509-9018-1d60a5757561 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:39.738755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5acb6c14-834e-4509-9018-1d60a5757561 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:39.739781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5acb6c14-834e-4509-9018-1d60a5757561 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:39.740510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5acb6c14-834e-4509-9018-1d60a5757561 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:39.743960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5acb6c14-834e-4509-9018-1d60a5757561 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:39.889305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-450e5108-a55f-4ecd-9cf4-ecfe29664e74 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:39.889305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-450e5108-a55f-4ecd-9cf4-ecfe29664e74 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:39.897044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-450e5108-a55f-4ecd-9cf4-ecfe29664e74 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:39.898337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-450e5108-a55f-4ecd-9cf4-ecfe29664e74 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:39.898949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-450e5108-a55f-4ecd-9cf4-ecfe29664e74 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:39.900425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-450e5108-a55f-4ecd-9cf4-ecfe29664e74 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:39.901034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-450e5108-a55f-4ecd-9cf4-ecfe29664e74 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:39.902329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-450e5108-a55f-4ecd-9cf4-ecfe29664e74 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:40.280208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-450e5108-a55f-4ecd-9cf4-ecfe29664e74 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:40.293487 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-450e5108-a55f-4ecd-9cf4-ecfe29664e74 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1502 microversion: 2.1 time: 0.408292 Sep 08 12:40:40.301275 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 418/844] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:39 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1502 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:40.316874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f67ab7f-7fdc-4788-84ea-e262df8eb587 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:40.318418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8f67ab7f-7fdc-4788-84ea-e262df8eb587 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:40.326289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5acb6c14-834e-4509-9018-1d60a5757561 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:40.333583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f67ab7f-7fdc-4788-84ea-e262df8eb587 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:40.334568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f67ab7f-7fdc-4788-84ea-e262df8eb587 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:40.335516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f67ab7f-7fdc-4788-84ea-e262df8eb587 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:40.336806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f67ab7f-7fdc-4788-84ea-e262df8eb587 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:40.337554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f67ab7f-7fdc-4788-84ea-e262df8eb587 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:40.338164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f67ab7f-7fdc-4788-84ea-e262df8eb587 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:40.371202 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5acb6c14-834e-4509-9018-1d60a5757561 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1472 microversion: 2.1 time: 0.651160 Sep 08 12:40:40.391588 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 427/845] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:39 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1472 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:40.402822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a8fc0c2a-de94-462d-bd5b-68a71aede89a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:40.404340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a8fc0c2a-de94-462d-bd5b-68a71aede89a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:40.446298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8fc0c2a-de94-462d-bd5b-68a71aede89a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:40.450452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8fc0c2a-de94-462d-bd5b-68a71aede89a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:40.451138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8fc0c2a-de94-462d-bd5b-68a71aede89a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:40.452854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8fc0c2a-de94-462d-bd5b-68a71aede89a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:40.453931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8fc0c2a-de94-462d-bd5b-68a71aede89a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:40.454925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8fc0c2a-de94-462d-bd5b-68a71aede89a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:40.489095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8f67ab7f-7fdc-4788-84ea-e262df8eb587 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:40.499986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8f67ab7f-7fdc-4788-84ea-e262df8eb587 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:40.514300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8f67ab7f-7fdc-4788-84ea-e262df8eb587 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:40.536599 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f67ab7f-7fdc-4788-84ea-e262df8eb587 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1512 microversion: 2.91 time: 0.233430 Sep 08 12:40:40.540238 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 419/846] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:40 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:40.649237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a8fc0c2a-de94-462d-bd5b-68a71aede89a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:40.664560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a8fc0c2a-de94-462d-bd5b-68a71aede89a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:40.668859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a8fc0c2a-de94-462d-bd5b-68a71aede89a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:40.671583 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a8fc0c2a-de94-462d-bd5b-68a71aede89a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1321 microversion: 2.25 time: 0.291448 Sep 08 12:40:40.693370 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 428/847] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:40 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:41.339642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4db2c024-061e-4628-a8d3-6306c97e7113 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:41.341878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4db2c024-061e-4628-a8d3-6306c97e7113 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:41.370646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4db2c024-061e-4628-a8d3-6306c97e7113 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:41.371688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4db2c024-061e-4628-a8d3-6306c97e7113 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:41.372380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4db2c024-061e-4628-a8d3-6306c97e7113 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:41.373447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4db2c024-061e-4628-a8d3-6306c97e7113 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:41.374280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4db2c024-061e-4628-a8d3-6306c97e7113 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:41.376186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4db2c024-061e-4628-a8d3-6306c97e7113 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:41.416045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dbe051e4-735f-4b59-bdd1-7c6f3eb72916 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:41.417395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dbe051e4-735f-4b59-bdd1-7c6f3eb72916 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:41.435090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbe051e4-735f-4b59-bdd1-7c6f3eb72916 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:41.435976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbe051e4-735f-4b59-bdd1-7c6f3eb72916 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:41.436735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbe051e4-735f-4b59-bdd1-7c6f3eb72916 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:41.449418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbe051e4-735f-4b59-bdd1-7c6f3eb72916 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:41.450434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbe051e4-735f-4b59-bdd1-7c6f3eb72916 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:41.455348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbe051e4-735f-4b59-bdd1-7c6f3eb72916 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:42.055408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4db2c024-061e-4628-a8d3-6306c97e7113 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:42.086978 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4db2c024-061e-4628-a8d3-6306c97e7113 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1502 microversion: 2.1 time: 0.753267 Sep 08 12:40:42.088494 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 420/848] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:41 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1502 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:42.134142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9d6d0f53-077e-468e-9ac1-4b6ea558d2c7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:42.142330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9d6d0f53-077e-468e-9ac1-4b6ea558d2c7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:42.169644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6d0f53-077e-468e-9ac1-4b6ea558d2c7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:42.171191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6d0f53-077e-468e-9ac1-4b6ea558d2c7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:42.171680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6d0f53-077e-468e-9ac1-4b6ea558d2c7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:42.172728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6d0f53-077e-468e-9ac1-4b6ea558d2c7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:42.173187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6d0f53-077e-468e-9ac1-4b6ea558d2c7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:42.178196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6d0f53-077e-468e-9ac1-4b6ea558d2c7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:42.184881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dbe051e4-735f-4b59-bdd1-7c6f3eb72916 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:42.217331 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dbe051e4-735f-4b59-bdd1-7c6f3eb72916 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1472 microversion: 2.1 time: 0.807223 Sep 08 12:40:42.223189 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 429/849] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:41 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1472 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:40:42.238295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7eab272d-d1d5-452d-9488-dd55a9740df7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:42.243122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7eab272d-d1d5-452d-9488-dd55a9740df7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:42.281622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7eab272d-d1d5-452d-9488-dd55a9740df7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:42.284957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7eab272d-d1d5-452d-9488-dd55a9740df7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:42.285883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7eab272d-d1d5-452d-9488-dd55a9740df7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:42.286840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7eab272d-d1d5-452d-9488-dd55a9740df7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:42.288710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7eab272d-d1d5-452d-9488-dd55a9740df7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:42.291716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7eab272d-d1d5-452d-9488-dd55a9740df7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:42.435558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d6d0f53-077e-468e-9ac1-4b6ea558d2c7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:42.446724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d6d0f53-077e-468e-9ac1-4b6ea558d2c7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:42.452690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d6d0f53-077e-468e-9ac1-4b6ea558d2c7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:42.471495 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9d6d0f53-077e-468e-9ac1-4b6ea558d2c7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1533 microversion: 2.91 time: 0.381294 Sep 08 12:40:42.487693 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 421/850] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:42 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1533 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:42.556037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7eab272d-d1d5-452d-9488-dd55a9740df7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:42.568395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7eab272d-d1d5-452d-9488-dd55a9740df7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:42.585493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7eab272d-d1d5-452d-9488-dd55a9740df7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:42.587691 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7eab272d-d1d5-452d-9488-dd55a9740df7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1319 microversion: 2.25 time: 0.362378 Sep 08 12:40:42.588469 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 430/851] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:42 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:42.656742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-05a416c1-773d-4c3f-920d-2adbb1e4904c req-9602e243-fa55-4a6f-aa4b-77498bad1921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1", "name": "network-vif-deleted", "tag": "c8d4e331-8416-4a7a-8ff3-16bef87b33b4"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:42.702453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-05a416c1-773d-4c3f-920d-2adbb1e4904c req-9602e243-fa55-4a6f-aa4b-77498bad1921 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:42.703132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-05a416c1-773d-4c3f-920d-2adbb1e4904c req-9602e243-fa55-4a6f-aa4b-77498bad1921 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:42.711545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-05a416c1-773d-4c3f-920d-2adbb1e4904c req-9602e243-fa55-4a6f-aa4b-77498bad1921 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:42.744525 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-05a416c1-773d-4c3f-920d-2adbb1e4904c req-9602e243-fa55-4a6f-aa4b-77498bad1921 service nova] Creating event network-vif-deleted:c8d4e331-8416-4a7a-8ff3-16bef87b33b4 for instance 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 on n-h2-852084-10 Sep 08 12:40:42.756395 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-05a416c1-773d-4c3f-920d-2adbb1e4904c req-9602e243-fa55-4a6f-aa4b-77498bad1921 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105056 Sep 08 12:40:42.761063 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 431/852] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:40:43.016324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c138581-e00f-4fbc-be27-7b76aecf6153 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:43.017091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5c138581-e00f-4fbc-be27-7b76aecf6153 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:43.028890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c138581-e00f-4fbc-be27-7b76aecf6153 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:43.030177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c138581-e00f-4fbc-be27-7b76aecf6153 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:43.032424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c138581-e00f-4fbc-be27-7b76aecf6153 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:43.035828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c138581-e00f-4fbc-be27-7b76aecf6153 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:43.036395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c138581-e00f-4fbc-be27-7b76aecf6153 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:43.036945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c138581-e00f-4fbc-be27-7b76aecf6153 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:43.121767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62c4b8ea-816d-46dc-9f5d-c55283f77f09 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:43.127958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-62c4b8ea-816d-46dc-9f5d-c55283f77f09 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:43.149725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62c4b8ea-816d-46dc-9f5d-c55283f77f09 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:43.157145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62c4b8ea-816d-46dc-9f5d-c55283f77f09 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:43.160482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62c4b8ea-816d-46dc-9f5d-c55283f77f09 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:43.161450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62c4b8ea-816d-46dc-9f5d-c55283f77f09 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:43.162206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62c4b8ea-816d-46dc-9f5d-c55283f77f09 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:43.163055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62c4b8ea-816d-46dc-9f5d-c55283f77f09 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:43.306086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-5c138581-e00f-4fbc-be27-7b76aecf6153 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lazy-loading 'services' on Instance uuid 3a0136c7-9cb3-4446-964d-ea92bc5ff815 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:40:43.462146 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c138581-e00f-4fbc-be27-7b76aecf6153 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1940 microversion: 2.91 time: 0.966228 Sep 08 12:40:43.488846 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 422/853] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:42 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1940 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:43.502472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:43.503484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:43.514797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:43.515689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:43.516348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:43.527884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:43.528922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:43.529724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:43.638338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:43.638918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:43.639496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:43.640025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lazy-loading 'fault' on Instance uuid 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:40:43.737705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:43.742403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-62c4b8ea-816d-46dc-9f5d-c55283f77f09 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:43.747029 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eb0145c6-b812-4bd6-a747-76567df3de51 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 200 len: 1307 microversion: 2.1 time: 0.256828 Sep 08 12:40:43.751797 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 423/854] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:43 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 1307 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:43.755584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7808aed0-665b-4c3e-9f80-1fc0706545bf tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:43.765771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7808aed0-665b-4c3e-9f80-1fc0706545bf tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:43.781262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7808aed0-665b-4c3e-9f80-1fc0706545bf tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:43.782093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7808aed0-665b-4c3e-9f80-1fc0706545bf tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:43.784739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7808aed0-665b-4c3e-9f80-1fc0706545bf tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:43.785748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7808aed0-665b-4c3e-9f80-1fc0706545bf tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:43.786400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7808aed0-665b-4c3e-9f80-1fc0706545bf tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:43.789745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7808aed0-665b-4c3e-9f80-1fc0706545bf tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:43.797215 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62c4b8ea-816d-46dc-9f5d-c55283f77f09 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1502 microversion: 2.1 time: 0.679886 Sep 08 12:40:43.800204 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 432/855] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:43 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1502 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:43.816893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9a37d428-3b05-4a20-b980-c294f2425c6d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:43.817543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9a37d428-3b05-4a20-b980-c294f2425c6d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:43.850561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a37d428-3b05-4a20-b980-c294f2425c6d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:43.851106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a37d428-3b05-4a20-b980-c294f2425c6d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:43.851584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a37d428-3b05-4a20-b980-c294f2425c6d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:43.852332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a37d428-3b05-4a20-b980-c294f2425c6d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:43.852794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a37d428-3b05-4a20-b980-c294f2425c6d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:43.853223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a37d428-3b05-4a20-b980-c294f2425c6d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.025082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-7808aed0-665b-4c3e-9f80-1fc0706545bf tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lazy-loading 'services' on Instance uuid 3a0136c7-9cb3-4446-964d-ea92bc5ff815 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:40:44.076076 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7808aed0-665b-4c3e-9f80-1fc0706545bf tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1940 microversion: 2.91 time: 0.326955 Sep 08 12:40:44.100052 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 424/856] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:43 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1940 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:44.119334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-814c16c8-4ca8-4af2-80c7-6ffb661110a1 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:44.123843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-814c16c8-4ca8-4af2-80c7-6ffb661110a1 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:44.135091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-814c16c8-4ca8-4af2-80c7-6ffb661110a1 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:44.135698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-814c16c8-4ca8-4af2-80c7-6ffb661110a1 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.137098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-814c16c8-4ca8-4af2-80c7-6ffb661110a1 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:44.137795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-814c16c8-4ca8-4af2-80c7-6ffb661110a1 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:44.138398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-814c16c8-4ca8-4af2-80c7-6ffb661110a1 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.187464 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-814c16c8-4ca8-4af2-80c7-6ffb661110a1 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 500 microversion: 2.91 time: 0.071744 Sep 08 12:40:44.207294 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 425/857] 10.222.0.78 () {60 vars in 1217 bytes} [Thu Sep 8 12:40:44 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 500 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:40:44.217478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7504f534-5720-4b98-940c-47e1870e41d0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:44.218692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7504f534-5720-4b98-940c-47e1870e41d0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:44.231792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7504f534-5720-4b98-940c-47e1870e41d0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:44.235397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7504f534-5720-4b98-940c-47e1870e41d0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:44.236095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7504f534-5720-4b98-940c-47e1870e41d0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.237345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7504f534-5720-4b98-940c-47e1870e41d0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:44.249399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7504f534-5720-4b98-940c-47e1870e41d0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:44.250154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7504f534-5720-4b98-940c-47e1870e41d0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.293660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-7504f534-5720-4b98-940c-47e1870e41d0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lazy-loading 'flavor' on Instance uuid 3a0136c7-9cb3-4446-964d-ea92bc5ff815 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:40:44.423853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9a37d428-3b05-4a20-b980-c294f2425c6d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:44.445361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9a37d428-3b05-4a20-b980-c294f2425c6d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:44.449157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9a37d428-3b05-4a20-b980-c294f2425c6d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:44.450758 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9a37d428-3b05-4a20-b980-c294f2425c6d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1361 microversion: 2.25 time: 0.650058 Sep 08 12:40:44.452000 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 433/858] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:43 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1361 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:44.463810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:44.722987 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7504f534-5720-4b98-940c-47e1870e41d0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "POST /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815/action" status: 202 len: 0 microversion: 2.91 time: 0.509808 Sep 08 12:40:44.724451 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 426/859] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 12:40:44 2022] POST /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 12:40:44.734470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1f0dd974-418b-4568-896e-60733e314529 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:44.735791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1f0dd974-418b-4568-896e-60733e314529 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:44.744371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f0dd974-418b-4568-896e-60733e314529 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:44.747431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f0dd974-418b-4568-896e-60733e314529 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:44.748574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f0dd974-418b-4568-896e-60733e314529 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.749833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f0dd974-418b-4568-896e-60733e314529 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:44.750549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f0dd974-418b-4568-896e-60733e314529 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:44.751314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f0dd974-418b-4568-896e-60733e314529 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.773792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c41eb3bb-900b-4a35-912e-6f5dffe58a50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:44.775086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c41eb3bb-900b-4a35-912e-6f5dffe58a50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:44.808094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c41eb3bb-900b-4a35-912e-6f5dffe58a50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:44.809046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c41eb3bb-900b-4a35-912e-6f5dffe58a50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:44.809618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c41eb3bb-900b-4a35-912e-6f5dffe58a50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.810477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c41eb3bb-900b-4a35-912e-6f5dffe58a50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:44.813143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c41eb3bb-900b-4a35-912e-6f5dffe58a50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:44.814843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c41eb3bb-900b-4a35-912e-6f5dffe58a50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.851424 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-c41eb3bb-900b-4a35-912e-6f5dffe58a50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] HTTP exception thrown: Instance 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 could not be found. Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c41eb3bb-900b-4a35-912e-6f5dffe58a50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Request method failure captured: Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 HTTP/1.1 Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIw6pvhdO4zXhGJCeJ68kJVlsg90ZbSv8TA1izVc9P8bD4Mdu4KXagKTNz1oO93ELXFA4g_EqPdtm7gyry5N4K7tu7lRJSgVuw6GQPzVgbC4uAAvWiLPrDcsyxqGiNNxf4BjA9XsBe47roVYCmKPUnjbtRu99GiZHdc1lNwkgijj3o Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:44.862656 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:44.864449 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:44.864449 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:40:44.864449 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:40:44.864449 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:40:44.864449 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:40:44.864449 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:44.864449 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:44.864449 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7d8ffdbbf2de43b9b4efc89b7fcd4897 Sep 08 12:40:44.864449 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:40:44.864449 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:40:44.864449 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 could not be found. Sep 08 12:40:44.864449 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1'} Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 could not be found. Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:44.865421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 could not be found. Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 could not be found. Sep 08 12:40:44.866837 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:44.868180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c41eb3bb-900b-4a35-912e-6f5dffe58a50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Returning 404 to user: Instance 9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:44.870345 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c41eb3bb-900b-4a35-912e-6f5dffe58a50 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1" status: 404 len: 111 microversion: 2.1 time: 0.101711 Sep 08 12:40:44.873092 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 427/860] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:44 2022] GET /compute/v2.1/servers/9ed7bf13-6790-48f2-8f58-a36d0b2fb7e1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 12:40:44.882056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4a1ad4f1-e4bb-4db3-af01-9f7102924974 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:44.883555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f0dd974-418b-4568-896e-60733e314529 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:44.896627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4a1ad4f1-e4bb-4db3-af01-9f7102924974 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:44.903338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f0dd974-418b-4568-896e-60733e314529 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:44.904823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f0dd974-418b-4568-896e-60733e314529 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:44.911050 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1f0dd974-418b-4568-896e-60733e314529 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.181973 Sep 08 12:40:44.915933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a1ad4f1-e4bb-4db3-af01-9f7102924974 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:44.927475 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 434/861] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:44 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:44.927629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a1ad4f1-e4bb-4db3-af01-9f7102924974 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:44.927629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a1ad4f1-e4bb-4db3-af01-9f7102924974 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.927629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a1ad4f1-e4bb-4db3-af01-9f7102924974 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:44.927629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a1ad4f1-e4bb-4db3-af01-9f7102924974 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:44.927936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a1ad4f1-e4bb-4db3-af01-9f7102924974 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.928021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ca404efd-958e-4f77-acf0-b4143a4948a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:44.928021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ca404efd-958e-4f77-acf0-b4143a4948a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:44.928021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:44.939672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca404efd-958e-4f77-acf0-b4143a4948a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:44.939672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca404efd-958e-4f77-acf0-b4143a4948a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:44.939672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca404efd-958e-4f77-acf0-b4143a4948a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.939672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca404efd-958e-4f77-acf0-b4143a4948a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:44.940124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca404efd-958e-4f77-acf0-b4143a4948a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:44.940124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca404efd-958e-4f77-acf0-b4143a4948a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:44.993486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ca404efd-958e-4f77-acf0-b4143a4948a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:40:45.108787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:45.171629 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ca404efd-958e-4f77-acf0-b4143a4948a9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 204 len: 0 microversion: 2.1 time: 0.253851 Sep 08 12:40:45.175639 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 435/862] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:40:44 2022] DELETE /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:40:45.182527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fcaf6f5b-9726-4745-81bf-084f5461972e tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Calling method '.version_select at 0x7fdb3b070160>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:45.188181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fcaf6f5b-9726-4745-81bf-084f5461972e tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:45.188714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fcaf6f5b-9726-4745-81bf-084f5461972e tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:45.189251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fcaf6f5b-9726-4745-81bf-084f5461972e tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:45.209993 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fcaf6f5b-9726-4745-81bf-084f5461972e tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1584 microversion: 2.1 time: 0.032693 Sep 08 12:40:45.222370 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 436/863] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 12:40:45 2022] GET /compute/v2.1/os-migrations => generated 1584 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:45.227606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-726fda08-6242-4920-8f52-9ac52107392d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:45.228359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-726fda08-6242-4920-8f52-9ac52107392d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:45.238840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-726fda08-6242-4920-8f52-9ac52107392d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:45.239382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-726fda08-6242-4920-8f52-9ac52107392d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:45.239918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-726fda08-6242-4920-8f52-9ac52107392d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:45.240655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-726fda08-6242-4920-8f52-9ac52107392d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:45.241179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-726fda08-6242-4920-8f52-9ac52107392d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:45.241666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-726fda08-6242-4920-8f52-9ac52107392d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:45.494654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4a1ad4f1-e4bb-4db3-af01-9f7102924974 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:45.507812 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4a1ad4f1-e4bb-4db3-af01-9f7102924974 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1477 microversion: 2.1 time: 0.633390 Sep 08 12:40:45.515368 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 428/864] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:44 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1477 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:45.527513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-71441d81-3a02-45b2-aaf4-462e863532a8 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:45.547896 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-71441d81-3a02-45b2-aaf4-462e863532a8 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029023 Sep 08 12:40:45.557149 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 429/865] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:40:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:45.569151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-458f3a81-a61c-4336-9e5b-88f50eb4dbb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:45.575928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-458f3a81-a61c-4336-9e5b-88f50eb4dbb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:45.584175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-458f3a81-a61c-4336-9e5b-88f50eb4dbb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:45.584936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-458f3a81-a61c-4336-9e5b-88f50eb4dbb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:45.585656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-458f3a81-a61c-4336-9e5b-88f50eb4dbb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:45.587099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-458f3a81-a61c-4336-9e5b-88f50eb4dbb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:45.587914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-458f3a81-a61c-4336-9e5b-88f50eb4dbb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:45.588497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-458f3a81-a61c-4336-9e5b-88f50eb4dbb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:45.676665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-726fda08-6242-4920-8f52-9ac52107392d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:45.689773 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-726fda08-6242-4920-8f52-9ac52107392d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1471 microversion: 2.1 time: 0.466172 Sep 08 12:40:45.707538 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 437/866] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:45 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1471 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:45.751759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a02ec1f-2636-4c6a-92ff-0afcb4801d24 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '.version_select at 0x7fdb3b0d69d0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:45.766372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a02ec1f-2636-4c6a-92ff-0afcb4801d24 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:45.767160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a02ec1f-2636-4c6a-92ff-0afcb4801d24 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:45.768640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a02ec1f-2636-4c6a-92ff-0afcb4801d24 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:45.782359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=20 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:45.795887 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a02ec1f-2636-4c6a-92ff-0afcb4801d24 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1584 microversion: 2.1 time: 0.068400 Sep 08 12:40:45.813088 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 438/867] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 12:40:45 2022] GET /compute/v2.1/os-migrations => generated 1584 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:45.824304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ec5459c-3847-4409-b365-07aef27e0687 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1233071314", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:45.881786 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ec5459c-3847-4409-b365-07aef27e0687 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.066484 Sep 08 12:40:45.896131 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 439/868] 10.222.0.78 () {60 vars in 1146 bytes} [Thu Sep 8 12:40:45 2022] POST /compute/v2.1/flavors => generated 499 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:45.925355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-05e5ea43-105e-4dfe-b18f-d1902b96a6d1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:45.928663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-05e5ea43-105e-4dfe-b18f-d1902b96a6d1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:45.958881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-05e5ea43-105e-4dfe-b18f-d1902b96a6d1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:45.967538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-05e5ea43-105e-4dfe-b18f-d1902b96a6d1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:45.970239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-05e5ea43-105e-4dfe-b18f-d1902b96a6d1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:45.971593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-05e5ea43-105e-4dfe-b18f-d1902b96a6d1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:45.972307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-05e5ea43-105e-4dfe-b18f-d1902b96a6d1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:45.972890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-05e5ea43-105e-4dfe-b18f-d1902b96a6d1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:46.088842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-458f3a81-a61c-4336-9e5b-88f50eb4dbb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:46.102932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-458f3a81-a61c-4336-9e5b-88f50eb4dbb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:46.104417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-458f3a81-a61c-4336-9e5b-88f50eb4dbb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:46.105780 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-458f3a81-a61c-4336-9e5b-88f50eb4dbb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1361 microversion: 2.25 time: 0.545779 Sep 08 12:40:46.119219 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 430/869] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:45 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1361 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:46.119219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e1f772f-153b-4a23-860c-97479e519ab2 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:46.124665 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6e1f772f-153b-4a23-860c-97479e519ab2 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012418 Sep 08 12:40:46.124665 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 431/870] 10.222.0.78 () {58 vars in 1182 bytes} [Thu Sep 8 12:40:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:40:46.126236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4d3e76e-d506-48b1-b48f-5c1cab9dc2c5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:46.127575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a4d3e76e-d506-48b1-b48f-5c1cab9dc2c5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:46.134567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4d3e76e-d506-48b1-b48f-5c1cab9dc2c5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:46.135084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4d3e76e-d506-48b1-b48f-5c1cab9dc2c5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:46.135673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4d3e76e-d506-48b1-b48f-5c1cab9dc2c5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:46.136983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4d3e76e-d506-48b1-b48f-5c1cab9dc2c5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:46.137434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4d3e76e-d506-48b1-b48f-5c1cab9dc2c5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:46.138533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4d3e76e-d506-48b1-b48f-5c1cab9dc2c5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:46.529058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4d3e76e-d506-48b1-b48f-5c1cab9dc2c5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:46.550699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4d3e76e-d506-48b1-b48f-5c1cab9dc2c5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:46.554565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4d3e76e-d506-48b1-b48f-5c1cab9dc2c5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:46.562837 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a4d3e76e-d506-48b1-b48f-5c1cab9dc2c5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.440977 Sep 08 12:40:46.565877 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 432/871] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:46 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:46.573185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-875478662", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "f361ff80-9c37-43f7-a9c8-9546c09dd3c5"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:46.720332 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-05e5ea43-105e-4dfe-b18f-d1902b96a6d1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1630 microversion: 2.1 time: 0.822280 Sep 08 12:40:46.732324 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 440/872] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:45 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1630 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:46.732324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-74755e30-a7e7-42dd-86e3-2e30f6441b45 req-121c215c-bdf4-4728-b9fb-a145418a47a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60526de3-67cc-4bf8-911d-590f531d0130", "tag": "fbd4d925-0ef2-4240-a577-779541fca496"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:46.741735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:40:46.765184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-74755e30-a7e7-42dd-86e3-2e30f6441b45 req-121c215c-bdf4-4728-b9fb-a145418a47a0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:46.765744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-74755e30-a7e7-42dd-86e3-2e30f6441b45 req-121c215c-bdf4-4728-b9fb-a145418a47a0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:46.766108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-74755e30-a7e7-42dd-86e3-2e30f6441b45 req-121c215c-bdf4-4728-b9fb-a145418a47a0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:46.788905 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-74755e30-a7e7-42dd-86e3-2e30f6441b45 req-121c215c-bdf4-4728-b9fb-a145418a47a0 service nova] Creating event network-changed:fbd4d925-0ef2-4240-a577-779541fca496 for instance 60526de3-67cc-4bf8-911d-590f531d0130 on n-h1-852084-10 Sep 08 12:40:46.794906 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-74755e30-a7e7-42dd-86e3-2e30f6441b45 req-121c215c-bdf4-4728-b9fb-a145418a47a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071967 Sep 08 12:40:46.795635 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 441/873] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:46.808778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-03f1c77b-8630-485b-a802-38e7955daa2e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:46.809786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-03f1c77b-8630-485b-a802-38e7955daa2e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:46.819985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03f1c77b-8630-485b-a802-38e7955daa2e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:46.821122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03f1c77b-8630-485b-a802-38e7955daa2e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:46.821976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03f1c77b-8630-485b-a802-38e7955daa2e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:46.822751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03f1c77b-8630-485b-a802-38e7955daa2e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:46.823115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03f1c77b-8630-485b-a802-38e7955daa2e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:46.824983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03f1c77b-8630-485b-a802-38e7955daa2e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:47.782737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-03f1c77b-8630-485b-a802-38e7955daa2e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:47.804404 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-03f1c77b-8630-485b-a802-38e7955daa2e tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1471 microversion: 2.1 time: 0.998911 Sep 08 12:40:47.806783 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 442/874] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:46 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1471 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:47.818977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-11fae784-792a-4792-9baa-6e7841496407 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Action: 'create', calling method: .version_select at 0x7fdb3af993a0>, body: {"keypair": {"name": "tempest-keypair-24079275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKDOdDv3y92KjX/gmOBcLdgPK6+sIdVCzsBIh39RA7AXm2oi9+h63V1Vi0qA5wR6O/TVH+JZ90Krlp0RKKmiecnx3St9UpR4vn0byJj/NEKx5R8znOrj6kzgdet0zW1sNw=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:47.919765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-11fae784-792a-4792-9baa-6e7841496407 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Getting quotas for project 5619e927afd449c4897bd41f96390988. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:47.930220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-11fae784-792a-4792-9baa-6e7841496407 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Getting quotas for user c7375a1da7fb43d8a6725f61fa2c7ec9 and project 5619e927afd449c4897bd41f96390988. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:47.994559 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-11fae784-792a-4792-9baa-6e7841496407 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.184882 Sep 08 12:40:48.006984 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 443/875] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:40:47 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:48.015317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7e9524d0-bf03-4555-8fae-4baf73b2e7f3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:48.016727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7e9524d0-bf03-4555-8fae-4baf73b2e7f3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:48.029313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e9524d0-bf03-4555-8fae-4baf73b2e7f3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:48.031583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e9524d0-bf03-4555-8fae-4baf73b2e7f3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:48.032838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e9524d0-bf03-4555-8fae-4baf73b2e7f3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:48.034488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e9524d0-bf03-4555-8fae-4baf73b2e7f3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:48.035963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e9524d0-bf03-4555-8fae-4baf73b2e7f3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:48.037090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e9524d0-bf03-4555-8fae-4baf73b2e7f3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:48.142788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:40:48.143789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:40:48.144995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:40:48.146036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:40:48.148189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:40:48.171124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:48.173580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:48.174716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:48.176513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:48.177812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:48.179052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:48.216741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Getting quotas for project 8c3e5d96296342eb8a99953dec8747c0. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:48.225944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Getting quotas for user 81af813dbf5340d0a3d9d4bf0cff3da7 and project 8c3e5d96296342eb8a99953dec8747c0. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:48.255906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:40:48.260760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:40:48.414849 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4511f0d2-773d-4bcd-bb46-4036c84eeecc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.845839 Sep 08 12:40:48.443749 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 433/876] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:40:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1876 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:40:48.455548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-af50339f-40a0-433d-ac8f-f6f72e2fad66 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:48.456441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-af50339f-40a0-433d-ac8f-f6f72e2fad66 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:48.471636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af50339f-40a0-433d-ac8f-f6f72e2fad66 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:48.480374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af50339f-40a0-433d-ac8f-f6f72e2fad66 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:48.481114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af50339f-40a0-433d-ac8f-f6f72e2fad66 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:48.482251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af50339f-40a0-433d-ac8f-f6f72e2fad66 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:48.483397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af50339f-40a0-433d-ac8f-f6f72e2fad66 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:48.484015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af50339f-40a0-433d-ac8f-f6f72e2fad66 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:48.718556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-af50339f-40a0-433d-ac8f-f6f72e2fad66 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:48.746780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-af50339f-40a0-433d-ac8f-f6f72e2fad66 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:48.755486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-af50339f-40a0-433d-ac8f-f6f72e2fad66 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:48.769968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7e9524d0-bf03-4555-8fae-4baf73b2e7f3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:48.821512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7e9524d0-bf03-4555-8fae-4baf73b2e7f3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:48.826796 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-af50339f-40a0-433d-ac8f-f6f72e2fad66 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.380327 Sep 08 12:40:48.827903 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 434/877] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:48 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:48.845852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7e9524d0-bf03-4555-8fae-4baf73b2e7f3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:48.847832 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7e9524d0-bf03-4555-8fae-4baf73b2e7f3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1361 microversion: 2.25 time: 0.839641 Sep 08 12:40:48.851544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cf91fc0c-688b-48f6-9029-c3e1349d1f0d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:48.852294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cf91fc0c-688b-48f6-9029-c3e1349d1f0d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:48.854057 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 444/878] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:48 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1361 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:48.874176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ead2048a-a20f-46fc-9740-cb61850fcfe5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:48.877837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ead2048a-a20f-46fc-9740-cb61850fcfe5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:48.899762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ead2048a-a20f-46fc-9740-cb61850fcfe5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:48.900297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ead2048a-a20f-46fc-9740-cb61850fcfe5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:48.900891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ead2048a-a20f-46fc-9740-cb61850fcfe5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:48.902328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ead2048a-a20f-46fc-9740-cb61850fcfe5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:48.902797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ead2048a-a20f-46fc-9740-cb61850fcfe5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:48.903257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ead2048a-a20f-46fc-9740-cb61850fcfe5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:49.081428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cf91fc0c-688b-48f6-9029-c3e1349d1f0d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:49.089935 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cf91fc0c-688b-48f6-9029-c3e1349d1f0d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1278 microversion: 2.1 time: 0.247944 Sep 08 12:40:49.104068 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 435/879] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:48 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1278 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:49.121438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ec7e2691-7632-4279-a9bc-22468044b6a8 req-4665e501-be6a-425f-88e8-a762707e2df7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a774146-a939-4912-8b1e-b52822ced599", "name": "network-vif-deleted", "tag": "a63ad412-f9c6-450f-b36d-46e365e0d8de"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:49.150068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ec7e2691-7632-4279-a9bc-22468044b6a8 req-4665e501-be6a-425f-88e8-a762707e2df7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:49.155021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ec7e2691-7632-4279-a9bc-22468044b6a8 req-4665e501-be6a-425f-88e8-a762707e2df7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:49.155782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ec7e2691-7632-4279-a9bc-22468044b6a8 req-4665e501-be6a-425f-88e8-a762707e2df7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:49.181679 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ec7e2691-7632-4279-a9bc-22468044b6a8 req-4665e501-be6a-425f-88e8-a762707e2df7 service nova] Creating event network-vif-deleted:a63ad412-f9c6-450f-b36d-46e365e0d8de for instance 5a774146-a939-4912-8b1e-b52822ced599 on n-h1-852084-10 Sep 08 12:40:49.198194 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ec7e2691-7632-4279-a9bc-22468044b6a8 req-4665e501-be6a-425f-88e8-a762707e2df7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087996 Sep 08 12:40:49.200846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ead2048a-a20f-46fc-9740-cb61850fcfe5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:49.202525 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 436/880] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:49.239156 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ead2048a-a20f-46fc-9740-cb61850fcfe5 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 200 len: 1429 microversion: 2.1 time: 0.380547 Sep 08 12:40:49.245821 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 445/881] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:48 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 1429 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:49.863727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cbd30acb-c251-416f-b5a7-8b7752b53e2a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:49.866111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cbd30acb-c251-416f-b5a7-8b7752b53e2a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:49.878394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-97a09711-8652-4d37-a7fd-30fba3b6f59b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:49.879094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-97a09711-8652-4d37-a7fd-30fba3b6f59b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:49.883745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=4,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:49.890253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbd30acb-c251-416f-b5a7-8b7752b53e2a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:49.895124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbd30acb-c251-416f-b5a7-8b7752b53e2a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:49.895735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbd30acb-c251-416f-b5a7-8b7752b53e2a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:49.898770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbd30acb-c251-416f-b5a7-8b7752b53e2a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:49.899662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbd30acb-c251-416f-b5a7-8b7752b53e2a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:49.900229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbd30acb-c251-416f-b5a7-8b7752b53e2a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:49.904769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97a09711-8652-4d37-a7fd-30fba3b6f59b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:49.905497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97a09711-8652-4d37-a7fd-30fba3b6f59b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:49.906217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97a09711-8652-4d37-a7fd-30fba3b6f59b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:49.907164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97a09711-8652-4d37-a7fd-30fba3b6f59b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:49.907804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97a09711-8652-4d37-a7fd-30fba3b6f59b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:49.908381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97a09711-8652-4d37-a7fd-30fba3b6f59b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:50.753208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cbd30acb-c251-416f-b5a7-8b7752b53e2a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:50.764115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cbd30acb-c251-416f-b5a7-8b7752b53e2a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:50.766204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cbd30acb-c251-416f-b5a7-8b7752b53e2a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:50.774922 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cbd30acb-c251-416f-b5a7-8b7752b53e2a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.919410 Sep 08 12:40:50.789755 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 437/882] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:49 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:50.804815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ede81ae-35c0-427a-91e6-d844476f917d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:50.805438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6ede81ae-35c0-427a-91e6-d844476f917d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:50.812557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ede81ae-35c0-427a-91e6-d844476f917d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:50.813303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ede81ae-35c0-427a-91e6-d844476f917d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:50.813921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ede81ae-35c0-427a-91e6-d844476f917d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:50.814782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ede81ae-35c0-427a-91e6-d844476f917d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:50.815423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ede81ae-35c0-427a-91e6-d844476f917d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:50.816027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ede81ae-35c0-427a-91e6-d844476f917d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:51.058621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6ede81ae-35c0-427a-91e6-d844476f917d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:51.076926 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6ede81ae-35c0-427a-91e6-d844476f917d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1330 microversion: 2.1 time: 0.285963 Sep 08 12:40:51.083935 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 438/883] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:50 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1330 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:51.094433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6592cc14-f802-49fc-a453-4d4b76849a74 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:51.098801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6592cc14-f802-49fc-a453-4d4b76849a74 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 5a774146-a939-4912-8b1e-b52822ced599] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:51.108659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6592cc14-f802-49fc-a453-4d4b76849a74 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:51.109389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6592cc14-f802-49fc-a453-4d4b76849a74 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:51.109990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6592cc14-f802-49fc-a453-4d4b76849a74 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:51.110867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6592cc14-f802-49fc-a453-4d4b76849a74 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:51.111670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6592cc14-f802-49fc-a453-4d4b76849a74 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:51.112255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6592cc14-f802-49fc-a453-4d4b76849a74 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:51.154565 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6592cc14-f802-49fc-a453-4d4b76849a74 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] HTTP exception thrown: Instance 5a774146-a939-4912-8b1e-b52822ced599 could not be found. Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6592cc14-f802-49fc-a453-4d4b76849a74 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Request method failure captured: Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 HTTP/1.1 Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIw6pvhdO4zXhGJCeJ68kJVlsg90ZbSv8TA1izVc9P8bD4Mdu4KXagKTNz1oO93ELXFA4g_EqPdtm7gyry5N4K7tu7lRJSgVuw6GQPzVgbC4uAAvWiLPrDcsyxqGiNNxf4BjA9XsBe47roVYCmKPUnjbtRu99GiZHdc1lNwkgijj3o Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:51.165574 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:51.167948 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:51.167948 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:40:51.167948 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:40:51.167948 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:40:51.167948 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:40:51.167948 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:51.167948 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:51.167948 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7d8ffdbbf2de43b9b4efc89b7fcd4897 Sep 08 12:40:51.167948 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:40:51.167948 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:40:51.167948 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 5a774146-a939-4912-8b1e-b52822ced599 could not be found. Sep 08 12:40:51.167948 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '5a774146-a939-4912-8b1e-b52822ced599'} Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a774146-a939-4912-8b1e-b52822ced599 could not be found. Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:51.169225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a774146-a939-4912-8b1e-b52822ced599 could not be found. Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a774146-a939-4912-8b1e-b52822ced599 could not be found. Sep 08 12:40:51.170618 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:51.172680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6592cc14-f802-49fc-a453-4d4b76849a74 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Returning 404 to user: Instance 5a774146-a939-4912-8b1e-b52822ced599 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:51.173705 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6592cc14-f802-49fc-a453-4d4b76849a74 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599" status: 404 len: 111 microversion: 2.1 time: 0.088467 Sep 08 12:40:51.177638 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 439/884] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:51 2022] GET /compute/v2.1/servers/5a774146-a939-4912-8b1e-b52822ced599 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:40:51.237777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-97a09711-8652-4d37-a7fd-30fba3b6f59b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:51.288036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-97a09711-8652-4d37-a7fd-30fba3b6f59b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:51.291544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-97a09711-8652-4d37-a7fd-30fba3b6f59b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:51.295526 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-97a09711-8652-4d37-a7fd-30fba3b6f59b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1361 microversion: 2.25 time: 1.424467 Sep 08 12:40:51.311952 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 446/885] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:49 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1361 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:51.342404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1539608535", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "9714d2bd-3c28-4c33-8e0b-3c4e73fb2914"}], "security_groups": [{"name": "tempest-securitygroup--1066941222"}], "key_name": "tempest-keypair-24079275", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:51.368434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-61aa2fc9-871b-48cd-b8f1-ee5210c920cd tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "e2a20e50-c75a-4628-96a9-da11de680175"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:51.375816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-61aa2fc9-871b-48cd-b8f1-ee5210c920cd tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:51.406108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61aa2fc9-871b-48cd-b8f1-ee5210c920cd tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:51.407592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61aa2fc9-871b-48cd-b8f1-ee5210c920cd tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:51.408634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61aa2fc9-871b-48cd-b8f1-ee5210c920cd tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:51.410771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61aa2fc9-871b-48cd-b8f1-ee5210c920cd tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:51.412698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61aa2fc9-871b-48cd-b8f1-ee5210c920cd tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:51.414219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61aa2fc9-871b-48cd-b8f1-ee5210c920cd tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:51.663328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] validate_networks() for [('9714d2bd-3c28-4c33-8e0b-3c4e73fb2914', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:40:51.726792 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-61aa2fc9-871b-48cd-b8f1-ee5210c920cd tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] HTTP exception thrown: Volume e2a20e50-c75a-4628-96a9-da11de680175 could not be found. Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-61aa2fc9-871b-48cd-b8f1-ee5210c920cd tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Request method failure captured: Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments/f033dd3a-1d90-4801-b984-65a924e8a25e HTTP/1.1 Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 74 Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJvbRzp_71scIb5Wr8BhxvxE_7Fyag-dMofWmaFKIPP9R8rHEhlDHjNJ11jsY17ks3e-8buY_Sor6RhBddymmACXJEz3VOO7HCH8wuxY9Vig3nHc1F8-S9Pg8OA9cTMy8Xj4tEnjlKwSlfEHQchcgUNyC2TtBri6ENtWkAfpsRy9Z8 Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 51992f88a963446893dee41e7a3b7cc8 Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesAdminNegativeTest-1333989979 Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:40:51.738991 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_51992f88a963446893dee41e7a3b7cc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/51992f88a963446893dee41e7a3b7cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/51992f88a963446893dee41e7a3b7cc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/51992f88a963446893dee41e7a3b7cc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesAdminNegativeTest-1333989979 Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 51992f88a963446893dee41e7a3b7cc8 Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1333989979 Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesAdminNegativeTest-1333989979-project-admin Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 72e28cc28eab4c808ffb20c8fa503323 Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesAdminNegativeTest-1333989979-project-admin Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: {"volumeAttachment": {"volumeId": "e2a20e50-c75a-4628-96a9-da11de680175"}} Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:40:51.742066 n-d-852084-10 devstack@n-api.service[128970]: exception: Volume e2a20e50-c75a-4628-96a9-da11de680175 could not be found. Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'server_id': '940b9bb1-c58b-464b-a472-03fb6acbe36b', 'id': 'f033dd3a-1d90-4801-b984-65a924e8a25e', 'body': {'volumeAttachment': {'volumeId': 'e2a20e50-c75a-4628-96a9-da11de680175'}}} Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:40:51.743924 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e2a20e50-c75a-4628-96a9-da11de680175 could not be found. (HTTP 404) (Request-ID: req-774b62e6-34b5-4e69-867d-df90999f4e76) Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 12:40:51.746580 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e2a20e50-c75a-4628-96a9-da11de680175 could not be found. Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:51.749284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume e2a20e50-c75a-4628-96a9-da11de680175 could not be found. Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e2a20e50-c75a-4628-96a9-da11de680175 could not be found. Sep 08 12:40:51.751849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:51.759259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-61aa2fc9-871b-48cd-b8f1-ee5210c920cd tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Returning 400 to user: Volume e2a20e50-c75a-4628-96a9-da11de680175 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:51.759259 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-61aa2fc9-871b-48cd-b8f1-ee5210c920cd tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] 10.222.0.78 "PUT /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments/f033dd3a-1d90-4801-b984-65a924e8a25e" status: 400 len: 107 microversion: 2.1 time: 0.579333 Sep 08 12:40:51.760465 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 440/886] 10.222.0.78 () {60 vars in 1433 bytes} [Thu Sep 8 12:40:51 2022] PUT /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments/f033dd3a-1d90-4801-b984-65a924e8a25e => generated 107 bytes in 582 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:40:51.775061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bf4ba430-0efd-4391-a4a8-5ecdecca1430 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:51.778012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bf4ba430-0efd-4391-a4a8-5ecdecca1430 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:51.818431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf4ba430-0efd-4391-a4a8-5ecdecca1430 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:51.821512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf4ba430-0efd-4391-a4a8-5ecdecca1430 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:51.824281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf4ba430-0efd-4391-a4a8-5ecdecca1430 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:51.832469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf4ba430-0efd-4391-a4a8-5ecdecca1430 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:51.833696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf4ba430-0efd-4391-a4a8-5ecdecca1430 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:51.835031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf4ba430-0efd-4391-a4a8-5ecdecca1430 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:51.961590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bf4ba430-0efd-4391-a4a8-5ecdecca1430 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:40:52.136532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:52.172490 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bf4ba430-0efd-4391-a4a8-5ecdecca1430 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "DELETE /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 204 len: 0 microversion: 2.1 time: 0.409875 Sep 08 12:40:52.176416 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 441/887] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:40:51 2022] DELETE /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:40:52.193163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9a9ed9b0-8361-49e5-ba70-204c8be60eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:52.199640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9a9ed9b0-8361-49e5-ba70-204c8be60eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:52.213074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a9ed9b0-8361-49e5-ba70-204c8be60eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:52.218484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a9ed9b0-8361-49e5-ba70-204c8be60eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:52.219335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a9ed9b0-8361-49e5-ba70-204c8be60eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:52.220326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a9ed9b0-8361-49e5-ba70-204c8be60eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:52.221010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a9ed9b0-8361-49e5-ba70-204c8be60eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:52.221685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a9ed9b0-8361-49e5-ba70-204c8be60eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:52.383455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9a9ed9b0-8361-49e5-ba70-204c8be60eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:52.404005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9a9ed9b0-8361-49e5-ba70-204c8be60eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:52.405578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9a9ed9b0-8361-49e5-ba70-204c8be60eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:52.418963 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9a9ed9b0-8361-49e5-ba70-204c8be60eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.240941 Sep 08 12:40:52.419650 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 442/888] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:52 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:52.438410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-df1065f2-874e-43ee-96d2-2ea3238fb8d1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:52.450263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-df1065f2-874e-43ee-96d2-2ea3238fb8d1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:52.469593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df1065f2-874e-43ee-96d2-2ea3238fb8d1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:52.470175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df1065f2-874e-43ee-96d2-2ea3238fb8d1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:52.473591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df1065f2-874e-43ee-96d2-2ea3238fb8d1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:52.476880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df1065f2-874e-43ee-96d2-2ea3238fb8d1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:52.476880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df1065f2-874e-43ee-96d2-2ea3238fb8d1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:52.481260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df1065f2-874e-43ee-96d2-2ea3238fb8d1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:52.873287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-df1065f2-874e-43ee-96d2-2ea3238fb8d1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lazy-loading 'services' on Instance uuid 940b9bb1-c58b-464b-a472-03fb6acbe36b {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:40:53.191064 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-df1065f2-874e-43ee-96d2-2ea3238fb8d1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "DELETE /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments/f033dd3a-1d90-4801-b984-65a924e8a25e" status: 202 len: 0 microversion: 2.1 time: 0.767470 Sep 08 12:40:53.192169 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 443/889] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 12:40:52 2022] DELETE /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments/f033dd3a-1d90-4801-b984-65a924e8a25e => generated 0 bytes in 769 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:40:53.207711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1cd014fb-9ba7-48ba-8dea-14fd2adcc01f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:53.209017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1cd014fb-9ba7-48ba-8dea-14fd2adcc01f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:53.217072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1cd014fb-9ba7-48ba-8dea-14fd2adcc01f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:53.217634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1cd014fb-9ba7-48ba-8dea-14fd2adcc01f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:53.218278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1cd014fb-9ba7-48ba-8dea-14fd2adcc01f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:53.219092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1cd014fb-9ba7-48ba-8dea-14fd2adcc01f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:53.219749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1cd014fb-9ba7-48ba-8dea-14fd2adcc01f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:53.220374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1cd014fb-9ba7-48ba-8dea-14fd2adcc01f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:53.251325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:40:53.251962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:40:53.252503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:40:53.253033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:40:53.253542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:40:53.267643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:53.268932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:53.269596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:53.270655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:53.271392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:53.272531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:53.297379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Getting quotas for project 5619e927afd449c4897bd41f96390988. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:53.303299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Getting quotas for user c7375a1da7fb43d8a6725f61fa2c7ec9 and project 5619e927afd449c4897bd41f96390988. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:53.319630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:40:53.322409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:40:53.422675 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-77ab28bd-4c0b-4f68-ad97-da90139114d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.109068 Sep 08 12:40:53.424263 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 447/890] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:40:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 2111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:40:53.435346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a18cce43-f186-4003-a7c4-a93feedc2c1f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:53.436375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a18cce43-f186-4003-a7c4-a93feedc2c1f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:53.445322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a18cce43-f186-4003-a7c4-a93feedc2c1f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:53.446002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a18cce43-f186-4003-a7c4-a93feedc2c1f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:53.446733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a18cce43-f186-4003-a7c4-a93feedc2c1f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:53.447654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a18cce43-f186-4003-a7c4-a93feedc2c1f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:53.448305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a18cce43-f186-4003-a7c4-a93feedc2c1f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:53.448938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a18cce43-f186-4003-a7c4-a93feedc2c1f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:53.913979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1cd014fb-9ba7-48ba-8dea-14fd2adcc01f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:53.928726 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1cd014fb-9ba7-48ba-8dea-14fd2adcc01f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1378 microversion: 2.1 time: 0.735216 Sep 08 12:40:53.929698 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 444/891] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:53 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1378 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:53.934578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3cfa5c8a-8b2b-48cf-881d-dcec57f34e58 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:53.935197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3cfa5c8a-8b2b-48cf-881d-dcec57f34e58 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:53.957152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cfa5c8a-8b2b-48cf-881d-dcec57f34e58 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:53.957647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cfa5c8a-8b2b-48cf-881d-dcec57f34e58 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:53.958081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cfa5c8a-8b2b-48cf-881d-dcec57f34e58 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:53.958876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cfa5c8a-8b2b-48cf-881d-dcec57f34e58 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:53.959373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cfa5c8a-8b2b-48cf-881d-dcec57f34e58 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:53.972870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cfa5c8a-8b2b-48cf-881d-dcec57f34e58 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:54.472387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a18cce43-f186-4003-a7c4-a93feedc2c1f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:54.505905 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a18cce43-f186-4003-a7c4-a93feedc2c1f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 200 len: 1472 microversion: 2.1 time: 1.079913 Sep 08 12:40:54.524629 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 448/892] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:53 2022] GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 1472 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:54.561390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d3dd595-853d-4644-936a-47acf3028f3e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:54.578152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d3dd595-853d-4644-936a-47acf3028f3e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:54.598484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3dd595-853d-4644-936a-47acf3028f3e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:54.599415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3dd595-853d-4644-936a-47acf3028f3e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:54.600627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3dd595-853d-4644-936a-47acf3028f3e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:54.602149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3dd595-853d-4644-936a-47acf3028f3e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:54.603210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3dd595-853d-4644-936a-47acf3028f3e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:54.604269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3dd595-853d-4644-936a-47acf3028f3e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:54.731967 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d3dd595-853d-4644-936a-47acf3028f3e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.205163 Sep 08 12:40:54.735707 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 449/893] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:40:54 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments => generated 197 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:54.741491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54df06b8-8eb5-460e-b8ae-dc78fa178e9e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:54.742390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54df06b8-8eb5-460e-b8ae-dc78fa178e9e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:54.752522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54df06b8-8eb5-460e-b8ae-dc78fa178e9e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:54.755533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54df06b8-8eb5-460e-b8ae-dc78fa178e9e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:54.756461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54df06b8-8eb5-460e-b8ae-dc78fa178e9e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:54.757442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54df06b8-8eb5-460e-b8ae-dc78fa178e9e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:54.758139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54df06b8-8eb5-460e-b8ae-dc78fa178e9e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:54.758760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54df06b8-8eb5-460e-b8ae-dc78fa178e9e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:54.941110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3cfa5c8a-8b2b-48cf-881d-dcec57f34e58 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:54.949515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:54.956693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3cfa5c8a-8b2b-48cf-881d-dcec57f34e58 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:54.959188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3cfa5c8a-8b2b-48cf-881d-dcec57f34e58 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:54.960786 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3cfa5c8a-8b2b-48cf-881d-dcec57f34e58 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1361 microversion: 2.25 time: 1.029717 Sep 08 12:40:54.968127 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 445/894] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:53 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1361 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:54.976160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e6c8aced-a4af-4b5a-94dc-2a1b7f86c70e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:54.993168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e6c8aced-a4af-4b5a-94dc-2a1b7f86c70e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:55.014488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6c8aced-a4af-4b5a-94dc-2a1b7f86c70e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:55.023588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6c8aced-a4af-4b5a-94dc-2a1b7f86c70e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:55.027786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6c8aced-a4af-4b5a-94dc-2a1b7f86c70e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:55.029299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6c8aced-a4af-4b5a-94dc-2a1b7f86c70e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:55.037491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6c8aced-a4af-4b5a-94dc-2a1b7f86c70e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:55.039720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6c8aced-a4af-4b5a-94dc-2a1b7f86c70e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:55.044543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54df06b8-8eb5-460e-b8ae-dc78fa178e9e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:55.059180 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54df06b8-8eb5-460e-b8ae-dc78fa178e9e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1285 microversion: 2.1 time: 0.320467 Sep 08 12:40:55.060971 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 450/895] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:54 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1285 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:55.066535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9e5cd2f7-3999-44b0-8e98-e6e302a6641a req-c8a455f9-febf-46f4-874b-637b4ae5bae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60526de3-67cc-4bf8-911d-590f531d0130", "name": "network-vif-plugged", "status": "completed", "tag": "fbd4d925-0ef2-4240-a577-779541fca496"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:55.083315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9e5cd2f7-3999-44b0-8e98-e6e302a6641a req-c8a455f9-febf-46f4-874b-637b4ae5bae5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:55.084434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9e5cd2f7-3999-44b0-8e98-e6e302a6641a req-c8a455f9-febf-46f4-874b-637b4ae5bae5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:55.085155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9e5cd2f7-3999-44b0-8e98-e6e302a6641a req-c8a455f9-febf-46f4-874b-637b4ae5bae5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:55.112081 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9e5cd2f7-3999-44b0-8e98-e6e302a6641a req-c8a455f9-febf-46f4-874b-637b4ae5bae5 service nova] Creating event network-vif-plugged:fbd4d925-0ef2-4240-a577-779541fca496 for instance 60526de3-67cc-4bf8-911d-590f531d0130 on n-h1-852084-10 Sep 08 12:40:55.119969 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9e5cd2f7-3999-44b0-8e98-e6e302a6641a req-c8a455f9-febf-46f4-874b-637b4ae5bae5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057263 Sep 08 12:40:55.129674 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 451/896] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:55.138675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bb4c9f97-8828-4333-a90f-c0d226dfb566 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:55.139701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bb4c9f97-8828-4333-a90f-c0d226dfb566 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:55.149181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb4c9f97-8828-4333-a90f-c0d226dfb566 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:55.150055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb4c9f97-8828-4333-a90f-c0d226dfb566 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:55.151018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb4c9f97-8828-4333-a90f-c0d226dfb566 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:55.152233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb4c9f97-8828-4333-a90f-c0d226dfb566 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:55.152862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb4c9f97-8828-4333-a90f-c0d226dfb566 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:55.153484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb4c9f97-8828-4333-a90f-c0d226dfb566 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:55.246579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6c8aced-a4af-4b5a-94dc-2a1b7f86c70e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:55.269724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6c8aced-a4af-4b5a-94dc-2a1b7f86c70e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:55.271597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6c8aced-a4af-4b5a-94dc-2a1b7f86c70e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:55.293012 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e6c8aced-a4af-4b5a-94dc-2a1b7f86c70e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.320277 Sep 08 12:40:55.318212 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 446/897] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:54 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:55.559543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b3720767-bdfd-4dd4-9da8-db8e0adb57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:55.560484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b3720767-bdfd-4dd4-9da8-db8e0adb57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:55.571240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3720767-bdfd-4dd4-9da8-db8e0adb57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:55.573995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3720767-bdfd-4dd4-9da8-db8e0adb57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:55.574785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3720767-bdfd-4dd4-9da8-db8e0adb57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:55.577615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3720767-bdfd-4dd4-9da8-db8e0adb57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:55.578258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3720767-bdfd-4dd4-9da8-db8e0adb57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:55.580231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3720767-bdfd-4dd4-9da8-db8e0adb57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:56.099945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b3720767-bdfd-4dd4-9da8-db8e0adb57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:56.124959 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b3720767-bdfd-4dd4-9da8-db8e0adb57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 200 len: 1430 microversion: 2.1 time: 0.570792 Sep 08 12:40:56.125575 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 447/898] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:55 2022] GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 1430 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:56.167337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dc7efd4c-0dc0-4739-83a3-6d3663c51725 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:56.176975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dc7efd4c-0dc0-4739-83a3-6d3663c51725 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:56.188217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc7efd4c-0dc0-4739-83a3-6d3663c51725 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:56.189387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc7efd4c-0dc0-4739-83a3-6d3663c51725 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:56.190014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc7efd4c-0dc0-4739-83a3-6d3663c51725 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:56.191013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc7efd4c-0dc0-4739-83a3-6d3663c51725 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:56.192652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc7efd4c-0dc0-4739-83a3-6d3663c51725 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:56.193296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc7efd4c-0dc0-4739-83a3-6d3663c51725 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:56.206060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bb4c9f97-8828-4333-a90f-c0d226dfb566 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:56.223358 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bb4c9f97-8828-4333-a90f-c0d226dfb566 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1378 microversion: 2.1 time: 1.088933 Sep 08 12:40:56.225002 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 452/899] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:55 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1378 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:56.242242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-51435f2a-d2dd-42c0-8c70-0fa9d4e91610 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:56.242888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-51435f2a-d2dd-42c0-8c70-0fa9d4e91610 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:56.263393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51435f2a-d2dd-42c0-8c70-0fa9d4e91610 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:56.263959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51435f2a-d2dd-42c0-8c70-0fa9d4e91610 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:56.264408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51435f2a-d2dd-42c0-8c70-0fa9d4e91610 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:56.265168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51435f2a-d2dd-42c0-8c70-0fa9d4e91610 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:56.265629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51435f2a-d2dd-42c0-8c70-0fa9d4e91610 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:56.266059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51435f2a-d2dd-42c0-8c70-0fa9d4e91610 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:56.310909 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dc7efd4c-0dc0-4739-83a3-6d3663c51725 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145821 Sep 08 12:40:56.311604 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 448/900] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:40:56 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:56.328716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f76d6a4e-f3bd-4c27-bdfc-fd24d40ff722 req-96ce9bf4-0f91-41ba-bf53-3d276e994300 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61574c60-0e9f-46f3-924f-ca5e7e74f04f", "name": "network-vif-deleted", "tag": "23905870-8446-4b2e-9ac6-e2812fed241f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:56.358961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f76d6a4e-f3bd-4c27-bdfc-fd24d40ff722 req-96ce9bf4-0f91-41ba-bf53-3d276e994300 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:56.360206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f76d6a4e-f3bd-4c27-bdfc-fd24d40ff722 req-96ce9bf4-0f91-41ba-bf53-3d276e994300 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:56.361898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f76d6a4e-f3bd-4c27-bdfc-fd24d40ff722 req-96ce9bf4-0f91-41ba-bf53-3d276e994300 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:56.384167 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f76d6a4e-f3bd-4c27-bdfc-fd24d40ff722 req-96ce9bf4-0f91-41ba-bf53-3d276e994300 service nova] Creating event network-vif-deleted:23905870-8446-4b2e-9ac6-e2812fed241f for instance 61574c60-0e9f-46f3-924f-ca5e7e74f04f on n-h1-852084-10 Sep 08 12:40:56.405152 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f76d6a4e-f3bd-4c27-bdfc-fd24d40ff722 req-96ce9bf4-0f91-41ba-bf53-3d276e994300 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090172 Sep 08 12:40:56.406421 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 449/901] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:56.423805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-839c5772-494d-4f79-ac93-08828e75be08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:56.424704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-839c5772-494d-4f79-ac93-08828e75be08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:56.439339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-839c5772-494d-4f79-ac93-08828e75be08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:56.440415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-839c5772-494d-4f79-ac93-08828e75be08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:56.444700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-839c5772-494d-4f79-ac93-08828e75be08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:56.446561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-839c5772-494d-4f79-ac93-08828e75be08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:56.450137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-839c5772-494d-4f79-ac93-08828e75be08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:56.457988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-839c5772-494d-4f79-ac93-08828e75be08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:56.669745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-839c5772-494d-4f79-ac93-08828e75be08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:56.684129 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-839c5772-494d-4f79-ac93-08828e75be08 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1291 microversion: 2.1 time: 0.272004 Sep 08 12:40:56.685024 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 450/902] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:56 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1291 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:56.786838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a8c74619-7c02-4c7d-83e2-d2d7cb421cf7 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Action: 'create', calling method: .version_select at 0x7fdb36efa430>, body: {"keypair": {"name": "tempest-keypair-106207217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJkyzdUIDXSiM/dcQJipX6LbvVO2sDeD96ZikZ9Ys4N0rKfmKscKsATRRmDPp7yPi9UixuB1X+p1+uwdsOUdD3xNBTb/7L0nXLy9+8eHfSaoeWoBkdS69fCN6oIut25bw=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:56.821287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a8c74619-7c02-4c7d-83e2-d2d7cb421cf7 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Getting quotas for project 0c8b4715d80648a0a6cbeedfbbf6f29c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:40:56.825692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a8c74619-7c02-4c7d-83e2-d2d7cb421cf7 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Getting quotas for user 55d39e1c491c47488c4de0e147732645 and project 0c8b4715d80648a0a6cbeedfbbf6f29c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:40:56.873001 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a8c74619-7c02-4c7d-83e2-d2d7cb421cf7 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.187058 Sep 08 12:40:56.874784 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 451/903] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:40:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:56.894697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a8c6703c-052a-4fad-9d2b-16d52c183cbf tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:56.896457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a8c6703c-052a-4fad-9d2b-16d52c183cbf tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:56.941783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c6703c-052a-4fad-9d2b-16d52c183cbf tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:56.942293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c6703c-052a-4fad-9d2b-16d52c183cbf tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:56.949264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c6703c-052a-4fad-9d2b-16d52c183cbf tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:56.950126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c6703c-052a-4fad-9d2b-16d52c183cbf tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:56.950676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c6703c-052a-4fad-9d2b-16d52c183cbf tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:56.951118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c6703c-052a-4fad-9d2b-16d52c183cbf tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:56.993191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-51435f2a-d2dd-42c0-8c70-0fa9d4e91610 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:57.015790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-51435f2a-d2dd-42c0-8c70-0fa9d4e91610 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:57.022705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-51435f2a-d2dd-42c0-8c70-0fa9d4e91610 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:57.029347 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-51435f2a-d2dd-42c0-8c70-0fa9d4e91610 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1361 microversion: 2.25 time: 0.796349 Sep 08 12:40:57.033161 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 453/904] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:56 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1361 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:57.159399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:57.160560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:57.170673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:57.171252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:57.171681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:57.173309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:57.174139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:57.175424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:57.232996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:57.234394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:57.235713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:57.236629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lazy-loading 'fault' on Instance uuid 61574c60-0e9f-46f3-924f-ca5e7e74f04f {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:40:57.237424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a8c6703c-052a-4fad-9d2b-16d52c183cbf tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:57.264279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a8c6703c-052a-4fad-9d2b-16d52c183cbf tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:57.268016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a8c6703c-052a-4fad-9d2b-16d52c183cbf tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:57.286497 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a8c6703c-052a-4fad-9d2b-16d52c183cbf tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.409081 Sep 08 12:40:57.296530 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 452/905] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:56 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:57.301574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-55c43de7-cb5c-41f7-b2dc-be5e963b0f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:57.302199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-55c43de7-cb5c-41f7-b2dc-be5e963b0f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:57.320400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55c43de7-cb5c-41f7-b2dc-be5e963b0f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:57.320984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55c43de7-cb5c-41f7-b2dc-be5e963b0f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:57.321471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55c43de7-cb5c-41f7-b2dc-be5e963b0f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:57.322382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55c43de7-cb5c-41f7-b2dc-be5e963b0f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:57.324006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55c43de7-cb5c-41f7-b2dc-be5e963b0f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:57.324006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55c43de7-cb5c-41f7-b2dc-be5e963b0f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:57.365533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:57.373632 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-23936e2c-9f28-475e-a28a-514e9bbc6470 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 200 len: 1306 microversion: 2.1 time: 0.218778 Sep 08 12:40:57.376130 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 454/906] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:57 2022] GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 1306 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:57.383810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a5017fab-9340-4d45-b23d-817ead6ff709 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:57.387379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a5017fab-9340-4d45-b23d-817ead6ff709 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:57.403845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5017fab-9340-4d45-b23d-817ead6ff709 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:57.404276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5017fab-9340-4d45-b23d-817ead6ff709 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:57.404771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5017fab-9340-4d45-b23d-817ead6ff709 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:57.405494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5017fab-9340-4d45-b23d-817ead6ff709 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:57.406009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5017fab-9340-4d45-b23d-817ead6ff709 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:57.406440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5017fab-9340-4d45-b23d-817ead6ff709 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:57.442610 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a5017fab-9340-4d45-b23d-817ead6ff709 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064778 Sep 08 12:40:57.444033 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 455/907] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:40:57 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:57.710501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e689b32-0209-4e20-a9db-c3ed1f9a8189 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:57.711381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6e689b32-0209-4e20-a9db-c3ed1f9a8189 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:57.726588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e689b32-0209-4e20-a9db-c3ed1f9a8189 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:57.727508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e689b32-0209-4e20-a9db-c3ed1f9a8189 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:57.728253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e689b32-0209-4e20-a9db-c3ed1f9a8189 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:57.729287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e689b32-0209-4e20-a9db-c3ed1f9a8189 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:57.729976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e689b32-0209-4e20-a9db-c3ed1f9a8189 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:57.734729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e689b32-0209-4e20-a9db-c3ed1f9a8189 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:57.751887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:58.074727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6e689b32-0209-4e20-a9db-c3ed1f9a8189 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:58.093126 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e689b32-0209-4e20-a9db-c3ed1f9a8189 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1291 microversion: 2.1 time: 0.386003 Sep 08 12:40:58.094049 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 456/908] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:57 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1291 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:58.108727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1e3dbb84-5a6d-475c-be61-63db750f4160 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:58.113056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1e3dbb84-5a6d-475c-be61-63db750f4160 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:58.123396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e3dbb84-5a6d-475c-be61-63db750f4160 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:58.124271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e3dbb84-5a6d-475c-be61-63db750f4160 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:58.124871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e3dbb84-5a6d-475c-be61-63db750f4160 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:58.125756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e3dbb84-5a6d-475c-be61-63db750f4160 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:58.126374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e3dbb84-5a6d-475c-be61-63db750f4160 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:58.126952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e3dbb84-5a6d-475c-be61-63db750f4160 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:58.196630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:40:58.561938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-55c43de7-cb5c-41f7-b2dc-be5e963b0f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:58.582415 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-55c43de7-cb5c-41f7-b2dc-be5e963b0f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1378 microversion: 2.1 time: 1.284566 Sep 08 12:40:58.583432 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 453/909] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:57 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1378 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:40:58.617463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-0c367bd0-3033-4926-9580-a2fa2a9f4c92 req-240673af-42db-4e8c-8f73-9ab9665bf88f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc95339-7b99-439b-8a64-3eeb808b9c77", "tag": "c88f65d9-eeed-4224-9551-d32c44c05007"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:40:58.645162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0c367bd0-3033-4926-9580-a2fa2a9f4c92 req-240673af-42db-4e8c-8f73-9ab9665bf88f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:58.645895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0c367bd0-3033-4926-9580-a2fa2a9f4c92 req-240673af-42db-4e8c-8f73-9ab9665bf88f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:58.646477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0c367bd0-3033-4926-9580-a2fa2a9f4c92 req-240673af-42db-4e8c-8f73-9ab9665bf88f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:58.661525 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-0c367bd0-3033-4926-9580-a2fa2a9f4c92 req-240673af-42db-4e8c-8f73-9ab9665bf88f service nova] Creating event network-changed:c88f65d9-eeed-4224-9551-d32c44c05007 for instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 on n-h2-852084-10 Sep 08 12:40:58.671826 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-0c367bd0-3033-4926-9580-a2fa2a9f4c92 req-240673af-42db-4e8c-8f73-9ab9665bf88f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063810 Sep 08 12:40:58.677627 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 454/910] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:58.685015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ccb8c5da-50ba-4d4f-b90a-a6f3186fb3d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:58.685792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ccb8c5da-50ba-4d4f-b90a-a6f3186fb3d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:58.710328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb8c5da-50ba-4d4f-b90a-a6f3186fb3d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:58.711368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb8c5da-50ba-4d4f-b90a-a6f3186fb3d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:58.712705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb8c5da-50ba-4d4f-b90a-a6f3186fb3d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:58.713629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb8c5da-50ba-4d4f-b90a-a6f3186fb3d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:58.714802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb8c5da-50ba-4d4f-b90a-a6f3186fb3d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:58.715673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb8c5da-50ba-4d4f-b90a-a6f3186fb3d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:58.968263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ccb8c5da-50ba-4d4f-b90a-a6f3186fb3d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:58.981763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ccb8c5da-50ba-4d4f-b90a-a6f3186fb3d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:58.983523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ccb8c5da-50ba-4d4f-b90a-a6f3186fb3d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:58.996481 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ccb8c5da-50ba-4d4f-b90a-a6f3186fb3d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.317507 Sep 08 12:40:58.997322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1e3dbb84-5a6d-475c-be61-63db750f4160 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:58.998477 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 455/911] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:58 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:59.021272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1e3dbb84-5a6d-475c-be61-63db750f4160 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:59.023820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ffd5215a-8bb0-4a19-9e48-40160d7de260 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:59.024621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ffd5215a-8bb0-4a19-9e48-40160d7de260 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 61574c60-0e9f-46f3-924f-ca5e7e74f04f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:59.030836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1e3dbb84-5a6d-475c-be61-63db750f4160 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:40:59.032426 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1e3dbb84-5a6d-475c-be61-63db750f4160 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1557 microversion: 2.25 time: 0.937272 Sep 08 12:40:59.032555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffd5215a-8bb0-4a19-9e48-40160d7de260 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:59.032955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffd5215a-8bb0-4a19-9e48-40160d7de260 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:59.033392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffd5215a-8bb0-4a19-9e48-40160d7de260 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:59.034089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffd5215a-8bb0-4a19-9e48-40160d7de260 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:59.043556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffd5215a-8bb0-4a19-9e48-40160d7de260 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:59.044168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffd5215a-8bb0-4a19-9e48-40160d7de260 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:59.057291 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 457/912] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:58 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1557 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:40:59.058728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b2c34797-b08c-4390-82e7-e347a5eddfa8 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:59.061332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b2c34797-b08c-4390-82e7-e347a5eddfa8 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:59.067723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2c34797-b08c-4390-82e7-e347a5eddfa8 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:59.068222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2c34797-b08c-4390-82e7-e347a5eddfa8 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:59.068709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2c34797-b08c-4390-82e7-e347a5eddfa8 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:59.069944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2c34797-b08c-4390-82e7-e347a5eddfa8 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:59.070626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2c34797-b08c-4390-82e7-e347a5eddfa8 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:59.072764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2c34797-b08c-4390-82e7-e347a5eddfa8 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:59.076287 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-ffd5215a-8bb0-4a19-9e48-40160d7de260 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] HTTP exception thrown: Instance 61574c60-0e9f-46f3-924f-ca5e7e74f04f could not be found. Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ffd5215a-8bb0-4a19-9e48-40160d7de260 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Request method failure captured: Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f HTTP/1.1 Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIw6pvhdO4zXhGJCeJ68kJVlsg90ZbSv8TA1izVc9P8bD4Mdu4KXagKTNz1oO93ELXFA4g_EqPdtm7gyry5N4K7tu7lRJSgVuw6GQPzVgbC4uAAvWiLPrDcsyxqGiNNxf4BjA9XsBe47roVYCmKPUnjbtRu99GiZHdc1lNwkgijj3o Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:40:59.081659 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:40:59.083463 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:40:59.083463 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:40:59.083463 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:40:59.083463 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:40:59.083463 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:40:59.083463 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:40:59.083463 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:40:59.083463 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7d8ffdbbf2de43b9b4efc89b7fcd4897 Sep 08 12:40:59.083463 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:40:59.083463 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:40:59.083463 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 61574c60-0e9f-46f3-924f-ca5e7e74f04f could not be found. Sep 08 12:40:59.083463 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '61574c60-0e9f-46f3-924f-ca5e7e74f04f'} Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61574c60-0e9f-46f3-924f-ca5e7e74f04f could not be found. Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:40:59.084357 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61574c60-0e9f-46f3-924f-ca5e7e74f04f could not be found. Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61574c60-0e9f-46f3-924f-ca5e7e74f04f could not be found. Sep 08 12:40:59.085754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:40:59.096221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ffd5215a-8bb0-4a19-9e48-40160d7de260 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Returning 404 to user: Instance 61574c60-0e9f-46f3-924f-ca5e7e74f04f could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:40:59.097397 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ffd5215a-8bb0-4a19-9e48-40160d7de260 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f" status: 404 len: 111 microversion: 2.1 time: 0.084541 Sep 08 12:40:59.098307 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 456/913] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:59 2022] GET /compute/v2.1/servers/61574c60-0e9f-46f3-924f-ca5e7e74f04f => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:40:59.124613 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b2c34797-b08c-4390-82e7-e347a5eddfa8 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071402 Sep 08 12:40:59.126343 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 458/914] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:40:59 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:40:59.135335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a075b6fb-917c-49c2-8cd6-3222266b57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:59.137156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a075b6fb-917c-49c2-8cd6-3222266b57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 953e5b9e-8c65-4892-a558-ec7764a7b037] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:59.163400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a075b6fb-917c-49c2-8cd6-3222266b57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:59.164878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a075b6fb-917c-49c2-8cd6-3222266b57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:59.165853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a075b6fb-917c-49c2-8cd6-3222266b57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:59.167091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a075b6fb-917c-49c2-8cd6-3222266b57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:59.167767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a075b6fb-917c-49c2-8cd6-3222266b57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:59.169339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a075b6fb-917c-49c2-8cd6-3222266b57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:59.212355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a075b6fb-917c-49c2-8cd6-3222266b57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 953e5b9e-8c65-4892-a558-ec7764a7b037] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:40:59.418140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f436826d-92a2-4395-9d54-98a56d0f7acf tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:59.419045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f436826d-92a2-4395-9d54-98a56d0f7acf tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:59.429303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f436826d-92a2-4395-9d54-98a56d0f7acf tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:59.429795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f436826d-92a2-4395-9d54-98a56d0f7acf tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:59.430226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f436826d-92a2-4395-9d54-98a56d0f7acf tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:59.440311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f436826d-92a2-4395-9d54-98a56d0f7acf tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:59.440795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f436826d-92a2-4395-9d54-98a56d0f7acf tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:59.441231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f436826d-92a2-4395-9d54-98a56d0f7acf tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:59.443845 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a075b6fb-917c-49c2-8cd6-3222266b57cd tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "DELETE /compute/v2.1/servers/953e5b9e-8c65-4892-a558-ec7764a7b037" status: 204 len: 0 microversion: 2.1 time: 0.315566 Sep 08 12:40:59.447405 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 459/915] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:40:59 2022] DELETE /compute/v2.1/servers/953e5b9e-8c65-4892-a558-ec7764a7b037 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:40:59.458986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-84f544ea-9458-40e1-b82e-3a6b57d0c6de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:40:59.459758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-84f544ea-9458-40e1-b82e-3a6b57d0c6de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:40:59.476865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84f544ea-9458-40e1-b82e-3a6b57d0c6de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:59.477394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84f544ea-9458-40e1-b82e-3a6b57d0c6de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:59.477841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84f544ea-9458-40e1-b82e-3a6b57d0c6de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:40:59.478571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84f544ea-9458-40e1-b82e-3a6b57d0c6de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:40:59.479207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84f544ea-9458-40e1-b82e-3a6b57d0c6de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:40:59.492096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84f544ea-9458-40e1-b82e-3a6b57d0c6de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:00.050373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-f436826d-92a2-4395-9d54-98a56d0f7acf tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid 60526de3-67cc-4bf8-911d-590f531d0130 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:41:00.102218 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f436826d-92a2-4395-9d54-98a56d0f7acf tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 2051 microversion: 2.25 time: 1.002464 Sep 08 12:41:00.103795 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 457/916] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:40:59 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 2051 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:00.113575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-03fb0a56-b75d-456d-99bd-800ff7b1d7c7 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:00.114525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-03fb0a56-b75d-456d-99bd-800ff7b1d7c7 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:00.130804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03fb0a56-b75d-456d-99bd-800ff7b1d7c7 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:00.132248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03fb0a56-b75d-456d-99bd-800ff7b1d7c7 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:00.133084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03fb0a56-b75d-456d-99bd-800ff7b1d7c7 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:00.134630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03fb0a56-b75d-456d-99bd-800ff7b1d7c7 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:00.135547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03fb0a56-b75d-456d-99bd-800ff7b1d7c7 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:00.137066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03fb0a56-b75d-456d-99bd-800ff7b1d7c7 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:00.177223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-03fb0a56-b75d-456d-99bd-800ff7b1d7c7 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:41:00.177782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-84f544ea-9458-40e1-b82e-3a6b57d0c6de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:00.191017 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-84f544ea-9458-40e1-b82e-3a6b57d0c6de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1359 microversion: 2.1 time: 0.742173 Sep 08 12:41:00.209002 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 460/917] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:40:59 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1359 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:00.215985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b9af2e92-de3d-4be1-86b9-288d0d1264c6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:00.216999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b9af2e92-de3d-4be1-86b9-288d0d1264c6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:00.224979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9af2e92-de3d-4be1-86b9-288d0d1264c6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:00.225842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9af2e92-de3d-4be1-86b9-288d0d1264c6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:00.226481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9af2e92-de3d-4be1-86b9-288d0d1264c6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:00.227499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9af2e92-de3d-4be1-86b9-288d0d1264c6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:00.228176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9af2e92-de3d-4be1-86b9-288d0d1264c6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:00.229718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9af2e92-de3d-4be1-86b9-288d0d1264c6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:00.350123 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-03fb0a56-b75d-456d-99bd-800ff7b1d7c7 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 204 len: 0 microversion: 2.1 time: 0.243081 Sep 08 12:41:00.352874 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 458/918] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:41:00 2022] DELETE /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:41:00.363517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9da9f291-56c0-48ab-a672-693af54dd9fd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:00.364545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9da9f291-56c0-48ab-a672-693af54dd9fd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:00.377148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9da9f291-56c0-48ab-a672-693af54dd9fd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:00.377801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9da9f291-56c0-48ab-a672-693af54dd9fd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:00.378514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9da9f291-56c0-48ab-a672-693af54dd9fd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:00.379762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9da9f291-56c0-48ab-a672-693af54dd9fd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:00.383631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9da9f291-56c0-48ab-a672-693af54dd9fd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:00.384198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9da9f291-56c0-48ab-a672-693af54dd9fd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:00.616276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9da9f291-56c0-48ab-a672-693af54dd9fd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:00.630097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9da9f291-56c0-48ab-a672-693af54dd9fd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:00.638445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9da9f291-56c0-48ab-a672-693af54dd9fd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:00.657609 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9da9f291-56c0-48ab-a672-693af54dd9fd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.303209 Sep 08 12:41:00.658321 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 459/919] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:00 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:00.685371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-53fb997e-dc0b-437f-bf0d-b351c5a28cd1 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:00.686967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-53fb997e-dc0b-437f-bf0d-b351c5a28cd1 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:00.699614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53fb997e-dc0b-437f-bf0d-b351c5a28cd1 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:00.700565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53fb997e-dc0b-437f-bf0d-b351c5a28cd1 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:00.701275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53fb997e-dc0b-437f-bf0d-b351c5a28cd1 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:00.702361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53fb997e-dc0b-437f-bf0d-b351c5a28cd1 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:00.703059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53fb997e-dc0b-437f-bf0d-b351c5a28cd1 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:00.704501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53fb997e-dc0b-437f-bf0d-b351c5a28cd1 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:00.820259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b9af2e92-de3d-4be1-86b9-288d0d1264c6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:00.834621 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b9af2e92-de3d-4be1-86b9-288d0d1264c6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1378 microversion: 2.1 time: 0.624080 Sep 08 12:41:00.838194 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 461/920] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:00 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1378 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:00.844157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8c9c40eb-f192-456f-a534-497966aa2a5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:00.851215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8c9c40eb-f192-456f-a534-497966aa2a5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:00.872354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c9c40eb-f192-456f-a534-497966aa2a5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:00.873255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c9c40eb-f192-456f-a534-497966aa2a5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:00.873913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c9c40eb-f192-456f-a534-497966aa2a5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:00.880043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c9c40eb-f192-456f-a534-497966aa2a5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:00.880782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c9c40eb-f192-456f-a534-497966aa2a5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:00.881224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c9c40eb-f192-456f-a534-497966aa2a5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:00.954714 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8c9c40eb-f192-456f-a534-497966aa2a5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115076 Sep 08 12:41:00.955663 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 462/921] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:41:00 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:00.961300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0f56794b-2b04-4981-98c9-851baf76c75c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:00.962501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0f56794b-2b04-4981-98c9-851baf76c75c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 953e5b9e-8c65-4892-a558-ec7764a7b037] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:00.985907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f56794b-2b04-4981-98c9-851baf76c75c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:00.988390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f56794b-2b04-4981-98c9-851baf76c75c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:00.994320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f56794b-2b04-4981-98c9-851baf76c75c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:00.995925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f56794b-2b04-4981-98c9-851baf76c75c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:00.996627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f56794b-2b04-4981-98c9-851baf76c75c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:00.997306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f56794b-2b04-4981-98c9-851baf76c75c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:01.242039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-53fb997e-dc0b-437f-bf0d-b351c5a28cd1 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid 60526de3-67cc-4bf8-911d-590f531d0130 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:41:01.281718 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-53fb997e-dc0b-437f-bf0d-b351c5a28cd1 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 2051 microversion: 2.25 time: 0.606780 Sep 08 12:41:01.284137 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 460/922] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:00 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 2051 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:01.296032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc6fc699-7fa4-4400-a12d-806058b4e166 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:01.296755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cc6fc699-7fa4-4400-a12d-806058b4e166 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:01.311920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc6fc699-7fa4-4400-a12d-806058b4e166 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:01.314111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc6fc699-7fa4-4400-a12d-806058b4e166 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:01.314761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc6fc699-7fa4-4400-a12d-806058b4e166 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:01.317908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc6fc699-7fa4-4400-a12d-806058b4e166 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:01.318399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc6fc699-7fa4-4400-a12d-806058b4e166 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:01.318845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc6fc699-7fa4-4400-a12d-806058b4e166 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:01.451262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0f56794b-2b04-4981-98c9-851baf76c75c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:01.466921 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0f56794b-2b04-4981-98c9-851baf76c75c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/953e5b9e-8c65-4892-a558-ec7764a7b037" status: 200 len: 1475 microversion: 2.1 time: 0.509765 Sep 08 12:41:01.471483 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 463/923] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:00 2022] GET /compute/v2.1/servers/953e5b9e-8c65-4892-a558-ec7764a7b037 => generated 1475 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:01.482557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-5b275284-7b75-4b5d-a77d-1ee3137600f9 req-da5f3568-9378-4888-a372-832057663635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d483e1-ee86-4c2f-ae5a-d14ad8686dea", "tag": "7c4cd857-97b7-4ae8-994c-544ea60d027c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:01.516774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5b275284-7b75-4b5d-a77d-1ee3137600f9 req-da5f3568-9378-4888-a372-832057663635 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:01.517540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5b275284-7b75-4b5d-a77d-1ee3137600f9 req-da5f3568-9378-4888-a372-832057663635 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:01.518514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5b275284-7b75-4b5d-a77d-1ee3137600f9 req-da5f3568-9378-4888-a372-832057663635 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:01.553361 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-5b275284-7b75-4b5d-a77d-1ee3137600f9 req-da5f3568-9378-4888-a372-832057663635 service nova] Creating event network-changed:7c4cd857-97b7-4ae8-994c-544ea60d027c for instance 62d483e1-ee86-4c2f-ae5a-d14ad8686dea on n-h2-852084-10 Sep 08 12:41:01.568975 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-5b275284-7b75-4b5d-a77d-1ee3137600f9 req-da5f3568-9378-4888-a372-832057663635 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095881 Sep 08 12:41:01.572955 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 464/924] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:01.588471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-41ae468e-329f-49e9-a007-4e506531e2cc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:01.597781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41ae468e-329f-49e9-a007-4e506531e2cc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:01.604266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41ae468e-329f-49e9-a007-4e506531e2cc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:01.605707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41ae468e-329f-49e9-a007-4e506531e2cc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:01.606587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41ae468e-329f-49e9-a007-4e506531e2cc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:01.607095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41ae468e-329f-49e9-a007-4e506531e2cc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:01.607591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41ae468e-329f-49e9-a007-4e506531e2cc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:01.708222 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-41ae468e-329f-49e9-a007-4e506531e2cc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.132429 Sep 08 12:41:01.717286 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 465/925] 10.222.0.78 () {60 vars in 1217 bytes} [Thu Sep 8 12:41:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:41:01.728842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fce82e55-d21e-4712-9da3-b042d7b76eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:01.749294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fce82e55-d21e-4712-9da3-b042d7b76eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:01.772205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cc6fc699-7fa4-4400-a12d-806058b4e166 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:01.777726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fce82e55-d21e-4712-9da3-b042d7b76eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:01.778504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fce82e55-d21e-4712-9da3-b042d7b76eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:01.779173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fce82e55-d21e-4712-9da3-b042d7b76eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:01.780280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fce82e55-d21e-4712-9da3-b042d7b76eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:01.780950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fce82e55-d21e-4712-9da3-b042d7b76eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:01.781587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fce82e55-d21e-4712-9da3-b042d7b76eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:01.784929 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc6fc699-7fa4-4400-a12d-806058b4e166 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1359 microversion: 2.1 time: 0.499485 Sep 08 12:41:01.800484 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 461/926] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:01 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1359 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:01.800484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-87e481e7-fa8b-457d-8205-c485e9618d18 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852084-10", "block_migration": "auto"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:01.800484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-87e481e7-fa8b-457d-8205-c485e9618d18 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:01.834665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87e481e7-fa8b-457d-8205-c485e9618d18 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:01.835195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87e481e7-fa8b-457d-8205-c485e9618d18 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:01.839682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87e481e7-fa8b-457d-8205-c485e9618d18 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:01.840378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87e481e7-fa8b-457d-8205-c485e9618d18 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:01.840867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87e481e7-fa8b-457d-8205-c485e9618d18 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:01.841355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87e481e7-fa8b-457d-8205-c485e9618d18 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:01.895140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fce82e55-d21e-4712-9da3-b042d7b76eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:01.920504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fce82e55-d21e-4712-9da3-b042d7b76eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:01.928136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fce82e55-d21e-4712-9da3-b042d7b76eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:01.953937 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fce82e55-d21e-4712-9da3-b042d7b76eed tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.230128 Sep 08 12:41:01.955492 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 466/927] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:01 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:01.965418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9bb8b221-5a2e-417f-9f7a-6cdca56dd8d8 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:01.966095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9bb8b221-5a2e-417f-9f7a-6cdca56dd8d8 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:01.980557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bb8b221-5a2e-417f-9f7a-6cdca56dd8d8 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:01.983651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bb8b221-5a2e-417f-9f7a-6cdca56dd8d8 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:01.984128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bb8b221-5a2e-417f-9f7a-6cdca56dd8d8 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:01.984894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bb8b221-5a2e-417f-9f7a-6cdca56dd8d8 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:01.985327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-87e481e7-fa8b-457d-8205-c485e9618d18 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'flavor' on Instance uuid 60526de3-67cc-4bf8-911d-590f531d0130 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:41:01.989535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bb8b221-5a2e-417f-9f7a-6cdca56dd8d8 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:01.990051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bb8b221-5a2e-417f-9f7a-6cdca56dd8d8 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:02.021766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-87e481e7-fa8b-457d-8205-c485e9618d18 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Going to try to live migrate instance to n-h2-852084-10 {{(pid=128970) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 12:41:02.056796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:02.966732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9bb8b221-5a2e-417f-9f7a-6cdca56dd8d8 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:02.985206 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9bb8b221-5a2e-417f-9f7a-6cdca56dd8d8 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1378 microversion: 2.1 time: 1.026387 Sep 08 12:41:02.990824 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 467/928] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:01 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1378 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:03.003046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-35aa1811-9a3e-47ed-a1a4-a99c413fefb9 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:03.010373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-35aa1811-9a3e-47ed-a1a4-a99c413fefb9 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:03.028117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35aa1811-9a3e-47ed-a1a4-a99c413fefb9 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:03.032122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35aa1811-9a3e-47ed-a1a4-a99c413fefb9 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:03.034417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35aa1811-9a3e-47ed-a1a4-a99c413fefb9 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:03.036184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35aa1811-9a3e-47ed-a1a4-a99c413fefb9 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:03.036928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35aa1811-9a3e-47ed-a1a4-a99c413fefb9 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:03.037636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35aa1811-9a3e-47ed-a1a4-a99c413fefb9 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:03.094987 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-35aa1811-9a3e-47ed-a1a4-a99c413fefb9 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101622 Sep 08 12:41:03.102431 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 468/929] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:41:02 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:41:03.115172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-887929212", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b5d1f658-99d6-412f-bb9f-030e7aeb366b"}], "security_groups": [{"name": "tempest-securitygroup--1801706165"}], "key_name": "tempest-keypair-106207217", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:03.313228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=34 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:03.362273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] validate_networks() for [('b5d1f658-99d6-412f-bb9f-030e7aeb366b', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:41:04.535906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Getting quotas for project 0c8b4715d80648a0a6cbeedfbbf6f29c. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:41:04.550347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Getting quotas for user 55d39e1c491c47488c4de0e147732645 and project 0c8b4715d80648a0a6cbeedfbbf6f29c. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:41:04.577316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:41:04.578212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:41:04.580390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:41:04.581113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:41:04.581874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:41:04.596314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:04.597256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:04.598095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:04.599093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:04.600171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:04.601433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:04.674988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Getting quotas for project 0c8b4715d80648a0a6cbeedfbbf6f29c. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:41:04.690924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Getting quotas for user 55d39e1c491c47488c4de0e147732645 and project 0c8b4715d80648a0a6cbeedfbbf6f29c. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:41:04.746739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:41:04.758852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:41:04.865146 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-af56e21b-9423-4467-bfde-024771f17bac tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.761011 Sep 08 12:41:04.866341 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 469/930] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:41:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 1763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:41:04.872420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c93a03cc-0c50-4fba-9289-b1f230d2c0b6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:04.873824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c93a03cc-0c50-4fba-9289-b1f230d2c0b6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 953e5b9e-8c65-4892-a558-ec7764a7b037] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:04.882020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:04.884739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c93a03cc-0c50-4fba-9289-b1f230d2c0b6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:04.886169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c93a03cc-0c50-4fba-9289-b1f230d2c0b6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:04.886840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c93a03cc-0c50-4fba-9289-b1f230d2c0b6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:04.888207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c93a03cc-0c50-4fba-9289-b1f230d2c0b6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:04.889158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c93a03cc-0c50-4fba-9289-b1f230d2c0b6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:04.890125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c93a03cc-0c50-4fba-9289-b1f230d2c0b6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:04.912264 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-c93a03cc-0c50-4fba-9289-b1f230d2c0b6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] HTTP exception thrown: Instance 953e5b9e-8c65-4892-a558-ec7764a7b037 could not be found. Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c93a03cc-0c50-4fba-9289-b1f230d2c0b6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Request method failure captured: Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/953e5b9e-8c65-4892-a558-ec7764a7b037 HTTP/1.1 Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIw6pvhdO4zXhGJCeJ68kJVlsg90ZbSv8TA1izVc9P8bD4Mdu4KXagKTNz1oO93ELXFA4g_EqPdtm7gyry5N4K7tu7lRJSgVuw6GQPzVgbC4uAAvWiLPrDcsyxqGiNNxf4BjA9XsBe47roVYCmKPUnjbtRu99GiZHdc1lNwkgijj3o Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:41:04.914103 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:41:04.915571 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:41:04.915571 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:04.915571 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:41:04.915571 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:04.915571 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:41:04.915571 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:41:04.915571 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:41:04.915571 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 7d8ffdbbf2de43b9b4efc89b7fcd4897 Sep 08 12:41:04.915571 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:41:04.915571 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:41:04.915571 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 953e5b9e-8c65-4892-a558-ec7764a7b037 could not be found. Sep 08 12:41:04.915571 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '953e5b9e-8c65-4892-a558-ec7764a7b037'} Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 953e5b9e-8c65-4892-a558-ec7764a7b037 could not be found. Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:41:04.916364 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 953e5b9e-8c65-4892-a558-ec7764a7b037 could not be found. Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 953e5b9e-8c65-4892-a558-ec7764a7b037 could not be found. Sep 08 12:41:04.917672 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:04.920941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c93a03cc-0c50-4fba-9289-b1f230d2c0b6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Returning 404 to user: Instance 953e5b9e-8c65-4892-a558-ec7764a7b037 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:41:04.922073 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c93a03cc-0c50-4fba-9289-b1f230d2c0b6 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/953e5b9e-8c65-4892-a558-ec7764a7b037" status: 404 len: 111 microversion: 2.1 time: 0.054621 Sep 08 12:41:04.923328 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 470/931] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:04 2022] GET /compute/v2.1/servers/953e5b9e-8c65-4892-a558-ec7764a7b037 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:41:04.928709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d41f3d25-4ef5-4773-bd9e-84101364b4a8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:04.934933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d41f3d25-4ef5-4773-bd9e-84101364b4a8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:04.959051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41f3d25-4ef5-4773-bd9e-84101364b4a8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:04.959739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41f3d25-4ef5-4773-bd9e-84101364b4a8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:04.960802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41f3d25-4ef5-4773-bd9e-84101364b4a8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:04.962126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41f3d25-4ef5-4773-bd9e-84101364b4a8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:04.966943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41f3d25-4ef5-4773-bd9e-84101364b4a8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:04.968298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41f3d25-4ef5-4773-bd9e-84101364b4a8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:05.038637 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-87e481e7-fa8b-457d-8205-c485e9618d18 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130/action" status: 202 len: 0 microversion: 2.25 time: 3.249205 Sep 08 12:41:05.040828 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 462/932] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 12:41:01 2022] POST /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130/action => generated 0 bytes in 3253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:41:05.068338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-64bb433d-7696-4801-add5-9d6f5d2797a1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:05.069518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-64bb433d-7696-4801-add5-9d6f5d2797a1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:05.107194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64bb433d-7696-4801-add5-9d6f5d2797a1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:05.109456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64bb433d-7696-4801-add5-9d6f5d2797a1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:05.113315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64bb433d-7696-4801-add5-9d6f5d2797a1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:05.114241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64bb433d-7696-4801-add5-9d6f5d2797a1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:05.115651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64bb433d-7696-4801-add5-9d6f5d2797a1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:05.116192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64bb433d-7696-4801-add5-9d6f5d2797a1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:05.249017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-64bb433d-7696-4801-add5-9d6f5d2797a1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:05.267395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d41f3d25-4ef5-4773-bd9e-84101364b4a8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:05.269908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-64bb433d-7696-4801-add5-9d6f5d2797a1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:05.272877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-64bb433d-7696-4801-add5-9d6f5d2797a1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:05.277307 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d41f3d25-4ef5-4773-bd9e-84101364b4a8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1359 microversion: 2.1 time: 0.352611 Sep 08 12:41:05.278115 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 471/933] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:04 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1359 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:05.283872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-451631886", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "2427be19-e512-4963-98e3-67b9c3b83a6d"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:05.287088 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-64bb433d-7696-4801-add5-9d6f5d2797a1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.244527 Sep 08 12:41:05.305863 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 463/934] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:05 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:05.348538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-9c2c9eb9-abdf-45bc-88e3-af0548048aae req-011452d8-86a6-4877-b8aa-63896795c5ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953e5b9e-8c65-4892-a558-ec7764a7b037", "name": "network-vif-deleted", "tag": "ece0ac07-b959-4de4-afa0-16ad3e7f613d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:05.376950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9c2c9eb9-abdf-45bc-88e3-af0548048aae req-011452d8-86a6-4877-b8aa-63896795c5ca service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:05.395082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9c2c9eb9-abdf-45bc-88e3-af0548048aae req-011452d8-86a6-4877-b8aa-63896795c5ca service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:05.398394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9c2c9eb9-abdf-45bc-88e3-af0548048aae req-011452d8-86a6-4877-b8aa-63896795c5ca service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:05.440361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] validate_networks() for [('2427be19-e512-4963-98e3-67b9c3b83a6d', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:41:05.474352 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-9c2c9eb9-abdf-45bc-88e3-af0548048aae req-011452d8-86a6-4877-b8aa-63896795c5ca service nova] Creating event network-vif-deleted:ece0ac07-b959-4de4-afa0-16ad3e7f613d for instance 953e5b9e-8c65-4892-a558-ec7764a7b037 on n-h2-852084-10 Sep 08 12:41:05.495084 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-9c2c9eb9-abdf-45bc-88e3-af0548048aae req-011452d8-86a6-4877-b8aa-63896795c5ca service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180720 Sep 08 12:41:05.500790 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 464/935] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:05.521826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a120ca78-81be-41c4-a1ab-dd6592efe2a1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:05.523851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a120ca78-81be-41c4-a1ab-dd6592efe2a1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:05.538300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a120ca78-81be-41c4-a1ab-dd6592efe2a1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:05.540948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a120ca78-81be-41c4-a1ab-dd6592efe2a1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:05.542580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a120ca78-81be-41c4-a1ab-dd6592efe2a1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:05.545173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a120ca78-81be-41c4-a1ab-dd6592efe2a1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:05.547930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a120ca78-81be-41c4-a1ab-dd6592efe2a1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:05.549963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a120ca78-81be-41c4-a1ab-dd6592efe2a1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:06.019054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a120ca78-81be-41c4-a1ab-dd6592efe2a1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:06.031454 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a120ca78-81be-41c4-a1ab-dd6592efe2a1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1378 microversion: 2.1 time: 0.526573 Sep 08 12:41:06.032968 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 465/936] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:05 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1378 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:06.040962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c29c9f4f-2b12-4057-bc19-a0c50f44e935 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:06.043014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c29c9f4f-2b12-4057-bc19-a0c50f44e935 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:06.055133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c29c9f4f-2b12-4057-bc19-a0c50f44e935 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:06.056343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c29c9f4f-2b12-4057-bc19-a0c50f44e935 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:06.056974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c29c9f4f-2b12-4057-bc19-a0c50f44e935 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:06.058930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c29c9f4f-2b12-4057-bc19-a0c50f44e935 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:06.059653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c29c9f4f-2b12-4057-bc19-a0c50f44e935 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:06.061281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c29c9f4f-2b12-4057-bc19-a0c50f44e935 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:06.247408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c29c9f4f-2b12-4057-bc19-a0c50f44e935 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:06.258070 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c29c9f4f-2b12-4057-bc19-a0c50f44e935 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1272 microversion: 2.1 time: 0.222931 Sep 08 12:41:06.259386 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 466/937] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:06 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1272 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:06.266557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-82463f9d-8ece-425a-aa5f-f8bf9e6f1285 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:06.267707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-82463f9d-8ece-425a-aa5f-f8bf9e6f1285 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 7b057001-7456-4c05-8f42-f421455b3cdd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:06.277083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82463f9d-8ece-425a-aa5f-f8bf9e6f1285 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:06.278118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82463f9d-8ece-425a-aa5f-f8bf9e6f1285 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:06.278783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82463f9d-8ece-425a-aa5f-f8bf9e6f1285 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:06.279854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82463f9d-8ece-425a-aa5f-f8bf9e6f1285 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:06.280604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82463f9d-8ece-425a-aa5f-f8bf9e6f1285 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:06.281403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82463f9d-8ece-425a-aa5f-f8bf9e6f1285 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:06.303385 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-82463f9d-8ece-425a-aa5f-f8bf9e6f1285 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] HTTP exception thrown: Instance 7b057001-7456-4c05-8f42-f421455b3cdd could not be found. Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-82463f9d-8ece-425a-aa5f-f8bf9e6f1285 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Request method failure captured: Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd HTTP/1.1 Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIw6pvhdO4zXhGJCeJ68kJVlsg90ZbSv8TA1izVc9P8bD4Mdu4KXagKTNz1oO93ELXFA4g_EqPdtm7gyry5N4K7tu7lRJSgVuw6GQPzVgbC4uAAvWiLPrDcsyxqGiNNxf4BjA9XsBe47roVYCmKPUnjbtRu99GiZHdc1lNwkgijj3o Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:41:06.320126 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:41:06.321633 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:41:06.321633 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:06.321633 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:41:06.321633 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:06.321633 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:41:06.321633 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:41:06.321633 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:41:06.321633 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7d8ffdbbf2de43b9b4efc89b7fcd4897 Sep 08 12:41:06.321633 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:41:06.321633 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:41:06.321633 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 7b057001-7456-4c05-8f42-f421455b3cdd could not be found. Sep 08 12:41:06.321633 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '7b057001-7456-4c05-8f42-f421455b3cdd'} Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b057001-7456-4c05-8f42-f421455b3cdd could not be found. Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:41:06.322390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b057001-7456-4c05-8f42-f421455b3cdd could not be found. Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b057001-7456-4c05-8f42-f421455b3cdd could not be found. Sep 08 12:41:06.324812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:06.327303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-82463f9d-8ece-425a-aa5f-f8bf9e6f1285 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Returning 404 to user: Instance 7b057001-7456-4c05-8f42-f421455b3cdd could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:41:06.327303 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-82463f9d-8ece-425a-aa5f-f8bf9e6f1285 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd" status: 404 len: 111 microversion: 2.1 time: 0.060822 Sep 08 12:41:06.330748 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 467/938] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:06 2022] GET /compute/v2.1/servers/7b057001-7456-4c05-8f42-f421455b3cdd => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:41:06.339832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-76fe78f0-6c97-45d8-8a7b-9102a6bcd7a0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:06.340459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-76fe78f0-6c97-45d8-8a7b-9102a6bcd7a0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:06.347827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-76fe78f0-6c97-45d8-8a7b-9102a6bcd7a0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:06.348307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-76fe78f0-6c97-45d8-8a7b-9102a6bcd7a0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:06.348928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-76fe78f0-6c97-45d8-8a7b-9102a6bcd7a0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:06.349802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-76fe78f0-6c97-45d8-8a7b-9102a6bcd7a0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:06.350435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-76fe78f0-6c97-45d8-8a7b-9102a6bcd7a0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:06.351017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-76fe78f0-6c97-45d8-8a7b-9102a6bcd7a0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:06.738192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-76fe78f0-6c97-45d8-8a7b-9102a6bcd7a0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:06.751111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-76fe78f0-6c97-45d8-8a7b-9102a6bcd7a0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:06.754038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-76fe78f0-6c97-45d8-8a7b-9102a6bcd7a0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:06.756117 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-76fe78f0-6c97-45d8-8a7b-9102a6bcd7a0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1567 microversion: 2.25 time: 0.423596 Sep 08 12:41:06.759004 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 468/939] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:06 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1567 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:06.769924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6b15dd11-2471-4c86-8645-b1807f9f6b72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:06.770853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6b15dd11-2471-4c86-8645-b1807f9f6b72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:06.772450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:41:06.773339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:41:06.774028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:41:06.774640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:41:06.775356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:41:06.780929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b15dd11-2471-4c86-8645-b1807f9f6b72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:06.784004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b15dd11-2471-4c86-8645-b1807f9f6b72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:06.784809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b15dd11-2471-4c86-8645-b1807f9f6b72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:06.785857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b15dd11-2471-4c86-8645-b1807f9f6b72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:06.786606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b15dd11-2471-4c86-8645-b1807f9f6b72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:06.787322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b15dd11-2471-4c86-8645-b1807f9f6b72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:06.802263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:06.802781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:06.808551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:06.809678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:06.810596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:06.811531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:06.844805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=12 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:06.876793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Getting quotas for project 3dc8fdfffe814f59ad6b22da13094cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:41:06.883581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Getting quotas for user 8f1fd37230b4490389ff38162ea813b9 and project 3dc8fdfffe814f59ad6b22da13094cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:41:06.899604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:41:06.902320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:41:06.968894 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-166a93a7-df5c-4a9f-b3d0-4ce783de2f1e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.689518 Sep 08 12:41:06.970463 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 472/940] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:41:06.981446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cb39ad1e-e213-4d79-98f9-8524d03cf7f6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:06.982521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cb39ad1e-e213-4d79-98f9-8524d03cf7f6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:06.995928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb39ad1e-e213-4d79-98f9-8524d03cf7f6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:06.997922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb39ad1e-e213-4d79-98f9-8524d03cf7f6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:06.998617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb39ad1e-e213-4d79-98f9-8524d03cf7f6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:06.999594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb39ad1e-e213-4d79-98f9-8524d03cf7f6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:07.000362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb39ad1e-e213-4d79-98f9-8524d03cf7f6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:07.001019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb39ad1e-e213-4d79-98f9-8524d03cf7f6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:07.128650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cb39ad1e-e213-4d79-98f9-8524d03cf7f6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:07.145399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cb39ad1e-e213-4d79-98f9-8524d03cf7f6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:07.149091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cb39ad1e-e213-4d79-98f9-8524d03cf7f6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:07.162429 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cb39ad1e-e213-4d79-98f9-8524d03cf7f6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.186654 Sep 08 12:41:07.164545 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 473/941] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:06 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:07.172618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3c78d6eb-7be4-479a-aa63-6877711f33ea tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:07.227092 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3c78d6eb-7be4-479a-aa63-6877711f33ea tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/a3630ffd-9610-4627-8612-0d59a3877639" status: 204 len: 0 microversion: 2.1 time: 0.060518 Sep 08 12:41:07.227813 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 474/942] 10.222.0.78 () {58 vars in 1266 bytes} [Thu Sep 8 12:41:07 2022] DELETE /compute/v2.1/os-server-groups/a3630ffd-9610-4627-8612-0d59a3877639 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:41:07.234820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-de48f8c6-2c27-44cc-907a-cef17de326f1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:07.235952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-de48f8c6-2c27-44cc-907a-cef17de326f1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:07.286860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6b15dd11-2471-4c86-8645-b1807f9f6b72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:07.300826 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6b15dd11-2471-4c86-8645-b1807f9f6b72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1359 microversion: 2.1 time: 0.540254 Sep 08 12:41:07.302866 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 469/943] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:06 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1359 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:07.313771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-279a3e2f-1a60-4ea2-9402-5b457f9bb455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:07.314770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-279a3e2f-1a60-4ea2-9402-5b457f9bb455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:07.321713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-279a3e2f-1a60-4ea2-9402-5b457f9bb455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:07.322527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-279a3e2f-1a60-4ea2-9402-5b457f9bb455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:07.322964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-279a3e2f-1a60-4ea2-9402-5b457f9bb455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:07.323969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-279a3e2f-1a60-4ea2-9402-5b457f9bb455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:07.325112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-279a3e2f-1a60-4ea2-9402-5b457f9bb455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:07.325663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-279a3e2f-1a60-4ea2-9402-5b457f9bb455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:07.344292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-de48f8c6-2c27-44cc-907a-cef17de326f1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:07.355257 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-de48f8c6-2c27-44cc-907a-cef17de326f1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1217 microversion: 2.1 time: 0.125197 Sep 08 12:41:07.375327 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 475/944] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:07 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:07.384592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0554c71-c8c0-4404-ac73-4f28529c3f9f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:07.385928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0554c71-c8c0-4404-ac73-4f28529c3f9f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: d348606f-4433-463c-b587-79f3f2e1fec1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:07.396992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0554c71-c8c0-4404-ac73-4f28529c3f9f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:07.398166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0554c71-c8c0-4404-ac73-4f28529c3f9f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:07.398806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0554c71-c8c0-4404-ac73-4f28529c3f9f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:07.399744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0554c71-c8c0-4404-ac73-4f28529c3f9f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:07.400562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0554c71-c8c0-4404-ac73-4f28529c3f9f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:07.401786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0554c71-c8c0-4404-ac73-4f28529c3f9f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:07.432148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:07.448247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0554c71-c8c0-4404-ac73-4f28529c3f9f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: d348606f-4433-463c-b587-79f3f2e1fec1] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:41:07.653939 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0554c71-c8c0-4404-ac73-4f28529c3f9f tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1" status: 204 len: 0 microversion: 2.1 time: 0.276313 Sep 08 12:41:07.655048 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 476/945] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:41:07 2022] DELETE /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:41:07.671770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-49ce6cb8-bb50-4e4b-925d-62bef4e26c1d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:07.674565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-49ce6cb8-bb50-4e4b-925d-62bef4e26c1d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:07.696805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ce6cb8-bb50-4e4b-925d-62bef4e26c1d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:07.708040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ce6cb8-bb50-4e4b-925d-62bef4e26c1d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:07.708543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ce6cb8-bb50-4e4b-925d-62bef4e26c1d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:07.709598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ce6cb8-bb50-4e4b-925d-62bef4e26c1d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:07.713155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ce6cb8-bb50-4e4b-925d-62bef4e26c1d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:07.713834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ce6cb8-bb50-4e4b-925d-62bef4e26c1d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.035850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-49ce6cb8-bb50-4e4b-925d-62bef4e26c1d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:08.044903 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-49ce6cb8-bb50-4e4b-925d-62bef4e26c1d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1334 microversion: 2.1 time: 0.384898 Sep 08 12:41:08.046107 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 477/946] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:07 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1334 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:08.051123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3aea42ee-6016-44e9-87bd-303451112ea0 req-5ab3d9b9-4c33-4028-8513-51f526a2d5fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b057001-7456-4c05-8f42-f421455b3cdd", "name": "network-vif-deleted", "tag": "cdc99e53-9228-4abb-811c-6f214aead362"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:08.063199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3aea42ee-6016-44e9-87bd-303451112ea0 req-5ab3d9b9-4c33-4028-8513-51f526a2d5fd service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.063991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3aea42ee-6016-44e9-87bd-303451112ea0 req-5ab3d9b9-4c33-4028-8513-51f526a2d5fd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.064573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3aea42ee-6016-44e9-87bd-303451112ea0 req-5ab3d9b9-4c33-4028-8513-51f526a2d5fd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.096466 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3aea42ee-6016-44e9-87bd-303451112ea0 req-5ab3d9b9-4c33-4028-8513-51f526a2d5fd service nova] Creating event network-vif-deleted:cdc99e53-9228-4abb-811c-6f214aead362 for instance 7b057001-7456-4c05-8f42-f421455b3cdd on n-h1-852084-10 Sep 08 12:41:08.108402 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3aea42ee-6016-44e9-87bd-303451112ea0 req-5ab3d9b9-4c33-4028-8513-51f526a2d5fd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059698 Sep 08 12:41:08.118114 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 478/947] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:08.134703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-86ea3769-3f08-4475-abe2-eca60edb45cf tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:08.137825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-86ea3769-3f08-4475-abe2-eca60edb45cf tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:08.149338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-279a3e2f-1a60-4ea2-9402-5b457f9bb455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:08.154042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86ea3769-3f08-4475-abe2-eca60edb45cf tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.155257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86ea3769-3f08-4475-abe2-eca60edb45cf tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.157384 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-279a3e2f-1a60-4ea2-9402-5b457f9bb455 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1378 microversion: 2.1 time: 0.850636 Sep 08 12:41:08.158054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86ea3769-3f08-4475-abe2-eca60edb45cf tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.161383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86ea3769-3f08-4475-abe2-eca60edb45cf tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.162835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86ea3769-3f08-4475-abe2-eca60edb45cf tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.163900 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 470/948] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:07 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1378 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:08.164641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86ea3769-3f08-4475-abe2-eca60edb45cf tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.171937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5875c9a6-5e6c-4082-bce4-f37fc0e93c1c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:08.172562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5875c9a6-5e6c-4082-bce4-f37fc0e93c1c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:08.185386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5875c9a6-5e6c-4082-bce4-f37fc0e93c1c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.185728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5875c9a6-5e6c-4082-bce4-f37fc0e93c1c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.185728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5875c9a6-5e6c-4082-bce4-f37fc0e93c1c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.185728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5875c9a6-5e6c-4082-bce4-f37fc0e93c1c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.185728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5875c9a6-5e6c-4082-bce4-f37fc0e93c1c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.188736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5875c9a6-5e6c-4082-bce4-f37fc0e93c1c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.232774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-86ea3769-3f08-4475-abe2-eca60edb45cf tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:41:08.346645 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-86ea3769-3f08-4475-abe2-eca60edb45cf tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 204 len: 0 microversion: 2.1 time: 0.224297 Sep 08 12:41:08.347290 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 479/949] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:41:08 2022] DELETE /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:41:08.491434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-10a759c9-8b2a-45b1-9711-c9c872eddaec tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-996610979", "ram": 512, "vcpus": 1, "disk": 10, "id": 2062698072, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:08.518081 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-10a759c9-8b2a-45b1-9711-c9c872eddaec tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.168973 Sep 08 12:41:08.527164 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 480/950] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:41:08 2022] POST /compute/v2.1/flavors => generated 415 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:08.527164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9935ff58-7a6a-43a9-bddc-a234fc849721 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:08.527164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9935ff58-7a6a-43a9-bddc-a234fc849721 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:08.540334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9935ff58-7a6a-43a9-bddc-a234fc849721 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.541414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9935ff58-7a6a-43a9-bddc-a234fc849721 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.542467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9935ff58-7a6a-43a9-bddc-a234fc849721 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.543207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9935ff58-7a6a-43a9-bddc-a234fc849721 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.543881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9935ff58-7a6a-43a9-bddc-a234fc849721 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.544357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9935ff58-7a6a-43a9-bddc-a234fc849721 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.580449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5875c9a6-5e6c-4082-bce4-f37fc0e93c1c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:08.604944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5875c9a6-5e6c-4082-bce4-f37fc0e93c1c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:08.606945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5875c9a6-5e6c-4082-bce4-f37fc0e93c1c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:08.609336 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5875c9a6-5e6c-4082-bce4-f37fc0e93c1c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1567 microversion: 2.25 time: 0.443978 Sep 08 12:41:08.611061 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 471/951] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:08 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1567 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:08.617680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a0a32e15-17f3-4ebf-bfcc-6dc0d41c1023 req-699f7844-0853-4c0a-90c3-d329cb6a33ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc95339-7b99-439b-8a64-3eeb808b9c77", "name": "network-vif-plugged", "status": "completed", "tag": "c88f65d9-eeed-4224-9551-d32c44c05007"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:08.633061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a0a32e15-17f3-4ebf-bfcc-6dc0d41c1023 req-699f7844-0853-4c0a-90c3-d329cb6a33ec service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.633572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a0a32e15-17f3-4ebf-bfcc-6dc0d41c1023 req-699f7844-0853-4c0a-90c3-d329cb6a33ec service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.634051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a0a32e15-17f3-4ebf-bfcc-6dc0d41c1023 req-699f7844-0853-4c0a-90c3-d329cb6a33ec service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.647535 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a0a32e15-17f3-4ebf-bfcc-6dc0d41c1023 req-699f7844-0853-4c0a-90c3-d329cb6a33ec service nova] Creating event network-vif-plugged:c88f65d9-eeed-4224-9551-d32c44c05007 for instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 on n-h2-852084-10 Sep 08 12:41:08.653428 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a0a32e15-17f3-4ebf-bfcc-6dc0d41c1023 req-699f7844-0853-4c0a-90c3-d329cb6a33ec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040495 Sep 08 12:41:08.654464 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 472/952] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:08.660116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-348860fb-ab0c-4d13-bb7e-80d64e069a32 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:08.660760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-348860fb-ab0c-4d13-bb7e-80d64e069a32 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:08.669814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-348860fb-ab0c-4d13-bb7e-80d64e069a32 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.670630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-348860fb-ab0c-4d13-bb7e-80d64e069a32 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.671263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-348860fb-ab0c-4d13-bb7e-80d64e069a32 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.672158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-348860fb-ab0c-4d13-bb7e-80d64e069a32 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.672773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-348860fb-ab0c-4d13-bb7e-80d64e069a32 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.673372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-348860fb-ab0c-4d13-bb7e-80d64e069a32 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.678850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9935ff58-7a6a-43a9-bddc-a234fc849721 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:08.712828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9935ff58-7a6a-43a9-bddc-a234fc849721 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:08.715164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9935ff58-7a6a-43a9-bddc-a234fc849721 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:08.725276 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9935ff58-7a6a-43a9-bddc-a234fc849721 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.203594 Sep 08 12:41:08.727786 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 481/953] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:08 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:08.760536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-054dfa1c-a9bc-493a-a946-bd4efa95d385 req-7ad16740-4cd7-410f-a98b-a00115de8559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60526de3-67cc-4bf8-911d-590f531d0130", "name": "network-vif-unplugged", "status": "completed", "tag": "fbd4d925-0ef2-4240-a577-779541fca496"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:08.794194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-054dfa1c-a9bc-493a-a946-bd4efa95d385 req-7ad16740-4cd7-410f-a98b-a00115de8559 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.795156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-054dfa1c-a9bc-493a-a946-bd4efa95d385 req-7ad16740-4cd7-410f-a98b-a00115de8559 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.795341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-054dfa1c-a9bc-493a-a946-bd4efa95d385 req-7ad16740-4cd7-410f-a98b-a00115de8559 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.810848 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-054dfa1c-a9bc-493a-a946-bd4efa95d385 req-7ad16740-4cd7-410f-a98b-a00115de8559 service nova] Creating event network-vif-unplugged:fbd4d925-0ef2-4240-a577-779541fca496 for instance 60526de3-67cc-4bf8-911d-590f531d0130 on n-h1-852084-10 Sep 08 12:41:08.816311 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-054dfa1c-a9bc-493a-a946-bd4efa95d385 req-7ad16740-4cd7-410f-a98b-a00115de8559 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085954 Sep 08 12:41:08.816929 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 482/954] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:08.824138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bac5257d-3182-4877-a869-42ce1492b3a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:08.824892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bac5257d-3182-4877-a869-42ce1492b3a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: d348606f-4433-463c-b587-79f3f2e1fec1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:08.832315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac5257d-3182-4877-a869-42ce1492b3a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.832957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac5257d-3182-4877-a869-42ce1492b3a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.833274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac5257d-3182-4877-a869-42ce1492b3a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:08.833962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac5257d-3182-4877-a869-42ce1492b3a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:08.834413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac5257d-3182-4877-a869-42ce1492b3a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:08.834835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac5257d-3182-4877-a869-42ce1492b3a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:09.178433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-348860fb-ab0c-4d13-bb7e-80d64e069a32 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:09.189348 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-348860fb-ab0c-4d13-bb7e-80d64e069a32 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1359 microversion: 2.1 time: 0.533267 Sep 08 12:41:09.189987 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 473/955] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:08 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1359 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:09.196059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a3e218d4-f330-4d55-b02f-9d6b0d1a61cc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:09.196587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a3e218d4-f330-4d55-b02f-9d6b0d1a61cc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:09.199860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:09.204124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3e218d4-f330-4d55-b02f-9d6b0d1a61cc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:09.204830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3e218d4-f330-4d55-b02f-9d6b0d1a61cc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:09.205261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3e218d4-f330-4d55-b02f-9d6b0d1a61cc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:09.206633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3e218d4-f330-4d55-b02f-9d6b0d1a61cc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:09.206633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3e218d4-f330-4d55-b02f-9d6b0d1a61cc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:09.206997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3e218d4-f330-4d55-b02f-9d6b0d1a61cc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:09.257706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bac5257d-3182-4877-a869-42ce1492b3a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:09.266000 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bac5257d-3182-4877-a869-42ce1492b3a3 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1" status: 200 len: 1475 microversion: 2.1 time: 0.447844 Sep 08 12:41:09.266601 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 483/956] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:08 2022] GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1 => generated 1475 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:09.271327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-511bfd5a-fca7-493d-b95f-7b8045f21d73 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:09.310557 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-511bfd5a-fca7-493d-b95f-7b8045f21d73 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/2062698072/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.042841 Sep 08 12:41:09.311185 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 484/957] 10.222.0.78 () {60 vars in 1224 bytes} [Thu Sep 8 12:41:09 2022] POST /compute/v2.1/flavors/2062698072/os-extra_specs => generated 66 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:41:09.316665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-de8c67f0-e00e-42b6-80e1-937788035eb8 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:09.317337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-de8c67f0-e00e-42b6-80e1-937788035eb8 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:09.324776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de8c67f0-e00e-42b6-80e1-937788035eb8 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:09.325436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de8c67f0-e00e-42b6-80e1-937788035eb8 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:09.326421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de8c67f0-e00e-42b6-80e1-937788035eb8 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:09.326576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de8c67f0-e00e-42b6-80e1-937788035eb8 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:09.327034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de8c67f0-e00e-42b6-80e1-937788035eb8 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:09.327486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de8c67f0-e00e-42b6-80e1-937788035eb8 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:09.329696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a3e218d4-f330-4d55-b02f-9d6b0d1a61cc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:09.342722 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a3e218d4-f330-4d55-b02f-9d6b0d1a61cc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1221 microversion: 2.1 time: 0.151196 Sep 08 12:41:09.348861 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 474/958] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:09 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1221 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:09.355679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8d2defb7-d737-473f-9ecd-40c0394d9fce tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:09.356660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8d2defb7-d737-473f-9ecd-40c0394d9fce tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:09.363804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d2defb7-d737-473f-9ecd-40c0394d9fce tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:09.364500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d2defb7-d737-473f-9ecd-40c0394d9fce tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:09.365008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d2defb7-d737-473f-9ecd-40c0394d9fce tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:09.365772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d2defb7-d737-473f-9ecd-40c0394d9fce tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:09.366287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d2defb7-d737-473f-9ecd-40c0394d9fce tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:09.366767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d2defb7-d737-473f-9ecd-40c0394d9fce tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:09.682680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-de8c67f0-e00e-42b6-80e1-937788035eb8 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:09.686551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8d2defb7-d737-473f-9ecd-40c0394d9fce tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:09.691660 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-de8c67f0-e00e-42b6-80e1-937788035eb8 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1402 microversion: 2.1 time: 0.379169 Sep 08 12:41:09.692739 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 485/959] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:09 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1402 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:09.706333 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8d2defb7-d737-473f-9ecd-40c0394d9fce tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1378 microversion: 2.1 time: 0.361867 Sep 08 12:41:09.707844 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 475/960] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:09 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1378 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:09.716439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ddc6da74-1bfe-4c96-89c0-84d4f37ea5a5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:09.718073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ddc6da74-1bfe-4c96-89c0-84d4f37ea5a5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:09.733760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddc6da74-1bfe-4c96-89c0-84d4f37ea5a5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:09.734283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddc6da74-1bfe-4c96-89c0-84d4f37ea5a5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:09.734722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddc6da74-1bfe-4c96-89c0-84d4f37ea5a5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:09.735509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddc6da74-1bfe-4c96-89c0-84d4f37ea5a5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:09.736073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddc6da74-1bfe-4c96-89c0-84d4f37ea5a5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:09.736498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddc6da74-1bfe-4c96-89c0-84d4f37ea5a5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:09.865452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bd74d1c2-ea5d-4ed3-9612-95601e68af5a tempest-FlavorsExtraSpecsTestJSON-1259949806 tempest-FlavorsExtraSpecsTestJSON-1259949806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:09.875908 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bd74d1c2-ea5d-4ed3-9612-95601e68af5a tempest-FlavorsExtraSpecsTestJSON-1259949806 tempest-FlavorsExtraSpecsTestJSON-1259949806-project] 10.222.0.78 "GET /compute/v2.1/flavors/2062698072/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.181837 Sep 08 12:41:09.876788 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 486/961] 10.222.0.78 () {58 vars in 1203 bytes} [Thu Sep 8 12:41:09 2022] GET /compute/v2.1/flavors/2062698072/os-extra_specs => generated 66 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:41:09.883041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-accb0aaa-6afc-41c6-a2c7-8753c75a7094 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:09.883881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-accb0aaa-6afc-41c6-a2c7-8753c75a7094 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:09.891933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-accb0aaa-6afc-41c6-a2c7-8753c75a7094 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:09.892676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-accb0aaa-6afc-41c6-a2c7-8753c75a7094 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:09.893217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-accb0aaa-6afc-41c6-a2c7-8753c75a7094 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:09.895271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-accb0aaa-6afc-41c6-a2c7-8753c75a7094 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:09.895999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-accb0aaa-6afc-41c6-a2c7-8753c75a7094 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:09.896569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-accb0aaa-6afc-41c6-a2c7-8753c75a7094 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:10.016586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ddc6da74-1bfe-4c96-89c0-84d4f37ea5a5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:10.025144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ddc6da74-1bfe-4c96-89c0-84d4f37ea5a5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:10.027248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ddc6da74-1bfe-4c96-89c0-84d4f37ea5a5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:10.028673 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ddc6da74-1bfe-4c96-89c0-84d4f37ea5a5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1567 microversion: 2.25 time: 0.319035 Sep 08 12:41:10.029598 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 476/962] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:09 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1567 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:10.034930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4af4d8a-5388-404d-bc5f-e2b262a60eb2 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:10.067668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-accb0aaa-6afc-41c6-a2c7-8753c75a7094 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:10.075422 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a4af4d8a-5388-404d-bc5f-e2b262a60eb2 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/2062698072/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.044644 Sep 08 12:41:10.076520 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 477/963] 10.222.0.78 () {60 vars in 1224 bytes} [Thu Sep 8 12:41:10 2022] POST /compute/v2.1/flavors/2062698072/os-extra_specs => generated 66 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:41:10.080653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-accb0aaa-6afc-41c6-a2c7-8753c75a7094 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:10.084207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-accb0aaa-6afc-41c6-a2c7-8753c75a7094 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:10.087989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-04f5cf10-8c6d-4f0a-a740-fd3546acd567 tempest-FlavorsExtraSpecsTestJSON-1259949806 tempest-FlavorsExtraSpecsTestJSON-1259949806-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:10.090800 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-accb0aaa-6afc-41c6-a2c7-8753c75a7094 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.212289 Sep 08 12:41:10.091749 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 487/964] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:09 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:10.098643 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-04f5cf10-8c6d-4f0a-a740-fd3546acd567 tempest-FlavorsExtraSpecsTestJSON-1259949806 tempest-FlavorsExtraSpecsTestJSON-1259949806-project] 10.222.0.78 "GET /compute/v2.1/flavors/2062698072/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.015035 Sep 08 12:41:10.099581 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 478/965] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:41:10 2022] GET /compute/v2.1/flavors/2062698072/os-extra_specs/hw:numa_nodes => generated 22 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:41:10.109495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b8bf9bf8-d3be-4f68-9219-3dca53f06505 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:10.138798 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b8bf9bf8-d3be-4f68-9219-3dca53f06505 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors/2062698072/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.032970 Sep 08 12:41:10.139964 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 488/966] 10.222.0.78 () {60 vars in 1224 bytes} [Thu Sep 8 12:41:10 2022] POST /compute/v2.1/flavors/2062698072/os-extra_specs => generated 66 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:41:10.149732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84a92c2f-9efd-4e29-8872-f7e54af0dc65 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:10.158553 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-84a92c2f-9efd-4e29-8872-f7e54af0dc65 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/2062698072/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012876 Sep 08 12:41:10.159270 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 479/967] 10.222.0.78 () {58 vars in 1203 bytes} [Thu Sep 8 12:41:10 2022] GET /compute/v2.1/flavors/2062698072/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 12:41:10.170287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-940b3c96-fad0-4277-a2f0-d470f7f04515 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:10.182898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=6,nova_api:DELETE=3,nova_api:UPDATE=2,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:10.206723 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-940b3c96-fad0-4277-a2f0-d470f7f04515 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/2062698072/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.040129 Sep 08 12:41:10.207504 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 489/968] 10.222.0.78 () {60 vars in 1265 bytes} [Thu Sep 8 12:41:10 2022] PUT /compute/v2.1/flavors/2062698072/os-extra_specs/hw:numa_nodes => generated 22 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:41:10.215068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bda24e77-14a9-45f6-b8d4-9ab466e5ed72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:10.216228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bda24e77-14a9-45f6-b8d4-9ab466e5ed72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:10.217025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c841e595-facc-42a3-9905-0ac885a0fe86 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:10.225495 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c841e595-facc-42a3-9905-0ac885a0fe86 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/2062698072/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012778 Sep 08 12:41:10.226356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bda24e77-14a9-45f6-b8d4-9ab466e5ed72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:10.226574 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 490/969] 10.222.0.78 () {58 vars in 1203 bytes} [Thu Sep 8 12:41:10 2022] GET /compute/v2.1/flavors/2062698072/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 12:41:10.227872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bda24e77-14a9-45f6-b8d4-9ab466e5ed72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:10.228920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bda24e77-14a9-45f6-b8d4-9ab466e5ed72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:10.230194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bda24e77-14a9-45f6-b8d4-9ab466e5ed72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:10.231310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bda24e77-14a9-45f6-b8d4-9ab466e5ed72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:10.233883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bda24e77-14a9-45f6-b8d4-9ab466e5ed72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:10.236352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-67bd7860-491c-49c7-8c70-2e22d1becf78 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:10.281920 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-67bd7860-491c-49c7-8c70-2e22d1becf78 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2062698072/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.049435 Sep 08 12:41:10.286634 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 491/970] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 12:41:10 2022] DELETE /compute/v2.1/flavors/2062698072/os-extra_specs/hw:numa_nodes => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Sep 08 12:41:10.303676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9e5a6caf-d7bd-4ce7-a877-d677646f8b2b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:10.304850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9e5a6caf-d7bd-4ce7-a877-d677646f8b2b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: d348606f-4433-463c-b587-79f3f2e1fec1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:10.314113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e5a6caf-d7bd-4ce7-a877-d677646f8b2b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:10.314741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e5a6caf-d7bd-4ce7-a877-d677646f8b2b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:10.315284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e5a6caf-d7bd-4ce7-a877-d677646f8b2b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:10.316088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e5a6caf-d7bd-4ce7-a877-d677646f8b2b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:10.316624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e5a6caf-d7bd-4ce7-a877-d677646f8b2b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:10.317123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e5a6caf-d7bd-4ce7-a877-d677646f8b2b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:10.602625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bda24e77-14a9-45f6-b8d4-9ab466e5ed72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:10.611831 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bda24e77-14a9-45f6-b8d4-9ab466e5ed72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1359 microversion: 2.1 time: 0.401538 Sep 08 12:41:10.612759 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 480/971] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:10 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1359 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:10.617851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1b12d978-70a2-4818-abe8-6ddf90c72b27 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:10.631334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9e5a6caf-d7bd-4ce7-a877-d677646f8b2b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:10.643077 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9e5a6caf-d7bd-4ce7-a877-d677646f8b2b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1" status: 200 len: 1475 microversion: 2.1 time: 0.356831 Sep 08 12:41:10.644412 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 492/972] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:10 2022] GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1 => generated 1475 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:41:10.653315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7867895d-05cc-49b6-a06f-76e28826896a tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:10.655152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7867895d-05cc-49b6-a06f-76e28826896a tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:10.658743 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1b12d978-70a2-4818-abe8-6ddf90c72b27 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2062698072/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.044883 Sep 08 12:41:10.659911 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 481/973] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 12:41:10 2022] DELETE /compute/v2.1/flavors/2062698072/os-extra_specs/hw:cpu_policy => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 12:41:10.664222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7867895d-05cc-49b6-a06f-76e28826896a tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:10.664822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7867895d-05cc-49b6-a06f-76e28826896a tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:10.665337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7867895d-05cc-49b6-a06f-76e28826896a tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:10.666193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7867895d-05cc-49b6-a06f-76e28826896a tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:10.666736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7867895d-05cc-49b6-a06f-76e28826896a tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:10.668327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7867895d-05cc-49b6-a06f-76e28826896a tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:10.669459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-37ab5f03-1c0e-433c-87c7-67a70e9e8323 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:10.677627 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-37ab5f03-1c0e-433c-87c7-67a70e9e8323 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/2062698072/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012615 Sep 08 12:41:10.686298 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 482/974] 10.222.0.78 () {58 vars in 1203 bytes} [Thu Sep 8 12:41:10 2022] GET /compute/v2.1/flavors/2062698072/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 12:41:10.696686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da51c977-a14f-42c7-9561-74048266b1a8 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:10.723201 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-da51c977-a14f-42c7-9561-74048266b1a8 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/2062698072" status: 202 len: 0 microversion: 2.1 time: 0.029947 Sep 08 12:41:10.724235 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 483/975] 10.222.0.78 () {58 vars in 1161 bytes} [Thu Sep 8 12:41:10 2022] DELETE /compute/v2.1/flavors/2062698072 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:41:10.730606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-39a76858-571c-4115-bd61-c4bf1e92572a tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:10.731281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-39a76858-571c-4115-bd61-c4bf1e92572a tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:10.740513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39a76858-571c-4115-bd61-c4bf1e92572a tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:10.741924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39a76858-571c-4115-bd61-c4bf1e92572a tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:10.742585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39a76858-571c-4115-bd61-c4bf1e92572a tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:10.743446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39a76858-571c-4115-bd61-c4bf1e92572a tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:10.744177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39a76858-571c-4115-bd61-c4bf1e92572a tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:10.744795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39a76858-571c-4115-bd61-c4bf1e92572a tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:10.772867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7867895d-05cc-49b6-a06f-76e28826896a tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:10.782890 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7867895d-05cc-49b6-a06f-76e28826896a tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1213 microversion: 2.1 time: 0.137022 Sep 08 12:41:10.783809 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 493/976] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:10 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1213 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:10.788533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f3899d92-cf38-48a7-834f-c8c5474218a4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:10.789156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f3899d92-cf38-48a7-834f-c8c5474218a4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:10.796358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3899d92-cf38-48a7-834f-c8c5474218a4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:10.797058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3899d92-cf38-48a7-834f-c8c5474218a4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:10.797603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3899d92-cf38-48a7-834f-c8c5474218a4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:10.798409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3899d92-cf38-48a7-834f-c8c5474218a4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:10.799095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3899d92-cf38-48a7-834f-c8c5474218a4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:10.799641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3899d92-cf38-48a7-834f-c8c5474218a4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:11.094394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-39a76858-571c-4115-bd61-c4bf1e92572a tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:11.103568 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-39a76858-571c-4115-bd61-c4bf1e92572a tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1402 microversion: 2.1 time: 0.377645 Sep 08 12:41:11.108169 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 484/977] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:10 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1402 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:11.115111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9a6eefa6-1bd3-4851-84e9-8c0340035536 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:11.161407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f3899d92-cf38-48a7-834f-c8c5474218a4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:11.163038 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9a6eefa6-1bd3-4851-84e9-8c0340035536 tempest-FlavorsExtraSpecsTestJSON-917566651 tempest-FlavorsExtraSpecsTestJSON-917566651-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.053684 Sep 08 12:41:11.168875 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 485/978] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:41:11 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:11.183564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-8f303ef0-8d61-44a7-b807-ffe0a1fb7186 req-66488db3-4466-487d-86a8-2444db903ae0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d483e1-ee86-4c2f-ae5a-d14ad8686dea", "name": "network-vif-plugged", "status": "completed", "tag": "7c4cd857-97b7-4ae8-994c-544ea60d027c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:11.192328 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f3899d92-cf38-48a7-834f-c8c5474218a4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1528 microversion: 2.1 time: 0.407312 Sep 08 12:41:11.193196 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 494/979] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:10 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1528 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:11.198581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2741cd44-3f36-408b-b0e8-f14451e58c29 req-fa3fe50d-16b4-4e1f-8e53-76a2d3364a1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60526de3-67cc-4bf8-911d-590f531d0130", "tag": "fbd4d925-0ef2-4240-a577-779541fca496"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:11.226990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2741cd44-3f36-408b-b0e8-f14451e58c29 req-fa3fe50d-16b4-4e1f-8e53-76a2d3364a1a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:11.227503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2741cd44-3f36-408b-b0e8-f14451e58c29 req-fa3fe50d-16b4-4e1f-8e53-76a2d3364a1a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:11.227937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2741cd44-3f36-408b-b0e8-f14451e58c29 req-fa3fe50d-16b4-4e1f-8e53-76a2d3364a1a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:11.230774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8f303ef0-8d61-44a7-b807-ffe0a1fb7186 req-66488db3-4466-487d-86a8-2444db903ae0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:11.231602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8f303ef0-8d61-44a7-b807-ffe0a1fb7186 req-66488db3-4466-487d-86a8-2444db903ae0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:11.232050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8f303ef0-8d61-44a7-b807-ffe0a1fb7186 req-66488db3-4466-487d-86a8-2444db903ae0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:11.253356 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-8f303ef0-8d61-44a7-b807-ffe0a1fb7186 req-66488db3-4466-487d-86a8-2444db903ae0 service nova] Creating event network-vif-plugged:7c4cd857-97b7-4ae8-994c-544ea60d027c for instance 62d483e1-ee86-4c2f-ae5a-d14ad8686dea on n-h2-852084-10 Sep 08 12:41:11.257037 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2741cd44-3f36-408b-b0e8-f14451e58c29 req-fa3fe50d-16b4-4e1f-8e53-76a2d3364a1a service nova] Creating event network-changed:fbd4d925-0ef2-4240-a577-779541fca496 for instance 60526de3-67cc-4bf8-911d-590f531d0130 on n-h1-852084-10 Sep 08 12:41:11.260250 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-8f303ef0-8d61-44a7-b807-ffe0a1fb7186 req-66488db3-4466-487d-86a8-2444db903ae0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089629 Sep 08 12:41:11.260962 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 486/980] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:11.266185 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2741cd44-3f36-408b-b0e8-f14451e58c29 req-fa3fe50d-16b4-4e1f-8e53-76a2d3364a1a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071459 Sep 08 12:41:11.268904 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 495/981] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:11.269376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00c0d2fd-7224-4524-9116-5889da578e60 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:11.270522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00c0d2fd-7224-4524-9116-5889da578e60 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:11.286268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-41628434-a1bd-466b-a850-afb3c65a13c4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:11.287019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-41628434-a1bd-466b-a850-afb3c65a13c4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:11.298182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00c0d2fd-7224-4524-9116-5889da578e60 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:11.298950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00c0d2fd-7224-4524-9116-5889da578e60 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:11.299727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00c0d2fd-7224-4524-9116-5889da578e60 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:11.300337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41628434-a1bd-466b-a850-afb3c65a13c4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:11.301316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00c0d2fd-7224-4524-9116-5889da578e60 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:11.301968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00c0d2fd-7224-4524-9116-5889da578e60 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:11.302587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00c0d2fd-7224-4524-9116-5889da578e60 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:11.305439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41628434-a1bd-466b-a850-afb3c65a13c4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:11.305897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41628434-a1bd-466b-a850-afb3c65a13c4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:11.306645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41628434-a1bd-466b-a850-afb3c65a13c4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:11.311456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41628434-a1bd-466b-a850-afb3c65a13c4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:11.313904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41628434-a1bd-466b-a850-afb3c65a13c4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:11.331352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:11.612987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-41628434-a1bd-466b-a850-afb3c65a13c4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:11.627060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-41628434-a1bd-466b-a850-afb3c65a13c4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:11.637140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-41628434-a1bd-466b-a850-afb3c65a13c4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:11.643136 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-41628434-a1bd-466b-a850-afb3c65a13c4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.364528 Sep 08 12:41:11.644059 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 496/982] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:11 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:11.662589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cb5f500c-8ad1-4aa5-9d4e-0221787528b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:11.671038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cb5f500c-8ad1-4aa5-9d4e-0221787528b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:11.693003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5f500c-8ad1-4aa5-9d4e-0221787528b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:11.695386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5f500c-8ad1-4aa5-9d4e-0221787528b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:11.696497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5f500c-8ad1-4aa5-9d4e-0221787528b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:11.697515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5f500c-8ad1-4aa5-9d4e-0221787528b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:11.698884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5f500c-8ad1-4aa5-9d4e-0221787528b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:11.699879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5f500c-8ad1-4aa5-9d4e-0221787528b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:12.050604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00c0d2fd-7224-4524-9116-5889da578e60 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:12.061883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00c0d2fd-7224-4524-9116-5889da578e60 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:12.063441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00c0d2fd-7224-4524-9116-5889da578e60 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:12.064563 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00c0d2fd-7224-4524-9116-5889da578e60 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1567 microversion: 2.25 time: 0.801948 Sep 08 12:41:12.080678 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 487/983] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:11 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1567 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:12.080678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-10ab507f-5b13-4b70-b061-a768357cfeab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:12.080678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-10ab507f-5b13-4b70-b061-a768357cfeab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:12.080678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10ab507f-5b13-4b70-b061-a768357cfeab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:12.080678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10ab507f-5b13-4b70-b061-a768357cfeab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:12.081221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10ab507f-5b13-4b70-b061-a768357cfeab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:12.081221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10ab507f-5b13-4b70-b061-a768357cfeab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:12.081221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10ab507f-5b13-4b70-b061-a768357cfeab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:12.081645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10ab507f-5b13-4b70-b061-a768357cfeab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:12.498333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cb5f500c-8ad1-4aa5-9d4e-0221787528b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:12.513077 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cb5f500c-8ad1-4aa5-9d4e-0221787528b1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1528 microversion: 2.1 time: 0.867743 Sep 08 12:41:12.521184 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 497/984] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:11 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1528 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:12.534944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8072adad-0be2-4dad-9f67-8f8e472b7ebc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:12.538766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8072adad-0be2-4dad-9f67-8f8e472b7ebc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: d348606f-4433-463c-b587-79f3f2e1fec1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:12.555900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8072adad-0be2-4dad-9f67-8f8e472b7ebc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:12.556877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8072adad-0be2-4dad-9f67-8f8e472b7ebc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:12.559462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8072adad-0be2-4dad-9f67-8f8e472b7ebc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:12.563716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8072adad-0be2-4dad-9f67-8f8e472b7ebc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:12.564786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8072adad-0be2-4dad-9f67-8f8e472b7ebc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:12.565682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8072adad-0be2-4dad-9f67-8f8e472b7ebc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:12.729444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8072adad-0be2-4dad-9f67-8f8e472b7ebc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:12.735543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:12.757401 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8072adad-0be2-4dad-9f67-8f8e472b7ebc tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1" status: 200 len: 1433 microversion: 2.1 time: 0.233385 Sep 08 12:41:12.758704 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 498/985] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:12 2022] GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1 => generated 1433 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:12.767980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e0a25671-b8a9-43ab-b893-9de5e6fc4d09 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:12.769825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e0a25671-b8a9-43ab-b893-9de5e6fc4d09 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:12.784991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0a25671-b8a9-43ab-b893-9de5e6fc4d09 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:12.786634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0a25671-b8a9-43ab-b893-9de5e6fc4d09 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:12.787459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0a25671-b8a9-43ab-b893-9de5e6fc4d09 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:12.798579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0a25671-b8a9-43ab-b893-9de5e6fc4d09 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:12.808891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0a25671-b8a9-43ab-b893-9de5e6fc4d09 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:12.817270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0a25671-b8a9-43ab-b893-9de5e6fc4d09 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:12.951212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-10ab507f-5b13-4b70-b061-a768357cfeab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:12.963736 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-10ab507f-5b13-4b70-b061-a768357cfeab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1359 microversion: 2.1 time: 0.896973 Sep 08 12:41:12.965890 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 488/986] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:12 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1359 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:12.985682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-05c0cd2e-1531-418c-806f-230334b779c9 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:12.987213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-05c0cd2e-1531-418c-806f-230334b779c9 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:12.998379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-05c0cd2e-1531-418c-806f-230334b779c9 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:12.999506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-05c0cd2e-1531-418c-806f-230334b779c9 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:13.000536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-05c0cd2e-1531-418c-806f-230334b779c9 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:13.001585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-05c0cd2e-1531-418c-806f-230334b779c9 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:13.002288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-05c0cd2e-1531-418c-806f-230334b779c9 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:13.002981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-05c0cd2e-1531-418c-806f-230334b779c9 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:13.036901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e0a25671-b8a9-43ab-b893-9de5e6fc4d09 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:13.048367 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e0a25671-b8a9-43ab-b893-9de5e6fc4d09 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1277 microversion: 2.1 time: 0.288106 Sep 08 12:41:13.049269 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 499/987] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:12 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1277 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:13.079788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-17dab881-6f7f-411c-a718-ad894b3b28a3 req-0007e981-22b2-42dc-88c4-38ee8c281133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d348606f-4433-463c-b587-79f3f2e1fec1", "name": "network-vif-deleted", "tag": "c1ad86c3-77fd-45a8-95f2-dbd5b219161a"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:13.096409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-17dab881-6f7f-411c-a718-ad894b3b28a3 req-0007e981-22b2-42dc-88c4-38ee8c281133 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:13.096887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-17dab881-6f7f-411c-a718-ad894b3b28a3 req-0007e981-22b2-42dc-88c4-38ee8c281133 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:13.097316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-17dab881-6f7f-411c-a718-ad894b3b28a3 req-0007e981-22b2-42dc-88c4-38ee8c281133 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:13.109874 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-17dab881-6f7f-411c-a718-ad894b3b28a3 req-0007e981-22b2-42dc-88c4-38ee8c281133 service nova] Creating event network-vif-deleted:c1ad86c3-77fd-45a8-95f2-dbd5b219161a for instance d348606f-4433-463c-b587-79f3f2e1fec1 on n-h1-852084-10 Sep 08 12:41:13.114980 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-17dab881-6f7f-411c-a718-ad894b3b28a3 req-0007e981-22b2-42dc-88c4-38ee8c281133 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064235 Sep 08 12:41:13.116091 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 500/988] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:13.121378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7b29ea53-2ad7-4447-9559-72c9d15dc10c tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:13.145738 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7b29ea53-2ad7-4447-9559-72c9d15dc10c tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/f361ff80-9c37-43f7-a9c8-9546c09dd3c5" status: 202 len: 0 microversion: 2.1 time: 0.027843 Sep 08 12:41:13.146835 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 501/989] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:41:13 2022] DELETE /compute/v2.1/flavors/f361ff80-9c37-43f7-a9c8-9546c09dd3c5 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:41:13.155657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bdb1a542-e0df-40bd-bb8e-f387247f28d3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:13.156797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bdb1a542-e0df-40bd-bb8e-f387247f28d3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:13.164247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bdb1a542-e0df-40bd-bb8e-f387247f28d3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:13.165032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bdb1a542-e0df-40bd-bb8e-f387247f28d3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:13.165719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bdb1a542-e0df-40bd-bb8e-f387247f28d3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:13.166699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bdb1a542-e0df-40bd-bb8e-f387247f28d3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:13.167840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bdb1a542-e0df-40bd-bb8e-f387247f28d3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:13.168122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bdb1a542-e0df-40bd-bb8e-f387247f28d3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:13.366213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bdb1a542-e0df-40bd-bb8e-f387247f28d3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:13.379371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bdb1a542-e0df-40bd-bb8e-f387247f28d3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:13.382298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bdb1a542-e0df-40bd-bb8e-f387247f28d3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:13.389951 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bdb1a542-e0df-40bd-bb8e-f387247f28d3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.241654 Sep 08 12:41:13.391023 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 502/990] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:13 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:13.398391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9660be90-6004-4cd3-a19f-e66c60889b49 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:13.399211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9660be90-6004-4cd3-a19f-e66c60889b49 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:13.408978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9660be90-6004-4cd3-a19f-e66c60889b49 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:13.409655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9660be90-6004-4cd3-a19f-e66c60889b49 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:13.410196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9660be90-6004-4cd3-a19f-e66c60889b49 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:13.411027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9660be90-6004-4cd3-a19f-e66c60889b49 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:13.411632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9660be90-6004-4cd3-a19f-e66c60889b49 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:13.413206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9660be90-6004-4cd3-a19f-e66c60889b49 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:13.693151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-05c0cd2e-1531-418c-806f-230334b779c9 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:13.706772 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-05c0cd2e-1531-418c-806f-230334b779c9 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1402 microversion: 2.1 time: 0.726592 Sep 08 12:41:13.724945 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 489/991] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:12 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1402 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:13.741495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-09131d3c-5684-4d42-9b01-010f426f8c24 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:13.784427 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-09131d3c-5684-4d42-9b01-010f426f8c24 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057122 Sep 08 12:41:13.800708 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 490/992] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:41:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:13.811802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d52dba54-cd51-4c79-818f-4637cd5305cf req-0818318a-3cf8-4e33-a68c-2a739b837f29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b350654b-8f8e-4077-b819-3f97ab94143c", "tag": "a40a204f-c921-4204-b9ec-b06d79e63487"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:13.849410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d52dba54-cd51-4c79-818f-4637cd5305cf req-0818318a-3cf8-4e33-a68c-2a739b837f29 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:13.852849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d52dba54-cd51-4c79-818f-4637cd5305cf req-0818318a-3cf8-4e33-a68c-2a739b837f29 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:13.853302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d52dba54-cd51-4c79-818f-4637cd5305cf req-0818318a-3cf8-4e33-a68c-2a739b837f29 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:13.874581 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d52dba54-cd51-4c79-818f-4637cd5305cf req-0818318a-3cf8-4e33-a68c-2a739b837f29 service nova] Creating event network-changed:a40a204f-c921-4204-b9ec-b06d79e63487 for instance b350654b-8f8e-4077-b819-3f97ab94143c on n-h2-852084-10 Sep 08 12:41:13.883992 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d52dba54-cd51-4c79-818f-4637cd5305cf req-0818318a-3cf8-4e33-a68c-2a739b837f29 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081388 Sep 08 12:41:13.884971 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 491/993] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:13.893313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:13.895734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: d348606f-4433-463c-b587-79f3f2e1fec1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:13.922428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:13.934212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:13.934791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:13.938424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:13.938894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:13.943070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:14.043856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:14.044724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:14.046507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:14.047880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lazy-loading 'fault' on Instance uuid d348606f-4433-463c-b587-79f3f2e1fec1 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:41:14.168172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:14.189584 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-94496f65-8ded-45d4-9d06-7d4b4618c293 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1" status: 200 len: 1309 microversion: 2.1 time: 0.302454 Sep 08 12:41:14.204903 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 492/994] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:13 2022] GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1 => generated 1309 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:14.217527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:14.220289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:14.227389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:14.227982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:14.228490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:14.231357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:14.231910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:14.234440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:14.298035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9660be90-6004-4cd3-a19f-e66c60889b49 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:14.312695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9660be90-6004-4cd3-a19f-e66c60889b49 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:14.317163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9660be90-6004-4cd3-a19f-e66c60889b49 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:14.321828 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9660be90-6004-4cd3-a19f-e66c60889b49 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1567 microversion: 2.25 time: 0.928571 Sep 08 12:41:14.335281 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 503/995] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:13 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1567 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:14.345911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2e7fc9ad-e903-474d-b16b-6d3fadaf38fb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:14.347092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2e7fc9ad-e903-474d-b16b-6d3fadaf38fb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:14.363934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e7fc9ad-e903-474d-b16b-6d3fadaf38fb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:14.364424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e7fc9ad-e903-474d-b16b-6d3fadaf38fb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:14.364856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e7fc9ad-e903-474d-b16b-6d3fadaf38fb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:14.365555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e7fc9ad-e903-474d-b16b-6d3fadaf38fb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:14.365999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e7fc9ad-e903-474d-b16b-6d3fadaf38fb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:14.366655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e7fc9ad-e903-474d-b16b-6d3fadaf38fb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:14.374975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:14.385441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Old instance type tempest-test_resize_flavor_-1233071314, new instance type m1.heat {{(pid=128970) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 12:41:14.407598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:41:14.408113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:41:14.408696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:41:14.409237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:41:14.409893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:41:14.581408 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9bb1a2d8-aa8c-4c28-829d-6992817fd426 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "POST /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77/action" status: 202 len: 0 microversion: 2.1 time: 0.371030 Sep 08 12:41:14.583172 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 493/996] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:41:14 2022] POST /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:41:14.594105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fbc041f3-ec35-42eb-a517-1655739de834 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:14.595873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fbc041f3-ec35-42eb-a517-1655739de834 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:14.610380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbc041f3-ec35-42eb-a517-1655739de834 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:14.611762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbc041f3-ec35-42eb-a517-1655739de834 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:14.612927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbc041f3-ec35-42eb-a517-1655739de834 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:14.616664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbc041f3-ec35-42eb-a517-1655739de834 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:14.618068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbc041f3-ec35-42eb-a517-1655739de834 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:14.619352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbc041f3-ec35-42eb-a517-1655739de834 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:14.673191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2e7fc9ad-e903-474d-b16b-6d3fadaf38fb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:14.682216 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2e7fc9ad-e903-474d-b16b-6d3fadaf38fb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1359 microversion: 2.1 time: 0.350021 Sep 08 12:41:14.682878 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 504/997] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:14 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1359 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:14.699798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3af68bff-0dc8-4dca-a5bd-611cb2b36f32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:14.713199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3af68bff-0dc8-4dca-a5bd-611cb2b36f32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:14.753917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3af68bff-0dc8-4dca-a5bd-611cb2b36f32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:14.755048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3af68bff-0dc8-4dca-a5bd-611cb2b36f32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:14.756239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3af68bff-0dc8-4dca-a5bd-611cb2b36f32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:14.758039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3af68bff-0dc8-4dca-a5bd-611cb2b36f32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:14.759389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3af68bff-0dc8-4dca-a5bd-611cb2b36f32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:14.760719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3af68bff-0dc8-4dca-a5bd-611cb2b36f32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:14.969292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fbc041f3-ec35-42eb-a517-1655739de834 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:14.993283 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fbc041f3-ec35-42eb-a517-1655739de834 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1317 microversion: 2.1 time: 0.407594 Sep 08 12:41:14.999446 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 494/998] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:14 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1317 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:15.023327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ea7cb634-6665-48cf-a19f-589b75c80299 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:15.026670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ea7cb634-6665-48cf-a19f-589b75c80299 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:15.035200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3af68bff-0dc8-4dca-a5bd-611cb2b36f32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:15.051388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3af68bff-0dc8-4dca-a5bd-611cb2b36f32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:15.052465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea7cb634-6665-48cf-a19f-589b75c80299 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:15.053661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3af68bff-0dc8-4dca-a5bd-611cb2b36f32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:15.058651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea7cb634-6665-48cf-a19f-589b75c80299 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:15.060109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea7cb634-6665-48cf-a19f-589b75c80299 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:15.062050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea7cb634-6665-48cf-a19f-589b75c80299 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:15.063595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea7cb634-6665-48cf-a19f-589b75c80299 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:15.064521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea7cb634-6665-48cf-a19f-589b75c80299 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:15.067769 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3af68bff-0dc8-4dca-a5bd-611cb2b36f32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.370929 Sep 08 12:41:15.069443 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 505/999] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:14 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:15.092684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4e545df5-150e-4f08-aa66-f57bfd62b3f0 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:15.098211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4e545df5-150e-4f08-aa66-f57bfd62b3f0 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:15.134201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e545df5-150e-4f08-aa66-f57bfd62b3f0 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:15.136489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e545df5-150e-4f08-aa66-f57bfd62b3f0 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:15.144570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e545df5-150e-4f08-aa66-f57bfd62b3f0 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:15.148137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e545df5-150e-4f08-aa66-f57bfd62b3f0 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:15.150563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e545df5-150e-4f08-aa66-f57bfd62b3f0 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:15.151619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e545df5-150e-4f08-aa66-f57bfd62b3f0 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:15.863727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ea7cb634-6665-48cf-a19f-589b75c80299 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:15.919914 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ea7cb634-6665-48cf-a19f-589b75c80299 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1537 microversion: 2.1 time: 0.915419 Sep 08 12:41:15.938745 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 495/1000] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:14 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1537 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:15.957303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4e545df5-150e-4f08-aa66-f57bfd62b3f0 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:15.974602 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4e545df5-150e-4f08-aa66-f57bfd62b3f0 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1402 microversion: 2.1 time: 0.902131 Sep 08 12:41:15.974940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a4a79a34-3aac-4e36-a79f-b869b3be028f req-e7ecdae3-1f06-4061-bff4-d98d2cfdb981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8f483b-fdbc-4f92-abfc-28462d1441fc", "name": "network-vif-deleted", "tag": "7cc8a47e-aa65-487a-a02a-c5e2e89d3886"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:15.978237 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 506/1001] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:15 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1402 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:16.013890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:16.017626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: d348606f-4433-463c-b587-79f3f2e1fec1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:16.032076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a4a79a34-3aac-4e36-a79f-b869b3be028f req-e7ecdae3-1f06-4061-bff4-d98d2cfdb981 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:16.032692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a4a79a34-3aac-4e36-a79f-b869b3be028f req-e7ecdae3-1f06-4061-bff4-d98d2cfdb981 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:16.033128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a4a79a34-3aac-4e36-a79f-b869b3be028f req-e7ecdae3-1f06-4061-bff4-d98d2cfdb981 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:16.043167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:16.045820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:16.046501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:16.049119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:16.051475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:16.052392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:16.076493 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a4a79a34-3aac-4e36-a79f-b869b3be028f req-e7ecdae3-1f06-4061-bff4-d98d2cfdb981 service nova] Creating event network-vif-deleted:7cc8a47e-aa65-487a-a02a-c5e2e89d3886 for instance 2e8f483b-fdbc-4f92-abfc-28462d1441fc on n-h1-852084-10 Sep 08 12:41:16.096952 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a4a79a34-3aac-4e36-a79f-b869b3be028f req-e7ecdae3-1f06-4061-bff4-d98d2cfdb981 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153818 Sep 08 12:41:16.098300 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 496/1002] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:16.117077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ba5a50f-8d8f-4a58-91d8-447c643a1357 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:16.118303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6ba5a50f-8d8f-4a58-91d8-447c643a1357 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:16.140468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ba5a50f-8d8f-4a58-91d8-447c643a1357 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:16.141738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ba5a50f-8d8f-4a58-91d8-447c643a1357 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:16.142800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ba5a50f-8d8f-4a58-91d8-447c643a1357 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:16.144331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ba5a50f-8d8f-4a58-91d8-447c643a1357 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:16.145495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ba5a50f-8d8f-4a58-91d8-447c643a1357 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:16.146602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:16.146989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ba5a50f-8d8f-4a58-91d8-447c643a1357 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:16.147947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:16.148459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:16.149003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lazy-loading 'fault' on Instance uuid d348606f-4433-463c-b587-79f3f2e1fec1 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:41:16.295770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:16.307131 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cecc9d1f-5810-4e77-a5f7-b5cd5a496646 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1" status: 200 len: 1309 microversion: 2.1 time: 0.326091 Sep 08 12:41:16.320893 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 507/1003] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:15 2022] GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1 => generated 1309 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:16.332804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5472fc29-a8be-454e-85fe-81a7c05af881 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:16.334181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5472fc29-a8be-454e-85fe-81a7c05af881 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:16.347807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5472fc29-a8be-454e-85fe-81a7c05af881 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:16.349131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5472fc29-a8be-454e-85fe-81a7c05af881 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:16.350252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5472fc29-a8be-454e-85fe-81a7c05af881 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:16.352735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5472fc29-a8be-454e-85fe-81a7c05af881 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:16.354376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5472fc29-a8be-454e-85fe-81a7c05af881 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:16.356199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5472fc29-a8be-454e-85fe-81a7c05af881 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:16.844789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:17.037436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6ba5a50f-8d8f-4a58-91d8-447c643a1357 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:17.087656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6ba5a50f-8d8f-4a58-91d8-447c643a1357 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:17.097435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6ba5a50f-8d8f-4a58-91d8-447c643a1357 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:17.100808 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6ba5a50f-8d8f-4a58-91d8-447c643a1357 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1567 microversion: 2.25 time: 0.996763 Sep 08 12:41:17.103455 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 497/1004] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:16 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1567 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:17.121531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3c0572bc-76fb-4fd6-af9c-c04fed0eb3c6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:17.125435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3c0572bc-76fb-4fd6-af9c-c04fed0eb3c6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:17.165939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c0572bc-76fb-4fd6-af9c-c04fed0eb3c6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:17.166884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c0572bc-76fb-4fd6-af9c-c04fed0eb3c6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:17.168271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c0572bc-76fb-4fd6-af9c-c04fed0eb3c6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:17.169612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c0572bc-76fb-4fd6-af9c-c04fed0eb3c6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:17.172022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c0572bc-76fb-4fd6-af9c-c04fed0eb3c6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:17.173039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c0572bc-76fb-4fd6-af9c-c04fed0eb3c6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:17.331529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5472fc29-a8be-454e-85fe-81a7c05af881 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:17.342622 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5472fc29-a8be-454e-85fe-81a7c05af881 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1541 microversion: 2.1 time: 1.019713 Sep 08 12:41:17.352394 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 508/1005] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:16 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1541 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:17.366639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0f10624-f65e-4bbb-be1e-475330cbdae5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:17.369416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0f10624-f65e-4bbb-be1e-475330cbdae5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:17.383700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=18 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:17.430922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0f10624-f65e-4bbb-be1e-475330cbdae5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:17.435716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0f10624-f65e-4bbb-be1e-475330cbdae5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:17.438019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0f10624-f65e-4bbb-be1e-475330cbdae5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:17.442724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0f10624-f65e-4bbb-be1e-475330cbdae5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:17.447018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0f10624-f65e-4bbb-be1e-475330cbdae5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:17.450157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0f10624-f65e-4bbb-be1e-475330cbdae5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:17.842328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0f10624-f65e-4bbb-be1e-475330cbdae5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:17.874741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0f10624-f65e-4bbb-be1e-475330cbdae5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:17.878084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0f10624-f65e-4bbb-be1e-475330cbdae5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:17.901837 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0f10624-f65e-4bbb-be1e-475330cbdae5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.547389 Sep 08 12:41:17.923556 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 509/1006] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:17 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:17.935884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-61baf659-712d-46a0-ab0a-8e06a79bf0cb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:17.936200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-61baf659-712d-46a0-ab0a-8e06a79bf0cb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:17.952895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61baf659-712d-46a0-ab0a-8e06a79bf0cb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:17.954122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61baf659-712d-46a0-ab0a-8e06a79bf0cb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:17.954900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61baf659-712d-46a0-ab0a-8e06a79bf0cb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:17.956482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61baf659-712d-46a0-ab0a-8e06a79bf0cb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:17.964832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61baf659-712d-46a0-ab0a-8e06a79bf0cb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:17.964832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61baf659-712d-46a0-ab0a-8e06a79bf0cb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.025811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3c0572bc-76fb-4fd6-af9c-c04fed0eb3c6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:18.042512 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3c0572bc-76fb-4fd6-af9c-c04fed0eb3c6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1317 microversion: 2.1 time: 0.933939 Sep 08 12:41:18.043518 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 498/1007] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:17 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1317 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:18.056608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd5c531c-1906-4499-b025-6a3fa7100caf tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:18.057237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dd5c531c-1906-4499-b025-6a3fa7100caf tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:18.075194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd5c531c-1906-4499-b025-6a3fa7100caf tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.075607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd5c531c-1906-4499-b025-6a3fa7100caf tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.076253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd5c531c-1906-4499-b025-6a3fa7100caf tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.077151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd5c531c-1906-4499-b025-6a3fa7100caf tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.077777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd5c531c-1906-4499-b025-6a3fa7100caf tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.078365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd5c531c-1906-4499-b025-6a3fa7100caf tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.369281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-61baf659-712d-46a0-ab0a-8e06a79bf0cb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:18.392734 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-61baf659-712d-46a0-ab0a-8e06a79bf0cb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1537 microversion: 2.1 time: 0.470500 Sep 08 12:41:18.394767 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 510/1008] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:17 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1537 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:18.419804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc4df4d7-e231-423a-92f3-38d0d8255e1c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:18.421850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cc4df4d7-e231-423a-92f3-38d0d8255e1c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: d348606f-4433-463c-b587-79f3f2e1fec1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:18.448021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc4df4d7-e231-423a-92f3-38d0d8255e1c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.450341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc4df4d7-e231-423a-92f3-38d0d8255e1c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.453173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc4df4d7-e231-423a-92f3-38d0d8255e1c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.455713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc4df4d7-e231-423a-92f3-38d0d8255e1c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.457031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc4df4d7-e231-423a-92f3-38d0d8255e1c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.458122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc4df4d7-e231-423a-92f3-38d0d8255e1c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.476286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dd5c531c-1906-4499-b025-6a3fa7100caf tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:18.499731 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-cc4df4d7-e231-423a-92f3-38d0d8255e1c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] HTTP exception thrown: Instance d348606f-4433-463c-b587-79f3f2e1fec1 could not be found. Sep 08 12:41:18.503516 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dd5c531c-1906-4499-b025-6a3fa7100caf tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1402 microversion: 2.1 time: 0.459093 Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc4df4d7-e231-423a-92f3-38d0d8255e1c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Request method failure captured: Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1 HTTP/1.1 Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIw6pvhdO4zXhGJCeJ68kJVlsg90ZbSv8TA1izVc9P8bD4Mdu4KXagKTNz1oO93ELXFA4g_EqPdtm7gyry5N4K7tu7lRJSgVuw6GQPzVgbC4uAAvWiLPrDcsyxqGiNNxf4BjA9XsBe47roVYCmKPUnjbtRu99GiZHdc1lNwkgijj3o Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:41:18.505285 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:41:18.508033 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:41:18.508033 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:18.508033 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:41:18.508033 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:18.508033 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:41:18.508033 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:41:18.508033 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:41:18.508033 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 7d8ffdbbf2de43b9b4efc89b7fcd4897 Sep 08 12:41:18.508033 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:41:18.508033 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:41:18.508033 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance d348606f-4433-463c-b587-79f3f2e1fec1 could not be found. Sep 08 12:41:18.508033 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'd348606f-4433-463c-b587-79f3f2e1fec1'} Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d348606f-4433-463c-b587-79f3f2e1fec1 could not be found. Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:41:18.509505 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d348606f-4433-463c-b587-79f3f2e1fec1 could not be found. Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d348606f-4433-463c-b587-79f3f2e1fec1 could not be found. Sep 08 12:41:18.517517 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:18.523904 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 499/1009] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:18 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1402 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:18.531366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d91839d2-4a26-4d83-aa83-5e866baa5536 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:18.534237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc4df4d7-e231-423a-92f3-38d0d8255e1c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Returning 404 to user: Instance d348606f-4433-463c-b587-79f3f2e1fec1 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:41:18.539412 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cc4df4d7-e231-423a-92f3-38d0d8255e1c tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1" status: 404 len: 111 microversion: 2.1 time: 0.141343 Sep 08 12:41:18.540719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d91839d2-4a26-4d83-aa83-5e866baa5536 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:18.544659 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 511/1010] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:18 2022] GET /compute/v2.1/servers/d348606f-4433-463c-b587-79f3f2e1fec1 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:41:18.555285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d91839d2-4a26-4d83-aa83-5e866baa5536 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.555976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d91839d2-4a26-4d83-aa83-5e866baa5536 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.556499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d91839d2-4a26-4d83-aa83-5e866baa5536 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.557402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d91839d2-4a26-4d83-aa83-5e866baa5536 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.562001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d91839d2-4a26-4d83-aa83-5e866baa5536 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.562001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d91839d2-4a26-4d83-aa83-5e866baa5536 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.589495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e5975b12-37d3-4d96-9152-eddfb652500a req-4a904f28-96a2-45fa-8333-ed4d67081610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5582b0f-06e1-4423-9a14-ed3d2d1668f5", "tag": "a9e22ed5-d751-4fb9-bb65-3ccccd7b5e8c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:18.609610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e5975b12-37d3-4d96-9152-eddfb652500a req-4a904f28-96a2-45fa-8333-ed4d67081610 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.610288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e5975b12-37d3-4d96-9152-eddfb652500a req-4a904f28-96a2-45fa-8333-ed4d67081610 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.610728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e5975b12-37d3-4d96-9152-eddfb652500a req-4a904f28-96a2-45fa-8333-ed4d67081610 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.659272 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e5975b12-37d3-4d96-9152-eddfb652500a req-4a904f28-96a2-45fa-8333-ed4d67081610 service nova] Creating event network-changed:a9e22ed5-d751-4fb9-bb65-3ccccd7b5e8c for instance b5582b0f-06e1-4423-9a14-ed3d2d1668f5 on n-h1-852084-10 Sep 08 12:41:18.667428 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e5975b12-37d3-4d96-9152-eddfb652500a req-4a904f28-96a2-45fa-8333-ed4d67081610 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119459 Sep 08 12:41:18.668086 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 512/1011] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:18.689661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cdbac109-8b43-47ac-9858-338809309c9d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:18.690376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cdbac109-8b43-47ac-9858-338809309c9d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:18.699823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdbac109-8b43-47ac-9858-338809309c9d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.700586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdbac109-8b43-47ac-9858-338809309c9d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.701362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdbac109-8b43-47ac-9858-338809309c9d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.702337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdbac109-8b43-47ac-9858-338809309c9d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.703081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdbac109-8b43-47ac-9858-338809309c9d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.703888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdbac109-8b43-47ac-9858-338809309c9d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.743805 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d91839d2-4a26-4d83-aa83-5e866baa5536 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.235795 Sep 08 12:41:18.749521 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 500/1012] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 12:41:18 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-interface => generated 284 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:18.763674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0f5a2d81-b7cb-4809-9500-ced7a5dec68b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:18.764312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0f5a2d81-b7cb-4809-9500-ced7a5dec68b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 2e8f483b-fdbc-4f92-abfc-28462d1441fc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:18.781190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f5a2d81-b7cb-4809-9500-ced7a5dec68b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.783025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f5a2d81-b7cb-4809-9500-ced7a5dec68b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.783766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f5a2d81-b7cb-4809-9500-ced7a5dec68b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.784854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f5a2d81-b7cb-4809-9500-ced7a5dec68b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.785509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f5a2d81-b7cb-4809-9500-ced7a5dec68b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.786559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f5a2d81-b7cb-4809-9500-ced7a5dec68b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.802660 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-0f5a2d81-b7cb-4809-9500-ced7a5dec68b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] HTTP exception thrown: Instance 2e8f483b-fdbc-4f92-abfc-28462d1441fc could not be found. Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0f5a2d81-b7cb-4809-9500-ced7a5dec68b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Request method failure captured: Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc HTTP/1.1 Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIw6pvhdO4zXhGJCeJ68kJVlsg90ZbSv8TA1izVc9P8bD4Mdu4KXagKTNz1oO93ELXFA4g_EqPdtm7gyry5N4K7tu7lRJSgVuw6GQPzVgbC4uAAvWiLPrDcsyxqGiNNxf4BjA9XsBe47roVYCmKPUnjbtRu99GiZHdc1lNwkgijj3o Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:41:18.805226 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:41:18.806894 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:41:18.806894 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:18.806894 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:41:18.806894 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:18.806894 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:41:18.806894 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:41:18.806894 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:41:18.806894 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7d8ffdbbf2de43b9b4efc89b7fcd4897 Sep 08 12:41:18.806894 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:41:18.806894 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:41:18.806894 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 2e8f483b-fdbc-4f92-abfc-28462d1441fc could not be found. Sep 08 12:41:18.806894 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '2e8f483b-fdbc-4f92-abfc-28462d1441fc'} Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8f483b-fdbc-4f92-abfc-28462d1441fc could not be found. Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:41:18.808362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8f483b-fdbc-4f92-abfc-28462d1441fc could not be found. Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8f483b-fdbc-4f92-abfc-28462d1441fc could not be found. Sep 08 12:41:18.809738 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:18.813497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0f5a2d81-b7cb-4809-9500-ced7a5dec68b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Returning 404 to user: Instance 2e8f483b-fdbc-4f92-abfc-28462d1441fc could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:41:18.814866 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0f5a2d81-b7cb-4809-9500-ced7a5dec68b tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc" status: 404 len: 111 microversion: 2.1 time: 0.064054 Sep 08 12:41:18.821298 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 501/1013] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:18 2022] GET /compute/v2.1/servers/2e8f483b-fdbc-4f92-abfc-28462d1441fc => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:41:18.830897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-10b7b7a9-e632-4b25-9fba-e5b650a153e9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:18.884369 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-10b7b7a9-e632-4b25-9fba-e5b650a153e9 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/4bc5fef3-8020-4e3b-9c5f-f4d3053e177f" status: 204 len: 0 microversion: 2.1 time: 0.058643 Sep 08 12:41:18.889735 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 502/1014] 10.222.0.78 () {58 vars in 1266 bytes} [Thu Sep 8 12:41:18 2022] DELETE /compute/v2.1/os-server-groups/4bc5fef3-8020-4e3b-9c5f-f4d3053e177f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:41:18.903776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b4595771-37d7-4aaa-929c-f8438496aa1d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:18.905433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b4595771-37d7-4aaa-929c-f8438496aa1d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:18.924864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4595771-37d7-4aaa-929c-f8438496aa1d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.924864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4595771-37d7-4aaa-929c-f8438496aa1d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.924864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4595771-37d7-4aaa-929c-f8438496aa1d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:18.924864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4595771-37d7-4aaa-929c-f8438496aa1d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:18.925853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4595771-37d7-4aaa-929c-f8438496aa1d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:18.925853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4595771-37d7-4aaa-929c-f8438496aa1d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:19.033134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b4595771-37d7-4aaa-929c-f8438496aa1d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:41:19.275592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cdbac109-8b43-47ac-9858-338809309c9d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:19.322172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cdbac109-8b43-47ac-9858-338809309c9d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:19.323874 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b4595771-37d7-4aaa-929c-f8438496aa1d tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "DELETE /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 204 len: 0 microversion: 2.1 time: 0.429742 Sep 08 12:41:19.326000 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 503/1015] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:41:18 2022] DELETE /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:41:19.327691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cdbac109-8b43-47ac-9858-338809309c9d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:19.329492 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cdbac109-8b43-47ac-9858-338809309c9d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1567 microversion: 2.25 time: 0.655646 Sep 08 12:41:19.330472 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 513/1016] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:18 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1567 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:19.340653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f30b4ad1-e1fe-4fb3-9283-bb4bb2b3c864 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:19.341376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f30b4ad1-e1fe-4fb3-9283-bb4bb2b3c864 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:19.345538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-16834447-a7ce-4a00-be9f-1d237956cd4f tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:19.349189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-16834447-a7ce-4a00-be9f-1d237956cd4f tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:19.359354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16834447-a7ce-4a00-be9f-1d237956cd4f tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:19.360421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16834447-a7ce-4a00-be9f-1d237956cd4f tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:19.360543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f30b4ad1-e1fe-4fb3-9283-bb4bb2b3c864 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:19.361048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f30b4ad1-e1fe-4fb3-9283-bb4bb2b3c864 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:19.361521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16834447-a7ce-4a00-be9f-1d237956cd4f tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:19.361666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f30b4ad1-e1fe-4fb3-9283-bb4bb2b3c864 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:19.362244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f30b4ad1-e1fe-4fb3-9283-bb4bb2b3c864 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:19.362778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f30b4ad1-e1fe-4fb3-9283-bb4bb2b3c864 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:19.363105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16834447-a7ce-4a00-be9f-1d237956cd4f tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:19.363348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f30b4ad1-e1fe-4fb3-9283-bb4bb2b3c864 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:19.364045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16834447-a7ce-4a00-be9f-1d237956cd4f tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:19.364890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16834447-a7ce-4a00-be9f-1d237956cd4f tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:19.560418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f30b4ad1-e1fe-4fb3-9283-bb4bb2b3c864 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:19.571951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f30b4ad1-e1fe-4fb3-9283-bb4bb2b3c864 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:19.574290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f30b4ad1-e1fe-4fb3-9283-bb4bb2b3c864 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:19.580725 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f30b4ad1-e1fe-4fb3-9283-bb4bb2b3c864 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.252951 Sep 08 12:41:19.581426 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 504/1017] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:19 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:19.612362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c2781d30-d028-4c24-b754-26029f0cdfd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:19.612982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c2781d30-d028-4c24-b754-26029f0cdfd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:19.621989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2781d30-d028-4c24-b754-26029f0cdfd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:19.622482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2781d30-d028-4c24-b754-26029f0cdfd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:19.622919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2781d30-d028-4c24-b754-26029f0cdfd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:19.623688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2781d30-d028-4c24-b754-26029f0cdfd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:19.624139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2781d30-d028-4c24-b754-26029f0cdfd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:19.624557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2781d30-d028-4c24-b754-26029f0cdfd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:19.629369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:19.943543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-16834447-a7ce-4a00-be9f-1d237956cd4f tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:19.963103 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-16834447-a7ce-4a00-be9f-1d237956cd4f tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1317 microversion: 2.1 time: 0.631215 Sep 08 12:41:19.964728 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 514/1018] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:19 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1317 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:20.010193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c2781d30-d028-4c24-b754-26029f0cdfd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:20.024574 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c2781d30-d028-4c24-b754-26029f0cdfd4 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1472 microversion: 2.1 time: 0.441875 Sep 08 12:41:20.025181 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 505/1019] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:19 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1472 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:20.030351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-012c9b8a-0bc8-40af-9aa6-a47204d0c5be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:20.030969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-012c9b8a-0bc8-40af-9aa6-a47204d0c5be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:20.041318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=88,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=7,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:20.060433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-012c9b8a-0bc8-40af-9aa6-a47204d0c5be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:20.061201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-012c9b8a-0bc8-40af-9aa6-a47204d0c5be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:20.061803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-012c9b8a-0bc8-40af-9aa6-a47204d0c5be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:20.062907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-012c9b8a-0bc8-40af-9aa6-a47204d0c5be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:20.063983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-012c9b8a-0bc8-40af-9aa6-a47204d0c5be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:20.064595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-012c9b8a-0bc8-40af-9aa6-a47204d0c5be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:20.232801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f4c34b6c-600b-4dd0-8528-ede33382911f tempest-FlavorsV255TestJSON-552081508 tempest-FlavorsV255TestJSON-552081508-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-1650243615", "id": 470675488, "os-flavor-access:is_public": "True"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:20.266982 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f4c34b6c-600b-4dd0-8528-ede33382911f tempest-FlavorsV255TestJSON-552081508 tempest-FlavorsV255TestJSON-552081508-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 446 microversion: 2.55 time: 0.282609 Sep 08 12:41:20.283739 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 515/1020] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 12:41:19 2022] POST /compute/v2.1/flavors => generated 446 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:41:20.289930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-32cc6dbe-414e-4109-8d23-77d092b3e06e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:20.290571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-32cc6dbe-414e-4109-8d23-77d092b3e06e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:20.297647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32cc6dbe-414e-4109-8d23-77d092b3e06e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:20.299205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32cc6dbe-414e-4109-8d23-77d092b3e06e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:20.299846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32cc6dbe-414e-4109-8d23-77d092b3e06e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:20.301142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32cc6dbe-414e-4109-8d23-77d092b3e06e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:20.301827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32cc6dbe-414e-4109-8d23-77d092b3e06e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:20.302451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32cc6dbe-414e-4109-8d23-77d092b3e06e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:20.593477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-012c9b8a-0bc8-40af-9aa6-a47204d0c5be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:20.610842 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-012c9b8a-0bc8-40af-9aa6-a47204d0c5be tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1537 microversion: 2.1 time: 0.584582 Sep 08 12:41:20.611850 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 506/1021] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:20 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1537 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:20.620952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2a432ea1-bd15-4956-83ea-44033ec9c571 req-388110ba-3191-4fba-b58e-90d376a74209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b350654b-8f8e-4077-b819-3f97ab94143c", "name": "network-vif-plugged", "status": "completed", "tag": "a40a204f-c921-4204-b9ec-b06d79e63487"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:20.639168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2a432ea1-bd15-4956-83ea-44033ec9c571 req-388110ba-3191-4fba-b58e-90d376a74209 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:20.639890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2a432ea1-bd15-4956-83ea-44033ec9c571 req-388110ba-3191-4fba-b58e-90d376a74209 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:20.640536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2a432ea1-bd15-4956-83ea-44033ec9c571 req-388110ba-3191-4fba-b58e-90d376a74209 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:20.655697 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2a432ea1-bd15-4956-83ea-44033ec9c571 req-388110ba-3191-4fba-b58e-90d376a74209 service nova] Creating event network-vif-plugged:a40a204f-c921-4204-b9ec-b06d79e63487 for instance b350654b-8f8e-4077-b819-3f97ab94143c on n-h2-852084-10 Sep 08 12:41:20.662197 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2a432ea1-bd15-4956-83ea-44033ec9c571 req-388110ba-3191-4fba-b58e-90d376a74209 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048866 Sep 08 12:41:20.663688 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 507/1022] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:20.936404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8c1683a5-f8de-4b3b-bb49-f9d9e931e8ac tempest-FlavorsV255TestJSON-727962155 tempest-FlavorsV255TestJSON-727962155-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:20.968707 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8c1683a5-f8de-4b3b-bb49-f9d9e931e8ac tempest-FlavorsV255TestJSON-727962155 tempest-FlavorsV255TestJSON-727962155-project] 10.222.0.78 "GET /compute/v2.1/flavors/470675488" status: 200 len: 446 microversion: 2.55 time: 0.303092 Sep 08 12:41:20.978399 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 508/1023] 10.222.0.78 () {60 vars in 1196 bytes} [Thu Sep 8 12:41:20 2022] GET /compute/v2.1/flavors/470675488 => generated 446 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:41:20.988934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-72b283cb-acd0-463e-b79c-adcd380a0bff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:20.989829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-72b283cb-acd0-463e-b79c-adcd380a0bff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:21.001532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b283cb-acd0-463e-b79c-adcd380a0bff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:21.002513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b283cb-acd0-463e-b79c-adcd380a0bff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:21.003090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b283cb-acd0-463e-b79c-adcd380a0bff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:21.004700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b283cb-acd0-463e-b79c-adcd380a0bff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:21.005294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b283cb-acd0-463e-b79c-adcd380a0bff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:21.005884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b283cb-acd0-463e-b79c-adcd380a0bff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:21.180224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-32cc6dbe-414e-4109-8d23-77d092b3e06e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:21.193276 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-32cc6dbe-414e-4109-8d23-77d092b3e06e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1402 microversion: 2.1 time: 0.908195 Sep 08 12:41:21.194089 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 516/1024] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:20 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1402 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:21.207655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-28eabf7a-50aa-4ee0-a04e-ba859f000991 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:21.210480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-28eabf7a-50aa-4ee0-a04e-ba859f000991 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:21.221025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28eabf7a-50aa-4ee0-a04e-ba859f000991 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:21.221625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28eabf7a-50aa-4ee0-a04e-ba859f000991 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:21.222275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28eabf7a-50aa-4ee0-a04e-ba859f000991 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:21.223066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28eabf7a-50aa-4ee0-a04e-ba859f000991 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:21.223803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28eabf7a-50aa-4ee0-a04e-ba859f000991 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:21.224350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28eabf7a-50aa-4ee0-a04e-ba859f000991 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:21.812612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-28eabf7a-50aa-4ee0-a04e-ba859f000991 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:21.833764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-28eabf7a-50aa-4ee0-a04e-ba859f000991 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:21.837142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-28eabf7a-50aa-4ee0-a04e-ba859f000991 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:21.844767 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-28eabf7a-50aa-4ee0-a04e-ba859f000991 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.649254 Sep 08 12:41:21.845642 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 517/1025] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:21 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:21.866851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5a8d4d4e-9c15-430d-b533-2b3ca7c1c72e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:21.867108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5a8d4d4e-9c15-430d-b533-2b3ca7c1c72e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:21.879333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a8d4d4e-9c15-430d-b533-2b3ca7c1c72e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:21.879931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a8d4d4e-9c15-430d-b533-2b3ca7c1c72e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:21.880584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a8d4d4e-9c15-430d-b533-2b3ca7c1c72e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:21.881240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a8d4d4e-9c15-430d-b533-2b3ca7c1c72e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:21.881784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a8d4d4e-9c15-430d-b533-2b3ca7c1c72e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:21.882340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a8d4d4e-9c15-430d-b533-2b3ca7c1c72e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:22.029035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-72b283cb-acd0-463e-b79c-adcd380a0bff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:22.040974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-72b283cb-acd0-463e-b79c-adcd380a0bff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:22.043421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-72b283cb-acd0-463e-b79c-adcd380a0bff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:22.044732 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-72b283cb-acd0-463e-b79c-adcd380a0bff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1567 microversion: 2.25 time: 1.062794 Sep 08 12:41:22.045424 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 509/1026] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:20 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1567 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:22.055280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-05ac26a9-4582-46ed-bb4a-211c87b8f3e3 tempest-FlavorsV255TestJSON-552081508 tempest-FlavorsV255TestJSON-552081508-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:22.128404 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-05ac26a9-4582-46ed-bb4a-211c87b8f3e3 tempest-FlavorsV255TestJSON-552081508 tempest-FlavorsV255TestJSON-552081508-project-admin] 10.222.0.78 "PUT /compute/v2.1/flavors/470675488" status: 200 len: 447 microversion: 2.55 time: 0.081635 Sep 08 12:41:22.140969 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 510/1027] 10.222.0.78 () {62 vars in 1216 bytes} [Thu Sep 8 12:41:22 2022] PUT /compute/v2.1/flavors/470675488 => generated 447 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:41:22.148639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-96fd5f1e-01ca-4951-8ccc-7d61f7179ebe tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:22.149669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-96fd5f1e-01ca-4951-8ccc-7d61f7179ebe tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:22.173016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96fd5f1e-01ca-4951-8ccc-7d61f7179ebe tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:22.173887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96fd5f1e-01ca-4951-8ccc-7d61f7179ebe tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:22.176154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96fd5f1e-01ca-4951-8ccc-7d61f7179ebe tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:22.180441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96fd5f1e-01ca-4951-8ccc-7d61f7179ebe tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:22.180938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96fd5f1e-01ca-4951-8ccc-7d61f7179ebe tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:22.181943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96fd5f1e-01ca-4951-8ccc-7d61f7179ebe tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:23.084870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5a8d4d4e-9c15-430d-b533-2b3ca7c1c72e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:23.099810 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5a8d4d4e-9c15-430d-b533-2b3ca7c1c72e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1317 microversion: 2.1 time: 1.237168 Sep 08 12:41:23.101320 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 518/1028] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:21 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1317 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:23.128909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b5cdad0e-c8da-48b2-8070-534a45f9268b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:23.129727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b5cdad0e-c8da-48b2-8070-534a45f9268b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:23.151081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5cdad0e-c8da-48b2-8070-534a45f9268b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:23.152778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5cdad0e-c8da-48b2-8070-534a45f9268b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:23.158048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5cdad0e-c8da-48b2-8070-534a45f9268b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:23.159889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5cdad0e-c8da-48b2-8070-534a45f9268b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:23.160805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5cdad0e-c8da-48b2-8070-534a45f9268b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:23.161643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5cdad0e-c8da-48b2-8070-534a45f9268b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:23.221431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:23.404599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-96fd5f1e-01ca-4951-8ccc-7d61f7179ebe tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:23.430856 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-96fd5f1e-01ca-4951-8ccc-7d61f7179ebe tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1472 microversion: 2.1 time: 1.287500 Sep 08 12:41:23.442319 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 511/1029] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:22 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1472 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:23.470294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5b1fddce-7eb5-4e0d-9558-467473ac841c tempest-FlavorsV255TestJSON-727962155 tempest-FlavorsV255TestJSON-727962155-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:23.520756 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5b1fddce-7eb5-4e0d-9558-467473ac841c tempest-FlavorsV255TestJSON-727962155 tempest-FlavorsV255TestJSON-727962155-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5722 microversion: 2.55 time: 0.075907 Sep 08 12:41:23.527938 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 512/1030] 10.222.0.78 () {60 vars in 1187 bytes} [Thu Sep 8 12:41:23 2022] GET /compute/v2.1/flavors/detail => generated 5722 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:23.565363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c45bcf3d-752a-4d3e-b6f0-0f7d3cc1d6fe tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:23.566341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c45bcf3d-752a-4d3e-b6f0-0f7d3cc1d6fe tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:23.588668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c45bcf3d-752a-4d3e-b6f0-0f7d3cc1d6fe tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:23.590045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c45bcf3d-752a-4d3e-b6f0-0f7d3cc1d6fe tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:23.591038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c45bcf3d-752a-4d3e-b6f0-0f7d3cc1d6fe tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:23.593539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c45bcf3d-752a-4d3e-b6f0-0f7d3cc1d6fe tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:23.594986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c45bcf3d-752a-4d3e-b6f0-0f7d3cc1d6fe tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:23.595665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c45bcf3d-752a-4d3e-b6f0-0f7d3cc1d6fe tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:23.902497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b5cdad0e-c8da-48b2-8070-534a45f9268b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:23.923929 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b5cdad0e-c8da-48b2-8070-534a45f9268b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 0.821204 Sep 08 12:41:23.924896 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 519/1031] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:23 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:23.933437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-27adb7c3-85fe-403d-bf7c-7d46b395dfa5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:23.935949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-27adb7c3-85fe-403d-bf7c-7d46b395dfa5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:23.949586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27adb7c3-85fe-403d-bf7c-7d46b395dfa5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:23.957876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27adb7c3-85fe-403d-bf7c-7d46b395dfa5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:23.958449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27adb7c3-85fe-403d-bf7c-7d46b395dfa5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:23.959513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27adb7c3-85fe-403d-bf7c-7d46b395dfa5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:23.960221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27adb7c3-85fe-403d-bf7c-7d46b395dfa5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:23.960877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27adb7c3-85fe-403d-bf7c-7d46b395dfa5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:24.005324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c45bcf3d-752a-4d3e-b6f0-0f7d3cc1d6fe tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:24.049422 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c45bcf3d-752a-4d3e-b6f0-0f7d3cc1d6fe tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1589 microversion: 2.1 time: 0.519284 Sep 08 12:41:24.057536 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 513/1032] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:23 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1589 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:24.079755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-02c98632-2071-43ee-a3da-956fdeb29d10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:24.080400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-02c98632-2071-43ee-a3da-956fdeb29d10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:24.089817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-27adb7c3-85fe-403d-bf7c-7d46b395dfa5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:24.098385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02c98632-2071-43ee-a3da-956fdeb29d10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:24.098952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02c98632-2071-43ee-a3da-956fdeb29d10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:24.099442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02c98632-2071-43ee-a3da-956fdeb29d10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:24.100205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02c98632-2071-43ee-a3da-956fdeb29d10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:24.100673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02c98632-2071-43ee-a3da-956fdeb29d10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:24.101133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02c98632-2071-43ee-a3da-956fdeb29d10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:24.122207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-27adb7c3-85fe-403d-bf7c-7d46b395dfa5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:24.124523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-27adb7c3-85fe-403d-bf7c-7d46b395dfa5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:24.133210 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-27adb7c3-85fe-403d-bf7c-7d46b395dfa5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.206912 Sep 08 12:41:24.143899 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 520/1033] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:23 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:24.163869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1edc7268-d2be-481b-b4b4-9ac0cd135cd4 tempest-FlavorsV255TestJSON-727962155 tempest-FlavorsV255TestJSON-727962155-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:24.170482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=88,nova_api:SAVEPOINT=3,nova_api:RELEASE=3,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:24.344128 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1edc7268-d2be-481b-b4b4-9ac0cd135cd4 tempest-FlavorsV255TestJSON-727962155 tempest-FlavorsV255TestJSON-727962155-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 3154 microversion: 2.55 time: 0.191282 Sep 08 12:41:24.351461 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 521/1034] 10.222.0.78 () {60 vars in 1166 bytes} [Thu Sep 8 12:41:24 2022] GET /compute/v2.1/flavors => generated 3154 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:24.388521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-1cceac0e-21fa-4ecc-85c1-cc23758da105 req-b1ec69ac-e92e-4d93-8915-01076678a30c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d483e1-ee86-4c2f-ae5a-d14ad8686dea", "tag": "7c4cd857-97b7-4ae8-994c-544ea60d027c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:24.422329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1cceac0e-21fa-4ecc-85c1-cc23758da105 req-b1ec69ac-e92e-4d93-8915-01076678a30c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:24.422858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1cceac0e-21fa-4ecc-85c1-cc23758da105 req-b1ec69ac-e92e-4d93-8915-01076678a30c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:24.423361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1cceac0e-21fa-4ecc-85c1-cc23758da105 req-b1ec69ac-e92e-4d93-8915-01076678a30c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:24.471006 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-1cceac0e-21fa-4ecc-85c1-cc23758da105 req-b1ec69ac-e92e-4d93-8915-01076678a30c service nova] Creating event network-changed:7c4cd857-97b7-4ae8-994c-544ea60d027c for instance 62d483e1-ee86-4c2f-ae5a-d14ad8686dea on n-h2-852084-10 Sep 08 12:41:24.483529 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-1cceac0e-21fa-4ecc-85c1-cc23758da105 req-b1ec69ac-e92e-4d93-8915-01076678a30c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130000 Sep 08 12:41:24.485146 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 522/1035] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:24.497456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e398efdc-e45b-4e73-bf1c-8e3f3c637605 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:24.499124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e398efdc-e45b-4e73-bf1c-8e3f3c637605 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:24.512160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e398efdc-e45b-4e73-bf1c-8e3f3c637605 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:24.513227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e398efdc-e45b-4e73-bf1c-8e3f3c637605 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:24.514152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e398efdc-e45b-4e73-bf1c-8e3f3c637605 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:24.515703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e398efdc-e45b-4e73-bf1c-8e3f3c637605 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:24.517657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e398efdc-e45b-4e73-bf1c-8e3f3c637605 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:24.518732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e398efdc-e45b-4e73-bf1c-8e3f3c637605 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:24.760105 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e398efdc-e45b-4e73-bf1c-8e3f3c637605 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.271643 Sep 08 12:41:24.762441 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 523/1036] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 12:41:24 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:24.786752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-98c7ef00-1083-46b1-999f-15c917ce76c5 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:24.806817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-98c7ef00-1083-46b1-999f-15c917ce76c5 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:24.828457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98c7ef00-1083-46b1-999f-15c917ce76c5 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:24.833211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98c7ef00-1083-46b1-999f-15c917ce76c5 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:24.835207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-02c98632-2071-43ee-a3da-956fdeb29d10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:24.836902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98c7ef00-1083-46b1-999f-15c917ce76c5 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:24.838389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98c7ef00-1083-46b1-999f-15c917ce76c5 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:24.844222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98c7ef00-1083-46b1-999f-15c917ce76c5 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:24.846234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98c7ef00-1083-46b1-999f-15c917ce76c5 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:24.850372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-02c98632-2071-43ee-a3da-956fdeb29d10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:24.853190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-02c98632-2071-43ee-a3da-956fdeb29d10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:24.855724 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-02c98632-2071-43ee-a3da-956fdeb29d10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1557 microversion: 2.25 time: 0.795915 Sep 08 12:41:24.856653 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 514/1037] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:24 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1557 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:24.888481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3715cdcc-0aac-47a3-8f6e-c15baa36e654 tempest-FlavorsV255TestJSON-552081508 tempest-FlavorsV255TestJSON-552081508-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:24.915429 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3715cdcc-0aac-47a3-8f6e-c15baa36e654 tempest-FlavorsV255TestJSON-552081508 tempest-FlavorsV255TestJSON-552081508-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/470675488" status: 202 len: 0 microversion: 2.55 time: 0.031724 Sep 08 12:41:24.917356 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 515/1038] 10.222.0.78 () {60 vars in 1199 bytes} [Thu Sep 8 12:41:24 2022] DELETE /compute/v2.1/flavors/470675488 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:41:24.930924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:24.931939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:24.954699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:24.955792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:24.956529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:24.957952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:24.958683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:24.959717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:25.080402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:25.081294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:25.082072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:25.082889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lazy-loading 'fault' on Instance uuid 970bb882-462b-4430-a3ae-e76024ca8892 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:41:25.137668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-98c7ef00-1083-46b1-999f-15c917ce76c5 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:25.166643 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-98c7ef00-1083-46b1-999f-15c917ce76c5 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1317 microversion: 2.1 time: 0.402316 Sep 08 12:41:25.170008 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 524/1039] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:24 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1317 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:25.180761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cca50c27-1dc9-4fee-bc85-d8c09fcf7cbe tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '.version_select at 0x7fdb3b185790>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:25.192835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cca50c27-1dc9-4fee-bc85-d8c09fcf7cbe tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:25.195386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cca50c27-1dc9-4fee-bc85-d8c09fcf7cbe tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:25.196176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cca50c27-1dc9-4fee-bc85-d8c09fcf7cbe tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:25.225526 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cca50c27-1dc9-4fee-bc85-d8c09fcf7cbe tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 2810 microversion: 2.25 time: 0.053684 Sep 08 12:41:25.239645 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 525/1040] 10.222.0.78 () {60 vars in 1184 bytes} [Thu Sep 8 12:41:25 2022] GET /compute/v2.1/os-migrations => generated 2810 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:25.263190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d54a7c29-09ca-408c-bb29-1161bf639124 tempest-FlavorsV255TestJSON-552081508 tempest-FlavorsV255TestJSON-552081508-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:25.270646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d8ffdbbf2de43b9b4efc89b7fcd4897', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5be40b5c51b9493d85c199b11a32726e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:25.296431 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-17911f2f-41c8-459a-a625-1d31b9408409 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 200 len: 1306 microversion: 2.1 time: 0.377562 Sep 08 12:41:25.300945 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 516/1041] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:24 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 1306 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:25.322461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0c03183d-4a4f-4ebf-899b-b3dbba987306 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:25.323790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0c03183d-4a4f-4ebf-899b-b3dbba987306 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:25.348323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c03183d-4a4f-4ebf-899b-b3dbba987306 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:25.352155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c03183d-4a4f-4ebf-899b-b3dbba987306 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:25.356861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c03183d-4a4f-4ebf-899b-b3dbba987306 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:25.359624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c03183d-4a4f-4ebf-899b-b3dbba987306 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:25.362015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c03183d-4a4f-4ebf-899b-b3dbba987306 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:25.363938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c03183d-4a4f-4ebf-899b-b3dbba987306 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:25.454284 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d54a7c29-09ca-408c-bb29-1161bf639124 tempest-FlavorsV255TestJSON-552081508 tempest-FlavorsV255TestJSON-552081508-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.197750 Sep 08 12:41:25.472066 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 526/1042] 10.222.0.78 () {60 vars in 1187 bytes} [Thu Sep 8 12:41:25 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:25.504158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4845868a-16a6-47dd-bb3a-be54a4470964 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:25.505332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4845868a-16a6-47dd-bb3a-be54a4470964 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:25.515677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4845868a-16a6-47dd-bb3a-be54a4470964 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:25.516452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4845868a-16a6-47dd-bb3a-be54a4470964 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:25.517098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4845868a-16a6-47dd-bb3a-be54a4470964 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:25.518364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4845868a-16a6-47dd-bb3a-be54a4470964 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:25.519034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4845868a-16a6-47dd-bb3a-be54a4470964 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:25.520610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4845868a-16a6-47dd-bb3a-be54a4470964 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:25.760395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4845868a-16a6-47dd-bb3a-be54a4470964 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:25.777632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4845868a-16a6-47dd-bb3a-be54a4470964 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:25.787802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4845868a-16a6-47dd-bb3a-be54a4470964 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:25.812230 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4845868a-16a6-47dd-bb3a-be54a4470964 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.336253 Sep 08 12:41:25.835303 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 527/1043] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:25 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:25.853541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b570b44e-a5a0-4045-9b99-c8a24869b20d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:25.855356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b570b44e-a5a0-4045-9b99-c8a24869b20d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:25.899860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b570b44e-a5a0-4045-9b99-c8a24869b20d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:25.902411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b570b44e-a5a0-4045-9b99-c8a24869b20d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:25.903304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b570b44e-a5a0-4045-9b99-c8a24869b20d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:25.904418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b570b44e-a5a0-4045-9b99-c8a24869b20d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:25.920762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b570b44e-a5a0-4045-9b99-c8a24869b20d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:25.921854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b570b44e-a5a0-4045-9b99-c8a24869b20d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:26.255433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0c03183d-4a4f-4ebf-899b-b3dbba987306 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:26.278646 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0c03183d-4a4f-4ebf-899b-b3dbba987306 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 0.970775 Sep 08 12:41:26.283840 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 517/1044] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:25 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:26.302448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b50f187d-35a2-43a3-909b-b544806284e6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:26.303084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b50f187d-35a2-43a3-909b-b544806284e6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:26.330658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b50f187d-35a2-43a3-909b-b544806284e6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:26.331152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b50f187d-35a2-43a3-909b-b544806284e6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:26.335790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b50f187d-35a2-43a3-909b-b544806284e6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:26.339819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b50f187d-35a2-43a3-909b-b544806284e6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:26.343101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b50f187d-35a2-43a3-909b-b544806284e6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:26.343611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b50f187d-35a2-43a3-909b-b544806284e6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:26.441082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-b570b44e-a5a0-4045-9b99-c8a24869b20d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid 60526de3-67cc-4bf8-911d-590f531d0130 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:41:26.538509 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b570b44e-a5a0-4045-9b99-c8a24869b20d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 2051 microversion: 2.25 time: 0.701849 Sep 08 12:41:26.553197 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 528/1045] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:25 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 2051 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:26.572682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a2a67357-9544-4037-94e2-d1b51b983e0c req-731406ef-a10c-4986-9390-c53428e09fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5582b0f-06e1-4423-9a14-ed3d2d1668f5", "name": "network-vif-plugged", "status": "completed", "tag": "a9e22ed5-d751-4fb9-bb65-3ccccd7b5e8c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:26.602979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a2a67357-9544-4037-94e2-d1b51b983e0c req-731406ef-a10c-4986-9390-c53428e09fae service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:26.603537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a2a67357-9544-4037-94e2-d1b51b983e0c req-731406ef-a10c-4986-9390-c53428e09fae service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:26.604072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a2a67357-9544-4037-94e2-d1b51b983e0c req-731406ef-a10c-4986-9390-c53428e09fae service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:26.666457 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a2a67357-9544-4037-94e2-d1b51b983e0c req-731406ef-a10c-4986-9390-c53428e09fae service nova] Creating event network-vif-plugged:a9e22ed5-d751-4fb9-bb65-3ccccd7b5e8c for instance b5582b0f-06e1-4423-9a14-ed3d2d1668f5 on n-h1-852084-10 Sep 08 12:41:26.697662 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a2a67357-9544-4037-94e2-d1b51b983e0c req-731406ef-a10c-4986-9390-c53428e09fae service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139142 Sep 08 12:41:26.704347 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 529/1046] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:26.737093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-715614a8-5902-4ba4-87fb-f228d4e88f46 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:26.737709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-715614a8-5902-4ba4-87fb-f228d4e88f46 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] [instance: 970bb882-462b-4430-a3ae-e76024ca8892] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:26.767079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-715614a8-5902-4ba4-87fb-f228d4e88f46 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:26.771993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-715614a8-5902-4ba4-87fb-f228d4e88f46 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:26.778238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-715614a8-5902-4ba4-87fb-f228d4e88f46 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:26.779132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-715614a8-5902-4ba4-87fb-f228d4e88f46 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:26.786448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-715614a8-5902-4ba4-87fb-f228d4e88f46 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:26.787079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-715614a8-5902-4ba4-87fb-f228d4e88f46 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:26.877932 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-715614a8-5902-4ba4-87fb-f228d4e88f46 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] HTTP exception thrown: Instance 970bb882-462b-4430-a3ae-e76024ca8892 could not be found. Sep 08 12:41:26.879202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b50f187d-35a2-43a3-909b-b544806284e6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-715614a8-5902-4ba4-87fb-f228d4e88f46 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Request method failure captured: Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 HTTP/1.1 Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIw6pvhdO4zXhGJCeJ68kJVlsg90ZbSv8TA1izVc9P8bD4Mdu4KXagKTNz1oO93ELXFA4g_EqPdtm7gyry5N4K7tu7lRJSgVuw6GQPzVgbC4uAAvWiLPrDcsyxqGiNNxf4BjA9XsBe47roVYCmKPUnjbtRu99GiZHdc1lNwkgijj3o Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:41:26.884760 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:41:26.886933 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5be40b5c51b9493d85c199b11a32726e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:41:26.886933 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:26.886933 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 5be40b5c51b9493d85c199b11a32726e Sep 08 12:41:26.886933 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-146773976 Sep 08 12:41:26.886933 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:41:26.886933 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:41:26.886933 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:41:26.886933 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 7d8ffdbbf2de43b9b4efc89b7fcd4897 Sep 08 12:41:26.886933 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersOnMultiNodesTest-146773976-project Sep 08 12:41:26.886933 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:41:26.886933 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 970bb882-462b-4430-a3ae-e76024ca8892 could not be found. Sep 08 12:41:26.886933 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '970bb882-462b-4430-a3ae-e76024ca8892'} Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 970bb882-462b-4430-a3ae-e76024ca8892 could not be found. Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:41:26.888024 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 970bb882-462b-4430-a3ae-e76024ca8892 could not be found. Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 970bb882-462b-4430-a3ae-e76024ca8892 could not be found. Sep 08 12:41:26.889663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:26.891069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-715614a8-5902-4ba4-87fb-f228d4e88f46 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] Returning 404 to user: Instance 970bb882-462b-4430-a3ae-e76024ca8892 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:41:26.891069 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-715614a8-5902-4ba4-87fb-f228d4e88f46 tempest-ServersOnMultiNodesTest-146773976 tempest-ServersOnMultiNodesTest-146773976-project] 10.222.0.78 "GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892" status: 404 len: 111 microversion: 2.1 time: 0.182863 Sep 08 12:41:26.891271 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 530/1047] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:26 2022] GET /compute/v2.1/servers/970bb882-462b-4430-a3ae-e76024ca8892 => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:41:26.905801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c0141e1a-3417-4b95-91f1-f2a4a52676af req-a6ddcaed-de36-46d4-b60c-bbaccba0131d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970bb882-462b-4430-a3ae-e76024ca8892", "name": "network-vif-deleted", "tag": "705e0576-9031-4c37-af92-e4df93acfac3"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:26.910225 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b50f187d-35a2-43a3-909b-b544806284e6 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1317 microversion: 2.1 time: 0.624316 Sep 08 12:41:26.915763 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 518/1048] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:26 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1317 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:26.929349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-42009196-a45f-4697-8da0-7eff1e396cd7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:26.934120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-42009196-a45f-4697-8da0-7eff1e396cd7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:26.947810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42009196-a45f-4697-8da0-7eff1e396cd7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:26.952946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42009196-a45f-4697-8da0-7eff1e396cd7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:26.954650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42009196-a45f-4697-8da0-7eff1e396cd7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:26.956583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42009196-a45f-4697-8da0-7eff1e396cd7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:26.959075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42009196-a45f-4697-8da0-7eff1e396cd7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:26.962082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42009196-a45f-4697-8da0-7eff1e396cd7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:26.965358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c0141e1a-3417-4b95-91f1-f2a4a52676af req-a6ddcaed-de36-46d4-b60c-bbaccba0131d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:26.965652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c0141e1a-3417-4b95-91f1-f2a4a52676af req-a6ddcaed-de36-46d4-b60c-bbaccba0131d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:26.966244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c0141e1a-3417-4b95-91f1-f2a4a52676af req-a6ddcaed-de36-46d4-b60c-bbaccba0131d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:27.032814 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c0141e1a-3417-4b95-91f1-f2a4a52676af req-a6ddcaed-de36-46d4-b60c-bbaccba0131d service nova] Creating event network-vif-deleted:705e0576-9031-4c37-af92-e4df93acfac3 for instance 970bb882-462b-4430-a3ae-e76024ca8892 on n-h2-852084-10 Sep 08 12:41:27.053430 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c0141e1a-3417-4b95-91f1-f2a4a52676af req-a6ddcaed-de36-46d4-b60c-bbaccba0131d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160416 Sep 08 12:41:27.063327 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 531/1049] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:27.090404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1300388230", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "d9960f69-c05a-419f-a17a-eee5648ebea7"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:27.274808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] validate_networks() for [('d9960f69-c05a-419f-a17a-eee5648ebea7', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:41:27.670461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-42009196-a45f-4697-8da0-7eff1e396cd7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:27.696785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-42009196-a45f-4697-8da0-7eff1e396cd7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:27.700493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-42009196-a45f-4697-8da0-7eff1e396cd7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:27.726635 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-42009196-a45f-4697-8da0-7eff1e396cd7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.802205 Sep 08 12:41:27.737720 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 519/1050] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:26 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:27.757251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-09d7dd76-f4eb-4f1b-9c5c-f2300870f5c1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:27.758742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-09d7dd76-f4eb-4f1b-9c5c-f2300870f5c1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:27.781875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09d7dd76-f4eb-4f1b-9c5c-f2300870f5c1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:27.788420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09d7dd76-f4eb-4f1b-9c5c-f2300870f5c1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:27.789553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09d7dd76-f4eb-4f1b-9c5c-f2300870f5c1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:27.794933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09d7dd76-f4eb-4f1b-9c5c-f2300870f5c1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:27.796246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09d7dd76-f4eb-4f1b-9c5c-f2300870f5c1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:27.797291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09d7dd76-f4eb-4f1b-9c5c-f2300870f5c1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:28.552344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-09d7dd76-f4eb-4f1b-9c5c-f2300870f5c1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:28.576461 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-09d7dd76-f4eb-4f1b-9c5c-f2300870f5c1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 0.836810 Sep 08 12:41:28.583093 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 520/1051] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:27 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:28.593897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cd37f615-720a-4e6b-9c00-4fb2bab3e737 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:28.599423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cd37f615-720a-4e6b-9c00-4fb2bab3e737 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:28.617003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd37f615-720a-4e6b-9c00-4fb2bab3e737 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:28.618682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd37f615-720a-4e6b-9c00-4fb2bab3e737 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:28.619920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd37f615-720a-4e6b-9c00-4fb2bab3e737 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:28.621728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd37f615-720a-4e6b-9c00-4fb2bab3e737 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:28.628516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd37f615-720a-4e6b-9c00-4fb2bab3e737 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:28.629739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd37f615-720a-4e6b-9c00-4fb2bab3e737 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:28.645513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:41:28.646376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:41:28.647423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:41:28.648631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:41:28.649510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:41:28.685614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:28.686507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:28.687248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:28.693881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:28.694714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:28.703553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:28.756605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Getting quotas for project df5a27766c1942a8be6a78466f7e7192. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:41:28.766064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Getting quotas for user 8af088dfb51e4f729cc97fc91699a55f and project df5a27766c1942a8be6a78466f7e7192. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:41:28.795096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:41:28.800632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:41:28.911688 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-09f57226-b420-40d2-aac9-bf5d4c5bd2e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.842743 Sep 08 12:41:28.923832 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 532/1052] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 12:41:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 12:41:28.933631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54ab545e-f7b3-4b64-ada9-06fabbcb5e40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:28.939636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54ab545e-f7b3-4b64-ada9-06fabbcb5e40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:28.966449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54ab545e-f7b3-4b64-ada9-06fabbcb5e40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:28.967056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54ab545e-f7b3-4b64-ada9-06fabbcb5e40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:28.967915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54ab545e-f7b3-4b64-ada9-06fabbcb5e40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:28.971703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54ab545e-f7b3-4b64-ada9-06fabbcb5e40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:28.976971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54ab545e-f7b3-4b64-ada9-06fabbcb5e40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:28.980320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54ab545e-f7b3-4b64-ada9-06fabbcb5e40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:29.136149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cd37f615-720a-4e6b-9c00-4fb2bab3e737 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:29.153117 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cd37f615-720a-4e6b-9c00-4fb2bab3e737 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1317 microversion: 2.1 time: 0.565133 Sep 08 12:41:29.154125 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 521/1053] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:28 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1317 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:29.175526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-74a83107-04dc-4fb4-958d-21dd80848edd req-e0b57e00-fdea-464a-9ae7-80b1e51a8327 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b350654b-8f8e-4077-b819-3f97ab94143c", "tag": "a40a204f-c921-4204-b9ec-b06d79e63487"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:29.195447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-74a83107-04dc-4fb4-958d-21dd80848edd req-e0b57e00-fdea-464a-9ae7-80b1e51a8327 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:29.198943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-74a83107-04dc-4fb4-958d-21dd80848edd req-e0b57e00-fdea-464a-9ae7-80b1e51a8327 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:29.206734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-74a83107-04dc-4fb4-958d-21dd80848edd req-e0b57e00-fdea-464a-9ae7-80b1e51a8327 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:29.248288 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-74a83107-04dc-4fb4-958d-21dd80848edd req-e0b57e00-fdea-464a-9ae7-80b1e51a8327 service nova] Creating event network-changed:a40a204f-c921-4204-b9ec-b06d79e63487 for instance b350654b-8f8e-4077-b819-3f97ab94143c on n-h2-852084-10 Sep 08 12:41:29.263314 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-74a83107-04dc-4fb4-958d-21dd80848edd req-e0b57e00-fdea-464a-9ae7-80b1e51a8327 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106911 Sep 08 12:41:29.283382 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 522/1054] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:29.298726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-380eb6e5-67a6-4a60-a284-07423b6aa73b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:29.300584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-380eb6e5-67a6-4a60-a284-07423b6aa73b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:29.319092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-380eb6e5-67a6-4a60-a284-07423b6aa73b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:29.322479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-380eb6e5-67a6-4a60-a284-07423b6aa73b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:29.326182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-380eb6e5-67a6-4a60-a284-07423b6aa73b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:29.328400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-380eb6e5-67a6-4a60-a284-07423b6aa73b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:29.329613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-380eb6e5-67a6-4a60-a284-07423b6aa73b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:29.330964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-380eb6e5-67a6-4a60-a284-07423b6aa73b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:29.625993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-380eb6e5-67a6-4a60-a284-07423b6aa73b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:29.680707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-380eb6e5-67a6-4a60-a284-07423b6aa73b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:29.693544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-380eb6e5-67a6-4a60-a284-07423b6aa73b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:29.724226 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-380eb6e5-67a6-4a60-a284-07423b6aa73b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.436264 Sep 08 12:41:29.727904 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 523/1055] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:29 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:29.747147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-747654a6-3479-4df5-b0e7-cececde0112b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:29.748476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-747654a6-3479-4df5-b0e7-cececde0112b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:29.757044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54ab545e-f7b3-4b64-ada9-06fabbcb5e40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:29.767543 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54ab545e-f7b3-4b64-ada9-06fabbcb5e40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1589 microversion: 2.1 time: 0.841642 Sep 08 12:41:29.778798 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 533/1056] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:28 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1589 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:29.791855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5d7a72fc-9b35-47af-af80-94795c1df6a2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:29.791855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5d7a72fc-9b35-47af-af80-94795c1df6a2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:29.827111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d7a72fc-9b35-47af-af80-94795c1df6a2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:29.832908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d7a72fc-9b35-47af-af80-94795c1df6a2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:29.835873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d7a72fc-9b35-47af-af80-94795c1df6a2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:29.845405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d7a72fc-9b35-47af-af80-94795c1df6a2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:29.849858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d7a72fc-9b35-47af-af80-94795c1df6a2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:29.850763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d7a72fc-9b35-47af-af80-94795c1df6a2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:29.941117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-747654a6-3479-4df5-b0e7-cececde0112b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:29.949685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-747654a6-3479-4df5-b0e7-cececde0112b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:29.954868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-747654a6-3479-4df5-b0e7-cececde0112b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:29.960775 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-747654a6-3479-4df5-b0e7-cececde0112b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1262 microversion: 2.25 time: 0.231348 Sep 08 12:41:29.961785 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 524/1057] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:29 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1262 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:30.179317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-08221655-f140-4bb2-9647-ea63d5a55122 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:30.180786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-08221655-f140-4bb2-9647-ea63d5a55122 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:30.194212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08221655-f140-4bb2-9647-ea63d5a55122 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:30.194775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08221655-f140-4bb2-9647-ea63d5a55122 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:30.195490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08221655-f140-4bb2-9647-ea63d5a55122 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:30.196514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08221655-f140-4bb2-9647-ea63d5a55122 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:30.197251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08221655-f140-4bb2-9647-ea63d5a55122 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:30.204394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08221655-f140-4bb2-9647-ea63d5a55122 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:31.201864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5d7a72fc-9b35-47af-af80-94795c1df6a2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:31.223663 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5d7a72fc-9b35-47af-af80-94795c1df6a2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 1.440799 Sep 08 12:41:31.224331 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 534/1058] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:29 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:31.244012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c23e7fe4-a898-4cb6-b983-47e256a5ba7c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:31.244641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c23e7fe4-a898-4cb6-b983-47e256a5ba7c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:31.262065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c23e7fe4-a898-4cb6-b983-47e256a5ba7c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:31.262596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c23e7fe4-a898-4cb6-b983-47e256a5ba7c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:31.263051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c23e7fe4-a898-4cb6-b983-47e256a5ba7c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:31.263829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c23e7fe4-a898-4cb6-b983-47e256a5ba7c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:31.264292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c23e7fe4-a898-4cb6-b983-47e256a5ba7c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:31.264723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c23e7fe4-a898-4cb6-b983-47e256a5ba7c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:31.444786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-08221655-f140-4bb2-9647-ea63d5a55122 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:31.468646 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-08221655-f140-4bb2-9647-ea63d5a55122 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1507 microversion: 2.1 time: 1.288249 Sep 08 12:41:31.471399 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 525/1059] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:30 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1507 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:41:31.477306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-94ef7535-0e80-460b-8baf-9924a2cf606c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:31.478494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-94ef7535-0e80-460b-8baf-9924a2cf606c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:31.524596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94ef7535-0e80-460b-8baf-9924a2cf606c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:31.529283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94ef7535-0e80-460b-8baf-9924a2cf606c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:31.532853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94ef7535-0e80-460b-8baf-9924a2cf606c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:31.543912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94ef7535-0e80-460b-8baf-9924a2cf606c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:31.544687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94ef7535-0e80-460b-8baf-9924a2cf606c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:31.547862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94ef7535-0e80-460b-8baf-9924a2cf606c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:31.824846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c23e7fe4-a898-4cb6-b983-47e256a5ba7c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:31.846639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c23e7fe4-a898-4cb6-b983-47e256a5ba7c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:31.850154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c23e7fe4-a898-4cb6-b983-47e256a5ba7c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:31.875958 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c23e7fe4-a898-4cb6-b983-47e256a5ba7c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.650451 Sep 08 12:41:31.880759 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 535/1060] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:31 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:32.128137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-94ef7535-0e80-460b-8baf-9924a2cf606c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:32.147663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-94ef7535-0e80-460b-8baf-9924a2cf606c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:32.157749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-94ef7535-0e80-460b-8baf-9924a2cf606c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:32.163798 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-94ef7535-0e80-460b-8baf-9924a2cf606c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1314 microversion: 2.25 time: 0.689128 Sep 08 12:41:32.184619 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 526/1061] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:31 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:32.325719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-047a66f6-1e4f-4cda-b9cc-136c36d36dfc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:32.326786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-047a66f6-1e4f-4cda-b9cc-136c36d36dfc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:32.410507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-047a66f6-1e4f-4cda-b9cc-136c36d36dfc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:32.411006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-047a66f6-1e4f-4cda-b9cc-136c36d36dfc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:32.411740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-047a66f6-1e4f-4cda-b9cc-136c36d36dfc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:32.412819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-047a66f6-1e4f-4cda-b9cc-136c36d36dfc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:32.413614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-047a66f6-1e4f-4cda-b9cc-136c36d36dfc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:32.414242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-047a66f6-1e4f-4cda-b9cc-136c36d36dfc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:32.910854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-29aeab31-699c-45d7-856e-f3f4c21550cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:32.911668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-29aeab31-699c-45d7-856e-f3f4c21550cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:32.942810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29aeab31-699c-45d7-856e-f3f4c21550cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:32.944423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29aeab31-699c-45d7-856e-f3f4c21550cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:32.946379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29aeab31-699c-45d7-856e-f3f4c21550cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:32.952566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29aeab31-699c-45d7-856e-f3f4c21550cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:32.954067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29aeab31-699c-45d7-856e-f3f4c21550cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:32.957075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29aeab31-699c-45d7-856e-f3f4c21550cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:32.966612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-047a66f6-1e4f-4cda-b9cc-136c36d36dfc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:32.986760 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-047a66f6-1e4f-4cda-b9cc-136c36d36dfc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 0.704869 Sep 08 12:41:32.990110 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 536/1062] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:32 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:33.128054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-29aeab31-699c-45d7-856e-f3f4c21550cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:33.143505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:33.161930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-29aeab31-699c-45d7-856e-f3f4c21550cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:33.175252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-29aeab31-699c-45d7-856e-f3f4c21550cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:33.198811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eb49f376-2320-47a5-9f33-e8fcbd0c734e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:33.199470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eb49f376-2320-47a5-9f33-e8fcbd0c734e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:33.205627 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-29aeab31-699c-45d7-856e-f3f4c21550cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.299211 Sep 08 12:41:33.212231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb49f376-2320-47a5-9f33-e8fcbd0c734e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:33.213024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb49f376-2320-47a5-9f33-e8fcbd0c734e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:33.214236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb49f376-2320-47a5-9f33-e8fcbd0c734e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:33.215254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb49f376-2320-47a5-9f33-e8fcbd0c734e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:33.215917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb49f376-2320-47a5-9f33-e8fcbd0c734e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:33.216516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb49f376-2320-47a5-9f33-e8fcbd0c734e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:33.229569 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 527/1063] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:32 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:33.430630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eb49f376-2320-47a5-9f33-e8fcbd0c734e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:33.453414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eb49f376-2320-47a5-9f33-e8fcbd0c734e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:33.458514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eb49f376-2320-47a5-9f33-e8fcbd0c734e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:33.462046 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eb49f376-2320-47a5-9f33-e8fcbd0c734e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1320 microversion: 2.25 time: 0.268767 Sep 08 12:41:33.484113 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 537/1064] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:33 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1320 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:34.028321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-24ea6464-e137-4f3e-a755-b079cc466c9c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:34.032934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-24ea6464-e137-4f3e-a755-b079cc466c9c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:34.069742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24ea6464-e137-4f3e-a755-b079cc466c9c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:34.075398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24ea6464-e137-4f3e-a755-b079cc466c9c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:34.077625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24ea6464-e137-4f3e-a755-b079cc466c9c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:34.080254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24ea6464-e137-4f3e-a755-b079cc466c9c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:34.084302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24ea6464-e137-4f3e-a755-b079cc466c9c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:34.087427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24ea6464-e137-4f3e-a755-b079cc466c9c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:34.263856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cf499013-a47b-48d4-b824-c851e535dec3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:34.263856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cf499013-a47b-48d4-b824-c851e535dec3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:34.295579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf499013-a47b-48d4-b824-c851e535dec3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:34.296359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf499013-a47b-48d4-b824-c851e535dec3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:34.297057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf499013-a47b-48d4-b824-c851e535dec3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:34.298250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf499013-a47b-48d4-b824-c851e535dec3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:34.299026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf499013-a47b-48d4-b824-c851e535dec3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:34.309024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf499013-a47b-48d4-b824-c851e535dec3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:34.624439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cf499013-a47b-48d4-b824-c851e535dec3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:34.679735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cf499013-a47b-48d4-b824-c851e535dec3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:34.718221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cf499013-a47b-48d4-b824-c851e535dec3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:34.746549 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cf499013-a47b-48d4-b824-c851e535dec3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.504642 Sep 08 12:41:34.782466 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 538/1065] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:34 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:34.810078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:34.832496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:34.874577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:34.880760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:34.882501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:34.884491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:34.886358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:34.887529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:35.366635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-24ea6464-e137-4f3e-a755-b079cc466c9c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:35.416337 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-24ea6464-e137-4f3e-a755-b079cc466c9c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 1.399919 Sep 08 12:41:35.420957 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 528/1066] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:34 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:35.560563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-72b7f26f-f48a-411f-bb7f-7cf90455bf3f tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "33fca086-dcc1-451c-917f-ad2bf208e7d3"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:35.573451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-72b7f26f-f48a-411f-bb7f-7cf90455bf3f tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:35.596946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b7f26f-f48a-411f-bb7f-7cf90455bf3f tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:35.600732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b7f26f-f48a-411f-bb7f-7cf90455bf3f tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:35.602033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b7f26f-f48a-411f-bb7f-7cf90455bf3f tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:35.608234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b7f26f-f48a-411f-bb7f-7cf90455bf3f tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:35.609847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b7f26f-f48a-411f-bb7f-7cf90455bf3f tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:35.611123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72b7f26f-f48a-411f-bb7f-7cf90455bf3f tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:35.745619 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-72b7f26f-f48a-411f-bb7f-7cf90455bf3f tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] HTTP exception thrown: Volume 35fcc9a6-3356-4624-b035-81c180d6276f could not be found. Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-72b7f26f-f48a-411f-bb7f-7cf90455bf3f tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Request method failure captured: Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5/os-volume_attachments/35fcc9a6-3356-4624-b035-81c180d6276f HTTP/1.1 Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 74 Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJvbRzp_71scIb5Wr8BhxvxE_7Fyag-dMofWmaFKIPP9R8rHEhlDHjNJ11jsY17ks3e-8buY_Sor6RhBddymmACXJEz3VOO7HCH8wuxY9Vig3nHc1F8-S9Pg8OA9cTMy8Xj4tEnjlKwSlfEHQchcgUNyC2TtBri6ENtWkAfpsRy9Z8 Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 51992f88a963446893dee41e7a3b7cc8 Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesAdminNegativeTest-1333989979 Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:41:35.748427 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_51992f88a963446893dee41e7a3b7cc8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/51992f88a963446893dee41e7a3b7cc8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/51992f88a963446893dee41e7a3b7cc8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/51992f88a963446893dee41e7a3b7cc8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesAdminNegativeTest-1333989979 Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 51992f88a963446893dee41e7a3b7cc8 Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1333989979 Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesAdminNegativeTest-1333989979-project-admin Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 72e28cc28eab4c808ffb20c8fa503323 Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesAdminNegativeTest-1333989979-project-admin Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: {"volumeAttachment": {"volumeId": "33fca086-dcc1-451c-917f-ad2bf208e7d3"}} Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:41:35.751165 n-d-852084-10 devstack@n-api.service[128970]: exception: Volume 35fcc9a6-3356-4624-b035-81c180d6276f could not be found. Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'server_id': 'b5582b0f-06e1-4423-9a14-ed3d2d1668f5', 'id': '35fcc9a6-3356-4624-b035-81c180d6276f', 'body': {'volumeAttachment': {'volumeId': '33fca086-dcc1-451c-917f-ad2bf208e7d3'}}} Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:41:35.752840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35fcc9a6-3356-4624-b035-81c180d6276f could not be found. (HTTP 404) (Request-ID: req-c3710a47-13c1-4011-88a7-92fac7789f7f) Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 12:41:35.754847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35fcc9a6-3356-4624-b035-81c180d6276f could not be found. Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:41:35.757063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35fcc9a6-3356-4624-b035-81c180d6276f could not be found. Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35fcc9a6-3356-4624-b035-81c180d6276f could not be found. Sep 08 12:41:35.759173 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:41:35.768216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-72b7f26f-f48a-411f-bb7f-7cf90455bf3f tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] Returning 404 to user: Volume 35fcc9a6-3356-4624-b035-81c180d6276f could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:41:35.768216 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-72b7f26f-f48a-411f-bb7f-7cf90455bf3f tempest-VolumesAdminNegativeTest-1333989979 tempest-VolumesAdminNegativeTest-1333989979-project-admin] 10.222.0.78 "PUT /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5/os-volume_attachments/35fcc9a6-3356-4624-b035-81c180d6276f" status: 404 len: 109 microversion: 2.1 time: 0.201596 Sep 08 12:41:35.768216 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 529/1067] 10.222.0.78 () {60 vars in 1433 bytes} [Thu Sep 8 12:41:35 2022] PUT /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5/os-volume_attachments/35fcc9a6-3356-4624-b035-81c180d6276f => generated 109 bytes in 215 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:41:35.842328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-798d3e4e-539b-4e9c-9ef9-0afc68b9372e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:35.843190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-798d3e4e-539b-4e9c-9ef9-0afc68b9372e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:35.868609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-798d3e4e-539b-4e9c-9ef9-0afc68b9372e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:35.869076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-798d3e4e-539b-4e9c-9ef9-0afc68b9372e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:35.869643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-798d3e4e-539b-4e9c-9ef9-0afc68b9372e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:35.870599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-798d3e4e-539b-4e9c-9ef9-0afc68b9372e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:35.871074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-798d3e4e-539b-4e9c-9ef9-0afc68b9372e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:35.871539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-798d3e4e-539b-4e9c-9ef9-0afc68b9372e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:35.873863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:35.914934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:35.923337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:35.929537 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1362 microversion: 2.25 time: 1.142286 Sep 08 12:41:35.930599 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 539/1068] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:34 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1362 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:35.933503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:35.936871 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-520e35cc-3d9b-465c-95fd-133031c44a84 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002756 Sep 08 12:41:35.937973 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 540/1069] 10.222.0.78 () {56 vars in 886 bytes} [Thu Sep 8 12:41:35 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 12:41:36.235443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-798d3e4e-539b-4e9c-9ef9-0afc68b9372e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:36.256055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-798d3e4e-539b-4e9c-9ef9-0afc68b9372e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:36.258316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-798d3e4e-539b-4e9c-9ef9-0afc68b9372e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:36.269672 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-798d3e4e-539b-4e9c-9ef9-0afc68b9372e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.432076 Sep 08 12:41:36.288431 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 530/1070] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:35 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:41:36.452020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-207de32a-776f-4763-8676-3773c58bbdbc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:36.453192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-207de32a-776f-4763-8676-3773c58bbdbc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:36.491505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-207de32a-776f-4763-8676-3773c58bbdbc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:36.493309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-207de32a-776f-4763-8676-3773c58bbdbc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:36.494335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-207de32a-776f-4763-8676-3773c58bbdbc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:36.496979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-207de32a-776f-4763-8676-3773c58bbdbc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:36.498079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-207de32a-776f-4763-8676-3773c58bbdbc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:36.499055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-207de32a-776f-4763-8676-3773c58bbdbc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:36.972607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-821db9f9-4236-4e12-a444-3b289296f672 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:36.976899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-821db9f9-4236-4e12-a444-3b289296f672 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:37.005778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-821db9f9-4236-4e12-a444-3b289296f672 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:37.014431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-821db9f9-4236-4e12-a444-3b289296f672 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:37.015244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-821db9f9-4236-4e12-a444-3b289296f672 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:37.021677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-821db9f9-4236-4e12-a444-3b289296f672 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:37.022533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-821db9f9-4236-4e12-a444-3b289296f672 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:37.030896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-821db9f9-4236-4e12-a444-3b289296f672 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:37.045380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-207de32a-776f-4763-8676-3773c58bbdbc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:37.064606 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-207de32a-776f-4763-8676-3773c58bbdbc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 0.621682 Sep 08 12:41:37.093775 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 541/1071] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:36 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:41:37.309810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-412adbdd-0fdc-49fb-b8fd-6c92ed9c7f51 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:37.312673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-412adbdd-0fdc-49fb-b8fd-6c92ed9c7f51 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:37.347949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-412adbdd-0fdc-49fb-b8fd-6c92ed9c7f51 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:37.349494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-412adbdd-0fdc-49fb-b8fd-6c92ed9c7f51 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:37.355666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-412adbdd-0fdc-49fb-b8fd-6c92ed9c7f51 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:37.359413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-412adbdd-0fdc-49fb-b8fd-6c92ed9c7f51 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:37.360610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-412adbdd-0fdc-49fb-b8fd-6c92ed9c7f51 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:37.364388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-412adbdd-0fdc-49fb-b8fd-6c92ed9c7f51 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:37.602100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-412adbdd-0fdc-49fb-b8fd-6c92ed9c7f51 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:37.620379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:37.627766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-412adbdd-0fdc-49fb-b8fd-6c92ed9c7f51 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:37.633566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-412adbdd-0fdc-49fb-b8fd-6c92ed9c7f51 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:37.666977 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-412adbdd-0fdc-49fb-b8fd-6c92ed9c7f51 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.366001 Sep 08 12:41:37.672136 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 542/1072] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:37 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:41:37.795828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-821db9f9-4236-4e12-a444-3b289296f672 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:37.807049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-821db9f9-4236-4e12-a444-3b289296f672 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:37.821126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-821db9f9-4236-4e12-a444-3b289296f672 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:37.826546 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-821db9f9-4236-4e12-a444-3b289296f672 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1362 microversion: 2.25 time: 0.862985 Sep 08 12:41:37.844051 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 531/1073] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:36 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1362 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:41:37.990185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f0b7da52-dafc-4b0c-927c-87792fde7ff2 req-9ee453a6-2d8c-403e-aced-8e9195a5934d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71e5bb7-a289-4944-926a-bee8b5bfe8ee", "tag": "5d38cff6-9d90-48f1-9f72-666a7a5acdc6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:38.063215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f0b7da52-dafc-4b0c-927c-87792fde7ff2 req-9ee453a6-2d8c-403e-aced-8e9195a5934d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:38.078546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f0b7da52-dafc-4b0c-927c-87792fde7ff2 req-9ee453a6-2d8c-403e-aced-8e9195a5934d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:38.079814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f0b7da52-dafc-4b0c-927c-87792fde7ff2 req-9ee453a6-2d8c-403e-aced-8e9195a5934d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:38.099174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9abc65b7-3a74-4d79-93bf-f86b26ae4283 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:38.100649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9abc65b7-3a74-4d79-93bf-f86b26ae4283 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:38.121679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9abc65b7-3a74-4d79-93bf-f86b26ae4283 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:38.122669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9abc65b7-3a74-4d79-93bf-f86b26ae4283 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:38.123679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9abc65b7-3a74-4d79-93bf-f86b26ae4283 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:38.124679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9abc65b7-3a74-4d79-93bf-f86b26ae4283 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:38.125731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9abc65b7-3a74-4d79-93bf-f86b26ae4283 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:38.127539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9abc65b7-3a74-4d79-93bf-f86b26ae4283 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:38.161444 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f0b7da52-dafc-4b0c-927c-87792fde7ff2 req-9ee453a6-2d8c-403e-aced-8e9195a5934d service nova] Creating event network-changed:5d38cff6-9d90-48f1-9f72-666a7a5acdc6 for instance c71e5bb7-a289-4944-926a-bee8b5bfe8ee on n-h1-852084-10 Sep 08 12:41:38.184842 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f0b7da52-dafc-4b0c-927c-87792fde7ff2 req-9ee453a6-2d8c-403e-aced-8e9195a5934d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202133 Sep 08 12:41:38.192098 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 543/1074] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:38.724544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b8141255-347f-4738-a2a4-c9d9ee6dc0a4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:38.725649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b8141255-347f-4738-a2a4-c9d9ee6dc0a4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:38.743899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:38.753004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8141255-347f-4738-a2a4-c9d9ee6dc0a4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:38.758079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8141255-347f-4738-a2a4-c9d9ee6dc0a4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:38.763043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8141255-347f-4738-a2a4-c9d9ee6dc0a4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:38.765517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8141255-347f-4738-a2a4-c9d9ee6dc0a4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:38.769437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8141255-347f-4738-a2a4-c9d9ee6dc0a4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:38.771834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8141255-347f-4738-a2a4-c9d9ee6dc0a4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:38.829616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:39.012108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9abc65b7-3a74-4d79-93bf-f86b26ae4283 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:39.060952 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9abc65b7-3a74-4d79-93bf-f86b26ae4283 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 0.965753 Sep 08 12:41:39.080351 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 532/1075] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:38 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:39.109538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2c756b62-bded-44dc-8c14-252f182fef53 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:39.111726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2c756b62-bded-44dc-8c14-252f182fef53 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:39.132694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b8141255-347f-4738-a2a4-c9d9ee6dc0a4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:39.169673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b8141255-347f-4738-a2a4-c9d9ee6dc0a4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:39.173589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b8141255-347f-4738-a2a4-c9d9ee6dc0a4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:39.175402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c756b62-bded-44dc-8c14-252f182fef53 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:39.176278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c756b62-bded-44dc-8c14-252f182fef53 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:39.177062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c756b62-bded-44dc-8c14-252f182fef53 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:39.189775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c756b62-bded-44dc-8c14-252f182fef53 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:39.193472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c756b62-bded-44dc-8c14-252f182fef53 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:39.195678 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b8141255-347f-4738-a2a4-c9d9ee6dc0a4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.475940 Sep 08 12:41:39.196894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c756b62-bded-44dc-8c14-252f182fef53 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:39.207576 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 544/1076] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:38 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:39.949268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:40.026188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2c756b62-bded-44dc-8c14-252f182fef53 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:40.086077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2c756b62-bded-44dc-8c14-252f182fef53 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:40.098309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2c756b62-bded-44dc-8c14-252f182fef53 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:40.101932 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2c756b62-bded-44dc-8c14-252f182fef53 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1362 microversion: 2.25 time: 1.016424 Sep 08 12:41:40.105185 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 533/1077] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:39 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1362 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:40.130098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d366d8c3-ccb0-4b4c-84be-d6a3d69f3cc7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:40.132735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d366d8c3-ccb0-4b4c-84be-d6a3d69f3cc7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:40.188536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d366d8c3-ccb0-4b4c-84be-d6a3d69f3cc7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:40.189433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d366d8c3-ccb0-4b4c-84be-d6a3d69f3cc7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:40.197252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d366d8c3-ccb0-4b4c-84be-d6a3d69f3cc7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:40.199672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d366d8c3-ccb0-4b4c-84be-d6a3d69f3cc7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:40.201260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d366d8c3-ccb0-4b4c-84be-d6a3d69f3cc7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:40.202385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d366d8c3-ccb0-4b4c-84be-d6a3d69f3cc7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:40.274954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-812608d4-4680-4abf-8f9b-64924d510bb3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:40.279328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-812608d4-4680-4abf-8f9b-64924d510bb3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:40.306748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-812608d4-4680-4abf-8f9b-64924d510bb3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:40.314828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-812608d4-4680-4abf-8f9b-64924d510bb3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:40.318396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-812608d4-4680-4abf-8f9b-64924d510bb3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:40.324040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-812608d4-4680-4abf-8f9b-64924d510bb3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:40.342347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-812608d4-4680-4abf-8f9b-64924d510bb3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:40.344722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-812608d4-4680-4abf-8f9b-64924d510bb3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:40.754332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-812608d4-4680-4abf-8f9b-64924d510bb3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:40.831491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-812608d4-4680-4abf-8f9b-64924d510bb3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:40.848998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-812608d4-4680-4abf-8f9b-64924d510bb3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:40.880160 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-812608d4-4680-4abf-8f9b-64924d510bb3 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.614407 Sep 08 12:41:40.886919 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 534/1078] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:40 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:41.111807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d366d8c3-ccb0-4b4c-84be-d6a3d69f3cc7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:41.125721 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d366d8c3-ccb0-4b4c-84be-d6a3d69f3cc7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 1.010233 Sep 08 12:41:41.134147 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 545/1079] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:40 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:41.161332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-22b989ef-4836-4965-8d2e-ce60a1707661 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:41.163265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-22b989ef-4836-4965-8d2e-ce60a1707661 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:41.218967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22b989ef-4836-4965-8d2e-ce60a1707661 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:41.219864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22b989ef-4836-4965-8d2e-ce60a1707661 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:41.220623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22b989ef-4836-4965-8d2e-ce60a1707661 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:41.221868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22b989ef-4836-4965-8d2e-ce60a1707661 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:41.231690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22b989ef-4836-4965-8d2e-ce60a1707661 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:41.236402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22b989ef-4836-4965-8d2e-ce60a1707661 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:41.922682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ed89b91-01a1-44f4-a54e-7c8d5ad9a9c2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:41.926861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ed89b91-01a1-44f4-a54e-7c8d5ad9a9c2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:41.950023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed89b91-01a1-44f4-a54e-7c8d5ad9a9c2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:41.950858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed89b91-01a1-44f4-a54e-7c8d5ad9a9c2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:41.951705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed89b91-01a1-44f4-a54e-7c8d5ad9a9c2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:41.953029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed89b91-01a1-44f4-a54e-7c8d5ad9a9c2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:41.965742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed89b91-01a1-44f4-a54e-7c8d5ad9a9c2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:41.967175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed89b91-01a1-44f4-a54e-7c8d5ad9a9c2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:42.332445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-22b989ef-4836-4965-8d2e-ce60a1707661 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:42.359111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-22b989ef-4836-4965-8d2e-ce60a1707661 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:42.366547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-22b989ef-4836-4965-8d2e-ce60a1707661 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:42.380888 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-22b989ef-4836-4965-8d2e-ce60a1707661 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1362 microversion: 2.25 time: 1.232514 Sep 08 12:41:42.382427 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 535/1080] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:41 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1362 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:42.397607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8121d6e-af85-48f7-92e2-fc4362f85c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:42.404481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b8121d6e-af85-48f7-92e2-fc4362f85c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:42.425454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8121d6e-af85-48f7-92e2-fc4362f85c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:42.426814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8121d6e-af85-48f7-92e2-fc4362f85c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:42.428009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8121d6e-af85-48f7-92e2-fc4362f85c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:42.435962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8121d6e-af85-48f7-92e2-fc4362f85c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:42.437184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8121d6e-af85-48f7-92e2-fc4362f85c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:42.438403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8121d6e-af85-48f7-92e2-fc4362f85c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:42.452910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ed89b91-01a1-44f4-a54e-7c8d5ad9a9c2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:42.499534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ed89b91-01a1-44f4-a54e-7c8d5ad9a9c2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:42.512823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ed89b91-01a1-44f4-a54e-7c8d5ad9a9c2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:42.526617 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ed89b91-01a1-44f4-a54e-7c8d5ad9a9c2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.615200 Sep 08 12:41:42.530457 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 546/1081] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:41 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:41:42.549635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-edc11950-2d5b-4865-b886-e2ff0896c4c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:42.550542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-edc11950-2d5b-4865-b886-e2ff0896c4c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:42.573568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edc11950-2d5b-4865-b886-e2ff0896c4c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:42.575340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edc11950-2d5b-4865-b886-e2ff0896c4c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:42.577243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edc11950-2d5b-4865-b886-e2ff0896c4c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:42.578586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edc11950-2d5b-4865-b886-e2ff0896c4c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:42.579451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edc11950-2d5b-4865-b886-e2ff0896c4c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:42.580294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edc11950-2d5b-4865-b886-e2ff0896c4c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:42.622365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b8121d6e-af85-48f7-92e2-fc4362f85c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:41:43.093080 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8121d6e-af85-48f7-92e2-fc4362f85c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 204 len: 0 microversion: 2.1 time: 0.708172 Sep 08 12:41:43.111434 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 536/1082] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:41:42 2022] DELETE /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:41:43.134499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-950dc762-7b75-43d0-9a70-cbef22220dd4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:43.135889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-950dc762-7b75-43d0-9a70-cbef22220dd4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:43.199480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-950dc762-7b75-43d0-9a70-cbef22220dd4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:43.205764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-950dc762-7b75-43d0-9a70-cbef22220dd4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:43.210567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-950dc762-7b75-43d0-9a70-cbef22220dd4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:43.214535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-950dc762-7b75-43d0-9a70-cbef22220dd4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:43.224445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-950dc762-7b75-43d0-9a70-cbef22220dd4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:43.225284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-950dc762-7b75-43d0-9a70-cbef22220dd4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:43.756709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-edc11950-2d5b-4865-b886-e2ff0896c4c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:43.778788 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-edc11950-2d5b-4865-b886-e2ff0896c4c0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 1.244177 Sep 08 12:41:43.789282 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 547/1083] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:42 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:43.799304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-29d0e3c5-33c9-4c4d-b2f4-ae984854fde4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:43.821939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-29d0e3c5-33c9-4c4d-b2f4-ae984854fde4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:43.849742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29d0e3c5-33c9-4c4d-b2f4-ae984854fde4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:43.851488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29d0e3c5-33c9-4c4d-b2f4-ae984854fde4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:43.856390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29d0e3c5-33c9-4c4d-b2f4-ae984854fde4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:43.858136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29d0e3c5-33c9-4c4d-b2f4-ae984854fde4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:43.859345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29d0e3c5-33c9-4c4d-b2f4-ae984854fde4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:43.863662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29d0e3c5-33c9-4c4d-b2f4-ae984854fde4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:44.322994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-950dc762-7b75-43d0-9a70-cbef22220dd4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:44.356634 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-950dc762-7b75-43d0-9a70-cbef22220dd4 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1513 microversion: 2.1 time: 1.241823 Sep 08 12:41:44.358249 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 537/1084] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:43 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1513 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:44.377203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cbea3ce2-ec88-4c62-8b8e-9e6b525820b6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:44.378827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cbea3ce2-ec88-4c62-8b8e-9e6b525820b6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:44.409933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbea3ce2-ec88-4c62-8b8e-9e6b525820b6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:44.411469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbea3ce2-ec88-4c62-8b8e-9e6b525820b6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:44.412321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbea3ce2-ec88-4c62-8b8e-9e6b525820b6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:44.414024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbea3ce2-ec88-4c62-8b8e-9e6b525820b6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:44.421951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbea3ce2-ec88-4c62-8b8e-9e6b525820b6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:44.423063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbea3ce2-ec88-4c62-8b8e-9e6b525820b6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:44.796172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-29d0e3c5-33c9-4c4d-b2f4-ae984854fde4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:44.817358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cbea3ce2-ec88-4c62-8b8e-9e6b525820b6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:44.853980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-29d0e3c5-33c9-4c4d-b2f4-ae984854fde4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:44.858703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-29d0e3c5-33c9-4c4d-b2f4-ae984854fde4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:44.862979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cbea3ce2-ec88-4c62-8b8e-9e6b525820b6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:44.871775 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-29d0e3c5-33c9-4c4d-b2f4-ae984854fde4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1362 microversion: 2.25 time: 1.079914 Sep 08 12:41:44.874911 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 548/1085] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:43 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1362 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:44.877218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cbea3ce2-ec88-4c62-8b8e-9e6b525820b6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:44.907689 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cbea3ce2-ec88-4c62-8b8e-9e6b525820b6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.547033 Sep 08 12:41:44.908807 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 538/1086] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:44 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:44.909962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-627f2b49-30dd-4158-9115-25bd2cdbda10 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:44.911759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-627f2b49-30dd-4158-9115-25bd2cdbda10 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:44.945172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-627f2b49-30dd-4158-9115-25bd2cdbda10 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:44.946220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-627f2b49-30dd-4158-9115-25bd2cdbda10 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:44.947162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-627f2b49-30dd-4158-9115-25bd2cdbda10 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:44.949292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-627f2b49-30dd-4158-9115-25bd2cdbda10 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:44.950331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-627f2b49-30dd-4158-9115-25bd2cdbda10 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:44.951274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-627f2b49-30dd-4158-9115-25bd2cdbda10 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:45.409286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4bb8d0a4-d42b-48ac-9fb2-b3a53cc61acc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:45.410567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4bb8d0a4-d42b-48ac-9fb2-b3a53cc61acc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:45.433891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bb8d0a4-d42b-48ac-9fb2-b3a53cc61acc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:45.434428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bb8d0a4-d42b-48ac-9fb2-b3a53cc61acc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:45.434870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bb8d0a4-d42b-48ac-9fb2-b3a53cc61acc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:45.435703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bb8d0a4-d42b-48ac-9fb2-b3a53cc61acc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:45.436369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bb8d0a4-d42b-48ac-9fb2-b3a53cc61acc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:45.436805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bb8d0a4-d42b-48ac-9fb2-b3a53cc61acc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:45.631654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-627f2b49-30dd-4158-9115-25bd2cdbda10 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:45.662333 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-627f2b49-30dd-4158-9115-25bd2cdbda10 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 0.779070 Sep 08 12:41:45.674636 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 549/1087] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:44 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:45.815451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4bb8d0a4-d42b-48ac-9fb2-b3a53cc61acc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:45.829233 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4bb8d0a4-d42b-48ac-9fb2-b3a53cc61acc tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1513 microversion: 2.1 time: 0.426365 Sep 08 12:41:45.831181 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 539/1088] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:45 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1513 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:41:45.909117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-017d84e7-846a-4b82-bd92-05d451a5ca59 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:45.910227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-017d84e7-846a-4b82-bd92-05d451a5ca59 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:45.922240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017d84e7-846a-4b82-bd92-05d451a5ca59 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:45.923836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017d84e7-846a-4b82-bd92-05d451a5ca59 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:45.925031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017d84e7-846a-4b82-bd92-05d451a5ca59 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:45.926740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017d84e7-846a-4b82-bd92-05d451a5ca59 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:45.928038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017d84e7-846a-4b82-bd92-05d451a5ca59 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:45.929554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-017d84e7-846a-4b82-bd92-05d451a5ca59 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:45.946498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-171ac243-b699-498c-bb3e-5c47f112d92a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:45.947475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-171ac243-b699-498c-bb3e-5c47f112d92a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:45.960941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:45.966441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-171ac243-b699-498c-bb3e-5c47f112d92a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:45.966945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-171ac243-b699-498c-bb3e-5c47f112d92a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:45.969619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-171ac243-b699-498c-bb3e-5c47f112d92a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:45.976146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-171ac243-b699-498c-bb3e-5c47f112d92a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:45.976948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-171ac243-b699-498c-bb3e-5c47f112d92a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:45.977405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-171ac243-b699-498c-bb3e-5c47f112d92a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:46.220910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-171ac243-b699-498c-bb3e-5c47f112d92a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:46.238378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-171ac243-b699-498c-bb3e-5c47f112d92a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:46.254163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-171ac243-b699-498c-bb3e-5c47f112d92a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:46.269131 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-171ac243-b699-498c-bb3e-5c47f112d92a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1537 microversion: 2.91 time: 0.337133 Sep 08 12:41:46.270550 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 540/1089] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:45 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1537 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:46.372565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-017d84e7-846a-4b82-bd92-05d451a5ca59 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:46.385254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-017d84e7-846a-4b82-bd92-05d451a5ca59 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:46.388224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-017d84e7-846a-4b82-bd92-05d451a5ca59 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:46.390030 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-017d84e7-846a-4b82-bd92-05d451a5ca59 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1362 microversion: 2.25 time: 0.488693 Sep 08 12:41:46.391437 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 550/1090] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:45 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1362 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:46.701499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-09bfcae5-7275-4dd9-b3b5-e505f3bd621b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:46.702500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-09bfcae5-7275-4dd9-b3b5-e505f3bd621b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:46.718832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09bfcae5-7275-4dd9-b3b5-e505f3bd621b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:46.723739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09bfcae5-7275-4dd9-b3b5-e505f3bd621b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:46.734500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09bfcae5-7275-4dd9-b3b5-e505f3bd621b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:46.736196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09bfcae5-7275-4dd9-b3b5-e505f3bd621b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:46.740868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09bfcae5-7275-4dd9-b3b5-e505f3bd621b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:46.741615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09bfcae5-7275-4dd9-b3b5-e505f3bd621b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:46.855832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0adf9fed-ee44-4602-9678-af101b765018 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:46.857235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0adf9fed-ee44-4602-9678-af101b765018 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:46.876433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0adf9fed-ee44-4602-9678-af101b765018 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:46.878021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0adf9fed-ee44-4602-9678-af101b765018 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:46.878672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0adf9fed-ee44-4602-9678-af101b765018 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:46.880064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0adf9fed-ee44-4602-9678-af101b765018 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:46.881028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0adf9fed-ee44-4602-9678-af101b765018 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:46.886642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0adf9fed-ee44-4602-9678-af101b765018 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:47.081109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0adf9fed-ee44-4602-9678-af101b765018 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:47.097681 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0adf9fed-ee44-4602-9678-af101b765018 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1471 microversion: 2.1 time: 0.246478 Sep 08 12:41:47.100326 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 551/1091] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:46 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1471 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:47.139106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f25b7c72-d584-4015-8726-3b45bfbdfab0 req-d6ccfc82-fd5a-409a-b801-2d37e85e672d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5582b0f-06e1-4423-9a14-ed3d2d1668f5", "name": "network-vif-deleted", "tag": "a9e22ed5-d751-4fb9-bb65-3ccccd7b5e8c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:47.140468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-09bfcae5-7275-4dd9-b3b5-e505f3bd621b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:47.159402 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-09bfcae5-7275-4dd9-b3b5-e505f3bd621b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 0.464873 Sep 08 12:41:47.161048 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 541/1092] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:46 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:41:47.170270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f25b7c72-d584-4015-8726-3b45bfbdfab0 req-d6ccfc82-fd5a-409a-b801-2d37e85e672d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:47.170950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f25b7c72-d584-4015-8726-3b45bfbdfab0 req-d6ccfc82-fd5a-409a-b801-2d37e85e672d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:47.171869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f25b7c72-d584-4015-8726-3b45bfbdfab0 req-d6ccfc82-fd5a-409a-b801-2d37e85e672d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:47.188972 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f25b7c72-d584-4015-8726-3b45bfbdfab0 req-d6ccfc82-fd5a-409a-b801-2d37e85e672d service nova] Creating event network-vif-deleted:a9e22ed5-d751-4fb9-bb65-3ccccd7b5e8c for instance b5582b0f-06e1-4423-9a14-ed3d2d1668f5 on n-h1-852084-10 Sep 08 12:41:47.197792 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f25b7c72-d584-4015-8726-3b45bfbdfab0 req-d6ccfc82-fd5a-409a-b801-2d37e85e672d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066508 Sep 08 12:41:47.201801 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 552/1093] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:41:47.327517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d07f3a64-143d-4ee8-a1f7-1396a20bb09b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:47.329129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d07f3a64-143d-4ee8-a1f7-1396a20bb09b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:47.348531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d07f3a64-143d-4ee8-a1f7-1396a20bb09b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:47.349383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d07f3a64-143d-4ee8-a1f7-1396a20bb09b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:47.350464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d07f3a64-143d-4ee8-a1f7-1396a20bb09b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:47.351833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d07f3a64-143d-4ee8-a1f7-1396a20bb09b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:47.352672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d07f3a64-143d-4ee8-a1f7-1396a20bb09b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:47.353442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d07f3a64-143d-4ee8-a1f7-1396a20bb09b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:47.452659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-35dbd007-f9ce-4a8b-8fbe-11c33f50c521 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:47.453911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-35dbd007-f9ce-4a8b-8fbe-11c33f50c521 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:47.465906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35dbd007-f9ce-4a8b-8fbe-11c33f50c521 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:47.466656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35dbd007-f9ce-4a8b-8fbe-11c33f50c521 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:47.477311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35dbd007-f9ce-4a8b-8fbe-11c33f50c521 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:47.478560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35dbd007-f9ce-4a8b-8fbe-11c33f50c521 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:47.479937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35dbd007-f9ce-4a8b-8fbe-11c33f50c521 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:47.480743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35dbd007-f9ce-4a8b-8fbe-11c33f50c521 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:47.659429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d07f3a64-143d-4ee8-a1f7-1396a20bb09b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:47.743062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d07f3a64-143d-4ee8-a1f7-1396a20bb09b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:47.761179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d07f3a64-143d-4ee8-a1f7-1396a20bb09b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:47.818230 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d07f3a64-143d-4ee8-a1f7-1396a20bb09b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1537 microversion: 2.91 time: 0.499395 Sep 08 12:41:47.827754 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 542/1094] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:47 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1537 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:41:48.169888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-35dbd007-f9ce-4a8b-8fbe-11c33f50c521 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:48.190718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-35dbd007-f9ce-4a8b-8fbe-11c33f50c521 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:48.193672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-35dbd007-f9ce-4a8b-8fbe-11c33f50c521 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:48.197199 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-35dbd007-f9ce-4a8b-8fbe-11c33f50c521 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1362 microversion: 2.25 time: 0.764573 Sep 08 12:41:48.212359 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 553/1095] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:47 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1362 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:41:48.265303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:48.269944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:48.307733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:48.315095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:48.316018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:48.318792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:48.320380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:48.322477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:48.346455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44095663-d1d0-4995-abbe-32112cc05042 tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Calling method '.version_select at 0x7fdb36ca2ee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:48.349958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44095663-d1d0-4995-abbe-32112cc05042 tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:48.350780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44095663-d1d0-4995-abbe-32112cc05042 tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:48.351592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44095663-d1d0-4995-abbe-32112cc05042 tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:48.359123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:48.379783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44095663-d1d0-4995-abbe-32112cc05042 tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:48.380960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44095663-d1d0-4995-abbe-32112cc05042 tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:48.381962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44095663-d1d0-4995-abbe-32112cc05042 tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:48.389834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:48.390454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:48.391216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:48.391519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lazy-loading 'fault' on Instance uuid b5582b0f-06e1-4423-9a14-ed3d2d1668f5 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:41:48.408288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44095663-d1d0-4995-abbe-32112cc05042 tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:48.409757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44095663-d1d0-4995-abbe-32112cc05042 tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:48.410895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44095663-d1d0-4995-abbe-32112cc05042 tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:48.426075 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44095663-d1d0-4995-abbe-32112cc05042 tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.595621 Sep 08 12:41:48.428092 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 543/1096] 10.222.0.78 () {60 vars in 1187 bytes} [Thu Sep 8 12:41:47 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:41:48.438103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9af911f3-ee24-4083-aa98-8b87ffd90334 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:48.440255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9af911f3-ee24-4083-aa98-8b87ffd90334 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:48.453883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9af911f3-ee24-4083-aa98-8b87ffd90334 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:48.455461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9af911f3-ee24-4083-aa98-8b87ffd90334 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:48.456558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9af911f3-ee24-4083-aa98-8b87ffd90334 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:48.458129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9af911f3-ee24-4083-aa98-8b87ffd90334 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:48.459474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9af911f3-ee24-4083-aa98-8b87ffd90334 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:48.460602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9af911f3-ee24-4083-aa98-8b87ffd90334 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:48.471752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:48.491386 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1663c0ac-b6df-44b6-8e9b-4f5f07a07245 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1307 microversion: 2.1 time: 0.276702 Sep 08 12:41:48.508764 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 554/1097] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:48 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1307 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:48.520056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cbb511f9-2b68-4b1e-aaf7-0af25f1d728f tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Calling method '.version_select at 0x7fdb3b0a33a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:48.523837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbb511f9-2b68-4b1e-aaf7-0af25f1d728f tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:48.524884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbb511f9-2b68-4b1e-aaf7-0af25f1d728f tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:48.525878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbb511f9-2b68-4b1e-aaf7-0af25f1d728f tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:48.544331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbb511f9-2b68-4b1e-aaf7-0af25f1d728f tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:48.545268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbb511f9-2b68-4b1e-aaf7-0af25f1d728f tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:48.546132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbb511f9-2b68-4b1e-aaf7-0af25f1d728f tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:48.556842 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cbb511f9-2b68-4b1e-aaf7-0af25f1d728f tempest-HypervisorAdminV228Test-549006789 tempest-HypervisorAdminV228Test-549006789-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 719 microversion: 2.28 time: 0.046125 Sep 08 12:41:48.572963 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 555/1098] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Sep 8 12:41:48 2022] GET /compute/v2.1/os-hypervisors/1 => generated 719 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:41:48.774812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9af911f3-ee24-4083-aa98-8b87ffd90334 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:48.801806 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9af911f3-ee24-4083-aa98-8b87ffd90334 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 0.371026 Sep 08 12:41:48.819524 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 544/1099] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:48 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:48.888466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a076fd3e-948f-4845-865a-50154944b154 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:48.889068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a076fd3e-948f-4845-865a-50154944b154 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:48.929177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a076fd3e-948f-4845-865a-50154944b154 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:48.930491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a076fd3e-948f-4845-865a-50154944b154 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:48.931355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a076fd3e-948f-4845-865a-50154944b154 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:48.933284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a076fd3e-948f-4845-865a-50154944b154 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:48.934188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a076fd3e-948f-4845-865a-50154944b154 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:48.935367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a076fd3e-948f-4845-865a-50154944b154 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:48.969315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-485b1801-5f31-405f-bbba-c9948cae457f req-465d8cbd-ae1f-4b5b-acad-7723582449da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71e5bb7-a289-4944-926a-bee8b5bfe8ee", "name": "network-vif-plugged", "status": "completed", "tag": "5d38cff6-9d90-48f1-9f72-666a7a5acdc6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:48.998878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-485b1801-5f31-405f-bbba-c9948cae457f req-465d8cbd-ae1f-4b5b-acad-7723582449da service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:49.000437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-485b1801-5f31-405f-bbba-c9948cae457f req-465d8cbd-ae1f-4b5b-acad-7723582449da service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:49.006914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-485b1801-5f31-405f-bbba-c9948cae457f req-465d8cbd-ae1f-4b5b-acad-7723582449da service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:49.040446 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-485b1801-5f31-405f-bbba-c9948cae457f req-465d8cbd-ae1f-4b5b-acad-7723582449da service nova] Creating event network-vif-plugged:5d38cff6-9d90-48f1-9f72-666a7a5acdc6 for instance c71e5bb7-a289-4944-926a-bee8b5bfe8ee on n-h1-852084-10 Sep 08 12:41:49.049093 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-485b1801-5f31-405f-bbba-c9948cae457f req-465d8cbd-ae1f-4b5b-acad-7723582449da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084030 Sep 08 12:41:49.050683 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 545/1100] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:49.134539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a076fd3e-948f-4845-865a-50154944b154 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:49.149510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a076fd3e-948f-4845-865a-50154944b154 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:49.151605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a076fd3e-948f-4845-865a-50154944b154 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:49.167071 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a076fd3e-948f-4845-865a-50154944b154 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1480 microversion: 2.91 time: 0.294870 Sep 08 12:41:49.168926 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 556/1101] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:48 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1480 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:49.220470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f8d18bb0-b321-4dbc-ba08-e87a787b1bd3 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-852084-10"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:49.223822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f8d18bb0-b321-4dbc-ba08-e87a787b1bd3 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:49.238032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8d18bb0-b321-4dbc-ba08-e87a787b1bd3 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:49.238582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8d18bb0-b321-4dbc-ba08-e87a787b1bd3 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:49.239065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8d18bb0-b321-4dbc-ba08-e87a787b1bd3 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:49.240110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8d18bb0-b321-4dbc-ba08-e87a787b1bd3 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:49.240663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8d18bb0-b321-4dbc-ba08-e87a787b1bd3 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:49.243313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8d18bb0-b321-4dbc-ba08-e87a787b1bd3 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:49.252776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b903060a-d5f5-4d31-a9ca-f383ddedb1b2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:49.255615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b903060a-d5f5-4d31-a9ca-f383ddedb1b2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:49.277004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b903060a-d5f5-4d31-a9ca-f383ddedb1b2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:49.278372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b903060a-d5f5-4d31-a9ca-f383ddedb1b2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:49.279952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b903060a-d5f5-4d31-a9ca-f383ddedb1b2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:49.283699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b903060a-d5f5-4d31-a9ca-f383ddedb1b2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:49.284530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b903060a-d5f5-4d31-a9ca-f383ddedb1b2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:49.285649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b903060a-d5f5-4d31-a9ca-f383ddedb1b2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:49.424702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f8d18bb0-b321-4dbc-ba08-e87a787b1bd3 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-852084-10". {{(pid=128970) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 12:41:49.690514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b903060a-d5f5-4d31-a9ca-f383ddedb1b2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:49.707681 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f8d18bb0-b321-4dbc-ba08-e87a787b1bd3 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815/action" status: 202 len: 0 microversion: 2.91 time: 0.492428 Sep 08 12:41:49.711145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b903060a-d5f5-4d31-a9ca-f383ddedb1b2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:49.711874 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 546/1102] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 12:41:49 2022] POST /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 08 12:41:49.715434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b903060a-d5f5-4d31-a9ca-f383ddedb1b2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:49.718959 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b903060a-d5f5-4d31-a9ca-f383ddedb1b2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1362 microversion: 2.25 time: 0.473743 Sep 08 12:41:49.720726 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 557/1103] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:49 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1362 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:41:49.727203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:49.728292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:49.730405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5ee351e8-a507-4381-8526-5892a46c1ec4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:49.731847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5ee351e8-a507-4381-8526-5892a46c1ec4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:49.737266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:49.746218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ee351e8-a507-4381-8526-5892a46c1ec4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:49.747026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ee351e8-a507-4381-8526-5892a46c1ec4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:49.747810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ee351e8-a507-4381-8526-5892a46c1ec4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:49.756756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ee351e8-a507-4381-8526-5892a46c1ec4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:49.758419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ee351e8-a507-4381-8526-5892a46c1ec4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:49.763722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ee351e8-a507-4381-8526-5892a46c1ec4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:49.767394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:49.769527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:49.771712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:49.773096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:49.779047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:49.781538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:49.889768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:49.890721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:49.893679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:49.895484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lazy-loading 'fault' on Instance uuid b5582b0f-06e1-4423-9a14-ed3d2d1668f5 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:41:50.009128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5ee351e8-a507-4381-8526-5892a46c1ec4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:50.037995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5ee351e8-a507-4381-8526-5892a46c1ec4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:50.054237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5ee351e8-a507-4381-8526-5892a46c1ec4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:50.070090 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5ee351e8-a507-4381-8526-5892a46c1ec4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1488 microversion: 2.91 time: 0.341359 Sep 08 12:41:50.081729 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 558/1104] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:49 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1488 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:50.093897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-130a8c43-f63c-48fc-97cb-554529b96784 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:50.096072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-130a8c43-f63c-48fc-97cb-554529b96784 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:50.109076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-130a8c43-f63c-48fc-97cb-554529b96784 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:50.110517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-130a8c43-f63c-48fc-97cb-554529b96784 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:50.111700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-130a8c43-f63c-48fc-97cb-554529b96784 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:50.113347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-130a8c43-f63c-48fc-97cb-554529b96784 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:50.114459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-130a8c43-f63c-48fc-97cb-554529b96784 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:50.115744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-130a8c43-f63c-48fc-97cb-554529b96784 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:50.632328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:50.667074 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ea372135-d9da-464e-8570-81dd4d2d3c5e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 200 len: 1307 microversion: 2.1 time: 0.952557 Sep 08 12:41:50.670013 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 547/1105] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:49 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 1307 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:50.777185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-06edcc78-190c-4a38-ba86-33a2342ac3a9 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:50.778396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-06edcc78-190c-4a38-ba86-33a2342ac3a9 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:50.808109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06edcc78-190c-4a38-ba86-33a2342ac3a9 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:50.808989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06edcc78-190c-4a38-ba86-33a2342ac3a9 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:50.809766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06edcc78-190c-4a38-ba86-33a2342ac3a9 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:50.811125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06edcc78-190c-4a38-ba86-33a2342ac3a9 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:50.812039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06edcc78-190c-4a38-ba86-33a2342ac3a9 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:50.812886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06edcc78-190c-4a38-ba86-33a2342ac3a9 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:51.267111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-130a8c43-f63c-48fc-97cb-554529b96784 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:51.281102 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-130a8c43-f63c-48fc-97cb-554529b96784 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 1.197053 Sep 08 12:41:51.289920 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 559/1106] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:50 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:51.304335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7f3e7694-1ac5-47ba-8569-feccb5c0d59d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:51.304965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f3e7694-1ac5-47ba-8569-feccb5c0d59d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:51.317455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f3e7694-1ac5-47ba-8569-feccb5c0d59d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:51.317962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f3e7694-1ac5-47ba-8569-feccb5c0d59d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:51.318523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f3e7694-1ac5-47ba-8569-feccb5c0d59d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:51.321630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f3e7694-1ac5-47ba-8569-feccb5c0d59d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:51.324926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f3e7694-1ac5-47ba-8569-feccb5c0d59d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:51.325970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f3e7694-1ac5-47ba-8569-feccb5c0d59d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:51.387525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-06edcc78-190c-4a38-ba86-33a2342ac3a9 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:51.415403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-06edcc78-190c-4a38-ba86-33a2342ac3a9 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:51.421047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-06edcc78-190c-4a38-ba86-33a2342ac3a9 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:51.424840 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-06edcc78-190c-4a38-ba86-33a2342ac3a9 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1362 microversion: 2.25 time: 0.657948 Sep 08 12:41:51.426212 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 548/1107] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:50 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1362 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:51.466288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7f3e7694-1ac5-47ba-8569-feccb5c0d59d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:51.469494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:41:51.495793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7f3e7694-1ac5-47ba-8569-feccb5c0d59d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:51.497786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7f3e7694-1ac5-47ba-8569-feccb5c0d59d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:51.504349 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7f3e7694-1ac5-47ba-8569-feccb5c0d59d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1488 microversion: 2.91 time: 0.213138 Sep 08 12:41:51.519947 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 560/1108] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:51 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1488 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:51.700479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8cefca59-1866-41a6-8827-f3be3188933e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:51.703029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8cefca59-1866-41a6-8827-f3be3188933e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: b5582b0f-06e1-4423-9a14-ed3d2d1668f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:51.715905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8cefca59-1866-41a6-8827-f3be3188933e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:51.716788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8cefca59-1866-41a6-8827-f3be3188933e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:51.717617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8cefca59-1866-41a6-8827-f3be3188933e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:51.718611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8cefca59-1866-41a6-8827-f3be3188933e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:51.719490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8cefca59-1866-41a6-8827-f3be3188933e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:51.720359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8cefca59-1866-41a6-8827-f3be3188933e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:51.746263 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-8cefca59-1866-41a6-8827-f3be3188933e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] HTTP exception thrown: Instance b5582b0f-06e1-4423-9a14-ed3d2d1668f5 could not be found. Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8cefca59-1866-41a6-8827-f3be3188933e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Request method failure captured: Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 HTTP/1.1 Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeJYtY5fPIo9ZXD4tPdAZobSOuX-w2Yu5wAlosO-4GjAAE9egT1dye9-ogqEtrym1fHZyBAwMJytc2Yr9FmuXU_bK-BkZ-3X9IBVF2-tZcqV_Zu6wH-4lAUzfkLeDPvIiJt0PF7SiMFj9ZJxJcUk-IVDHCABdIJMC8FdfEKhTVfvCs4 Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 3dc8fdfffe814f59ad6b22da13094cc9 Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-VolumesAdminNegativeTest-206436524 Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:41:51.748676 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:41:51.750944 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3dc8fdfffe814f59ad6b22da13094cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3dc8fdfffe814f59ad6b22da13094cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3dc8fdfffe814f59ad6b22da13094cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3dc8fdfffe814f59ad6b22da13094cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:41:51.750944 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-VolumesAdminNegativeTest-206436524 Sep 08 12:41:51.750944 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 3dc8fdfffe814f59ad6b22da13094cc9 Sep 08 12:41:51.750944 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-206436524 Sep 08 12:41:51.750944 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-VolumesAdminNegativeTest-206436524-project Sep 08 12:41:51.750944 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:41:51.750944 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:41:51.750944 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 8f1fd37230b4490389ff38162ea813b9 Sep 08 12:41:51.750944 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-VolumesAdminNegativeTest-206436524-project Sep 08 12:41:51.750944 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:41:51.750944 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance b5582b0f-06e1-4423-9a14-ed3d2d1668f5 could not be found. Sep 08 12:41:51.750944 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'b5582b0f-06e1-4423-9a14-ed3d2d1668f5'} Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5582b0f-06e1-4423-9a14-ed3d2d1668f5 could not be found. Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:41:51.751808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5582b0f-06e1-4423-9a14-ed3d2d1668f5 could not be found. Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5582b0f-06e1-4423-9a14-ed3d2d1668f5 could not be found. Sep 08 12:41:51.753224 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:41:51.766875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8cefca59-1866-41a6-8827-f3be3188933e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Returning 404 to user: Instance b5582b0f-06e1-4423-9a14-ed3d2d1668f5 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:41:51.771977 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8cefca59-1866-41a6-8827-f3be3188933e tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5" status: 404 len: 111 microversion: 2.1 time: 0.075871 Sep 08 12:41:51.773073 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 561/1109] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:51 2022] GET /compute/v2.1/servers/b5582b0f-06e1-4423-9a14-ed3d2d1668f5 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:41:52.186401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1853889761", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "537f47b6-a4a4-481b-95fa-dc20a0bdcd66"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:52.335203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] validate_networks() for [('537f47b6-a4a4-481b-95fa-dc20a0bdcd66', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:41:52.336311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63c42d69-1db2-4385-89d0-75aa4ab42b64 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:52.336983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-63c42d69-1db2-4385-89d0-75aa4ab42b64 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:52.346160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63c42d69-1db2-4385-89d0-75aa4ab42b64 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:52.347008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63c42d69-1db2-4385-89d0-75aa4ab42b64 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:52.347658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63c42d69-1db2-4385-89d0-75aa4ab42b64 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:52.348592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63c42d69-1db2-4385-89d0-75aa4ab42b64 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:52.349239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63c42d69-1db2-4385-89d0-75aa4ab42b64 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:52.349861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63c42d69-1db2-4385-89d0-75aa4ab42b64 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:52.754336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-63c42d69-1db2-4385-89d0-75aa4ab42b64 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:52.786845 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-63c42d69-1db2-4385-89d0-75aa4ab42b64 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1542 microversion: 2.1 time: 0.457247 Sep 08 12:41:52.799973 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 562/1110] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:52 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1542 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:41:52.799973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-08943fab-a33e-4d8f-a878-3d6e196275c8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:52.799973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-08943fab-a33e-4d8f-a878-3d6e196275c8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:52.814924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08943fab-a33e-4d8f-a878-3d6e196275c8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:52.814924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08943fab-a33e-4d8f-a878-3d6e196275c8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:52.814924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08943fab-a33e-4d8f-a878-3d6e196275c8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:52.814924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08943fab-a33e-4d8f-a878-3d6e196275c8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:52.815500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08943fab-a33e-4d8f-a878-3d6e196275c8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:52.815500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08943fab-a33e-4d8f-a878-3d6e196275c8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:53.835613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-08943fab-a33e-4d8f-a878-3d6e196275c8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:53.845194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:41:53.846025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:41:53.846185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:41:53.846652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:41:53.847043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:41:53.867997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-08943fab-a33e-4d8f-a878-3d6e196275c8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:53.870830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:53.871403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:53.872043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:53.874410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:53.874677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-08943fab-a33e-4d8f-a878-3d6e196275c8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:53.875086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:53.875799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:53.879104 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-08943fab-a33e-4d8f-a878-3d6e196275c8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1557 microversion: 2.25 time: 1.089589 Sep 08 12:41:53.911515 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 563/1111] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:52 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1557 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:53.927943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Getting quotas for project dd43c0505e05417aa4004cc015d919c6. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:41:53.936762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Getting quotas for user ca5a5815b22c4a6e8f5016083e547662 and project dd43c0505e05417aa4004cc015d919c6. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:41:53.976306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:41:53.979933 n-d-852084-10 devstack@n-api.service[128970]: WARNING nova.utils [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1853889761 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-185388976 Sep 08 12:41:53.980390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-70b89838-3899-4cb7-b2a8-346b70a363df tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:53.981595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-70b89838-3899-4cb7-b2a8-346b70a363df tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:53.987767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:41:54.002330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70b89838-3899-4cb7-b2a8-346b70a363df tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:54.003214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70b89838-3899-4cb7-b2a8-346b70a363df tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:54.003974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70b89838-3899-4cb7-b2a8-346b70a363df tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:54.005141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70b89838-3899-4cb7-b2a8-346b70a363df tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:54.005747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70b89838-3899-4cb7-b2a8-346b70a363df tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:54.006296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70b89838-3899-4cb7-b2a8-346b70a363df tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:54.097982 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-46af7189-177a-4986-9313-81a6fb395f3a tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.669844 Sep 08 12:41:54.099186 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 549/1112] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:41:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:41:54.118865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dfb90212-7d22-4c53-aaf6-3c38707e44d1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:54.123656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dfb90212-7d22-4c53-aaf6-3c38707e44d1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:54.139394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfb90212-7d22-4c53-aaf6-3c38707e44d1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:54.145083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfb90212-7d22-4c53-aaf6-3c38707e44d1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:54.145807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfb90212-7d22-4c53-aaf6-3c38707e44d1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:54.147422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfb90212-7d22-4c53-aaf6-3c38707e44d1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:54.148746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfb90212-7d22-4c53-aaf6-3c38707e44d1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:54.149347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfb90212-7d22-4c53-aaf6-3c38707e44d1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:54.178656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-70b89838-3899-4cb7-b2a8-346b70a363df tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:54.191363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-70b89838-3899-4cb7-b2a8-346b70a363df tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:54.203466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-70b89838-3899-4cb7-b2a8-346b70a363df tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:54.212837 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-70b89838-3899-4cb7-b2a8-346b70a363df tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.281304 Sep 08 12:41:54.214010 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 564/1113] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:53 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:54.230364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5a8a8a36-f9fe-4dd5-8929-4d3370851f1b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:54.231490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5a8a8a36-f9fe-4dd5-8929-4d3370851f1b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:54.242447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a8a8a36-f9fe-4dd5-8929-4d3370851f1b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:54.254257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a8a8a36-f9fe-4dd5-8929-4d3370851f1b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:54.255202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a8a8a36-f9fe-4dd5-8929-4d3370851f1b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:54.256365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a8a8a36-f9fe-4dd5-8929-4d3370851f1b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:54.257192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a8a8a36-f9fe-4dd5-8929-4d3370851f1b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:54.257930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a8a8a36-f9fe-4dd5-8929-4d3370851f1b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:54.690340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dfb90212-7d22-4c53-aaf6-3c38707e44d1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:54.743980 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dfb90212-7d22-4c53-aaf6-3c38707e44d1 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1541 microversion: 2.1 time: 0.640485 Sep 08 12:41:54.759264 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 550/1114] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:54 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1541 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:54.781758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e670075-4d2e-4580-ad17-23dd9ebfb667 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:54.783357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2e670075-4d2e-4580-ad17-23dd9ebfb667 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:54.856808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-5a8a8a36-f9fe-4dd5-8929-4d3370851f1b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid c71e5bb7-a289-4944-926a-bee8b5bfe8ee {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:41:54.968190 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5a8a8a36-f9fe-4dd5-8929-4d3370851f1b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 2052 microversion: 2.25 time: 0.750093 Sep 08 12:41:55.015913 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 565/1115] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:54 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 2052 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:55.023015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2e670075-4d2e-4580-ad17-23dd9ebfb667 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:55.052234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-fc290875-aeb3-4e73-a855-ee3d75be441a req-08073196-abdc-460e-b9fb-d319868c325e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc95339-7b99-439b-8a64-3eeb808b9c77", "name": "network-vif-unplugged", "status": "completed", "tag": "c88f65d9-eeed-4224-9551-d32c44c05007"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:55.059635 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2e670075-4d2e-4580-ad17-23dd9ebfb667 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1232 microversion: 2.1 time: 0.305586 Sep 08 12:41:55.062659 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 551/1116] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:54 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1232 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:55.082933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-593849dd-3f92-4679-9f3f-701d708271c0 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:55.083877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-593849dd-3f92-4679-9f3f-701d708271c0 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:55.106454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-593849dd-3f92-4679-9f3f-701d708271c0 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:55.108698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-593849dd-3f92-4679-9f3f-701d708271c0 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:55.109823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-593849dd-3f92-4679-9f3f-701d708271c0 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:55.111519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-593849dd-3f92-4679-9f3f-701d708271c0 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:55.112589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-593849dd-3f92-4679-9f3f-701d708271c0 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:55.113672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-593849dd-3f92-4679-9f3f-701d708271c0 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:55.115337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fc290875-aeb3-4e73-a855-ee3d75be441a req-08073196-abdc-460e-b9fb-d319868c325e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:55.127173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fc290875-aeb3-4e73-a855-ee3d75be441a req-08073196-abdc-460e-b9fb-d319868c325e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:55.127790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fc290875-aeb3-4e73-a855-ee3d75be441a req-08073196-abdc-460e-b9fb-d319868c325e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:55.217862 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-fc290875-aeb3-4e73-a855-ee3d75be441a req-08073196-abdc-460e-b9fb-d319868c325e service nova] Creating event network-vif-unplugged:c88f65d9-eeed-4224-9551-d32c44c05007 for instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 on n-h1-852084-10 Sep 08 12:41:55.271906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-fc290875-aeb3-4e73-a855-ee3d75be441a req-08073196-abdc-460e-b9fb-d319868c325e service nova] Instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:41:55.358531 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-fc290875-aeb3-4e73-a855-ee3d75be441a req-08073196-abdc-460e-b9fb-d319868c325e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.340722 Sep 08 12:41:55.368977 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 566/1117] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:55.396825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9117a84a-371c-4e85-b4de-65bd83e2c6af tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:55.397737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9117a84a-371c-4e85-b4de-65bd83e2c6af tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:55.428583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9117a84a-371c-4e85-b4de-65bd83e2c6af tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:55.429330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9117a84a-371c-4e85-b4de-65bd83e2c6af tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:55.429884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9117a84a-371c-4e85-b4de-65bd83e2c6af tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:55.430690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9117a84a-371c-4e85-b4de-65bd83e2c6af tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:55.436464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9117a84a-371c-4e85-b4de-65bd83e2c6af tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:55.440061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9117a84a-371c-4e85-b4de-65bd83e2c6af tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:55.895527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9117a84a-371c-4e85-b4de-65bd83e2c6af tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:55.919442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9117a84a-371c-4e85-b4de-65bd83e2c6af tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:55.920060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-593849dd-3f92-4679-9f3f-701d708271c0 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid c71e5bb7-a289-4944-926a-bee8b5bfe8ee {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:41:55.934171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9117a84a-371c-4e85-b4de-65bd83e2c6af tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:55.963344 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9117a84a-371c-4e85-b4de-65bd83e2c6af tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.587073 Sep 08 12:41:55.964736 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 567/1118] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:55 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:55.977407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62756408-a6d5-4342-be41-44584b89d6ee tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:55.984618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-62756408-a6d5-4342-be41-44584b89d6ee tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:55.996133 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-593849dd-3f92-4679-9f3f-701d708271c0 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 2052 microversion: 2.25 time: 0.930178 Sep 08 12:41:56.000082 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 552/1119] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:55 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 2052 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:56.040476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eb35ee51-bebc-43be-af7c-9d01f195482d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:56.047907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62756408-a6d5-4342-be41-44584b89d6ee tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:56.050577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62756408-a6d5-4342-be41-44584b89d6ee tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:56.052292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62756408-a6d5-4342-be41-44584b89d6ee tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:56.058123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62756408-a6d5-4342-be41-44584b89d6ee tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:56.062290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62756408-a6d5-4342-be41-44584b89d6ee tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:56.062988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62756408-a6d5-4342-be41-44584b89d6ee tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:56.067859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb35ee51-bebc-43be-af7c-9d01f195482d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:56.070723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb35ee51-bebc-43be-af7c-9d01f195482d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:56.074432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb35ee51-bebc-43be-af7c-9d01f195482d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:56.078191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb35ee51-bebc-43be-af7c-9d01f195482d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:56.082874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb35ee51-bebc-43be-af7c-9d01f195482d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:56.088581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb35ee51-bebc-43be-af7c-9d01f195482d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:56.217479 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eb35ee51-bebc-43be-af7c-9d01f195482d tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.185774 Sep 08 12:41:56.225879 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 553/1120] 10.222.0.78 () {60 vars in 1217 bytes} [Thu Sep 8 12:41:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 12:41:56.255442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-865c9329-0f72-4d40-a829-f4e8fd20d364 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:56.260970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-865c9329-0f72-4d40-a829-f4e8fd20d364 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:56.299116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-865c9329-0f72-4d40-a829-f4e8fd20d364 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:56.303906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-865c9329-0f72-4d40-a829-f4e8fd20d364 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:56.304863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-865c9329-0f72-4d40-a829-f4e8fd20d364 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:56.313128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-865c9329-0f72-4d40-a829-f4e8fd20d364 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:56.314701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-865c9329-0f72-4d40-a829-f4e8fd20d364 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:56.321970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-865c9329-0f72-4d40-a829-f4e8fd20d364 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:56.730670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-865c9329-0f72-4d40-a829-f4e8fd20d364 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:56.783535 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-865c9329-0f72-4d40-a829-f4e8fd20d364 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1228 microversion: 2.1 time: 0.550894 Sep 08 12:41:56.784511 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 554/1121] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:56 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1228 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:56.806932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-028ecc70-86c5-4bdc-a205-de1766484076 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:56.816612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-028ecc70-86c5-4bdc-a205-de1766484076 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:56.880586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-028ecc70-86c5-4bdc-a205-de1766484076 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:56.881578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-028ecc70-86c5-4bdc-a205-de1766484076 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:56.883815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-028ecc70-86c5-4bdc-a205-de1766484076 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:56.890276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-028ecc70-86c5-4bdc-a205-de1766484076 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:56.892508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-028ecc70-86c5-4bdc-a205-de1766484076 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:56.900005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-028ecc70-86c5-4bdc-a205-de1766484076 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:56.947894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-62756408-a6d5-4342-be41-44584b89d6ee tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:56.972934 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62756408-a6d5-4342-be41-44584b89d6ee tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1541 microversion: 2.1 time: 1.005564 Sep 08 12:41:56.977291 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 568/1122] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:55 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1541 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:57.026417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a62909fd-10a6-4d0d-a212-4ec66814ce47 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:57.027579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a62909fd-10a6-4d0d-a212-4ec66814ce47 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:57.041291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a62909fd-10a6-4d0d-a212-4ec66814ce47 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:57.044823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a62909fd-10a6-4d0d-a212-4ec66814ce47 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:57.046930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a62909fd-10a6-4d0d-a212-4ec66814ce47 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:57.049642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a62909fd-10a6-4d0d-a212-4ec66814ce47 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:57.060152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a62909fd-10a6-4d0d-a212-4ec66814ce47 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:57.063571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a62909fd-10a6-4d0d-a212-4ec66814ce47 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:57.145380 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-028ecc70-86c5-4bdc-a205-de1766484076 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee/action" status: 202 len: 0 microversion: 2.25 time: 0.354707 Sep 08 12:41:57.154337 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 555/1123] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 12:41:56 2022] POST /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:41:57.172926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-50967f9d-2695-45f0-94fe-c647acb3a752 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:57.177657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-50967f9d-2695-45f0-94fe-c647acb3a752 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:57.202361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50967f9d-2695-45f0-94fe-c647acb3a752 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:57.203137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50967f9d-2695-45f0-94fe-c647acb3a752 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:57.204967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50967f9d-2695-45f0-94fe-c647acb3a752 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:57.222901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50967f9d-2695-45f0-94fe-c647acb3a752 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:57.224928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50967f9d-2695-45f0-94fe-c647acb3a752 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:57.225665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50967f9d-2695-45f0-94fe-c647acb3a752 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:57.285009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a62909fd-10a6-4d0d-a212-4ec66814ce47 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:57.304427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a62909fd-10a6-4d0d-a212-4ec66814ce47 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:57.306007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a62909fd-10a6-4d0d-a212-4ec66814ce47 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:57.324644 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a62909fd-10a6-4d0d-a212-4ec66814ce47 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.307647 Sep 08 12:41:57.357968 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 569/1124] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:57 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:41:57.379589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-66478056-d367-4578-a5e4-c21e3de2c289 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:57.380674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-66478056-d367-4578-a5e4-c21e3de2c289 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:57.403461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66478056-d367-4578-a5e4-c21e3de2c289 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:57.404382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66478056-d367-4578-a5e4-c21e3de2c289 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:57.405033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66478056-d367-4578-a5e4-c21e3de2c289 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:57.405937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66478056-d367-4578-a5e4-c21e3de2c289 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:57.406610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66478056-d367-4578-a5e4-c21e3de2c289 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:57.407344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66478056-d367-4578-a5e4-c21e3de2c289 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:57.770546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-50967f9d-2695-45f0-94fe-c647acb3a752 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid c71e5bb7-a289-4944-926a-bee8b5bfe8ee {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:41:57.864667 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-50967f9d-2695-45f0-94fe-c647acb3a752 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 2057 microversion: 2.25 time: 0.704017 Sep 08 12:41:57.865434 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 556/1125] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:57 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 2057 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:41:57.911178 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-66478056-d367-4578-a5e4-c21e3de2c289 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1813 microversion: 2.1 time: 0.550640 Sep 08 12:41:57.926806 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 570/1126] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:57 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1813 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:57.935358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-9f764741-7119-4b99-bebb-d2614e17d35e req-311ee475-61ab-42b0-923b-f64c0c138eb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc95339-7b99-439b-8a64-3eeb808b9c77", "tag": "c88f65d9-eeed-4224-9551-d32c44c05007"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:41:57.961133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2cc04f0e-4cee-473b-9376-fc73f40f06b8 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:57.961944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2cc04f0e-4cee-473b-9376-fc73f40f06b8 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:57.994678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9f764741-7119-4b99-bebb-d2614e17d35e req-311ee475-61ab-42b0-923b-f64c0c138eb1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:58.006609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9f764741-7119-4b99-bebb-d2614e17d35e req-311ee475-61ab-42b0-923b-f64c0c138eb1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:58.008140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cc04f0e-4cee-473b-9376-fc73f40f06b8 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:58.008993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9f764741-7119-4b99-bebb-d2614e17d35e req-311ee475-61ab-42b0-923b-f64c0c138eb1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:58.013523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cc04f0e-4cee-473b-9376-fc73f40f06b8 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:58.013856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cc04f0e-4cee-473b-9376-fc73f40f06b8 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:58.016889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cc04f0e-4cee-473b-9376-fc73f40f06b8 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:58.020193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cc04f0e-4cee-473b-9376-fc73f40f06b8 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:58.024407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cc04f0e-4cee-473b-9376-fc73f40f06b8 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:58.078411 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-9f764741-7119-4b99-bebb-d2614e17d35e req-311ee475-61ab-42b0-923b-f64c0c138eb1 service nova] Creating event network-changed:c88f65d9-eeed-4224-9551-d32c44c05007 for instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 on n-h1-852084-10 Sep 08 12:41:58.099744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-9f764741-7119-4b99-bebb-d2614e17d35e req-311ee475-61ab-42b0-923b-f64c0c138eb1 service nova] Instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:41:58.126516 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-9f764741-7119-4b99-bebb-d2614e17d35e req-311ee475-61ab-42b0-923b-f64c0c138eb1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259618 Sep 08 12:41:58.136551 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 557/1127] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:58.143917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52736c76-3426-41f4-b9ac-898e2f0fd2f9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:58.149993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52736c76-3426-41f4-b9ac-898e2f0fd2f9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:58.158186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52736c76-3426-41f4-b9ac-898e2f0fd2f9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:58.159059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52736c76-3426-41f4-b9ac-898e2f0fd2f9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:58.160686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52736c76-3426-41f4-b9ac-898e2f0fd2f9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:58.162903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52736c76-3426-41f4-b9ac-898e2f0fd2f9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:58.178209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52736c76-3426-41f4-b9ac-898e2f0fd2f9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:58.284465 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-52736c76-3426-41f4-b9ac-898e2f0fd2f9 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.145631 Sep 08 12:41:58.285118 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 558/1128] 10.222.0.78 () {58 vars in 1176 bytes} [Thu Sep 8 12:41:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:41:58.325228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-875ff33f-9d7d-400d-857b-8a81a73ef8ad tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:58.338153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-875ff33f-9d7d-400d-857b-8a81a73ef8ad tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:58.405202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-875ff33f-9d7d-400d-857b-8a81a73ef8ad tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:58.411610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-875ff33f-9d7d-400d-857b-8a81a73ef8ad tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:58.419541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-875ff33f-9d7d-400d-857b-8a81a73ef8ad tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:58.428217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-875ff33f-9d7d-400d-857b-8a81a73ef8ad tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:58.429908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-875ff33f-9d7d-400d-857b-8a81a73ef8ad tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:58.433637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-875ff33f-9d7d-400d-857b-8a81a73ef8ad tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:58.738321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2cc04f0e-4cee-473b-9376-fc73f40f06b8 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:58.779179 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2cc04f0e-4cee-473b-9376-fc73f40f06b8 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1292 microversion: 2.1 time: 0.850629 Sep 08 12:41:58.796171 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 571/1129] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:57 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1292 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:41:58.894048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1a291dd8-1a4f-4618-89ad-ca958113a924 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:58.894899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1a291dd8-1a4f-4618-89ad-ca958113a924 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:58.924422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a291dd8-1a4f-4618-89ad-ca958113a924 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:58.925090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a291dd8-1a4f-4618-89ad-ca958113a924 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:58.925678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a291dd8-1a4f-4618-89ad-ca958113a924 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:58.926447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a291dd8-1a4f-4618-89ad-ca958113a924 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:58.927111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a291dd8-1a4f-4618-89ad-ca958113a924 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:58.939149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a291dd8-1a4f-4618-89ad-ca958113a924 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:59.363481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1a291dd8-1a4f-4618-89ad-ca958113a924 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:59.382840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1a291dd8-1a4f-4618-89ad-ca958113a924 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:59.402527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1a291dd8-1a4f-4618-89ad-ca958113a924 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:41:59.436569 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1a291dd8-1a4f-4618-89ad-ca958113a924 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.635687 Sep 08 12:41:59.442069 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 572/1130] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:58 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:41:59.462462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-85ff5602-86e7-4c3d-a5f7-edcc0d343133 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:41:59.464095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-85ff5602-86e7-4c3d-a5f7-edcc0d343133 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:41:59.487507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85ff5602-86e7-4c3d-a5f7-edcc0d343133 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:59.490510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85ff5602-86e7-4c3d-a5f7-edcc0d343133 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:59.499999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85ff5602-86e7-4c3d-a5f7-edcc0d343133 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:41:59.501294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85ff5602-86e7-4c3d-a5f7-edcc0d343133 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:41:59.502015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85ff5602-86e7-4c3d-a5f7-edcc0d343133 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:41:59.503639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85ff5602-86e7-4c3d-a5f7-edcc0d343133 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:00.260723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-875ff33f-9d7d-400d-857b-8a81a73ef8ad tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:00.275757 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-875ff33f-9d7d-400d-857b-8a81a73ef8ad tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1541 microversion: 2.1 time: 1.989513 Sep 08 12:42:00.284763 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 559/1131] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:41:58 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1541 bytes in 1999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:00.306484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c0a8e295-2c09-431a-8f62-707bb18b2103 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:00.309476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c0a8e295-2c09-431a-8f62-707bb18b2103 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:00.334304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0a8e295-2c09-431a-8f62-707bb18b2103 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:00.336762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0a8e295-2c09-431a-8f62-707bb18b2103 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:00.339092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0a8e295-2c09-431a-8f62-707bb18b2103 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:00.340279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0a8e295-2c09-431a-8f62-707bb18b2103 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:00.341556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0a8e295-2c09-431a-8f62-707bb18b2103 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:00.342188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0a8e295-2c09-431a-8f62-707bb18b2103 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:00.434530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:00.508013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-85ff5602-86e7-4c3d-a5f7-edcc0d343133 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid c71e5bb7-a289-4944-926a-bee8b5bfe8ee {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:42:00.552384 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-85ff5602-86e7-4c3d-a5f7-edcc0d343133 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 2037 microversion: 2.25 time: 1.108800 Sep 08 12:42:00.553506 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 573/1132] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:41:59 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 2037 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:00.582173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2b526a2a-5468-480a-abad-77e2ce55021d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:00.597249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2b526a2a-5468-480a-abad-77e2ce55021d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:00.607581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b526a2a-5468-480a-abad-77e2ce55021d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:00.614359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b526a2a-5468-480a-abad-77e2ce55021d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:00.615283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b526a2a-5468-480a-abad-77e2ce55021d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:00.616723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b526a2a-5468-480a-abad-77e2ce55021d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:00.619916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b526a2a-5468-480a-abad-77e2ce55021d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:00.620847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b526a2a-5468-480a-abad-77e2ce55021d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:00.741580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c0a8e295-2c09-431a-8f62-707bb18b2103 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:00.761520 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c0a8e295-2c09-431a-8f62-707bb18b2103 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1290 microversion: 2.1 time: 0.473178 Sep 08 12:42:00.770794 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 560/1133] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:00 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1290 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:00.778123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4ae06ebd-3056-451f-b64e-b3e3b31decca tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852084-10", "block_migration": "auto"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:00.806751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4ae06ebd-3056-451f-b64e-b3e3b31decca tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:00.829290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ae06ebd-3056-451f-b64e-b3e3b31decca tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:00.848376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ae06ebd-3056-451f-b64e-b3e3b31decca tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:00.848667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ae06ebd-3056-451f-b64e-b3e3b31decca tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:00.849479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ae06ebd-3056-451f-b64e-b3e3b31decca tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:00.849961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ae06ebd-3056-451f-b64e-b3e3b31decca tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:00.850433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ae06ebd-3056-451f-b64e-b3e3b31decca tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:00.976777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2b526a2a-5468-480a-abad-77e2ce55021d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:00.989921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-4ae06ebd-3056-451f-b64e-b3e3b31decca tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'flavor' on Instance uuid c71e5bb7-a289-4944-926a-bee8b5bfe8ee {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:42:01.000401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2b526a2a-5468-480a-abad-77e2ce55021d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:01.012650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2b526a2a-5468-480a-abad-77e2ce55021d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:01.034718 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2b526a2a-5468-480a-abad-77e2ce55021d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.459347 Sep 08 12:42:01.038027 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 574/1134] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:00 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:01.099988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4ae06ebd-3056-451f-b64e-b3e3b31decca tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Going to try to live migrate instance to n-h2-852084-10 {{(pid=128970) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 12:42:01.320560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1129c713-f30f-437e-a878-dae38636f9b6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:01.325587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1129c713-f30f-437e-a878-dae38636f9b6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:01.377386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1129c713-f30f-437e-a878-dae38636f9b6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:01.377843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1129c713-f30f-437e-a878-dae38636f9b6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:01.379707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1129c713-f30f-437e-a878-dae38636f9b6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:01.388723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1129c713-f30f-437e-a878-dae38636f9b6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:01.389526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1129c713-f30f-437e-a878-dae38636f9b6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:01.390160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1129c713-f30f-437e-a878-dae38636f9b6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:02.268368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1129c713-f30f-437e-a878-dae38636f9b6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:02.295076 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1129c713-f30f-437e-a878-dae38636f9b6 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1473 microversion: 2.1 time: 0.986184 Sep 08 12:42:02.296566 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 575/1135] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:01 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1473 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:02.310529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dfbad6e2-a781-4bd7-a93d-0cea6d6ee932 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:02.311446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dfbad6e2-a781-4bd7-a93d-0cea6d6ee932 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:02.330636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfbad6e2-a781-4bd7-a93d-0cea6d6ee932 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:02.333016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfbad6e2-a781-4bd7-a93d-0cea6d6ee932 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:02.339001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfbad6e2-a781-4bd7-a93d-0cea6d6ee932 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:02.345931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfbad6e2-a781-4bd7-a93d-0cea6d6ee932 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:02.346621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfbad6e2-a781-4bd7-a93d-0cea6d6ee932 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:02.347249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfbad6e2-a781-4bd7-a93d-0cea6d6ee932 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:02.441417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dfbad6e2-a781-4bd7-a93d-0cea6d6ee932 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:42:02.519597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:02.649777 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dfbad6e2-a781-4bd7-a93d-0cea6d6ee932 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "DELETE /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 204 len: 0 microversion: 2.1 time: 0.350315 Sep 08 12:42:02.652621 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 576/1136] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:42:02 2022] DELETE /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:42:02.664522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc3075d8-ab8a-4670-b097-145c667b9812 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:02.666624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cc3075d8-ab8a-4670-b097-145c667b9812 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:02.680173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc3075d8-ab8a-4670-b097-145c667b9812 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:02.682498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc3075d8-ab8a-4670-b097-145c667b9812 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:02.683872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc3075d8-ab8a-4670-b097-145c667b9812 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:02.685770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc3075d8-ab8a-4670-b097-145c667b9812 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:02.687069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc3075d8-ab8a-4670-b097-145c667b9812 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:02.688085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc3075d8-ab8a-4670-b097-145c667b9812 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:03.128313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cc3075d8-ab8a-4670-b097-145c667b9812 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:03.140237 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cc3075d8-ab8a-4670-b097-145c667b9812 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1332 microversion: 2.1 time: 0.484733 Sep 08 12:42:03.157463 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 577/1137] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:02 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1332 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:03.171591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f3ce99d2-7447-4b90-8cfb-40276686b19a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:03.174112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f3ce99d2-7447-4b90-8cfb-40276686b19a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:03.191509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3ce99d2-7447-4b90-8cfb-40276686b19a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:03.195696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3ce99d2-7447-4b90-8cfb-40276686b19a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:03.196675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3ce99d2-7447-4b90-8cfb-40276686b19a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:03.198392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3ce99d2-7447-4b90-8cfb-40276686b19a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:03.200941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3ce99d2-7447-4b90-8cfb-40276686b19a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:03.202412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3ce99d2-7447-4b90-8cfb-40276686b19a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:03.346582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f3ce99d2-7447-4b90-8cfb-40276686b19a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:03.374414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f3ce99d2-7447-4b90-8cfb-40276686b19a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:03.381493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f3ce99d2-7447-4b90-8cfb-40276686b19a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:03.393868 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f3ce99d2-7447-4b90-8cfb-40276686b19a tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.232319 Sep 08 12:42:03.394807 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 578/1138] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:03 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:03.401807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4898ad71-2ae7-4d2e-8c5c-de211cd94c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:03.402764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4898ad71-2ae7-4d2e-8c5c-de211cd94c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:03.415740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4898ad71-2ae7-4d2e-8c5c-de211cd94c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:03.417870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4898ad71-2ae7-4d2e-8c5c-de211cd94c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:03.420629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4898ad71-2ae7-4d2e-8c5c-de211cd94c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:03.421868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4898ad71-2ae7-4d2e-8c5c-de211cd94c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:03.425538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4898ad71-2ae7-4d2e-8c5c-de211cd94c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:03.426334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4898ad71-2ae7-4d2e-8c5c-de211cd94c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:03.804799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4898ad71-2ae7-4d2e-8c5c-de211cd94c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:03.817567 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4898ad71-2ae7-4d2e-8c5c-de211cd94c98 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 200 len: 1681 microversion: 2.1 time: 0.421331 Sep 08 12:42:03.834274 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 579/1139] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:03 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 1681 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:03.845690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-989e3f6a-4195-4725-a816-fdc66f1dd2f6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e728690-e39e-4f99-955b-8f02897de03e", "device": "/dev/xvdb"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:03.850489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-989e3f6a-4195-4725-a816-fdc66f1dd2f6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:03.869854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-989e3f6a-4195-4725-a816-fdc66f1dd2f6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:03.872540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-989e3f6a-4195-4725-a816-fdc66f1dd2f6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:03.873369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-989e3f6a-4195-4725-a816-fdc66f1dd2f6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:03.874400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-989e3f6a-4195-4725-a816-fdc66f1dd2f6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:03.876115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-989e3f6a-4195-4725-a816-fdc66f1dd2f6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:03.879140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-989e3f6a-4195-4725-a816-fdc66f1dd2f6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:04.757626 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-989e3f6a-4195-4725-a816-fdc66f1dd2f6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "POST /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.920193 Sep 08 12:42:04.760711 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 580/1140] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 12:42:03 2022] POST /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments => generated 194 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:04.772895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-77d858f8-b370-4e03-9481-edb9358f4c92 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:04.781624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-77d858f8-b370-4e03-9481-edb9358f4c92 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:04.805648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77d858f8-b370-4e03-9481-edb9358f4c92 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:04.812253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77d858f8-b370-4e03-9481-edb9358f4c92 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:04.814304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77d858f8-b370-4e03-9481-edb9358f4c92 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:04.828984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77d858f8-b370-4e03-9481-edb9358f4c92 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:04.830020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77d858f8-b370-4e03-9481-edb9358f4c92 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:04.830858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77d858f8-b370-4e03-9481-edb9358f4c92 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:05.056037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:05.966768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-77d858f8-b370-4e03-9481-edb9358f4c92 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:05.983927 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-77d858f8-b370-4e03-9481-edb9358f4c92 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1470 microversion: 2.1 time: 1.221019 Sep 08 12:42:05.989385 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 581/1141] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:04 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1470 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:06.018375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-24d651a7-87e0-4066-9f46-b561f7806e1b tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:06.028299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-24d651a7-87e0-4066-9f46-b561f7806e1b tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:06.072517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-24d651a7-87e0-4066-9f46-b561f7806e1b tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:06.081758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-24d651a7-87e0-4066-9f46-b561f7806e1b tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:06.082266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-24d651a7-87e0-4066-9f46-b561f7806e1b tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:06.090433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-24d651a7-87e0-4066-9f46-b561f7806e1b tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:06.113319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-24d651a7-87e0-4066-9f46-b561f7806e1b tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:06.114800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-24d651a7-87e0-4066-9f46-b561f7806e1b tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:06.698413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-24d651a7-87e0-4066-9f46-b561f7806e1b tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:06.716507 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-24d651a7-87e0-4066-9f46-b561f7806e1b tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1332 microversion: 2.1 time: 0.725133 Sep 08 12:42:06.723096 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 582/1142] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:05 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1332 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:06.729795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-51d47d80-0fb6-410e-a7dd-a8be897f4898 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:06.741877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-51d47d80-0fb6-410e-a7dd-a8be897f4898 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:06.768319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51d47d80-0fb6-410e-a7dd-a8be897f4898 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:06.771544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51d47d80-0fb6-410e-a7dd-a8be897f4898 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:06.772337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51d47d80-0fb6-410e-a7dd-a8be897f4898 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:06.784437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51d47d80-0fb6-410e-a7dd-a8be897f4898 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:06.785470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51d47d80-0fb6-410e-a7dd-a8be897f4898 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:06.786113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51d47d80-0fb6-410e-a7dd-a8be897f4898 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:07.277410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-51d47d80-0fb6-410e-a7dd-a8be897f4898 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:07.289979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-51d47d80-0fb6-410e-a7dd-a8be897f4898 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:07.304665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-51d47d80-0fb6-410e-a7dd-a8be897f4898 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:07.328616 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-51d47d80-0fb6-410e-a7dd-a8be897f4898 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.603711 Sep 08 12:42:07.330682 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 583/1143] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:06 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:07.361610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2065b6c4-7b8f-4117-8614-7b20136a4e79 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:07.363610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2065b6c4-7b8f-4117-8614-7b20136a4e79 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:07.378940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2065b6c4-7b8f-4117-8614-7b20136a4e79 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:07.381105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2065b6c4-7b8f-4117-8614-7b20136a4e79 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:07.383215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2065b6c4-7b8f-4117-8614-7b20136a4e79 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:07.384449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2065b6c4-7b8f-4117-8614-7b20136a4e79 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:07.386355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2065b6c4-7b8f-4117-8614-7b20136a4e79 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:07.387079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2065b6c4-7b8f-4117-8614-7b20136a4e79 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:07.455097 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4ae06ebd-3056-451f-b64e-b3e3b31decca tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee/action" status: 202 len: 0 microversion: 2.25 time: 6.681366 Sep 08 12:42:07.466046 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 561/1144] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 12:42:00 2022] POST /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee/action => generated 0 bytes in 6688 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:42:07.493417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-29f397fa-ad53-461e-8ec1-2f618b63ac39 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:07.517910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-29f397fa-ad53-461e-8ec1-2f618b63ac39 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:07.518726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-29f397fa-ad53-461e-8ec1-2f618b63ac39 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Searching by: {'deleted': False, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:42:07.568849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29f397fa-ad53-461e-8ec1-2f618b63ac39 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:07.569344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29f397fa-ad53-461e-8ec1-2f618b63ac39 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:07.569788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29f397fa-ad53-461e-8ec1-2f618b63ac39 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:07.580500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29f397fa-ad53-461e-8ec1-2f618b63ac39 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:07.587575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29f397fa-ad53-461e-8ec1-2f618b63ac39 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:07.587998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29f397fa-ad53-461e-8ec1-2f618b63ac39 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:07.768722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-29f397fa-ad53-461e-8ec1-2f618b63ac39 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:42:07.889569 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-29f397fa-ad53-461e-8ec1-2f618b63ac39 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.420282 Sep 08 12:42:07.890748 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 562/1145] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 12:42:07 2022] GET /compute/v2.1/servers => generated 339 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:07.899265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:07.900115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:07.906398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2065b6c4-7b8f-4117-8614-7b20136a4e79 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:07.910634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:07.912554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:07.913517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:07.914835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:07.915649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:07.917106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:07.945441 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2065b6c4-7b8f-4117-8614-7b20136a4e79 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 200 len: 1613 microversion: 2.1 time: 0.598333 Sep 08 12:42:07.953512 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 584/1146] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:07 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 1613 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:07.991039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-506939d7-a15f-41f6-9937-4461a86bbab9 req-b8f7bb15-f3ef-4bb6-b507-4f3706b62a97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21de9f4e-35f1-485e-bf5c-301cec48fa12", "tag": "c54bf0d4-ec44-4b9b-aa86-f5c058b69112"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:07.998031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:07.999009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:08.000932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:08.002099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:08.002905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:08.006224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:08.039334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-506939d7-a15f-41f6-9937-4461a86bbab9 req-b8f7bb15-f3ef-4bb6-b507-4f3706b62a97 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:08.040088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-506939d7-a15f-41f6-9937-4461a86bbab9 req-b8f7bb15-f3ef-4bb6-b507-4f3706b62a97 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:08.040667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-506939d7-a15f-41f6-9937-4461a86bbab9 req-b8f7bb15-f3ef-4bb6-b507-4f3706b62a97 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:08.100834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Getting quotas for project 8c3e5d96296342eb8a99953dec8747c0. Resources: {'cores', 'ram'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:42:08.105933 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-506939d7-a15f-41f6-9937-4461a86bbab9 req-b8f7bb15-f3ef-4bb6-b507-4f3706b62a97 service nova] Creating event network-changed:c54bf0d4-ec44-4b9b-aa86-f5c058b69112 for instance 21de9f4e-35f1-485e-bf5c-301cec48fa12 on n-h1-852084-10 Sep 08 12:42:08.118739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Getting quotas for user 81af813dbf5340d0a3d9d4bf0cff3da7 and project 8c3e5d96296342eb8a99953dec8747c0. Resources: {'cores', 'ram'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:42:08.121007 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-506939d7-a15f-41f6-9937-4461a86bbab9 req-b8f7bb15-f3ef-4bb6-b507-4f3706b62a97 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165637 Sep 08 12:42:08.121821 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 585/1147] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:08.143634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b5d5ca6f-1d8e-405e-8713-5b34ee3f9ee3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:08.162998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b5d5ca6f-1d8e-405e-8713-5b34ee3f9ee3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:08.173757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5d5ca6f-1d8e-405e-8713-5b34ee3f9ee3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:08.174269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5d5ca6f-1d8e-405e-8713-5b34ee3f9ee3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:08.183678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5d5ca6f-1d8e-405e-8713-5b34ee3f9ee3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:08.184550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5d5ca6f-1d8e-405e-8713-5b34ee3f9ee3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:08.185444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5d5ca6f-1d8e-405e-8713-5b34ee3f9ee3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:08.186487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5d5ca6f-1d8e-405e-8713-5b34ee3f9ee3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:08.523743 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-02f2b6c5-8f9d-474f-bf23-901c5624c419 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "POST /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77/action" status: 202 len: 0 microversion: 2.1 time: 0.628781 Sep 08 12:42:08.525881 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 563/1148] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:42:07 2022] POST /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:42:08.535185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bf8fd8ed-08ef-427a-a11b-297c756adf17 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:08.536834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bf8fd8ed-08ef-427a-a11b-297c756adf17 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:08.550068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf8fd8ed-08ef-427a-a11b-297c756adf17 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:08.576345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf8fd8ed-08ef-427a-a11b-297c756adf17 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:08.578833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf8fd8ed-08ef-427a-a11b-297c756adf17 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:08.581296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf8fd8ed-08ef-427a-a11b-297c756adf17 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:08.590129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf8fd8ed-08ef-427a-a11b-297c756adf17 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:08.591328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf8fd8ed-08ef-427a-a11b-297c756adf17 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:09.428419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b5d5ca6f-1d8e-405e-8713-5b34ee3f9ee3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:09.472828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b5d5ca6f-1d8e-405e-8713-5b34ee3f9ee3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:09.483148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b5d5ca6f-1d8e-405e-8713-5b34ee3f9ee3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:09.488818 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b5d5ca6f-1d8e-405e-8713-5b34ee3f9ee3 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1567 microversion: 2.25 time: 1.350832 Sep 08 12:42:09.490911 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 586/1149] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:08 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1567 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:09.508554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-8e91a534-925d-4677-9060-ae2414fa9002 req-dfb95bf2-90ff-436a-8d95-648e99657cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc95339-7b99-439b-8a64-3eeb808b9c77", "name": "network-vif-plugged", "status": "completed", "tag": "c88f65d9-eeed-4224-9551-d32c44c05007"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:09.549230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8e91a534-925d-4677-9060-ae2414fa9002 req-dfb95bf2-90ff-436a-8d95-648e99657cb0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:09.551217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8e91a534-925d-4677-9060-ae2414fa9002 req-dfb95bf2-90ff-436a-8d95-648e99657cb0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:09.552197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8e91a534-925d-4677-9060-ae2414fa9002 req-dfb95bf2-90ff-436a-8d95-648e99657cb0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:09.576128 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-8e91a534-925d-4677-9060-ae2414fa9002 req-dfb95bf2-90ff-436a-8d95-648e99657cb0 service nova] Creating event network-vif-plugged:c88f65d9-eeed-4224-9551-d32c44c05007 for instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 on n-h1-852084-10 Sep 08 12:42:09.590947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-8e91a534-925d-4677-9060-ae2414fa9002 req-dfb95bf2-90ff-436a-8d95-648e99657cb0 service nova] Instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:42:09.601759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bf8fd8ed-08ef-427a-a11b-297c756adf17 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:09.617822 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-8e91a534-925d-4677-9060-ae2414fa9002 req-dfb95bf2-90ff-436a-8d95-648e99657cb0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123732 Sep 08 12:42:09.620280 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 587/1150] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:09.625731 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bf8fd8ed-08ef-427a-a11b-297c756adf17 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1332 microversion: 2.1 time: 1.097570 Sep 08 12:42:09.626348 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 564/1151] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:08 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1332 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:09.641708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c5eafe80-b193-4689-aae8-0f03df8852b5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:09.642685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c5eafe80-b193-4689-aae8-0f03df8852b5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:09.652079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:09.660901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:09.675923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:09.676940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Searching by: {'deleted': False, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:42:09.680915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5eafe80-b193-4689-aae8-0f03df8852b5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:09.694860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:09.695516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:09.698412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:09.702039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:09.703708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5eafe80-b193-4689-aae8-0f03df8852b5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:09.704439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5eafe80-b193-4689-aae8-0f03df8852b5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:09.704842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:09.705338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5eafe80-b193-4689-aae8-0f03df8852b5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:09.705802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5eafe80-b193-4689-aae8-0f03df8852b5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:09.706182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:09.706311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5eafe80-b193-4689-aae8-0f03df8852b5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:09.876287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:42:09.939348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c5eafe80-b193-4689-aae8-0f03df8852b5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:09.970877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c5eafe80-b193-4689-aae8-0f03df8852b5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:09.974148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c5eafe80-b193-4689-aae8-0f03df8852b5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:09.995319 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c5eafe80-b193-4689-aae8-0f03df8852b5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.364077 Sep 08 12:42:10.007195 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 565/1152] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:09 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:10.030245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33e0d140-a2c9-40d2-a5f6-2f16635b9108 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:10.031954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-33e0d140-a2c9-40d2-a5f6-2f16635b9108 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:10.043526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33e0d140-a2c9-40d2-a5f6-2f16635b9108 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:10.044032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33e0d140-a2c9-40d2-a5f6-2f16635b9108 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:10.044548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33e0d140-a2c9-40d2-a5f6-2f16635b9108 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:10.045531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33e0d140-a2c9-40d2-a5f6-2f16635b9108 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:10.046016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33e0d140-a2c9-40d2-a5f6-2f16635b9108 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:10.046459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33e0d140-a2c9-40d2-a5f6-2f16635b9108 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:10.054143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:10.068450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:10.069594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:10.070487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:10.622196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-33e0d140-a2c9-40d2-a5f6-2f16635b9108 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:10.663656 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-33e0d140-a2c9-40d2-a5f6-2f16635b9108 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1469 microversion: 2.1 time: 0.653760 Sep 08 12:42:10.665936 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 566/1153] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:10 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1469 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:10.706390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:10.715881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:10.741835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:10.742764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:10.754240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:10.755776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:10.758462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:10.759280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:10.923325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:10.926817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:10.929246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:10.930410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lazy-loading 'fault' on Instance uuid 940b9bb1-c58b-464b-a472-03fb6acbe36b {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:42:11.149420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f1fd37230b4490389ff38162ea813b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc8fdfffe814f59ad6b22da13094cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:11.165685 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ce6d3e2b-5217-415d-ada5-d4be88b6194c tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 200 len: 1330 microversion: 2.1 time: 0.495971 Sep 08 12:42:11.166409 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 567/1154] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:10 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 1330 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:11.209969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ab04e487-05c3-4eac-9fd6-b40efb716745 req-ee768583-5619-47fb-b6ac-29eb7c0c4a95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "940b9bb1-c58b-464b-a472-03fb6acbe36b", "name": "network-vif-deleted", "tag": "79a1be76-7c37-4bba-b881-2e981148c298"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:11.272499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ab04e487-05c3-4eac-9fd6-b40efb716745 req-ee768583-5619-47fb-b6ac-29eb7c0c4a95 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:11.279825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ab04e487-05c3-4eac-9fd6-b40efb716745 req-ee768583-5619-47fb-b6ac-29eb7c0c4a95 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:11.283123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ab04e487-05c3-4eac-9fd6-b40efb716745 req-ee768583-5619-47fb-b6ac-29eb7c0c4a95 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:11.394840 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ab04e487-05c3-4eac-9fd6-b40efb716745 req-ee768583-5619-47fb-b6ac-29eb7c0c4a95 service nova] Creating event network-vif-deleted:79a1be76-7c37-4bba-b881-2e981148c298 for instance 940b9bb1-c58b-464b-a472-03fb6acbe36b on n-h2-852084-10 Sep 08 12:42:11.431531 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-165c74f1-473c-466a-a06c-6cff6d558c40 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 1.790715 Sep 08 12:42:11.431531 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 588/1155] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:42:09 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:11.451523 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ab04e487-05c3-4eac-9fd6-b40efb716745 req-ee768583-5619-47fb-b6ac-29eb7c0c4a95 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.263752 Sep 08 12:42:11.455602 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 568/1156] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:11.500450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4e7ed267-d47b-444b-949d-5b1d5a7b2828 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:11.502145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4e7ed267-d47b-444b-949d-5b1d5a7b2828 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:11.557912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e7ed267-d47b-444b-949d-5b1d5a7b2828 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:11.559052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e7ed267-d47b-444b-949d-5b1d5a7b2828 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:11.571843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e7ed267-d47b-444b-949d-5b1d5a7b2828 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:11.577059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e7ed267-d47b-444b-949d-5b1d5a7b2828 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:11.577902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e7ed267-d47b-444b-949d-5b1d5a7b2828 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:11.578719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e7ed267-d47b-444b-949d-5b1d5a7b2828 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:11.911426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3aa9a39-65b7-454f-bb3c-706ddce553fe tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:11.920150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3aa9a39-65b7-454f-bb3c-706ddce553fe tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:11.920645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3aa9a39-65b7-454f-bb3c-706ddce553fe tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:11.921939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3aa9a39-65b7-454f-bb3c-706ddce553fe tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:11.922929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3aa9a39-65b7-454f-bb3c-706ddce553fe tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:11.929425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3aa9a39-65b7-454f-bb3c-706ddce553fe tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:11.930711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3aa9a39-65b7-454f-bb3c-706ddce553fe tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:11.994435 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3aa9a39-65b7-454f-bb3c-706ddce553fe tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.579273 Sep 08 12:42:11.995697 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 589/1157] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:42:11 2022] GET /compute/v2.1/os-services => generated 949 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:12.013423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2d959b4-5c06-43ef-8c42-9181d736ff75 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:12.014513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2d959b4-5c06-43ef-8c42-9181d736ff75 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:12.022629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2d959b4-5c06-43ef-8c42-9181d736ff75 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:12.023557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2d959b4-5c06-43ef-8c42-9181d736ff75 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:12.024596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2d959b4-5c06-43ef-8c42-9181d736ff75 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:12.025599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2d959b4-5c06-43ef-8c42-9181d736ff75 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:12.026858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2d959b4-5c06-43ef-8c42-9181d736ff75 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:12.027547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2d959b4-5c06-43ef-8c42-9181d736ff75 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:12.813095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4e7ed267-d47b-444b-949d-5b1d5a7b2828 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:12.832319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4e7ed267-d47b-444b-949d-5b1d5a7b2828 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:12.834339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4e7ed267-d47b-444b-949d-5b1d5a7b2828 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:12.842731 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4e7ed267-d47b-444b-949d-5b1d5a7b2828 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1567 microversion: 2.25 time: 1.372960 Sep 08 12:42:12.843968 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 569/1158] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:11 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1567 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:12.878452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28d6913a-6e1d-4013-98e6-940558bfdaa7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:12.879337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-28d6913a-6e1d-4013-98e6-940558bfdaa7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:12.905924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d6913a-6e1d-4013-98e6-940558bfdaa7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:12.907488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d6913a-6e1d-4013-98e6-940558bfdaa7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:12.908921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d6913a-6e1d-4013-98e6-940558bfdaa7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:12.913133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d6913a-6e1d-4013-98e6-940558bfdaa7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:12.916200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d6913a-6e1d-4013-98e6-940558bfdaa7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:12.918019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d6913a-6e1d-4013-98e6-940558bfdaa7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:12.981831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f2d959b4-5c06-43ef-8c42-9181d736ff75 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:12.999978 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2d959b4-5c06-43ef-8c42-9181d736ff75 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1332 microversion: 2.1 time: 1.002999 Sep 08 12:42:13.018339 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 590/1159] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:11 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1332 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:13.049722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-55299e95-1408-43f5-885e-c83dab355ede tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:13.074015 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-55299e95-1408-43f5-885e-c83dab355ede tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.053186 Sep 08 12:42:13.074635 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 591/1160] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:42:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:13.112950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5e85b70c-cad6-4a16-83ba-f07121bc1027 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:13.117893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5e85b70c-cad6-4a16-83ba-f07121bc1027 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:13.143021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e85b70c-cad6-4a16-83ba-f07121bc1027 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:13.143572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e85b70c-cad6-4a16-83ba-f07121bc1027 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:13.144018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e85b70c-cad6-4a16-83ba-f07121bc1027 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:13.144794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e85b70c-cad6-4a16-83ba-f07121bc1027 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:13.145490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e85b70c-cad6-4a16-83ba-f07121bc1027 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:13.151902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e85b70c-cad6-4a16-83ba-f07121bc1027 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:13.554323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-28d6913a-6e1d-4013-98e6-940558bfdaa7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:13.580916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-28d6913a-6e1d-4013-98e6-940558bfdaa7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:13.584585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-28d6913a-6e1d-4013-98e6-940558bfdaa7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:13.608255 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-28d6913a-6e1d-4013-98e6-940558bfdaa7 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.762587 Sep 08 12:42:13.633324 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 570/1161] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:12 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:13.647204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-74615ab9-af3d-4418-898d-6e4af9404791 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:13.655275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74615ab9-af3d-4418-898d-6e4af9404791 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:13.658522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74615ab9-af3d-4418-898d-6e4af9404791 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:13.660526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74615ab9-af3d-4418-898d-6e4af9404791 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:13.663256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74615ab9-af3d-4418-898d-6e4af9404791 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:13.665796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74615ab9-af3d-4418-898d-6e4af9404791 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:13.667707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74615ab9-af3d-4418-898d-6e4af9404791 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:13.712069 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-74615ab9-af3d-4418-898d-6e4af9404791 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=n-d-852084-10" status: 200 len: 581 microversion: 2.1 time: 0.076842 Sep 08 12:42:13.713750 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 571/1162] 10.222.0.78 () {58 vars in 1174 bytes} [Thu Sep 8 12:42:13 2022] GET /compute/v2.1/os-services?host=n-d-852084-10 => generated 581 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:13.720370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-313220b4-9769-41f0-b193-5b37a7d47fd1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:13.721490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-313220b4-9769-41f0-b193-5b37a7d47fd1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] [instance: 940b9bb1-c58b-464b-a472-03fb6acbe36b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:13.734020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-313220b4-9769-41f0-b193-5b37a7d47fd1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:13.735282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-313220b4-9769-41f0-b193-5b37a7d47fd1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:13.736029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-313220b4-9769-41f0-b193-5b37a7d47fd1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:13.737145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-313220b4-9769-41f0-b193-5b37a7d47fd1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:13.737901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-313220b4-9769-41f0-b193-5b37a7d47fd1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:13.738929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-313220b4-9769-41f0-b193-5b37a7d47fd1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:13.762191 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-313220b4-9769-41f0-b193-5b37a7d47fd1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] HTTP exception thrown: Instance 940b9bb1-c58b-464b-a472-03fb6acbe36b could not be found. Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-313220b4-9769-41f0-b193-5b37a7d47fd1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Request method failure captured: Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b HTTP/1.1 Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJYtY5fPIo9ZXD4tPdAZobSOuX-w2Yu5wAlosO-4GjAAE9egT1dye9-ogqEtrym1fHZyBAwMJytc2Yr9FmuXU_bK-BkZ-3X9IBVF2-tZcqV_Zu6wH-4lAUzfkLeDPvIiJt0PF7SiMFj9ZJxJcUk-IVDHCABdIJMC8FdfEKhTVfvCs4 Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 3dc8fdfffe814f59ad6b22da13094cc9 Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesAdminNegativeTest-206436524 Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:42:13.764631 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:42:13.766208 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3dc8fdfffe814f59ad6b22da13094cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3dc8fdfffe814f59ad6b22da13094cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3dc8fdfffe814f59ad6b22da13094cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3dc8fdfffe814f59ad6b22da13094cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:42:13.766208 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesAdminNegativeTest-206436524 Sep 08 12:42:13.766208 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 3dc8fdfffe814f59ad6b22da13094cc9 Sep 08 12:42:13.766208 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-206436524 Sep 08 12:42:13.766208 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesAdminNegativeTest-206436524-project Sep 08 12:42:13.766208 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:42:13.766208 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:42:13.766208 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 8f1fd37230b4490389ff38162ea813b9 Sep 08 12:42:13.766208 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesAdminNegativeTest-206436524-project Sep 08 12:42:13.766208 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:42:13.766208 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 940b9bb1-c58b-464b-a472-03fb6acbe36b could not be found. Sep 08 12:42:13.766208 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '940b9bb1-c58b-464b-a472-03fb6acbe36b'} Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 940b9bb1-c58b-464b-a472-03fb6acbe36b could not be found. Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:42:13.768816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 940b9bb1-c58b-464b-a472-03fb6acbe36b could not be found. Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 940b9bb1-c58b-464b-a472-03fb6acbe36b could not be found. Sep 08 12:42:13.770576 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:13.774523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-313220b4-9769-41f0-b193-5b37a7d47fd1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Returning 404 to user: Instance 940b9bb1-c58b-464b-a472-03fb6acbe36b could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:42:13.776789 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-313220b4-9769-41f0-b193-5b37a7d47fd1 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b" status: 404 len: 111 microversion: 2.1 time: 0.061155 Sep 08 12:42:13.778653 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 572/1163] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:13 2022] GET /compute/v2.1/servers/940b9bb1-c58b-464b-a472-03fb6acbe36b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:42:13.810483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4e3cc328-a213-4e1a-aa09-b3b44c51c86f tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:13.812743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4e3cc328-a213-4e1a-aa09-b3b44c51c86f tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:13.855420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e3cc328-a213-4e1a-aa09-b3b44c51c86f tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:13.857194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e3cc328-a213-4e1a-aa09-b3b44c51c86f tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:13.858854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e3cc328-a213-4e1a-aa09-b3b44c51c86f tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:13.868012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e3cc328-a213-4e1a-aa09-b3b44c51c86f tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:13.869412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e3cc328-a213-4e1a-aa09-b3b44c51c86f tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:13.876304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e3cc328-a213-4e1a-aa09-b3b44c51c86f tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:13.994307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:14.007528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4e3cc328-a213-4e1a-aa09-b3b44c51c86f tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:42:14.252660 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4e3cc328-a213-4e1a-aa09-b3b44c51c86f tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 204 len: 0 microversion: 2.1 time: 0.469608 Sep 08 12:42:14.255210 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 573/1164] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:42:13 2022] DELETE /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:42:14.267380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5e85b70c-cad6-4a16-83ba-f07121bc1027 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:14.269436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e8bc61cc-79f2-4b2a-905b-7315fd5a0991 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:14.278168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8bc61cc-79f2-4b2a-905b-7315fd5a0991 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:14.279407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8bc61cc-79f2-4b2a-905b-7315fd5a0991 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:14.280690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8bc61cc-79f2-4b2a-905b-7315fd5a0991 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:14.282431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8bc61cc-79f2-4b2a-905b-7315fd5a0991 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:14.283566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8bc61cc-79f2-4b2a-905b-7315fd5a0991 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:14.284282 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5e85b70c-cad6-4a16-83ba-f07121bc1027 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1469 microversion: 2.1 time: 1.187897 Sep 08 12:42:14.285325 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 592/1165] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:13 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1469 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:14.300220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8bc61cc-79f2-4b2a-905b-7315fd5a0991 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:14.303981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff0ce49e-1a1d-4a0a-a9a9-d993f679fcf7 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] Calling method '.version_select at 0x7fdb3adfa040>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:14.327299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:14.345754 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ff0ce49e-1a1d-4a0a-a9a9-d993f679fcf7 tempest-VolumesAdminNegativeTest-206436524 tempest-VolumesAdminNegativeTest-206436524-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-124175808" status: 202 len: 0 microversion: 2.1 time: 0.058937 Sep 08 12:42:14.346551 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 593/1166] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 12:42:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-124175808 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:42:14.365402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71c3850b-e6d0-4576-b600-1682a31211ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:14.366223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-71c3850b-e6d0-4576-b600-1682a31211ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:14.378070 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e8bc61cc-79f2-4b2a-905b-7315fd5a0991 tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.119693 Sep 08 12:42:14.378681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71c3850b-e6d0-4576-b600-1682a31211ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:14.379424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71c3850b-e6d0-4576-b600-1682a31211ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:14.380729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71c3850b-e6d0-4576-b600-1682a31211ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:14.384728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71c3850b-e6d0-4576-b600-1682a31211ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:14.386136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71c3850b-e6d0-4576-b600-1682a31211ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:14.392429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71c3850b-e6d0-4576-b600-1682a31211ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:14.392661 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 574/1167] 10.222.0.78 () {58 vars in 1176 bytes} [Thu Sep 8 12:42:14 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:14.403955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-53d37a1e-afd8-4945-a15c-7ac7fca90638 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:14.405929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-53d37a1e-afd8-4945-a15c-7ac7fca90638 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:14.420633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:14.426121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53d37a1e-afd8-4945-a15c-7ac7fca90638 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:14.426561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53d37a1e-afd8-4945-a15c-7ac7fca90638 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:14.427006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53d37a1e-afd8-4945-a15c-7ac7fca90638 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:14.427785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53d37a1e-afd8-4945-a15c-7ac7fca90638 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:14.428245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53d37a1e-afd8-4945-a15c-7ac7fca90638 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:14.428669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53d37a1e-afd8-4945-a15c-7ac7fca90638 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:14.998977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-71c3850b-e6d0-4576-b600-1682a31211ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:15.013653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-53d37a1e-afd8-4945-a15c-7ac7fca90638 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:15.021902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-71c3850b-e6d0-4576-b600-1682a31211ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:15.026418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-71c3850b-e6d0-4576-b600-1682a31211ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:15.030711 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-71c3850b-e6d0-4576-b600-1682a31211ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1567 microversion: 2.25 time: 0.676349 Sep 08 12:42:15.032545 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-53d37a1e-afd8-4945-a15c-7ac7fca90638 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1332 microversion: 2.1 time: 0.635046 Sep 08 12:42:15.034411 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 594/1168] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:14 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1567 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:15.047635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9ff29936-4a91-4c94-8a02-a004fe4a734d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:15.049539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9ff29936-4a91-4c94-8a02-a004fe4a734d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:15.050553 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 575/1169] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:14 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1332 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:15.064743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ff29936-4a91-4c94-8a02-a004fe4a734d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:15.066219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ff29936-4a91-4c94-8a02-a004fe4a734d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:15.067431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ff29936-4a91-4c94-8a02-a004fe4a734d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:15.069319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ff29936-4a91-4c94-8a02-a004fe4a734d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:15.070659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ff29936-4a91-4c94-8a02-a004fe4a734d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:15.071148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e758244d-97a1-4d4d-8963-395e6962482b req-642088e4-d91c-4212-9c9f-459659741d7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71e5bb7-a289-4944-926a-bee8b5bfe8ee", "name": "network-vif-unplugged", "status": "completed", "tag": "5d38cff6-9d90-48f1-9f72-666a7a5acdc6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:15.072209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ff29936-4a91-4c94-8a02-a004fe4a734d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:15.110767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e758244d-97a1-4d4d-8963-395e6962482b req-642088e4-d91c-4212-9c9f-459659741d7d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:15.111501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e758244d-97a1-4d4d-8963-395e6962482b req-642088e4-d91c-4212-9c9f-459659741d7d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:15.113065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e758244d-97a1-4d4d-8963-395e6962482b req-642088e4-d91c-4212-9c9f-459659741d7d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:15.143673 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e758244d-97a1-4d4d-8963-395e6962482b req-642088e4-d91c-4212-9c9f-459659741d7d service nova] Creating event network-vif-unplugged:5d38cff6-9d90-48f1-9f72-666a7a5acdc6 for instance c71e5bb7-a289-4944-926a-bee8b5bfe8ee on n-h1-852084-10 Sep 08 12:42:15.159493 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e758244d-97a1-4d4d-8963-395e6962482b req-642088e4-d91c-4212-9c9f-459659741d7d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103728 Sep 08 12:42:15.162073 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 576/1170] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:15.174807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-34f4b624-f4ce-4fcb-86f0-1bfbcc49390d tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:15.189223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34f4b624-f4ce-4fcb-86f0-1bfbcc49390d tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:15.189720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34f4b624-f4ce-4fcb-86f0-1bfbcc49390d tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:15.193069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34f4b624-f4ce-4fcb-86f0-1bfbcc49390d tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:15.194234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34f4b624-f4ce-4fcb-86f0-1bfbcc49390d tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:15.194743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34f4b624-f4ce-4fcb-86f0-1bfbcc49390d tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:15.195214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34f4b624-f4ce-4fcb-86f0-1bfbcc49390d tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:15.233884 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-34f4b624-f4ce-4fcb-86f0-1bfbcc49390d tempest-ServicesAdminTestJSON-2016380490 tempest-ServicesAdminTestJSON-2016380490-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.068700 Sep 08 12:42:15.244115 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 577/1171] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:42:15 2022] GET /compute/v2.1/os-services => generated 949 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:15.268649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1d439dd2-2cf9-429b-bbc2-ee75c845aecd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:15.269387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1d439dd2-2cf9-429b-bbc2-ee75c845aecd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:15.290132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d439dd2-2cf9-429b-bbc2-ee75c845aecd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:15.290644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d439dd2-2cf9-429b-bbc2-ee75c845aecd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:15.291121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d439dd2-2cf9-429b-bbc2-ee75c845aecd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:15.291973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d439dd2-2cf9-429b-bbc2-ee75c845aecd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:15.293480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d439dd2-2cf9-429b-bbc2-ee75c845aecd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:15.297144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d439dd2-2cf9-429b-bbc2-ee75c845aecd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:15.464533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1d439dd2-2cf9-429b-bbc2-ee75c845aecd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:15.474180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9ff29936-4a91-4c94-8a02-a004fe4a734d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:15.488446 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9ff29936-4a91-4c94-8a02-a004fe4a734d tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1714 microversion: 2.1 time: 0.451962 Sep 08 12:42:15.489069 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 595/1172] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:15 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1714 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:15.492923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1d439dd2-2cf9-429b-bbc2-ee75c845aecd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:15.493662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1d439dd2-2cf9-429b-bbc2-ee75c845aecd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:15.508987 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1d439dd2-2cf9-429b-bbc2-ee75c845aecd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.255656 Sep 08 12:42:15.517139 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 578/1173] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:15 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:15.532890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5b9bdcf4-0cb2-442f-91a1-e8a11468307e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:15.535791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5b9bdcf4-0cb2-442f-91a1-e8a11468307e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:15.542133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7286253d-16e4-420f-b34d-927dbc81fc8f req-c6330ee0-88dd-48ba-83ed-4f8d5b37e89d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21de9f4e-35f1-485e-bf5c-301cec48fa12", "name": "network-vif-plugged", "status": "completed", "tag": "c54bf0d4-ec44-4b9b-aa86-f5c058b69112"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:15.549122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b9bdcf4-0cb2-442f-91a1-e8a11468307e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:15.552240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b9bdcf4-0cb2-442f-91a1-e8a11468307e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:15.553265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b9bdcf4-0cb2-442f-91a1-e8a11468307e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:15.554656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b9bdcf4-0cb2-442f-91a1-e8a11468307e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:15.556671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b9bdcf4-0cb2-442f-91a1-e8a11468307e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:15.559317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b9bdcf4-0cb2-442f-91a1-e8a11468307e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:15.587672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7286253d-16e4-420f-b34d-927dbc81fc8f req-c6330ee0-88dd-48ba-83ed-4f8d5b37e89d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:15.593304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7286253d-16e4-420f-b34d-927dbc81fc8f req-c6330ee0-88dd-48ba-83ed-4f8d5b37e89d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:15.596602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7286253d-16e4-420f-b34d-927dbc81fc8f req-c6330ee0-88dd-48ba-83ed-4f8d5b37e89d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:15.651136 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7286253d-16e4-420f-b34d-927dbc81fc8f req-c6330ee0-88dd-48ba-83ed-4f8d5b37e89d service nova] Creating event network-vif-plugged:c54bf0d4-ec44-4b9b-aa86-f5c058b69112 for instance 21de9f4e-35f1-485e-bf5c-301cec48fa12 on n-h1-852084-10 Sep 08 12:42:15.677197 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7286253d-16e4-420f-b34d-927dbc81fc8f req-c6330ee0-88dd-48ba-83ed-4f8d5b37e89d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154954 Sep 08 12:42:15.684271 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 596/1174] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:16.083761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36e62374-8d64-4b66-ac25-4afc8574fc29 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:16.085189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-36e62374-8d64-4b66-ac25-4afc8574fc29 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:16.100214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36e62374-8d64-4b66-ac25-4afc8574fc29 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:16.105283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36e62374-8d64-4b66-ac25-4afc8574fc29 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:16.106215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36e62374-8d64-4b66-ac25-4afc8574fc29 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:16.108899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36e62374-8d64-4b66-ac25-4afc8574fc29 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:16.110011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36e62374-8d64-4b66-ac25-4afc8574fc29 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:16.111712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36e62374-8d64-4b66-ac25-4afc8574fc29 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:16.180699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5b9bdcf4-0cb2-442f-91a1-e8a11468307e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:16.198784 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5b9bdcf4-0cb2-442f-91a1-e8a11468307e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1469 microversion: 2.1 time: 0.687972 Sep 08 12:42:16.200019 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 579/1175] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:15 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1469 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:16.206717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-31464b7a-b900-4aed-8ec1-f9e61cce2e7e tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:16.207871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-31464b7a-b900-4aed-8ec1-f9e61cce2e7e tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:16.216986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31464b7a-b900-4aed-8ec1-f9e61cce2e7e tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:16.217730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31464b7a-b900-4aed-8ec1-f9e61cce2e7e tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:16.218501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31464b7a-b900-4aed-8ec1-f9e61cce2e7e tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:16.219461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31464b7a-b900-4aed-8ec1-f9e61cce2e7e tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:16.220062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31464b7a-b900-4aed-8ec1-f9e61cce2e7e tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:16.220679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31464b7a-b900-4aed-8ec1-f9e61cce2e7e tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:16.719077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-36e62374-8d64-4b66-ac25-4afc8574fc29 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:16.739402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-36e62374-8d64-4b66-ac25-4afc8574fc29 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:16.741732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-36e62374-8d64-4b66-ac25-4afc8574fc29 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:16.744854 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36e62374-8d64-4b66-ac25-4afc8574fc29 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1567 microversion: 2.25 time: 0.668340 Sep 08 12:42:16.756210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-31464b7a-b900-4aed-8ec1-f9e61cce2e7e tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:16.770712 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-31464b7a-b900-4aed-8ec1-f9e61cce2e7e tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1332 microversion: 2.1 time: 0.569157 Sep 08 12:42:16.772453 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 597/1176] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:16 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1567 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:42:16.781739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2329d4be-4e87-4e0a-bbb4-87da15028c4e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:16.783026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2329d4be-4e87-4e0a-bbb4-87da15028c4e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:16.784074 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 580/1177] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:16 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1332 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:16.790825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2329d4be-4e87-4e0a-bbb4-87da15028c4e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:16.791543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2329d4be-4e87-4e0a-bbb4-87da15028c4e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:16.792003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2329d4be-4e87-4e0a-bbb4-87da15028c4e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:16.793119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2329d4be-4e87-4e0a-bbb4-87da15028c4e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:16.793606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2329d4be-4e87-4e0a-bbb4-87da15028c4e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:16.795632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2329d4be-4e87-4e0a-bbb4-87da15028c4e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:16.806225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-78cf5a7e-43b9-49c4-bc9d-32b8a5d29586 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:16.806892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-78cf5a7e-43b9-49c4-bc9d-32b8a5d29586 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:16.821669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78cf5a7e-43b9-49c4-bc9d-32b8a5d29586 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:16.822169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78cf5a7e-43b9-49c4-bc9d-32b8a5d29586 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:16.823183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78cf5a7e-43b9-49c4-bc9d-32b8a5d29586 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:16.823973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78cf5a7e-43b9-49c4-bc9d-32b8a5d29586 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:16.824433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78cf5a7e-43b9-49c4-bc9d-32b8a5d29586 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:16.824854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78cf5a7e-43b9-49c4-bc9d-32b8a5d29586 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:16.985900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-78cf5a7e-43b9-49c4-bc9d-32b8a5d29586 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:16.999973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-78cf5a7e-43b9-49c4-bc9d-32b8a5d29586 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:17.001695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-78cf5a7e-43b9-49c4-bc9d-32b8a5d29586 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:17.016777 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-78cf5a7e-43b9-49c4-bc9d-32b8a5d29586 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.231027 Sep 08 12:42:17.018328 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 581/1178] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:16 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:17.229455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c64d93b2-1c98-443c-b5a5-d96d3957405c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:17.230989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c64d93b2-1c98-443c-b5a5-d96d3957405c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:17.241308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c64d93b2-1c98-443c-b5a5-d96d3957405c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:17.242056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c64d93b2-1c98-443c-b5a5-d96d3957405c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:17.244026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c64d93b2-1c98-443c-b5a5-d96d3957405c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:17.244026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c64d93b2-1c98-443c-b5a5-d96d3957405c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:17.246166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c64d93b2-1c98-443c-b5a5-d96d3957405c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:17.246860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c64d93b2-1c98-443c-b5a5-d96d3957405c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:17.261494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2329d4be-4e87-4e0a-bbb4-87da15028c4e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:17.292852 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2329d4be-4e87-4e0a-bbb4-87da15028c4e tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1714 microversion: 2.1 time: 0.516810 Sep 08 12:42:17.294434 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 598/1179] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:16 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1714 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:17.317153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-ee2d2906-6fb6-4d6b-bf8c-8ef07805defd req-eac29716-2394-4374-9416-3a2441f13f2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c71e5bb7-a289-4944-926a-bee8b5bfe8ee", "tag": "5d38cff6-9d90-48f1-9f72-666a7a5acdc6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:17.329529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ee2d2906-6fb6-4d6b-bf8c-8ef07805defd req-eac29716-2394-4374-9416-3a2441f13f2a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:17.330208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ee2d2906-6fb6-4d6b-bf8c-8ef07805defd req-eac29716-2394-4374-9416-3a2441f13f2a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:17.330765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ee2d2906-6fb6-4d6b-bf8c-8ef07805defd req-eac29716-2394-4374-9416-3a2441f13f2a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:17.367285 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-ee2d2906-6fb6-4d6b-bf8c-8ef07805defd req-eac29716-2394-4374-9416-3a2441f13f2a service nova] Creating event network-changed:5d38cff6-9d90-48f1-9f72-666a7a5acdc6 for instance c71e5bb7-a289-4944-926a-bee8b5bfe8ee on n-h1-852084-10 Sep 08 12:42:17.377122 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-ee2d2906-6fb6-4d6b-bf8c-8ef07805defd req-eac29716-2394-4374-9416-3a2441f13f2a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077647 Sep 08 12:42:17.389634 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 599/1180] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:42:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:17.682815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c64d93b2-1c98-443c-b5a5-d96d3957405c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:17.707684 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c64d93b2-1c98-443c-b5a5-d96d3957405c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1469 microversion: 2.1 time: 0.483878 Sep 08 12:42:17.722979 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 582/1181] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:17 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1469 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:17.790300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9ba62423-ba02-493e-99a6-d30e2885ddae tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:17.792552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9ba62423-ba02-493e-99a6-d30e2885ddae tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:17.802405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a2edc1de-2e97-460b-8f4c-6867a9828e64 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:17.803656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a2edc1de-2e97-460b-8f4c-6867a9828e64 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:17.826594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2edc1de-2e97-460b-8f4c-6867a9828e64 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:17.827183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2edc1de-2e97-460b-8f4c-6867a9828e64 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:17.827701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2edc1de-2e97-460b-8f4c-6867a9828e64 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:17.828445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2edc1de-2e97-460b-8f4c-6867a9828e64 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:17.833558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ba62423-ba02-493e-99a6-d30e2885ddae tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:17.834062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ba62423-ba02-493e-99a6-d30e2885ddae tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:17.834510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ba62423-ba02-493e-99a6-d30e2885ddae tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:17.835284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ba62423-ba02-493e-99a6-d30e2885ddae tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:17.835760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ba62423-ba02-493e-99a6-d30e2885ddae tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:17.836361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ba62423-ba02-493e-99a6-d30e2885ddae tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:17.842100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2edc1de-2e97-460b-8f4c-6867a9828e64 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:17.842719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2edc1de-2e97-460b-8f4c-6867a9828e64 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:18.675717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a2edc1de-2e97-460b-8f4c-6867a9828e64 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:18.683821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9ba62423-ba02-493e-99a6-d30e2885ddae tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:18.704011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9ba62423-ba02-493e-99a6-d30e2885ddae tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:18.709192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9ba62423-ba02-493e-99a6-d30e2885ddae tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:18.713770 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a2edc1de-2e97-460b-8f4c-6867a9828e64 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1332 microversion: 2.1 time: 0.917212 Sep 08 12:42:18.715743 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 583/1182] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:17 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1332 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:18.716537 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9ba62423-ba02-493e-99a6-d30e2885ddae tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1567 microversion: 2.25 time: 0.927126 Sep 08 12:42:18.717999 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 600/1183] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:17 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1567 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:42:18.725882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a3dad2da-ae3e-400f-b7fa-4b6f505b8ac2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:18.727170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9f92333f-2a6b-4ceb-ab39-7a2f7475ca96 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:18.727989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a3dad2da-ae3e-400f-b7fa-4b6f505b8ac2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:18.728719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9f92333f-2a6b-4ceb-ab39-7a2f7475ca96 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:18.743707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f92333f-2a6b-4ceb-ab39-7a2f7475ca96 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:18.745473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f92333f-2a6b-4ceb-ab39-7a2f7475ca96 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:18.746151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3dad2da-ae3e-400f-b7fa-4b6f505b8ac2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:18.746553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f92333f-2a6b-4ceb-ab39-7a2f7475ca96 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:18.748123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3dad2da-ae3e-400f-b7fa-4b6f505b8ac2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:18.748713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f92333f-2a6b-4ceb-ab39-7a2f7475ca96 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:18.749798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f92333f-2a6b-4ceb-ab39-7a2f7475ca96 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:18.749991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3dad2da-ae3e-400f-b7fa-4b6f505b8ac2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:18.751453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f92333f-2a6b-4ceb-ab39-7a2f7475ca96 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:18.752349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3dad2da-ae3e-400f-b7fa-4b6f505b8ac2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:18.753355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3dad2da-ae3e-400f-b7fa-4b6f505b8ac2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:18.754356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3dad2da-ae3e-400f-b7fa-4b6f505b8ac2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:18.920385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a3dad2da-ae3e-400f-b7fa-4b6f505b8ac2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:18.938038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a3dad2da-ae3e-400f-b7fa-4b6f505b8ac2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:18.942929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a3dad2da-ae3e-400f-b7fa-4b6f505b8ac2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:18.957963 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a3dad2da-ae3e-400f-b7fa-4b6f505b8ac2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.239741 Sep 08 12:42:18.958588 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 584/1184] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:18 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:18.971473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-17fa5040-aaf7-4e7a-b2ac-3adaa57d69d7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:18.973900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-17fa5040-aaf7-4e7a-b2ac-3adaa57d69d7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:18.988329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fa5040-aaf7-4e7a-b2ac-3adaa57d69d7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:18.988836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fa5040-aaf7-4e7a-b2ac-3adaa57d69d7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:18.994072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fa5040-aaf7-4e7a-b2ac-3adaa57d69d7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:18.996468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fa5040-aaf7-4e7a-b2ac-3adaa57d69d7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:18.996704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fa5040-aaf7-4e7a-b2ac-3adaa57d69d7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:18.997198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fa5040-aaf7-4e7a-b2ac-3adaa57d69d7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:19.134485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9f92333f-2a6b-4ceb-ab39-7a2f7475ca96 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55d39e1c491c47488c4de0e147732645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c8b4715d80648a0a6cbeedfbbf6f29c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:19.151953 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9f92333f-2a6b-4ceb-ab39-7a2f7475ca96 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 200 len: 1646 microversion: 2.1 time: 0.432163 Sep 08 12:42:19.155809 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 601/1185] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:18 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 1646 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:19.346113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-17fa5040-aaf7-4e7a-b2ac-3adaa57d69d7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:19.365647 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-17fa5040-aaf7-4e7a-b2ac-3adaa57d69d7 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1469 microversion: 2.1 time: 0.403159 Sep 08 12:42:19.366659 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 585/1186] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:18 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1469 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:19.513601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3a467edc-eb0b-484d-865b-ca76e5aa5518 req-a8b363e1-82ba-46c7-9e54-bebfb7d9aa9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b350654b-8f8e-4077-b819-3f97ab94143c", "name": "network-vif-deleted", "tag": "a40a204f-c921-4204-b9ec-b06d79e63487"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:19.549457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3a467edc-eb0b-484d-865b-ca76e5aa5518 req-a8b363e1-82ba-46c7-9e54-bebfb7d9aa9d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:19.552305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3a467edc-eb0b-484d-865b-ca76e5aa5518 req-a8b363e1-82ba-46c7-9e54-bebfb7d9aa9d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:19.555318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3a467edc-eb0b-484d-865b-ca76e5aa5518 req-a8b363e1-82ba-46c7-9e54-bebfb7d9aa9d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:19.607035 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3a467edc-eb0b-484d-865b-ca76e5aa5518 req-a8b363e1-82ba-46c7-9e54-bebfb7d9aa9d service nova] Creating event network-vif-deleted:a40a204f-c921-4204-b9ec-b06d79e63487 for instance b350654b-8f8e-4077-b819-3f97ab94143c on n-h2-852084-10 Sep 08 12:42:19.627937 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3a467edc-eb0b-484d-865b-ca76e5aa5518 req-a8b363e1-82ba-46c7-9e54-bebfb7d9aa9d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117670 Sep 08 12:42:19.630738 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 602/1187] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:42:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:19.743529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e24fc74-328a-4701-ab76-ed27aa8197b1 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:19.746056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6e24fc74-328a-4701-ab76-ed27aa8197b1 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:19.753445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-37908e34-3dea-4cdf-9061-f5c353af0d0d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:19.754396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-37908e34-3dea-4cdf-9061-f5c353af0d0d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:19.761509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e24fc74-328a-4701-ab76-ed27aa8197b1 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:19.762424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e24fc74-328a-4701-ab76-ed27aa8197b1 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:19.763896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e24fc74-328a-4701-ab76-ed27aa8197b1 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:19.765990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e24fc74-328a-4701-ab76-ed27aa8197b1 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:19.769385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e24fc74-328a-4701-ab76-ed27aa8197b1 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:19.770244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37908e34-3dea-4cdf-9061-f5c353af0d0d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:19.770380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e24fc74-328a-4701-ab76-ed27aa8197b1 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:19.771673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37908e34-3dea-4cdf-9061-f5c353af0d0d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:19.774521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37908e34-3dea-4cdf-9061-f5c353af0d0d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:19.778416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37908e34-3dea-4cdf-9061-f5c353af0d0d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:19.779023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37908e34-3dea-4cdf-9061-f5c353af0d0d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:19.779574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37908e34-3dea-4cdf-9061-f5c353af0d0d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:20.041878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:20.528193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6e24fc74-328a-4701-ab76-ed27aa8197b1 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:20.550106 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6e24fc74-328a-4701-ab76-ed27aa8197b1 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1536 microversion: 2.1 time: 0.815428 Sep 08 12:42:20.551811 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 586/1188] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:19 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1536 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:20.576919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-854215f8-5c80-4d4b-ba88-8ad916f42c4b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:20.579957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-854215f8-5c80-4d4b-ba88-8ad916f42c4b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:20.610672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-854215f8-5c80-4d4b-ba88-8ad916f42c4b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:20.611916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-854215f8-5c80-4d4b-ba88-8ad916f42c4b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:20.614139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-854215f8-5c80-4d4b-ba88-8ad916f42c4b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:20.621617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-854215f8-5c80-4d4b-ba88-8ad916f42c4b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:20.624726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-854215f8-5c80-4d4b-ba88-8ad916f42c4b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:20.628516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-854215f8-5c80-4d4b-ba88-8ad916f42c4b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:21.164082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-854215f8-5c80-4d4b-ba88-8ad916f42c4b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:21.213700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-854215f8-5c80-4d4b-ba88-8ad916f42c4b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:21.226912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-854215f8-5c80-4d4b-ba88-8ad916f42c4b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:21.266154 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-854215f8-5c80-4d4b-ba88-8ad916f42c4b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.711176 Sep 08 12:42:21.270985 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 587/1189] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:20 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:21.305648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ebc3e79e-8124-4758-ac92-99e09e43a863 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:21.306773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ebc3e79e-8124-4758-ac92-99e09e43a863 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] [instance: b350654b-8f8e-4077-b819-3f97ab94143c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:21.364475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc3e79e-8124-4758-ac92-99e09e43a863 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:21.365456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc3e79e-8124-4758-ac92-99e09e43a863 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:21.365801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc3e79e-8124-4758-ac92-99e09e43a863 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:21.367054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc3e79e-8124-4758-ac92-99e09e43a863 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:21.383932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc3e79e-8124-4758-ac92-99e09e43a863 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:21.384606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc3e79e-8124-4758-ac92-99e09e43a863 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:21.409433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-37908e34-3dea-4cdf-9061-f5c353af0d0d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:21.489860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-37908e34-3dea-4cdf-9061-f5c353af0d0d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:21.524741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-37908e34-3dea-4cdf-9061-f5c353af0d0d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:21.527620 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-37908e34-3dea-4cdf-9061-f5c353af0d0d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1567 microversion: 2.25 time: 1.780384 Sep 08 12:42:21.540685 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-ebc3e79e-8124-4758-ac92-99e09e43a863 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] HTTP exception thrown: Instance b350654b-8f8e-4077-b819-3f97ab94143c could not be found. Sep 08 12:42:21.543744 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 603/1190] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:19 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1567 bytes in 1798 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ebc3e79e-8124-4758-ac92-99e09e43a863 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Request method failure captured: Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c HTTP/1.1 Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeLX5u9rdpljzGFRv79KkeqG1y8LUkyRS8yILmpx4ahL3WbD7zL08nSlOS4ricjysUNzpNlkyp9-KLMI0GLpiV8oNBJso5a4_K22cPDpFudrcAuQYSJYSEiekbDGgXsMD2xDBHhQfuS8q1Sapt8V1jqRpX0vslABxBY2zT_AQYYnx9g Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0c8b4715d80648a0a6cbeedfbbf6f29c Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestManualDisk-387420151 Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:42:21.554983 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:42:21.558264 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c8b4715d80648a0a6cbeedfbbf6f29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c8b4715d80648a0a6cbeedfbbf6f29c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c8b4715d80648a0a6cbeedfbbf6f29c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c8b4715d80648a0a6cbeedfbbf6f29c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:42:21.558264 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestManualDisk-387420151 Sep 08 12:42:21.558264 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0c8b4715d80648a0a6cbeedfbbf6f29c Sep 08 12:42:21.558264 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestManualDisk-387420151 Sep 08 12:42:21.558264 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestManualDisk-387420151-project Sep 08 12:42:21.558264 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:42:21.558264 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:42:21.558264 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 55d39e1c491c47488c4de0e147732645 Sep 08 12:42:21.558264 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestManualDisk-387420151-project Sep 08 12:42:21.558264 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:42:21.558264 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance b350654b-8f8e-4077-b819-3f97ab94143c could not be found. Sep 08 12:42:21.558264 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'b350654b-8f8e-4077-b819-3f97ab94143c'} Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b350654b-8f8e-4077-b819-3f97ab94143c could not be found. Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:42:21.559962 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b350654b-8f8e-4077-b819-3f97ab94143c could not be found. Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b350654b-8f8e-4077-b819-3f97ab94143c could not be found. Sep 08 12:42:21.562641 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:21.580712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ebc3e79e-8124-4758-ac92-99e09e43a863 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Returning 404 to user: Instance b350654b-8f8e-4077-b819-3f97ab94143c could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:42:21.587840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-389ee677-50bd-468d-976d-ca218fb6dc35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:21.591644 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ebc3e79e-8124-4758-ac92-99e09e43a863 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c" status: 404 len: 111 microversion: 2.1 time: 0.311450 Sep 08 12:42:21.595902 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 588/1191] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:21 2022] GET /compute/v2.1/servers/b350654b-8f8e-4077-b819-3f97ab94143c => generated 111 bytes in 324 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:42:21.602853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-389ee677-50bd-468d-976d-ca218fb6dc35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:21.626136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-389ee677-50bd-468d-976d-ca218fb6dc35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:21.627258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-389ee677-50bd-468d-976d-ca218fb6dc35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:21.628019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-389ee677-50bd-468d-976d-ca218fb6dc35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:21.629249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-389ee677-50bd-468d-976d-ca218fb6dc35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:21.630079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-389ee677-50bd-468d-976d-ca218fb6dc35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:21.630963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-389ee677-50bd-468d-976d-ca218fb6dc35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:21.633262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75910968-df3f-4070-a2de-b95b0f7f80d8 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Action: 'create', calling method: .version_select at 0x7fdb36c69550>, body: {"pool": "c37e2e21-e71d-413c-a8dc-a35ec1a46711"} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:21.945111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:22.656839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-389ee677-50bd-468d-976d-ca218fb6dc35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:22.672887 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-389ee677-50bd-468d-976d-ca218fb6dc35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1535 microversion: 2.1 time: 1.126873 Sep 08 12:42:22.703796 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 604/1192] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:21 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1535 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:22.715823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-450dac3f-01cd-4e6c-ae83-d3d19bc7e977 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] Calling method '.version_select at 0x7fdb3ad308b0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:22.761132 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-450dac3f-01cd-4e6c-ae83-d3d19bc7e977 tempest-ServersTestManualDisk-387420151 tempest-ServersTestManualDisk-387420151-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-106207217" status: 202 len: 0 microversion: 2.1 time: 0.053470 Sep 08 12:42:22.762823 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 605/1193] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 12:42:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-106207217 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:42:22.777146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f0a63b44-e9b8-494b-aab5-152bf83aa587 req-e28fc92b-9b7e-4120-9e13-bdb2c76c49b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc95339-7b99-439b-8a64-3eeb808b9c77", "name": "network-vif-unplugged", "status": "completed", "tag": "c88f65d9-eeed-4224-9551-d32c44c05007"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:22.804006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f0a63b44-e9b8-494b-aab5-152bf83aa587 req-e28fc92b-9b7e-4120-9e13-bdb2c76c49b8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:22.805565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f0a63b44-e9b8-494b-aab5-152bf83aa587 req-e28fc92b-9b7e-4120-9e13-bdb2c76c49b8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:22.806735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f0a63b44-e9b8-494b-aab5-152bf83aa587 req-e28fc92b-9b7e-4120-9e13-bdb2c76c49b8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:22.836234 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f0a63b44-e9b8-494b-aab5-152bf83aa587 req-e28fc92b-9b7e-4120-9e13-bdb2c76c49b8 service nova] Creating event network-vif-unplugged:c88f65d9-eeed-4224-9551-d32c44c05007 for instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 on n-h2-852084-10 Sep 08 12:42:22.853375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-f0a63b44-e9b8-494b-aab5-152bf83aa587 req-e28fc92b-9b7e-4120-9e13-bdb2c76c49b8 service nova] Instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:42:22.884628 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f0a63b44-e9b8-494b-aab5-152bf83aa587 req-e28fc92b-9b7e-4120-9e13-bdb2c76c49b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118414 Sep 08 12:42:22.894228 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 606/1194] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:22.916173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7276769d-e2b9-4aaa-beff-6438cfd34f4c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:22.920950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7276769d-e2b9-4aaa-beff-6438cfd34f4c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:22.938519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7276769d-e2b9-4aaa-beff-6438cfd34f4c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:22.940747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7276769d-e2b9-4aaa-beff-6438cfd34f4c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:22.949429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7276769d-e2b9-4aaa-beff-6438cfd34f4c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:22.954308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7276769d-e2b9-4aaa-beff-6438cfd34f4c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:22.957273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7276769d-e2b9-4aaa-beff-6438cfd34f4c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:22.960349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7276769d-e2b9-4aaa-beff-6438cfd34f4c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:23.340783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7276769d-e2b9-4aaa-beff-6438cfd34f4c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:23.375438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7276769d-e2b9-4aaa-beff-6438cfd34f4c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:23.380851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7276769d-e2b9-4aaa-beff-6438cfd34f4c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:23.398368 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7276769d-e2b9-4aaa-beff-6438cfd34f4c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1533 microversion: 2.91 time: 0.497216 Sep 08 12:42:23.421159 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 607/1195] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:22 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1533 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:23.442879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-acbad330-d627-46ad-8c67-f99cced59209 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:23.448179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-acbad330-d627-46ad-8c67-f99cced59209 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:23.466268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acbad330-d627-46ad-8c67-f99cced59209 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:23.468444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acbad330-d627-46ad-8c67-f99cced59209 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:23.469699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acbad330-d627-46ad-8c67-f99cced59209 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:23.473203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acbad330-d627-46ad-8c67-f99cced59209 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:23.477787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acbad330-d627-46ad-8c67-f99cced59209 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:23.479575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acbad330-d627-46ad-8c67-f99cced59209 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:24.522448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-acbad330-d627-46ad-8c67-f99cced59209 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:24.540658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-acbad330-d627-46ad-8c67-f99cced59209 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:24.546212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-acbad330-d627-46ad-8c67-f99cced59209 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:24.549586 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-acbad330-d627-46ad-8c67-f99cced59209 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1567 microversion: 2.25 time: 1.125690 Sep 08 12:42:24.551267 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 608/1196] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:23 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1567 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:24.567526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-52f12ee0-4dd7-447b-8aea-30fe5661f506 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:24.570267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-52f12ee0-4dd7-447b-8aea-30fe5661f506 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:24.577628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52f12ee0-4dd7-447b-8aea-30fe5661f506 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:24.577628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52f12ee0-4dd7-447b-8aea-30fe5661f506 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:24.578105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52f12ee0-4dd7-447b-8aea-30fe5661f506 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:24.578937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52f12ee0-4dd7-447b-8aea-30fe5661f506 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:24.579463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52f12ee0-4dd7-447b-8aea-30fe5661f506 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:24.579892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52f12ee0-4dd7-447b-8aea-30fe5661f506 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:24.879848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-52f12ee0-4dd7-447b-8aea-30fe5661f506 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lazy-loading 'services' on Instance uuid 3a0136c7-9cb3-4446-964d-ea92bc5ff815 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:42:24.928917 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-52f12ee0-4dd7-447b-8aea-30fe5661f506 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1940 microversion: 2.91 time: 0.373217 Sep 08 12:42:24.931126 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 609/1197] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:24 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1940 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:24.944759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d9a14dac-174b-41d4-a807-654b444b527e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:24.948464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d9a14dac-174b-41d4-a807-654b444b527e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:24.967008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9a14dac-174b-41d4-a807-654b444b527e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:24.968309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9a14dac-174b-41d4-a807-654b444b527e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:24.969376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9a14dac-174b-41d4-a807-654b444b527e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:24.971104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9a14dac-174b-41d4-a807-654b444b527e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:24.972224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9a14dac-174b-41d4-a807-654b444b527e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:24.973279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9a14dac-174b-41d4-a807-654b444b527e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:25.212752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=17 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:25.745606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d9a14dac-174b-41d4-a807-654b444b527e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:25.757117 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d9a14dac-174b-41d4-a807-654b444b527e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1535 microversion: 2.1 time: 0.822866 Sep 08 12:42:25.758320 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 610/1198] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:24 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1535 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:25.999036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e16b049a-3491-4378-bcac-b1b5afce53c3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3ae22f70>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:26.003031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e16b049a-3491-4378-bcac-b1b5afce53c3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:26.004120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e16b049a-3491-4378-bcac-b1b5afce53c3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:26.004555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e16b049a-3491-4378-bcac-b1b5afce53c3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:26.014293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e16b049a-3491-4378-bcac-b1b5afce53c3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:26.014782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e16b049a-3491-4378-bcac-b1b5afce53c3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:26.015483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e16b049a-3491-4378-bcac-b1b5afce53c3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:26.024549 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e16b049a-3491-4378-bcac-b1b5afce53c3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] HTTP exception thrown: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e16b049a-3491-4378-bcac-b1b5afce53c3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Request method failure captured: Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: request: PUT /compute/v2.1/os-services/cac545f6-dd39-49c7-81e0-bbb99f5214bd HTTP/1.1 Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 56 Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeMv8R7EfX--tQeJVnfz0AZIiqPKcth6A5YHJJSTjoPaDVVyGuixb4ngRlXOpe-lq11SKLyT0p8PIcna9SZ5YCKA-nGkqQibBoLLHEzSXuLfHC8onRawOSLbfeWKGmH25Pwynrq4DvyCcyOhFQYUT1WPsXbVa8Z-2EH8HPx2pnf3aP8 Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.53 Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: cf78aa6038d147579efcf10a859356e2 Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1617912140 Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:42:26.027899 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cf78aa6038d147579efcf10a859356e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cf78aa6038d147579efcf10a859356e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf78aa6038d147579efcf10a859356e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf78aa6038d147579efcf10a859356e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1617912140 Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: cf78aa6038d147579efcf10a859356e2 Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1617912140 Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: ebb45dfb2f3a44cda286a8d3d25806b2 Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: {"status": "disabled", "disabled_reason": "maintenance"} Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:42:26.033252 n-d-852084-10 devstack@n-api.service[128971]: exception: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'cac545f6-dd39-49c7-81e0-bbb99f5214bd', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:42:26.041043 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:26.053436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:42:26.066896 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:42:26.066896 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:26.066896 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:42:26.066896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e16b049a-3491-4378-bcac-b1b5afce53c3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Returning 404 to user: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:42:26.066896 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e16b049a-3491-4378-bcac-b1b5afce53c3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/cac545f6-dd39-49c7-81e0-bbb99f5214bd" status: 404 len: 110 microversion: 2.53 time: 0.269947 Sep 08 12:42:26.066896 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 611/1199] 10.222.0.78 () {62 vars in 1309 bytes} [Thu Sep 8 12:42:25 2022] PUT /compute/v2.1/os-services/cac545f6-dd39-49c7-81e0-bbb99f5214bd => generated 110 bytes in 276 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:42:26.066896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92080764-f37a-4bce-8f34-22b8480d6034 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:26.069427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-92080764-f37a-4bce-8f34-22b8480d6034 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:26.069427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92080764-f37a-4bce-8f34-22b8480d6034 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:26.069427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92080764-f37a-4bce-8f34-22b8480d6034 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:26.069427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92080764-f37a-4bce-8f34-22b8480d6034 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:26.071826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92080764-f37a-4bce-8f34-22b8480d6034 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:26.071826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92080764-f37a-4bce-8f34-22b8480d6034 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:26.071826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92080764-f37a-4bce-8f34-22b8480d6034 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:26.444161 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92080764-f37a-4bce-8f34-22b8480d6034 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1859 microversion: 2.1 time: 0.403464 Sep 08 12:42:26.445144 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 612/1200] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:26 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1859 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:26.456386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8be5ff11-bc76-46ac-97cc-5b196dcae74c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:26.457471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8be5ff11-bc76-46ac-97cc-5b196dcae74c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:26.465330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8be5ff11-bc76-46ac-97cc-5b196dcae74c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:26.466340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8be5ff11-bc76-46ac-97cc-5b196dcae74c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:26.467075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8be5ff11-bc76-46ac-97cc-5b196dcae74c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:26.468166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8be5ff11-bc76-46ac-97cc-5b196dcae74c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:26.468821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8be5ff11-bc76-46ac-97cc-5b196dcae74c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:26.469484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8be5ff11-bc76-46ac-97cc-5b196dcae74c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:26.508211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-8be5ff11-bc76-46ac-97cc-5b196dcae74c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lazy-loading 'flavor' on Instance uuid 3a0136c7-9cb3-4446-964d-ea92bc5ff815 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:42:26.624673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:26.872759 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8be5ff11-bc76-46ac-97cc-5b196dcae74c tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "POST /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815/action" status: 202 len: 0 microversion: 2.91 time: 0.422724 Sep 08 12:42:26.875818 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 613/1201] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 12:42:26 2022] POST /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:42:26.897410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ef653931-4f0f-457a-8f84-8c8ad858050e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:26.910202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ef653931-4f0f-457a-8f84-8c8ad858050e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:26.943208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef653931-4f0f-457a-8f84-8c8ad858050e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:26.943830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef653931-4f0f-457a-8f84-8c8ad858050e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:26.945275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef653931-4f0f-457a-8f84-8c8ad858050e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:26.948933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef653931-4f0f-457a-8f84-8c8ad858050e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:26.949991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef653931-4f0f-457a-8f84-8c8ad858050e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:26.950932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef653931-4f0f-457a-8f84-8c8ad858050e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:27.826165 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-75910968-df3f-4070-a2de-b95b0f7f80d8 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 6.225830 Sep 08 12:42:27.827004 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 589/1202] 10.222.0.78 () {60 vars in 1170 bytes} [Thu Sep 8 12:42:21 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 6228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:27.841707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f157f31a-c1d7-480b-beb9-21dd85d56718 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Action: 'update', calling method: .version_select at 0x7fdb36db7af0>, body: {"status": "disabled"} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:27.845995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f157f31a-c1d7-480b-beb9-21dd85d56718 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:27.847478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f157f31a-c1d7-480b-beb9-21dd85d56718 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:27.848082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f157f31a-c1d7-480b-beb9-21dd85d56718 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:27.859214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f157f31a-c1d7-480b-beb9-21dd85d56718 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:27.859731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f157f31a-c1d7-480b-beb9-21dd85d56718 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:27.860172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f157f31a-c1d7-480b-beb9-21dd85d56718 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:27.869291 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-f157f31a-c1d7-480b-beb9-21dd85d56718 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] HTTP exception thrown: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f157f31a-c1d7-480b-beb9-21dd85d56718 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Request method failure captured: Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/os-services/cac545f6-dd39-49c7-81e0-bbb99f5214bd HTTP/1.1 Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 22 Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeMv8R7EfX--tQeJVnfz0AZIiqPKcth6A5YHJJSTjoPaDVVyGuixb4ngRlXOpe-lq11SKLyT0p8PIcna9SZ5YCKA-nGkqQibBoLLHEzSXuLfHC8onRawOSLbfeWKGmH25Pwynrq4DvyCcyOhFQYUT1WPsXbVa8Z-2EH8HPx2pnf3aP8 Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.53 Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: cf78aa6038d147579efcf10a859356e2 Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1617912140 Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:42:27.874192 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cf78aa6038d147579efcf10a859356e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cf78aa6038d147579efcf10a859356e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf78aa6038d147579efcf10a859356e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf78aa6038d147579efcf10a859356e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1617912140 Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: cf78aa6038d147579efcf10a859356e2 Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1617912140 Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: ebb45dfb2f3a44cda286a8d3d25806b2 Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: {"status": "disabled"} Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: exception: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:27.877054 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'cac545f6-dd39-49c7-81e0-bbb99f5214bd', 'body': {'status': 'disabled'}} Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:27.878936 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:42:27.881507 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:42:27.883688 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:27.883688 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:27.883688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f157f31a-c1d7-480b-beb9-21dd85d56718 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Returning 404 to user: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:42:27.883688 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f157f31a-c1d7-480b-beb9-21dd85d56718 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/cac545f6-dd39-49c7-81e0-bbb99f5214bd" status: 404 len: 110 microversion: 2.53 time: 0.038597 Sep 08 12:42:27.883688 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 590/1203] 10.222.0.78 () {62 vars in 1309 bytes} [Thu Sep 8 12:42:27 2022] PUT /compute/v2.1/os-services/cac545f6-dd39-49c7-81e0-bbb99f5214bd => generated 110 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:42:27.883688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ea51b383-5209-41ce-bd84-36ac8c59bfc7 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-852084-10", "block_migration": true, "disk_over_commit": false}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:27.887724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ea51b383-5209-41ce-bd84-36ac8c59bfc7 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:27.895701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea51b383-5209-41ce-bd84-36ac8c59bfc7 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:27.896377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea51b383-5209-41ce-bd84-36ac8c59bfc7 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:27.896829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea51b383-5209-41ce-bd84-36ac8c59bfc7 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:27.897741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea51b383-5209-41ce-bd84-36ac8c59bfc7 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:27.898212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea51b383-5209-41ce-bd84-36ac8c59bfc7 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:27.898718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea51b383-5209-41ce-bd84-36ac8c59bfc7 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:27.931412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-ea51b383-5209-41ce-bd84-36ac8c59bfc7 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lazy-loading 'flavor' on Instance uuid 62d483e1-ee86-4c2f-ae5a-d14ad8686dea {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:42:27.947120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ea51b383-5209-41ce-bd84-36ac8c59bfc7 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Going to try to live migrate instance to n-h1-852084-10 {{(pid=128970) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 12:42:27.962758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ef653931-4f0f-457a-8f84-8c8ad858050e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:27.973256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ef653931-4f0f-457a-8f84-8c8ad858050e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:27.975284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ef653931-4f0f-457a-8f84-8c8ad858050e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:27.977063 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ef653931-4f0f-457a-8f84-8c8ad858050e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1542 microversion: 2.25 time: 1.096173 Sep 08 12:42:27.991268 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 614/1204] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:26 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1542 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:27.991268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-79725c15-e158-46ef-b310-6d8fdad49d53 req-ab52bedb-3642-4d78-adf1-cde5543f63d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bc95339-7b99-439b-8a64-3eeb808b9c77", "tag": "c88f65d9-eeed-4224-9551-d32c44c05007"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:28.002448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-79725c15-e158-46ef-b310-6d8fdad49d53 req-ab52bedb-3642-4d78-adf1-cde5543f63d1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:28.003345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-79725c15-e158-46ef-b310-6d8fdad49d53 req-ab52bedb-3642-4d78-adf1-cde5543f63d1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:28.003923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-79725c15-e158-46ef-b310-6d8fdad49d53 req-ab52bedb-3642-4d78-adf1-cde5543f63d1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:28.020661 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-79725c15-e158-46ef-b310-6d8fdad49d53 req-ab52bedb-3642-4d78-adf1-cde5543f63d1 service nova] Creating event network-changed:c88f65d9-eeed-4224-9551-d32c44c05007 for instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 on n-h2-852084-10 Sep 08 12:42:28.028427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-79725c15-e158-46ef-b310-6d8fdad49d53 req-ab52bedb-3642-4d78-adf1-cde5543f63d1 service nova] Instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:42:28.037668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:28.045795 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-79725c15-e158-46ef-b310-6d8fdad49d53 req-ab52bedb-3642-4d78-adf1-cde5543f63d1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063987 Sep 08 12:42:28.047002 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 615/1205] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:28.054945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b30619b-de34-4594-b127-3e22daec2efb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:28.056171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1b30619b-de34-4594-b127-3e22daec2efb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:28.068695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b30619b-de34-4594-b127-3e22daec2efb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:28.070828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b30619b-de34-4594-b127-3e22daec2efb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:28.071888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b30619b-de34-4594-b127-3e22daec2efb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:28.073317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b30619b-de34-4594-b127-3e22daec2efb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:28.074224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b30619b-de34-4594-b127-3e22daec2efb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:28.074919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b30619b-de34-4594-b127-3e22daec2efb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:28.306600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1b30619b-de34-4594-b127-3e22daec2efb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:28.322170 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1b30619b-de34-4594-b127-3e22daec2efb tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1535 microversion: 2.1 time: 0.273333 Sep 08 12:42:28.324127 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 616/1206] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:28 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1535 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:28.334357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3b30dc67-d670-4200-983e-9f6924f239e6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:28.336192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3b30dc67-d670-4200-983e-9f6924f239e6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:28.350363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b30dc67-d670-4200-983e-9f6924f239e6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:28.353604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b30dc67-d670-4200-983e-9f6924f239e6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:28.355393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b30dc67-d670-4200-983e-9f6924f239e6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:28.357055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b30dc67-d670-4200-983e-9f6924f239e6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:28.358175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b30dc67-d670-4200-983e-9f6924f239e6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:28.359290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b30dc67-d670-4200-983e-9f6924f239e6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:28.481461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b30dc67-d670-4200-983e-9f6924f239e6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:28.493120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b30dc67-d670-4200-983e-9f6924f239e6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:28.495140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b30dc67-d670-4200-983e-9f6924f239e6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:28.502107 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3b30dc67-d670-4200-983e-9f6924f239e6 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.176142 Sep 08 12:42:28.503266 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 617/1207] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:28 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:28.508351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Action: 'action', calling method: .version_select at 0x7fdb3d4ab550>, body: {"addFloatingIp": {"address": "172.25.4.161"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:28.511182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:28.524308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:28.526793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:28.527765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:28.529081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:28.529921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:28.530687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:28.716089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "refresh_cache-21de9f4e-35f1-485e-bf5c-301cec48fa12" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 12:42:28.716940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquired lock "refresh_cache-21de9f4e-35f1-485e-bf5c-301cec48fa12" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 12:42:31.234144 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ea51b383-5209-41ce-bd84-36ac8c59bfc7 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/action" status: 202 len: 0 microversion: 2.1 time: 3.355261 Sep 08 12:42:31.240433 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 591/1208] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:42:27 2022] POST /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/action => generated 0 bytes in 3358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:42:31.255470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4cabd7d5-46f5-4237-9989-8ce8e781583c tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Action: 'update', calling method: .version_select at 0x7fdb36bf3790>, body: {"status": "enabled"} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:31.278392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cabd7d5-46f5-4237-9989-8ce8e781583c tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:31.280159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cabd7d5-46f5-4237-9989-8ce8e781583c tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:31.281037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cabd7d5-46f5-4237-9989-8ce8e781583c tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:31.303456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cabd7d5-46f5-4237-9989-8ce8e781583c tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:31.305923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cabd7d5-46f5-4237-9989-8ce8e781583c tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:31.306443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cabd7d5-46f5-4237-9989-8ce8e781583c tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:31.315984 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-4cabd7d5-46f5-4237-9989-8ce8e781583c tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] HTTP exception thrown: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4cabd7d5-46f5-4237-9989-8ce8e781583c tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Request method failure captured: Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/os-services/cac545f6-dd39-49c7-81e0-bbb99f5214bd HTTP/1.1 Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 21 Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeMv8R7EfX--tQeJVnfz0AZIiqPKcth6A5YHJJSTjoPaDVVyGuixb4ngRlXOpe-lq11SKLyT0p8PIcna9SZ5YCKA-nGkqQibBoLLHEzSXuLfHC8onRawOSLbfeWKGmH25Pwynrq4DvyCcyOhFQYUT1WPsXbVa8Z-2EH8HPx2pnf3aP8 Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.53 Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: cf78aa6038d147579efcf10a859356e2 Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1617912140 Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:42:31.317894 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cf78aa6038d147579efcf10a859356e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cf78aa6038d147579efcf10a859356e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf78aa6038d147579efcf10a859356e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cf78aa6038d147579efcf10a859356e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1617912140 Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: cf78aa6038d147579efcf10a859356e2 Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1617912140 Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: ebb45dfb2f3a44cda286a8d3d25806b2 Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: {"status": "enabled"} Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: exception: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:31.319630 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'cac545f6-dd39-49c7-81e0-bbb99f5214bd', 'body': {'status': 'enabled'}} Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:31.320675 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:42:31.322268 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:42:31.323876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. Sep 08 12:42:31.323876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:31.323876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4cabd7d5-46f5-4237-9989-8ce8e781583c tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Returning 404 to user: Service cac545f6-dd39-49c7-81e0-bbb99f5214bd could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:42:31.323876 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4cabd7d5-46f5-4237-9989-8ce8e781583c tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-services/cac545f6-dd39-49c7-81e0-bbb99f5214bd" status: 404 len: 110 microversion: 2.53 time: 0.077392 Sep 08 12:42:31.329190 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 592/1209] 10.222.0.78 () {62 vars in 1309 bytes} [Thu Sep 8 12:42:31 2022] PUT /compute/v2.1/os-services/cac545f6-dd39-49c7-81e0-bbb99f5214bd => generated 110 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:42:31.335696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-553de29b-2afe-4432-9d15-0d65622f6353 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '.version_select at 0x7fdb36b64ca0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:31.342689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-553de29b-2afe-4432-9d15-0d65622f6353 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:31.351817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-553de29b-2afe-4432-9d15-0d65622f6353 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:31.355310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-553de29b-2afe-4432-9d15-0d65622f6353 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:31.408990 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-553de29b-2afe-4432-9d15-0d65622f6353 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 3659 microversion: 2.25 time: 0.078212 Sep 08 12:42:31.410040 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 593/1210] 10.222.0.78 () {60 vars in 1184 bytes} [Thu Sep 8 12:42:31 2022] GET /compute/v2.1/os-migrations => generated 3659 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:31.432314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ff7d52e-96cc-43ec-ace4-cde580041442 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:31.433470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8ff7d52e-96cc-43ec-ace4-cde580041442 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:31.447514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ff7d52e-96cc-43ec-ace4-cde580041442 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:31.448402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ff7d52e-96cc-43ec-ace4-cde580041442 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:31.449224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ff7d52e-96cc-43ec-ace4-cde580041442 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:31.450621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ff7d52e-96cc-43ec-ace4-cde580041442 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:31.451361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ff7d52e-96cc-43ec-ace4-cde580041442 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:31.452115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ff7d52e-96cc-43ec-ace4-cde580041442 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:32.163873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8ff7d52e-96cc-43ec-ace4-cde580041442 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:32.183873 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8ff7d52e-96cc-43ec-ace4-cde580041442 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1528 microversion: 2.1 time: 0.756285 Sep 08 12:42:32.185540 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 594/1211] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:31 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1528 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:32.196675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d293f94f-37b3-487a-aa45-cfc0fc2a923d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:32.198967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d293f94f-37b3-487a-aa45-cfc0fc2a923d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:32.212897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d293f94f-37b3-487a-aa45-cfc0fc2a923d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:32.215299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d293f94f-37b3-487a-aa45-cfc0fc2a923d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:32.216658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d293f94f-37b3-487a-aa45-cfc0fc2a923d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:32.222351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d293f94f-37b3-487a-aa45-cfc0fc2a923d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:32.225490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d293f94f-37b3-487a-aa45-cfc0fc2a923d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:32.226798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d293f94f-37b3-487a-aa45-cfc0fc2a923d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:32.710521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d293f94f-37b3-487a-aa45-cfc0fc2a923d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:32.723595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d293f94f-37b3-487a-aa45-cfc0fc2a923d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:32.725086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d293f94f-37b3-487a-aa45-cfc0fc2a923d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:32.737715 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d293f94f-37b3-487a-aa45-cfc0fc2a923d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.550307 Sep 08 12:42:32.738907 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 595/1212] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:32 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:32.745532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca79cc5f-4fc6-4cae-8201-0ef6df6864e1 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:32.746548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ca79cc5f-4fc6-4cae-8201-0ef6df6864e1 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:32.755318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca79cc5f-4fc6-4cae-8201-0ef6df6864e1 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:32.756377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca79cc5f-4fc6-4cae-8201-0ef6df6864e1 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:32.757066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca79cc5f-4fc6-4cae-8201-0ef6df6864e1 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:32.758024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca79cc5f-4fc6-4cae-8201-0ef6df6864e1 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:32.759013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca79cc5f-4fc6-4cae-8201-0ef6df6864e1 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:32.759757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca79cc5f-4fc6-4cae-8201-0ef6df6864e1 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:33.361139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ca79cc5f-4fc6-4cae-8201-0ef6df6864e1 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:33.372383 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca79cc5f-4fc6-4cae-8201-0ef6df6864e1 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1716 microversion: 2.1 time: 0.631973 Sep 08 12:42:33.372978 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 596/1213] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:32 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1716 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:33.378151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1c09ffec-d741-44c3-8519-bd5e7fa323ec tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:33.382733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c09ffec-d741-44c3-8519-bd5e7fa323ec tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:33.383681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c09ffec-d741-44c3-8519-bd5e7fa323ec tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:33.384378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c09ffec-d741-44c3-8519-bd5e7fa323ec tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:33.385955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c09ffec-d741-44c3-8519-bd5e7fa323ec tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:33.386671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c09ffec-d741-44c3-8519-bd5e7fa323ec tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:33.387373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c09ffec-d741-44c3-8519-bd5e7fa323ec tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:33.418664 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1c09ffec-d741-44c3-8519-bd5e7fa323ec tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.044279 Sep 08 12:42:33.419900 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 597/1214] 10.222.0.78 () {60 vars in 1178 bytes} [Thu Sep 8 12:42:33 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:33.425039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d1826082-3614-4c36-b3dc-a5774d42a8a3 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:33.426072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d1826082-3614-4c36-b3dc-a5774d42a8a3 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:33.433197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1826082-3614-4c36-b3dc-a5774d42a8a3 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:33.434327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1826082-3614-4c36-b3dc-a5774d42a8a3 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:33.435085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1826082-3614-4c36-b3dc-a5774d42a8a3 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:33.436703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1826082-3614-4c36-b3dc-a5774d42a8a3 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:33.437496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1826082-3614-4c36-b3dc-a5774d42a8a3 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:33.438372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1826082-3614-4c36-b3dc-a5774d42a8a3 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:34.308416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Building network info cache for instance {{(pid=128971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 12:42:34.352232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-d1826082-3614-4c36-b3dc-a5774d42a8a3 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid c71e5bb7-a289-4944-926a-bee8b5bfe8ee {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:42:34.431881 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d1826082-3614-4c36-b3dc-a5774d42a8a3 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 2037 microversion: 2.25 time: 1.004162 Sep 08 12:42:34.437113 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 598/1215] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:33 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 2037 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:34.486253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-37a97655-c28c-49e1-a043-4fa9c5af5bb4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:34.488005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-37a97655-c28c-49e1-a043-4fa9c5af5bb4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:34.545788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37a97655-c28c-49e1-a043-4fa9c5af5bb4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:34.549698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37a97655-c28c-49e1-a043-4fa9c5af5bb4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:34.559500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37a97655-c28c-49e1-a043-4fa9c5af5bb4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:34.562706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37a97655-c28c-49e1-a043-4fa9c5af5bb4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:34.563893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37a97655-c28c-49e1-a043-4fa9c5af5bb4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:34.568496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37a97655-c28c-49e1-a043-4fa9c5af5bb4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:36.012244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:36.124413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-37a97655-c28c-49e1-a043-4fa9c5af5bb4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:36.156740 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-37a97655-c28c-49e1-a043-4fa9c5af5bb4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1528 microversion: 2.1 time: 1.714272 Sep 08 12:42:36.184875 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 599/1216] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:34 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1528 bytes in 1746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:36.203619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1b7da03f-45e8-44ad-b914-fd94c28cf8ab tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:36.210312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b7da03f-45e8-44ad-b914-fd94c28cf8ab tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:36.211121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b7da03f-45e8-44ad-b914-fd94c28cf8ab tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:36.211901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b7da03f-45e8-44ad-b914-fd94c28cf8ab tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:36.213227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b7da03f-45e8-44ad-b914-fd94c28cf8ab tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:36.214478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b7da03f-45e8-44ad-b914-fd94c28cf8ab tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:36.215193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b7da03f-45e8-44ad-b914-fd94c28cf8ab tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:36.278608 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1b7da03f-45e8-44ad-b914-fd94c28cf8ab tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.083935 Sep 08 12:42:36.294153 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 600/1217] 10.222.0.78 () {60 vars in 1211 bytes} [Thu Sep 8 12:42:36 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:36.294153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6a12059b-b234-44cd-a2d6-b1ba70353d11 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:36.294153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6a12059b-b234-44cd-a2d6-b1ba70353d11 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:36.301614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a12059b-b234-44cd-a2d6-b1ba70353d11 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:36.302496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a12059b-b234-44cd-a2d6-b1ba70353d11 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:36.303251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a12059b-b234-44cd-a2d6-b1ba70353d11 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:36.304645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a12059b-b234-44cd-a2d6-b1ba70353d11 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:36.305489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a12059b-b234-44cd-a2d6-b1ba70353d11 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:36.306261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a12059b-b234-44cd-a2d6-b1ba70353d11 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:36.636264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6a12059b-b234-44cd-a2d6-b1ba70353d11 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:36.675441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6a12059b-b234-44cd-a2d6-b1ba70353d11 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:36.679260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6a12059b-b234-44cd-a2d6-b1ba70353d11 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:36.716960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:36.720806 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6a12059b-b234-44cd-a2d6-b1ba70353d11 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.438030 Sep 08 12:42:36.740664 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 601/1218] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:36 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:36.768057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e8f1b835-9508-454f-862f-38dd9106075b req-8ceb290f-c619-4be9-990f-2a140b0249da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21de9f4e-35f1-485e-bf5c-301cec48fa12", "tag": "c54bf0d4-ec44-4b9b-aa86-f5c058b69112"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:36.796065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e8f1b835-9508-454f-862f-38dd9106075b req-8ceb290f-c619-4be9-990f-2a140b0249da service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:36.796852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e8f1b835-9508-454f-862f-38dd9106075b req-8ceb290f-c619-4be9-990f-2a140b0249da service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:36.797482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e8f1b835-9508-454f-862f-38dd9106075b req-8ceb290f-c619-4be9-990f-2a140b0249da service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:36.818466 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e8f1b835-9508-454f-862f-38dd9106075b req-8ceb290f-c619-4be9-990f-2a140b0249da service nova] Creating event network-changed:c54bf0d4-ec44-4b9b-aa86-f5c058b69112 for instance 21de9f4e-35f1-485e-bf5c-301cec48fa12 on n-h1-852084-10 Sep 08 12:42:36.831835 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e8f1b835-9508-454f-862f-38dd9106075b req-8ceb290f-c619-4be9-990f-2a140b0249da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088179 Sep 08 12:42:36.833217 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 602/1219] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:36.861189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b48046de-22e7-4f8f-ac0e-4dd92d1531ab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:36.862936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b48046de-22e7-4f8f-ac0e-4dd92d1531ab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:36.876057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b48046de-22e7-4f8f-ac0e-4dd92d1531ab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:36.877624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b48046de-22e7-4f8f-ac0e-4dd92d1531ab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:36.878763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b48046de-22e7-4f8f-ac0e-4dd92d1531ab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:36.880705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b48046de-22e7-4f8f-ac0e-4dd92d1531ab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:36.881612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b48046de-22e7-4f8f-ac0e-4dd92d1531ab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:36.882659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b48046de-22e7-4f8f-ac0e-4dd92d1531ab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:37.550458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b48046de-22e7-4f8f-ac0e-4dd92d1531ab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:37.587047 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b48046de-22e7-4f8f-ac0e-4dd92d1531ab tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1716 microversion: 2.1 time: 0.751738 Sep 08 12:42:37.589061 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 603/1220] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:36 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1716 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:37.610650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-781b469b-7170-491e-8229-56827d392a0e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Action: 'create', calling method: .version_select at 0x7fdb36bfc790>, body: {"keypair": {"name": "tempest-keypair-2002878501", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQCI06h+l00UmqPvaTafkLxHksufUyG8DEjwg+8SVDoQT6EqugpfqqUszuQLz8xS0SNMArv7HoYvVd5F6LdbZ2/yy8gp6Uw6Msv4F++CNFUZb9/ArVIt6X+ABwRj5k2pQ=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:37.680320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-781b469b-7170-491e-8229-56827d392a0e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Getting quotas for project df5a27766c1942a8be6a78466f7e7192. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:42:37.696507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-781b469b-7170-491e-8229-56827d392a0e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Getting quotas for user 8af088dfb51e4f729cc97fc91699a55f and project df5a27766c1942a8be6a78466f7e7192. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:42:37.776937 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-781b469b-7170-491e-8229-56827d392a0e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.182419 Sep 08 12:42:37.778571 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 604/1221] 10.222.0.78 () {62 vars in 1200 bytes} [Thu Sep 8 12:42:37 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 186 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 12:42:37.795324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-19eb3603-f6e6-4f6d-b07d-8ce9ceb76846 req-5a466aa4-f646-4312-9beb-374df256f18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc95339-7b99-439b-8a64-3eeb808b9c77", "name": "network-vif-plugged", "status": "completed", "tag": "c88f65d9-eeed-4224-9551-d32c44c05007"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:37.810855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-19eb3603-f6e6-4f6d-b07d-8ce9ceb76846 req-5a466aa4-f646-4312-9beb-374df256f18c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:37.811852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-19eb3603-f6e6-4f6d-b07d-8ce9ceb76846 req-5a466aa4-f646-4312-9beb-374df256f18c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:37.812823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-19eb3603-f6e6-4f6d-b07d-8ce9ceb76846 req-5a466aa4-f646-4312-9beb-374df256f18c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:37.833228 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-19eb3603-f6e6-4f6d-b07d-8ce9ceb76846 req-5a466aa4-f646-4312-9beb-374df256f18c service nova] Creating event network-vif-plugged:c88f65d9-eeed-4224-9551-d32c44c05007 for instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 on n-h2-852084-10 Sep 08 12:42:37.841621 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-19eb3603-f6e6-4f6d-b07d-8ce9ceb76846 req-5a466aa4-f646-4312-9beb-374df256f18c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060097 Sep 08 12:42:37.842904 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 605/1222] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:37.851594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4aa54ddb-fcdf-4c0f-be87-95cfa9527afb tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:37.862354 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-4aa54ddb-fcdf-4c0f-be87-95cfa9527afb tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] HTTP exception thrown: Flavor f361ff80-9c37-43f7-a9c8-9546c09dd3c5 could not be found. Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4aa54ddb-fcdf-4c0f-be87-95cfa9527afb tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Request method failure captured: Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/flavors/f361ff80-9c37-43f7-a9c8-9546c09dd3c5 HTTP/1.1 Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIfHf86DP91IjZJxUHs14wkR7rc5MiosWXbC6U0eSp8lUg98xmJ3AOjca-23Fcyaq5xhYq-Pxb3ehAWpfWrWNce5OLI333qS497JFdcDBt0AZioAas3m07q2Rn9ARpll1tQirI-mvT5w14codww-M7tkpcHC86jLsqacjTPZyyHh2g Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 4de55f3095a54139b6025010d04c71e2 Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-MigrationsAdminTest-939955457 Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:42:37.867663 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:42:37.870734 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4de55f3095a54139b6025010d04c71e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4de55f3095a54139b6025010d04c71e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4de55f3095a54139b6025010d04c71e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4de55f3095a54139b6025010d04c71e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:42:37.870734 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-MigrationsAdminTest-939955457 Sep 08 12:42:37.870734 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 4de55f3095a54139b6025010d04c71e2 Sep 08 12:42:37.870734 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-MigrationsAdminTest-939955457 Sep 08 12:42:37.870734 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-MigrationsAdminTest-939955457-project-admin Sep 08 12:42:37.870734 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:42:37.870734 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:42:37.870734 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 74c643246dd84fab86e1f771cdc6dcd0 Sep 08 12:42:37.870734 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-MigrationsAdminTest-939955457-project-admin Sep 08 12:42:37.870734 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:42:37.870734 n-d-852084-10 devstack@n-api.service[128970]: exception: Flavor f361ff80-9c37-43f7-a9c8-9546c09dd3c5 could not be found. Sep 08 12:42:37.870734 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'f361ff80-9c37-43f7-a9c8-9546c09dd3c5'} Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi flavor.destroy() Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor f361ff80-9c37-43f7-a9c8-9546c09dd3c5 could not be found. Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:37.873998 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor f361ff80-9c37-43f7-a9c8-9546c09dd3c5 could not be found. Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor f361ff80-9c37-43f7-a9c8-9546c09dd3c5 could not be found. Sep 08 12:42:37.877197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:37.881495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4aa54ddb-fcdf-4c0f-be87-95cfa9527afb tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Returning 404 to user: Flavor f361ff80-9c37-43f7-a9c8-9546c09dd3c5 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:42:37.885700 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4aa54ddb-fcdf-4c0f-be87-95cfa9527afb tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/f361ff80-9c37-43f7-a9c8-9546c09dd3c5" status: 404 len: 109 microversion: 2.1 time: 0.039685 Sep 08 12:42:37.888411 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 606/1223] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:42:37 2022] DELETE /compute/v2.1/flavors/f361ff80-9c37-43f7-a9c8-9546c09dd3c5 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:42:37.899478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Updating instance_info_cache with network_info: [{"id": "c54bf0d4-ec44-4b9b-aa86-f5c058b69112", "address": "fa:16:3e:30:32:d6", "network": {"id": "537f47b6-a4a4-481b-95fa-dc20a0bdcd66", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2044299134-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dd43c0505e05417aa4004cc015d919c6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc54bf0d4-ec", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 12:42:37.922846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2673b71f-85bd-4e3c-8b81-c0acc816a353 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:37.935154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2673b71f-85bd-4e3c-8b81-c0acc816a353 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:37.936427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2673b71f-85bd-4e3c-8b81-c0acc816a353 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:37.937572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2673b71f-85bd-4e3c-8b81-c0acc816a353 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:37.939299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2673b71f-85bd-4e3c-8b81-c0acc816a353 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:37.940473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2673b71f-85bd-4e3c-8b81-c0acc816a353 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:37.941516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2673b71f-85bd-4e3c-8b81-c0acc816a353 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:37.954102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Releasing lock "refresh_cache-21de9f4e-35f1-485e-bf5c-301cec48fa12" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 12:42:37.961508 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e668aa4-e1cc-496d-bb64-cb16a5176177 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action" status: 202 len: 0 microversion: 2.1 time: 9.457204 Sep 08 12:42:37.963741 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 618/1224] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:42:28 2022] POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action => generated 0 bytes in 9460 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 12:42:37.986437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bbb008fa-1fba-4493-8a45-66c170b9f316 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:37.987490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bbb008fa-1fba-4493-8a45-66c170b9f316 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:38.002332 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2673b71f-85bd-4e3c-8b81-c0acc816a353 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.111315 Sep 08 12:42:38.012676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbb008fa-1fba-4493-8a45-66c170b9f316 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:38.014413 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 607/1225] 10.222.0.78 () {60 vars in 1178 bytes} [Thu Sep 8 12:42:37 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:38.014638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbb008fa-1fba-4493-8a45-66c170b9f316 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:38.023179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbb008fa-1fba-4493-8a45-66c170b9f316 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:38.023179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbb008fa-1fba-4493-8a45-66c170b9f316 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:38.023179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbb008fa-1fba-4493-8a45-66c170b9f316 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:38.026498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbb008fa-1fba-4493-8a45-66c170b9f316 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:38.032829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-816858fe-bf7f-4e75-8d8c-15663f532833 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Action: 'create', calling method: .version_select at 0x7fdb36be8040>, body: {"pool": "c37e2e21-e71d-413c-a8dc-a35ec1a46711"} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:38.285805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bbb008fa-1fba-4493-8a45-66c170b9f316 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:38.309244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bbb008fa-1fba-4493-8a45-66c170b9f316 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:38.311169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bbb008fa-1fba-4493-8a45-66c170b9f316 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:38.323750 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bbb008fa-1fba-4493-8a45-66c170b9f316 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.355076 Sep 08 12:42:38.324703 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 619/1226] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:37 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:38.344501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ed461420-5141-40c9-a814-a5b966816b5e tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:38.350007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed461420-5141-40c9-a814-a5b966816b5e tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:38.350734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed461420-5141-40c9-a814-a5b966816b5e tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:38.352134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed461420-5141-40c9-a814-a5b966816b5e tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:38.355598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed461420-5141-40c9-a814-a5b966816b5e tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:38.356544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed461420-5141-40c9-a814-a5b966816b5e tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:38.357967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed461420-5141-40c9-a814-a5b966816b5e tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:38.407366 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ed461420-5141-40c9-a814-a5b966816b5e tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=n-d-852084-10&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.080928 Sep 08 12:42:38.418154 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 620/1227] 10.222.0.78 () {60 vars in 1237 bytes} [Thu Sep 8 12:42:38 2022] GET /compute/v2.1/os-services?host=n-d-852084-10&binary=xxx => generated 16 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:38.424051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1167452494", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:38.514723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:42:39.421679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:42:39.422580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:42:39.423413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:42:39.424165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:42:39.427383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:42:39.479306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:39.482577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:39.484236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:39.485972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:39.487165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:39.488673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:39.561236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Getting quotas for project 8c3e5d96296342eb8a99953dec8747c0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:42:39.568889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Getting quotas for user 81af813dbf5340d0a3d9d4bf0cff3da7 and project 8c3e5d96296342eb8a99953dec8747c0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:42:39.592470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:42:39.599089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:42:39.740634 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c0c3a3df-50ce-4415-92fa-5cdd0e48157a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.317444 Sep 08 12:42:39.741762 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 621/1228] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:42:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1323 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:42:39.770071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8529d78f-333f-4921-ac5b-646df58b32e0 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:39.788684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8529d78f-333f-4921-ac5b-646df58b32e0 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:39.791379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8529d78f-333f-4921-ac5b-646df58b32e0 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:39.795435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8529d78f-333f-4921-ac5b-646df58b32e0 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:39.798635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8529d78f-333f-4921-ac5b-646df58b32e0 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:39.799906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8529d78f-333f-4921-ac5b-646df58b32e0 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:39.802192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8529d78f-333f-4921-ac5b-646df58b32e0 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:39.878660 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8529d78f-333f-4921-ac5b-646df58b32e0 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.129767 Sep 08 12:42:39.889322 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 622/1229] 10.222.0.78 () {60 vars in 1178 bytes} [Thu Sep 8 12:42:39 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:39.894973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-79b4e8b5-8d44-4234-b0d0-3418c622d810 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:39.895816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-79b4e8b5-8d44-4234-b0d0-3418c622d810 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:39.904183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79b4e8b5-8d44-4234-b0d0-3418c622d810 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:39.904966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79b4e8b5-8d44-4234-b0d0-3418c622d810 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:39.905599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79b4e8b5-8d44-4234-b0d0-3418c622d810 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:39.907043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79b4e8b5-8d44-4234-b0d0-3418c622d810 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:39.907886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79b4e8b5-8d44-4234-b0d0-3418c622d810 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:39.908510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79b4e8b5-8d44-4234-b0d0-3418c622d810 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:40.309889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-79b4e8b5-8d44-4234-b0d0-3418c622d810 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:40.337973 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-79b4e8b5-8d44-4234-b0d0-3418c622d810 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1716 microversion: 2.1 time: 0.447004 Sep 08 12:42:40.340528 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 623/1230] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:39 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1716 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:40.348971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9f7fdf3e-3849-4242-88c6-cd60bed2d389 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:40.350330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9f7fdf3e-3849-4242-88c6-cd60bed2d389 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:40.358316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f7fdf3e-3849-4242-88c6-cd60bed2d389 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:40.359257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f7fdf3e-3849-4242-88c6-cd60bed2d389 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:40.361668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f7fdf3e-3849-4242-88c6-cd60bed2d389 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:40.362767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f7fdf3e-3849-4242-88c6-cd60bed2d389 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:40.363496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f7fdf3e-3849-4242-88c6-cd60bed2d389 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:40.364179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f7fdf3e-3849-4242-88c6-cd60bed2d389 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:40.486143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9f7fdf3e-3849-4242-88c6-cd60bed2d389 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:40.497162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9f7fdf3e-3849-4242-88c6-cd60bed2d389 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:40.517416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9f7fdf3e-3849-4242-88c6-cd60bed2d389 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:40.531935 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9f7fdf3e-3849-4242-88c6-cd60bed2d389 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.188308 Sep 08 12:42:40.559624 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 624/1231] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:40 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:40.570128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d72ce145-904e-4152-90c2-7a57620ddb05 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:40.570819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d72ce145-904e-4152-90c2-7a57620ddb05 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:40.683764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d72ce145-904e-4152-90c2-7a57620ddb05 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:40.696465 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d72ce145-904e-4152-90c2-7a57620ddb05 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1213 microversion: 2.1 time: 0.135478 Sep 08 12:42:40.711773 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 625/1232] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:40 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1213 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:40.729088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-335ff45b-be61-4157-802a-a8b54f5f6cb3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:40.733993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-335ff45b-be61-4157-802a-a8b54f5f6cb3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:40.735133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-335ff45b-be61-4157-802a-a8b54f5f6cb3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:40.735899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-335ff45b-be61-4157-802a-a8b54f5f6cb3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:40.736998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-335ff45b-be61-4157-802a-a8b54f5f6cb3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:40.738040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-335ff45b-be61-4157-802a-a8b54f5f6cb3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:40.738922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-335ff45b-be61-4157-802a-a8b54f5f6cb3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:40.770615 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-335ff45b-be61-4157-802a-a8b54f5f6cb3 tempest-ServicesAdminNegativeV253TestJSON-1617912140 tempest-ServicesAdminNegativeV253TestJSON-1617912140-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.057211 Sep 08 12:42:40.781965 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 626/1233] 10.222.0.78 () {60 vars in 1239 bytes} [Thu Sep 8 12:42:40 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:41.258803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d48b911-899d-4aef-97e2-3504d20a7452 tempest-ServicesAdminNegativeV253TestJSON-183805595 tempest-ServicesAdminNegativeV253TestJSON-183805595-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:41.263644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1d48b911-899d-4aef-97e2-3504d20a7452 tempest-ServicesAdminNegativeV253TestJSON-183805595 tempest-ServicesAdminNegativeV253TestJSON-183805595-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'fea82030df5149f7b341bb682d03dce2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '78c70ae83c5a4c20b11107b3349dc9d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d48b911-899d-4aef-97e2-3504d20a7452 tempest-ServicesAdminNegativeV253TestJSON-183805595 tempest-ServicesAdminNegativeV253TestJSON-183805595-project] Request method failure captured: Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeMuunlEhHQe5n8CykqnE0LNjlKv-odAgDa4OL-PKhKUrT1A-Fpddapnzogl5EnuoLiZ9XLy4NyCxuloRKGcRap8AITSjHOCagpj1aVuiPD_lgr5FIQIVKNW67J_oryD47YekKrpXhavf5lxLv8hH2uHkuMdSLP6St9V2WCv3TLfziQ Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.53 Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 78c70ae83c5a4c20b11107b3349dc9d4 Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-183805595 Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:42:41.271729 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:42:41.273454 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_78c70ae83c5a4c20b11107b3349dc9d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/78c70ae83c5a4c20b11107b3349dc9d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/78c70ae83c5a4c20b11107b3349dc9d4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/78c70ae83c5a4c20b11107b3349dc9d4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:42:41.273454 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-183805595 Sep 08 12:42:41.273454 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 78c70ae83c5a4c20b11107b3349dc9d4 Sep 08 12:42:41.273454 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-183805595 Sep 08 12:42:41.273454 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServicesAdminNegativeV253TestJSON-183805595-project Sep 08 12:42:41.273454 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:42:41.273454 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:42:41.273454 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: fea82030df5149f7b341bb682d03dce2 Sep 08 12:42:41.273454 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-183805595-project Sep 08 12:42:41.273454 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:42:41.273454 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 12:42:41.273454 n-d-852084-10 devstack@n-api.service[128971]: action_args: {} Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:42:41.274495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 12:42:41.276568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:42:41.279393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d48b911-899d-4aef-97e2-3504d20a7452 tempest-ServicesAdminNegativeV253TestJSON-183805595 tempest-ServicesAdminNegativeV253TestJSON-183805595-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:42:41.280761 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1d48b911-899d-4aef-97e2-3504d20a7452 tempest-ServicesAdminNegativeV253TestJSON-183805595 tempest-ServicesAdminNegativeV253TestJSON-183805595-project] 10.222.0.78 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.497076 Sep 08 12:42:41.283179 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 627/1234] 10.222.0.78 () {60 vars in 1178 bytes} [Thu Sep 8 12:42:40 2022] GET /compute/v2.1/os-services => generated 112 bytes in 500 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:42:41.380113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bee9458f-4723-4008-8af9-617e780a0ffd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:41.381180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bee9458f-4723-4008-8af9-617e780a0ffd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:41.385495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:DELETE=2,nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:41.399608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bee9458f-4723-4008-8af9-617e780a0ffd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:41.403821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bee9458f-4723-4008-8af9-617e780a0ffd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:41.404662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bee9458f-4723-4008-8af9-617e780a0ffd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:41.405718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bee9458f-4723-4008-8af9-617e780a0ffd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:41.406431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bee9458f-4723-4008-8af9-617e780a0ffd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:41.407302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bee9458f-4723-4008-8af9-617e780a0ffd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:41.968644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bee9458f-4723-4008-8af9-617e780a0ffd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:41.993009 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bee9458f-4723-4008-8af9-617e780a0ffd tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1716 microversion: 2.1 time: 0.617430 Sep 08 12:42:42.001524 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 628/1235] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:41 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1716 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:42.018521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7b1da8b5-bfae-49cc-8713-22c39b896676 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:42.030402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7b1da8b5-bfae-49cc-8713-22c39b896676 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:42.038493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b1da8b5-bfae-49cc-8713-22c39b896676 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:42.039442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b1da8b5-bfae-49cc-8713-22c39b896676 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:42.040252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b1da8b5-bfae-49cc-8713-22c39b896676 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:42.041766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b1da8b5-bfae-49cc-8713-22c39b896676 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:42.042546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b1da8b5-bfae-49cc-8713-22c39b896676 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:42.043158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b1da8b5-bfae-49cc-8713-22c39b896676 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:42.298253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7b1da8b5-bfae-49cc-8713-22c39b896676 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:42.317092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7b1da8b5-bfae-49cc-8713-22c39b896676 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:42.320012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7b1da8b5-bfae-49cc-8713-22c39b896676 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:42.346416 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7b1da8b5-bfae-49cc-8713-22c39b896676 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.342259 Sep 08 12:42:42.352753 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 629/1236] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:42 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:42.367799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6de13e95-739f-42d0-8571-04831d3ca3dc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:42.374061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6de13e95-739f-42d0-8571-04831d3ca3dc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:42.395308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6de13e95-739f-42d0-8571-04831d3ca3dc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:42.398932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6de13e95-739f-42d0-8571-04831d3ca3dc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:42.399664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6de13e95-739f-42d0-8571-04831d3ca3dc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:42.404379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6de13e95-739f-42d0-8571-04831d3ca3dc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:42.405597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6de13e95-739f-42d0-8571-04831d3ca3dc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:42.410188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6de13e95-739f-42d0-8571-04831d3ca3dc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:42.490992 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-816858fe-bf7f-4e75-8d8c-15663f532833 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.473791 Sep 08 12:42:42.493226 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 608/1237] 10.222.0.78 () {60 vars in 1170 bytes} [Thu Sep 8 12:42:38 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:42.507573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Action: 'action', calling method: .version_select at 0x7fdb3cd91f70>, body: {"addFloatingIp": {"address": "172.25.4.74"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:42.513362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:42.528287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:42.529946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:42.533366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:42.535712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:42.537050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:42.539516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:42.597199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6de13e95-739f-42d0-8571-04831d3ca3dc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:42.628684 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6de13e95-739f-42d0-8571-04831d3ca3dc tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1265 microversion: 2.1 time: 0.273163 Sep 08 12:42:42.633689 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 630/1238] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:42 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1265 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:42.779603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "refresh_cache-21de9f4e-35f1-485e-bf5c-301cec48fa12" {{(pid=128970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 12:42:42.780463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquired lock "refresh_cache-21de9f4e-35f1-485e-bf5c-301cec48fa12" {{(pid=128970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 12:42:43.646951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-103820426", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "e6471e8e-6e50-4517-8517-6648d123dcf3"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:43.860869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] validate_networks() for [('e6471e8e-6e50-4517-8517-6648d123dcf3', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:42:45.514443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG neutronclient.v2_0.client [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.4.74 (e49559d8-8a7d-4e79-9242-6caa7f5aafb9) with port c54bf0d4-ec44-4b9b-aa86-f5c058b69112 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network c37e2e21-e71d-413c-a8dc-a35ec1a46711.", "detail": ""}} {{(pid=128970) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:42:45.515742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Releasing lock "refresh_cache-21de9f4e-35f1-485e-bf5c-301cec48fa12" {{(pid=128970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 12:42:45.518827 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] HTTP exception thrown: Cannot associate floating IP 172.25.4.74 (e49559d8-8a7d-4e79-9242-6caa7f5aafb9) with port c54bf0d4-ec44-4b9b-aa86-f5c058b69112 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network c37e2e21-e71d-413c-a8dc-a35ec1a46711. Sep 08 12:42:45.518827 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-984a1157-27f4-435b-9aa1-d62f6c839b55'] Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Request method failure captured: Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action HTTP/1.1 Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 45 Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeMOai9HlXT63ULNh0wDkBCHuQCRuASwYRcrjCNfJoe7cSI6fvUb1WCak1KVqhaVLLpesvTdK65I79178Kp1YE-ZOpGqtH6gzV8TBrLi2Jd8-L_3o2dpAOqV___EkbuEexJpKsIsetD4nW7YuYtmsOIs4__PJwBdaN_dE7kmcmNrtpg Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: dd43c0505e05417aa4004cc015d919c6 Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:42:45.536739 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:42:45.540340 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:42:45.540340 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:42:45.540340 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: dd43c0505e05417aa4004cc015d919c6 Sep 08 12:42:45.540340 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:42:45.540340 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project Sep 08 12:42:45.540340 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:42:45.540340 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:42:45.540340 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: ca5a5815b22c4a6e8f5016083e547662 Sep 08 12:42:45.540340 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project Sep 08 12:42:45.540340 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:42:45.540340 n-d-852084-10 devstack@n-api.service[128970]: {"addFloatingIp": {"address": "172.25.4.74"}} Sep 08 12:42:45.540340 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: exception: Cannot associate floating IP 172.25.4.74 (e49559d8-8a7d-4e79-9242-6caa7f5aafb9) with port c54bf0d4-ec44-4b9b-aa86-f5c058b69112 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network c37e2e21-e71d-413c-a8dc-a35ec1a46711. Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-984a1157-27f4-435b-9aa1-d62f6c839b55'] Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '21de9f4e-35f1-485e-bf5c-301cec48fa12', 'body': {'addFloatingIp': {'address': '172.25.4.74'}}} Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:42:45.542491 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:42:45.544822 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.4.74 (e49559d8-8a7d-4e79-9242-6caa7f5aafb9) with port c54bf0d4-ec44-4b9b-aa86-f5c058b69112 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network c37e2e21-e71d-413c-a8dc-a35ec1a46711. Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-984a1157-27f4-435b-9aa1-d62f6c839b55'] Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.4.74 (e49559d8-8a7d-4e79-9242-6caa7f5aafb9) with port c54bf0d4-ec44-4b9b-aa86-f5c058b69112 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network c37e2e21-e71d-413c-a8dc-a35ec1a46711. Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-984a1157-27f4-435b-9aa1-d62f6c839b55'] Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:45.549093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.4.74 (e49559d8-8a7d-4e79-9242-6caa7f5aafb9) with port c54bf0d4-ec44-4b9b-aa86-f5c058b69112 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network c37e2e21-e71d-413c-a8dc-a35ec1a46711. Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-984a1157-27f4-435b-9aa1-d62f6c839b55'] Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:45.551914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:42:45.554923 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:45.554923 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:42:45.554923 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:42:45.554923 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:42:45.554923 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:42:45.554923 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:42:45.554923 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.4.74 (e49559d8-8a7d-4e79-9242-6caa7f5aafb9) with port c54bf0d4-ec44-4b9b-aa86-f5c058b69112 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network c37e2e21-e71d-413c-a8dc-a35ec1a46711. Sep 08 12:42:45.554923 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-984a1157-27f4-435b-9aa1-d62f6c839b55'] Sep 08 12:42:45.554923 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:42:45.554923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Returning 400 to user: Cannot associate floating IP 172.25.4.74 (e49559d8-8a7d-4e79-9242-6caa7f5aafb9) with port c54bf0d4-ec44-4b9b-aa86-f5c058b69112 using fixed IP 172.20.0.9, as that fixed IP already has a floating IP on external network c37e2e21-e71d-413c-a8dc-a35ec1a46711. Sep 08 12:42:45.554923 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-984a1157-27f4-435b-9aa1-d62f6c839b55'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:42:45.558373 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-232ffc14-e5d0-456f-a5f7-c3125ccfa565 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action" status: 400 len: 380 microversion: 2.1 time: 3.049332 Sep 08 12:42:45.569133 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 609/1239] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:42:42 2022] POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action => generated 380 bytes in 3066 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:42:45.596255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc93daee-7f66-4252-860f-ee816f51aa4b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:45.606614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc93daee-7f66-4252-860f-ee816f51aa4b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:45.631386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc93daee-7f66-4252-860f-ee816f51aa4b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:45.632783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc93daee-7f66-4252-860f-ee816f51aa4b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:45.635409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc93daee-7f66-4252-860f-ee816f51aa4b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:45.637005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc93daee-7f66-4252-860f-ee816f51aa4b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:45.640422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc93daee-7f66-4252-860f-ee816f51aa4b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:45.644364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc93daee-7f66-4252-860f-ee816f51aa4b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:46.594177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc93daee-7f66-4252-860f-ee816f51aa4b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:46.642549 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc93daee-7f66-4252-860f-ee816f51aa4b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1716 microversion: 2.1 time: 1.068693 Sep 08 12:42:46.646884 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 610/1240] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:45 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1716 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:46.664080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f931ebe-e4fc-4fb4-9568-acebb203d0d4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:46.668441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f931ebe-e4fc-4fb4-9568-acebb203d0d4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:46.682533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f931ebe-e4fc-4fb4-9568-acebb203d0d4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:46.684804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f931ebe-e4fc-4fb4-9568-acebb203d0d4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:46.686866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f931ebe-e4fc-4fb4-9568-acebb203d0d4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:46.690675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f931ebe-e4fc-4fb4-9568-acebb203d0d4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:46.692212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f931ebe-e4fc-4fb4-9568-acebb203d0d4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:46.696543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f931ebe-e4fc-4fb4-9568-acebb203d0d4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:46.948066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:42:46.949433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:42:46.950114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:42:46.950718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:42:46.951375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:42:46.985401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:46.985401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:46.990289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f931ebe-e4fc-4fb4-9568-acebb203d0d4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:46.998893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:46.999966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:47.000462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:47.002149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:47.013424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f931ebe-e4fc-4fb4-9568-acebb203d0d4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:47.020305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f931ebe-e4fc-4fb4-9568-acebb203d0d4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:47.059002 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f931ebe-e4fc-4fb4-9568-acebb203d0d4 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.405898 Sep 08 12:42:47.064475 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 611/1241] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:46 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:47.092882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-771a214e-1f48-4c72-ba40-5aee0aa0cbca tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:47.094018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-771a214e-1f48-4c72-ba40-5aee0aa0cbca tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:47.099802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Getting quotas for project 089fe13d64434cd48d0311dfe9d43493. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:42:47.130714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Getting quotas for user fe4e7ae0a8b34345986479e340102892 and project 089fe13d64434cd48d0311dfe9d43493. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:42:47.138214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-771a214e-1f48-4c72-ba40-5aee0aa0cbca tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:47.139141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-771a214e-1f48-4c72-ba40-5aee0aa0cbca tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:47.144365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-771a214e-1f48-4c72-ba40-5aee0aa0cbca tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:47.145838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-771a214e-1f48-4c72-ba40-5aee0aa0cbca tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:47.150327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-771a214e-1f48-4c72-ba40-5aee0aa0cbca tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:47.151714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-771a214e-1f48-4c72-ba40-5aee0aa0cbca tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:47.196649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:42:47.205552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:42:47.469455 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-71dc7809-375d-4545-a8f8-8eb140e20767 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.698802 Sep 08 12:42:47.514048 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 631/1242] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:42:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 4744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:42:47.535057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-546194870", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "d9960f69-c05a-419f-a17a-eee5648ebea7"}], "security_groups": [{"name": "tempest-securitygroup--2028267855"}], "key_name": "tempest-keypair-2002878501", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:47.597000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-771a214e-1f48-4c72-ba40-5aee0aa0cbca tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:47.629250 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-771a214e-1f48-4c72-ba40-5aee0aa0cbca tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1313 microversion: 2.1 time: 0.562203 Sep 08 12:42:47.634320 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 612/1243] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:47 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1313 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:47.659283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f89a5639-8300-4b16-8dc7-f5e6c0eb0427 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '.version_select at 0x7fdb36db7790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:47.734147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:47.961532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=10 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:48.352449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] validate_networks() for [('d9960f69-c05a-419f-a17a-eee5648ebea7', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:42:51.368383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:42:51.369433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:42:51.369433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:42:51.369851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:42:51.370643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:42:51.404052 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f89a5639-8300-4b16-8dc7-f5e6c0eb0427 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/e49559d8-8a7d-4e79-9242-6caa7f5aafb9" status: 202 len: 0 microversion: 2.1 time: 3.766233 Sep 08 12:42:51.405423 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 613/1244] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:42:47 2022] DELETE /compute/v2.1/os-floating-ips/e49559d8-8a7d-4e79-9242-6caa7f5aafb9 => generated 0 bytes in 3770 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:42:51.417230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:51.418438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:51.419578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:51.420338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8df72e53-9ec1-4e0c-b381-f4f6b6ebd77b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:51.423102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:51.423578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:51.424484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8df72e53-9ec1-4e0c-b381-f4f6b6ebd77b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:51.428497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:51.438737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8df72e53-9ec1-4e0c-b381-f4f6b6ebd77b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:51.440312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8df72e53-9ec1-4e0c-b381-f4f6b6ebd77b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:51.441512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8df72e53-9ec1-4e0c-b381-f4f6b6ebd77b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:51.444730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8df72e53-9ec1-4e0c-b381-f4f6b6ebd77b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:51.446262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8df72e53-9ec1-4e0c-b381-f4f6b6ebd77b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:51.447878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8df72e53-9ec1-4e0c-b381-f4f6b6ebd77b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:51.557730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Getting quotas for project df5a27766c1942a8be6a78466f7e7192. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:42:51.585411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Getting quotas for user 8af088dfb51e4f729cc97fc91699a55f and project df5a27766c1942a8be6a78466f7e7192. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:42:51.643687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:42:51.660714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:42:51.878694 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ffca733b-5bfd-4394-8a96-0d284e771ac1 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 4.361097 Sep 08 12:42:51.893028 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 632/1245] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 12:42:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 4377 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 12:42:51.913805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1008323510", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "e6471e8e-6e50-4517-8517-6648d123dcf3"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:52.048799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] validate_networks() for [('e6471e8e-6e50-4517-8517-6648d123dcf3', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:42:52.112457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8df72e53-9ec1-4e0c-b381-f4f6b6ebd77b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:52.163371 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8df72e53-9ec1-4e0c-b381-f4f6b6ebd77b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1716 microversion: 2.1 time: 0.750800 Sep 08 12:42:52.184932 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 614/1246] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:51 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1716 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:52.207247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-93b3d4d2-5064-491c-8241-98a6758c6abc tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:52.222616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-93b3d4d2-5064-491c-8241-98a6758c6abc tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:52.269620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93b3d4d2-5064-491c-8241-98a6758c6abc tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:52.270188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93b3d4d2-5064-491c-8241-98a6758c6abc tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:52.270629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93b3d4d2-5064-491c-8241-98a6758c6abc tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:52.272023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93b3d4d2-5064-491c-8241-98a6758c6abc tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:52.273053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93b3d4d2-5064-491c-8241-98a6758c6abc tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:52.273815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93b3d4d2-5064-491c-8241-98a6758c6abc tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:52.616048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-93b3d4d2-5064-491c-8241-98a6758c6abc tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:52.667279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-93b3d4d2-5064-491c-8241-98a6758c6abc tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:52.680962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-93b3d4d2-5064-491c-8241-98a6758c6abc tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:52.721791 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-93b3d4d2-5064-491c-8241-98a6758c6abc tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.532190 Sep 08 12:42:52.729233 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 615/1247] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:52 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:53.372687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9f0cf53a-6d11-4826-b777-7c7b4fc17f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:53.377525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9f0cf53a-6d11-4826-b777-7c7b4fc17f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:53.398831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f0cf53a-6d11-4826-b777-7c7b4fc17f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:53.399656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f0cf53a-6d11-4826-b777-7c7b4fc17f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:53.400089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f0cf53a-6d11-4826-b777-7c7b4fc17f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:53.400827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f0cf53a-6d11-4826-b777-7c7b4fc17f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:53.401312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f0cf53a-6d11-4826-b777-7c7b4fc17f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:53.401719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f0cf53a-6d11-4826-b777-7c7b4fc17f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:53.406808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:42:53.768904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:42:53.769748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:42:53.769748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:42:53.771217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:42:53.772251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:42:53.793178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:53.795829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:53.796491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:53.800297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:53.801237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:53.808599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:53.867172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Getting quotas for project 089fe13d64434cd48d0311dfe9d43493. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:42:53.882462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Getting quotas for user fe4e7ae0a8b34345986479e340102892 and project 089fe13d64434cd48d0311dfe9d43493. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:42:53.943761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:42:53.946629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 83b2b1b0-2e34-4bbc-9d98-40eec81036ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:42:54.099684 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-817cd904-213c-43a6-a2d0-77f6797bd2fb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.204419 Sep 08 12:42:54.102190 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 633/1248] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:42:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 2208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:42:54.120830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-4081b319-d21c-4b4a-9329-049700e141db req-ad7320df-8b0a-4c6d-8255-570a3a9aa84c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0860ae28-9636-40dd-a79d-bbf608e0a922", "tag": "7d11df58-0218-4b52-87b7-4c5dc9927ca6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:54.183847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4081b319-d21c-4b4a-9329-049700e141db req-ad7320df-8b0a-4c6d-8255-570a3a9aa84c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:54.185018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4081b319-d21c-4b4a-9329-049700e141db req-ad7320df-8b0a-4c6d-8255-570a3a9aa84c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:54.187593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4081b319-d21c-4b4a-9329-049700e141db req-ad7320df-8b0a-4c6d-8255-570a3a9aa84c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:54.244260 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-4081b319-d21c-4b4a-9329-049700e141db req-ad7320df-8b0a-4c6d-8255-570a3a9aa84c service nova] Creating event network-changed:7d11df58-0218-4b52-87b7-4c5dc9927ca6 for instance 0860ae28-9636-40dd-a79d-bbf608e0a922 on n-h1-852084-10 Sep 08 12:42:54.270162 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-4081b319-d21c-4b4a-9329-049700e141db req-ad7320df-8b0a-4c6d-8255-570a3a9aa84c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157996 Sep 08 12:42:54.275622 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 634/1249] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:42:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:42:54.305248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Action: 'action', calling method: .version_select at 0x7fdb3d1411f0>, body: {"removeFloatingIp": {"address": "172.25.4.161"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:54.727152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9f0cf53a-6d11-4826-b777-7c7b4fc17f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:54.765296 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9f0cf53a-6d11-4826-b777-7c7b4fc17f8a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1313 microversion: 2.1 time: 2.032520 Sep 08 12:42:54.769174 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 616/1250] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:52 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1313 bytes in 2039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:54.774980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-83c0ce3c-e6a1-4601-8d96-2be140d5c1b5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:54.776146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-83c0ce3c-e6a1-4601-8d96-2be140d5c1b5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:54.783684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83c0ce3c-e6a1-4601-8d96-2be140d5c1b5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:54.784625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83c0ce3c-e6a1-4601-8d96-2be140d5c1b5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:54.785323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83c0ce3c-e6a1-4601-8d96-2be140d5c1b5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:54.786423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83c0ce3c-e6a1-4601-8d96-2be140d5c1b5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:54.787566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83c0ce3c-e6a1-4601-8d96-2be140d5c1b5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:54.790899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83c0ce3c-e6a1-4601-8d96-2be140d5c1b5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:55.908550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83c0ce3c-e6a1-4601-8d96-2be140d5c1b5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:55.967174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83c0ce3c-e6a1-4601-8d96-2be140d5c1b5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:55.978729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83c0ce3c-e6a1-4601-8d96-2be140d5c1b5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:55.985678 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-83c0ce3c-e6a1-4601-8d96-2be140d5c1b5 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1281 microversion: 2.25 time: 1.212560 Sep 08 12:42:55.986358 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 617/1251] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:54 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1281 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:56.022710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4d754dff-8625-4370-8eeb-d7204bae6eaf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:56.024002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4d754dff-8625-4370-8eeb-d7204bae6eaf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:56.040378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:56.045193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d754dff-8625-4370-8eeb-d7204bae6eaf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:56.046165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d754dff-8625-4370-8eeb-d7204bae6eaf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:56.046860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d754dff-8625-4370-8eeb-d7204bae6eaf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:56.048013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d754dff-8625-4370-8eeb-d7204bae6eaf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:56.048818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d754dff-8625-4370-8eeb-d7204bae6eaf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:56.049922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d754dff-8625-4370-8eeb-d7204bae6eaf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:56.085578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:56.087353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:56.092720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:56.094107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:56.094976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:56.098099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:56.611456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4d754dff-8625-4370-8eeb-d7204bae6eaf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:56.633266 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4d754dff-8625-4370-8eeb-d7204bae6eaf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1716 microversion: 2.1 time: 0.641057 Sep 08 12:42:56.647816 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 618/1252] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:42:55 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1716 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:42:56.656919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4feee3f7-4eba-49f9-afec-575ccddcd504 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:42:56.661197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4feee3f7-4eba-49f9-afec-575ccddcd504 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:42:56.688421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4feee3f7-4eba-49f9-afec-575ccddcd504 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:56.689058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4feee3f7-4eba-49f9-afec-575ccddcd504 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:56.689530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4feee3f7-4eba-49f9-afec-575ccddcd504 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:56.697885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4feee3f7-4eba-49f9-afec-575ccddcd504 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:42:56.701141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4feee3f7-4eba-49f9-afec-575ccddcd504 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:42:56.705877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4feee3f7-4eba-49f9-afec-575ccddcd504 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:42:56.821760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "refresh_cache-21de9f4e-35f1-485e-bf5c-301cec48fa12" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 12:42:56.822680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquired lock "refresh_cache-21de9f4e-35f1-485e-bf5c-301cec48fa12" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 12:42:57.104579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4feee3f7-4eba-49f9-afec-575ccddcd504 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:57.122429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4feee3f7-4eba-49f9-afec-575ccddcd504 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:57.131911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4feee3f7-4eba-49f9-afec-575ccddcd504 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:42:57.157095 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4feee3f7-4eba-49f9-afec-575ccddcd504 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.505030 Sep 08 12:42:57.159895 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 619/1253] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:42:56 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:42:57.175004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1263695653", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "451", "networks": [{"uuid": "e6471e8e-6e50-4517-8517-6648d123dcf3"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:42:57.297750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] validate_networks() for [('e6471e8e-6e50-4517-8517-6648d123dcf3', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:43:02.621294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:43:02.623488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:43:02.624266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:43:02.624971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:43:02.625687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:43:02.658912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:02.660706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:02.662432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:02.663364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:02.664407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:02.666510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:02.733036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Getting quotas for project 089fe13d64434cd48d0311dfe9d43493. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:43:02.751795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Getting quotas for user fe4e7ae0a8b34345986479e340102892 and project 089fe13d64434cd48d0311dfe9d43493. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:43:02.784735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:43:02.793384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:43:02.985074 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-25b89169-7e04-4b08-9283-abd14d47a8af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.823197 Sep 08 12:43:02.988753 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 620/1254] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:42:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 5828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:43:03.019196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e62c58b0-fc3d-45e7-a566-738efd3dcf7b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:03.030215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e62c58b0-fc3d-45e7-a566-738efd3dcf7b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:03.077982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e62c58b0-fc3d-45e7-a566-738efd3dcf7b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:03.078501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e62c58b0-fc3d-45e7-a566-738efd3dcf7b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:03.078945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e62c58b0-fc3d-45e7-a566-738efd3dcf7b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:03.080256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e62c58b0-fc3d-45e7-a566-738efd3dcf7b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:03.080420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e62c58b0-fc3d-45e7-a566-738efd3dcf7b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:03.080734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e62c58b0-fc3d-45e7-a566-738efd3dcf7b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:03.834016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=14 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:03.906072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=26 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:04.971001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e62c58b0-fc3d-45e7-a566-738efd3dcf7b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:05.003831 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e62c58b0-fc3d-45e7-a566-738efd3dcf7b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1313 microversion: 2.1 time: 2.008401 Sep 08 12:43:05.004779 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 621/1255] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:02 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1313 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:05.022607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d663411-4497-48c4-ac3e-ecdd86b6fe36 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:05.026515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6d663411-4497-48c4-ac3e-ecdd86b6fe36 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:05.041556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d663411-4497-48c4-ac3e-ecdd86b6fe36 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:05.044079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d663411-4497-48c4-ac3e-ecdd86b6fe36 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:05.044761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d663411-4497-48c4-ac3e-ecdd86b6fe36 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:05.048769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d663411-4497-48c4-ac3e-ecdd86b6fe36 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:05.049708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d663411-4497-48c4-ac3e-ecdd86b6fe36 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:05.054376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d663411-4497-48c4-ac3e-ecdd86b6fe36 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:05.620737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Building network info cache for instance {{(pid=128971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 12:43:05.630344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:06.067122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=9 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:06.199088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d663411-4497-48c4-ac3e-ecdd86b6fe36 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:06.250562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d663411-4497-48c4-ac3e-ecdd86b6fe36 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:06.274364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d663411-4497-48c4-ac3e-ecdd86b6fe36 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:06.285142 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6d663411-4497-48c4-ac3e-ecdd86b6fe36 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1411 microversion: 2.25 time: 1.272941 Sep 08 12:43:06.288093 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 622/1256] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:05 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1411 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:06.317678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-020c2b01-916c-43e4-905a-006e1fc03bd5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:06.322253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-020c2b01-916c-43e4-905a-006e1fc03bd5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:06.343753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-020c2b01-916c-43e4-905a-006e1fc03bd5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:06.344284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-020c2b01-916c-43e4-905a-006e1fc03bd5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:06.344737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-020c2b01-916c-43e4-905a-006e1fc03bd5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:06.345500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-020c2b01-916c-43e4-905a-006e1fc03bd5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:06.345969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-020c2b01-916c-43e4-905a-006e1fc03bd5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:06.346403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-020c2b01-916c-43e4-905a-006e1fc03bd5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:09.000493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-020c2b01-916c-43e4-905a-006e1fc03bd5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:09.020770 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-020c2b01-916c-43e4-905a-006e1fc03bd5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1716 microversion: 2.1 time: 2.729886 Sep 08 12:43:09.032040 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 623/1257] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:06 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1716 bytes in 2742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:09.210820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-dd08a876-6b70-476b-935d-b5bc7c34100f req-742a17be-e3e7-4490-be01-5d96f5838d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d483e1-ee86-4c2f-ae5a-d14ad8686dea", "name": "network-vif-unplugged", "status": "completed", "tag": "7c4cd857-97b7-4ae8-994c-544ea60d027c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:09.230223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:09.233333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dd08a876-6b70-476b-935d-b5bc7c34100f req-742a17be-e3e7-4490-be01-5d96f5838d3e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:09.234294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dd08a876-6b70-476b-935d-b5bc7c34100f req-742a17be-e3e7-4490-be01-5d96f5838d3e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:09.234983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dd08a876-6b70-476b-935d-b5bc7c34100f req-742a17be-e3e7-4490-be01-5d96f5838d3e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:09.259097 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-dd08a876-6b70-476b-935d-b5bc7c34100f req-742a17be-e3e7-4490-be01-5d96f5838d3e service nova] Creating event network-vif-unplugged:7c4cd857-97b7-4ae8-994c-544ea60d027c for instance 62d483e1-ee86-4c2f-ae5a-d14ad8686dea on n-h2-852084-10 Sep 08 12:43:09.266737 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-dd08a876-6b70-476b-935d-b5bc7c34100f req-742a17be-e3e7-4490-be01-5d96f5838d3e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.233261 Sep 08 12:43:09.268382 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 624/1258] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:09.286477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60f8d906-f137-461f-806c-4dbd808b5d4e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:09.287575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-60f8d906-f137-461f-806c-4dbd808b5d4e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:09.296774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60f8d906-f137-461f-806c-4dbd808b5d4e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:09.297613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60f8d906-f137-461f-806c-4dbd808b5d4e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:09.298302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60f8d906-f137-461f-806c-4dbd808b5d4e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:09.299297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60f8d906-f137-461f-806c-4dbd808b5d4e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:09.300062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60f8d906-f137-461f-806c-4dbd808b5d4e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:09.301047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60f8d906-f137-461f-806c-4dbd808b5d4e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:09.730052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-60f8d906-f137-461f-806c-4dbd808b5d4e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:09.776391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-60f8d906-f137-461f-806c-4dbd808b5d4e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:09.789647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-60f8d906-f137-461f-806c-4dbd808b5d4e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:09.819393 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-60f8d906-f137-461f-806c-4dbd808b5d4e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.547384 Sep 08 12:43:09.836647 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 625/1259] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:09 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:09.875946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-451396fc-ef08-4f3a-b014-f3454f0ae5e0 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:09.892660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-451396fc-ef08-4f3a-b014-f3454f0ae5e0 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:09.904971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-451396fc-ef08-4f3a-b014-f3454f0ae5e0 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:09.908725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-451396fc-ef08-4f3a-b014-f3454f0ae5e0 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:09.915193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-451396fc-ef08-4f3a-b014-f3454f0ae5e0 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:09.916957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-451396fc-ef08-4f3a-b014-f3454f0ae5e0 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:09.918128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-451396fc-ef08-4f3a-b014-f3454f0ae5e0 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:09.919381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-451396fc-ef08-4f3a-b014-f3454f0ae5e0 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:11.167820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-451396fc-ef08-4f3a-b014-f3454f0ae5e0 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:11.188458 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-451396fc-ef08-4f3a-b014-f3454f0ae5e0 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 200 len: 1279 microversion: 2.1 time: 1.349623 Sep 08 12:43:11.200786 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 626/1260] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:09 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 1279 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:11.435646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d6347ddf-3266-45f9-957f-95e07ba38a77 req-d112e59a-e23c-47ec-904e-0a238625f020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21de9f4e-35f1-485e-bf5c-301cec48fa12", "tag": "c54bf0d4-ec44-4b9b-aa86-f5c058b69112"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:11.481423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d6347ddf-3266-45f9-957f-95e07ba38a77 req-d112e59a-e23c-47ec-904e-0a238625f020 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:11.489055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d6347ddf-3266-45f9-957f-95e07ba38a77 req-d112e59a-e23c-47ec-904e-0a238625f020 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:11.490427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d6347ddf-3266-45f9-957f-95e07ba38a77 req-d112e59a-e23c-47ec-904e-0a238625f020 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:11.599276 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d6347ddf-3266-45f9-957f-95e07ba38a77 req-d112e59a-e23c-47ec-904e-0a238625f020 service nova] Creating event network-changed:c54bf0d4-ec44-4b9b-aa86-f5c058b69112 for instance 21de9f4e-35f1-485e-bf5c-301cec48fa12 on n-h1-852084-10 Sep 08 12:43:11.618041 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d6347ddf-3266-45f9-957f-95e07ba38a77 req-d112e59a-e23c-47ec-904e-0a238625f020 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.414373 Sep 08 12:43:11.624149 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 627/1261] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:11.675255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a1e04189-1d47-4c64-a1e3-862b81f6cb77 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:11.688185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a1e04189-1d47-4c64-a1e3-862b81f6cb77 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:11.709735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1e04189-1d47-4c64-a1e3-862b81f6cb77 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:11.710639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1e04189-1d47-4c64-a1e3-862b81f6cb77 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:11.720357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1e04189-1d47-4c64-a1e3-862b81f6cb77 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:11.721706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1e04189-1d47-4c64-a1e3-862b81f6cb77 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:11.722714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1e04189-1d47-4c64-a1e3-862b81f6cb77 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:11.723535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1e04189-1d47-4c64-a1e3-862b81f6cb77 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:11.904688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Updating instance_info_cache with network_info: [{"id": "c54bf0d4-ec44-4b9b-aa86-f5c058b69112", "address": "fa:16:3e:30:32:d6", "network": {"id": "537f47b6-a4a4-481b-95fa-dc20a0bdcd66", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-2044299134-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "dd43c0505e05417aa4004cc015d919c6", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc54bf0d4-ec", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 12:43:11.952008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Releasing lock "refresh_cache-21de9f4e-35f1-485e-bf5c-301cec48fa12" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 12:43:11.954367 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9ca50814-3c68-4593-b363-c175449a7543 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action" status: 202 len: 0 microversion: 2.1 time: 17.668899 Sep 08 12:43:11.956430 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 635/1262] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:42:54 2022] POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action => generated 0 bytes in 17680 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 12:43:12.199649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a06920c0-b771-4168-a034-94ab7d5d70d4 req-92e7b111-a512-45d5-abfa-a4ff26df9444 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0860ae28-9636-40dd-a79d-bbf608e0a922", "name": "network-vif-plugged", "status": "completed", "tag": "7d11df58-0218-4b52-87b7-4c5dc9927ca6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:12.222049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a06920c0-b771-4168-a034-94ab7d5d70d4 req-92e7b111-a512-45d5-abfa-a4ff26df9444 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:12.225569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a06920c0-b771-4168-a034-94ab7d5d70d4 req-92e7b111-a512-45d5-abfa-a4ff26df9444 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:12.226799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a06920c0-b771-4168-a034-94ab7d5d70d4 req-92e7b111-a512-45d5-abfa-a4ff26df9444 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:12.315986 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a06920c0-b771-4168-a034-94ab7d5d70d4 req-92e7b111-a512-45d5-abfa-a4ff26df9444 service nova] Creating event network-vif-plugged:7d11df58-0218-4b52-87b7-4c5dc9927ca6 for instance 0860ae28-9636-40dd-a79d-bbf608e0a922 on n-h1-852084-10 Sep 08 12:43:12.334817 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a06920c0-b771-4168-a034-94ab7d5d70d4 req-92e7b111-a512-45d5-abfa-a4ff26df9444 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.375849 Sep 08 12:43:12.342452 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 636/1263] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:12.402761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-edc7e874-c1ed-4c75-ba89-163e5170b9dc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:12.407586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-edc7e874-c1ed-4c75-ba89-163e5170b9dc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:12.447177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edc7e874-c1ed-4c75-ba89-163e5170b9dc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:12.466009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edc7e874-c1ed-4c75-ba89-163e5170b9dc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:12.466907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edc7e874-c1ed-4c75-ba89-163e5170b9dc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:12.468432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edc7e874-c1ed-4c75-ba89-163e5170b9dc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:12.474735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edc7e874-c1ed-4c75-ba89-163e5170b9dc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:12.482425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edc7e874-c1ed-4c75-ba89-163e5170b9dc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:12.710289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:12.779638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:13.244317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a1e04189-1d47-4c64-a1e3-862b81f6cb77 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:13.271589 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a1e04189-1d47-4c64-a1e3-862b81f6cb77 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1313 microversion: 2.1 time: 1.620589 Sep 08 12:43:13.283272 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 628/1264] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:11 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1313 bytes in 1630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:13.434943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-440800190", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "58f4da24-cf42-4565-9c74-ba91eb9335e3"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:13.695764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] validate_networks() for [('58f4da24-cf42-4565-9c74-ba91eb9335e3', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:43:15.002276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-edc7e874-c1ed-4c75-ba89-163e5170b9dc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:15.018103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-edc7e874-c1ed-4c75-ba89-163e5170b9dc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:15.019677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-edc7e874-c1ed-4c75-ba89-163e5170b9dc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:15.030298 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-edc7e874-c1ed-4c75-ba89-163e5170b9dc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1411 microversion: 2.25 time: 2.676343 Sep 08 12:43:15.043260 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 637/1265] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:12 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1411 bytes in 2688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:15.050259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3d19ebc7-53bd-466b-9828-0b94940dd14b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:15.050259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3d19ebc7-53bd-466b-9828-0b94940dd14b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:15.069216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d19ebc7-53bd-466b-9828-0b94940dd14b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:15.070590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d19ebc7-53bd-466b-9828-0b94940dd14b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:15.071218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d19ebc7-53bd-466b-9828-0b94940dd14b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:15.072304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d19ebc7-53bd-466b-9828-0b94940dd14b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:15.073053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d19ebc7-53bd-466b-9828-0b94940dd14b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:15.073808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d19ebc7-53bd-466b-9828-0b94940dd14b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:16.376542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3d19ebc7-53bd-466b-9828-0b94940dd14b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:16.405735 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3d19ebc7-53bd-466b-9828-0b94940dd14b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1716 microversion: 2.1 time: 1.372004 Sep 08 12:43:16.417160 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 638/1266] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:15 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1716 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:16.426548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a8e9b394-941e-4967-b93d-d39cc5a696e8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:16.431825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a8e9b394-941e-4967-b93d-d39cc5a696e8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:16.458013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8e9b394-941e-4967-b93d-d39cc5a696e8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:16.459122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8e9b394-941e-4967-b93d-d39cc5a696e8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:16.460001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8e9b394-941e-4967-b93d-d39cc5a696e8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:16.461890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8e9b394-941e-4967-b93d-d39cc5a696e8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:16.462750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8e9b394-941e-4967-b93d-d39cc5a696e8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:16.468831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8e9b394-941e-4967-b93d-d39cc5a696e8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:17.096988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a8e9b394-941e-4967-b93d-d39cc5a696e8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:17.107748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a8e9b394-941e-4967-b93d-d39cc5a696e8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:17.126398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a8e9b394-941e-4967-b93d-d39cc5a696e8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:17.153048 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a8e9b394-941e-4967-b93d-d39cc5a696e8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.734073 Sep 08 12:43:17.169895 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 639/1267] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:16 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:17.185968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-daeb1967-d362-41d6-93ea-ff3f3d439994 req-b35baa9d-e627-4b42-ab82-f7638a92f2da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62d483e1-ee86-4c2f-ae5a-d14ad8686dea", "tag": "7c4cd857-97b7-4ae8-994c-544ea60d027c"}, {"name": "network-changed", "server_uuid": "83b2b1b0-2e34-4bbc-9d98-40eec81036ac", "tag": "b6f3f915-c769-47f3-8624-14a1d7dcf25a"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:17.213091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-daeb1967-d362-41d6-93ea-ff3f3d439994 req-b35baa9d-e627-4b42-ab82-f7638a92f2da service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:17.236625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-daeb1967-d362-41d6-93ea-ff3f3d439994 req-b35baa9d-e627-4b42-ab82-f7638a92f2da service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:17.242542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-daeb1967-d362-41d6-93ea-ff3f3d439994 req-b35baa9d-e627-4b42-ab82-f7638a92f2da service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:17.347926 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-daeb1967-d362-41d6-93ea-ff3f3d439994 req-b35baa9d-e627-4b42-ab82-f7638a92f2da service nova] Creating event network-changed:7c4cd857-97b7-4ae8-994c-544ea60d027c for instance 62d483e1-ee86-4c2f-ae5a-d14ad8686dea on n-h2-852084-10 Sep 08 12:43:17.351293 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-daeb1967-d362-41d6-93ea-ff3f3d439994 req-b35baa9d-e627-4b42-ab82-f7638a92f2da service nova] Creating event network-changed:b6f3f915-c769-47f3-8624-14a1d7dcf25a for instance 83b2b1b0-2e34-4bbc-9d98-40eec81036ac on n-h1-852084-10 Sep 08 12:43:17.483536 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-daeb1967-d362-41d6-93ea-ff3f3d439994 req-b35baa9d-e627-4b42-ab82-f7638a92f2da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.280043 Sep 08 12:43:17.490430 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 640/1268] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:17.547103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6f477a3e-f705-4739-9f96-e53391d9737c tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '.version_select at 0x7fdb3abb53a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:17.641457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:43:17.642404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:43:17.643583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:43:17.644890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:43:17.647982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:43:17.682411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:17.683957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:17.685068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:17.687122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:17.688430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:17.689776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:17.790949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Getting quotas for project c486d69d062749c7b334423a3a89cc13. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:43:17.810060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Getting quotas for user b1900295263741188d26b49e7e8b4036 and project c486d69d062749c7b334423a3a89cc13. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:43:17.873997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:43:17.883858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:43:18.053579 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-02ac2ab8-60af-4562-9273-23ea1d011476 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.777656 Sep 08 12:43:18.056214 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 629/1269] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:43:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 4782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:43:18.070739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2f46aedc-5354-4faf-8302-70226e0660e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:18.075977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2f46aedc-5354-4faf-8302-70226e0660e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:18.097430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f46aedc-5354-4faf-8302-70226e0660e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:18.098376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f46aedc-5354-4faf-8302-70226e0660e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:18.099815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f46aedc-5354-4faf-8302-70226e0660e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:18.104025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f46aedc-5354-4faf-8302-70226e0660e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:18.104875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f46aedc-5354-4faf-8302-70226e0660e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:18.105535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f46aedc-5354-4faf-8302-70226e0660e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:21.219040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2f46aedc-5354-4faf-8302-70226e0660e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:21.233275 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2f46aedc-5354-4faf-8302-70226e0660e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 200 len: 1321 microversion: 2.1 time: 3.174845 Sep 08 12:43:21.249079 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 630/1270] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:18 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 1321 bytes in 3191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:21.282857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-75a07b00-94f3-4fea-9b70-83757f5e7d4c req-02c995cf-50a5-422d-a880-d1351b28f0ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3", "tag": "c30198ff-9bbb-464d-a8d0-e361028a7b78"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:21.353332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-75a07b00-94f3-4fea-9b70-83757f5e7d4c req-02c995cf-50a5-422d-a880-d1351b28f0ec service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:21.359555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-75a07b00-94f3-4fea-9b70-83757f5e7d4c req-02c995cf-50a5-422d-a880-d1351b28f0ec service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:21.365083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-75a07b00-94f3-4fea-9b70-83757f5e7d4c req-02c995cf-50a5-422d-a880-d1351b28f0ec service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:21.427336 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-75a07b00-94f3-4fea-9b70-83757f5e7d4c req-02c995cf-50a5-422d-a880-d1351b28f0ec service nova] Creating event network-changed:c30198ff-9bbb-464d-a8d0-e361028a7b78 for instance ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 on n-h2-852084-10 Sep 08 12:43:21.439506 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-75a07b00-94f3-4fea-9b70-83757f5e7d4c req-02c995cf-50a5-422d-a880-d1351b28f0ec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187811 Sep 08 12:43:21.441135 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 631/1271] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:21.458903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bb829c27-2d6f-4dfa-bdfe-8bc97b964490 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:21.464966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bb829c27-2d6f-4dfa-bdfe-8bc97b964490 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:21.476429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb829c27-2d6f-4dfa-bdfe-8bc97b964490 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:21.484143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb829c27-2d6f-4dfa-bdfe-8bc97b964490 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:21.484617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb829c27-2d6f-4dfa-bdfe-8bc97b964490 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:21.485456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb829c27-2d6f-4dfa-bdfe-8bc97b964490 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:21.486832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb829c27-2d6f-4dfa-bdfe-8bc97b964490 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:21.487461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb829c27-2d6f-4dfa-bdfe-8bc97b964490 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:23.524355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bb829c27-2d6f-4dfa-bdfe-8bc97b964490 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:23.542097 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bb829c27-2d6f-4dfa-bdfe-8bc97b964490 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1463 microversion: 2.1 time: 2.099248 Sep 08 12:43:23.543486 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 632/1272] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:21 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1463 bytes in 2101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:23.551829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e6b0a3de-aa04-400c-b09f-3bea1056ad91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:23.552906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e6b0a3de-aa04-400c-b09f-3bea1056ad91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:23.577387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6b0a3de-aa04-400c-b09f-3bea1056ad91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:23.578364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6b0a3de-aa04-400c-b09f-3bea1056ad91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:23.579071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6b0a3de-aa04-400c-b09f-3bea1056ad91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:23.580388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6b0a3de-aa04-400c-b09f-3bea1056ad91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:23.581187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6b0a3de-aa04-400c-b09f-3bea1056ad91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:23.581942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6b0a3de-aa04-400c-b09f-3bea1056ad91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:23.612523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=81 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:24.694941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6b0a3de-aa04-400c-b09f-3bea1056ad91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:24.715683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6b0a3de-aa04-400c-b09f-3bea1056ad91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:24.718454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6b0a3de-aa04-400c-b09f-3bea1056ad91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:24.720235 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e6b0a3de-aa04-400c-b09f-3bea1056ad91 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1411 microversion: 2.25 time: 1.175387 Sep 08 12:43:24.722683 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 633/1273] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:23 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1411 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:24.739967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ff7fd04d-6215-43fe-a272-70b41ca1df3c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:24.740859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff7fd04d-6215-43fe-a272-70b41ca1df3c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:24.756009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff7fd04d-6215-43fe-a272-70b41ca1df3c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:24.759027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff7fd04d-6215-43fe-a272-70b41ca1df3c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:24.759935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff7fd04d-6215-43fe-a272-70b41ca1df3c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:24.763255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff7fd04d-6215-43fe-a272-70b41ca1df3c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:24.764034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff7fd04d-6215-43fe-a272-70b41ca1df3c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:24.764661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff7fd04d-6215-43fe-a272-70b41ca1df3c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:25.195635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ff7fd04d-6215-43fe-a272-70b41ca1df3c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:25.223198 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ff7fd04d-6215-43fe-a272-70b41ca1df3c tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1716 microversion: 2.1 time: 0.494266 Sep 08 12:43:25.229637 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 634/1274] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:24 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1716 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:25.261469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a031d63a-6158-4898-8378-f78e5f0e4be4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:25.262912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a031d63a-6158-4898-8378-f78e5f0e4be4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:25.299012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a031d63a-6158-4898-8378-f78e5f0e4be4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:25.304527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a031d63a-6158-4898-8378-f78e5f0e4be4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:25.305921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a031d63a-6158-4898-8378-f78e5f0e4be4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:25.309064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a031d63a-6158-4898-8378-f78e5f0e4be4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:25.311812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a031d63a-6158-4898-8378-f78e5f0e4be4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:25.315653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a031d63a-6158-4898-8378-f78e5f0e4be4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:25.990025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a031d63a-6158-4898-8378-f78e5f0e4be4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:26.000703 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a031d63a-6158-4898-8378-f78e5f0e4be4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db" status: 200 len: 1307 microversion: 2.1 time: 0.768157 Sep 08 12:43:26.001305 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 635/1275] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:25 2022] GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db => generated 1307 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:26.043977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8dd84737-ab5c-400f-937f-a813394b9bb0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:26.046107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8dd84737-ab5c-400f-937f-a813394b9bb0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:26.070384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8dd84737-ab5c-400f-937f-a813394b9bb0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:26.074902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8dd84737-ab5c-400f-937f-a813394b9bb0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:26.077993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8dd84737-ab5c-400f-937f-a813394b9bb0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:26.080881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8dd84737-ab5c-400f-937f-a813394b9bb0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:26.085640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8dd84737-ab5c-400f-937f-a813394b9bb0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:26.091077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8dd84737-ab5c-400f-937f-a813394b9bb0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:26.518309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8dd84737-ab5c-400f-937f-a813394b9bb0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:26.539026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8dd84737-ab5c-400f-937f-a813394b9bb0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:26.543104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8dd84737-ab5c-400f-937f-a813394b9bb0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:26.559616 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8dd84737-ab5c-400f-937f-a813394b9bb0 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1555 microversion: 2.91 time: 0.538793 Sep 08 12:43:26.561001 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 636/1276] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:26 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1555 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:26.593106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-cde8ecf3-85d6-4659-b226-2f72871ef217 req-ebaaaa65-f564-4585-9ce4-0c322c82784f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3", "name": "network-vif-plugged", "status": "completed", "tag": "c30198ff-9bbb-464d-a8d0-e361028a7b78"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:26.648978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cde8ecf3-85d6-4659-b226-2f72871ef217 req-ebaaaa65-f564-4585-9ce4-0c322c82784f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:26.650155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cde8ecf3-85d6-4659-b226-2f72871ef217 req-ebaaaa65-f564-4585-9ce4-0c322c82784f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:26.651586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cde8ecf3-85d6-4659-b226-2f72871ef217 req-ebaaaa65-f564-4585-9ce4-0c322c82784f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:26.712535 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-cde8ecf3-85d6-4659-b226-2f72871ef217 req-ebaaaa65-f564-4585-9ce4-0c322c82784f service nova] Creating event network-vif-plugged:c30198ff-9bbb-464d-a8d0-e361028a7b78 for instance ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 on n-h2-852084-10 Sep 08 12:43:26.727631 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-cde8ecf3-85d6-4659-b226-2f72871ef217 req-ebaaaa65-f564-4585-9ce4-0c322c82784f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163105 Sep 08 12:43:26.729689 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 637/1277] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:26.740600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-50446678-07aa-492c-acba-edd4248e8e53 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:26.743216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-50446678-07aa-492c-acba-edd4248e8e53 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:26.753164 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6f477a3e-f705-4739-9f96-e53391d9737c tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/e007e00c-0e7a-40fb-907b-7fe158028480" status: 202 len: 0 microversion: 2.1 time: 9.257242 Sep 08 12:43:26.754352 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 641/1278] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:43:17 2022] DELETE /compute/v2.1/os-floating-ips/e007e00c-0e7a-40fb-907b-7fe158028480 => generated 0 bytes in 9263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:43:26.759318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50446678-07aa-492c-acba-edd4248e8e53 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:26.761110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50446678-07aa-492c-acba-edd4248e8e53 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:26.762381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50446678-07aa-492c-acba-edd4248e8e53 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:26.764313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50446678-07aa-492c-acba-edd4248e8e53 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:26.765736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50446678-07aa-492c-acba-edd4248e8e53 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:26.766825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50446678-07aa-492c-acba-edd4248e8e53 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:27.212266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=12 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:27.277338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=25,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:27.304865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-50446678-07aa-492c-acba-edd4248e8e53 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:27.345760 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-50446678-07aa-492c-acba-edd4248e8e53 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 200 len: 1321 microversion: 2.1 time: 0.607741 Sep 08 12:43:27.345760 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 638/1279] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:26 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 1321 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:27.369404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-1c38fdb1-0099-4c5b-b045-1fc77df71634 req-ba24d5a2-7de1-47bc-ab00-763def3086f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba78845-4ce9-474d-ac71-a91626b110d1", "tag": "0305f968-e274-437c-8891-b5da427a44bc"}, {"name": "network-changed", "server_uuid": "9195ae17-364a-4f94-8842-296c9f1b9a7e", "tag": "e8d6e8c5-d6c1-474a-ad8e-18a25c148aeb"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:27.426340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1c38fdb1-0099-4c5b-b045-1fc77df71634 req-ba24d5a2-7de1-47bc-ab00-763def3086f7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:27.426956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1c38fdb1-0099-4c5b-b045-1fc77df71634 req-ba24d5a2-7de1-47bc-ab00-763def3086f7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:27.431398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1c38fdb1-0099-4c5b-b045-1fc77df71634 req-ba24d5a2-7de1-47bc-ab00-763def3086f7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:27.524623 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1c38fdb1-0099-4c5b-b045-1fc77df71634 req-ba24d5a2-7de1-47bc-ab00-763def3086f7 service nova] Creating event network-changed:0305f968-e274-437c-8891-b5da427a44bc for instance 2ba78845-4ce9-474d-ac71-a91626b110d1 on n-h1-852084-10 Sep 08 12:43:27.530427 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1c38fdb1-0099-4c5b-b045-1fc77df71634 req-ba24d5a2-7de1-47bc-ab00-763def3086f7 service nova] Creating event network-changed:e8d6e8c5-d6c1-474a-ad8e-18a25c148aeb for instance 9195ae17-364a-4f94-8842-296c9f1b9a7e on n-h2-852084-10 Sep 08 12:43:27.581730 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-1c38fdb1-0099-4c5b-b045-1fc77df71634 req-ba24d5a2-7de1-47bc-ab00-763def3086f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.215728 Sep 08 12:43:27.583112 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 639/1280] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:27.594206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2947a5cb-e285-4d4d-b4b4-f3c6dceb3f6a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:27.595709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2947a5cb-e285-4d4d-b4b4-f3c6dceb3f6a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:27.607693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2947a5cb-e285-4d4d-b4b4-f3c6dceb3f6a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:27.608635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2947a5cb-e285-4d4d-b4b4-f3c6dceb3f6a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:27.609263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2947a5cb-e285-4d4d-b4b4-f3c6dceb3f6a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:27.610247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2947a5cb-e285-4d4d-b4b4-f3c6dceb3f6a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:27.610921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2947a5cb-e285-4d4d-b4b4-f3c6dceb3f6a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:27.611633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2947a5cb-e285-4d4d-b4b4-f3c6dceb3f6a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:27.726675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:27.752759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-84dbdeee-2ef1-453e-bf17-490e2a0c1b6c tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:27.761130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-84dbdeee-2ef1-453e-bf17-490e2a0c1b6c tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:27.783556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84dbdeee-2ef1-453e-bf17-490e2a0c1b6c tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:27.784852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84dbdeee-2ef1-453e-bf17-490e2a0c1b6c tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:27.785931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84dbdeee-2ef1-453e-bf17-490e2a0c1b6c tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:27.787288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84dbdeee-2ef1-453e-bf17-490e2a0c1b6c tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:27.788433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84dbdeee-2ef1-453e-bf17-490e2a0c1b6c tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:27.789496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84dbdeee-2ef1-453e-bf17-490e2a0c1b6c tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:27.842550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:28.204192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2947a5cb-e285-4d4d-b4b4-f3c6dceb3f6a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:28.235088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2947a5cb-e285-4d4d-b4b4-f3c6dceb3f6a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:28.238332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2947a5cb-e285-4d4d-b4b4-f3c6dceb3f6a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:28.240569 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2947a5cb-e285-4d4d-b4b4-f3c6dceb3f6a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1411 microversion: 2.25 time: 0.655418 Sep 08 12:43:28.243275 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 640/1281] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:27 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1411 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:28.255958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c819a0a-e280-467c-a816-a7a8f43ea14f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:28.258267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5c819a0a-e280-467c-a816-a7a8f43ea14f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:28.274899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c819a0a-e280-467c-a816-a7a8f43ea14f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:28.275856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c819a0a-e280-467c-a816-a7a8f43ea14f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:28.276658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c819a0a-e280-467c-a816-a7a8f43ea14f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:28.280261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c819a0a-e280-467c-a816-a7a8f43ea14f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:28.281585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c819a0a-e280-467c-a816-a7a8f43ea14f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:28.282726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c819a0a-e280-467c-a816-a7a8f43ea14f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:28.310969 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-84dbdeee-2ef1-453e-bf17-490e2a0c1b6c tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1616 microversion: 2.1 time: 1.551083 Sep 08 12:43:28.314065 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 642/1282] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:26 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1616 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:28.337379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc262bd0-1b0a-49b7-8090-46714feeafab tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc262bd0-1b0a-49b7-8090-46714feeafab tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Request method failure captured: Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action HTTP/1.1 Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 34 Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeMOai9HlXT63ULNh0wDkBCHuQCRuASwYRcrjCNfJoe7cSI6fvUb1WCak1KVqhaVLLpesvTdK65I79178Kp1YE-ZOpGqtH6gzV8TBrLi2Jd8-L_3o2dpAOqV___EkbuEexJpKsIsetD4nW7YuYtmsOIs4__PJwBdaN_dE7kmcmNrtpg Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: dd43c0505e05417aa4004cc015d919c6 Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:43:28.362003 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: dd43c0505e05417aa4004cc015d919c6 Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: ca5a5815b22c4a6e8f5016083e547662 Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: {"addFloatingIp": {"address": ""}} Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:43:28.365411 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '21de9f4e-35f1-485e-bf5c-301cec48fa12', 'body': {'addFloatingIp': {'address': ''}}} Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi '' Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:43:28.367961 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:43:28.371011 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:43:28.373690 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Sep 08 12:43:28.373690 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:28.379531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc262bd0-1b0a-49b7-8090-46714feeafab tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:43:28.382233 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fc262bd0-1b0a-49b7-8090-46714feeafab tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action" status: 400 len: 142 microversion: 2.1 time: 0.064238 Sep 08 12:43:28.388251 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 643/1283] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:43:28 2022] POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action => generated 142 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:43:28.412839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b54db67d-49df-40ab-915b-3c6136ef9933 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:28.414580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b54db67d-49df-40ab-915b-3c6136ef9933 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:28.444837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b54db67d-49df-40ab-915b-3c6136ef9933 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:28.446144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b54db67d-49df-40ab-915b-3c6136ef9933 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:28.451531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b54db67d-49df-40ab-915b-3c6136ef9933 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:28.456354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b54db67d-49df-40ab-915b-3c6136ef9933 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:28.457770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b54db67d-49df-40ab-915b-3c6136ef9933 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:28.458920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b54db67d-49df-40ab-915b-3c6136ef9933 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:28.910134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5c819a0a-e280-467c-a816-a7a8f43ea14f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:28.942315 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c819a0a-e280-467c-a816-a7a8f43ea14f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1716 microversion: 2.1 time: 0.696565 Sep 08 12:43:28.947659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b54db67d-49df-40ab-915b-3c6136ef9933 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:28.948979 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 641/1284] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:28 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1716 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:28.965386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-435464e8-0532-440d-a6cc-c746f05cb14d req-2d1d7801-9011-4448-986c-694bb69bbbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24093877-782e-42db-b41b-90a91e8a11db", "tag": "ef1e04ce-bdbe-4842-a056-a3b1bc3291a5"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:29.003144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-435464e8-0532-440d-a6cc-c746f05cb14d req-2d1d7801-9011-4448-986c-694bb69bbbb0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:29.003841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-435464e8-0532-440d-a6cc-c746f05cb14d req-2d1d7801-9011-4448-986c-694bb69bbbb0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:29.004602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-435464e8-0532-440d-a6cc-c746f05cb14d req-2d1d7801-9011-4448-986c-694bb69bbbb0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:29.054511 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-435464e8-0532-440d-a6cc-c746f05cb14d req-2d1d7801-9011-4448-986c-694bb69bbbb0 service nova] Creating event network-changed:ef1e04ce-bdbe-4842-a056-a3b1bc3291a5 for instance 24093877-782e-42db-b41b-90a91e8a11db on n-h2-852084-10 Sep 08 12:43:29.076636 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-435464e8-0532-440d-a6cc-c746f05cb14d req-2d1d7801-9011-4448-986c-694bb69bbbb0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125089 Sep 08 12:43:29.086032 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 642/1285] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:29.104311 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b54db67d-49df-40ab-915b-3c6136ef9933 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db" status: 200 len: 1307 microversion: 2.1 time: 0.713663 Sep 08 12:43:29.109624 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 644/1286] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:28 2022] GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db => generated 1307 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:29.141126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-302edd61-8813-45db-a1e6-a260f44b7914 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:29.150496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-49cd764b-b5e3-417d-abb7-d587b5b6e839 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:29.152126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-49cd764b-b5e3-417d-abb7-d587b5b6e839 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:29.154091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-302edd61-8813-45db-a1e6-a260f44b7914 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:29.186384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49cd764b-b5e3-417d-abb7-d587b5b6e839 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:29.189195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49cd764b-b5e3-417d-abb7-d587b5b6e839 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:29.190779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49cd764b-b5e3-417d-abb7-d587b5b6e839 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:29.193935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49cd764b-b5e3-417d-abb7-d587b5b6e839 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:29.195128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49cd764b-b5e3-417d-abb7-d587b5b6e839 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:29.196507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49cd764b-b5e3-417d-abb7-d587b5b6e839 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:29.196735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-302edd61-8813-45db-a1e6-a260f44b7914 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:29.198907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-302edd61-8813-45db-a1e6-a260f44b7914 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:29.199753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-302edd61-8813-45db-a1e6-a260f44b7914 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:29.201291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-302edd61-8813-45db-a1e6-a260f44b7914 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:29.214298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-302edd61-8813-45db-a1e6-a260f44b7914 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:29.217587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-302edd61-8813-45db-a1e6-a260f44b7914 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:29.334038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-49cd764b-b5e3-417d-abb7-d587b5b6e839 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '74c643246dd84fab86e1f771cdc6dcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4de55f3095a54139b6025010d04c71e2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:29.336203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-49cd764b-b5e3-417d-abb7-d587b5b6e839 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] flavor_id is None. Assuming migration. {{(pid=128971) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 08 12:43:29.337227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-49cd764b-b5e3-417d-abb7-d587b5b6e839 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128971) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 12:43:30.232666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-302edd61-8813-45db-a1e6-a260f44b7914 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:30.251739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-302edd61-8813-45db-a1e6-a260f44b7914 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:30.258662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-302edd61-8813-45db-a1e6-a260f44b7914 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:30.276584 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-302edd61-8813-45db-a1e6-a260f44b7914 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1537 microversion: 2.91 time: 1.188578 Sep 08 12:43:30.277844 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 643/1287] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:29 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1537 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:30.284805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-709c69d4-fe93-4fcf-a669-4fbf69cad50f tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:30.285727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-709c69d4-fe93-4fcf-a669-4fbf69cad50f tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:30.303002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-709c69d4-fe93-4fcf-a669-4fbf69cad50f tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:30.304941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-709c69d4-fe93-4fcf-a669-4fbf69cad50f tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:30.308379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-709c69d4-fe93-4fcf-a669-4fbf69cad50f tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:30.318401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-709c69d4-fe93-4fcf-a669-4fbf69cad50f tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:30.318401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-709c69d4-fe93-4fcf-a669-4fbf69cad50f tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:30.324920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-709c69d4-fe93-4fcf-a669-4fbf69cad50f tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:30.527595 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-49cd764b-b5e3-417d-abb7-d587b5b6e839 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922/action" status: 202 len: 0 microversion: 2.1 time: 1.415423 Sep 08 12:43:30.529673 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 645/1288] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:43:29 2022] POST /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922/action => generated 0 bytes in 1419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:43:30.545890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:30.550061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:30.566592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:30.568087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:30.569937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:30.571800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:30.572964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:30.576917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:30.655429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "refresh_cache-21de9f4e-35f1-485e-bf5c-301cec48fa12" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 12:43:30.655806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquired lock "refresh_cache-21de9f4e-35f1-485e-bf5c-301cec48fa12" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 12:43:31.048554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Releasing lock "refresh_cache-21de9f4e-35f1-485e-bf5c-301cec48fa12" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 12:43:31.058024 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] HTTP exception thrown: floating IP not found Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Request method failure captured: Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action HTTP/1.1 Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 41 Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeMOai9HlXT63ULNh0wDkBCHuQCRuASwYRcrjCNfJoe7cSI6fvUb1WCak1KVqhaVLLpesvTdK65I79178Kp1YE-ZOpGqtH6gzV8TBrLi2Jd8-L_3o2dpAOqV___EkbuEexJpKsIsetD4nW7YuYtmsOIs4__PJwBdaN_dE7kmcmNrtpg Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: dd43c0505e05417aa4004cc015d919c6 Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:43:31.061311 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: dd43c0505e05417aa4004cc015d919c6 Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: ca5a5815b22c4a6e8f5016083e547662 Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: {"addFloatingIp": {"address": "0.0.0.0"}} Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:43:31.063012 n-d-852084-10 devstack@n-api.service[128971]: exception: floating IP not found Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '21de9f4e-35f1-485e-bf5c-301cec48fa12', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:43:31.064170 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Sep 08 12:43:31.066034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:31.071766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Returning 404 to user: floating IP not found {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:43:31.073763 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dbf55104-a637-4b86-a8c7-ae8ce3be7ef2 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action" status: 404 len: 67 microversion: 2.1 time: 0.536974 Sep 08 12:43:31.076124 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 646/1289] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:43:30 2022] POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action => generated 67 bytes in 541 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:43:31.084111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-709c69d4-fe93-4fcf-a669-4fbf69cad50f tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:31.093811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9eebf3df-ca6e-461b-9c4c-0a9e698b5c66 req-627f6e0b-555e-4cb3-a9c4-715355c43a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b2b1b0-2e34-4bbc-9d98-40eec81036ac", "name": "network-vif-plugged", "status": "completed", "tag": "b6f3f915-c769-47f3-8624-14a1d7dcf25a"}, {"server_uuid": "2ba78845-4ce9-474d-ac71-a91626b110d1", "name": "network-vif-plugged", "status": "completed", "tag": "0305f968-e274-437c-8891-b5da427a44bc"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:31.109982 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-709c69d4-fe93-4fcf-a669-4fbf69cad50f tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 200 len: 1321 microversion: 2.1 time: 0.830048 Sep 08 12:43:31.111482 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 644/1290] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:30 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 1321 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:31.128378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9eebf3df-ca6e-461b-9c4c-0a9e698b5c66 req-627f6e0b-555e-4cb3-a9c4-715355c43a8d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:31.129447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9eebf3df-ca6e-461b-9c4c-0a9e698b5c66 req-627f6e0b-555e-4cb3-a9c4-715355c43a8d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:31.130278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9eebf3df-ca6e-461b-9c4c-0a9e698b5c66 req-627f6e0b-555e-4cb3-a9c4-715355c43a8d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:31.145085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-56f1baa9-c3e3-4dba-9ff4-d9b0bf80454a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:31.146310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-56f1baa9-c3e3-4dba-9ff4-d9b0bf80454a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:31.165263 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9eebf3df-ca6e-461b-9c4c-0a9e698b5c66 req-627f6e0b-555e-4cb3-a9c4-715355c43a8d service nova] Creating event network-vif-plugged:b6f3f915-c769-47f3-8624-14a1d7dcf25a for instance 83b2b1b0-2e34-4bbc-9d98-40eec81036ac on n-h1-852084-10 Sep 08 12:43:31.167583 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9eebf3df-ca6e-461b-9c4c-0a9e698b5c66 req-627f6e0b-555e-4cb3-a9c4-715355c43a8d service nova] Creating event network-vif-plugged:0305f968-e274-437c-8891-b5da427a44bc for instance 2ba78845-4ce9-474d-ac71-a91626b110d1 on n-h1-852084-10 Sep 08 12:43:31.172187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56f1baa9-c3e3-4dba-9ff4-d9b0bf80454a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:31.173220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56f1baa9-c3e3-4dba-9ff4-d9b0bf80454a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:31.174292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56f1baa9-c3e3-4dba-9ff4-d9b0bf80454a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:31.185343 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9eebf3df-ca6e-461b-9c4c-0a9e698b5c66 req-627f6e0b-555e-4cb3-a9c4-715355c43a8d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.106487 Sep 08 12:43:31.186684 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 647/1291] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:31.189718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56f1baa9-c3e3-4dba-9ff4-d9b0bf80454a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:31.190794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56f1baa9-c3e3-4dba-9ff4-d9b0bf80454a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:31.191711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56f1baa9-c3e3-4dba-9ff4-d9b0bf80454a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:31.226061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e733005d-b09b-43aa-aff9-208febbe6e76 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:31.227975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e733005d-b09b-43aa-aff9-208febbe6e76 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:31.261327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e733005d-b09b-43aa-aff9-208febbe6e76 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:31.262729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e733005d-b09b-43aa-aff9-208febbe6e76 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:31.263901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e733005d-b09b-43aa-aff9-208febbe6e76 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:31.269826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e733005d-b09b-43aa-aff9-208febbe6e76 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:31.271091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e733005d-b09b-43aa-aff9-208febbe6e76 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:31.275415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e733005d-b09b-43aa-aff9-208febbe6e76 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:31.980669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-56f1baa9-c3e3-4dba-9ff4-d9b0bf80454a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:32.014700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-56f1baa9-c3e3-4dba-9ff4-d9b0bf80454a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:32.017124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-56f1baa9-c3e3-4dba-9ff4-d9b0bf80454a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:32.018575 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-56f1baa9-c3e3-4dba-9ff4-d9b0bf80454a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1411 microversion: 2.25 time: 0.905218 Sep 08 12:43:32.051273 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 645/1292] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:31 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1411 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:32.074076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e175569f-0f04-4fa1-a71b-2677d1c74b82 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:32.078553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e175569f-0f04-4fa1-a71b-2677d1c74b82 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:32.121323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e175569f-0f04-4fa1-a71b-2677d1c74b82 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:32.122297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e175569f-0f04-4fa1-a71b-2677d1c74b82 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:32.129399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e175569f-0f04-4fa1-a71b-2677d1c74b82 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:32.135828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e175569f-0f04-4fa1-a71b-2677d1c74b82 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:32.139762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e175569f-0f04-4fa1-a71b-2677d1c74b82 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:32.143894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e175569f-0f04-4fa1-a71b-2677d1c74b82 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:32.217493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e733005d-b09b-43aa-aff9-208febbe6e76 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:32.234454 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e733005d-b09b-43aa-aff9-208febbe6e76 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1706 microversion: 2.1 time: 1.045528 Sep 08 12:43:32.235558 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 648/1293] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:31 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1706 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:32.254939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3e1a2af-f45a-4d8c-926b-7a2315c9701a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:32.255619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d3e1a2af-f45a-4d8c-926b-7a2315c9701a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:32.274990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3e1a2af-f45a-4d8c-926b-7a2315c9701a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:32.279396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3e1a2af-f45a-4d8c-926b-7a2315c9701a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:32.280320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3e1a2af-f45a-4d8c-926b-7a2315c9701a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:32.281472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3e1a2af-f45a-4d8c-926b-7a2315c9701a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:32.282204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3e1a2af-f45a-4d8c-926b-7a2315c9701a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:32.282865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3e1a2af-f45a-4d8c-926b-7a2315c9701a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:32.895106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e175569f-0f04-4fa1-a71b-2677d1c74b82 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:32.909467 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e175569f-0f04-4fa1-a71b-2677d1c74b82 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db" status: 200 len: 1307 microversion: 2.1 time: 0.856916 Sep 08 12:43:32.912718 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 646/1294] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:32 2022] GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db => generated 1307 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:32.922799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ae8b748-9acb-4410-a498-8499ffce54de tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Action: 'action', calling method: .version_select at 0x7fdb3ce34f70>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:32.925360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d3e1a2af-f45a-4d8c-926b-7a2315c9701a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:32.944776 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3e1a2af-f45a-4d8c-926b-7a2315c9701a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1472 microversion: 2.1 time: 0.707088 Sep 08 12:43:32.946445 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 649/1295] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:32 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1472 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:32.984917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-14d8897e-b61c-4598-a9c1-dbcb30dee935 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:32.986225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-14d8897e-b61c-4598-a9c1-dbcb30dee935 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:33.017960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14d8897e-b61c-4598-a9c1-dbcb30dee935 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:33.018909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14d8897e-b61c-4598-a9c1-dbcb30dee935 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:33.028161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14d8897e-b61c-4598-a9c1-dbcb30dee935 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:33.029597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14d8897e-b61c-4598-a9c1-dbcb30dee935 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:33.032586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14d8897e-b61c-4598-a9c1-dbcb30dee935 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:33.034825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14d8897e-b61c-4598-a9c1-dbcb30dee935 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:33.085097 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-1ae8b748-9acb-4410-a498-8499ffce54de tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ae8b748-9acb-4410-a498-8499ffce54de tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Request method failure captured: Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action HTTP/1.1 Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 44 Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeMOai9HlXT63ULNh0wDkBCHuQCRuASwYRcrjCNfJoe7cSI6fvUb1WCak1KVqhaVLLpesvTdK65I79178Kp1YE-ZOpGqtH6gzV8TBrLi2Jd8-L_3o2dpAOqV___EkbuEexJpKsIsetD4nW7YuYtmsOIs4__PJwBdaN_dE7kmcmNrtpg Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: dd43c0505e05417aa4004cc015d919c6 Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:43:33.090237 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: dd43c0505e05417aa4004cc015d919c6 Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: ca5a5815b22c4a6e8f5016083e547662 Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: {"removeFloatingIp": {"address": "0.0.0.0"}} Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:43:33.093651 n-d-852084-10 devstack@n-api.service[128970]: exception: Floating IP not found for address 0.0.0.0. Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '21de9f4e-35f1-485e-bf5c-301cec48fa12', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:43:33.096540 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Sep 08 12:43:33.099198 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:43:33.107949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ae8b748-9acb-4410-a498-8499ffce54de tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:43:33.107949 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1ae8b748-9acb-4410-a498-8499ffce54de tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action" status: 404 len: 88 microversion: 2.1 time: 0.187797 Sep 08 12:43:33.119118 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 647/1296] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:43:32 2022] POST /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12/action => generated 88 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:43:33.127494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44b80d27-aae3-43f7-a254-a216b609fb1e tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:33.129057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-44b80d27-aae3-43f7-a254-a216b609fb1e tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:33.143405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44b80d27-aae3-43f7-a254-a216b609fb1e tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:33.144853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44b80d27-aae3-43f7-a254-a216b609fb1e tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:33.146169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44b80d27-aae3-43f7-a254-a216b609fb1e tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:33.148653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44b80d27-aae3-43f7-a254-a216b609fb1e tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:33.150257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44b80d27-aae3-43f7-a254-a216b609fb1e tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:33.151719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44b80d27-aae3-43f7-a254-a216b609fb1e tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:33.305456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-14d8897e-b61c-4598-a9c1-dbcb30dee935 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:33.345100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-14d8897e-b61c-4598-a9c1-dbcb30dee935 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:33.349007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-14d8897e-b61c-4598-a9c1-dbcb30dee935 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:33.361144 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-14d8897e-b61c-4598-a9c1-dbcb30dee935 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1480 microversion: 2.91 time: 0.412251 Sep 08 12:43:33.363072 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 650/1297] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:32 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1480 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:33.375020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f5792ddf-4270-4f35-8c57-e4efbf62ccb1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '.version_select at 0x7fdb3af725e0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:33.391890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5792ddf-4270-4f35-8c57-e4efbf62ccb1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:33.395748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5792ddf-4270-4f35-8c57-e4efbf62ccb1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:33.400112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5792ddf-4270-4f35-8c57-e4efbf62ccb1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:33.432933 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f5792ddf-4270-4f35-8c57-e4efbf62ccb1 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 3547 microversion: 2.1 time: 0.067371 Sep 08 12:43:33.434899 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 651/1298] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 12:43:33 2022] GET /compute/v2.1/os-migrations => generated 3547 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:33.454826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d5b30396-24ea-467a-8f01-0fcc41f33391 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:33.456517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d5b30396-24ea-467a-8f01-0fcc41f33391 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:33.470348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5b30396-24ea-467a-8f01-0fcc41f33391 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:33.478723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5b30396-24ea-467a-8f01-0fcc41f33391 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:33.479957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5b30396-24ea-467a-8f01-0fcc41f33391 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:33.487663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5b30396-24ea-467a-8f01-0fcc41f33391 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:33.488671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5b30396-24ea-467a-8f01-0fcc41f33391 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:33.489521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5b30396-24ea-467a-8f01-0fcc41f33391 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:33.794148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-44b80d27-aae3-43f7-a254-a216b609fb1e tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:33.814064 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44b80d27-aae3-43f7-a254-a216b609fb1e tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 200 len: 1321 microversion: 2.1 time: 0.690778 Sep 08 12:43:33.817169 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 648/1299] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:33 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 1321 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:33.827483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-819d0765-a819-407c-a9e1-607dae2bc1ee tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:33.829191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-819d0765-a819-407c-a9e1-607dae2bc1ee tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:33.843594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-819d0765-a819-407c-a9e1-607dae2bc1ee tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:33.845240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-819d0765-a819-407c-a9e1-607dae2bc1ee tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:33.846345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-819d0765-a819-407c-a9e1-607dae2bc1ee tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:33.847150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-819d0765-a819-407c-a9e1-607dae2bc1ee tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:33.847688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-819d0765-a819-407c-a9e1-607dae2bc1ee tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:33.848285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-819d0765-a819-407c-a9e1-607dae2bc1ee tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:33.890273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-819d0765-a819-407c-a9e1-607dae2bc1ee tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:43:34.011489 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-819d0765-a819-407c-a9e1-607dae2bc1ee tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "DELETE /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 204 len: 0 microversion: 2.1 time: 0.192116 Sep 08 12:43:34.012366 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 649/1300] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:43:33 2022] DELETE /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:43:34.021770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e0de4886-647f-4458-8884-a2220cbf99ca req-d7094077-66b5-41f3-b372-d1e8c53ea5ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9195ae17-364a-4f94-8842-296c9f1b9a7e", "name": "network-vif-plugged", "status": "completed", "tag": "e8d6e8c5-d6c1-474a-ad8e-18a25c148aeb"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:34.036592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e0de4886-647f-4458-8884-a2220cbf99ca req-d7094077-66b5-41f3-b372-d1e8c53ea5ce service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:34.036981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e0de4886-647f-4458-8884-a2220cbf99ca req-d7094077-66b5-41f3-b372-d1e8c53ea5ce service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:34.039281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e0de4886-647f-4458-8884-a2220cbf99ca req-d7094077-66b5-41f3-b372-d1e8c53ea5ce service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:34.054467 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e0de4886-647f-4458-8884-a2220cbf99ca req-d7094077-66b5-41f3-b372-d1e8c53ea5ce service nova] Creating event network-vif-plugged:e8d6e8c5-d6c1-474a-ad8e-18a25c148aeb for instance 9195ae17-364a-4f94-8842-296c9f1b9a7e on n-h2-852084-10 Sep 08 12:43:34.060803 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e0de4886-647f-4458-8884-a2220cbf99ca req-d7094077-66b5-41f3-b372-d1e8c53ea5ce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046095 Sep 08 12:43:34.062049 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 650/1301] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:34.070703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-96669a0a-a2df-452b-ba48-1f8c999f6f92 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-852084-10"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:34.074957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-96669a0a-a2df-452b-ba48-1f8c999f6f92 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:34.083908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96669a0a-a2df-452b-ba48-1f8c999f6f92 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:34.084876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96669a0a-a2df-452b-ba48-1f8c999f6f92 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:34.085553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96669a0a-a2df-452b-ba48-1f8c999f6f92 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:34.086989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96669a0a-a2df-452b-ba48-1f8c999f6f92 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:34.088043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96669a0a-a2df-452b-ba48-1f8c999f6f92 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:34.088668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96669a0a-a2df-452b-ba48-1f8c999f6f92 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:34.140016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:34.158008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-96669a0a-a2df-452b-ba48-1f8c999f6f92 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-852084-10". {{(pid=128970) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 12:43:34.264688 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-96669a0a-a2df-452b-ba48-1f8c999f6f92 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815/action" status: 202 len: 0 microversion: 2.91 time: 0.201000 Sep 08 12:43:34.265811 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 651/1302] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 12:43:34 2022] POST /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:43:34.272209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-24c290c4-e46b-47a3-81eb-ddde339ab575 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:34.273014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-24c290c4-e46b-47a3-81eb-ddde339ab575 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:34.281907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24c290c4-e46b-47a3-81eb-ddde339ab575 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:34.282462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24c290c4-e46b-47a3-81eb-ddde339ab575 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:34.282924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24c290c4-e46b-47a3-81eb-ddde339ab575 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:34.283741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24c290c4-e46b-47a3-81eb-ddde339ab575 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:34.284233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24c290c4-e46b-47a3-81eb-ddde339ab575 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:34.284679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24c290c4-e46b-47a3-81eb-ddde339ab575 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:34.636937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d5b30396-24ea-467a-8f01-0fcc41f33391 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:34.658392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d5b30396-24ea-467a-8f01-0fcc41f33391 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:34.660139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d5b30396-24ea-467a-8f01-0fcc41f33391 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:34.661448 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d5b30396-24ea-467a-8f01-0fcc41f33391 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1411 microversion: 2.25 time: 1.224880 Sep 08 12:43:34.662421 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 652/1303] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:33 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1411 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:34.667672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3e35112e-575c-4205-9f41-38daaafc35e9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:34.668649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3e35112e-575c-4205-9f41-38daaafc35e9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:34.677860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e35112e-575c-4205-9f41-38daaafc35e9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:34.683842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e35112e-575c-4205-9f41-38daaafc35e9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:34.687153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e35112e-575c-4205-9f41-38daaafc35e9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:34.689768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e35112e-575c-4205-9f41-38daaafc35e9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:34.691587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e35112e-575c-4205-9f41-38daaafc35e9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:34.692990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e35112e-575c-4205-9f41-38daaafc35e9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:35.164469 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-24c290c4-e46b-47a3-81eb-ddde339ab575 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1859 microversion: 2.1 time: 0.897237 Sep 08 12:43:35.166078 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 652/1304] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:34 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1859 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:35.174607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee697219-f30b-4060-ad81-60643b039d33 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:35.176416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ee697219-f30b-4060-ad81-60643b039d33 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:35.189352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee697219-f30b-4060-ad81-60643b039d33 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:35.190244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee697219-f30b-4060-ad81-60643b039d33 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:35.190916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee697219-f30b-4060-ad81-60643b039d33 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:35.192132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee697219-f30b-4060-ad81-60643b039d33 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:35.192894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee697219-f30b-4060-ad81-60643b039d33 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:35.194419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee697219-f30b-4060-ad81-60643b039d33 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:35.256413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3e35112e-575c-4205-9f41-38daaafc35e9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:35.275370 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3e35112e-575c-4205-9f41-38daaafc35e9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db" status: 200 len: 1307 microversion: 2.1 time: 0.611541 Sep 08 12:43:35.276262 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 653/1305] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:34 2022] GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db => generated 1307 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:35.281650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-69702360-d697-494c-92b4-e123deb5d107 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:35.283123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-69702360-d697-494c-92b4-e123deb5d107 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:35.291944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69702360-d697-494c-92b4-e123deb5d107 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:35.293964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69702360-d697-494c-92b4-e123deb5d107 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:35.294647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69702360-d697-494c-92b4-e123deb5d107 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:35.295857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69702360-d697-494c-92b4-e123deb5d107 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:35.296542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69702360-d697-494c-92b4-e123deb5d107 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:35.297370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69702360-d697-494c-92b4-e123deb5d107 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:35.745928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ee697219-f30b-4060-ad81-60643b039d33 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:35.772483 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee697219-f30b-4060-ad81-60643b039d33 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1472 microversion: 2.1 time: 0.592302 Sep 08 12:43:35.776383 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 653/1306] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:35 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1472 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:35.783094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-69702360-d697-494c-92b4-e123deb5d107 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca5a5815b22c4a6e8f5016083e547662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd43c0505e05417aa4004cc015d919c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:35.789287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bc5d5521-a0eb-4e9f-96a4-c7e0bfc3712e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:35.790408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bc5d5521-a0eb-4e9f-96a4-c7e0bfc3712e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:35.804481 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-69702360-d697-494c-92b4-e123deb5d107 tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 200 len: 1542 microversion: 2.1 time: 0.526594 Sep 08 12:43:35.810078 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 654/1307] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:35 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 1542 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:35.823967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc5d5521-a0eb-4e9f-96a4-c7e0bfc3712e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:35.824959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc5d5521-a0eb-4e9f-96a4-c7e0bfc3712e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:35.826082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc5d5521-a0eb-4e9f-96a4-c7e0bfc3712e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:35.827906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc5d5521-a0eb-4e9f-96a4-c7e0bfc3712e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:35.828929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc5d5521-a0eb-4e9f-96a4-c7e0bfc3712e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:35.831031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc5d5521-a0eb-4e9f-96a4-c7e0bfc3712e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:35.856702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e757be1e-affb-4d49-9bd5-1cc59b424737 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:35.863084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e757be1e-affb-4d49-9bd5-1cc59b424737 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:35.906906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e757be1e-affb-4d49-9bd5-1cc59b424737 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:35.909713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e757be1e-affb-4d49-9bd5-1cc59b424737 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:35.916386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e757be1e-affb-4d49-9bd5-1cc59b424737 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:35.922158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e757be1e-affb-4d49-9bd5-1cc59b424737 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:35.924659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e757be1e-affb-4d49-9bd5-1cc59b424737 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:35.926760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e757be1e-affb-4d49-9bd5-1cc59b424737 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:36.195468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bc5d5521-a0eb-4e9f-96a4-c7e0bfc3712e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:36.239745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bc5d5521-a0eb-4e9f-96a4-c7e0bfc3712e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:36.264060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bc5d5521-a0eb-4e9f-96a4-c7e0bfc3712e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:36.288854 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bc5d5521-a0eb-4e9f-96a4-c7e0bfc3712e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.503595 Sep 08 12:43:36.291086 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 654/1308] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:35 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:36.303929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-68441e00-6842-4bdd-b430-5daa2349ef36 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:36.305627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-68441e00-6842-4bdd-b430-5daa2349ef36 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:36.330929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68441e00-6842-4bdd-b430-5daa2349ef36 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:36.331859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68441e00-6842-4bdd-b430-5daa2349ef36 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:36.333286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68441e00-6842-4bdd-b430-5daa2349ef36 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:36.336091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68441e00-6842-4bdd-b430-5daa2349ef36 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:36.337671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68441e00-6842-4bdd-b430-5daa2349ef36 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:36.339217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68441e00-6842-4bdd-b430-5daa2349ef36 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:36.695804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e757be1e-affb-4d49-9bd5-1cc59b424737 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:36.730055 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e757be1e-affb-4d49-9bd5-1cc59b424737 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 200 len: 1510 microversion: 2.1 time: 0.904963 Sep 08 12:43:36.736917 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 655/1309] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:35 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 1510 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:36.752336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0bd64de-18af-42e8-9ccc-ecb181000c50 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:36.754940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0bd64de-18af-42e8-9ccc-ecb181000c50 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:36.786544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0bd64de-18af-42e8-9ccc-ecb181000c50 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:36.789603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0bd64de-18af-42e8-9ccc-ecb181000c50 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:36.790695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0bd64de-18af-42e8-9ccc-ecb181000c50 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:36.791875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0bd64de-18af-42e8-9ccc-ecb181000c50 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:36.792634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0bd64de-18af-42e8-9ccc-ecb181000c50 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:36.793402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0bd64de-18af-42e8-9ccc-ecb181000c50 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:36.932550 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-68441e00-6842-4bdd-b430-5daa2349ef36 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1859 microversion: 2.1 time: 0.638088 Sep 08 12:43:36.947946 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 655/1310] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:36 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1859 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:36.965258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-820c3f1d-2d5e-4724-ba4b-bdc49847d32c req-eb58a2f1-5a0f-4032-a020-7acf470382dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24093877-782e-42db-b41b-90a91e8a11db", "name": "network-vif-plugged", "status": "completed", "tag": "ef1e04ce-bdbe-4842-a056-a3b1bc3291a5"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:36.991295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-820c3f1d-2d5e-4724-ba4b-bdc49847d32c req-eb58a2f1-5a0f-4032-a020-7acf470382dd service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:36.992527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-820c3f1d-2d5e-4724-ba4b-bdc49847d32c req-eb58a2f1-5a0f-4032-a020-7acf470382dd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:36.993204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-820c3f1d-2d5e-4724-ba4b-bdc49847d32c req-eb58a2f1-5a0f-4032-a020-7acf470382dd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:37.009349 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-820c3f1d-2d5e-4724-ba4b-bdc49847d32c req-eb58a2f1-5a0f-4032-a020-7acf470382dd service nova] Creating event network-vif-plugged:ef1e04ce-bdbe-4842-a056-a3b1bc3291a5 for instance 24093877-782e-42db-b41b-90a91e8a11db on n-h2-852084-10 Sep 08 12:43:37.016685 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-820c3f1d-2d5e-4724-ba4b-bdc49847d32c req-eb58a2f1-5a0f-4032-a020-7acf470382dd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066238 Sep 08 12:43:37.018426 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 656/1311] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:37.045956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8d1e7b86-dcd6-4601-9630-f93e6c915dca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:37.047216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8d1e7b86-dcd6-4601-9630-f93e6c915dca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:37.072919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d1e7b86-dcd6-4601-9630-f93e6c915dca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:37.077174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d1e7b86-dcd6-4601-9630-f93e6c915dca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:37.080257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d1e7b86-dcd6-4601-9630-f93e6c915dca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:37.081399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d1e7b86-dcd6-4601-9630-f93e6c915dca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:37.082133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d1e7b86-dcd6-4601-9630-f93e6c915dca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:37.082909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d1e7b86-dcd6-4601-9630-f93e6c915dca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:37.613825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8d1e7b86-dcd6-4601-9630-f93e6c915dca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:37.636904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0bd64de-18af-42e8-9ccc-ecb181000c50 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:37.653752 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8d1e7b86-dcd6-4601-9630-f93e6c915dca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db" status: 200 len: 1307 microversion: 2.1 time: 0.630238 Sep 08 12:43:37.666055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0bd64de-18af-42e8-9ccc-ecb181000c50 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:37.668544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0bd64de-18af-42e8-9ccc-ecb181000c50 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:37.671798 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0bd64de-18af-42e8-9ccc-ecb181000c50 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1606 microversion: 2.25 time: 0.931386 Sep 08 12:43:37.672147 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 657/1312] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:37 2022] GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db => generated 1307 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:37.685583 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 656/1313] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:36 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1606 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:37.701504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-059f9d43-ef07-4c08-9d66-12a5d59fd9c3 req-dd4a576a-4e9f-4d43-a868-e24259cfd345 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21de9f4e-35f1-485e-bf5c-301cec48fa12", "name": "network-vif-deleted", "tag": "c54bf0d4-ec44-4b9b-aa86-f5c058b69112"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:37.710808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cee46f62-2f17-4d22-aa2e-b965605e5a98 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:37.711677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cee46f62-2f17-4d22-aa2e-b965605e5a98 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:37.720982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cee46f62-2f17-4d22-aa2e-b965605e5a98 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:37.722419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cee46f62-2f17-4d22-aa2e-b965605e5a98 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:37.723069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cee46f62-2f17-4d22-aa2e-b965605e5a98 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:37.723945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cee46f62-2f17-4d22-aa2e-b965605e5a98 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:37.725269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cee46f62-2f17-4d22-aa2e-b965605e5a98 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:37.726446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cee46f62-2f17-4d22-aa2e-b965605e5a98 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:37.739520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-059f9d43-ef07-4c08-9d66-12a5d59fd9c3 req-dd4a576a-4e9f-4d43-a868-e24259cfd345 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:37.740916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-059f9d43-ef07-4c08-9d66-12a5d59fd9c3 req-dd4a576a-4e9f-4d43-a868-e24259cfd345 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:37.741688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-059f9d43-ef07-4c08-9d66-12a5d59fd9c3 req-dd4a576a-4e9f-4d43-a868-e24259cfd345 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:37.809040 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-059f9d43-ef07-4c08-9d66-12a5d59fd9c3 req-dd4a576a-4e9f-4d43-a868-e24259cfd345 service nova] Creating event network-vif-deleted:c54bf0d4-ec44-4b9b-aa86-f5c058b69112 for instance 21de9f4e-35f1-485e-bf5c-301cec48fa12 on n-h1-852084-10 Sep 08 12:43:37.825144 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-059f9d43-ef07-4c08-9d66-12a5d59fd9c3 req-dd4a576a-4e9f-4d43-a868-e24259cfd345 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150252 Sep 08 12:43:37.828466 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 658/1314] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:37.853006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-40f6439d-d632-4c9e-81da-e37917a17ea2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:37.854294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-40f6439d-d632-4c9e-81da-e37917a17ea2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:37.889312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:37.902885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40f6439d-d632-4c9e-81da-e37917a17ea2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:37.904036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40f6439d-d632-4c9e-81da-e37917a17ea2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:37.905323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40f6439d-d632-4c9e-81da-e37917a17ea2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:37.906422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40f6439d-d632-4c9e-81da-e37917a17ea2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:37.907133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40f6439d-d632-4c9e-81da-e37917a17ea2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:37.908233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40f6439d-d632-4c9e-81da-e37917a17ea2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:38.078201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cee46f62-2f17-4d22-aa2e-b965605e5a98 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:38.103127 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cee46f62-2f17-4d22-aa2e-b965605e5a98 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1510 microversion: 2.1 time: 0.404871 Sep 08 12:43:38.109264 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 657/1315] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:37 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1510 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:38.130460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-25f7491e-eed9-4ad1-a02e-9ef9c53987ba tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:38.134547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-25f7491e-eed9-4ad1-a02e-9ef9c53987ba tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] [instance: 21de9f4e-35f1-485e-bf5c-301cec48fa12] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:38.153171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25f7491e-eed9-4ad1-a02e-9ef9c53987ba tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:38.153666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25f7491e-eed9-4ad1-a02e-9ef9c53987ba tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:38.154467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25f7491e-eed9-4ad1-a02e-9ef9c53987ba tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:38.154846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25f7491e-eed9-4ad1-a02e-9ef9c53987ba tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:38.155375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25f7491e-eed9-4ad1-a02e-9ef9c53987ba tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:38.155831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25f7491e-eed9-4ad1-a02e-9ef9c53987ba tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:38.174820 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-25f7491e-eed9-4ad1-a02e-9ef9c53987ba tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] HTTP exception thrown: Instance 21de9f4e-35f1-485e-bf5c-301cec48fa12 could not be found. Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-25f7491e-eed9-4ad1-a02e-9ef9c53987ba tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Request method failure captured: Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 HTTP/1.1 Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeMOai9HlXT63ULNh0wDkBCHuQCRuASwYRcrjCNfJoe7cSI6fvUb1WCak1KVqhaVLLpesvTdK65I79178Kp1YE-ZOpGqtH6gzV8TBrLi2Jd8-L_3o2dpAOqV___EkbuEexJpKsIsetD4nW7YuYtmsOIs4__PJwBdaN_dE7kmcmNrtpg Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: dd43c0505e05417aa4004cc015d919c6 Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:43:38.176610 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:43:38.178664 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd43c0505e05417aa4004cc015d919c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:43:38.178664 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:43:38.178664 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: dd43c0505e05417aa4004cc015d919c6 Sep 08 12:43:38.178664 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410 Sep 08 12:43:38.178664 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project Sep 08 12:43:38.178664 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:43:38.178664 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:43:38.178664 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: ca5a5815b22c4a6e8f5016083e547662 Sep 08 12:43:38.178664 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project Sep 08 12:43:38.178664 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:43:38.178664 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 21de9f4e-35f1-485e-bf5c-301cec48fa12 could not be found. Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '21de9f4e-35f1-485e-bf5c-301cec48fa12'} Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21de9f4e-35f1-485e-bf5c-301cec48fa12 could not be found. Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:43:38.179619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21de9f4e-35f1-485e-bf5c-301cec48fa12 could not be found. Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21de9f4e-35f1-485e-bf5c-301cec48fa12 could not be found. Sep 08 12:43:38.181492 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:43:38.183193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-25f7491e-eed9-4ad1-a02e-9ef9c53987ba tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] Returning 404 to user: Instance 21de9f4e-35f1-485e-bf5c-301cec48fa12 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:43:38.183193 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-25f7491e-eed9-4ad1-a02e-9ef9c53987ba tempest-FloatingIPsAssociationNegativeTestJSON-607360410 tempest-FloatingIPsAssociationNegativeTestJSON-607360410-project] 10.222.0.78 "GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12" status: 404 len: 111 microversion: 2.1 time: 0.063970 Sep 08 12:43:38.183193 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 658/1316] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:38 2022] GET /compute/v2.1/servers/21de9f4e-35f1-485e-bf5c-301cec48fa12 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:43:38.184714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aaa16f9f-7564-401c-add9-900e5eb16637 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:38.185282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-aaa16f9f-7564-401c-add9-900e5eb16637 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:38.192202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aaa16f9f-7564-401c-add9-900e5eb16637 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:38.192704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aaa16f9f-7564-401c-add9-900e5eb16637 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:38.193194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aaa16f9f-7564-401c-add9-900e5eb16637 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:38.194399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aaa16f9f-7564-401c-add9-900e5eb16637 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:38.195139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aaa16f9f-7564-401c-add9-900e5eb16637 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:38.195847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aaa16f9f-7564-401c-add9-900e5eb16637 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:38.417886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40f6439d-d632-4c9e-81da-e37917a17ea2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:38.434791 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-40f6439d-d632-4c9e-81da-e37917a17ea2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1477 microversion: 2.1 time: 0.604290 Sep 08 12:43:38.436885 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 659/1317] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:37 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1477 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:38.452932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9326b74-cb70-4484-9bd3-b1478db458a2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:38.456236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a9326b74-cb70-4484-9bd3-b1478db458a2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:38.460233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-aaa16f9f-7564-401c-add9-900e5eb16637 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lazy-loading 'services' on Instance uuid 62d483e1-ee86-4c2f-ae5a-d14ad8686dea {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:43:38.478777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9326b74-cb70-4484-9bd3-b1478db458a2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:38.479312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9326b74-cb70-4484-9bd3-b1478db458a2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:38.479756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9326b74-cb70-4484-9bd3-b1478db458a2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:38.480742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9326b74-cb70-4484-9bd3-b1478db458a2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:38.480935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9326b74-cb70-4484-9bd3-b1478db458a2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:38.481430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9326b74-cb70-4484-9bd3-b1478db458a2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:38.578108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:38.660795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9326b74-cb70-4484-9bd3-b1478db458a2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:38.705521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9326b74-cb70-4484-9bd3-b1478db458a2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:38.728660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9326b74-cb70-4484-9bd3-b1478db458a2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:38.746252 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a9326b74-cb70-4484-9bd3-b1478db458a2 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.305708 Sep 08 12:43:38.759218 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 660/1318] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:38 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:38.768351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-48a0922f-e1bc-4806-9784-368f25516080 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:38.769787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-48a0922f-e1bc-4806-9784-368f25516080 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:38.815136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a0922f-e1bc-4806-9784-368f25516080 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:38.821922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a0922f-e1bc-4806-9784-368f25516080 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:38.823114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a0922f-e1bc-4806-9784-368f25516080 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:38.824681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a0922f-e1bc-4806-9784-368f25516080 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:38.826042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a0922f-e1bc-4806-9784-368f25516080 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:38.831411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a0922f-e1bc-4806-9784-368f25516080 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:39.063088 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-aaa16f9f-7564-401c-add9-900e5eb16637 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "DELETE /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments/5e728690-e39e-4f99-955b-8f02897de03e" status: 202 len: 0 microversion: 2.1 time: 0.881999 Sep 08 12:43:39.077926 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 659/1319] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 12:43:38 2022] DELETE /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments/5e728690-e39e-4f99-955b-8f02897de03e => generated 0 bytes in 898 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:43:39.104743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4a603331-8e7f-44c0-92b1-d03f9fa98d8b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:39.108169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4a603331-8e7f-44c0-92b1-d03f9fa98d8b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 83b2b1b0-2e34-4bbc-9d98-40eec81036ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:39.136523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a603331-8e7f-44c0-92b1-d03f9fa98d8b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:39.137479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a603331-8e7f-44c0-92b1-d03f9fa98d8b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:39.138330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a603331-8e7f-44c0-92b1-d03f9fa98d8b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:39.152856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a603331-8e7f-44c0-92b1-d03f9fa98d8b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:39.154206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a603331-8e7f-44c0-92b1-d03f9fa98d8b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:39.173355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a603331-8e7f-44c0-92b1-d03f9fa98d8b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:39.335881 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-48a0922f-e1bc-4806-9784-368f25516080 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.574586 Sep 08 12:43:39.350091 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 661/1320] 10.222.0.78 () {60 vars in 1316 bytes} [Thu Sep 8 12:43:38 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1/os-interface => generated 284 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:43:39.360616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-57ac783e-0357-4370-831d-b2dcb9c59b83 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:39.377579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-57ac783e-0357-4370-831d-b2dcb9c59b83 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:39.438018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57ac783e-0357-4370-831d-b2dcb9c59b83 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:39.438841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57ac783e-0357-4370-831d-b2dcb9c59b83 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:39.446597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57ac783e-0357-4370-831d-b2dcb9c59b83 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:39.448363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57ac783e-0357-4370-831d-b2dcb9c59b83 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:39.449209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57ac783e-0357-4370-831d-b2dcb9c59b83 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:39.458658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57ac783e-0357-4370-831d-b2dcb9c59b83 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:40.417436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4a603331-8e7f-44c0-92b1-d03f9fa98d8b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:40.436390 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4a603331-8e7f-44c0-92b1-d03f9fa98d8b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac" status: 200 len: 1511 microversion: 2.1 time: 1.356057 Sep 08 12:43:40.442284 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 660/1321] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:39 2022] GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac => generated 1511 bytes in 1364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:40.459474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0f91765b-b66e-4490-843a-efb58d23f6c7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:40.474841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0f91765b-b66e-4490-843a-efb58d23f6c7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:40.511292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f91765b-b66e-4490-843a-efb58d23f6c7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:40.512242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f91765b-b66e-4490-843a-efb58d23f6c7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:40.513089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f91765b-b66e-4490-843a-efb58d23f6c7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:40.514464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f91765b-b66e-4490-843a-efb58d23f6c7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:40.520637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f91765b-b66e-4490-843a-efb58d23f6c7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:40.529356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-57ac783e-0357-4370-831d-b2dcb9c59b83 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:40.537361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f91765b-b66e-4490-843a-efb58d23f6c7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:40.561127 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-57ac783e-0357-4370-831d-b2dcb9c59b83 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db" status: 200 len: 1487 microversion: 2.1 time: 1.220881 Sep 08 12:43:40.576722 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 662/1322] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:39 2022] GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db => generated 1487 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:40.631983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b14859e-3a3a-4687-ac7c-059203f6ae27 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:40.650932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7b14859e-3a3a-4687-ac7c-059203f6ae27 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:40.682162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b14859e-3a3a-4687-ac7c-059203f6ae27 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:40.688691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b14859e-3a3a-4687-ac7c-059203f6ae27 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:40.689918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b14859e-3a3a-4687-ac7c-059203f6ae27 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:40.691589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b14859e-3a3a-4687-ac7c-059203f6ae27 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:40.692771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b14859e-3a3a-4687-ac7c-059203f6ae27 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:40.700467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b14859e-3a3a-4687-ac7c-059203f6ae27 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:40.760363 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0f91765b-b66e-4490-843a-efb58d23f6c7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.306930 Sep 08 12:43:40.776437 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 661/1323] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:43:40 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments => generated 197 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:40.786558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8c49ab29-fe31-49f4-9464-6001ebc1ecde tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:40.800749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8c49ab29-fe31-49f4-9464-6001ebc1ecde tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:40.815149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c49ab29-fe31-49f4-9464-6001ebc1ecde tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:40.823041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c49ab29-fe31-49f4-9464-6001ebc1ecde tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:40.824500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c49ab29-fe31-49f4-9464-6001ebc1ecde tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:40.826279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c49ab29-fe31-49f4-9464-6001ebc1ecde tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:40.832387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c49ab29-fe31-49f4-9464-6001ebc1ecde tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:40.833874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c49ab29-fe31-49f4-9464-6001ebc1ecde tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:41.229428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8c49ab29-fe31-49f4-9464-6001ebc1ecde tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:41.261164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8c49ab29-fe31-49f4-9464-6001ebc1ecde tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:41.268099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8c49ab29-fe31-49f4-9464-6001ebc1ecde tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:41.275352 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8c49ab29-fe31-49f4-9464-6001ebc1ecde tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.496596 Sep 08 12:43:41.294349 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 662/1324] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:40 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:41.306512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:41.312630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:41.313765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:43:41.328382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:41.329224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:41.329853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:41.330865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:41.331558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:41.332193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:41.476399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:43:41.576654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:41.585553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:41.586404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:41.587100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:41.596877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b14859e-3a3a-4687-ac7c-059203f6ae27 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:41.610663 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7b14859e-3a3a-4687-ac7c-059203f6ae27 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1477 microversion: 2.1 time: 1.017527 Sep 08 12:43:41.611327 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 663/1325] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:40 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1477 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:41.622743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4daf3a4-664d-4740-8e9f-0f5e01d43be5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:41.635705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a4daf3a4-664d-4740-8e9f-0f5e01d43be5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:41.645100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4daf3a4-664d-4740-8e9f-0f5e01d43be5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:41.648371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4daf3a4-664d-4740-8e9f-0f5e01d43be5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:41.649236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4daf3a4-664d-4740-8e9f-0f5e01d43be5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:41.654596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4daf3a4-664d-4740-8e9f-0f5e01d43be5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:41.655436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4daf3a4-664d-4740-8e9f-0f5e01d43be5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:41.656089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4daf3a4-664d-4740-8e9f-0f5e01d43be5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:41.838739 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-08f6d63e-6c9e-4056-b640-00ccd4b7a573 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.542678 Sep 08 12:43:41.839840 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 663/1326] 10.222.0.78 () {58 vars in 1167 bytes} [Thu Sep 8 12:43:41 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:41.845767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f96f84cf-3f6a-4a44-ac9d-517b7d8349de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:41.857346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f96f84cf-3f6a-4a44-ac9d-517b7d8349de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:41.889643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f96f84cf-3f6a-4a44-ac9d-517b7d8349de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:41.895687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f96f84cf-3f6a-4a44-ac9d-517b7d8349de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:41.901068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f96f84cf-3f6a-4a44-ac9d-517b7d8349de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:41.901915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f96f84cf-3f6a-4a44-ac9d-517b7d8349de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:41.906112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f96f84cf-3f6a-4a44-ac9d-517b7d8349de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:41.906476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f96f84cf-3f6a-4a44-ac9d-517b7d8349de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:41.908639 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a4daf3a4-664d-4740-8e9f-0f5e01d43be5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "POST /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db/action" status: 202 len: 0 microversion: 2.1 time: 0.295997 Sep 08 12:43:41.916567 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 664/1327] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:43:41 2022] POST /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:43:41.938652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:41.963833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:41.971612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-103820426', 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:43:41.988479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:41.996840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:41.998233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:42.000945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:42.006766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:42.008019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:42.029712 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f96f84cf-3f6a-4a44-ac9d-517b7d8349de tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188548 Sep 08 12:43:42.041237 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 664/1328] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:43:41 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:42.059963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-74586950-15c0-4018-ba6e-262c0b50a51c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:42.064142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-74586950-15c0-4018-ba6e-262c0b50a51c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:42.085311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74586950-15c0-4018-ba6e-262c0b50a51c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:42.092161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74586950-15c0-4018-ba6e-262c0b50a51c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:42.092817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74586950-15c0-4018-ba6e-262c0b50a51c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:42.094627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74586950-15c0-4018-ba6e-262c0b50a51c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:42.097078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74586950-15c0-4018-ba6e-262c0b50a51c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:42.097791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74586950-15c0-4018-ba6e-262c0b50a51c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:42.685899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:43:43.097743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:43.123012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:43.123220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:43.123710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:43.524706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-74586950-15c0-4018-ba6e-262c0b50a51c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:43.553880 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-74586950-15c0-4018-ba6e-262c0b50a51c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db" status: 200 len: 1492 microversion: 2.1 time: 1.510979 Sep 08 12:43:43.554743 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 665/1329] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:42 2022] GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db => generated 1492 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:43.581484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ed554ed-edb8-4b8c-bdd2-5933f0a04d3e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:43.584983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ed554ed-edb8-4b8c-bdd2-5933f0a04d3e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:43.615993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed554ed-edb8-4b8c-bdd2-5933f0a04d3e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:43.616908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed554ed-edb8-4b8c-bdd2-5933f0a04d3e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:43.618056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed554ed-edb8-4b8c-bdd2-5933f0a04d3e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:43.619466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed554ed-edb8-4b8c-bdd2-5933f0a04d3e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:43.621385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed554ed-edb8-4b8c-bdd2-5933f0a04d3e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:43.622954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed554ed-edb8-4b8c-bdd2-5933f0a04d3e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:44.730227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ed554ed-edb8-4b8c-bdd2-5933f0a04d3e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:44.759406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ed554ed-edb8-4b8c-bdd2-5933f0a04d3e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:44.760960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ed554ed-edb8-4b8c-bdd2-5933f0a04d3e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:44.781662 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ed554ed-edb8-4b8c-bdd2-5933f0a04d3e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 1.225705 Sep 08 12:43:44.795288 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 666/1330] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:43 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:44.800945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-477b6c8b-730c-4411-baf9-e6ecff5bee08 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:44.801649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-477b6c8b-730c-4411-baf9-e6ecff5bee08 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:44.810159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-477b6c8b-730c-4411-baf9-e6ecff5bee08 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:44.810683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-477b6c8b-730c-4411-baf9-e6ecff5bee08 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:44.811285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-477b6c8b-730c-4411-baf9-e6ecff5bee08 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:44.820369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-477b6c8b-730c-4411-baf9-e6ecff5bee08 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:44.820881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-477b6c8b-730c-4411-baf9-e6ecff5bee08 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:44.821334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-477b6c8b-730c-4411-baf9-e6ecff5bee08 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:45.424579 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6ccb81b5-2e7d-4e3b-a6f3-024247b56c52 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-103820426" status: 200 len: 1513 microversion: 2.1 time: 3.505678 Sep 08 12:43:45.427006 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 665/1331] 10.222.0.78 () {58 vars in 1261 bytes} [Thu Sep 8 12:43:41 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-103820426 => generated 1513 bytes in 3510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:45.495303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f093efb-2c79-4ca1-9611-3b7738d58d7f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:45.501001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f093efb-2c79-4ca1-9611-3b7738d58d7f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:45.550466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f093efb-2c79-4ca1-9611-3b7738d58d7f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:45.559510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f093efb-2c79-4ca1-9611-3b7738d58d7f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:45.560815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f093efb-2c79-4ca1-9611-3b7738d58d7f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:45.561963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f093efb-2c79-4ca1-9611-3b7738d58d7f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:45.563325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f093efb-2c79-4ca1-9611-3b7738d58d7f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:45.566337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f093efb-2c79-4ca1-9611-3b7738d58d7f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:45.617992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-477b6c8b-730c-4411-baf9-e6ecff5bee08 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:45.633509 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-477b6c8b-730c-4411-baf9-e6ecff5bee08 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1477 microversion: 2.1 time: 0.849513 Sep 08 12:43:45.640561 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 667/1332] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:44 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1477 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:45.649231 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f093efb-2c79-4ca1-9611-3b7738d58d7f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.202507 Sep 08 12:43:45.657997 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 666/1333] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:43:45 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:45.670279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c117bb2d-d4ef-48cc-85c4-fc4363636910 req-444726cf-5443-43a4-9af7-57aa759b8c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba78845-4ce9-474d-ac71-a91626b110d1", "tag": "0305f968-e274-437c-8891-b5da427a44bc"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:45.677320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b2aa79ca-4da0-437b-a187-e8b5d0e7c4a4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:45.713027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b2aa79ca-4da0-437b-a187-e8b5d0e7c4a4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:45.714644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c117bb2d-d4ef-48cc-85c4-fc4363636910 req-444726cf-5443-43a4-9af7-57aa759b8c0d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:45.727414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c117bb2d-d4ef-48cc-85c4-fc4363636910 req-444726cf-5443-43a4-9af7-57aa759b8c0d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:45.728503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c117bb2d-d4ef-48cc-85c4-fc4363636910 req-444726cf-5443-43a4-9af7-57aa759b8c0d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:45.764054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:45.770282 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c117bb2d-d4ef-48cc-85c4-fc4363636910 req-444726cf-5443-43a4-9af7-57aa759b8c0d service nova] Creating event network-changed:0305f968-e274-437c-8891-b5da427a44bc for instance 2ba78845-4ce9-474d-ac71-a91626b110d1 on n-h1-852084-10 Sep 08 12:43:45.776331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2aa79ca-4da0-437b-a187-e8b5d0e7c4a4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:45.779242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2aa79ca-4da0-437b-a187-e8b5d0e7c4a4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:45.784748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2aa79ca-4da0-437b-a187-e8b5d0e7c4a4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:45.789080 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c117bb2d-d4ef-48cc-85c4-fc4363636910 req-444726cf-5443-43a4-9af7-57aa759b8c0d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128990 Sep 08 12:43:45.798470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2aa79ca-4da0-437b-a187-e8b5d0e7c4a4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:45.805468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2aa79ca-4da0-437b-a187-e8b5d0e7c4a4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:45.806146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2aa79ca-4da0-437b-a187-e8b5d0e7c4a4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:45.806566 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 667/1334] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:45.818722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:45.843526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:45.845074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:43:45.857606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:45.868410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:45.874308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:45.875665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:45.876479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:45.877310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:46.459098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:43:46.665423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:46.696049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:46.708503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:46.709831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:47.326895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b2aa79ca-4da0-437b-a187-e8b5d0e7c4a4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:47.376558 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b2aa79ca-4da0-437b-a187-e8b5d0e7c4a4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db" status: 200 len: 1472 microversion: 2.1 time: 1.727741 Sep 08 12:43:47.379041 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 668/1335] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:45 2022] GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db => generated 1472 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:47.409463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d623213b-b132-40f4-b5a9-fffc4940a0cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:47.416202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d623213b-b132-40f4-b5a9-fffc4940a0cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:47.490544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d623213b-b132-40f4-b5a9-fffc4940a0cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:47.493450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d623213b-b132-40f4-b5a9-fffc4940a0cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:47.500371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d623213b-b132-40f4-b5a9-fffc4940a0cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:47.504659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d623213b-b132-40f4-b5a9-fffc4940a0cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:47.514588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d623213b-b132-40f4-b5a9-fffc4940a0cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:47.522100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d623213b-b132-40f4-b5a9-fffc4940a0cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:48.357011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d623213b-b132-40f4-b5a9-fffc4940a0cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:48.437687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d623213b-b132-40f4-b5a9-fffc4940a0cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:48.444792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d623213b-b132-40f4-b5a9-fffc4940a0cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:48.476534 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d623213b-b132-40f4-b5a9-fffc4940a0cb tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 1.091702 Sep 08 12:43:48.479630 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 669/1336] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:47 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:48.486866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dadfdc14-056a-4c2b-9f70-e248fcf090a4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:48.493260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dadfdc14-056a-4c2b-9f70-e248fcf090a4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:48.510587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dadfdc14-056a-4c2b-9f70-e248fcf090a4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:48.511457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dadfdc14-056a-4c2b-9f70-e248fcf090a4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:48.520076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dadfdc14-056a-4c2b-9f70-e248fcf090a4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:48.521695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dadfdc14-056a-4c2b-9f70-e248fcf090a4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:48.522666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dadfdc14-056a-4c2b-9f70-e248fcf090a4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:48.523319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dadfdc14-056a-4c2b-9f70-e248fcf090a4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:48.640946 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dadfdc14-056a-4c2b-9f70-e248fcf090a4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.159837 Sep 08 12:43:48.651456 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 670/1337] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:43:48 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:48.671369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44a5447f-f98d-4009-b1de-267d38f9230d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:48.672542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-44a5447f-f98d-4009-b1de-267d38f9230d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:48.681419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44a5447f-f98d-4009-b1de-267d38f9230d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:48.686274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44a5447f-f98d-4009-b1de-267d38f9230d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:48.687253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44a5447f-f98d-4009-b1de-267d38f9230d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:48.689994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44a5447f-f98d-4009-b1de-267d38f9230d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:48.690939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44a5447f-f98d-4009-b1de-267d38f9230d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:48.695439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44a5447f-f98d-4009-b1de-267d38f9230d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:49.067849 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7a0195b9-320e-40f2-85ed-7fa818abb387 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4514 microversion: 2.1 time: 3.258479 Sep 08 12:43:49.116683 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 668/1338] 10.222.0.78 () {58 vars in 1173 bytes} [Thu Sep 8 12:43:45 2022] GET /compute/v2.1/servers/detail?status=active => generated 4514 bytes in 3309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:49.160481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e7ab4506-fea5-4714-92d1-c944f11ed552 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1315732536"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:49.182927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e7ab4506-fea5-4714-92d1-c944f11ed552 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:49.258243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7ab4506-fea5-4714-92d1-c944f11ed552 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:49.259721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7ab4506-fea5-4714-92d1-c944f11ed552 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:49.265534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7ab4506-fea5-4714-92d1-c944f11ed552 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:49.275178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7ab4506-fea5-4714-92d1-c944f11ed552 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:49.279009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7ab4506-fea5-4714-92d1-c944f11ed552 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:49.280400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7ab4506-fea5-4714-92d1-c944f11ed552 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:49.526052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-44a5447f-f98d-4009-b1de-267d38f9230d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:49.541843 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-44a5447f-f98d-4009-b1de-267d38f9230d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1477 microversion: 2.1 time: 0.888755 Sep 08 12:43:49.554942 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 671/1339] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:48 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1477 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:49.587659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:49.612870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:49.620011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.compute.servers [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Removing options 'limit' from query {{(pid=128971) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 12:43:49.621476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:43:49.640503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:49.660605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:49.668122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:49.670133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:49.680573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:49.693517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:49.876007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:49.933126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:49.939495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:49.943268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:51.193243 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a8bcb1ff-5171-4aca-b8a3-f01b42f2936d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 1.633035 Sep 08 12:43:51.206609 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 672/1340] 10.222.0.78 () {58 vars in 1161 bytes} [Thu Sep 8 12:43:49 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 1647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:51.230125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b2e3f32-7a6e-4183-8db9-ae57abb6ca32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:51.230949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6b2e3f32-7a6e-4183-8db9-ae57abb6ca32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:51.244794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b2e3f32-7a6e-4183-8db9-ae57abb6ca32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:51.245589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b2e3f32-7a6e-4183-8db9-ae57abb6ca32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:51.245996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b2e3f32-7a6e-4183-8db9-ae57abb6ca32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:51.247507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b2e3f32-7a6e-4183-8db9-ae57abb6ca32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:51.248106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b2e3f32-7a6e-4183-8db9-ae57abb6ca32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:51.248724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b2e3f32-7a6e-4183-8db9-ae57abb6ca32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:51.509640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6b2e3f32-7a6e-4183-8db9-ae57abb6ca32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:51.526105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6b2e3f32-7a6e-4183-8db9-ae57abb6ca32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:51.527838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6b2e3f32-7a6e-4183-8db9-ae57abb6ca32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:51.549247 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6b2e3f32-7a6e-4183-8db9-ae57abb6ca32 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.331322 Sep 08 12:43:51.558266 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 673/1341] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:51 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:51.565190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-25c9e2ba-4fd4-4782-879c-bb3812dfddf3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:51.582848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-25c9e2ba-4fd4-4782-879c-bb3812dfddf3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:51.600194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c9e2ba-4fd4-4782-879c-bb3812dfddf3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:51.611646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c9e2ba-4fd4-4782-879c-bb3812dfddf3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:51.613864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c9e2ba-4fd4-4782-879c-bb3812dfddf3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:51.615922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c9e2ba-4fd4-4782-879c-bb3812dfddf3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:51.616747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c9e2ba-4fd4-4782-879c-bb3812dfddf3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:51.618931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c9e2ba-4fd4-4782-879c-bb3812dfddf3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:51.801031 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-25c9e2ba-4fd4-4782-879c-bb3812dfddf3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.240923 Sep 08 12:43:51.813869 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 674/1342] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:43:51 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments => generated 197 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:51.836712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b5f4aadd-a72c-4fd2-9d9c-ec7df928e737 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:51.842783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b5f4aadd-a72c-4fd2-9d9c-ec7df928e737 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:51.855014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5f4aadd-a72c-4fd2-9d9c-ec7df928e737 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:51.865544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5f4aadd-a72c-4fd2-9d9c-ec7df928e737 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:51.866300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5f4aadd-a72c-4fd2-9d9c-ec7df928e737 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:51.867476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5f4aadd-a72c-4fd2-9d9c-ec7df928e737 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:51.868187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5f4aadd-a72c-4fd2-9d9c-ec7df928e737 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:51.868855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5f4aadd-a72c-4fd2-9d9c-ec7df928e737 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:52.870158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b5f4aadd-a72c-4fd2-9d9c-ec7df928e737 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:52.893695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:52.903162 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b5f4aadd-a72c-4fd2-9d9c-ec7df928e737 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1476 microversion: 2.1 time: 1.079792 Sep 08 12:43:52.924215 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 675/1343] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:51 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1476 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:52.950405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a9e90c8a-4c6d-499f-841d-e7fabbb2b09d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:52.960963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a9e90c8a-4c6d-499f-841d-e7fabbb2b09d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:52.965501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a9e90c8a-4c6d-499f-841d-e7fabbb2b09d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:43:52.983183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9e90c8a-4c6d-499f-841d-e7fabbb2b09d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:52.984091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9e90c8a-4c6d-499f-841d-e7fabbb2b09d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:52.986539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9e90c8a-4c6d-499f-841d-e7fabbb2b09d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:52.989669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9e90c8a-4c6d-499f-841d-e7fabbb2b09d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:52.993453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9e90c8a-4c6d-499f-841d-e7fabbb2b09d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:52.994323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9e90c8a-4c6d-499f-841d-e7fabbb2b09d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:53.305772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-a9e90c8a-4c6d-499f-841d-e7fabbb2b09d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:43:53.655087 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a9e90c8a-4c6d-499f-841d-e7fabbb2b09d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?status=active" status: 200 len: 1011 microversion: 2.1 time: 0.728766 Sep 08 12:43:53.667336 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 676/1344] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:43:52 2022] GET /compute/v2.1/servers?status=active => generated 1011 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:53.680303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0c1f384b-e555-4eec-b8ca-15f1550a3c75 req-d97c65f0-e8d2-43a9-ab10-cd2abe7026ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0860ae28-9636-40dd-a79d-bbf608e0a922", "name": "network-vif-unplugged", "status": "completed", "tag": "7d11df58-0218-4b52-87b7-4c5dc9927ca6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:53.706509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0c1f384b-e555-4eec-b8ca-15f1550a3c75 req-d97c65f0-e8d2-43a9-ab10-cd2abe7026ed service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:53.715540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0c1f384b-e555-4eec-b8ca-15f1550a3c75 req-d97c65f0-e8d2-43a9-ab10-cd2abe7026ed service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:53.716605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0c1f384b-e555-4eec-b8ca-15f1550a3c75 req-d97c65f0-e8d2-43a9-ab10-cd2abe7026ed service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:53.774637 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0c1f384b-e555-4eec-b8ca-15f1550a3c75 req-d97c65f0-e8d2-43a9-ab10-cd2abe7026ed service nova] Creating event network-vif-unplugged:7d11df58-0218-4b52-87b7-4c5dc9927ca6 for instance 0860ae28-9636-40dd-a79d-bbf608e0a922 on n-h2-852084-10 Sep 08 12:43:53.798967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-0c1f384b-e555-4eec-b8ca-15f1550a3c75 req-d97c65f0-e8d2-43a9-ab10-cd2abe7026ed service nova] Instance 0860ae28-9636-40dd-a79d-bbf608e0a922 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:43:53.891866 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0c1f384b-e555-4eec-b8ca-15f1550a3c75 req-d97c65f0-e8d2-43a9-ab10-cd2abe7026ed service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.214271 Sep 08 12:43:53.892970 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 677/1345] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:53.913584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4bbf2755-6ece-448b-a5b8-5e1fb1886c4d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:53.919593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4bbf2755-6ece-448b-a5b8-5e1fb1886c4d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:53.953468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bbf2755-6ece-448b-a5b8-5e1fb1886c4d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:53.964391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bbf2755-6ece-448b-a5b8-5e1fb1886c4d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:53.965355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bbf2755-6ece-448b-a5b8-5e1fb1886c4d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:53.966506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bbf2755-6ece-448b-a5b8-5e1fb1886c4d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:53.967262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bbf2755-6ece-448b-a5b8-5e1fb1886c4d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:53.970995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bbf2755-6ece-448b-a5b8-5e1fb1886c4d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:54.630275 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e7ab4506-fea5-4714-92d1-c944f11ed552 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "POST /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db/action" status: 202 len: 0 microversion: 2.1 time: 5.506162 Sep 08 12:43:54.639678 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 669/1346] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:43:49 2022] POST /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db/action => generated 0 bytes in 5521 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 12:43:54.686985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6b4c0ade-cebf-436a-b10a-309b7b3cc3b6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:54.703819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6b4c0ade-cebf-436a-b10a-309b7b3cc3b6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:54.743494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b4c0ade-cebf-436a-b10a-309b7b3cc3b6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:54.751747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b4c0ade-cebf-436a-b10a-309b7b3cc3b6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:54.753082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b4c0ade-cebf-436a-b10a-309b7b3cc3b6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:54.754843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b4c0ade-cebf-436a-b10a-309b7b3cc3b6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:54.756750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b4c0ade-cebf-436a-b10a-309b7b3cc3b6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:54.761072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b4c0ade-cebf-436a-b10a-309b7b3cc3b6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:54.864380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4bbf2755-6ece-448b-a5b8-5e1fb1886c4d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:54.900315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4bbf2755-6ece-448b-a5b8-5e1fb1886c4d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:54.912912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4bbf2755-6ece-448b-a5b8-5e1fb1886c4d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:54.974111 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6b4c0ade-cebf-436a-b10a-309b7b3cc3b6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.326104 Sep 08 12:43:54.979340 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4bbf2755-6ece-448b-a5b8-5e1fb1886c4d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 1.073121 Sep 08 12:43:54.991571 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 678/1347] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:53 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:54.996545 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 670/1348] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:43:54 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments => generated 197 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:55.032561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a0f31765-3178-49cc-937a-114c441cb6af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:55.047094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-55527e6b-80ac-4a75-8229-5bbea750790e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:55.052544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-55527e6b-80ac-4a75-8229-5bbea750790e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:55.074234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a0f31765-3178-49cc-937a-114c441cb6af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:55.087127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.compute.servers [None req-a0f31765-3178-49cc-937a-114c441cb6af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Removing options 'limit' from query {{(pid=128971) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 12:43:55.100458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a0f31765-3178-49cc-937a-114c441cb6af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:43:55.104662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55527e6b-80ac-4a75-8229-5bbea750790e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:55.116106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55527e6b-80ac-4a75-8229-5bbea750790e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:55.121155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55527e6b-80ac-4a75-8229-5bbea750790e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:55.125188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55527e6b-80ac-4a75-8229-5bbea750790e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:55.132060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55527e6b-80ac-4a75-8229-5bbea750790e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:55.132905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0f31765-3178-49cc-937a-114c441cb6af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:55.134948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0f31765-3178-49cc-937a-114c441cb6af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:55.136243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55527e6b-80ac-4a75-8229-5bbea750790e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:55.138432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0f31765-3178-49cc-937a-114c441cb6af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:55.143988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0f31765-3178-49cc-937a-114c441cb6af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:55.148621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0f31765-3178-49cc-937a-114c441cb6af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:55.151420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0f31765-3178-49cc-937a-114c441cb6af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:55.314891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-a0f31765-3178-49cc-937a-114c441cb6af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:43:55.427340 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a0f31765-3178-49cc-937a-114c441cb6af tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1011 microversion: 2.1 time: 0.433365 Sep 08 12:43:55.455376 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 679/1349] 10.222.0.78 () {58 vars in 1150 bytes} [Thu Sep 8 12:43:54 2022] GET /compute/v2.1/servers?limit=100000 => generated 1011 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:55.461406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-86d7ff68-889d-490e-9949-61c15f5416f4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3afa3820>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:55.655947 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-86d7ff68-889d-490e-9949-61c15f5416f4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d" status: 200 len: 1412 microversion: 2.1 time: 0.180109 Sep 08 12:43:55.721261 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 680/1350] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:43:55 2022] GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d => generated 1412 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:55.763476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-90c9cbd4-62cb-4e49-9826-85d16e3dd3db tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:55.845119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-90c9cbd4-62cb-4e49-9826-85d16e3dd3db tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:55.853038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-90c9cbd4-62cb-4e49-9826-85d16e3dd3db tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:43:55.944955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90c9cbd4-62cb-4e49-9826-85d16e3dd3db tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:55.952717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90c9cbd4-62cb-4e49-9826-85d16e3dd3db tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:55.958333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90c9cbd4-62cb-4e49-9826-85d16e3dd3db tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:55.977264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90c9cbd4-62cb-4e49-9826-85d16e3dd3db tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:55.978554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90c9cbd4-62cb-4e49-9826-85d16e3dd3db tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:55.982638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90c9cbd4-62cb-4e49-9826-85d16e3dd3db tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:56.150890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-90c9cbd4-62cb-4e49-9826-85d16e3dd3db tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:43:56.151211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:56.407907 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-90c9cbd4-62cb-4e49-9826-85d16e3dd3db tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1011 microversion: 2.1 time: 0.683123 Sep 08 12:43:56.417700 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 681/1351] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 12:43:55 2022] GET /compute/v2.1/servers => generated 1011 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:56.652668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:56.968106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d802b0be-6982-4e86-8e4b-331b4ea56c72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:56.972227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d802b0be-6982-4e86-8e4b-331b4ea56c72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:56.996703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d802b0be-6982-4e86-8e4b-331b4ea56c72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:57.007997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d802b0be-6982-4e86-8e4b-331b4ea56c72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:57.008992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d802b0be-6982-4e86-8e4b-331b4ea56c72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:57.010030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d802b0be-6982-4e86-8e4b-331b4ea56c72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:57.014557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d802b0be-6982-4e86-8e4b-331b4ea56c72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:57.016878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d802b0be-6982-4e86-8e4b-331b4ea56c72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:57.156252 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d802b0be-6982-4e86-8e4b-331b4ea56c72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.737015 Sep 08 12:43:57.163939 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 682/1352] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:43:56 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments => generated 197 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:57.181519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f14b1939-0574-42b0-bdd7-b32dce67cc04 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:57.182236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f14b1939-0574-42b0-bdd7-b32dce67cc04 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:57.201534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f14b1939-0574-42b0-bdd7-b32dce67cc04 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:57.202115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f14b1939-0574-42b0-bdd7-b32dce67cc04 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:57.202633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f14b1939-0574-42b0-bdd7-b32dce67cc04 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:57.203505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f14b1939-0574-42b0-bdd7-b32dce67cc04 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:57.204092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f14b1939-0574-42b0-bdd7-b32dce67cc04 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:57.205550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f14b1939-0574-42b0-bdd7-b32dce67cc04 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:57.590736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f14b1939-0574-42b0-bdd7-b32dce67cc04 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:57.657168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f14b1939-0574-42b0-bdd7-b32dce67cc04 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:57.675068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f14b1939-0574-42b0-bdd7-b32dce67cc04 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:57.695861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=99 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:57.781317 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f14b1939-0574-42b0-bdd7-b32dce67cc04 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.574665 Sep 08 12:43:57.802417 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 683/1353] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:57 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:43:57.839390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-498c73e9-d1aa-4ca9-affc-a6c078ab965b req-4845f77f-9005-4be2-82f3-8b3bb1bc4b54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0860ae28-9636-40dd-a79d-bbf608e0a922", "tag": "7d11df58-0218-4b52-87b7-4c5dc9927ca6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:57.859553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-498c73e9-d1aa-4ca9-affc-a6c078ab965b req-4845f77f-9005-4be2-82f3-8b3bb1bc4b54 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:57.860447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-498c73e9-d1aa-4ca9-affc-a6c078ab965b req-4845f77f-9005-4be2-82f3-8b3bb1bc4b54 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:57.876585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-498c73e9-d1aa-4ca9-affc-a6c078ab965b req-4845f77f-9005-4be2-82f3-8b3bb1bc4b54 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:57.952866 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-498c73e9-d1aa-4ca9-affc-a6c078ab965b req-4845f77f-9005-4be2-82f3-8b3bb1bc4b54 service nova] Creating event network-changed:7d11df58-0218-4b52-87b7-4c5dc9927ca6 for instance 0860ae28-9636-40dd-a79d-bbf608e0a922 on n-h2-852084-10 Sep 08 12:43:57.983804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-498c73e9-d1aa-4ca9-affc-a6c078ab965b req-4845f77f-9005-4be2-82f3-8b3bb1bc4b54 service nova] Instance 0860ae28-9636-40dd-a79d-bbf608e0a922 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:43:58.055070 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-498c73e9-d1aa-4ca9-affc-a6c078ab965b req-4845f77f-9005-4be2-82f3-8b3bb1bc4b54 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250292 Sep 08 12:43:58.065259 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 684/1354] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:58.091510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c51b37f7-812d-489a-b28b-c8ab9debe45d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:58.149647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c51b37f7-812d-489a-b28b-c8ab9debe45d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:58.161677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c51b37f7-812d-489a-b28b-c8ab9debe45d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:43:58.193371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-55527e6b-80ac-4a75-8229-5bbea750790e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:58.224242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c51b37f7-812d-489a-b28b-c8ab9debe45d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:58.225591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c51b37f7-812d-489a-b28b-c8ab9debe45d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:58.226731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c51b37f7-812d-489a-b28b-c8ab9debe45d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:58.228661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c51b37f7-812d-489a-b28b-c8ab9debe45d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:58.230450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c51b37f7-812d-489a-b28b-c8ab9debe45d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:58.231594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c51b37f7-812d-489a-b28b-c8ab9debe45d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:58.281873 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-55527e6b-80ac-4a75-8229-5bbea750790e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1476 microversion: 2.1 time: 3.280955 Sep 08 12:43:58.301395 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 671/1355] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:54 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1476 bytes in 3304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:58.313948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ef6f65a9-39e4-432e-bf9e-49dd9d99557a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb375f7f70>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:58.418842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-c51b37f7-812d-489a-b28b-c8ab9debe45d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:43:58.427035 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ef6f65a9-39e4-432e-bf9e-49dd9d99557a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d" status: 200 len: 1412 microversion: 2.1 time: 0.122750 Sep 08 12:43:58.437768 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 672/1356] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:43:58 2022] GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d => generated 1412 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:58.452886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da3b7748-e4ce-494c-98f7-e4f1059c3da6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:58.455780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-da3b7748-e4ce-494c-98f7-e4f1059c3da6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:58.475163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da3b7748-e4ce-494c-98f7-e4f1059c3da6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:58.477598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da3b7748-e4ce-494c-98f7-e4f1059c3da6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:58.481427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da3b7748-e4ce-494c-98f7-e4f1059c3da6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:58.482707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da3b7748-e4ce-494c-98f7-e4f1059c3da6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:58.483842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da3b7748-e4ce-494c-98f7-e4f1059c3da6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:58.486131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da3b7748-e4ce-494c-98f7-e4f1059c3da6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:58.576964 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-da3b7748-e4ce-494c-98f7-e4f1059c3da6 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.137357 Sep 08 12:43:58.578591 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 673/1357] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:43:58 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:58.588202 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c51b37f7-812d-489a-b28b-c8ab9debe45d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.517486 Sep 08 12:43:58.617393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1effd8d9-d20a-4569-ba25-6284bec11a6b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:58.623425 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 685/1358] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:43:58 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:58.631310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1effd8d9-d20a-4569-ba25-6284bec11a6b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:58.633063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.compute.servers [None req-1effd8d9-d20a-4569-ba25-6284bec11a6b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Removing options 'limit' from query {{(pid=128970) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 12:43:58.636941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1effd8d9-d20a-4569-ba25-6284bec11a6b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:43:58.655922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1effd8d9-d20a-4569-ba25-6284bec11a6b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:58.659680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1effd8d9-d20a-4569-ba25-6284bec11a6b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:58.660763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1effd8d9-d20a-4569-ba25-6284bec11a6b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:58.663901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1effd8d9-d20a-4569-ba25-6284bec11a6b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:58.666140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1effd8d9-d20a-4569-ba25-6284bec11a6b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:58.666900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1effd8d9-d20a-4569-ba25-6284bec11a6b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:58.763180 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1effd8d9-d20a-4569-ba25-6284bec11a6b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.155088 Sep 08 12:43:58.766926 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 674/1359] 10.222.0.78 () {58 vars in 1140 bytes} [Thu Sep 8 12:43:58 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:43:58.796820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b76ff284-5b1e-4a45-b101-5fa4042012b4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:58.820259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b76ff284-5b1e-4a45-b101-5fa4042012b4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:58.823166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b76ff284-5b1e-4a45-b101-5fa4042012b4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-103820426', 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:43:58.843957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3143ad8d-5c0d-4f66-b5eb-1d18fdd8c07e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:58.845163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3143ad8d-5c0d-4f66-b5eb-1d18fdd8c07e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:58.855989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b76ff284-5b1e-4a45-b101-5fa4042012b4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:58.857179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b76ff284-5b1e-4a45-b101-5fa4042012b4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:58.858142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b76ff284-5b1e-4a45-b101-5fa4042012b4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:58.862506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b76ff284-5b1e-4a45-b101-5fa4042012b4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:58.867669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3143ad8d-5c0d-4f66-b5eb-1d18fdd8c07e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:58.869333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b76ff284-5b1e-4a45-b101-5fa4042012b4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:58.870122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b76ff284-5b1e-4a45-b101-5fa4042012b4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:58.871019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3143ad8d-5c0d-4f66-b5eb-1d18fdd8c07e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:58.876724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3143ad8d-5c0d-4f66-b5eb-1d18fdd8c07e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:58.884391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3143ad8d-5c0d-4f66-b5eb-1d18fdd8c07e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:58.885263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3143ad8d-5c0d-4f66-b5eb-1d18fdd8c07e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:58.891246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3143ad8d-5c0d-4f66-b5eb-1d18fdd8c07e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:59.214613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-b76ff284-5b1e-4a45-b101-5fa4042012b4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:43:59.241632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3143ad8d-5c0d-4f66-b5eb-1d18fdd8c07e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:59.282201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3143ad8d-5c0d-4f66-b5eb-1d18fdd8c07e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:59.293474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3143ad8d-5c0d-4f66-b5eb-1d18fdd8c07e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:43:59.315285 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3143ad8d-5c0d-4f66-b5eb-1d18fdd8c07e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.475127 Sep 08 12:43:59.320486 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 675/1360] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:43:58 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:43:59.341095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ba899203-06ec-49e0-886e-c3df0a3f9df2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:59.344347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ba899203-06ec-49e0-886e-c3df0a3f9df2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:59.390615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba899203-06ec-49e0-886e-c3df0a3f9df2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:59.393784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba899203-06ec-49e0-886e-c3df0a3f9df2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:59.398604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba899203-06ec-49e0-886e-c3df0a3f9df2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:59.404448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba899203-06ec-49e0-886e-c3df0a3f9df2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:59.421309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba899203-06ec-49e0-886e-c3df0a3f9df2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:59.425932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba899203-06ec-49e0-886e-c3df0a3f9df2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:59.567937 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b76ff284-5b1e-4a45-b101-5fa4042012b4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-103820426" status: 200 len: 345 microversion: 2.1 time: 0.775782 Sep 08 12:43:59.600394 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 686/1361] 10.222.0.78 () {58 vars in 1240 bytes} [Thu Sep 8 12:43:58 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-103820426 => generated 345 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:43:59.637838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-66f30fed-bee2-46bb-aa5e-c29ad39b2ed3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3af99550>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:59.791568 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-66f30fed-bee2-46bb-aa5e-c29ad39b2ed3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d" status: 200 len: 1412 microversion: 2.1 time: 0.188569 Sep 08 12:43:59.792920 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 687/1362] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:43:59 2022] GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d => generated 1412 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:43:59.799729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-486851b4-c0d5-4ddb-a203-f2a0758f95d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:43:59.803361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-486851b4-c0d5-4ddb-a203-f2a0758f95d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:43:59.812972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-486851b4-c0d5-4ddb-a203-f2a0758f95d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:59.813849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-486851b4-c0d5-4ddb-a203-f2a0758f95d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:59.814565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-486851b4-c0d5-4ddb-a203-f2a0758f95d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:59.815523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-486851b4-c0d5-4ddb-a203-f2a0758f95d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:59.816217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-486851b4-c0d5-4ddb-a203-f2a0758f95d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:59.816882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-486851b4-c0d5-4ddb-a203-f2a0758f95d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:43:59.871652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:43:59.907972 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-486851b4-c0d5-4ddb-a203-f2a0758f95d2 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.113544 Sep 08 12:43:59.918383 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 688/1363] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:43:59 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:43:59.918383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d8cbb809-6aa3-4f34-b4de-26bb2c01631b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:43:59.936730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8cbb809-6aa3-4f34-b4de-26bb2c01631b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:43:59.939647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8cbb809-6aa3-4f34-b4de-26bb2c01631b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:43:59.939647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8cbb809-6aa3-4f34-b4de-26bb2c01631b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:00.228634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d8cbb809-6aa3-4f34-b4de-26bb2c01631b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Going to try to stop instance {{(pid=128971) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 12:44:00.444114 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d8cbb809-6aa3-4f34-b4de-26bb2c01631b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "POST /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3/action" status: 202 len: 0 microversion: 2.1 time: 0.528374 Sep 08 12:44:00.447655 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 689/1364] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:43:59 2022] POST /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:44:00.462474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-870f4e67-b209-4daf-bd74-c8815c6e6377 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:00.463206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-870f4e67-b209-4daf-bd74-c8815c6e6377 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:00.507659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-870f4e67-b209-4daf-bd74-c8815c6e6377 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:00.508737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-870f4e67-b209-4daf-bd74-c8815c6e6377 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:00.509892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-870f4e67-b209-4daf-bd74-c8815c6e6377 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:00.511942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-870f4e67-b209-4daf-bd74-c8815c6e6377 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:00.512436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-870f4e67-b209-4daf-bd74-c8815c6e6377 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:00.512895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-870f4e67-b209-4daf-bd74-c8815c6e6377 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:01.521185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-870f4e67-b209-4daf-bd74-c8815c6e6377 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:01.557327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-870f4e67-b209-4daf-bd74-c8815c6e6377 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:01.578571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-870f4e67-b209-4daf-bd74-c8815c6e6377 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:01.610214 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-870f4e67-b209-4daf-bd74-c8815c6e6377 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 1.157715 Sep 08 12:44:01.611007 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 690/1365] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:00 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:01.653763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-02c0204e-f75b-4c06-9c0e-ba0493db91d6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:01.665693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-02c0204e-f75b-4c06-9c0e-ba0493db91d6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:01.719065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02c0204e-f75b-4c06-9c0e-ba0493db91d6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:01.732214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02c0204e-f75b-4c06-9c0e-ba0493db91d6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:01.740010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02c0204e-f75b-4c06-9c0e-ba0493db91d6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:01.753833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02c0204e-f75b-4c06-9c0e-ba0493db91d6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:01.754585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02c0204e-f75b-4c06-9c0e-ba0493db91d6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:01.755049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02c0204e-f75b-4c06-9c0e-ba0493db91d6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:02.239424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ba899203-06ec-49e0-886e-c3df0a3f9df2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:02.274817 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ba899203-06ec-49e0-886e-c3df0a3f9df2 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1474 microversion: 2.1 time: 2.942377 Sep 08 12:44:02.279801 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 676/1366] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:43:59 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1474 bytes in 2952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:02.299772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-98e55708-5ab7-40dd-8492-33a8e579db10 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb375bc3a0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:02.527365 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-98e55708-5ab7-40dd-8492-33a8e579db10 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d" status: 200 len: 1412 microversion: 2.1 time: 0.242334 Sep 08 12:44:02.535927 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 677/1367] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:44:02 2022] GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d => generated 1412 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:02.545546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c88733c2-5bb4-4117-9a1a-2912fb929ebd req-49f13ae8-606c-4e1c-906d-9d819849c82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24093877-782e-42db-b41b-90a91e8a11db", "name": "network-vif-plugged", "status": "completed", "tag": "ef1e04ce-bdbe-4842-a056-a3b1bc3291a5"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:02.589545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c88733c2-5bb4-4117-9a1a-2912fb929ebd req-49f13ae8-606c-4e1c-906d-9d819849c82a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:02.592475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c88733c2-5bb4-4117-9a1a-2912fb929ebd req-49f13ae8-606c-4e1c-906d-9d819849c82a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:02.593253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c88733c2-5bb4-4117-9a1a-2912fb929ebd req-49f13ae8-606c-4e1c-906d-9d819849c82a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:02.625387 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c88733c2-5bb4-4117-9a1a-2912fb929ebd req-49f13ae8-606c-4e1c-906d-9d819849c82a service nova] Creating event network-vif-plugged:ef1e04ce-bdbe-4842-a056-a3b1bc3291a5 for instance 24093877-782e-42db-b41b-90a91e8a11db on n-h2-852084-10 Sep 08 12:44:02.638751 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c88733c2-5bb4-4117-9a1a-2912fb929ebd req-49f13ae8-606c-4e1c-906d-9d819849c82a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100974 Sep 08 12:44:02.644431 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 678/1368] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:02.674534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d304fe9c-f5e1-4fc8-9e83-6919a9adcaa1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:02.675590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d304fe9c-f5e1-4fc8-9e83-6919a9adcaa1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:02.710362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d304fe9c-f5e1-4fc8-9e83-6919a9adcaa1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:02.711137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d304fe9c-f5e1-4fc8-9e83-6919a9adcaa1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:02.713626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d304fe9c-f5e1-4fc8-9e83-6919a9adcaa1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:02.714669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d304fe9c-f5e1-4fc8-9e83-6919a9adcaa1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:02.721021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d304fe9c-f5e1-4fc8-9e83-6919a9adcaa1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:02.722728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d304fe9c-f5e1-4fc8-9e83-6919a9adcaa1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:02.730952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-02c0204e-f75b-4c06-9c0e-ba0493db91d6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:02.746805 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-02c0204e-f75b-4c06-9c0e-ba0493db91d6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1520 microversion: 2.1 time: 1.111881 Sep 08 12:44:02.761437 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 691/1369] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:01 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1520 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:03.131288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d304fe9c-f5e1-4fc8-9e83-6919a9adcaa1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:03.189104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d304fe9c-f5e1-4fc8-9e83-6919a9adcaa1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:03.204568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d304fe9c-f5e1-4fc8-9e83-6919a9adcaa1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:03.231723 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d304fe9c-f5e1-4fc8-9e83-6919a9adcaa1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.558079 Sep 08 12:44:03.250483 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 679/1370] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:02 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:03.349885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b329d7e1-bd1d-4bad-9d82-ed9c82df1a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:03.351138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b329d7e1-bd1d-4bad-9d82-ed9c82df1a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:03.375975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b329d7e1-bd1d-4bad-9d82-ed9c82df1a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:03.376578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b329d7e1-bd1d-4bad-9d82-ed9c82df1a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:03.377232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b329d7e1-bd1d-4bad-9d82-ed9c82df1a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:03.378110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b329d7e1-bd1d-4bad-9d82-ed9c82df1a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:03.378684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b329d7e1-bd1d-4bad-9d82-ed9c82df1a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:03.379172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b329d7e1-bd1d-4bad-9d82-ed9c82df1a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:03.436324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:03.551968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3354059b-079c-41c0-a62b-1e7c0c6bca7d tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb370065e0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:03.729173 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3354059b-079c-41c0-a62b-1e7c0c6bca7d tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d" status: 200 len: 1412 microversion: 2.1 time: 0.183863 Sep 08 12:44:03.733832 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 680/1371] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:44:03 2022] GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d => generated 1412 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:44:03.788788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae54d93e-9f14-4908-a0f6-f21725d911c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:03.796841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ae54d93e-9f14-4908-a0f6-f21725d911c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:03.901923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae54d93e-9f14-4908-a0f6-f21725d911c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:03.903996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae54d93e-9f14-4908-a0f6-f21725d911c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:03.906329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae54d93e-9f14-4908-a0f6-f21725d911c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:03.910615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae54d93e-9f14-4908-a0f6-f21725d911c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:03.920273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae54d93e-9f14-4908-a0f6-f21725d911c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:03.934591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae54d93e-9f14-4908-a0f6-f21725d911c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:03.960028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b329d7e1-bd1d-4bad-9d82-ed9c82df1a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:03.976501 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b329d7e1-bd1d-4bad-9d82-ed9c82df1a01 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1471 microversion: 2.1 time: 0.642967 Sep 08 12:44:03.983930 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 692/1372] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:03 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1471 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:04.030625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6bdabc62-02b9-47ce-826f-6ce7092b2c7e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:04.031529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6bdabc62-02b9-47ce-826f-6ce7092b2c7e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:04.055351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6bdabc62-02b9-47ce-826f-6ce7092b2c7e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:04.056240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6bdabc62-02b9-47ce-826f-6ce7092b2c7e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:04.056892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6bdabc62-02b9-47ce-826f-6ce7092b2c7e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:04.060457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6bdabc62-02b9-47ce-826f-6ce7092b2c7e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:04.063140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6bdabc62-02b9-47ce-826f-6ce7092b2c7e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:04.068262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6bdabc62-02b9-47ce-826f-6ce7092b2c7e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:04.447034 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6bdabc62-02b9-47ce-826f-6ce7092b2c7e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "POST /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922/action" status: 202 len: 0 microversion: 2.1 time: 0.431483 Sep 08 12:44:04.451631 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 693/1373] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:44:04 2022] POST /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:44:04.466883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9d32efdb-6640-4f05-b9c4-c812732f7627 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:04.468545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9d32efdb-6640-4f05-b9c4-c812732f7627 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:04.497239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d32efdb-6640-4f05-b9c4-c812732f7627 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:04.499151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d32efdb-6640-4f05-b9c4-c812732f7627 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:04.500021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d32efdb-6640-4f05-b9c4-c812732f7627 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:04.501968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d32efdb-6640-4f05-b9c4-c812732f7627 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:04.503671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d32efdb-6640-4f05-b9c4-c812732f7627 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:04.505871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d32efdb-6640-4f05-b9c4-c812732f7627 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:04.564798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ae54d93e-9f14-4908-a0f6-f21725d911c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:04.590641 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ae54d93e-9f14-4908-a0f6-f21725d911c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1520 microversion: 2.1 time: 0.811316 Sep 08 12:44:04.615037 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 681/1374] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:03 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1520 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:44:04.650629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f839af36-c0c5-4758-8679-593a17b0ca67 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:04.660932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f839af36-c0c5-4758-8679-593a17b0ca67 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:04.694955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f839af36-c0c5-4758-8679-593a17b0ca67 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:04.696586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f839af36-c0c5-4758-8679-593a17b0ca67 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:04.703119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f839af36-c0c5-4758-8679-593a17b0ca67 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:04.706717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f839af36-c0c5-4758-8679-593a17b0ca67 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:04.710553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f839af36-c0c5-4758-8679-593a17b0ca67 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:04.714345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f839af36-c0c5-4758-8679-593a17b0ca67 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:04.759393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9d32efdb-6640-4f05-b9c4-c812732f7627 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:04.778594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9d32efdb-6640-4f05-b9c4-c812732f7627 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:04.802466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9d32efdb-6640-4f05-b9c4-c812732f7627 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:04.819729 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9d32efdb-6640-4f05-b9c4-c812732f7627 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.365970 Sep 08 12:44:04.822124 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 694/1375] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:04 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:04.827921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a66101f4-7663-4652-b4c4-9ebc0a70d6c4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3ac03790>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:05.211945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f839af36-c0c5-4758-8679-593a17b0ca67 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:05.220731 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f839af36-c0c5-4758-8679-593a17b0ca67 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1470 microversion: 2.1 time: 0.604038 Sep 08 12:44:05.221572 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 682/1376] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:04 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1470 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:05.243727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-bf52e6f1-6e4f-4724-8557-8f5a1b93e27d req-ea1efca3-ecdd-45a2-998d-728674fdbd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0860ae28-9636-40dd-a79d-bbf608e0a922", "name": "network-vif-plugged", "status": "completed", "tag": "7d11df58-0218-4b52-87b7-4c5dc9927ca6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:05.260601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bf52e6f1-6e4f-4724-8557-8f5a1b93e27d req-ea1efca3-ecdd-45a2-998d-728674fdbd88 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:05.261497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bf52e6f1-6e4f-4724-8557-8f5a1b93e27d req-ea1efca3-ecdd-45a2-998d-728674fdbd88 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:05.262291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bf52e6f1-6e4f-4724-8557-8f5a1b93e27d req-ea1efca3-ecdd-45a2-998d-728674fdbd88 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:05.288211 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-bf52e6f1-6e4f-4724-8557-8f5a1b93e27d req-ea1efca3-ecdd-45a2-998d-728674fdbd88 service nova] Creating event network-vif-plugged:7d11df58-0218-4b52-87b7-4c5dc9927ca6 for instance 0860ae28-9636-40dd-a79d-bbf608e0a922 on n-h2-852084-10 Sep 08 12:44:05.315215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-bf52e6f1-6e4f-4724-8557-8f5a1b93e27d req-ea1efca3-ecdd-45a2-998d-728674fdbd88 service nova] Instance 0860ae28-9636-40dd-a79d-bbf608e0a922 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:44:05.351630 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-bf52e6f1-6e4f-4724-8557-8f5a1b93e27d req-ea1efca3-ecdd-45a2-998d-728674fdbd88 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127813 Sep 08 12:44:05.361099 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 683/1377] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:05.631863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-15dfad2b-7c0d-4d9f-839d-1e5a286a2736 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:05.632787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-15dfad2b-7c0d-4d9f-839d-1e5a286a2736 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:05.643904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15dfad2b-7c0d-4d9f-839d-1e5a286a2736 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:05.645142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15dfad2b-7c0d-4d9f-839d-1e5a286a2736 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:05.645698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15dfad2b-7c0d-4d9f-839d-1e5a286a2736 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:05.646551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15dfad2b-7c0d-4d9f-839d-1e5a286a2736 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:05.647416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15dfad2b-7c0d-4d9f-839d-1e5a286a2736 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:05.647992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15dfad2b-7c0d-4d9f-839d-1e5a286a2736 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:06.171131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-15dfad2b-7c0d-4d9f-839d-1e5a286a2736 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:06.182774 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-15dfad2b-7c0d-4d9f-839d-1e5a286a2736 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1520 microversion: 2.1 time: 0.556486 Sep 08 12:44:06.183422 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 684/1378] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:05 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1520 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:06.243325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-848c40f0-427b-4ec0-8349-8d30b396d52e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:06.243325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-848c40f0-427b-4ec0-8349-8d30b396d52e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:06.257281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-848c40f0-427b-4ec0-8349-8d30b396d52e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:06.258325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-848c40f0-427b-4ec0-8349-8d30b396d52e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:06.259278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-848c40f0-427b-4ec0-8349-8d30b396d52e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:06.260735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-848c40f0-427b-4ec0-8349-8d30b396d52e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:06.261962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-848c40f0-427b-4ec0-8349-8d30b396d52e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:06.263066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-848c40f0-427b-4ec0-8349-8d30b396d52e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:06.455378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-848c40f0-427b-4ec0-8349-8d30b396d52e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:06.485070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-848c40f0-427b-4ec0-8349-8d30b396d52e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:06.493317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-848c40f0-427b-4ec0-8349-8d30b396d52e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:06.508741 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-848c40f0-427b-4ec0-8349-8d30b396d52e tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.296780 Sep 08 12:44:06.525895 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 685/1379] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:06 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:06.538208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee4f1bc4-f740-4d58-9b9e-73ccb1bcf80b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:06.540200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ee4f1bc4-f740-4d58-9b9e-73ccb1bcf80b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:06.557626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee4f1bc4-f740-4d58-9b9e-73ccb1bcf80b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:06.558624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee4f1bc4-f740-4d58-9b9e-73ccb1bcf80b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:06.559644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee4f1bc4-f740-4d58-9b9e-73ccb1bcf80b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:06.560742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee4f1bc4-f740-4d58-9b9e-73ccb1bcf80b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:06.563425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee4f1bc4-f740-4d58-9b9e-73ccb1bcf80b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:06.575725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee4f1bc4-f740-4d58-9b9e-73ccb1bcf80b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:06.833138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ee4f1bc4-f740-4d58-9b9e-73ccb1bcf80b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:06.839160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:06.854999 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee4f1bc4-f740-4d58-9b9e-73ccb1bcf80b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1470 microversion: 2.1 time: 0.324144 Sep 08 12:44:06.858786 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 686/1380] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:06 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1470 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:07.216303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d3211dcd-7506-4d7c-921a-1b694f6283ae tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:07.217969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d3211dcd-7506-4d7c-921a-1b694f6283ae tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:07.246993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3211dcd-7506-4d7c-921a-1b694f6283ae tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:07.249710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3211dcd-7506-4d7c-921a-1b694f6283ae tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:07.249710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3211dcd-7506-4d7c-921a-1b694f6283ae tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:07.250779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3211dcd-7506-4d7c-921a-1b694f6283ae tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:07.251702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3211dcd-7506-4d7c-921a-1b694f6283ae tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:07.252565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3211dcd-7506-4d7c-921a-1b694f6283ae tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:07.536323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d3211dcd-7506-4d7c-921a-1b694f6283ae tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:07.551742 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d3211dcd-7506-4d7c-921a-1b694f6283ae tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1520 microversion: 2.1 time: 0.343733 Sep 08 12:44:07.552732 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 687/1381] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:07 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:44:07.588011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2a366ea2-3a73-43df-9ad9-f1420fd03185 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:07.589510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2a366ea2-3a73-43df-9ad9-f1420fd03185 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:07.604162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a366ea2-3a73-43df-9ad9-f1420fd03185 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:07.604954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a366ea2-3a73-43df-9ad9-f1420fd03185 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:07.605631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a366ea2-3a73-43df-9ad9-f1420fd03185 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:07.606988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a366ea2-3a73-43df-9ad9-f1420fd03185 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:07.607874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a366ea2-3a73-43df-9ad9-f1420fd03185 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:07.608673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a366ea2-3a73-43df-9ad9-f1420fd03185 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:07.774681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2a366ea2-3a73-43df-9ad9-f1420fd03185 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:07.795320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2a366ea2-3a73-43df-9ad9-f1420fd03185 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:07.803293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2a366ea2-3a73-43df-9ad9-f1420fd03185 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:07.812488 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2a366ea2-3a73-43df-9ad9-f1420fd03185 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.242258 Sep 08 12:44:07.813431 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 688/1382] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:07 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:07.900012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2d9fb4ac-d817-4a01-b554-b1f9219747c4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:07.900935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2d9fb4ac-d817-4a01-b554-b1f9219747c4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:07.908539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d9fb4ac-d817-4a01-b554-b1f9219747c4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:07.909040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d9fb4ac-d817-4a01-b554-b1f9219747c4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:07.910311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d9fb4ac-d817-4a01-b554-b1f9219747c4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:07.911927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d9fb4ac-d817-4a01-b554-b1f9219747c4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:07.912453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d9fb4ac-d817-4a01-b554-b1f9219747c4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:07.912923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d9fb4ac-d817-4a01-b554-b1f9219747c4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:08.237520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2d9fb4ac-d817-4a01-b554-b1f9219747c4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:08.258534 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2d9fb4ac-d817-4a01-b554-b1f9219747c4 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1470 microversion: 2.1 time: 0.367537 Sep 08 12:44:08.275085 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 689/1383] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:07 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1470 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:08.602927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4dd26db6-f7f5-4898-b77a-b58e44675ba2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:08.605388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4dd26db6-f7f5-4898-b77a-b58e44675ba2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:08.619905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=70 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:08.625243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dd26db6-f7f5-4898-b77a-b58e44675ba2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:08.626153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dd26db6-f7f5-4898-b77a-b58e44675ba2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:08.626956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dd26db6-f7f5-4898-b77a-b58e44675ba2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:08.630255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dd26db6-f7f5-4898-b77a-b58e44675ba2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:08.630255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dd26db6-f7f5-4898-b77a-b58e44675ba2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:08.630255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dd26db6-f7f5-4898-b77a-b58e44675ba2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:08.698474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:08.970405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=14 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:09.008487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4dd26db6-f7f5-4898-b77a-b58e44675ba2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:09.028258 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4dd26db6-f7f5-4898-b77a-b58e44675ba2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1520 microversion: 2.1 time: 0.434483 Sep 08 12:44:09.091908 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 690/1384] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:08 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1520 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:09.140270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cd3178e3-4bbc-41db-aaef-7c84f46703cd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:09.141703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cd3178e3-4bbc-41db-aaef-7c84f46703cd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:09.158600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd3178e3-4bbc-41db-aaef-7c84f46703cd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:09.159506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd3178e3-4bbc-41db-aaef-7c84f46703cd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:09.160344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd3178e3-4bbc-41db-aaef-7c84f46703cd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:09.161635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd3178e3-4bbc-41db-aaef-7c84f46703cd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:09.162841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd3178e3-4bbc-41db-aaef-7c84f46703cd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:09.163674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd3178e3-4bbc-41db-aaef-7c84f46703cd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:09.295873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cd3178e3-4bbc-41db-aaef-7c84f46703cd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:09.324373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cd3178e3-4bbc-41db-aaef-7c84f46703cd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:09.336789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cd3178e3-4bbc-41db-aaef-7c84f46703cd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:09.345811 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cd3178e3-4bbc-41db-aaef-7c84f46703cd tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.252236 Sep 08 12:44:09.351382 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 691/1385] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:09 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:09.359739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-db89fd59-3049-4ace-8429-e1548b724c6a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:09.361649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-db89fd59-3049-4ace-8429-e1548b724c6a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:09.374359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db89fd59-3049-4ace-8429-e1548b724c6a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:09.381717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db89fd59-3049-4ace-8429-e1548b724c6a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:09.383153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db89fd59-3049-4ace-8429-e1548b724c6a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:09.385784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db89fd59-3049-4ace-8429-e1548b724c6a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:09.387295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db89fd59-3049-4ace-8429-e1548b724c6a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:09.388473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db89fd59-3049-4ace-8429-e1548b724c6a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:09.668595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-db89fd59-3049-4ace-8429-e1548b724c6a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:09.684423 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-db89fd59-3049-4ace-8429-e1548b724c6a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1470 microversion: 2.1 time: 0.336012 Sep 08 12:44:09.685745 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 692/1386] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:09 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1470 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:10.092654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ab448807-5030-4094-b385-93f0bd724f06 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:10.100710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ab448807-5030-4094-b385-93f0bd724f06 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:10.123407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab448807-5030-4094-b385-93f0bd724f06 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:10.128152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab448807-5030-4094-b385-93f0bd724f06 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:10.129701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab448807-5030-4094-b385-93f0bd724f06 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:10.131307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab448807-5030-4094-b385-93f0bd724f06 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:10.132475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab448807-5030-4094-b385-93f0bd724f06 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:10.133525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab448807-5030-4094-b385-93f0bd724f06 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:10.452999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ab448807-5030-4094-b385-93f0bd724f06 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:10.471129 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ab448807-5030-4094-b385-93f0bd724f06 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1520 microversion: 2.1 time: 0.382020 Sep 08 12:44:10.472586 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 693/1387] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:10 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1520 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:44:10.481012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1b0b8f97-813f-4da6-967c-87343995a3d1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:10.482629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1b0b8f97-813f-4da6-967c-87343995a3d1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:10.494837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b0b8f97-813f-4da6-967c-87343995a3d1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:10.495875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b0b8f97-813f-4da6-967c-87343995a3d1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:10.496774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b0b8f97-813f-4da6-967c-87343995a3d1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:10.498392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b0b8f97-813f-4da6-967c-87343995a3d1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:10.499682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b0b8f97-813f-4da6-967c-87343995a3d1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:10.505798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b0b8f97-813f-4da6-967c-87343995a3d1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:10.655582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1b0b8f97-813f-4da6-967c-87343995a3d1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:10.681685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1b0b8f97-813f-4da6-967c-87343995a3d1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:10.685334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1b0b8f97-813f-4da6-967c-87343995a3d1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:10.701135 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1b0b8f97-813f-4da6-967c-87343995a3d1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.226676 Sep 08 12:44:10.702863 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 694/1388] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:10 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:10.726088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc7c9b2e-a5cf-422f-9ab5-eb65061e431a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:10.729752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cc7c9b2e-a5cf-422f-9ab5-eb65061e431a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:10.752624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc7c9b2e-a5cf-422f-9ab5-eb65061e431a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:10.753828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc7c9b2e-a5cf-422f-9ab5-eb65061e431a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:10.754868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc7c9b2e-a5cf-422f-9ab5-eb65061e431a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:10.756570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc7c9b2e-a5cf-422f-9ab5-eb65061e431a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:10.759133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc7c9b2e-a5cf-422f-9ab5-eb65061e431a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:10.761154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc7c9b2e-a5cf-422f-9ab5-eb65061e431a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:11.092777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cc7c9b2e-a5cf-422f-9ab5-eb65061e431a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:11.113053 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc7c9b2e-a5cf-422f-9ab5-eb65061e431a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1470 microversion: 2.1 time: 0.394502 Sep 08 12:44:11.115604 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 695/1389] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:10 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1470 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:44:11.500874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b1c97ed9-e444-46cf-b677-9e1b6e08d8e9 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:11.501788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b1c97ed9-e444-46cf-b677-9e1b6e08d8e9 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:11.535254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1c97ed9-e444-46cf-b677-9e1b6e08d8e9 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:11.536126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1c97ed9-e444-46cf-b677-9e1b6e08d8e9 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:11.536926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1c97ed9-e444-46cf-b677-9e1b6e08d8e9 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:11.547311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1c97ed9-e444-46cf-b677-9e1b6e08d8e9 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:11.548380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1c97ed9-e444-46cf-b677-9e1b6e08d8e9 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:11.558365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1c97ed9-e444-46cf-b677-9e1b6e08d8e9 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:11.911295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b1c97ed9-e444-46cf-b677-9e1b6e08d8e9 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:11.930900 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b1c97ed9-e444-46cf-b677-9e1b6e08d8e9 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1497 microversion: 2.1 time: 0.434138 Sep 08 12:44:11.932510 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 696/1390] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:11 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1497 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:11.939498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-0b957a9f-bdf0-4ac5-a96a-4e48fcd2b829 req-953b610a-5c09-463d-bee6-8d9f8d9b4151 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0860ae28-9636-40dd-a79d-bbf608e0a922", "name": "network-vif-unplugged", "status": "completed", "tag": "7d11df58-0218-4b52-87b7-4c5dc9927ca6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:11.969502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0b957a9f-bdf0-4ac5-a96a-4e48fcd2b829 req-953b610a-5c09-463d-bee6-8d9f8d9b4151 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:11.970665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0b957a9f-bdf0-4ac5-a96a-4e48fcd2b829 req-953b610a-5c09-463d-bee6-8d9f8d9b4151 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:11.971404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0b957a9f-bdf0-4ac5-a96a-4e48fcd2b829 req-953b610a-5c09-463d-bee6-8d9f8d9b4151 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:12.003310 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-0b957a9f-bdf0-4ac5-a96a-4e48fcd2b829 req-953b610a-5c09-463d-bee6-8d9f8d9b4151 service nova] Creating event network-vif-unplugged:7d11df58-0218-4b52-87b7-4c5dc9927ca6 for instance 0860ae28-9636-40dd-a79d-bbf608e0a922 on n-h1-852084-10 Sep 08 12:44:12.059268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-0b957a9f-bdf0-4ac5-a96a-4e48fcd2b829 req-953b610a-5c09-463d-bee6-8d9f8d9b4151 service nova] Instance 0860ae28-9636-40dd-a79d-bbf608e0a922 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:44:12.086661 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-0b957a9f-bdf0-4ac5-a96a-4e48fcd2b829 req-953b610a-5c09-463d-bee6-8d9f8d9b4151 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.152158 Sep 08 12:44:12.088662 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 697/1391] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:12.104979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2c0573b4-acc6-4fb9-83ce-3f36e3b9c5d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:12.107567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2c0573b4-acc6-4fb9-83ce-3f36e3b9c5d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:12.120430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c0573b4-acc6-4fb9-83ce-3f36e3b9c5d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:12.121707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c0573b4-acc6-4fb9-83ce-3f36e3b9c5d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:12.122911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c0573b4-acc6-4fb9-83ce-3f36e3b9c5d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:12.127033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c0573b4-acc6-4fb9-83ce-3f36e3b9c5d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:12.128162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c0573b4-acc6-4fb9-83ce-3f36e3b9c5d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:12.129709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c0573b4-acc6-4fb9-83ce-3f36e3b9c5d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:12.269273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2c0573b4-acc6-4fb9-83ce-3f36e3b9c5d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:12.304080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2c0573b4-acc6-4fb9-83ce-3f36e3b9c5d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:12.319573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2c0573b4-acc6-4fb9-83ce-3f36e3b9c5d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:12.338535 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2c0573b4-acc6-4fb9-83ce-3f36e3b9c5d9 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.242380 Sep 08 12:44:12.344820 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 698/1392] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:12 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:12.362727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6221228a-5282-4d6c-813d-de0fcadc02ca tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:12.409084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6221228a-5282-4d6c-813d-de0fcadc02ca tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:12.411655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6221228a-5282-4d6c-813d-de0fcadc02ca tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:44:12.441193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6221228a-5282-4d6c-813d-de0fcadc02ca tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:12.442561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6221228a-5282-4d6c-813d-de0fcadc02ca tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:12.443403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6221228a-5282-4d6c-813d-de0fcadc02ca tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:12.444840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6221228a-5282-4d6c-813d-de0fcadc02ca tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:12.447926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6221228a-5282-4d6c-813d-de0fcadc02ca tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:12.448860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6221228a-5282-4d6c-813d-de0fcadc02ca tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:12.654358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-6221228a-5282-4d6c-813d-de0fcadc02ca tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:44:12.805183 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6221228a-5282-4d6c-813d-de0fcadc02ca tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 345 microversion: 2.1 time: 0.457024 Sep 08 12:44:12.819106 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 699/1393] 10.222.0.78 () {58 vars in 1154 bytes} [Thu Sep 8 12:44:12 2022] GET /compute/v2.1/servers?status=shutoff => generated 345 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:12.819106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4a23a26e-4e3d-41cb-bf8b-7fd13b41757e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:12.819106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4a23a26e-4e3d-41cb-bf8b-7fd13b41757e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:12.831828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a23a26e-4e3d-41cb-bf8b-7fd13b41757e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:12.833160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a23a26e-4e3d-41cb-bf8b-7fd13b41757e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:12.834481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a23a26e-4e3d-41cb-bf8b-7fd13b41757e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:12.836007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a23a26e-4e3d-41cb-bf8b-7fd13b41757e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:12.837244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a23a26e-4e3d-41cb-bf8b-7fd13b41757e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:12.837898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a23a26e-4e3d-41cb-bf8b-7fd13b41757e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:13.267012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4a23a26e-4e3d-41cb-bf8b-7fd13b41757e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:13.289283 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4a23a26e-4e3d-41cb-bf8b-7fd13b41757e tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1470 microversion: 2.1 time: 0.479948 Sep 08 12:44:13.290875 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 700/1394] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:12 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1470 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:13.298768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3b938c0e-5735-4af0-b8b4-432644405904 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:13.310542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b938c0e-5735-4af0-b8b4-432644405904 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:13.311544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b938c0e-5735-4af0-b8b4-432644405904 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:13.312451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b938c0e-5735-4af0-b8b4-432644405904 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:13.419136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3b938c0e-5735-4af0-b8b4-432644405904 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Going to try to start instance {{(pid=128970) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 12:44:13.517253 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3b938c0e-5735-4af0-b8b4-432644405904 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "POST /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3/action" status: 202 len: 0 microversion: 2.1 time: 0.222636 Sep 08 12:44:13.539170 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 701/1395] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:44:13 2022] POST /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:44:13.611743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0a920164-760f-49f4-abab-c1f193f02cd8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:13.627247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0a920164-760f-49f4-abab-c1f193f02cd8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:13.659064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a920164-760f-49f4-abab-c1f193f02cd8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:13.660863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a920164-760f-49f4-abab-c1f193f02cd8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:13.661357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a920164-760f-49f4-abab-c1f193f02cd8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:13.664946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a920164-760f-49f4-abab-c1f193f02cd8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:13.667473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a920164-760f-49f4-abab-c1f193f02cd8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:13.669193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a920164-760f-49f4-abab-c1f193f02cd8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:13.741262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:13.846247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0a920164-760f-49f4-abab-c1f193f02cd8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:13.868947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0a920164-760f-49f4-abab-c1f193f02cd8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:13.871271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0a920164-760f-49f4-abab-c1f193f02cd8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:13.885731 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0a920164-760f-49f4-abab-c1f193f02cd8 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.338896 Sep 08 12:44:13.886931 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 702/1396] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:13 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:13.895297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0f274290-2198-4cb8-bf11-51af9c4ad7ad tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:13.897338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0f274290-2198-4cb8-bf11-51af9c4ad7ad tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:13.937755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f274290-2198-4cb8-bf11-51af9c4ad7ad tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:13.944199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f274290-2198-4cb8-bf11-51af9c4ad7ad tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:13.944772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f274290-2198-4cb8-bf11-51af9c4ad7ad tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:13.946588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f274290-2198-4cb8-bf11-51af9c4ad7ad tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:13.946588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f274290-2198-4cb8-bf11-51af9c4ad7ad tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:13.946588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f274290-2198-4cb8-bf11-51af9c4ad7ad tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:14.275669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0f274290-2198-4cb8-bf11-51af9c4ad7ad tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:14.312118 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0f274290-2198-4cb8-bf11-51af9c4ad7ad tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1506 microversion: 2.1 time: 0.422868 Sep 08 12:44:14.323203 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 703/1397] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:13 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1506 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:14.346274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-61f164f1-a43b-40c7-b615-d3ae3078c9cd req-3fd8dbd3-d387-4aae-8643-1e17af889db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0860ae28-9636-40dd-a79d-bbf608e0a922", "tag": "7d11df58-0218-4b52-87b7-4c5dc9927ca6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:14.382445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-61f164f1-a43b-40c7-b615-d3ae3078c9cd req-3fd8dbd3-d387-4aae-8643-1e17af889db4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:14.383433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-61f164f1-a43b-40c7-b615-d3ae3078c9cd req-3fd8dbd3-d387-4aae-8643-1e17af889db4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:14.384789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-61f164f1-a43b-40c7-b615-d3ae3078c9cd req-3fd8dbd3-d387-4aae-8643-1e17af889db4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:14.423323 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-61f164f1-a43b-40c7-b615-d3ae3078c9cd req-3fd8dbd3-d387-4aae-8643-1e17af889db4 service nova] Creating event network-changed:7d11df58-0218-4b52-87b7-4c5dc9927ca6 for instance 0860ae28-9636-40dd-a79d-bbf608e0a922 on n-h1-852084-10 Sep 08 12:44:14.438777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-61f164f1-a43b-40c7-b615-d3ae3078c9cd req-3fd8dbd3-d387-4aae-8643-1e17af889db4 service nova] Instance 0860ae28-9636-40dd-a79d-bbf608e0a922 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 12:44:14.458164 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-61f164f1-a43b-40c7-b615-d3ae3078c9cd req-3fd8dbd3-d387-4aae-8643-1e17af889db4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142135 Sep 08 12:44:14.459139 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 704/1398] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:14.465739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-66654d55-0883-435c-bf75-8fd915f0c8e5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:14.466472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-66654d55-0883-435c-bf75-8fd915f0c8e5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:14.481420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66654d55-0883-435c-bf75-8fd915f0c8e5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:14.483443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66654d55-0883-435c-bf75-8fd915f0c8e5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:14.486664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66654d55-0883-435c-bf75-8fd915f0c8e5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:14.489713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66654d55-0883-435c-bf75-8fd915f0c8e5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:14.491760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66654d55-0883-435c-bf75-8fd915f0c8e5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:14.492948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66654d55-0883-435c-bf75-8fd915f0c8e5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:14.772947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:14.819365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=31 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:14.906350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-66654d55-0883-435c-bf75-8fd915f0c8e5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:14.930035 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-66654d55-0883-435c-bf75-8fd915f0c8e5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1470 microversion: 2.1 time: 0.469203 Sep 08 12:44:14.931128 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 705/1399] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:14 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1470 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:14.950526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0502348b-4009-44ea-9a05-bf68efa71f84 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:14.951434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0502348b-4009-44ea-9a05-bf68efa71f84 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:14.961891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0502348b-4009-44ea-9a05-bf68efa71f84 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:14.962641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0502348b-4009-44ea-9a05-bf68efa71f84 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:14.963376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0502348b-4009-44ea-9a05-bf68efa71f84 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:14.964433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0502348b-4009-44ea-9a05-bf68efa71f84 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:14.978970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0502348b-4009-44ea-9a05-bf68efa71f84 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:14.979760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0502348b-4009-44ea-9a05-bf68efa71f84 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:15.151877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0502348b-4009-44ea-9a05-bf68efa71f84 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:15.167096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0502348b-4009-44ea-9a05-bf68efa71f84 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:15.173784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0502348b-4009-44ea-9a05-bf68efa71f84 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:15.191697 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0502348b-4009-44ea-9a05-bf68efa71f84 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.245561 Sep 08 12:44:15.207994 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 706/1400] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:14 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:15.239101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-05bd0f39-d8e3-4ede-9aa7-348977950fd6 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:15.240035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-05bd0f39-d8e3-4ede-9aa7-348977950fd6 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:15.250582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-05bd0f39-d8e3-4ede-9aa7-348977950fd6 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:15.251060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-05bd0f39-d8e3-4ede-9aa7-348977950fd6 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:15.251548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-05bd0f39-d8e3-4ede-9aa7-348977950fd6 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:15.252323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-05bd0f39-d8e3-4ede-9aa7-348977950fd6 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:15.253638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-05bd0f39-d8e3-4ede-9aa7-348977950fd6 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:15.254389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-05bd0f39-d8e3-4ede-9aa7-348977950fd6 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:16.164020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-05bd0f39-d8e3-4ede-9aa7-348977950fd6 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid 2ba78845-4ce9-474d-ac71-a91626b110d1 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:44:16.227065 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-05bd0f39-d8e3-4ede-9aa7-348977950fd6 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 2345 microversion: 2.25 time: 1.015945 Sep 08 12:44:16.229735 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 707/1401] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:15 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 2345 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:16.250381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-091ce4bc-bbd0-4f21-b720-af2c73bb3e42 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:16.256391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-091ce4bc-bbd0-4f21-b720-af2c73bb3e42 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:16.283519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-091ce4bc-bbd0-4f21-b720-af2c73bb3e42 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:16.295163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-091ce4bc-bbd0-4f21-b720-af2c73bb3e42 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:16.296057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-091ce4bc-bbd0-4f21-b720-af2c73bb3e42 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:16.297308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-091ce4bc-bbd0-4f21-b720-af2c73bb3e42 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:16.298088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-091ce4bc-bbd0-4f21-b720-af2c73bb3e42 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:16.308186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-091ce4bc-bbd0-4f21-b720-af2c73bb3e42 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:16.825211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-091ce4bc-bbd0-4f21-b720-af2c73bb3e42 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:16.836696 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-091ce4bc-bbd0-4f21-b720-af2c73bb3e42 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1510 microversion: 2.1 time: 0.605077 Sep 08 12:44:16.841258 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 708/1402] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:16 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1510 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:16.851639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4f569855-06f3-417d-b572-eba17c8f4977 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:16.857346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4f569855-06f3-417d-b572-eba17c8f4977 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:16.873978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f569855-06f3-417d-b572-eba17c8f4977 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:16.874488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f569855-06f3-417d-b572-eba17c8f4977 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:16.874940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f569855-06f3-417d-b572-eba17c8f4977 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:16.875761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f569855-06f3-417d-b572-eba17c8f4977 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:16.876268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f569855-06f3-417d-b572-eba17c8f4977 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:16.876809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f569855-06f3-417d-b572-eba17c8f4977 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:17.243593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4f569855-06f3-417d-b572-eba17c8f4977 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:17.283307 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4f569855-06f3-417d-b572-eba17c8f4977 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1463 microversion: 2.1 time: 0.440612 Sep 08 12:44:17.283976 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 709/1403] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:16 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1463 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:17.326819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1a0984e4-b413-4a99-8ae4-ac5fe9550aad tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:17.327968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1a0984e4-b413-4a99-8ae4-ac5fe9550aad tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:17.367049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0984e4-b413-4a99-8ae4-ac5fe9550aad tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:17.367977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0984e4-b413-4a99-8ae4-ac5fe9550aad tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:17.368673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0984e4-b413-4a99-8ae4-ac5fe9550aad tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:17.375547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0984e4-b413-4a99-8ae4-ac5fe9550aad tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:17.376735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0984e4-b413-4a99-8ae4-ac5fe9550aad tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:17.377814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a0984e4-b413-4a99-8ae4-ac5fe9550aad tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:17.518772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a0984e4-b413-4a99-8ae4-ac5fe9550aad tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:17.546407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a0984e4-b413-4a99-8ae4-ac5fe9550aad tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:17.550479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a0984e4-b413-4a99-8ae4-ac5fe9550aad tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:17.563332 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1a0984e4-b413-4a99-8ae4-ac5fe9550aad tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.258894 Sep 08 12:44:17.564797 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 710/1404] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:17 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:17.574029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f3b1a25b-eaf0-464b-b25c-0952b09e2a48 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:17.584384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3b1a25b-eaf0-464b-b25c-0952b09e2a48 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:17.585661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3b1a25b-eaf0-464b-b25c-0952b09e2a48 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:17.586850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3b1a25b-eaf0-464b-b25c-0952b09e2a48 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:17.589161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3b1a25b-eaf0-464b-b25c-0952b09e2a48 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:17.589707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3b1a25b-eaf0-464b-b25c-0952b09e2a48 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:17.590252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3b1a25b-eaf0-464b-b25c-0952b09e2a48 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:17.646685 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f3b1a25b-eaf0-464b-b25c-0952b09e2a48 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.078637 Sep 08 12:44:17.659683 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 711/1405] 10.222.0.78 () {60 vars in 1217 bytes} [Thu Sep 8 12:44:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:44:17.659683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e03cdc52-46c5-498d-80d2-dca5970d8e2b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:17.682367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e03cdc52-46c5-498d-80d2-dca5970d8e2b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:17.683190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.compute.servers [None req-e03cdc52-46c5-498d-80d2-dca5970d8e2b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Removing options 'limit' from query {{(pid=128970) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 12:44:17.689595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e03cdc52-46c5-498d-80d2-dca5970d8e2b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:44:17.692435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e03cdc52-46c5-498d-80d2-dca5970d8e2b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:17.695096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e03cdc52-46c5-498d-80d2-dca5970d8e2b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:17.696943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e03cdc52-46c5-498d-80d2-dca5970d8e2b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:17.701002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e03cdc52-46c5-498d-80d2-dca5970d8e2b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:17.703466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e03cdc52-46c5-498d-80d2-dca5970d8e2b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:17.704388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e03cdc52-46c5-498d-80d2-dca5970d8e2b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:17.708148 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e03cdc52-46c5-498d-80d2-dca5970d8e2b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.057431 Sep 08 12:44:17.708798 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 712/1406] 10.222.0.78 () {58 vars in 1140 bytes} [Thu Sep 8 12:44:17 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:44:17.731904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-73b6729f-157c-4d58-9e71-3b9c55cee0a4 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:17.733153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-73b6729f-157c-4d58-9e71-3b9c55cee0a4 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:17.745189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73b6729f-157c-4d58-9e71-3b9c55cee0a4 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:17.746063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73b6729f-157c-4d58-9e71-3b9c55cee0a4 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:17.746888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73b6729f-157c-4d58-9e71-3b9c55cee0a4 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:17.748286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73b6729f-157c-4d58-9e71-3b9c55cee0a4 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:17.749556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73b6729f-157c-4d58-9e71-3b9c55cee0a4 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:17.750395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73b6729f-157c-4d58-9e71-3b9c55cee0a4 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:18.196050 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-73b6729f-157c-4d58-9e71-3b9c55cee0a4 tempest-MigrationsAdminTest-939955457 tempest-MigrationsAdminTest-939955457-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1616 microversion: 2.1 time: 0.470787 Sep 08 12:44:18.220477 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 713/1407] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:17 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1616 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:18.287768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c3868902-12b2-4f34-be33-733a6f367e80 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:18.295489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c3868902-12b2-4f34-be33-733a6f367e80 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:18.320368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3868902-12b2-4f34-be33-733a6f367e80 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:18.323427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3868902-12b2-4f34-be33-733a6f367e80 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:18.325226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3868902-12b2-4f34-be33-733a6f367e80 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:18.326918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3868902-12b2-4f34-be33-733a6f367e80 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:18.335526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3868902-12b2-4f34-be33-733a6f367e80 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:18.336852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3868902-12b2-4f34-be33-733a6f367e80 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:18.852160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c3868902-12b2-4f34-be33-733a6f367e80 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:18.865110 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c3868902-12b2-4f34-be33-733a6f367e80 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1510 microversion: 2.1 time: 0.631205 Sep 08 12:44:18.880747 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 714/1408] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:18 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1510 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:18.896206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-85170de2-38b9-454b-b54e-aceac4845917 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:18.897166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-85170de2-38b9-454b-b54e-aceac4845917 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:18.906140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85170de2-38b9-454b-b54e-aceac4845917 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:18.906649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85170de2-38b9-454b-b54e-aceac4845917 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:18.907364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85170de2-38b9-454b-b54e-aceac4845917 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:18.908935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85170de2-38b9-454b-b54e-aceac4845917 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:18.910161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85170de2-38b9-454b-b54e-aceac4845917 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:18.911160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85170de2-38b9-454b-b54e-aceac4845917 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:19.055677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-85170de2-38b9-454b-b54e-aceac4845917 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:44:19.365572 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-85170de2-38b9-454b-b54e-aceac4845917 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 204 len: 0 microversion: 2.1 time: 0.482517 Sep 08 12:44:19.371610 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 715/1409] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:44:18 2022] DELETE /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:44:19.389274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-520a4035-18e1-4df9-8e37-0a0d9b49606d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:19.391984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-520a4035-18e1-4df9-8e37-0a0d9b49606d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:19.406434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-520a4035-18e1-4df9-8e37-0a0d9b49606d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:19.408028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-520a4035-18e1-4df9-8e37-0a0d9b49606d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:19.409681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-520a4035-18e1-4df9-8e37-0a0d9b49606d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:19.410431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-520a4035-18e1-4df9-8e37-0a0d9b49606d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:19.413236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-520a4035-18e1-4df9-8e37-0a0d9b49606d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:19.414783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-520a4035-18e1-4df9-8e37-0a0d9b49606d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:19.600155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-520a4035-18e1-4df9-8e37-0a0d9b49606d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:19.614017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-520a4035-18e1-4df9-8e37-0a0d9b49606d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:19.616140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-520a4035-18e1-4df9-8e37-0a0d9b49606d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:19.624596 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-520a4035-18e1-4df9-8e37-0a0d9b49606d tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.249416 Sep 08 12:44:19.640577 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 716/1410] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:19 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:19.655379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ccba9c05-dd35-4115-8d32-4dd67e9868b8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:19.656359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ccba9c05-dd35-4115-8d32-4dd67e9868b8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 83b2b1b0-2e34-4bbc-9d98-40eec81036ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:19.665686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccba9c05-dd35-4115-8d32-4dd67e9868b8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:19.666260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccba9c05-dd35-4115-8d32-4dd67e9868b8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:19.666634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccba9c05-dd35-4115-8d32-4dd67e9868b8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:19.667658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccba9c05-dd35-4115-8d32-4dd67e9868b8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:19.668737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccba9c05-dd35-4115-8d32-4dd67e9868b8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:19.669612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccba9c05-dd35-4115-8d32-4dd67e9868b8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:20.142162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ccba9c05-dd35-4115-8d32-4dd67e9868b8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:20.153518 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ccba9c05-dd35-4115-8d32-4dd67e9868b8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac" status: 200 len: 1511 microversion: 2.1 time: 0.511234 Sep 08 12:44:20.154462 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 717/1411] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:19 2022] GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac => generated 1511 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:20.159913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8c3ffa10-1a60-413f-8853-b0135e54036f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:20.160578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8c3ffa10-1a60-413f-8853-b0135e54036f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:20.180932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c3ffa10-1a60-413f-8853-b0135e54036f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:20.181450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c3ffa10-1a60-413f-8853-b0135e54036f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:20.181902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c3ffa10-1a60-413f-8853-b0135e54036f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:20.182643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c3ffa10-1a60-413f-8853-b0135e54036f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:20.183139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c3ffa10-1a60-413f-8853-b0135e54036f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:20.187886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c3ffa10-1a60-413f-8853-b0135e54036f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:20.556326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8c3ffa10-1a60-413f-8853-b0135e54036f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:20.571426 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8c3ffa10-1a60-413f-8853-b0135e54036f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1469 microversion: 2.1 time: 0.415689 Sep 08 12:44:20.587258 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 718/1412] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:20 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1469 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:20.607692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c53bf7ff-a814-4ccf-be6c-62bbbd42d1ac tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:20.610862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c53bf7ff-a814-4ccf-be6c-62bbbd42d1ac tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:20.624957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c53bf7ff-a814-4ccf-be6c-62bbbd42d1ac tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:20.626187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c53bf7ff-a814-4ccf-be6c-62bbbd42d1ac tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:20.627197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c53bf7ff-a814-4ccf-be6c-62bbbd42d1ac tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:20.628675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c53bf7ff-a814-4ccf-be6c-62bbbd42d1ac tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:20.629576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c53bf7ff-a814-4ccf-be6c-62bbbd42d1ac tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:20.630242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c53bf7ff-a814-4ccf-be6c-62bbbd42d1ac tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:20.635953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:21.144259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c53bf7ff-a814-4ccf-be6c-62bbbd42d1ac tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:21.163048 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c53bf7ff-a814-4ccf-be6c-62bbbd42d1ac tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 200 len: 1510 microversion: 2.1 time: 0.583396 Sep 08 12:44:21.165683 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 719/1413] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:20 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 1510 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:21.182698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-88caa876-f471-46cf-86db-44e7124fa80b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:21.183631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-88caa876-f471-46cf-86db-44e7124fa80b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:21.209980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88caa876-f471-46cf-86db-44e7124fa80b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:21.209980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88caa876-f471-46cf-86db-44e7124fa80b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:21.209980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88caa876-f471-46cf-86db-44e7124fa80b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:21.214638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88caa876-f471-46cf-86db-44e7124fa80b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:21.215184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88caa876-f471-46cf-86db-44e7124fa80b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:21.215878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88caa876-f471-46cf-86db-44e7124fa80b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:21.387962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-88caa876-f471-46cf-86db-44e7124fa80b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:21.410795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-88caa876-f471-46cf-86db-44e7124fa80b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:21.414666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-88caa876-f471-46cf-86db-44e7124fa80b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:21.427310 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-88caa876-f471-46cf-86db-44e7124fa80b tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.260428 Sep 08 12:44:21.428251 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 720/1414] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:21 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:21.434033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-54caa7ab-6a08-471d-b95c-d0a254cac85f req-c05e1ac7-34f1-4f50-a9d5-ecafd47d9c8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0860ae28-9636-40dd-a79d-bbf608e0a922", "name": "network-vif-plugged", "status": "completed", "tag": "7d11df58-0218-4b52-87b7-4c5dc9927ca6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:21.452581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-54caa7ab-6a08-471d-b95c-d0a254cac85f req-c05e1ac7-34f1-4f50-a9d5-ecafd47d9c8a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:21.453182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-54caa7ab-6a08-471d-b95c-d0a254cac85f req-c05e1ac7-34f1-4f50-a9d5-ecafd47d9c8a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:21.453916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-54caa7ab-6a08-471d-b95c-d0a254cac85f req-c05e1ac7-34f1-4f50-a9d5-ecafd47d9c8a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:21.478573 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-54caa7ab-6a08-471d-b95c-d0a254cac85f req-c05e1ac7-34f1-4f50-a9d5-ecafd47d9c8a service nova] Creating event network-vif-plugged:7d11df58-0218-4b52-87b7-4c5dc9927ca6 for instance 0860ae28-9636-40dd-a79d-bbf608e0a922 on n-h1-852084-10 Sep 08 12:44:21.485493 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-54caa7ab-6a08-471d-b95c-d0a254cac85f req-c05e1ac7-34f1-4f50-a9d5-ecafd47d9c8a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055333 Sep 08 12:44:21.486242 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 721/1415] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:21.499249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8eeee6d3-e686-42aa-8207-8f75aa5053c4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:21.505987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8eeee6d3-e686-42aa-8207-8f75aa5053c4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:21.506783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8eeee6d3-e686-42aa-8207-8f75aa5053c4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:44:21.710482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8eeee6d3-e686-42aa-8207-8f75aa5053c4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:21.710482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8eeee6d3-e686-42aa-8207-8f75aa5053c4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:21.711563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8eeee6d3-e686-42aa-8207-8f75aa5053c4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:21.713485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8eeee6d3-e686-42aa-8207-8f75aa5053c4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:21.714455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8eeee6d3-e686-42aa-8207-8f75aa5053c4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:21.715275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8eeee6d3-e686-42aa-8207-8f75aa5053c4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:21.965003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-8eeee6d3-e686-42aa-8207-8f75aa5053c4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:44:22.068716 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8eeee6d3-e686-42aa-8207-8f75aa5053c4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 345 microversion: 2.1 time: 0.580424 Sep 08 12:44:22.070080 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 722/1416] 10.222.0.78 () {58 vars in 1154 bytes} [Thu Sep 8 12:44:21 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 345 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:22.076597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bf3c44a3-61e6-4824-bb9d-2b766264e185 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:22.077814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bf3c44a3-61e6-4824-bb9d-2b766264e185 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:22.085491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf3c44a3-61e6-4824-bb9d-2b766264e185 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:22.086603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf3c44a3-61e6-4824-bb9d-2b766264e185 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:22.087363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf3c44a3-61e6-4824-bb9d-2b766264e185 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:22.088463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf3c44a3-61e6-4824-bb9d-2b766264e185 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:22.089186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf3c44a3-61e6-4824-bb9d-2b766264e185 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:22.090192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf3c44a3-61e6-4824-bb9d-2b766264e185 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:22.676400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bf3c44a3-61e6-4824-bb9d-2b766264e185 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:22.702580 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bf3c44a3-61e6-4824-bb9d-2b766264e185 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 200 len: 1427 microversion: 2.1 time: 0.629705 Sep 08 12:44:22.717729 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 723/1417] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:22 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 1427 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:22.727146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-acb7c9f7-6f56-4fe8-afb9-4c970fed60bd tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:22.735633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-acb7c9f7-6f56-4fe8-afb9-4c970fed60bd tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:22.756146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acb7c9f7-6f56-4fe8-afb9-4c970fed60bd tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:22.756529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acb7c9f7-6f56-4fe8-afb9-4c970fed60bd tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:22.769127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acb7c9f7-6f56-4fe8-afb9-4c970fed60bd tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:22.770469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acb7c9f7-6f56-4fe8-afb9-4c970fed60bd tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:22.771600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acb7c9f7-6f56-4fe8-afb9-4c970fed60bd tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:22.772844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acb7c9f7-6f56-4fe8-afb9-4c970fed60bd tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:23.197565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-acb7c9f7-6f56-4fe8-afb9-4c970fed60bd tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:23.215343 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-acb7c9f7-6f56-4fe8-afb9-4c970fed60bd tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1510 microversion: 2.1 time: 0.492951 Sep 08 12:44:23.215343 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 724/1418] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:22 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1510 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:23.224838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-956d1e0c-5339-4709-b49b-4c10f2e2f526 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1ec4ae3-0664-4e0b-9790-48b84e24b869", "device": "/dev/xvdb"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:23.231050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-956d1e0c-5339-4709-b49b-4c10f2e2f526 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:23.245168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-956d1e0c-5339-4709-b49b-4c10f2e2f526 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:23.246049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-956d1e0c-5339-4709-b49b-4c10f2e2f526 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:23.247861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-956d1e0c-5339-4709-b49b-4c10f2e2f526 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:23.249253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-956d1e0c-5339-4709-b49b-4c10f2e2f526 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:23.250122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-956d1e0c-5339-4709-b49b-4c10f2e2f526 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:23.250920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-956d1e0c-5339-4709-b49b-4c10f2e2f526 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:24.011054 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-956d1e0c-5339-4709-b49b-4c10f2e2f526 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "POST /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.793994 Sep 08 12:44:24.012123 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 725/1419] 10.222.0.78 () {62 vars in 1364 bytes} [Thu Sep 8 12:44:23 2022] POST /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1/os-volume_attachments => generated 194 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:44:24.025791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f8e60e54-a3a8-4ae0-8b21-3e0c84ac12e5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:24.025791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f8e60e54-a3a8-4ae0-8b21-3e0c84ac12e5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:24.050403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8e60e54-a3a8-4ae0-8b21-3e0c84ac12e5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:24.051365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8e60e54-a3a8-4ae0-8b21-3e0c84ac12e5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:24.052481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8e60e54-a3a8-4ae0-8b21-3e0c84ac12e5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:24.054884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8e60e54-a3a8-4ae0-8b21-3e0c84ac12e5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:24.054884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8e60e54-a3a8-4ae0-8b21-3e0c84ac12e5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:24.055843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8e60e54-a3a8-4ae0-8b21-3e0c84ac12e5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:24.155156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f8e60e54-a3a8-4ae0-8b21-3e0c84ac12e5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:24.166280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f8e60e54-a3a8-4ae0-8b21-3e0c84ac12e5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:24.169912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f8e60e54-a3a8-4ae0-8b21-3e0c84ac12e5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:24.177765 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f8e60e54-a3a8-4ae0-8b21-3e0c84ac12e5 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.163548 Sep 08 12:44:24.181828 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 726/1420] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:24 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:24.208852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f7486f04-0159-451e-9531-a86c04309f00 req-13eff670-225d-4603-9912-937cb99962f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0860ae28-9636-40dd-a79d-bbf608e0a922", "name": "network-vif-deleted", "tag": "7d11df58-0218-4b52-87b7-4c5dc9927ca6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:24.223368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f7486f04-0159-451e-9531-a86c04309f00 req-13eff670-225d-4603-9912-937cb99962f1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:24.223903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f7486f04-0159-451e-9531-a86c04309f00 req-13eff670-225d-4603-9912-937cb99962f1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:24.224382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f7486f04-0159-451e-9531-a86c04309f00 req-13eff670-225d-4603-9912-937cb99962f1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:24.240470 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f7486f04-0159-451e-9531-a86c04309f00 req-13eff670-225d-4603-9912-937cb99962f1 service nova] Creating event network-vif-deleted:7d11df58-0218-4b52-87b7-4c5dc9927ca6 for instance 0860ae28-9636-40dd-a79d-bbf608e0a922 on n-h1-852084-10 Sep 08 12:44:24.250789 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f7486f04-0159-451e-9531-a86c04309f00 req-13eff670-225d-4603-9912-937cb99962f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058132 Sep 08 12:44:24.251778 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 727/1421] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:24.258179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3aa01bd0-e12b-4822-9934-9d91297eb317 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:24.259378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3aa01bd0-e12b-4822-9934-9d91297eb317 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 83b2b1b0-2e34-4bbc-9d98-40eec81036ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:24.268451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3aa01bd0-e12b-4822-9934-9d91297eb317 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:24.270406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3aa01bd0-e12b-4822-9934-9d91297eb317 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:24.271900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3aa01bd0-e12b-4822-9934-9d91297eb317 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:24.273837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3aa01bd0-e12b-4822-9934-9d91297eb317 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:24.274650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3aa01bd0-e12b-4822-9934-9d91297eb317 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:24.275453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3aa01bd0-e12b-4822-9934-9d91297eb317 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:24.526560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3aa01bd0-e12b-4822-9934-9d91297eb317 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:24.539938 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3aa01bd0-e12b-4822-9934-9d91297eb317 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac" status: 200 len: 1511 microversion: 2.1 time: 0.286421 Sep 08 12:44:24.555473 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 728/1422] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:24 2022] GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac => generated 1511 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:24.555473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9380aa83-8978-41e3-a23e-66571d22926d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:24.555473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9380aa83-8978-41e3-a23e-66571d22926d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0860ae28-9636-40dd-a79d-bbf608e0a922] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:24.569546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:24.571878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9380aa83-8978-41e3-a23e-66571d22926d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:24.572399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9380aa83-8978-41e3-a23e-66571d22926d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:24.573474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9380aa83-8978-41e3-a23e-66571d22926d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:24.574459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9380aa83-8978-41e3-a23e-66571d22926d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:24.575215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9380aa83-8978-41e3-a23e-66571d22926d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:24.575695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9380aa83-8978-41e3-a23e-66571d22926d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:24.604850 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-9380aa83-8978-41e3-a23e-66571d22926d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] HTTP exception thrown: Instance 0860ae28-9636-40dd-a79d-bbf608e0a922 could not be found. Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9380aa83-8978-41e3-a23e-66571d22926d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Request method failure captured: Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 HTTP/1.1 Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIe4q6vxTgoIzq-Y3nPgGqapZ1PmdB7K5U4PvgSCUH-wx_Bk7v98xm3N5-p87C7FhcseUJga-eaVeNXMwnOG6IaRpZEa8K11T5pXd-mZP4zmke6SHMAnEZsMYpdq1DO3Qu6PrZRR2zMQtGyIfVtc4p0pY5cGWs_AE4qOcLtkPGNGA4 Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 8c3e5d96296342eb8a99953dec8747c0 Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-MigrationsAdminTest-379577382 Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:44:24.607122 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:44:24.609102 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:44:24.609102 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-MigrationsAdminTest-379577382 Sep 08 12:44:24.609102 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 8c3e5d96296342eb8a99953dec8747c0 Sep 08 12:44:24.609102 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-MigrationsAdminTest-379577382 Sep 08 12:44:24.609102 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-MigrationsAdminTest-379577382-project Sep 08 12:44:24.609102 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:44:24.609102 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:44:24.609102 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 81af813dbf5340d0a3d9d4bf0cff3da7 Sep 08 12:44:24.609102 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-MigrationsAdminTest-379577382-project Sep 08 12:44:24.609102 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:44:24.609102 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 0860ae28-9636-40dd-a79d-bbf608e0a922 could not be found. Sep 08 12:44:24.609102 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '0860ae28-9636-40dd-a79d-bbf608e0a922'} Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0860ae28-9636-40dd-a79d-bbf608e0a922 could not be found. Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:44:24.609985 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0860ae28-9636-40dd-a79d-bbf608e0a922 could not be found. Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0860ae28-9636-40dd-a79d-bbf608e0a922 could not be found. Sep 08 12:44:24.612048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:24.613308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9380aa83-8978-41e3-a23e-66571d22926d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Returning 404 to user: Instance 0860ae28-9636-40dd-a79d-bbf608e0a922 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:44:24.613308 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9380aa83-8978-41e3-a23e-66571d22926d tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922" status: 404 len: 111 microversion: 2.1 time: 0.067163 Sep 08 12:44:24.613308 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 729/1423] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:24 2022] GET /compute/v2.1/servers/0860ae28-9636-40dd-a79d-bbf608e0a922 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:44:24.619060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3ae3a475-bde2-43c3-8eb7-5c290ddf5986 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:24.619832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3ae3a475-bde2-43c3-8eb7-5c290ddf5986 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:24.628683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ae3a475-bde2-43c3-8eb7-5c290ddf5986 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:24.629248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ae3a475-bde2-43c3-8eb7-5c290ddf5986 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:24.629842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ae3a475-bde2-43c3-8eb7-5c290ddf5986 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:24.631645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ae3a475-bde2-43c3-8eb7-5c290ddf5986 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:24.632710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ae3a475-bde2-43c3-8eb7-5c290ddf5986 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:24.633193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ae3a475-bde2-43c3-8eb7-5c290ddf5986 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:24.863113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3ae3a475-bde2-43c3-8eb7-5c290ddf5986 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:24.882947 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3ae3a475-bde2-43c3-8eb7-5c290ddf5986 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 200 len: 1510 microversion: 2.1 time: 0.272268 Sep 08 12:44:24.884338 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 730/1424] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:24 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 1510 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:24.908703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ddd4cd3a-6bae-4134-8918-cfedf272cf57 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:24.910597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ddd4cd3a-6bae-4134-8918-cfedf272cf57 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:24.917843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddd4cd3a-6bae-4134-8918-cfedf272cf57 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:24.918634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddd4cd3a-6bae-4134-8918-cfedf272cf57 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:24.919285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddd4cd3a-6bae-4134-8918-cfedf272cf57 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:24.921550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddd4cd3a-6bae-4134-8918-cfedf272cf57 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:24.922030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddd4cd3a-6bae-4134-8918-cfedf272cf57 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:24.922553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddd4cd3a-6bae-4134-8918-cfedf272cf57 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:24.968102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ddd4cd3a-6bae-4134-8918-cfedf272cf57 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:44:25.097494 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ddd4cd3a-6bae-4134-8918-cfedf272cf57 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 204 len: 0 microversion: 2.1 time: 0.194161 Sep 08 12:44:25.099330 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 731/1425] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:44:24 2022] DELETE /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:44:25.113882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:25.124750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:25.127195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:44:25.143704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:25.144663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:25.145530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:25.147393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:25.148195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:25.149109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:25.388455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:44:25.547187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:25.563961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:25.564904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:25.567636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:25.823915 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a872c1dc-e1f5-4910-a2e6-f33c4a1b8b9d tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 4514 microversion: 2.1 time: 0.718944 Sep 08 12:44:25.843965 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 732/1426] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:44:25 2022] GET /compute/v2.1/servers/detail => generated 4514 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:25.855122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dbdb516b-a1b6-4a0a-82e4-fcf65786129b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:25.856543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dbdb516b-a1b6-4a0a-82e4-fcf65786129b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:25.864715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dbdb516b-a1b6-4a0a-82e4-fcf65786129b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:25.865517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dbdb516b-a1b6-4a0a-82e4-fcf65786129b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:25.866222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dbdb516b-a1b6-4a0a-82e4-fcf65786129b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:25.866952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dbdb516b-a1b6-4a0a-82e4-fcf65786129b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:25.867675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dbdb516b-a1b6-4a0a-82e4-fcf65786129b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:25.868284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dbdb516b-a1b6-4a0a-82e4-fcf65786129b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:26.099933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dbdb516b-a1b6-4a0a-82e4-fcf65786129b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:26.109807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:26.113547 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dbdb516b-a1b6-4a0a-82e4-fcf65786129b tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1534 microversion: 2.1 time: 0.268029 Sep 08 12:44:26.114909 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 733/1427] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:25 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1534 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:26.120983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c2f62ad-73b4-4a0b-8b44-737c0e573000 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:26.121874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5c2f62ad-73b4-4a0b-8b44-737c0e573000 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:26.130386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c2f62ad-73b4-4a0b-8b44-737c0e573000 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:26.131331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c2f62ad-73b4-4a0b-8b44-737c0e573000 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:26.132012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c2f62ad-73b4-4a0b-8b44-737c0e573000 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:26.132728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c2f62ad-73b4-4a0b-8b44-737c0e573000 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:26.133185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c2f62ad-73b4-4a0b-8b44-737c0e573000 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:26.133609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c2f62ad-73b4-4a0b-8b44-737c0e573000 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:26.292889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5c2f62ad-73b4-4a0b-8b44-737c0e573000 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:26.317010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5c2f62ad-73b4-4a0b-8b44-737c0e573000 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:26.320297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5c2f62ad-73b4-4a0b-8b44-737c0e573000 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:26.349148 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c2f62ad-73b4-4a0b-8b44-737c0e573000 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1546 microversion: 2.91 time: 0.226127 Sep 08 12:44:26.360893 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 734/1428] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:26 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1546 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:26.382263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5ff3d5e5-a34d-45ec-8d64-7a90e50cc030 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:26.423968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5ff3d5e5-a34d-45ec-8d64-7a90e50cc030 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:26.430128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5ff3d5e5-a34d-45ec-8d64-7a90e50cc030 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:44:26.755896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ff3d5e5-a34d-45ec-8d64-7a90e50cc030 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:26.756748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ff3d5e5-a34d-45ec-8d64-7a90e50cc030 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:26.757519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ff3d5e5-a34d-45ec-8d64-7a90e50cc030 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:26.761818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ff3d5e5-a34d-45ec-8d64-7a90e50cc030 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:26.762882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ff3d5e5-a34d-45ec-8d64-7a90e50cc030 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:26.769896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ff3d5e5-a34d-45ec-8d64-7a90e50cc030 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:26.941042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-5ff3d5e5-a34d-45ec-8d64-7a90e50cc030 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:44:27.068515 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5ff3d5e5-a34d-45ec-8d64-7a90e50cc030 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1011 microversion: 2.1 time: 0.703888 Sep 08 12:44:27.068515 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 735/1429] 10.222.0.78 () {58 vars in 1150 bytes} [Thu Sep 8 12:44:26 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1011 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:27.102309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4da2d7ed-6c12-44c8-ad96-16e9d4151054 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:27.117549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4da2d7ed-6c12-44c8-ad96-16e9d4151054 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:27.119117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4da2d7ed-6c12-44c8-ad96-16e9d4151054 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:44:27.129870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4da2d7ed-6c12-44c8-ad96-16e9d4151054 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:27.130990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4da2d7ed-6c12-44c8-ad96-16e9d4151054 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:27.131948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4da2d7ed-6c12-44c8-ad96-16e9d4151054 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:27.133439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4da2d7ed-6c12-44c8-ad96-16e9d4151054 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:27.134723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4da2d7ed-6c12-44c8-ad96-16e9d4151054 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:27.135672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4da2d7ed-6c12-44c8-ad96-16e9d4151054 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:27.406945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-4da2d7ed-6c12-44c8-ad96-16e9d4151054 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:44:27.554167 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a66101f4-7663-4652-b4c4-9ebc0a70d6c4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d" status: 200 len: 1421 microversion: 2.1 time: 22.724551 Sep 08 12:44:27.557354 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 695/1430] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:44:04 2022] GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d => generated 1421 bytes in 22734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:27.583705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0975ae17-4a80-420b-88f7-6deecc941e26 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:27.585451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0975ae17-4a80-420b-88f7-6deecc941e26 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:27.600778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0975ae17-4a80-420b-88f7-6deecc941e26 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:27.602276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0975ae17-4a80-420b-88f7-6deecc941e26 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:27.603734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0975ae17-4a80-420b-88f7-6deecc941e26 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:27.605526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0975ae17-4a80-420b-88f7-6deecc941e26 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:27.606862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0975ae17-4a80-420b-88f7-6deecc941e26 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:27.608076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0975ae17-4a80-420b-88f7-6deecc941e26 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:27.644234 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4da2d7ed-6c12-44c8-ad96-16e9d4151054 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1011 microversion: 2.1 time: 0.548831 Sep 08 12:44:27.645485 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 736/1431] 10.222.0.78 () {58 vars in 1212 bytes} [Thu Sep 8 12:44:27 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1011 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:27.652944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dcbaca54-7781-4344-9909-6be8cfe08c25 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:27.654049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dcbaca54-7781-4344-9909-6be8cfe08c25 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:27.665313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcbaca54-7781-4344-9909-6be8cfe08c25 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:27.666469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcbaca54-7781-4344-9909-6be8cfe08c25 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:27.667488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcbaca54-7781-4344-9909-6be8cfe08c25 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:27.668668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcbaca54-7781-4344-9909-6be8cfe08c25 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:27.669492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcbaca54-7781-4344-9909-6be8cfe08c25 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:27.670448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcbaca54-7781-4344-9909-6be8cfe08c25 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:27.807419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dcbaca54-7781-4344-9909-6be8cfe08c25 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:27.827453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dcbaca54-7781-4344-9909-6be8cfe08c25 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:27.829968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dcbaca54-7781-4344-9909-6be8cfe08c25 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:27.863126 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dcbaca54-7781-4344-9909-6be8cfe08c25 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1533 microversion: 2.91 time: 0.213921 Sep 08 12:44:27.881757 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 737/1432] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:27 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1533 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:27.901840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-edb0d15f-0aea-4188-840c-53606ad37bfd tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3741aca0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:28.190321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0975ae17-4a80-420b-88f7-6deecc941e26 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:28.219325 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0975ae17-4a80-420b-88f7-6deecc941e26 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 200 len: 1534 microversion: 2.1 time: 0.655959 Sep 08 12:44:28.227734 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 696/1433] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:27 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 1534 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:28.257370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e64884c0-cf03-4813-978b-02b247c0b0c6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:28.307350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e64884c0-cf03-4813-978b-02b247c0b0c6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:28.308975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e64884c0-cf03-4813-978b-02b247c0b0c6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:44:28.348478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e64884c0-cf03-4813-978b-02b247c0b0c6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:28.349370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e64884c0-cf03-4813-978b-02b247c0b0c6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:28.350160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e64884c0-cf03-4813-978b-02b247c0b0c6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:28.352617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e64884c0-cf03-4813-978b-02b247c0b0c6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:28.354475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e64884c0-cf03-4813-978b-02b247c0b0c6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:28.355998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e64884c0-cf03-4813-978b-02b247c0b0c6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:28.637059 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-edb0d15f-0aea-4188-840c-53606ad37bfd tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d" status: 200 len: 1421 microversion: 2.1 time: 0.753361 Sep 08 12:44:28.646827 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 738/1434] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:44:27 2022] GET /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d => generated 1421 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:28.664675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-005be3a8-6140-4019-a76a-bccda2a795d8 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:28.665836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-005be3a8-6140-4019-a76a-bccda2a795d8 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:28.705976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-005be3a8-6140-4019-a76a-bccda2a795d8 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:28.707464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-005be3a8-6140-4019-a76a-bccda2a795d8 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:28.708688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-005be3a8-6140-4019-a76a-bccda2a795d8 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:28.710339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-005be3a8-6140-4019-a76a-bccda2a795d8 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:28.711205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-005be3a8-6140-4019-a76a-bccda2a795d8 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:28.712025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-005be3a8-6140-4019-a76a-bccda2a795d8 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:28.909355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-e64884c0-cf03-4813-978b-02b247c0b0c6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:44:29.027371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-005be3a8-6140-4019-a76a-bccda2a795d8 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] Lazy-loading 'services' on Instance uuid 3a0136c7-9cb3-4446-964d-ea92bc5ff815 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:44:29.083881 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-005be3a8-6140-4019-a76a-bccda2a795d8 tempest-UnshelveToHostMultiNodesTest-250158646 tempest-UnshelveToHostMultiNodesTest-250158646-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1940 microversion: 2.91 time: 0.435293 Sep 08 12:44:29.084761 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 739/1435] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:28 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1940 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:29.130382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e59797bd-2263-492f-bfcf-d7300efcfd1f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36db2310>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:29.170412 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e64884c0-cf03-4813-978b-02b247c0b0c6 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1011 microversion: 2.1 time: 0.940664 Sep 08 12:44:29.171883 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 697/1436] 10.222.0.78 () {58 vars in 1196 bytes} [Thu Sep 8 12:44:28 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1011 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:29.180100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8411dbdb-505c-4047-b239-5777b4621a15 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3b1bfb80>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:29.217541 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e59797bd-2263-492f-bfcf-d7300efcfd1f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/a507ff68-4490-4649-92d8-417de29c876f" status: 200 len: 662 microversion: 2.1 time: 0.102810 Sep 08 12:44:29.219141 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 740/1437] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:44:29 2022] GET /compute/v2.1/images/a507ff68-4490-4649-92d8-417de29c876f => generated 662 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:29.231842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-4ef6a93a-9293-4724-9430-8a5e37ad9107 req-19c6f237-06da-47c6-b0b6-dd7e8f3dc4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bc95339-7b99-439b-8a64-3eeb808b9c77", "name": "network-vif-deleted", "tag": "c88f65d9-eeed-4224-9551-d32c44c05007"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:29.288582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4ef6a93a-9293-4724-9430-8a5e37ad9107 req-19c6f237-06da-47c6-b0b6-dd7e8f3dc4f9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:29.289184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4ef6a93a-9293-4724-9430-8a5e37ad9107 req-19c6f237-06da-47c6-b0b6-dd7e8f3dc4f9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:29.289626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4ef6a93a-9293-4724-9430-8a5e37ad9107 req-19c6f237-06da-47c6-b0b6-dd7e8f3dc4f9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:29.340957 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-4ef6a93a-9293-4724-9430-8a5e37ad9107 req-19c6f237-06da-47c6-b0b6-dd7e8f3dc4f9 service nova] Creating event network-vif-deleted:c88f65d9-eeed-4224-9551-d32c44c05007 for instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 on n-h2-852084-10 Sep 08 12:44:29.365175 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-4ef6a93a-9293-4724-9430-8a5e37ad9107 req-19c6f237-06da-47c6-b0b6-dd7e8f3dc4f9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143886 Sep 08 12:44:29.366084 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 741/1438] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:29.403969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c084b38-7a68-434f-90fe-f5c2346a20f1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:29.404630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5c084b38-7a68-434f-90fe-f5c2346a20f1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:29.465517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c084b38-7a68-434f-90fe-f5c2346a20f1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:29.483477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c084b38-7a68-434f-90fe-f5c2346a20f1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:29.485311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c084b38-7a68-434f-90fe-f5c2346a20f1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:29.489587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c084b38-7a68-434f-90fe-f5c2346a20f1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:29.493992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c084b38-7a68-434f-90fe-f5c2346a20f1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:29.497329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c084b38-7a68-434f-90fe-f5c2346a20f1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:29.601976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5c084b38-7a68-434f-90fe-f5c2346a20f1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:44:29.864786 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c084b38-7a68-434f-90fe-f5c2346a20f1 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 204 len: 0 microversion: 2.91 time: 0.497454 Sep 08 12:44:29.865867 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 742/1439] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:44:29 2022] DELETE /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 12:44:29.888986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8b0bfa8c-cf3f-4d0e-b3a6-bbbd188a5859 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:29.954281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8b0bfa8c-cf3f-4d0e-b3a6-bbbd188a5859 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:29.963780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8b0bfa8c-cf3f-4d0e-b3a6-bbbd188a5859 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'name': '-103820426', 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:44:30.004721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b0bfa8c-cf3f-4d0e-b3a6-bbbd188a5859 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:30.005978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b0bfa8c-cf3f-4d0e-b3a6-bbbd188a5859 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:30.007106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b0bfa8c-cf3f-4d0e-b3a6-bbbd188a5859 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:30.012672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b0bfa8c-cf3f-4d0e-b3a6-bbbd188a5859 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:30.014132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b0bfa8c-cf3f-4d0e-b3a6-bbbd188a5859 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:30.017180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b0bfa8c-cf3f-4d0e-b3a6-bbbd188a5859 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:30.188740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-8b0bfa8c-cf3f-4d0e-b3a6-bbbd188a5859 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:44:30.265109 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8b0bfa8c-cf3f-4d0e-b3a6-bbbd188a5859 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?name=-103820426" status: 200 len: 345 microversion: 2.1 time: 0.397025 Sep 08 12:44:30.275603 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 743/1440] 10.222.0.78 () {58 vars in 1156 bytes} [Thu Sep 8 12:44:29 2022] GET /compute/v2.1/servers?name=-103820426 => generated 345 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:30.286190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ccdca533-304b-4047-b3be-5fef74685110 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3742cca0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:31.076010 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8411dbdb-505c-4047-b239-5777b4621a15 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d" status: 204 len: 0 microversion: 2.1 time: 1.902340 Sep 08 12:44:31.077207 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 698/1441] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:29 2022] DELETE /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d => generated 0 bytes in 1905 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:44:31.086388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e718d051-b359-45ac-8409-cf3a258e8bda tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:31.087123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e718d051-b359-45ac-8409-cf3a258e8bda tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 0bc95339-7b99-439b-8a64-3eeb808b9c77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:31.113785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e718d051-b359-45ac-8409-cf3a258e8bda tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:31.114397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e718d051-b359-45ac-8409-cf3a258e8bda tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:31.115251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e718d051-b359-45ac-8409-cf3a258e8bda tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:31.116583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e718d051-b359-45ac-8409-cf3a258e8bda tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:31.117381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e718d051-b359-45ac-8409-cf3a258e8bda tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:31.118428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e718d051-b359-45ac-8409-cf3a258e8bda tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:31.164168 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e718d051-b359-45ac-8409-cf3a258e8bda tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] HTTP exception thrown: Instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 could not be found. Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e718d051-b359-45ac-8409-cf3a258e8bda tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Request method failure captured: Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 HTTP/1.1 Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIe4q6vxTgoIzq-Y3nPgGqapZ1PmdB7K5U4PvgSCUH-wx_Bk7v98xm3N5-p87C7FhcseUJga-eaVeNXMwnOG6IaRpZEa8K11T5pXd-mZP4zmke6SHMAnEZsMYpdq1DO3Qu6PrZRR2zMQtGyIfVtc4p0pY5cGWs_AE4qOcLtkPGNGA4 Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 8c3e5d96296342eb8a99953dec8747c0 Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-MigrationsAdminTest-379577382 Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:44:31.172547 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:44:31.174962 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:44:31.174962 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-MigrationsAdminTest-379577382 Sep 08 12:44:31.174962 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 8c3e5d96296342eb8a99953dec8747c0 Sep 08 12:44:31.174962 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-MigrationsAdminTest-379577382 Sep 08 12:44:31.174962 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-MigrationsAdminTest-379577382-project Sep 08 12:44:31.174962 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:44:31.174962 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:44:31.174962 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 81af813dbf5340d0a3d9d4bf0cff3da7 Sep 08 12:44:31.174962 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-MigrationsAdminTest-379577382-project Sep 08 12:44:31.174962 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:44:31.174962 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 could not be found. Sep 08 12:44:31.174962 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '0bc95339-7b99-439b-8a64-3eeb808b9c77'} Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 could not be found. Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:44:31.176405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 could not be found. Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 could not be found. Sep 08 12:44:31.178407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:31.180826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e718d051-b359-45ac-8409-cf3a258e8bda tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Returning 404 to user: Instance 0bc95339-7b99-439b-8a64-3eeb808b9c77 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:44:31.182134 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e718d051-b359-45ac-8409-cf3a258e8bda tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77" status: 404 len: 111 microversion: 2.1 time: 0.103452 Sep 08 12:44:31.191864 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 699/1442] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:31 2022] GET /compute/v2.1/servers/0bc95339-7b99-439b-8a64-3eeb808b9c77 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:44:31.199782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6c4cc525-e0bc-4dd1-9b96-1b61588b0cfa tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:31.204765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6c4cc525-e0bc-4dd1-9b96-1b61588b0cfa tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:31.220239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c4cc525-e0bc-4dd1-9b96-1b61588b0cfa tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:31.221439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c4cc525-e0bc-4dd1-9b96-1b61588b0cfa tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:31.222103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c4cc525-e0bc-4dd1-9b96-1b61588b0cfa tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:31.223036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c4cc525-e0bc-4dd1-9b96-1b61588b0cfa tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:31.223732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c4cc525-e0bc-4dd1-9b96-1b61588b0cfa tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:31.224176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c4cc525-e0bc-4dd1-9b96-1b61588b0cfa tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:31.226680 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ccdca533-304b-4047-b3be-5fef74685110 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/a507ff68-4490-4649-92d8-417de29c876f" status: 200 len: 662 microversion: 2.1 time: 0.947916 Sep 08 12:44:31.227784 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 744/1443] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:44:30 2022] GET /compute/v2.1/images/a507ff68-4490-4649-92d8-417de29c876f => generated 662 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:31.269003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9d5c6d49-3fdf-4fac-aa7a-c1943cbd3ac8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:31.281848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d5c6d49-3fdf-4fac-aa7a-c1943cbd3ac8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:31.284230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9d5c6d49-3fdf-4fac-aa7a-c1943cbd3ac8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:44:31.302742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d5c6d49-3fdf-4fac-aa7a-c1943cbd3ac8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:31.307190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d5c6d49-3fdf-4fac-aa7a-c1943cbd3ac8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:31.320335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d5c6d49-3fdf-4fac-aa7a-c1943cbd3ac8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:31.322528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d5c6d49-3fdf-4fac-aa7a-c1943cbd3ac8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:31.323825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d5c6d49-3fdf-4fac-aa7a-c1943cbd3ac8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:31.324956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d5c6d49-3fdf-4fac-aa7a-c1943cbd3ac8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:31.484532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c4cc525-e0bc-4dd1-9b96-1b61588b0cfa tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:31.512433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c4cc525-e0bc-4dd1-9b96-1b61588b0cfa tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:31.520177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c4cc525-e0bc-4dd1-9b96-1b61588b0cfa tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:31.535941 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6c4cc525-e0bc-4dd1-9b96-1b61588b0cfa tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.340586 Sep 08 12:44:31.537203 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 700/1444] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:31 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:31.546636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-41b1e261-0e32-40c5-b9cd-d183c0eedd87 req-a971bb9c-cec1-4b3f-8058-73dbb8267bb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24093877-782e-42db-b41b-90a91e8a11db", "name": "network-vif-unplugged", "status": "completed", "tag": "ef1e04ce-bdbe-4842-a056-a3b1bc3291a5"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:31.567339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-41b1e261-0e32-40c5-b9cd-d183c0eedd87 req-a971bb9c-cec1-4b3f-8058-73dbb8267bb6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:31.572845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-41b1e261-0e32-40c5-b9cd-d183c0eedd87 req-a971bb9c-cec1-4b3f-8058-73dbb8267bb6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:31.574306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-41b1e261-0e32-40c5-b9cd-d183c0eedd87 req-a971bb9c-cec1-4b3f-8058-73dbb8267bb6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:31.609225 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-41b1e261-0e32-40c5-b9cd-d183c0eedd87 req-a971bb9c-cec1-4b3f-8058-73dbb8267bb6 service nova] Creating event network-vif-unplugged:ef1e04ce-bdbe-4842-a056-a3b1bc3291a5 for instance 24093877-782e-42db-b41b-90a91e8a11db on n-h2-852084-10 Sep 08 12:44:31.622145 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-41b1e261-0e32-40c5-b9cd-d183c0eedd87 req-a971bb9c-cec1-4b3f-8058-73dbb8267bb6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081696 Sep 08 12:44:31.624370 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 701/1445] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:31.634770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-9d5c6d49-3fdf-4fac-aa7a-c1943cbd3ac8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:44:31.649543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3e4ecdd8-4b50-46ad-9ae3-73aa0ef20d96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:31.651077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3e4ecdd8-4b50-46ad-9ae3-73aa0ef20d96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:31.677026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e4ecdd8-4b50-46ad-9ae3-73aa0ef20d96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:31.697595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e4ecdd8-4b50-46ad-9ae3-73aa0ef20d96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:31.699743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e4ecdd8-4b50-46ad-9ae3-73aa0ef20d96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:31.702414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e4ecdd8-4b50-46ad-9ae3-73aa0ef20d96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:31.707213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e4ecdd8-4b50-46ad-9ae3-73aa0ef20d96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:31.708263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e4ecdd8-4b50-46ad-9ae3-73aa0ef20d96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:31.744654 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9d5c6d49-3fdf-4fac-aa7a-c1943cbd3ac8 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1011 microversion: 2.1 time: 0.489213 Sep 08 12:44:31.745904 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 745/1446] 10.222.0.78 () {58 vars in 1154 bytes} [Thu Sep 8 12:44:31 2022] GET /compute/v2.1/servers?name=-instance => generated 1011 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:31.752532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2c00414f-4294-47c2-a0d0-2b3e767f5920 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '.version_select at 0x7fdb36d61820>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:31.790105 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2c00414f-4294-47c2-a0d0-2b3e767f5920 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112600229" status: 202 len: 0 microversion: 2.1 time: 0.042207 Sep 08 12:44:31.791739 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 746/1447] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Sep 8 12:44:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2112600229 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:44:31.806298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1cf3a718-9255-4d8c-a91a-a532330aa3aa tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:31.817228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1cf3a718-9255-4d8c-a91a-a532330aa3aa tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:31.818789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1cf3a718-9255-4d8c-a91a-a532330aa3aa tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-10382042', 'deleted': False, 'project_id': '089fe13d64434cd48d0311dfe9d43493'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:44:31.828395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1cf3a718-9255-4d8c-a91a-a532330aa3aa tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:31.829548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1cf3a718-9255-4d8c-a91a-a532330aa3aa tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:31.836548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1cf3a718-9255-4d8c-a91a-a532330aa3aa tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:31.837670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1cf3a718-9255-4d8c-a91a-a532330aa3aa tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:31.838353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1cf3a718-9255-4d8c-a91a-a532330aa3aa tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:31.839403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1cf3a718-9255-4d8c-a91a-a532330aa3aa tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:31.852715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3e4ecdd8-4b50-46ad-9ae3-73aa0ef20d96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:44:32.007335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-1cf3a718-9255-4d8c-a91a-a532330aa3aa tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:44:32.251151 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3e4ecdd8-4b50-46ad-9ae3-73aa0ef20d96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db" status: 204 len: 0 microversion: 2.1 time: 0.623130 Sep 08 12:44:32.257645 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 702/1448] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:44:31 2022] DELETE /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:44:32.268763 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1cf3a718-9255-4d8c-a91a-a532330aa3aa tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-10382042" status: 200 len: 345 microversion: 2.1 time: 0.470342 Sep 08 12:44:32.269617 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 747/1449] 10.222.0.78 () {58 vars in 1226 bytes} [Thu Sep 8 12:44:31 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-10382042 => generated 345 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:32.310249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0facc7b6-71de-4fe5-8f5e-751dd1cbe9f2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:32.312013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0facc7b6-71de-4fe5-8f5e-751dd1cbe9f2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:32.344927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0facc7b6-71de-4fe5-8f5e-751dd1cbe9f2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:32.347205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0facc7b6-71de-4fe5-8f5e-751dd1cbe9f2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:32.348504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0facc7b6-71de-4fe5-8f5e-751dd1cbe9f2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:32.350142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0facc7b6-71de-4fe5-8f5e-751dd1cbe9f2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:32.351349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0facc7b6-71de-4fe5-8f5e-751dd1cbe9f2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:32.352549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0facc7b6-71de-4fe5-8f5e-751dd1cbe9f2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:32.465381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0facc7b6-71de-4fe5-8f5e-751dd1cbe9f2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:44:32.586245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7ac7b4d5-1522-42ad-9c1d-3a47ba46f246 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:32.589248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7ac7b4d5-1522-42ad-9c1d-3a47ba46f246 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:32.634120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ac7b4d5-1522-42ad-9c1d-3a47ba46f246 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:32.637265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ac7b4d5-1522-42ad-9c1d-3a47ba46f246 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:32.638645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ac7b4d5-1522-42ad-9c1d-3a47ba46f246 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:32.639979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ac7b4d5-1522-42ad-9c1d-3a47ba46f246 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:32.640860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ac7b4d5-1522-42ad-9c1d-3a47ba46f246 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:32.653276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ac7b4d5-1522-42ad-9c1d-3a47ba46f246 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:32.704295 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0facc7b6-71de-4fe5-8f5e-751dd1cbe9f2 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 204 len: 0 microversion: 2.1 time: 0.407574 Sep 08 12:44:32.716430 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 703/1450] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:44:32 2022] DELETE /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:44:32.747501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-529124171", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "58f4da24-cf42-4565-9c74-ba91eb9335e3"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:32.995118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ac7b4d5-1522-42ad-9c1d-3a47ba46f246 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:33.038749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ac7b4d5-1522-42ad-9c1d-3a47ba46f246 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:33.042886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ac7b4d5-1522-42ad-9c1d-3a47ba46f246 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:33.072193 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7ac7b4d5-1522-42ad-9c1d-3a47ba46f246 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1539 microversion: 2.91 time: 0.496324 Sep 08 12:44:33.079442 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 748/1451] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:32 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1539 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:33.099664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1948e0f5-8f65-4183-9a29-6b86db8b6209 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:33.107501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1948e0f5-8f65-4183-9a29-6b86db8b6209 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:33.132431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1948e0f5-8f65-4183-9a29-6b86db8b6209 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:33.140077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1948e0f5-8f65-4183-9a29-6b86db8b6209 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:33.141398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1948e0f5-8f65-4183-9a29-6b86db8b6209 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:33.149036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1948e0f5-8f65-4183-9a29-6b86db8b6209 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:33.150464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1948e0f5-8f65-4183-9a29-6b86db8b6209 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:33.151613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1948e0f5-8f65-4183-9a29-6b86db8b6209 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:33.671155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] validate_networks() for [('58f4da24-cf42-4565-9c74-ba91eb9335e3', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:44:33.987448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1948e0f5-8f65-4183-9a29-6b86db8b6209 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:34.004339 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1948e0f5-8f65-4183-9a29-6b86db8b6209 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 200 len: 1516 microversion: 2.1 time: 0.920921 Sep 08 12:44:34.005270 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 749/1452] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:33 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 1516 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:34.010464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1531bf80-c4f6-4bad-a490-4183f3794c49 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36464700>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:34.104850 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1531bf80-c4f6-4bad-a490-4183f3794c49 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ab07099f-9d61-46f0-915f-c5e4ff4839b1" status: 200 len: 661 microversion: 2.1 time: 0.098429 Sep 08 12:44:34.118499 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 750/1453] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:44:34 2022] GET /compute/v2.1/images/ab07099f-9d61-46f0-915f-c5e4ff4839b1 => generated 661 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:34.177300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a33b5ee8-05c4-4b1c-82d2-eaac29c276c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:34.178351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a33b5ee8-05c4-4b1c-82d2-eaac29c276c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:34.204426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a33b5ee8-05c4-4b1c-82d2-eaac29c276c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:34.205375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a33b5ee8-05c4-4b1c-82d2-eaac29c276c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:34.206127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a33b5ee8-05c4-4b1c-82d2-eaac29c276c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:34.207446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a33b5ee8-05c4-4b1c-82d2-eaac29c276c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:34.208243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a33b5ee8-05c4-4b1c-82d2-eaac29c276c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:34.208969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a33b5ee8-05c4-4b1c-82d2-eaac29c276c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:34.328337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a33b5ee8-05c4-4b1c-82d2-eaac29c276c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:44:34.455445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:34.574465 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a33b5ee8-05c4-4b1c-82d2-eaac29c276c5 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 204 len: 0 microversion: 2.1 time: 0.454170 Sep 08 12:44:34.577866 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 751/1454] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:44:34 2022] DELETE /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:44:34.597373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:34.602477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:34.620015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:34.621328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:34.622354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:34.624481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:34.625576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:34.626569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:34.795562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:34.795929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:34.796383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:34.796848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lazy-loading 'fault' on Instance uuid 3a0136c7-9cb3-4446-964d-ea92bc5ff815 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:44:34.886520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:34.905305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:34.908495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39fff7dbe63845da84919aca5522e37d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '105d37caed90426aacdeb70033333269', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:34.925356 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2b7866dc-5841-4dae-89dd-d99632f5580f tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 200 len: 1544 microversion: 2.91 time: 0.337061 Sep 08 12:44:34.926170 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 752/1455] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:34 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 1544 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:34.939825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c10d362-293f-4d68-8394-9c04a4002c97 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb364015e0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:35.083198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:44:35.084053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:44:35.084372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:44:35.085073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:44:35.085885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:44:35.111893 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6c10d362-293f-4d68-8394-9c04a4002c97 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ab07099f-9d61-46f0-915f-c5e4ff4839b1" status: 200 len: 661 microversion: 2.1 time: 0.179112 Sep 08 12:44:35.114202 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 753/1456] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:44:34 2022] GET /compute/v2.1/images/ab07099f-9d61-46f0-915f-c5e4ff4839b1 => generated 661 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:35.127455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:35.128436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:35.130227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:35.132382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:35.136022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:35.136799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:35.188589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b65b6f4b-76be-4ede-9594-c9051f37d46a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:35.189904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b65b6f4b-76be-4ede-9594-c9051f37d46a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:35.198167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Getting quotas for project c486d69d062749c7b334423a3a89cc13. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:44:35.210139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Getting quotas for user b1900295263741188d26b49e7e8b4036 and project c486d69d062749c7b334423a3a89cc13. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:44:35.211356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b65b6f4b-76be-4ede-9594-c9051f37d46a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:35.211896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b65b6f4b-76be-4ede-9594-c9051f37d46a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:35.212347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b65b6f4b-76be-4ede-9594-c9051f37d46a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:35.213109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b65b6f4b-76be-4ede-9594-c9051f37d46a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:35.213572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b65b6f4b-76be-4ede-9594-c9051f37d46a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:35.214074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b65b6f4b-76be-4ede-9594-c9051f37d46a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:35.232301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:44:35.237322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:44:35.318343 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d5a8e528-6db5-4a6f-92f7-c5502bf7e975 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.597526 Sep 08 12:44:35.319944 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 704/1457] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:44:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:44:35.326481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-89398451-2351-4783-804e-69f9dc9399c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:35.327495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-89398451-2351-4783-804e-69f9dc9399c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:35.340860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89398451-2351-4783-804e-69f9dc9399c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:35.342156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89398451-2351-4783-804e-69f9dc9399c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:35.343112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89398451-2351-4783-804e-69f9dc9399c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:35.345706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89398451-2351-4783-804e-69f9dc9399c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:35.346977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89398451-2351-4783-804e-69f9dc9399c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:35.348262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89398451-2351-4783-804e-69f9dc9399c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:35.918345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:37.076612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-89398451-2351-4783-804e-69f9dc9399c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:37.120700 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-89398451-2351-4783-804e-69f9dc9399c1 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 200 len: 1516 microversion: 2.1 time: 1.797762 Sep 08 12:44:37.125125 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 705/1458] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:35 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 1516 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:37.162704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0eb5ef1b-207c-4dee-b7a8-d6aa825b7a5c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:37.165755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0eb5ef1b-207c-4dee-b7a8-d6aa825b7a5c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:37.780285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0eb5ef1b-207c-4dee-b7a8-d6aa825b7a5c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:37.801536 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0eb5ef1b-207c-4dee-b7a8-d6aa825b7a5c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1207 microversion: 2.1 time: 0.671996 Sep 08 12:44:37.805770 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 706/1459] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:37 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1207 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:37.823861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a651e757-cc0e-4a04-b648-cc456e8d7777 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:37.828199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b65b6f4b-76be-4ede-9594-c9051f37d46a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:37.842312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a651e757-cc0e-4a04-b648-cc456e8d7777 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] [instance: 3a0136c7-9cb3-4446-964d-ea92bc5ff815] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:37.853264 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b65b6f4b-76be-4ede-9594-c9051f37d46a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1469 microversion: 2.1 time: 2.735749 Sep 08 12:44:37.868581 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 754/1460] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:35 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1469 bytes in 2753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:37.896668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a651e757-cc0e-4a04-b648-cc456e8d7777 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:37.897535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a651e757-cc0e-4a04-b648-cc456e8d7777 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:37.899145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-98ef6da4-1289-4ef1-9f3f-f5fad2211833 req-a7c78273-886e-4ba2-9001-667f0a516a5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24093877-782e-42db-b41b-90a91e8a11db", "name": "network-vif-deleted", "tag": "ef1e04ce-bdbe-4842-a056-a3b1bc3291a5"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:37.900276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a651e757-cc0e-4a04-b648-cc456e8d7777 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:37.904603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a651e757-cc0e-4a04-b648-cc456e8d7777 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:37.905604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a651e757-cc0e-4a04-b648-cc456e8d7777 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:37.906239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a651e757-cc0e-4a04-b648-cc456e8d7777 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:37.920788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-98ef6da4-1289-4ef1-9f3f-f5fad2211833 req-a7c78273-886e-4ba2-9001-667f0a516a5d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:37.921409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-98ef6da4-1289-4ef1-9f3f-f5fad2211833 req-a7c78273-886e-4ba2-9001-667f0a516a5d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:37.928494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-98ef6da4-1289-4ef1-9f3f-f5fad2211833 req-a7c78273-886e-4ba2-9001-667f0a516a5d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:37.964337 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-a651e757-cc0e-4a04-b648-cc456e8d7777 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] HTTP exception thrown: Instance 3a0136c7-9cb3-4446-964d-ea92bc5ff815 could not be found. Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a651e757-cc0e-4a04-b648-cc456e8d7777 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Request method failure captured: Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 HTTP/1.1 Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeK_ZE7UqUiG9hySNCb0-xQ_97X5q-kPdHV8uFNq_Hi4-jKKwHX7xWhh9-UaQE-9P2ElGLxMQKeif6zIM9O4BneHBbpx4iU5haX5Jpw0xq6Eqp5fWs68QIEY3m7N-mSErrkTtUV_UGoxw9ynP7sLb2dnLXhYBe5dwZamdJUYXboWCF0 Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.91 Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 105d37caed90426aacdeb70033333269 Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-329127654 Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:44:37.966106 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:44:37.968043 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_105d37caed90426aacdeb70033333269"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/105d37caed90426aacdeb70033333269"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/105d37caed90426aacdeb70033333269"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/105d37caed90426aacdeb70033333269"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:44:37.968043 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-329127654 Sep 08 12:44:37.968043 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 105d37caed90426aacdeb70033333269 Sep 08 12:44:37.968043 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-329127654 Sep 08 12:44:37.968043 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-UnshelveToHostMultiNodesTest-329127654-project Sep 08 12:44:37.968043 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:44:37.968043 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:44:37.968043 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 39fff7dbe63845da84919aca5522e37d Sep 08 12:44:37.968043 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-329127654-project Sep 08 12:44:37.968043 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:44:37.968043 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 3a0136c7-9cb3-4446-964d-ea92bc5ff815 could not be found. Sep 08 12:44:37.968043 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '3a0136c7-9cb3-4446-964d-ea92bc5ff815'} Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a0136c7-9cb3-4446-964d-ea92bc5ff815 could not be found. Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:44:37.969118 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a0136c7-9cb3-4446-964d-ea92bc5ff815 could not be found. Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a0136c7-9cb3-4446-964d-ea92bc5ff815 could not be found. Sep 08 12:44:37.970984 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:37.972738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a651e757-cc0e-4a04-b648-cc456e8d7777 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] Returning 404 to user: Instance 3a0136c7-9cb3-4446-964d-ea92bc5ff815 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:44:37.972738 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a651e757-cc0e-4a04-b648-cc456e8d7777 tempest-UnshelveToHostMultiNodesTest-329127654 tempest-UnshelveToHostMultiNodesTest-329127654-project] 10.222.0.78 "GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815" status: 404 len: 111 microversion: 2.91 time: 0.160963 Sep 08 12:44:37.979966 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 707/1461] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:37 2022] GET /compute/v2.1/servers/3a0136c7-9cb3-4446-964d-ea92bc5ff815 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:44:37.991009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-19cf7eeb-854b-4a3b-9dd6-522524a9e64c tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3ac034c0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:38.015400 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-98ef6da4-1289-4ef1-9f3f-f5fad2211833 req-a7c78273-886e-4ba2-9001-667f0a516a5d service nova] Creating event network-vif-deleted:ef1e04ce-bdbe-4842-a056-a3b1bc3291a5 for instance 24093877-782e-42db-b41b-90a91e8a11db on n-h2-852084-10 Sep 08 12:44:38.048079 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-98ef6da4-1289-4ef1-9f3f-f5fad2211833 req-a7c78273-886e-4ba2-9001-667f0a516a5d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172046 Sep 08 12:44:38.058567 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 755/1462] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:38.084131 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-19cf7eeb-854b-4a3b-9dd6-522524a9e64c tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/a1d06a04-8a26-43af-9c62-159a9d52af88" status: 200 len: 662 microversion: 2.1 time: 0.101827 Sep 08 12:44:38.085005 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 708/1463] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:44:37 2022] GET /compute/v2.1/images/a1d06a04-8a26-43af-9c62-159a9d52af88 => generated 662 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:38.111955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0bddf4c0-242d-4b51-ab87-eeca2b908f69 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36401a60>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:38.169895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-31000ca9-9ad3-4626-a284-03ab5e22eccb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:38.170953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-31000ca9-9ad3-4626-a284-03ab5e22eccb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:38.187779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31000ca9-9ad3-4626-a284-03ab5e22eccb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:38.189911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31000ca9-9ad3-4626-a284-03ab5e22eccb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:38.191077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31000ca9-9ad3-4626-a284-03ab5e22eccb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:38.192634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31000ca9-9ad3-4626-a284-03ab5e22eccb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:38.194727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31000ca9-9ad3-4626-a284-03ab5e22eccb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:38.197303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31000ca9-9ad3-4626-a284-03ab5e22eccb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:38.229923 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0bddf4c0-242d-4b51-ab87-eeca2b908f69 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/a1d06a04-8a26-43af-9c62-159a9d52af88" status: 200 len: 662 microversion: 2.1 time: 0.126295 Sep 08 12:44:38.231843 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 756/1464] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:44:38 2022] GET /compute/v2.1/images/a1d06a04-8a26-43af-9c62-159a9d52af88 => generated 662 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:38.345141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1647891037", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:38.504626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:44:38.525435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-31000ca9-9ad3-4626-a284-03ab5e22eccb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:38.542907 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-31000ca9-9ad3-4626-a284-03ab5e22eccb tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 200 len: 1474 microversion: 2.1 time: 0.377117 Sep 08 12:44:38.546665 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 709/1465] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:38 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 1474 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:38.770438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-69b8fe27-8cd2-4f23-b664-9169d4f27da7 req-fc329144-73d6-465c-93b7-8ce026593779 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9195ae17-364a-4f94-8842-296c9f1b9a7e", "name": "network-vif-deleted", "tag": "e8d6e8c5-d6c1-474a-ad8e-18a25c148aeb"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:38.817254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-69b8fe27-8cd2-4f23-b664-9169d4f27da7 req-fc329144-73d6-465c-93b7-8ce026593779 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:38.819459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-69b8fe27-8cd2-4f23-b664-9169d4f27da7 req-fc329144-73d6-465c-93b7-8ce026593779 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:38.820627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-69b8fe27-8cd2-4f23-b664-9169d4f27da7 req-fc329144-73d6-465c-93b7-8ce026593779 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:38.862109 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-69b8fe27-8cd2-4f23-b664-9169d4f27da7 req-fc329144-73d6-465c-93b7-8ce026593779 service nova] Creating event network-vif-deleted:e8d6e8c5-d6c1-474a-ad8e-18a25c148aeb for instance 9195ae17-364a-4f94-8842-296c9f1b9a7e on n-h2-852084-10 Sep 08 12:44:38.877513 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-69b8fe27-8cd2-4f23-b664-9169d4f27da7 req-fc329144-73d6-465c-93b7-8ce026593779 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112185 Sep 08 12:44:38.878945 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 710/1466] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:38.892017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-69db9adb-ae6c-4117-a7d3-e4f2da50aad2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:38.909636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-69db9adb-ae6c-4117-a7d3-e4f2da50aad2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:38.949185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69db9adb-ae6c-4117-a7d3-e4f2da50aad2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:38.952001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69db9adb-ae6c-4117-a7d3-e4f2da50aad2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:38.956752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69db9adb-ae6c-4117-a7d3-e4f2da50aad2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:38.959391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69db9adb-ae6c-4117-a7d3-e4f2da50aad2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:38.965682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69db9adb-ae6c-4117-a7d3-e4f2da50aad2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:38.966615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69db9adb-ae6c-4117-a7d3-e4f2da50aad2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:39.562923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-69db9adb-ae6c-4117-a7d3-e4f2da50aad2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:39.591530 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-69db9adb-ae6c-4117-a7d3-e4f2da50aad2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1259 microversion: 2.1 time: 0.708445 Sep 08 12:44:39.599718 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 711/1467] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:38 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1259 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:39.625337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d0aac079-ba06-4592-a280-7d97337a5151 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:39.629717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d0aac079-ba06-4592-a280-7d97337a5151 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:39.654690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0aac079-ba06-4592-a280-7d97337a5151 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:39.655307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0aac079-ba06-4592-a280-7d97337a5151 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:39.655957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0aac079-ba06-4592-a280-7d97337a5151 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:39.657201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0aac079-ba06-4592-a280-7d97337a5151 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:39.658301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0aac079-ba06-4592-a280-7d97337a5151 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:39.659991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0aac079-ba06-4592-a280-7d97337a5151 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:39.718512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:44:39.719419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:44:39.719604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:44:39.720159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:44:39.720594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:44:39.748962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:39.749478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:39.749953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:39.750717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:39.760472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:39.761198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:39.797467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=19 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:39.846483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Getting quotas for project 0907b16c3dc14e1da57160d1528ce871. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:44:39.879899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Getting quotas for user 17f8a317d282493493d44ceab17bbe23 and project 0907b16c3dc14e1da57160d1528ce871. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:44:39.922299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d0aac079-ba06-4592-a280-7d97337a5151 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:39.926300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:44:39.931712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 810cd6cb-eab9-4427-aa03-597406fd20f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:44:40.001955 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d0aac079-ba06-4592-a280-7d97337a5151 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1427 microversion: 2.1 time: 0.391514 Sep 08 12:44:40.005991 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 712/1468] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:39 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1427 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:40.049282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:40.054482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:40.155766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:40.169761 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-804142be-5457-4a70-9214-158b907812fa tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.830037 Sep 08 12:44:40.170453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:40.173078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:40.175059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:40.181381 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 757/1469] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:44:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 12:44:40.202874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:40.204209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:40.443587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:40.444958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:40.448241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:40.449121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lazy-loading 'fault' on Instance uuid 9195ae17-364a-4f94-8842-296c9f1b9a7e {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:44:40.625382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d2858d4b-1593-456e-b29a-3716d12a943f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:40.627795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d2858d4b-1593-456e-b29a-3716d12a943f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:40.660252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2858d4b-1593-456e-b29a-3716d12a943f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:40.662563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2858d4b-1593-456e-b29a-3716d12a943f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:40.666365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2858d4b-1593-456e-b29a-3716d12a943f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:40.673145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2858d4b-1593-456e-b29a-3716d12a943f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:40.677462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2858d4b-1593-456e-b29a-3716d12a943f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:40.679006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2858d4b-1593-456e-b29a-3716d12a943f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:40.746767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:40.764914 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1bd5d50e-90c2-4fb8-8388-823c33910b11 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 200 len: 1311 microversion: 2.1 time: 0.752383 Sep 08 12:44:40.796239 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 713/1470] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:40 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 1311 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:40.837443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-637377758", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:40.850124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d2858d4b-1593-456e-b29a-3716d12a943f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:40.861857 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d2858d4b-1593-456e-b29a-3716d12a943f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1265 microversion: 2.1 time: 0.240508 Sep 08 12:44:40.863553 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 758/1471] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:40 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:40.946159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:44:40.969528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ffdf2388-dc7f-4fef-9a9c-2b169005c548 req-22de7179-bc18-4306-8fd3-4db129e25611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cca9ba42-71fb-4d52-a831-4c5e4ac02c81", "name": "network-vif-deleted", "tag": "0d33a618-1a67-43bf-9f68-aca849e7e550"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:41.014180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ffdf2388-dc7f-4fef-9a9c-2b169005c548 req-22de7179-bc18-4306-8fd3-4db129e25611 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:41.015209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ffdf2388-dc7f-4fef-9a9c-2b169005c548 req-22de7179-bc18-4306-8fd3-4db129e25611 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:41.017562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ffdf2388-dc7f-4fef-9a9c-2b169005c548 req-22de7179-bc18-4306-8fd3-4db129e25611 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:41.081658 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ffdf2388-dc7f-4fef-9a9c-2b169005c548 req-22de7179-bc18-4306-8fd3-4db129e25611 service nova] Creating event network-vif-deleted:0d33a618-1a67-43bf-9f68-aca849e7e550 for instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 on n-h1-852084-10 Sep 08 12:44:41.103300 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ffdf2388-dc7f-4fef-9a9c-2b169005c548 req-22de7179-bc18-4306-8fd3-4db129e25611 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139494 Sep 08 12:44:41.121814 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 759/1472] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:44:41.152029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:41.157495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:41.191350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:41.191857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:41.192298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:41.205662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:41.206291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:41.206746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:41.403700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:41.404221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:41.404735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:41.405379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lazy-loading 'fault' on Instance uuid cca9ba42-71fb-4d52-a831-4c5e4ac02c81 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:44:41.749345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:41.800156 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-211ae99a-5173-4b42-a6c3-733099ed822a tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 200 len: 1303 microversion: 2.1 time: 0.674885 Sep 08 12:44:41.809266 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 760/1473] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:41 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 1303 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:41.827162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-03aa3936-532e-4d15-9279-86fd470cca47 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:41.837256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-03aa3936-532e-4d15-9279-86fd470cca47 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 9195ae17-364a-4f94-8842-296c9f1b9a7e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:41.890889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:41.907266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03aa3936-532e-4d15-9279-86fd470cca47 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:41.910765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03aa3936-532e-4d15-9279-86fd470cca47 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:41.912865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03aa3936-532e-4d15-9279-86fd470cca47 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:41.917123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03aa3936-532e-4d15-9279-86fd470cca47 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:41.922086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03aa3936-532e-4d15-9279-86fd470cca47 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:41.935333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03aa3936-532e-4d15-9279-86fd470cca47 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:42.063424 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-03aa3936-532e-4d15-9279-86fd470cca47 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] HTTP exception thrown: Instance 9195ae17-364a-4f94-8842-296c9f1b9a7e could not be found. Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-03aa3936-532e-4d15-9279-86fd470cca47 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Request method failure captured: Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e HTTP/1.1 Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeNCUJnZl9yJYasgBWX9M-UgQFLb8IakYGT5bqR_k_KqhclHMuVY2NEsDbNZ2AuHFbqpjFUDmQCxEhivtXSNvnLY68iEe9H_UZ-4AP5txitTbp0ssj3JfiUT8JCGRCqv_Xj7MCk-YLOMqfXFAymOjEwP4y8uVPD9xUzUEzjbDfEVZ2A Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 089fe13d64434cd48d0311dfe9d43493 Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ListServerFiltersTestJSON-1802960894 Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:44:42.072745 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:44:42.074637 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_089fe13d64434cd48d0311dfe9d43493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/089fe13d64434cd48d0311dfe9d43493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089fe13d64434cd48d0311dfe9d43493"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089fe13d64434cd48d0311dfe9d43493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:44:42.074637 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ListServerFiltersTestJSON-1802960894 Sep 08 12:44:42.074637 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 089fe13d64434cd48d0311dfe9d43493 Sep 08 12:44:42.074637 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1802960894 Sep 08 12:44:42.074637 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ListServerFiltersTestJSON-1802960894-project Sep 08 12:44:42.074637 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:44:42.074637 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:44:42.074637 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: fe4e7ae0a8b34345986479e340102892 Sep 08 12:44:42.074637 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ListServerFiltersTestJSON-1802960894-project Sep 08 12:44:42.074637 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:44:42.074637 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 9195ae17-364a-4f94-8842-296c9f1b9a7e could not be found. Sep 08 12:44:42.074637 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '9195ae17-364a-4f94-8842-296c9f1b9a7e'} Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9195ae17-364a-4f94-8842-296c9f1b9a7e could not be found. Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:44:42.075691 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9195ae17-364a-4f94-8842-296c9f1b9a7e could not be found. Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9195ae17-364a-4f94-8842-296c9f1b9a7e could not be found. Sep 08 12:44:42.077316 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:42.082072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-03aa3936-532e-4d15-9279-86fd470cca47 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Returning 404 to user: Instance 9195ae17-364a-4f94-8842-296c9f1b9a7e could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:44:42.084005 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-03aa3936-532e-4d15-9279-86fd470cca47 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e" status: 404 len: 111 microversion: 2.1 time: 0.272704 Sep 08 12:44:42.088779 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 761/1474] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:41 2022] GET /compute/v2.1/servers/9195ae17-364a-4f94-8842-296c9f1b9a7e => generated 111 bytes in 279 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:44:42.113791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-17479251-ef64-4e24-9686-8bf3f60245af tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:42.118494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-17479251-ef64-4e24-9686-8bf3f60245af tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:42.159689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17479251-ef64-4e24-9686-8bf3f60245af tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:42.161646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17479251-ef64-4e24-9686-8bf3f60245af tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:42.165580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17479251-ef64-4e24-9686-8bf3f60245af tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:42.169575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17479251-ef64-4e24-9686-8bf3f60245af tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:42.178687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17479251-ef64-4e24-9686-8bf3f60245af tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:42.179482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17479251-ef64-4e24-9686-8bf3f60245af tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:42.218904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:44:42.221110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:44:42.222613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:44:42.224697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:44:42.226468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:44:42.263843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:42.268686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:42.269890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:42.272028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:42.276566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:42.278172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:42.361348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Getting quotas for project 0907b16c3dc14e1da57160d1528ce871. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:44:42.381638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Getting quotas for user 17f8a317d282493493d44ceab17bbe23 and project 0907b16c3dc14e1da57160d1528ce871. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:44:42.440374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:44:42.448705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:44:42.669074 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c0a479b2-4cc8-47b0-b368-6534b1267867 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.834854 Sep 08 12:44:42.681554 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 714/1475] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:44:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1839 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:44:42.739281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f3e96171-fc14-4272-877d-3c6892a811e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:42.742331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f3e96171-fc14-4272-877d-3c6892a811e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 83b2b1b0-2e34-4bbc-9d98-40eec81036ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:42.819401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3e96171-fc14-4272-877d-3c6892a811e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:42.820035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3e96171-fc14-4272-877d-3c6892a811e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:42.820493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3e96171-fc14-4272-877d-3c6892a811e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:42.821275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3e96171-fc14-4272-877d-3c6892a811e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:42.835952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3e96171-fc14-4272-877d-3c6892a811e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:42.836693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3e96171-fc14-4272-877d-3c6892a811e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:42.992770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:43.013402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f3e96171-fc14-4272-877d-3c6892a811e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 83b2b1b0-2e34-4bbc-9d98-40eec81036ac] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:44:43.043562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-17479251-ef64-4e24-9686-8bf3f60245af tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:43.058658 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-17479251-ef64-4e24-9686-8bf3f60245af tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1307 microversion: 2.1 time: 0.967728 Sep 08 12:44:43.059298 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 762/1476] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:42 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1307 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:43.086456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d6bf1797-c62a-4bf5-b1e1-b296321c9d29 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:43.087400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d6bf1797-c62a-4bf5-b1e1-b296321c9d29 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:43.352460 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f3e96171-fc14-4272-877d-3c6892a811e4 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "DELETE /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac" status: 204 len: 0 microversion: 2.1 time: 0.674404 Sep 08 12:44:43.358216 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 715/1477] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:44:42 2022] DELETE /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac => generated 0 bytes in 681 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:44:43.368991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d14aa78-a4f8-45e3-b224-09c3ce7f097f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:43.369728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1d14aa78-a4f8-45e3-b224-09c3ce7f097f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: cca9ba42-71fb-4d52-a831-4c5e4ac02c81] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:43.386712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d6bf1797-c62a-4bf5-b1e1-b296321c9d29 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:43.386973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d14aa78-a4f8-45e3-b224-09c3ce7f097f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:43.389661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d14aa78-a4f8-45e3-b224-09c3ce7f097f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:43.390355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d14aa78-a4f8-45e3-b224-09c3ce7f097f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:43.396758 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d6bf1797-c62a-4bf5-b1e1-b296321c9d29 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1217 microversion: 2.1 time: 0.315095 Sep 08 12:44:43.397170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d14aa78-a4f8-45e3-b224-09c3ce7f097f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:43.397357 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 763/1478] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:43 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1217 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:43.401573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d14aa78-a4f8-45e3-b224-09c3ce7f097f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:43.408843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d14aa78-a4f8-45e3-b224-09c3ce7f097f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:43.426259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-49e2bd8b-e7ec-460a-b74d-acd25e62df89 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:43.426894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-49e2bd8b-e7ec-460a-b74d-acd25e62df89 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 83b2b1b0-2e34-4bbc-9d98-40eec81036ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:43.467163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-49e2bd8b-e7ec-460a-b74d-acd25e62df89 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:43.467803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-49e2bd8b-e7ec-460a-b74d-acd25e62df89 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:43.468270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-49e2bd8b-e7ec-460a-b74d-acd25e62df89 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:43.473711 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1d14aa78-a4f8-45e3-b224-09c3ce7f097f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] HTTP exception thrown: Instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 could not be found. Sep 08 12:44:43.474009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-49e2bd8b-e7ec-460a-b74d-acd25e62df89 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:43.474341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-49e2bd8b-e7ec-460a-b74d-acd25e62df89 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:43.479147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-49e2bd8b-e7ec-460a-b74d-acd25e62df89 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d14aa78-a4f8-45e3-b224-09c3ce7f097f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Request method failure captured: Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 HTTP/1.1 Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeIe4q6vxTgoIzq-Y3nPgGqapZ1PmdB7K5U4PvgSCUH-wx_Bk7v98xm3N5-p87C7FhcseUJga-eaVeNXMwnOG6IaRpZEa8K11T5pXd-mZP4zmke6SHMAnEZsMYpdq1DO3Qu6PrZRR2zMQtGyIfVtc4p0pY5cGWs_AE4qOcLtkPGNGA4 Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 8c3e5d96296342eb8a99953dec8747c0 Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-MigrationsAdminTest-379577382 Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:44:43.485570 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:44:43.488765 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:44:43.488765 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-MigrationsAdminTest-379577382 Sep 08 12:44:43.488765 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 8c3e5d96296342eb8a99953dec8747c0 Sep 08 12:44:43.488765 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-MigrationsAdminTest-379577382 Sep 08 12:44:43.488765 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-MigrationsAdminTest-379577382-project Sep 08 12:44:43.488765 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:44:43.488765 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:44:43.488765 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 81af813dbf5340d0a3d9d4bf0cff3da7 Sep 08 12:44:43.488765 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-MigrationsAdminTest-379577382-project Sep 08 12:44:43.488765 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:44:43.488765 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 could not be found. Sep 08 12:44:43.488765 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'cca9ba42-71fb-4d52-a831-4c5e4ac02c81'} Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 could not be found. Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:44:43.490405 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 could not be found. Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 could not be found. Sep 08 12:44:43.493325 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:44:43.501444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d14aa78-a4f8-45e3-b224-09c3ce7f097f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Returning 404 to user: Instance cca9ba42-71fb-4d52-a831-4c5e4ac02c81 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:44:43.505115 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1d14aa78-a4f8-45e3-b224-09c3ce7f097f tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81" status: 404 len: 111 microversion: 2.1 time: 0.147636 Sep 08 12:44:43.511425 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 716/1479] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:43 2022] GET /compute/v2.1/servers/cca9ba42-71fb-4d52-a831-4c5e4ac02c81 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:44:43.535147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d982167-614c-493f-b847-0fccd67a706c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:43.543402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d982167-614c-493f-b847-0fccd67a706c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:43.570752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d982167-614c-493f-b847-0fccd67a706c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:43.572091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d982167-614c-493f-b847-0fccd67a706c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:43.577174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d982167-614c-493f-b847-0fccd67a706c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:43.578915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d982167-614c-493f-b847-0fccd67a706c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:43.583424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d982167-614c-493f-b847-0fccd67a706c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:43.584591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d982167-614c-493f-b847-0fccd67a706c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:43.702360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d982167-614c-493f-b847-0fccd67a706c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:44:43.993278 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d982167-614c-493f-b847-0fccd67a706c tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 204 len: 0 microversion: 2.1 time: 0.475802 Sep 08 12:44:43.993917 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 717/1480] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:44:43 2022] DELETE /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:44:44.019600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-65233c14-2211-47f5-86cf-5eb7a30a2e35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:44.023630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-65233c14-2211-47f5-86cf-5eb7a30a2e35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:44.039325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=4,nova_api:INSERT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:44.059519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65233c14-2211-47f5-86cf-5eb7a30a2e35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:44.060651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65233c14-2211-47f5-86cf-5eb7a30a2e35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:44.061354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65233c14-2211-47f5-86cf-5eb7a30a2e35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:44.065212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65233c14-2211-47f5-86cf-5eb7a30a2e35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:44.067996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65233c14-2211-47f5-86cf-5eb7a30a2e35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:44.068700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65233c14-2211-47f5-86cf-5eb7a30a2e35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:44.783422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-49e2bd8b-e7ec-460a-b74d-acd25e62df89 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:44.822633 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-49e2bd8b-e7ec-460a-b74d-acd25e62df89 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac" status: 200 len: 1517 microversion: 2.1 time: 1.419981 Sep 08 12:44:44.847592 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 764/1481] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:43 2022] GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac => generated 1517 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:44.875951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fa053e2c-1c8e-4394-b3a7-cfe00269dc14 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:44.886671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fa053e2c-1c8e-4394-b3a7-cfe00269dc14 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:44.905354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa053e2c-1c8e-4394-b3a7-cfe00269dc14 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:44.919004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa053e2c-1c8e-4394-b3a7-cfe00269dc14 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:44.926782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa053e2c-1c8e-4394-b3a7-cfe00269dc14 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:44.927928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa053e2c-1c8e-4394-b3a7-cfe00269dc14 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:44.931306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa053e2c-1c8e-4394-b3a7-cfe00269dc14 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:44.936047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa053e2c-1c8e-4394-b3a7-cfe00269dc14 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:46.161042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-65233c14-2211-47f5-86cf-5eb7a30a2e35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:46.177162 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-65233c14-2211-47f5-86cf-5eb7a30a2e35 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1468 microversion: 2.1 time: 2.176938 Sep 08 12:44:46.186278 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 718/1482] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:43 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1468 bytes in 2187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:46.209113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2cc6638e-075b-445d-9fc8-0f1aac0526c7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:46.209857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2cc6638e-075b-445d-9fc8-0f1aac0526c7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:46.226523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cc6638e-075b-445d-9fc8-0f1aac0526c7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:46.227213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cc6638e-075b-445d-9fc8-0f1aac0526c7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:46.228453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cc6638e-075b-445d-9fc8-0f1aac0526c7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:46.232322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cc6638e-075b-445d-9fc8-0f1aac0526c7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:46.233239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cc6638e-075b-445d-9fc8-0f1aac0526c7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:46.234293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cc6638e-075b-445d-9fc8-0f1aac0526c7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:47.491355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fa053e2c-1c8e-4394-b3a7-cfe00269dc14 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:47.512350 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fa053e2c-1c8e-4394-b3a7-cfe00269dc14 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1307 microversion: 2.1 time: 2.662337 Sep 08 12:44:47.523994 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 765/1483] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:44 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1307 bytes in 2675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:47.557791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b209bbe4-57e5-4a0c-80ed-9d8dea1a7ddd tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:47.558600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b209bbe4-57e5-4a0c-80ed-9d8dea1a7ddd tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:47.588572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b209bbe4-57e5-4a0c-80ed-9d8dea1a7ddd tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:47.589629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b209bbe4-57e5-4a0c-80ed-9d8dea1a7ddd tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:47.590240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b209bbe4-57e5-4a0c-80ed-9d8dea1a7ddd tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:47.591757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b209bbe4-57e5-4a0c-80ed-9d8dea1a7ddd tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:47.592400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b209bbe4-57e5-4a0c-80ed-9d8dea1a7ddd tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:47.598800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b209bbe4-57e5-4a0c-80ed-9d8dea1a7ddd tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:47.874268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b209bbe4-57e5-4a0c-80ed-9d8dea1a7ddd tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:47.894011 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b209bbe4-57e5-4a0c-80ed-9d8dea1a7ddd tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1275 microversion: 2.1 time: 0.367963 Sep 08 12:44:47.908924 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 766/1484] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:47 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1275 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:47.939584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-85616f25-1fbe-495f-9a28-1d84c63d24c9 req-de88eff4-5718-4a3b-8fe5-f4e5366c41ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18d02535-ee1c-46e0-a965-f6a888a88504", "tag": "4d658519-2984-4e4c-98fe-154b8d56375b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:47.972375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-85616f25-1fbe-495f-9a28-1d84c63d24c9 req-de88eff4-5718-4a3b-8fe5-f4e5366c41ad service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:47.973254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-85616f25-1fbe-495f-9a28-1d84c63d24c9 req-de88eff4-5718-4a3b-8fe5-f4e5366c41ad service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:47.974037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-85616f25-1fbe-495f-9a28-1d84c63d24c9 req-de88eff4-5718-4a3b-8fe5-f4e5366c41ad service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:48.054456 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-85616f25-1fbe-495f-9a28-1d84c63d24c9 req-de88eff4-5718-4a3b-8fe5-f4e5366c41ad service nova] Creating event network-changed:4d658519-2984-4e4c-98fe-154b8d56375b for instance 18d02535-ee1c-46e0-a965-f6a888a88504 on n-h1-852084-10 Sep 08 12:44:48.083338 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-85616f25-1fbe-495f-9a28-1d84c63d24c9 req-de88eff4-5718-4a3b-8fe5-f4e5366c41ad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168009 Sep 08 12:44:48.087495 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 767/1485] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:48.111846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7db26e3e-b248-411b-9f46-e2115f18007a tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:48.112941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-2cc6638e-075b-445d-9fc8-0f1aac0526c7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid 2ba78845-4ce9-474d-ac71-a91626b110d1 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:44:48.115381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7db26e3e-b248-411b-9f46-e2115f18007a tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 83b2b1b0-2e34-4bbc-9d98-40eec81036ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:48.146874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7db26e3e-b248-411b-9f46-e2115f18007a tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:48.149750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7db26e3e-b248-411b-9f46-e2115f18007a tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:48.151454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7db26e3e-b248-411b-9f46-e2115f18007a tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:48.162714 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2cc6638e-075b-445d-9fc8-0f1aac0526c7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 2423 microversion: 2.25 time: 1.974715 Sep 08 12:44:48.171955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7db26e3e-b248-411b-9f46-e2115f18007a tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:48.173001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7db26e3e-b248-411b-9f46-e2115f18007a tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:48.173779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7db26e3e-b248-411b-9f46-e2115f18007a tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:48.178776 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 719/1486] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:46 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 2423 bytes in 1992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:48.199034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:48.204721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:48.226895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:48.232875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:48.233117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:48.233892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:48.237371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:48.239754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:48.410387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:48.414328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:48.419001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:48.419862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lazy-loading 'fault' on Instance uuid 8f08576a-9db5-42b3-967c-2b64c7b70d35 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:44:48.742286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81af813dbf5340d0a3d9d4bf0cff3da7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c3e5d96296342eb8a99953dec8747c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:48.768215 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-90ce5723-d43c-4d41-b977-46149e650ece tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 200 len: 1302 microversion: 2.1 time: 0.587774 Sep 08 12:44:48.779088 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 720/1487] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:48 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 1302 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:48.802269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-724cfe1e-3948-4f13-ba59-c79447798274 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852084-10", "block_migration": "auto"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:48.810793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-724cfe1e-3948-4f13-ba59-c79447798274 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:48.842242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-724cfe1e-3948-4f13-ba59-c79447798274 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:48.843172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-724cfe1e-3948-4f13-ba59-c79447798274 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:48.844044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-724cfe1e-3948-4f13-ba59-c79447798274 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:48.845421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-724cfe1e-3948-4f13-ba59-c79447798274 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:48.848639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-724cfe1e-3948-4f13-ba59-c79447798274 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:48.849611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-724cfe1e-3948-4f13-ba59-c79447798274 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:48.932424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-724cfe1e-3948-4f13-ba59-c79447798274 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'flavor' on Instance uuid 2ba78845-4ce9-474d-ac71-a91626b110d1 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:44:48.970327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-724cfe1e-3948-4f13-ba59-c79447798274 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Going to try to live migrate instance to n-h2-852084-10 {{(pid=128971) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 12:44:49.217164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7db26e3e-b248-411b-9f46-e2115f18007a tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:49.243053 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7db26e3e-b248-411b-9f46-e2115f18007a tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac" status: 200 len: 1517 microversion: 2.1 time: 1.148361 Sep 08 12:44:49.259504 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 768/1488] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:48 2022] GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac => generated 1517 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:49.276503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6056c3b9-22a4-4e8c-8fc1-9c72c2053230 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:49.277568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6056c3b9-22a4-4e8c-8fc1-9c72c2053230 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:49.303416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6056c3b9-22a4-4e8c-8fc1-9c72c2053230 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:49.311648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6056c3b9-22a4-4e8c-8fc1-9c72c2053230 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:49.312508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6056c3b9-22a4-4e8c-8fc1-9c72c2053230 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:49.314405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6056c3b9-22a4-4e8c-8fc1-9c72c2053230 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:49.314822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6056c3b9-22a4-4e8c-8fc1-9c72c2053230 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:49.318982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6056c3b9-22a4-4e8c-8fc1-9c72c2053230 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:49.826723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:50.480177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6056c3b9-22a4-4e8c-8fc1-9c72c2053230 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:50.514727 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6056c3b9-22a4-4e8c-8fc1-9c72c2053230 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1307 microversion: 2.1 time: 1.251635 Sep 08 12:44:50.548543 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 769/1489] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:49 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1307 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:50.581087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-0cc65bb5-979d-41e2-8b2d-a5454fe76dad req-42f77ceb-ca52-4b5c-ba07-fee08f00bc9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b2b1b0-2e34-4bbc-9d98-40eec81036ac", "name": "network-vif-unplugged", "status": "completed", "tag": "b6f3f915-c769-47f3-8624-14a1d7dcf25a"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:50.632774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0cc65bb5-979d-41e2-8b2d-a5454fe76dad req-42f77ceb-ca52-4b5c-ba07-fee08f00bc9c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:50.637529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0cc65bb5-979d-41e2-8b2d-a5454fe76dad req-42f77ceb-ca52-4b5c-ba07-fee08f00bc9c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:50.638404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0cc65bb5-979d-41e2-8b2d-a5454fe76dad req-42f77ceb-ca52-4b5c-ba07-fee08f00bc9c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:50.684419 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-0cc65bb5-979d-41e2-8b2d-a5454fe76dad req-42f77ceb-ca52-4b5c-ba07-fee08f00bc9c service nova] Creating event network-vif-unplugged:b6f3f915-c769-47f3-8624-14a1d7dcf25a for instance 83b2b1b0-2e34-4bbc-9d98-40eec81036ac on n-h1-852084-10 Sep 08 12:44:50.710819 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-0cc65bb5-979d-41e2-8b2d-a5454fe76dad req-42f77ceb-ca52-4b5c-ba07-fee08f00bc9c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150937 Sep 08 12:44:50.717982 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 770/1490] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:50.741321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1584233340", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "9714d2bd-3c28-4c33-8e0b-3c4e73fb2914"}], "block_device_mapping_v2": [{"uuid": "fb9ddd77-6da5-4540-a39a-3caf334b2e44", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:51.148846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] validate_networks() for [('9714d2bd-3c28-4c33-8e0b-3c4e73fb2914', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:44:52.310940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:52.417385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=14 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:53.320010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:44:53.320531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:44:53.321820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:44:53.322445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:44:53.322959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:44:53.349476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:53.350408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:53.351054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:53.352205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:53.352994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:53.354128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:53.404668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Getting quotas for project 5619e927afd449c4897bd41f96390988. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:44:53.421157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Getting quotas for user c7375a1da7fb43d8a6725f61fa2c7ec9 and project 5619e927afd449c4897bd41f96390988. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:44:53.489416 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-724cfe1e-3948-4f13-ba59-c79447798274 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1/action" status: 202 len: 0 microversion: 2.25 time: 4.706720 Sep 08 12:44:53.490551 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 721/1491] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 12:44:48 2022] POST /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1/action => generated 0 bytes in 4711 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:44:53.540653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-26ad0c72-0284-49d0-810c-ec644d3a96ac tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:53.548808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-26ad0c72-0284-49d0-810c-ec644d3a96ac tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:53.600475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26ad0c72-0284-49d0-810c-ec644d3a96ac tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:53.606889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26ad0c72-0284-49d0-810c-ec644d3a96ac tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:53.609525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26ad0c72-0284-49d0-810c-ec644d3a96ac tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:53.614425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26ad0c72-0284-49d0-810c-ec644d3a96ac tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:53.616208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26ad0c72-0284-49d0-810c-ec644d3a96ac tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:53.616950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26ad0c72-0284-49d0-810c-ec644d3a96ac tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:53.801347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:44:53.804984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb9ddd77-6da5-4540-a39a-3caf334b2e44',volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:44:54.247930 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5bd690fb-4f23-44f0-85bc-3015d5a291cb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.528109 Sep 08 12:44:54.264742 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 771/1492] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:44:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:44:54.273554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4c889e1f-a1b6-4041-887d-12b16abb23b0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:54.275068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4c889e1f-a1b6-4041-887d-12b16abb23b0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] [instance: 8f08576a-9db5-42b3-967c-2b64c7b70d35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:54.286014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c889e1f-a1b6-4041-887d-12b16abb23b0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:54.288936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c889e1f-a1b6-4041-887d-12b16abb23b0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:54.290056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c889e1f-a1b6-4041-887d-12b16abb23b0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:54.291828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c889e1f-a1b6-4041-887d-12b16abb23b0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:54.292751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c889e1f-a1b6-4041-887d-12b16abb23b0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:54.293553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c889e1f-a1b6-4041-887d-12b16abb23b0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:54.358486 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-4c889e1f-a1b6-4041-887d-12b16abb23b0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] HTTP exception thrown: Instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 could not be found. Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4c889e1f-a1b6-4041-887d-12b16abb23b0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Request method failure captured: Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 HTTP/1.1 Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeIe4q6vxTgoIzq-Y3nPgGqapZ1PmdB7K5U4PvgSCUH-wx_Bk7v98xm3N5-p87C7FhcseUJga-eaVeNXMwnOG6IaRpZEa8K11T5pXd-mZP4zmke6SHMAnEZsMYpdq1DO3Qu6PrZRR2zMQtGyIfVtc4p0pY5cGWs_AE4qOcLtkPGNGA4 Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 8c3e5d96296342eb8a99953dec8747c0 Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-MigrationsAdminTest-379577382 Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:44:54.368498 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:44:54.370456 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8c3e5d96296342eb8a99953dec8747c0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:44:54.370456 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-MigrationsAdminTest-379577382 Sep 08 12:44:54.370456 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 8c3e5d96296342eb8a99953dec8747c0 Sep 08 12:44:54.370456 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-MigrationsAdminTest-379577382 Sep 08 12:44:54.370456 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-MigrationsAdminTest-379577382-project Sep 08 12:44:54.370456 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:44:54.370456 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:44:54.370456 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 81af813dbf5340d0a3d9d4bf0cff3da7 Sep 08 12:44:54.370456 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-MigrationsAdminTest-379577382-project Sep 08 12:44:54.370456 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:44:54.370456 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 could not be found. Sep 08 12:44:54.370456 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '8f08576a-9db5-42b3-967c-2b64c7b70d35'} Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 could not be found. Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:44:54.371683 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 could not be found. Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 could not be found. Sep 08 12:44:54.373574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:54.375092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4c889e1f-a1b6-4041-887d-12b16abb23b0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] Returning 404 to user: Instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:44:54.375092 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4c889e1f-a1b6-4041-887d-12b16abb23b0 tempest-MigrationsAdminTest-379577382 tempest-MigrationsAdminTest-379577382-project] 10.222.0.78 "GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35" status: 404 len: 111 microversion: 2.1 time: 0.104356 Sep 08 12:44:54.379766 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 772/1493] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:54 2022] GET /compute/v2.1/servers/8f08576a-9db5-42b3-967c-2b64c7b70d35 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:44:54.402484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-96f76dd6-9960-4a36-a845-a28b71e359f0 req-f4ad43f6-958f-44c7-962f-7416b62af1bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83b2b1b0-2e34-4bbc-9d98-40eec81036ac", "name": "network-vif-deleted", "tag": "b6f3f915-c769-47f3-8624-14a1d7dcf25a"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:54.424236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-96f76dd6-9960-4a36-a845-a28b71e359f0 req-f4ad43f6-958f-44c7-962f-7416b62af1bd service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:54.432897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-96f76dd6-9960-4a36-a845-a28b71e359f0 req-f4ad43f6-958f-44c7-962f-7416b62af1bd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:54.433640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-96f76dd6-9960-4a36-a845-a28b71e359f0 req-f4ad43f6-958f-44c7-962f-7416b62af1bd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:54.485495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-26ad0c72-0284-49d0-810c-ec644d3a96ac tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:54.501781 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-26ad0c72-0284-49d0-810c-ec644d3a96ac tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1317 microversion: 2.1 time: 1.008987 Sep 08 12:44:54.507648 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 722/1494] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:53 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1317 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:54.525316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e1516b99-45ba-497d-a882-08555c0f1975 req-9ef9bbce-828c-4cf7-bba6-2c68a3eb3010 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f08576a-9db5-42b3-967c-2b64c7b70d35", "name": "network-vif-deleted", "tag": "c0202d88-6f01-4f52-9d83-e48a31f22c1d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:54.536955 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-96f76dd6-9960-4a36-a845-a28b71e359f0 req-f4ad43f6-958f-44c7-962f-7416b62af1bd service nova] Creating event network-vif-deleted:b6f3f915-c769-47f3-8624-14a1d7dcf25a for instance 83b2b1b0-2e34-4bbc-9d98-40eec81036ac on n-h1-852084-10 Sep 08 12:44:54.544566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e1516b99-45ba-497d-a882-08555c0f1975 req-9ef9bbce-828c-4cf7-bba6-2c68a3eb3010 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:54.546989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e1516b99-45ba-497d-a882-08555c0f1975 req-9ef9bbce-828c-4cf7-bba6-2c68a3eb3010 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:54.548231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e1516b99-45ba-497d-a882-08555c0f1975 req-9ef9bbce-828c-4cf7-bba6-2c68a3eb3010 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:54.573212 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-96f76dd6-9960-4a36-a845-a28b71e359f0 req-f4ad43f6-958f-44c7-962f-7416b62af1bd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191806 Sep 08 12:44:54.575032 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 773/1495] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:54.581140 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e1516b99-45ba-497d-a882-08555c0f1975 req-9ef9bbce-828c-4cf7-bba6-2c68a3eb3010 service nova] Creating event network-vif-deleted:c0202d88-6f01-4f52-9d83-e48a31f22c1d for instance 8f08576a-9db5-42b3-967c-2b64c7b70d35 on n-h2-852084-10 Sep 08 12:44:54.593594 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e1516b99-45ba-497d-a882-08555c0f1975 req-9ef9bbce-828c-4cf7-bba6-2c68a3eb3010 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084240 Sep 08 12:44:54.596596 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 723/1496] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:54.614428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e1272eaf-9f40-4a2a-9a32-24bbb6a58754 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:54.616122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e7cfdd1c-6f17-4103-b6ff-04779f562ee2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:54.622933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e7cfdd1c-6f17-4103-b6ff-04779f562ee2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:54.631962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e1272eaf-9f40-4a2a-9a32-24bbb6a58754 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: 83b2b1b0-2e34-4bbc-9d98-40eec81036ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:54.643794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7cfdd1c-6f17-4103-b6ff-04779f562ee2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:54.645974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7cfdd1c-6f17-4103-b6ff-04779f562ee2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:54.647378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7cfdd1c-6f17-4103-b6ff-04779f562ee2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:54.649332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7cfdd1c-6f17-4103-b6ff-04779f562ee2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:54.651941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7cfdd1c-6f17-4103-b6ff-04779f562ee2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:54.657325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7cfdd1c-6f17-4103-b6ff-04779f562ee2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:54.686998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1272eaf-9f40-4a2a-9a32-24bbb6a58754 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:54.701922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1272eaf-9f40-4a2a-9a32-24bbb6a58754 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:54.701922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1272eaf-9f40-4a2a-9a32-24bbb6a58754 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:54.701922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1272eaf-9f40-4a2a-9a32-24bbb6a58754 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:54.704999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1272eaf-9f40-4a2a-9a32-24bbb6a58754 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:54.712447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1272eaf-9f40-4a2a-9a32-24bbb6a58754 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:54.855150 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e1272eaf-9f40-4a2a-9a32-24bbb6a58754 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] HTTP exception thrown: Instance 83b2b1b0-2e34-4bbc-9d98-40eec81036ac could not be found. Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e1272eaf-9f40-4a2a-9a32-24bbb6a58754 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Request method failure captured: Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac HTTP/1.1 Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeNCUJnZl9yJYasgBWX9M-UgQFLb8IakYGT5bqR_k_KqhclHMuVY2NEsDbNZ2AuHFbqpjFUDmQCxEhivtXSNvnLY68iEe9H_UZ-4AP5txitTbp0ssj3JfiUT8JCGRCqv_Xj7MCk-YLOMqfXFAymOjEwP4y8uVPD9xUzUEzjbDfEVZ2A Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 089fe13d64434cd48d0311dfe9d43493 Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ListServerFiltersTestJSON-1802960894 Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:44:54.867952 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:44:54.869635 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_089fe13d64434cd48d0311dfe9d43493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/089fe13d64434cd48d0311dfe9d43493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089fe13d64434cd48d0311dfe9d43493"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089fe13d64434cd48d0311dfe9d43493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:44:54.869635 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ListServerFiltersTestJSON-1802960894 Sep 08 12:44:54.869635 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 089fe13d64434cd48d0311dfe9d43493 Sep 08 12:44:54.869635 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1802960894 Sep 08 12:44:54.869635 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ListServerFiltersTestJSON-1802960894-project Sep 08 12:44:54.869635 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:44:54.869635 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:44:54.869635 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: fe4e7ae0a8b34345986479e340102892 Sep 08 12:44:54.869635 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ListServerFiltersTestJSON-1802960894-project Sep 08 12:44:54.869635 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:44:54.869635 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 83b2b1b0-2e34-4bbc-9d98-40eec81036ac could not be found. Sep 08 12:44:54.869635 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '83b2b1b0-2e34-4bbc-9d98-40eec81036ac'} Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83b2b1b0-2e34-4bbc-9d98-40eec81036ac could not be found. Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:44:54.870879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83b2b1b0-2e34-4bbc-9d98-40eec81036ac could not be found. Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83b2b1b0-2e34-4bbc-9d98-40eec81036ac could not be found. Sep 08 12:44:54.872722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:44:54.874580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e1272eaf-9f40-4a2a-9a32-24bbb6a58754 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Returning 404 to user: Instance 83b2b1b0-2e34-4bbc-9d98-40eec81036ac could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:44:54.879593 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e1272eaf-9f40-4a2a-9a32-24bbb6a58754 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac" status: 404 len: 111 microversion: 2.1 time: 0.295137 Sep 08 12:44:54.880554 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 774/1497] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:54 2022] GET /compute/v2.1/servers/83b2b1b0-2e34-4bbc-9d98-40eec81036ac => generated 111 bytes in 305 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:44:54.898528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-deae283e-64d0-44f5-a4d0-791c1329151d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:54.906545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-deae283e-64d0-44f5-a4d0-791c1329151d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:54.926967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-deae283e-64d0-44f5-a4d0-791c1329151d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:54.927661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-deae283e-64d0-44f5-a4d0-791c1329151d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:54.928228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-deae283e-64d0-44f5-a4d0-791c1329151d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:54.929178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-deae283e-64d0-44f5-a4d0-791c1329151d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:54.930361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-deae283e-64d0-44f5-a4d0-791c1329151d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:54.931060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-deae283e-64d0-44f5-a4d0-791c1329151d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:55.851604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e7cfdd1c-6f17-4103-b6ff-04779f562ee2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:55.906381 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e7cfdd1c-6f17-4103-b6ff-04779f562ee2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1307 microversion: 2.1 time: 1.305887 Sep 08 12:44:55.910705 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 724/1498] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:54 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1307 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:55.945054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-299463df-fe2f-4097-b0b3-a5817588b34d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:55.946907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-299463df-fe2f-4097-b0b3-a5817588b34d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:55.976010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-299463df-fe2f-4097-b0b3-a5817588b34d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:55.976879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-299463df-fe2f-4097-b0b3-a5817588b34d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:55.977617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-299463df-fe2f-4097-b0b3-a5817588b34d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:55.978703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-299463df-fe2f-4097-b0b3-a5817588b34d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:55.979512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-299463df-fe2f-4097-b0b3-a5817588b34d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:55.980265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-299463df-fe2f-4097-b0b3-a5817588b34d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:56.083786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-deae283e-64d0-44f5-a4d0-791c1329151d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:56.104506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-deae283e-64d0-44f5-a4d0-791c1329151d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:56.106721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-deae283e-64d0-44f5-a4d0-791c1329151d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:56.112904 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-deae283e-64d0-44f5-a4d0-791c1329151d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 1.227586 Sep 08 12:44:56.124733 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 775/1499] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:54 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:44:56.163103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9934cf3-b11d-49cb-8094-4c7baafbdc9b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:56.163932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a9934cf3-b11d-49cb-8094-4c7baafbdc9b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:56.183608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9934cf3-b11d-49cb-8094-4c7baafbdc9b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:56.188024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9934cf3-b11d-49cb-8094-4c7baafbdc9b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:56.188501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9934cf3-b11d-49cb-8094-4c7baafbdc9b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:56.189315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9934cf3-b11d-49cb-8094-4c7baafbdc9b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:56.189916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9934cf3-b11d-49cb-8094-4c7baafbdc9b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:56.193604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9934cf3-b11d-49cb-8094-4c7baafbdc9b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:56.251509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:56.275389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a9934cf3-b11d-49cb-8094-4c7baafbdc9b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:44:56.352562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-299463df-fe2f-4097-b0b3-a5817588b34d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:56.364852 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-299463df-fe2f-4097-b0b3-a5817588b34d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1095 microversion: 2.1 time: 0.448590 Sep 08 12:44:56.367677 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 725/1500] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:55 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1095 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:56.412442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-4c33c429-2130-4fb9-a516-2ea75cea5932 req-8c9f3aae-9700-4a26-bcaf-07fac00cca28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d02535-ee1c-46e0-a965-f6a888a88504", "name": "network-vif-plugged", "status": "completed", "tag": "4d658519-2984-4e4c-98fe-154b8d56375b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:56.444428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4c33c429-2130-4fb9-a516-2ea75cea5932 req-8c9f3aae-9700-4a26-bcaf-07fac00cca28 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:56.447198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4c33c429-2130-4fb9-a516-2ea75cea5932 req-8c9f3aae-9700-4a26-bcaf-07fac00cca28 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:56.447851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4c33c429-2130-4fb9-a516-2ea75cea5932 req-8c9f3aae-9700-4a26-bcaf-07fac00cca28 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:56.487469 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-4c33c429-2130-4fb9-a516-2ea75cea5932 req-8c9f3aae-9700-4a26-bcaf-07fac00cca28 service nova] Creating event network-vif-plugged:4d658519-2984-4e4c-98fe-154b8d56375b for instance 18d02535-ee1c-46e0-a965-f6a888a88504 on n-h1-852084-10 Sep 08 12:44:56.511404 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-4c33c429-2130-4fb9-a516-2ea75cea5932 req-8c9f3aae-9700-4a26-bcaf-07fac00cca28 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112085 Sep 08 12:44:56.513232 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a9934cf3-b11d-49cb-8094-4c7baafbdc9b tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 204 len: 0 microversion: 2.1 time: 0.378454 Sep 08 12:44:56.514611 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 726/1501] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:56.521109 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 776/1502] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:44:56 2022] DELETE /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:44:56.528569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-48e739cf-abf1-4ed9-b5c6-8e529235fa97 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:56.529501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-48e739cf-abf1-4ed9-b5c6-8e529235fa97 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:56.534244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f7ffed22-47ef-4414-9031-2d871b14ba81 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:56.535005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f7ffed22-47ef-4414-9031-2d871b14ba81 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:56.562599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48e739cf-abf1-4ed9-b5c6-8e529235fa97 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:56.564393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48e739cf-abf1-4ed9-b5c6-8e529235fa97 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:56.565689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48e739cf-abf1-4ed9-b5c6-8e529235fa97 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:56.566820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48e739cf-abf1-4ed9-b5c6-8e529235fa97 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:56.567687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48e739cf-abf1-4ed9-b5c6-8e529235fa97 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:56.568380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48e739cf-abf1-4ed9-b5c6-8e529235fa97 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:56.569487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7ffed22-47ef-4414-9031-2d871b14ba81 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:56.570389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7ffed22-47ef-4414-9031-2d871b14ba81 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:56.581360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7ffed22-47ef-4414-9031-2d871b14ba81 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:56.584990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7ffed22-47ef-4414-9031-2d871b14ba81 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:56.588045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7ffed22-47ef-4414-9031-2d871b14ba81 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:56.593836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7ffed22-47ef-4414-9031-2d871b14ba81 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:57.777706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f7ffed22-47ef-4414-9031-2d871b14ba81 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:57.795796 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f7ffed22-47ef-4414-9031-2d871b14ba81 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1317 microversion: 2.1 time: 1.278262 Sep 08 12:44:57.805141 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 727/1503] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:56 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1317 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:57.823383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-48e739cf-abf1-4ed9-b5c6-8e529235fa97 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:57.824554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-5ccac205-0ace-45ca-844f-1c7507b1a753 req-a2f6875f-2ab6-4c9e-8873-2216a101d6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "810cd6cb-eab9-4427-aa03-597406fd20f6", "tag": "7817753f-a720-43f2-8c41-dcb97e0c1bbd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:44:57.850423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5ccac205-0ace-45ca-844f-1c7507b1a753 req-a2f6875f-2ab6-4c9e-8873-2216a101d6cd service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:57.851474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5ccac205-0ace-45ca-844f-1c7507b1a753 req-a2f6875f-2ab6-4c9e-8873-2216a101d6cd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:57.852165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5ccac205-0ace-45ca-844f-1c7507b1a753 req-a2f6875f-2ab6-4c9e-8873-2216a101d6cd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:57.858418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:44:57.859861 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-48e739cf-abf1-4ed9-b5c6-8e529235fa97 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1516 microversion: 2.1 time: 1.334784 Sep 08 12:44:57.861783 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 777/1504] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:56 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1516 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:44:57.873639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cab6e275-7eba-4db6-b35d-500afd1b2893 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:57.877223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cab6e275-7eba-4db6-b35d-500afd1b2893 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:57.890244 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-5ccac205-0ace-45ca-844f-1c7507b1a753 req-a2f6875f-2ab6-4c9e-8873-2216a101d6cd service nova] Creating event network-changed:7817753f-a720-43f2-8c41-dcb97e0c1bbd for instance 810cd6cb-eab9-4427-aa03-597406fd20f6 on n-h2-852084-10 Sep 08 12:44:57.892706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cab6e275-7eba-4db6-b35d-500afd1b2893 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:57.895509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cab6e275-7eba-4db6-b35d-500afd1b2893 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:57.896765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cab6e275-7eba-4db6-b35d-500afd1b2893 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:57.898604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cab6e275-7eba-4db6-b35d-500afd1b2893 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:57.900022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cab6e275-7eba-4db6-b35d-500afd1b2893 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:57.901229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cab6e275-7eba-4db6-b35d-500afd1b2893 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:57.905164 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-5ccac205-0ace-45ca-844f-1c7507b1a753 req-a2f6875f-2ab6-4c9e-8873-2216a101d6cd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096989 Sep 08 12:44:57.905831 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 728/1505] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:44:57.928422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-913be33f-1124-476f-8034-904fa201c3ec tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:57.929496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-913be33f-1124-476f-8034-904fa201c3ec tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:44:57.949922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-913be33f-1124-476f-8034-904fa201c3ec tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:57.952391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-913be33f-1124-476f-8034-904fa201c3ec tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:57.957341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-913be33f-1124-476f-8034-904fa201c3ec tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:57.958700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-913be33f-1124-476f-8034-904fa201c3ec tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:44:57.961837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-913be33f-1124-476f-8034-904fa201c3ec tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:44:57.963338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-913be33f-1124-476f-8034-904fa201c3ec tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:44:59.816157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cab6e275-7eba-4db6-b35d-500afd1b2893 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:44:59.846651 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cab6e275-7eba-4db6-b35d-500afd1b2893 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1307 microversion: 2.1 time: 1.978658 Sep 08 12:44:59.852789 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 778/1506] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:57 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1307 bytes in 1990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:44:59.993857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-56c617f2-b40c-4fa0-a4e2-dce24ee96609 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:44:59.996617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-56c617f2-b40c-4fa0-a4e2-dce24ee96609 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:00.034508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56c617f2-b40c-4fa0-a4e2-dce24ee96609 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:00.035624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56c617f2-b40c-4fa0-a4e2-dce24ee96609 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:00.039794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56c617f2-b40c-4fa0-a4e2-dce24ee96609 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:00.045633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56c617f2-b40c-4fa0-a4e2-dce24ee96609 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:00.054329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56c617f2-b40c-4fa0-a4e2-dce24ee96609 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:00.055745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56c617f2-b40c-4fa0-a4e2-dce24ee96609 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:00.118143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-913be33f-1124-476f-8034-904fa201c3ec tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:00.131179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-913be33f-1124-476f-8034-904fa201c3ec tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:00.133888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-913be33f-1124-476f-8034-904fa201c3ec tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:00.135882 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-913be33f-1124-476f-8034-904fa201c3ec tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 2.221810 Sep 08 12:45:00.137917 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 729/1507] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:44:57 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 2226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:00.146174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4c5cf535-07b7-4d9e-8231-e36ca8c4a95f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:00.147175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4c5cf535-07b7-4d9e-8231-e36ca8c4a95f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:00.160622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c5cf535-07b7-4d9e-8231-e36ca8c4a95f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:00.161720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c5cf535-07b7-4d9e-8231-e36ca8c4a95f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:00.162433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c5cf535-07b7-4d9e-8231-e36ca8c4a95f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:00.163520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c5cf535-07b7-4d9e-8231-e36ca8c4a95f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:00.164248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c5cf535-07b7-4d9e-8231-e36ca8c4a95f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:00.165279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c5cf535-07b7-4d9e-8231-e36ca8c4a95f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:00.648314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-56c617f2-b40c-4fa0-a4e2-dce24ee96609 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:00.662889 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-56c617f2-b40c-4fa0-a4e2-dce24ee96609 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1169 microversion: 2.1 time: 0.788617 Sep 08 12:45:00.676190 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 779/1508] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:44:59 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1169 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:00.694550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-df910e0a-c6c3-47ff-8515-c933e75f8967 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:00.695519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-df910e0a-c6c3-47ff-8515-c933e75f8967 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:00.713637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df910e0a-c6c3-47ff-8515-c933e75f8967 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:00.723172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df910e0a-c6c3-47ff-8515-c933e75f8967 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:00.729969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df910e0a-c6c3-47ff-8515-c933e75f8967 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:00.731069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df910e0a-c6c3-47ff-8515-c933e75f8967 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:00.733365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df910e0a-c6c3-47ff-8515-c933e75f8967 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:00.734231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df910e0a-c6c3-47ff-8515-c933e75f8967 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:02.071903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-df910e0a-c6c3-47ff-8515-c933e75f8967 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe4e7ae0a8b34345986479e340102892', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089fe13d64434cd48d0311dfe9d43493', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:02.082537 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-df910e0a-c6c3-47ff-8515-c933e75f8967 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 200 len: 1516 microversion: 2.1 time: 1.404776 Sep 08 12:45:02.089635 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 780/1509] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:00 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 1516 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:02.102175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f08cdcfb-cb1a-40c2-895e-feb3fa3d5b16 req-2a57549c-6c95-4c33-b215-f302c11ff146 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3390d320-1b6f-4e3a-8f99-fff7b4e179a4", "tag": "ed71639b-831f-4e95-b890-50fca7bd47bf"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:02.127923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f08cdcfb-cb1a-40c2-895e-feb3fa3d5b16 req-2a57549c-6c95-4c33-b215-f302c11ff146 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:02.128862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f08cdcfb-cb1a-40c2-895e-feb3fa3d5b16 req-2a57549c-6c95-4c33-b215-f302c11ff146 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:02.129517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f08cdcfb-cb1a-40c2-895e-feb3fa3d5b16 req-2a57549c-6c95-4c33-b215-f302c11ff146 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:02.152361 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f08cdcfb-cb1a-40c2-895e-feb3fa3d5b16 req-2a57549c-6c95-4c33-b215-f302c11ff146 service nova] Creating event network-changed:ed71639b-831f-4e95-b890-50fca7bd47bf for instance 3390d320-1b6f-4e3a-8f99-fff7b4e179a4 on n-h2-852084-10 Sep 08 12:45:02.160607 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f08cdcfb-cb1a-40c2-895e-feb3fa3d5b16 req-2a57549c-6c95-4c33-b215-f302c11ff146 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068998 Sep 08 12:45:02.162146 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 781/1510] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:02.175804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3edb4cb8-7b63-4106-9fec-d1abba91ac8e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:02.177150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3edb4cb8-7b63-4106-9fec-d1abba91ac8e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:02.186673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3edb4cb8-7b63-4106-9fec-d1abba91ac8e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:02.188327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3edb4cb8-7b63-4106-9fec-d1abba91ac8e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:02.189264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3edb4cb8-7b63-4106-9fec-d1abba91ac8e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:02.190698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3edb4cb8-7b63-4106-9fec-d1abba91ac8e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:02.191668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3edb4cb8-7b63-4106-9fec-d1abba91ac8e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:02.192415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3edb4cb8-7b63-4106-9fec-d1abba91ac8e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:02.459908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4c5cf535-07b7-4d9e-8231-e36ca8c4a95f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:02.470631 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4c5cf535-07b7-4d9e-8231-e36ca8c4a95f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1317 microversion: 2.1 time: 2.331220 Sep 08 12:45:02.491278 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 730/1511] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:00 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1317 bytes in 2338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:02.491278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-34204384-fa81-4c78-9f79-46170141ddce tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:02.491278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-34204384-fa81-4c78-9f79-46170141ddce tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:02.514978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-34204384-fa81-4c78-9f79-46170141ddce tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:02.515596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-34204384-fa81-4c78-9f79-46170141ddce tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:02.516221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-34204384-fa81-4c78-9f79-46170141ddce tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:02.516966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-34204384-fa81-4c78-9f79-46170141ddce tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:02.517666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-34204384-fa81-4c78-9f79-46170141ddce tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:02.518178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-34204384-fa81-4c78-9f79-46170141ddce tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:02.615085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3edb4cb8-7b63-4106-9fec-d1abba91ac8e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:02.667781 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3edb4cb8-7b63-4106-9fec-d1abba91ac8e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1488 microversion: 2.1 time: 0.502824 Sep 08 12:45:02.671884 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 782/1512] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:02 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1488 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:02.702482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b9d9e9c9-c8e3-4540-abe3-572ff7437220 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:02.720338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b9d9e9c9-c8e3-4540-abe3-572ff7437220 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:02.749934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9d9e9c9-c8e3-4540-abe3-572ff7437220 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:02.763458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9d9e9c9-c8e3-4540-abe3-572ff7437220 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:02.769485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9d9e9c9-c8e3-4540-abe3-572ff7437220 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:02.772618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9d9e9c9-c8e3-4540-abe3-572ff7437220 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:02.773694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9d9e9c9-c8e3-4540-abe3-572ff7437220 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:02.774515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9d9e9c9-c8e3-4540-abe3-572ff7437220 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:03.375733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:03.440183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=14 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:03.802471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b9d9e9c9-c8e3-4540-abe3-572ff7437220 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:03.814596 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b9d9e9c9-c8e3-4540-abe3-572ff7437220 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1211 microversion: 2.1 time: 1.139974 Sep 08 12:45:03.827261 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 783/1513] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:02 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1211 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:03.928750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-34204384-fa81-4c78-9f79-46170141ddce tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:04.025588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-34204384-fa81-4c78-9f79-46170141ddce tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:04.034555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-34204384-fa81-4c78-9f79-46170141ddce tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:04.040666 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-34204384-fa81-4c78-9f79-46170141ddce tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 1.559734 Sep 08 12:45:04.044156 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 731/1514] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:02 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:04.060183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f8628fc4-6625-4a97-b46b-ec3061d72e0c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:04.081459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8628fc4-6625-4a97-b46b-ec3061d72e0c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:04.081981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8628fc4-6625-4a97-b46b-ec3061d72e0c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:04.082428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8628fc4-6625-4a97-b46b-ec3061d72e0c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:04.186870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f8628fc4-6625-4a97-b46b-ec3061d72e0c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Going to try to stop instance {{(pid=128971) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 12:45:04.429686 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f8628fc4-6625-4a97-b46b-ec3061d72e0c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "POST /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504/action" status: 202 len: 0 microversion: 2.1 time: 0.380420 Sep 08 12:45:04.431068 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 732/1515] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:45:04 2022] POST /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:45:04.463842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-997bc176-efb6-43db-a4a7-0d99cc3fa098 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:04.470387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-997bc176-efb6-43db-a4a7-0d99cc3fa098 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] [instance: ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:04.496251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-997bc176-efb6-43db-a4a7-0d99cc3fa098 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:04.497143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-997bc176-efb6-43db-a4a7-0d99cc3fa098 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:04.498565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-997bc176-efb6-43db-a4a7-0d99cc3fa098 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:04.505560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-997bc176-efb6-43db-a4a7-0d99cc3fa098 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:04.507504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-997bc176-efb6-43db-a4a7-0d99cc3fa098 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:04.518970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-997bc176-efb6-43db-a4a7-0d99cc3fa098 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:04.566140 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-997bc176-efb6-43db-a4a7-0d99cc3fa098 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] HTTP exception thrown: Instance ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 could not be found. Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-997bc176-efb6-43db-a4a7-0d99cc3fa098 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Request method failure captured: Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 HTTP/1.1 Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeNCUJnZl9yJYasgBWX9M-UgQFLb8IakYGT5bqR_k_KqhclHMuVY2NEsDbNZ2AuHFbqpjFUDmQCxEhivtXSNvnLY68iEe9H_UZ-4AP5txitTbp0ssj3JfiUT8JCGRCqv_Xj7MCk-YLOMqfXFAymOjEwP4y8uVPD9xUzUEzjbDfEVZ2A Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 089fe13d64434cd48d0311dfe9d43493 Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ListServerFiltersTestJSON-1802960894 Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:45:04.571383 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:45:04.573064 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_089fe13d64434cd48d0311dfe9d43493"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/089fe13d64434cd48d0311dfe9d43493"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089fe13d64434cd48d0311dfe9d43493"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089fe13d64434cd48d0311dfe9d43493"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:45:04.573064 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ListServerFiltersTestJSON-1802960894 Sep 08 12:45:04.573064 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 089fe13d64434cd48d0311dfe9d43493 Sep 08 12:45:04.573064 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1802960894 Sep 08 12:45:04.573064 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ListServerFiltersTestJSON-1802960894-project Sep 08 12:45:04.573064 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:45:04.573064 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:45:04.573064 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: fe4e7ae0a8b34345986479e340102892 Sep 08 12:45:04.573064 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ListServerFiltersTestJSON-1802960894-project Sep 08 12:45:04.573064 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:45:04.573064 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 could not be found. Sep 08 12:45:04.573064 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3'} Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 could not be found. Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:45:04.574289 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 could not be found. Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 could not be found. Sep 08 12:45:04.575679 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:45:04.578753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-997bc176-efb6-43db-a4a7-0d99cc3fa098 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] Returning 404 to user: Instance ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:45:04.578753 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-997bc176-efb6-43db-a4a7-0d99cc3fa098 tempest-ListServerFiltersTestJSON-1802960894 tempest-ListServerFiltersTestJSON-1802960894-project] 10.222.0.78 "GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3" status: 404 len: 111 microversion: 2.1 time: 0.140484 Sep 08 12:45:04.595120 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 733/1516] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:04 2022] GET /compute/v2.1/servers/ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:45:04.603976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f720be78-a57c-4ebc-b4f3-ac49f6177584 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Action: 'create', calling method: .version_select at 0x7fdb375d98b0>, body: {"keypair": {"name": "tempest-keypair-867829672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCuUCEo/FWsG80RNHU7bJBkM2ejTkAGseM5il9wIJ9ABGPlkoCu01cqvhEj8skw/px3SMjxuH8gWyfAjJ/swnddeHEzmqUcVSSwzh+L3eHCosxvlJeN2qC+bXrHwotVtJA=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:04.614093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2c955d54-7d2c-4823-9e38-2b5081d1b82b tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:04.615076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2c955d54-7d2c-4823-9e38-2b5081d1b82b tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:04.635417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c955d54-7d2c-4823-9e38-2b5081d1b82b tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:04.636634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c955d54-7d2c-4823-9e38-2b5081d1b82b tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:04.637085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c955d54-7d2c-4823-9e38-2b5081d1b82b tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:04.643448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c955d54-7d2c-4823-9e38-2b5081d1b82b tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:04.643973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c955d54-7d2c-4823-9e38-2b5081d1b82b tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:04.644422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c955d54-7d2c-4823-9e38-2b5081d1b82b tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:04.674412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f720be78-a57c-4ebc-b4f3-ac49f6177584 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Getting quotas for project 793c739b689c423cb09af2ce731ac899. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:45:04.710648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f720be78-a57c-4ebc-b4f3-ac49f6177584 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Getting quotas for user 77d18d15099442da8c0924f402b03ff0 and project 793c739b689c423cb09af2ce731ac899. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:45:04.778876 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f720be78-a57c-4ebc-b4f3-ac49f6177584 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.959887 Sep 08 12:45:04.783047 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 784/1517] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:45:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:04.799511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ef10826c-cd2b-458b-9181-5bb137a3890b req-8a4415c6-af41-4d57-8ad9-1215c77468e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3", "name": "network-vif-deleted", "tag": "c30198ff-9bbb-464d-a8d0-e361028a7b78"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:04.840805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ef10826c-cd2b-458b-9181-5bb137a3890b req-8a4415c6-af41-4d57-8ad9-1215c77468e6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:04.841406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ef10826c-cd2b-458b-9181-5bb137a3890b req-8a4415c6-af41-4d57-8ad9-1215c77468e6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:04.843947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ef10826c-cd2b-458b-9181-5bb137a3890b req-8a4415c6-af41-4d57-8ad9-1215c77468e6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:04.882131 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ef10826c-cd2b-458b-9181-5bb137a3890b req-8a4415c6-af41-4d57-8ad9-1215c77468e6 service nova] Creating event network-vif-deleted:c30198ff-9bbb-464d-a8d0-e361028a7b78 for instance ec6a8f2b-4ece-40d8-a754-552bc2d1d3a3 on n-h2-852084-10 Sep 08 12:45:04.900049 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ef10826c-cd2b-458b-9181-5bb137a3890b req-8a4415c6-af41-4d57-8ad9-1215c77468e6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109272 Sep 08 12:45:04.900871 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 785/1518] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:04.917340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8809dd02-1a4a-4c86-9fe6-34d2bd54789b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:04.919924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8809dd02-1a4a-4c86-9fe6-34d2bd54789b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:04.946662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8809dd02-1a4a-4c86-9fe6-34d2bd54789b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:04.947265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8809dd02-1a4a-4c86-9fe6-34d2bd54789b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:04.949092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8809dd02-1a4a-4c86-9fe6-34d2bd54789b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:04.952469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8809dd02-1a4a-4c86-9fe6-34d2bd54789b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:04.954244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8809dd02-1a4a-4c86-9fe6-34d2bd54789b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:04.957400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8809dd02-1a4a-4c86-9fe6-34d2bd54789b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:05.920686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c955d54-7d2c-4823-9e38-2b5081d1b82b tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:05.937831 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2c955d54-7d2c-4823-9e38-2b5081d1b82b tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1317 microversion: 2.1 time: 1.338918 Sep 08 12:45:05.958937 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 734/1519] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:04 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1317 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:06.017731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-41bd7122-8a5b-459b-9b2c-9f06686e24e8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:06.019556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-41bd7122-8a5b-459b-9b2c-9f06686e24e8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:06.055119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41bd7122-8a5b-459b-9b2c-9f06686e24e8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:06.058836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41bd7122-8a5b-459b-9b2c-9f06686e24e8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:06.064528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41bd7122-8a5b-459b-9b2c-9f06686e24e8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:06.067013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41bd7122-8a5b-459b-9b2c-9f06686e24e8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:06.072008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41bd7122-8a5b-459b-9b2c-9f06686e24e8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:06.075381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41bd7122-8a5b-459b-9b2c-9f06686e24e8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:06.519271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8809dd02-1a4a-4c86-9fe6-34d2bd54789b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:06.546776 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8809dd02-1a4a-4c86-9fe6-34d2bd54789b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1498 microversion: 2.1 time: 1.641221 Sep 08 12:45:06.575269 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 786/1520] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:04 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1498 bytes in 1659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:06.603648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b1931e7-f29e-4811-8aeb-aaa138e058cd tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:06.604831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7b1931e7-f29e-4811-8aeb-aaa138e058cd tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:06.620462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b1931e7-f29e-4811-8aeb-aaa138e058cd tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:06.625439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b1931e7-f29e-4811-8aeb-aaa138e058cd tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:06.629254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b1931e7-f29e-4811-8aeb-aaa138e058cd tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:06.635085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b1931e7-f29e-4811-8aeb-aaa138e058cd tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:06.636743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b1931e7-f29e-4811-8aeb-aaa138e058cd tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:06.637504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b1931e7-f29e-4811-8aeb-aaa138e058cd tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:07.188417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-41bd7122-8a5b-459b-9b2c-9f06686e24e8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:07.201250 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-41bd7122-8a5b-459b-9b2c-9f06686e24e8 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1211 microversion: 2.1 time: 1.239974 Sep 08 12:45:07.215741 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 735/1521] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:05 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1211 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:07.226514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9735d815-bf3e-4c84-adac-897fd245eaff req-dda9a3f7-c215-49f2-b1b0-59e06938eb0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810cd6cb-eab9-4427-aa03-597406fd20f6", "name": "network-vif-plugged", "status": "completed", "tag": "7817753f-a720-43f2-8c41-dcb97e0c1bbd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:07.241704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9735d815-bf3e-4c84-adac-897fd245eaff req-dda9a3f7-c215-49f2-b1b0-59e06938eb0b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:07.242964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9735d815-bf3e-4c84-adac-897fd245eaff req-dda9a3f7-c215-49f2-b1b0-59e06938eb0b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:07.243644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9735d815-bf3e-4c84-adac-897fd245eaff req-dda9a3f7-c215-49f2-b1b0-59e06938eb0b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:07.258140 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9735d815-bf3e-4c84-adac-897fd245eaff req-dda9a3f7-c215-49f2-b1b0-59e06938eb0b service nova] Creating event network-vif-plugged:7817753f-a720-43f2-8c41-dcb97e0c1bbd for instance 810cd6cb-eab9-4427-aa03-597406fd20f6 on n-h2-852084-10 Sep 08 12:45:07.264463 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9735d815-bf3e-4c84-adac-897fd245eaff req-dda9a3f7-c215-49f2-b1b0-59e06938eb0b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046708 Sep 08 12:45:07.265978 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 736/1522] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:07.272525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-cee59459-86aa-41c2-b876-7ef2b9989c1f req-78b16ba9-656a-4ba3-90cc-d03273d03c2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ca204f-7749-4f5a-b800-091b9695b80a", "tag": "25c32986-35c2-405b-a739-03cfb2c72c38"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:07.288588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cee59459-86aa-41c2-b876-7ef2b9989c1f req-78b16ba9-656a-4ba3-90cc-d03273d03c2f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:07.290342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cee59459-86aa-41c2-b876-7ef2b9989c1f req-78b16ba9-656a-4ba3-90cc-d03273d03c2f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:07.291015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cee59459-86aa-41c2-b876-7ef2b9989c1f req-78b16ba9-656a-4ba3-90cc-d03273d03c2f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:07.310879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b1931e7-f29e-4811-8aeb-aaa138e058cd tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:07.321104 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-cee59459-86aa-41c2-b876-7ef2b9989c1f req-78b16ba9-656a-4ba3-90cc-d03273d03c2f service nova] Creating event network-changed:25c32986-35c2-405b-a739-03cfb2c72c38 for instance 79ca204f-7749-4f5a-b800-091b9695b80a on n-h1-852084-10 Sep 08 12:45:07.334353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b1931e7-f29e-4811-8aeb-aaa138e058cd tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:07.341051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b1931e7-f29e-4811-8aeb-aaa138e058cd tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:07.342894 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7b1931e7-f29e-4811-8aeb-aaa138e058cd tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 0.764751 Sep 08 12:45:07.343960 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-cee59459-86aa-41c2-b876-7ef2b9989c1f req-78b16ba9-656a-4ba3-90cc-d03273d03c2f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073618 Sep 08 12:45:07.347367 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 737/1523] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:07.350737 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 787/1524] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:06 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:07.690719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1df48687-8556-4ec6-8e06-f79fdee0cdff tempest-NetworksTest-1888596605 tempest-NetworksTest-1888596605-project-admin] Calling method '.version_select at 0x7fdb3b430940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:07.762347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1438507185", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "9176055f-8b84-428f-a7d5-ad0c21b3939e"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:07.964582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] validate_networks() for [('9176055f-8b84-428f-a7d5-ad0c21b3939e', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:45:08.600410 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1df48687-8556-4ec6-8e06-f79fdee0cdff tempest-NetworksTest-1888596605 tempest-NetworksTest-1888596605-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks" status: 200 len: 8102 microversion: 2.1 time: 1.250469 Sep 08 12:45:08.607802 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 738/1525] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:45:07 2022] GET /compute/v2.1/os-networks => generated 8102 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:08.619901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ac250b65-ba69-43f8-b035-af32ee3c3b63 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:08.633834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ac250b65-ba69-43f8-b035-af32ee3c3b63 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:08.661454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac250b65-ba69-43f8-b035-af32ee3c3b63 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:08.662779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac250b65-ba69-43f8-b035-af32ee3c3b63 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:08.664153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac250b65-ba69-43f8-b035-af32ee3c3b63 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:08.665873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac250b65-ba69-43f8-b035-af32ee3c3b63 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:08.666970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac250b65-ba69-43f8-b035-af32ee3c3b63 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:08.668095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac250b65-ba69-43f8-b035-af32ee3c3b63 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:09.255804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ac250b65-ba69-43f8-b035-af32ee3c3b63 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:09.268172 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ac250b65-ba69-43f8-b035-af32ee3c3b63 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1317 microversion: 2.1 time: 0.657647 Sep 08 12:45:09.268795 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 739/1526] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:08 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1317 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:09.290201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-be8ea610-0dd2-4085-9fbd-f1a744579bb2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:09.291154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-be8ea610-0dd2-4085-9fbd-f1a744579bb2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:09.299447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be8ea610-0dd2-4085-9fbd-f1a744579bb2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:09.300245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be8ea610-0dd2-4085-9fbd-f1a744579bb2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:09.301256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be8ea610-0dd2-4085-9fbd-f1a744579bb2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:09.302455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be8ea610-0dd2-4085-9fbd-f1a744579bb2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:09.303119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be8ea610-0dd2-4085-9fbd-f1a744579bb2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:09.303984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be8ea610-0dd2-4085-9fbd-f1a744579bb2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:09.779202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:45:09.785294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:45:09.786964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:45:09.790112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:45:09.794360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:45:09.831389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:09.831953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:09.835150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:09.838560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:09.844834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:09.845618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:09.902251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Getting quotas for project 501fb79cb7544fe4995bc7122c87dbad. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:45:09.917081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Getting quotas for user 2b96cccdfbf149fc880cb1dfb29d416a and project 501fb79cb7544fe4995bc7122c87dbad. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:45:09.949541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:45:09.956602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-be8ea610-0dd2-4085-9fbd-f1a744579bb2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:09.972149 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-be8ea610-0dd2-4085-9fbd-f1a744579bb2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1498 microversion: 2.1 time: 0.687464 Sep 08 12:45:09.976660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:45:09.987272 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 740/1527] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:09 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1498 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:09.987272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-103dc2c3-8f1c-4a04-8d2b-8ed2557cfb62 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:09.987272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-103dc2c3-8f1c-4a04-8d2b-8ed2557cfb62 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:10.001344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-103dc2c3-8f1c-4a04-8d2b-8ed2557cfb62 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:10.001847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-103dc2c3-8f1c-4a04-8d2b-8ed2557cfb62 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:10.002295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-103dc2c3-8f1c-4a04-8d2b-8ed2557cfb62 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:10.003046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-103dc2c3-8f1c-4a04-8d2b-8ed2557cfb62 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:10.003541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-103dc2c3-8f1c-4a04-8d2b-8ed2557cfb62 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:10.003971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-103dc2c3-8f1c-4a04-8d2b-8ed2557cfb62 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:10.037302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:10.068284 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-72dc1470-04df-4696-ab3a-6afaddd73f19 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.715471 Sep 08 12:45:10.082703 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 788/1528] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:45:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 2731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:45:10.111593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-83f69ef5-4a34-4947-ac77-1a0eb5a551d4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:10.113008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-83f69ef5-4a34-4947-ac77-1a0eb5a551d4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:10.154047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83f69ef5-4a34-4947-ac77-1a0eb5a551d4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:10.156229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83f69ef5-4a34-4947-ac77-1a0eb5a551d4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:10.157714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83f69ef5-4a34-4947-ac77-1a0eb5a551d4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:10.161950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83f69ef5-4a34-4947-ac77-1a0eb5a551d4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:10.163480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83f69ef5-4a34-4947-ac77-1a0eb5a551d4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:10.164530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83f69ef5-4a34-4947-ac77-1a0eb5a551d4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:10.577377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-103dc2c3-8f1c-4a04-8d2b-8ed2557cfb62 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:10.597130 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-103dc2c3-8f1c-4a04-8d2b-8ed2557cfb62 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1211 microversion: 2.1 time: 0.618327 Sep 08 12:45:10.604032 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 741/1529] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:09 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1211 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:10.616128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-77a289ce-bb24-4675-b574-24cb554aae51 tempest-NetworksTest-1888596605 tempest-NetworksTest-1888596605-project-admin] Calling method '.version_select at 0x7fdb3b430b80>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:10.807376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83f69ef5-4a34-4947-ac77-1a0eb5a551d4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:10.846716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83f69ef5-4a34-4947-ac77-1a0eb5a551d4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:10.852967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83f69ef5-4a34-4947-ac77-1a0eb5a551d4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:10.854787 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-83f69ef5-4a34-4947-ac77-1a0eb5a551d4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 0.769523 Sep 08 12:45:10.867659 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 789/1530] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:10 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:10.879759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-cd108d1d-b792-48c5-836b-ad751318d958 req-087ae11c-e42c-4173-93d6-18775bea0fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3390d320-1b6f-4e3a-8f99-fff7b4e179a4", "name": "network-vif-plugged", "status": "completed", "tag": "ed71639b-831f-4e95-b890-50fca7bd47bf"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:10.914110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cd108d1d-b792-48c5-836b-ad751318d958 req-087ae11c-e42c-4173-93d6-18775bea0fc6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:10.919352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cd108d1d-b792-48c5-836b-ad751318d958 req-087ae11c-e42c-4173-93d6-18775bea0fc6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:10.920051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cd108d1d-b792-48c5-836b-ad751318d958 req-087ae11c-e42c-4173-93d6-18775bea0fc6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:10.951686 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-cd108d1d-b792-48c5-836b-ad751318d958 req-087ae11c-e42c-4173-93d6-18775bea0fc6 service nova] Creating event network-vif-plugged:ed71639b-831f-4e95-b890-50fca7bd47bf for instance 3390d320-1b6f-4e3a-8f99-fff7b4e179a4 on n-h2-852084-10 Sep 08 12:45:10.967703 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-cd108d1d-b792-48c5-836b-ad751318d958 req-087ae11c-e42c-4173-93d6-18775bea0fc6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098244 Sep 08 12:45:10.968748 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 790/1531] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:10.980148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-278130ae-c0ff-4954-b6bf-f274026dafb0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:10.986416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-278130ae-c0ff-4954-b6bf-f274026dafb0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:11.189325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-278130ae-c0ff-4954-b6bf-f274026dafb0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:11.199766 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-278130ae-c0ff-4954-b6bf-f274026dafb0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1225 microversion: 2.1 time: 0.227574 Sep 08 12:45:11.202466 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 791/1532] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:10 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1225 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:11.224615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6747837-9e58-4eeb-8a41-4c975755d03d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:11.225736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f6747837-9e58-4eeb-8a41-4c975755d03d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:11.255272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6747837-9e58-4eeb-8a41-4c975755d03d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:11.257944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6747837-9e58-4eeb-8a41-4c975755d03d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:11.259691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6747837-9e58-4eeb-8a41-4c975755d03d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:11.272282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6747837-9e58-4eeb-8a41-4c975755d03d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:11.274037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6747837-9e58-4eeb-8a41-4c975755d03d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:11.276876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6747837-9e58-4eeb-8a41-4c975755d03d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:11.334590 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-77a289ce-bb24-4675-b574-24cb554aae51 tempest-NetworksTest-1888596605 tempest-NetworksTest-1888596605-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks/c37e2e21-e71d-413c-a8dc-a35ec1a46711" status: 200 len: 652 microversion: 2.1 time: 0.728945 Sep 08 12:45:11.343816 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 742/1533] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 12:45:10 2022] GET /compute/v2.1/os-networks/c37e2e21-e71d-413c-a8dc-a35ec1a46711 => generated 652 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:11.352145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a7af2eff-5806-4736-b372-a9abcb8d9c96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:11.352783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a7af2eff-5806-4736-b372-a9abcb8d9c96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:11.384391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7af2eff-5806-4736-b372-a9abcb8d9c96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:11.384906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7af2eff-5806-4736-b372-a9abcb8d9c96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:11.385549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7af2eff-5806-4736-b372-a9abcb8d9c96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:11.399624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7af2eff-5806-4736-b372-a9abcb8d9c96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:11.399624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7af2eff-5806-4736-b372-a9abcb8d9c96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:11.399624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7af2eff-5806-4736-b372-a9abcb8d9c96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:12.114346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a7af2eff-5806-4736-b372-a9abcb8d9c96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:12.140035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f6747837-9e58-4eeb-8a41-4c975755d03d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:12.154897 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a7af2eff-5806-4736-b372-a9abcb8d9c96 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1498 microversion: 2.1 time: 0.809582 Sep 08 12:45:12.194979 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f6747837-9e58-4eeb-8a41-4c975755d03d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1317 microversion: 2.1 time: 0.987359 Sep 08 12:45:12.198092 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 743/1534] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:11 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1498 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:12.208390 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 792/1535] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:11 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1317 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:12.218232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4a8d28c-7756-407b-b457-7278b63ef912 tempest-NetworksTest-1888596605 tempest-NetworksTest-1888596605-project-admin] Calling method '.version_select at 0x7fdb3a793700>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:12.231997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7987c303-0fdf-4d5d-b729-20537ca2ef81 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:12.252825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7987c303-0fdf-4d5d-b729-20537ca2ef81 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:12.278539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7987c303-0fdf-4d5d-b729-20537ca2ef81 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:12.283588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7987c303-0fdf-4d5d-b729-20537ca2ef81 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:12.285213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7987c303-0fdf-4d5d-b729-20537ca2ef81 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:12.289456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7987c303-0fdf-4d5d-b729-20537ca2ef81 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:12.296701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7987c303-0fdf-4d5d-b729-20537ca2ef81 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:12.299574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7987c303-0fdf-4d5d-b729-20537ca2ef81 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:12.726595 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b4a8d28c-7756-407b-b457-7278b63ef912 tempest-NetworksTest-1888596605 tempest-NetworksTest-1888596605-project-admin] 10.222.0.78 "GET /compute/v2.1/os-networks" status: 200 len: 7417 microversion: 2.1 time: 0.526341 Sep 08 12:45:12.728383 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 744/1536] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:45:12 2022] GET /compute/v2.1/os-networks => generated 7417 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:12.736919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-43f72710-60ec-43f5-9f30-bf8a0c4b5413 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:12.739829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-43f72710-60ec-43f5-9f30-bf8a0c4b5413 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:12.762587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43f72710-60ec-43f5-9f30-bf8a0c4b5413 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:12.766712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43f72710-60ec-43f5-9f30-bf8a0c4b5413 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:12.767685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43f72710-60ec-43f5-9f30-bf8a0c4b5413 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:12.771563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43f72710-60ec-43f5-9f30-bf8a0c4b5413 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:12.772769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43f72710-60ec-43f5-9f30-bf8a0c4b5413 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:12.773623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43f72710-60ec-43f5-9f30-bf8a0c4b5413 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:12.849226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7987c303-0fdf-4d5d-b729-20537ca2ef81 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:12.869982 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7987c303-0fdf-4d5d-b729-20537ca2ef81 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1211 microversion: 2.1 time: 0.658638 Sep 08 12:45:12.872039 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 793/1537] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:12 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1211 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:12.888851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-11bc3d32-7ae2-47d2-95fd-eb3e86006968 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:12.890101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-11bc3d32-7ae2-47d2-95fd-eb3e86006968 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:12.914716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11bc3d32-7ae2-47d2-95fd-eb3e86006968 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:12.931946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11bc3d32-7ae2-47d2-95fd-eb3e86006968 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:12.932787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11bc3d32-7ae2-47d2-95fd-eb3e86006968 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:12.933809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11bc3d32-7ae2-47d2-95fd-eb3e86006968 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:12.934533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11bc3d32-7ae2-47d2-95fd-eb3e86006968 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:12.935116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11bc3d32-7ae2-47d2-95fd-eb3e86006968 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:13.210993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-11bc3d32-7ae2-47d2-95fd-eb3e86006968 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:13.245003 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-11bc3d32-7ae2-47d2-95fd-eb3e86006968 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1221 microversion: 2.1 time: 0.364539 Sep 08 12:45:13.248002 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 794/1538] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:12 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1221 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:13.259191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-2090607937", "imageRef": "3ac36144-0ba2-4976-b577-b3fa75331700", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "3256486a-000a-43aa-b4f8-21e736b74052"}], "security_groups": [{"name": "tempest-securitygroup--1936931280"}], "key_name": "tempest-keypair-867829672", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:13.367036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-43f72710-60ec-43f5-9f30-bf8a0c4b5413 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:13.399126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-43f72710-60ec-43f5-9f30-bf8a0c4b5413 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:13.403633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-43f72710-60ec-43f5-9f30-bf8a0c4b5413 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:13.407077 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-43f72710-60ec-43f5-9f30-bf8a0c4b5413 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 0.676969 Sep 08 12:45:13.408571 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 745/1539] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:12 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:13.457559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-faae2700-d6e0-462c-a009-be30ff064ae1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:13.458669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-faae2700-d6e0-462c-a009-be30ff064ae1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:13.471325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-faae2700-d6e0-462c-a009-be30ff064ae1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:13.472739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-faae2700-d6e0-462c-a009-be30ff064ae1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:13.474018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-faae2700-d6e0-462c-a009-be30ff064ae1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:13.476049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-faae2700-d6e0-462c-a009-be30ff064ae1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:13.477470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-faae2700-d6e0-462c-a009-be30ff064ae1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:13.478550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-faae2700-d6e0-462c-a009-be30ff064ae1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:13.725180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] validate_networks() for [('3256486a-000a-43aa-b4f8-21e736b74052', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:45:14.075330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-faae2700-d6e0-462c-a009-be30ff064ae1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:14.111943 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-faae2700-d6e0-462c-a009-be30ff064ae1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1498 microversion: 2.1 time: 0.674406 Sep 08 12:45:14.113489 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 746/1540] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:13 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1498 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:14.120953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-89fe921a-6188-49e7-8edb-6fdb1f7148d0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:14.122368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-89fe921a-6188-49e7-8edb-6fdb1f7148d0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:14.133604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89fe921a-6188-49e7-8edb-6fdb1f7148d0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:14.135566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89fe921a-6188-49e7-8edb-6fdb1f7148d0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:14.136454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89fe921a-6188-49e7-8edb-6fdb1f7148d0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:14.137669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89fe921a-6188-49e7-8edb-6fdb1f7148d0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:14.138890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89fe921a-6188-49e7-8edb-6fdb1f7148d0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:14.139633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89fe921a-6188-49e7-8edb-6fdb1f7148d0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:14.938280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-89fe921a-6188-49e7-8edb-6fdb1f7148d0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:14.953778 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-89fe921a-6188-49e7-8edb-6fdb1f7148d0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1467 microversion: 2.1 time: 0.832088 Sep 08 12:45:14.954789 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 747/1541] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:14 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1467 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:14.962335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c7d9976f-ef03-4eb8-80d5-9702091679c3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:14.963400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c7d9976f-ef03-4eb8-80d5-9702091679c3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:14.978389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=57 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:14.980885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7d9976f-ef03-4eb8-80d5-9702091679c3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:14.984181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7d9976f-ef03-4eb8-80d5-9702091679c3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:14.984927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7d9976f-ef03-4eb8-80d5-9702091679c3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:14.993006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7d9976f-ef03-4eb8-80d5-9702091679c3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:14.993873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7d9976f-ef03-4eb8-80d5-9702091679c3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:14.994401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7d9976f-ef03-4eb8-80d5-9702091679c3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:15.532252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c7d9976f-ef03-4eb8-80d5-9702091679c3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:15.567251 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c7d9976f-ef03-4eb8-80d5-9702091679c3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1211 microversion: 2.1 time: 0.611163 Sep 08 12:45:15.568257 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 748/1542] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:14 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1211 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:15.578419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-19480c8f-29f1-4cfd-9033-8d66598b7bb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:15.592142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:45:15.593635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:45:15.594469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:45:15.595119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:45:15.595952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:45:15.600743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-19480c8f-29f1-4cfd-9033-8d66598b7bb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:15.619963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19480c8f-29f1-4cfd-9033-8d66598b7bb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:15.620485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19480c8f-29f1-4cfd-9033-8d66598b7bb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:15.620929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19480c8f-29f1-4cfd-9033-8d66598b7bb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:15.621666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19480c8f-29f1-4cfd-9033-8d66598b7bb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:15.622132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19480c8f-29f1-4cfd-9033-8d66598b7bb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:15.622562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19480c8f-29f1-4cfd-9033-8d66598b7bb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:15.651584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:15.657320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:15.660607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:15.661680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:15.669228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:15.707599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:15.712164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:15.781419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-19480c8f-29f1-4cfd-9033-8d66598b7bb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:15.814495 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-19480c8f-29f1-4cfd-9033-8d66598b7bb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1283 microversion: 2.1 time: 0.242402 Sep 08 12:45:15.834710 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 749/1543] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:15 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1283 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:15.849377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Getting quotas for project 793c739b689c423cb09af2ce731ac899. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:45:15.870754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Getting quotas for user 77d18d15099442da8c0924f402b03ff0 and project 793c739b689c423cb09af2ce731ac899. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:45:15.871618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0fd79090-8714-43be-a6a9-c827ccdf0072 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:15.873049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0fd79090-8714-43be-a6a9-c827ccdf0072 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:15.887344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0fd79090-8714-43be-a6a9-c827ccdf0072 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:15.888660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0fd79090-8714-43be-a6a9-c827ccdf0072 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:15.889817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0fd79090-8714-43be-a6a9-c827ccdf0072 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:15.891418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0fd79090-8714-43be-a6a9-c827ccdf0072 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:15.892518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0fd79090-8714-43be-a6a9-c827ccdf0072 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:15.893875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0fd79090-8714-43be-a6a9-c827ccdf0072 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:15.938962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:45:15.944018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3ac36144-0ba2-4976-b577-b3fa75331700',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:45:16.139714 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8a9171e5-0ef1-4daa-8da4-3463699deb63 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.889611 Sep 08 12:45:16.140601 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 795/1544] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:45:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 2892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:45:16.157513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-928fa42c-89b8-4000-a7ff-221ed0156ef7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:16.158848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-928fa42c-89b8-4000-a7ff-221ed0156ef7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 810cd6cb-eab9-4427-aa03-597406fd20f6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:16.168404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-928fa42c-89b8-4000-a7ff-221ed0156ef7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:16.169196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-928fa42c-89b8-4000-a7ff-221ed0156ef7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:16.170068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-928fa42c-89b8-4000-a7ff-221ed0156ef7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:16.172129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-928fa42c-89b8-4000-a7ff-221ed0156ef7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:16.172918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-928fa42c-89b8-4000-a7ff-221ed0156ef7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:16.175079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-928fa42c-89b8-4000-a7ff-221ed0156ef7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:17.623772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-928fa42c-89b8-4000-a7ff-221ed0156ef7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:17.630340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:17.650219 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-928fa42c-89b8-4000-a7ff-221ed0156ef7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6" status: 200 len: 1467 microversion: 2.1 time: 1.506701 Sep 08 12:45:17.659009 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 796/1545] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:16 2022] GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6 => generated 1467 bytes in 1518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:17.708194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79b6087a-9167-4628-a843-b3bf5ca254a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:17.726898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-79b6087a-9167-4628-a843-b3bf5ca254a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:17.755727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79b6087a-9167-4628-a843-b3bf5ca254a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:17.756665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79b6087a-9167-4628-a843-b3bf5ca254a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:17.758323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79b6087a-9167-4628-a843-b3bf5ca254a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:17.759958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79b6087a-9167-4628-a843-b3bf5ca254a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:17.760996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79b6087a-9167-4628-a843-b3bf5ca254a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:17.761998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79b6087a-9167-4628-a843-b3bf5ca254a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:18.132976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0fd79090-8714-43be-a6a9-c827ccdf0072 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:18.154879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0fd79090-8714-43be-a6a9-c827ccdf0072 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:18.167027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0fd79090-8714-43be-a6a9-c827ccdf0072 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:18.184599 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0fd79090-8714-43be-a6a9-c827ccdf0072 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 2.327287 Sep 08 12:45:18.186137 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 750/1546] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:15 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 2344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:18.195871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c817a56d-707c-4824-9f6d-d0d808608b2e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:18.197002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c817a56d-707c-4824-9f6d-d0d808608b2e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:18.224528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c817a56d-707c-4824-9f6d-d0d808608b2e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:18.225452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c817a56d-707c-4824-9f6d-d0d808608b2e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:18.228351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c817a56d-707c-4824-9f6d-d0d808608b2e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:18.234065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c817a56d-707c-4824-9f6d-d0d808608b2e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:18.237342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c817a56d-707c-4824-9f6d-d0d808608b2e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:18.238190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c817a56d-707c-4824-9f6d-d0d808608b2e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:18.426433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-79b6087a-9167-4628-a843-b3bf5ca254a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:18.437222 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-79b6087a-9167-4628-a843-b3bf5ca254a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1498 microversion: 2.1 time: 0.775610 Sep 08 12:45:18.438607 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 797/1547] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:17 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1498 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:18.441395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c817a56d-707c-4824-9f6d-d0d808608b2e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d18d15099442da8c0924f402b03ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793c739b689c423cb09af2ce731ac899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:18.444782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-795e538b-8df0-4fae-ba43-9d5345bbe422 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:18.445804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-795e538b-8df0-4fae-ba43-9d5345bbe422 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:18.454175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-795e538b-8df0-4fae-ba43-9d5345bbe422 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:18.455173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-795e538b-8df0-4fae-ba43-9d5345bbe422 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:18.455935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-795e538b-8df0-4fae-ba43-9d5345bbe422 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:18.457045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-795e538b-8df0-4fae-ba43-9d5345bbe422 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:18.457773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-795e538b-8df0-4fae-ba43-9d5345bbe422 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:18.458443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-795e538b-8df0-4fae-ba43-9d5345bbe422 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:18.480500 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c817a56d-707c-4824-9f6d-d0d808608b2e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 200 len: 1297 microversion: 2.1 time: 0.290823 Sep 08 12:45:18.484846 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 751/1548] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:18 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 1297 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:18.494830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-de140eae-1cb2-4d11-ab5b-3515a9723ce8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:18.497932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-de140eae-1cb2-4d11-ab5b-3515a9723ce8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:18.516172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de140eae-1cb2-4d11-ab5b-3515a9723ce8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:18.517057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de140eae-1cb2-4d11-ab5b-3515a9723ce8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:18.517769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de140eae-1cb2-4d11-ab5b-3515a9723ce8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:18.518789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de140eae-1cb2-4d11-ab5b-3515a9723ce8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:18.519565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de140eae-1cb2-4d11-ab5b-3515a9723ce8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:18.522511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de140eae-1cb2-4d11-ab5b-3515a9723ce8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:19.217435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-de140eae-1cb2-4d11-ab5b-3515a9723ce8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:19.243477 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-de140eae-1cb2-4d11-ab5b-3515a9723ce8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1325 microversion: 2.1 time: 0.756452 Sep 08 12:45:19.244508 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 752/1549] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:18 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1325 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:19.288255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-34c55c5a-a0ba-4023-8b82-db7b114b6673 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-438504539"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:19.297403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-34c55c5a-a0ba-4023-8b82-db7b114b6673 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 810cd6cb-eab9-4427-aa03-597406fd20f6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:19.338304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-34c55c5a-a0ba-4023-8b82-db7b114b6673 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:19.339166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-34c55c5a-a0ba-4023-8b82-db7b114b6673 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:19.340274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-34c55c5a-a0ba-4023-8b82-db7b114b6673 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:19.341858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-34c55c5a-a0ba-4023-8b82-db7b114b6673 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:19.343691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-34c55c5a-a0ba-4023-8b82-db7b114b6673 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:19.344728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-34c55c5a-a0ba-4023-8b82-db7b114b6673 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:19.671374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-795e538b-8df0-4fae-ba43-9d5345bbe422 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:19.692275 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-795e538b-8df0-4fae-ba43-9d5345bbe422 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1199 microversion: 2.1 time: 1.251873 Sep 08 12:45:19.731266 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 798/1550] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:18 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1199 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:19.754721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4904562-415e-4fc3-9a54-cf650d695321 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:19.755936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e4904562-415e-4fc3-9a54-cf650d695321 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:19.786290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4904562-415e-4fc3-9a54-cf650d695321 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:19.787049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4904562-415e-4fc3-9a54-cf650d695321 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:19.790029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4904562-415e-4fc3-9a54-cf650d695321 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:19.793216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4904562-415e-4fc3-9a54-cf650d695321 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:19.795850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4904562-415e-4fc3-9a54-cf650d695321 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:19.798679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4904562-415e-4fc3-9a54-cf650d695321 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:20.130932 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-34c55c5a-a0ba-4023-8b82-db7b114b6673 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "POST /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6/action" status: 202 len: 0 microversion: 2.1 time: 0.879501 Sep 08 12:45:20.132758 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 753/1551] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:45:19 2022] POST /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6/action => generated 0 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 12:45:20.153249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c8628c03-9705-4c58-950b-8f0cc11691ff tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:20.155683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c8628c03-9705-4c58-950b-8f0cc11691ff tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:20.190982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8628c03-9705-4c58-950b-8f0cc11691ff tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:20.195186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8628c03-9705-4c58-950b-8f0cc11691ff tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:20.198803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8628c03-9705-4c58-950b-8f0cc11691ff tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:20.206210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8628c03-9705-4c58-950b-8f0cc11691ff tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:20.208186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8628c03-9705-4c58-950b-8f0cc11691ff tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:20.211776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8628c03-9705-4c58-950b-8f0cc11691ff tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:21.335745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e4904562-415e-4fc3-9a54-cf650d695321 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:21.370149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e4904562-415e-4fc3-9a54-cf650d695321 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:21.379574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e4904562-415e-4fc3-9a54-cf650d695321 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:21.385777 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e4904562-415e-4fc3-9a54-cf650d695321 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 1.658437 Sep 08 12:45:21.399793 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 799/1552] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:19 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 1677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:21.449981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7ac2640f-d461-4b96-962c-319a9668641b tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:21.454090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7ac2640f-d461-4b96-962c-319a9668641b tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:21.478589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ac2640f-d461-4b96-962c-319a9668641b tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:21.481539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ac2640f-d461-4b96-962c-319a9668641b tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:21.484594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ac2640f-d461-4b96-962c-319a9668641b tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:21.493257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ac2640f-d461-4b96-962c-319a9668641b tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:21.499193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ac2640f-d461-4b96-962c-319a9668641b tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:21.500546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ac2640f-d461-4b96-962c-319a9668641b tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:21.724983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c8628c03-9705-4c58-950b-8f0cc11691ff tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:21.773495 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c8628c03-9705-4c58-950b-8f0cc11691ff tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1498 microversion: 2.1 time: 1.631432 Sep 08 12:45:21.782524 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 754/1553] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:20 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1498 bytes in 1649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:21.803861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ac2640f-d461-4b96-962c-319a9668641b tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d18d15099442da8c0924f402b03ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793c739b689c423cb09af2ce731ac899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:21.816334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ebc1faff-e6fc-488a-8587-54eb5389f1ea tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3b47c430>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:21.843395 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7ac2640f-d461-4b96-962c-319a9668641b tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 200 len: 1303 microversion: 2.1 time: 0.440579 Sep 08 12:45:21.864158 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 800/1554] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:21 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 1303 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:21.917652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7f94cea7-60c7-4e32-9c67-11bbd054d61f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:21.924547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7f94cea7-60c7-4e32-9c67-11bbd054d61f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:21.948475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f94cea7-60c7-4e32-9c67-11bbd054d61f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:21.949684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f94cea7-60c7-4e32-9c67-11bbd054d61f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:21.950883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f94cea7-60c7-4e32-9c67-11bbd054d61f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:21.952931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f94cea7-60c7-4e32-9c67-11bbd054d61f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:21.954238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f94cea7-60c7-4e32-9c67-11bbd054d61f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:21.956144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f94cea7-60c7-4e32-9c67-11bbd054d61f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:22.007394 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ebc1faff-e6fc-488a-8587-54eb5389f1ea tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b" status: 200 len: 1452 microversion: 2.1 time: 0.221739 Sep 08 12:45:22.043075 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 755/1555] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:21 2022] GET /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b => generated 1452 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:22.062088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3fc643f5-59e5-4a3f-ac40-fd4bd51fc5b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:22.063328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3fc643f5-59e5-4a3f-ac40-fd4bd51fc5b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:22.105963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3fc643f5-59e5-4a3f-ac40-fd4bd51fc5b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:22.114400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3fc643f5-59e5-4a3f-ac40-fd4bd51fc5b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:22.115491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3fc643f5-59e5-4a3f-ac40-fd4bd51fc5b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:22.117291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3fc643f5-59e5-4a3f-ac40-fd4bd51fc5b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:22.119877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3fc643f5-59e5-4a3f-ac40-fd4bd51fc5b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:22.121361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3fc643f5-59e5-4a3f-ac40-fd4bd51fc5b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:23.333562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7f94cea7-60c7-4e32-9c67-11bbd054d61f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:23.376087 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7f94cea7-60c7-4e32-9c67-11bbd054d61f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1325 microversion: 2.1 time: 1.480220 Sep 08 12:45:23.377292 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 801/1556] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:21 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1325 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:23.400954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f3bd7f9-14cc-4988-b48d-f65b3ad601e6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:23.417278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1f3bd7f9-14cc-4988-b48d-f65b3ad601e6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:23.435698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3fc643f5-59e5-4a3f-ac40-fd4bd51fc5b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:23.444167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f3bd7f9-14cc-4988-b48d-f65b3ad601e6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:23.445050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f3bd7f9-14cc-4988-b48d-f65b3ad601e6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:23.445829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f3bd7f9-14cc-4988-b48d-f65b3ad601e6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:23.450449 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3fc643f5-59e5-4a3f-ac40-fd4bd51fc5b3 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1199 microversion: 2.1 time: 1.404349 Sep 08 12:45:23.453222 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 756/1557] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:22 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1199 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:23.459373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f3bd7f9-14cc-4988-b48d-f65b3ad601e6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:23.460646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f3bd7f9-14cc-4988-b48d-f65b3ad601e6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:23.461359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f3bd7f9-14cc-4988-b48d-f65b3ad601e6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:23.469115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ccf5c53d-0161-45c9-949b-7b6505c3af08 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:23.472261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ccf5c53d-0161-45c9-949b-7b6505c3af08 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:23.488384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccf5c53d-0161-45c9-949b-7b6505c3af08 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:23.491764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccf5c53d-0161-45c9-949b-7b6505c3af08 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:23.494230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccf5c53d-0161-45c9-949b-7b6505c3af08 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:23.495342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccf5c53d-0161-45c9-949b-7b6505c3af08 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:23.500136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccf5c53d-0161-45c9-949b-7b6505c3af08 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:23.501165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccf5c53d-0161-45c9-949b-7b6505c3af08 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:24.149184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1f3bd7f9-14cc-4988-b48d-f65b3ad601e6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:24.220578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1f3bd7f9-14cc-4988-b48d-f65b3ad601e6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:24.232113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1f3bd7f9-14cc-4988-b48d-f65b3ad601e6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:24.238932 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1f3bd7f9-14cc-4988-b48d-f65b3ad601e6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 0.856768 Sep 08 12:45:24.259348 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 802/1558] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:23 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:24.273189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-77af5bf1-b04f-4ddf-b788-07e2e4059458 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:24.274304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-77af5bf1-b04f-4ddf-b788-07e2e4059458 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:24.283668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77af5bf1-b04f-4ddf-b788-07e2e4059458 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:24.285314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77af5bf1-b04f-4ddf-b788-07e2e4059458 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:24.286120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77af5bf1-b04f-4ddf-b788-07e2e4059458 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:24.287064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77af5bf1-b04f-4ddf-b788-07e2e4059458 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:24.288337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77af5bf1-b04f-4ddf-b788-07e2e4059458 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:24.289211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77af5bf1-b04f-4ddf-b788-07e2e4059458 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:24.846004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ccf5c53d-0161-45c9-949b-7b6505c3af08 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:24.865683 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ccf5c53d-0161-45c9-949b-7b6505c3af08 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1498 microversion: 2.1 time: 1.409607 Sep 08 12:45:24.874219 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 757/1559] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:23 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1498 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:24.908344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b1f2688a-2625-40f3-b0cc-c47457a487d8 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3ae35a60>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:25.073804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-77af5bf1-b04f-4ddf-b788-07e2e4059458 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d18d15099442da8c0924f402b03ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793c739b689c423cb09af2ce731ac899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:25.096841 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-77af5bf1-b04f-4ddf-b788-07e2e4059458 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 200 len: 1371 microversion: 2.1 time: 0.835569 Sep 08 12:45:25.100076 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 803/1560] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:24 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 1371 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:25.105771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ef811c82-415a-4eec-8a5d-2c0f379d5511 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:25.106413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ef811c82-415a-4eec-8a5d-2c0f379d5511 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:25.185479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef811c82-415a-4eec-8a5d-2c0f379d5511 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:25.187545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef811c82-415a-4eec-8a5d-2c0f379d5511 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:25.195802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef811c82-415a-4eec-8a5d-2c0f379d5511 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:25.196726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef811c82-415a-4eec-8a5d-2c0f379d5511 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:25.197273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef811c82-415a-4eec-8a5d-2c0f379d5511 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:25.197746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef811c82-415a-4eec-8a5d-2c0f379d5511 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:25.797883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:25.887141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ef811c82-415a-4eec-8a5d-2c0f379d5511 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:25.917299 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ef811c82-415a-4eec-8a5d-2c0f379d5511 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1325 microversion: 2.1 time: 0.815049 Sep 08 12:45:25.941745 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 804/1561] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:25 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1325 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:25.950370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9ca2fcc5-3b67-4d34-8747-4af76f929f6d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:25.953794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9ca2fcc5-3b67-4d34-8747-4af76f929f6d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:25.959587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=18 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:25.980655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ca2fcc5-3b67-4d34-8747-4af76f929f6d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:25.985998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ca2fcc5-3b67-4d34-8747-4af76f929f6d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:25.990838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ca2fcc5-3b67-4d34-8747-4af76f929f6d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:25.992723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ca2fcc5-3b67-4d34-8747-4af76f929f6d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:25.993454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ca2fcc5-3b67-4d34-8747-4af76f929f6d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:25.998090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ca2fcc5-3b67-4d34-8747-4af76f929f6d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:27.416371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9ca2fcc5-3b67-4d34-8747-4af76f929f6d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:27.452052 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9ca2fcc5-3b67-4d34-8747-4af76f929f6d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1199 microversion: 2.1 time: 1.508316 Sep 08 12:45:27.468628 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 805/1562] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:25 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1199 bytes in 1526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:28.069043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fd70aebc-ee99-4fc7-9cf1-1b1e7bf1ecbd tempest-QuotaClassesAdminTestJSON-2012596277 tempest-QuotaClassesAdminTestJSON-2012596277-project-admin] Calling method '.version_select at 0x7fdb36cbee50>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:28.175431 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fd70aebc-ee99-4fc7-9cf1-1b1e7bf1ecbd tempest-QuotaClassesAdminTestJSON-2012596277 tempest-QuotaClassesAdminTestJSON-2012596277-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.675870 Sep 08 12:45:28.184625 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 806/1563] 10.222.0.78 () {58 vars in 1185 bytes} [Thu Sep 8 12:45:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:28.216330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-9921be81-1abc-48a7-8c50-5a26cf99a37d req-f7427721-dc36-4b7f-8605-179584414a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5776fc4-0794-44f8-b595-fc8f50fcbbe4", "tag": "1bc8eeea-c3ad-4bbb-af0a-cd58872c9650"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:28.291955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9921be81-1abc-48a7-8c50-5a26cf99a37d req-f7427721-dc36-4b7f-8605-179584414a84 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:28.292865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9921be81-1abc-48a7-8c50-5a26cf99a37d req-f7427721-dc36-4b7f-8605-179584414a84 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:28.297005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9921be81-1abc-48a7-8c50-5a26cf99a37d req-f7427721-dc36-4b7f-8605-179584414a84 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:28.344634 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-9921be81-1abc-48a7-8c50-5a26cf99a37d req-f7427721-dc36-4b7f-8605-179584414a84 service nova] Creating event network-changed:1bc8eeea-c3ad-4bbb-af0a-cd58872c9650 for instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 on n-h2-852084-10 Sep 08 12:45:28.368844 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-9921be81-1abc-48a7-8c50-5a26cf99a37d req-f7427721-dc36-4b7f-8605-179584414a84 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.179869 Sep 08 12:45:28.376190 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 807/1564] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:28.391840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fec4f8dd-47f8-44e5-a7a7-2ff5244f8fff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:28.397393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fec4f8dd-47f8-44e5-a7a7-2ff5244f8fff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:28.419130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fec4f8dd-47f8-44e5-a7a7-2ff5244f8fff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:28.421554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fec4f8dd-47f8-44e5-a7a7-2ff5244f8fff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:28.422393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fec4f8dd-47f8-44e5-a7a7-2ff5244f8fff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:28.424781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fec4f8dd-47f8-44e5-a7a7-2ff5244f8fff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:28.428041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fec4f8dd-47f8-44e5-a7a7-2ff5244f8fff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:28.429198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fec4f8dd-47f8-44e5-a7a7-2ff5244f8fff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:29.849797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fec4f8dd-47f8-44e5-a7a7-2ff5244f8fff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:29.871615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fec4f8dd-47f8-44e5-a7a7-2ff5244f8fff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:29.873844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fec4f8dd-47f8-44e5-a7a7-2ff5244f8fff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:29.875559 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fec4f8dd-47f8-44e5-a7a7-2ff5244f8fff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 1.496922 Sep 08 12:45:29.879176 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 808/1565] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:28 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:29.884984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-263435a9-cbf3-45bb-a4fa-35ee7ba9ecb8 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:29.898891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-263435a9-cbf3-45bb-a4fa-35ee7ba9ecb8 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:29.914528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-263435a9-cbf3-45bb-a4fa-35ee7ba9ecb8 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:29.916109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-263435a9-cbf3-45bb-a4fa-35ee7ba9ecb8 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:29.919629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-263435a9-cbf3-45bb-a4fa-35ee7ba9ecb8 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:29.920733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-263435a9-cbf3-45bb-a4fa-35ee7ba9ecb8 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:29.921555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-263435a9-cbf3-45bb-a4fa-35ee7ba9ecb8 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:29.927435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-263435a9-cbf3-45bb-a4fa-35ee7ba9ecb8 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:30.842101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-263435a9-cbf3-45bb-a4fa-35ee7ba9ecb8 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:30.858998 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-263435a9-cbf3-45bb-a4fa-35ee7ba9ecb8 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1498 microversion: 2.1 time: 0.977339 Sep 08 12:45:30.862524 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 809/1566] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:29 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1498 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:30.875022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52739f2c-b14c-49bd-af19-498fd1113848 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:30.878016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-52739f2c-b14c-49bd-af19-498fd1113848 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:30.890769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52739f2c-b14c-49bd-af19-498fd1113848 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:30.891985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52739f2c-b14c-49bd-af19-498fd1113848 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:30.893416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52739f2c-b14c-49bd-af19-498fd1113848 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:30.895700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52739f2c-b14c-49bd-af19-498fd1113848 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:30.897880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52739f2c-b14c-49bd-af19-498fd1113848 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:30.899169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52739f2c-b14c-49bd-af19-498fd1113848 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:32.508571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-52739f2c-b14c-49bd-af19-498fd1113848 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d18d15099442da8c0924f402b03ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793c739b689c423cb09af2ce731ac899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:32.531024 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-52739f2c-b14c-49bd-af19-498fd1113848 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 200 len: 1371 microversion: 2.1 time: 1.666449 Sep 08 12:45:32.539111 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 810/1567] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:30 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 1371 bytes in 1676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:32.554242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c0368a76-5df6-468c-b9b5-40451a7203ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:32.560394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c0368a76-5df6-468c-b9b5-40451a7203ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:32.591508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0368a76-5df6-468c-b9b5-40451a7203ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:32.596296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0368a76-5df6-468c-b9b5-40451a7203ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:32.597147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0368a76-5df6-468c-b9b5-40451a7203ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:32.598321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0368a76-5df6-468c-b9b5-40451a7203ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:32.611182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0368a76-5df6-468c-b9b5-40451a7203ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:32.617487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0368a76-5df6-468c-b9b5-40451a7203ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:33.442910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c0368a76-5df6-468c-b9b5-40451a7203ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:33.472145 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c0368a76-5df6-468c-b9b5-40451a7203ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1325 microversion: 2.1 time: 0.930637 Sep 08 12:45:33.481470 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 811/1568] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:32 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1325 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:33.495683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aa977c50-49e9-4585-8274-6d977f051d31 tempest-QuotaClassesAdminTestJSON-2012596277 tempest-QuotaClassesAdminTestJSON-2012596277-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3742c160>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:33.497258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=17 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:33.893229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:INSERT=11,nova_api:SELECT=82,nova_api:UPDATE=7 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:34.256612 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aa977c50-49e9-4585-8274-6d977f051d31 tempest-QuotaClassesAdminTestJSON-2012596277 tempest-QuotaClassesAdminTestJSON-2012596277-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.773635 Sep 08 12:45:34.257550 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 812/1569] 10.222.0.78 () {60 vars in 1206 bytes} [Thu Sep 8 12:45:33 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:34.278122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-68f8e154-86fc-4a33-8f45-53051f338e2e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:34.280243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-68f8e154-86fc-4a33-8f45-53051f338e2e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:34.299818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68f8e154-86fc-4a33-8f45-53051f338e2e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:34.301366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68f8e154-86fc-4a33-8f45-53051f338e2e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:34.302678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68f8e154-86fc-4a33-8f45-53051f338e2e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:34.304634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68f8e154-86fc-4a33-8f45-53051f338e2e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:34.306038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68f8e154-86fc-4a33-8f45-53051f338e2e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:34.307113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68f8e154-86fc-4a33-8f45-53051f338e2e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:34.662478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-68f8e154-86fc-4a33-8f45-53051f338e2e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:34.692951 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-68f8e154-86fc-4a33-8f45-53051f338e2e tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1199 microversion: 2.1 time: 0.432791 Sep 08 12:45:34.696912 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 813/1570] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:34 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1199 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:34.722661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ed99b068-b11f-440e-8b18-4577ba88626c req-82a41657-bfdc-4a1d-89df-6982bdf515c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810cd6cb-eab9-4427-aa03-597406fd20f6", "name": "network-vif-plugged", "status": "completed", "tag": "7817753f-a720-43f2-8c41-dcb97e0c1bbd"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:34.755294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ed99b068-b11f-440e-8b18-4577ba88626c req-82a41657-bfdc-4a1d-89df-6982bdf515c2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:34.756527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ed99b068-b11f-440e-8b18-4577ba88626c req-82a41657-bfdc-4a1d-89df-6982bdf515c2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:34.757105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ed99b068-b11f-440e-8b18-4577ba88626c req-82a41657-bfdc-4a1d-89df-6982bdf515c2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:34.798144 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ed99b068-b11f-440e-8b18-4577ba88626c req-82a41657-bfdc-4a1d-89df-6982bdf515c2 service nova] Creating event network-vif-plugged:7817753f-a720-43f2-8c41-dcb97e0c1bbd for instance 810cd6cb-eab9-4427-aa03-597406fd20f6 on n-h2-852084-10 Sep 08 12:45:34.813675 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ed99b068-b11f-440e-8b18-4577ba88626c req-82a41657-bfdc-4a1d-89df-6982bdf515c2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114892 Sep 08 12:45:34.818409 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 814/1571] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:34.826935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-44fd03ad-05d7-43d4-b2ac-2342b746286d req-223a74ed-1a91-4267-924f-0e6ce8db280d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64629c30-c7bd-49ef-b0dd-5e17ce9ade56", "tag": "60fbb237-266e-49a4-bd28-6c90c3640508"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:34.853959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:34.854907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-44fd03ad-05d7-43d4-b2ac-2342b746286d req-223a74ed-1a91-4267-924f-0e6ce8db280d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:34.855347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-44fd03ad-05d7-43d4-b2ac-2342b746286d req-223a74ed-1a91-4267-924f-0e6ce8db280d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:34.855972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-44fd03ad-05d7-43d4-b2ac-2342b746286d req-223a74ed-1a91-4267-924f-0e6ce8db280d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:34.895391 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-44fd03ad-05d7-43d4-b2ac-2342b746286d req-223a74ed-1a91-4267-924f-0e6ce8db280d service nova] Creating event network-changed:60fbb237-266e-49a4-bd28-6c90c3640508 for instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 on n-h1-852084-10 Sep 08 12:45:34.902543 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-44fd03ad-05d7-43d4-b2ac-2342b746286d req-223a74ed-1a91-4267-924f-0e6ce8db280d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082020 Sep 08 12:45:34.903925 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 815/1572] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:35.313927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9acad61-092c-43dd-8fab-63d744c846b4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:35.315062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a9acad61-092c-43dd-8fab-63d744c846b4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:35.346899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9acad61-092c-43dd-8fab-63d744c846b4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:35.347890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9acad61-092c-43dd-8fab-63d744c846b4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:35.348680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9acad61-092c-43dd-8fab-63d744c846b4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:35.350045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9acad61-092c-43dd-8fab-63d744c846b4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:35.350924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9acad61-092c-43dd-8fab-63d744c846b4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:35.351879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9acad61-092c-43dd-8fab-63d744c846b4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:35.899552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9acad61-092c-43dd-8fab-63d744c846b4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:35.916398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9acad61-092c-43dd-8fab-63d744c846b4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:35.922070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9acad61-092c-43dd-8fab-63d744c846b4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:35.925506 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a9acad61-092c-43dd-8fab-63d744c846b4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 1.017977 Sep 08 12:45:35.942327 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 816/1573] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:34 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:35.959204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-65fa35b2-82c5-4e79-b976-f33b4a3fa0e9 req-61548cca-f08c-4fb3-abb2-c909ebf51250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba78845-4ce9-474d-ac71-a91626b110d1", "name": "network-vif-unplugged", "status": "completed", "tag": "0305f968-e274-437c-8891-b5da427a44bc"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:35.981925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-65fa35b2-82c5-4e79-b976-f33b4a3fa0e9 req-61548cca-f08c-4fb3-abb2-c909ebf51250 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:35.982827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-65fa35b2-82c5-4e79-b976-f33b4a3fa0e9 req-61548cca-f08c-4fb3-abb2-c909ebf51250 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:35.983510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-65fa35b2-82c5-4e79-b976-f33b4a3fa0e9 req-61548cca-f08c-4fb3-abb2-c909ebf51250 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:36.002204 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-65fa35b2-82c5-4e79-b976-f33b4a3fa0e9 req-61548cca-f08c-4fb3-abb2-c909ebf51250 service nova] Creating event network-vif-unplugged:0305f968-e274-437c-8891-b5da427a44bc for instance 2ba78845-4ce9-474d-ac71-a91626b110d1 on n-h1-852084-10 Sep 08 12:45:36.008954 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-65fa35b2-82c5-4e79-b976-f33b4a3fa0e9 req-61548cca-f08c-4fb3-abb2-c909ebf51250 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057892 Sep 08 12:45:36.015188 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 817/1574] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:36.026778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-83b65c2b-dfb7-467f-a3a6-503a0aedc1ca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:36.028933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-83b65c2b-dfb7-467f-a3a6-503a0aedc1ca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:36.041274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83b65c2b-dfb7-467f-a3a6-503a0aedc1ca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:36.042098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83b65c2b-dfb7-467f-a3a6-503a0aedc1ca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:36.042908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83b65c2b-dfb7-467f-a3a6-503a0aedc1ca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:36.043696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83b65c2b-dfb7-467f-a3a6-503a0aedc1ca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:36.044262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83b65c2b-dfb7-467f-a3a6-503a0aedc1ca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:36.044693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83b65c2b-dfb7-467f-a3a6-503a0aedc1ca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:36.051996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:36.423675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83b65c2b-dfb7-467f-a3a6-503a0aedc1ca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:36.437166 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-83b65c2b-dfb7-467f-a3a6-503a0aedc1ca tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 200 len: 1475 microversion: 2.1 time: 0.419871 Sep 08 12:45:36.445656 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 818/1575] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:36 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 1475 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:36.655131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-726371668", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:41.862043 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b1f2688a-2625-40f3-b0cc-c47457a487d8 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b" status: 200 len: 1452 microversion: 2.1 time: 16.981901 Sep 08 12:45:41.867159 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 758/1576] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:24 2022] GET /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b => generated 1452 bytes in 16989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:41.883162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] validate_networks() for [('dbbef684-d919-4b69-9ace-2501fd7b2925', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:45:41.890207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a5c81262-4012-49d5-a080-3f03482543e4 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:41.891371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a5c81262-4012-49d5-a080-3f03482543e4 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:41.903057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5c81262-4012-49d5-a080-3f03482543e4 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:41.905118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5c81262-4012-49d5-a080-3f03482543e4 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:41.905871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5c81262-4012-49d5-a080-3f03482543e4 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:41.906995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5c81262-4012-49d5-a080-3f03482543e4 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:41.907667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5c81262-4012-49d5-a080-3f03482543e4 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:41.908333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5c81262-4012-49d5-a080-3f03482543e4 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:42.271207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a5c81262-4012-49d5-a080-3f03482543e4 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d18d15099442da8c0924f402b03ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793c739b689c423cb09af2ce731ac899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:42.294222 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a5c81262-4012-49d5-a080-3f03482543e4 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 200 len: 1371 microversion: 2.1 time: 0.425681 Sep 08 12:45:42.312886 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 759/1577] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:41 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 1371 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:42.319560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a4c65588-3d62-44c4-992c-33c63b56387f tempest-QuotaClassesAdminTestJSON-2012596277 tempest-QuotaClassesAdminTestJSON-2012596277-project-admin] Calling method '.version_select at 0x7fdb3f2cf670>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:42.344472 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a4c65588-3d62-44c4-992c-33c63b56387f tempest-QuotaClassesAdminTestJSON-2012596277 tempest-QuotaClassesAdminTestJSON-2012596277-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.030286 Sep 08 12:45:42.359174 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 760/1578] 10.222.0.78 () {58 vars in 1185 bytes} [Thu Sep 8 12:45:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:42.369650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff098dc1-387f-4f86-9a8b-45188cec51e3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:42.376556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ff098dc1-387f-4f86-9a8b-45188cec51e3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:42.390320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff098dc1-387f-4f86-9a8b-45188cec51e3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:42.391893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff098dc1-387f-4f86-9a8b-45188cec51e3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:42.393700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff098dc1-387f-4f86-9a8b-45188cec51e3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:42.395641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff098dc1-387f-4f86-9a8b-45188cec51e3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:42.396920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff098dc1-387f-4f86-9a8b-45188cec51e3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:42.398093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff098dc1-387f-4f86-9a8b-45188cec51e3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:42.702650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:45:42.703090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:45:42.704032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ff098dc1-387f-4f86-9a8b-45188cec51e3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:42.708725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:45:42.709222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:45:42.709668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:45:42.718607 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ff098dc1-387f-4f86-9a8b-45188cec51e3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1325 microversion: 2.1 time: 0.356650 Sep 08 12:45:42.731322 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 761/1579] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:42 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:42.731606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:42.731606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:42.731606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:42.731606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:42.738223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d3cc436-b9b4-48c7-81c5-486fbd9ab820 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:42.738223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d3cc436-b9b4-48c7-81c5-486fbd9ab820 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:42.738676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:42.738848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:42.757244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3cc436-b9b4-48c7-81c5-486fbd9ab820 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:42.758051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3cc436-b9b4-48c7-81c5-486fbd9ab820 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:42.758487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3cc436-b9b4-48c7-81c5-486fbd9ab820 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:42.759351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3cc436-b9b4-48c7-81c5-486fbd9ab820 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:42.759849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3cc436-b9b4-48c7-81c5-486fbd9ab820 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:42.760277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3cc436-b9b4-48c7-81c5-486fbd9ab820 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:42.797095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Getting quotas for project 140b9d3cf7484c5784af2808e1ba0954. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:45:42.803380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Getting quotas for user 15d486316fc448eaa9f35bbf895ac50a and project 140b9d3cf7484c5784af2808e1ba0954. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:45:42.823212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:45:42.828958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:45:42.982371 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fbb5912b-83ee-4c0d-8602-c979248e4276 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.534693 Sep 08 12:45:43.007921 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 819/1580] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:45:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 6561 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:45:43.036090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-63a332ef-2ee3-48b4-9e4e-c7dc385a98a1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-690229081"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:43.040394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-63a332ef-2ee3-48b4-9e4e-c7dc385a98a1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:43.048962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8d3cc436-b9b4-48c7-81c5-486fbd9ab820 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:43.081605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63a332ef-2ee3-48b4-9e4e-c7dc385a98a1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:43.082101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63a332ef-2ee3-48b4-9e4e-c7dc385a98a1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:43.082765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63a332ef-2ee3-48b4-9e4e-c7dc385a98a1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:43.083837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63a332ef-2ee3-48b4-9e4e-c7dc385a98a1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:43.084502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63a332ef-2ee3-48b4-9e4e-c7dc385a98a1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:43.085152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63a332ef-2ee3-48b4-9e4e-c7dc385a98a1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:43.107200 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d3cc436-b9b4-48c7-81c5-486fbd9ab820 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1199 microversion: 2.1 time: 0.386072 Sep 08 12:45:43.115192 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 762/1581] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:42 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1199 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:43.127056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2e2af1c0-bd6f-431a-90d5-ec4e3725bf91 req-4507e416-232b-463e-9793-980c399a186a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ca204f-7749-4f5a-b800-091b9695b80a", "name": "network-vif-plugged", "status": "completed", "tag": "25c32986-35c2-405b-a739-03cfb2c72c38"}, {"server_uuid": "c5776fc4-0794-44f8-b595-fc8f50fcbbe4", "name": "network-vif-plugged", "status": "completed", "tag": "1bc8eeea-c3ad-4bbb-af0a-cd58872c9650"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:43.151952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2e2af1c0-bd6f-431a-90d5-ec4e3725bf91 req-4507e416-232b-463e-9793-980c399a186a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:43.152697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2e2af1c0-bd6f-431a-90d5-ec4e3725bf91 req-4507e416-232b-463e-9793-980c399a186a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:43.153501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2e2af1c0-bd6f-431a-90d5-ec4e3725bf91 req-4507e416-232b-463e-9793-980c399a186a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:43.217252 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2e2af1c0-bd6f-431a-90d5-ec4e3725bf91 req-4507e416-232b-463e-9793-980c399a186a service nova] Creating event network-vif-plugged:25c32986-35c2-405b-a739-03cfb2c72c38 for instance 79ca204f-7749-4f5a-b800-091b9695b80a on n-h1-852084-10 Sep 08 12:45:43.218162 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2e2af1c0-bd6f-431a-90d5-ec4e3725bf91 req-4507e416-232b-463e-9793-980c399a186a service nova] Creating event network-vif-plugged:1bc8eeea-c3ad-4bbb-af0a-cd58872c9650 for instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 on n-h2-852084-10 Sep 08 12:45:43.267546 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2e2af1c0-bd6f-431a-90d5-ec4e3725bf91 req-4507e416-232b-463e-9793-980c399a186a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.149716 Sep 08 12:45:43.269326 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 763/1582] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:43.284755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6aac31f3-075b-40c2-9ad0-05d51d18015b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:43.286053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6aac31f3-075b-40c2-9ad0-05d51d18015b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:43.305189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6aac31f3-075b-40c2-9ad0-05d51d18015b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:43.305718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6aac31f3-075b-40c2-9ad0-05d51d18015b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:43.306209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6aac31f3-075b-40c2-9ad0-05d51d18015b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:43.306988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6aac31f3-075b-40c2-9ad0-05d51d18015b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:43.307544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6aac31f3-075b-40c2-9ad0-05d51d18015b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:43.308014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6aac31f3-075b-40c2-9ad0-05d51d18015b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:43.797655 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-63a332ef-2ee3-48b4-9e4e-c7dc385a98a1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "POST /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504/action" status: 202 len: 0 microversion: 2.1 time: 0.784330 Sep 08 12:45:43.801510 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 820/1583] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:45:43 2022] POST /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504/action => generated 0 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 12:45:43.829659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-42969c24-b690-4306-848e-b42416d9f59b req-15001190-7e0c-4bf9-8e43-88f6fdf62be0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ba78845-4ce9-474d-ac71-a91626b110d1", "tag": "0305f968-e274-437c-8891-b5da427a44bc"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:43.878198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-42969c24-b690-4306-848e-b42416d9f59b req-15001190-7e0c-4bf9-8e43-88f6fdf62be0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:43.879657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-42969c24-b690-4306-848e-b42416d9f59b req-15001190-7e0c-4bf9-8e43-88f6fdf62be0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:43.880704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-42969c24-b690-4306-848e-b42416d9f59b req-15001190-7e0c-4bf9-8e43-88f6fdf62be0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:43.917683 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-42969c24-b690-4306-848e-b42416d9f59b req-15001190-7e0c-4bf9-8e43-88f6fdf62be0 service nova] Creating event network-changed:0305f968-e274-437c-8891-b5da427a44bc for instance 2ba78845-4ce9-474d-ac71-a91626b110d1 on n-h1-852084-10 Sep 08 12:45:43.935520 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-42969c24-b690-4306-848e-b42416d9f59b req-15001190-7e0c-4bf9-8e43-88f6fdf62be0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130129 Sep 08 12:45:43.954381 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 821/1584] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:43.974033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ea4e183b-0f63-4de3-93c5-ebba9b0dc5ca tempest-QuotaClassesAdminTestJSON-2012596277 tempest-QuotaClassesAdminTestJSON-2012596277-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3702a310>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:44.015198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6aac31f3-075b-40c2-9ad0-05d51d18015b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:44.043341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6aac31f3-075b-40c2-9ad0-05d51d18015b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:44.051150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6aac31f3-075b-40c2-9ad0-05d51d18015b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:44.060405 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6aac31f3-075b-40c2-9ad0-05d51d18015b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 0.785796 Sep 08 12:45:44.065685 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 764/1585] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:43 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:44.085195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-69046e55-04be-4e1d-979d-b6b985a5a55f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3a749e50>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:44.253269 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-69046e55-04be-4e1d-979d-b6b985a5a55f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b" status: 200 len: 1452 microversion: 2.1 time: 0.183195 Sep 08 12:45:44.258367 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 765/1586] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:44 2022] GET /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b => generated 1452 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:44.281373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5ab70378-4b32-4cab-be3d-a4b5679951e2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:44.284792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5ab70378-4b32-4cab-be3d-a4b5679951e2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:44.325757 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ea4e183b-0f63-4de3-93c5-ebba9b0dc5ca tempest-QuotaClassesAdminTestJSON-2012596277 tempest-QuotaClassesAdminTestJSON-2012596277-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.365828 Sep 08 12:45:44.331593 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 822/1587] 10.222.0.78 () {60 vars in 1206 bytes} [Thu Sep 8 12:45:43 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:44.338992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f1eb39a8-e8c1-4640-b0f2-674e1266ab0f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:44.350807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f1eb39a8-e8c1-4640-b0f2-674e1266ab0f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:44.377969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1eb39a8-e8c1-4640-b0f2-674e1266ab0f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:44.384009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1eb39a8-e8c1-4640-b0f2-674e1266ab0f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:44.385512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1eb39a8-e8c1-4640-b0f2-674e1266ab0f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:44.386487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1eb39a8-e8c1-4640-b0f2-674e1266ab0f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:44.387155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1eb39a8-e8c1-4640-b0f2-674e1266ab0f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:44.387827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1eb39a8-e8c1-4640-b0f2-674e1266ab0f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:44.848084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5ab70378-4b32-4cab-be3d-a4b5679951e2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:44.881168 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5ab70378-4b32-4cab-be3d-a4b5679951e2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1213 microversion: 2.1 time: 0.618779 Sep 08 12:45:44.883260 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 766/1588] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:44 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1213 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:44.939815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f48a927e-8f41-434c-8146-88b5ceece002 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:44.963551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f48a927e-8f41-434c-8146-88b5ceece002 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:44.963862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f1eb39a8-e8c1-4640-b0f2-674e1266ab0f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d18d15099442da8c0924f402b03ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793c739b689c423cb09af2ce731ac899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:44.969807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f48a927e-8f41-434c-8146-88b5ceece002 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:44.989018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f48a927e-8f41-434c-8146-88b5ceece002 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:44.989018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f48a927e-8f41-434c-8146-88b5ceece002 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:44.989018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f48a927e-8f41-434c-8146-88b5ceece002 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:44.989018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f48a927e-8f41-434c-8146-88b5ceece002 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:44.990034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f48a927e-8f41-434c-8146-88b5ceece002 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:45.033958 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f1eb39a8-e8c1-4640-b0f2-674e1266ab0f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 200 len: 1371 microversion: 2.1 time: 0.698609 Sep 08 12:45:45.054356 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 823/1589] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:44 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 1371 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:45.077433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2956767d-accb-4a22-aa2c-f72de16bc900 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3716b670>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:45.301127 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2956767d-accb-4a22-aa2c-f72de16bc900 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f" status: 200 len: 1411 microversion: 2.1 time: 0.252691 Sep 08 12:45:45.307161 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 824/1590] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:45 2022] GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f => generated 1411 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:45.329790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-431091fa-8282-4b08-8cf9-003a09fb2853 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:45.333206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-431091fa-8282-4b08-8cf9-003a09fb2853 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:45.363488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-431091fa-8282-4b08-8cf9-003a09fb2853 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:45.365234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-431091fa-8282-4b08-8cf9-003a09fb2853 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:45.367929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-431091fa-8282-4b08-8cf9-003a09fb2853 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:45.376370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-431091fa-8282-4b08-8cf9-003a09fb2853 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:45.377683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-431091fa-8282-4b08-8cf9-003a09fb2853 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:45.380568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-431091fa-8282-4b08-8cf9-003a09fb2853 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:45.637805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f48a927e-8f41-434c-8146-88b5ceece002 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:45.683082 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f48a927e-8f41-434c-8146-88b5ceece002 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1325 microversion: 2.1 time: 0.797624 Sep 08 12:45:45.718337 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 767/1591] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:44 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1325 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:45.744412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1f161a03-1fc2-4ca9-9e79-282feed02ef0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:45.746238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1f161a03-1fc2-4ca9-9e79-282feed02ef0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:45.767352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f161a03-1fc2-4ca9-9e79-282feed02ef0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:45.768809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f161a03-1fc2-4ca9-9e79-282feed02ef0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:45.771404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f161a03-1fc2-4ca9-9e79-282feed02ef0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:45.777543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f161a03-1fc2-4ca9-9e79-282feed02ef0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:45.780534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f161a03-1fc2-4ca9-9e79-282feed02ef0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:45.782580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f161a03-1fc2-4ca9-9e79-282feed02ef0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:45.869450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-431091fa-8282-4b08-8cf9-003a09fb2853 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:45.881956 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-431091fa-8282-4b08-8cf9-003a09fb2853 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1199 microversion: 2.1 time: 0.572920 Sep 08 12:45:45.882568 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 825/1592] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:45 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1199 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:45.903352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cec0cf89-9104-4cb6-98db-3db6fc3c7665 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3730a0d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:46.049185 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cec0cf89-9104-4cb6-98db-3db6fc3c7665 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b" status: 200 len: 1452 microversion: 2.1 time: 0.150769 Sep 08 12:45:46.053929 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 826/1593] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:45 2022] GET /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:46.074023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-32bda5cc-5448-4323-b88f-c16e809ec5a3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:46.082895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-32bda5cc-5448-4323-b88f-c16e809ec5a3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:46.125180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32bda5cc-5448-4323-b88f-c16e809ec5a3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:46.136012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32bda5cc-5448-4323-b88f-c16e809ec5a3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:46.136996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32bda5cc-5448-4323-b88f-c16e809ec5a3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:46.142954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32bda5cc-5448-4323-b88f-c16e809ec5a3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:46.143814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32bda5cc-5448-4323-b88f-c16e809ec5a3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:46.150295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32bda5cc-5448-4323-b88f-c16e809ec5a3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:46.448160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-32bda5cc-5448-4323-b88f-c16e809ec5a3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:46.484467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f161a03-1fc2-4ca9-9e79-282feed02ef0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:46.486153 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-32bda5cc-5448-4323-b88f-c16e809ec5a3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1265 microversion: 2.1 time: 0.421058 Sep 08 12:45:46.488185 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 827/1594] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:46 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1265 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:46.515597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ea2c9eb6-a0f9-4afe-b98b-2625ff629a01 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:46.517764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ea2c9eb6-a0f9-4afe-b98b-2625ff629a01 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:46.533197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea2c9eb6-a0f9-4afe-b98b-2625ff629a01 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:46.534732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea2c9eb6-a0f9-4afe-b98b-2625ff629a01 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:46.536203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea2c9eb6-a0f9-4afe-b98b-2625ff629a01 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:46.537330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f161a03-1fc2-4ca9-9e79-282feed02ef0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:46.538720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea2c9eb6-a0f9-4afe-b98b-2625ff629a01 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:46.539167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f161a03-1fc2-4ca9-9e79-282feed02ef0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:46.540417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea2c9eb6-a0f9-4afe-b98b-2625ff629a01 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:46.540616 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1f161a03-1fc2-4ca9-9e79-282feed02ef0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 0.820300 Sep 08 12:45:46.541807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea2c9eb6-a0f9-4afe-b98b-2625ff629a01 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:46.546401 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 768/1595] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:45 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:46.552016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-adfb4e0d-9b2f-4de1-8322-168e8c5667dc tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3a752dc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:46.669663 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-adfb4e0d-9b2f-4de1-8322-168e8c5667dc tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f" status: 200 len: 1411 microversion: 2.1 time: 0.121784 Sep 08 12:45:46.671835 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 769/1596] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:46 2022] GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f => generated 1411 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:46.749882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e0b157e3-6b40-4b93-acd3-02eb2dc18a39 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:46.753375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e0b157e3-6b40-4b93-acd3-02eb2dc18a39 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:46.779342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0b157e3-6b40-4b93-acd3-02eb2dc18a39 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:46.786421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0b157e3-6b40-4b93-acd3-02eb2dc18a39 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:46.788175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0b157e3-6b40-4b93-acd3-02eb2dc18a39 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:46.803411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0b157e3-6b40-4b93-acd3-02eb2dc18a39 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:46.805998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0b157e3-6b40-4b93-acd3-02eb2dc18a39 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:46.809453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0b157e3-6b40-4b93-acd3-02eb2dc18a39 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:47.202925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ea2c9eb6-a0f9-4afe-b98b-2625ff629a01 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d18d15099442da8c0924f402b03ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793c739b689c423cb09af2ce731ac899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:47.222952 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ea2c9eb6-a0f9-4afe-b98b-2625ff629a01 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 200 len: 1371 microversion: 2.1 time: 0.729730 Sep 08 12:45:47.236199 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 828/1597] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:46 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 1371 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:47.241766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f86c3e2-e621-49eb-8151-4c8d8ae6cd72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:47.242700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f86c3e2-e621-49eb-8151-4c8d8ae6cd72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:47.253765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f86c3e2-e621-49eb-8151-4c8d8ae6cd72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:47.260303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f86c3e2-e621-49eb-8151-4c8d8ae6cd72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:47.261262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f86c3e2-e621-49eb-8151-4c8d8ae6cd72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:47.262767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f86c3e2-e621-49eb-8151-4c8d8ae6cd72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:47.263625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f86c3e2-e621-49eb-8151-4c8d8ae6cd72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:47.264381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f86c3e2-e621-49eb-8151-4c8d8ae6cd72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:47.555603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e0b157e3-6b40-4b93-acd3-02eb2dc18a39 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:47.574595 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e0b157e3-6b40-4b93-acd3-02eb2dc18a39 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1522 microversion: 2.1 time: 0.837889 Sep 08 12:45:47.577160 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 770/1598] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:46 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1522 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:47.589554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c0313e94-9d0b-45e4-89ed-70ebeb3afe8a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3ad26af0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:47.707393 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c0313e94-9d0b-45e4-89ed-70ebeb3afe8a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b" status: 200 len: 1461 microversion: 2.1 time: 0.122937 Sep 08 12:45:47.711184 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 771/1599] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:47 2022] GET /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b => generated 1461 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:47.721511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9d22043d-1319-4847-b41d-f921ab4cb015 req-7f0121e7-cf5b-4c8e-8b30-b6c3aea3c9b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64629c30-c7bd-49ef-b0dd-5e17ce9ade56", "name": "network-vif-plugged", "status": "completed", "tag": "60fbb237-266e-49a4-bd28-6c90c3640508"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:47.748310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9d22043d-1319-4847-b41d-f921ab4cb015 req-7f0121e7-cf5b-4c8e-8b30-b6c3aea3c9b2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:47.749523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9d22043d-1319-4847-b41d-f921ab4cb015 req-7f0121e7-cf5b-4c8e-8b30-b6c3aea3c9b2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:47.750546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9d22043d-1319-4847-b41d-f921ab4cb015 req-7f0121e7-cf5b-4c8e-8b30-b6c3aea3c9b2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:47.776457 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9d22043d-1319-4847-b41d-f921ab4cb015 req-7f0121e7-cf5b-4c8e-8b30-b6c3aea3c9b2 service nova] Creating event network-vif-plugged:60fbb237-266e-49a4-bd28-6c90c3640508 for instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 on n-h1-852084-10 Sep 08 12:45:47.787540 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9d22043d-1319-4847-b41d-f921ab4cb015 req-7f0121e7-cf5b-4c8e-8b30-b6c3aea3c9b2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073862 Sep 08 12:45:47.796127 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 772/1600] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:47.810426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-97c205f5-48fb-4967-9e8c-c863ed0222cc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:47.812413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-97c205f5-48fb-4967-9e8c-c863ed0222cc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:47.824277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97c205f5-48fb-4967-9e8c-c863ed0222cc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:47.826247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97c205f5-48fb-4967-9e8c-c863ed0222cc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:47.828117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97c205f5-48fb-4967-9e8c-c863ed0222cc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:47.830209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97c205f5-48fb-4967-9e8c-c863ed0222cc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:47.831436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97c205f5-48fb-4967-9e8c-c863ed0222cc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:47.832447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97c205f5-48fb-4967-9e8c-c863ed0222cc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:48.051964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f86c3e2-e621-49eb-8151-4c8d8ae6cd72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:48.061715 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f86c3e2-e621-49eb-8151-4c8d8ae6cd72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1382 microversion: 2.1 time: 0.824008 Sep 08 12:45:48.063040 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 829/1601] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:47 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1382 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:48.071549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aa3a5af5-f9b4-45a3-bb9e-5fad69d223da tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:48.072394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aa3a5af5-f9b4-45a3-bb9e-5fad69d223da tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:48.082285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa3a5af5-f9b4-45a3-bb9e-5fad69d223da tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:48.083157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa3a5af5-f9b4-45a3-bb9e-5fad69d223da tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:48.094094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa3a5af5-f9b4-45a3-bb9e-5fad69d223da tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:48.097702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-97c205f5-48fb-4967-9e8c-c863ed0222cc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:48.102027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa3a5af5-f9b4-45a3-bb9e-5fad69d223da tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:48.102953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa3a5af5-f9b4-45a3-bb9e-5fad69d223da tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:48.103447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa3a5af5-f9b4-45a3-bb9e-5fad69d223da tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:48.113435 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-97c205f5-48fb-4967-9e8c-c863ed0222cc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1271 microversion: 2.1 time: 0.315126 Sep 08 12:45:48.133224 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 773/1602] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:47 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1271 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:48.153406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d421749e-5f4b-43aa-9f74-b2403d1b9ac9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:48.155368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d421749e-5f4b-43aa-9f74-b2403d1b9ac9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:48.166650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d421749e-5f4b-43aa-9f74-b2403d1b9ac9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:48.168041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d421749e-5f4b-43aa-9f74-b2403d1b9ac9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:48.169273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d421749e-5f4b-43aa-9f74-b2403d1b9ac9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:48.170219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d421749e-5f4b-43aa-9f74-b2403d1b9ac9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:48.171066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d421749e-5f4b-43aa-9f74-b2403d1b9ac9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:48.172122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d421749e-5f4b-43aa-9f74-b2403d1b9ac9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:49.019674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aa3a5af5-f9b4-45a3-bb9e-5fad69d223da tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:49.040298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aa3a5af5-f9b4-45a3-bb9e-5fad69d223da tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:49.042762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aa3a5af5-f9b4-45a3-bb9e-5fad69d223da tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:49.045491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d421749e-5f4b-43aa-9f74-b2403d1b9ac9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:49.046358 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aa3a5af5-f9b4-45a3-bb9e-5fad69d223da tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1813 microversion: 2.25 time: 0.981577 Sep 08 12:45:49.067264 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 830/1603] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:48 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1813 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:49.077241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c5a9c3f-258e-468e-8ef0-b8c9064058ec tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb36cbec10>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:49.099184 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d421749e-5f4b-43aa-9f74-b2403d1b9ac9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1522 microversion: 2.1 time: 0.977655 Sep 08 12:45:49.118099 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 774/1604] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:48 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1522 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:49.146728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ddd59602-4e0b-4ad3-bbf8-3f6b703bdebc tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3b47cd30>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:49.287522 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c5a9c3f-258e-468e-8ef0-b8c9064058ec tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f" status: 200 len: 1411 microversion: 2.1 time: 0.237581 Sep 08 12:45:49.299679 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ddd59602-4e0b-4ad3-bbf8-3f6b703bdebc tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b" status: 200 len: 1461 microversion: 2.1 time: 0.179626 Sep 08 12:45:49.301477 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 831/1605] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:49 2022] GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f => generated 1411 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:49.333656 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 775/1606] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:49 2022] GET /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b => generated 1461 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:49.358180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-50100230-1564-4519-bcac-5efa23f9a52e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:49.358865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-50100230-1564-4519-bcac-5efa23f9a52e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:49.401446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50100230-1564-4519-bcac-5efa23f9a52e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:49.401952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50100230-1564-4519-bcac-5efa23f9a52e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:49.402401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50100230-1564-4519-bcac-5efa23f9a52e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:49.423990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50100230-1564-4519-bcac-5efa23f9a52e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:49.425120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50100230-1564-4519-bcac-5efa23f9a52e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:49.426005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50100230-1564-4519-bcac-5efa23f9a52e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:49.992935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-50100230-1564-4519-bcac-5efa23f9a52e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d18d15099442da8c0924f402b03ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793c739b689c423cb09af2ce731ac899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:50.006827 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-50100230-1564-4519-bcac-5efa23f9a52e tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 200 len: 1371 microversion: 2.1 time: 0.664434 Sep 08 12:45:50.026065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fda6ffbe-84f1-4733-a90b-5685405cae39 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:50.026811 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 776/1607] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:49 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 1371 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:50.031041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fda6ffbe-84f1-4733-a90b-5685405cae39 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:50.041072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c04d9bbe-84ca-4145-a98f-bbedb4ad31c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:50.043280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c04d9bbe-84ca-4145-a98f-bbedb4ad31c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:50.059881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c04d9bbe-84ca-4145-a98f-bbedb4ad31c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:50.065002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c04d9bbe-84ca-4145-a98f-bbedb4ad31c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:50.065966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c04d9bbe-84ca-4145-a98f-bbedb4ad31c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:50.066956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c04d9bbe-84ca-4145-a98f-bbedb4ad31c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:50.067743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c04d9bbe-84ca-4145-a98f-bbedb4ad31c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:50.068189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c04d9bbe-84ca-4145-a98f-bbedb4ad31c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:50.073477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fda6ffbe-84f1-4733-a90b-5685405cae39 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:50.074400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fda6ffbe-84f1-4733-a90b-5685405cae39 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:50.075088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fda6ffbe-84f1-4733-a90b-5685405cae39 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:50.095294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fda6ffbe-84f1-4733-a90b-5685405cae39 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:50.097169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fda6ffbe-84f1-4733-a90b-5685405cae39 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:50.105616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fda6ffbe-84f1-4733-a90b-5685405cae39 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:50.317539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c04d9bbe-84ca-4145-a98f-bbedb4ad31c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:50.332438 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c04d9bbe-84ca-4145-a98f-bbedb4ad31c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1271 microversion: 2.1 time: 0.301549 Sep 08 12:45:50.348422 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 777/1608] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:50 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1271 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:50.362081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b3b182a-cf84-45e0-9c18-e2b2e608a674 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-426234118", "metadata": {"": ""}}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b3b182a-cf84-45e0-9c18-e2b2e608a674 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action HTTP/1.1 Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 106 Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:45:50.376883 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:45:50.379056 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:45:50.379056 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:45:50.379056 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:45:50.379056 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:45:50.379056 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:45:50.379056 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:45:50.379056 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:45:50.379056 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:45:50.379056 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:45:50.379056 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:45:50.379056 n-d-852084-10 devstack@n-api.service[128971]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-426234118", "metadata": {"": ""}}} Sep 08 12:45:50.379056 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'c5776fc4-0794-44f8-b595-fc8f50fcbbe4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-426234118', 'metadata': {'': ''}}}} Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'': ''} Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:45:50.380016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:45:50.381820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:45:50.383497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:45:50.383497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:45:50.383497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:45:50.383497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:45:50.383497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:45:50.383497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:45:50.388805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b3b182a-cf84-45e0-9c18-e2b2e608a674 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:45:50.390420 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5b3b182a-cf84-45e0-9c18-e2b2e608a674 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action" status: 400 len: 170 microversion: 2.1 time: 0.040329 Sep 08 12:45:50.396640 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 778/1609] 10.222.0.78 () {60 vars in 1279 bytes} [Thu Sep 8 12:45:50 2022] POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action => generated 170 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:45:50.408892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5de6debc-3a9f-4812-83ad-51dae3e51b0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:50.412451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5de6debc-3a9f-4812-83ad-51dae3e51b0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 810cd6cb-eab9-4427-aa03-597406fd20f6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:50.441201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5de6debc-3a9f-4812-83ad-51dae3e51b0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:50.441711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5de6debc-3a9f-4812-83ad-51dae3e51b0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:50.442214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5de6debc-3a9f-4812-83ad-51dae3e51b0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:50.443008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5de6debc-3a9f-4812-83ad-51dae3e51b0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:50.443556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5de6debc-3a9f-4812-83ad-51dae3e51b0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:50.443992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5de6debc-3a9f-4812-83ad-51dae3e51b0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:50.991950 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fda6ffbe-84f1-4733-a90b-5685405cae39 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1535 microversion: 2.1 time: 1.686553 Sep 08 12:45:51.016825 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 832/1610] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:49 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1535 bytes in 1712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:51.025329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ff7539bf-cce8-4ff3-847d-848f3ea54148 req-7e66b764-2ec6-4e4c-90a6-acb73db0530e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d02535-ee1c-46e0-a965-f6a888a88504", "name": "network-vif-plugged", "status": "completed", "tag": "4d658519-2984-4e4c-98fe-154b8d56375b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:51.033373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=17,nova_api:INSERT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:51.046969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ff7539bf-cce8-4ff3-847d-848f3ea54148 req-7e66b764-2ec6-4e4c-90a6-acb73db0530e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:51.048348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ff7539bf-cce8-4ff3-847d-848f3ea54148 req-7e66b764-2ec6-4e4c-90a6-acb73db0530e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:51.049305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ff7539bf-cce8-4ff3-847d-848f3ea54148 req-7e66b764-2ec6-4e4c-90a6-acb73db0530e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:51.076450 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ff7539bf-cce8-4ff3-847d-848f3ea54148 req-7e66b764-2ec6-4e4c-90a6-acb73db0530e service nova] Creating event network-vif-plugged:4d658519-2984-4e4c-98fe-154b8d56375b for instance 18d02535-ee1c-46e0-a965-f6a888a88504 on n-h1-852084-10 Sep 08 12:45:51.093375 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ff7539bf-cce8-4ff3-847d-848f3ea54148 req-7e66b764-2ec6-4e4c-90a6-acb73db0530e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074488 Sep 08 12:45:51.097877 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 833/1611] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:51.101322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5de6debc-3a9f-4812-83ad-51dae3e51b0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:51.116428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9a234b5d-6533-4fe2-8dd6-f01cea9114c2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:51.117839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9a234b5d-6533-4fe2-8dd6-f01cea9114c2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:51.135932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a234b5d-6533-4fe2-8dd6-f01cea9114c2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:51.136971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a234b5d-6533-4fe2-8dd6-f01cea9114c2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:51.137700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a234b5d-6533-4fe2-8dd6-f01cea9114c2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:51.143770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a234b5d-6533-4fe2-8dd6-f01cea9114c2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:51.144987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a234b5d-6533-4fe2-8dd6-f01cea9114c2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:51.145713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a234b5d-6533-4fe2-8dd6-f01cea9114c2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:51.162030 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5de6debc-3a9f-4812-83ad-51dae3e51b0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6" status: 200 len: 1467 microversion: 2.1 time: 0.762920 Sep 08 12:45:51.179265 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 779/1612] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:50 2022] GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6 => generated 1467 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:51.179681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4468946d-ff14-463d-a73e-252693c9c96b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3b1ca5e0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:51.320353 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4468946d-ff14-463d-a73e-252693c9c96b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f" status: 200 len: 1411 microversion: 2.1 time: 0.152873 Sep 08 12:45:51.321799 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 780/1613] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:51 2022] GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f => generated 1411 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:51.344216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-45468e8a-4738-4095-abb5-b14c57259323 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:51.346489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-45468e8a-4738-4095-abb5-b14c57259323 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:51.363824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45468e8a-4738-4095-abb5-b14c57259323 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:51.364786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45468e8a-4738-4095-abb5-b14c57259323 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:51.365955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45468e8a-4738-4095-abb5-b14c57259323 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:51.368363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45468e8a-4738-4095-abb5-b14c57259323 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:51.369755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45468e8a-4738-4095-abb5-b14c57259323 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:51.371148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45468e8a-4738-4095-abb5-b14c57259323 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:52.060254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9a234b5d-6533-4fe2-8dd6-f01cea9114c2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:52.080594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9a234b5d-6533-4fe2-8dd6-f01cea9114c2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:52.082502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9a234b5d-6533-4fe2-8dd6-f01cea9114c2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:52.084350 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9a234b5d-6533-4fe2-8dd6-f01cea9114c2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1803 microversion: 2.25 time: 0.984526 Sep 08 12:45:52.091938 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 834/1614] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:51 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1803 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:52.097830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bb8e1186-c6d1-42e0-9b48-c2a8c8b9c2d3 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:52.098661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bb8e1186-c6d1-42e0-9b48-c2a8c8b9c2d3 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:52.118777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb8e1186-c6d1-42e0-9b48-c2a8c8b9c2d3 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:52.127458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb8e1186-c6d1-42e0-9b48-c2a8c8b9c2d3 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:52.128426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb8e1186-c6d1-42e0-9b48-c2a8c8b9c2d3 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:52.129876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb8e1186-c6d1-42e0-9b48-c2a8c8b9c2d3 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:52.130374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb8e1186-c6d1-42e0-9b48-c2a8c8b9c2d3 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:52.130876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb8e1186-c6d1-42e0-9b48-c2a8c8b9c2d3 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:52.373802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-45468e8a-4738-4095-abb5-b14c57259323 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:52.405055 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-45468e8a-4738-4095-abb5-b14c57259323 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1522 microversion: 2.1 time: 1.081261 Sep 08 12:45:52.419341 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 781/1615] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:51 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1522 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:52.431987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5db1a17e-5ed9-4389-a17b-e165bff7d2db tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:52.434253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5db1a17e-5ed9-4389-a17b-e165bff7d2db tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:52.459570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5db1a17e-5ed9-4389-a17b-e165bff7d2db tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:52.468160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5db1a17e-5ed9-4389-a17b-e165bff7d2db tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:52.468788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5db1a17e-5ed9-4389-a17b-e165bff7d2db tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:52.469647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5db1a17e-5ed9-4389-a17b-e165bff7d2db tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:52.470201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5db1a17e-5ed9-4389-a17b-e165bff7d2db tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:52.470732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5db1a17e-5ed9-4389-a17b-e165bff7d2db tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:52.755544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:52.904625 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bb8e1186-c6d1-42e0-9b48-c2a8c8b9c2d3 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1535 microversion: 2.1 time: 0.809737 Sep 08 12:45:52.906405 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 835/1616] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:52 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1535 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:52.912521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5db1a17e-5ed9-4389-a17b-e165bff7d2db tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d18d15099442da8c0924f402b03ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793c739b689c423cb09af2ce731ac899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:52.928308 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5db1a17e-5ed9-4389-a17b-e165bff7d2db tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 200 len: 1557 microversion: 2.1 time: 0.519991 Sep 08 12:45:52.928553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1195bb2e-e63f-43f6-99fd-2a027007bbe7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-2023401925"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:52.935868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1195bb2e-e63f-43f6-99fd-2a027007bbe7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:52.946740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1195bb2e-e63f-43f6-99fd-2a027007bbe7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:52.947450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1195bb2e-e63f-43f6-99fd-2a027007bbe7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:52.948330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1195bb2e-e63f-43f6-99fd-2a027007bbe7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:52.949310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1195bb2e-e63f-43f6-99fd-2a027007bbe7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:52.950065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1195bb2e-e63f-43f6-99fd-2a027007bbe7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:52.950913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1195bb2e-e63f-43f6-99fd-2a027007bbe7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:52.952724 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 782/1617] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:52 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 1557 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:52.964366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-78878262-091c-461c-a77c-5aac9dee11c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:52.965007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-78878262-091c-461c-a77c-5aac9dee11c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:52.979297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78878262-091c-461c-a77c-5aac9dee11c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:52.980135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78878262-091c-461c-a77c-5aac9dee11c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:52.980798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78878262-091c-461c-a77c-5aac9dee11c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:52.982338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78878262-091c-461c-a77c-5aac9dee11c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:52.983538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78878262-091c-461c-a77c-5aac9dee11c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:52.984144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78878262-091c-461c-a77c-5aac9dee11c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:53.356915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-78878262-091c-461c-a77c-5aac9dee11c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:53.386360 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-78878262-091c-461c-a77c-5aac9dee11c0 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1313 microversion: 2.1 time: 0.432328 Sep 08 12:45:53.387414 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 783/1618] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:52 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1313 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:53.396895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e167d0d0-3ce4-4461-93a3-314e89ee1925 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '.version_select at 0x7fdb3f2cf310>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:53.402346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e167d0d0-3ce4-4461-93a3-314e89ee1925 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:53.404006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e167d0d0-3ce4-4461-93a3-314e89ee1925 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:53.404698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e167d0d0-3ce4-4461-93a3-314e89ee1925 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:53.420270 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1195bb2e-e63f-43f6-99fd-2a027007bbe7 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "POST /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4/action" status: 202 len: 0 microversion: 2.1 time: 0.510765 Sep 08 12:45:53.424383 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 836/1619] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:45:52 2022] POST /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 12:45:53.436715 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e167d0d0-3ce4-4461-93a3-314e89ee1925 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 2561 microversion: 2.25 time: 0.047588 Sep 08 12:45:53.441416 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 784/1620] 10.222.0.78 () {60 vars in 1184 bytes} [Thu Sep 8 12:45:53 2022] GET /compute/v2.1/os-migrations => generated 2561 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:53.441900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5153bc26-42da-4dbc-bbf8-23fda033bb01 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb37451310>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:53.461746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e67e9a6a-53f2-4071-a840-afe01c6295ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:53.468201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e67e9a6a-53f2-4071-a840-afe01c6295ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:53.484730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e67e9a6a-53f2-4071-a840-afe01c6295ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:53.486162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e67e9a6a-53f2-4071-a840-afe01c6295ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:53.487705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e67e9a6a-53f2-4071-a840-afe01c6295ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:53.489087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e67e9a6a-53f2-4071-a840-afe01c6295ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:53.490273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e67e9a6a-53f2-4071-a840-afe01c6295ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:53.493435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e67e9a6a-53f2-4071-a840-afe01c6295ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:53.527445 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5153bc26-42da-4dbc-bbf8-23fda033bb01 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f" status: 200 len: 1411 microversion: 2.1 time: 0.096644 Sep 08 12:45:53.528570 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 837/1621] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:53 2022] GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f => generated 1411 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:53.540445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:53.719859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-93e9e5e3-303b-4bb9-84bf-8af5505d7cf2 tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Action: 'update', calling method: .version_select at 0x7fdb36cad160>, body: {"quota_set": {"ram": "5120"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:53.817074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93e9e5e3-303b-4bb9-84bf-8af5505d7cf2 tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:53.817587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93e9e5e3-303b-4bb9-84bf-8af5505d7cf2 tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:53.818528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93e9e5e3-303b-4bb9-84bf-8af5505d7cf2 tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:53.819662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93e9e5e3-303b-4bb9-84bf-8af5505d7cf2 tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:53.820349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93e9e5e3-303b-4bb9-84bf-8af5505d7cf2 tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:53.820915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93e9e5e3-303b-4bb9-84bf-8af5505d7cf2 tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:53.903544 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-93e9e5e3-303b-4bb9-84bf-8af5505d7cf2 tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/befbfdafa3df4e81aa5d100632fed108" status: 200 len: 148 microversion: 2.57 time: 0.368100 Sep 08 12:45:53.915012 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 838/1622] 10.222.0.78 () {62 vars in 1303 bytes} [Thu Sep 8 12:45:53 2022] PUT /compute/v2.1/os-quota-sets/befbfdafa3df4e81aa5d100632fed108 => generated 148 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:45:53.921822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5e03f8e5-ae27-4425-bce0-22952f48fbec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:53.926018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e03f8e5-ae27-4425-bce0-22952f48fbec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:53.927294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e03f8e5-ae27-4425-bce0-22952f48fbec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:53.927294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e03f8e5-ae27-4425-bce0-22952f48fbec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:53.928097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e03f8e5-ae27-4425-bce0-22952f48fbec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:53.928691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e03f8e5-ae27-4425-bce0-22952f48fbec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:53.929228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e03f8e5-ae27-4425-bce0-22952f48fbec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:53.960308 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5e03f8e5-ae27-4425-bce0-22952f48fbec tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.042937 Sep 08 12:45:53.969982 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 839/1623] 10.222.0.78 () {58 vars in 1176 bytes} [Thu Sep 8 12:45:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:53.976266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fcbfa08b-4b36-4e2d-9346-7d8fac34f2be tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:53.977274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fcbfa08b-4b36-4e2d-9346-7d8fac34f2be tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:53.986286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcbfa08b-4b36-4e2d-9346-7d8fac34f2be tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:53.986958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcbfa08b-4b36-4e2d-9346-7d8fac34f2be tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:53.987622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcbfa08b-4b36-4e2d-9346-7d8fac34f2be tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:53.988624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcbfa08b-4b36-4e2d-9346-7d8fac34f2be tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:53.989126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcbfa08b-4b36-4e2d-9346-7d8fac34f2be tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:53.989688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcbfa08b-4b36-4e2d-9346-7d8fac34f2be tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:54.017090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:54.108238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e67e9a6a-53f2-4071-a840-afe01c6295ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:54.118106 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e67e9a6a-53f2-4071-a840-afe01c6295ec tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1522 microversion: 2.1 time: 0.670850 Sep 08 12:45:54.118717 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 785/1624] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:53 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1522 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:54.124963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f0d975b1-868a-4d9f-9dda-8dbab908c77f req-441fed7b-7c4f-4427-a320-979bfac2b2e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810cd6cb-eab9-4427-aa03-597406fd20f6", "name": "network-vif-unplugged", "status": "completed", "tag": "7817753f-a720-43f2-8c41-dcb97e0c1bbd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:54.137449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f0d975b1-868a-4d9f-9dda-8dbab908c77f req-441fed7b-7c4f-4427-a320-979bfac2b2e5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:54.138144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f0d975b1-868a-4d9f-9dda-8dbab908c77f req-441fed7b-7c4f-4427-a320-979bfac2b2e5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:54.138576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f0d975b1-868a-4d9f-9dda-8dbab908c77f req-441fed7b-7c4f-4427-a320-979bfac2b2e5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:54.154169 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f0d975b1-868a-4d9f-9dda-8dbab908c77f req-441fed7b-7c4f-4427-a320-979bfac2b2e5 service nova] Creating event network-vif-unplugged:7817753f-a720-43f2-8c41-dcb97e0c1bbd for instance 810cd6cb-eab9-4427-aa03-597406fd20f6 on n-h2-852084-10 Sep 08 12:45:54.166589 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f0d975b1-868a-4d9f-9dda-8dbab908c77f req-441fed7b-7c4f-4427-a320-979bfac2b2e5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044569 Sep 08 12:45:54.167685 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 786/1625] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:54.175823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eb9a7a47-22f8-42a8-ae21-2f3af2f80d01 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f2833a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:54.243028 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fcbfa08b-4b36-4e2d-9346-7d8fac34f2be tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.270796 Sep 08 12:45:54.244159 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 840/1626] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 12:45:53 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56/os-interface => generated 285 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:54.253225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-705f87e0-c249-4a46-91db-d15ca8bf7af5 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:54.254434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-705f87e0-c249-4a46-91db-d15ca8bf7af5 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:54.272391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-705f87e0-c249-4a46-91db-d15ca8bf7af5 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:54.277081 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eb9a7a47-22f8-42a8-ae21-2f3af2f80d01 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7" status: 200 len: 1453 microversion: 2.1 time: 0.107775 Sep 08 12:45:54.277700 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 787/1627] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:54 2022] GET /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7 => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:54.288531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-705f87e0-c249-4a46-91db-d15ca8bf7af5 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:54.289738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-705f87e0-c249-4a46-91db-d15ca8bf7af5 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:54.291390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-705f87e0-c249-4a46-91db-d15ca8bf7af5 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:54.292532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-705f87e0-c249-4a46-91db-d15ca8bf7af5 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:54.304432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-705f87e0-c249-4a46-91db-d15ca8bf7af5 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:54.309975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c3143aa7-b41b-4d7e-837f-aead363400dc tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Calling method '.version_select at 0x7fdb3addeb80>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:54.528883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3143aa7-b41b-4d7e-837f-aead363400dc tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:54.529950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3143aa7-b41b-4d7e-837f-aead363400dc tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:54.530589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3143aa7-b41b-4d7e-837f-aead363400dc tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:54.548404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3143aa7-b41b-4d7e-837f-aead363400dc tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:54.549323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3143aa7-b41b-4d7e-837f-aead363400dc tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:54.550199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3143aa7-b41b-4d7e-837f-aead363400dc tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:54.660541 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c3143aa7-b41b-4d7e-837f-aead363400dc tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/befbfdafa3df4e81aa5d100632fed108/detail" status: 200 len: 463 microversion: 2.57 time: 0.380738 Sep 08 12:45:54.665775 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 788/1628] 10.222.0.78 () {60 vars in 1304 bytes} [Thu Sep 8 12:45:54 2022] GET /compute/v2.1/os-quota-sets/befbfdafa3df4e81aa5d100632fed108/detail => generated 463 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:45:54.685851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-191dca31-4388-46b1-bd39-eeb553bb738f tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852084-10", "block_migration": false, "disk_over_commit": false}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:54.701428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-191dca31-4388-46b1-bd39-eeb553bb738f tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:54.713233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-705f87e0-c249-4a46-91db-d15ca8bf7af5 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid 2ba78845-4ce9-474d-ac71-a91626b110d1 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:45:54.729854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-191dca31-4388-46b1-bd39-eeb553bb738f tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:54.735618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-191dca31-4388-46b1-bd39-eeb553bb738f tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:54.736978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-191dca31-4388-46b1-bd39-eeb553bb738f tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:54.742393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-191dca31-4388-46b1-bd39-eeb553bb738f tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:54.743847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-191dca31-4388-46b1-bd39-eeb553bb738f tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:54.745062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-191dca31-4388-46b1-bd39-eeb553bb738f tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:54.781987 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-705f87e0-c249-4a46-91db-d15ca8bf7af5 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 2423 microversion: 2.25 time: 0.535881 Sep 08 12:45:54.786644 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 841/1629] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:54 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 2423 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:54.811623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-6ce81487-7fba-42c1-bbdc-a113cb404eba req-adb601cb-31d4-4e4b-a992-4065e18e87bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aa41362-f02f-4905-8473-4c9397d260e0", "tag": "975b74c9-35fe-4989-a249-1c550697c91b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:54.856613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6ce81487-7fba-42c1-bbdc-a113cb404eba req-adb601cb-31d4-4e4b-a992-4065e18e87bb service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:54.874154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6ce81487-7fba-42c1-bbdc-a113cb404eba req-adb601cb-31d4-4e4b-a992-4065e18e87bb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:54.875160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6ce81487-7fba-42c1-bbdc-a113cb404eba req-adb601cb-31d4-4e4b-a992-4065e18e87bb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:54.893406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-191dca31-4388-46b1-bd39-eeb553bb738f tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lazy-loading 'flavor' on Instance uuid 79ca204f-7749-4f5a-b800-091b9695b80a {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:45:54.918863 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-6ce81487-7fba-42c1-bbdc-a113cb404eba req-adb601cb-31d4-4e4b-a992-4065e18e87bb service nova] Creating event network-changed:975b74c9-35fe-4989-a249-1c550697c91b for instance 0aa41362-f02f-4905-8473-4c9397d260e0 on n-h2-852084-10 Sep 08 12:45:54.942036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-191dca31-4388-46b1-bd39-eeb553bb738f tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Going to try to live migrate instance to n-h2-852084-10 {{(pid=128971) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 12:45:54.946351 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-6ce81487-7fba-42c1-bbdc-a113cb404eba req-adb601cb-31d4-4e4b-a992-4065e18e87bb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.156435 Sep 08 12:45:54.947898 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 842/1630] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:45:55.000199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-897b330c-35b0-4df6-8c89-4624ab47fcd1 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1725971733", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-897b330c-35b0-4df6-8c89-4624ab47fcd1 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action HTTP/1.1 Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 619 Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:45:55.024327 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:45:55.027116 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:45:55.027116 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:45:55.027116 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:45:55.027116 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:45:55.027116 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:45:55.027116 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:45:55.027116 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:45:55.027116 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:45:55.027116 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:45:55.027116 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:45:55.029598 n-d-852084-10 devstack@n-api.service[128970]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1725971733", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Sep 08 12:45:55.029598 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:45:55.029598 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:45:55.030310 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c5776fc4-0794-44f8-b595-fc8f50fcbbe4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1725971733', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Sep 08 12:45:55.030310 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:45:55.030310 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:45:55.030310 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:45:55.030310 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:45:55.030310 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:45:55.030310 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:45:55.030310 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:45:55.030310 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:45:55.030310 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Sep 08 12:45:55.030310 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:45:55.032163 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:45:55.046297 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:45:55.046297 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:45:55.046297 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:45:55.046297 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:45:55.046297 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:45:55.046297 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:45:55.046297 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:45:55.046297 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:45:55.046297 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:45:55.046297 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:45:55.046297 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:45:55.046297 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:45:55.049189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:45:55.049189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:45:55.049189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:45:55.049189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:45:55.049189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:45:55.049189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:45:55.050447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-897b330c-35b0-4df6-8c89-4624ab47fcd1 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:45:55.050447 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-897b330c-35b0-4df6-8c89-4624ab47fcd1 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action" status: 400 len: 938 microversion: 2.1 time: 0.082561 Sep 08 12:45:55.050447 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 843/1631] 10.222.0.78 () {60 vars in 1279 bytes} [Thu Sep 8 12:45:54 2022] POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action => generated 938 bytes in 86 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:45:55.059776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-148f9edb-8ad8-4261-bab5-64aaea1efc1c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:55.061785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-148f9edb-8ad8-4261-bab5-64aaea1efc1c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:55.077629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-148f9edb-8ad8-4261-bab5-64aaea1efc1c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:55.079384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-148f9edb-8ad8-4261-bab5-64aaea1efc1c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:55.080493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-148f9edb-8ad8-4261-bab5-64aaea1efc1c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:55.082213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-148f9edb-8ad8-4261-bab5-64aaea1efc1c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:55.084374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-148f9edb-8ad8-4261-bab5-64aaea1efc1c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:55.085606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-148f9edb-8ad8-4261-bab5-64aaea1efc1c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:55.568500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-148f9edb-8ad8-4261-bab5-64aaea1efc1c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:55.608404 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-148f9edb-8ad8-4261-bab5-64aaea1efc1c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1313 microversion: 2.1 time: 0.549317 Sep 08 12:45:55.631752 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 844/1632] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:55 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1313 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:55.651159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-85b46d67-9bcd-44ec-bf1d-23faa645a2eb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb36ebd550>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:55.756753 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-85b46d67-9bcd-44ec-bf1d-23faa645a2eb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f" status: 200 len: 1411 microversion: 2.1 time: 0.122843 Sep 08 12:45:55.770708 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 845/1633] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:55 2022] GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f => generated 1411 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:55.786568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00839bc6-c768-4031-b8f6-661451098d9b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:55.788368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00839bc6-c768-4031-b8f6-661451098d9b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:55.801528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00839bc6-c768-4031-b8f6-661451098d9b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:55.802933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00839bc6-c768-4031-b8f6-661451098d9b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:55.804135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00839bc6-c768-4031-b8f6-661451098d9b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:55.805728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00839bc6-c768-4031-b8f6-661451098d9b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:55.806875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00839bc6-c768-4031-b8f6-661451098d9b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:55.808356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00839bc6-c768-4031-b8f6-661451098d9b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:56.136034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-00839bc6-c768-4031-b8f6-661451098d9b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid 2ba78845-4ce9-474d-ac71-a91626b110d1 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:45:56.175129 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00839bc6-c768-4031-b8f6-661451098d9b tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 2423 microversion: 2.25 time: 0.395703 Sep 08 12:45:56.179667 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 846/1634] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:45:55 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 2423 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:45:56.189941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0b15a8fd-1bed-4cea-ac9c-ed2471b69841 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:56.190582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0b15a8fd-1bed-4cea-ac9c-ed2471b69841 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:56.208855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b15a8fd-1bed-4cea-ac9c-ed2471b69841 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:56.209364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b15a8fd-1bed-4cea-ac9c-ed2471b69841 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:56.209822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b15a8fd-1bed-4cea-ac9c-ed2471b69841 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:56.210679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b15a8fd-1bed-4cea-ac9c-ed2471b69841 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:56.211148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b15a8fd-1bed-4cea-ac9c-ed2471b69841 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:56.213976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b15a8fd-1bed-4cea-ac9c-ed2471b69841 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:56.475085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0b15a8fd-1bed-4cea-ac9c-ed2471b69841 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:56.499799 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0b15a8fd-1bed-4cea-ac9c-ed2471b69841 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1522 microversion: 2.1 time: 0.318482 Sep 08 12:45:56.501364 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 847/1635] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:56 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:56.512912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Action: 'update', calling method: .version_select at 0x7fdb36cbe550>, body: {"quota_set": {"ram": "2048"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:45:56.673436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=57,nova_cell0:UPDATE=12 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:45:56.685881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:56.686939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:56.687902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:56.689557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:56.690885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:56.695933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:56.774583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:56.775630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:56.776222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:56.779551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:56.779551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:56.783316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:56.914387 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f2086141-dfe1-4828-815b-96a1e29bc14a tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/befbfdafa3df4e81aa5d100632fed108?user_id=4c0aa969732049a8866e0006a98dccf9" status: 200 len: 148 microversion: 2.57 time: 0.410549 Sep 08 12:45:56.916795 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 848/1636] 10.222.0.78 () {62 vars in 1384 bytes} [Thu Sep 8 12:45:56 2022] PUT /compute/v2.1/os-quota-sets/befbfdafa3df4e81aa5d100632fed108?user_id=4c0aa969732049a8866e0006a98dccf9 => generated 148 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:45:56.927965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ac2c6a6-854c-417f-9430-6dcdf93a87ef tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36cad9d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:57.029393 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1ac2c6a6-854c-417f-9430-6dcdf93a87ef tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7" status: 200 len: 1453 microversion: 2.1 time: 0.109965 Sep 08 12:45:57.031505 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 849/1637] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:56 2022] GET /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7 => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:57.041764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-66168a32-1f5c-411e-a1ce-b13b9482024d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:57.043293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-66168a32-1f5c-411e-a1ce-b13b9482024d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:57.056851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66168a32-1f5c-411e-a1ce-b13b9482024d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:57.058024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66168a32-1f5c-411e-a1ce-b13b9482024d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:57.058927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66168a32-1f5c-411e-a1ce-b13b9482024d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:57.061177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66168a32-1f5c-411e-a1ce-b13b9482024d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:57.062166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66168a32-1f5c-411e-a1ce-b13b9482024d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:57.063166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66168a32-1f5c-411e-a1ce-b13b9482024d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:57.335896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-66168a32-1f5c-411e-a1ce-b13b9482024d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lazy-loading 'services' on Instance uuid 2ba78845-4ce9-474d-ac71-a91626b110d1 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:45:57.596221 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-66168a32-1f5c-411e-a1ce-b13b9482024d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1/os-volume_attachments/a1ec4ae3-0664-4e0b-9790-48b84e24b869" status: 202 len: 0 microversion: 2.25 time: 0.562463 Sep 08 12:45:57.597304 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 850/1638] 10.222.0.78 () {60 vars in 1457 bytes} [Thu Sep 8 12:45:57 2022] DELETE /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1/os-volume_attachments/a1ec4ae3-0664-4e0b-9790-48b84e24b869 => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:45:57.614612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-130c6b10-d588-427b-9709-739ce6363681 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:57.622880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-130c6b10-d588-427b-9709-739ce6363681 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:57.666468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-130c6b10-d588-427b-9709-739ce6363681 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:57.667747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-130c6b10-d588-427b-9709-739ce6363681 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:57.673400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-130c6b10-d588-427b-9709-739ce6363681 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:57.676044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-130c6b10-d588-427b-9709-739ce6363681 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:57.685392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-130c6b10-d588-427b-9709-739ce6363681 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:57.685392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-130c6b10-d588-427b-9709-739ce6363681 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:59.180439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-130c6b10-d588-427b-9709-739ce6363681 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:59.201647 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-130c6b10-d588-427b-9709-739ce6363681 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1522 microversion: 2.1 time: 1.602786 Sep 08 12:45:59.203214 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 851/1639] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:57 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1522 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:59.252011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be25f0ab-d6e8-49e5-9f66-682db437d95e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:59.256165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-be25f0ab-d6e8-49e5-9f66-682db437d95e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:45:59.274602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be25f0ab-d6e8-49e5-9f66-682db437d95e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:59.277297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be25f0ab-d6e8-49e5-9f66-682db437d95e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:59.286400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be25f0ab-d6e8-49e5-9f66-682db437d95e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:59.287023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be25f0ab-d6e8-49e5-9f66-682db437d95e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:45:59.288422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be25f0ab-d6e8-49e5-9f66-682db437d95e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:45:59.288422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be25f0ab-d6e8-49e5-9f66-682db437d95e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:45:59.707139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-be25f0ab-d6e8-49e5-9f66-682db437d95e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:45:59.722749 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-be25f0ab-d6e8-49e5-9f66-682db437d95e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1313 microversion: 2.1 time: 0.516535 Sep 08 12:45:59.724550 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 852/1640] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:45:59 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1313 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:45:59.741946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b9fb3f0e-df27-41eb-977c-c637c21c2a8e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb370b09d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:45:59.998572 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-191dca31-4388-46b1-bd39-eeb553bb738f tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a/action" status: 202 len: 0 microversion: 2.1 time: 5.330223 Sep 08 12:45:59.999467 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 789/1641] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:45:54 2022] POST /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a/action => generated 0 bytes in 5332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:46:00.004239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-842b504d-95a4-4e99-b003-635f80c5df3b tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] Calling method '.version_select at 0x7fdb3a7528b0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:00.359915 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-842b504d-95a4-4e99-b003-635f80c5df3b tempest-QuotasAdminTestV257-1377214326 tempest-QuotasAdminTestV257-1377214326-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/befbfdafa3df4e81aa5d100632fed108?user_id=4c0aa969732049a8866e0006a98dccf9" status: 200 len: 190 microversion: 2.57 time: 0.359127 Sep 08 12:46:00.362347 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 790/1642] 10.222.0.78 () {60 vars in 1364 bytes} [Thu Sep 8 12:45:59 2022] GET /compute/v2.1/os-quota-sets/befbfdafa3df4e81aa5d100632fed108?user_id=4c0aa969732049a8866e0006a98dccf9 => generated 190 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:46:00.368506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-70b497eb-6743-4cc5-b43d-6a30168514ee req-660de721-06b8-4535-9b07-c3ecb987a561 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64629c30-c7bd-49ef-b0dd-5e17ce9ade56", "tag": "60fbb237-266e-49a4-bd28-6c90c3640508"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:00.417499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-70b497eb-6743-4cc5-b43d-6a30168514ee req-660de721-06b8-4535-9b07-c3ecb987a561 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:00.418916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-70b497eb-6743-4cc5-b43d-6a30168514ee req-660de721-06b8-4535-9b07-c3ecb987a561 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:00.419686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-70b497eb-6743-4cc5-b43d-6a30168514ee req-660de721-06b8-4535-9b07-c3ecb987a561 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:00.446895 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-70b497eb-6743-4cc5-b43d-6a30168514ee req-660de721-06b8-4535-9b07-c3ecb987a561 service nova] Creating event network-changed:60fbb237-266e-49a4-bd28-6c90c3640508 for instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 on n-h1-852084-10 Sep 08 12:46:00.461566 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-70b497eb-6743-4cc5-b43d-6a30168514ee req-660de721-06b8-4535-9b07-c3ecb987a561 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097288 Sep 08 12:46:00.463953 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 791/1643] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:00.492997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-78fd01e6-99ef-42ad-9b34-016127eabe64 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:00.500608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-78fd01e6-99ef-42ad-9b34-016127eabe64 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:00.556355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78fd01e6-99ef-42ad-9b34-016127eabe64 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:00.560842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78fd01e6-99ef-42ad-9b34-016127eabe64 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:00.564286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78fd01e6-99ef-42ad-9b34-016127eabe64 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:00.571776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78fd01e6-99ef-42ad-9b34-016127eabe64 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:00.573527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78fd01e6-99ef-42ad-9b34-016127eabe64 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:00.581208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78fd01e6-99ef-42ad-9b34-016127eabe64 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:00.815791 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-78fd01e6-99ef-42ad-9b34-016127eabe64 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.338939 Sep 08 12:46:00.821985 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 792/1644] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 12:46:00 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1/os-volume_attachments => generated 197 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:46:00.844198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6a1e9861-be11-4aa1-90e5-31e29d40f981 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3abddf70>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:04.586607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:06.813487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=9 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:06.897503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=11 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:09.264486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:09.720080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:10.340393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=10 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:10.380202 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b9fb3f0e-df27-41eb-977c-c637c21c2a8e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f" status: 200 len: 1420 microversion: 2.1 time: 10.651811 Sep 08 12:46:10.381237 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 853/1645] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:45:59 2022] GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f => generated 1420 bytes in 10656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:10.400888 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6a1e9861-be11-4aa1-90e5-31e29d40f981 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7" status: 200 len: 1453 microversion: 2.1 time: 9.581274 Sep 08 12:46:10.401108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7fa58109-1b08-4731-b656-54601ca1d328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:10.401916 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 793/1646] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:00 2022] GET /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7 => generated 1453 bytes in 9584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7fa58109-1b08-4731-b656-54601ca1d328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action HTTP/1.1 Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 285 Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:46:10.427400 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:46:10.436701 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:46:10.436701 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:46:10.436701 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:46:10.436701 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:46:10.436701 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:46:10.436701 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:46:10.436701 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:46:10.436701 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:46:10.436701 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:46:10.436701 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:46:10.436701 n-d-852084-10 devstack@n-api.service[128970]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 08 12:46:10.438424 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:46:10.438424 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 12:46:10.438424 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c5776fc4-0794-44f8-b595-fc8f50fcbbe4', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 08 12:46:10.438424 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:46:10.438424 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:46:10.438424 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:46:10.438424 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:46:10.438424 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:46:10.438424 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:46:10.438424 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['createImage']: Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:46:10.440049 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:46:10.443060 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:46:10.445022 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 12:46:10.445022 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:46:10.445022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7fa58109-1b08-4731-b656-54601ca1d328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:46:10.445022 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7fa58109-1b08-4731-b656-54601ca1d328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action" status: 400 len: 619 microversion: 2.1 time: 0.034688 Sep 08 12:46:10.445698 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 854/1647] 10.222.0.78 () {60 vars in 1279 bytes} [Thu Sep 8 12:46:10 2022] POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action => generated 619 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:46:10.445698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1dbb7238-a3d4-4dc8-abd4-b43b0e013518 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:10.445698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1dbb7238-a3d4-4dc8-abd4-b43b0e013518 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:10.451408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-340fb948-3f7e-488f-9a8b-08cd0379d83f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:10.451408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-340fb948-3f7e-488f-9a8b-08cd0379d83f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:10.451930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1dbb7238-a3d4-4dc8-abd4-b43b0e013518 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:10.451930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1dbb7238-a3d4-4dc8-abd4-b43b0e013518 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:10.452309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1dbb7238-a3d4-4dc8-abd4-b43b0e013518 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:10.452975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1dbb7238-a3d4-4dc8-abd4-b43b0e013518 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:10.453973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1dbb7238-a3d4-4dc8-abd4-b43b0e013518 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:10.454417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1dbb7238-a3d4-4dc8-abd4-b43b0e013518 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:10.461109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=65 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:10.464599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-340fb948-3f7e-488f-9a8b-08cd0379d83f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:10.465900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-340fb948-3f7e-488f-9a8b-08cd0379d83f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:10.467546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-340fb948-3f7e-488f-9a8b-08cd0379d83f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:10.469279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-340fb948-3f7e-488f-9a8b-08cd0379d83f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:10.470462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-340fb948-3f7e-488f-9a8b-08cd0379d83f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:10.471610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-340fb948-3f7e-488f-9a8b-08cd0379d83f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:10.963666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1dbb7238-a3d4-4dc8-abd4-b43b0e013518 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:10.987049 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1dbb7238-a3d4-4dc8-abd4-b43b0e013518 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1313 microversion: 2.1 time: 0.550524 Sep 08 12:46:10.990062 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 855/1648] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:10 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1313 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:10.992742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-340fb948-3f7e-488f-9a8b-08cd0379d83f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:11.006713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bbf0bc93-2659-42fd-aafa-62d51dad80ff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:11.015358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bbf0bc93-2659-42fd-aafa-62d51dad80ff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:11.022301 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-340fb948-3f7e-488f-9a8b-08cd0379d83f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1392 microversion: 2.1 time: 0.604127 Sep 08 12:46:11.034268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbf0bc93-2659-42fd-aafa-62d51dad80ff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:11.037440 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 794/1649] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:10 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1392 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:11.038877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbf0bc93-2659-42fd-aafa-62d51dad80ff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:11.042899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbf0bc93-2659-42fd-aafa-62d51dad80ff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:11.044306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbf0bc93-2659-42fd-aafa-62d51dad80ff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:11.046971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbf0bc93-2659-42fd-aafa-62d51dad80ff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:11.048827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbf0bc93-2659-42fd-aafa-62d51dad80ff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:11.052371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a933a2a2-dd80-4e45-bccc-3a70ecca1d38 req-ab8b9cbe-4a38-4865-a5e4-66b22844d8f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3390d320-1b6f-4e3a-8f99-fff7b4e179a4", "name": "network-vif-plugged", "status": "completed", "tag": "ed71639b-831f-4e95-b890-50fca7bd47bf"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:11.073259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a933a2a2-dd80-4e45-bccc-3a70ecca1d38 req-ab8b9cbe-4a38-4865-a5e4-66b22844d8f0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:11.074658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a933a2a2-dd80-4e45-bccc-3a70ecca1d38 req-ab8b9cbe-4a38-4865-a5e4-66b22844d8f0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:11.075342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a933a2a2-dd80-4e45-bccc-3a70ecca1d38 req-ab8b9cbe-4a38-4865-a5e4-66b22844d8f0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:11.092376 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a933a2a2-dd80-4e45-bccc-3a70ecca1d38 req-ab8b9cbe-4a38-4865-a5e4-66b22844d8f0 service nova] Creating event network-vif-plugged:ed71639b-831f-4e95-b890-50fca7bd47bf for instance 3390d320-1b6f-4e3a-8f99-fff7b4e179a4 on n-h2-852084-10 Sep 08 12:46:11.100815 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a933a2a2-dd80-4e45-bccc-3a70ecca1d38 req-ab8b9cbe-4a38-4865-a5e4-66b22844d8f0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058730 Sep 08 12:46:11.102608 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 795/1650] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:11.129583 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bbf0bc93-2659-42fd-aafa-62d51dad80ff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.135710 Sep 08 12:46:11.130392 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 856/1651] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 12:46:10 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1/os-volume_attachments => generated 25 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:11.143187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-202c1819-e0a5-414c-b0e7-128e0813fa78 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb36ebd670>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:11.252896 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-202c1819-e0a5-414c-b0e7-128e0813fa78 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f" status: 200 len: 1420 microversion: 2.1 time: 0.113942 Sep 08 12:46:11.253644 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 857/1652] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:11 2022] GET /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:11.291008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-32d3dca0-dde5-48eb-a820-74bd82799cab tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:11.295297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-32d3dca0-dde5-48eb-a820-74bd82799cab tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:11.311241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32d3dca0-dde5-48eb-a820-74bd82799cab tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:11.313690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32d3dca0-dde5-48eb-a820-74bd82799cab tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:11.314101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32d3dca0-dde5-48eb-a820-74bd82799cab tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:11.316199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32d3dca0-dde5-48eb-a820-74bd82799cab tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:11.317428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32d3dca0-dde5-48eb-a820-74bd82799cab tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:11.318489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32d3dca0-dde5-48eb-a820-74bd82799cab tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:11.684068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-32d3dca0-dde5-48eb-a820-74bd82799cab tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:11.706913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3eaec7da-2f91-406b-8d52-42ade56a1332 tempest-SecurityGroupsTestAdminJSON-211840844 tempest-SecurityGroupsTestAdminJSON-211840844-project] Action: 'create', calling method: .version_select at 0x7fdb3abbab80>, body: {"security_group": {"name": "tempest-securitygroup-186197591", "description": "tempest-description-829682352"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:11.707852 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-32d3dca0-dde5-48eb-a820-74bd82799cab tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1522 microversion: 2.1 time: 0.445998 Sep 08 12:46:11.723442 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 858/1653] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:11 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1522 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:11.742653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f47a35f6-3047-47af-9f69-6aed600c084e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb377b7dc0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:12.204047 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3eaec7da-2f91-406b-8d52-42ade56a1332 tempest-SecurityGroupsTestAdminJSON-211840844 tempest-SecurityGroupsTestAdminJSON-211840844-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.099190 Sep 08 12:46:12.208134 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 796/1654] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:46:11 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:12.215454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0d0b3b52-d63a-4498-9813-7209ad0fde78 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f2da670>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:13.056658 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f47a35f6-3047-47af-9f69-6aed600c084e tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f" status: 204 len: 0 microversion: 2.1 time: 1.342750 Sep 08 12:46:13.057680 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 859/1655] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:11 2022] DELETE /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f => generated 0 bytes in 1345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:46:13.069930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e973bbbe-836b-4930-8741-64f3ffc4f96c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:13.071313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e973bbbe-836b-4930-8741-64f3ffc4f96c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:13.095146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e973bbbe-836b-4930-8741-64f3ffc4f96c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:13.097217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e973bbbe-836b-4930-8741-64f3ffc4f96c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:13.098507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e973bbbe-836b-4930-8741-64f3ffc4f96c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:13.100245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e973bbbe-836b-4930-8741-64f3ffc4f96c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:13.101334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e973bbbe-836b-4930-8741-64f3ffc4f96c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:13.102469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e973bbbe-836b-4930-8741-64f3ffc4f96c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:13.170919 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0d0b3b52-d63a-4498-9813-7209ad0fde78 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7" status: 200 len: 1453 microversion: 2.1 time: 0.961613 Sep 08 12:46:13.172207 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 797/1656] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:12 2022] GET /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7 => generated 1453 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:13.183683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-99ba7e8a-109f-4a79-bea2-ef8d78ea353a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:13.188403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-99ba7e8a-109f-4a79-bea2-ef8d78ea353a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:13.206791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99ba7e8a-109f-4a79-bea2-ef8d78ea353a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:13.207703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99ba7e8a-109f-4a79-bea2-ef8d78ea353a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:13.212056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99ba7e8a-109f-4a79-bea2-ef8d78ea353a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:13.214959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99ba7e8a-109f-4a79-bea2-ef8d78ea353a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:13.216411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99ba7e8a-109f-4a79-bea2-ef8d78ea353a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:13.217962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99ba7e8a-109f-4a79-bea2-ef8d78ea353a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:13.683972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e973bbbe-836b-4930-8741-64f3ffc4f96c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:13.734067 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e973bbbe-836b-4930-8741-64f3ffc4f96c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1522 microversion: 2.1 time: 0.674335 Sep 08 12:46:13.744047 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 860/1657] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:13 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1522 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:13.780322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0c80ba25-6827-49a4-8e9e-79132f254237 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:13.781624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0c80ba25-6827-49a4-8e9e-79132f254237 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:13.817926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c80ba25-6827-49a4-8e9e-79132f254237 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:13.819858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c80ba25-6827-49a4-8e9e-79132f254237 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:13.826765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c80ba25-6827-49a4-8e9e-79132f254237 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:13.828390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c80ba25-6827-49a4-8e9e-79132f254237 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:13.829360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c80ba25-6827-49a4-8e9e-79132f254237 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:13.830272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c80ba25-6827-49a4-8e9e-79132f254237 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:13.869629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-99ba7e8a-109f-4a79-bea2-ef8d78ea353a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:13.899165 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-99ba7e8a-109f-4a79-bea2-ef8d78ea353a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1313 microversion: 2.1 time: 0.721274 Sep 08 12:46:13.919959 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 798/1658] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:13 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1313 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:13.962970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-29c77b66-47b3-4adf-b295-09cfc73cd625 tempest-SecurityGroupsTestAdminJSON-211840844 tempest-SecurityGroupsTestAdminJSON-211840844-project] Action: 'create', calling method: .version_select at 0x7fdb3ae35af0>, body: {"security_group": {"name": "tempest-securitygroup-248692602", "description": "tempest-description-1926913444"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:14.367316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0c80ba25-6827-49a4-8e9e-79132f254237 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:14.402133 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0c80ba25-6827-49a4-8e9e-79132f254237 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1392 microversion: 2.1 time: 0.655648 Sep 08 12:46:14.414584 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 861/1659] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:13 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1392 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:14.431473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cfce7b96-1453-4a17-9d1c-93a82418833a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:14.432280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cfce7b96-1453-4a17-9d1c-93a82418833a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:14.450892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfce7b96-1453-4a17-9d1c-93a82418833a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:14.452622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfce7b96-1453-4a17-9d1c-93a82418833a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:14.453692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfce7b96-1453-4a17-9d1c-93a82418833a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:14.473529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfce7b96-1453-4a17-9d1c-93a82418833a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:14.476163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfce7b96-1453-4a17-9d1c-93a82418833a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:14.477166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfce7b96-1453-4a17-9d1c-93a82418833a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:14.583248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cfce7b96-1453-4a17-9d1c-93a82418833a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:46:14.832838 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cfce7b96-1453-4a17-9d1c-93a82418833a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 204 len: 0 microversion: 2.1 time: 0.411315 Sep 08 12:46:14.841875 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 862/1660] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:46:14 2022] DELETE /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:46:14.869906 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-29c77b66-47b3-4adf-b295-09cfc73cd625 tempest-SecurityGroupsTestAdminJSON-211840844 tempest-SecurityGroupsTestAdminJSON-211840844-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.947340 Sep 08 12:46:14.871549 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 799/1661] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:46:13 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:14.892965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44fc062c-36f1-4970-aaa2-122d62756b68 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1989931215"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:14.911208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d69f8947-e225-4c94-92c9-532c679a926a req-2d5e9cee-82ba-4869-9b0c-d16b3d83f56a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa41362-f02f-4905-8473-4c9397d260e0", "name": "network-vif-plugged", "status": "completed", "tag": "975b74c9-35fe-4989-a249-1c550697c91b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:14.916938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-44fc062c-36f1-4970-aaa2-122d62756b68 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:14.961124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44fc062c-36f1-4970-aaa2-122d62756b68 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:14.965684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44fc062c-36f1-4970-aaa2-122d62756b68 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:14.971653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44fc062c-36f1-4970-aaa2-122d62756b68 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:14.977521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44fc062c-36f1-4970-aaa2-122d62756b68 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:14.978863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44fc062c-36f1-4970-aaa2-122d62756b68 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:14.980434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44fc062c-36f1-4970-aaa2-122d62756b68 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:14.991068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d69f8947-e225-4c94-92c9-532c679a926a req-2d5e9cee-82ba-4869-9b0c-d16b3d83f56a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:14.992414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d69f8947-e225-4c94-92c9-532c679a926a req-2d5e9cee-82ba-4869-9b0c-d16b3d83f56a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:14.993018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d69f8947-e225-4c94-92c9-532c679a926a req-2d5e9cee-82ba-4869-9b0c-d16b3d83f56a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:15.084685 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d69f8947-e225-4c94-92c9-532c679a926a req-2d5e9cee-82ba-4869-9b0c-d16b3d83f56a service nova] Creating event network-vif-plugged:975b74c9-35fe-4989-a249-1c550697c91b for instance 0aa41362-f02f-4905-8473-4c9397d260e0 on n-h2-852084-10 Sep 08 12:46:15.098220 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d69f8947-e225-4c94-92c9-532c679a926a req-2d5e9cee-82ba-4869-9b0c-d16b3d83f56a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.241636 Sep 08 12:46:15.100110 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 863/1662] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:15.127497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-61d30198-4c34-4766-9a93-70f709aee5cf tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36401b80>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:21.328483 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-61d30198-4c34-4766-9a93-70f709aee5cf tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7" status: 200 len: 1462 microversion: 2.1 time: 6.225769 Sep 08 12:46:21.329304 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 864/1663] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:15 2022] GET /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7 => generated 1462 bytes in 6228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:21.387721 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-44fc062c-36f1-4970-aaa2-122d62756b68 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action" status: 202 len: 0 microversion: 2.1 time: 6.514395 Sep 08 12:46:21.389664 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 800/1664] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:46:14 2022] POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action => generated 0 bytes in 6517 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 12:46:21.395709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4ee265ad-8c94-4875-9a7d-bcf47baf2bb5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:21.397201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ee265ad-8c94-4875-9a7d-bcf47baf2bb5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:21.406298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ee265ad-8c94-4875-9a7d-bcf47baf2bb5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:21.407396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ee265ad-8c94-4875-9a7d-bcf47baf2bb5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:21.408296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ee265ad-8c94-4875-9a7d-bcf47baf2bb5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:21.409119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ee265ad-8c94-4875-9a7d-bcf47baf2bb5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:21.409592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ee265ad-8c94-4875-9a7d-bcf47baf2bb5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:21.410021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ee265ad-8c94-4875-9a7d-bcf47baf2bb5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:21.441479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e0815f2b-2574-4935-bcd7-7221cb9f6b13 tempest-SecurityGroupsTestAdminJSON-759263129 tempest-SecurityGroupsTestAdminJSON-759263129-project-admin] Action: 'create', calling method: .version_select at 0x7fdb370a7280>, body: {"security_group": {"name": "tempest-securitygroup-1844515288", "description": "tempest-description-736570362"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:21.710910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4ee265ad-8c94-4875-9a7d-bcf47baf2bb5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:21.729341 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4ee265ad-8c94-4875-9a7d-bcf47baf2bb5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1497 microversion: 2.1 time: 0.337837 Sep 08 12:46:21.731854 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 801/1665] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:21 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1497 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:21.742727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-659734338", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "58f4da24-cf42-4565-9c74-ba91eb9335e3"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:21.909182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] validate_networks() for [('58f4da24-cf42-4565-9c74-ba91eb9335e3', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:46:22.077265 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e0815f2b-2574-4935-bcd7-7221cb9f6b13 tempest-SecurityGroupsTestAdminJSON-759263129 tempest-SecurityGroupsTestAdminJSON-759263129-project-admin] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.746915 Sep 08 12:46:22.090486 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 865/1666] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:46:21 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:22.098734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-968c2938-0826-4df7-8952-4182aec8335d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:22.100122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-968c2938-0826-4df7-8952-4182aec8335d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:22.113603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-968c2938-0826-4df7-8952-4182aec8335d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:22.114732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-968c2938-0826-4df7-8952-4182aec8335d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:22.115346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-968c2938-0826-4df7-8952-4182aec8335d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:22.116602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-968c2938-0826-4df7-8952-4182aec8335d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:22.117442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-968c2938-0826-4df7-8952-4182aec8335d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:22.118066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-968c2938-0826-4df7-8952-4182aec8335d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:22.436149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-968c2938-0826-4df7-8952-4182aec8335d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:22.455071 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-968c2938-0826-4df7-8952-4182aec8335d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1392 microversion: 2.1 time: 0.373121 Sep 08 12:46:22.465119 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 866/1667] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:22 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1392 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:22.465119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ca6676be-8836-414b-8227-0597de46e477 req-11bb00c3-f6d1-4a76-a8c6-d4fcb5dc6710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d02535-ee1c-46e0-a965-f6a888a88504", "name": "network-vif-unplugged", "status": "completed", "tag": "4d658519-2984-4e4c-98fe-154b8d56375b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:22.477998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ca6676be-8836-414b-8227-0597de46e477 req-11bb00c3-f6d1-4a76-a8c6-d4fcb5dc6710 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:22.478505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ca6676be-8836-414b-8227-0597de46e477 req-11bb00c3-f6d1-4a76-a8c6-d4fcb5dc6710 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:22.478936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ca6676be-8836-414b-8227-0597de46e477 req-11bb00c3-f6d1-4a76-a8c6-d4fcb5dc6710 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:22.496446 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ca6676be-8836-414b-8227-0597de46e477 req-11bb00c3-f6d1-4a76-a8c6-d4fcb5dc6710 service nova] Creating event network-vif-unplugged:4d658519-2984-4e4c-98fe-154b8d56375b for instance 18d02535-ee1c-46e0-a965-f6a888a88504 on n-h1-852084-10 Sep 08 12:46:22.503321 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ca6676be-8836-414b-8227-0597de46e477 req-11bb00c3-f6d1-4a76-a8c6-d4fcb5dc6710 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044611 Sep 08 12:46:22.504008 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 867/1668] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:22.510256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a291cab1-bc72-4b24-bec5-e8f9a446ba0a req-d15731b7-c6b9-4de1-bc47-dc1068b5b721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18d02535-ee1c-46e0-a965-f6a888a88504", "name": "network-vif-deleted", "tag": "4d658519-2984-4e4c-98fe-154b8d56375b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:22.524724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a291cab1-bc72-4b24-bec5-e8f9a446ba0a req-d15731b7-c6b9-4de1-bc47-dc1068b5b721 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:22.525496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a291cab1-bc72-4b24-bec5-e8f9a446ba0a req-d15731b7-c6b9-4de1-bc47-dc1068b5b721 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:22.526064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a291cab1-bc72-4b24-bec5-e8f9a446ba0a req-d15731b7-c6b9-4de1-bc47-dc1068b5b721 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:22.547832 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a291cab1-bc72-4b24-bec5-e8f9a446ba0a req-d15731b7-c6b9-4de1-bc47-dc1068b5b721 service nova] Creating event network-vif-deleted:4d658519-2984-4e4c-98fe-154b8d56375b for instance 18d02535-ee1c-46e0-a965-f6a888a88504 on n-h1-852084-10 Sep 08 12:46:22.557292 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a291cab1-bc72-4b24-bec5-e8f9a446ba0a req-d15731b7-c6b9-4de1-bc47-dc1068b5b721 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051301 Sep 08 12:46:22.558864 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 868/1669] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:22.569420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a966b0e6-cd3b-410b-a2f7-43386c27cbea tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36be8ee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:22.646172 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a966b0e6-cd3b-410b-a2f7-43386c27cbea tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7" status: 200 len: 1462 microversion: 2.1 time: 0.085299 Sep 08 12:46:22.646869 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 869/1670] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:22 2022] GET /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7 => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:22.664972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:46:22.666536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:46:22.667125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:46:22.667937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:46:22.668512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:46:22.669330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bcf4e92f-ff05-4b92-996a-52d14a003d03 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1289963266"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:22.674021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bcf4e92f-ff05-4b92-996a-52d14a003d03 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:22.683434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:22.684512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:22.685209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:22.686446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:22.686654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcf4e92f-ff05-4b92-996a-52d14a003d03 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:22.687363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcf4e92f-ff05-4b92-996a-52d14a003d03 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:22.687750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:22.687923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcf4e92f-ff05-4b92-996a-52d14a003d03 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:22.688073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:22.688592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcf4e92f-ff05-4b92-996a-52d14a003d03 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:22.689050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcf4e92f-ff05-4b92-996a-52d14a003d03 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:22.689571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcf4e92f-ff05-4b92-996a-52d14a003d03 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:22.712251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Getting quotas for project c486d69d062749c7b334423a3a89cc13. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:46:22.719596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Getting quotas for user b1900295263741188d26b49e7e8b4036 and project c486d69d062749c7b334423a3a89cc13. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:46:22.737234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:46:22.740311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:46:22.765380 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-bcf4e92f-ff05-4b92-996a-52d14a003d03 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] HTTP exception thrown: Cannot 'createImage' instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 while it is in task_state image_snapshot Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bcf4e92f-ff05-4b92-996a-52d14a003d03 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action HTTP/1.1 Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 85 Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:46:22.769318 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:46:22.772277 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:46:22.772277 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:46:22.772277 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:46:22.772277 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:46:22.772277 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:46:22.772277 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:46:22.772277 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:46:22.772277 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:46:22.772277 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:46:22.772277 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:46:22.772277 n-d-852084-10 devstack@n-api.service[128970]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1289963266"}} Sep 08 12:46:22.772277 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: exception: Cannot 'createImage' instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 while it is in task_state image_snapshot Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c5776fc4-0794-44f8-b595-fc8f50fcbbe4', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1289963266'}}} Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:46:22.773711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 while it is in task_state image_snapshot Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 while it is in task_state image_snapshot Sep 08 12:46:22.776655 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:46:22.780946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bcf4e92f-ff05-4b92-996a-52d14a003d03 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 409 to user: Cannot 'createImage' instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 while it is in task_state image_snapshot {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:46:22.780946 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bcf4e92f-ff05-4b92-996a-52d14a003d03 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action" status: 409 len: 159 microversion: 2.1 time: 0.123986 Sep 08 12:46:22.780946 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 870/1671] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:46:22 2022] POST /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4/action => generated 159 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:46:22.785623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b4d50327-2697-4b31-ac08-bec422eb3847 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:22.790841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b4d50327-2697-4b31-ac08-bec422eb3847 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:22.806229 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d31493d5-a531-4559-b921-8c2bd64672b2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.071893 Sep 08 12:46:22.808188 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 802/1672] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:46:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:46:22.814732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-91077c78-3b39-4235-8c63-aa894f94e7eb tempest-SecurityGroupsTestAdminJSON-759263129 tempest-SecurityGroupsTestAdminJSON-759263129-project-admin] Action: 'create', calling method: .version_select at 0x7fdb3a7491f0>, body: {"security_group": {"name": "tempest-securitygroup-434643912", "description": "tempest-description-1478087397"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:22.816987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4d50327-2697-4b31-ac08-bec422eb3847 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:22.817997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4d50327-2697-4b31-ac08-bec422eb3847 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:22.819250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4d50327-2697-4b31-ac08-bec422eb3847 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:22.820620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4d50327-2697-4b31-ac08-bec422eb3847 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:22.821596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4d50327-2697-4b31-ac08-bec422eb3847 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:22.823000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4d50327-2697-4b31-ac08-bec422eb3847 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:22.898200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-b4d50327-2697-4b31-ac08-bec422eb3847 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lazy-loading 'flavor' on Instance uuid 0aa41362-f02f-4905-8473-4c9397d260e0 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:46:23.096554 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-91077c78-3b39-4235-8c63-aa894f94e7eb tempest-SecurityGroupsTestAdminJSON-759263129 tempest-SecurityGroupsTestAdminJSON-759263129-project-admin] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.286637 Sep 08 12:46:23.101233 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b4d50327-2697-4b31-ac08-bec422eb3847 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "POST /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0/action" status: 200 len: 32 microversion: 2.1 time: 0.324659 Sep 08 12:46:23.103465 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 871/1673] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:46:22 2022] POST /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0/action => generated 32 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:46:23.107696 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 803/1674] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:46:22 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:23.115161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6134ba36-5001-4f76-9ab7-97a40752f1f2 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:23.116519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6134ba36-5001-4f76-9ab7-97a40752f1f2 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:23.128527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-85356f04-dacd-4aee-b529-ff3b8d2a5f21 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '.version_select at 0x7fdb3ac03940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:23.134501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6134ba36-5001-4f76-9ab7-97a40752f1f2 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:23.135531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6134ba36-5001-4f76-9ab7-97a40752f1f2 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:23.136333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6134ba36-5001-4f76-9ab7-97a40752f1f2 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:23.138450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6134ba36-5001-4f76-9ab7-97a40752f1f2 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:23.139767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6134ba36-5001-4f76-9ab7-97a40752f1f2 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:23.140603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6134ba36-5001-4f76-9ab7-97a40752f1f2 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:23.376385 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-85356f04-dacd-4aee-b529-ff3b8d2a5f21 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "DELETE /compute/v2.1/images/7de77b06-ec69-4e8a-8dba-faf4ee0d494b" status: 204 len: 0 microversion: 2.1 time: 0.259801 Sep 08 12:46:23.377319 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 804/1675] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:23 2022] DELETE /compute/v2.1/images/7de77b06-ec69-4e8a-8dba-faf4ee0d494b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:46:23.388866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7ac7249b-9c44-4a21-a37d-4d2d5946ec6f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:23.389825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7ac7249b-9c44-4a21-a37d-4d2d5946ec6f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:23.544207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7ac7249b-9c44-4a21-a37d-4d2d5946ec6f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:23.558144 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7ac7249b-9c44-4a21-a37d-4d2d5946ec6f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 200 len: 1207 microversion: 2.1 time: 0.179200 Sep 08 12:46:23.576598 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 805/1676] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:23 2022] GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 1207 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:23.596314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d621f01b-d7cc-46ee-8e5c-bc9dc18406ef tempest-SecurityGroupsTestAdminJSON-759263129 tempest-SecurityGroupsTestAdminJSON-759263129-project-admin] Calling method '.version_select at 0x7fdb3abdde50>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:23.710116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6134ba36-5001-4f76-9ab7-97a40752f1f2 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:23.743017 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6134ba36-5001-4f76-9ab7-97a40752f1f2 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1467 microversion: 2.1 time: 0.636623 Sep 08 12:46:23.744261 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 872/1677] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:23 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1467 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:23.764324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f26d1767-898d-43d9-8d75-9d997ba956e3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:23.768482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f26d1767-898d-43d9-8d75-9d997ba956e3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:23.797983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f26d1767-898d-43d9-8d75-9d997ba956e3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:23.800716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f26d1767-898d-43d9-8d75-9d997ba956e3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:23.801586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f26d1767-898d-43d9-8d75-9d997ba956e3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:23.807283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f26d1767-898d-43d9-8d75-9d997ba956e3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:23.812137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f26d1767-898d-43d9-8d75-9d997ba956e3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:23.813300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f26d1767-898d-43d9-8d75-9d997ba956e3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:24.900636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f26d1767-898d-43d9-8d75-9d997ba956e3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:24.914953 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f26d1767-898d-43d9-8d75-9d997ba956e3 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1503 microversion: 2.1 time: 1.168444 Sep 08 12:46:24.923504 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 873/1678] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:23 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1503 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:24.927701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9652846c-6689-4cbd-b918-320a64724de9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:24.929007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9652846c-6689-4cbd-b918-320a64724de9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:24.939304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9652846c-6689-4cbd-b918-320a64724de9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:24.940284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9652846c-6689-4cbd-b918-320a64724de9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:24.941040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9652846c-6689-4cbd-b918-320a64724de9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:24.942255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9652846c-6689-4cbd-b918-320a64724de9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:24.942985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9652846c-6689-4cbd-b918-320a64724de9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:24.943496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9652846c-6689-4cbd-b918-320a64724de9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:25.466770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9652846c-6689-4cbd-b918-320a64724de9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:25.488552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:25.512837 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9652846c-6689-4cbd-b918-320a64724de9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1540 microversion: 2.1 time: 0.594336 Sep 08 12:46:25.517907 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 874/1679] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:24 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1540 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:25.554301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4933eb8a-5dbc-4d32-ba79-2e58e6097bcf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:25.555463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4933eb8a-5dbc-4d32-ba79-2e58e6097bcf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:25.579737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4933eb8a-5dbc-4d32-ba79-2e58e6097bcf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:25.592526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4933eb8a-5dbc-4d32-ba79-2e58e6097bcf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:25.593867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4933eb8a-5dbc-4d32-ba79-2e58e6097bcf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:25.595103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4933eb8a-5dbc-4d32-ba79-2e58e6097bcf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:25.595998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4933eb8a-5dbc-4d32-ba79-2e58e6097bcf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:25.596771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4933eb8a-5dbc-4d32-ba79-2e58e6097bcf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:26.194613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4933eb8a-5dbc-4d32-ba79-2e58e6097bcf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:26.227367 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4933eb8a-5dbc-4d32-ba79-2e58e6097bcf tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1392 microversion: 2.1 time: 0.703639 Sep 08 12:46:26.228812 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 875/1680] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:25 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1392 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:26.252851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3751a631-b230-44a7-96a5-fe50b74a75cc tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-243511808"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:26.267304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3751a631-b230-44a7-96a5-fe50b74a75cc tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 810cd6cb-eab9-4427-aa03-597406fd20f6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:26.314887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3751a631-b230-44a7-96a5-fe50b74a75cc tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:26.321601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3751a631-b230-44a7-96a5-fe50b74a75cc tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:26.330672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3751a631-b230-44a7-96a5-fe50b74a75cc tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:26.335069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3751a631-b230-44a7-96a5-fe50b74a75cc tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:26.338451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3751a631-b230-44a7-96a5-fe50b74a75cc tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:26.342590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3751a631-b230-44a7-96a5-fe50b74a75cc tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:27.038566 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3751a631-b230-44a7-96a5-fe50b74a75cc tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "POST /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6/action" status: 202 len: 0 microversion: 2.1 time: 0.807139 Sep 08 12:46:27.039847 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 876/1681] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:46:26 2022] POST /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6/action => generated 0 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 12:46:27.076085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5e9cb707-b8e4-4847-8083-72adf0f1b7d4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:27.080658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5e9cb707-b8e4-4847-8083-72adf0f1b7d4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:27.096736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e9cb707-b8e4-4847-8083-72adf0f1b7d4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:27.099038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e9cb707-b8e4-4847-8083-72adf0f1b7d4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:27.101200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e9cb707-b8e4-4847-8083-72adf0f1b7d4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:27.104682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e9cb707-b8e4-4847-8083-72adf0f1b7d4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:27.108610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e9cb707-b8e4-4847-8083-72adf0f1b7d4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:27.113416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e9cb707-b8e4-4847-8083-72adf0f1b7d4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:27.596729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5e9cb707-b8e4-4847-8083-72adf0f1b7d4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:27.618719 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5e9cb707-b8e4-4847-8083-72adf0f1b7d4 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 200 len: 1307 microversion: 2.1 time: 0.575790 Sep 08 12:46:27.634793 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 877/1682] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:27 2022] GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 1307 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:27.650566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-10dbf35e-e8ce-4b33-a3bd-50b796b00454 req-d690d4ea-989b-4189-b486-7095f9a8db86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5776fc4-0794-44f8-b595-fc8f50fcbbe4", "name": "network-vif-plugged", "status": "completed", "tag": "1bc8eeea-c3ad-4bbb-af0a-cd58872c9650"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:27.691035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-10dbf35e-e8ce-4b33-a3bd-50b796b00454 req-d690d4ea-989b-4189-b486-7095f9a8db86 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:27.691957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-10dbf35e-e8ce-4b33-a3bd-50b796b00454 req-d690d4ea-989b-4189-b486-7095f9a8db86 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:27.692818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-10dbf35e-e8ce-4b33-a3bd-50b796b00454 req-d690d4ea-989b-4189-b486-7095f9a8db86 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:27.723570 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-10dbf35e-e8ce-4b33-a3bd-50b796b00454 req-d690d4ea-989b-4189-b486-7095f9a8db86 service nova] Creating event network-vif-plugged:1bc8eeea-c3ad-4bbb-af0a-cd58872c9650 for instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 on n-h2-852084-10 Sep 08 12:46:27.733695 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-10dbf35e-e8ce-4b33-a3bd-50b796b00454 req-d690d4ea-989b-4189-b486-7095f9a8db86 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096381 Sep 08 12:46:27.734986 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 878/1683] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:27.753137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-97bc5d3a-8bfe-4270-9470-1e71a69252a1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:27.762252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-97bc5d3a-8bfe-4270-9470-1e71a69252a1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:27.794560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97bc5d3a-8bfe-4270-9470-1e71a69252a1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:27.797576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97bc5d3a-8bfe-4270-9470-1e71a69252a1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:27.798755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97bc5d3a-8bfe-4270-9470-1e71a69252a1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:27.804633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97bc5d3a-8bfe-4270-9470-1e71a69252a1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:27.806110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97bc5d3a-8bfe-4270-9470-1e71a69252a1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:27.807207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97bc5d3a-8bfe-4270-9470-1e71a69252a1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:28.471772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-97bc5d3a-8bfe-4270-9470-1e71a69252a1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:28.506247 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-97bc5d3a-8bfe-4270-9470-1e71a69252a1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1503 microversion: 2.1 time: 0.769468 Sep 08 12:46:28.511927 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 879/1684] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:27 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1503 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:28.550564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc7e4367-f561-4385-a6bd-36b2540cc101 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:28.556849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc7e4367-f561-4385-a6bd-36b2540cc101 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:28.603751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc7e4367-f561-4385-a6bd-36b2540cc101 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:28.604742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc7e4367-f561-4385-a6bd-36b2540cc101 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:28.609844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc7e4367-f561-4385-a6bd-36b2540cc101 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:28.611439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc7e4367-f561-4385-a6bd-36b2540cc101 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:28.612269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc7e4367-f561-4385-a6bd-36b2540cc101 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:28.630618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc7e4367-f561-4385-a6bd-36b2540cc101 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:29.090402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc7e4367-f561-4385-a6bd-36b2540cc101 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:29.103291 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc7e4367-f561-4385-a6bd-36b2540cc101 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1522 microversion: 2.1 time: 0.585418 Sep 08 12:46:29.105490 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 880/1685] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:28 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1522 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:29.111781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-55e2e20b-e344-4742-8d08-a8b753cecdfc req-cdf9091f-2de4-4bc6-8a4f-05231137fc88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ca204f-7749-4f5a-b800-091b9695b80a", "name": "network-vif-unplugged", "status": "completed", "tag": "25c32986-35c2-405b-a739-03cfb2c72c38"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:29.124826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-55e2e20b-e344-4742-8d08-a8b753cecdfc req-cdf9091f-2de4-4bc6-8a4f-05231137fc88 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:29.125531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-55e2e20b-e344-4742-8d08-a8b753cecdfc req-cdf9091f-2de4-4bc6-8a4f-05231137fc88 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:29.126151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-55e2e20b-e344-4742-8d08-a8b753cecdfc req-cdf9091f-2de4-4bc6-8a4f-05231137fc88 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:29.143894 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-55e2e20b-e344-4742-8d08-a8b753cecdfc req-cdf9091f-2de4-4bc6-8a4f-05231137fc88 service nova] Creating event network-vif-unplugged:25c32986-35c2-405b-a739-03cfb2c72c38 for instance 79ca204f-7749-4f5a-b800-091b9695b80a on n-h1-852084-10 Sep 08 12:46:29.151921 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-55e2e20b-e344-4742-8d08-a8b753cecdfc req-cdf9091f-2de4-4bc6-8a4f-05231137fc88 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044388 Sep 08 12:46:29.152919 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 881/1686] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:29.161365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4698635-c903-4040-8249-4d06b8100c65 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36ec2af0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:29.251295 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a4698635-c903-4040-8249-4d06b8100c65 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1452 microversion: 2.1 time: 0.096373 Sep 08 12:46:29.265098 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 882/1687] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:29 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:29.274996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d84d5fdc-79a1-4e77-b593-192b43277eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:29.276433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d84d5fdc-79a1-4e77-b593-192b43277eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:29.297664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d84d5fdc-79a1-4e77-b593-192b43277eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:29.298893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d84d5fdc-79a1-4e77-b593-192b43277eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:29.299753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d84d5fdc-79a1-4e77-b593-192b43277eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:29.302153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d84d5fdc-79a1-4e77-b593-192b43277eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:29.303005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d84d5fdc-79a1-4e77-b593-192b43277eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:29.303820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d84d5fdc-79a1-4e77-b593-192b43277eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:29.550574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d84d5fdc-79a1-4e77-b593-192b43277eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:29.565281 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d84d5fdc-79a1-4e77-b593-192b43277eb7 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1392 microversion: 2.1 time: 0.298193 Sep 08 12:46:29.566758 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 883/1688] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:29 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1392 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:29.573638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-70a388cb-17e8-483e-bea1-c39e3d73e6b9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:29.574972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-70a388cb-17e8-483e-bea1-c39e3d73e6b9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:29.587750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70a388cb-17e8-483e-bea1-c39e3d73e6b9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:29.592004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70a388cb-17e8-483e-bea1-c39e3d73e6b9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:29.594249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70a388cb-17e8-483e-bea1-c39e3d73e6b9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:29.595931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70a388cb-17e8-483e-bea1-c39e3d73e6b9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:29.595931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70a388cb-17e8-483e-bea1-c39e3d73e6b9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:29.596578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70a388cb-17e8-483e-bea1-c39e3d73e6b9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:29.971976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-70a388cb-17e8-483e-bea1-c39e3d73e6b9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:29.992580 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-70a388cb-17e8-483e-bea1-c39e3d73e6b9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 200 len: 1307 microversion: 2.1 time: 0.423673 Sep 08 12:46:30.009841 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 884/1689] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:29 2022] GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 1307 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:30.032946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a4f2e944-dc27-4fe9-9054-3332a711b7aa req-a307dfa9-d53f-42df-8847-2326e257ac7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f0e4984-ae73-4066-af92-a105ea8c3f79", "tag": "a5086897-e4a8-49d0-8a48-44dd1f183cd3"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:30.054327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a4f2e944-dc27-4fe9-9054-3332a711b7aa req-a307dfa9-d53f-42df-8847-2326e257ac7a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:30.055789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a4f2e944-dc27-4fe9-9054-3332a711b7aa req-a307dfa9-d53f-42df-8847-2326e257ac7a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:30.056831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a4f2e944-dc27-4fe9-9054-3332a711b7aa req-a307dfa9-d53f-42df-8847-2326e257ac7a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:30.085158 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a4f2e944-dc27-4fe9-9054-3332a711b7aa req-a307dfa9-d53f-42df-8847-2326e257ac7a service nova] Creating event network-changed:a5086897-e4a8-49d0-8a48-44dd1f183cd3 for instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 on n-h1-852084-10 Sep 08 12:46:30.097654 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a4f2e944-dc27-4fe9-9054-3332a711b7aa req-a307dfa9-d53f-42df-8847-2326e257ac7a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083819 Sep 08 12:46:30.099783 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 885/1690] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:30.111908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-45b75044-6bcf-4b99-a147-899eb2418ca5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:30.113267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-45b75044-6bcf-4b99-a147-899eb2418ca5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:30.128295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45b75044-6bcf-4b99-a147-899eb2418ca5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:30.129456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45b75044-6bcf-4b99-a147-899eb2418ca5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:30.130408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45b75044-6bcf-4b99-a147-899eb2418ca5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:30.131890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45b75044-6bcf-4b99-a147-899eb2418ca5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:30.132929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45b75044-6bcf-4b99-a147-899eb2418ca5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:30.133621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45b75044-6bcf-4b99-a147-899eb2418ca5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:30.210704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-45b75044-6bcf-4b99-a147-899eb2418ca5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:46:30.443636 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-45b75044-6bcf-4b99-a147-899eb2418ca5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 204 len: 0 microversion: 2.1 time: 0.337238 Sep 08 12:46:30.445586 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 886/1691] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:46:30 2022] DELETE /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:46:30.461242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-46c9a155-8eee-4d32-8682-27e7a8044eb7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:30.462407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-46c9a155-8eee-4d32-8682-27e7a8044eb7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:30.474544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46c9a155-8eee-4d32-8682-27e7a8044eb7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:30.475434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46c9a155-8eee-4d32-8682-27e7a8044eb7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:30.476609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46c9a155-8eee-4d32-8682-27e7a8044eb7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:30.478340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46c9a155-8eee-4d32-8682-27e7a8044eb7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:30.479779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46c9a155-8eee-4d32-8682-27e7a8044eb7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:30.480768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46c9a155-8eee-4d32-8682-27e7a8044eb7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:30.595659 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d621f01b-d7cc-46ee-8e5c-bc9dc18406ef tempest-SecurityGroupsTestAdminJSON-759263129 tempest-SecurityGroupsTestAdminJSON-759263129-project-admin] 10.222.0.78 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 12984 microversion: 2.1 time: 7.015559 Sep 08 12:46:30.614124 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 806/1692] 10.222.0.78 () {58 vars in 1191 bytes} [Thu Sep 8 12:46:23 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 12984 bytes in 7035 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:46:30.656456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-4a37f73f-7018-4282-91c0-12a67f601115 req-b67879e0-c826-4396-acf7-099187d0cf5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3390d320-1b6f-4e3a-8f99-fff7b4e179a4", "name": "network-vif-unplugged", "status": "completed", "tag": "ed71639b-831f-4e95-b890-50fca7bd47bf"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:30.677905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4a37f73f-7018-4282-91c0-12a67f601115 req-b67879e0-c826-4396-acf7-099187d0cf5f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:30.679538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4a37f73f-7018-4282-91c0-12a67f601115 req-b67879e0-c826-4396-acf7-099187d0cf5f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:30.680916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4a37f73f-7018-4282-91c0-12a67f601115 req-b67879e0-c826-4396-acf7-099187d0cf5f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:30.705500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:30.714385 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-4a37f73f-7018-4282-91c0-12a67f601115 req-b67879e0-c826-4396-acf7-099187d0cf5f service nova] Creating event network-vif-unplugged:ed71639b-831f-4e95-b890-50fca7bd47bf for instance 3390d320-1b6f-4e3a-8f99-fff7b4e179a4 on n-h2-852084-10 Sep 08 12:46:30.728271 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-4a37f73f-7018-4282-91c0-12a67f601115 req-b67879e0-c826-4396-acf7-099187d0cf5f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110497 Sep 08 12:46:30.730335 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 807/1693] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:30.749538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ef11b627-6a3a-4a20-a4fe-e25ac4e47a9e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3a752dc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:30.855074 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ef11b627-6a3a-4a20-a4fe-e25ac4e47a9e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1452 microversion: 2.1 time: 0.117399 Sep 08 12:46:30.860397 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 808/1694] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:30 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1452 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:30.884652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e73bebf0-ef64-47a5-bcb8-f87c38d47585 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:30.886996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e73bebf0-ef64-47a5-bcb8-f87c38d47585 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:30.917422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-46c9a155-8eee-4d32-8682-27e7a8044eb7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:30.919327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e73bebf0-ef64-47a5-bcb8-f87c38d47585 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:30.920419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e73bebf0-ef64-47a5-bcb8-f87c38d47585 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:30.921360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e73bebf0-ef64-47a5-bcb8-f87c38d47585 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:30.923274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e73bebf0-ef64-47a5-bcb8-f87c38d47585 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:30.926019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e73bebf0-ef64-47a5-bcb8-f87c38d47585 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:30.927132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e73bebf0-ef64-47a5-bcb8-f87c38d47585 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:30.934519 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-46c9a155-8eee-4d32-8682-27e7a8044eb7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1503 microversion: 2.1 time: 0.481495 Sep 08 12:46:30.959637 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 887/1695] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:30 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1503 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:30.997907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-48720fce-bbf9-49f7-aba2-d88ec0f6b960 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:31.002568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-48720fce-bbf9-49f7-aba2-d88ec0f6b960 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:31.035394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48720fce-bbf9-49f7-aba2-d88ec0f6b960 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:31.036289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48720fce-bbf9-49f7-aba2-d88ec0f6b960 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:31.037092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48720fce-bbf9-49f7-aba2-d88ec0f6b960 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:31.038293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48720fce-bbf9-49f7-aba2-d88ec0f6b960 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:31.038896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48720fce-bbf9-49f7-aba2-d88ec0f6b960 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:31.039653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48720fce-bbf9-49f7-aba2-d88ec0f6b960 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:31.386077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e73bebf0-ef64-47a5-bcb8-f87c38d47585 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:31.415179 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e73bebf0-ef64-47a5-bcb8-f87c38d47585 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1528 microversion: 2.1 time: 0.552673 Sep 08 12:46:31.427261 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 809/1696] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:30 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1528 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:31.433125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5f7a538b-670c-43e5-8d6e-2c06bb31ef16 tempest-SecurityGroupsTestAdminJSON-211840844 tempest-SecurityGroupsTestAdminJSON-211840844-project] Calling method '.version_select at 0x7fdb3aebbdc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:31.514064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-48720fce-bbf9-49f7-aba2-d88ec0f6b960 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:31.533622 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-48720fce-bbf9-49f7-aba2-d88ec0f6b960 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1392 microversion: 2.1 time: 0.572289 Sep 08 12:46:31.548100 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 888/1697] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:30 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1392 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:31.577582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b0c4f70f-ae20-4e66-98e1-daa1ff9e4d66 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:31.578581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b0c4f70f-ae20-4e66-98e1-daa1ff9e4d66 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:31.590767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0c4f70f-ae20-4e66-98e1-daa1ff9e4d66 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:31.591806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0c4f70f-ae20-4e66-98e1-daa1ff9e4d66 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:31.592616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0c4f70f-ae20-4e66-98e1-daa1ff9e4d66 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:31.594235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0c4f70f-ae20-4e66-98e1-daa1ff9e4d66 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:31.595385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0c4f70f-ae20-4e66-98e1-daa1ff9e4d66 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:31.596502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0c4f70f-ae20-4e66-98e1-daa1ff9e4d66 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:32.133569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0c4f70f-ae20-4e66-98e1-daa1ff9e4d66 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:32.150765 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b0c4f70f-ae20-4e66-98e1-daa1ff9e4d66 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 200 len: 1307 microversion: 2.1 time: 0.600811 Sep 08 12:46:32.152568 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 889/1698] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:31 2022] GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 1307 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:32.169270 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5f7a538b-670c-43e5-8d6e-2c06bb31ef16 tempest-SecurityGroupsTestAdminJSON-211840844 tempest-SecurityGroupsTestAdminJSON-211840844-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.750960 Sep 08 12:46:32.169874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-3b9aed93-bb06-49d4-b2a5-bd0c101027ba req-f1b7827d-5b36-4c9b-9214-ea525087e7ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79ca204f-7749-4f5a-b800-091b9695b80a", "tag": "25c32986-35c2-405b-a739-03cfb2c72c38"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:32.175264 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 810/1699] 10.222.0.78 () {58 vars in 1191 bytes} [Thu Sep 8 12:46:31 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:32.187292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f5588d0a-d36e-4a13-be2c-a2d26750ed02 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f2a7dc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:32.237209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3b9aed93-bb06-49d4-b2a5-bd0c101027ba req-f1b7827d-5b36-4c9b-9214-ea525087e7ee service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:32.243598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3b9aed93-bb06-49d4-b2a5-bd0c101027ba req-f1b7827d-5b36-4c9b-9214-ea525087e7ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:32.245611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3b9aed93-bb06-49d4-b2a5-bd0c101027ba req-f1b7827d-5b36-4c9b-9214-ea525087e7ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:32.279725 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-3b9aed93-bb06-49d4-b2a5-bd0c101027ba req-f1b7827d-5b36-4c9b-9214-ea525087e7ee service nova] Creating event network-changed:25c32986-35c2-405b-a739-03cfb2c72c38 for instance 79ca204f-7749-4f5a-b800-091b9695b80a on n-h1-852084-10 Sep 08 12:46:32.280761 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f5588d0a-d36e-4a13-be2c-a2d26750ed02 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1452 microversion: 2.1 time: 0.104105 Sep 08 12:46:32.281417 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 811/1700] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:32 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1452 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:32.288893 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-3b9aed93-bb06-49d4-b2a5-bd0c101027ba req-f1b7827d-5b36-4c9b-9214-ea525087e7ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127879 Sep 08 12:46:32.290074 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 890/1701] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:32.298779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-783c0767-25a3-4afa-9a8a-d30caf1481cf tempest-SecurityGroupsTestAdminJSON-759263129 tempest-SecurityGroupsTestAdminJSON-759263129-project-admin] Calling method '.version_select at 0x7fdb36d98790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:32.302216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1ead5f15-ed30-4ad4-b058-6808be6f65f8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:32.302866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1ead5f15-ed30-4ad4-b058-6808be6f65f8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:32.326288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ead5f15-ed30-4ad4-b058-6808be6f65f8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:32.332754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ead5f15-ed30-4ad4-b058-6808be6f65f8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:32.333644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ead5f15-ed30-4ad4-b058-6808be6f65f8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:32.334644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ead5f15-ed30-4ad4-b058-6808be6f65f8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:32.335400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ead5f15-ed30-4ad4-b058-6808be6f65f8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:32.335834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ead5f15-ed30-4ad4-b058-6808be6f65f8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:32.699707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:33.216443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1ead5f15-ed30-4ad4-b058-6808be6f65f8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:33.263244 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1ead5f15-ed30-4ad4-b058-6808be6f65f8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1503 microversion: 2.1 time: 0.970747 Sep 08 12:46:33.264653 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 812/1702] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:32 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1503 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:33.275137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6ce8b6f9-23a9-4038-862a-ad551d3492d4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:33.279294 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-783c0767-25a3-4afa-9a8a-d30caf1481cf tempest-SecurityGroupsTestAdminJSON-759263129 tempest-SecurityGroupsTestAdminJSON-759263129-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/47f6b27a-b745-4ac1-b65e-467abdeab5a4" status: 202 len: 0 microversion: 2.1 time: 0.987668 Sep 08 12:46:33.284513 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 891/1703] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:46:32 2022] DELETE /compute/v2.1/os-security-groups/47f6b27a-b745-4ac1-b65e-467abdeab5a4 => generated 0 bytes in 994 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:46:33.290272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-35f2ef48-b74e-4572-857e-5bb10d4328bb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:33.292077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-35f2ef48-b74e-4572-857e-5bb10d4328bb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:33.295997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6ce8b6f9-23a9-4038-862a-ad551d3492d4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:33.323587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ce8b6f9-23a9-4038-862a-ad551d3492d4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:33.333314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35f2ef48-b74e-4572-857e-5bb10d4328bb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:33.334360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ce8b6f9-23a9-4038-862a-ad551d3492d4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:33.335311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35f2ef48-b74e-4572-857e-5bb10d4328bb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:33.336487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ce8b6f9-23a9-4038-862a-ad551d3492d4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:33.339074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35f2ef48-b74e-4572-857e-5bb10d4328bb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:33.340171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35f2ef48-b74e-4572-857e-5bb10d4328bb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:33.340369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35f2ef48-b74e-4572-857e-5bb10d4328bb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:33.340953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35f2ef48-b74e-4572-857e-5bb10d4328bb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:33.344306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ce8b6f9-23a9-4038-862a-ad551d3492d4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:33.344791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ce8b6f9-23a9-4038-862a-ad551d3492d4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:33.345250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ce8b6f9-23a9-4038-862a-ad551d3492d4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:33.550258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:34.124110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6ce8b6f9-23a9-4038-862a-ad551d3492d4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:34.146733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-35f2ef48-b74e-4572-857e-5bb10d4328bb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:34.159418 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6ce8b6f9-23a9-4038-862a-ad551d3492d4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 200 len: 1528 microversion: 2.1 time: 0.893197 Sep 08 12:46:34.160599 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 813/1704] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:33 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 1528 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:34.164298 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-35f2ef48-b74e-4572-857e-5bb10d4328bb tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1392 microversion: 2.1 time: 0.878175 Sep 08 12:46:34.165066 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 892/1705] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:33 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1392 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:34.178513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c423d64c-9c8a-47b2-a527-3b3bc6ccc57c req-bd75913a-7e14-4690-9d73-311e72d87427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5776fc4-0794-44f8-b595-fc8f50fcbbe4", "name": "network-vif-unplugged", "status": "completed", "tag": "1bc8eeea-c3ad-4bbb-af0a-cd58872c9650"}, {"server_uuid": "810cd6cb-eab9-4427-aa03-597406fd20f6", "name": "network-vif-plugged", "status": "completed", "tag": "7817753f-a720-43f2-8c41-dcb97e0c1bbd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:34.185514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f25e3b28-25a1-4221-ba69-71e581d2010f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:34.186233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f25e3b28-25a1-4221-ba69-71e581d2010f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:34.211595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c423d64c-9c8a-47b2-a527-3b3bc6ccc57c req-bd75913a-7e14-4690-9d73-311e72d87427 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:34.212202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c423d64c-9c8a-47b2-a527-3b3bc6ccc57c req-bd75913a-7e14-4690-9d73-311e72d87427 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:34.212451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c423d64c-9c8a-47b2-a527-3b3bc6ccc57c req-bd75913a-7e14-4690-9d73-311e72d87427 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:34.228556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f25e3b28-25a1-4221-ba69-71e581d2010f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:34.242856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f25e3b28-25a1-4221-ba69-71e581d2010f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:34.243658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f25e3b28-25a1-4221-ba69-71e581d2010f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:34.245324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f25e3b28-25a1-4221-ba69-71e581d2010f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:34.246060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f25e3b28-25a1-4221-ba69-71e581d2010f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:34.246754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f25e3b28-25a1-4221-ba69-71e581d2010f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:34.281953 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c423d64c-9c8a-47b2-a527-3b3bc6ccc57c req-bd75913a-7e14-4690-9d73-311e72d87427 service nova] Creating event network-vif-unplugged:1bc8eeea-c3ad-4bbb-af0a-cd58872c9650 for instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 on n-h2-852084-10 Sep 08 12:46:34.287062 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c423d64c-9c8a-47b2-a527-3b3bc6ccc57c req-bd75913a-7e14-4690-9d73-311e72d87427 service nova] Creating event network-vif-plugged:7817753f-a720-43f2-8c41-dcb97e0c1bbd for instance 810cd6cb-eab9-4427-aa03-597406fd20f6 on n-h2-852084-10 Sep 08 12:46:34.313504 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c423d64c-9c8a-47b2-a527-3b3bc6ccc57c req-bd75913a-7e14-4690-9d73-311e72d87427 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.152173 Sep 08 12:46:34.319079 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 814/1706] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:34 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:34.332452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:34.335321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0679dae3-a941-432c-886e-7cf7061d033e tempest-SecurityGroupsTestAdminJSON-759263129 tempest-SecurityGroupsTestAdminJSON-759263129-project-admin] Calling method '.version_select at 0x7fdb3f2cf280>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:34.693018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f25e3b28-25a1-4221-ba69-71e581d2010f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:34.727026 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f25e3b28-25a1-4221-ba69-71e581d2010f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 200 len: 1307 microversion: 2.1 time: 0.542328 Sep 08 12:46:34.730851 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 893/1707] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:34 2022] GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 1307 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:34.767514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6823422b-7fb7-42a8-b6b1-1f7fea2d386c tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36ec25e0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:34.982663 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0679dae3-a941-432c-886e-7cf7061d033e tempest-SecurityGroupsTestAdminJSON-759263129 tempest-SecurityGroupsTestAdminJSON-759263129-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/173b0579-0e55-4fb1-bc08-321a68a47d4d" status: 202 len: 0 microversion: 2.1 time: 0.661682 Sep 08 12:46:34.987271 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 815/1708] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:46:34 2022] DELETE /compute/v2.1/os-security-groups/173b0579-0e55-4fb1-bc08-321a68a47d4d => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:46:34.993031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b349b504-7137-456a-bb68-613914e2cf0a tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3e20f40-4c18-4cd2-aaea-7892022c3750"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:34.999439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b349b504-7137-456a-bb68-613914e2cf0a tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:35.017521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b349b504-7137-456a-bb68-613914e2cf0a tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:35.019085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b349b504-7137-456a-bb68-613914e2cf0a tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:35.023076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b349b504-7137-456a-bb68-613914e2cf0a tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:35.024207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b349b504-7137-456a-bb68-613914e2cf0a tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:35.024680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b349b504-7137-456a-bb68-613914e2cf0a tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:35.025317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b349b504-7137-456a-bb68-613914e2cf0a tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:35.921476 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b349b504-7137-456a-bb68-613914e2cf0a tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "POST /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.932399 Sep 08 12:46:35.933382 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 816/1709] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 12:46:34 2022] POST /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56/os-volume_attachments => generated 194 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:35.946856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0e3acf2a-c2e1-46cc-8fa8-2bf8ad26f040 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:35.949312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0e3acf2a-c2e1-46cc-8fa8-2bf8ad26f040 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:35.968778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e3acf2a-c2e1-46cc-8fa8-2bf8ad26f040 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:35.969834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e3acf2a-c2e1-46cc-8fa8-2bf8ad26f040 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:35.971322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e3acf2a-c2e1-46cc-8fa8-2bf8ad26f040 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:35.972508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e3acf2a-c2e1-46cc-8fa8-2bf8ad26f040 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:35.975900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e3acf2a-c2e1-46cc-8fa8-2bf8ad26f040 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:35.977182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e3acf2a-c2e1-46cc-8fa8-2bf8ad26f040 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:36.339572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0e3acf2a-c2e1-46cc-8fa8-2bf8ad26f040 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:36.367529 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0e3acf2a-c2e1-46cc-8fa8-2bf8ad26f040 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1503 microversion: 2.1 time: 0.432047 Sep 08 12:46:36.373338 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 817/1710] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:35 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1503 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:36.386302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c647a4e9-ee47-4888-9f2e-08897b19c552 tempest-SecurityGroupsTestAdminJSON-211840844 tempest-SecurityGroupsTestAdminJSON-211840844-project] Calling method '.version_select at 0x7fdb3f283700>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:36.887013 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c647a4e9-ee47-4888-9f2e-08897b19c552 tempest-SecurityGroupsTestAdminJSON-211840844 tempest-SecurityGroupsTestAdminJSON-211840844-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/3239a727-3c56-4787-89c2-f68161f2ee93" status: 202 len: 0 microversion: 2.1 time: 0.510497 Sep 08 12:46:36.888016 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 818/1711] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:46:36 2022] DELETE /compute/v2.1/os-security-groups/3239a727-3c56-4787-89c2-f68161f2ee93 => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:46:36.896324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-d7470231-edb9-4691-b44c-6201845ce07c req-4e6f28b7-d69f-4b49-a0c3-aca593ed43ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5776fc4-0794-44f8-b595-fc8f50fcbbe4", "name": "network-vif-deleted", "tag": "1bc8eeea-c3ad-4bbb-af0a-cd58872c9650"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:36.975247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d7470231-edb9-4691-b44c-6201845ce07c req-4e6f28b7-d69f-4b49-a0c3-aca593ed43ab service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:36.976135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d7470231-edb9-4691-b44c-6201845ce07c req-4e6f28b7-d69f-4b49-a0c3-aca593ed43ab service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:36.987041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d7470231-edb9-4691-b44c-6201845ce07c req-4e6f28b7-d69f-4b49-a0c3-aca593ed43ab service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:37.075541 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d7470231-edb9-4691-b44c-6201845ce07c req-4e6f28b7-d69f-4b49-a0c3-aca593ed43ab service nova] Creating event network-vif-deleted:1bc8eeea-c3ad-4bbb-af0a-cd58872c9650 for instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 on n-h2-852084-10 Sep 08 12:46:37.096348 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-d7470231-edb9-4691-b44c-6201845ce07c req-4e6f28b7-d69f-4b49-a0c3-aca593ed43ab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206270 Sep 08 12:46:37.113877 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 819/1712] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:37.128452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-463ee053-2323-4a80-b048-cb2db0d4de72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:37.133912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-463ee053-2323-4a80-b048-cb2db0d4de72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:37.161768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-463ee053-2323-4a80-b048-cb2db0d4de72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:37.164459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-463ee053-2323-4a80-b048-cb2db0d4de72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:37.165581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-463ee053-2323-4a80-b048-cb2db0d4de72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:37.166738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-463ee053-2323-4a80-b048-cb2db0d4de72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:37.168138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-463ee053-2323-4a80-b048-cb2db0d4de72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:37.175115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-463ee053-2323-4a80-b048-cb2db0d4de72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:37.634794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-463ee053-2323-4a80-b048-cb2db0d4de72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:37.652523 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-463ee053-2323-4a80-b048-cb2db0d4de72 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1392 microversion: 2.1 time: 0.534536 Sep 08 12:46:37.653976 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 820/1713] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:37 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1392 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:37.666899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cbd3b7d4-44ad-4119-a198-e1b5609df28a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:37.668788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cbd3b7d4-44ad-4119-a198-e1b5609df28a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:37.698270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbd3b7d4-44ad-4119-a198-e1b5609df28a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:37.699085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbd3b7d4-44ad-4119-a198-e1b5609df28a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:37.699930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbd3b7d4-44ad-4119-a198-e1b5609df28a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:37.701027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbd3b7d4-44ad-4119-a198-e1b5609df28a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:37.701745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbd3b7d4-44ad-4119-a198-e1b5609df28a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:37.740983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbd3b7d4-44ad-4119-a198-e1b5609df28a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:37.848676 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-cbd3b7d4-44ad-4119-a198-e1b5609df28a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] HTTP exception thrown: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cbd3b7d4-44ad-4119-a198-e1b5609df28a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 HTTP/1.1 Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:46:37.853501 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:46:37.856377 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:46:37.856377 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:46:37.856377 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:46:37.856377 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:46:37.856377 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:46:37.856377 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:46:37.856377 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:46:37.856377 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:46:37.856377 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:46:37.856377 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:46:37.856377 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:46:37.856377 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'c5776fc4-0794-44f8-b595-fc8f50fcbbe4'} Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:46:37.857798 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:46:37.860150 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:46:37.862159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cbd3b7d4-44ad-4119-a198-e1b5609df28a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 404 to user: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:46:37.864086 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cbd3b7d4-44ad-4119-a198-e1b5609df28a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 404 len: 111 microversion: 2.1 time: 0.207339 Sep 08 12:46:37.865319 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 821/1714] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:37 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:46:37.872674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-479f6b84-0878-41fe-8df6-b58625f0e321 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:37.873852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-479f6b84-0878-41fe-8df6-b58625f0e321 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:37.881369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479f6b84-0878-41fe-8df6-b58625f0e321 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:37.882183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479f6b84-0878-41fe-8df6-b58625f0e321 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:37.883051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479f6b84-0878-41fe-8df6-b58625f0e321 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:37.884131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479f6b84-0878-41fe-8df6-b58625f0e321 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:37.884920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479f6b84-0878-41fe-8df6-b58625f0e321 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:37.885379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479f6b84-0878-41fe-8df6-b58625f0e321 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:38.219332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-479f6b84-0878-41fe-8df6-b58625f0e321 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:38.282566 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-479f6b84-0878-41fe-8df6-b58625f0e321 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 200 len: 1307 microversion: 2.1 time: 0.413764 Sep 08 12:46:38.284850 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 822/1715] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:37 2022] GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 1307 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:38.392183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-306dff30-54b7-467b-aa4b-ea78e42eb8ff req-48f6062d-ff48-41aa-b5a6-d775d84ba8ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0e4984-ae73-4066-af92-a105ea8c3f79", "name": "network-vif-plugged", "status": "completed", "tag": "a5086897-e4a8-49d0-8a48-44dd1f183cd3"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:38.475192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-306dff30-54b7-467b-aa4b-ea78e42eb8ff req-48f6062d-ff48-41aa-b5a6-d775d84ba8ee service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:38.484247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-306dff30-54b7-467b-aa4b-ea78e42eb8ff req-48f6062d-ff48-41aa-b5a6-d775d84ba8ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:38.493304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-306dff30-54b7-467b-aa4b-ea78e42eb8ff req-48f6062d-ff48-41aa-b5a6-d775d84ba8ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:38.542743 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6823422b-7fb7-42a8-b6b1-1f7fea2d386c tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1452 microversion: 2.1 time: 3.805291 Sep 08 12:46:38.546900 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 894/1716] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:34 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1452 bytes in 3815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:38.582353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8fd9d33-2cba-4c39-9435-916c45f88b4a tempest-SecurityGroupsTestAdminJSON-211840844 tempest-SecurityGroupsTestAdminJSON-211840844-project] Calling method '.version_select at 0x7fdb36cbea60>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:38.586868 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-306dff30-54b7-467b-aa4b-ea78e42eb8ff req-48f6062d-ff48-41aa-b5a6-d775d84ba8ee service nova] Creating event network-vif-plugged:a5086897-e4a8-49d0-8a48-44dd1f183cd3 for instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 on n-h1-852084-10 Sep 08 12:46:38.630591 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-306dff30-54b7-467b-aa4b-ea78e42eb8ff req-48f6062d-ff48-41aa-b5a6-d775d84ba8ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.285717 Sep 08 12:46:38.631322 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 823/1717] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:38.652911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a4577538-eb9e-427c-9d01-20a8f414ba9a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:38.653976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a4577538-eb9e-427c-9d01-20a8f414ba9a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:38.694303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4577538-eb9e-427c-9d01-20a8f414ba9a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:38.713679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4577538-eb9e-427c-9d01-20a8f414ba9a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:38.724283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4577538-eb9e-427c-9d01-20a8f414ba9a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:38.724980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4577538-eb9e-427c-9d01-20a8f414ba9a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:38.725478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4577538-eb9e-427c-9d01-20a8f414ba9a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:38.725931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4577538-eb9e-427c-9d01-20a8f414ba9a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:39.157300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a4577538-eb9e-427c-9d01-20a8f414ba9a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:39.177000 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a4577538-eb9e-427c-9d01-20a8f414ba9a tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1503 microversion: 2.1 time: 0.544273 Sep 08 12:46:39.178203 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 824/1718] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:38 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1503 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:39.184645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-34403e1d-c54d-4d0c-880e-fb9c9603a7f5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Action: 'create', calling method: .version_select at 0x7fdb3f293940>, body: {"keypair": {"name": "tempest-keypair-413112974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDeJ2g25gqRRFBidzcYo4ojkXl7WgaYJwKFI7+RUPhy0D54A1T0cvipSFJwfjut4RY5C36CdfeJeeTpic4qZrVl0DwFKkwzy3FhGA0VZQr51oShbf2fuhCpqlAvomahf2A=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:39.235501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-34403e1d-c54d-4d0c-880e-fb9c9603a7f5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Getting quotas for project 501fb79cb7544fe4995bc7122c87dbad. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:46:39.243608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-34403e1d-c54d-4d0c-880e-fb9c9603a7f5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Getting quotas for user 2b96cccdfbf149fc880cb1dfb29d416a and project 501fb79cb7544fe4995bc7122c87dbad. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:46:39.281748 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-34403e1d-c54d-4d0c-880e-fb9c9603a7f5 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102184 Sep 08 12:46:39.287735 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 825/1719] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:46:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:46:39.293148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-74aab2c1-6058-424e-8c6b-b100f2094030 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:39.301725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-74aab2c1-6058-424e-8c6b-b100f2094030 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:39.304795 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8fd9d33-2cba-4c39-9435-916c45f88b4a tempest-SecurityGroupsTestAdminJSON-211840844 tempest-SecurityGroupsTestAdminJSON-211840844-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/593f2b4b-6ffe-41d6-a11e-807289f760d9" status: 202 len: 0 microversion: 2.1 time: 0.747974 Sep 08 12:46:39.308607 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 895/1720] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:46:38 2022] DELETE /compute/v2.1/os-security-groups/593f2b4b-6ffe-41d6-a11e-807289f760d9 => generated 0 bytes in 758 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:46:39.325557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74aab2c1-6058-424e-8c6b-b100f2094030 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:39.326396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74aab2c1-6058-424e-8c6b-b100f2094030 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:39.327062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74aab2c1-6058-424e-8c6b-b100f2094030 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:39.328988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74aab2c1-6058-424e-8c6b-b100f2094030 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:39.329845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74aab2c1-6058-424e-8c6b-b100f2094030 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:39.330593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-74aab2c1-6058-424e-8c6b-b100f2094030 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:39.340192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b5a2e0fb-beef-46b4-8010-79b7ced86773 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:39.358476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b5a2e0fb-beef-46b4-8010-79b7ced86773 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:39.372245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:39.448342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5a2e0fb-beef-46b4-8010-79b7ced86773 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:39.449234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5a2e0fb-beef-46b4-8010-79b7ced86773 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:39.479666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5a2e0fb-beef-46b4-8010-79b7ced86773 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:39.495667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5a2e0fb-beef-46b4-8010-79b7ced86773 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:39.496518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5a2e0fb-beef-46b4-8010-79b7ced86773 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:39.497294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5a2e0fb-beef-46b4-8010-79b7ced86773 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:40.246547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b5a2e0fb-beef-46b4-8010-79b7ced86773 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:40.298720 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b5a2e0fb-beef-46b4-8010-79b7ced86773 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 200 len: 1307 microversion: 2.1 time: 0.967008 Sep 08 12:46:40.304669 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 896/1721] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:39 2022] GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 1307 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:40.332273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-872404b1-71d1-4dc6-a2b2-81c9622558ce tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36decd30>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:40.470469 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-872404b1-71d1-4dc6-a2b2-81c9622558ce tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1452 microversion: 2.1 time: 0.161298 Sep 08 12:46:40.471436 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 897/1722] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:40 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:40.477555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-74aab2c1-6058-424e-8c6b-b100f2094030 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:40.491206 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-74aab2c1-6058-424e-8c6b-b100f2094030 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1392 microversion: 2.1 time: 1.202121 Sep 08 12:46:40.501449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-afda78d9-02ec-4276-8196-44d94c3473c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:40.503143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-afda78d9-02ec-4276-8196-44d94c3473c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:40.524738 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 826/1723] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:39 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1392 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:40.539157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afda78d9-02ec-4276-8196-44d94c3473c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:40.547509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afda78d9-02ec-4276-8196-44d94c3473c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:40.549372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afda78d9-02ec-4276-8196-44d94c3473c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:40.553127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afda78d9-02ec-4276-8196-44d94c3473c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:40.557750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afda78d9-02ec-4276-8196-44d94c3473c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:40.562329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afda78d9-02ec-4276-8196-44d94c3473c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:41.337587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c3859c94-1d26-4c64-92b8-f4fe129dc73f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:41.343839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c3859c94-1d26-4c64-92b8-f4fe129dc73f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:41.345382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-afda78d9-02ec-4276-8196-44d94c3473c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:41.363341 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-afda78d9-02ec-4276-8196-44d94c3473c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1503 microversion: 2.1 time: 0.881255 Sep 08 12:46:41.364579 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 898/1724] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:40 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1503 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:41.394393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:41.399829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3859c94-1d26-4c64-92b8-f4fe129dc73f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:41.407019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3859c94-1d26-4c64-92b8-f4fe129dc73f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:41.408472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3859c94-1d26-4c64-92b8-f4fe129dc73f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:41.409866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3859c94-1d26-4c64-92b8-f4fe129dc73f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:41.410665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3859c94-1d26-4c64-92b8-f4fe129dc73f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:41.411423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3859c94-1d26-4c64-92b8-f4fe129dc73f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:41.491007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5a574614-05d1-4f8f-b84c-7b7041732e78 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36cffca0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:41.579486 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5a574614-05d1-4f8f-b84c-7b7041732e78 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1452 microversion: 2.1 time: 0.095234 Sep 08 12:46:41.581177 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 899/1725] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:41 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1452 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:41.588232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4dc53547-bc03-4285-86d3-501a0857e1c4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:41.589397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4dc53547-bc03-4285-86d3-501a0857e1c4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:41.598611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dc53547-bc03-4285-86d3-501a0857e1c4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:41.599463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dc53547-bc03-4285-86d3-501a0857e1c4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:41.600104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dc53547-bc03-4285-86d3-501a0857e1c4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:41.601267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dc53547-bc03-4285-86d3-501a0857e1c4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:41.602283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dc53547-bc03-4285-86d3-501a0857e1c4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:41.603135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dc53547-bc03-4285-86d3-501a0857e1c4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:42.142467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4dc53547-bc03-4285-86d3-501a0857e1c4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:42.178557 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4dc53547-bc03-4285-86d3-501a0857e1c4 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1392 microversion: 2.1 time: 0.591892 Sep 08 12:46:42.203752 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 900/1726] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:41 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1392 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:42.387513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c3859c94-1d26-4c64-92b8-f4fe129dc73f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:42.404768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7df875ed-0dc0-4955-b0f3-fdb6bed817f7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:42.405688 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c3859c94-1d26-4c64-92b8-f4fe129dc73f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 200 len: 1487 microversion: 2.1 time: 1.074866 Sep 08 12:46:42.406240 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 827/1727] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:41 2022] GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 1487 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:42.411641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7df875ed-0dc0-4955-b0f3-fdb6bed817f7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:42.452027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4b3f6062-f483-4a3c-83f7-9cb9c472a714 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:42.452671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4b3f6062-f483-4a3c-83f7-9cb9c472a714 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:42.463325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b3f6062-f483-4a3c-83f7-9cb9c472a714 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:42.466890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7df875ed-0dc0-4955-b0f3-fdb6bed817f7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:42.470389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b3f6062-f483-4a3c-83f7-9cb9c472a714 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:42.474248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7df875ed-0dc0-4955-b0f3-fdb6bed817f7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:42.477209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7df875ed-0dc0-4955-b0f3-fdb6bed817f7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:42.477817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b3f6062-f483-4a3c-83f7-9cb9c472a714 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:42.480079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7df875ed-0dc0-4955-b0f3-fdb6bed817f7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:42.484184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7df875ed-0dc0-4955-b0f3-fdb6bed817f7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:42.484454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b3f6062-f483-4a3c-83f7-9cb9c472a714 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:42.485007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b3f6062-f483-4a3c-83f7-9cb9c472a714 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:42.485460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b3f6062-f483-4a3c-83f7-9cb9c472a714 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:42.487135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7df875ed-0dc0-4955-b0f3-fdb6bed817f7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:42.614963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-4b3f6062-f483-4a3c-83f7-9cb9c472a714 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lazy-loading 'flavor' on Instance uuid 7f0e4984-ae73-4066-af92-a105ea8c3f79 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:46:42.908372 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4b3f6062-f483-4a3c-83f7-9cb9c472a714 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "POST /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79/action" status: 202 len: 0 microversion: 2.1 time: 0.461211 Sep 08 12:46:42.909643 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 828/1728] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:46:42 2022] POST /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 12:46:42.920860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c16cb852-e801-49ec-95de-45e7e9b5715e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f293dc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:43.199072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7df875ed-0dc0-4955-b0f3-fdb6bed817f7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:43.218545 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7df875ed-0dc0-4955-b0f3-fdb6bed817f7 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1503 microversion: 2.1 time: 0.822158 Sep 08 12:46:43.236521 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 901/1729] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:42 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1503 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:43.266627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-36790c90-b3df-47ac-81c6-e744a36e9c1b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:43.267165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-36790c90-b3df-47ac-81c6-e744a36e9c1b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:43.268594 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c16cb852-e801-49ec-95de-45e7e9b5715e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1452 microversion: 2.1 time: 0.356748 Sep 08 12:46:43.272450 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 829/1730] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:42 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1452 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:43.288970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a2fff4f9-c4c5-4c99-8f08-0ae78fa72ef5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:43.301156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36790c90-b3df-47ac-81c6-e744a36e9c1b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:43.302003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36790c90-b3df-47ac-81c6-e744a36e9c1b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:43.302660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36790c90-b3df-47ac-81c6-e744a36e9c1b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:43.303631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36790c90-b3df-47ac-81c6-e744a36e9c1b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:43.304952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a2fff4f9-c4c5-4c99-8f08-0ae78fa72ef5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:43.308059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36790c90-b3df-47ac-81c6-e744a36e9c1b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:43.309506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36790c90-b3df-47ac-81c6-e744a36e9c1b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:43.326068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2fff4f9-c4c5-4c99-8f08-0ae78fa72ef5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:43.326975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2fff4f9-c4c5-4c99-8f08-0ae78fa72ef5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:43.327815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2fff4f9-c4c5-4c99-8f08-0ae78fa72ef5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:43.329139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2fff4f9-c4c5-4c99-8f08-0ae78fa72ef5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:43.330021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2fff4f9-c4c5-4c99-8f08-0ae78fa72ef5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:43.330827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2fff4f9-c4c5-4c99-8f08-0ae78fa72ef5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:45.007571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a2fff4f9-c4c5-4c99-8f08-0ae78fa72ef5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:45.042565 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a2fff4f9-c4c5-4c99-8f08-0ae78fa72ef5 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1392 microversion: 2.1 time: 1.761826 Sep 08 12:46:45.044319 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 830/1731] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:43 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1392 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:45.054111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6f51f161-a8f3-44c6-a58d-abd4e310b4e8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:45.099050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6f51f161-a8f3-44c6-a58d-abd4e310b4e8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:45.116421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-36790c90-b3df-47ac-81c6-e744a36e9c1b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:45.140630 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-36790c90-b3df-47ac-81c6-e744a36e9c1b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 200 len: 1495 microversion: 2.1 time: 1.891129 Sep 08 12:46:45.141902 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 902/1732] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:43 2022] GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 1495 bytes in 1904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:45.151141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f2fefa52-990b-4acb-84bc-f21bf775cb94 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36bcd3a0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:45.195958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f51f161-a8f3-44c6-a58d-abd4e310b4e8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:45.198602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f51f161-a8f3-44c6-a58d-abd4e310b4e8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:45.204669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f51f161-a8f3-44c6-a58d-abd4e310b4e8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:45.209640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f51f161-a8f3-44c6-a58d-abd4e310b4e8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:45.212379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f51f161-a8f3-44c6-a58d-abd4e310b4e8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:45.213541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f51f161-a8f3-44c6-a58d-abd4e310b4e8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:45.347699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:45.361469 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f2fefa52-990b-4acb-84bc-f21bf775cb94 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1452 microversion: 2.1 time: 0.217033 Sep 08 12:46:45.373571 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 903/1733] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:45 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1452 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:45.434379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1768435934", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:45.744698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] validate_networks() for [('9176055f-8b84-428f-a7d5-ad0c21b3939e', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:46:45.874134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6f51f161-a8f3-44c6-a58d-abd4e310b4e8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:45.897736 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6f51f161-a8f3-44c6-a58d-abd4e310b4e8 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1503 microversion: 2.1 time: 0.849097 Sep 08 12:46:45.908304 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 831/1734] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:45 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1503 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:46.092559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7fef8b7b-c17d-43db-825d-1ed998837e3f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:46.093625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7fef8b7b-c17d-43db-825d-1ed998837e3f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:46.110685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fef8b7b-c17d-43db-825d-1ed998837e3f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:46.111292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fef8b7b-c17d-43db-825d-1ed998837e3f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:46.111746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fef8b7b-c17d-43db-825d-1ed998837e3f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:46.112826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fef8b7b-c17d-43db-825d-1ed998837e3f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:46.113435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fef8b7b-c17d-43db-825d-1ed998837e3f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:46.113867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fef8b7b-c17d-43db-825d-1ed998837e3f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:47.063276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7fef8b7b-c17d-43db-825d-1ed998837e3f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:47.083995 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7fef8b7b-c17d-43db-825d-1ed998837e3f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1382 microversion: 2.1 time: 0.996505 Sep 08 12:46:47.084999 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 832/1735] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:46 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1382 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:47.124409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2bddc484-060a-43cf-a52c-1d1a97dfc56a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:47.142282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2bddc484-060a-43cf-a52c-1d1a97dfc56a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:47.167916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bddc484-060a-43cf-a52c-1d1a97dfc56a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:47.170795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bddc484-060a-43cf-a52c-1d1a97dfc56a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:47.171512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bddc484-060a-43cf-a52c-1d1a97dfc56a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:47.174143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bddc484-060a-43cf-a52c-1d1a97dfc56a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:47.177707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bddc484-060a-43cf-a52c-1d1a97dfc56a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:47.179007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bddc484-060a-43cf-a52c-1d1a97dfc56a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:47.476232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:46:47.476998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:46:47.478454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:46:47.479517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:46:47.480551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:46:47.526478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:47.533507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:47.534375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:47.535614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:47.536442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:47.537398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:47.614855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Getting quotas for project 501fb79cb7544fe4995bc7122c87dbad. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:46:47.640831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Getting quotas for user 2b96cccdfbf149fc880cb1dfb29d416a and project 501fb79cb7544fe4995bc7122c87dbad. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:46:47.703203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2bddc484-060a-43cf-a52c-1d1a97dfc56a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:47.719992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:46:47.725669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:46:47.739108 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2bddc484-060a-43cf-a52c-1d1a97dfc56a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 200 len: 1478 microversion: 2.1 time: 0.620397 Sep 08 12:46:47.754654 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 833/1736] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:47 2022] GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 1478 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:47.787708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7a4d63a0-a83d-4f73-9785-d00ca2c9455e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3a7538b0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:47.888464 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b0235139-e75c-4910-9171-37e322b30a7a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.457335 Sep 08 12:46:47.899854 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 904/1737] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:46:45 2022] POST /compute/v2.1/servers => generated 383 bytes in 2472 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:46:47.921997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0979c93e-ed54-452a-a06f-211cbece1508 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:47.923477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0979c93e-ed54-452a-a06f-211cbece1508 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:47.942537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0979c93e-ed54-452a-a06f-211cbece1508 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:47.943046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0979c93e-ed54-452a-a06f-211cbece1508 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:47.948254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0979c93e-ed54-452a-a06f-211cbece1508 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:47.952876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0979c93e-ed54-452a-a06f-211cbece1508 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:47.953396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0979c93e-ed54-452a-a06f-211cbece1508 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:47.954133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0979c93e-ed54-452a-a06f-211cbece1508 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:47.997213 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7a4d63a0-a83d-4f73-9785-d00ca2c9455e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1452 microversion: 2.1 time: 0.239806 Sep 08 12:46:47.998798 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 834/1738] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:47 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1452 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:48.017253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-505e4bbd-b454-4fcd-b725-b4baeb95340b tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '.version_select at 0x7fdb3f254820>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:48.042708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-505e4bbd-b454-4fcd-b725-b4baeb95340b tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:48.044239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-505e4bbd-b454-4fcd-b725-b4baeb95340b tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:48.047977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-505e4bbd-b454-4fcd-b725-b4baeb95340b tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:48.113859 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-505e4bbd-b454-4fcd-b725-b4baeb95340b tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 2734 microversion: 2.1 time: 0.111593 Sep 08 12:46:48.115462 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 835/1739] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 12:46:47 2022] GET /compute/v2.1/os-migrations => generated 2734 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:48.125008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a04cdf3b-ff4b-4284-a124-16f1f9fc6c58 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1319012793"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:48.135817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a04cdf3b-ff4b-4284-a124-16f1f9fc6c58 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:48.164370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a04cdf3b-ff4b-4284-a124-16f1f9fc6c58 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:48.165237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a04cdf3b-ff4b-4284-a124-16f1f9fc6c58 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:48.166722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a04cdf3b-ff4b-4284-a124-16f1f9fc6c58 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:48.175735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a04cdf3b-ff4b-4284-a124-16f1f9fc6c58 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:48.176605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a04cdf3b-ff4b-4284-a124-16f1f9fc6c58 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:48.177402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a04cdf3b-ff4b-4284-a124-16f1f9fc6c58 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:48.338001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0979c93e-ed54-452a-a06f-211cbece1508 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:48.367458 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0979c93e-ed54-452a-a06f-211cbece1508 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1503 microversion: 2.1 time: 0.452748 Sep 08 12:46:48.368327 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 905/1740] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:47 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1503 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:48.392307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f6caa83-d297-463c-a81b-96495ba8b713 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:48.393804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f6caa83-d297-463c-a81b-96495ba8b713 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:48.640908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f6caa83-d297-463c-a81b-96495ba8b713 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:48.700264 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f6caa83-d297-463c-a81b-96495ba8b713 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1225 microversion: 2.1 time: 0.330037 Sep 08 12:46:48.718125 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 906/1741] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:48 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1225 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:48.743539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-18573b37-a9b2-4eee-a023-35b13d923e96 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:48.755255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-18573b37-a9b2-4eee-a023-35b13d923e96 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:48.814088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18573b37-a9b2-4eee-a023-35b13d923e96 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:48.815629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18573b37-a9b2-4eee-a023-35b13d923e96 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:48.833914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18573b37-a9b2-4eee-a023-35b13d923e96 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:48.835948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18573b37-a9b2-4eee-a023-35b13d923e96 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:48.837151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18573b37-a9b2-4eee-a023-35b13d923e96 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:48.838850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18573b37-a9b2-4eee-a023-35b13d923e96 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:49.028397 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a04cdf3b-ff4b-4284-a124-16f1f9fc6c58 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "POST /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79/action" status: 202 len: 0 microversion: 2.1 time: 0.910839 Sep 08 12:46:49.035876 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 836/1742] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:46:48 2022] POST /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79/action => generated 0 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 12:46:49.073745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-738b0bb0-c545-4190-b8a5-bf278e867a86 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f283940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:49.186941 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-738b0bb0-c545-4190-b8a5-bf278e867a86 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1452 microversion: 2.1 time: 0.147149 Sep 08 12:46:49.202619 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 837/1743] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:49 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:49.237364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8fa8335e-44e3-4b17-a3ab-e9b22d43f873 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3f274820>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:49.284364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:46:49.399446 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8fa8335e-44e3-4b17-a3ab-e9b22d43f873 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1438 microversion: 2.1 time: 0.192102 Sep 08 12:46:49.402365 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 838/1744] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:49 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1438 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:49.432832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3beb486d-e278-41ce-8eea-20888343d5f5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:49.436976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3beb486d-e278-41ce-8eea-20888343d5f5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:49.467432 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-18573b37-a9b2-4eee-a023-35b13d923e96 tempest-LiveMigrationTest-1305950162 tempest-LiveMigrationTest-1305950162-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1535 microversion: 2.1 time: 0.745861 Sep 08 12:46:49.481467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3beb486d-e278-41ce-8eea-20888343d5f5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:49.484837 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 907/1745] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:48 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1535 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:49.487829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3beb486d-e278-41ce-8eea-20888343d5f5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:49.490976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3beb486d-e278-41ce-8eea-20888343d5f5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:49.490976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3beb486d-e278-41ce-8eea-20888343d5f5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:49.490976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3beb486d-e278-41ce-8eea-20888343d5f5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:49.491621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3beb486d-e278-41ce-8eea-20888343d5f5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:49.523273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f8c25bdf-36af-42de-82e8-fc96e5f0d206 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:49.524168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f8c25bdf-36af-42de-82e8-fc96e5f0d206 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:49.573532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8c25bdf-36af-42de-82e8-fc96e5f0d206 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:49.578620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8c25bdf-36af-42de-82e8-fc96e5f0d206 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:49.590601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8c25bdf-36af-42de-82e8-fc96e5f0d206 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:49.600214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8c25bdf-36af-42de-82e8-fc96e5f0d206 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:49.605258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8c25bdf-36af-42de-82e8-fc96e5f0d206 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:49.612822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8c25bdf-36af-42de-82e8-fc96e5f0d206 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:49.747800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f8c25bdf-36af-42de-82e8-fc96e5f0d206 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:46:49.997343 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f8c25bdf-36af-42de-82e8-fc96e5f0d206 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "DELETE /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 204 len: 0 microversion: 2.1 time: 0.482781 Sep 08 12:46:49.999033 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 908/1746] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:46:49 2022] DELETE /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:46:50.019325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5e4eb130-1578-45bb-8b29-a9636dd22828 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:50.020660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5e4eb130-1578-45bb-8b29-a9636dd22828 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:50.046646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3beb486d-e278-41ce-8eea-20888343d5f5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:50.051528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e4eb130-1578-45bb-8b29-a9636dd22828 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:50.058345 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3beb486d-e278-41ce-8eea-20888343d5f5 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1503 microversion: 2.1 time: 0.645795 Sep 08 12:46:50.059570 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 839/1747] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:49 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1503 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:50.062670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e4eb130-1578-45bb-8b29-a9636dd22828 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:50.063664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e4eb130-1578-45bb-8b29-a9636dd22828 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:50.065847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e4eb130-1578-45bb-8b29-a9636dd22828 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:50.068897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e4eb130-1578-45bb-8b29-a9636dd22828 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:50.070683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e4eb130-1578-45bb-8b29-a9636dd22828 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:50.075039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dc2dced6-a783-4135-bf21-2acbe53a7d4d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:50.076998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dc2dced6-a783-4135-bf21-2acbe53a7d4d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:50.091792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc2dced6-a783-4135-bf21-2acbe53a7d4d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:50.094034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc2dced6-a783-4135-bf21-2acbe53a7d4d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:50.096019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc2dced6-a783-4135-bf21-2acbe53a7d4d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:50.097354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc2dced6-a783-4135-bf21-2acbe53a7d4d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:50.100510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc2dced6-a783-4135-bf21-2acbe53a7d4d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:50.101454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc2dced6-a783-4135-bf21-2acbe53a7d4d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:50.264477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5e4eb130-1578-45bb-8b29-a9636dd22828 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:50.288546 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5e4eb130-1578-45bb-8b29-a9636dd22828 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1229 microversion: 2.1 time: 0.285022 Sep 08 12:46:50.303264 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 909/1748] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:49 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1229 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:50.318255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-65d6db8b-dfeb-42fa-b742-3b0bb853ee5e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36c695e0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:50.410763 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-65d6db8b-dfeb-42fa-b742-3b0bb853ee5e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1452 microversion: 2.1 time: 0.117389 Sep 08 12:46:50.412598 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 910/1749] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:50 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1452 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:50.592651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dc2dced6-a783-4135-bf21-2acbe53a7d4d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:50.608082 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dc2dced6-a783-4135-bf21-2acbe53a7d4d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1388 microversion: 2.1 time: 0.545934 Sep 08 12:46:50.614218 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 840/1750] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:50 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1388 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:50.632161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-08e6a538-3684-4b7b-a7ad-a49cbfe9d956 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3f283940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:50.723036 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-08e6a538-3684-4b7b-a7ad-a49cbfe9d956 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1438 microversion: 2.1 time: 0.106840 Sep 08 12:46:50.730223 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 841/1751] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:50 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1438 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:50.812392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-521774968", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:46:51.022322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:46:51.111680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-58414114-f59d-4051-ad6c-f51811358f52 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:51.112663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-58414114-f59d-4051-ad6c-f51811358f52 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:51.137397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58414114-f59d-4051-ad6c-f51811358f52 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:51.138215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58414114-f59d-4051-ad6c-f51811358f52 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:51.138840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58414114-f59d-4051-ad6c-f51811358f52 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:51.139790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58414114-f59d-4051-ad6c-f51811358f52 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:51.141046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58414114-f59d-4051-ad6c-f51811358f52 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:51.141883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58414114-f59d-4051-ad6c-f51811358f52 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:52.520901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-58414114-f59d-4051-ad6c-f51811358f52 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:52.536375 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-58414114-f59d-4051-ad6c-f51811358f52 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1503 microversion: 2.1 time: 1.431707 Sep 08 12:46:52.540268 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 842/1752] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:51 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1503 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:46:52.565095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7cfd8bd2-6a8e-44a0-a083-74729d2dd751 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:52.580784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7cfd8bd2-6a8e-44a0-a083-74729d2dd751 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:52.619459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cfd8bd2-6a8e-44a0-a083-74729d2dd751 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:52.626011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cfd8bd2-6a8e-44a0-a083-74729d2dd751 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:52.627146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cfd8bd2-6a8e-44a0-a083-74729d2dd751 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:52.633017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cfd8bd2-6a8e-44a0-a083-74729d2dd751 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:52.634376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cfd8bd2-6a8e-44a0-a083-74729d2dd751 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:52.638182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cfd8bd2-6a8e-44a0-a083-74729d2dd751 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:52.980514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7cfd8bd2-6a8e-44a0-a083-74729d2dd751 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:53.014033 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7cfd8bd2-6a8e-44a0-a083-74729d2dd751 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1283 microversion: 2.1 time: 0.471832 Sep 08 12:46:53.015104 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 843/1753] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:52 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1283 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:53.092065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-55222f02-5175-4e34-a440-cc6d6311fbe8 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3a749f70>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:53.137319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:46:53.137319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:46:53.142617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:46:53.145713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:46:53.146477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:46:53.202674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:53.203577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:53.204467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:53.205986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:53.207060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:53.208188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:53.241115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Getting quotas for project 29f211f252354a48af471ba6e6b30da4. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:46:53.267431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Getting quotas for user 927fd8bab7eb46e6be632c68788bf942 and project 29f211f252354a48af471ba6e6b30da4. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:46:53.305138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:46:53.312146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:46:53.563811 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-938b70e0-4be7-46f7-bb49-a4223592f779 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.139470 Sep 08 12:46:53.565327 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 911/1754] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3151 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:46:53.602523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4f773ccd-9ccd-4d0b-9a3d-f73cd239933d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:46:53.611548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4f773ccd-9ccd-4d0b-9a3d-f73cd239933d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:46:53.636823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f773ccd-9ccd-4d0b-9a3d-f73cd239933d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:53.656399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f773ccd-9ccd-4d0b-9a3d-f73cd239933d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:53.661370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f773ccd-9ccd-4d0b-9a3d-f73cd239933d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:53.674529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f773ccd-9ccd-4d0b-9a3d-f73cd239933d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:46:53.675923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f773ccd-9ccd-4d0b-9a3d-f73cd239933d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:46:53.676927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f773ccd-9ccd-4d0b-9a3d-f73cd239933d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:46:54.095582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4f773ccd-9ccd-4d0b-9a3d-f73cd239933d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:46:54.114974 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4f773ccd-9ccd-4d0b-9a3d-f73cd239933d tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 200 len: 1184 microversion: 2.1 time: 0.544127 Sep 08 12:46:54.136069 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 912/1755] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:46:53 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 1184 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:46:54.146956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca307439-77d4-42fb-a06b-3789757a6eb5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb370a7ee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:02.596407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=21 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:02.989660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:03.226586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:03.287446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=14 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:03.624789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:04.109397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:05.192080 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-55222f02-5175-4e34-a440-cc6d6311fbe8 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1461 microversion: 2.1 time: 12.128270 Sep 08 12:47:05.200532 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 844/1756] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:53 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1461 bytes in 12185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:05.216760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-fc5a4679-df03-4245-801b-aadf91ce9069 req-ab3a174f-5b70-46da-84cc-a3a249be4604 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79ca204f-7749-4f5a-b800-091b9695b80a", "name": "network-vif-deleted", "tag": "25c32986-35c2-405b-a739-03cfb2c72c38"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:05.238334 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca307439-77d4-42fb-a06b-3789757a6eb5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1438 microversion: 2.1 time: 11.100323 Sep 08 12:47:05.239285 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 913/1757] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:46:54 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1438 bytes in 11102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:05.252378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fc5a4679-df03-4245-801b-aadf91ce9069 req-ab3a174f-5b70-46da-84cc-a3a249be4604 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:05.253790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fc5a4679-df03-4245-801b-aadf91ce9069 req-ab3a174f-5b70-46da-84cc-a3a249be4604 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:05.254869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fc5a4679-df03-4245-801b-aadf91ce9069 req-ab3a174f-5b70-46da-84cc-a3a249be4604 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:05.271580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-31835f0d-81cf-4b40-ae4f-24f95ad91fea tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:05.273637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-31835f0d-81cf-4b40-ae4f-24f95ad91fea tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:05.280265 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-fc5a4679-df03-4245-801b-aadf91ce9069 req-ab3a174f-5b70-46da-84cc-a3a249be4604 service nova] Creating event network-vif-deleted:25c32986-35c2-405b-a739-03cfb2c72c38 for instance 79ca204f-7749-4f5a-b800-091b9695b80a on n-h2-852084-10 Sep 08 12:47:05.290434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31835f0d-81cf-4b40-ae4f-24f95ad91fea tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:05.292171 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-fc5a4679-df03-4245-801b-aadf91ce9069 req-ab3a174f-5b70-46da-84cc-a3a249be4604 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088583 Sep 08 12:47:05.292407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31835f0d-81cf-4b40-ae4f-24f95ad91fea tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:05.293057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31835f0d-81cf-4b40-ae4f-24f95ad91fea tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:05.294259 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 845/1758] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:05.294783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31835f0d-81cf-4b40-ae4f-24f95ad91fea tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:05.297317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31835f0d-81cf-4b40-ae4f-24f95ad91fea tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:05.299728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31835f0d-81cf-4b40-ae4f-24f95ad91fea tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:05.312458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1c6aa769-ff71-434c-8f03-9ba6593f20cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:05.314015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1c6aa769-ff71-434c-8f03-9ba6593f20cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:05.326795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c6aa769-ff71-434c-8f03-9ba6593f20cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:05.328468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c6aa769-ff71-434c-8f03-9ba6593f20cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:05.329597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c6aa769-ff71-434c-8f03-9ba6593f20cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:05.331563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c6aa769-ff71-434c-8f03-9ba6593f20cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:05.332778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c6aa769-ff71-434c-8f03-9ba6593f20cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:05.333815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c6aa769-ff71-434c-8f03-9ba6593f20cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:05.829686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1c6aa769-ff71-434c-8f03-9ba6593f20cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:05.847016 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1c6aa769-ff71-434c-8f03-9ba6593f20cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1483 microversion: 2.1 time: 0.544148 Sep 08 12:47:05.847690 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 846/1759] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:05 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1483 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:05.854574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d934e0ed-ebba-4397-8ef7-56ced28f1132 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:05.860441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d934e0ed-ebba-4397-8ef7-56ced28f1132 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:05.877428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d934e0ed-ebba-4397-8ef7-56ced28f1132 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:05.878956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d934e0ed-ebba-4397-8ef7-56ced28f1132 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:05.879793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-31835f0d-81cf-4b40-ae4f-24f95ad91fea tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927fd8bab7eb46e6be632c68788bf942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f211f252354a48af471ba6e6b30da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:05.879992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d934e0ed-ebba-4397-8ef7-56ced28f1132 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:05.880569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d934e0ed-ebba-4397-8ef7-56ced28f1132 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:05.881032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d934e0ed-ebba-4397-8ef7-56ced28f1132 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:05.881455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d934e0ed-ebba-4397-8ef7-56ced28f1132 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:05.900386 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-31835f0d-81cf-4b40-ae4f-24f95ad91fea tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] 10.222.0.78 "GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6" status: 200 len: 1322 microversion: 2.1 time: 0.655844 Sep 08 12:47:05.901536 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 914/1760] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:05 2022] GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6 => generated 1322 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:05.917325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9395f4b9-afcb-4ba6-9dec-69f870ad4695 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:05.920132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9395f4b9-afcb-4ba6-9dec-69f870ad4695 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 79ca204f-7749-4f5a-b800-091b9695b80a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:05.937499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9395f4b9-afcb-4ba6-9dec-69f870ad4695 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:05.938343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9395f4b9-afcb-4ba6-9dec-69f870ad4695 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:05.938803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9395f4b9-afcb-4ba6-9dec-69f870ad4695 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:05.939823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9395f4b9-afcb-4ba6-9dec-69f870ad4695 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:05.942199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9395f4b9-afcb-4ba6-9dec-69f870ad4695 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:05.942960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9395f4b9-afcb-4ba6-9dec-69f870ad4695 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:05.976549 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-9395f4b9-afcb-4ba6-9dec-69f870ad4695 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] HTTP exception thrown: Instance 79ca204f-7749-4f5a-b800-091b9695b80a could not be found. Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9395f4b9-afcb-4ba6-9dec-69f870ad4695 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Request method failure captured: Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a HTTP/1.1 Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJTMqPa7Ox420kmLjhrbQ0GKrdd3PpmBcQEwzR2mf0k9d5_yUK865nxvW5TZ2E2qxSCm44uLNvniKzHl8CNvjYUFj-lOpWJAo9d2s7mUa6RFf4kWAgJVjRciMtpxzCJtCNmAYP8Xv0uw0-8w8iT894sF3AaSeFK9vg_Hov39YlQFGc Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 5619e927afd449c4897bd41f96390988 Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-LiveMigrationTest-297167026 Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:47:05.981331 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:47:05.983325 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5619e927afd449c4897bd41f96390988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5619e927afd449c4897bd41f96390988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5619e927afd449c4897bd41f96390988"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5619e927afd449c4897bd41f96390988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:05.983325 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-LiveMigrationTest-297167026 Sep 08 12:47:05.983325 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 5619e927afd449c4897bd41f96390988 Sep 08 12:47:05.983325 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-LiveMigrationTest-297167026 Sep 08 12:47:05.983325 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-LiveMigrationTest-297167026-project Sep 08 12:47:05.983325 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:47:05.983325 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:47:05.983325 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: c7375a1da7fb43d8a6725f61fa2c7ec9 Sep 08 12:47:05.983325 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-LiveMigrationTest-297167026-project Sep 08 12:47:05.983325 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:47:05.983325 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 79ca204f-7749-4f5a-b800-091b9695b80a could not be found. Sep 08 12:47:05.983325 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '79ca204f-7749-4f5a-b800-091b9695b80a'} Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79ca204f-7749-4f5a-b800-091b9695b80a could not be found. Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:05.984581 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79ca204f-7749-4f5a-b800-091b9695b80a could not be found. Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79ca204f-7749-4f5a-b800-091b9695b80a could not be found. Sep 08 12:47:05.989225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:05.992627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9395f4b9-afcb-4ba6-9dec-69f870ad4695 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Returning 404 to user: Instance 79ca204f-7749-4f5a-b800-091b9695b80a could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:05.995072 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9395f4b9-afcb-4ba6-9dec-69f870ad4695 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a" status: 404 len: 111 microversion: 2.1 time: 0.090347 Sep 08 12:47:05.996222 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 915/1761] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:05 2022] GET /compute/v2.1/servers/79ca204f-7749-4f5a-b800-091b9695b80a => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:47:06.005306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-5ca7ddc9-7d6c-4791-8665-5c503a50b1a9 req-731b214f-4279-421a-a3aa-c3222c1b3f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0e4984-ae73-4066-af92-a105ea8c3f79", "name": "network-vif-plugged", "status": "completed", "tag": "a5086897-e4a8-49d0-8a48-44dd1f183cd3"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:06.054034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5ca7ddc9-7d6c-4791-8665-5c503a50b1a9 req-731b214f-4279-421a-a3aa-c3222c1b3f23 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:06.054911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5ca7ddc9-7d6c-4791-8665-5c503a50b1a9 req-731b214f-4279-421a-a3aa-c3222c1b3f23 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:06.054911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5ca7ddc9-7d6c-4791-8665-5c503a50b1a9 req-731b214f-4279-421a-a3aa-c3222c1b3f23 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:06.100433 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-5ca7ddc9-7d6c-4791-8665-5c503a50b1a9 req-731b214f-4279-421a-a3aa-c3222c1b3f23 service nova] Creating event network-vif-plugged:a5086897-e4a8-49d0-8a48-44dd1f183cd3 for instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 on n-h1-852084-10 Sep 08 12:47:06.128795 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-5ca7ddc9-7d6c-4791-8665-5c503a50b1a9 req-731b214f-4279-421a-a3aa-c3222c1b3f23 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130332 Sep 08 12:47:06.129941 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 916/1762] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:06.159014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ecf0b723-bd2b-4482-bccc-efa53f155d6c req-159f4349-b99c-4bd0-998d-498eeb099cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8df21d92-5b95-485a-9eb0-9896f885a1d2", "tag": "2c1e646d-cb61-4f74-a2eb-ccc0c5f974a8"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:06.194256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ecf0b723-bd2b-4482-bccc-efa53f155d6c req-159f4349-b99c-4bd0-998d-498eeb099cc2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:06.194766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ecf0b723-bd2b-4482-bccc-efa53f155d6c req-159f4349-b99c-4bd0-998d-498eeb099cc2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:06.195348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ecf0b723-bd2b-4482-bccc-efa53f155d6c req-159f4349-b99c-4bd0-998d-498eeb099cc2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:06.234999 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ecf0b723-bd2b-4482-bccc-efa53f155d6c req-159f4349-b99c-4bd0-998d-498eeb099cc2 service nova] Creating event network-changed:2c1e646d-cb61-4f74-a2eb-ccc0c5f974a8 for instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 on n-h1-852084-10 Sep 08 12:47:06.251202 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ecf0b723-bd2b-4482-bccc-efa53f155d6c req-159f4349-b99c-4bd0-998d-498eeb099cc2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118713 Sep 08 12:47:06.256497 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 917/1763] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:06.266616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e6225d91-6203-4bb0-b3aa-31f4b72af68f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:06.277848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e6225d91-6203-4bb0-b3aa-31f4b72af68f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:06.281402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d934e0ed-ebba-4397-8ef7-56ced28f1132 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:06.298309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6225d91-6203-4bb0-b3aa-31f4b72af68f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:06.299216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6225d91-6203-4bb0-b3aa-31f4b72af68f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:06.299903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6225d91-6203-4bb0-b3aa-31f4b72af68f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:06.300957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6225d91-6203-4bb0-b3aa-31f4b72af68f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:06.305179 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d934e0ed-ebba-4397-8ef7-56ced28f1132 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1325 microversion: 2.1 time: 0.450863 Sep 08 12:47:06.307618 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 847/1764] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:05 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1325 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:06.310214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6225d91-6203-4bb0-b3aa-31f4b72af68f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:06.310697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6225d91-6203-4bb0-b3aa-31f4b72af68f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:06.326196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1058877857", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "d9960f69-c05a-419f-a17a-eee5648ebea7"}], "block_device_mapping_v2": [{"uuid": "140b8a5c-ddbc-441d-bec5-45a3211437a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:06.385194 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e6225d91-6203-4bb0-b3aa-31f4b72af68f tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126829 Sep 08 12:47:06.386789 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 918/1765] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:47:06 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:06.397026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ec2cfa6-7fa0-44cf-a5b5-c00fd0a69f7f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36ec21f0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:06.466965 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8ec2cfa6-7fa0-44cf-a5b5-c00fd0a69f7f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 200 len: 1461 microversion: 2.1 time: 0.078135 Sep 08 12:47:06.467637 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 919/1766] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:06 2022] GET /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 1461 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:06.493955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5acfbcf9-2650-48ae-afc0-ba325b3032df tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb36cffd30>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:06.583934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] validate_networks() for [('d9960f69-c05a-419f-a17a-eee5648ebea7', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:47:06.634160 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5acfbcf9-2650-48ae-afc0-ba325b3032df tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1438 microversion: 2.1 time: 0.157200 Sep 08 12:47:06.637306 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 920/1767] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:06 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1438 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:06.657399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-707505934", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:06.785479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] validate_networks() for [('dbbef684-d919-4b69-9ace-2501fd7b2925', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:47:08.047019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:47:08.050363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:47:08.068615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:47:08.072823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:47:08.075445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:47:08.113365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:47:08.115529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:47:08.118195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:47:08.119494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:47:08.122456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:08.124022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:47:08.127746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:08.128735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:08.132963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:08.136284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:08.138310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:08.169028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:08.169028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:08.169028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:08.175216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:08.176744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:08.177947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:08.200469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Getting quotas for project df5a27766c1942a8be6a78466f7e7192. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:47:08.212614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Getting quotas for user 8af088dfb51e4f729cc97fc91699a55f and project df5a27766c1942a8be6a78466f7e7192. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:47:08.223008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Getting quotas for project 140b9d3cf7484c5784af2808e1ba0954. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:47:08.244367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Getting quotas for user 15d486316fc448eaa9f35bbf895ac50a and project 140b9d3cf7484c5784af2808e1ba0954. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:47:08.306261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:47:08.325716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:47:08.469742 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-77da0a92-31bf-4117-9f92-45b7519f8797 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.828869 Sep 08 12:47:08.473209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:47:08.474538 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 921/1768] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:47:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 1835 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:47:08.486493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='140b8a5c-ddbc-441d-bec5-45a3211437a5',volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:47:08.490374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca47e7e5-3962-4c5d-9090-0704a7124ef8 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:08.493643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ca47e7e5-3962-4c5d-9090-0704a7124ef8 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:08.512647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca47e7e5-3962-4c5d-9090-0704a7124ef8 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:08.514036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca47e7e5-3962-4c5d-9090-0704a7124ef8 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:08.515801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca47e7e5-3962-4c5d-9090-0704a7124ef8 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:08.517166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca47e7e5-3962-4c5d-9090-0704a7124ef8 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:08.518263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca47e7e5-3962-4c5d-9090-0704a7124ef8 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:08.519528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca47e7e5-3962-4c5d-9090-0704a7124ef8 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:08.837169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-ca47e7e5-3962-4c5d-9090-0704a7124ef8 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lazy-loading 'services' on Instance uuid 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:47:09.030775 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-711ed3b3-d67f-42ae-b76d-4ced780ce5d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.721185 Sep 08 12:47:09.032295 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 848/1769] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 12:47:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2724 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 12:47:09.048357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ae71d083-38bb-49cb-a9a6-4a0178268a53 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:09.054200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ae71d083-38bb-49cb-a9a6-4a0178268a53 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 810cd6cb-eab9-4427-aa03-597406fd20f6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:09.067766 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca47e7e5-3962-4c5d-9090-0704a7124ef8 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "DELETE /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56/os-volume_attachments/f3e20f40-4c18-4cd2-aaea-7892022c3750" status: 202 len: 0 microversion: 2.1 time: 0.590679 Sep 08 12:47:09.068822 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 922/1770] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 12:47:08 2022] DELETE /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56/os-volume_attachments/f3e20f40-4c18-4cd2-aaea-7892022c3750 => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:47:09.070212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae71d083-38bb-49cb-a9a6-4a0178268a53 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:09.071943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae71d083-38bb-49cb-a9a6-4a0178268a53 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:09.075552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae71d083-38bb-49cb-a9a6-4a0178268a53 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:09.076798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae71d083-38bb-49cb-a9a6-4a0178268a53 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:09.079971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae71d083-38bb-49cb-a9a6-4a0178268a53 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:09.080736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae71d083-38bb-49cb-a9a6-4a0178268a53 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:09.141346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3b54da7d-8e4f-42cb-85ae-259c92ba260a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:09.142305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3b54da7d-8e4f-42cb-85ae-259c92ba260a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:09.161369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b54da7d-8e4f-42cb-85ae-259c92ba260a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:09.162297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b54da7d-8e4f-42cb-85ae-259c92ba260a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:09.162796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b54da7d-8e4f-42cb-85ae-259c92ba260a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:09.163630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b54da7d-8e4f-42cb-85ae-259c92ba260a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:09.164109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b54da7d-8e4f-42cb-85ae-259c92ba260a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:09.164590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b54da7d-8e4f-42cb-85ae-259c92ba260a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:10.030327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3b54da7d-8e4f-42cb-85ae-259c92ba260a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927fd8bab7eb46e6be632c68788bf942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f211f252354a48af471ba6e6b30da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:10.036417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ae71d083-38bb-49cb-a9a6-4a0178268a53 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:10.064176 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ae71d083-38bb-49cb-a9a6-4a0178268a53 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6" status: 200 len: 1467 microversion: 2.1 time: 1.027387 Sep 08 12:47:10.065134 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 849/1771] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:09 2022] GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6 => generated 1467 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:10.071448 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3b54da7d-8e4f-42cb-85ae-259c92ba260a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] 10.222.0.78 "GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6" status: 200 len: 1322 microversion: 2.1 time: 1.000698 Sep 08 12:47:10.081270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5482b613-b1c6-453b-9d36-d212660d5a43 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:10.083874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5482b613-b1c6-453b-9d36-d212660d5a43 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:10.105013 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 923/1772] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:09 2022] GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6 => generated 1322 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:10.132246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5482b613-b1c6-453b-9d36-d212660d5a43 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:10.139784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5482b613-b1c6-453b-9d36-d212660d5a43 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:10.144225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-dc648823-7fbf-4268-917c-b6de34754009 req-46cc4f5a-d863-40c2-9d7e-a5c41c1c5f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51aca69d-8f54-434e-b126-033d4e4515a6", "tag": "b688b07d-6fc5-4349-8d01-1bfa37dcde92"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:10.147105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5482b613-b1c6-453b-9d36-d212660d5a43 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:10.153108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5482b613-b1c6-453b-9d36-d212660d5a43 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:10.155865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5482b613-b1c6-453b-9d36-d212660d5a43 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:10.156460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5482b613-b1c6-453b-9d36-d212660d5a43 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:10.223293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dc648823-7fbf-4268-917c-b6de34754009 req-46cc4f5a-d863-40c2-9d7e-a5c41c1c5f2d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:10.224012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dc648823-7fbf-4268-917c-b6de34754009 req-46cc4f5a-d863-40c2-9d7e-a5c41c1c5f2d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:10.229729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dc648823-7fbf-4268-917c-b6de34754009 req-46cc4f5a-d863-40c2-9d7e-a5c41c1c5f2d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:10.268812 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-dc648823-7fbf-4268-917c-b6de34754009 req-46cc4f5a-d863-40c2-9d7e-a5c41c1c5f2d service nova] Creating event network-changed:b688b07d-6fc5-4349-8d01-1bfa37dcde92 for instance 51aca69d-8f54-434e-b126-033d4e4515a6 on n-h2-852084-10 Sep 08 12:47:10.304203 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-dc648823-7fbf-4268-917c-b6de34754009 req-46cc4f5a-d863-40c2-9d7e-a5c41c1c5f2d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191101 Sep 08 12:47:10.307083 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 924/1773] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:10.340712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f02a47c7-a2e3-47c6-b6b5-c78aa4b09c39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb36cffdc0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:10.442862 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f02a47c7-a2e3-47c6-b6b5-c78aa4b09c39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1438 microversion: 2.1 time: 0.128767 Sep 08 12:47:10.454099 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 925/1774] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:10 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1438 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:10.466435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2398e3fe-01cb-4280-a8cd-4857bd291d96 req-f76c0aa8-8137-4157-8984-8202c6986719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df21d92-5b95-485a-9eb0-9896f885a1d2", "name": "network-vif-plugged", "status": "completed", "tag": "2c1e646d-cb61-4f74-a2eb-ccc0c5f974a8"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:10.505453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2398e3fe-01cb-4280-a8cd-4857bd291d96 req-f76c0aa8-8137-4157-8984-8202c6986719 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:10.512489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2398e3fe-01cb-4280-a8cd-4857bd291d96 req-f76c0aa8-8137-4157-8984-8202c6986719 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:10.514370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2398e3fe-01cb-4280-a8cd-4857bd291d96 req-f76c0aa8-8137-4157-8984-8202c6986719 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:10.585814 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2398e3fe-01cb-4280-a8cd-4857bd291d96 req-f76c0aa8-8137-4157-8984-8202c6986719 service nova] Creating event network-vif-plugged:2c1e646d-cb61-4f74-a2eb-ccc0c5f974a8 for instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 on n-h1-852084-10 Sep 08 12:47:10.624785 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2398e3fe-01cb-4280-a8cd-4857bd291d96 req-f76c0aa8-8137-4157-8984-8202c6986719 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158264 Sep 08 12:47:10.628314 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 926/1775] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:10.649980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-67680ab3-a64b-4838-a7bb-0f061ed6c15e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:10.656765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-67680ab3-a64b-4838-a7bb-0f061ed6c15e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:10.675710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67680ab3-a64b-4838-a7bb-0f061ed6c15e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:10.679841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67680ab3-a64b-4838-a7bb-0f061ed6c15e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:10.681005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67680ab3-a64b-4838-a7bb-0f061ed6c15e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:10.686568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67680ab3-a64b-4838-a7bb-0f061ed6c15e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:10.687487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67680ab3-a64b-4838-a7bb-0f061ed6c15e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:10.688205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67680ab3-a64b-4838-a7bb-0f061ed6c15e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:10.739642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5482b613-b1c6-453b-9d36-d212660d5a43 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:10.767934 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5482b613-b1c6-453b-9d36-d212660d5a43 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1325 microversion: 2.1 time: 0.687914 Sep 08 12:47:10.775027 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 850/1776] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:10 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1325 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:10.817791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8a1c9db0-ba72-48b3-9fff-d6b3d9c35222 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:10.819467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8a1c9db0-ba72-48b3-9fff-d6b3d9c35222 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:10.859635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a1c9db0-ba72-48b3-9fff-d6b3d9c35222 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:10.860965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a1c9db0-ba72-48b3-9fff-d6b3d9c35222 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:10.866087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a1c9db0-ba72-48b3-9fff-d6b3d9c35222 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:10.875451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a1c9db0-ba72-48b3-9fff-d6b3d9c35222 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:10.877038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a1c9db0-ba72-48b3-9fff-d6b3d9c35222 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:10.881080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a1c9db0-ba72-48b3-9fff-d6b3d9c35222 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:11.246868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-67680ab3-a64b-4838-a7bb-0f061ed6c15e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:11.266086 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-67680ab3-a64b-4838-a7bb-0f061ed6c15e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1209 microversion: 2.1 time: 0.625965 Sep 08 12:47:11.268753 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 927/1777] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:10 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1209 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:11.280921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a1c9db0-ba72-48b3-9fff-d6b3d9c35222 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:11.282381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-daaf9a3e-3239-44de-97f1-278c7f01f157 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36be83a0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:11.325978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a1c9db0-ba72-48b3-9fff-d6b3d9c35222 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:11.329312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a1c9db0-ba72-48b3-9fff-d6b3d9c35222 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:11.335597 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8a1c9db0-ba72-48b3-9fff-d6b3d9c35222 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1185 microversion: 2.25 time: 0.554560 Sep 08 12:47:11.347260 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 851/1778] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:10 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1185 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:11.355657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ed0830fb-6ab6-4560-b784-67e00a1a18fc tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:11.356906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ed0830fb-6ab6-4560-b784-67e00a1a18fc tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:11.381642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed0830fb-6ab6-4560-b784-67e00a1a18fc tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:11.382663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed0830fb-6ab6-4560-b784-67e00a1a18fc tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:11.383650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed0830fb-6ab6-4560-b784-67e00a1a18fc tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:11.385020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed0830fb-6ab6-4560-b784-67e00a1a18fc tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:11.385970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed0830fb-6ab6-4560-b784-67e00a1a18fc tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:11.387188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed0830fb-6ab6-4560-b784-67e00a1a18fc tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:11.781833 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-daaf9a3e-3239-44de-97f1-278c7f01f157 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images?changes-since=2022-09-08T12%3A44%3A35Z" status: 200 len: 2328 microversion: 2.1 time: 0.509204 Sep 08 12:47:11.786256 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 928/1779] 10.222.0.78 () {58 vars in 1199 bytes} [Thu Sep 8 12:47:11 2022] GET /compute/v2.1/images?changes-since=2022-09-08T12%3A44%3A35Z => generated 2328 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:11.811352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9919b008-c027-4ef6-9470-2b687ecd5b83 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb36bf3670>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:11.957064 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9919b008-c027-4ef6-9470-2b687ecd5b83 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1438 microversion: 2.1 time: 0.168706 Sep 08 12:47:11.957708 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 929/1780] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:11 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1438 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:11.969711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26f5e98e-a054-4f70-b417-a6b35bafc328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:11.970352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-26f5e98e-a054-4f70-b417-a6b35bafc328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:11.982923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26f5e98e-a054-4f70-b417-a6b35bafc328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:11.983677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26f5e98e-a054-4f70-b417-a6b35bafc328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:11.984149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26f5e98e-a054-4f70-b417-a6b35bafc328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:11.984909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26f5e98e-a054-4f70-b417-a6b35bafc328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:11.985377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26f5e98e-a054-4f70-b417-a6b35bafc328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:11.985820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26f5e98e-a054-4f70-b417-a6b35bafc328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:12.996843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ed0830fb-6ab6-4560-b784-67e00a1a18fc tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927fd8bab7eb46e6be632c68788bf942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f211f252354a48af471ba6e6b30da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:13.015583 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ed0830fb-6ab6-4560-b784-67e00a1a18fc tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] 10.222.0.78 "GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6" status: 200 len: 1322 microversion: 2.1 time: 1.676321 Sep 08 12:47:13.018105 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 852/1781] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:11 2022] GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6 => generated 1322 bytes in 1680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:13.031887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-444be618-0153-483f-af58-71e2854f69f8 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f2daa60>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:13.385521 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-444be618-0153-483f-af58-71e2854f69f8 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1203845563" status: 200 len: 485 microversion: 2.1 time: 0.365836 Sep 08 12:47:13.388696 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 853/1782] 10.222.0.78 () {58 vars in 1231 bytes} [Thu Sep 8 12:47:13 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1203845563 => generated 485 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:13.411663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d6261e52-2e33-49fc-a67c-8eeb89d43264 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:13.411663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d6261e52-2e33-49fc-a67c-8eeb89d43264 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:13.455969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6261e52-2e33-49fc-a67c-8eeb89d43264 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:13.464265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6261e52-2e33-49fc-a67c-8eeb89d43264 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:13.465246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6261e52-2e33-49fc-a67c-8eeb89d43264 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:13.466280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6261e52-2e33-49fc-a67c-8eeb89d43264 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:13.474739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6261e52-2e33-49fc-a67c-8eeb89d43264 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:13.475740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6261e52-2e33-49fc-a67c-8eeb89d43264 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:13.614767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26f5e98e-a054-4f70-b417-a6b35bafc328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:13.629346 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-26f5e98e-a054-4f70-b417-a6b35bafc328 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1325 microversion: 2.1 time: 1.670347 Sep 08 12:47:13.636007 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 930/1783] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:11 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1325 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:13.647579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a11651cf-0fe9-415c-9712-3483dfd860fb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:13.655760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a11651cf-0fe9-415c-9712-3483dfd860fb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:13.686656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a11651cf-0fe9-415c-9712-3483dfd860fb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:13.687289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a11651cf-0fe9-415c-9712-3483dfd860fb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:13.687842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a11651cf-0fe9-415c-9712-3483dfd860fb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:13.689148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a11651cf-0fe9-415c-9712-3483dfd860fb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:13.692374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a11651cf-0fe9-415c-9712-3483dfd860fb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:13.697919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d6261e52-2e33-49fc-a67c-8eeb89d43264 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:13.698774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a11651cf-0fe9-415c-9712-3483dfd860fb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:13.712165 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d6261e52-2e33-49fc-a67c-8eeb89d43264 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1271 microversion: 2.1 time: 0.321232 Sep 08 12:47:13.715131 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 854/1784] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:13 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:13.751637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-5dd730ad-9694-44ce-a401-6e24e14ad8ed req-2a7a2451-e67c-4277-9769-b080a729f591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51aca69d-8f54-434e-b126-033d4e4515a6", "name": "network-vif-plugged", "status": "completed", "tag": "b688b07d-6fc5-4349-8d01-1bfa37dcde92"}, {"server_uuid": "810cd6cb-eab9-4427-aa03-597406fd20f6", "name": "network-vif-unplugged", "status": "completed", "tag": "7817753f-a720-43f2-8c41-dcb97e0c1bbd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:13.786025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5dd730ad-9694-44ce-a401-6e24e14ad8ed req-2a7a2451-e67c-4277-9769-b080a729f591 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:13.787209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5dd730ad-9694-44ce-a401-6e24e14ad8ed req-2a7a2451-e67c-4277-9769-b080a729f591 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:13.787862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5dd730ad-9694-44ce-a401-6e24e14ad8ed req-2a7a2451-e67c-4277-9769-b080a729f591 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:13.835207 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-5dd730ad-9694-44ce-a401-6e24e14ad8ed req-2a7a2451-e67c-4277-9769-b080a729f591 service nova] Creating event network-vif-plugged:b688b07d-6fc5-4349-8d01-1bfa37dcde92 for instance 51aca69d-8f54-434e-b126-033d4e4515a6 on n-h2-852084-10 Sep 08 12:47:13.841677 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-5dd730ad-9694-44ce-a401-6e24e14ad8ed req-2a7a2451-e67c-4277-9769-b080a729f591 service nova] Creating event network-vif-unplugged:7817753f-a720-43f2-8c41-dcb97e0c1bbd for instance 810cd6cb-eab9-4427-aa03-597406fd20f6 on n-h2-852084-10 Sep 08 12:47:13.859695 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-5dd730ad-9694-44ce-a401-6e24e14ad8ed req-2a7a2451-e67c-4277-9769-b080a729f591 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.118389 Sep 08 12:47:13.863987 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 855/1785] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:13 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:13.891433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a11651cf-0fe9-415c-9712-3483dfd860fb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:13.903983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a11651cf-0fe9-415c-9712-3483dfd860fb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:13.910558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a11651cf-0fe9-415c-9712-3483dfd860fb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:13.912366 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a11651cf-0fe9-415c-9712-3483dfd860fb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1233 microversion: 2.25 time: 0.274883 Sep 08 12:47:13.915188 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 931/1786] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:13 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1233 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:13.918826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0f892466-c613-4be8-8158-83482b07d075 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3a72da60>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:13.927395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ff563e4-5631-4dc1-8a03-e4e5e418120f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36518790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:14.186646 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1ff563e4-5631-4dc1-8a03-e4e5e418120f tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images?server=810cd6cb-eab9-4427-aa03-597406fd20f6" status: 200 len: 956 microversion: 2.1 time: 0.268085 Sep 08 12:47:14.195357 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 932/1787] 10.222.0.78 () {58 vars in 1209 bytes} [Thu Sep 8 12:47:13 2022] GET /compute/v2.1/images?server=810cd6cb-eab9-4427-aa03-597406fd20f6 => generated 956 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:14.200098 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0f892466-c613-4be8-8158-83482b07d075 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1438 microversion: 2.1 time: 0.333077 Sep 08 12:47:14.208912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-484f1d41-5015-4439-bdbb-c7b0282380fa tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:14.208912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-484f1d41-5015-4439-bdbb-c7b0282380fa tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:14.209873 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 856/1788] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:13 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1438 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:14.225101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-484f1d41-5015-4439-bdbb-c7b0282380fa tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:14.225752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-484f1d41-5015-4439-bdbb-c7b0282380fa tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:14.226394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-484f1d41-5015-4439-bdbb-c7b0282380fa tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:14.229090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-75dadbbb-5da6-4baf-ab41-c5699507e94c tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f241ee0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:14.230116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-484f1d41-5015-4439-bdbb-c7b0282380fa tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:14.230811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-484f1d41-5015-4439-bdbb-c7b0282380fa tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:14.231545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-484f1d41-5015-4439-bdbb-c7b0282380fa tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:14.436169 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-75dadbbb-5da6-4baf-ab41-c5699507e94c tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2F3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 485 microversion: 2.1 time: 0.215607 Sep 08 12:47:14.447329 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 857/1789] 10.222.0.78 () {58 vars in 1317 bytes} [Thu Sep 8 12:47:14 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2F3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 485 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:14.459831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad81ea51-b2d9-4860-9855-e1bd76c9db22 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3a753af0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:14.598809 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad81ea51-b2d9-4860-9855-e1bd76c9db22 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2F3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 485 microversion: 2.1 time: 0.150023 Sep 08 12:47:14.610924 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 858/1790] 10.222.0.78 () {58 vars in 1303 bytes} [Thu Sep 8 12:47:14 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2F3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 485 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:14.632111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-150e60ec-6afe-4fe2-affe-1c791226c0da tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f2daf70>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:14.697568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-484f1d41-5015-4439-bdbb-c7b0282380fa tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927fd8bab7eb46e6be632c68788bf942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f211f252354a48af471ba6e6b30da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:14.713993 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-484f1d41-5015-4439-bdbb-c7b0282380fa tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] 10.222.0.78 "GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6" status: 200 len: 1322 microversion: 2.1 time: 0.516821 Sep 08 12:47:14.730266 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 933/1791] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:14 2022] GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6 => generated 1322 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:14.737987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-17d85be6-5ba7-49a1-814d-8ab32a5ddfb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:14.739380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-17d85be6-5ba7-49a1-814d-8ab32a5ddfb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:14.758771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17d85be6-5ba7-49a1-814d-8ab32a5ddfb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:14.759884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17d85be6-5ba7-49a1-814d-8ab32a5ddfb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:14.760972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17d85be6-5ba7-49a1-814d-8ab32a5ddfb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:14.762144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17d85be6-5ba7-49a1-814d-8ab32a5ddfb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:14.764190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17d85be6-5ba7-49a1-814d-8ab32a5ddfb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:14.770716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17d85be6-5ba7-49a1-814d-8ab32a5ddfb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:15.026956 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-150e60ec-6afe-4fe2-affe-1c791226c0da tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3706 microversion: 2.1 time: 0.407100 Sep 08 12:47:15.040873 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 859/1792] 10.222.0.78 () {58 vars in 1149 bytes} [Thu Sep 8 12:47:14 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3706 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:15.053975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-590dd930-0103-4111-8458-c5684687b12c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:15.055762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-590dd930-0103-4111-8458-c5684687b12c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:15.076416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-590dd930-0103-4111-8458-c5684687b12c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:15.077244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-590dd930-0103-4111-8458-c5684687b12c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:15.080389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-17d85be6-5ba7-49a1-814d-8ab32a5ddfb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:15.081465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-590dd930-0103-4111-8458-c5684687b12c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:15.082535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-590dd930-0103-4111-8458-c5684687b12c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:15.087371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-590dd930-0103-4111-8458-c5684687b12c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:15.087910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-590dd930-0103-4111-8458-c5684687b12c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:15.091028 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-17d85be6-5ba7-49a1-814d-8ab32a5ddfb8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1521 microversion: 2.1 time: 0.357550 Sep 08 12:47:15.092474 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 934/1793] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:14 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:15.098645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e54c0ca1-1425-4d41-9fc9-0082238895d2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:15.099621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e54c0ca1-1425-4d41-9fc9-0082238895d2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:15.109116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e54c0ca1-1425-4d41-9fc9-0082238895d2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:15.110097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e54c0ca1-1425-4d41-9fc9-0082238895d2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:15.110910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e54c0ca1-1425-4d41-9fc9-0082238895d2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:15.112291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e54c0ca1-1425-4d41-9fc9-0082238895d2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:15.113199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e54c0ca1-1425-4d41-9fc9-0082238895d2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:15.114140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e54c0ca1-1425-4d41-9fc9-0082238895d2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:15.200517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e54c0ca1-1425-4d41-9fc9-0082238895d2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:15.220972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e54c0ca1-1425-4d41-9fc9-0082238895d2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:15.223933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e54c0ca1-1425-4d41-9fc9-0082238895d2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:15.230968 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e54c0ca1-1425-4d41-9fc9-0082238895d2 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1251 microversion: 2.25 time: 0.136767 Sep 08 12:47:15.235219 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 935/1794] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:15 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1251 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:15.245768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-708e0169-e66b-43a2-9f53-dd4658e839c4 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36c69e50>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:15.300550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-590dd930-0103-4111-8458-c5684687b12c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:15.315864 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-590dd930-0103-4111-8458-c5684687b12c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1271 microversion: 2.1 time: 0.273402 Sep 08 12:47:15.327547 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 860/1795] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:15 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1271 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:15.354121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-33901ca7-55a7-42f5-8a48-36dc2b51f288 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:15.358827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33901ca7-55a7-42f5-8a48-36dc2b51f288 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:15.372645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33901ca7-55a7-42f5-8a48-36dc2b51f288 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:15.375605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33901ca7-55a7-42f5-8a48-36dc2b51f288 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:15.377136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33901ca7-55a7-42f5-8a48-36dc2b51f288 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:15.378347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33901ca7-55a7-42f5-8a48-36dc2b51f288 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:15.382124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33901ca7-55a7-42f5-8a48-36dc2b51f288 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:15.384348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33901ca7-55a7-42f5-8a48-36dc2b51f288 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:15.494472 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-708e0169-e66b-43a2-9f53-dd4658e839c4 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.254663 Sep 08 12:47:15.504365 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 936/1796] 10.222.0.78 () {58 vars in 1149 bytes} [Thu Sep 8 12:47:15 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:15.523212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6eb28df8-2f9a-4889-b734-de3dc52a754c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb36518310>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:15.707983 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6eb28df8-2f9a-4889-b734-de3dc52a754c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1438 microversion: 2.1 time: 0.201704 Sep 08 12:47:15.710001 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 937/1797] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:15 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1438 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:15.724595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ed821be-765d-4d13-b719-e626a512f530 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36cff670>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:15.999503 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1ed821be-765d-4d13-b719-e626a512f530 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.284809 Sep 08 12:47:16.002036 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 938/1798] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:47:15 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:16.019763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8732ebab-e753-4ff6-9c89-21bc806a1247 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:16.022364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-33901ca7-55a7-42f5-8a48-36dc2b51f288 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:16.028099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8732ebab-e753-4ff6-9c89-21bc806a1247 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:16.036386 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-33901ca7-55a7-42f5-8a48-36dc2b51f288 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1521 microversion: 2.1 time: 0.707297 Sep 08 12:47:16.040197 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 861/1799] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:15 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1521 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:16.058599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8732ebab-e753-4ff6-9c89-21bc806a1247 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:16.062686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-24c2d589-0fa7-4a70-a286-5bd2190bf601 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f283160>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:16.064202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8732ebab-e753-4ff6-9c89-21bc806a1247 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:16.065374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8732ebab-e753-4ff6-9c89-21bc806a1247 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:16.069247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8732ebab-e753-4ff6-9c89-21bc806a1247 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:16.075384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8732ebab-e753-4ff6-9c89-21bc806a1247 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:16.077719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8732ebab-e753-4ff6-9c89-21bc806a1247 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:16.507441 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-24c2d589-0fa7-4a70-a286-5bd2190bf601 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/detail?changes-since=2022-09-08T12%3A44%3A25Z" status: 200 len: 7015 microversion: 2.1 time: 0.464111 Sep 08 12:47:16.512451 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 862/1800] 10.222.0.78 () {58 vars in 1220 bytes} [Thu Sep 8 12:47:16 2022] GET /compute/v2.1/images/detail?changes-since=2022-09-08T12%3A44%3A25Z => generated 7015 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:16.534306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0d7c5927-9751-4dc5-9596-a6cc8c01f424 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1531298348"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:16.542839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0d7c5927-9751-4dc5-9596-a6cc8c01f424 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:16.572174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d7c5927-9751-4dc5-9596-a6cc8c01f424 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:16.573014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d7c5927-9751-4dc5-9596-a6cc8c01f424 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:16.573663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d7c5927-9751-4dc5-9596-a6cc8c01f424 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:16.574673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d7c5927-9751-4dc5-9596-a6cc8c01f424 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:16.579557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d7c5927-9751-4dc5-9596-a6cc8c01f424 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:16.582209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d7c5927-9751-4dc5-9596-a6cc8c01f424 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:17.239067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8732ebab-e753-4ff6-9c89-21bc806a1247 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927fd8bab7eb46e6be632c68788bf942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f211f252354a48af471ba6e6b30da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:17.262608 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8732ebab-e753-4ff6-9c89-21bc806a1247 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] 10.222.0.78 "GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6" status: 200 len: 1470 microversion: 2.1 time: 1.242977 Sep 08 12:47:17.279294 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 939/1801] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:16 2022] GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6 => generated 1470 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:17.291496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f9669282-205a-47aa-8b57-893e65ebb8b6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:17.294464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f9669282-205a-47aa-8b57-893e65ebb8b6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:17.313443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9669282-205a-47aa-8b57-893e65ebb8b6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:17.313938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9669282-205a-47aa-8b57-893e65ebb8b6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:17.318373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9669282-205a-47aa-8b57-893e65ebb8b6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:17.319753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9669282-205a-47aa-8b57-893e65ebb8b6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:17.322449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9669282-205a-47aa-8b57-893e65ebb8b6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:17.323166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9669282-205a-47aa-8b57-893e65ebb8b6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:17.499442 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0d7c5927-9751-4dc5-9596-a6cc8c01f424 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "POST /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2/action" status: 202 len: 0 microversion: 2.1 time: 0.984610 Sep 08 12:47:17.512049 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 863/1802] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:47:16 2022] POST /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2/action => generated 0 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 12:47:17.532060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-397d5ddc-34f7-46e5-8bf9-57a2b13100b9 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:17.534343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-397d5ddc-34f7-46e5-8bf9-57a2b13100b9 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:17.566771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f9669282-205a-47aa-8b57-893e65ebb8b6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:17.569742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-397d5ddc-34f7-46e5-8bf9-57a2b13100b9 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:17.570902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-397d5ddc-34f7-46e5-8bf9-57a2b13100b9 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:17.576875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-397d5ddc-34f7-46e5-8bf9-57a2b13100b9 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:17.578758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-397d5ddc-34f7-46e5-8bf9-57a2b13100b9 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:17.580199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-397d5ddc-34f7-46e5-8bf9-57a2b13100b9 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:17.581106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-397d5ddc-34f7-46e5-8bf9-57a2b13100b9 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:17.597110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f9669282-205a-47aa-8b57-893e65ebb8b6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:17.608440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f9669282-205a-47aa-8b57-893e65ebb8b6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:17.610359 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f9669282-205a-47aa-8b57-893e65ebb8b6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1251 microversion: 2.25 time: 0.332324 Sep 08 12:47:17.633930 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 940/1803] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:17 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1251 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:17.633930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e6576600-cfff-4b39-beaa-a16f3e53a2e8 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb373563a0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:17.791172 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e6576600-cfff-4b39-beaa-a16f3e53a2e8 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1203845563" status: 200 len: 665 microversion: 2.1 time: 0.170901 Sep 08 12:47:17.798941 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 941/1804] 10.222.0.78 () {58 vars in 1252 bytes} [Thu Sep 8 12:47:17 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1203845563 => generated 665 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:17.827338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9bc04138-7f88-4676-9ccf-3899f6386c33 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb377ea670>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:17.940661 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9bc04138-7f88-4676-9ccf-3899f6386c33 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1438 microversion: 2.1 time: 0.136833 Sep 08 12:47:17.944635 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 942/1805] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:17 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1438 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:17.953063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f5d4d219-602e-413c-a8bd-01f68ad7fe27 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:17.953727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f5d4d219-602e-413c-a8bd-01f68ad7fe27 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:18.008901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5d4d219-602e-413c-a8bd-01f68ad7fe27 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:18.010507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5d4d219-602e-413c-a8bd-01f68ad7fe27 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:18.012721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5d4d219-602e-413c-a8bd-01f68ad7fe27 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:18.014658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5d4d219-602e-413c-a8bd-01f68ad7fe27 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:18.018165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5d4d219-602e-413c-a8bd-01f68ad7fe27 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:18.021595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5d4d219-602e-413c-a8bd-01f68ad7fe27 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:18.100416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f5d4d219-602e-413c-a8bd-01f68ad7fe27 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '927fd8bab7eb46e6be632c68788bf942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f211f252354a48af471ba6e6b30da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f5d4d219-602e-413c-a8bd-01f68ad7fe27 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Request method failure captured: Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6/diagnostics HTTP/1.1 Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeQ31-xFgdka5wCVJlGVlaSHJSDyPfEFTxlC-F-GW6EU8sff1PEi58uQJn17_B8z2OuPL0OGr9QGlSdirOLhDkw4UaoZn0vr9NY5uEd1jiCBPbWEirvPwBVPgCuIKHvybq0RGZzWnLBQnQHVK110pI8YyWQ439PDjhCC8dihNmKXa0g Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 29f211f252354a48af471ba6e6b30da4 Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1486900174 Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:47:18.110677 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:47:18.113878 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_29f211f252354a48af471ba6e6b30da4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/29f211f252354a48af471ba6e6b30da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/29f211f252354a48af471ba6e6b30da4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/29f211f252354a48af471ba6e6b30da4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:18.113878 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1486900174 Sep 08 12:47:18.113878 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 29f211f252354a48af471ba6e6b30da4 Sep 08 12:47:18.113878 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1486900174 Sep 08 12:47:18.113878 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerDiagnosticsNegativeTest-1486900174-project Sep 08 12:47:18.113878 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:47:18.113878 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:47:18.113878 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 927fd8bab7eb46e6be632c68788bf942 Sep 08 12:47:18.113878 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1486900174-project Sep 08 12:47:18.113878 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:47:18.113878 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'server_id': '51aca69d-8f54-434e-b126-033d4e4515a6'} Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:47:18.115488 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:18.118858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f5d4d219-602e-413c-a8bd-01f68ad7fe27 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:18.126848 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f5d4d219-602e-413c-a8bd-01f68ad7fe27 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] 10.222.0.78 "GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.165906 Sep 08 12:47:18.126848 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 943/1806] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:47:17 2022] GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6/diagnostics => generated 117 bytes in 169 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:47:18.129940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-04070017-dabb-4015-89b1-6319bb459aee tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '.version_select at 0x7fdb36cbec10>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:18.177450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:18.189368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:18.230342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:18.260846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:18.340520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-397d5ddc-34f7-46e5-8bf9-57a2b13100b9 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:18.379670 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-397d5ddc-34f7-46e5-8bf9-57a2b13100b9 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1313 microversion: 2.1 time: 0.867640 Sep 08 12:47:18.382165 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 864/1807] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:17 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1313 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:18.409117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d7e3fd9c-bab4-44bf-bb4d-f597e24d2730 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f24c310>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:18.758384 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-04070017-dabb-4015-89b1-6319bb459aee tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "DELETE /compute/v2.1/images/21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06" status: 204 len: 0 microversion: 2.1 time: 0.638828 Sep 08 12:47:18.760278 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 944/1808] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:18 2022] DELETE /compute/v2.1/images/21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:18.767726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6be3c78c-8837-4326-a9a4-a283b88fd561 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:18.770518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6be3c78c-8837-4326-a9a4-a283b88fd561 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:18.799753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6be3c78c-8837-4326-a9a4-a283b88fd561 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:18.805846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6be3c78c-8837-4326-a9a4-a283b88fd561 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:18.806875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6be3c78c-8837-4326-a9a4-a283b88fd561 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:18.808651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6be3c78c-8837-4326-a9a4-a283b88fd561 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:18.809551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6be3c78c-8837-4326-a9a4-a283b88fd561 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:18.812527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6be3c78c-8837-4326-a9a4-a283b88fd561 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:18.876498 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d7e3fd9c-bab4-44bf-bb4d-f597e24d2730 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2F3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1465 microversion: 2.1 time: 0.490002 Sep 08 12:47:18.878372 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 865/1809] 10.222.0.78 () {58 vars in 1338 bytes} [Thu Sep 8 12:47:18 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fv2.1%2Fservers%2F3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1465 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:18.889775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f705d58d-4626-49ab-950e-d50b41215d8e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:18.893113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f705d58d-4626-49ab-950e-d50b41215d8e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:18.908081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6be3c78c-8837-4326-a9a4-a283b88fd561 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:47:18.915546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f705d58d-4626-49ab-950e-d50b41215d8e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:18.919845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f705d58d-4626-49ab-950e-d50b41215d8e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:18.921216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f705d58d-4626-49ab-950e-d50b41215d8e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:18.927815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f705d58d-4626-49ab-950e-d50b41215d8e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:18.929123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f705d58d-4626-49ab-950e-d50b41215d8e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:18.931096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f705d58d-4626-49ab-950e-d50b41215d8e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:18.996679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:19.236696 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6be3c78c-8837-4326-a9a4-a283b88fd561 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] 10.222.0.78 "DELETE /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6" status: 204 len: 0 microversion: 2.1 time: 0.471746 Sep 08 12:47:19.237868 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 945/1810] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:47:18 2022] DELETE /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:19.266671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6086d0c5-e014-438d-b4b9-3e6cae48565b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '.version_select at 0x7fdb36cbea60>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:19.327340 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6086d0c5-e014-438d-b4b9-3e6cae48565b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] HTTP exception thrown: Image not found. Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6086d0c5-e014-438d-b4b9-3e6cae48565b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/images/21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06 HTTP/1.1 Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:47:19.331041 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: exception: Image not found. Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06'} Sep 08 12:47:19.332966 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:47:19.334455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06 Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:47:19.336782 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06 could not be found. Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:47:19.338508 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:19.340443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6086d0c5-e014-438d-b4b9-3e6cae48565b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 404 to user: Image not found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:19.341942 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6086d0c5-e014-438d-b4b9-3e6cae48565b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/images/21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06" status: 404 len: 62 microversion: 2.1 time: 0.082059 Sep 08 12:47:19.355055 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 946/1811] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:19 2022] GET /compute/v2.1/images/21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06 => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:47:19.384043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ad221e60-394f-44ce-a386-e8a46d95b5e4 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36c698b0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:19.571918 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ad221e60-394f-44ce-a386-e8a46d95b5e4 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2F3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1465 microversion: 2.1 time: 0.214126 Sep 08 12:47:19.584447 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 947/1812] 10.222.0.78 () {58 vars in 1324 bytes} [Thu Sep 8 12:47:19 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.78%2Fcompute%2Fservers%2F3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1465 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:19.600641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-919c3e8d-3a2a-455d-aa9c-c00bea06d5b0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3761eee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:19.648042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f705d58d-4626-49ab-950e-d50b41215d8e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:19.683016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f705d58d-4626-49ab-950e-d50b41215d8e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:19.686726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f705d58d-4626-49ab-950e-d50b41215d8e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:19.689503 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f705d58d-4626-49ab-950e-d50b41215d8e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1293 microversion: 2.25 time: 0.807422 Sep 08 12:47:19.711589 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 866/1813] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:18 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1293 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:19.750756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c841b39a-77cb-4897-b0b0-c7159d6cff0a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:19.758284 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-919c3e8d-3a2a-455d-aa9c-c00bea06d5b0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1438 microversion: 2.1 time: 0.170979 Sep 08 12:47:19.773905 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 948/1814] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:19 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1438 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:19.773905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-847b66a4-c290-43a3-a343-a311471b2c6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:19.773905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-847b66a4-c290-43a3-a343-a311471b2c6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:19.775490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c841b39a-77cb-4897-b0b0-c7159d6cff0a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:19.784753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-847b66a4-c290-43a3-a343-a311471b2c6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:19.785743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-847b66a4-c290-43a3-a343-a311471b2c6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:19.787066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-847b66a4-c290-43a3-a343-a311471b2c6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:19.788033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-847b66a4-c290-43a3-a343-a311471b2c6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:19.788955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-847b66a4-c290-43a3-a343-a311471b2c6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:19.789767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-847b66a4-c290-43a3-a343-a311471b2c6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:19.799027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c841b39a-77cb-4897-b0b0-c7159d6cff0a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:19.812527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c841b39a-77cb-4897-b0b0-c7159d6cff0a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:19.813784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c841b39a-77cb-4897-b0b0-c7159d6cff0a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:19.815497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c841b39a-77cb-4897-b0b0-c7159d6cff0a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:19.816705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c841b39a-77cb-4897-b0b0-c7159d6cff0a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:19.819024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c841b39a-77cb-4897-b0b0-c7159d6cff0a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:20.383681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-847b66a4-c290-43a3-a343-a311471b2c6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:20.401405 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-847b66a4-c290-43a3-a343-a311471b2c6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1539 microversion: 2.1 time: 0.640010 Sep 08 12:47:20.402240 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 949/1815] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:19 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1539 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:20.438630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c841b39a-77cb-4897-b0b0-c7159d6cff0a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927fd8bab7eb46e6be632c68788bf942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f211f252354a48af471ba6e6b30da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:20.446771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f93f068a-e8ef-4a17-b9f6-2d6718305bcc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:20.448177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f93f068a-e8ef-4a17-b9f6-2d6718305bcc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:20.467086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f93f068a-e8ef-4a17-b9f6-2d6718305bcc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:20.467330 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c841b39a-77cb-4897-b0b0-c7159d6cff0a tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] 10.222.0.78 "GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6" status: 200 len: 1476 microversion: 2.1 time: 0.746162 Sep 08 12:47:20.467934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f93f068a-e8ef-4a17-b9f6-2d6718305bcc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:20.468763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f93f068a-e8ef-4a17-b9f6-2d6718305bcc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:20.469320 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 867/1816] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:19 2022] GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6 => generated 1476 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:20.470119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f93f068a-e8ef-4a17-b9f6-2d6718305bcc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:20.470958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f93f068a-e8ef-4a17-b9f6-2d6718305bcc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:20.472540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f93f068a-e8ef-4a17-b9f6-2d6718305bcc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:20.480358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5fbd00b9-3dee-418e-9e68-d6a9f0418a40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f268280>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:20.790287 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5fbd00b9-3dee-418e-9e68-d6a9f0418a40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7790 microversion: 2.1 time: 0.314118 Sep 08 12:47:20.793761 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 868/1817] 10.222.0.78 () {58 vars in 1170 bytes} [Thu Sep 8 12:47:20 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7790 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:20.840821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-545d554a-2448-4bc6-a96b-8362c3d551ea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:20.842456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-545d554a-2448-4bc6-a96b-8362c3d551ea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:20.856240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-545d554a-2448-4bc6-a96b-8362c3d551ea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:20.857771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-545d554a-2448-4bc6-a96b-8362c3d551ea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:20.858944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-545d554a-2448-4bc6-a96b-8362c3d551ea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:20.861701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-545d554a-2448-4bc6-a96b-8362c3d551ea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:20.863048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-545d554a-2448-4bc6-a96b-8362c3d551ea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:20.864166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-545d554a-2448-4bc6-a96b-8362c3d551ea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:21.562974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f93f068a-e8ef-4a17-b9f6-2d6718305bcc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:21.579609 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f93f068a-e8ef-4a17-b9f6-2d6718305bcc tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1313 microversion: 2.1 time: 1.162894 Sep 08 12:47:21.591247 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 950/1818] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:20 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1313 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:21.596981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-656ffb30-cb0a-4ef6-86aa-e2c4c3befff2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb373a9c10>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:21.733353 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-656ffb30-cb0a-4ef6-86aa-e2c4c3befff2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1438 microversion: 2.1 time: 0.140239 Sep 08 12:47:21.747277 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 951/1819] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:21 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1438 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:21.747627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6b5e87cf-484e-43e3-bd24-4abc45a49fd1 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb371c8280>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:21.998617 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6b5e87cf-484e-43e3-bd24-4abc45a49fd1 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4369 microversion: 2.1 time: 0.258662 Sep 08 12:47:22.005108 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 952/1820] 10.222.0.78 () {58 vars in 1170 bytes} [Thu Sep 8 12:47:21 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4369 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:22.024991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c3b6a925-b802-4b3d-b331-69cf05b82314 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:22.025943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c3b6a925-b802-4b3d-b331-69cf05b82314 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:22.035771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b6a925-b802-4b3d-b331-69cf05b82314 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:22.036573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b6a925-b802-4b3d-b331-69cf05b82314 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:22.037268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b6a925-b802-4b3d-b331-69cf05b82314 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:22.038210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b6a925-b802-4b3d-b331-69cf05b82314 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:22.039432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b6a925-b802-4b3d-b331-69cf05b82314 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:22.043025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b6a925-b802-4b3d-b331-69cf05b82314 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:22.075408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-545d554a-2448-4bc6-a96b-8362c3d551ea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:22.116179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-545d554a-2448-4bc6-a96b-8362c3d551ea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:22.129206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-545d554a-2448-4bc6-a96b-8362c3d551ea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:22.131501 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-545d554a-2448-4bc6-a96b-8362c3d551ea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1293 microversion: 2.25 time: 1.319684 Sep 08 12:47:22.132123 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 869/1821] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:20 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1293 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:22.154724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e4e98f95-5536-467c-9c85-e89408bedc9a req-9cc13e44-9de4-4ffe-b7fb-e0f972a4537a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f", "tag": "e368f8a1-84db-49b8-b146-dd5064ae7f33"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:22.197516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e4e98f95-5536-467c-9c85-e89408bedc9a req-9cc13e44-9de4-4ffe-b7fb-e0f972a4537a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:22.200869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e4e98f95-5536-467c-9c85-e89408bedc9a req-9cc13e44-9de4-4ffe-b7fb-e0f972a4537a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:22.201437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e4e98f95-5536-467c-9c85-e89408bedc9a req-9cc13e44-9de4-4ffe-b7fb-e0f972a4537a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:22.208799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:22.247864 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e4e98f95-5536-467c-9c85-e89408bedc9a req-9cc13e44-9de4-4ffe-b7fb-e0f972a4537a service nova] Creating event network-changed:e368f8a1-84db-49b8-b146-dd5064ae7f33 for instance 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f on n-h1-852084-10 Sep 08 12:47:22.257453 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e4e98f95-5536-467c-9c85-e89408bedc9a req-9cc13e44-9de4-4ffe-b7fb-e0f972a4537a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123905 Sep 08 12:47:22.263298 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 870/1822] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:22.272701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e5c79fd2-9bf9-43c6-82ec-fc5809b70e68 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:22.277598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e5c79fd2-9bf9-43c6-82ec-fc5809b70e68 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:22.302624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5c79fd2-9bf9-43c6-82ec-fc5809b70e68 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:22.305272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5c79fd2-9bf9-43c6-82ec-fc5809b70e68 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:22.306267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5c79fd2-9bf9-43c6-82ec-fc5809b70e68 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:22.308335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5c79fd2-9bf9-43c6-82ec-fc5809b70e68 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:22.310935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5c79fd2-9bf9-43c6-82ec-fc5809b70e68 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:22.312872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5c79fd2-9bf9-43c6-82ec-fc5809b70e68 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:22.958700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e5c79fd2-9bf9-43c6-82ec-fc5809b70e68 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927fd8bab7eb46e6be632c68788bf942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f211f252354a48af471ba6e6b30da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:22.976492 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e5c79fd2-9bf9-43c6-82ec-fc5809b70e68 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] 10.222.0.78 "GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6" status: 200 len: 1476 microversion: 2.1 time: 0.711189 Sep 08 12:47:22.987593 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 871/1823] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:22 2022] GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6 => generated 1476 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:22.993845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ea6e0d1a-c199-4d5c-bf2e-03f9fb3f9531 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f2414c0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:23.052848 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 12:47:23.053505 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 12:47:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 (ip 10.222.0.78) !!! Sep 08 12:47:23.100021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c3b6a925-b802-4b3d-b331-69cf05b82314 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:23.110786 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c3b6a925-b802-4b3d-b331-69cf05b82314 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1521 microversion: 2.1 time: 1.104046 Sep 08 12:47:23.117019 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 953/1824] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:22 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1521 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:23.128384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44002d73-c521-4a30-9ba9-4a79f8c7701f tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:23.129367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-44002d73-c521-4a30-9ba9-4a79f8c7701f tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:23.158806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44002d73-c521-4a30-9ba9-4a79f8c7701f tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:23.159687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44002d73-c521-4a30-9ba9-4a79f8c7701f tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:23.160320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44002d73-c521-4a30-9ba9-4a79f8c7701f tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:23.161247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44002d73-c521-4a30-9ba9-4a79f8c7701f tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:23.162042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44002d73-c521-4a30-9ba9-4a79f8c7701f tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:23.162692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44002d73-c521-4a30-9ba9-4a79f8c7701f tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:23.185082 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ea6e0d1a-c199-4d5c-bf2e-03f9fb3f9531 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/f54d39f0-e02f-4735-8a67-b5b40688d75d" status: 200 len: 784 microversion: 2.1 time: 0.204943 Sep 08 12:47:23.202114 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 872/1825] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:22 2022] GET /compute/v2.1/images/f54d39f0-e02f-4735-8a67-b5b40688d75d => generated 784 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:23.220855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0175a043-b13f-4e6a-95da-40c811d5dee1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3f252af0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:23.355897 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0175a043-b13f-4e6a-95da-40c811d5dee1 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1438 microversion: 2.1 time: 0.141382 Sep 08 12:47:23.372780 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 873/1826] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:23 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1438 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:23.387959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92563102-8a78-4a54-9db1-962bdd27e63b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:23.389477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-92563102-8a78-4a54-9db1-962bdd27e63b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:23.425792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92563102-8a78-4a54-9db1-962bdd27e63b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:23.426770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92563102-8a78-4a54-9db1-962bdd27e63b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:23.427547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92563102-8a78-4a54-9db1-962bdd27e63b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:23.428831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92563102-8a78-4a54-9db1-962bdd27e63b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:23.430168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92563102-8a78-4a54-9db1-962bdd27e63b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:23.431261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92563102-8a78-4a54-9db1-962bdd27e63b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:23.522006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-92563102-8a78-4a54-9db1-962bdd27e63b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:47:23.946961 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92563102-8a78-4a54-9db1-962bdd27e63b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 204 len: 0 microversion: 2.1 time: 0.571762 Sep 08 12:47:23.952933 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 874/1827] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:47:23 2022] DELETE /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:23.962595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6c3602e0-fb4d-4c0b-a8cf-9e91fa1b5695 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:23.968087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6c3602e0-fb4d-4c0b-a8cf-9e91fa1b5695 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:23.999967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3602e0-fb4d-4c0b-a8cf-9e91fa1b5695 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:24.003007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3602e0-fb4d-4c0b-a8cf-9e91fa1b5695 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:24.003700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3602e0-fb4d-4c0b-a8cf-9e91fa1b5695 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:24.005240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3602e0-fb4d-4c0b-a8cf-9e91fa1b5695 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:24.008763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3602e0-fb4d-4c0b-a8cf-9e91fa1b5695 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:24.009850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c3602e0-fb4d-4c0b-a8cf-9e91fa1b5695 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:24.333204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-44002d73-c521-4a30-9ba9-4a79f8c7701f tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:24.395861 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44002d73-c521-4a30-9ba9-4a79f8c7701f tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1313 microversion: 2.1 time: 1.276128 Sep 08 12:47:24.397526 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 954/1828] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:23 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1313 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:24.412504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fadced6b-1f6e-421d-9988-a1772117967c tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36d98790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:24.543349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c3602e0-fb4d-4c0b-a8cf-9e91fa1b5695 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:24.567422 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fadced6b-1f6e-421d-9988-a1772117967c tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1608 microversion: 2.1 time: 0.162803 Sep 08 12:47:24.569939 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 955/1829] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:47:24 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1608 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:24.592575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e8f9bde-4028-4b0e-ab3d-b9fefb093620 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:24.596816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6e8f9bde-4028-4b0e-ab3d-b9fefb093620 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:24.598841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c3602e0-fb4d-4c0b-a8cf-9e91fa1b5695 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:24.602920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c3602e0-fb4d-4c0b-a8cf-9e91fa1b5695 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:24.605472 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6c3602e0-fb4d-4c0b-a8cf-9e91fa1b5695 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1293 microversion: 2.25 time: 0.654504 Sep 08 12:47:24.612599 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 875/1830] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:23 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1293 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:24.623908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a7f480e2-3da7-4090-a131-465c9794120b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:24.624744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a7f480e2-3da7-4090-a131-465c9794120b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:24.636407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7f480e2-3da7-4090-a131-465c9794120b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:24.637341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7f480e2-3da7-4090-a131-465c9794120b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:24.638228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7f480e2-3da7-4090-a131-465c9794120b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:24.639731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7f480e2-3da7-4090-a131-465c9794120b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:24.640621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7f480e2-3da7-4090-a131-465c9794120b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:24.641424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7f480e2-3da7-4090-a131-465c9794120b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:24.661393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e8f9bde-4028-4b0e-ab3d-b9fefb093620 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:24.662087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e8f9bde-4028-4b0e-ab3d-b9fefb093620 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:24.662565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e8f9bde-4028-4b0e-ab3d-b9fefb093620 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:24.663375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e8f9bde-4028-4b0e-ab3d-b9fefb093620 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:24.664543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e8f9bde-4028-4b0e-ab3d-b9fefb093620 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:24.665273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e8f9bde-4028-4b0e-ab3d-b9fefb093620 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:24.711872 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6e8f9bde-4028-4b0e-ab3d-b9fefb093620 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.137594 Sep 08 12:47:24.713156 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 956/1831] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:47:24 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:47:24.735317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a7f480e2-3da7-4090-a131-465c9794120b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:47:24.745876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-3830d051-97d1-4d05-a2e5-ef05b47df3b3 req-65a5964b-6e02-49bb-8477-9357f05fef86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df21d92-5b95-485a-9eb0-9896f885a1d2", "name": "network-vif-plugged", "status": "completed", "tag": "2c1e646d-cb61-4f74-a2eb-ccc0c5f974a8"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:24.782228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3830d051-97d1-4d05-a2e5-ef05b47df3b3 req-65a5964b-6e02-49bb-8477-9357f05fef86 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:24.784912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3830d051-97d1-4d05-a2e5-ef05b47df3b3 req-65a5964b-6e02-49bb-8477-9357f05fef86 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:24.785688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3830d051-97d1-4d05-a2e5-ef05b47df3b3 req-65a5964b-6e02-49bb-8477-9357f05fef86 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:24.848535 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-3830d051-97d1-4d05-a2e5-ef05b47df3b3 req-65a5964b-6e02-49bb-8477-9357f05fef86 service nova] Creating event network-vif-plugged:2c1e646d-cb61-4f74-a2eb-ccc0c5f974a8 for instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 on n-h1-852084-10 Sep 08 12:47:24.866666 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-3830d051-97d1-4d05-a2e5-ef05b47df3b3 req-65a5964b-6e02-49bb-8477-9357f05fef86 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122526 Sep 08 12:47:24.871153 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 957/1832] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:24.877984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f557b846-5f05-49f8-af68-3d57796fba16 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:24.879259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f557b846-5f05-49f8-af68-3d57796fba16 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:24.888408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f557b846-5f05-49f8-af68-3d57796fba16 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:24.889316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f557b846-5f05-49f8-af68-3d57796fba16 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:24.890439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f557b846-5f05-49f8-af68-3d57796fba16 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:24.892033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f557b846-5f05-49f8-af68-3d57796fba16 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:24.893084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f557b846-5f05-49f8-af68-3d57796fba16 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:24.893893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f557b846-5f05-49f8-af68-3d57796fba16 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:24.912345 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a7f480e2-3da7-4090-a131-465c9794120b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "DELETE /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 204 len: 0 microversion: 2.1 time: 0.296678 Sep 08 12:47:24.913420 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 876/1833] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:47:24 2022] DELETE /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:24.919440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:24.924447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:24.934262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:24.934766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:24.935254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:24.936011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:24.936533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:24.936976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:25.012732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:25.019131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:25.019867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:25.020737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lazy-loading 'fault' on Instance uuid 51aca69d-8f54-434e-b126-033d4e4515a6 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:47:25.152295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '927fd8bab7eb46e6be632c68788bf942', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29f211f252354a48af471ba6e6b30da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:25.174614 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-12db7f03-5c9e-4f6b-b76a-d37b05933d99 tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] 10.222.0.78 "GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6" status: 200 len: 1312 microversion: 2.1 time: 0.259466 Sep 08 12:47:25.186141 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 877/1834] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:24 2022] GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6 => generated 1312 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:25.192232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a4719d88-b0e8-46af-ac37-d0982d6a62e5 req-d647b52e-0d2d-4323-82d9-8b28f9d43163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51aca69d-8f54-434e-b126-033d4e4515a6", "name": "network-vif-deleted", "tag": "b688b07d-6fc5-4349-8d01-1bfa37dcde92"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:25.218136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a4719d88-b0e8-46af-ac37-d0982d6a62e5 req-d647b52e-0d2d-4323-82d9-8b28f9d43163 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:25.218972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a4719d88-b0e8-46af-ac37-d0982d6a62e5 req-d647b52e-0d2d-4323-82d9-8b28f9d43163 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:25.219678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a4719d88-b0e8-46af-ac37-d0982d6a62e5 req-d647b52e-0d2d-4323-82d9-8b28f9d43163 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:25.257809 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a4719d88-b0e8-46af-ac37-d0982d6a62e5 req-d647b52e-0d2d-4323-82d9-8b28f9d43163 service nova] Creating event network-vif-deleted:b688b07d-6fc5-4349-8d01-1bfa37dcde92 for instance 51aca69d-8f54-434e-b126-033d4e4515a6 on n-h2-852084-10 Sep 08 12:47:25.294507 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a4719d88-b0e8-46af-ac37-d0982d6a62e5 req-d647b52e-0d2d-4323-82d9-8b28f9d43163 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106546 Sep 08 12:47:25.297256 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 878/1835] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:25.305000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-32567c06-59bb-4003-b6dc-89efaf8f98a6 req-1be64f40-3bff-47ee-b888-3a9e88c0391d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ac97d7-8051-4b86-981b-eae55076e04c", "tag": "0651dd1c-1b65-417f-a953-0882fc7b9d25"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:25.357407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-32567c06-59bb-4003-b6dc-89efaf8f98a6 req-1be64f40-3bff-47ee-b888-3a9e88c0391d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:25.357949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-32567c06-59bb-4003-b6dc-89efaf8f98a6 req-1be64f40-3bff-47ee-b888-3a9e88c0391d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:25.358391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-32567c06-59bb-4003-b6dc-89efaf8f98a6 req-1be64f40-3bff-47ee-b888-3a9e88c0391d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:25.361867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f557b846-5f05-49f8-af68-3d57796fba16 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:25.392947 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-32567c06-59bb-4003-b6dc-89efaf8f98a6 req-1be64f40-3bff-47ee-b888-3a9e88c0391d service nova] Creating event network-changed:0651dd1c-1b65-417f-a953-0882fc7b9d25 for instance 19ac97d7-8051-4b86-981b-eae55076e04c on n-h1-852084-10 Sep 08 12:47:25.395039 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f557b846-5f05-49f8-af68-3d57796fba16 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1527 microversion: 2.1 time: 0.510671 Sep 08 12:47:25.422342 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-32567c06-59bb-4003-b6dc-89efaf8f98a6 req-1be64f40-3bff-47ee-b888-3a9e88c0391d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108624 Sep 08 12:47:25.425638 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 879/1836] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:25.430316 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 958/1837] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:24 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1527 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:25.446470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6189ab55-cfa5-40b5-8c22-58627718e999 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb36d650d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:25.459737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-11d06c97-771a-494e-ad48-6181aba1ea97 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3f252f70>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:26.414972 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6189ab55-cfa5-40b5-8c22-58627718e999 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "DELETE /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0" status: 204 len: 0 microversion: 2.1 time: 0.979958 Sep 08 12:47:26.434518 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 959/1838] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:25 2022] DELETE /compute/v2.1/images/ca2e99bf-a71c-40fe-8802-dfb49314f3b0 => generated 0 bytes in 1003 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:26.454905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d11228f4-3af5-49e9-a01e-d6f622a68a26 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:26.461676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d11228f4-3af5-49e9-a01e-d6f622a68a26 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:26.494272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d11228f4-3af5-49e9-a01e-d6f622a68a26 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:26.495973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d11228f4-3af5-49e9-a01e-d6f622a68a26 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:26.497162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d11228f4-3af5-49e9-a01e-d6f622a68a26 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:26.498877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d11228f4-3af5-49e9-a01e-d6f622a68a26 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:26.500169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d11228f4-3af5-49e9-a01e-d6f622a68a26 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:26.501363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d11228f4-3af5-49e9-a01e-d6f622a68a26 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:26.568725 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d11228f4-3af5-49e9-a01e-d6f622a68a26 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131548 Sep 08 12:47:26.570228 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 960/1839] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:47:26 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56/os-volume_attachments => generated 25 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:47:26.579266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3fab8f9-949c-4416-bfb6-4167693ab16f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:26.580754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e3fab8f9-949c-4416-bfb6-4167693ab16f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:26.599798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3fab8f9-949c-4416-bfb6-4167693ab16f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:26.603388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3fab8f9-949c-4416-bfb6-4167693ab16f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:26.605275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3fab8f9-949c-4416-bfb6-4167693ab16f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:26.613158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3fab8f9-949c-4416-bfb6-4167693ab16f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:26.616830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3fab8f9-949c-4416-bfb6-4167693ab16f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:26.618808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3fab8f9-949c-4416-bfb6-4167693ab16f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:26.652882 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-11d06c97-771a-494e-ad48-6181aba1ea97 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1447 microversion: 2.1 time: 1.202753 Sep 08 12:47:26.670359 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 880/1840] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:25 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1447 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:26.670359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-046922f3-b0b2-4886-a4a1-39d99884d992 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:26.670359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-046922f3-b0b2-4886-a4a1-39d99884d992 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:26.714708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-046922f3-b0b2-4886-a4a1-39d99884d992 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:26.715546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-046922f3-b0b2-4886-a4a1-39d99884d992 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:26.716373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-046922f3-b0b2-4886-a4a1-39d99884d992 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:26.717751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-046922f3-b0b2-4886-a4a1-39d99884d992 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:26.718656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-046922f3-b0b2-4886-a4a1-39d99884d992 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:26.719519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-046922f3-b0b2-4886-a4a1-39d99884d992 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:26.983651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e3fab8f9-949c-4416-bfb6-4167693ab16f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:26.996189 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e3fab8f9-949c-4416-bfb6-4167693ab16f tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1666 microversion: 2.1 time: 0.424003 Sep 08 12:47:27.016145 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 961/1841] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:26 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1666 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:27.026434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2f2b9214-f206-4d2b-96e6-e4dc412e122a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:27.027981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2f2b9214-f206-4d2b-96e6-e4dc412e122a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:27.037103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f2b9214-f206-4d2b-96e6-e4dc412e122a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:27.038046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f2b9214-f206-4d2b-96e6-e4dc412e122a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:27.038830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f2b9214-f206-4d2b-96e6-e4dc412e122a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:27.039894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f2b9214-f206-4d2b-96e6-e4dc412e122a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:27.040617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f2b9214-f206-4d2b-96e6-e4dc412e122a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:27.042937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f2b9214-f206-4d2b-96e6-e4dc412e122a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:27.381473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-046922f3-b0b2-4886-a4a1-39d99884d992 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:27.410321 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-046922f3-b0b2-4886-a4a1-39d99884d992 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1313 microversion: 2.1 time: 0.747581 Sep 08 12:47:27.441240 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 881/1842] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:26 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1313 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:27.467093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-321e6e18-9d2e-4313-af83-4371e69a5efb tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:27.470398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-321e6e18-9d2e-4313-af83-4371e69a5efb tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] [instance: 51aca69d-8f54-434e-b126-033d4e4515a6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:27.495996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-321e6e18-9d2e-4313-af83-4371e69a5efb tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:27.497860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-321e6e18-9d2e-4313-af83-4371e69a5efb tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:27.499459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-321e6e18-9d2e-4313-af83-4371e69a5efb tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:27.502955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-321e6e18-9d2e-4313-af83-4371e69a5efb tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:27.504538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-321e6e18-9d2e-4313-af83-4371e69a5efb tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:27.506309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-321e6e18-9d2e-4313-af83-4371e69a5efb tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:27.563804 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-321e6e18-9d2e-4313-af83-4371e69a5efb tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] HTTP exception thrown: Instance 51aca69d-8f54-434e-b126-033d4e4515a6 could not be found. Sep 08 12:47:27.573573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2f2b9214-f206-4d2b-96e6-e4dc412e122a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-321e6e18-9d2e-4313-af83-4371e69a5efb tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Request method failure captured: Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6 HTTP/1.1 Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeQ31-xFgdka5wCVJlGVlaSHJSDyPfEFTxlC-F-GW6EU8sff1PEi58uQJn17_B8z2OuPL0OGr9QGlSdirOLhDkw4UaoZn0vr9NY5uEd1jiCBPbWEirvPwBVPgCuIKHvybq0RGZzWnLBQnQHVK110pI8YyWQ439PDjhCC8dihNmKXa0g Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 29f211f252354a48af471ba6e6b30da4 Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1486900174 Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:47:27.588151 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:47:27.589824 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_29f211f252354a48af471ba6e6b30da4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/29f211f252354a48af471ba6e6b30da4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/29f211f252354a48af471ba6e6b30da4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/29f211f252354a48af471ba6e6b30da4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:27.589824 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1486900174 Sep 08 12:47:27.589824 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 29f211f252354a48af471ba6e6b30da4 Sep 08 12:47:27.589824 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1486900174 Sep 08 12:47:27.589824 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerDiagnosticsNegativeTest-1486900174-project Sep 08 12:47:27.589824 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:47:27.589824 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:47:27.589824 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 927fd8bab7eb46e6be632c68788bf942 Sep 08 12:47:27.589824 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1486900174-project Sep 08 12:47:27.589824 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:47:27.589824 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 51aca69d-8f54-434e-b126-033d4e4515a6 could not be found. Sep 08 12:47:27.589824 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '51aca69d-8f54-434e-b126-033d4e4515a6'} Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51aca69d-8f54-434e-b126-033d4e4515a6 could not be found. Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:27.590802 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51aca69d-8f54-434e-b126-033d4e4515a6 could not be found. Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51aca69d-8f54-434e-b126-033d4e4515a6 could not be found. Sep 08 12:47:27.593638 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:27.597375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-321e6e18-9d2e-4313-af83-4371e69a5efb tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] Returning 404 to user: Instance 51aca69d-8f54-434e-b126-033d4e4515a6 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:27.597375 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-321e6e18-9d2e-4313-af83-4371e69a5efb tempest-ServerDiagnosticsNegativeTest-1486900174 tempest-ServerDiagnosticsNegativeTest-1486900174-project] 10.222.0.78 "GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6" status: 404 len: 111 microversion: 2.1 time: 0.147173 Sep 08 12:47:27.602671 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 882/1843] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:27 2022] GET /compute/v2.1/servers/51aca69d-8f54-434e-b126-033d4e4515a6 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:47:27.636739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2f2b9214-f206-4d2b-96e6-e4dc412e122a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:27.640199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2f2b9214-f206-4d2b-96e6-e4dc412e122a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:27.645558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db82c22f-315b-44f8-bc26-e3375baea8a3 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f24f430>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:27.654379 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2f2b9214-f206-4d2b-96e6-e4dc412e122a tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1293 microversion: 2.25 time: 0.621078 Sep 08 12:47:27.656469 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 962/1844] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:27 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1293 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:27.686547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-15d86187-d411-403a-942a-a497f3b2db12 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:27.698053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-15d86187-d411-403a-942a-a497f3b2db12 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:27.737825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15d86187-d411-403a-942a-a497f3b2db12 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:27.738361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15d86187-d411-403a-942a-a497f3b2db12 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:27.738805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15d86187-d411-403a-942a-a497f3b2db12 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:27.740422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15d86187-d411-403a-942a-a497f3b2db12 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:27.740422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15d86187-d411-403a-942a-a497f3b2db12 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:27.740422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15d86187-d411-403a-942a-a497f3b2db12 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:27.996744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-15d86187-d411-403a-942a-a497f3b2db12 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:28.013783 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-15d86187-d411-403a-942a-a497f3b2db12 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1485 microversion: 2.1 time: 0.352326 Sep 08 12:47:28.032444 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 963/1845] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:27 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1485 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:28.032444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-143dca7f-869c-459d-a6b1-52c26639b98f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb36be8e50>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:28.170747 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-143dca7f-869c-459d-a6b1-52c26639b98f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 200 len: 1447 microversion: 2.1 time: 0.153681 Sep 08 12:47:28.191872 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 964/1846] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:47:28 2022] GET /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:28.202674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e36f97fb-68c5-4a47-a002-70481636bda7 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:28.203551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e36f97fb-68c5-4a47-a002-70481636bda7 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:28.212098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e36f97fb-68c5-4a47-a002-70481636bda7 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:28.212977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e36f97fb-68c5-4a47-a002-70481636bda7 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:28.214981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e36f97fb-68c5-4a47-a002-70481636bda7 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:28.216054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e36f97fb-68c5-4a47-a002-70481636bda7 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:28.216832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e36f97fb-68c5-4a47-a002-70481636bda7 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:28.217577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e36f97fb-68c5-4a47-a002-70481636bda7 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:28.378690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e36f97fb-68c5-4a47-a002-70481636bda7 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:47:28.657489 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-db82c22f-315b-44f8-bc26-e3375baea8a3 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "DELETE /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7" status: 204 len: 0 microversion: 2.1 time: 1.041972 Sep 08 12:47:28.658077 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 883/1847] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:27 2022] DELETE /compute/v2.1/images/19d75a74-08b8-4366-b8e4-7db311a688a7 => generated 0 bytes in 1059 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:28.666659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c6257455-27cd-4e00-87f7-12a746a4461a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:28.667324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c6257455-27cd-4e00-87f7-12a746a4461a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:28.687840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6257455-27cd-4e00-87f7-12a746a4461a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:28.691602 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e36f97fb-68c5-4a47-a002-70481636bda7 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "DELETE /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 204 len: 0 microversion: 2.1 time: 0.497648 Sep 08 12:47:28.692263 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 965/1848] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:47:28 2022] DELETE /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:28.697157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6257455-27cd-4e00-87f7-12a746a4461a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:28.698949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6257455-27cd-4e00-87f7-12a746a4461a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:28.699780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6257455-27cd-4e00-87f7-12a746a4461a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:28.702569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6257455-27cd-4e00-87f7-12a746a4461a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:28.703075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6257455-27cd-4e00-87f7-12a746a4461a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:28.708404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c9ea5b52-1668-4192-a7f5-791652eff701 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb36b490d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:28.899350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c6257455-27cd-4e00-87f7-12a746a4461a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:28.916528 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c6257455-27cd-4e00-87f7-12a746a4461a tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1666 microversion: 2.1 time: 0.257089 Sep 08 12:47:28.919039 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 884/1849] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:28 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1666 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:28.930824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7820d5fd-5941-4d9e-835e-7b401ae619ad req-4ed3192b-a5ff-427c-9081-8738ca25851d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8df21d92-5b95-485a-9eb0-9896f885a1d2", "name": "network-vif-deleted", "tag": "2c1e646d-cb61-4f74-a2eb-ccc0c5f974a8"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:28.947794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7820d5fd-5941-4d9e-835e-7b401ae619ad req-4ed3192b-a5ff-427c-9081-8738ca25851d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:28.948570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7820d5fd-5941-4d9e-835e-7b401ae619ad req-4ed3192b-a5ff-427c-9081-8738ca25851d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:28.949385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7820d5fd-5941-4d9e-835e-7b401ae619ad req-4ed3192b-a5ff-427c-9081-8738ca25851d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:28.964195 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7820d5fd-5941-4d9e-835e-7b401ae619ad req-4ed3192b-a5ff-427c-9081-8738ca25851d service nova] Creating event network-vif-deleted:2c1e646d-cb61-4f74-a2eb-ccc0c5f974a8 for instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 on n-h1-852084-10 Sep 08 12:47:28.971084 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7820d5fd-5941-4d9e-835e-7b401ae619ad req-4ed3192b-a5ff-427c-9081-8738ca25851d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050422 Sep 08 12:47:28.972185 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 885/1850] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:28.982143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a7b7a181-420d-4739-ad1f-0e114276e066 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:28.983157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a7b7a181-420d-4739-ad1f-0e114276e066 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:28.992469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7b7a181-420d-4739-ad1f-0e114276e066 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:28.993604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7b7a181-420d-4739-ad1f-0e114276e066 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:28.995111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7b7a181-420d-4739-ad1f-0e114276e066 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:28.997761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7b7a181-420d-4739-ad1f-0e114276e066 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:28.998255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7b7a181-420d-4739-ad1f-0e114276e066 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:28.998698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7b7a181-420d-4739-ad1f-0e114276e066 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:29.202763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a7b7a181-420d-4739-ad1f-0e114276e066 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:29.214914 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a7b7a181-420d-4739-ad1f-0e114276e066 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1313 microversion: 2.1 time: 0.238508 Sep 08 12:47:29.216356 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 886/1851] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:28 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:29.223733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e2915843-b98c-438e-9d35-1dfbbeb3d77a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f2413a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:30.149470 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c9ea5b52-1668-4192-a7f5-791652eff701 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 204 len: 0 microversion: 2.1 time: 1.450896 Sep 08 12:47:30.150427 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 966/1852] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:28 2022] DELETE /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 0 bytes in 1458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:30.160332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e96dc330-bc06-4178-b867-a20ce29c8551 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:30.165214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e96dc330-bc06-4178-b867-a20ce29c8551 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:30.188987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e96dc330-bc06-4178-b867-a20ce29c8551 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:30.197263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e96dc330-bc06-4178-b867-a20ce29c8551 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:30.198498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e96dc330-bc06-4178-b867-a20ce29c8551 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:30.201152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e96dc330-bc06-4178-b867-a20ce29c8551 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:30.203879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e96dc330-bc06-4178-b867-a20ce29c8551 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:30.207126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e96dc330-bc06-4178-b867-a20ce29c8551 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:30.287933 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e2915843-b98c-438e-9d35-1dfbbeb3d77a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "DELETE /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b" status: 204 len: 0 microversion: 2.1 time: 1.069125 Sep 08 12:47:30.288960 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 887/1853] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:29 2022] DELETE /compute/v2.1/images/1daeb8f5-76c0-48b2-83ae-01c073e0989b => generated 0 bytes in 1071 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:30.330980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-87c89261-d754-46bc-9d1f-dc87126313c3 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:30.336668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-87c89261-d754-46bc-9d1f-dc87126313c3 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:30.367293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87c89261-d754-46bc-9d1f-dc87126313c3 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:30.368085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87c89261-d754-46bc-9d1f-dc87126313c3 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:30.369083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87c89261-d754-46bc-9d1f-dc87126313c3 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:30.382865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87c89261-d754-46bc-9d1f-dc87126313c3 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:30.384332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87c89261-d754-46bc-9d1f-dc87126313c3 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:30.385134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87c89261-d754-46bc-9d1f-dc87126313c3 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:30.722773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-87c89261-d754-46bc-9d1f-dc87126313c3 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d18d15099442da8c0924f402b03ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793c739b689c423cb09af2ce731ac899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:30.749423 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-87c89261-d754-46bc-9d1f-dc87126313c3 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 200 len: 1681 microversion: 2.1 time: 0.458721 Sep 08 12:47:30.756730 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 888/1854] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:30 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 1681 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:30.768199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:30.769391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:30.806747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:30.807665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:30.808436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:30.809750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:30.817821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:30.826306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:30.978218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:30.989557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:30.990030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:30.990513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lazy-loading 'fault' on Instance uuid 8df21d92-5b95-485a-9eb0-9896f885a1d2 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:47:31.193230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:31.206329 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5e535f42-24ad-44f8-adba-95721c7fe5e2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 200 len: 1315 microversion: 2.1 time: 0.445684 Sep 08 12:47:31.207468 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 889/1855] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:30 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:31.221374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:31.222387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:31.244131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:31.245224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:31.245774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:31.246660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:31.247754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:31.254244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:31.325158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:31.326484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:31.327108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:31.327782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lazy-loading 'fault' on Instance uuid 62d483e1-ee86-4c2f-ae5a-d14ad8686dea {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:47:31.393458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e96dc330-bc06-4178-b867-a20ce29c8551 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:31.411025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e96dc330-bc06-4178-b867-a20ce29c8551 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:31.415972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e96dc330-bc06-4178-b867-a20ce29c8551 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:31.419489 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e96dc330-bc06-4178-b867-a20ce29c8551 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1293 microversion: 2.25 time: 1.266089 Sep 08 12:47:31.421852 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 967/1856] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:30 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1293 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:31.450809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ee8b72fb-2ba7-4fb5-b3de-2a9d843f84eb req-675d77c9-2efb-4449-9fe1-256a43465857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f", "name": "network-vif-plugged", "status": "completed", "tag": "e368f8a1-84db-49b8-b146-dd5064ae7f33"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:31.496391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:31.497413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ee8b72fb-2ba7-4fb5-b3de-2a9d843f84eb req-675d77c9-2efb-4449-9fe1-256a43465857 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:31.497918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ee8b72fb-2ba7-4fb5-b3de-2a9d843f84eb req-675d77c9-2efb-4449-9fe1-256a43465857 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:31.498364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ee8b72fb-2ba7-4fb5-b3de-2a9d843f84eb req-675d77c9-2efb-4449-9fe1-256a43465857 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:31.502279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:31.515065 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7258bb5c-5d9c-4ae4-928b-f436fde7be7b tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 200 len: 1323 microversion: 2.1 time: 0.305184 Sep 08 12:47:31.534827 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ee8b72fb-2ba7-4fb5-b3de-2a9d843f84eb req-675d77c9-2efb-4449-9fe1-256a43465857 service nova] Creating event network-vif-plugged:e368f8a1-84db-49b8-b146-dd5064ae7f33 for instance 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f on n-h1-852084-10 Sep 08 12:47:31.543688 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ee8b72fb-2ba7-4fb5-b3de-2a9d843f84eb req-675d77c9-2efb-4449-9fe1-256a43465857 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119125 Sep 08 12:47:31.547533 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 890/1857] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:31 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 1323 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:31.548021 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 968/1858] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:31.553338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7fb11a1c-7732-4971-ae07-2a8a4908f7c3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:31.553880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7fb11a1c-7732-4971-ae07-2a8a4908f7c3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:31.560298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b365aa9-429f-4d94-a886-b0c1591d17a6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:31.561606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7b365aa9-429f-4d94-a886-b0c1591d17a6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:31.571795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:31.584010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fb11a1c-7732-4971-ae07-2a8a4908f7c3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:31.586019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fb11a1c-7732-4971-ae07-2a8a4908f7c3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:31.587588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fb11a1c-7732-4971-ae07-2a8a4908f7c3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:31.589396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fb11a1c-7732-4971-ae07-2a8a4908f7c3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:31.590220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b365aa9-429f-4d94-a886-b0c1591d17a6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:31.590724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b365aa9-429f-4d94-a886-b0c1591d17a6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:31.591166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b365aa9-429f-4d94-a886-b0c1591d17a6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:31.591987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b365aa9-429f-4d94-a886-b0c1591d17a6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:31.592452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b365aa9-429f-4d94-a886-b0c1591d17a6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:31.592881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b365aa9-429f-4d94-a886-b0c1591d17a6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:31.594078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fb11a1c-7732-4971-ae07-2a8a4908f7c3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:31.595029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fb11a1c-7732-4971-ae07-2a8a4908f7c3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:31.664148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7fb11a1c-7732-4971-ae07-2a8a4908f7c3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:47:31.871260 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7fb11a1c-7732-4971-ae07-2a8a4908f7c3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 204 len: 0 microversion: 2.1 time: 0.321742 Sep 08 12:47:31.872839 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 891/1859] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:47:31 2022] DELETE /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:31.896713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-40a5b541-09e6-460d-a7c8-247791d89a00 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:31.901253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-40a5b541-09e6-460d-a7c8-247791d89a00 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:31.920005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40a5b541-09e6-460d-a7c8-247791d89a00 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:31.920993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40a5b541-09e6-460d-a7c8-247791d89a00 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:31.921793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40a5b541-09e6-460d-a7c8-247791d89a00 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:31.924085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40a5b541-09e6-460d-a7c8-247791d89a00 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:31.926573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40a5b541-09e6-460d-a7c8-247791d89a00 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:31.930091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40a5b541-09e6-460d-a7c8-247791d89a00 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:31.992045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-40a5b541-09e6-460d-a7c8-247791d89a00 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:47:32.014715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b365aa9-429f-4d94-a886-b0c1591d17a6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:32.023408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:32.055251 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7b365aa9-429f-4d94-a886-b0c1591d17a6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1313 microversion: 2.1 time: 0.502800 Sep 08 12:47:32.061771 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 969/1860] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:31 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1313 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:32.082662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f417bdee-8ec1-4e83-ab67-a2b8985e05ed req-c12d9834-cc1c-4b71-92ec-b1a35baec937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62d483e1-ee86-4c2f-ae5a-d14ad8686dea", "name": "network-vif-deleted", "tag": "7c4cd857-97b7-4ae8-994c-544ea60d027c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:32.140350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f417bdee-8ec1-4e83-ab67-a2b8985e05ed req-c12d9834-cc1c-4b71-92ec-b1a35baec937 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:32.143903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f417bdee-8ec1-4e83-ab67-a2b8985e05ed req-c12d9834-cc1c-4b71-92ec-b1a35baec937 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:32.147250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f417bdee-8ec1-4e83-ab67-a2b8985e05ed req-c12d9834-cc1c-4b71-92ec-b1a35baec937 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:32.175810 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f417bdee-8ec1-4e83-ab67-a2b8985e05ed req-c12d9834-cc1c-4b71-92ec-b1a35baec937 service nova] Creating event network-vif-deleted:7c4cd857-97b7-4ae8-994c-544ea60d027c for instance 62d483e1-ee86-4c2f-ae5a-d14ad8686dea on n-h1-852084-10 Sep 08 12:47:32.208210 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f417bdee-8ec1-4e83-ab67-a2b8985e05ed req-c12d9834-cc1c-4b71-92ec-b1a35baec937 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141733 Sep 08 12:47:32.211415 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 970/1861] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:32.225276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-496dcb47-45b6-4fee-b146-c450f8d40cf5 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:32.227834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-496dcb47-45b6-4fee-b146-c450f8d40cf5 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:32.244587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:32.248468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-496dcb47-45b6-4fee-b146-c450f8d40cf5 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:32.249627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-496dcb47-45b6-4fee-b146-c450f8d40cf5 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:32.250603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-496dcb47-45b6-4fee-b146-c450f8d40cf5 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:32.252498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-496dcb47-45b6-4fee-b146-c450f8d40cf5 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:32.260684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-496dcb47-45b6-4fee-b146-c450f8d40cf5 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:32.261938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-496dcb47-45b6-4fee-b146-c450f8d40cf5 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:32.399160 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-40a5b541-09e6-460d-a7c8-247791d89a00 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 204 len: 0 microversion: 2.1 time: 0.520000 Sep 08 12:47:32.400783 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 892/1862] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:47:31 2022] DELETE /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:32.415514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f5b055b3-2c2d-4df2-89ea-0566323c34ba tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:32.416596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f5b055b3-2c2d-4df2-89ea-0566323c34ba tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:32.432138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5b055b3-2c2d-4df2-89ea-0566323c34ba tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:32.433015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5b055b3-2c2d-4df2-89ea-0566323c34ba tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:32.433752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5b055b3-2c2d-4df2-89ea-0566323c34ba tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:32.435014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5b055b3-2c2d-4df2-89ea-0566323c34ba tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:32.436468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5b055b3-2c2d-4df2-89ea-0566323c34ba tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:32.437296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5b055b3-2c2d-4df2-89ea-0566323c34ba tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:32.445865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-496dcb47-45b6-4fee-b146-c450f8d40cf5 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77d18d15099442da8c0924f402b03ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '793c739b689c423cb09af2ce731ac899', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:32.467841 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-496dcb47-45b6-4fee-b146-c450f8d40cf5 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 200 len: 1613 microversion: 2.1 time: 0.254115 Sep 08 12:47:32.468929 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 971/1863] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:32 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 1613 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:32.474724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-671029402", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "58f4da24-cf42-4565-9c74-ba91eb9335e3"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:32.493424 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-f5b055b3-2c2d-4df2-89ea-0566323c34ba tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] HTTP exception thrown: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f5b055b3-2c2d-4df2-89ea-0566323c34ba tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 HTTP/1.1 Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:47:32.495931 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:47:32.497673 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:32.497673 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:47:32.497673 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:47:32.497673 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:47:32.497673 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:47:32.497673 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:47:32.497673 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:47:32.497673 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:47:32.497673 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:47:32.497673 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:47:32.497673 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:47:32.497673 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '8df21d92-5b95-485a-9eb0-9896f885a1d2'} Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:32.498665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:47:32.500707 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:32.504345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f5b055b3-2c2d-4df2-89ea-0566323c34ba tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 404 to user: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:32.506875 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f5b055b3-2c2d-4df2-89ea-0566323c34ba tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 404 len: 111 microversion: 2.1 time: 0.104169 Sep 08 12:47:32.511683 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 893/1864] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:32 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:47:32.519189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9b4d9a8e-8f8e-4845-8db4-f7df77ff5f40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:32.522338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9b4d9a8e-8f8e-4845-8db4-f7df77ff5f40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:32.562904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4d9a8e-8f8e-4845-8db4-f7df77ff5f40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:32.564811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4d9a8e-8f8e-4845-8db4-f7df77ff5f40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:32.565496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4d9a8e-8f8e-4845-8db4-f7df77ff5f40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:32.568240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4d9a8e-8f8e-4845-8db4-f7df77ff5f40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:32.571750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4d9a8e-8f8e-4845-8db4-f7df77ff5f40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:32.573513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4d9a8e-8f8e-4845-8db4-f7df77ff5f40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:32.622820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] validate_networks() for [('58f4da24-cf42-4565-9c74-ba91eb9335e3', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:47:33.278686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9b4d9a8e-8f8e-4845-8db4-f7df77ff5f40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:33.317937 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9b4d9a8e-8f8e-4845-8db4-f7df77ff5f40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1473 microversion: 2.1 time: 0.803843 Sep 08 12:47:33.319046 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 894/1865] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:32 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1473 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:33.336762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-47828323-18a1-4df8-8912-970d8f7a20d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:33.340391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-47828323-18a1-4df8-8912-970d8f7a20d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:33.369452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47828323-18a1-4df8-8912-970d8f7a20d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:33.371204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47828323-18a1-4df8-8912-970d8f7a20d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:33.372342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47828323-18a1-4df8-8912-970d8f7a20d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:33.374324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47828323-18a1-4df8-8912-970d8f7a20d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:33.375460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47828323-18a1-4df8-8912-970d8f7a20d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:33.376246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47828323-18a1-4df8-8912-970d8f7a20d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:33.940439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-47828323-18a1-4df8-8912-970d8f7a20d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:33.950374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-47828323-18a1-4df8-8912-970d8f7a20d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:33.952482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-47828323-18a1-4df8-8912-970d8f7a20d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:33.953770 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-47828323-18a1-4df8-8912-970d8f7a20d6 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1293 microversion: 2.25 time: 0.629957 Sep 08 12:47:33.955023 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 895/1866] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:33 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1293 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:33.961927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d509e23b-1b21-4105-85da-99f084ac7479 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:33.963104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d509e23b-1b21-4105-85da-99f084ac7479 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 62d483e1-ee86-4c2f-ae5a-d14ad8686dea] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:33.970627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d509e23b-1b21-4105-85da-99f084ac7479 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:33.971502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d509e23b-1b21-4105-85da-99f084ac7479 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:33.972147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d509e23b-1b21-4105-85da-99f084ac7479 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:33.973094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d509e23b-1b21-4105-85da-99f084ac7479 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:33.973751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d509e23b-1b21-4105-85da-99f084ac7479 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:33.974355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d509e23b-1b21-4105-85da-99f084ac7479 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:34.000420 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-d509e23b-1b21-4105-85da-99f084ac7479 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] HTTP exception thrown: Instance 62d483e1-ee86-4c2f-ae5a-d14ad8686dea could not be found. Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d509e23b-1b21-4105-85da-99f084ac7479 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Request method failure captured: Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea HTTP/1.1 Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeJTMqPa7Ox420kmLjhrbQ0GKrdd3PpmBcQEwzR2mf0k9d5_yUK865nxvW5TZ2E2qxSCm44uLNvniKzHl8CNvjYUFj-lOpWJAo9d2s7mUa6RFf4kWAgJVjRciMtpxzCJtCNmAYP8Xv0uw0-8w8iT894sF3AaSeFK9vg_Hov39YlQFGc Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 5619e927afd449c4897bd41f96390988 Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-LiveMigrationTest-297167026 Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:47:34.002394 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:47:34.004771 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5619e927afd449c4897bd41f96390988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5619e927afd449c4897bd41f96390988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5619e927afd449c4897bd41f96390988"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5619e927afd449c4897bd41f96390988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:34.004771 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-LiveMigrationTest-297167026 Sep 08 12:47:34.004771 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 5619e927afd449c4897bd41f96390988 Sep 08 12:47:34.004771 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-LiveMigrationTest-297167026 Sep 08 12:47:34.004771 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-LiveMigrationTest-297167026-project Sep 08 12:47:34.004771 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:47:34.004771 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:47:34.004771 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: c7375a1da7fb43d8a6725f61fa2c7ec9 Sep 08 12:47:34.004771 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-LiveMigrationTest-297167026-project Sep 08 12:47:34.004771 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:47:34.004771 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 62d483e1-ee86-4c2f-ae5a-d14ad8686dea could not be found. Sep 08 12:47:34.004771 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '62d483e1-ee86-4c2f-ae5a-d14ad8686dea'} Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 62d483e1-ee86-4c2f-ae5a-d14ad8686dea could not be found. Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:34.005977 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 62d483e1-ee86-4c2f-ae5a-d14ad8686dea could not be found. Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 62d483e1-ee86-4c2f-ae5a-d14ad8686dea could not be found. Sep 08 12:47:34.007976 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:47:34.009809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d509e23b-1b21-4105-85da-99f084ac7479 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Returning 404 to user: Instance 62d483e1-ee86-4c2f-ae5a-d14ad8686dea could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:34.009809 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d509e23b-1b21-4105-85da-99f084ac7479 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea" status: 404 len: 111 microversion: 2.1 time: 0.051833 Sep 08 12:47:34.015211 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 896/1867] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:33 2022] GET /compute/v2.1/servers/62d483e1-ee86-4c2f-ae5a-d14ad8686dea => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:47:34.024015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-358442669", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:34.112986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] validate_networks() for [('9176055f-8b84-428f-a7d5-ad0c21b3939e', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:47:34.955300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:47:34.955300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:47:34.955300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:47:34.955300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:47:34.956950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:47:34.976972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:34.978828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:34.981684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:34.981684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:34.984748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:34.985589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:35.037944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Getting quotas for project c486d69d062749c7b334423a3a89cc13. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:47:35.045243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Getting quotas for user b1900295263741188d26b49e7e8b4036 and project c486d69d062749c7b334423a3a89cc13. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:47:35.063828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:47:35.067393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:47:35.152837 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ac5e5e63-346e-4261-b46d-9282cb855026 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.681565 Sep 08 12:47:35.167323 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 972/1868] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:47:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:47:35.178293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8237406f-241c-4a08-be58-eac40c726a4c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:35.180545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8237406f-241c-4a08-be58-eac40c726a4c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:35.193729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8237406f-241c-4a08-be58-eac40c726a4c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:35.195053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8237406f-241c-4a08-be58-eac40c726a4c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:35.196182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8237406f-241c-4a08-be58-eac40c726a4c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:35.198614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8237406f-241c-4a08-be58-eac40c726a4c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:35.200166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8237406f-241c-4a08-be58-eac40c726a4c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:35.202564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8237406f-241c-4a08-be58-eac40c726a4c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:35.653064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:47:35.654279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:47:35.655504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:47:35.656425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:47:35.657627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:47:35.729863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:35.734900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:35.737773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:35.741858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:35.744390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:35.748322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:35.757778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8237406f-241c-4a08-be58-eac40c726a4c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:35.768385 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8237406f-241c-4a08-be58-eac40c726a4c tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1497 microversion: 2.1 time: 0.598706 Sep 08 12:47:35.773631 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 973/1869] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:35 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1497 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:35.799337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-92029bea-e5e6-41dc-95de-c852a052de3c tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:35.802290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-92029bea-e5e6-41dc-95de-c852a052de3c tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:35.821447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Getting quotas for project 501fb79cb7544fe4995bc7122c87dbad. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:47:35.832094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Getting quotas for user 2b96cccdfbf149fc880cb1dfb29d416a and project 501fb79cb7544fe4995bc7122c87dbad. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:47:35.836066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92029bea-e5e6-41dc-95de-c852a052de3c tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:35.840130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92029bea-e5e6-41dc-95de-c852a052de3c tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:35.843096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92029bea-e5e6-41dc-95de-c852a052de3c tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:35.846323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92029bea-e5e6-41dc-95de-c852a052de3c tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:35.850085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92029bea-e5e6-41dc-95de-c852a052de3c tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:35.852847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92029bea-e5e6-41dc-95de-c852a052de3c tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:35.872190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:47:35.876715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:47:35.898823 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-92029bea-e5e6-41dc-95de-c852a052de3c tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] HTTP exception thrown: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-92029bea-e5e6-41dc-95de-c852a052de3c tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Request method failure captured: Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 HTTP/1.1 Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeNqB1uk6QXOdWs1vRYV5ZPLhpsvTw3uL0j_Lb87B0OTDMhUOfJVNnXddQAx1LuUyiHj8Ecw98_i4_NeQNzo8hE_KYbLutZ1XuVdyZH3PWUXKvQJKWQ4JVlZREJ33AJ4arjnDXF235wCNbQghfMgUC8ORgA7WkgMCT907VPTc5rRurU Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 793c739b689c423cb09af2ce731ac899 Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1232294897 Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:47:35.922065 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:47:35.925705 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_793c739b689c423cb09af2ce731ac899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/793c739b689c423cb09af2ce731ac899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/793c739b689c423cb09af2ce731ac899"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/793c739b689c423cb09af2ce731ac899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:35.925705 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1232294897 Sep 08 12:47:35.925705 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 793c739b689c423cb09af2ce731ac899 Sep 08 12:47:35.925705 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1232294897 Sep 08 12:47:35.925705 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachSCSIVolumeTestJSON-1232294897-project Sep 08 12:47:35.925705 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:47:35.925705 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:47:35.925705 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 77d18d15099442da8c0924f402b03ff0 Sep 08 12:47:35.925705 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1232294897-project Sep 08 12:47:35.925705 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:47:35.925705 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:35.925705 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '64629c30-c7bd-49ef-b0dd-5e17ce9ade56'} Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:35.927727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:35.931636 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:35.942974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-92029bea-e5e6-41dc-95de-c852a052de3c tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Returning 404 to user: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:35.946351 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-92029bea-e5e6-41dc-95de-c852a052de3c tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 404 len: 111 microversion: 2.1 time: 0.169355 Sep 08 12:47:35.951706 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 974/1870] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:35 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:47:35.988972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-91f13215-d833-428e-8634-a4a2d4fd5aee req-e6b1eb1f-3dda-4ec2-bc89-2300ece3d5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0e4984-ae73-4066-af92-a105ea8c3f79", "name": "network-vif-unplugged", "status": "completed", "tag": "a5086897-e4a8-49d0-8a48-44dd1f183cd3"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:36.034471 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-04bbe449-b606-4bc5-9b20-1b38d7e1e238 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.017173 Sep 08 12:47:36.040487 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 897/1871] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:47:34 2022] POST /compute/v2.1/servers => generated 383 bytes in 2028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:47:36.043985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-91f13215-d833-428e-8634-a4a2d4fd5aee req-e6b1eb1f-3dda-4ec2-bc89-2300ece3d5d4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:36.044813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-91f13215-d833-428e-8634-a4a2d4fd5aee req-e6b1eb1f-3dda-4ec2-bc89-2300ece3d5d4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:36.045519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-91f13215-d833-428e-8634-a4a2d4fd5aee req-e6b1eb1f-3dda-4ec2-bc89-2300ece3d5d4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:36.065263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-25454361-2d53-4e5e-98ad-7ed27bcfb066 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '.version_select at 0x7fdb3a749790>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:36.119770 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-25454361-2d53-4e5e-98ad-7ed27bcfb066 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-24079275" status: 202 len: 0 microversion: 2.1 time: 0.075961 Sep 08 12:47:36.136115 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 898/1872] 10.222.0.78 () {58 vars in 1215 bytes} [Thu Sep 8 12:47:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-24079275 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:47:36.141222 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-91f13215-d833-428e-8634-a4a2d4fd5aee req-e6b1eb1f-3dda-4ec2-bc89-2300ece3d5d4 service nova] Creating event network-vif-unplugged:a5086897-e4a8-49d0-8a48-44dd1f183cd3 for instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 on n-h1-852084-10 Sep 08 12:47:36.149138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-305b3d4f-5bc7-4c8e-b3c1-af517cba28c5 req-72d55008-ee18-45fd-a17a-a6c342e5f479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64629c30-c7bd-49ef-b0dd-5e17ce9ade56", "name": "network-vif-deleted", "tag": "60fbb237-266e-49a4-bd28-6c90c3640508"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:36.191921 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-91f13215-d833-428e-8634-a4a2d4fd5aee req-e6b1eb1f-3dda-4ec2-bc89-2300ece3d5d4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.236995 Sep 08 12:47:36.196367 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 975/1873] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:36.204917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-305b3d4f-5bc7-4c8e-b3c1-af517cba28c5 req-72d55008-ee18-45fd-a17a-a6c342e5f479 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:36.205486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-305b3d4f-5bc7-4c8e-b3c1-af517cba28c5 req-72d55008-ee18-45fd-a17a-a6c342e5f479 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:36.209402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-305b3d4f-5bc7-4c8e-b3c1-af517cba28c5 req-72d55008-ee18-45fd-a17a-a6c342e5f479 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:36.212503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be31d224-d820-4a2e-b0b0-98970b0a5489 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:36.215009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-be31d224-d820-4a2e-b0b0-98970b0a5489 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:36.231996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be31d224-d820-4a2e-b0b0-98970b0a5489 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:36.233560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be31d224-d820-4a2e-b0b0-98970b0a5489 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:36.235744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be31d224-d820-4a2e-b0b0-98970b0a5489 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:36.238276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be31d224-d820-4a2e-b0b0-98970b0a5489 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:36.239839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be31d224-d820-4a2e-b0b0-98970b0a5489 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:36.241043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be31d224-d820-4a2e-b0b0-98970b0a5489 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:36.245616 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-305b3d4f-5bc7-4c8e-b3c1-af517cba28c5 req-72d55008-ee18-45fd-a17a-a6c342e5f479 service nova] Creating event network-vif-deleted:60fbb237-266e-49a4-bd28-6c90c3640508 for instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 on n-h1-852084-10 Sep 08 12:47:36.271282 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-305b3d4f-5bc7-4c8e-b3c1-af517cba28c5 req-72d55008-ee18-45fd-a17a-a6c342e5f479 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133436 Sep 08 12:47:36.280386 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 899/1874] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:36.316271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-808d5ef9-1546-4fa6-92af-c856789d1b8b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:36.325067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-808d5ef9-1546-4fa6-92af-c856789d1b8b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:36.359868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-808d5ef9-1546-4fa6-92af-c856789d1b8b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:36.362888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-808d5ef9-1546-4fa6-92af-c856789d1b8b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:36.368206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-808d5ef9-1546-4fa6-92af-c856789d1b8b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:36.368987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-808d5ef9-1546-4fa6-92af-c856789d1b8b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:36.371727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-808d5ef9-1546-4fa6-92af-c856789d1b8b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:36.376088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-808d5ef9-1546-4fa6-92af-c856789d1b8b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:36.788560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-be31d224-d820-4a2e-b0b0-98970b0a5489 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:36.827383 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-be31d224-d820-4a2e-b0b0-98970b0a5489 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1302 microversion: 2.1 time: 0.619585 Sep 08 12:47:36.830095 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 976/1875] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:36 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1302 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:36.851750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e7b265d-43e8-489d-a80d-3690dcbac25c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:36.854904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2e7b265d-43e8-489d-a80d-3690dcbac25c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:36.883265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e7b265d-43e8-489d-a80d-3690dcbac25c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:36.886645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e7b265d-43e8-489d-a80d-3690dcbac25c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:36.888154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e7b265d-43e8-489d-a80d-3690dcbac25c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:36.891879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e7b265d-43e8-489d-a80d-3690dcbac25c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:36.892981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e7b265d-43e8-489d-a80d-3690dcbac25c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:36.896880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e7b265d-43e8-489d-a80d-3690dcbac25c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:37.045729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-808d5ef9-1546-4fa6-92af-c856789d1b8b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:37.059935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-808d5ef9-1546-4fa6-92af-c856789d1b8b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:37.068035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-808d5ef9-1546-4fa6-92af-c856789d1b8b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:37.071494 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-808d5ef9-1546-4fa6-92af-c856789d1b8b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1281 microversion: 2.25 time: 0.775691 Sep 08 12:47:37.076598 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 900/1876] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:36 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1281 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:37.100156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bc99919a-c06e-4cef-b75f-484851ad6e93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:37.103812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bc99919a-c06e-4cef-b75f-484851ad6e93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:37.117630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc99919a-c06e-4cef-b75f-484851ad6e93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:37.118570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc99919a-c06e-4cef-b75f-484851ad6e93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:37.120792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc99919a-c06e-4cef-b75f-484851ad6e93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:37.121875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc99919a-c06e-4cef-b75f-484851ad6e93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:37.124355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc99919a-c06e-4cef-b75f-484851ad6e93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:37.125235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc99919a-c06e-4cef-b75f-484851ad6e93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:37.138297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2e7b265d-43e8-489d-a80d-3690dcbac25c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:37.172890 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2e7b265d-43e8-489d-a80d-3690dcbac25c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1203 microversion: 2.1 time: 0.338709 Sep 08 12:47:37.179110 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 977/1877] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:36 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1203 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:37.199690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-73d8ecee-b9c1-439a-86ca-8a42f2d70083 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '.version_select at 0x7fdb36b64040>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:37.208834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-bc99919a-c06e-4cef-b75f-484851ad6e93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lazy-loading 'flavor' on Instance uuid 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:47:37.247090 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-73d8ecee-b9c1-439a-86ca-8a42f2d70083 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-867829672" status: 202 len: 0 microversion: 2.1 time: 0.066302 Sep 08 12:47:37.247801 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 978/1878] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 12:47:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-867829672 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:47:37.267913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2f808624-632b-4c14-8f18-f60f2e3a3b1f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:37.268723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2f808624-632b-4c14-8f18-f60f2e3a3b1f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:37.399089 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bc99919a-c06e-4cef-b75f-484851ad6e93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "POST /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f/action" status: 200 len: 32 microversion: 2.1 time: 0.319754 Sep 08 12:47:37.400567 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 901/1879] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:47:37 2022] POST /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f/action => generated 32 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:47:37.407918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7f979c4a-592f-4cc5-958a-dddf7b3d8f70 req-2595b1f9-270b-4869-b37a-26ced18e3ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3390d320-1b6f-4e3a-8f99-fff7b4e179a4", "name": "network-vif-deleted", "tag": "ed71639b-831f-4e95-b890-50fca7bd47bf"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:37.433766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7f979c4a-592f-4cc5-958a-dddf7b3d8f70 req-2595b1f9-270b-4869-b37a-26ced18e3ca8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:37.435424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7f979c4a-592f-4cc5-958a-dddf7b3d8f70 req-2595b1f9-270b-4869-b37a-26ced18e3ca8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:37.436654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7f979c4a-592f-4cc5-958a-dddf7b3d8f70 req-2595b1f9-270b-4869-b37a-26ced18e3ca8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:37.456010 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7f979c4a-592f-4cc5-958a-dddf7b3d8f70 req-2595b1f9-270b-4869-b37a-26ced18e3ca8 service nova] Creating event network-vif-deleted:ed71639b-831f-4e95-b890-50fca7bd47bf for instance 3390d320-1b6f-4e3a-8f99-fff7b4e179a4 on n-h2-852084-10 Sep 08 12:47:37.464250 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7f979c4a-592f-4cc5-958a-dddf7b3d8f70 req-2595b1f9-270b-4869-b37a-26ced18e3ca8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061426 Sep 08 12:47:37.466533 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 902/1880] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:37.473905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-255329fe-974a-4df3-b933-55f1caae71d4 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:37.475394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-255329fe-974a-4df3-b933-55f1caae71d4 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:37.497485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-255329fe-974a-4df3-b933-55f1caae71d4 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:37.498339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-255329fe-974a-4df3-b933-55f1caae71d4 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:37.499086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-255329fe-974a-4df3-b933-55f1caae71d4 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:37.500556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-255329fe-974a-4df3-b933-55f1caae71d4 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:37.501595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2f808624-632b-4c14-8f18-f60f2e3a3b1f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:37.501909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-255329fe-974a-4df3-b933-55f1caae71d4 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:37.504188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-255329fe-974a-4df3-b933-55f1caae71d4 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:37.537429 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2f808624-632b-4c14-8f18-f60f2e3a3b1f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1224 microversion: 2.1 time: 0.283287 Sep 08 12:47:37.552854 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 979/1881] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:37 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1224 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:37.860291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:37.863437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:37.893612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:37.894197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:37.894648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:37.895427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:37.895888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:37.901441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:37.960364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:37.961419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:37.961419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:37.961851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lazy-loading 'fault' on Instance uuid 3390d320-1b6f-4e3a-8f99-fff7b4e179a4 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:47:38.099655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-255329fe-974a-4df3-b933-55f1caae71d4 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:38.132665 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-255329fe-974a-4df3-b933-55f1caae71d4 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1503 microversion: 2.1 time: 0.664003 Sep 08 12:47:38.139715 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 903/1882] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:37 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1503 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:38.148436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:38.168285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b36b413f-dee0-45d0-88e9-aa85dde73c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:38.169803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b36b413f-dee0-45d0-88e9-aa85dde73c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:38.182151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b36b413f-dee0-45d0-88e9-aa85dde73c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:38.185536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b36b413f-dee0-45d0-88e9-aa85dde73c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:38.187526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b36b413f-dee0-45d0-88e9-aa85dde73c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:38.189255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b36b413f-dee0-45d0-88e9-aa85dde73c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:38.191432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b36b413f-dee0-45d0-88e9-aa85dde73c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:38.207074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b36b413f-dee0-45d0-88e9-aa85dde73c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:38.210167 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00a06eaa-3e18-46e3-960b-7d79164d7a03 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 200 len: 1307 microversion: 2.1 time: 0.352930 Sep 08 12:47:38.219908 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 980/1883] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:37 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 1307 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:38.246014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-269192b7-7495-4c1c-b1dd-d8636250ee3c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:38.249253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-269192b7-7495-4c1c-b1dd-d8636250ee3c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:38.274366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-269192b7-7495-4c1c-b1dd-d8636250ee3c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:38.275422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-269192b7-7495-4c1c-b1dd-d8636250ee3c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:38.276539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-269192b7-7495-4c1c-b1dd-d8636250ee3c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:38.278456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-269192b7-7495-4c1c-b1dd-d8636250ee3c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:38.282969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-269192b7-7495-4c1c-b1dd-d8636250ee3c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:38.286336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-269192b7-7495-4c1c-b1dd-d8636250ee3c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:38.500389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-269192b7-7495-4c1c-b1dd-d8636250ee3c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:38.532422 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-269192b7-7495-4c1c-b1dd-d8636250ee3c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1259 microversion: 2.1 time: 0.310493 Sep 08 12:47:38.552466 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 981/1884] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:38 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1259 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:38.563427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d9060d33-e729-4a58-b167-23765301dd6d req-02a0a4c7-c2e8-4bbb-9411-cabfa28fc853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f0e4984-ae73-4066-af92-a105ea8c3f79", "name": "network-vif-deleted", "tag": "a5086897-e4a8-49d0-8a48-44dd1f183cd3"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:38.589918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d9060d33-e729-4a58-b167-23765301dd6d req-02a0a4c7-c2e8-4bbb-9411-cabfa28fc853 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:38.591393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d9060d33-e729-4a58-b167-23765301dd6d req-02a0a4c7-c2e8-4bbb-9411-cabfa28fc853 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:38.592495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d9060d33-e729-4a58-b167-23765301dd6d req-02a0a4c7-c2e8-4bbb-9411-cabfa28fc853 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:38.606414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b36b413f-dee0-45d0-88e9-aa85dde73c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:38.621516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b36b413f-dee0-45d0-88e9-aa85dde73c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:38.625802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b36b413f-dee0-45d0-88e9-aa85dde73c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:38.627167 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b36b413f-dee0-45d0-88e9-aa85dde73c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1281 microversion: 2.25 time: 0.485579 Sep 08 12:47:38.628501 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d9060d33-e729-4a58-b167-23765301dd6d req-02a0a4c7-c2e8-4bbb-9411-cabfa28fc853 service nova] Creating event network-vif-deleted:a5086897-e4a8-49d0-8a48-44dd1f183cd3 for instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 on n-h1-852084-10 Sep 08 12:47:38.635694 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 904/1885] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:38 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1281 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:38.645568 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d9060d33-e729-4a58-b167-23765301dd6d req-02a0a4c7-c2e8-4bbb-9411-cabfa28fc853 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088153 Sep 08 12:47:38.645936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-10d54f79-39df-4c3c-b018-1fb6f31ac788 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:38.645936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-10d54f79-39df-4c3c-b018-1fb6f31ac788 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:38.650076 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 982/1886] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:38.660716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10d54f79-39df-4c3c-b018-1fb6f31ac788 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:38.661276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10d54f79-39df-4c3c-b018-1fb6f31ac788 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:38.661719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10d54f79-39df-4c3c-b018-1fb6f31ac788 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:38.662513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-01e077fc-28c8-44d0-9968-c616ebc7f33f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:38.662686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10d54f79-39df-4c3c-b018-1fb6f31ac788 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:38.663619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10d54f79-39df-4c3c-b018-1fb6f31ac788 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:38.664061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10d54f79-39df-4c3c-b018-1fb6f31ac788 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:38.665279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-01e077fc-28c8-44d0-9968-c616ebc7f33f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:38.678808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01e077fc-28c8-44d0-9968-c616ebc7f33f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:38.680350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01e077fc-28c8-44d0-9968-c616ebc7f33f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:38.681207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01e077fc-28c8-44d0-9968-c616ebc7f33f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:38.691724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01e077fc-28c8-44d0-9968-c616ebc7f33f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:38.691724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01e077fc-28c8-44d0-9968-c616ebc7f33f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:38.691724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01e077fc-28c8-44d0-9968-c616ebc7f33f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:38.815649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-10d54f79-39df-4c3c-b018-1fb6f31ac788 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:47:38.978580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:39.009719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-01e077fc-28c8-44d0-9968-c616ebc7f33f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:39.027551 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-01e077fc-28c8-44d0-9968-c616ebc7f33f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1220 microversion: 2.1 time: 0.375124 Sep 08 12:47:39.031981 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 983/1887] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:38 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1220 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:39.122618 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-10d54f79-39df-4c3c-b018-1fb6f31ac788 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 204 len: 0 microversion: 2.1 time: 0.484598 Sep 08 12:47:39.123760 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 905/1888] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:47:38 2022] DELETE /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:39.134580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-54e54507-e947-4037-b3e3-fefb47ff47ad tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:39.135657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-54e54507-e947-4037-b3e3-fefb47ff47ad tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:39.153081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54e54507-e947-4037-b3e3-fefb47ff47ad tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:39.155997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54e54507-e947-4037-b3e3-fefb47ff47ad tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:39.156754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54e54507-e947-4037-b3e3-fefb47ff47ad tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:39.157722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54e54507-e947-4037-b3e3-fefb47ff47ad tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:39.158502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54e54507-e947-4037-b3e3-fefb47ff47ad tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:39.159569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54e54507-e947-4037-b3e3-fefb47ff47ad tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:39.184861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f7c350c0-bb53-45ad-80bc-3c355a024767 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:39.185594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f7c350c0-bb53-45ad-80bc-3c355a024767 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:39.200742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7c350c0-bb53-45ad-80bc-3c355a024767 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:39.201356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7c350c0-bb53-45ad-80bc-3c355a024767 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:39.201806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7c350c0-bb53-45ad-80bc-3c355a024767 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:39.202569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7c350c0-bb53-45ad-80bc-3c355a024767 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:39.203029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7c350c0-bb53-45ad-80bc-3c355a024767 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:39.203491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7c350c0-bb53-45ad-80bc-3c355a024767 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:39.881520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-54e54507-e947-4037-b3e3-fefb47ff47ad tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:39.909916 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-54e54507-e947-4037-b3e3-fefb47ff47ad tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1483 microversion: 2.1 time: 0.780260 Sep 08 12:47:39.916567 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 984/1889] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:39 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1483 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:47:39.927900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3a30125b-3fc2-4b2d-a011-e14814f32b2a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:39.929440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3a30125b-3fc2-4b2d-a011-e14814f32b2a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 3390d320-1b6f-4e3a-8f99-fff7b4e179a4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:39.938589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a30125b-3fc2-4b2d-a011-e14814f32b2a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:39.939553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a30125b-3fc2-4b2d-a011-e14814f32b2a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:39.940290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a30125b-3fc2-4b2d-a011-e14814f32b2a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:39.941371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a30125b-3fc2-4b2d-a011-e14814f32b2a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:39.942091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a30125b-3fc2-4b2d-a011-e14814f32b2a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:39.942756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a30125b-3fc2-4b2d-a011-e14814f32b2a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:39.961781 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-3a30125b-3fc2-4b2d-a011-e14814f32b2a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] HTTP exception thrown: Instance 3390d320-1b6f-4e3a-8f99-fff7b4e179a4 could not be found. Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3a30125b-3fc2-4b2d-a011-e14814f32b2a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Request method failure captured: Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 HTTP/1.1 Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeOVcczwxUP80gWe_QTvjB9HAHZWEcInztHdW5UpWUZIRjVlSSfwKf2liAsy_LXRlyydx54Em5pZlDPPcQOhzjpGQqE5lSvGw0gapA6_7CJbKDrES15QvWcPV3XYIemvjKwcz_g9SS1-fHW0afOXjRiN3vf8mmcxca3e6Q6q77o9368 Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0907b16c3dc14e1da57160d1528ce871 Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ListImageFiltersTestJSON-557705461 Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:47:39.963717 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:47:39.965499 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0907b16c3dc14e1da57160d1528ce871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0907b16c3dc14e1da57160d1528ce871"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0907b16c3dc14e1da57160d1528ce871"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0907b16c3dc14e1da57160d1528ce871"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:39.965499 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ListImageFiltersTestJSON-557705461 Sep 08 12:47:39.965499 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0907b16c3dc14e1da57160d1528ce871 Sep 08 12:47:39.965499 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-557705461 Sep 08 12:47:39.965499 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ListImageFiltersTestJSON-557705461-project Sep 08 12:47:39.965499 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:47:39.965499 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:47:39.965499 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 17f8a317d282493493d44ceab17bbe23 Sep 08 12:47:39.965499 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ListImageFiltersTestJSON-557705461-project Sep 08 12:47:39.965499 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:47:39.965499 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 3390d320-1b6f-4e3a-8f99-fff7b4e179a4 could not be found. Sep 08 12:47:39.965499 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '3390d320-1b6f-4e3a-8f99-fff7b4e179a4'} Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3390d320-1b6f-4e3a-8f99-fff7b4e179a4 could not be found. Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:39.966559 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3390d320-1b6f-4e3a-8f99-fff7b4e179a4 could not be found. Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3390d320-1b6f-4e3a-8f99-fff7b4e179a4 could not be found. Sep 08 12:47:39.969518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:39.972341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3a30125b-3fc2-4b2d-a011-e14814f32b2a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Returning 404 to user: Instance 3390d320-1b6f-4e3a-8f99-fff7b4e179a4 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:39.973591 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3a30125b-3fc2-4b2d-a011-e14814f32b2a tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4" status: 404 len: 111 microversion: 2.1 time: 0.053499 Sep 08 12:47:39.978381 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 985/1890] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:39 2022] GET /compute/v2.1/servers/3390d320-1b6f-4e3a-8f99-fff7b4e179a4 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:47:39.993928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e160003d-bfc4-4469-911b-634b2b716710 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:39.994986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e160003d-bfc4-4469-911b-634b2b716710 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:39.995664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f7c350c0-bb53-45ad-80bc-3c355a024767 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:40.008209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e160003d-bfc4-4469-911b-634b2b716710 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:40.009113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e160003d-bfc4-4469-911b-634b2b716710 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:40.011450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e160003d-bfc4-4469-911b-634b2b716710 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:40.013560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e160003d-bfc4-4469-911b-634b2b716710 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:40.017223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e160003d-bfc4-4469-911b-634b2b716710 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:40.018242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e160003d-bfc4-4469-911b-634b2b716710 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:40.030310 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f7c350c0-bb53-45ad-80bc-3c355a024767 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1503 microversion: 2.1 time: 0.846578 Sep 08 12:47:40.033626 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 906/1891] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:39 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1503 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:47:40.079970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3d13d163-1a24-48af-bda9-63a2e80d1eb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:40.085197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3d13d163-1a24-48af-bda9-63a2e80d1eb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:40.101960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d13d163-1a24-48af-bda9-63a2e80d1eb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:40.103683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d13d163-1a24-48af-bda9-63a2e80d1eb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:40.110775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d13d163-1a24-48af-bda9-63a2e80d1eb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:40.113054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d13d163-1a24-48af-bda9-63a2e80d1eb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:40.114478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d13d163-1a24-48af-bda9-63a2e80d1eb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:40.116950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d13d163-1a24-48af-bda9-63a2e80d1eb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:40.154515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e160003d-bfc4-4469-911b-634b2b716710 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:40.168601 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e160003d-bfc4-4469-911b-634b2b716710 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1265 microversion: 2.1 time: 0.187129 Sep 08 12:47:40.172448 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 986/1892] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:39 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1265 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:40.193026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-93af9269-3372-451a-b0b3-d441fa7aee40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:40.193625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-93af9269-3372-451a-b0b3-d441fa7aee40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 810cd6cb-eab9-4427-aa03-597406fd20f6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:40.203995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93af9269-3372-451a-b0b3-d441fa7aee40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:40.206902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93af9269-3372-451a-b0b3-d441fa7aee40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:40.207522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93af9269-3372-451a-b0b3-d441fa7aee40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:40.210019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93af9269-3372-451a-b0b3-d441fa7aee40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:40.211578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93af9269-3372-451a-b0b3-d441fa7aee40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:40.212353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93af9269-3372-451a-b0b3-d441fa7aee40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:40.278306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-93af9269-3372-451a-b0b3-d441fa7aee40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 810cd6cb-eab9-4427-aa03-597406fd20f6] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:47:40.648168 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-93af9269-3372-451a-b0b3-d441fa7aee40 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "DELETE /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6" status: 204 len: 0 microversion: 2.1 time: 0.472137 Sep 08 12:47:40.649656 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 987/1893] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:47:40 2022] DELETE /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:40.693095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e1fe59d8-494c-4aed-8bfb-a49ce7b0b641 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:40.698758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e1fe59d8-494c-4aed-8bfb-a49ce7b0b641 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:40.733166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1fe59d8-494c-4aed-8bfb-a49ce7b0b641 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:40.739859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1fe59d8-494c-4aed-8bfb-a49ce7b0b641 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:40.741721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1fe59d8-494c-4aed-8bfb-a49ce7b0b641 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:40.743554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1fe59d8-494c-4aed-8bfb-a49ce7b0b641 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:40.746937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1fe59d8-494c-4aed-8bfb-a49ce7b0b641 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:40.753265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1fe59d8-494c-4aed-8bfb-a49ce7b0b641 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:41.130213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e1fe59d8-494c-4aed-8bfb-a49ce7b0b641 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:41.157700 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e1fe59d8-494c-4aed-8bfb-a49ce7b0b641 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1294 microversion: 2.1 time: 0.497194 Sep 08 12:47:41.164594 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 988/1894] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:40 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1294 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:41.183050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3d13d163-1a24-48af-bda9-63a2e80d1eb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:41.206914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3d13d163-1a24-48af-bda9-63a2e80d1eb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:41.207906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4b7b584d-5596-43ac-b80e-30a94bfcd6a0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:41.212305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3d13d163-1a24-48af-bda9-63a2e80d1eb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:41.212650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4b7b584d-5596-43ac-b80e-30a94bfcd6a0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 810cd6cb-eab9-4427-aa03-597406fd20f6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:41.215162 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3d13d163-1a24-48af-bda9-63a2e80d1eb8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1281 microversion: 2.25 time: 1.178791 Sep 08 12:47:41.217387 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 907/1895] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:40 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1281 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:41.243279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b7b584d-5596-43ac-b80e-30a94bfcd6a0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:41.245389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4cff1645-7219-49ba-a306-a2c89990ea14 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:41.246049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4cff1645-7219-49ba-a306-a2c89990ea14 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:41.252319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b7b584d-5596-43ac-b80e-30a94bfcd6a0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:41.253141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b7b584d-5596-43ac-b80e-30a94bfcd6a0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:41.254442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b7b584d-5596-43ac-b80e-30a94bfcd6a0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:41.262210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b7b584d-5596-43ac-b80e-30a94bfcd6a0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:41.263071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b7b584d-5596-43ac-b80e-30a94bfcd6a0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:41.274190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4cff1645-7219-49ba-a306-a2c89990ea14 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:41.275004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4cff1645-7219-49ba-a306-a2c89990ea14 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:41.276752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4cff1645-7219-49ba-a306-a2c89990ea14 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:41.278131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4cff1645-7219-49ba-a306-a2c89990ea14 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:41.281154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4cff1645-7219-49ba-a306-a2c89990ea14 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:41.281899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4cff1645-7219-49ba-a306-a2c89990ea14 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:42.357481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4cff1645-7219-49ba-a306-a2c89990ea14 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:42.378690 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4cff1645-7219-49ba-a306-a2c89990ea14 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 200 len: 1483 microversion: 2.1 time: 1.158936 Sep 08 12:47:42.381056 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 908/1896] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:41 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 1483 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:42.397887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-005f84b0-ef9a-4778-950a-9ddc628d7d1e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:42.401676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-005f84b0-ef9a-4778-950a-9ddc628d7d1e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:42.417646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-005f84b0-ef9a-4778-950a-9ddc628d7d1e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:42.418193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-005f84b0-ef9a-4778-950a-9ddc628d7d1e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:42.418721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-005f84b0-ef9a-4778-950a-9ddc628d7d1e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:42.419494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-005f84b0-ef9a-4778-950a-9ddc628d7d1e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:42.426369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-005f84b0-ef9a-4778-950a-9ddc628d7d1e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:42.427244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-005f84b0-ef9a-4778-950a-9ddc628d7d1e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:42.460912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4b7b584d-5596-43ac-b80e-30a94bfcd6a0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:42.510744 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4b7b584d-5596-43ac-b80e-30a94bfcd6a0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6" status: 200 len: 1473 microversion: 2.1 time: 1.338475 Sep 08 12:47:42.515513 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 989/1897] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:41 2022] GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6 => generated 1473 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:42.531569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dbadbb13-bce4-45bd-9935-3b85ef5cd3a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:42.542318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dbadbb13-bce4-45bd-9935-3b85ef5cd3a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:42.573034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dbadbb13-bce4-45bd-9935-3b85ef5cd3a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:42.580832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dbadbb13-bce4-45bd-9935-3b85ef5cd3a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:42.588217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dbadbb13-bce4-45bd-9935-3b85ef5cd3a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:42.589984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dbadbb13-bce4-45bd-9935-3b85ef5cd3a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:42.592361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dbadbb13-bce4-45bd-9935-3b85ef5cd3a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:42.598018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dbadbb13-bce4-45bd-9935-3b85ef5cd3a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:42.671025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:43.290246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-005f84b0-ef9a-4778-950a-9ddc628d7d1e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:43.327460 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-005f84b0-ef9a-4778-950a-9ddc628d7d1e tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1503 microversion: 2.1 time: 0.942334 Sep 08 12:47:43.332688 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 909/1898] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:42 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1503 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:43.372245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f4f77a2c-9b5a-4ed6-8756-1563214c1d9d req-22971473-43dd-42ae-8c7a-295866c818d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e528819-d8de-43e3-b477-698431023370", "name": "network-vif-deleted", "tag": "306af9a9-d6af-4544-81f3-b62d073c0839"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:43.425609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f4f77a2c-9b5a-4ed6-8756-1563214c1d9d req-22971473-43dd-42ae-8c7a-295866c818d7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:43.427398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f4f77a2c-9b5a-4ed6-8756-1563214c1d9d req-22971473-43dd-42ae-8c7a-295866c818d7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:43.429192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f4f77a2c-9b5a-4ed6-8756-1563214c1d9d req-22971473-43dd-42ae-8c7a-295866c818d7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:43.447653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dbadbb13-bce4-45bd-9935-3b85ef5cd3a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:43.488805 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dbadbb13-bce4-45bd-9935-3b85ef5cd3a9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1307 microversion: 2.1 time: 0.971127 Sep 08 12:47:43.492407 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f4f77a2c-9b5a-4ed6-8756-1563214c1d9d req-22971473-43dd-42ae-8c7a-295866c818d7 service nova] Creating event network-vif-deleted:306af9a9-d6af-4544-81f3-b62d073c0839 for instance 3e528819-d8de-43e3-b477-698431023370 on n-h1-852084-10 Sep 08 12:47:43.493095 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 990/1899] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:42 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1307 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:43.507302 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f4f77a2c-9b5a-4ed6-8756-1563214c1d9d req-22971473-43dd-42ae-8c7a-295866c818d7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171978 Sep 08 12:47:43.508241 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 910/1900] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:43.512577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e971f521-23af-45a1-80a0-bdccd6c0a173 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:43.519682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2380748b-c1d0-47ed-bbfc-e7c1e312b060 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:43.520392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e971f521-23af-45a1-80a0-bdccd6c0a173 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:43.520663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2380748b-c1d0-47ed-bbfc-e7c1e312b060 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:43.536951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2380748b-c1d0-47ed-bbfc-e7c1e312b060 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:43.537455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2380748b-c1d0-47ed-bbfc-e7c1e312b060 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:43.538524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2380748b-c1d0-47ed-bbfc-e7c1e312b060 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:43.539294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2380748b-c1d0-47ed-bbfc-e7c1e312b060 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:43.539923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2380748b-c1d0-47ed-bbfc-e7c1e312b060 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:43.540444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2380748b-c1d0-47ed-bbfc-e7c1e312b060 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:43.550793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e971f521-23af-45a1-80a0-bdccd6c0a173 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:43.552281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e971f521-23af-45a1-80a0-bdccd6c0a173 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:43.553939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e971f521-23af-45a1-80a0-bdccd6c0a173 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:43.558418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e971f521-23af-45a1-80a0-bdccd6c0a173 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:43.563016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e971f521-23af-45a1-80a0-bdccd6c0a173 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:43.564292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e971f521-23af-45a1-80a0-bdccd6c0a173 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:44.011697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e971f521-23af-45a1-80a0-bdccd6c0a173 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:44.039477 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e971f521-23af-45a1-80a0-bdccd6c0a173 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1282 microversion: 2.1 time: 0.544449 Sep 08 12:47:44.046182 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 991/1901] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:43 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1282 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:44.051533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-24b88c57-611b-48f8-a232-cd3a8a91a639 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:44.064236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-24b88c57-611b-48f8-a232-cd3a8a91a639 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: 3e528819-d8de-43e3-b477-698431023370] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:44.083859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24b88c57-611b-48f8-a232-cd3a8a91a639 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:44.087758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24b88c57-611b-48f8-a232-cd3a8a91a639 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:44.088513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24b88c57-611b-48f8-a232-cd3a8a91a639 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:44.096362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24b88c57-611b-48f8-a232-cd3a8a91a639 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:44.097657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24b88c57-611b-48f8-a232-cd3a8a91a639 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:44.108034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24b88c57-611b-48f8-a232-cd3a8a91a639 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:44.129574 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-24b88c57-611b-48f8-a232-cd3a8a91a639 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] HTTP exception thrown: Instance 3e528819-d8de-43e3-b477-698431023370 could not be found. Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-24b88c57-611b-48f8-a232-cd3a8a91a639 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Request method failure captured: Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 HTTP/1.1 Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJTMqPa7Ox420kmLjhrbQ0GKrdd3PpmBcQEwzR2mf0k9d5_yUK865nxvW5TZ2E2qxSCm44uLNvniKzHl8CNvjYUFj-lOpWJAo9d2s7mUa6RFf4kWAgJVjRciMtpxzCJtCNmAYP8Xv0uw0-8w8iT894sF3AaSeFK9vg_Hov39YlQFGc Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 5619e927afd449c4897bd41f96390988 Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-LiveMigrationTest-297167026 Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:47:44.135162 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:47:44.136954 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5619e927afd449c4897bd41f96390988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5619e927afd449c4897bd41f96390988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5619e927afd449c4897bd41f96390988"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5619e927afd449c4897bd41f96390988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:44.136954 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-LiveMigrationTest-297167026 Sep 08 12:47:44.136954 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 5619e927afd449c4897bd41f96390988 Sep 08 12:47:44.136954 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-LiveMigrationTest-297167026 Sep 08 12:47:44.136954 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-LiveMigrationTest-297167026-project Sep 08 12:47:44.136954 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:47:44.136954 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:47:44.136954 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: c7375a1da7fb43d8a6725f61fa2c7ec9 Sep 08 12:47:44.136954 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-LiveMigrationTest-297167026-project Sep 08 12:47:44.136954 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:47:44.136954 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 3e528819-d8de-43e3-b477-698431023370 could not be found. Sep 08 12:47:44.136954 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '3e528819-d8de-43e3-b477-698431023370'} Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e528819-d8de-43e3-b477-698431023370 could not be found. Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:44.137966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e528819-d8de-43e3-b477-698431023370 could not be found. Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e528819-d8de-43e3-b477-698431023370 could not be found. Sep 08 12:47:44.139571 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:44.148517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-24b88c57-611b-48f8-a232-cd3a8a91a639 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Returning 404 to user: Instance 3e528819-d8de-43e3-b477-698431023370 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:44.149733 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-24b88c57-611b-48f8-a232-cd3a8a91a639 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370" status: 404 len: 111 microversion: 2.1 time: 0.102249 Sep 08 12:47:44.152187 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 992/1902] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:44 2022] GET /compute/v2.1/servers/3e528819-d8de-43e3-b477-698431023370 => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:47:44.165963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0d37b2a1-ce00-45cc-8530-81ee91c2fe90 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:44.167090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0d37b2a1-ce00-45cc-8530-81ee91c2fe90 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 810cd6cb-eab9-4427-aa03-597406fd20f6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:44.184929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d37b2a1-ce00-45cc-8530-81ee91c2fe90 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:44.185735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d37b2a1-ce00-45cc-8530-81ee91c2fe90 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:44.186389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d37b2a1-ce00-45cc-8530-81ee91c2fe90 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:44.187403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d37b2a1-ce00-45cc-8530-81ee91c2fe90 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:44.188058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d37b2a1-ce00-45cc-8530-81ee91c2fe90 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:44.188664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d37b2a1-ce00-45cc-8530-81ee91c2fe90 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:44.860308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2380748b-c1d0-47ed-bbfc-e7c1e312b060 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:44.911157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2380748b-c1d0-47ed-bbfc-e7c1e312b060 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:44.924114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2380748b-c1d0-47ed-bbfc-e7c1e312b060 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:44.926411 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2380748b-c1d0-47ed-bbfc-e7c1e312b060 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1281 microversion: 2.25 time: 1.416560 Sep 08 12:47:44.927493 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 911/1903] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:43 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1281 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:44.962177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01d152c7-e37c-4561-8ede-49395f5535d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:44.963088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-01d152c7-e37c-4561-8ede-49395f5535d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:44.997627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01d152c7-e37c-4561-8ede-49395f5535d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:45.001601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01d152c7-e37c-4561-8ede-49395f5535d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:45.005906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01d152c7-e37c-4561-8ede-49395f5535d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:45.007776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01d152c7-e37c-4561-8ede-49395f5535d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:45.011758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01d152c7-e37c-4561-8ede-49395f5535d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:45.014323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01d152c7-e37c-4561-8ede-49395f5535d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:45.021268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:45.134637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-01d152c7-e37c-4561-8ede-49395f5535d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:47:45.314588 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-01d152c7-e37c-4561-8ede-49395f5535d9 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 204 len: 0 microversion: 2.1 time: 0.366844 Sep 08 12:47:45.318136 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 912/1904] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:47:44 2022] DELETE /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:45.337535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2ba1411e-f57a-4e08-892d-57db0eb83988 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:45.338854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2ba1411e-f57a-4e08-892d-57db0eb83988 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:45.372909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ba1411e-f57a-4e08-892d-57db0eb83988 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:45.373870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ba1411e-f57a-4e08-892d-57db0eb83988 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:45.374996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ba1411e-f57a-4e08-892d-57db0eb83988 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:45.376673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ba1411e-f57a-4e08-892d-57db0eb83988 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:45.377904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ba1411e-f57a-4e08-892d-57db0eb83988 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:45.378966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ba1411e-f57a-4e08-892d-57db0eb83988 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:45.796290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:45.852387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:46.153854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0d37b2a1-ce00-45cc-8530-81ee91c2fe90 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:46.196698 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0d37b2a1-ce00-45cc-8530-81ee91c2fe90 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6" status: 200 len: 1473 microversion: 2.1 time: 2.042557 Sep 08 12:47:46.198222 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 993/1905] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:44 2022] GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6 => generated 1473 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:46.210957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7c0786ce-dfb9-43b8-962d-b87813d492b6 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:46.217719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7c0786ce-dfb9-43b8-962d-b87813d492b6 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:46.262319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c0786ce-dfb9-43b8-962d-b87813d492b6 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:46.263716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c0786ce-dfb9-43b8-962d-b87813d492b6 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:46.264847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c0786ce-dfb9-43b8-962d-b87813d492b6 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:46.269044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c0786ce-dfb9-43b8-962d-b87813d492b6 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:46.269770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c0786ce-dfb9-43b8-962d-b87813d492b6 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:46.270363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c0786ce-dfb9-43b8-962d-b87813d492b6 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:46.606979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2ba1411e-f57a-4e08-892d-57db0eb83988 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:46.618676 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2ba1411e-f57a-4e08-892d-57db0eb83988 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1503 microversion: 2.1 time: 1.296114 Sep 08 12:47:46.619345 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 913/1906] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:45 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1503 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:46.626869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-733943e2-e29a-438f-8f2d-65e9e084c598 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:46.627951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-733943e2-e29a-438f-8f2d-65e9e084c598 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:46.637072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-733943e2-e29a-438f-8f2d-65e9e084c598 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:46.638139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-733943e2-e29a-438f-8f2d-65e9e084c598 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:46.638812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-733943e2-e29a-438f-8f2d-65e9e084c598 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:46.639912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-733943e2-e29a-438f-8f2d-65e9e084c598 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:46.640639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-733943e2-e29a-438f-8f2d-65e9e084c598 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:46.641071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-733943e2-e29a-438f-8f2d-65e9e084c598 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:47.018110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7c0786ce-dfb9-43b8-962d-b87813d492b6 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:47.037330 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7c0786ce-dfb9-43b8-962d-b87813d492b6 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1307 microversion: 2.1 time: 0.836294 Sep 08 12:47:47.043396 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 994/1907] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:46 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1307 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:47.067770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d80f5cab-563c-44ea-914e-c4b3caf7caec tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:47.074298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d80f5cab-563c-44ea-914e-c4b3caf7caec tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:47.089840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d80f5cab-563c-44ea-914e-c4b3caf7caec tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:47.091652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d80f5cab-563c-44ea-914e-c4b3caf7caec tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:47.100706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d80f5cab-563c-44ea-914e-c4b3caf7caec tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:47.101878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d80f5cab-563c-44ea-914e-c4b3caf7caec tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:47.102588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d80f5cab-563c-44ea-914e-c4b3caf7caec tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:47.103285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d80f5cab-563c-44ea-914e-c4b3caf7caec tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:47.404197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d80f5cab-563c-44ea-914e-c4b3caf7caec tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7375a1da7fb43d8a6725f61fa2c7ec9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5619e927afd449c4897bd41f96390988', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:47.419685 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d80f5cab-563c-44ea-914e-c4b3caf7caec tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 200 len: 1456 microversion: 2.1 time: 0.366562 Sep 08 12:47:47.428293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-733943e2-e29a-438f-8f2d-65e9e084c598 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:47.440539 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 995/1908] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:47 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 1456 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:47.456634 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-733943e2-e29a-438f-8f2d-65e9e084c598 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1324 microversion: 2.1 time: 0.835914 Sep 08 12:47:47.458824 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 914/1909] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:46 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1324 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:47.467913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-394a33c8-3b55-4b06-b289-f9e2306bcd16 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:47.469081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-394a33c8-3b55-4b06-b289-f9e2306bcd16 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:47.479951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c364b2c3-4caf-4a47-a817-508e15a7a26e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:47.481016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c364b2c3-4caf-4a47-a817-508e15a7a26e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 810cd6cb-eab9-4427-aa03-597406fd20f6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:47.483030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-394a33c8-3b55-4b06-b289-f9e2306bcd16 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:47.486481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-394a33c8-3b55-4b06-b289-f9e2306bcd16 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:47.489033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-394a33c8-3b55-4b06-b289-f9e2306bcd16 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:47.491855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-394a33c8-3b55-4b06-b289-f9e2306bcd16 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:47.494109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-394a33c8-3b55-4b06-b289-f9e2306bcd16 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:47.494939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-394a33c8-3b55-4b06-b289-f9e2306bcd16 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:47.509188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c364b2c3-4caf-4a47-a817-508e15a7a26e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:47.509807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c364b2c3-4caf-4a47-a817-508e15a7a26e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:47.510413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c364b2c3-4caf-4a47-a817-508e15a7a26e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:47.512407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c364b2c3-4caf-4a47-a817-508e15a7a26e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:47.514547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c364b2c3-4caf-4a47-a817-508e15a7a26e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:47.515090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c364b2c3-4caf-4a47-a817-508e15a7a26e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:47.564792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:48.048632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c364b2c3-4caf-4a47-a817-508e15a7a26e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17f8a317d282493493d44ceab17bbe23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0907b16c3dc14e1da57160d1528ce871', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:48.080483 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c364b2c3-4caf-4a47-a817-508e15a7a26e tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6" status: 200 len: 1431 microversion: 2.1 time: 0.597495 Sep 08 12:47:48.106429 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 915/1910] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:47 2022] GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6 => generated 1431 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:48.123138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3b0a94ad-679b-4bd9-bb97-0808c335ea79 req-1b6d6c65-8339-4576-8644-b942cc8ecf43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "810cd6cb-eab9-4427-aa03-597406fd20f6", "name": "network-vif-deleted", "tag": "7817753f-a720-43f2-8c41-dcb97e0c1bbd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:48.134660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3b0a94ad-679b-4bd9-bb97-0808c335ea79 req-1b6d6c65-8339-4576-8644-b942cc8ecf43 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:48.135867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3b0a94ad-679b-4bd9-bb97-0808c335ea79 req-1b6d6c65-8339-4576-8644-b942cc8ecf43 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:48.136201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3b0a94ad-679b-4bd9-bb97-0808c335ea79 req-1b6d6c65-8339-4576-8644-b942cc8ecf43 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:48.154429 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3b0a94ad-679b-4bd9-bb97-0808c335ea79 req-1b6d6c65-8339-4576-8644-b942cc8ecf43 service nova] Creating event network-vif-deleted:7817753f-a720-43f2-8c41-dcb97e0c1bbd for instance 810cd6cb-eab9-4427-aa03-597406fd20f6 on n-h2-852084-10 Sep 08 12:47:48.165860 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3b0a94ad-679b-4bd9-bb97-0808c335ea79 req-1b6d6c65-8339-4576-8644-b942cc8ecf43 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055272 Sep 08 12:47:48.166671 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 916/1911] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:48.180322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a4d2b552-5a98-493c-bfae-d1c1436793cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:48.181120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a4d2b552-5a98-493c-bfae-d1c1436793cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:48.193432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4d2b552-5a98-493c-bfae-d1c1436793cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:48.193982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4d2b552-5a98-493c-bfae-d1c1436793cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:48.194457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4d2b552-5a98-493c-bfae-d1c1436793cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:48.195199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4d2b552-5a98-493c-bfae-d1c1436793cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:48.203696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4d2b552-5a98-493c-bfae-d1c1436793cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:48.204171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4d2b552-5a98-493c-bfae-d1c1436793cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:48.246055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-394a33c8-3b55-4b06-b289-f9e2306bcd16 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:48.269279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-394a33c8-3b55-4b06-b289-f9e2306bcd16 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:48.278056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-394a33c8-3b55-4b06-b289-f9e2306bcd16 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:48.279874 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-394a33c8-3b55-4b06-b289-f9e2306bcd16 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1281 microversion: 2.25 time: 0.836791 Sep 08 12:47:48.305746 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 996/1912] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:47 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1281 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:48.321073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-bd50ea52-4ef2-487e-9b58-481f07e8f109 req-d6a2f9ce-a934-49fc-be97-7e9d2e3572ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c952db45-70f9-47b4-9061-490992a347be", "name": "network-vif-deleted", "tag": "b98800b6-5185-43d6-b8ad-064fb1654065"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:48.355904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bd50ea52-4ef2-487e-9b58-481f07e8f109 req-d6a2f9ce-a934-49fc-be97-7e9d2e3572ee service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:48.359081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bd50ea52-4ef2-487e-9b58-481f07e8f109 req-d6a2f9ce-a934-49fc-be97-7e9d2e3572ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:48.359961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bd50ea52-4ef2-487e-9b58-481f07e8f109 req-d6a2f9ce-a934-49fc-be97-7e9d2e3572ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:48.394490 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-bd50ea52-4ef2-487e-9b58-481f07e8f109 req-d6a2f9ce-a934-49fc-be97-7e9d2e3572ee service nova] Creating event network-vif-deleted:b98800b6-5185-43d6-b8ad-064fb1654065 for instance c952db45-70f9-47b4-9061-490992a347be on n-h1-852084-10 Sep 08 12:47:48.406051 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-bd50ea52-4ef2-487e-9b58-481f07e8f109 req-d6a2f9ce-a934-49fc-be97-7e9d2e3572ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098567 Sep 08 12:47:48.413077 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 997/1913] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:48.435389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ec184ec-1a10-4962-9fdf-57efe2b04ac9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:48.438675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1ec184ec-1a10-4962-9fdf-57efe2b04ac9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:48.458346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ec184ec-1a10-4962-9fdf-57efe2b04ac9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:48.464003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ec184ec-1a10-4962-9fdf-57efe2b04ac9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:48.464738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ec184ec-1a10-4962-9fdf-57efe2b04ac9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:48.465675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ec184ec-1a10-4962-9fdf-57efe2b04ac9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:48.466330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ec184ec-1a10-4962-9fdf-57efe2b04ac9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:48.466938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ec184ec-1a10-4962-9fdf-57efe2b04ac9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.109053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1ec184ec-1a10-4962-9fdf-57efe2b04ac9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:49.123980 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1ec184ec-1a10-4962-9fdf-57efe2b04ac9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1307 microversion: 2.1 time: 0.709272 Sep 08 12:47:49.127463 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 998/1914] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:48 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1307 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:49.141703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8fa4d8cd-fce4-4a2b-9eac-3d4320f668f9 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:49.145430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8fa4d8cd-fce4-4a2b-9eac-3d4320f668f9 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:49.174057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fa4d8cd-fce4-4a2b-9eac-3d4320f668f9 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.175354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fa4d8cd-fce4-4a2b-9eac-3d4320f668f9 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.177803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fa4d8cd-fce4-4a2b-9eac-3d4320f668f9 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.182597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fa4d8cd-fce4-4a2b-9eac-3d4320f668f9 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.185466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fa4d8cd-fce4-4a2b-9eac-3d4320f668f9 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.186368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fa4d8cd-fce4-4a2b-9eac-3d4320f668f9 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.249995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a4d2b552-5a98-493c-bfae-d1c1436793cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:49.258745 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-8fa4d8cd-fce4-4a2b-9eac-3d4320f668f9 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] HTTP exception thrown: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8fa4d8cd-fce4-4a2b-9eac-3d4320f668f9 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Request method failure captured: Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 HTTP/1.1 Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeNqB1uk6QXOdWs1vRYV5ZPLhpsvTw3uL0j_Lb87B0OTDMhUOfJVNnXddQAx1LuUyiHj8Ecw98_i4_NeQNzo8hE_KYbLutZ1XuVdyZH3PWUXKvQJKWQ4JVlZREJ33AJ4arjnDXF235wCNbQghfMgUC8ORgA7WkgMCT907VPTc5rRurU Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 793c739b689c423cb09af2ce731ac899 Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1232294897 Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:47:49.266411 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:47:49.269949 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_793c739b689c423cb09af2ce731ac899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/793c739b689c423cb09af2ce731ac899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/793c739b689c423cb09af2ce731ac899"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/793c739b689c423cb09af2ce731ac899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:49.269949 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1232294897 Sep 08 12:47:49.269949 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 793c739b689c423cb09af2ce731ac899 Sep 08 12:47:49.269949 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1232294897 Sep 08 12:47:49.269949 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachSCSIVolumeTestJSON-1232294897-project Sep 08 12:47:49.269949 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:47:49.269949 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:47:49.269949 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 77d18d15099442da8c0924f402b03ff0 Sep 08 12:47:49.269949 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1232294897-project Sep 08 12:47:49.269949 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:47:49.269949 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:49.269949 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '64629c30-c7bd-49ef-b0dd-5e17ce9ade56'} Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:49.273895 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:49.278960 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.285402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8fa4d8cd-fce4-4a2b-9eac-3d4320f668f9 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Returning 404 to user: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:49.285402 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8fa4d8cd-fce4-4a2b-9eac-3d4320f668f9 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "DELETE /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 404 len: 111 microversion: 2.1 time: 0.138297 Sep 08 12:47:49.285402 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 999/1915] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:47:49 2022] DELETE /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:47:49.297896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c0b404f-d2d5-45fc-97df-4fdb6b2d6490 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:49.299038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6c0b404f-d2d5-45fc-97df-4fdb6b2d6490 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] [instance: c952db45-70f9-47b4-9061-490992a347be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:49.307838 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a4d2b552-5a98-493c-bfae-d1c1436793cb tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1503 microversion: 2.1 time: 1.136180 Sep 08 12:47:49.310608 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 917/1916] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:48 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1503 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:49.325918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a2d50f81-0809-4d12-bf03-aec55e219cd3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:49.332559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a2d50f81-0809-4d12-bf03-aec55e219cd3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:49.354327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c0b404f-d2d5-45fc-97df-4fdb6b2d6490 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.354677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2d50f81-0809-4d12-bf03-aec55e219cd3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.355054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2d50f81-0809-4d12-bf03-aec55e219cd3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.356922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c0b404f-d2d5-45fc-97df-4fdb6b2d6490 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.357728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2d50f81-0809-4d12-bf03-aec55e219cd3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.358501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2d50f81-0809-4d12-bf03-aec55e219cd3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.358854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c0b404f-d2d5-45fc-97df-4fdb6b2d6490 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.359093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2d50f81-0809-4d12-bf03-aec55e219cd3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.360421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2d50f81-0809-4d12-bf03-aec55e219cd3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.363407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c0b404f-d2d5-45fc-97df-4fdb6b2d6490 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.366523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c0b404f-d2d5-45fc-97df-4fdb6b2d6490 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.368180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c0b404f-d2d5-45fc-97df-4fdb6b2d6490 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.460443 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6c0b404f-d2d5-45fc-97df-4fdb6b2d6490 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] HTTP exception thrown: Instance c952db45-70f9-47b4-9061-490992a347be could not be found. Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c0b404f-d2d5-45fc-97df-4fdb6b2d6490 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Request method failure captured: Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be HTTP/1.1 Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeJTMqPa7Ox420kmLjhrbQ0GKrdd3PpmBcQEwzR2mf0k9d5_yUK865nxvW5TZ2E2qxSCm44uLNvniKzHl8CNvjYUFj-lOpWJAo9d2s7mUa6RFf4kWAgJVjRciMtpxzCJtCNmAYP8Xv0uw0-8w8iT894sF3AaSeFK9vg_Hov39YlQFGc Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 5619e927afd449c4897bd41f96390988 Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-LiveMigrationTest-297167026 Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:47:49.466597 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:47:49.469679 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5619e927afd449c4897bd41f96390988"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5619e927afd449c4897bd41f96390988"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5619e927afd449c4897bd41f96390988"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5619e927afd449c4897bd41f96390988"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:49.469679 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-LiveMigrationTest-297167026 Sep 08 12:47:49.469679 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 5619e927afd449c4897bd41f96390988 Sep 08 12:47:49.469679 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-LiveMigrationTest-297167026 Sep 08 12:47:49.469679 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-LiveMigrationTest-297167026-project Sep 08 12:47:49.469679 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:47:49.469679 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:47:49.469679 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: c7375a1da7fb43d8a6725f61fa2c7ec9 Sep 08 12:47:49.469679 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-LiveMigrationTest-297167026-project Sep 08 12:47:49.469679 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:47:49.469679 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance c952db45-70f9-47b4-9061-490992a347be could not be found. Sep 08 12:47:49.469679 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c952db45-70f9-47b4-9061-490992a347be'} Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c952db45-70f9-47b4-9061-490992a347be could not be found. Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:49.472226 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c952db45-70f9-47b4-9061-490992a347be could not be found. Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c952db45-70f9-47b4-9061-490992a347be could not be found. Sep 08 12:47:49.485257 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.492358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c0b404f-d2d5-45fc-97df-4fdb6b2d6490 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] Returning 404 to user: Instance c952db45-70f9-47b4-9061-490992a347be could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:49.492358 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6c0b404f-d2d5-45fc-97df-4fdb6b2d6490 tempest-LiveMigrationTest-297167026 tempest-LiveMigrationTest-297167026-project] 10.222.0.78 "GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be" status: 404 len: 111 microversion: 2.1 time: 0.183765 Sep 08 12:47:49.492358 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1000/1917] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:49 2022] GET /compute/v2.1/servers/c952db45-70f9-47b4-9061-490992a347be => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:47:49.495011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-5c64b475-0f44-47df-8492-32dbad4930e6 req-7c2d8e26-c8b1-4a5d-a1a9-10c30706505f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ac97d7-8051-4b86-981b-eae55076e04c", "name": "network-vif-plugged", "status": "completed", "tag": "0651dd1c-1b65-417f-a953-0882fc7b9d25"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:49.536881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5c64b475-0f44-47df-8492-32dbad4930e6 req-7c2d8e26-c8b1-4a5d-a1a9-10c30706505f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.537825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5c64b475-0f44-47df-8492-32dbad4930e6 req-7c2d8e26-c8b1-4a5d-a1a9-10c30706505f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.538583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5c64b475-0f44-47df-8492-32dbad4930e6 req-7c2d8e26-c8b1-4a5d-a1a9-10c30706505f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.571049 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-5c64b475-0f44-47df-8492-32dbad4930e6 req-7c2d8e26-c8b1-4a5d-a1a9-10c30706505f service nova] Creating event network-vif-plugged:0651dd1c-1b65-417f-a953-0882fc7b9d25 for instance 19ac97d7-8051-4b86-981b-eae55076e04c on n-h1-852084-10 Sep 08 12:47:49.588898 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-5c64b475-0f44-47df-8492-32dbad4930e6 req-7c2d8e26-c8b1-4a5d-a1a9-10c30706505f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109966 Sep 08 12:47:49.598809 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1001/1918] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:49.616402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-67234fbd-71b6-4d21-a6ad-7698a3f40d0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:49.631341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-67234fbd-71b6-4d21-a6ad-7698a3f40d0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] [instance: 810cd6cb-eab9-4427-aa03-597406fd20f6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:49.697029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67234fbd-71b6-4d21-a6ad-7698a3f40d0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.699760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67234fbd-71b6-4d21-a6ad-7698a3f40d0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.704280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67234fbd-71b6-4d21-a6ad-7698a3f40d0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.706190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67234fbd-71b6-4d21-a6ad-7698a3f40d0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.712141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67234fbd-71b6-4d21-a6ad-7698a3f40d0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.713352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67234fbd-71b6-4d21-a6ad-7698a3f40d0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.774043 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-67234fbd-71b6-4d21-a6ad-7698a3f40d0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] HTTP exception thrown: Instance 810cd6cb-eab9-4427-aa03-597406fd20f6 could not be found. Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-67234fbd-71b6-4d21-a6ad-7698a3f40d0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Request method failure captured: Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6 HTTP/1.1 Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeOVcczwxUP80gWe_QTvjB9HAHZWEcInztHdW5UpWUZIRjVlSSfwKf2liAsy_LXRlyydx54Em5pZlDPPcQOhzjpGQqE5lSvGw0gapA6_7CJbKDrES15QvWcPV3XYIemvjKwcz_g9SS1-fHW0afOXjRiN3vf8mmcxca3e6Q6q77o9368 Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0907b16c3dc14e1da57160d1528ce871 Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ListImageFiltersTestJSON-557705461 Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:47:49.780770 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:47:49.785687 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0907b16c3dc14e1da57160d1528ce871"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0907b16c3dc14e1da57160d1528ce871"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0907b16c3dc14e1da57160d1528ce871"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0907b16c3dc14e1da57160d1528ce871"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:49.785687 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ListImageFiltersTestJSON-557705461 Sep 08 12:47:49.785687 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0907b16c3dc14e1da57160d1528ce871 Sep 08 12:47:49.785687 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-557705461 Sep 08 12:47:49.785687 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ListImageFiltersTestJSON-557705461-project Sep 08 12:47:49.785687 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:47:49.785687 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:47:49.785687 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 17f8a317d282493493d44ceab17bbe23 Sep 08 12:47:49.785687 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ListImageFiltersTestJSON-557705461-project Sep 08 12:47:49.785687 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:47:49.785687 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 810cd6cb-eab9-4427-aa03-597406fd20f6 could not be found. Sep 08 12:47:49.785687 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '810cd6cb-eab9-4427-aa03-597406fd20f6'} Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 810cd6cb-eab9-4427-aa03-597406fd20f6 could not be found. Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:49.788619 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 810cd6cb-eab9-4427-aa03-597406fd20f6 could not be found. Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 810cd6cb-eab9-4427-aa03-597406fd20f6 could not be found. Sep 08 12:47:49.792300 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.799362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a2d50f81-0809-4d12-bf03-aec55e219cd3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:49.800668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-67234fbd-71b6-4d21-a6ad-7698a3f40d0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Returning 404 to user: Instance 810cd6cb-eab9-4427-aa03-597406fd20f6 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:49.802768 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-67234fbd-71b6-4d21-a6ad-7698a3f40d0d tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6" status: 404 len: 111 microversion: 2.1 time: 0.197716 Sep 08 12:47:49.810549 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1002/1919] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:49 2022] GET /compute/v2.1/servers/810cd6cb-eab9-4427-aa03-597406fd20f6 => generated 111 bytes in 210 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:47:49.814588 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a2d50f81-0809-4d12-bf03-aec55e219cd3 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1324 microversion: 2.1 time: 0.500078 Sep 08 12:47:49.815360 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 918/1920] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:49 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1324 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:49.829612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-31f5beb6-82f0-46ce-ac74-ad42fbd33d70 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:49.831416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-31f5beb6-82f0-46ce-ac74-ad42fbd33d70 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] [instance: 64629c30-c7bd-49ef-b0dd-5e17ce9ade56] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:49.836247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bbd2c4c0-41d4-4313-8d7b-b3ec81bc9ba4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:49.837558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bbd2c4c0-41d4-4313-8d7b-b3ec81bc9ba4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:49.844270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31f5beb6-82f0-46ce-ac74-ad42fbd33d70 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.845679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31f5beb6-82f0-46ce-ac74-ad42fbd33d70 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.847020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31f5beb6-82f0-46ce-ac74-ad42fbd33d70 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.849020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31f5beb6-82f0-46ce-ac74-ad42fbd33d70 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.850466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31f5beb6-82f0-46ce-ac74-ad42fbd33d70 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.851668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31f5beb6-82f0-46ce-ac74-ad42fbd33d70 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.864669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd2c4c0-41d4-4313-8d7b-b3ec81bc9ba4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.880300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd2c4c0-41d4-4313-8d7b-b3ec81bc9ba4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.881971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd2c4c0-41d4-4313-8d7b-b3ec81bc9ba4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.886626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd2c4c0-41d4-4313-8d7b-b3ec81bc9ba4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:49.887689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd2c4c0-41d4-4313-8d7b-b3ec81bc9ba4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:49.895325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd2c4c0-41d4-4313-8d7b-b3ec81bc9ba4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:49.917685 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-31f5beb6-82f0-46ce-ac74-ad42fbd33d70 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] HTTP exception thrown: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-31f5beb6-82f0-46ce-ac74-ad42fbd33d70 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Request method failure captured: Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 HTTP/1.1 Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeNqB1uk6QXOdWs1vRYV5ZPLhpsvTw3uL0j_Lb87B0OTDMhUOfJVNnXddQAx1LuUyiHj8Ecw98_i4_NeQNzo8hE_KYbLutZ1XuVdyZH3PWUXKvQJKWQ4JVlZREJ33AJ4arjnDXF235wCNbQghfMgUC8ORgA7WkgMCT907VPTc5rRurU Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 793c739b689c423cb09af2ce731ac899 Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1232294897 Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:47:49.927148 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:47:49.929872 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_793c739b689c423cb09af2ce731ac899"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/793c739b689c423cb09af2ce731ac899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/793c739b689c423cb09af2ce731ac899"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/793c739b689c423cb09af2ce731ac899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:47:49.929872 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1232294897 Sep 08 12:47:49.929872 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 793c739b689c423cb09af2ce731ac899 Sep 08 12:47:49.929872 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1232294897 Sep 08 12:47:49.929872 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachSCSIVolumeTestJSON-1232294897-project Sep 08 12:47:49.929872 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:47:49.929872 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:47:49.929872 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 77d18d15099442da8c0924f402b03ff0 Sep 08 12:47:49.929872 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1232294897-project Sep 08 12:47:49.929872 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:47:49.929872 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:49.929872 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '64629c30-c7bd-49ef-b0dd-5e17ce9ade56'} Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:47:49.930771 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. Sep 08 12:47:49.932671 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:47:49.935194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-31f5beb6-82f0-46ce-ac74-ad42fbd33d70 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] Returning 404 to user: Instance 64629c30-c7bd-49ef-b0dd-5e17ce9ade56 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:47:49.935194 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-31f5beb6-82f0-46ce-ac74-ad42fbd33d70 tempest-AttachSCSIVolumeTestJSON-1232294897 tempest-AttachSCSIVolumeTestJSON-1232294897-project] 10.222.0.78 "GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56" status: 404 len: 111 microversion: 2.1 time: 0.118959 Sep 08 12:47:49.939404 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1003/1921] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:49 2022] GET /compute/v2.1/servers/64629c30-c7bd-49ef-b0dd-5e17ce9ade56 => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:47:50.406296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bbd2c4c0-41d4-4313-8d7b-b3ec81bc9ba4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:50.450204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bbd2c4c0-41d4-4313-8d7b-b3ec81bc9ba4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:50.462777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bbd2c4c0-41d4-4313-8d7b-b3ec81bc9ba4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:50.470605 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bbd2c4c0-41d4-4313-8d7b-b3ec81bc9ba4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1281 microversion: 2.25 time: 0.650187 Sep 08 12:47:50.475478 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 919/1922] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:49 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1281 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:50.496184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-51326b8a-9878-4389-931f-7cd7ed023ce0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f268940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:50.603016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1788434226", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "682d96b1-a973-4824-9a27-17bd1d4dbbfc"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:50.819562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] validate_networks() for [('682d96b1-a973-4824-9a27-17bd1d4dbbfc', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:47:51.144048 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-51326b8a-9878-4389-931f-7cd7ed023ce0 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "DELETE /compute/v2.1/images/a1d06a04-8a26-43af-9c62-159a9d52af88" status: 204 len: 0 microversion: 2.1 time: 0.662809 Sep 08 12:47:51.144978 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 920/1923] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:50 2022] DELETE /compute/v2.1/images/a1d06a04-8a26-43af-9c62-159a9d52af88 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:51.151591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0e04f0d6-62f5-41e4-8f0b-504c14000164 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:51.152852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0e04f0d6-62f5-41e4-8f0b-504c14000164 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:51.162744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e04f0d6-62f5-41e4-8f0b-504c14000164 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:51.164048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e04f0d6-62f5-41e4-8f0b-504c14000164 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:51.164817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e04f0d6-62f5-41e4-8f0b-504c14000164 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:51.166335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e04f0d6-62f5-41e4-8f0b-504c14000164 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:51.167248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e04f0d6-62f5-41e4-8f0b-504c14000164 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:51.168078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e04f0d6-62f5-41e4-8f0b-504c14000164 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:52.031750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0e04f0d6-62f5-41e4-8f0b-504c14000164 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:52.058384 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0e04f0d6-62f5-41e4-8f0b-504c14000164 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1307 microversion: 2.1 time: 0.911044 Sep 08 12:47:52.066107 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 921/1924] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:51 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1307 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:52.088858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9af4712f-99e0-4aa1-b859-fc3b078248aa req-532eb055-09b8-4f4a-b93e-8bd09558c45c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "badbb586-c456-4f32-8edc-09050258e2c2", "tag": "33b1a4eb-d0d9-47e3-93a8-eb5b7665e5ea"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:52.121636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=4,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:52.126268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9af4712f-99e0-4aa1-b859-fc3b078248aa req-532eb055-09b8-4f4a-b93e-8bd09558c45c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:52.129717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9af4712f-99e0-4aa1-b859-fc3b078248aa req-532eb055-09b8-4f4a-b93e-8bd09558c45c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:52.130568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9af4712f-99e0-4aa1-b859-fc3b078248aa req-532eb055-09b8-4f4a-b93e-8bd09558c45c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:52.138973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:52.163351 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9af4712f-99e0-4aa1-b859-fc3b078248aa req-532eb055-09b8-4f4a-b93e-8bd09558c45c service nova] Creating event network-changed:33b1a4eb-d0d9-47e3-93a8-eb5b7665e5ea for instance badbb586-c456-4f32-8edc-09050258e2c2 on n-h2-852084-10 Sep 08 12:47:52.173209 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9af4712f-99e0-4aa1-b859-fc3b078248aa req-532eb055-09b8-4f4a-b93e-8bd09558c45c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102045 Sep 08 12:47:52.174383 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 922/1925] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:52.185697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-41195302-f14f-4c9e-a695-8730d992db24 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:52.189646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-41195302-f14f-4c9e-a695-8730d992db24 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:52.206252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41195302-f14f-4c9e-a695-8730d992db24 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:52.207788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41195302-f14f-4c9e-a695-8730d992db24 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:52.208706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41195302-f14f-4c9e-a695-8730d992db24 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:52.210954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41195302-f14f-4c9e-a695-8730d992db24 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:52.213425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41195302-f14f-4c9e-a695-8730d992db24 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:52.214201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41195302-f14f-4c9e-a695-8730d992db24 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:53.501260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-41195302-f14f-4c9e-a695-8730d992db24 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:53.523947 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-41195302-f14f-4c9e-a695-8730d992db24 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1503 microversion: 2.1 time: 1.346914 Sep 08 12:47:53.526234 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 923/1926] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:52 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1503 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:53.536882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8a328241-ea9c-4160-b973-af93865bdce2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:53.540147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8a328241-ea9c-4160-b973-af93865bdce2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:53.557010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a328241-ea9c-4160-b973-af93865bdce2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:53.557922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a328241-ea9c-4160-b973-af93865bdce2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:53.559536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a328241-ea9c-4160-b973-af93865bdce2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:53.561584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a328241-ea9c-4160-b973-af93865bdce2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:53.562454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a328241-ea9c-4160-b973-af93865bdce2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:53.563480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a328241-ea9c-4160-b973-af93865bdce2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:53.711478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:47:53.712630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:47:53.713878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:47:53.714624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:47:53.715205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:47:53.729691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:53.730459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:53.731783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:53.733339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:53.734045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:53.734876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:53.764981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Getting quotas for project 111d6d19644b4164a4e623bc7ea07dbf. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:47:53.778456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Getting quotas for user d728c4e964f44edf9f8c5114032a4fbb and project 111d6d19644b4164a4e623bc7ea07dbf. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:47:53.783844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:47:53.808398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:47:53.814025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:47:53.948596 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ced808ef-955a-4c13-94a2-5ad004ae0326 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.995749 Sep 08 12:47:53.951618 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1004/1927] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:47:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 4011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:47:53.963559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d86e9e5-6b47-46f0-b2ed-9a0a7bf4ccda tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb370b04c0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:54.640894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a328241-ea9c-4160-b973-af93865bdce2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:54.655991 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8a328241-ea9c-4160-b973-af93865bdce2 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1324 microversion: 2.1 time: 1.127682 Sep 08 12:47:54.660410 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 924/1928] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:53 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1324 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:54.672414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1f7ca0c1-c741-4643-bf84-caef784754ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:54.673041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1f7ca0c1-c741-4643-bf84-caef784754ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:54.694305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7ca0c1-c741-4643-bf84-caef784754ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:54.694879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7ca0c1-c741-4643-bf84-caef784754ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:54.695517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7ca0c1-c741-4643-bf84-caef784754ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:54.696166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7ca0c1-c741-4643-bf84-caef784754ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:54.696635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7ca0c1-c741-4643-bf84-caef784754ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:54.699458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7ca0c1-c741-4643-bf84-caef784754ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:54.747703 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6d86e9e5-6b47-46f0-b2ed-9a0a7bf4ccda tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "DELETE /compute/v2.1/images/ab07099f-9d61-46f0-915f-c5e4ff4839b1" status: 204 len: 0 microversion: 2.1 time: 0.793666 Sep 08 12:47:54.749028 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1005/1929] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:53 2022] DELETE /compute/v2.1/images/ab07099f-9d61-46f0-915f-c5e4ff4839b1 => generated 0 bytes in 797 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:54.770716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-66480195-6771-45e0-8234-dd1e6b7919d0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:54.777786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-66480195-6771-45e0-8234-dd1e6b7919d0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:54.819109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66480195-6771-45e0-8234-dd1e6b7919d0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:54.826982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66480195-6771-45e0-8234-dd1e6b7919d0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:54.834899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66480195-6771-45e0-8234-dd1e6b7919d0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:54.836767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66480195-6771-45e0-8234-dd1e6b7919d0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:54.844265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66480195-6771-45e0-8234-dd1e6b7919d0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:54.845707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66480195-6771-45e0-8234-dd1e6b7919d0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:55.813973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-66480195-6771-45e0-8234-dd1e6b7919d0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:55.826796 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-66480195-6771-45e0-8234-dd1e6b7919d0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1307 microversion: 2.1 time: 1.076147 Sep 08 12:47:55.842863 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1006/1930] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:54 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1307 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:55.865134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5e54a125-3b77-47ae-bc39-b714faf30c8b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:55.874097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5e54a125-3b77-47ae-bc39-b714faf30c8b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:55.893495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e54a125-3b77-47ae-bc39-b714faf30c8b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:55.894853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e54a125-3b77-47ae-bc39-b714faf30c8b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:55.896045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e54a125-3b77-47ae-bc39-b714faf30c8b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:55.897700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e54a125-3b77-47ae-bc39-b714faf30c8b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:55.899092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e54a125-3b77-47ae-bc39-b714faf30c8b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:55.900186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e54a125-3b77-47ae-bc39-b714faf30c8b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:55.971850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f7ca0c1-c741-4643-bf84-caef784754ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:55.982722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f7ca0c1-c741-4643-bf84-caef784754ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:55.984939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f7ca0c1-c741-4643-bf84-caef784754ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:55.986840 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1f7ca0c1-c741-4643-bf84-caef784754ef tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1476 microversion: 2.25 time: 1.322911 Sep 08 12:47:56.003320 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 925/1931] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:54 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1476 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:56.015723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f020744f-6c1e-4e15-92a1-a0419ba2bbc3 req-4ab5cbb4-6a25-4569-8831-d6031b1a0c30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "202a5721-a9d4-400b-b2a6-56586bc32e83", "tag": "fb380d9e-a756-4dbf-b677-997e0408fe77"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:47:56.029170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f020744f-6c1e-4e15-92a1-a0419ba2bbc3 req-4ab5cbb4-6a25-4569-8831-d6031b1a0c30 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:56.030153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f020744f-6c1e-4e15-92a1-a0419ba2bbc3 req-4ab5cbb4-6a25-4569-8831-d6031b1a0c30 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:56.030826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f020744f-6c1e-4e15-92a1-a0419ba2bbc3 req-4ab5cbb4-6a25-4569-8831-d6031b1a0c30 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:56.084522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5e54a125-3b77-47ae-bc39-b714faf30c8b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:56.102465 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f020744f-6c1e-4e15-92a1-a0419ba2bbc3 req-4ab5cbb4-6a25-4569-8831-d6031b1a0c30 service nova] Creating event network-changed:fb380d9e-a756-4dbf-b677-997e0408fe77 for instance 202a5721-a9d4-400b-b2a6-56586bc32e83 on n-h2-852084-10 Sep 08 12:47:56.125526 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f020744f-6c1e-4e15-92a1-a0419ba2bbc3 req-4ab5cbb4-6a25-4569-8831-d6031b1a0c30 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115590 Sep 08 12:47:56.126632 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 926/1932] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:47:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:47:56.128819 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5e54a125-3b77-47ae-bc39-b714faf30c8b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 200 len: 1228 microversion: 2.1 time: 0.283315 Sep 08 12:47:56.154023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ee70e28a-feea-4208-838f-b1085862bd08 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:56.156261 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1007/1933] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:55 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 1228 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:56.171984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ee70e28a-feea-4208-838f-b1085862bd08 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:56.177004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c7e1e406-8858-4e68-ae06-ad8e5be14f26 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] Calling method '.version_select at 0x7fdb3f2da1f0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:56.237398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee70e28a-feea-4208-838f-b1085862bd08 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:56.240138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee70e28a-feea-4208-838f-b1085862bd08 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:56.241550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee70e28a-feea-4208-838f-b1085862bd08 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:56.242794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee70e28a-feea-4208-838f-b1085862bd08 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:56.243606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee70e28a-feea-4208-838f-b1085862bd08 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:56.244238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee70e28a-feea-4208-838f-b1085862bd08 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:56.864789 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c7e1e406-8858-4e68-ae06-ad8e5be14f26 tempest-ListImageFiltersTestJSON-557705461 tempest-ListImageFiltersTestJSON-557705461-project] 10.222.0.78 "DELETE /compute/v2.1/images/a507ff68-4490-4649-92d8-417de29c876f" status: 204 len: 0 microversion: 2.1 time: 0.707058 Sep 08 12:47:56.869622 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1008/1934] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:56 2022] DELETE /compute/v2.1/images/a507ff68-4490-4649-92d8-417de29c876f => generated 0 bytes in 713 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:47:56.885027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1b6462f9-05e9-411c-aae9-53bd56ce9f6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:56.897303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1b6462f9-05e9-411c-aae9-53bd56ce9f6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:56.941061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b6462f9-05e9-411c-aae9-53bd56ce9f6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:56.953988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b6462f9-05e9-411c-aae9-53bd56ce9f6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:56.953988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b6462f9-05e9-411c-aae9-53bd56ce9f6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:56.960512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b6462f9-05e9-411c-aae9-53bd56ce9f6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:56.961572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b6462f9-05e9-411c-aae9-53bd56ce9f6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:56.962334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b6462f9-05e9-411c-aae9-53bd56ce9f6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:57.487893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ee70e28a-feea-4208-838f-b1085862bd08 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:57.500813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1b6462f9-05e9-411c-aae9-53bd56ce9f6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:57.502694 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ee70e28a-feea-4208-838f-b1085862bd08 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1503 microversion: 2.1 time: 1.370659 Sep 08 12:47:57.508006 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 927/1935] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:56 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1503 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:57.518601 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1b6462f9-05e9-411c-aae9-53bd56ce9f6a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1324 microversion: 2.1 time: 0.646748 Sep 08 12:47:57.532564 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1009/1936] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:56 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1324 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:57.549704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-80638d53-faca-4f2d-a4cb-f32518dca16a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:57.550588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-80638d53-faca-4f2d-a4cb-f32518dca16a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:57.564798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80638d53-faca-4f2d-a4cb-f32518dca16a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:57.565410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80638d53-faca-4f2d-a4cb-f32518dca16a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:57.565968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80638d53-faca-4f2d-a4cb-f32518dca16a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:57.566716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80638d53-faca-4f2d-a4cb-f32518dca16a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:57.567372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80638d53-faca-4f2d-a4cb-f32518dca16a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:57.567811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80638d53-faca-4f2d-a4cb-f32518dca16a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:58.503917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-16c675f2-77e5-474b-9253-b2f58693f238 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:58.509589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-16c675f2-77e5-474b-9253-b2f58693f238 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:58.539964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16c675f2-77e5-474b-9253-b2f58693f238 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:58.541493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16c675f2-77e5-474b-9253-b2f58693f238 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:58.546634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16c675f2-77e5-474b-9253-b2f58693f238 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:58.548492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16c675f2-77e5-474b-9253-b2f58693f238 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:58.549270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16c675f2-77e5-474b-9253-b2f58693f238 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:58.550704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16c675f2-77e5-474b-9253-b2f58693f238 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:59.184875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-80638d53-faca-4f2d-a4cb-f32518dca16a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:59.225499 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-80638d53-faca-4f2d-a4cb-f32518dca16a tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1307 microversion: 2.1 time: 1.686788 Sep 08 12:47:59.228203 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1010/1937] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:57 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1307 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:59.244348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-050b63f4-b3df-440d-9312-06919f0c9982 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:59.249537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-050b63f4-b3df-440d-9312-06919f0c9982 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:59.280246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-050b63f4-b3df-440d-9312-06919f0c9982 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:59.285261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-050b63f4-b3df-440d-9312-06919f0c9982 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:59.291551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-050b63f4-b3df-440d-9312-06919f0c9982 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:59.301051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-050b63f4-b3df-440d-9312-06919f0c9982 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:59.304438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-050b63f4-b3df-440d-9312-06919f0c9982 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:59.311149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-050b63f4-b3df-440d-9312-06919f0c9982 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:59.742943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-050b63f4-b3df-440d-9312-06919f0c9982 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:47:59.758848 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-050b63f4-b3df-440d-9312-06919f0c9982 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 200 len: 1282 microversion: 2.1 time: 0.524000 Sep 08 12:47:59.761335 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1011/1938] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:59 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 1282 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:47:59.773429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da2d49cd-b87f-4cc3-9b7a-ea492a2feb9b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:59.774416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-da2d49cd-b87f-4cc3-9b7a-ea492a2feb9b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:59.797787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da2d49cd-b87f-4cc3-9b7a-ea492a2feb9b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:59.798362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da2d49cd-b87f-4cc3-9b7a-ea492a2feb9b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:59.798794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da2d49cd-b87f-4cc3-9b7a-ea492a2feb9b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:59.799579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da2d49cd-b87f-4cc3-9b7a-ea492a2feb9b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:59.800052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da2d49cd-b87f-4cc3-9b7a-ea492a2feb9b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:59.800645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da2d49cd-b87f-4cc3-9b7a-ea492a2feb9b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:59.950630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-16c675f2-77e5-474b-9253-b2f58693f238 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid 19ac97d7-8051-4b86-981b-eae55076e04c {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:47:59.973269 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-16c675f2-77e5-474b-9253-b2f58693f238 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1971 microversion: 2.25 time: 2.463643 Sep 08 12:47:59.974808 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 928/1939] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:47:57 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1971 bytes in 2466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:47:59.981322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8a847802-8c0f-4aba-b2b5-3b6c5428cbf1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:47:59.983336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8a847802-8c0f-4aba-b2b5-3b6c5428cbf1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:47:59.991371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a847802-8c0f-4aba-b2b5-3b6c5428cbf1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:59.992927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a847802-8c0f-4aba-b2b5-3b6c5428cbf1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:59.993932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a847802-8c0f-4aba-b2b5-3b6c5428cbf1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:47:59.995341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a847802-8c0f-4aba-b2b5-3b6c5428cbf1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:47:59.996290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a847802-8c0f-4aba-b2b5-3b6c5428cbf1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:47:59.997078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a847802-8c0f-4aba-b2b5-3b6c5428cbf1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:00.373721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-da2d49cd-b87f-4cc3-9b7a-ea492a2feb9b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:00.383427 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-da2d49cd-b87f-4cc3-9b7a-ea492a2feb9b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1324 microversion: 2.1 time: 0.620845 Sep 08 12:48:00.389289 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1012/1940] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:59 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1324 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:00.395595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b702b19f-39d1-41a4-8fc0-8bc2469391f7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:00.408283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b702b19f-39d1-41a4-8fc0-8bc2469391f7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:00.419148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b702b19f-39d1-41a4-8fc0-8bc2469391f7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:00.420081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b702b19f-39d1-41a4-8fc0-8bc2469391f7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:00.420750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b702b19f-39d1-41a4-8fc0-8bc2469391f7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:00.421690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b702b19f-39d1-41a4-8fc0-8bc2469391f7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:00.422368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b702b19f-39d1-41a4-8fc0-8bc2469391f7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:00.428423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b702b19f-39d1-41a4-8fc0-8bc2469391f7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:00.524253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a847802-8c0f-4aba-b2b5-3b6c5428cbf1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:00.534246 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8a847802-8c0f-4aba-b2b5-3b6c5428cbf1 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1483 microversion: 2.1 time: 0.557957 Sep 08 12:48:00.544556 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 929/1941] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:47:59 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1483 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:00.559997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bab4debb-2589-4252-8963-1e6ee5af0f8c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:00.561179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bab4debb-2589-4252-8963-1e6ee5af0f8c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:00.572420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bab4debb-2589-4252-8963-1e6ee5af0f8c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:00.573597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bab4debb-2589-4252-8963-1e6ee5af0f8c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:00.575689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bab4debb-2589-4252-8963-1e6ee5af0f8c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:00.577747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bab4debb-2589-4252-8963-1e6ee5af0f8c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:00.578681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bab4debb-2589-4252-8963-1e6ee5af0f8c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:00.587720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bab4debb-2589-4252-8963-1e6ee5af0f8c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:00.990651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bab4debb-2589-4252-8963-1e6ee5af0f8c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:00.991773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-b702b19f-39d1-41a4-8fc0-8bc2469391f7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid 19ac97d7-8051-4b86-981b-eae55076e04c {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:48:01.004067 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bab4debb-2589-4252-8963-1e6ee5af0f8c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1307 microversion: 2.1 time: 0.457962 Sep 08 12:48:01.006705 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 930/1942] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:00 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1307 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:01.019213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7b598dbc-1c67-48a8-941d-e591a6ff1cdf tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:01.020209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7b598dbc-1c67-48a8-941d-e591a6ff1cdf tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:01.034056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b598dbc-1c67-48a8-941d-e591a6ff1cdf tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:01.036163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b598dbc-1c67-48a8-941d-e591a6ff1cdf tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:01.042774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b598dbc-1c67-48a8-941d-e591a6ff1cdf tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:01.044217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b598dbc-1c67-48a8-941d-e591a6ff1cdf tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:01.044906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b598dbc-1c67-48a8-941d-e591a6ff1cdf tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:01.045559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b598dbc-1c67-48a8-941d-e591a6ff1cdf tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:01.051888 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b702b19f-39d1-41a4-8fc0-8bc2469391f7 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1971 microversion: 2.25 time: 0.660831 Sep 08 12:48:01.054721 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1013/1943] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:00 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1971 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:01.065069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-40d0c4fa-8e7e-43f3-b73f-403c93ad5acf tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:01.066130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-40d0c4fa-8e7e-43f3-b73f-403c93ad5acf tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:01.080883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40d0c4fa-8e7e-43f3-b73f-403c93ad5acf tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:01.081795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40d0c4fa-8e7e-43f3-b73f-403c93ad5acf tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:01.082771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40d0c4fa-8e7e-43f3-b73f-403c93ad5acf tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:01.084834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40d0c4fa-8e7e-43f3-b73f-403c93ad5acf tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:01.085638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40d0c4fa-8e7e-43f3-b73f-403c93ad5acf tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:01.086334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40d0c4fa-8e7e-43f3-b73f-403c93ad5acf tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:01.095256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:01.233366 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7b598dbc-1c67-48a8-941d-e591a6ff1cdf tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "POST /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f/action" status: 202 len: 0 microversion: 2.1 time: 0.224757 Sep 08 12:48:01.239374 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 931/1944] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:48:01 2022] POST /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:48:01.252535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-02ee3268-6b61-4bcb-be75-888140f5238f req-d616acc9-1c23-4387-bb44-3f6ae17d565e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "badbb586-c456-4f32-8edc-09050258e2c2", "name": "network-vif-plugged", "status": "completed", "tag": "33b1a4eb-d0d9-47e3-93a8-eb5b7665e5ea"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:01.310988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-02ee3268-6b61-4bcb-be75-888140f5238f req-d616acc9-1c23-4387-bb44-3f6ae17d565e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:01.317954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-02ee3268-6b61-4bcb-be75-888140f5238f req-d616acc9-1c23-4387-bb44-3f6ae17d565e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:01.319146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-02ee3268-6b61-4bcb-be75-888140f5238f req-d616acc9-1c23-4387-bb44-3f6ae17d565e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:01.342067 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-02ee3268-6b61-4bcb-be75-888140f5238f req-d616acc9-1c23-4387-bb44-3f6ae17d565e service nova] Creating event network-vif-plugged:33b1a4eb-d0d9-47e3-93a8-eb5b7665e5ea for instance badbb586-c456-4f32-8edc-09050258e2c2 on n-h2-852084-10 Sep 08 12:48:01.360426 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-02ee3268-6b61-4bcb-be75-888140f5238f req-d616acc9-1c23-4387-bb44-3f6ae17d565e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118454 Sep 08 12:48:01.361831 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 932/1945] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:01.374708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b9c647e8-4927-449d-89e6-c0a1c1f93556 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:01.392210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9c647e8-4927-449d-89e6-c0a1c1f93556 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:01.393852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9c647e8-4927-449d-89e6-c0a1c1f93556 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:01.396837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9c647e8-4927-449d-89e6-c0a1c1f93556 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:01.398963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9c647e8-4927-449d-89e6-c0a1c1f93556 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:01.400200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9c647e8-4927-449d-89e6-c0a1c1f93556 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:01.400911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9c647e8-4927-449d-89e6-c0a1c1f93556 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:01.490110 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b9c647e8-4927-449d-89e6-c0a1c1f93556 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.126234 Sep 08 12:48:01.491829 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 933/1946] 10.222.0.78 () {60 vars in 1217 bytes} [Thu Sep 8 12:48:01 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:48:01.503270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b54d5669-2507-4163-a016-6b45958dd79b tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:01.504436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b54d5669-2507-4163-a016-6b45958dd79b tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:01.518176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b54d5669-2507-4163-a016-6b45958dd79b tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:01.519259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b54d5669-2507-4163-a016-6b45958dd79b tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:01.520130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b54d5669-2507-4163-a016-6b45958dd79b tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:01.521466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b54d5669-2507-4163-a016-6b45958dd79b tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:01.524475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b54d5669-2507-4163-a016-6b45958dd79b tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:01.525989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b54d5669-2507-4163-a016-6b45958dd79b tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:01.838119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40d0c4fa-8e7e-43f3-b73f-403c93ad5acf tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:01.848389 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-40d0c4fa-8e7e-43f3-b73f-403c93ad5acf tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 200 len: 1324 microversion: 2.1 time: 0.788364 Sep 08 12:48:01.849384 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1014/1947] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:01 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 1324 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:01.857376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fb91ccb4-381e-4d8c-8c3d-c808439af3b6 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:01.858522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fb91ccb4-381e-4d8c-8c3d-c808439af3b6 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:01.866967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb91ccb4-381e-4d8c-8c3d-c808439af3b6 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:01.867999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb91ccb4-381e-4d8c-8c3d-c808439af3b6 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:01.868719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb91ccb4-381e-4d8c-8c3d-c808439af3b6 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:01.869776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb91ccb4-381e-4d8c-8c3d-c808439af3b6 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:01.870483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb91ccb4-381e-4d8c-8c3d-c808439af3b6 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:01.871164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb91ccb4-381e-4d8c-8c3d-c808439af3b6 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:02.013857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b54d5669-2507-4163-a016-6b45958dd79b tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:02.033926 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b54d5669-2507-4163-a016-6b45958dd79b tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1491 microversion: 2.1 time: 0.539577 Sep 08 12:48:02.038177 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 934/1948] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:01 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1491 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:02.066573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fbe14342-ab3a-49e8-9f00-7e5b715e0a75 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-852084-10", "block_migration": "auto"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:02.072141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fbe14342-ab3a-49e8-9f00-7e5b715e0a75 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:02.082528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbe14342-ab3a-49e8-9f00-7e5b715e0a75 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:02.083150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbe14342-ab3a-49e8-9f00-7e5b715e0a75 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:02.085348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbe14342-ab3a-49e8-9f00-7e5b715e0a75 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:02.086269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbe14342-ab3a-49e8-9f00-7e5b715e0a75 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:02.086940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbe14342-ab3a-49e8-9f00-7e5b715e0a75 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:02.087456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbe14342-ab3a-49e8-9f00-7e5b715e0a75 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:02.136034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-fbe14342-ab3a-49e8-9f00-7e5b715e0a75 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'flavor' on Instance uuid 19ac97d7-8051-4b86-981b-eae55076e04c {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:48:02.153065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fbe14342-ab3a-49e8-9f00-7e5b715e0a75 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Going to try to live migrate instance to n-h2-852084-10 {{(pid=128971) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 12:48:02.233683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fb91ccb4-381e-4d8c-8c3d-c808439af3b6 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:02.254705 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fb91ccb4-381e-4d8c-8c3d-c808439af3b6 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1324 microversion: 2.1 time: 0.402448 Sep 08 12:48:02.257441 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1015/1949] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:01 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1324 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:02.276372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e6edbf6-b89c-41f9-a333-597f3c2b14ed tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:02.279105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8e6edbf6-b89c-41f9-a333-597f3c2b14ed tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:02.294196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e6edbf6-b89c-41f9-a333-597f3c2b14ed tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:02.296751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e6edbf6-b89c-41f9-a333-597f3c2b14ed tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:02.298044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e6edbf6-b89c-41f9-a333-597f3c2b14ed tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:02.307977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e6edbf6-b89c-41f9-a333-597f3c2b14ed tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:02.308414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e6edbf6-b89c-41f9-a333-597f3c2b14ed tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:02.311769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e6edbf6-b89c-41f9-a333-597f3c2b14ed tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:02.748707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8e6edbf6-b89c-41f9-a333-597f3c2b14ed tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:02.799181 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8e6edbf6-b89c-41f9-a333-597f3c2b14ed tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1307 microversion: 2.1 time: 0.536937 Sep 08 12:48:02.802525 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1016/1950] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:02 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1307 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:02.904889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac3f3baa-c0a6-4f80-83f5-71c9a1169634 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:02.908547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ac3f3baa-c0a6-4f80-83f5-71c9a1169634 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:02.994704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac3f3baa-c0a6-4f80-83f5-71c9a1169634 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:03.013739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac3f3baa-c0a6-4f80-83f5-71c9a1169634 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:03.017338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac3f3baa-c0a6-4f80-83f5-71c9a1169634 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:03.024405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac3f3baa-c0a6-4f80-83f5-71c9a1169634 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:03.030296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac3f3baa-c0a6-4f80-83f5-71c9a1169634 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:03.032060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac3f3baa-c0a6-4f80-83f5-71c9a1169634 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:03.749345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:03.794493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:03.889014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ac3f3baa-c0a6-4f80-83f5-71c9a1169634 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:03.913692 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ac3f3baa-c0a6-4f80-83f5-71c9a1169634 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 200 len: 1324 microversion: 2.1 time: 1.035964 Sep 08 12:48:03.917428 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1017/1951] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:02 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 1324 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:03.930042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e6c772e6-d2e6-4448-8e8a-9e4b1dc53869 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:03.931447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e6c772e6-d2e6-4448-8e8a-9e4b1dc53869 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:03.946234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6c772e6-d2e6-4448-8e8a-9e4b1dc53869 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:03.947288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6c772e6-d2e6-4448-8e8a-9e4b1dc53869 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:03.948416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6c772e6-d2e6-4448-8e8a-9e4b1dc53869 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:03.950079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6c772e6-d2e6-4448-8e8a-9e4b1dc53869 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:03.951296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6c772e6-d2e6-4448-8e8a-9e4b1dc53869 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:03.952421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6c772e6-d2e6-4448-8e8a-9e4b1dc53869 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:04.371416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6c772e6-d2e6-4448-8e8a-9e4b1dc53869 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:04.393594 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e6c772e6-d2e6-4448-8e8a-9e4b1dc53869 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1491 microversion: 2.1 time: 0.473866 Sep 08 12:48:04.394346 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1018/1952] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:03 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1491 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:04.417658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ff989ffb-1088-445e-a39e-c3c37cdaab6f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:04.418672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff989ffb-1088-445e-a39e-c3c37cdaab6f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:04.426107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff989ffb-1088-445e-a39e-c3c37cdaab6f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:04.427007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff989ffb-1088-445e-a39e-c3c37cdaab6f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:04.427862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff989ffb-1088-445e-a39e-c3c37cdaab6f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:04.428811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff989ffb-1088-445e-a39e-c3c37cdaab6f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:04.429459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff989ffb-1088-445e-a39e-c3c37cdaab6f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:04.430064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff989ffb-1088-445e-a39e-c3c37cdaab6f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:04.986274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ff989ffb-1088-445e-a39e-c3c37cdaab6f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:05.010080 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ff989ffb-1088-445e-a39e-c3c37cdaab6f tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1324 microversion: 2.1 time: 0.601050 Sep 08 12:48:05.011255 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1019/1953] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:04 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1324 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:05.035650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d8a7bd8e-fd79-4148-8851-9fba45cd2981 req-5a69a46a-6a10-4325-8113-4509ef0e0d8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202a5721-a9d4-400b-b2a6-56586bc32e83", "name": "network-vif-plugged", "status": "completed", "tag": "fb380d9e-a756-4dbf-b677-997e0408fe77"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:05.054557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d8a7bd8e-fd79-4148-8851-9fba45cd2981 req-5a69a46a-6a10-4325-8113-4509ef0e0d8e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:05.055979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d8a7bd8e-fd79-4148-8851-9fba45cd2981 req-5a69a46a-6a10-4325-8113-4509ef0e0d8e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:05.057123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d8a7bd8e-fd79-4148-8851-9fba45cd2981 req-5a69a46a-6a10-4325-8113-4509ef0e0d8e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:05.082219 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d8a7bd8e-fd79-4148-8851-9fba45cd2981 req-5a69a46a-6a10-4325-8113-4509ef0e0d8e service nova] Creating event network-vif-plugged:fb380d9e-a756-4dbf-b677-997e0408fe77 for instance 202a5721-a9d4-400b-b2a6-56586bc32e83 on n-h2-852084-10 Sep 08 12:48:05.093605 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d8a7bd8e-fd79-4148-8851-9fba45cd2981 req-5a69a46a-6a10-4325-8113-4509ef0e0d8e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080091 Sep 08 12:48:05.095547 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1020/1954] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:05.106297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4b029f03-984e-4ba9-9e43-2b215b898c91 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:05.108326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4b029f03-984e-4ba9-9e43-2b215b898c91 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:05.120363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b029f03-984e-4ba9-9e43-2b215b898c91 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:05.121648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b029f03-984e-4ba9-9e43-2b215b898c91 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:05.122363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b029f03-984e-4ba9-9e43-2b215b898c91 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:05.123537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b029f03-984e-4ba9-9e43-2b215b898c91 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:05.127144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b029f03-984e-4ba9-9e43-2b215b898c91 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:05.128001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b029f03-984e-4ba9-9e43-2b215b898c91 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:05.742234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4b029f03-984e-4ba9-9e43-2b215b898c91 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:05.783703 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4b029f03-984e-4ba9-9e43-2b215b898c91 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1488 microversion: 2.1 time: 0.685363 Sep 08 12:48:05.799964 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1021/1955] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:05 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1488 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:05.816849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-eecf513d-ab88-45ec-b473-0f123ca6cdcb req-412e1879-a327-48a1-9172-99a0aba8fadc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfe69bb-91ad-499f-9f12-de0ac60519b6", "tag": "feb64804-e1ff-419a-8a16-60a42fef7a86"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:05.845881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-eecf513d-ab88-45ec-b473-0f123ca6cdcb req-412e1879-a327-48a1-9172-99a0aba8fadc service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:05.846385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-eecf513d-ab88-45ec-b473-0f123ca6cdcb req-412e1879-a327-48a1-9172-99a0aba8fadc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:05.846826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-eecf513d-ab88-45ec-b473-0f123ca6cdcb req-412e1879-a327-48a1-9172-99a0aba8fadc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:05.882488 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-eecf513d-ab88-45ec-b473-0f123ca6cdcb req-412e1879-a327-48a1-9172-99a0aba8fadc service nova] Creating event network-changed:feb64804-e1ff-419a-8a16-60a42fef7a86 for instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 on n-h1-852084-10 Sep 08 12:48:05.888480 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-eecf513d-ab88-45ec-b473-0f123ca6cdcb req-412e1879-a327-48a1-9172-99a0aba8fadc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090422 Sep 08 12:48:05.889269 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1022/1956] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:05.895797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ffc27db1-531c-484e-9d48-0682ebb42e0b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:05.897158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ffc27db1-531c-484e-9d48-0682ebb42e0b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:05.904542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffc27db1-531c-484e-9d48-0682ebb42e0b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:05.905421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffc27db1-531c-484e-9d48-0682ebb42e0b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:05.906101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffc27db1-531c-484e-9d48-0682ebb42e0b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:05.907051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffc27db1-531c-484e-9d48-0682ebb42e0b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:05.907737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffc27db1-531c-484e-9d48-0682ebb42e0b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:05.908349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffc27db1-531c-484e-9d48-0682ebb42e0b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:06.104614 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fbe14342-ab3a-49e8-9f00-7e5b715e0a75 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c/action" status: 202 len: 0 microversion: 2.25 time: 4.062062 Sep 08 12:48:06.105925 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 935/1957] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 12:48:02 2022] POST /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c/action => generated 0 bytes in 4067 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:48:06.148725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-89f4c397-91ec-43b9-b516-488a94d249c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:06.150949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-89f4c397-91ec-43b9-b516-488a94d249c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:06.164031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89f4c397-91ec-43b9-b516-488a94d249c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:06.167551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89f4c397-91ec-43b9-b516-488a94d249c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:06.168454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89f4c397-91ec-43b9-b516-488a94d249c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:06.170604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89f4c397-91ec-43b9-b516-488a94d249c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:06.171561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89f4c397-91ec-43b9-b516-488a94d249c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:06.173062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89f4c397-91ec-43b9-b516-488a94d249c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:06.206223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ffc27db1-531c-484e-9d48-0682ebb42e0b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:06.220289 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ffc27db1-531c-484e-9d48-0682ebb42e0b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 200 len: 1324 microversion: 2.1 time: 0.329569 Sep 08 12:48:06.225024 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1023/1958] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:05 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 1324 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:06.241304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ce3f656d-426f-4c7c-88c4-fa88f83b6842 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-996301152"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:06.244469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ce3f656d-426f-4c7c-88c4-fa88f83b6842 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:06.272627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce3f656d-426f-4c7c-88c4-fa88f83b6842 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:06.273187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce3f656d-426f-4c7c-88c4-fa88f83b6842 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:06.274300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce3f656d-426f-4c7c-88c4-fa88f83b6842 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:06.275601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce3f656d-426f-4c7c-88c4-fa88f83b6842 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:06.276141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce3f656d-426f-4c7c-88c4-fa88f83b6842 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:06.276589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce3f656d-426f-4c7c-88c4-fa88f83b6842 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:06.710313 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ce3f656d-426f-4c7c-88c4-fa88f83b6842 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "POST /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2/action" status: 202 len: 0 microversion: 2.1 time: 0.483200 Sep 08 12:48:06.711571 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1024/1959] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:48:06 2022] POST /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 12:48:06.730863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8482bd4c-ae01-499a-8629-5c4e3792cd22 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:06.734246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8482bd4c-ae01-499a-8629-5c4e3792cd22 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:06.753779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8482bd4c-ae01-499a-8629-5c4e3792cd22 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:06.754384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8482bd4c-ae01-499a-8629-5c4e3792cd22 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:06.760003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8482bd4c-ae01-499a-8629-5c4e3792cd22 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:06.763747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8482bd4c-ae01-499a-8629-5c4e3792cd22 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:06.764264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8482bd4c-ae01-499a-8629-5c4e3792cd22 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:06.764706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8482bd4c-ae01-499a-8629-5c4e3792cd22 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:06.852811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-89f4c397-91ec-43b9-b516-488a94d249c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:06.862653 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-89f4c397-91ec-43b9-b516-488a94d249c2 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1497 microversion: 2.1 time: 0.725670 Sep 08 12:48:06.876534 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 936/1960] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:06 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1497 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:06.883751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0954d191-eea5-40d2-a27b-30eeb1b68d2b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:06.884904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0954d191-eea5-40d2-a27b-30eeb1b68d2b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:06.908949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0954d191-eea5-40d2-a27b-30eeb1b68d2b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:06.909769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0954d191-eea5-40d2-a27b-30eeb1b68d2b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:06.910417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0954d191-eea5-40d2-a27b-30eeb1b68d2b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:06.911447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0954d191-eea5-40d2-a27b-30eeb1b68d2b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:06.912235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0954d191-eea5-40d2-a27b-30eeb1b68d2b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:06.912936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0954d191-eea5-40d2-a27b-30eeb1b68d2b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:08.058077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0954d191-eea5-40d2-a27b-30eeb1b68d2b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:08.088393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0954d191-eea5-40d2-a27b-30eeb1b68d2b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:08.093651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0954d191-eea5-40d2-a27b-30eeb1b68d2b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:08.096342 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0954d191-eea5-40d2-a27b-30eeb1b68d2b tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 1.218153 Sep 08 12:48:08.099945 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 937/1961] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:06 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:08.121186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c1cfc2f0-3c58-4ecd-8e70-8de616052be8 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3f2dab80>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:08.218055 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c1cfc2f0-3c58-4ecd-8e70-8de616052be8 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/f84e6dc6-fa37-4b18-a2ed-49a472d2cfef" status: 200 len: 1411 microversion: 2.1 time: 0.116655 Sep 08 12:48:08.219850 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 938/1962] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:48:08 2022] GET /compute/v2.1/images/f84e6dc6-fa37-4b18-a2ed-49a472d2cfef => generated 1411 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:08.235856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9cb79122-5c20-4ecf-bc24-0fe061cb8479 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:08.243087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9cb79122-5c20-4ecf-bc24-0fe061cb8479 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:08.265032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cb79122-5c20-4ecf-bc24-0fe061cb8479 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:08.265869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cb79122-5c20-4ecf-bc24-0fe061cb8479 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:08.266572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cb79122-5c20-4ecf-bc24-0fe061cb8479 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:08.267889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cb79122-5c20-4ecf-bc24-0fe061cb8479 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:08.268638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cb79122-5c20-4ecf-bc24-0fe061cb8479 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:08.269249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cb79122-5c20-4ecf-bc24-0fe061cb8479 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:08.339964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:08.345234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9cb79122-5c20-4ecf-bc24-0fe061cb8479 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:48:08.495654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8482bd4c-ae01-499a-8629-5c4e3792cd22 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:08.508712 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8482bd4c-ae01-499a-8629-5c4e3792cd22 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1324 microversion: 2.1 time: 1.795033 Sep 08 12:48:08.531706 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1025/1963] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:06 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1324 bytes in 1812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:08.541295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-156ca7d3-6c02-43a8-b314-a4db9723d8cc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:08.542575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-156ca7d3-6c02-43a8-b314-a4db9723d8cc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:08.576149 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9cb79122-5c20-4ecf-bc24-0fe061cb8479 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 204 len: 0 microversion: 2.1 time: 0.354568 Sep 08 12:48:08.577392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-156ca7d3-6c02-43a8-b314-a4db9723d8cc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:08.579907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-156ca7d3-6c02-43a8-b314-a4db9723d8cc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:08.580746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-156ca7d3-6c02-43a8-b314-a4db9723d8cc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:08.584575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-156ca7d3-6c02-43a8-b314-a4db9723d8cc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:08.585375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-156ca7d3-6c02-43a8-b314-a4db9723d8cc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:08.586028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-156ca7d3-6c02-43a8-b314-a4db9723d8cc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:08.586850 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 939/1964] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:48:08 2022] DELETE /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:48:08.595530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bb774233-83c7-417a-aea4-a97a6869f1a6 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3f230790>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:08.725967 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bb774233-83c7-417a-aea4-a97a6869f1a6 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/f84e6dc6-fa37-4b18-a2ed-49a472d2cfef" status: 200 len: 1411 microversion: 2.1 time: 0.135060 Sep 08 12:48:08.737829 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 940/1965] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:48:08 2022] GET /compute/v2.1/images/f84e6dc6-fa37-4b18-a2ed-49a472d2cfef => generated 1411 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:08.752462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-544f566d-f0b6-46f5-9110-db64d8ecbe55 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:08.754514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-544f566d-f0b6-46f5-9110-db64d8ecbe55 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:08.769525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-544f566d-f0b6-46f5-9110-db64d8ecbe55 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:08.770245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-544f566d-f0b6-46f5-9110-db64d8ecbe55 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:08.771023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-544f566d-f0b6-46f5-9110-db64d8ecbe55 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:08.772811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-544f566d-f0b6-46f5-9110-db64d8ecbe55 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:08.773390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-544f566d-f0b6-46f5-9110-db64d8ecbe55 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:08.774783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-544f566d-f0b6-46f5-9110-db64d8ecbe55 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:09.360639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-156ca7d3-6c02-43a8-b314-a4db9723d8cc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:09.388716 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-156ca7d3-6c02-43a8-b314-a4db9723d8cc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 200 len: 1324 microversion: 2.1 time: 0.854813 Sep 08 12:48:09.389830 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1026/1966] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:08 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 1324 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:09.403788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-544f566d-f0b6-46f5-9110-db64d8ecbe55 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:09.417932 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-544f566d-f0b6-46f5-9110-db64d8ecbe55 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1503 microversion: 2.1 time: 0.675722 Sep 08 12:48:09.419099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c1a7b81d-c638-4cf1-8c16-e5044f56f98c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb363f9280>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:09.420514 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 941/1967] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:08 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1503 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:09.435507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-99b6c315-e348-454f-af61-7b1ac0fbcee8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:09.436493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-99b6c315-e348-454f-af61-7b1ac0fbcee8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:09.490200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99b6c315-e348-454f-af61-7b1ac0fbcee8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:09.491574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99b6c315-e348-454f-af61-7b1ac0fbcee8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:09.492997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99b6c315-e348-454f-af61-7b1ac0fbcee8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:09.496179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99b6c315-e348-454f-af61-7b1ac0fbcee8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:09.497721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99b6c315-e348-454f-af61-7b1ac0fbcee8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:09.500128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99b6c315-e348-454f-af61-7b1ac0fbcee8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:09.811086 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c1a7b81d-c638-4cf1-8c16-e5044f56f98c tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/images/f84e6dc6-fa37-4b18-a2ed-49a472d2cfef" status: 204 len: 0 microversion: 2.1 time: 0.409999 Sep 08 12:48:09.812414 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1027/1968] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:09 2022] DELETE /compute/v2.1/images/f84e6dc6-fa37-4b18-a2ed-49a472d2cfef => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:48:09.837208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca00bc7d-1e63-4094-96a1-06a3e9332c9a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:09.840294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ca00bc7d-1e63-4094-96a1-06a3e9332c9a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:09.867026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca00bc7d-1e63-4094-96a1-06a3e9332c9a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:09.870678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca00bc7d-1e63-4094-96a1-06a3e9332c9a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:09.875214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca00bc7d-1e63-4094-96a1-06a3e9332c9a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:09.878214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca00bc7d-1e63-4094-96a1-06a3e9332c9a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:09.884066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca00bc7d-1e63-4094-96a1-06a3e9332c9a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:09.886812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca00bc7d-1e63-4094-96a1-06a3e9332c9a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:10.340544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-99b6c315-e348-454f-af61-7b1ac0fbcee8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:10.430132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-99b6c315-e348-454f-af61-7b1ac0fbcee8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:10.457255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-99b6c315-e348-454f-af61-7b1ac0fbcee8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:10.471206 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-99b6c315-e348-454f-af61-7b1ac0fbcee8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 1.035529 Sep 08 12:48:10.500917 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 942/1969] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:09 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:10.553259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-24d4ef6d-f1ba-4d38-b56a-cc06d6339563 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3f1ef550>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:10.619072 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-24d4ef6d-f1ba-4d38-b56a-cc06d6339563 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] HTTP exception thrown: Image not found. Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-24d4ef6d-f1ba-4d38-b56a-cc06d6339563 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Request method failure captured: Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/images/f84e6dc6-fa37-4b18-a2ed-49a472d2cfef HTTP/1.1 Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeNb2bGFcbBOl1cv4HEaMaAcRwEepQEALA8WfW0-v4blJtuEPlA6Ak20pW-TClT7v4Sic5V2MPVgN13m0hRsfRCjYih8szkeR_avMQqTYHvLLc_9M5iUXeA8-GcUpqR4WsJKo5PzyZm-yg5hB6obGHogWgMaqtj5K3ekVR3iyfIgcUA Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:10.644589 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c486d69d062749c7b334423a3a89cc13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesTestJSON-163488162 Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b1900295263741188d26b49e7e8b4036 Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: exception: Image not found. Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'f84e6dc6-fa37-4b18-a2ed-49a472d2cfef'} Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:10.648733 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f84e6dc6-fa37-4b18-a2ed-49a472d2cfef Sep 08 12:48:10.651612 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:48:10.656991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f84e6dc6-fa37-4b18-a2ed-49a472d2cfef could not be found. Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:48:10.663936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:48:10.671773 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:10.676322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-24d4ef6d-f1ba-4d38-b56a-cc06d6339563 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Returning 404 to user: Image not found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:10.684080 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-24d4ef6d-f1ba-4d38-b56a-cc06d6339563 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/images/f84e6dc6-fa37-4b18-a2ed-49a472d2cfef" status: 404 len: 62 microversion: 2.1 time: 0.158141 Sep 08 12:48:10.688778 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 943/1970] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:48:10 2022] GET /compute/v2.1/images/f84e6dc6-fa37-4b18-a2ed-49a472d2cfef => generated 62 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:48:10.724491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2bfe8c24-ebc2-4a9e-9d8f-d2b44810a230 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:10.731685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2bfe8c24-ebc2-4a9e-9d8f-d2b44810a230 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:10.735295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ca00bc7d-1e63-4094-96a1-06a3e9332c9a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:10.757040 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca00bc7d-1e63-4094-96a1-06a3e9332c9a tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1521 microversion: 2.1 time: 0.942242 Sep 08 12:48:10.758662 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1028/1971] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:09 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1521 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:10.773227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-57e53adf-fab8-4249-ba3c-558d3f13e624 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:10.782083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-57e53adf-fab8-4249-ba3c-558d3f13e624 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:10.793303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bfe8c24-ebc2-4a9e-9d8f-d2b44810a230 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:10.794452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bfe8c24-ebc2-4a9e-9d8f-d2b44810a230 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:10.795285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bfe8c24-ebc2-4a9e-9d8f-d2b44810a230 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:10.797743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bfe8c24-ebc2-4a9e-9d8f-d2b44810a230 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:10.800384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bfe8c24-ebc2-4a9e-9d8f-d2b44810a230 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:10.804372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bfe8c24-ebc2-4a9e-9d8f-d2b44810a230 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:10.810378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e53adf-fab8-4249-ba3c-558d3f13e624 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:10.811893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e53adf-fab8-4249-ba3c-558d3f13e624 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:10.813088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e53adf-fab8-4249-ba3c-558d3f13e624 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:10.821949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e53adf-fab8-4249-ba3c-558d3f13e624 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:10.824372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e53adf-fab8-4249-ba3c-558d3f13e624 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:10.825273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e53adf-fab8-4249-ba3c-558d3f13e624 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:11.408295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:11.747415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2bfe8c24-ebc2-4a9e-9d8f-d2b44810a230 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:11.757555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-57e53adf-fab8-4249-ba3c-558d3f13e624 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:11.762327 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2bfe8c24-ebc2-4a9e-9d8f-d2b44810a230 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 200 len: 1324 microversion: 2.1 time: 1.063547 Sep 08 12:48:11.773510 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-57e53adf-fab8-4249-ba3c-558d3f13e624 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1503 microversion: 2.1 time: 1.012473 Sep 08 12:48:11.773898 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 944/1972] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:10 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 1324 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:11.777905 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1029/1973] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:10 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1503 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:11.789339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b5abfc3b-145f-4716-a311-25dbc69e466f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:11.790257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b5abfc3b-145f-4716-a311-25dbc69e466f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:11.791460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a01215e3-a836-4f18-9abb-4aca113eb2c9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:11.792032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a01215e3-a836-4f18-9abb-4aca113eb2c9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:11.798869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5abfc3b-145f-4716-a311-25dbc69e466f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:11.799727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5abfc3b-145f-4716-a311-25dbc69e466f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:11.800344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5abfc3b-145f-4716-a311-25dbc69e466f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:11.801919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5abfc3b-145f-4716-a311-25dbc69e466f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:11.802610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5abfc3b-145f-4716-a311-25dbc69e466f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:11.803209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5abfc3b-145f-4716-a311-25dbc69e466f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:11.811911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a01215e3-a836-4f18-9abb-4aca113eb2c9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:11.816805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a01215e3-a836-4f18-9abb-4aca113eb2c9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:11.817437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a01215e3-a836-4f18-9abb-4aca113eb2c9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:11.831122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a01215e3-a836-4f18-9abb-4aca113eb2c9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:11.837617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a01215e3-a836-4f18-9abb-4aca113eb2c9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:11.838126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a01215e3-a836-4f18-9abb-4aca113eb2c9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:11.917150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a01215e3-a836-4f18-9abb-4aca113eb2c9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:48:12.009757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:12.129402 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a01215e3-a836-4f18-9abb-4aca113eb2c9 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "DELETE /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 204 len: 0 microversion: 2.1 time: 0.348644 Sep 08 12:48:12.130818 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1030/1974] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:48:11 2022] DELETE /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:48:12.158727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-547f9148-e8a7-48c6-86ed-b26a3d142975 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:12.165729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-547f9148-e8a7-48c6-86ed-b26a3d142975 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:12.203961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-547f9148-e8a7-48c6-86ed-b26a3d142975 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:12.210560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-547f9148-e8a7-48c6-86ed-b26a3d142975 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:12.211726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-547f9148-e8a7-48c6-86ed-b26a3d142975 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:12.213290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-547f9148-e8a7-48c6-86ed-b26a3d142975 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:12.224174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-547f9148-e8a7-48c6-86ed-b26a3d142975 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:12.229852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-547f9148-e8a7-48c6-86ed-b26a3d142975 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:13.007916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-547f9148-e8a7-48c6-86ed-b26a3d142975 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:13.018585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-547f9148-e8a7-48c6-86ed-b26a3d142975 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:13.034077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-547f9148-e8a7-48c6-86ed-b26a3d142975 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:13.035947 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-547f9148-e8a7-48c6-86ed-b26a3d142975 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 0.903338 Sep 08 12:48:13.037765 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1031/1975] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:12 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:13.050409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-31732946-acec-433e-8ced-e7d1d035d5f4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:13.051629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-31732946-acec-433e-8ced-e7d1d035d5f4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:13.065725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31732946-acec-433e-8ced-e7d1d035d5f4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:13.066231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31732946-acec-433e-8ced-e7d1d035d5f4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:13.066674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31732946-acec-433e-8ced-e7d1d035d5f4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:13.067526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31732946-acec-433e-8ced-e7d1d035d5f4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:13.068472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31732946-acec-433e-8ced-e7d1d035d5f4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:13.068943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31732946-acec-433e-8ced-e7d1d035d5f4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:13.103554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b5abfc3b-145f-4716-a311-25dbc69e466f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:13.117019 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b5abfc3b-145f-4716-a311-25dbc69e466f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1488 microversion: 2.1 time: 1.335577 Sep 08 12:48:13.117628 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 945/1976] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:11 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1488 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:13.131554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc5d611b-dec5-4915-889e-b5e1f8fa49ce tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:13.131554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fc5d611b-dec5-4915-889e-b5e1f8fa49ce tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:13.147086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc5d611b-dec5-4915-889e-b5e1f8fa49ce tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:13.147548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc5d611b-dec5-4915-889e-b5e1f8fa49ce tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:13.148008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc5d611b-dec5-4915-889e-b5e1f8fa49ce tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:13.148795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc5d611b-dec5-4915-889e-b5e1f8fa49ce tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:13.149269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc5d611b-dec5-4915-889e-b5e1f8fa49ce tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:13.149704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc5d611b-dec5-4915-889e-b5e1f8fa49ce tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:13.612884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-31732946-acec-433e-8ced-e7d1d035d5f4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:13.635058 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-31732946-acec-433e-8ced-e7d1d035d5f4 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1527 microversion: 2.1 time: 0.595835 Sep 08 12:48:13.640269 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1032/1977] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:13 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1527 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:13.655139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-57e0f6ad-b954-4ec2-9978-469082819d93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:13.660562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-57e0f6ad-b954-4ec2-9978-469082819d93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:13.676292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e0f6ad-b954-4ec2-9978-469082819d93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:13.679536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e0f6ad-b954-4ec2-9978-469082819d93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:13.682358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e0f6ad-b954-4ec2-9978-469082819d93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:13.684497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e0f6ad-b954-4ec2-9978-469082819d93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:13.687468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e0f6ad-b954-4ec2-9978-469082819d93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:13.689903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e0f6ad-b954-4ec2-9978-469082819d93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:14.000029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fc5d611b-dec5-4915-889e-b5e1f8fa49ce tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:14.021948 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fc5d611b-dec5-4915-889e-b5e1f8fa49ce tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 200 len: 1324 microversion: 2.1 time: 0.902727 Sep 08 12:48:14.024921 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 946/1978] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:13 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 1324 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:14.410201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3d5ef777-157f-4a84-9df3-83e4f0774232 req-12d93cb1-c2c2-4954-bf17-480f7b02fbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "badbb586-c456-4f32-8edc-09050258e2c2", "name": "network-vif-plugged", "status": "completed", "tag": "33b1a4eb-d0d9-47e3-93a8-eb5b7665e5ea"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:14.440964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3d5ef777-157f-4a84-9df3-83e4f0774232 req-12d93cb1-c2c2-4954-bf17-480f7b02fbb8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:14.441598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3d5ef777-157f-4a84-9df3-83e4f0774232 req-12d93cb1-c2c2-4954-bf17-480f7b02fbb8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:14.442614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3d5ef777-157f-4a84-9df3-83e4f0774232 req-12d93cb1-c2c2-4954-bf17-480f7b02fbb8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:14.486989 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3d5ef777-157f-4a84-9df3-83e4f0774232 req-12d93cb1-c2c2-4954-bf17-480f7b02fbb8 service nova] Creating event network-vif-plugged:33b1a4eb-d0d9-47e3-93a8-eb5b7665e5ea for instance badbb586-c456-4f32-8edc-09050258e2c2 on n-h2-852084-10 Sep 08 12:48:14.503182 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3d5ef777-157f-4a84-9df3-83e4f0774232 req-12d93cb1-c2c2-4954-bf17-480f7b02fbb8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.474360 Sep 08 12:48:14.506199 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 947/1979] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:15.125422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-57e0f6ad-b954-4ec2-9978-469082819d93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:15.160468 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-57e0f6ad-b954-4ec2-9978-469082819d93 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 200 len: 1503 microversion: 2.1 time: 1.518639 Sep 08 12:48:15.198171 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1033/1980] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:13 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 1503 bytes in 1557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:15.212396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-136fcbf8-b85a-49ab-bd76-d90c693601ca tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:15.220383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-136fcbf8-b85a-49ab-bd76-d90c693601ca tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:15.244668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-136fcbf8-b85a-49ab-bd76-d90c693601ca tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:15.250114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-136fcbf8-b85a-49ab-bd76-d90c693601ca tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:15.250968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-136fcbf8-b85a-49ab-bd76-d90c693601ca tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:15.252080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-136fcbf8-b85a-49ab-bd76-d90c693601ca tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:15.254434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-136fcbf8-b85a-49ab-bd76-d90c693601ca tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:15.262337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-136fcbf8-b85a-49ab-bd76-d90c693601ca tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:15.298117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ab952b10-304d-48a4-9a5c-e2274adcf9bb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:15.299993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ab952b10-304d-48a4-9a5c-e2274adcf9bb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:15.317252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab952b10-304d-48a4-9a5c-e2274adcf9bb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:15.321030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab952b10-304d-48a4-9a5c-e2274adcf9bb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:15.321641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab952b10-304d-48a4-9a5c-e2274adcf9bb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:15.325087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab952b10-304d-48a4-9a5c-e2274adcf9bb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:15.325810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab952b10-304d-48a4-9a5c-e2274adcf9bb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:15.328569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab952b10-304d-48a4-9a5c-e2274adcf9bb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:15.401914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ab952b10-304d-48a4-9a5c-e2274adcf9bb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:48:15.606508 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ab952b10-304d-48a4-9a5c-e2274adcf9bb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 204 len: 0 microversion: 2.1 time: 1.093139 Sep 08 12:48:15.614377 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 948/1981] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:48:14 2022] DELETE /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 0 bytes in 1096 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:48:15.937814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-136fcbf8-b85a-49ab-bd76-d90c693601ca tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:15.978956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-136fcbf8-b85a-49ab-bd76-d90c693601ca tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:15.983465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-136fcbf8-b85a-49ab-bd76-d90c693601ca tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:15.987491 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-136fcbf8-b85a-49ab-bd76-d90c693601ca tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 0.787459 Sep 08 12:48:15.991163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-344090d1-cdcc-4927-bbcd-bff6e37c6705 req-24660e36-88f9-48fd-af5e-955ebb89e471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f", "name": "network-vif-deleted", "tag": "e368f8a1-84db-49b8-b146-dd5064ae7f33"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:15.995948 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1034/1982] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:15 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:16.028695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4ec9b711-e162-4fa4-9423-c38317a78490 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:16.030458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4ec9b711-e162-4fa4-9423-c38317a78490 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:16.059531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-344090d1-cdcc-4927-bbcd-bff6e37c6705 req-24660e36-88f9-48fd-af5e-955ebb89e471 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:16.063066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ec9b711-e162-4fa4-9423-c38317a78490 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:16.065236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ec9b711-e162-4fa4-9423-c38317a78490 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:16.066585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ec9b711-e162-4fa4-9423-c38317a78490 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:16.069861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ec9b711-e162-4fa4-9423-c38317a78490 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:16.070189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-344090d1-cdcc-4927-bbcd-bff6e37c6705 req-24660e36-88f9-48fd-af5e-955ebb89e471 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:16.071002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-344090d1-cdcc-4927-bbcd-bff6e37c6705 req-24660e36-88f9-48fd-af5e-955ebb89e471 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:16.071986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ec9b711-e162-4fa4-9423-c38317a78490 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:16.073224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ec9b711-e162-4fa4-9423-c38317a78490 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:16.120932 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-344090d1-cdcc-4927-bbcd-bff6e37c6705 req-24660e36-88f9-48fd-af5e-955ebb89e471 service nova] Creating event network-vif-deleted:e368f8a1-84db-49b8-b146-dd5064ae7f33 for instance 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f on n-h1-852084-10 Sep 08 12:48:16.144335 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-344090d1-cdcc-4927-bbcd-bff6e37c6705 req-24660e36-88f9-48fd-af5e-955ebb89e471 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.529174 Sep 08 12:48:16.146572 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 949/1983] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:16.164030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d4c794e1-898a-42fe-a047-ceabcb723c47 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:16.166851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d4c794e1-898a-42fe-a047-ceabcb723c47 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:16.178928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4c794e1-898a-42fe-a047-ceabcb723c47 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:16.180102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4c794e1-898a-42fe-a047-ceabcb723c47 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:16.181068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4c794e1-898a-42fe-a047-ceabcb723c47 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:16.182694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4c794e1-898a-42fe-a047-ceabcb723c47 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:16.184205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4c794e1-898a-42fe-a047-ceabcb723c47 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:16.185189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4c794e1-898a-42fe-a047-ceabcb723c47 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:16.620407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4ec9b711-e162-4fa4-9423-c38317a78490 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:16.648166 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4ec9b711-e162-4fa4-9423-c38317a78490 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1485 microversion: 2.1 time: 0.648942 Sep 08 12:48:16.668280 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1035/1984] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:15 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1485 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:16.703505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e64769ee-82a7-476a-8417-d47d2280360b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3f29b430>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:16.809690 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e64769ee-82a7-476a-8417-d47d2280360b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] HTTP exception thrown: Image not found. Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e64769ee-82a7-476a-8417-d47d2280360b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Request method failure captured: Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/images/f84e6dc6-fa37-4b18-a2ed-49a472d2cfef HTTP/1.1 Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeNb2bGFcbBOl1cv4HEaMaAcRwEepQEALA8WfW0-v4blJtuEPlA6Ak20pW-TClT7v4Sic5V2MPVgN13m0hRsfRCjYih8szkeR_avMQqTYHvLLc_9M5iUXeA8-GcUpqR4WsJKo5PzyZm-yg5hB6obGHogWgMaqtj5K3ekVR3iyfIgcUA Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:48:16.814692 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c486d69d062749c7b334423a3a89cc13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesTestJSON-163488162 Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b1900295263741188d26b49e7e8b4036 Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: exception: Image not found. Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'f84e6dc6-fa37-4b18-a2ed-49a472d2cfef'} Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:16.817410 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image f84e6dc6-fa37-4b18-a2ed-49a472d2cfef to delete Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:16.819286 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f84e6dc6-fa37-4b18-a2ed-49a472d2cfef could not be found. Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:16.821840 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e64769ee-82a7-476a-8417-d47d2280360b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Returning 404 to user: Image not found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:16.828891 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e64769ee-82a7-476a-8417-d47d2280360b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/images/f84e6dc6-fa37-4b18-a2ed-49a472d2cfef" status: 404 len: 62 microversion: 2.1 time: 0.156337 Sep 08 12:48:16.835346 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1036/1985] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:16 2022] DELETE /compute/v2.1/images/f84e6dc6-fa37-4b18-a2ed-49a472d2cfef => generated 62 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:48:16.844710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4a56d0e5-48c8-47ca-9cab-43e5cd00008d tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:16.846811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4a56d0e5-48c8-47ca-9cab-43e5cd00008d tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:16.874243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a56d0e5-48c8-47ca-9cab-43e5cd00008d tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:16.876884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a56d0e5-48c8-47ca-9cab-43e5cd00008d tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:16.878221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a56d0e5-48c8-47ca-9cab-43e5cd00008d tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:16.887324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a56d0e5-48c8-47ca-9cab-43e5cd00008d tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:16.888751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a56d0e5-48c8-47ca-9cab-43e5cd00008d tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:16.890005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a56d0e5-48c8-47ca-9cab-43e5cd00008d tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:16.959213 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-4a56d0e5-48c8-47ca-9cab-43e5cd00008d tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] HTTP exception thrown: Instance 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f could not be found. Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4a56d0e5-48c8-47ca-9cab-43e5cd00008d tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Request method failure captured: Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f HTTP/1.1 Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGePrRMX1l1oR3-Jt6uKf15WyMRY8bZ_kJOKraZuglPtaQlIX9jAXJwDMq2_kG1CiAGRsWHwHIxOuc0tI_a1ZN99PaGUq0z14ky20mKkqsNosiGxU3DbJJFBXAL0E6ukBkAED7mGHo2lFSN_gO5_ohVcGCCqLKCCtUHmxgcBlLSqcTzM Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 140b9d3cf7484c5784af2808e1ba0954 Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerRescueTestJSON-2109499988 Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:48:16.966982 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:48:16.970068 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_140b9d3cf7484c5784af2808e1ba0954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/140b9d3cf7484c5784af2808e1ba0954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/140b9d3cf7484c5784af2808e1ba0954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/140b9d3cf7484c5784af2808e1ba0954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:16.970068 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerRescueTestJSON-2109499988 Sep 08 12:48:16.970068 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 140b9d3cf7484c5784af2808e1ba0954 Sep 08 12:48:16.970068 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerRescueTestJSON-2109499988 Sep 08 12:48:16.970068 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerRescueTestJSON-2109499988-project Sep 08 12:48:16.970068 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:48:16.970068 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:48:16.970068 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 15d486316fc448eaa9f35bbf895ac50a Sep 08 12:48:16.970068 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerRescueTestJSON-2109499988-project Sep 08 12:48:16.970068 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:48:16.970068 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f could not be found. Sep 08 12:48:16.970068 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f'} Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f could not be found. Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:16.972596 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f could not be found. Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f could not be found. Sep 08 12:48:16.977848 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:16.987433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4a56d0e5-48c8-47ca-9cab-43e5cd00008d tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Returning 404 to user: Instance 6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:16.987433 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4a56d0e5-48c8-47ca-9cab-43e5cd00008d tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f" status: 404 len: 111 microversion: 2.1 time: 0.138263 Sep 08 12:48:16.992591 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1037/1986] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:16 2022] GET /compute/v2.1/servers/6df6c103-a5f4-4cef-91cb-b9b1b5c1ad8f => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:17.015453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d6c1a76a-0d12-476c-9ab5-cbd44ddfbcf9 req-a971a84d-1f61-419f-951f-e958cfb9b687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfe69bb-91ad-499f-9f12-de0ac60519b6", "name": "network-vif-plugged", "status": "completed", "tag": "feb64804-e1ff-419a-8a16-60a42fef7a86"}, {"server_uuid": "202a5721-a9d4-400b-b2a6-56586bc32e83", "name": "network-vif-unplugged", "status": "completed", "tag": "fb380d9e-a756-4dbf-b677-997e0408fe77"}, {"server_uuid": "badbb586-c456-4f32-8edc-09050258e2c2", "name": "network-vif-unplugged", "status": "completed", "tag": "33b1a4eb-d0d9-47e3-93a8-eb5b7665e5ea"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:17.068342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d6c1a76a-0d12-476c-9ab5-cbd44ddfbcf9 req-a971a84d-1f61-419f-951f-e958cfb9b687 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:17.069410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d6c1a76a-0d12-476c-9ab5-cbd44ddfbcf9 req-a971a84d-1f61-419f-951f-e958cfb9b687 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:17.071838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d6c1a76a-0d12-476c-9ab5-cbd44ddfbcf9 req-a971a84d-1f61-419f-951f-e958cfb9b687 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:17.144628 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d6c1a76a-0d12-476c-9ab5-cbd44ddfbcf9 req-a971a84d-1f61-419f-951f-e958cfb9b687 service nova] Creating event network-vif-plugged:feb64804-e1ff-419a-8a16-60a42fef7a86 for instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 on n-h1-852084-10 Sep 08 12:48:17.146729 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d6c1a76a-0d12-476c-9ab5-cbd44ddfbcf9 req-a971a84d-1f61-419f-951f-e958cfb9b687 service nova] Creating event network-vif-unplugged:fb380d9e-a756-4dbf-b677-997e0408fe77 for instance 202a5721-a9d4-400b-b2a6-56586bc32e83 on n-h2-852084-10 Sep 08 12:48:17.147801 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d6c1a76a-0d12-476c-9ab5-cbd44ddfbcf9 req-a971a84d-1f61-419f-951f-e958cfb9b687 service nova] Creating event network-vif-unplugged:33b1a4eb-d0d9-47e3-93a8-eb5b7665e5ea for instance badbb586-c456-4f32-8edc-09050258e2c2 on n-h2-852084-10 Sep 08 12:48:17.202077 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d6c1a76a-0d12-476c-9ab5-cbd44ddfbcf9 req-a971a84d-1f61-419f-951f-e958cfb9b687 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 529 microversion: 2.1 time: 0.204493 Sep 08 12:48:17.203117 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1038/1987] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:16 2022] POST /compute/v2.1/os-server-external-events => generated 529 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:17.228113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-87eff4e4-60b4-48ef-9b86-097d3b0f5bc2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:17.234163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-87eff4e4-60b4-48ef-9b86-097d3b0f5bc2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:17.293315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87eff4e4-60b4-48ef-9b86-097d3b0f5bc2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:17.294334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87eff4e4-60b4-48ef-9b86-097d3b0f5bc2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:17.299561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87eff4e4-60b4-48ef-9b86-097d3b0f5bc2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:17.305992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87eff4e4-60b4-48ef-9b86-097d3b0f5bc2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:17.306936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87eff4e4-60b4-48ef-9b86-097d3b0f5bc2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:17.307778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87eff4e4-60b4-48ef-9b86-097d3b0f5bc2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:17.519525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-87eff4e4-60b4-48ef-9b86-097d3b0f5bc2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:48:17.684215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d4c794e1-898a-42fe-a047-ceabcb723c47 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:17.714779 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d4c794e1-898a-42fe-a047-ceabcb723c47 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 200 len: 1324 microversion: 2.1 time: 1.565938 Sep 08 12:48:17.721693 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 950/1988] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:16 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 1324 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:17.750170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d470d14c-15e8-4a56-a449-41f008fac6e6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:17.761032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d470d14c-15e8-4a56-a449-41f008fac6e6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:17.814634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d470d14c-15e8-4a56-a449-41f008fac6e6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:17.815907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d470d14c-15e8-4a56-a449-41f008fac6e6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:17.820535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d470d14c-15e8-4a56-a449-41f008fac6e6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:17.823946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d470d14c-15e8-4a56-a449-41f008fac6e6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:17.824845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d470d14c-15e8-4a56-a449-41f008fac6e6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:17.825939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d470d14c-15e8-4a56-a449-41f008fac6e6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:17.840296 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.compute.api [None req-87eff4e4-60b4-48ef-9b86-097d3b0f5bc2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Instance is already in deleting state, ignoring this request Sep 08 12:48:17.842229 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-87eff4e4-60b4-48ef-9b86-097d3b0f5bc2 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 204 len: 0 microversion: 2.1 time: 0.633846 Sep 08 12:48:17.859512 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1039/1989] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:48:17 2022] DELETE /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:48:17.893932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1fbfce84-8046-462a-b7eb-8057c1fe2d5e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:17.895076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1fbfce84-8046-462a-b7eb-8057c1fe2d5e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:17.940560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1fbfce84-8046-462a-b7eb-8057c1fe2d5e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:17.946639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1fbfce84-8046-462a-b7eb-8057c1fe2d5e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:17.947861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1fbfce84-8046-462a-b7eb-8057c1fe2d5e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:17.964997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1fbfce84-8046-462a-b7eb-8057c1fe2d5e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:17.965888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1fbfce84-8046-462a-b7eb-8057c1fe2d5e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:17.966706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1fbfce84-8046-462a-b7eb-8057c1fe2d5e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:18.033185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d470d14c-15e8-4a56-a449-41f008fac6e6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:48:18.291826 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d470d14c-15e8-4a56-a449-41f008fac6e6 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 204 len: 0 microversion: 2.1 time: 0.566692 Sep 08 12:48:18.292928 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 951/1990] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:48:17 2022] DELETE /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:48:18.656459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-1e612d2d-1d9a-431d-9a47-fb34ce80cdc2 req-923fdb76-c93c-4225-8634-d15f866057ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "202a5721-a9d4-400b-b2a6-56586bc32e83", "name": "network-vif-deleted", "tag": "fb380d9e-a756-4dbf-b677-997e0408fe77"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:18.696379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1e612d2d-1d9a-431d-9a47-fb34ce80cdc2 req-923fdb76-c93c-4225-8634-d15f866057ee service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:18.701967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1e612d2d-1d9a-431d-9a47-fb34ce80cdc2 req-923fdb76-c93c-4225-8634-d15f866057ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:18.703762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1e612d2d-1d9a-431d-9a47-fb34ce80cdc2 req-923fdb76-c93c-4225-8634-d15f866057ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:18.751665 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-1e612d2d-1d9a-431d-9a47-fb34ce80cdc2 req-923fdb76-c93c-4225-8634-d15f866057ee service nova] Creating event network-vif-deleted:fb380d9e-a756-4dbf-b677-997e0408fe77 for instance 202a5721-a9d4-400b-b2a6-56586bc32e83 on n-h2-852084-10 Sep 08 12:48:18.771414 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-1e612d2d-1d9a-431d-9a47-fb34ce80cdc2 req-923fdb76-c93c-4225-8634-d15f866057ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.468778 Sep 08 12:48:18.772206 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 952/1991] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:18.781006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:18.787703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:18.795682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:18.796081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:18.796927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:18.798049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:18.798999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:18.800408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:18.907903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:18.909905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:18.916472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:18.918152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lazy-loading 'fault' on Instance uuid 202a5721-a9d4-400b-b2a6-56586bc32e83 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:48:19.026785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1fbfce84-8046-462a-b7eb-8057c1fe2d5e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:19.046503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1fbfce84-8046-462a-b7eb-8057c1fe2d5e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:19.053212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1fbfce84-8046-462a-b7eb-8057c1fe2d5e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:19.057722 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1fbfce84-8046-462a-b7eb-8057c1fe2d5e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 1.195571 Sep 08 12:48:19.060426 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1040/1992] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:17 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:19.082752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ebe7d3d-1f53-48b4-b059-345435511cd9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:19.089842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8ebe7d3d-1f53-48b4-b059-345435511cd9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:19.102628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b96cccdfbf149fc880cb1dfb29d416a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '501fb79cb7544fe4995bc7122c87dbad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:19.125400 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6c9091dc-6353-4bd1-b12e-b9a0984065d8 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 200 len: 1314 microversion: 2.1 time: 0.348356 Sep 08 12:48:19.151298 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 953/1993] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:18 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 1314 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:19.163896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ebe7d3d-1f53-48b4-b059-345435511cd9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:19.164501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ebe7d3d-1f53-48b4-b059-345435511cd9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:19.165992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ebe7d3d-1f53-48b4-b059-345435511cd9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:19.166686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ebe7d3d-1f53-48b4-b059-345435511cd9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:19.166898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ebe7d3d-1f53-48b4-b059-345435511cd9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:19.181998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-125bb48d-48d3-4f60-a2ef-f040bf379896 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:19.182623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-125bb48d-48d3-4f60-a2ef-f040bf379896 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:19.189755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ebe7d3d-1f53-48b4-b059-345435511cd9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:19.213793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-125bb48d-48d3-4f60-a2ef-f040bf379896 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:19.214206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-125bb48d-48d3-4f60-a2ef-f040bf379896 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:19.219583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-125bb48d-48d3-4f60-a2ef-f040bf379896 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:19.221954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-125bb48d-48d3-4f60-a2ef-f040bf379896 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:19.225303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-125bb48d-48d3-4f60-a2ef-f040bf379896 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:19.229328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-125bb48d-48d3-4f60-a2ef-f040bf379896 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:19.276679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:20.278191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-125bb48d-48d3-4f60-a2ef-f040bf379896 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:20.291099 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-125bb48d-48d3-4f60-a2ef-f040bf379896 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1489 microversion: 2.1 time: 1.137659 Sep 08 12:48:20.291777 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 954/1994] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:19 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1489 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:20.320188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e9474c4-1179-47c6-869d-735a4a1e6ff7 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:20.320714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8e9474c4-1179-47c6-869d-735a4a1e6ff7 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:20.354032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e9474c4-1179-47c6-869d-735a4a1e6ff7 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:20.357974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e9474c4-1179-47c6-869d-735a4a1e6ff7 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:20.359173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e9474c4-1179-47c6-869d-735a4a1e6ff7 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:20.362473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e9474c4-1179-47c6-869d-735a4a1e6ff7 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:20.365268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e9474c4-1179-47c6-869d-735a4a1e6ff7 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:20.366128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e9474c4-1179-47c6-869d-735a4a1e6ff7 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:21.041393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8ebe7d3d-1f53-48b4-b059-345435511cd9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1900295263741188d26b49e7e8b4036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c486d69d062749c7b334423a3a89cc13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:21.074422 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8ebe7d3d-1f53-48b4-b059-345435511cd9 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 200 len: 1494 microversion: 2.1 time: 2.008846 Sep 08 12:48:21.079164 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1041/1995] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:19 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 1494 bytes in 2016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:21.105065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1c9486d5-5dc9-409d-901f-8a0d135aa20d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:21.106782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1c9486d5-5dc9-409d-901f-8a0d135aa20d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:21.131595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c9486d5-5dc9-409d-901f-8a0d135aa20d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:21.135818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c9486d5-5dc9-409d-901f-8a0d135aa20d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:21.140582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c9486d5-5dc9-409d-901f-8a0d135aa20d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:21.144989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c9486d5-5dc9-409d-901f-8a0d135aa20d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:21.149890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c9486d5-5dc9-409d-901f-8a0d135aa20d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:21.152602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c9486d5-5dc9-409d-901f-8a0d135aa20d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:22.025827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8e9474c4-1179-47c6-869d-735a4a1e6ff7 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:22.063257 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8e9474c4-1179-47c6-869d-735a4a1e6ff7 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 200 len: 1520 microversion: 2.1 time: 1.768554 Sep 08 12:48:22.069760 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 955/1996] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:20 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 1520 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:22.090880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e5cff883-66b3-40bb-92e8-edf769e0c7f0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:22.095474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e5cff883-66b3-40bb-92e8-edf769e0c7f0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 202a5721-a9d4-400b-b2a6-56586bc32e83] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:22.122584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5cff883-66b3-40bb-92e8-edf769e0c7f0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:22.125124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5cff883-66b3-40bb-92e8-edf769e0c7f0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:22.125933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5cff883-66b3-40bb-92e8-edf769e0c7f0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:22.130654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5cff883-66b3-40bb-92e8-edf769e0c7f0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:22.132736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5cff883-66b3-40bb-92e8-edf769e0c7f0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:22.135988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5cff883-66b3-40bb-92e8-edf769e0c7f0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:22.215920 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e5cff883-66b3-40bb-92e8-edf769e0c7f0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] HTTP exception thrown: Instance 202a5721-a9d4-400b-b2a6-56586bc32e83 could not be found. Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e5cff883-66b3-40bb-92e8-edf769e0c7f0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 HTTP/1.1 Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:22.228069 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:22.231257 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:22.231257 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:22.231257 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:22.231257 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:22.231257 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:22.231257 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:22.231257 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:22.231257 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:48:22.231257 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:22.231257 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:48:22.231257 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 202a5721-a9d4-400b-b2a6-56586bc32e83 could not be found. Sep 08 12:48:22.231257 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '202a5721-a9d4-400b-b2a6-56586bc32e83'} Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 202a5721-a9d4-400b-b2a6-56586bc32e83 could not be found. Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:22.232586 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 202a5721-a9d4-400b-b2a6-56586bc32e83 could not be found. Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 202a5721-a9d4-400b-b2a6-56586bc32e83 could not be found. Sep 08 12:48:22.234644 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:22.236777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e5cff883-66b3-40bb-92e8-edf769e0c7f0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 404 to user: Instance 202a5721-a9d4-400b-b2a6-56586bc32e83 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:22.236777 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e5cff883-66b3-40bb-92e8-edf769e0c7f0 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83" status: 404 len: 111 microversion: 2.1 time: 0.160481 Sep 08 12:48:22.244667 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 956/1997] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:22 2022] GET /compute/v2.1/servers/202a5721-a9d4-400b-b2a6-56586bc32e83 => generated 111 bytes in 173 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:22.599704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-45eea7fd-3e35-4180-bbe1-ce7395f8852d tempest-QuotaClassesAdmin257Test-821659555 tempest-QuotaClassesAdmin257Test-821659555-project-admin] Calling method '.version_select at 0x7fdb3f1c0310>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:22.608720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:22.650752 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-45eea7fd-3e35-4180-bbe1-ce7395f8852d tempest-QuotaClassesAdmin257Test-821659555 tempest-QuotaClassesAdmin257Test-821659555-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.401939 Sep 08 12:48:22.667338 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 957/1998] 10.222.0.78 () {60 vars in 1226 bytes} [Thu Sep 8 12:48:22 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:48:22.686139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9f145b97-6c48-48d8-9364-3237ea817748 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:22.689517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9f145b97-6c48-48d8-9364-3237ea817748 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:22.722856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f145b97-6c48-48d8-9364-3237ea817748 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:22.725565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f145b97-6c48-48d8-9364-3237ea817748 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:22.726349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f145b97-6c48-48d8-9364-3237ea817748 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:22.730822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f145b97-6c48-48d8-9364-3237ea817748 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:22.734015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f145b97-6c48-48d8-9364-3237ea817748 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:22.738315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f145b97-6c48-48d8-9364-3237ea817748 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:22.787634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1c9486d5-5dc9-409d-901f-8a0d135aa20d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:22.822890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1c9486d5-5dc9-409d-901f-8a0d135aa20d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:22.828288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1c9486d5-5dc9-409d-901f-8a0d135aa20d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:22.834437 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1c9486d5-5dc9-409d-901f-8a0d135aa20d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 1.751369 Sep 08 12:48:22.836973 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1042/1999] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:21 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 1756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:22.854008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6bfcbccc-ae90-4457-8037-9edf67fde33b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Action: 'create', calling method: .version_select at 0x7fdb363fa5e0>, body: {"pool": null} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:24.298040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9f145b97-6c48-48d8-9364-3237ea817748 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15d486316fc448eaa9f35bbf895ac50a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140b9d3cf7484c5784af2808e1ba0954', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:24.332849 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9f145b97-6c48-48d8-9364-3237ea817748 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 200 len: 1489 microversion: 2.1 time: 1.672486 Sep 08 12:48:24.335612 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 958/2000] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:22 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 1489 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:24.348852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ab4ca36d-c34b-4b02-b04b-716d499dee16 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:24.350978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ab4ca36d-c34b-4b02-b04b-716d499dee16 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: badbb586-c456-4f32-8edc-09050258e2c2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:24.399079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab4ca36d-c34b-4b02-b04b-716d499dee16 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:24.401771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab4ca36d-c34b-4b02-b04b-716d499dee16 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:24.404205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab4ca36d-c34b-4b02-b04b-716d499dee16 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:24.407416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab4ca36d-c34b-4b02-b04b-716d499dee16 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:24.409301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab4ca36d-c34b-4b02-b04b-716d499dee16 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:24.410137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab4ca36d-c34b-4b02-b04b-716d499dee16 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:24.440530 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-ab4ca36d-c34b-4b02-b04b-716d499dee16 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] HTTP exception thrown: Instance badbb586-c456-4f32-8edc-09050258e2c2 could not be found. Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ab4ca36d-c34b-4b02-b04b-716d499dee16 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Request method failure captured: Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 HTTP/1.1 Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeNb2bGFcbBOl1cv4HEaMaAcRwEepQEALA8WfW0-v4blJtuEPlA6Ak20pW-TClT7v4Sic5V2MPVgN13m0hRsfRCjYih8szkeR_avMQqTYHvLLc_9M5iUXeA8-GcUpqR4WsJKo5PzyZm-yg5hB6obGHogWgMaqtj5K3ekVR3iyfIgcUA Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:24.448324 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:24.451913 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c486d69d062749c7b334423a3a89cc13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:24.451913 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesTestJSON-163488162 Sep 08 12:48:24.451913 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:24.451913 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:24.451913 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:24.451913 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:24.451913 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:24.451913 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b1900295263741188d26b49e7e8b4036 Sep 08 12:48:24.451913 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:24.451913 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:48:24.451913 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance badbb586-c456-4f32-8edc-09050258e2c2 could not be found. Sep 08 12:48:24.451913 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'badbb586-c456-4f32-8edc-09050258e2c2'} Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance badbb586-c456-4f32-8edc-09050258e2c2 could not be found. Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:24.454187 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance badbb586-c456-4f32-8edc-09050258e2c2 could not be found. Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance badbb586-c456-4f32-8edc-09050258e2c2 could not be found. Sep 08 12:48:24.459182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:24.462216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ab4ca36d-c34b-4b02-b04b-716d499dee16 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Returning 404 to user: Instance badbb586-c456-4f32-8edc-09050258e2c2 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:24.462216 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ab4ca36d-c34b-4b02-b04b-716d499dee16 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2" status: 404 len: 111 microversion: 2.1 time: 0.120647 Sep 08 12:48:24.462216 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 959/2001] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:24 2022] GET /compute/v2.1/servers/badbb586-c456-4f32-8edc-09050258e2c2 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:24.469605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-91b5fda8-e7c8-4d26-a7ab-fe4a808f0f8c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '.version_select at 0x7fdb3f1c5670>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:24.549633 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-91b5fda8-e7c8-4d26-a7ab-fe4a808f0f8c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] HTTP exception thrown: Image not found. Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-91b5fda8-e7c8-4d26-a7ab-fe4a808f0f8c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/images/21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06 HTTP/1.1 Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:24.552967 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: exception: Image not found. Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06'} Sep 08 12:48:24.555035 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06 to delete Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:24.556500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06 could not be found. Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:24.558127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-91b5fda8-e7c8-4d26-a7ab-fe4a808f0f8c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 404 to user: Image not found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:24.560087 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-91b5fda8-e7c8-4d26-a7ab-fe4a808f0f8c tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "DELETE /compute/v2.1/images/21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06" status: 404 len: 62 microversion: 2.1 time: 0.091923 Sep 08 12:48:24.561657 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 960/2002] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:24 2022] DELETE /compute/v2.1/images/21e5dfa0-0c77-4bfa-ab87-cc37d8fd5a06 => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:48:24.700580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1604707545", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "9324045c-e84a-4063-86c3-13924eff78b4"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:24.827266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] validate_networks() for [('9324045c-e84a-4063-86c3-13924eff78b4', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:48:26.410327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:48:26.412127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:48:26.412127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:48:26.412471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:48:26.412671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:48:26.432046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:26.432865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:26.436200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:26.437289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:26.440874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:26.441618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:26.476253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Getting quotas for project 0c2a7d092bfb409abbaa54af1841ac99. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:48:26.482955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Getting quotas for user 9e7b70f33287409794f79507bd31b81c and project 0c2a7d092bfb409abbaa54af1841ac99. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:48:26.506823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:48:26.510317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:48:26.593899 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7f066c7f-b727-4698-96cb-de5b48a49883 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.035585 Sep 08 12:48:26.598472 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 961/2003] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:48:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:48:26.609980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9e2a256c-67a1-45d6-81dc-85fbffed2495 tempest-QuotaClassesAdmin257Test-821659555 tempest-QuotaClassesAdmin257Test-821659555-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3f1c0310>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:26.798325 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9e2a256c-67a1-45d6-81dc-85fbffed2495 tempest-QuotaClassesAdmin257Test-821659555 tempest-QuotaClassesAdmin257Test-821659555-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.196642 Sep 08 12:48:26.803883 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 962/2004] 10.222.0.78 () {62 vars in 1247 bytes} [Thu Sep 8 12:48:26 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:48:26.809505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-833c1945-c8d2-4e98-91c8-364d4ebf32e7 req-13afead6-e82c-4756-aa02-9744c442b677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "badbb586-c456-4f32-8edc-09050258e2c2", "name": "network-vif-deleted", "tag": "33b1a4eb-d0d9-47e3-93a8-eb5b7665e5ea"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:26.822294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-833c1945-c8d2-4e98-91c8-364d4ebf32e7 req-13afead6-e82c-4756-aa02-9744c442b677 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:26.823127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-833c1945-c8d2-4e98-91c8-364d4ebf32e7 req-13afead6-e82c-4756-aa02-9744c442b677 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:26.824163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-833c1945-c8d2-4e98-91c8-364d4ebf32e7 req-13afead6-e82c-4756-aa02-9744c442b677 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:26.909678 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-833c1945-c8d2-4e98-91c8-364d4ebf32e7 req-13afead6-e82c-4756-aa02-9744c442b677 service nova] Creating event network-vif-deleted:33b1a4eb-d0d9-47e3-93a8-eb5b7665e5ea for instance badbb586-c456-4f32-8edc-09050258e2c2 on n-h2-852084-10 Sep 08 12:48:26.909678 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-833c1945-c8d2-4e98-91c8-364d4ebf32e7 req-13afead6-e82c-4756-aa02-9744c442b677 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058245 Sep 08 12:48:26.909678 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 963/2005] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:26.909678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cebe1165-99e3-4c1c-9d3d-e86bdc5fcfe4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:26.909678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cebe1165-99e3-4c1c-9d3d-e86bdc5fcfe4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:26.914087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cebe1165-99e3-4c1c-9d3d-e86bdc5fcfe4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:26.914087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cebe1165-99e3-4c1c-9d3d-e86bdc5fcfe4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:26.914087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cebe1165-99e3-4c1c-9d3d-e86bdc5fcfe4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:26.914087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cebe1165-99e3-4c1c-9d3d-e86bdc5fcfe4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:26.915661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cebe1165-99e3-4c1c-9d3d-e86bdc5fcfe4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:26.915661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cebe1165-99e3-4c1c-9d3d-e86bdc5fcfe4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:27.392134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cebe1165-99e3-4c1c-9d3d-e86bdc5fcfe4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:27.403497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cebe1165-99e3-4c1c-9d3d-e86bdc5fcfe4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:27.406017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cebe1165-99e3-4c1c-9d3d-e86bdc5fcfe4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:27.407508 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cebe1165-99e3-4c1c-9d3d-e86bdc5fcfe4 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 0.540689 Sep 08 12:48:27.420358 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 964/2006] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:26 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:27.434294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5c13a744-3574-46b0-abf6-27513da05ba5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3abba820>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:27.469659 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-5c13a744-3574-46b0-abf6-27513da05ba5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] HTTP exception thrown: Image not found. Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5c13a744-3574-46b0-abf6-27513da05ba5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Request method failure captured: Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 HTTP/1.1 Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeNb2bGFcbBOl1cv4HEaMaAcRwEepQEALA8WfW0-v4blJtuEPlA6Ak20pW-TClT7v4Sic5V2MPVgN13m0hRsfRCjYih8szkeR_avMQqTYHvLLc_9M5iUXeA8-GcUpqR4WsJKo5PzyZm-yg5hB6obGHogWgMaqtj5K3ekVR3iyfIgcUA Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:27.471872 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c486d69d062749c7b334423a3a89cc13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesTestJSON-163488162 Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b1900295263741188d26b49e7e8b4036 Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: exception: Image not found. Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '4abeccc8-edc3-464d-b646-57e2bcad0b75'} Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:27.479002 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4abeccc8-edc3-464d-b646-57e2bcad0b75 to delete Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.480473 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4abeccc8-edc3-464d-b646-57e2bcad0b75 could not be found. Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:27.482558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5c13a744-3574-46b0-abf6-27513da05ba5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Returning 404 to user: Image not found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5c13a744-3574-46b0-abf6-27513da05ba5 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75" status: 404 len: 62 microversion: 2.1 time: 0.051414 Sep 08 12:48:27.484787 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 965/2007] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:27 2022] DELETE /compute/v2.1/images/4abeccc8-edc3-464d-b646-57e2bcad0b75 => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:48:27.491719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8dc95411-eeb7-4a26-933f-277d3a8ec89b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:27.492222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8dc95411-eeb7-4a26-933f-277d3a8ec89b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:27.514841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dc95411-eeb7-4a26-933f-277d3a8ec89b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:27.524017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dc95411-eeb7-4a26-933f-277d3a8ec89b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:27.524907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dc95411-eeb7-4a26-933f-277d3a8ec89b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:27.526514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dc95411-eeb7-4a26-933f-277d3a8ec89b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:27.527185 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6bfcbccc-ae90-4457-8037-9edf67fde33b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.687182 Sep 08 12:48:27.527876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dc95411-eeb7-4a26-933f-277d3a8ec89b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:27.527986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dc95411-eeb7-4a26-933f-277d3a8ec89b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:27.540895 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1043/2008] 10.222.0.78 () {60 vars in 1170 bytes} [Thu Sep 8 12:48:22 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:27.554372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a08a032d-78ec-44e7-af1a-c294fc3dc747 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:27.555502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a08a032d-78ec-44e7-af1a-c294fc3dc747 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] [instance: 0aa41362-f02f-4905-8473-4c9397d260e0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:27.560155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:27.567747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a08a032d-78ec-44e7-af1a-c294fc3dc747 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:27.568669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a08a032d-78ec-44e7-af1a-c294fc3dc747 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:27.569804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a08a032d-78ec-44e7-af1a-c294fc3dc747 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:27.571499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a08a032d-78ec-44e7-af1a-c294fc3dc747 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:27.572217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a08a032d-78ec-44e7-af1a-c294fc3dc747 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:27.573050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a08a032d-78ec-44e7-af1a-c294fc3dc747 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:27.601363 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-8dc95411-eeb7-4a26-933f-277d3a8ec89b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] HTTP exception thrown: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:48:27.604898 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-a08a032d-78ec-44e7-af1a-c294fc3dc747 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] HTTP exception thrown: Instance 0aa41362-f02f-4905-8473-4c9397d260e0 could not be found. Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8dc95411-eeb7-4a26-933f-277d3a8ec89b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 HTTP/1.1 Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:27.605270 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:27.606408 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:27.606408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:27.606408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:27.606408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:27.606408 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:27.606408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:27.606408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:27.606408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:48:27.606408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:27.606408 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:48:27.606408 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:48:27.606408 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '8df21d92-5b95-485a-9eb0-9896f885a1d2'} Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:27.607112 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:48:27.608335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.610955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8dc95411-eeb7-4a26-933f-277d3a8ec89b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 404 to user: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:27.612582 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8dc95411-eeb7-4a26-933f-277d3a8ec89b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 404 len: 111 microversion: 2.1 time: 0.132811 Sep 08 12:48:27.613371 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 966/2009] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:48:27 2022] DELETE /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a08a032d-78ec-44e7-af1a-c294fc3dc747 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Request method failure captured: Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 HTTP/1.1 Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGePrRMX1l1oR3-Jt6uKf15WyMRY8bZ_kJOKraZuglPtaQlIX9jAXJwDMq2_kG1CiAGRsWHwHIxOuc0tI_a1ZN99PaGUq0z14ky20mKkqsNosiGxU3DbJJFBXAL0E6ukBkAED7mGHo2lFSN_gO5_ohVcGCCqLKCCtUHmxgcBlLSqcTzM Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 140b9d3cf7484c5784af2808e1ba0954 Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerRescueTestJSON-2109499988 Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:48:27.613474 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:48:27.614833 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_140b9d3cf7484c5784af2808e1ba0954"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/140b9d3cf7484c5784af2808e1ba0954"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/140b9d3cf7484c5784af2808e1ba0954"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/140b9d3cf7484c5784af2808e1ba0954"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:27.614833 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerRescueTestJSON-2109499988 Sep 08 12:48:27.614833 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 140b9d3cf7484c5784af2808e1ba0954 Sep 08 12:48:27.614833 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerRescueTestJSON-2109499988 Sep 08 12:48:27.614833 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerRescueTestJSON-2109499988-project Sep 08 12:48:27.614833 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:48:27.614833 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:48:27.614833 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 15d486316fc448eaa9f35bbf895ac50a Sep 08 12:48:27.614833 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerRescueTestJSON-2109499988-project Sep 08 12:48:27.614833 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:48:27.614833 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 0aa41362-f02f-4905-8473-4c9397d260e0 could not be found. Sep 08 12:48:27.614833 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '0aa41362-f02f-4905-8473-4c9397d260e0'} Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aa41362-f02f-4905-8473-4c9397d260e0 could not be found. Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:27.615644 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aa41362-f02f-4905-8473-4c9397d260e0 could not be found. Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aa41362-f02f-4905-8473-4c9397d260e0 could not be found. Sep 08 12:48:27.616774 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.618526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a08a032d-78ec-44e7-af1a-c294fc3dc747 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] Returning 404 to user: Instance 0aa41362-f02f-4905-8473-4c9397d260e0 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:27.619978 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a08a032d-78ec-44e7-af1a-c294fc3dc747 tempest-ServerRescueTestJSON-2109499988 tempest-ServerRescueTestJSON-2109499988-project] 10.222.0.78 "GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0" status: 404 len: 111 microversion: 2.1 time: 0.076998 Sep 08 12:48:27.621219 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1044/2010] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:27 2022] GET /compute/v2.1/servers/0aa41362-f02f-4905-8473-4c9397d260e0 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:27.625186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ebf27915-0a11-404d-98f5-aa51a8002aba tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:27.628407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-39b760dd-94b9-4a7a-bc40-026073e6de8f tempest-QuotaClassesAdmin257Test-821659555 tempest-QuotaClassesAdmin257Test-821659555-project-admin] Calling method '.version_select at 0x7fdb3f2daa60>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:27.640022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ebf27915-0a11-404d-98f5-aa51a8002aba tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:27.651672 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-39b760dd-94b9-4a7a-bc40-026073e6de8f tempest-QuotaClassesAdmin257Test-821659555 tempest-QuotaClassesAdmin257Test-821659555-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.028167 Sep 08 12:48:27.655768 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1045/2011] 10.222.0.78 () {60 vars in 1226 bytes} [Thu Sep 8 12:48:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:48:27.668889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebf27915-0a11-404d-98f5-aa51a8002aba tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:27.669477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebf27915-0a11-404d-98f5-aa51a8002aba tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:27.670018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebf27915-0a11-404d-98f5-aa51a8002aba tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:27.670985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f06e20ca-3a60-4365-a786-f0b9ca57c91f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:27.671922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f06e20ca-3a60-4365-a786-f0b9ca57c91f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:27.683921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f06e20ca-3a60-4365-a786-f0b9ca57c91f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:27.685427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f06e20ca-3a60-4365-a786-f0b9ca57c91f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:27.685647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebf27915-0a11-404d-98f5-aa51a8002aba tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:27.686608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f06e20ca-3a60-4365-a786-f0b9ca57c91f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:27.689603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebf27915-0a11-404d-98f5-aa51a8002aba tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:27.690427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebf27915-0a11-404d-98f5-aa51a8002aba tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:27.690930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f06e20ca-3a60-4365-a786-f0b9ca57c91f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:27.692658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f06e20ca-3a60-4365-a786-f0b9ca57c91f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:27.693975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f06e20ca-3a60-4365-a786-f0b9ca57c91f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:27.772909 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-f06e20ca-3a60-4365-a786-f0b9ca57c91f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] HTTP exception thrown: Instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 could not be found. Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f06e20ca-3a60-4365-a786-f0b9ca57c91f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Request method failure captured: Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 HTTP/1.1 Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeNb2bGFcbBOl1cv4HEaMaAcRwEepQEALA8WfW0-v4blJtuEPlA6Ak20pW-TClT7v4Sic5V2MPVgN13m0hRsfRCjYih8szkeR_avMQqTYHvLLc_9M5iUXeA8-GcUpqR4WsJKo5PzyZm-yg5hB6obGHogWgMaqtj5K3ekVR3iyfIgcUA Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:48:27.780121 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:48:27.782515 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c486d69d062749c7b334423a3a89cc13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:27.782515 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesTestJSON-163488162 Sep 08 12:48:27.782515 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:27.782515 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:27.782515 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:27.782515 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:48:27.782515 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:48:27.782515 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b1900295263741188d26b49e7e8b4036 Sep 08 12:48:27.782515 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:27.782515 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:48:27.782515 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 could not be found. Sep 08 12:48:27.782515 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '7f0e4984-ae73-4066-af92-a105ea8c3f79'} Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 could not be found. Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:27.783849 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 could not be found. Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 could not be found. Sep 08 12:48:27.787071 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.789647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f06e20ca-3a60-4365-a786-f0b9ca57c91f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Returning 404 to user: Instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:27.789647 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f06e20ca-3a60-4365-a786-f0b9ca57c91f tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 404 len: 111 microversion: 2.1 time: 0.131457 Sep 08 12:48:27.795300 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1046/2012] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:48:27 2022] DELETE /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:27.813700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-040134db-4be8-4140-b11f-82cf72c59dac tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:27.815851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-040134db-4be8-4140-b11f-82cf72c59dac tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: 8df21d92-5b95-485a-9eb0-9896f885a1d2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:27.845302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-040134db-4be8-4140-b11f-82cf72c59dac tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:27.847559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-040134db-4be8-4140-b11f-82cf72c59dac tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:27.850690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-040134db-4be8-4140-b11f-82cf72c59dac tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:27.852329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-040134db-4be8-4140-b11f-82cf72c59dac tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:27.853639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-040134db-4be8-4140-b11f-82cf72c59dac tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:27.863553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-040134db-4be8-4140-b11f-82cf72c59dac tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:27.917357 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-040134db-4be8-4140-b11f-82cf72c59dac tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] HTTP exception thrown: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-040134db-4be8-4140-b11f-82cf72c59dac tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 HTTP/1.1 Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:48:27.919112 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:48:27.920292 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:27.920292 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:27.920292 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:27.920292 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:27.920292 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:27.920292 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:48:27.920292 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:48:27.920292 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:48:27.920292 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:27.920292 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:48:27.920292 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:48:27.920292 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '8df21d92-5b95-485a-9eb0-9896f885a1d2'} Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:27.920947 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. Sep 08 12:48:27.921943 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:27.923855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-040134db-4be8-4140-b11f-82cf72c59dac tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 404 to user: Instance 8df21d92-5b95-485a-9eb0-9896f885a1d2 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:27.925042 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-040134db-4be8-4140-b11f-82cf72c59dac tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2" status: 404 len: 111 microversion: 2.1 time: 0.128675 Sep 08 12:48:27.925776 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1047/2013] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:27 2022] GET /compute/v2.1/servers/8df21d92-5b95-485a-9eb0-9896f885a1d2 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:27.949881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d41b3d97-b888-4400-9620-8628410bc62d tempest-QuotaClassesAdmin257Test-821659555 tempest-QuotaClassesAdmin257Test-821659555-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3f2ecb80>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:27.966944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ebf27915-0a11-404d-98f5-aa51a8002aba tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:27.982491 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ebf27915-0a11-404d-98f5-aa51a8002aba tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1222 microversion: 2.1 time: 0.362561 Sep 08 12:48:27.995631 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 967/2014] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:27 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1222 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:28.022370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e843ec57-cb35-4a5e-91bc-26955dd05bfb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:28.028546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e843ec57-cb35-4a5e-91bc-26955dd05bfb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 7f0e4984-ae73-4066-af92-a105ea8c3f79] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:28.046878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e843ec57-cb35-4a5e-91bc-26955dd05bfb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:28.047785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e843ec57-cb35-4a5e-91bc-26955dd05bfb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:28.048563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e843ec57-cb35-4a5e-91bc-26955dd05bfb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:28.049982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e843ec57-cb35-4a5e-91bc-26955dd05bfb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:28.050795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e843ec57-cb35-4a5e-91bc-26955dd05bfb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:28.052051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e843ec57-cb35-4a5e-91bc-26955dd05bfb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:28.087706 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d41b3d97-b888-4400-9620-8628410bc62d tempest-QuotaClassesAdmin257Test-821659555 tempest-QuotaClassesAdmin257Test-821659555-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.159416 Sep 08 12:48:28.088394 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e843ec57-cb35-4a5e-91bc-26955dd05bfb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] HTTP exception thrown: Instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 could not be found. Sep 08 12:48:28.096179 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1048/2015] 10.222.0.78 () {62 vars in 1247 bytes} [Thu Sep 8 12:48:27 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e843ec57-cb35-4a5e-91bc-26955dd05bfb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Request method failure captured: Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 HTTP/1.1 Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeNb2bGFcbBOl1cv4HEaMaAcRwEepQEALA8WfW0-v4blJtuEPlA6Ak20pW-TClT7v4Sic5V2MPVgN13m0hRsfRCjYih8szkeR_avMQqTYHvLLc_9M5iUXeA8-GcUpqR4WsJKo5PzyZm-yg5hB6obGHogWgMaqtj5K3ekVR3iyfIgcUA Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:28.098244 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:28.099577 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c486d69d062749c7b334423a3a89cc13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:28.099577 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesTestJSON-163488162 Sep 08 12:48:28.099577 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:28.099577 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:28.099577 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:28.099577 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:28.099577 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:28.099577 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b1900295263741188d26b49e7e8b4036 Sep 08 12:48:28.099577 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:28.099577 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:48:28.099577 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 could not be found. Sep 08 12:48:28.099577 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '7f0e4984-ae73-4066-af92-a105ea8c3f79'} Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 could not be found. Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:28.100241 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 could not be found. Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 could not be found. Sep 08 12:48:28.101353 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.102465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1662124813", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "682d96b1-a973-4824-9a27-17bd1d4dbbfc"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:28.108590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e843ec57-cb35-4a5e-91bc-26955dd05bfb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Returning 404 to user: Instance 7f0e4984-ae73-4066-af92-a105ea8c3f79 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:28.110005 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e843ec57-cb35-4a5e-91bc-26955dd05bfb tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79" status: 404 len: 111 microversion: 2.1 time: 0.110840 Sep 08 12:48:28.110727 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 968/2016] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:27 2022] GET /compute/v2.1/servers/7f0e4984-ae73-4066-af92-a105ea8c3f79 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:28.120541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-56e0806f-c861-42e2-8bc8-583b51312850 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '.version_select at 0x7fdb3f1ef8b0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:28.169814 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-56e0806f-c861-42e2-8bc8-583b51312850 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-413112974" status: 202 len: 0 microversion: 2.1 time: 0.055541 Sep 08 12:48:28.171035 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 969/2017] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 12:48:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-413112974 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:48:28.186706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-292f6812-a7a5-45bf-8a1c-7b7386720ab7 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3abbaca0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:28.189525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] validate_networks() for [('682d96b1-a973-4824-9a27-17bd1d4dbbfc', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:48:28.226410 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-292f6812-a7a5-45bf-8a1c-7b7386720ab7 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] HTTP exception thrown: Image not found. Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-292f6812-a7a5-45bf-8a1c-7b7386720ab7 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Request method failure captured: Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f HTTP/1.1 Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeNb2bGFcbBOl1cv4HEaMaAcRwEepQEALA8WfW0-v4blJtuEPlA6Ak20pW-TClT7v4Sic5V2MPVgN13m0hRsfRCjYih8szkeR_avMQqTYHvLLc_9M5iUXeA8-GcUpqR4WsJKo5PzyZm-yg5hB6obGHogWgMaqtj5K3ekVR3iyfIgcUA Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:28.229266 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c486d69d062749c7b334423a3a89cc13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesTestJSON-163488162 Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b1900295263741188d26b49e7e8b4036 Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: exception: Image not found. Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'e4c92836-ef49-4edd-9309-05e5e8ebf04f'} Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:28.230408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e4c92836-ef49-4edd-9309-05e5e8ebf04f to delete Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.231434 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e4c92836-ef49-4edd-9309-05e5e8ebf04f could not be found. Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:28.232382 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.236045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-292f6812-a7a5-45bf-8a1c-7b7386720ab7 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Returning 404 to user: Image not found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:28.247648 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-292f6812-a7a5-45bf-8a1c-7b7386720ab7 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f" status: 404 len: 62 microversion: 2.1 time: 0.073803 Sep 08 12:48:28.252891 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 970/2018] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:28 2022] DELETE /compute/v2.1/images/e4c92836-ef49-4edd-9309-05e5e8ebf04f => generated 62 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:48:28.263597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3daba7e-68e0-4267-a319-29da8ac9acf0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:28.266736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d3daba7e-68e0-4267-a319-29da8ac9acf0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:28.293969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3daba7e-68e0-4267-a319-29da8ac9acf0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:28.295132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3daba7e-68e0-4267-a319-29da8ac9acf0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:28.295994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3daba7e-68e0-4267-a319-29da8ac9acf0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:28.299054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3daba7e-68e0-4267-a319-29da8ac9acf0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:28.299743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3daba7e-68e0-4267-a319-29da8ac9acf0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:28.300219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3daba7e-68e0-4267-a319-29da8ac9acf0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:28.328471 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-d3daba7e-68e0-4267-a319-29da8ac9acf0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] HTTP exception thrown: Instance 18d02535-ee1c-46e0-a965-f6a888a88504 could not be found. Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3daba7e-68e0-4267-a319-29da8ac9acf0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Request method failure captured: Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 HTTP/1.1 Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeNb2bGFcbBOl1cv4HEaMaAcRwEepQEALA8WfW0-v4blJtuEPlA6Ak20pW-TClT7v4Sic5V2MPVgN13m0hRsfRCjYih8szkeR_avMQqTYHvLLc_9M5iUXeA8-GcUpqR4WsJKo5PzyZm-yg5hB6obGHogWgMaqtj5K3ekVR3iyfIgcUA Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:28.333231 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:28.334548 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c486d69d062749c7b334423a3a89cc13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:28.334548 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesTestJSON-163488162 Sep 08 12:48:28.334548 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:28.334548 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:28.334548 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:28.334548 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:28.334548 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:28.334548 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b1900295263741188d26b49e7e8b4036 Sep 08 12:48:28.334548 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:28.334548 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:48:28.334548 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 18d02535-ee1c-46e0-a965-f6a888a88504 could not be found. Sep 08 12:48:28.334548 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '18d02535-ee1c-46e0-a965-f6a888a88504'} Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d02535-ee1c-46e0-a965-f6a888a88504 could not be found. Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:28.335217 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d02535-ee1c-46e0-a965-f6a888a88504 could not be found. Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d02535-ee1c-46e0-a965-f6a888a88504 could not be found. Sep 08 12:48:28.340986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.341922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3daba7e-68e0-4267-a319-29da8ac9acf0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Returning 404 to user: Instance 18d02535-ee1c-46e0-a965-f6a888a88504 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:28.341922 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3daba7e-68e0-4267-a319-29da8ac9acf0 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 404 len: 111 microversion: 2.1 time: 0.079123 Sep 08 12:48:28.341922 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 971/2019] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:48:28 2022] DELETE /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:28.353142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e026d760-dc27-4fa1-9684-dc658a517dd3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:28.358408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e026d760-dc27-4fa1-9684-dc658a517dd3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 18d02535-ee1c-46e0-a965-f6a888a88504] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:28.377758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e026d760-dc27-4fa1-9684-dc658a517dd3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:28.378721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e026d760-dc27-4fa1-9684-dc658a517dd3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:28.387453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e026d760-dc27-4fa1-9684-dc658a517dd3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:28.388977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e026d760-dc27-4fa1-9684-dc658a517dd3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:28.389781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e026d760-dc27-4fa1-9684-dc658a517dd3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:28.390523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e026d760-dc27-4fa1-9684-dc658a517dd3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:28.414190 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e026d760-dc27-4fa1-9684-dc658a517dd3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] HTTP exception thrown: Instance 18d02535-ee1c-46e0-a965-f6a888a88504 could not be found. Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e026d760-dc27-4fa1-9684-dc658a517dd3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Request method failure captured: Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 HTTP/1.1 Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeNb2bGFcbBOl1cv4HEaMaAcRwEepQEALA8WfW0-v4blJtuEPlA6Ak20pW-TClT7v4Sic5V2MPVgN13m0hRsfRCjYih8szkeR_avMQqTYHvLLc_9M5iUXeA8-GcUpqR4WsJKo5PzyZm-yg5hB6obGHogWgMaqtj5K3ekVR3iyfIgcUA Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:28.417413 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:28.418512 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c486d69d062749c7b334423a3a89cc13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:28.418512 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesTestJSON-163488162 Sep 08 12:48:28.418512 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:28.418512 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:28.418512 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:28.418512 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:28.418512 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:28.418512 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b1900295263741188d26b49e7e8b4036 Sep 08 12:48:28.418512 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:28.418512 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:48:28.418512 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 18d02535-ee1c-46e0-a965-f6a888a88504 could not be found. Sep 08 12:48:28.418512 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '18d02535-ee1c-46e0-a965-f6a888a88504'} Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18d02535-ee1c-46e0-a965-f6a888a88504 could not be found. Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:28.419276 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18d02535-ee1c-46e0-a965-f6a888a88504 could not be found. Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18d02535-ee1c-46e0-a965-f6a888a88504 could not be found. Sep 08 12:48:28.420248 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:28.427748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e026d760-dc27-4fa1-9684-dc658a517dd3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Returning 404 to user: Instance 18d02535-ee1c-46e0-a965-f6a888a88504 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:28.429014 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e026d760-dc27-4fa1-9684-dc658a517dd3 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504" status: 404 len: 111 microversion: 2.1 time: 0.088786 Sep 08 12:48:28.433678 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 972/2020] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:28 2022] GET /compute/v2.1/servers/18d02535-ee1c-46e0-a965-f6a888a88504 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 12:48:28.441552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2604d9d1-f780-4ae7-8bc2-8cc58cd9c4e8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:28.443123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2604d9d1-f780-4ae7-8bc2-8cc58cd9c4e8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:28.452579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2604d9d1-f780-4ae7-8bc2-8cc58cd9c4e8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:28.453374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2604d9d1-f780-4ae7-8bc2-8cc58cd9c4e8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:28.453988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2604d9d1-f780-4ae7-8bc2-8cc58cd9c4e8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:28.455017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2604d9d1-f780-4ae7-8bc2-8cc58cd9c4e8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:28.455978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2604d9d1-f780-4ae7-8bc2-8cc58cd9c4e8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:28.457091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2604d9d1-f780-4ae7-8bc2-8cc58cd9c4e8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:29.378121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2604d9d1-f780-4ae7-8bc2-8cc58cd9c4e8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:29.401881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2604d9d1-f780-4ae7-8bc2-8cc58cd9c4e8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:29.409138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2604d9d1-f780-4ae7-8bc2-8cc58cd9c4e8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:29.412136 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2604d9d1-f780-4ae7-8bc2-8cc58cd9c4e8 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 0.977035 Sep 08 12:48:29.413921 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 973/2021] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:28 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:29.428853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2ab86d54-1035-47df-ae12-491a7e92fc3b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '.version_select at 0x7fdb3ae35820>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:29.485933 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-2ab86d54-1035-47df-ae12-491a7e92fc3b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] HTTP exception thrown: Image not found. Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2ab86d54-1035-47df-ae12-491a7e92fc3b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Request method failure captured: Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d HTTP/1.1 Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeNb2bGFcbBOl1cv4HEaMaAcRwEepQEALA8WfW0-v4blJtuEPlA6Ak20pW-TClT7v4Sic5V2MPVgN13m0hRsfRCjYih8szkeR_avMQqTYHvLLc_9M5iUXeA8-GcUpqR4WsJKo5PzyZm-yg5hB6obGHogWgMaqtj5K3ekVR3iyfIgcUA Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:29.488351 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c486d69d062749c7b334423a3a89cc13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesTestJSON-163488162 Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b1900295263741188d26b49e7e8b4036 Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: exception: Image not found. Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '70774836-9595-465d-b87b-b55e1a70c99d'} Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:29.490127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 70774836-9595-465d-b87b-b55e1a70c99d to delete Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:29.490786 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 70774836-9595-465d-b87b-b55e1a70c99d could not be found. Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:29.491699 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 12:48:29.492626 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:48:29.492626 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:48:29.492626 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:29.492626 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:29.492626 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:29.492626 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:29.492626 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:29.492626 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:29.492626 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:29.492626 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:29.492626 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:48:29.492626 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:29.496626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2ab86d54-1035-47df-ae12-491a7e92fc3b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Returning 404 to user: Image not found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:29.504524 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2ab86d54-1035-47df-ae12-491a7e92fc3b tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d" status: 404 len: 62 microversion: 2.1 time: 0.088888 Sep 08 12:48:29.506434 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 974/2022] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:29 2022] DELETE /compute/v2.1/images/70774836-9595-465d-b87b-b55e1a70c99d => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:48:29.517222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0e758ab2-ccd6-4402-91a2-bcfc388781d4 req-4ff9463f-58a9-4358-84d2-3a902b6db48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aa41362-f02f-4905-8473-4c9397d260e0", "name": "network-vif-deleted", "tag": "975b74c9-35fe-4989-a249-1c550697c91b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:29.530505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0e758ab2-ccd6-4402-91a2-bcfc388781d4 req-4ff9463f-58a9-4358-84d2-3a902b6db48d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:29.531341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0e758ab2-ccd6-4402-91a2-bcfc388781d4 req-4ff9463f-58a9-4358-84d2-3a902b6db48d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:29.532000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0e758ab2-ccd6-4402-91a2-bcfc388781d4 req-4ff9463f-58a9-4358-84d2-3a902b6db48d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:29.545746 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0e758ab2-ccd6-4402-91a2-bcfc388781d4 req-4ff9463f-58a9-4358-84d2-3a902b6db48d service nova] Creating event network-vif-deleted:975b74c9-35fe-4989-a249-1c550697c91b for instance 0aa41362-f02f-4905-8473-4c9397d260e0 on n-h2-852084-10 Sep 08 12:48:29.554778 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0e758ab2-ccd6-4402-91a2-bcfc388781d4 req-4ff9463f-58a9-4358-84d2-3a902b6db48d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045920 Sep 08 12:48:29.556938 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 975/2023] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:29.565514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4f94bf7f-1cec-4333-a0d5-d28736086e49 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:29.568057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4f94bf7f-1cec-4333-a0d5-d28736086e49 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:29.583068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f94bf7f-1cec-4333-a0d5-d28736086e49 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:29.583984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f94bf7f-1cec-4333-a0d5-d28736086e49 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:29.584626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f94bf7f-1cec-4333-a0d5-d28736086e49 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:29.585692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f94bf7f-1cec-4333-a0d5-d28736086e49 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:29.586371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f94bf7f-1cec-4333-a0d5-d28736086e49 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:29.587692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f94bf7f-1cec-4333-a0d5-d28736086e49 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:30.692690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4f94bf7f-1cec-4333-a0d5-d28736086e49 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:30.733046 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4f94bf7f-1cec-4333-a0d5-d28736086e49 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1276 microversion: 2.1 time: 1.173650 Sep 08 12:48:30.739377 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 976/2024] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:29 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1276 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:30.776503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7d9595ae-4ecf-4c93-af2d-de86d2c91212 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:30.783182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7d9595ae-4ecf-4c93-af2d-de86d2c91212 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:30.803212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9595ae-4ecf-4c93-af2d-de86d2c91212 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:30.804758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9595ae-4ecf-4c93-af2d-de86d2c91212 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:30.805801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9595ae-4ecf-4c93-af2d-de86d2c91212 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:30.807548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9595ae-4ecf-4c93-af2d-de86d2c91212 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:30.809607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9595ae-4ecf-4c93-af2d-de86d2c91212 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:30.811796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9595ae-4ecf-4c93-af2d-de86d2c91212 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:30.882250 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-7d9595ae-4ecf-4c93-af2d-de86d2c91212 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] HTTP exception thrown: Instance 24093877-782e-42db-b41b-90a91e8a11db could not be found. Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7d9595ae-4ecf-4c93-af2d-de86d2c91212 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Request method failure captured: Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db HTTP/1.1 Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeNb2bGFcbBOl1cv4HEaMaAcRwEepQEALA8WfW0-v4blJtuEPlA6Ak20pW-TClT7v4Sic5V2MPVgN13m0hRsfRCjYih8szkeR_avMQqTYHvLLc_9M5iUXeA8-GcUpqR4WsJKo5PzyZm-yg5hB6obGHogWgMaqtj5K3ekVR3iyfIgcUA Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:30.893020 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:30.896250 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c486d69d062749c7b334423a3a89cc13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:30.896250 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesTestJSON-163488162 Sep 08 12:48:30.896250 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:30.896250 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:30.896250 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:30.896250 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:30.896250 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:30.896250 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b1900295263741188d26b49e7e8b4036 Sep 08 12:48:30.896250 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:30.896250 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:48:30.896250 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 24093877-782e-42db-b41b-90a91e8a11db could not be found. Sep 08 12:48:30.896250 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '24093877-782e-42db-b41b-90a91e8a11db'} Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24093877-782e-42db-b41b-90a91e8a11db could not be found. Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:30.897654 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24093877-782e-42db-b41b-90a91e8a11db could not be found. Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24093877-782e-42db-b41b-90a91e8a11db could not be found. Sep 08 12:48:30.899956 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:30.904821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7d9595ae-4ecf-4c93-af2d-de86d2c91212 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Returning 404 to user: Instance 24093877-782e-42db-b41b-90a91e8a11db could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:30.907003 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7d9595ae-4ecf-4c93-af2d-de86d2c91212 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "DELETE /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db" status: 404 len: 111 microversion: 2.1 time: 0.164975 Sep 08 12:48:30.914947 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 977/2025] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:48:30 2022] DELETE /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:30.927313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-692badc2-c217-4c0a-ab17-fd1aea172ba0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:30.928882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-692badc2-c217-4c0a-ab17-fd1aea172ba0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:30.943167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-692badc2-c217-4c0a-ab17-fd1aea172ba0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:30.946982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-692badc2-c217-4c0a-ab17-fd1aea172ba0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:30.948356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-692badc2-c217-4c0a-ab17-fd1aea172ba0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:30.950269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-692badc2-c217-4c0a-ab17-fd1aea172ba0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:30.951759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-692badc2-c217-4c0a-ab17-fd1aea172ba0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:30.952889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-692badc2-c217-4c0a-ab17-fd1aea172ba0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:31.681914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:48:31.683281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:48:31.684282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:48:31.686039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:48:31.690139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:48:31.723772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:31.725075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:31.727868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:31.730988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:31.732506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:31.733514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:31.744316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-692badc2-c217-4c0a-ab17-fd1aea172ba0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:31.785712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-692badc2-c217-4c0a-ab17-fd1aea172ba0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:31.788274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-692badc2-c217-4c0a-ab17-fd1aea172ba0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:31.799125 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-692badc2-c217-4c0a-ab17-fd1aea172ba0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 0.881683 Sep 08 12:48:31.800892 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 978/2026] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:30 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:31.822368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Getting quotas for project 111d6d19644b4164a4e623bc7ea07dbf. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:48:31.826422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f9a97452-e1e5-420b-ba8f-c09501ba3f39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:31.827714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f9a97452-e1e5-420b-ba8f-c09501ba3f39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] [instance: 24093877-782e-42db-b41b-90a91e8a11db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:31.841053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Getting quotas for user d728c4e964f44edf9f8c5114032a4fbb and project 111d6d19644b4164a4e623bc7ea07dbf. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:48:31.842702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9a97452-e1e5-420b-ba8f-c09501ba3f39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:31.847571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9a97452-e1e5-420b-ba8f-c09501ba3f39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:31.850382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9a97452-e1e5-420b-ba8f-c09501ba3f39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:31.856653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9a97452-e1e5-420b-ba8f-c09501ba3f39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:31.857421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9a97452-e1e5-420b-ba8f-c09501ba3f39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:31.858152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9a97452-e1e5-420b-ba8f-c09501ba3f39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:31.877094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:48:31.884857 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-f9a97452-e1e5-420b-ba8f-c09501ba3f39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] HTTP exception thrown: Instance 24093877-782e-42db-b41b-90a91e8a11db could not be found. Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f9a97452-e1e5-420b-ba8f-c09501ba3f39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Request method failure captured: Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db HTTP/1.1 Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeNb2bGFcbBOl1cv4HEaMaAcRwEepQEALA8WfW0-v4blJtuEPlA6Ak20pW-TClT7v4Sic5V2MPVgN13m0hRsfRCjYih8szkeR_avMQqTYHvLLc_9M5iUXeA8-GcUpqR4WsJKo5PzyZm-yg5hB6obGHogWgMaqtj5K3ekVR3iyfIgcUA Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:31.886836 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:31.888572 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c486d69d062749c7b334423a3a89cc13"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c486d69d062749c7b334423a3a89cc13"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:31.888572 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesTestJSON-163488162 Sep 08 12:48:31.888572 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c486d69d062749c7b334423a3a89cc13 Sep 08 12:48:31.888572 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesTestJSON-163488162 Sep 08 12:48:31.888572 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:31.888572 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:31.888572 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:31.888572 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b1900295263741188d26b49e7e8b4036 Sep 08 12:48:31.888572 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesTestJSON-163488162-project Sep 08 12:48:31.888572 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:48:31.888572 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 24093877-782e-42db-b41b-90a91e8a11db could not be found. Sep 08 12:48:31.888572 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '24093877-782e-42db-b41b-90a91e8a11db'} Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24093877-782e-42db-b41b-90a91e8a11db could not be found. Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:31.889568 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24093877-782e-42db-b41b-90a91e8a11db could not be found. Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24093877-782e-42db-b41b-90a91e8a11db could not be found. Sep 08 12:48:31.891099 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:31.892601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:48:31.893560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f9a97452-e1e5-420b-ba8f-c09501ba3f39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] Returning 404 to user: Instance 24093877-782e-42db-b41b-90a91e8a11db could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:31.894587 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f9a97452-e1e5-420b-ba8f-c09501ba3f39 tempest-ImagesTestJSON-163488162 tempest-ImagesTestJSON-163488162-project] 10.222.0.78 "GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db" status: 404 len: 111 microversion: 2.1 time: 0.091393 Sep 08 12:48:31.900966 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 979/2027] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:31 2022] GET /compute/v2.1/servers/24093877-782e-42db-b41b-90a91e8a11db => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:31.907556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6546e073-ff5f-46b4-b0cf-669e549b9fe1 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '.version_select at 0x7fdb3f1c53a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:31.964470 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-6546e073-ff5f-46b4-b0cf-669e549b9fe1 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] HTTP exception thrown: Image not found. Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6546e073-ff5f-46b4-b0cf-669e549b9fe1 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/images/7de77b06-ec69-4e8a-8dba-faf4ee0d494b HTTP/1.1 Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:48:31.967438 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: exception: Image not found. Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '7de77b06-ec69-4e8a-8dba-faf4ee0d494b'} Sep 08 12:48:31.969389 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 7de77b06-ec69-4e8a-8dba-faf4ee0d494b to delete Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:31.970182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 7de77b06-ec69-4e8a-8dba-faf4ee0d494b could not be found. Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:31.971340 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:48:31.972529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:48:31.974563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6546e073-ff5f-46b4-b0cf-669e549b9fe1 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 404 to user: Image not found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:31.975725 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6546e073-ff5f-46b4-b0cf-669e549b9fe1 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "DELETE /compute/v2.1/images/7de77b06-ec69-4e8a-8dba-faf4ee0d494b" status: 404 len: 62 microversion: 2.1 time: 0.073345 Sep 08 12:48:31.976975 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 980/2028] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:31 2022] DELETE /compute/v2.1/images/7de77b06-ec69-4e8a-8dba-faf4ee0d494b => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:48:31.987580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e3fa4f80-ffb8-4822-b499-6b6cc2b5fdbd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:31.988521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e3fa4f80-ffb8-4822-b499-6b6cc2b5fdbd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:32.013712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e3fa4f80-ffb8-4822-b499-6b6cc2b5fdbd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:32.014628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e3fa4f80-ffb8-4822-b499-6b6cc2b5fdbd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:32.015459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e3fa4f80-ffb8-4822-b499-6b6cc2b5fdbd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:32.017121 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5bcf98af-327b-4be1-86c0-65d766d9a69b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.926627 Sep 08 12:48:32.024062 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1049/2029] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:48:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:48:32.033950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e3fa4f80-ffb8-4822-b499-6b6cc2b5fdbd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:32.038430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e3fa4f80-ffb8-4822-b499-6b6cc2b5fdbd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:32.040760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c544e2af-926e-4c71-9c70-9c1576b61b40 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:32.048016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e3fa4f80-ffb8-4822-b499-6b6cc2b5fdbd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:32.051613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c544e2af-926e-4c71-9c70-9c1576b61b40 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:32.074252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c544e2af-926e-4c71-9c70-9c1576b61b40 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:32.078006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c544e2af-926e-4c71-9c70-9c1576b61b40 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:32.079430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c544e2af-926e-4c71-9c70-9c1576b61b40 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:32.083052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c544e2af-926e-4c71-9c70-9c1576b61b40 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:32.086600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c544e2af-926e-4c71-9c70-9c1576b61b40 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:32.088424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c544e2af-926e-4c71-9c70-9c1576b61b40 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:32.182706 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-c544e2af-926e-4c71-9c70-9c1576b61b40 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] HTTP exception thrown: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c544e2af-926e-4c71-9c70-9c1576b61b40 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 HTTP/1.1 Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:48:32.194360 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:48:32.195617 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:32.195617 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:32.195617 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:32.195617 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:32.195617 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:32.195617 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:48:32.195617 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:48:32.195617 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:48:32.195617 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:32.195617 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:48:32.195617 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:48:32.195617 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c5776fc4-0794-44f8-b595-fc8f50fcbbe4'} Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:32.196211 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:48:32.197264 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:32.199243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c544e2af-926e-4c71-9c70-9c1576b61b40 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 404 to user: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:32.199243 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c544e2af-926e-4c71-9c70-9c1576b61b40 tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 404 len: 111 microversion: 2.1 time: 0.168962 Sep 08 12:48:32.199243 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1050/2030] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:48:32 2022] DELETE /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:32.257209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c6529723-7798-4f5b-b568-8cf1379a41ed tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:32.259011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c6529723-7798-4f5b-b568-8cf1379a41ed tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:33.388132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c6529723-7798-4f5b-b568-8cf1379a41ed tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:33.432034 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c6529723-7798-4f5b-b568-8cf1379a41ed tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1224 microversion: 2.1 time: 1.211802 Sep 08 12:48:33.433610 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1051/2031] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:32 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1224 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:33.452275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9f99e56f-6a55-47ff-9daf-6cee0c10ca2b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:33.453500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9f99e56f-6a55-47ff-9daf-6cee0c10ca2b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] [instance: c5776fc4-0794-44f8-b595-fc8f50fcbbe4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:33.467203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f99e56f-6a55-47ff-9daf-6cee0c10ca2b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:33.468129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f99e56f-6a55-47ff-9daf-6cee0c10ca2b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:33.468947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f99e56f-6a55-47ff-9daf-6cee0c10ca2b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:33.470515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f99e56f-6a55-47ff-9daf-6cee0c10ca2b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:33.471980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f99e56f-6a55-47ff-9daf-6cee0c10ca2b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:33.474690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f99e56f-6a55-47ff-9daf-6cee0c10ca2b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:33.475906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e3fa4f80-ffb8-4822-b499-6b6cc2b5fdbd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:33.523931 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e3fa4f80-ffb8-4822-b499-6b6cc2b5fdbd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1276 microversion: 2.1 time: 1.543551 Sep 08 12:48:33.529704 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 981/2032] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:31 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1276 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:33.538591 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-9f99e56f-6a55-47ff-9daf-6cee0c10ca2b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] HTTP exception thrown: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9f99e56f-6a55-47ff-9daf-6cee0c10ca2b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Request method failure captured: Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 HTTP/1.1 Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGePSzUxrd_XwpsSSsH84tVqQNFjdmkRU68Tmi3AS3hChqL7D8WM4U6FJhgUL7_LXTDcM9rldBEetPPICmJugc4If1bwYdaftn8u4fhTmqdHUffKu2wd6tQMxWkb-NN5cezlpYny9xi9dngrjOioKr8iRuxqOU3mnwP8KNbp5JzbLkUg Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:48:33.548280 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:48:33.550997 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/501fb79cb7544fe4995bc7122c87dbad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:48:33.550997 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:33.550997 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 501fb79cb7544fe4995bc7122c87dbad Sep 08 12:48:33.550997 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292 Sep 08 12:48:33.550997 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:33.550997 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:48:33.550997 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:48:33.550997 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2b96cccdfbf149fc880cb1dfb29d416a Sep 08 12:48:33.550997 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1352894292-project Sep 08 12:48:33.550997 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:48:33.550997 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:48:33.550997 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c5776fc4-0794-44f8-b595-fc8f50fcbbe4'} Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:48:33.552511 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. Sep 08 12:48:33.555939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:48:33.559032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9f99e56f-6a55-47ff-9daf-6cee0c10ca2b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] Returning 404 to user: Instance c5776fc4-0794-44f8-b595-fc8f50fcbbe4 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:48:33.559251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc73bef9-0472-48d2-9f9e-a8c87a75f07f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:33.561474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fc73bef9-0472-48d2-9f9e-a8c87a75f07f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:33.561742 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9f99e56f-6a55-47ff-9daf-6cee0c10ca2b tempest-ImagesOneServerNegativeTestJSON-1352894292 tempest-ImagesOneServerNegativeTestJSON-1352894292-project] 10.222.0.78 "GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4" status: 404 len: 111 microversion: 2.1 time: 0.120205 Sep 08 12:48:33.567149 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1052/2033] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:33 2022] GET /compute/v2.1/servers/c5776fc4-0794-44f8-b595-fc8f50fcbbe4 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:48:33.591503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-50813b0e-f2dd-43be-917f-315855b5f59a req-2d65308c-bbce-4c91-9ef6-52dcb68239f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ac97d7-8051-4b86-981b-eae55076e04c", "name": "network-vif-unplugged", "status": "completed", "tag": "0651dd1c-1b65-417f-a953-0882fc7b9d25"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:33.604035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc73bef9-0472-48d2-9f9e-a8c87a75f07f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:33.608667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc73bef9-0472-48d2-9f9e-a8c87a75f07f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:33.611680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc73bef9-0472-48d2-9f9e-a8c87a75f07f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:33.616115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc73bef9-0472-48d2-9f9e-a8c87a75f07f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:33.617461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc73bef9-0472-48d2-9f9e-a8c87a75f07f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:33.619526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-50813b0e-f2dd-43be-917f-315855b5f59a req-2d65308c-bbce-4c91-9ef6-52dcb68239f9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:33.620215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-50813b0e-f2dd-43be-917f-315855b5f59a req-2d65308c-bbce-4c91-9ef6-52dcb68239f9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:33.620822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-50813b0e-f2dd-43be-917f-315855b5f59a req-2d65308c-bbce-4c91-9ef6-52dcb68239f9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:33.622620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc73bef9-0472-48d2-9f9e-a8c87a75f07f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:33.644268 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-50813b0e-f2dd-43be-917f-315855b5f59a req-2d65308c-bbce-4c91-9ef6-52dcb68239f9 service nova] Creating event network-vif-unplugged:0651dd1c-1b65-417f-a953-0882fc7b9d25 for instance 19ac97d7-8051-4b86-981b-eae55076e04c on n-h1-852084-10 Sep 08 12:48:33.654647 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-50813b0e-f2dd-43be-917f-315855b5f59a req-2d65308c-bbce-4c91-9ef6-52dcb68239f9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082544 Sep 08 12:48:33.667781 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1053/2034] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:34.468057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0a4681ac-3f4b-401f-9b6d-953e834c17f1 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:34.470568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0a4681ac-3f4b-401f-9b6d-953e834c17f1 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:34.492812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a4681ac-3f4b-401f-9b6d-953e834c17f1 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:34.493581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a4681ac-3f4b-401f-9b6d-953e834c17f1 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:34.494217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a4681ac-3f4b-401f-9b6d-953e834c17f1 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:34.495122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a4681ac-3f4b-401f-9b6d-953e834c17f1 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:34.495773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a4681ac-3f4b-401f-9b6d-953e834c17f1 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:34.496360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a4681ac-3f4b-401f-9b6d-953e834c17f1 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:34.569827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fc73bef9-0472-48d2-9f9e-a8c87a75f07f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:34.581719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fc73bef9-0472-48d2-9f9e-a8c87a75f07f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:34.592802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fc73bef9-0472-48d2-9f9e-a8c87a75f07f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:34.594567 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fc73bef9-0472-48d2-9f9e-a8c87a75f07f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 1.063189 Sep 08 12:48:34.600436 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 982/2035] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:33 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:34.606308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5a4db50e-3afb-4eca-96ea-83c25926900f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:34.612212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5a4db50e-3afb-4eca-96ea-83c25926900f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:34.637332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a4db50e-3afb-4eca-96ea-83c25926900f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:34.638392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a4db50e-3afb-4eca-96ea-83c25926900f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:34.639337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a4db50e-3afb-4eca-96ea-83c25926900f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:34.640472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a4db50e-3afb-4eca-96ea-83c25926900f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:34.643763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a4db50e-3afb-4eca-96ea-83c25926900f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:34.651856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a4db50e-3afb-4eca-96ea-83c25926900f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:34.782508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0a4681ac-3f4b-401f-9b6d-953e834c17f1 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:34.804151 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0a4681ac-3f4b-401f-9b6d-953e834c17f1 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1276 microversion: 2.1 time: 0.342158 Sep 08 12:48:34.821131 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1054/2036] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:34 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1276 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:35.728550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-135196691", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": "none"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:35.777087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5a4db50e-3afb-4eca-96ea-83c25926900f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:35.806583 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5a4db50e-3afb-4eca-96ea-83c25926900f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1318 microversion: 2.1 time: 1.204426 Sep 08 12:48:35.807189 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 983/2037] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:34 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1318 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:35.825484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f9bba45-2755-462a-8bdc-6893a1365fa7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:35.826241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f9bba45-2755-462a-8bdc-6893a1365fa7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:35.844666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f9bba45-2755-462a-8bdc-6893a1365fa7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:35.844666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f9bba45-2755-462a-8bdc-6893a1365fa7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:35.844922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f9bba45-2755-462a-8bdc-6893a1365fa7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:35.845634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f9bba45-2755-462a-8bdc-6893a1365fa7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:35.846130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f9bba45-2755-462a-8bdc-6893a1365fa7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:35.846610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f9bba45-2755-462a-8bdc-6893a1365fa7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:35.877770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:48:35.878857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:48:35.880042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:48:35.881255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:48:35.882238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:48:35.905106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:35.905106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:35.906260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:35.909813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:35.911948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:35.913100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:36.016846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Getting quotas for project 56ccd022b4a3402a8f20565df6b160e5. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:48:36.030615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Getting quotas for user 0d3bdb8a171c435aa2f008e767324543 and project 56ccd022b4a3402a8f20565df6b160e5. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:48:36.049835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:48:36.052667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:48:36.112954 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d5062608-488f-402a-bf73-17ab93ff601e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.646783 Sep 08 12:48:36.114955 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1055/2038] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 12:48:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 650 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 08 12:48:36.136640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-063affc1-9f07-4897-b458-dd1d5a65d5d5 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:36.142285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-063affc1-9f07-4897-b458-dd1d5a65d5d5 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:36.152612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-063affc1-9f07-4897-b458-dd1d5a65d5d5 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:36.153894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-063affc1-9f07-4897-b458-dd1d5a65d5d5 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:36.154751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-063affc1-9f07-4897-b458-dd1d5a65d5d5 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:36.156224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-063affc1-9f07-4897-b458-dd1d5a65d5d5 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:36.157083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-063affc1-9f07-4897-b458-dd1d5a65d5d5 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:36.158024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-063affc1-9f07-4897-b458-dd1d5a65d5d5 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:36.464451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:36.787097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-063affc1-9f07-4897-b458-dd1d5a65d5d5 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:36.796194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=16,nova_cell0:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:36.820207 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-063affc1-9f07-4897-b458-dd1d5a65d5d5 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1282 microversion: 2.1 time: 0.702945 Sep 08 12:48:36.822628 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1056/2039] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:36 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1282 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:36.838967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b0321a84-af9e-4816-80f8-fc547654b5cf tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:36.844858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b0321a84-af9e-4816-80f8-fc547654b5cf tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:37.005766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f9bba45-2755-462a-8bdc-6893a1365fa7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:37.024692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f9bba45-2755-462a-8bdc-6893a1365fa7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:37.033620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f9bba45-2755-462a-8bdc-6893a1365fa7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:37.038441 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f9bba45-2755-462a-8bdc-6893a1365fa7 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 1.224373 Sep 08 12:48:37.041391 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 984/2040] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:35 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:37.056154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-d3a77e14-c3e3-4c50-98c5-730f373b9568 req-7fd25fb3-3d62-4f61-a47f-769ab4e7d688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19ac97d7-8051-4b86-981b-eae55076e04c", "tag": "0651dd1c-1b65-417f-a953-0882fc7b9d25"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:37.077904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d3a77e14-c3e3-4c50-98c5-730f373b9568 req-7fd25fb3-3d62-4f61-a47f-769ab4e7d688 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:37.079820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d3a77e14-c3e3-4c50-98c5-730f373b9568 req-7fd25fb3-3d62-4f61-a47f-769ab4e7d688 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:37.080959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d3a77e14-c3e3-4c50-98c5-730f373b9568 req-7fd25fb3-3d62-4f61-a47f-769ab4e7d688 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:37.132825 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d3a77e14-c3e3-4c50-98c5-730f373b9568 req-7fd25fb3-3d62-4f61-a47f-769ab4e7d688 service nova] Creating event network-changed:0651dd1c-1b65-417f-a953-0882fc7b9d25 for instance 19ac97d7-8051-4b86-981b-eae55076e04c on n-h1-852084-10 Sep 08 12:48:37.140403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0321a84-af9e-4816-80f8-fc547654b5cf tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:37.159713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0321a84-af9e-4816-80f8-fc547654b5cf tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:37.163174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0321a84-af9e-4816-80f8-fc547654b5cf tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:37.169534 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-d3a77e14-c3e3-4c50-98c5-730f373b9568 req-7fd25fb3-3d62-4f61-a47f-769ab4e7d688 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123750 Sep 08 12:48:37.173517 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 985/2041] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:37.174067 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b0321a84-af9e-4816-80f8-fc547654b5cf tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "PUT /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1358 microversion: 2.75 time: 0.349257 Sep 08 12:48:37.187617 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1057/2042] 10.222.0.78 () {62 vars in 1297 bytes} [Thu Sep 8 12:48:36 2022] PUT /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1358 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:37.204022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff81db4f-8d5b-48ea-b107-1c75f9c3a119 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:37.206046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ff81db4f-8d5b-48ea-b107-1c75f9c3a119 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:37.228639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff81db4f-8d5b-48ea-b107-1c75f9c3a119 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:37.230025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff81db4f-8d5b-48ea-b107-1c75f9c3a119 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:37.231114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff81db4f-8d5b-48ea-b107-1c75f9c3a119 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:37.233046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff81db4f-8d5b-48ea-b107-1c75f9c3a119 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:37.234374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff81db4f-8d5b-48ea-b107-1c75f9c3a119 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:37.235574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff81db4f-8d5b-48ea-b107-1c75f9c3a119 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:37.242161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7f2f6ac9-2bb8-4ab7-8d3d-3aa0aa909450 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:37.243658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7f2f6ac9-2bb8-4ab7-8d3d-3aa0aa909450 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:37.260900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f2f6ac9-2bb8-4ab7-8d3d-3aa0aa909450 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:37.261943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f2f6ac9-2bb8-4ab7-8d3d-3aa0aa909450 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:37.262798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f2f6ac9-2bb8-4ab7-8d3d-3aa0aa909450 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:37.264484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f2f6ac9-2bb8-4ab7-8d3d-3aa0aa909450 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:37.265429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f2f6ac9-2bb8-4ab7-8d3d-3aa0aa909450 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:37.268050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f2f6ac9-2bb8-4ab7-8d3d-3aa0aa909450 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:37.280235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:37.557961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7f2f6ac9-2bb8-4ab7-8d3d-3aa0aa909450 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:37.575955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7f2f6ac9-2bb8-4ab7-8d3d-3aa0aa909450 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:37.584202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7f2f6ac9-2bb8-4ab7-8d3d-3aa0aa909450 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:37.597420 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7f2f6ac9-2bb8-4ab7-8d3d-3aa0aa909450 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1362 microversion: 2.75 time: 0.365817 Sep 08 12:48:37.601130 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1058/2043] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:37 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1362 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:37.871100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2af8b715-148c-4c19-ad15-14ffdc4c8c8f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:37.873725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2af8b715-148c-4c19-ad15-14ffdc4c8c8f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:37.907121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2af8b715-148c-4c19-ad15-14ffdc4c8c8f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:37.909380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2af8b715-148c-4c19-ad15-14ffdc4c8c8f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:37.911892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2af8b715-148c-4c19-ad15-14ffdc4c8c8f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:37.918152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2af8b715-148c-4c19-ad15-14ffdc4c8c8f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:37.922164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2af8b715-148c-4c19-ad15-14ffdc4c8c8f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:37.923316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2af8b715-148c-4c19-ad15-14ffdc4c8c8f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:38.089278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ff81db4f-8d5b-48ea-b107-1c75f9c3a119 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:38.126888 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ff81db4f-8d5b-48ea-b107-1c75f9c3a119 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1318 microversion: 2.1 time: 0.949022 Sep 08 12:48:38.131430 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 986/2044] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:37 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1318 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:38.144176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8a7c39c6-cb9a-411a-917f-f9afbec2052e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:38.145648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8a7c39c6-cb9a-411a-917f-f9afbec2052e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:38.165768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a7c39c6-cb9a-411a-917f-f9afbec2052e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:38.166827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a7c39c6-cb9a-411a-917f-f9afbec2052e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:38.167473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a7c39c6-cb9a-411a-917f-f9afbec2052e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:38.168416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a7c39c6-cb9a-411a-917f-f9afbec2052e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:38.169263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a7c39c6-cb9a-411a-917f-f9afbec2052e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:38.170640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a7c39c6-cb9a-411a-917f-f9afbec2052e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:38.176567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:38.213467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2af8b715-148c-4c19-ad15-14ffdc4c8c8f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:38.238901 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2af8b715-148c-4c19-ad15-14ffdc4c8c8f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1282 microversion: 2.1 time: 0.392006 Sep 08 12:48:38.248112 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1059/2045] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:37 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1282 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:38.646248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-975b22c8-45e6-4fd3-a2db-f34185870828 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:38.655048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-975b22c8-45e6-4fd3-a2db-f34185870828 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:38.685885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-975b22c8-45e6-4fd3-a2db-f34185870828 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:38.687598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-975b22c8-45e6-4fd3-a2db-f34185870828 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:38.698605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-975b22c8-45e6-4fd3-a2db-f34185870828 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:38.705301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-975b22c8-45e6-4fd3-a2db-f34185870828 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:38.730169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-975b22c8-45e6-4fd3-a2db-f34185870828 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:38.732347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-975b22c8-45e6-4fd3-a2db-f34185870828 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:38.976708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-975b22c8-45e6-4fd3-a2db-f34185870828 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:39.033439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-975b22c8-45e6-4fd3-a2db-f34185870828 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:39.045714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-975b22c8-45e6-4fd3-a2db-f34185870828 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:39.058090 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-975b22c8-45e6-4fd3-a2db-f34185870828 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1418 microversion: 2.75 time: 0.425528 Sep 08 12:48:39.075843 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1060/2046] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:38 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1418 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:39.176394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-742aca9a-7186-444c-a26b-c8b4d1d9d592 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:39.177991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-742aca9a-7186-444c-a26b-c8b4d1d9d592 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:39.189669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-742aca9a-7186-444c-a26b-c8b4d1d9d592 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:39.190494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-742aca9a-7186-444c-a26b-c8b4d1d9d592 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:39.192043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-742aca9a-7186-444c-a26b-c8b4d1d9d592 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:39.193320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-742aca9a-7186-444c-a26b-c8b4d1d9d592 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:39.194237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-742aca9a-7186-444c-a26b-c8b4d1d9d592 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:39.195068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-742aca9a-7186-444c-a26b-c8b4d1d9d592 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:39.245081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a7c39c6-cb9a-411a-917f-f9afbec2052e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:39.302093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a7c39c6-cb9a-411a-917f-f9afbec2052e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:39.306615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a7c39c6-cb9a-411a-917f-f9afbec2052e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:39.309342 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8a7c39c6-cb9a-411a-917f-f9afbec2052e tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 1.175762 Sep 08 12:48:39.327450 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 987/2047] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:38 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:39.350186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-79edc1d7-dbc6-4529-b5a9-71d47b88149f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:39.351718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-79edc1d7-dbc6-4529-b5a9-71d47b88149f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:39.364958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79edc1d7-dbc6-4529-b5a9-71d47b88149f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:39.366182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79edc1d7-dbc6-4529-b5a9-71d47b88149f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:39.367199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79edc1d7-dbc6-4529-b5a9-71d47b88149f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:39.368795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79edc1d7-dbc6-4529-b5a9-71d47b88149f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:39.369874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79edc1d7-dbc6-4529-b5a9-71d47b88149f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:39.370870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79edc1d7-dbc6-4529-b5a9-71d47b88149f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:39.624286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-79edc1d7-dbc6-4529-b5a9-71d47b88149f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:39.643806 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-79edc1d7-dbc6-4529-b5a9-71d47b88149f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1282 microversion: 2.1 time: 0.309212 Sep 08 12:48:39.645766 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 988/2048] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:39 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1282 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:39.999834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e3dbe57b-c9bf-4ee6-9e29-55a25b13db6c req-cffa4c89-88dc-4986-8d03-dc4230538f63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6afa649b-c753-458a-9be6-2e4d3fdfb25b", "tag": "39228a6d-960b-4a1a-a56d-f8eba7c2e0cc"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:40.024993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e3dbe57b-c9bf-4ee6-9e29-55a25b13db6c req-cffa4c89-88dc-4986-8d03-dc4230538f63 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:40.026470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e3dbe57b-c9bf-4ee6-9e29-55a25b13db6c req-cffa4c89-88dc-4986-8d03-dc4230538f63 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:40.028038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e3dbe57b-c9bf-4ee6-9e29-55a25b13db6c req-cffa4c89-88dc-4986-8d03-dc4230538f63 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:40.045807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-742aca9a-7186-444c-a26b-c8b4d1d9d592 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:40.061158 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-742aca9a-7186-444c-a26b-c8b4d1d9d592 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1318 microversion: 2.1 time: 0.899257 Sep 08 12:48:40.063589 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1061/2049] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:39 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1318 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:40.068756 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e3dbe57b-c9bf-4ee6-9e29-55a25b13db6c req-cffa4c89-88dc-4986-8d03-dc4230538f63 service nova] Creating event network-changed:39228a6d-960b-4a1a-a56d-f8eba7c2e0cc for instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b on n-h2-852084-10 Sep 08 12:48:40.089245 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e3dbe57b-c9bf-4ee6-9e29-55a25b13db6c req-cffa4c89-88dc-4986-8d03-dc4230538f63 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096126 Sep 08 12:48:40.095502 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 989/2050] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:48:40.111205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0ac86409-241a-46e1-8e11-5a03b6c39276 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:40.111901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0ac86409-241a-46e1-8e11-5a03b6c39276 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:40.128407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ac86409-241a-46e1-8e11-5a03b6c39276 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:40.131939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ac86409-241a-46e1-8e11-5a03b6c39276 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:40.132570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ac86409-241a-46e1-8e11-5a03b6c39276 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:40.133532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ac86409-241a-46e1-8e11-5a03b6c39276 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:40.140298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ac86409-241a-46e1-8e11-5a03b6c39276 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:40.141124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ac86409-241a-46e1-8e11-5a03b6c39276 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:40.359012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0ac86409-241a-46e1-8e11-5a03b6c39276 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:40.386435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0b97c70-5e3f-49bd-bd0b-355d01ed1b1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:40.389402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0b97c70-5e3f-49bd-bd0b-355d01ed1b1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:40.403419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b97c70-5e3f-49bd-bd0b-355d01ed1b1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:40.404874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b97c70-5e3f-49bd-bd0b-355d01ed1b1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:40.405933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b97c70-5e3f-49bd-bd0b-355d01ed1b1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:40.407551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b97c70-5e3f-49bd-bd0b-355d01ed1b1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:40.408975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b97c70-5e3f-49bd-bd0b-355d01ed1b1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:40.411272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b97c70-5e3f-49bd-bd0b-355d01ed1b1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:40.421079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0ac86409-241a-46e1-8e11-5a03b6c39276 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:40.438976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0ac86409-241a-46e1-8e11-5a03b6c39276 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:40.470337 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0ac86409-241a-46e1-8e11-5a03b6c39276 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1416 microversion: 2.75 time: 0.362855 Sep 08 12:48:40.474494 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1062/2051] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:40 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1416 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:40.685609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc927355-8273-411f-984c-404f0c221e7b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:40.686526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc927355-8273-411f-984c-404f0c221e7b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:40.701734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc927355-8273-411f-984c-404f0c221e7b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:40.702324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc927355-8273-411f-984c-404f0c221e7b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:40.710508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc927355-8273-411f-984c-404f0c221e7b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:40.716154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc927355-8273-411f-984c-404f0c221e7b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:40.716688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc927355-8273-411f-984c-404f0c221e7b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:40.717306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc927355-8273-411f-984c-404f0c221e7b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:40.963974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc927355-8273-411f-984c-404f0c221e7b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:40.979780 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc927355-8273-411f-984c-404f0c221e7b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1282 microversion: 2.1 time: 0.298986 Sep 08 12:48:40.985054 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1063/2052] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:40 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1282 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:41.024512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0b97c70-5e3f-49bd-bd0b-355d01ed1b1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:41.072881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0b97c70-5e3f-49bd-bd0b-355d01ed1b1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:41.077433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0b97c70-5e3f-49bd-bd0b-355d01ed1b1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:41.093679 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0b97c70-5e3f-49bd-bd0b-355d01ed1b1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 0.718033 Sep 08 12:48:41.108205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3afc5d77-fffb-4880-a3da-a4fac982c859 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:41.109886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3afc5d77-fffb-4880-a3da-a4fac982c859 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:41.110180 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 990/2053] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:40 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:41.130634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3afc5d77-fffb-4880-a3da-a4fac982c859 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:41.131446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3afc5d77-fffb-4880-a3da-a4fac982c859 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:41.132046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3afc5d77-fffb-4880-a3da-a4fac982c859 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:41.132949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3afc5d77-fffb-4880-a3da-a4fac982c859 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:41.133573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3afc5d77-fffb-4880-a3da-a4fac982c859 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:41.134191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3afc5d77-fffb-4880-a3da-a4fac982c859 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:41.530803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8890697a-c70b-4f5a-baab-d3235684e822 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:41.531632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8890697a-c70b-4f5a-baab-d3235684e822 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:41.551104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8890697a-c70b-4f5a-baab-d3235684e822 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:41.551880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8890697a-c70b-4f5a-baab-d3235684e822 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:41.552597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8890697a-c70b-4f5a-baab-d3235684e822 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:41.553726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8890697a-c70b-4f5a-baab-d3235684e822 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:41.554617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8890697a-c70b-4f5a-baab-d3235684e822 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:41.556289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8890697a-c70b-4f5a-baab-d3235684e822 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:41.578018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3afc5d77-fffb-4880-a3da-a4fac982c859 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:41.614756 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3afc5d77-fffb-4880-a3da-a4fac982c859 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1318 microversion: 2.1 time: 0.511266 Sep 08 12:48:41.620101 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1064/2054] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:41 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1318 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:41.948290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8890697a-c70b-4f5a-baab-d3235684e822 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:41.980050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8890697a-c70b-4f5a-baab-d3235684e822 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:41.981954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8890697a-c70b-4f5a-baab-d3235684e822 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:41.992921 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8890697a-c70b-4f5a-baab-d3235684e822 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1416 microversion: 2.75 time: 0.467407 Sep 08 12:48:42.020424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f578a795-5a52-4871-92fb-4d7b39a70a95 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:42.024400 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 991/2055] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:41 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1416 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:48:42.026262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f578a795-5a52-4871-92fb-4d7b39a70a95 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:42.041066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=7,nova_api:INSERT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:42.058435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f578a795-5a52-4871-92fb-4d7b39a70a95 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:42.059897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f578a795-5a52-4871-92fb-4d7b39a70a95 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:42.064125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f578a795-5a52-4871-92fb-4d7b39a70a95 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:42.065913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f578a795-5a52-4871-92fb-4d7b39a70a95 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:42.069588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f578a795-5a52-4871-92fb-4d7b39a70a95 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:42.073326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f578a795-5a52-4871-92fb-4d7b39a70a95 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:42.144433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b7540c3e-6e71-4d80-9b63-8dbe7671b368 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:42.148375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b7540c3e-6e71-4d80-9b63-8dbe7671b368 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:42.172655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7540c3e-6e71-4d80-9b63-8dbe7671b368 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:42.177700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7540c3e-6e71-4d80-9b63-8dbe7671b368 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:42.179019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7540c3e-6e71-4d80-9b63-8dbe7671b368 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:42.192188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7540c3e-6e71-4d80-9b63-8dbe7671b368 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:42.193015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7540c3e-6e71-4d80-9b63-8dbe7671b368 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:42.217564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7540c3e-6e71-4d80-9b63-8dbe7671b368 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:43.555780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f578a795-5a52-4871-92fb-4d7b39a70a95 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:43.572480 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f578a795-5a52-4871-92fb-4d7b39a70a95 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1324 microversion: 2.1 time: 1.569192 Sep 08 12:48:43.573908 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1065/2056] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:42 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1324 bytes in 1572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:43.587296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b6c253f3-ab9b-4eb4-99cd-73176e82d40d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:43.588384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b6c253f3-ab9b-4eb4-99cd-73176e82d40d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:43.604360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6c253f3-ab9b-4eb4-99cd-73176e82d40d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:43.605323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6c253f3-ab9b-4eb4-99cd-73176e82d40d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:43.606213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6c253f3-ab9b-4eb4-99cd-73176e82d40d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:43.608898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6c253f3-ab9b-4eb4-99cd-73176e82d40d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:43.612118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6c253f3-ab9b-4eb4-99cd-73176e82d40d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:43.620004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6c253f3-ab9b-4eb4-99cd-73176e82d40d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:43.621281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b7540c3e-6e71-4d80-9b63-8dbe7671b368 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:43.654203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b7540c3e-6e71-4d80-9b63-8dbe7671b368 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:43.664142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b7540c3e-6e71-4d80-9b63-8dbe7671b368 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:43.669991 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b7540c3e-6e71-4d80-9b63-8dbe7671b368 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 1.541945 Sep 08 12:48:43.695648 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 992/2057] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:42 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:43.712518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b2229e11-9f5e-4b1d-a8e5-42689945c022 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:43.721816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b2229e11-9f5e-4b1d-a8e5-42689945c022 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:43.737529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5,nova_api:UPDATE=7,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:43.739886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2229e11-9f5e-4b1d-a8e5-42689945c022 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:43.744652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2229e11-9f5e-4b1d-a8e5-42689945c022 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:43.745701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2229e11-9f5e-4b1d-a8e5-42689945c022 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:43.748843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2229e11-9f5e-4b1d-a8e5-42689945c022 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:43.754477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2229e11-9f5e-4b1d-a8e5-42689945c022 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:43.755595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2229e11-9f5e-4b1d-a8e5-42689945c022 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:44.592084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b2229e11-9f5e-4b1d-a8e5-42689945c022 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:44.606631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b2229e11-9f5e-4b1d-a8e5-42689945c022 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:44.611654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b2229e11-9f5e-4b1d-a8e5-42689945c022 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:44.627892 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b2229e11-9f5e-4b1d-a8e5-42689945c022 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1437 microversion: 2.75 time: 0.928201 Sep 08 12:48:44.631713 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 993/2058] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:43 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1437 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:44.653820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2db13b7a-65f0-4d1f-b81b-ab24135bf699 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:44.654343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2db13b7a-65f0-4d1f-b81b-ab24135bf699 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:44.665152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2db13b7a-65f0-4d1f-b81b-ab24135bf699 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:44.665891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2db13b7a-65f0-4d1f-b81b-ab24135bf699 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:44.667025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2db13b7a-65f0-4d1f-b81b-ab24135bf699 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:44.673131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2db13b7a-65f0-4d1f-b81b-ab24135bf699 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:44.673784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2db13b7a-65f0-4d1f-b81b-ab24135bf699 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:44.674495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2db13b7a-65f0-4d1f-b81b-ab24135bf699 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:45.190843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b6c253f3-ab9b-4eb4-99cd-73176e82d40d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:45.223969 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b6c253f3-ab9b-4eb4-99cd-73176e82d40d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1318 microversion: 2.1 time: 1.647808 Sep 08 12:48:45.224430 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1066/2059] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:43 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1318 bytes in 1650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:45.238988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:45.243014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:45.259750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:45.267594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:45.268393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:45.270150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:45.271138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:45.272259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:45.360514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2db13b7a-65f0-4d1f-b81b-ab24135bf699 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:45.370876 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2db13b7a-65f0-4d1f-b81b-ab24135bf699 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1324 microversion: 2.1 time: 0.738696 Sep 08 12:48:45.378894 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 994/2060] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:44 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1324 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:45.396516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2d060e57-94b6-4d2b-b58b-8ef546722dfb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:45.397403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2d060e57-94b6-4d2b-b58b-8ef546722dfb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:45.411593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d060e57-94b6-4d2b-b58b-8ef546722dfb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:45.424071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d060e57-94b6-4d2b-b58b-8ef546722dfb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:45.425016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d060e57-94b6-4d2b-b58b-8ef546722dfb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:45.426004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d060e57-94b6-4d2b-b58b-8ef546722dfb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:45.436396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d060e57-94b6-4d2b-b58b-8ef546722dfb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:45.437254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d060e57-94b6-4d2b-b58b-8ef546722dfb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:45.461663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:48:45.462339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:48:45.463035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:48:45.463662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:48:45.464643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:48:45.805265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:45.825857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:45.828227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:45.829272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:45.831080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:45.833702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:45.834546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:45.981414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:45.998510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2d060e57-94b6-4d2b-b58b-8ef546722dfb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:46.014265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2d060e57-94b6-4d2b-b58b-8ef546722dfb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:46.015953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2d060e57-94b6-4d2b-b58b-8ef546722dfb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:46.017568 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2d060e57-94b6-4d2b-b58b-8ef546722dfb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 0.637327 Sep 08 12:48:46.029356 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 995/2061] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:45 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:46.150966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:46.165627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:46.167286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:46.181512 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b484f2b7-764b-4baa-b096-5374df6c75d7 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "POST /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db/action" status: 202 len: 1494 microversion: 2.75 time: 0.955774 Sep 08 12:48:46.182191 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1067/2062] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 12:48:45 2022] POST /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db/action => generated 1494 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 12:48:46.239559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dddd05bd-aa9e-43bf-9e4b-b55e3e1d6e67 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:46.241092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dddd05bd-aa9e-43bf-9e4b-b55e3e1d6e67 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:46.254889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dddd05bd-aa9e-43bf-9e4b-b55e3e1d6e67 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:46.255442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dddd05bd-aa9e-43bf-9e4b-b55e3e1d6e67 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:46.255927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dddd05bd-aa9e-43bf-9e4b-b55e3e1d6e67 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:46.256669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dddd05bd-aa9e-43bf-9e4b-b55e3e1d6e67 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:46.257133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dddd05bd-aa9e-43bf-9e4b-b55e3e1d6e67 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:46.263937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-45f0d2fc-df85-4169-aa13-6b6a6445c210 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:46.264747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-45f0d2fc-df85-4169-aa13-6b6a6445c210 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:46.282859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dddd05bd-aa9e-43bf-9e4b-b55e3e1d6e67 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:46.293103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45f0d2fc-df85-4169-aa13-6b6a6445c210 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:46.296619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45f0d2fc-df85-4169-aa13-6b6a6445c210 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:46.297302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45f0d2fc-df85-4169-aa13-6b6a6445c210 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:46.298253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45f0d2fc-df85-4169-aa13-6b6a6445c210 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:46.300232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45f0d2fc-df85-4169-aa13-6b6a6445c210 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:46.303927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45f0d2fc-df85-4169-aa13-6b6a6445c210 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:46.887532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dddd05bd-aa9e-43bf-9e4b-b55e3e1d6e67 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:46.902212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dddd05bd-aa9e-43bf-9e4b-b55e3e1d6e67 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:46.911412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dddd05bd-aa9e-43bf-9e4b-b55e3e1d6e67 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:46.934205 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dddd05bd-aa9e-43bf-9e4b-b55e3e1d6e67 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1446 microversion: 2.75 time: 0.699395 Sep 08 12:48:46.937674 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 996/2063] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:46 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1446 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:46.964785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-153ecc68-e8ac-4f76-8952-b8bb6efa7f9c tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:46.966067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-153ecc68-e8ac-4f76-8952-b8bb6efa7f9c tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:46.975166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-153ecc68-e8ac-4f76-8952-b8bb6efa7f9c tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:46.976199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-153ecc68-e8ac-4f76-8952-b8bb6efa7f9c tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:46.979439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-153ecc68-e8ac-4f76-8952-b8bb6efa7f9c tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:46.980632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-153ecc68-e8ac-4f76-8952-b8bb6efa7f9c tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:46.984709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-153ecc68-e8ac-4f76-8952-b8bb6efa7f9c tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:46.995410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-153ecc68-e8ac-4f76-8952-b8bb6efa7f9c tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:47.146484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=20 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:47.804196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-45f0d2fc-df85-4169-aa13-6b6a6445c210 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:47.837725 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-45f0d2fc-df85-4169-aa13-6b6a6445c210 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1318 microversion: 2.1 time: 1.578029 Sep 08 12:48:47.839605 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1068/2064] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:46 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1318 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:48:47.850105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-22715736-e05e-4053-98da-b5109e9fd65d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:47.851703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-22715736-e05e-4053-98da-b5109e9fd65d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:47.880260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22715736-e05e-4053-98da-b5109e9fd65d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:47.881549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22715736-e05e-4053-98da-b5109e9fd65d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:47.882531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22715736-e05e-4053-98da-b5109e9fd65d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:47.884133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22715736-e05e-4053-98da-b5109e9fd65d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:47.885668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22715736-e05e-4053-98da-b5109e9fd65d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:47.886732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22715736-e05e-4053-98da-b5109e9fd65d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:47.909772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-153ecc68-e8ac-4f76-8952-b8bb6efa7f9c tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:47.947134 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-153ecc68-e8ac-4f76-8952-b8bb6efa7f9c tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1324 microversion: 2.1 time: 1.007306 Sep 08 12:48:47.963686 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 997/2065] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:46 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1324 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:48.005407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8a1be777-1fa3-42f1-bf20-76b1622304fe tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:48.006683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8a1be777-1fa3-42f1-bf20-76b1622304fe tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:48.021625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a1be777-1fa3-42f1-bf20-76b1622304fe tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:48.023989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a1be777-1fa3-42f1-bf20-76b1622304fe tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:48.024903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a1be777-1fa3-42f1-bf20-76b1622304fe tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:48.027330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a1be777-1fa3-42f1-bf20-76b1622304fe tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:48.028299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a1be777-1fa3-42f1-bf20-76b1622304fe tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:48.029034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a1be777-1fa3-42f1-bf20-76b1622304fe tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:48.299538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a1be777-1fa3-42f1-bf20-76b1622304fe tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:48.335944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a1be777-1fa3-42f1-bf20-76b1622304fe tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:48.338787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a1be777-1fa3-42f1-bf20-76b1622304fe tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:48.349424 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8a1be777-1fa3-42f1-bf20-76b1622304fe tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1446 microversion: 2.75 time: 0.350592 Sep 08 12:48:48.350380 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 998/2066] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:47 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1446 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:48.651086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-22715736-e05e-4053-98da-b5109e9fd65d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:48.698980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-22715736-e05e-4053-98da-b5109e9fd65d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:48.713847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e552b04f-714b-496a-9a44-ca8303fc635d req-f308df2c-d713-4b02-9da2-e8c325980873 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50dcd06-1d5d-44ad-b802-4ef07c7bac31", "tag": "09c06616-5ed3-4b3a-86d4-642b9f89e269"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:48.715441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-22715736-e05e-4053-98da-b5109e9fd65d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:48.722962 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-22715736-e05e-4053-98da-b5109e9fd65d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 0.878979 Sep 08 12:48:48.733437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e552b04f-714b-496a-9a44-ca8303fc635d req-f308df2c-d713-4b02-9da2-e8c325980873 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:48.734344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e552b04f-714b-496a-9a44-ca8303fc635d req-f308df2c-d713-4b02-9da2-e8c325980873 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:48.735397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e552b04f-714b-496a-9a44-ca8303fc635d req-f308df2c-d713-4b02-9da2-e8c325980873 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:48.735507 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1069/2067] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:47 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:48.754537 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e552b04f-714b-496a-9a44-ca8303fc635d req-f308df2c-d713-4b02-9da2-e8c325980873 service nova] Creating event network-changed:09c06616-5ed3-4b3a-86d4-642b9f89e269 for instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 on n-h1-852084-10 Sep 08 12:48:48.770011 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e552b04f-714b-496a-9a44-ca8303fc635d req-f308df2c-d713-4b02-9da2-e8c325980873 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060006 Sep 08 12:48:48.771757 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 999/2068] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:48:48.885737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-df1bffcd-c455-47aa-94d3-77b835675175 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:48.886504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-df1bffcd-c455-47aa-94d3-77b835675175 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:48.898481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df1bffcd-c455-47aa-94d3-77b835675175 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:48.898481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df1bffcd-c455-47aa-94d3-77b835675175 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:48.898728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df1bffcd-c455-47aa-94d3-77b835675175 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:48.904074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df1bffcd-c455-47aa-94d3-77b835675175 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:48.904711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df1bffcd-c455-47aa-94d3-77b835675175 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:48.905221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df1bffcd-c455-47aa-94d3-77b835675175 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:48.980078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-40a718e7-ecdf-46a4-bbb6-180410d99314 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:48.986089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-40a718e7-ecdf-46a4-bbb6-180410d99314 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:49.025875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40a718e7-ecdf-46a4-bbb6-180410d99314 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:49.026812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40a718e7-ecdf-46a4-bbb6-180410d99314 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:49.029211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40a718e7-ecdf-46a4-bbb6-180410d99314 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:49.034233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40a718e7-ecdf-46a4-bbb6-180410d99314 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:49.048945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40a718e7-ecdf-46a4-bbb6-180410d99314 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:49.052783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40a718e7-ecdf-46a4-bbb6-180410d99314 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:49.755079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-df1bffcd-c455-47aa-94d3-77b835675175 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:49.778089 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-df1bffcd-c455-47aa-94d3-77b835675175 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1318 microversion: 2.1 time: 0.898366 Sep 08 12:48:49.779175 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1070/2069] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:48 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1318 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:49.811799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f0b71078-967f-480d-8c63-b860eba62b3e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:49.812716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f0b71078-967f-480d-8c63-b860eba62b3e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:49.824239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0b71078-967f-480d-8c63-b860eba62b3e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:49.825002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0b71078-967f-480d-8c63-b860eba62b3e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:49.838284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0b71078-967f-480d-8c63-b860eba62b3e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:49.839071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0b71078-967f-480d-8c63-b860eba62b3e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:49.839623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0b71078-967f-480d-8c63-b860eba62b3e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:49.840102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0b71078-967f-480d-8c63-b860eba62b3e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:50.354522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f0b71078-967f-480d-8c63-b860eba62b3e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:50.370564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f0b71078-967f-480d-8c63-b860eba62b3e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:50.374110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f0b71078-967f-480d-8c63-b860eba62b3e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:50.413524 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f0b71078-967f-480d-8c63-b860eba62b3e tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1446 microversion: 2.75 time: 0.621227 Sep 08 12:48:50.414369 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1071/2070] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:49 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1446 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:50.440741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8363c59-6121-4781-a861-d3b3610a7f6c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:50.441380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b8363c59-6121-4781-a861-d3b3610a7f6c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:50.458605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8363c59-6121-4781-a861-d3b3610a7f6c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:50.459111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8363c59-6121-4781-a861-d3b3610a7f6c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:50.459611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8363c59-6121-4781-a861-d3b3610a7f6c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:50.469317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8363c59-6121-4781-a861-d3b3610a7f6c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:50.473498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8363c59-6121-4781-a861-d3b3610a7f6c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:50.477974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8363c59-6121-4781-a861-d3b3610a7f6c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:50.524625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:50.942349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-40a718e7-ecdf-46a4-bbb6-180410d99314 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:50.985165 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-40a718e7-ecdf-46a4-bbb6-180410d99314 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1324 microversion: 2.1 time: 2.007943 Sep 08 12:48:50.986370 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1000/2071] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:48 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1324 bytes in 2014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:48:51.016127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8472af4a-c285-4da9-a7c1-486ecde5032d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:51.018163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8472af4a-c285-4da9-a7c1-486ecde5032d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:51.039088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8472af4a-c285-4da9-a7c1-486ecde5032d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:51.039861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8472af4a-c285-4da9-a7c1-486ecde5032d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:51.040904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8472af4a-c285-4da9-a7c1-486ecde5032d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:51.042456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8472af4a-c285-4da9-a7c1-486ecde5032d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:51.043764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8472af4a-c285-4da9-a7c1-486ecde5032d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:51.044793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8472af4a-c285-4da9-a7c1-486ecde5032d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:51.359729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b8363c59-6121-4781-a861-d3b3610a7f6c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:51.386926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b8363c59-6121-4781-a861-d3b3610a7f6c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:51.391718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b8363c59-6121-4781-a861-d3b3610a7f6c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:51.394657 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8363c59-6121-4781-a861-d3b3610a7f6c tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 0.978276 Sep 08 12:48:51.414662 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1072/2072] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:50 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:51.426584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-39311651-e4a7-4200-975a-4da737648e82 req-756067df-d239-4f08-aff0-09ab280c13b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afa649b-c753-458a-9be6-2e4d3fdfb25b", "name": "network-vif-plugged", "status": "completed", "tag": "39228a6d-960b-4a1a-a56d-f8eba7c2e0cc"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:51.459097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-39311651-e4a7-4200-975a-4da737648e82 req-756067df-d239-4f08-aff0-09ab280c13b7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:51.459910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-39311651-e4a7-4200-975a-4da737648e82 req-756067df-d239-4f08-aff0-09ab280c13b7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:51.461087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-39311651-e4a7-4200-975a-4da737648e82 req-756067df-d239-4f08-aff0-09ab280c13b7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:51.491202 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-39311651-e4a7-4200-975a-4da737648e82 req-756067df-d239-4f08-aff0-09ab280c13b7 service nova] Creating event network-vif-plugged:39228a6d-960b-4a1a-a56d-f8eba7c2e0cc for instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b on n-h2-852084-10 Sep 08 12:48:51.504544 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-39311651-e4a7-4200-975a-4da737648e82 req-756067df-d239-4f08-aff0-09ab280c13b7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086807 Sep 08 12:48:51.507444 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1073/2073] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:48:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:48:51.522451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e03e459-2ca2-4798-9607-51217f6cafd8 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:51.524742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2e03e459-2ca2-4798-9607-51217f6cafd8 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:51.542365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e03e459-2ca2-4798-9607-51217f6cafd8 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:51.543606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e03e459-2ca2-4798-9607-51217f6cafd8 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:51.544711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e03e459-2ca2-4798-9607-51217f6cafd8 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:51.547061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e03e459-2ca2-4798-9607-51217f6cafd8 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:51.548449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e03e459-2ca2-4798-9607-51217f6cafd8 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:51.551186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e03e459-2ca2-4798-9607-51217f6cafd8 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:52.310363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2e03e459-2ca2-4798-9607-51217f6cafd8 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:52.330353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2e03e459-2ca2-4798-9607-51217f6cafd8 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:52.336231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2e03e459-2ca2-4798-9607-51217f6cafd8 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:52.351043 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2e03e459-2ca2-4798-9607-51217f6cafd8 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1446 microversion: 2.75 time: 0.841163 Sep 08 12:48:52.352760 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1074/2074] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:51 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1446 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:52.363854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dc257f9a-d487-41e4-90a1-7d0cca55c6cb tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:52.366025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dc257f9a-d487-41e4-90a1-7d0cca55c6cb tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:52.404640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc257f9a-d487-41e4-90a1-7d0cca55c6cb tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:52.407144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc257f9a-d487-41e4-90a1-7d0cca55c6cb tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:52.411062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc257f9a-d487-41e4-90a1-7d0cca55c6cb tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:52.414281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc257f9a-d487-41e4-90a1-7d0cca55c6cb tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:52.430785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc257f9a-d487-41e4-90a1-7d0cca55c6cb tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:52.431704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc257f9a-d487-41e4-90a1-7d0cca55c6cb tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:52.544813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8472af4a-c285-4da9-a7c1-486ecde5032d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:52.572018 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8472af4a-c285-4da9-a7c1-486ecde5032d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1318 microversion: 2.1 time: 1.583663 Sep 08 12:48:52.600935 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1001/2075] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:50 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1318 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:52.600935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7c379d21-bc0f-4ff0-93fb-8bc52e9a7a1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:52.600935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7c379d21-bc0f-4ff0-93fb-8bc52e9a7a1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:52.620653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c379d21-bc0f-4ff0-93fb-8bc52e9a7a1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:52.620653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c379d21-bc0f-4ff0-93fb-8bc52e9a7a1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:52.624986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c379d21-bc0f-4ff0-93fb-8bc52e9a7a1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:52.626351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c379d21-bc0f-4ff0-93fb-8bc52e9a7a1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:52.627168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c379d21-bc0f-4ff0-93fb-8bc52e9a7a1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:52.628012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c379d21-bc0f-4ff0-93fb-8bc52e9a7a1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:53.566595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dc257f9a-d487-41e4-90a1-7d0cca55c6cb tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:53.600520 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dc257f9a-d487-41e4-90a1-7d0cca55c6cb tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1324 microversion: 2.1 time: 1.245902 Sep 08 12:48:53.602782 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1075/2076] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:52 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1324 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:53.619196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f80f3562-61f6-43cd-ba7d-61355983e63f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:53.622317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f80f3562-61f6-43cd-ba7d-61355983e63f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:53.634179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f80f3562-61f6-43cd-ba7d-61355983e63f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:53.635576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f80f3562-61f6-43cd-ba7d-61355983e63f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:53.636552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f80f3562-61f6-43cd-ba7d-61355983e63f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:53.638087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f80f3562-61f6-43cd-ba7d-61355983e63f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:53.639176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f80f3562-61f6-43cd-ba7d-61355983e63f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:53.640189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f80f3562-61f6-43cd-ba7d-61355983e63f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:53.972921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f80f3562-61f6-43cd-ba7d-61355983e63f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:53.975879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7c379d21-bc0f-4ff0-93fb-8bc52e9a7a1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:54.029542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7c379d21-bc0f-4ff0-93fb-8bc52e9a7a1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:54.034538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7c379d21-bc0f-4ff0-93fb-8bc52e9a7a1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:54.038205 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7c379d21-bc0f-4ff0-93fb-8bc52e9a7a1f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 1.452139 Sep 08 12:48:54.039286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f80f3562-61f6-43cd-ba7d-61355983e63f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:54.042233 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1002/2077] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:52 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:54.083176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c8739088-5cb9-4da6-a205-58656d956670 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:54.084553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f80f3562-61f6-43cd-ba7d-61355983e63f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:54.088753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c8739088-5cb9-4da6-a205-58656d956670 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:54.109873 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f80f3562-61f6-43cd-ba7d-61355983e63f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1446 microversion: 2.75 time: 0.500397 Sep 08 12:48:54.116055 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1076/2078] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:53 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1446 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:54.127481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8739088-5cb9-4da6-a205-58656d956670 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:54.127481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8739088-5cb9-4da6-a205-58656d956670 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:54.127481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8739088-5cb9-4da6-a205-58656d956670 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:54.127481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8739088-5cb9-4da6-a205-58656d956670 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:54.127956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8739088-5cb9-4da6-a205-58656d956670 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:54.127956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8739088-5cb9-4da6-a205-58656d956670 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:54.633495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3c7c8f14-fecd-4010-92d1-a115d66a8ced tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:54.635387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3c7c8f14-fecd-4010-92d1-a115d66a8ced tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:54.656738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c7c8f14-fecd-4010-92d1-a115d66a8ced tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:54.657625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c7c8f14-fecd-4010-92d1-a115d66a8ced tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:54.658402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c7c8f14-fecd-4010-92d1-a115d66a8ced tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:54.659782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c7c8f14-fecd-4010-92d1-a115d66a8ced tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:54.660713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c7c8f14-fecd-4010-92d1-a115d66a8ced tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:54.672676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c7c8f14-fecd-4010-92d1-a115d66a8ced tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:55.198780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c8739088-5cb9-4da6-a205-58656d956670 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:55.212691 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c8739088-5cb9-4da6-a205-58656d956670 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1508 microversion: 2.1 time: 1.167947 Sep 08 12:48:55.215733 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1003/2079] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:54 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1508 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:55.240283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e845ceed-a802-48a1-983c-da7b387a6f35 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:55.240927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e845ceed-a802-48a1-983c-da7b387a6f35 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:55.264039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e845ceed-a802-48a1-983c-da7b387a6f35 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:55.264830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e845ceed-a802-48a1-983c-da7b387a6f35 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:55.265347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e845ceed-a802-48a1-983c-da7b387a6f35 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:55.266135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e845ceed-a802-48a1-983c-da7b387a6f35 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:55.267008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e845ceed-a802-48a1-983c-da7b387a6f35 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:55.273627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e845ceed-a802-48a1-983c-da7b387a6f35 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:55.806957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3c7c8f14-fecd-4010-92d1-a115d66a8ced tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:55.826207 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3c7c8f14-fecd-4010-92d1-a115d66a8ced tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1324 microversion: 2.1 time: 1.200011 Sep 08 12:48:55.826827 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1077/2080] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:54 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1324 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:48:55.846341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc9154b7-418a-4bf5-a2b6-302db5a6e20b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:55.847662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc9154b7-418a-4bf5-a2b6-302db5a6e20b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:55.866404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc9154b7-418a-4bf5-a2b6-302db5a6e20b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:55.866950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc9154b7-418a-4bf5-a2b6-302db5a6e20b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:55.867675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc9154b7-418a-4bf5-a2b6-302db5a6e20b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:55.868628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc9154b7-418a-4bf5-a2b6-302db5a6e20b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:55.869223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc9154b7-418a-4bf5-a2b6-302db5a6e20b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:55.869816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc9154b7-418a-4bf5-a2b6-302db5a6e20b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:56.012845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e845ceed-a802-48a1-983c-da7b387a6f35 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:56.014765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc9154b7-418a-4bf5-a2b6-302db5a6e20b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:56.027842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e845ceed-a802-48a1-983c-da7b387a6f35 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:56.030730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e845ceed-a802-48a1-983c-da7b387a6f35 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:56.032948 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e845ceed-a802-48a1-983c-da7b387a6f35 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1486 microversion: 2.25 time: 0.815258 Sep 08 12:48:56.034057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc9154b7-418a-4bf5-a2b6-302db5a6e20b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:56.035322 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1004/2081] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:55 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1486 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:56.042189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a2186e1-e826-400f-8670-055cb3f293d0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:56.043458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2a2186e1-e826-400f-8670-055cb3f293d0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:56.048184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc9154b7-418a-4bf5-a2b6-302db5a6e20b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:56.053073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a2186e1-e826-400f-8670-055cb3f293d0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:56.054461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a2186e1-e826-400f-8670-055cb3f293d0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:56.055547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a2186e1-e826-400f-8670-055cb3f293d0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:56.056747 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc9154b7-418a-4bf5-a2b6-302db5a6e20b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1446 microversion: 2.75 time: 0.228214 Sep 08 12:48:56.057361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a2186e1-e826-400f-8670-055cb3f293d0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:56.058821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a2186e1-e826-400f-8670-055cb3f293d0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:56.059911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a2186e1-e826-400f-8670-055cb3f293d0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:56.072223 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1078/2082] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:55 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1446 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:56.140275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:48:56.406105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-987184035", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "4747d3aa-48ad-4261-8c5f-8e68d67f95b8"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:56.537473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] validate_networks() for [('4747d3aa-48ad-4261-8c5f-8e68d67f95b8', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:48:56.680813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2a2186e1-e826-400f-8670-055cb3f293d0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:56.695658 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a2186e1-e826-400f-8670-055cb3f293d0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1508 microversion: 2.1 time: 0.658849 Sep 08 12:48:56.700234 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1005/2083] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:56 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1508 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:56.736055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:48:56.742102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:56.764528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:56.765396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:56.766432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:56.767449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:56.768096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:56.769323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:57.021455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:48:57.022324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:48:57.023318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:48:57.024153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:48:57.024846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:48:57.202226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:57.272362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:57.275282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:57.282747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:57.284351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:57.287375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:57.296315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:57.417196 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d2cfd8f0-74d1-44e0-b48d-a0ecc70427ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "POST /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b/action" status: 202 len: 1110 microversion: 2.1 time: 0.684393 Sep 08 12:48:57.419668 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1006/2084] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:48:56 2022] POST /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b/action => generated 1110 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 08 12:48:57.436657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-82b6b34a-c9a8-45af-9f23-f9ac8b640649 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:57.438716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-82b6b34a-c9a8-45af-9f23-f9ac8b640649 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:57.462616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82b6b34a-c9a8-45af-9f23-f9ac8b640649 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:57.466459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82b6b34a-c9a8-45af-9f23-f9ac8b640649 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:57.467704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82b6b34a-c9a8-45af-9f23-f9ac8b640649 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:57.472487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82b6b34a-c9a8-45af-9f23-f9ac8b640649 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:57.473253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82b6b34a-c9a8-45af-9f23-f9ac8b640649 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:57.477401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82b6b34a-c9a8-45af-9f23-f9ac8b640649 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:58.299369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-82b6b34a-c9a8-45af-9f23-f9ac8b640649 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:58.335653 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-82b6b34a-c9a8-45af-9f23-f9ac8b640649 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1324 microversion: 2.1 time: 0.911778 Sep 08 12:48:58.338098 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1007/2085] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:57 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1324 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:58.364297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e5b344de-61d3-41ea-aac3-5aabad0c64e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:58.369896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e5b344de-61d3-41ea-aac3-5aabad0c64e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:58.402420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5b344de-61d3-41ea-aac3-5aabad0c64e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:58.405233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5b344de-61d3-41ea-aac3-5aabad0c64e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:58.413853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5b344de-61d3-41ea-aac3-5aabad0c64e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:58.415389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5b344de-61d3-41ea-aac3-5aabad0c64e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:58.418197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5b344de-61d3-41ea-aac3-5aabad0c64e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:58.423656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5b344de-61d3-41ea-aac3-5aabad0c64e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:58.518015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:48:58.519579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:48:58.520221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:48:58.520797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:48:58.521599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:48:58.554961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:58.555783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:58.556356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:58.557768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:58.558385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:58.562543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:58.644502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Getting quotas for project f42c21dc89784818ae3f51b9086771d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:48:58.670132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Getting quotas for user e6a4501165214cbbaedd633030e68a6b and project f42c21dc89784818ae3f51b9086771d7. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:48:58.768428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:48:58.777923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:48:58.861674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e5b344de-61d3-41ea-aac3-5aabad0c64e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:58.879464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e5b344de-61d3-41ea-aac3-5aabad0c64e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:58.882283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e5b344de-61d3-41ea-aac3-5aabad0c64e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:58.886953 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e5b344de-61d3-41ea-aac3-5aabad0c64e0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1476 microversion: 2.25 time: 0.545759 Sep 08 12:48:58.892046 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1008/2086] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:58 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1476 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:58.905675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-517c1719-6681-4ae1-8ebb-93e48c8f4d15 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:58.906995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-517c1719-6681-4ae1-8ebb-93e48c8f4d15 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:58.925181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-517c1719-6681-4ae1-8ebb-93e48c8f4d15 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:58.928662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-517c1719-6681-4ae1-8ebb-93e48c8f4d15 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:58.929306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-517c1719-6681-4ae1-8ebb-93e48c8f4d15 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:58.930989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-517c1719-6681-4ae1-8ebb-93e48c8f4d15 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:58.939929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-517c1719-6681-4ae1-8ebb-93e48c8f4d15 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:58.945853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-517c1719-6681-4ae1-8ebb-93e48c8f4d15 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:58.966059 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0fe19b43-bd95-4631-acb6-8a826e9ff1d1 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.891922 Sep 08 12:48:58.980124 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1079/2087] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:48:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:48:58.995762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-91a097ba-f57c-45f6-8332-eca4b2393550 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:58.997405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-91a097ba-f57c-45f6-8332-eca4b2393550 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:59.019272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91a097ba-f57c-45f6-8332-eca4b2393550 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:59.021839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91a097ba-f57c-45f6-8332-eca4b2393550 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:59.022779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91a097ba-f57c-45f6-8332-eca4b2393550 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:59.024223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91a097ba-f57c-45f6-8332-eca4b2393550 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:59.025516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91a097ba-f57c-45f6-8332-eca4b2393550 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:59.026668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91a097ba-f57c-45f6-8332-eca4b2393550 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:59.191291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-517c1719-6681-4ae1-8ebb-93e48c8f4d15 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:59.232724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-517c1719-6681-4ae1-8ebb-93e48c8f4d15 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:59.238200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-517c1719-6681-4ae1-8ebb-93e48c8f4d15 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:59.264087 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-517c1719-6681-4ae1-8ebb-93e48c8f4d15 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1446 microversion: 2.75 time: 0.368996 Sep 08 12:48:59.266430 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1009/2088] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:48:58 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1446 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:59.547366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-91a097ba-f57c-45f6-8332-eca4b2393550 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:59.558015 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-91a097ba-f57c-45f6-8332-eca4b2393550 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1515 microversion: 2.1 time: 0.576178 Sep 08 12:48:59.562071 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1080/2089] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:58 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1515 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:59.568676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9a81e6ad-f2f7-4005-94e4-bfedeea7ef03 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '.version_select at 0x7fdb3f2de160>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:59.573661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a81e6ad-f2f7-4005-94e4-bfedeea7ef03 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:59.575186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a81e6ad-f2f7-4005-94e4-bfedeea7ef03 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:59.586441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a81e6ad-f2f7-4005-94e4-bfedeea7ef03 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:59.606706 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9a81e6ad-f2f7-4005-94e4-bfedeea7ef03 tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/os-migrations" status: 200 len: 1714 microversion: 2.25 time: 0.042256 Sep 08 12:48:59.610285 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1081/2090] 10.222.0.78 () {60 vars in 1184 bytes} [Thu Sep 8 12:48:59 2022] GET /compute/v2.1/os-migrations => generated 1714 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:48:59.620386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bf3b791c-aa55-4a41-acbf-7424f4996b5c tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:59.622803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bf3b791c-aa55-4a41-acbf-7424f4996b5c tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:59.875566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bf3b791c-aa55-4a41-acbf-7424f4996b5c tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a4501165214cbbaedd633030e68a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42c21dc89784818ae3f51b9086771d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:48:59.896955 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bf3b791c-aa55-4a41-acbf-7424f4996b5c tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 200 len: 1215 microversion: 2.1 time: 0.279900 Sep 08 12:48:59.897835 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1082/2091] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:59 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 1215 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:48:59.915451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-97f03da2-c5f0-4008-9a70-ea6afda4d064 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:59.926647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-97f03da2-c5f0-4008-9a70-ea6afda4d064 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:48:59.961903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d5f46553-2c56-41d7-88df-640c99862660 tempest-ListImagesTestJSON-2015774497 tempest-ListImagesTestJSON-2015774497-project] Calling method '.version_select at 0x7fdb3f1c0280>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:48:59.967849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97f03da2-c5f0-4008-9a70-ea6afda4d064 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:59.968466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97f03da2-c5f0-4008-9a70-ea6afda4d064 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:59.968921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97f03da2-c5f0-4008-9a70-ea6afda4d064 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:48:59.976712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97f03da2-c5f0-4008-9a70-ea6afda4d064 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:48:59.977331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97f03da2-c5f0-4008-9a70-ea6afda4d064 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:48:59.980706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97f03da2-c5f0-4008-9a70-ea6afda4d064 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:00.056299 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d5f46553-2c56-41d7-88df-640c99862660 tempest-ListImagesTestJSON-2015774497 tempest-ListImagesTestJSON-2015774497-project] 10.222.0.78 "GET /compute/v2.1/images/f54d39f0-e02f-4735-8a67-b5b40688d75d" status: 200 len: 784 microversion: 2.1 time: 0.785687 Sep 08 12:49:00.057031 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1010/2092] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:48:59 2022] GET /compute/v2.1/images/f54d39f0-e02f-4735-8a67-b5b40688d75d => generated 784 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:00.096403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-fdc8b285-5715-4731-aac5-64330d9130d2 req-a8cb2f89-9b01-406e-adf4-43fb9cd3c3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50dcd06-1d5d-44ad-b802-4ef07c7bac31", "name": "network-vif-plugged", "status": "completed", "tag": "09c06616-5ed3-4b3a-86d4-642b9f89e269"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:00.166585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fdc8b285-5715-4731-aac5-64330d9130d2 req-a8cb2f89-9b01-406e-adf4-43fb9cd3c3e3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:00.167288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fdc8b285-5715-4731-aac5-64330d9130d2 req-a8cb2f89-9b01-406e-adf4-43fb9cd3c3e3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:00.169370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fdc8b285-5715-4731-aac5-64330d9130d2 req-a8cb2f89-9b01-406e-adf4-43fb9cd3c3e3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:00.199555 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-fdc8b285-5715-4731-aac5-64330d9130d2 req-a8cb2f89-9b01-406e-adf4-43fb9cd3c3e3 service nova] Creating event network-vif-plugged:09c06616-5ed3-4b3a-86d4-642b9f89e269 for instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 on n-h1-852084-10 Sep 08 12:49:00.217242 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-fdc8b285-5715-4731-aac5-64330d9130d2 req-a8cb2f89-9b01-406e-adf4-43fb9cd3c3e3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135885 Sep 08 12:49:00.221187 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1011/2093] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:00.233337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff86af00-5584-46bf-b884-0964e50d28bc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:00.237514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ff86af00-5584-46bf-b884-0964e50d28bc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:00.275520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff86af00-5584-46bf-b884-0964e50d28bc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:00.281323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff86af00-5584-46bf-b884-0964e50d28bc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:00.286676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff86af00-5584-46bf-b884-0964e50d28bc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:00.289110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff86af00-5584-46bf-b884-0964e50d28bc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:00.291646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff86af00-5584-46bf-b884-0964e50d28bc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:00.296481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff86af00-5584-46bf-b884-0964e50d28bc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:00.689844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-97f03da2-c5f0-4008-9a70-ea6afda4d064 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:00.722862 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-97f03da2-c5f0-4008-9a70-ea6afda4d064 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1324 microversion: 2.1 time: 0.819615 Sep 08 12:49:00.725340 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1083/2094] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:48:59 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1324 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:00.743541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc17299d-8d23-481c-954d-e17815944fe2 tempest-ListImagesTestJSON-2015774497 tempest-ListImagesTestJSON-2015774497-project] Calling method '.version_select at 0x7fdb3f248a60>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:00.828204 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc17299d-8d23-481c-954d-e17815944fe2 tempest-ListImagesTestJSON-2015774497 tempest-ListImagesTestJSON-2015774497-project] 10.222.0.78 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.100890 Sep 08 12:49:00.828821 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1084/2095] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Sep 8 12:49:00 2022] GET /compute/v2.1/images => generated 445 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:00.845495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-467fc3ab-1092-40f9-ae87-6edd17592c8f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:00.848355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-467fc3ab-1092-40f9-ae87-6edd17592c8f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:00.863950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-467fc3ab-1092-40f9-ae87-6edd17592c8f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:00.865548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-467fc3ab-1092-40f9-ae87-6edd17592c8f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:00.866093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-467fc3ab-1092-40f9-ae87-6edd17592c8f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:00.866877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-467fc3ab-1092-40f9-ae87-6edd17592c8f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:00.869741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-467fc3ab-1092-40f9-ae87-6edd17592c8f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:00.870243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-467fc3ab-1092-40f9-ae87-6edd17592c8f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:00.959973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-ff86af00-5584-46bf-b884-0964e50d28bc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] Lazy-loading 'services' on Instance uuid 19ac97d7-8051-4b86-981b-eae55076e04c {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:49:01.025955 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ff86af00-5584-46bf-b884-0964e50d28bc tempest-LiveAutoBlockMigrationV225Test-494265812 tempest-LiveAutoBlockMigrationV225Test-494265812-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1971 microversion: 2.25 time: 0.800466 Sep 08 12:49:01.026908 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1012/2096] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:00 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1971 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:01.066005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-467fc3ab-1092-40f9-ae87-6edd17592c8f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:01.085413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-467fc3ab-1092-40f9-ae87-6edd17592c8f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:01.086680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-467fc3ab-1092-40f9-ae87-6edd17592c8f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:01.103890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7e69345f-1842-4326-aa45-50edce6c33ce tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:01.120215 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-467fc3ab-1092-40f9-ae87-6edd17592c8f tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1446 microversion: 2.75 time: 0.281695 Sep 08 12:49:01.121876 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1085/2097] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:00 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1446 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:01.131162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7e69345f-1842-4326-aa45-50edce6c33ce tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:01.134122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ead6559a-dd76-4fd7-9184-ce30dfd3d5f7 tempest-ListImagesTestJSON-2015774497 tempest-ListImagesTestJSON-2015774497-project] Calling method '.version_select at 0x7fdb3f2ecc10>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:01.163850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e69345f-1842-4326-aa45-50edce6c33ce tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:01.166980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e69345f-1842-4326-aa45-50edce6c33ce tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:01.181822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e69345f-1842-4326-aa45-50edce6c33ce tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:01.185436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e69345f-1842-4326-aa45-50edce6c33ce tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:01.189404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e69345f-1842-4326-aa45-50edce6c33ce tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:01.201665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e69345f-1842-4326-aa45-50edce6c33ce tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:01.358772 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ead6559a-dd76-4fd7-9184-ce30dfd3d5f7 tempest-ListImagesTestJSON-2015774497 tempest-ListImagesTestJSON-2015774497-project] 10.222.0.78 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.235140 Sep 08 12:49:01.362153 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1086/2098] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 12:49:01 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:01.385002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9fddb804-981f-4b9b-96c1-df4fa93ec9d0 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:01.388868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9fddb804-981f-4b9b-96c1-df4fa93ec9d0 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:01.435869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9fddb804-981f-4b9b-96c1-df4fa93ec9d0 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:01.442808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9fddb804-981f-4b9b-96c1-df4fa93ec9d0 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:01.445462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9fddb804-981f-4b9b-96c1-df4fa93ec9d0 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:01.447258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9fddb804-981f-4b9b-96c1-df4fa93ec9d0 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:01.448451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9fddb804-981f-4b9b-96c1-df4fa93ec9d0 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:01.452752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9fddb804-981f-4b9b-96c1-df4fa93ec9d0 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:01.997661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9fddb804-981f-4b9b-96c1-df4fa93ec9d0 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a4501165214cbbaedd633030e68a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42c21dc89784818ae3f51b9086771d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:02.028909 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9fddb804-981f-4b9b-96c1-df4fa93ec9d0 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 200 len: 1267 microversion: 2.1 time: 0.657284 Sep 08 12:49:02.033226 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1087/2099] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:01 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 1267 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:02.044048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-43f4003f-76dd-411d-8ea6-3db3134e3c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:02.045675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-43f4003f-76dd-411d-8ea6-3db3134e3c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:02.065051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f4003f-76dd-411d-8ea6-3db3134e3c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:02.069261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f4003f-76dd-411d-8ea6-3db3134e3c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:02.070262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f4003f-76dd-411d-8ea6-3db3134e3c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:02.072713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f4003f-76dd-411d-8ea6-3db3134e3c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:02.074295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f4003f-76dd-411d-8ea6-3db3134e3c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:02.087805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f4003f-76dd-411d-8ea6-3db3134e3c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:02.232068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-43f4003f-76dd-411d-8ea6-3db3134e3c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:49:02.268247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7e69345f-1842-4326-aa45-50edce6c33ce tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:02.324462 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7e69345f-1842-4326-aa45-50edce6c33ce tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1515 microversion: 2.1 time: 1.277417 Sep 08 12:49:02.335825 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1013/2100] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:01 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1515 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:02.353481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f8f161b-c67a-4ec9-8932-f72b5b35c543 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:02.379414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f8f161b-c67a-4ec9-8932-f72b5b35c543 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:02.407673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f8f161b-c67a-4ec9-8932-f72b5b35c543 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:02.409670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f8f161b-c67a-4ec9-8932-f72b5b35c543 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:02.411735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f8f161b-c67a-4ec9-8932-f72b5b35c543 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:02.413296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f8f161b-c67a-4ec9-8932-f72b5b35c543 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:02.414950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f8f161b-c67a-4ec9-8932-f72b5b35c543 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:02.416261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f8f161b-c67a-4ec9-8932-f72b5b35c543 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:02.433466 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-43f4003f-76dd-411d-8ea6-3db3134e3c10 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "DELETE /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 204 len: 0 microversion: 2.25 time: 0.396959 Sep 08 12:49:02.439640 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1088/2101] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:49:02 2022] DELETE /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 12:49:02.451567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5d6b53b4-c03d-4f9f-bf88-0783a580add2 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:02.452920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5d6b53b4-c03d-4f9f-bf88-0783a580add2 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:02.467028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d6b53b4-c03d-4f9f-bf88-0783a580add2 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:02.467956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d6b53b4-c03d-4f9f-bf88-0783a580add2 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:02.470371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d6b53b4-c03d-4f9f-bf88-0783a580add2 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:02.470648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d6b53b4-c03d-4f9f-bf88-0783a580add2 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:02.471630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d6b53b4-c03d-4f9f-bf88-0783a580add2 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:02.472424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d6b53b4-c03d-4f9f-bf88-0783a580add2 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:02.938681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5d6b53b4-c03d-4f9f-bf88-0783a580add2 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:02.952859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5d6b53b4-c03d-4f9f-bf88-0783a580add2 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:02.966218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5d6b53b4-c03d-4f9f-bf88-0783a580add2 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:03.000408 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5d6b53b4-c03d-4f9f-bf88-0783a580add2 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1446 microversion: 2.75 time: 0.558585 Sep 08 12:49:03.006812 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1089/2102] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:02 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1446 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:03.028646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5dc86246-f24f-4c1d-a0c9-0b64647e1fea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:03.031048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5dc86246-f24f-4c1d-a0c9-0b64647e1fea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:03.052653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5dc86246-f24f-4c1d-a0c9-0b64647e1fea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:03.055041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5dc86246-f24f-4c1d-a0c9-0b64647e1fea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:03.055886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5dc86246-f24f-4c1d-a0c9-0b64647e1fea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:03.058158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5dc86246-f24f-4c1d-a0c9-0b64647e1fea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:03.063902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5dc86246-f24f-4c1d-a0c9-0b64647e1fea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:03.064522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5dc86246-f24f-4c1d-a0c9-0b64647e1fea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:03.122825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f8f161b-c67a-4ec9-8932-f72b5b35c543 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:03.158984 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f8f161b-c67a-4ec9-8932-f72b5b35c543 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 200 len: 1521 microversion: 2.1 time: 0.818451 Sep 08 12:49:03.189467 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1014/2103] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:02 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 1521 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:03.201966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0e026d46-b4be-41b8-bfcb-ae58ffb74251 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:03.202808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0e026d46-b4be-41b8-bfcb-ae58ffb74251 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:03.215045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e026d46-b4be-41b8-bfcb-ae58ffb74251 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:03.215743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e026d46-b4be-41b8-bfcb-ae58ffb74251 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:03.216412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e026d46-b4be-41b8-bfcb-ae58ffb74251 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:03.217437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e026d46-b4be-41b8-bfcb-ae58ffb74251 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:03.218084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e026d46-b4be-41b8-bfcb-ae58ffb74251 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:03.219110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e026d46-b4be-41b8-bfcb-ae58ffb74251 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:03.625015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0e026d46-b4be-41b8-bfcb-ae58ffb74251 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a4501165214cbbaedd633030e68a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42c21dc89784818ae3f51b9086771d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:03.639518 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0e026d46-b4be-41b8-bfcb-ae58ffb74251 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 200 len: 1273 microversion: 2.1 time: 0.442845 Sep 08 12:49:03.640850 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1015/2104] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:03 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 1273 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:03.662447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.112"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:03.666688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:03.681466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:03.682304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:03.682937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:03.683994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:03.684840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:03.685489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:03.788432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "refresh_cache-5bfe69bb-91ad-499f-9f12-de0ac60519b6" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 12:49:03.789555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquired lock "refresh_cache-5bfe69bb-91ad-499f-9f12-de0ac60519b6" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 12:49:04.198995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5dc86246-f24f-4c1d-a0c9-0b64647e1fea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:04.221262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5dc86246-f24f-4c1d-a0c9-0b64647e1fea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:04.235539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5dc86246-f24f-4c1d-a0c9-0b64647e1fea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:04.251985 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5dc86246-f24f-4c1d-a0c9-0b64647e1fea tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1482 microversion: 2.25 time: 1.242374 Sep 08 12:49:04.254140 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1090/2105] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:03 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1482 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:04.270060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-90893223-530a-4149-b8c2-ec603750dfdc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:04.272028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-90893223-530a-4149-b8c2-ec603750dfdc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:04.290621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90893223-530a-4149-b8c2-ec603750dfdc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:04.292320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90893223-530a-4149-b8c2-ec603750dfdc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:04.293485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90893223-530a-4149-b8c2-ec603750dfdc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:04.297321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90893223-530a-4149-b8c2-ec603750dfdc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:04.298594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90893223-530a-4149-b8c2-ec603750dfdc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:04.300544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90893223-530a-4149-b8c2-ec603750dfdc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:05.291395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-90893223-530a-4149-b8c2-ec603750dfdc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:05.374943 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-90893223-530a-4149-b8c2-ec603750dfdc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1515 microversion: 2.1 time: 1.098296 Sep 08 12:49:05.376908 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1091/2106] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:04 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1515 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:05.403298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c431c141-3ca4-4c80-bbc0-1251fe065662 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:05.408222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c431c141-3ca4-4c80-bbc0-1251fe065662 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:05.442892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c431c141-3ca4-4c80-bbc0-1251fe065662 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:05.444082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c431c141-3ca4-4c80-bbc0-1251fe065662 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:05.445673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c431c141-3ca4-4c80-bbc0-1251fe065662 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:05.448758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c431c141-3ca4-4c80-bbc0-1251fe065662 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:05.451396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c431c141-3ca4-4c80-bbc0-1251fe065662 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:05.452734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c431c141-3ca4-4c80-bbc0-1251fe065662 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:05.543128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:05.670739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c431c141-3ca4-4c80-bbc0-1251fe065662 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:05.706563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c431c141-3ca4-4c80-bbc0-1251fe065662 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:05.715791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c431c141-3ca4-4c80-bbc0-1251fe065662 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:05.745126 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c431c141-3ca4-4c80-bbc0-1251fe065662 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1446 microversion: 2.75 time: 0.364571 Sep 08 12:49:05.748291 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1092/2107] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:05 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1446 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:05.770272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4843a44-6c7e-48c1-84e8-5b35840a635d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:05.771337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e4843a44-6c7e-48c1-84e8-5b35840a635d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:05.790213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4843a44-6c7e-48c1-84e8-5b35840a635d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:05.796338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4843a44-6c7e-48c1-84e8-5b35840a635d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:05.797357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4843a44-6c7e-48c1-84e8-5b35840a635d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:05.806250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4843a44-6c7e-48c1-84e8-5b35840a635d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:05.807839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4843a44-6c7e-48c1-84e8-5b35840a635d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:05.811986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4843a44-6c7e-48c1-84e8-5b35840a635d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:06.130693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e4843a44-6c7e-48c1-84e8-5b35840a635d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a4501165214cbbaedd633030e68a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42c21dc89784818ae3f51b9086771d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:06.160613 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e4843a44-6c7e-48c1-84e8-5b35840a635d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 200 len: 1273 microversion: 2.1 time: 0.407797 Sep 08 12:49:06.176749 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1093/2108] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:05 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 1273 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:06.187004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b9a19b38-29e0-4cec-8510-99d7f46a398d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:06.187004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b9a19b38-29e0-4cec-8510-99d7f46a398d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:06.221746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9a19b38-29e0-4cec-8510-99d7f46a398d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:06.227052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9a19b38-29e0-4cec-8510-99d7f46a398d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:06.231259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9a19b38-29e0-4cec-8510-99d7f46a398d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:06.241385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9a19b38-29e0-4cec-8510-99d7f46a398d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:06.242211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9a19b38-29e0-4cec-8510-99d7f46a398d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:06.242978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9a19b38-29e0-4cec-8510-99d7f46a398d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:06.859351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b9a19b38-29e0-4cec-8510-99d7f46a398d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:06.892181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b9a19b38-29e0-4cec-8510-99d7f46a398d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:06.894316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b9a19b38-29e0-4cec-8510-99d7f46a398d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:06.896032 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b9a19b38-29e0-4cec-8510-99d7f46a398d tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1482 microversion: 2.25 time: 0.729451 Sep 08 12:49:06.896703 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1094/2109] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:06 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1482 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:06.919405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7c67a650-61da-47da-bc66-fda7f985d389 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:06.927029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7c67a650-61da-47da-bc66-fda7f985d389 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:06.946699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c67a650-61da-47da-bc66-fda7f985d389 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:06.953442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c67a650-61da-47da-bc66-fda7f985d389 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:06.954494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c67a650-61da-47da-bc66-fda7f985d389 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:06.955849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c67a650-61da-47da-bc66-fda7f985d389 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:06.956848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c67a650-61da-47da-bc66-fda7f985d389 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:06.964282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c67a650-61da-47da-bc66-fda7f985d389 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:08.366439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7c67a650-61da-47da-bc66-fda7f985d389 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:08.393342 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7c67a650-61da-47da-bc66-fda7f985d389 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1515 microversion: 2.1 time: 1.479749 Sep 08 12:49:08.394342 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1095/2110] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:06 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1515 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:08.410021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd41a4ab-7888-4414-84cf-930b58b54ab1 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:08.410657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dd41a4ab-7888-4414-84cf-930b58b54ab1 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:08.434417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd41a4ab-7888-4414-84cf-930b58b54ab1 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:08.436222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd41a4ab-7888-4414-84cf-930b58b54ab1 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:08.437137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd41a4ab-7888-4414-84cf-930b58b54ab1 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:08.438564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd41a4ab-7888-4414-84cf-930b58b54ab1 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:08.439844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd41a4ab-7888-4414-84cf-930b58b54ab1 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:08.441184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd41a4ab-7888-4414-84cf-930b58b54ab1 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:08.619852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:08.642713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Building network info cache for instance {{(pid=128971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 12:49:08.680072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dd41a4ab-7888-4414-84cf-930b58b54ab1 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:08.692975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dd41a4ab-7888-4414-84cf-930b58b54ab1 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:08.694931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dd41a4ab-7888-4414-84cf-930b58b54ab1 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:08.733611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:08.737516 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dd41a4ab-7888-4414-84cf-930b58b54ab1 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1446 microversion: 2.75 time: 0.341377 Sep 08 12:49:08.746636 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1096/2111] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:08 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1446 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:08.766590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-6021fa91-c01b-4036-a7a3-f1c1b6881069 req-785a0301-56b3-4205-920d-cc815af53535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19ac97d7-8051-4b86-981b-eae55076e04c", "name": "network-vif-deleted", "tag": "0651dd1c-1b65-417f-a953-0882fc7b9d25"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:08.808990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6021fa91-c01b-4036-a7a3-f1c1b6881069 req-785a0301-56b3-4205-920d-cc815af53535 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:08.812738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6021fa91-c01b-4036-a7a3-f1c1b6881069 req-785a0301-56b3-4205-920d-cc815af53535 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:08.816844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6021fa91-c01b-4036-a7a3-f1c1b6881069 req-785a0301-56b3-4205-920d-cc815af53535 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:08.846240 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-6021fa91-c01b-4036-a7a3-f1c1b6881069 req-785a0301-56b3-4205-920d-cc815af53535 service nova] Creating event network-vif-deleted:0651dd1c-1b65-417f-a953-0882fc7b9d25 for instance 19ac97d7-8051-4b86-981b-eae55076e04c on n-h2-852084-10 Sep 08 12:49:08.856542 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-6021fa91-c01b-4036-a7a3-f1c1b6881069 req-785a0301-56b3-4205-920d-cc815af53535 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106955 Sep 08 12:49:08.858439 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1097/2112] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:08.868822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9b5c6114-daff-4c09-a075-2235490e3982 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:08.870531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9b5c6114-daff-4c09-a075-2235490e3982 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:08.885251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b5c6114-daff-4c09-a075-2235490e3982 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:08.886571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b5c6114-daff-4c09-a075-2235490e3982 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:08.887685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b5c6114-daff-4c09-a075-2235490e3982 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:08.889285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b5c6114-daff-4c09-a075-2235490e3982 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:08.890462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b5c6114-daff-4c09-a075-2235490e3982 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:08.891869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b5c6114-daff-4c09-a075-2235490e3982 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:09.880669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:09.992385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9b5c6114-daff-4c09-a075-2235490e3982 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a4501165214cbbaedd633030e68a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42c21dc89784818ae3f51b9086771d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:10.013841 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9b5c6114-daff-4c09-a075-2235490e3982 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 200 len: 1315 microversion: 2.1 time: 1.152860 Sep 08 12:49:10.014866 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1098/2113] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:08 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 1315 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:10.744866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0004dddb-b809-4115-8eef-88b38ef3d48d tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Action: 'create', calling method: .version_select at 0x7fdb3f255b80>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKb1iwv189Ok2WrKp8/G/siJH46tjqmwZtPZlK0CRy0RftpizshazWgzue4mtg22hVNjBWLqCFKlE4OQxlSOlW025KOU3DdvU71/V+k+hVTlyN8CAHx3+Qx92TDutZ7Ww=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0004dddb-b809-4115-8eef-88b38ef3d48d tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Request method failure captured: Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 257 Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTDKVI7wXSEstTe_sCim7uaM6Zim9OGabzSVyoUW_pbrZokGHJQtfY7Ao3YY2TQtLhxwQ5XoT_jbJeBs7JRB_2qbJzjUugDwWc6iaLB5LIxVCcMAtvGOIY56IRPCCjrjTvFmt7tT81T3f1or92JSLbvTK2O-2ZTY8jOJSou_ZOcvN0 Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:10.791665 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:10.794475 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_85c79bc3802d489ba6b78345454bf720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:10.794475 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:10.794475 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:10.794475 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:10.794475 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:10.794475 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:10.794475 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:10.794475 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:10.794475 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:10.794475 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:10.794475 n-d-852084-10 devstack@n-api.service[128970]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKb1iwv189Ok2WrKp8/G/siJH46tjqmwZtPZlK0CRy0RftpizshazWgzue4mtg22hVNjBWLqCFKlE4OQxlSOlW025KOU3DdvU71/V+k+hVTlyN8CAHx3+Qx92TDutZ7Ww=="}} Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMKb1iwv189Ok2WrKp8/G/siJH46tjqmwZtPZlK0CRy0RftpizshazWgzue4mtg22hVNjBWLqCFKlE4OQxlSOlW025KOU3DdvU71/V+k+hVTlyN8CAHx3+Qx92TDutZ7Ww=='}}} Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:10.795916 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'minLength': 1, Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'string'} Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:10.798010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:49:10.802810 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:49:10.807579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Sep 08 12:49:10.807579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:10.813574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0004dddb-b809-4115-8eef-88b38ef3d48d tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:10.821404 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0004dddb-b809-4115-8eef-88b38ef3d48d tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.775107 Sep 08 12:49:10.829201 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1099/2114] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:49:10 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 814 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:49:10.870079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e9be3c1-1144-433b-aa09-0f0a4486ee08 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:10.873455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3e9be3c1-1144-433b-aa09-0f0a4486ee08 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:10.905223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e9be3c1-1144-433b-aa09-0f0a4486ee08 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:10.911390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e9be3c1-1144-433b-aa09-0f0a4486ee08 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:10.912228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e9be3c1-1144-433b-aa09-0f0a4486ee08 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:10.913547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e9be3c1-1144-433b-aa09-0f0a4486ee08 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:10.919730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e9be3c1-1144-433b-aa09-0f0a4486ee08 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:10.920635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e9be3c1-1144-433b-aa09-0f0a4486ee08 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:11.217219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3e9be3c1-1144-433b-aa09-0f0a4486ee08 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:11.239922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3e9be3c1-1144-433b-aa09-0f0a4486ee08 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:11.242726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3e9be3c1-1144-433b-aa09-0f0a4486ee08 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:11.247819 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3e9be3c1-1144-433b-aa09-0f0a4486ee08 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1266 microversion: 2.25 time: 0.413607 Sep 08 12:49:11.253074 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1100/2115] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:10 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1266 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:11.264878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3b60aeb6-e9b4-4b89-aa36-da28e9047847 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:11.271517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3b60aeb6-e9b4-4b89-aa36-da28e9047847 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:11.289149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b60aeb6-e9b4-4b89-aa36-da28e9047847 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:11.293373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b60aeb6-e9b4-4b89-aa36-da28e9047847 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:11.294187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b60aeb6-e9b4-4b89-aa36-da28e9047847 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:11.295262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b60aeb6-e9b4-4b89-aa36-da28e9047847 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:11.298226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b60aeb6-e9b4-4b89-aa36-da28e9047847 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:11.298945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b60aeb6-e9b4-4b89-aa36-da28e9047847 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:11.434091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Updating instance_info_cache with network_info: [{"id": "feb64804-e1ff-419a-8a16-60a42fef7a86", "address": "fa:16:3e:5c:e5:d5", "network": {"id": "682d96b1-a973-4824-9a27-17bd1d4dbbfc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2087556098-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "111d6d19644b4164a4e623bc7ea07dbf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfeb64804-e1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 12:49:11.480096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Releasing lock "refresh_cache-5bfe69bb-91ad-499f-9f12-de0ac60519b6" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 12:49:11.487189 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-33b46a49-a6df-4115-805b-ae5f9505919b tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "POST /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6/action" status: 202 len: 0 microversion: 2.1 time: 7.841298 Sep 08 12:49:11.488781 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1016/2116] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:49:03 2022] POST /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6/action => generated 0 bytes in 7847 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 12:49:11.513471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-57d658a2-1ba8-48d1-b395-f208f537acce tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:11.515018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-57d658a2-1ba8-48d1-b395-f208f537acce tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:11.543365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57d658a2-1ba8-48d1-b395-f208f537acce tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:11.544818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57d658a2-1ba8-48d1-b395-f208f537acce tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:11.547193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57d658a2-1ba8-48d1-b395-f208f537acce tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:11.552600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57d658a2-1ba8-48d1-b395-f208f537acce tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:11.554004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57d658a2-1ba8-48d1-b395-f208f537acce tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:11.556042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57d658a2-1ba8-48d1-b395-f208f537acce tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:11.618337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3b60aeb6-e9b4-4b89-aa36-da28e9047847 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:11.629418 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3b60aeb6-e9b4-4b89-aa36-da28e9047847 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1515 microversion: 2.1 time: 0.374200 Sep 08 12:49:11.661988 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1101/2117] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:11 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1515 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:11.678580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-19763f57-ea2b-485f-ad23-cebb6198b442 tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Action: 'create', calling method: .version_select at 0x7fdb3665b700>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-116636380", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:11.724886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-19763f57-ea2b-485f-ad23-cebb6198b442 tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Getting quotas for project 85c79bc3802d489ba6b78345454bf720. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:49:11.738550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-19763f57-ea2b-485f-ad23-cebb6198b442 tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Getting quotas for user c2a5334e0eb946499f1e7ee79a5fdc5c and project 85c79bc3802d489ba6b78345454bf720. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:49:11.787739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-57d658a2-1ba8-48d1-b395-f208f537acce tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:11.813247 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-19763f57-ea2b-485f-ad23-cebb6198b442 tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:11.827373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-57d658a2-1ba8-48d1-b395-f208f537acce tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-19763f57-ea2b-485f-ad23-cebb6198b442 tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Request method failure captured: Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 2166 Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTDKVI7wXSEstTe_sCim7uaM6Zim9OGabzSVyoUW_pbrZokGHJQtfY7Ao3YY2TQtLhxwQ5XoT_jbJeBs7JRB_2qbJzjUugDwWc6iaLB5LIxVCcMAtvGOIY56IRPCCjrjTvFmt7tT81T3f1or92JSLbvTK2O-2ZTY8jOJSou_ZOcvN0 Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_85c79bc3802d489ba6b78345454bf720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-116636380", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:49:11.831389 n-d-852084-10 devstack@n-api.service[128970]: exception: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-116636380', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:11.835345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-19763f57-ea2b-485f-ad23-cebb6198b442 tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-19763f57-ea2b-485f-ad23-cebb6198b442 tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.167708 Sep 08 12:49:11.839952 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1102/2118] 10.222.0.78 () {60 vars in 1160 bytes} [Thu Sep 8 12:49:11 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:49:11.845407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-57d658a2-1ba8-48d1-b395-f208f537acce tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:11.850293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e185a0d2-eb43-471f-8bfc-7ad358fe566a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:11.851123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e185a0d2-eb43-471f-8bfc-7ad358fe566a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:11.857349 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-57d658a2-1ba8-48d1-b395-f208f537acce tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1446 microversion: 2.75 time: 0.366204 Sep 08 12:49:11.868522 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1017/2119] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:11 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1446 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:11.872641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e185a0d2-eb43-471f-8bfc-7ad358fe566a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:11.875359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e185a0d2-eb43-471f-8bfc-7ad358fe566a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:11.876085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e185a0d2-eb43-471f-8bfc-7ad358fe566a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:11.880685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e185a0d2-eb43-471f-8bfc-7ad358fe566a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:11.881558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e185a0d2-eb43-471f-8bfc-7ad358fe566a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:11.882231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e185a0d2-eb43-471f-8bfc-7ad358fe566a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:11.891366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0ba60301-11aa-4f89-885a-3345c47f954d req-58819eb7-66d2-42d5-b71c-d28a0b4a14be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfe69bb-91ad-499f-9f12-de0ac60519b6", "tag": "feb64804-e1ff-419a-8a16-60a42fef7a86"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:11.919050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0ba60301-11aa-4f89-885a-3345c47f954d req-58819eb7-66d2-42d5-b71c-d28a0b4a14be service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:11.920559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0ba60301-11aa-4f89-885a-3345c47f954d req-58819eb7-66d2-42d5-b71c-d28a0b4a14be service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:11.921713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0ba60301-11aa-4f89-885a-3345c47f954d req-58819eb7-66d2-42d5-b71c-d28a0b4a14be service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:11.950603 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0ba60301-11aa-4f89-885a-3345c47f954d req-58819eb7-66d2-42d5-b71c-d28a0b4a14be service nova] Creating event network-changed:feb64804-e1ff-419a-8a16-60a42fef7a86 for instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 on n-h1-852084-10 Sep 08 12:49:11.962175 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0ba60301-11aa-4f89-885a-3345c47f954d req-58819eb7-66d2-42d5-b71c-d28a0b4a14be service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091049 Sep 08 12:49:11.964144 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1018/2120] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:11.984462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.112"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:11.993328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:12.007501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:12.009657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:12.010758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:12.013930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:12.015911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:12.017278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:12.076783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "refresh_cache-c50dcd06-1d5d-44ad-b802-4ef07c7bac31" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 12:49:12.078503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquired lock "refresh_cache-c50dcd06-1d5d-44ad-b802-4ef07c7bac31" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 12:49:12.631727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e185a0d2-eb43-471f-8bfc-7ad358fe566a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a4501165214cbbaedd633030e68a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42c21dc89784818ae3f51b9086771d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:12.650997 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e185a0d2-eb43-471f-8bfc-7ad358fe566a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 200 len: 1315 microversion: 2.1 time: 0.814906 Sep 08 12:49:12.652665 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1103/2121] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:11 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 1315 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:12.662853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-8aa87548-399a-46ca-a053-56236857cb85 req-0f7f25b7-ca18-4739-9e3d-a4904212f3ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d1e44cb-d0d1-4c3a-9804-287bfe740bc5", "tag": "9fd049b2-77ee-4791-bd71-d7867f7f28d4"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:12.710510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8aa87548-399a-46ca-a053-56236857cb85 req-0f7f25b7-ca18-4739-9e3d-a4904212f3ed service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:12.715063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8aa87548-399a-46ca-a053-56236857cb85 req-0f7f25b7-ca18-4739-9e3d-a4904212f3ed service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:12.715936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8aa87548-399a-46ca-a053-56236857cb85 req-0f7f25b7-ca18-4739-9e3d-a4904212f3ed service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:12.755880 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-8aa87548-399a-46ca-a053-56236857cb85 req-0f7f25b7-ca18-4739-9e3d-a4904212f3ed service nova] Creating event network-changed:9fd049b2-77ee-4791-bd71-d7867f7f28d4 for instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 on n-h1-852084-10 Sep 08 12:49:12.771903 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-8aa87548-399a-46ca-a053-56236857cb85 req-0f7f25b7-ca18-4739-9e3d-a4904212f3ed service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116869 Sep 08 12:49:12.776282 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1104/2122] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:12.794621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2256665d-4c14-4cf5-b7af-636b4f4d7b9e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Action: 'create', calling method: .version_select at 0x7fdb3f2daca0>, body: {"keypair": {"name": "tempest-keypair-1425900736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk4tOFmkgp7I3TuptkapGnhGDUwlX0B1tXBiAJit7pSefr6DqbidVjA6QtIViXgLl+jzCmGtI+iRzaHob+gzazAcTlgzx1cjXLf+TkJqG0fWO9EGed2qjtU4VPUCOo1nQ=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:12.837786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-2256665d-4c14-4cf5-b7af-636b4f4d7b9e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Getting quotas for project 85c79bc3802d489ba6b78345454bf720. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:49:12.850565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-2256665d-4c14-4cf5-b7af-636b4f4d7b9e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Getting quotas for user c2a5334e0eb946499f1e7ee79a5fdc5c and project 85c79bc3802d489ba6b78345454bf720. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:49:12.942068 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2256665d-4c14-4cf5-b7af-636b4f4d7b9e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.160733 Sep 08 12:49:12.943151 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1105/2123] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:49:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:12.958980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d01230c5-0539-4b09-85f0-ad17e1614849 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:12.964065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d01230c5-0539-4b09-85f0-ad17e1614849 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:12.983116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d01230c5-0539-4b09-85f0-ad17e1614849 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:12.984584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d01230c5-0539-4b09-85f0-ad17e1614849 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:12.986335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d01230c5-0539-4b09-85f0-ad17e1614849 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:12.988544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d01230c5-0539-4b09-85f0-ad17e1614849 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:12.990763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d01230c5-0539-4b09-85f0-ad17e1614849 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:12.991494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d01230c5-0539-4b09-85f0-ad17e1614849 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:13.536994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d01230c5-0539-4b09-85f0-ad17e1614849 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:13.595501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d01230c5-0539-4b09-85f0-ad17e1614849 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:13.603799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d01230c5-0539-4b09-85f0-ad17e1614849 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:13.612964 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d01230c5-0539-4b09-85f0-ad17e1614849 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1266 microversion: 2.25 time: 0.666645 Sep 08 12:49:13.615979 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1106/2124] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:12 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1266 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:13.657011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-69810220-a344-4fbb-9021-8abbfb42a90b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:13.661795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-69810220-a344-4fbb-9021-8abbfb42a90b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:13.683915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69810220-a344-4fbb-9021-8abbfb42a90b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:13.688667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69810220-a344-4fbb-9021-8abbfb42a90b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:13.692127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69810220-a344-4fbb-9021-8abbfb42a90b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:13.695744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69810220-a344-4fbb-9021-8abbfb42a90b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:13.696712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69810220-a344-4fbb-9021-8abbfb42a90b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:13.697426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69810220-a344-4fbb-9021-8abbfb42a90b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:14.823643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-69810220-a344-4fbb-9021-8abbfb42a90b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:14.852217 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-69810220-a344-4fbb-9021-8abbfb42a90b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1515 microversion: 2.1 time: 1.203262 Sep 08 12:49:14.856235 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1107/2125] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:13 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1515 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:14.886628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-07a391af-8beb-447b-98da-756c6eccdd5c tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:14.889941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-07a391af-8beb-447b-98da-756c6eccdd5c tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:14.925574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07a391af-8beb-447b-98da-756c6eccdd5c tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:14.927659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07a391af-8beb-447b-98da-756c6eccdd5c tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:14.929802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07a391af-8beb-447b-98da-756c6eccdd5c tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:14.932799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07a391af-8beb-447b-98da-756c6eccdd5c tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:14.946046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07a391af-8beb-447b-98da-756c6eccdd5c tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:14.951142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07a391af-8beb-447b-98da-756c6eccdd5c tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:16.009754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-07a391af-8beb-447b-98da-756c6eccdd5c tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:16.047524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-07a391af-8beb-447b-98da-756c6eccdd5c tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:16.052184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-07a391af-8beb-447b-98da-756c6eccdd5c tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:16.066246 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-07a391af-8beb-447b-98da-756c6eccdd5c tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1452 microversion: 2.75 time: 1.206688 Sep 08 12:49:16.068064 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1108/2126] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:14 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1452 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:16.075115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee1a3478-21e4-472d-8c9b-e9945aac569e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Action: 'create', calling method: .version_select at 0x7fdb3f205ca0>, body: {"keypair": {"name": "tempest-keypair-1425900736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdroe8on1x1rwxioafBx84yMjslHO3w5UE+0jsshxIkYa1fqD7x3IGKyvoal0mM7rAKHc796ukVvzeLNcZuBkJ09jjKX9Dm/WKQb1Va1fBYXTRzZbY52UbH40fAcKih1w=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:16.101038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ee1a3478-21e4-472d-8c9b-e9945aac569e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Getting quotas for project 85c79bc3802d489ba6b78345454bf720. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:49:16.108575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ee1a3478-21e4-472d-8c9b-e9945aac569e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Getting quotas for user c2a5334e0eb946499f1e7ee79a5fdc5c and project 85c79bc3802d489ba6b78345454bf720. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:49:16.171043 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-ee1a3478-21e4-472d-8c9b-e9945aac569e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] HTTP exception thrown: Key pair 'tempest-keypair-1425900736' already exists. Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee1a3478-21e4-472d-8c9b-e9945aac569e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Request method failure captured: Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 273 Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTDKVI7wXSEstTe_sCim7uaM6Zim9OGabzSVyoUW_pbrZokGHJQtfY7Ao3YY2TQtLhxwQ5XoT_jbJeBs7JRB_2qbJzjUugDwWc6iaLB5LIxVCcMAtvGOIY56IRPCCjrjTvFmt7tT81T3f1or92JSLbvTK2O-2ZTY8jOJSou_ZOcvN0 Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_85c79bc3802d489ba6b78345454bf720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: {"keypair": {"name": "tempest-keypair-1425900736", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdroe8on1x1rwxioafBx84yMjslHO3w5UE+0jsshxIkYa1fqD7x3IGKyvoal0mM7rAKHc796ukVvzeLNcZuBkJ09jjKX9Dm/WKQb1Va1fBYXTRzZbY52UbH40fAcKih1w=="}} Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: exception: Key pair 'tempest-keypair-1425900736' already exists. Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-1425900736', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdroe8on1x1rwxioafBx84yMjslHO3w5UE+0jsshxIkYa1fqD7x3IGKyvoal0mM7rAKHc796ukVvzeLNcZuBkJ09jjKX9Dm/WKQb1Va1fBYXTRzZbY52UbH40fAcKih1w=='}}} Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result.read() Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'c2a5334e0eb946499f1e7ee79a5fdc5c-tempest-keypair-1425900736' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 08 12:49:16.186633 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi kp.save(context.session) Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi session.flush() Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._flush(objects) Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi compat.raise_( Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi flush_context.execute() Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi rec.execute(self) Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = self._query(query) Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi conn.query(q) Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result.read() Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Sep 08 12:49:16.190209 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'c2a5334e0eb946499f1e7ee79a5fdc5c-tempest-keypair-1425900736' for key 'key_pairs.uniq_key_pairs0user_id0name'") Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 9, 8, 12, 49, 16, 157403), 'updated_at': None, 'name': 'tempest-keypair-1425900736', 'user_id': 'c2a5334e0eb946499f1e7ee79a5fdc5c', 'fingerprint': '4b:ae:e8:bf:08:af:1d:c5:2c:5a:10:b6:2a:9e:51:fa', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdroe8on1x1rwxioafBx84yMjslHO3w5UE+0jsshxIkYa1fqD7x3IGKyvoal0mM7rAKHc796ukVvzeLNcZuBkJ09jjKX9Dm/WKQb1Va1fBYXTRzZbY52UbH40fAcKih1w==', 'type': 'ssh'}] Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi keypair.create() Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._create() Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-1425900736' already exists. Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Sep 08 12:49:16.195467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-1425900736' already exists. Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-1425900736' already exists. Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee1a3478-21e4-472d-8c9b-e9945aac569e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Returning 409 to user: Key pair 'tempest-keypair-1425900736' already exists. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee1a3478-21e4-472d-8c9b-e9945aac569e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 409 len: 105 microversion: 2.1 time: 0.121884 Sep 08 12:49:16.203139 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1109/2127] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:49:16 2022] POST /compute/v2.1/os-keypairs => generated 105 bytes in 128 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:49:16.217199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5e138de6-d452-4688-b150-29b4df32eefa tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:16.218351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5e138de6-d452-4688-b150-29b4df32eefa tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:16.242625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e138de6-d452-4688-b150-29b4df32eefa tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:16.249756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e138de6-d452-4688-b150-29b4df32eefa tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:16.250724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e138de6-d452-4688-b150-29b4df32eefa tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:16.253268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e138de6-d452-4688-b150-29b4df32eefa tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:16.255185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e138de6-d452-4688-b150-29b4df32eefa tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:16.257026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e138de6-d452-4688-b150-29b4df32eefa tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:17.012140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5e138de6-d452-4688-b150-29b4df32eefa tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a4501165214cbbaedd633030e68a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42c21dc89784818ae3f51b9086771d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:17.093482 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5e138de6-d452-4688-b150-29b4df32eefa tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 200 len: 1315 microversion: 2.1 time: 0.894130 Sep 08 12:49:17.118233 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1110/2128] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:16 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 1315 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:17.176629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d8bceb3a-87ae-4fdb-be12-6485067a3787 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:17.182949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d8bceb3a-87ae-4fdb-be12-6485067a3787 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:17.210281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8bceb3a-87ae-4fdb-be12-6485067a3787 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:17.220571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8bceb3a-87ae-4fdb-be12-6485067a3787 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:17.222568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8bceb3a-87ae-4fdb-be12-6485067a3787 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:17.224279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8bceb3a-87ae-4fdb-be12-6485067a3787 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:17.225468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8bceb3a-87ae-4fdb-be12-6485067a3787 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:17.226570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8bceb3a-87ae-4fdb-be12-6485067a3787 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:17.592751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d8bceb3a-87ae-4fdb-be12-6485067a3787 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:17.628027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d8bceb3a-87ae-4fdb-be12-6485067a3787 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:17.632987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d8bceb3a-87ae-4fdb-be12-6485067a3787 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:17.635287 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d8bceb3a-87ae-4fdb-be12-6485067a3787 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 200 len: 1266 microversion: 2.25 time: 0.504536 Sep 08 12:49:17.636932 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1111/2129] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:17 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 1266 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:17.646784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f373abcb-c46f-4ca1-81c6-7f1806d3b679 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:17.648242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f373abcb-c46f-4ca1-81c6-7f1806d3b679 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:17.670248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f373abcb-c46f-4ca1-81c6-7f1806d3b679 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:17.671101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f373abcb-c46f-4ca1-81c6-7f1806d3b679 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:17.671958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f373abcb-c46f-4ca1-81c6-7f1806d3b679 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:17.673278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f373abcb-c46f-4ca1-81c6-7f1806d3b679 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:17.678108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f373abcb-c46f-4ca1-81c6-7f1806d3b679 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:17.679059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f373abcb-c46f-4ca1-81c6-7f1806d3b679 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:18.760793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f373abcb-c46f-4ca1-81c6-7f1806d3b679 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:18.812833 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f373abcb-c46f-4ca1-81c6-7f1806d3b679 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1515 microversion: 2.1 time: 1.172572 Sep 08 12:49:18.831273 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1112/2130] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:17 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1515 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:18.839565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44983484-5382-4d51-a5b7-62aba8b9611f tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Calling method '.version_select at 0x7fdb36d989d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:18.937857 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44983484-5382-4d51-a5b7-62aba8b9611f tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425900736" status: 202 len: 0 microversion: 2.1 time: 0.114952 Sep 08 12:49:18.940093 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1113/2131] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Sep 8 12:49:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1425900736 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:49:18.953731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2347b32a-f693-4d59-9151-061a7a194e53 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:18.960818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2347b32a-f693-4d59-9151-061a7a194e53 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:18.990912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2347b32a-f693-4d59-9151-061a7a194e53 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:18.996794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2347b32a-f693-4d59-9151-061a7a194e53 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:18.997880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2347b32a-f693-4d59-9151-061a7a194e53 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:18.999760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2347b32a-f693-4d59-9151-061a7a194e53 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:19.009793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2347b32a-f693-4d59-9151-061a7a194e53 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:19.010930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2347b32a-f693-4d59-9151-061a7a194e53 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:19.539737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2347b32a-f693-4d59-9151-061a7a194e53 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:19.577344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2347b32a-f693-4d59-9151-061a7a194e53 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:19.581990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2347b32a-f693-4d59-9151-061a7a194e53 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:19.591016 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2347b32a-f693-4d59-9151-061a7a194e53 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1437 microversion: 2.75 time: 0.649231 Sep 08 12:49:19.593454 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1114/2132] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:18 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1437 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:19.600983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ffc2b7a2-f6ab-49a7-a0fe-ee51a6f82ab5 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:19.603656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ffc2b7a2-f6ab-49a7-a0fe-ee51a6f82ab5 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:19.664505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffc2b7a2-f6ab-49a7-a0fe-ee51a6f82ab5 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:19.665669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffc2b7a2-f6ab-49a7-a0fe-ee51a6f82ab5 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:19.669549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffc2b7a2-f6ab-49a7-a0fe-ee51a6f82ab5 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:19.673327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffc2b7a2-f6ab-49a7-a0fe-ee51a6f82ab5 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:19.674565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffc2b7a2-f6ab-49a7-a0fe-ee51a6f82ab5 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:19.677525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffc2b7a2-f6ab-49a7-a0fe-ee51a6f82ab5 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:19.798191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:20.770357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ffc2b7a2-f6ab-49a7-a0fe-ee51a6f82ab5 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a4501165214cbbaedd633030e68a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42c21dc89784818ae3f51b9086771d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:20.817127 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ffc2b7a2-f6ab-49a7-a0fe-ee51a6f82ab5 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 200 len: 1315 microversion: 2.1 time: 1.221597 Sep 08 12:49:20.865999 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1115/2133] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:19 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 1315 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:20.897134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33547405-05e0-47ea-9335-318c02b01a17 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:20.897950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-33547405-05e0-47ea-9335-318c02b01a17 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 19ac97d7-8051-4b86-981b-eae55076e04c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:20.934949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33547405-05e0-47ea-9335-318c02b01a17 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:20.936762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33547405-05e0-47ea-9335-318c02b01a17 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:20.940882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33547405-05e0-47ea-9335-318c02b01a17 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:20.944106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33547405-05e0-47ea-9335-318c02b01a17 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:20.945195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33547405-05e0-47ea-9335-318c02b01a17 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:20.948519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33547405-05e0-47ea-9335-318c02b01a17 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:21.018652 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-33547405-05e0-47ea-9335-318c02b01a17 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] HTTP exception thrown: Instance 19ac97d7-8051-4b86-981b-eae55076e04c could not be found. Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33547405-05e0-47ea-9335-318c02b01a17 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Request method failure captured: Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c HTTP/1.1 Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKxlpY1IbMyY5ZD8fhRJghwJHCqOAVJje9hTMCM6IyWpGbpVObcW8c1FqdL9mzvGHFLBpowN2NwMRcmp3G51ZYgQaV6YWezrqMNPxYd2W1oO67pJzCz7PUPEpLwIxcBuVLVsXQnXuWWdnFig4aff_iccKQRdBSMdPG4-ZDyiw3o_gM Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.25 Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: df5a27766c1942a8be6a78466f7e7192 Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-910002977 Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-910002977 Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: df5a27766c1942a8be6a78466f7e7192 Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-910002977 Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-LiveAutoBlockMigrationV225Test-910002977-project Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 8af088dfb51e4f729cc97fc91699a55f Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-910002977-project Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 19ac97d7-8051-4b86-981b-eae55076e04c could not be found. Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '19ac97d7-8051-4b86-981b-eae55076e04c'} Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19ac97d7-8051-4b86-981b-eae55076e04c could not be found. Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19ac97d7-8051-4b86-981b-eae55076e04c could not be found. Sep 08 12:49:21.031992 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:21.040716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:21.040716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:21.040716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:21.040716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:21.040716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:21.040716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:21.040716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:21.040716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19ac97d7-8051-4b86-981b-eae55076e04c could not be found. Sep 08 12:49:21.040716 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:21.044341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33547405-05e0-47ea-9335-318c02b01a17 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Returning 404 to user: Instance 19ac97d7-8051-4b86-981b-eae55076e04c could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:21.053556 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-33547405-05e0-47ea-9335-318c02b01a17 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c" status: 404 len: 111 microversion: 2.25 time: 0.177787 Sep 08 12:49:21.061768 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1116/2134] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:20 2022] GET /compute/v2.1/servers/19ac97d7-8051-4b86-981b-eae55076e04c => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:49:21.081184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a94cace2-0d5b-4d26-a60f-6658b80f887c tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Action: 'create', calling method: .version_select at 0x7fdb3f218d30>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwM3WdY8JbMW/PGSVRGNzqQSTvJOgt7iq3dG9qo5ReeMaX4QdXvVn7ZIm44Y3uonmkMoFnclVsZYfwBZby1vsEVRRdx5CsI23KRS3DHWYajyDEtM3I7n+HPA6iUojct5A=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a94cace2-0d5b-4d26-a60f-6658b80f887c tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Request method failure captured: Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 247 Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTDKVI7wXSEstTe_sCim7uaM6Zim9OGabzSVyoUW_pbrZokGHJQtfY7Ao3YY2TQtLhxwQ5XoT_jbJeBs7JRB_2qbJzjUugDwWc6iaLB5LIxVCcMAtvGOIY56IRPCCjrjTvFmt7tT81T3f1or92JSLbvTK2O-2ZTY8jOJSou_ZOcvN0 Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_85c79bc3802d489ba6b78345454bf720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwM3WdY8JbMW/PGSVRGNzqQSTvJOgt7iq3dG9qo5ReeMaX4QdXvVn7ZIm44Y3uonmkMoFnclVsZYfwBZby1vsEVRRdx5CsI23KRS3DHWYajyDEtM3I7n+HPA6iUojct5A=="}} Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKwM3WdY8JbMW/PGSVRGNzqQSTvJOgt7iq3dG9qo5ReeMaX4QdXvVn7ZIm44Y3uonmkMoFnclVsZYfwBZby1vsEVRRdx5CsI23KRS3DHWYajyDEtM3I7n+HPA6iUojct5A=='}}} Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi '' Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:49:21.098937 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 08 12:49:21.103495 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:21.110501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a94cace2-0d5b-4d26-a60f-6658b80f887c tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:21.113557 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a94cace2-0d5b-4d26-a60f-6658b80f887c tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.048447 Sep 08 12:49:21.117333 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1117/2135] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:49:21 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:49:21.660715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:21.679202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:21.753311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:21.754850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:21.759992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:21.765632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:21.775283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:21.778333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:22.006531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=65 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:22.071873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:22.122534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:49:22.127638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:49:22.133160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:49:22.133909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:49:22.135308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:49:22.309426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:22.342374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:22.351728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:22.353239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:22.354937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:22.359931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:22.361062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:23.024069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lazy-loading 'services' on Instance uuid fc2e63e9-502b-4e71-8d22-cb9e9792e8db {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:49:23.100907 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-01883c49-1ba7-41d3-b357-8dab462f069c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db/action" status: 202 len: 1942 microversion: 2.75 time: 1.982011 Sep 08 12:49:23.102377 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1118/2136] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 12:49:21 2022] POST /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db/action => generated 1942 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 12:49:23.117883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e28240ad-f59b-4e82-9242-3fc7b75f11bd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:23.128932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e28240ad-f59b-4e82-9242-3fc7b75f11bd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:23.155216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e28240ad-f59b-4e82-9242-3fc7b75f11bd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:23.156206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e28240ad-f59b-4e82-9242-3fc7b75f11bd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:23.158119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e28240ad-f59b-4e82-9242-3fc7b75f11bd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:23.159494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e28240ad-f59b-4e82-9242-3fc7b75f11bd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:23.160213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e28240ad-f59b-4e82-9242-3fc7b75f11bd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:23.160877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e28240ad-f59b-4e82-9242-3fc7b75f11bd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:25.529680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e28240ad-f59b-4e82-9242-3fc7b75f11bd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:25.548875 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e28240ad-f59b-4e82-9242-3fc7b75f11bd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1515 microversion: 2.1 time: 2.441095 Sep 08 12:49:25.550542 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1119/2137] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:23 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1515 bytes in 2447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:25.562839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-039a8ff9-88c9-4b0c-ac28-5a60b222ea8e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Action: 'create', calling method: .version_select at 0x7fdb3f23b040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-622693015", "public_key": " "}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:25.614577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-039a8ff9-88c9-4b0c-ac28-5a60b222ea8e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Getting quotas for project 85c79bc3802d489ba6b78345454bf720. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:49:25.628085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-039a8ff9-88c9-4b0c-ac28-5a60b222ea8e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Getting quotas for user c2a5334e0eb946499f1e7ee79a5fdc5c and project 85c79bc3802d489ba6b78345454bf720. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:49:25.692112 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-039a8ff9-88c9-4b0c-ac28-5a60b222ea8e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-039a8ff9-88c9-4b0c-ac28-5a60b222ea8e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Request method failure captured: Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 94 Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTDKVI7wXSEstTe_sCim7uaM6Zim9OGabzSVyoUW_pbrZokGHJQtfY7Ao3YY2TQtLhxwQ5XoT_jbJeBs7JRB_2qbJzjUugDwWc6iaLB5LIxVCcMAtvGOIY56IRPCCjrjTvFmt7tT81T3f1or92JSLbvTK2O-2ZTY8jOJSou_ZOcvN0 Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_85c79bc3802d489ba6b78345454bf720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-622693015", "public_key": " "}} Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: exception: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-622693015', 'public_key': ' '}}} Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:25.694404 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-039a8ff9-88c9-4b0c-ac28-5a60b222ea8e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:25.704527 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-039a8ff9-88c9-4b0c-ac28-5a60b222ea8e tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.146952 Sep 08 12:49:25.707677 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1120/2138] 10.222.0.78 () {60 vars in 1158 bytes} [Thu Sep 8 12:49:25 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:49:25.722089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-58092fca-2676-4d2c-adba-954250836087 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:25.726509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58092fca-2676-4d2c-adba-954250836087 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:25.742432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58092fca-2676-4d2c-adba-954250836087 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:25.746893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58092fca-2676-4d2c-adba-954250836087 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:25.747561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58092fca-2676-4d2c-adba-954250836087 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:25.748667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58092fca-2676-4d2c-adba-954250836087 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:25.752278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58092fca-2676-4d2c-adba-954250836087 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:25.753038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58092fca-2676-4d2c-adba-954250836087 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:25.843265 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.network.neutron [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] re-assign floating IP 172.25.4.112 from instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 Sep 08 12:49:25.976964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Building network info cache for instance {{(pid=128971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 12:49:27.537010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-58092fca-2676-4d2c-adba-954250836087 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a4501165214cbbaedd633030e68a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42c21dc89784818ae3f51b9086771d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:27.548506 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-58092fca-2676-4d2c-adba-954250836087 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 200 len: 1315 microversion: 2.1 time: 1.840859 Sep 08 12:49:27.557598 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1121/2139] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:25 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 1315 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:27.571618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-262a62a5-ceee-4f01-b944-761509d4f31c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:27.571618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-262a62a5-ceee-4f01-b944-761509d4f31c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:27.648315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-262a62a5-ceee-4f01-b944-761509d4f31c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:27.648881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-262a62a5-ceee-4f01-b944-761509d4f31c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:27.649701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-262a62a5-ceee-4f01-b944-761509d4f31c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:27.651043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-262a62a5-ceee-4f01-b944-761509d4f31c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:27.655916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-262a62a5-ceee-4f01-b944-761509d4f31c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:27.657007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-262a62a5-ceee-4f01-b944-761509d4f31c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:28.349914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-262a62a5-ceee-4f01-b944-761509d4f31c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lazy-loading 'services' on Instance uuid fc2e63e9-502b-4e71-8d22-cb9e9792e8db {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:49:28.401346 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-262a62a5-ceee-4f01-b944-761509d4f31c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1929 microversion: 2.75 time: 0.840698 Sep 08 12:49:28.404807 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1122/2140] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:27 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1929 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:28.419395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e3fa0589-9ffc-4d77-b6ac-7f110fc8f079 req-3e99611e-c975-4bf6-9449-a24618020c8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1e44cb-d0d1-4c3a-9804-287bfe740bc5", "name": "network-vif-plugged", "status": "completed", "tag": "9fd049b2-77ee-4791-bd71-d7867f7f28d4"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:28.443523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:28.450537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e3fa0589-9ffc-4d77-b6ac-7f110fc8f079 req-3e99611e-c975-4bf6-9449-a24618020c8f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:28.451577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e3fa0589-9ffc-4d77-b6ac-7f110fc8f079 req-3e99611e-c975-4bf6-9449-a24618020c8f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:28.455958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e3fa0589-9ffc-4d77-b6ac-7f110fc8f079 req-3e99611e-c975-4bf6-9449-a24618020c8f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:28.491062 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e3fa0589-9ffc-4d77-b6ac-7f110fc8f079 req-3e99611e-c975-4bf6-9449-a24618020c8f service nova] Creating event network-vif-plugged:9fd049b2-77ee-4791-bd71-d7867f7f28d4 for instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 on n-h1-852084-10 Sep 08 12:49:28.511352 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e3fa0589-9ffc-4d77-b6ac-7f110fc8f079 req-3e99611e-c975-4bf6-9449-a24618020c8f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103247 Sep 08 12:49:28.515770 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1123/2141] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:28.528868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-530c6ea7-937d-40df-b1d6-0d691ad3ce80 req-807cc392-f530-466c-ac77-7bd6c3590d12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfe69bb-91ad-499f-9f12-de0ac60519b6", "tag": "feb64804-e1ff-419a-8a16-60a42fef7a86"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:28.562973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-530c6ea7-937d-40df-b1d6-0d691ad3ce80 req-807cc392-f530-466c-ac77-7bd6c3590d12 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:28.564645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-530c6ea7-937d-40df-b1d6-0d691ad3ce80 req-807cc392-f530-466c-ac77-7bd6c3590d12 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:28.565338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-530c6ea7-937d-40df-b1d6-0d691ad3ce80 req-807cc392-f530-466c-ac77-7bd6c3590d12 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:28.586843 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-530c6ea7-937d-40df-b1d6-0d691ad3ce80 req-807cc392-f530-466c-ac77-7bd6c3590d12 service nova] Creating event network-changed:feb64804-e1ff-419a-8a16-60a42fef7a86 for instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 on n-h1-852084-10 Sep 08 12:49:28.596602 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-530c6ea7-937d-40df-b1d6-0d691ad3ce80 req-807cc392-f530-466c-ac77-7bd6c3590d12 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077034 Sep 08 12:49:28.598707 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1124/2142] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:28.606826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e850b3f0-a49a-4f9e-a141-f2192623de7c tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Action: 'create', calling method: .version_select at 0x7fdb363fac10>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj0tO2oFM51lqJ1IFyd/96fFRPsrMYJj6YvRzJnjBlEcxOLA0YK50J85AVNsJJgPSA1H2rBtso+euymvt6xQ/xyT6w7VmdYXivL4HL3si5hZ0TiBEa/t/m75esCYmJAhg=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e850b3f0-a49a-4f9e-a141-f2192623de7c tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Request method failure captured: Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 507 Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTDKVI7wXSEstTe_sCim7uaM6Zim9OGabzSVyoUW_pbrZokGHJQtfY7Ao3YY2TQtLhxwQ5XoT_jbJeBs7JRB_2qbJzjUugDwWc6iaLB5LIxVCcMAtvGOIY56IRPCCjrjTvFmt7tT81T3f1or92JSLbvTK2O-2ZTY8jOJSou_ZOcvN0 Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_85c79bc3802d489ba6b78345454bf720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj0tO2oFM51lqJ1IFyd/96fFRPsrMYJj6YvRzJnjBlEcxOLA0YK50J85AVNsJJgPSA1H2rBtso+euymvt6xQ/xyT6w7VmdYXivL4HL3si5hZ0TiBEa/t/m75esCYmJAhg=="}} Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFj0tO2oFM51lqJ1IFyd/96fFRPsrMYJj6YvRzJnjBlEcxOLA0YK50J85AVNsJJgPSA1H2rBtso+euymvt6xQ/xyT6w7VmdYXivL4HL3si5hZ0TiBEa/t/m75esCYmJAhg=='}}} Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['keypair']: Sep 08 12:49:28.613413 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Sep 08 12:49:28.616526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:28.622679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e850b3f0-a49a-4f9e-a141-f2192623de7c tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:28.624780 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e850b3f0-a49a-4f9e-a141-f2192623de7c tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.023683 Sep 08 12:49:28.626129 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1125/2143] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:49:28 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:49:28.633433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0bfe4e7c-4833-4780-9589-6a4c6a271ca5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:28.634810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0bfe4e7c-4833-4780-9589-6a4c6a271ca5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:28.647664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0bfe4e7c-4833-4780-9589-6a4c6a271ca5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:28.648550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0bfe4e7c-4833-4780-9589-6a4c6a271ca5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:28.649045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0bfe4e7c-4833-4780-9589-6a4c6a271ca5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:28.651727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0bfe4e7c-4833-4780-9589-6a4c6a271ca5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:28.651727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0bfe4e7c-4833-4780-9589-6a4c6a271ca5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:28.651727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0bfe4e7c-4833-4780-9589-6a4c6a271ca5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:29.717969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Updating instance_info_cache with network_info: [{"id": "feb64804-e1ff-419a-8a16-60a42fef7a86", "address": "fa:16:3e:5c:e5:d5", "network": {"id": "682d96b1-a973-4824-9a27-17bd1d4dbbfc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2087556098-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "111d6d19644b4164a4e623bc7ea07dbf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfeb64804-e1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 12:49:29.753388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Building network info cache for instance {{(pid=128971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 12:49:30.755167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0bfe4e7c-4833-4780-9589-6a4c6a271ca5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:30.808481 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0bfe4e7c-4833-4780-9589-6a4c6a271ca5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1521 microversion: 2.1 time: 2.179460 Sep 08 12:49:30.812831 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1126/2144] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:28 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1521 bytes in 2186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:30.881215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-36f4f2e1-bb23-4d43-a381-8e7c6242996e tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:30.883945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-36f4f2e1-bb23-4d43-a381-8e7c6242996e tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:30.925986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36f4f2e1-bb23-4d43-a381-8e7c6242996e tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:30.927512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36f4f2e1-bb23-4d43-a381-8e7c6242996e tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:30.931421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36f4f2e1-bb23-4d43-a381-8e7c6242996e tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:30.935827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36f4f2e1-bb23-4d43-a381-8e7c6242996e tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:30.938774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36f4f2e1-bb23-4d43-a381-8e7c6242996e tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:30.945508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36f4f2e1-bb23-4d43-a381-8e7c6242996e tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:31.864336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-36f4f2e1-bb23-4d43-a381-8e7c6242996e tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a4501165214cbbaedd633030e68a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42c21dc89784818ae3f51b9086771d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:31.894903 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-36f4f2e1-bb23-4d43-a381-8e7c6242996e tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 200 len: 1503 microversion: 2.1 time: 1.050586 Sep 08 12:49:31.898330 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1127/2145] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:30 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 1503 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:31.927955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-751da940-c08a-420a-812a-ffefcf83585a tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Action: 'create', calling method: .version_select at 0x7fdb3f2daca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-76779426", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:32.010804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-751da940-c08a-420a-812a-ffefcf83585a tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Getting quotas for project 85c79bc3802d489ba6b78345454bf720. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:49:32.073893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-751da940-c08a-420a-812a-ffefcf83585a tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Getting quotas for user c2a5334e0eb946499f1e7ee79a5fdc5c and project 85c79bc3802d489ba6b78345454bf720. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:49:32.160465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Updating instance_info_cache with network_info: [{"id": "09c06616-5ed3-4b3a-86d4-642b9f89e269", "address": "fa:16:3e:96:e3:f1", "network": {"id": "682d96b1-a973-4824-9a27-17bd1d4dbbfc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2087556098-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "111d6d19644b4164a4e623bc7ea07dbf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap09c06616-5e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 12:49:32.165994 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-751da940-c08a-420a-812a-ffefcf83585a tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-751da940-c08a-420a-812a-ffefcf83585a tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Request method failure captured: Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 116 Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTDKVI7wXSEstTe_sCim7uaM6Zim9OGabzSVyoUW_pbrZokGHJQtfY7Ao3YY2TQtLhxwQ5XoT_jbJeBs7JRB_2qbJzjUugDwWc6iaLB5LIxVCcMAtvGOIY56IRPCCjrjTvFmt7tT81T3f1or92JSLbvTK2O-2ZTY8jOJSou_ZOcvN0 Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_85c79bc3802d489ba6b78345454bf720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-76779426", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: exception: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-76779426', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Sep 08 12:49:32.171084 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._create(req, body) Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Sep 08 12:49:32.181225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:32.197389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-751da940-c08a-420a-812a-ffefcf83585a tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:32.197389 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-751da940-c08a-420a-812a-ffefcf83585a tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.286490 Sep 08 12:49:32.199882 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1128/2146] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:49:31 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 301 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:49:32.214435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0fdac2b2-7baf-4f1c-8e26-00c3849ea90b tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:32.215975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0fdac2b2-7baf-4f1c-8e26-00c3849ea90b tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:32.217598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Releasing lock "refresh_cache-c50dcd06-1d5d-44ad-b802-4ef07c7bac31" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 12:49:32.219101 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3efd163-e5eb-4290-8cc4-deca59932e57 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "POST /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31/action" status: 202 len: 0 microversion: 2.1 time: 20.251918 Sep 08 12:49:32.220842 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1019/2147] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:49:11 2022] POST /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31/action => generated 0 bytes in 20256 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 12:49:32.229766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fdac2b2-7baf-4f1c-8e26-00c3849ea90b tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:32.230765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fdac2b2-7baf-4f1c-8e26-00c3849ea90b tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:32.231929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fdac2b2-7baf-4f1c-8e26-00c3849ea90b tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:32.233487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fdac2b2-7baf-4f1c-8e26-00c3849ea90b tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:32.234930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fdac2b2-7baf-4f1c-8e26-00c3849ea90b tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:32.248051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fdac2b2-7baf-4f1c-8e26-00c3849ea90b tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:32.258411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b27b936a-a89f-486c-aae4-03edffe45761 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:32.259831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b27b936a-a89f-486c-aae4-03edffe45761 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:32.279474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b27b936a-a89f-486c-aae4-03edffe45761 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:32.282374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b27b936a-a89f-486c-aae4-03edffe45761 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:32.284248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b27b936a-a89f-486c-aae4-03edffe45761 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:32.285967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b27b936a-a89f-486c-aae4-03edffe45761 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:32.287183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b27b936a-a89f-486c-aae4-03edffe45761 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:32.288421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b27b936a-a89f-486c-aae4-03edffe45761 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:32.369456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b27b936a-a89f-486c-aae4-03edffe45761 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:49:32.445875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-0fdac2b2-7baf-4f1c-8e26-00c3849ea90b tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lazy-loading 'services' on Instance uuid fc2e63e9-502b-4e71-8d22-cb9e9792e8db {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:49:32.474283 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0fdac2b2-7baf-4f1c-8e26-00c3849ea90b tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1929 microversion: 2.75 time: 0.270206 Sep 08 12:49:32.475494 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1129/2148] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:32 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1929 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:32.481830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-bbfc996c-1bd4-4fe1-8dda-9bedf592cb6a req-e434f557-434a-4e32-8235-3ea5a0a21fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afa649b-c753-458a-9be6-2e4d3fdfb25b", "name": "network-vif-unplugged", "status": "completed", "tag": "39228a6d-960b-4a1a-a56d-f8eba7c2e0cc"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:32.499723 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b27b936a-a89f-486c-aae4-03edffe45761 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 204 len: 0 microversion: 2.25 time: 0.276703 Sep 08 12:49:32.507357 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1020/2149] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:49:32 2022] DELETE /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 12:49:32.519657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3ba9f7c1-54da-4061-ad6d-ea5952f5005f req-9a48cdc2-a2c4-4204-b980-691e6e75a185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50dcd06-1d5d-44ad-b802-4ef07c7bac31", "tag": "09c06616-5ed3-4b3a-86d4-642b9f89e269"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:32.519906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bbfc996c-1bd4-4fe1-8dda-9bedf592cb6a req-e434f557-434a-4e32-8235-3ea5a0a21fe9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:32.520386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bbfc996c-1bd4-4fe1-8dda-9bedf592cb6a req-e434f557-434a-4e32-8235-3ea5a0a21fe9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:32.521330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bbfc996c-1bd4-4fe1-8dda-9bedf592cb6a req-e434f557-434a-4e32-8235-3ea5a0a21fe9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:32.541668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3ba9f7c1-54da-4061-ad6d-ea5952f5005f req-9a48cdc2-a2c4-4204-b980-691e6e75a185 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:32.541668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3ba9f7c1-54da-4061-ad6d-ea5952f5005f req-9a48cdc2-a2c4-4204-b980-691e6e75a185 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:32.541668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3ba9f7c1-54da-4061-ad6d-ea5952f5005f req-9a48cdc2-a2c4-4204-b980-691e6e75a185 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:32.557097 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3ba9f7c1-54da-4061-ad6d-ea5952f5005f req-9a48cdc2-a2c4-4204-b980-691e6e75a185 service nova] Creating event network-changed:09c06616-5ed3-4b3a-86d4-642b9f89e269 for instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 on n-h1-852084-10 Sep 08 12:49:32.567849 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-bbfc996c-1bd4-4fe1-8dda-9bedf592cb6a req-e434f557-434a-4e32-8235-3ea5a0a21fe9 service nova] Creating event network-vif-unplugged:39228a6d-960b-4a1a-a56d-f8eba7c2e0cc for instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b on n-h2-852084-10 Sep 08 12:49:32.568953 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3ba9f7c1-54da-4061-ad6d-ea5952f5005f req-9a48cdc2-a2c4-4204-b980-691e6e75a185 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058083 Sep 08 12:49:32.570684 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1021/2150] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:32.592992 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-bbfc996c-1bd4-4fe1-8dda-9bedf592cb6a req-e434f557-434a-4e32-8235-3ea5a0a21fe9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115596 Sep 08 12:49:32.594355 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1130/2151] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:32.594826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e7bf20cb-7853-44f9-95bb-24a3fd8f3f6f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:32.596467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e7bf20cb-7853-44f9-95bb-24a3fd8f3f6f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:32.600468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-abc7816c-73b0-4e4d-bf04-c54ccc75345a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:32.602737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-abc7816c-73b0-4e4d-bf04-c54ccc75345a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:32.613468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abc7816c-73b0-4e4d-bf04-c54ccc75345a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:32.614380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abc7816c-73b0-4e4d-bf04-c54ccc75345a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:32.615041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abc7816c-73b0-4e4d-bf04-c54ccc75345a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:32.615958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abc7816c-73b0-4e4d-bf04-c54ccc75345a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:32.616439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abc7816c-73b0-4e4d-bf04-c54ccc75345a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:32.616884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abc7816c-73b0-4e4d-bf04-c54ccc75345a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:32.629849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7bf20cb-7853-44f9-95bb-24a3fd8f3f6f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:32.630745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7bf20cb-7853-44f9-95bb-24a3fd8f3f6f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:32.631911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7bf20cb-7853-44f9-95bb-24a3fd8f3f6f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:32.632967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7bf20cb-7853-44f9-95bb-24a3fd8f3f6f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:32.633816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7bf20cb-7853-44f9-95bb-24a3fd8f3f6f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:32.634595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7bf20cb-7853-44f9-95bb-24a3fd8f3f6f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:32.650844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-abc7816c-73b0-4e4d-bf04-c54ccc75345a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:49:32.771635 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-abc7816c-73b0-4e4d-bf04-c54ccc75345a tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 204 len: 0 microversion: 2.1 time: 0.175376 Sep 08 12:49:32.772175 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1131/2152] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:49:32 2022] DELETE /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:49:32.864468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ab1b47c-2e44-4e29-ac0d-c235a70c6900 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3f1bb670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-403610517", "description": "tempest-description-610001058"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:33.127666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e7bf20cb-7853-44f9-95bb-24a3fd8f3f6f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:33.144551 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e7bf20cb-7853-44f9-95bb-24a3fd8f3f6f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1521 microversion: 2.1 time: 0.571492 Sep 08 12:49:33.161476 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1022/2153] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:32 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1521 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:33.173142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec00763d-ce40-49f2-a038-ee61ec3aefaf tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Calling method '.version_select at 0x7fdb3a752a60>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:33.197854 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-ec00763d-ce40-49f2-a038-ee61ec3aefaf tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1359048933 not found for user c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec00763d-ce40-49f2-a038-ee61ec3aefaf tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Request method failure captured: Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1359048933 HTTP/1.1 Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeTDKVI7wXSEstTe_sCim7uaM6Zim9OGabzSVyoUW_pbrZokGHJQtfY7Ao3YY2TQtLhxwQ5XoT_jbJeBs7JRB_2qbJzjUugDwWc6iaLB5LIxVCcMAtvGOIY56IRPCCjrjTvFmt7tT81T3f1or92JSLbvTK2O-2ZTY8jOJSou_ZOcvN0 Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_85c79bc3802d489ba6b78345454bf720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/85c79bc3802d489ba6b78345454bf720"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 85c79bc3802d489ba6b78345454bf720 Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1183071481 Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1183071481-project Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: exception: Keypair tempest-keypair-non-existent-1359048933 not found for user c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'tempest-keypair-non-existent-1359048933'} Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-1359048933 not found for user c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:33.203525 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req, id) Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-1359048933 not found for user c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-1359048933 not found for user c2a5334e0eb946499f1e7ee79a5fdc5c Sep 08 12:49:33.209665 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:33.216394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec00763d-ce40-49f2-a038-ee61ec3aefaf tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1359048933 not found for user c2a5334e0eb946499f1e7ee79a5fdc5c {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:33.218013 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ec00763d-ce40-49f2-a038-ee61ec3aefaf tempest-KeyPairsNegativeTestJSON-1183071481 tempest-KeyPairsNegativeTestJSON-1183071481-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1359048933" status: 404 len: 145 microversion: 2.1 time: 0.055231 Sep 08 12:49:33.219104 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1023/2154] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:49:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1359048933 => generated 145 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:49:33.225320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-87216914-6e37-46ee-9eff-63bbeed7f25e tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.112"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:34.409522 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8ab1b47c-2e44-4e29-ac0d-c235a70c6900 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.635962 Sep 08 12:49:34.420824 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1132/2155] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:49:32 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:34.427033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-773591ba-1658-42d6-95a9-c10a13d4ac9f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:34.429595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-773591ba-1658-42d6-95a9-c10a13d4ac9f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:34.432194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-87216914-6e37-46ee-9eff-63bbeed7f25e tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:34.440831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87216914-6e37-46ee-9eff-63bbeed7f25e tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:34.441782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87216914-6e37-46ee-9eff-63bbeed7f25e tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:34.446938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87216914-6e37-46ee-9eff-63bbeed7f25e tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:34.448204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87216914-6e37-46ee-9eff-63bbeed7f25e tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:34.450654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87216914-6e37-46ee-9eff-63bbeed7f25e tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:34.451840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87216914-6e37-46ee-9eff-63bbeed7f25e tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:34.461321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-773591ba-1658-42d6-95a9-c10a13d4ac9f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:34.464740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-773591ba-1658-42d6-95a9-c10a13d4ac9f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:34.467591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-773591ba-1658-42d6-95a9-c10a13d4ac9f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:34.470695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-773591ba-1658-42d6-95a9-c10a13d4ac9f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:34.472585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-773591ba-1658-42d6-95a9-c10a13d4ac9f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:34.473774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-773591ba-1658-42d6-95a9-c10a13d4ac9f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:35.274368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-773591ba-1658-42d6-95a9-c10a13d4ac9f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:35.309484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-773591ba-1658-42d6-95a9-c10a13d4ac9f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:35.314421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-773591ba-1658-42d6-95a9-c10a13d4ac9f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:35.317870 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-773591ba-1658-42d6-95a9-c10a13d4ac9f tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1731 microversion: 2.25 time: 0.894852 Sep 08 12:49:35.319131 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1133/2156] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:34 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1731 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:35.329017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f4954b1e-5e36-4c3c-8a8b-c944c4c7ee6b tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:35.330764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f4954b1e-5e36-4c3c-8a8b-c944c4c7ee6b tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:35.349848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4954b1e-5e36-4c3c-8a8b-c944c4c7ee6b tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:35.351141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4954b1e-5e36-4c3c-8a8b-c944c4c7ee6b tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:35.361523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4954b1e-5e36-4c3c-8a8b-c944c4c7ee6b tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:35.362761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4954b1e-5e36-4c3c-8a8b-c944c4c7ee6b tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:35.364409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4954b1e-5e36-4c3c-8a8b-c944c4c7ee6b tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:35.365588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4954b1e-5e36-4c3c-8a8b-c944c4c7ee6b tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:35.530749 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-87216914-6e37-46ee-9eff-63bbeed7f25e tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] HTTP exception thrown: Floating IP 172.25.4.112 is not associated with instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6. Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-87216914-6e37-46ee-9eff-63bbeed7f25e tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Request method failure captured: Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6/action HTTP/1.1 Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 49 Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeR1IXHSCL4T_0-k4BIFUTBsP8L3-cxGhkRdZjYdL1efvbPk_5tuUjqAxn27exlNZA8RamhG6s4cSkXHYOtsX1gxo77O5Q9NAzb0SUDVLx46NtAGBI0X85vzGWd8U6RD7aw9xs9h16EM8AStuAXdNwqpKkE2d9wddOL2QQlqEeASvtg Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 111d6d19644b4164a4e623bc7ea07dbf Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1499655394 Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1499655394 Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 111d6d19644b4164a4e623bc7ea07dbf Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1499655394 Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FloatingIPsAssociationTestJSON-1499655394-project Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d728c4e964f44edf9f8c5114032a4fbb Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1499655394-project Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: {"removeFloatingIp": {"address": "172.25.4.112"}} Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: exception: Floating IP 172.25.4.112 is not associated with instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6. Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '5bfe69bb-91ad-499f-9f12-de0ac60519b6', 'body': {'removeFloatingIp': {'address': '172.25.4.112'}}} Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.4.112 is not associated with instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6. Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.4.112 is not associated with instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6. Sep 08 12:49:35.537579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:35.549288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-87216914-6e37-46ee-9eff-63bbeed7f25e tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Returning 409 to user: Floating IP 172.25.4.112 is not associated with instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:35.551463 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-87216914-6e37-46ee-9eff-63bbeed7f25e tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "POST /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6/action" status: 409 len: 146 microversion: 2.1 time: 2.330660 Sep 08 12:49:35.558634 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1024/2157] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:49:33 2022] POST /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6/action => generated 146 bytes in 2338 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:49:35.579959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5884a5b5-805f-42f1-b4da-e2d70d476590 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:35.579959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5884a5b5-805f-42f1-b4da-e2d70d476590 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:35.590401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5884a5b5-805f-42f1-b4da-e2d70d476590 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:35.590917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5884a5b5-805f-42f1-b4da-e2d70d476590 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:35.591406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5884a5b5-805f-42f1-b4da-e2d70d476590 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:35.592504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5884a5b5-805f-42f1-b4da-e2d70d476590 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:35.592666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5884a5b5-805f-42f1-b4da-e2d70d476590 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:35.593001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5884a5b5-805f-42f1-b4da-e2d70d476590 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:35.811241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-5884a5b5-805f-42f1-b4da-e2d70d476590 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lazy-loading 'services' on Instance uuid fc2e63e9-502b-4e71-8d22-cb9e9792e8db {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:49:35.879014 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5884a5b5-805f-42f1-b4da-e2d70d476590 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1929 microversion: 2.75 time: 0.307649 Sep 08 12:49:35.884491 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1025/2158] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:35 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1929 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:35.913018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6c60097c-d5dd-4fd9-b305-c5b9dbdc79e0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:35.914244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6c60097c-d5dd-4fd9-b305-c5b9dbdc79e0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:36.007847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c60097c-d5dd-4fd9-b305-c5b9dbdc79e0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:36.011790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c60097c-d5dd-4fd9-b305-c5b9dbdc79e0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:36.013049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c60097c-d5dd-4fd9-b305-c5b9dbdc79e0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:36.021804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c60097c-d5dd-4fd9-b305-c5b9dbdc79e0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:36.023582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c60097c-d5dd-4fd9-b305-c5b9dbdc79e0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:36.024771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c60097c-d5dd-4fd9-b305-c5b9dbdc79e0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:36.036295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f4954b1e-5e36-4c3c-8a8b-c944c4c7ee6b tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e6a4501165214cbbaedd633030e68a6b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f42c21dc89784818ae3f51b9086771d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:36.049421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:36.085861 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f4954b1e-5e36-4c3c-8a8b-c944c4c7ee6b tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 200 len: 1509 microversion: 2.1 time: 0.764558 Sep 08 12:49:36.091938 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1134/2159] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:35 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 1509 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:36.118851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5df46cd0-2c37-4aa1-80bc-fb9fbc4043cb tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3f198ee0>, body: {"security_group_rule": {"parent_group_id": "5a4e09f8-dd27-4947-968b-1a3e5b4e46a7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:37.121991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c60097c-d5dd-4fd9-b305-c5b9dbdc79e0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:37.150597 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6c60097c-d5dd-4fd9-b305-c5b9dbdc79e0 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1521 microversion: 2.1 time: 1.264156 Sep 08 12:49:37.170291 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1026/2160] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:35 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1521 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:37.191726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0ffe0fc6-1265-4332-8767-1f57065e02f9 req-9649998e-7420-4242-bab1-191974a1fff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afa649b-c753-458a-9be6-2e4d3fdfb25b", "name": "network-vif-plugged", "status": "completed", "tag": "39228a6d-960b-4a1a-a56d-f8eba7c2e0cc"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:37.233273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0ffe0fc6-1265-4332-8767-1f57065e02f9 req-9649998e-7420-4242-bab1-191974a1fff6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:37.233931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0ffe0fc6-1265-4332-8767-1f57065e02f9 req-9649998e-7420-4242-bab1-191974a1fff6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:37.239028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0ffe0fc6-1265-4332-8767-1f57065e02f9 req-9649998e-7420-4242-bab1-191974a1fff6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:37.293716 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0ffe0fc6-1265-4332-8767-1f57065e02f9 req-9649998e-7420-4242-bab1-191974a1fff6 service nova] Creating event network-vif-plugged:39228a6d-960b-4a1a-a56d-f8eba7c2e0cc for instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b on n-h2-852084-10 Sep 08 12:49:37.314887 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0ffe0fc6-1265-4332-8767-1f57065e02f9 req-9649998e-7420-4242-bab1-191974a1fff6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133332 Sep 08 12:49:37.323737 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1027/2161] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:37.362324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.112"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:38.104564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:38.118926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:38.120161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:38.121576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:38.123259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:38.125286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:38.126167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:38.493356 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5df46cd0-2c37-4aa1-80bc-fb9fbc4043cb tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 2.398781 Sep 08 12:49:38.494418 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1135/2162] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:49:36 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 2401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:38.500042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bac4fbda-f84a-417c-a384-6aab29c86956 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:38.500753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bac4fbda-f84a-417c-a384-6aab29c86956 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:38.513039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bac4fbda-f84a-417c-a384-6aab29c86956 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:38.513987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bac4fbda-f84a-417c-a384-6aab29c86956 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:38.514728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bac4fbda-f84a-417c-a384-6aab29c86956 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:38.515706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bac4fbda-f84a-417c-a384-6aab29c86956 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:38.520605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bac4fbda-f84a-417c-a384-6aab29c86956 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:38.521411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bac4fbda-f84a-417c-a384-6aab29c86956 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:38.725748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bac4fbda-f84a-417c-a384-6aab29c86956 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:38.742391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bac4fbda-f84a-417c-a384-6aab29c86956 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:38.745731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bac4fbda-f84a-417c-a384-6aab29c86956 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:38.749984 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bac4fbda-f84a-417c-a384-6aab29c86956 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 200 len: 1663 microversion: 2.25 time: 0.253348 Sep 08 12:49:38.752643 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1136/2163] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:38 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 1663 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:38.833596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "refresh_cache-c50dcd06-1d5d-44ad-b802-4ef07c7bac31" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 12:49:38.833972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquired lock "refresh_cache-c50dcd06-1d5d-44ad-b802-4ef07c7bac31" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 12:49:39.161399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-880162176", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "d5dcefb0-4778-4530-8c52-dda6d71bbdcd"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:39.254287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] validate_networks() for [('d5dcefb0-4778-4530-8c52-dda6d71bbdcd', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:49:40.544951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Building network info cache for instance {{(pid=128971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 12:49:40.676563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:49:40.678240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:49:40.679585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:49:40.681496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:49:40.685739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:49:40.729160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=21 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:40.734583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:40.738795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:40.739670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:40.745585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:40.748200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:40.749015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:40.847008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Getting quotas for project 4f6e4f8a7d2b473c875460f24e685ee2. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:49:40.877583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Getting quotas for user 55a2295e4ec3478fb86588f624650e01 and project 4f6e4f8a7d2b473c875460f24e685ee2. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:49:40.916777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:49:40.923532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:49:41.071649 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-471c098c-f4e9-473d-b1b7-7e8045560ac9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.313020 Sep 08 12:49:41.078363 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1137/2164] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:49:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:49:41.113608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-bb7fdecd-9c1a-412e-af32-301252e50d44 req-561f5d20-0b49-40b8-bc7b-e25c636c1530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d1e44cb-d0d1-4c3a-9804-287bfe740bc5", "name": "network-vif-deleted", "tag": "9fd049b2-77ee-4791-bd71-d7867f7f28d4"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:41.155535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bb7fdecd-9c1a-412e-af32-301252e50d44 req-561f5d20-0b49-40b8-bc7b-e25c636c1530 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:41.156294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bb7fdecd-9c1a-412e-af32-301252e50d44 req-561f5d20-0b49-40b8-bc7b-e25c636c1530 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:41.157112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bb7fdecd-9c1a-412e-af32-301252e50d44 req-561f5d20-0b49-40b8-bc7b-e25c636c1530 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:41.202564 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-bb7fdecd-9c1a-412e-af32-301252e50d44 req-561f5d20-0b49-40b8-bc7b-e25c636c1530 service nova] Creating event network-vif-deleted:9fd049b2-77ee-4791-bd71-d7867f7f28d4 for instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 on n-h1-852084-10 Sep 08 12:49:41.220499 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-bb7fdecd-9c1a-412e-af32-301252e50d44 req-561f5d20-0b49-40b8-bc7b-e25c636c1530 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132510 Sep 08 12:49:41.228773 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1138/2165] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:41.253197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-161a7eb1-7474-44ce-be47-a4588a5d4f9c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:41.259895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-161a7eb1-7474-44ce-be47-a4588a5d4f9c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:41.288377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-161a7eb1-7474-44ce-be47-a4588a5d4f9c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:41.289972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-161a7eb1-7474-44ce-be47-a4588a5d4f9c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:41.291074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-161a7eb1-7474-44ce-be47-a4588a5d4f9c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:41.296970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-161a7eb1-7474-44ce-be47-a4588a5d4f9c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:41.298390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-161a7eb1-7474-44ce-be47-a4588a5d4f9c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:41.299946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-161a7eb1-7474-44ce-be47-a4588a5d4f9c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.027862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-161a7eb1-7474-44ce-be47-a4588a5d4f9c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lazy-loading 'services' on Instance uuid fc2e63e9-502b-4e71-8d22-cb9e9792e8db {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:49:42.059249 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-161a7eb1-7474-44ce-be47-a4588a5d4f9c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1929 microversion: 2.75 time: 0.827030 Sep 08 12:49:42.059875 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1139/2166] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:41 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1929 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:42.078234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-32ca2a63-2869-45c6-83ea-09cb3135e326 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:42.078234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-32ca2a63-2869-45c6-83ea-09cb3135e326 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:42.094003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32ca2a63-2869-45c6-83ea-09cb3135e326 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.096489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32ca2a63-2869-45c6-83ea-09cb3135e326 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.097435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32ca2a63-2869-45c6-83ea-09cb3135e326 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.098909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32ca2a63-2869-45c6-83ea-09cb3135e326 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.099916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32ca2a63-2869-45c6-83ea-09cb3135e326 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.100847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32ca2a63-2869-45c6-83ea-09cb3135e326 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.129424 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-32ca2a63-2869-45c6-83ea-09cb3135e326 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] HTTP exception thrown: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-32ca2a63-2869-45c6-83ea-09cb3135e326 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Request method failure captured: Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 HTTP/1.1 Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeS3pK2HPwY-r-rhOMrDQAvhiz_o3SHX5chvz25bxPQ47jd21dpmSIc8_qBje1M-OmInIZvuJmLzjClXbZpRCcNKXGevizWp2PnBMKZgzFJro0m68gfdzeJggdA8qmpJOYWuL2hZkyFYDWJhhxgxEK5_UtM4rq0EikoXGmjxxcMJNgA Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: e6a4501165214cbbaedd633030e68a6b Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '7d1e44cb-d0d1-4c3a-9804-287bfe740bc5'} Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:42.133390 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.143536 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:42.143536 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:42.143536 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:42.143536 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:42.143536 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:42.143536 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:42.143536 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.143536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-32ca2a63-2869-45c6-83ea-09cb3135e326 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Returning 404 to user: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:42.143536 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-32ca2a63-2869-45c6-83ea-09cb3135e326 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 404 len: 111 microversion: 2.1 time: 0.073816 Sep 08 12:49:42.143536 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1140/2167] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:42 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:49:42.153128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3fdc689e-3067-4a2a-ab24-0cb5f2d19164 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:42.153502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3fdc689e-3067-4a2a-ab24-0cb5f2d19164 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:42.168048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fdc689e-3067-4a2a-ab24-0cb5f2d19164 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.168994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fdc689e-3067-4a2a-ab24-0cb5f2d19164 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.169832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fdc689e-3067-4a2a-ab24-0cb5f2d19164 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.171218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fdc689e-3067-4a2a-ab24-0cb5f2d19164 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.172139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fdc689e-3067-4a2a-ab24-0cb5f2d19164 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.172983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fdc689e-3067-4a2a-ab24-0cb5f2d19164 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.431904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Updating instance_info_cache with network_info: [{"id": "09c06616-5ed3-4b3a-86d4-642b9f89e269", "address": "fa:16:3e:96:e3:f1", "network": {"id": "682d96b1-a973-4824-9a27-17bd1d4dbbfc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2087556098-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "111d6d19644b4164a4e623bc7ea07dbf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap09c06616-5e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 12:49:42.452816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Releasing lock "refresh_cache-c50dcd06-1d5d-44ad-b802-4ef07c7bac31" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 12:49:42.454697 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9b4752bb-020a-40fa-9777-624e57fc303f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "POST /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31/action" status: 202 len: 0 microversion: 2.1 time: 5.128751 Sep 08 12:49:42.460444 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1028/2168] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:49:37 2022] POST /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31/action => generated 0 bytes in 5136 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 12:49:42.503530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3fdc689e-3067-4a2a-ab24-0cb5f2d19164 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:42.527277 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3fdc689e-3067-4a2a-ab24-0cb5f2d19164 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1506 microversion: 2.1 time: 0.383235 Sep 08 12:49:42.530878 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1141/2169] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:42 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:42.544790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9f29ccb-8bd0-452e-a3b8-2304632131e6 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3f1bb280>, body: {"security_group_rule": {"parent_group_id": "5a4e09f8-dd27-4947-968b-1a3e5b4e46a7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:42.598516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6f35e9ae-d38a-44a8-b55c-b0b97856d06e tempest-AbsoluteLimitsTestJSON-508039117 tempest-AbsoluteLimitsTestJSON-508039117-project] Calling method '.version_select at 0x7fdb3ab5fd30>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:42.618868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f35e9ae-d38a-44a8-b55c-b0b97856d06e tempest-AbsoluteLimitsTestJSON-508039117 tempest-AbsoluteLimitsTestJSON-508039117-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.627486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f35e9ae-d38a-44a8-b55c-b0b97856d06e tempest-AbsoluteLimitsTestJSON-508039117 tempest-AbsoluteLimitsTestJSON-508039117-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.628428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f35e9ae-d38a-44a8-b55c-b0b97856d06e tempest-AbsoluteLimitsTestJSON-508039117 tempest-AbsoluteLimitsTestJSON-508039117-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.629655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f35e9ae-d38a-44a8-b55c-b0b97856d06e tempest-AbsoluteLimitsTestJSON-508039117 tempest-AbsoluteLimitsTestJSON-508039117-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.630367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f35e9ae-d38a-44a8-b55c-b0b97856d06e tempest-AbsoluteLimitsTestJSON-508039117 tempest-AbsoluteLimitsTestJSON-508039117-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.631128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f35e9ae-d38a-44a8-b55c-b0b97856d06e tempest-AbsoluteLimitsTestJSON-508039117 tempest-AbsoluteLimitsTestJSON-508039117-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.681643 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-a9f29ccb-8bd0-452e-a3b8-2304632131e6 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] HTTP exception thrown: This rule already exists in group 5a4e09f8-dd27-4947-968b-1a3e5b4e46a7 Sep 08 12:49:42.690536 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6f35e9ae-d38a-44a8-b55c-b0b97856d06e tempest-AbsoluteLimitsTestJSON-508039117 tempest-AbsoluteLimitsTestJSON-508039117-project] 10.222.0.78 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.228390 Sep 08 12:49:42.692100 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1029/2170] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Sep 8 12:49:42 2022] GET /compute/v2.1/limits => generated 511 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:42.699342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c61838b2-22df-4dff-9dd1-203d4a2e3d32 req-f15ed19b-cd3f-46c4-a73c-948ce56aa574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ba78845-4ce9-474d-ac71-a91626b110d1", "name": "network-vif-deleted", "tag": "0305f968-e274-437c-8891-b5da427a44bc"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9f29ccb-8bd0-452e-a3b8-2304632131e6 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Request method failure captured: Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 138 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTb8Ko5dVXO9wNCJCefr56P-Sg4Z7FHdVbv5hRFZXpmfkoAOGtJ5kuPtpsUjecnpyMQ-WudEmMcYMs2z64aLX-v9mn-awO7YI6uqVKqm4wcsinOQiI9otsaxpNYVnhhiuYm-qkZJuOQbR4B9cwrcs7gA5EkAJfh-_8xz-BOiYmuwRw Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: ec985c7670dd47c0ab68614537d32028 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: {"security_group_rule": {"parent_group_id": "5a4e09f8-dd27-4947-968b-1a3e5b4e46a7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: exception: This rule already exists in group 5a4e09f8-dd27-4947-968b-1a3e5b4e46a7 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'security_group_rule': {'parent_group_id': '5a4e09f8-dd27-4947-968b-1a3e5b4e46a7', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 5a4e09f8-dd27-4947-968b-1a3e5b4e46a7 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 5a4e09f8-dd27-4947-968b-1a3e5b4e46a7 Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:42.708151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:42.713288 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:42.713288 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:42.713288 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 5a4e09f8-dd27-4947-968b-1a3e5b4e46a7 Sep 08 12:49:42.713288 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.713288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9f29ccb-8bd0-452e-a3b8-2304632131e6 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Returning 400 to user: This rule already exists in group 5a4e09f8-dd27-4947-968b-1a3e5b4e46a7 {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:42.713288 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a9f29ccb-8bd0-452e-a3b8-2304632131e6 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.178132 Sep 08 12:49:42.714358 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1142/2171] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:49:42 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 182 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:49:42.724640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c61838b2-22df-4dff-9dd1-203d4a2e3d32 req-f15ed19b-cd3f-46c4-a73c-948ce56aa574 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.726722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c61838b2-22df-4dff-9dd1-203d4a2e3d32 req-f15ed19b-cd3f-46c4-a73c-948ce56aa574 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.727517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c61838b2-22df-4dff-9dd1-203d4a2e3d32 req-f15ed19b-cd3f-46c4-a73c-948ce56aa574 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.738761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f249a852-54cb-4ab5-9f1f-f0fae7bed028 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:42.742029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f249a852-54cb-4ab5-9f1f-f0fae7bed028 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 2ba78845-4ce9-474d-ac71-a91626b110d1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:42.744359 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c61838b2-22df-4dff-9dd1-203d4a2e3d32 req-f15ed19b-cd3f-46c4-a73c-948ce56aa574 service nova] Creating event network-vif-deleted:0305f968-e274-437c-8891-b5da427a44bc for instance 2ba78845-4ce9-474d-ac71-a91626b110d1 on n-h2-852084-10 Sep 08 12:49:42.754389 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c61838b2-22df-4dff-9dd1-203d4a2e3d32 req-f15ed19b-cd3f-46c4-a73c-948ce56aa574 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059307 Sep 08 12:49:42.756096 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1030/2172] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:42.768348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3b701a75-20a0-4a4d-bd42-ee2c2c99afc9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:42.769026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f249a852-54cb-4ab5-9f1f-f0fae7bed028 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.769881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f249a852-54cb-4ab5-9f1f-f0fae7bed028 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.770675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3b701a75-20a0-4a4d-bd42-ee2c2c99afc9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:42.770854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f249a852-54cb-4ab5-9f1f-f0fae7bed028 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.772662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f249a852-54cb-4ab5-9f1f-f0fae7bed028 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.778820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f249a852-54cb-4ab5-9f1f-f0fae7bed028 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.780542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f249a852-54cb-4ab5-9f1f-f0fae7bed028 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.786182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b701a75-20a0-4a4d-bd42-ee2c2c99afc9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.787105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b701a75-20a0-4a4d-bd42-ee2c2c99afc9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.788484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b701a75-20a0-4a4d-bd42-ee2c2c99afc9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.790265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b701a75-20a0-4a4d-bd42-ee2c2c99afc9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.793463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b701a75-20a0-4a4d-bd42-ee2c2c99afc9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.794213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b701a75-20a0-4a4d-bd42-ee2c2c99afc9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.831330 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-f249a852-54cb-4ab5-9f1f-f0fae7bed028 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] HTTP exception thrown: Instance 2ba78845-4ce9-474d-ac71-a91626b110d1 could not be found. Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f249a852-54cb-4ab5-9f1f-f0fae7bed028 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Request method failure captured: Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 HTTP/1.1 Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKxlpY1IbMyY5ZD8fhRJghwJHCqOAVJje9hTMCM6IyWpGbpVObcW8c1FqdL9mzvGHFLBpowN2NwMRcmp3G51ZYgQaV6YWezrqMNPxYd2W1oO67pJzCz7PUPEpLwIxcBuVLVsXQnXuWWdnFig4aff_iccKQRdBSMdPG4-ZDyiw3o_gM Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.25 Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: df5a27766c1942a8be6a78466f7e7192 Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-910002977 Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-910002977 Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: df5a27766c1942a8be6a78466f7e7192 Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-910002977 Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-LiveAutoBlockMigrationV225Test-910002977-project Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 8af088dfb51e4f729cc97fc91699a55f Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-910002977-project Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 2ba78845-4ce9-474d-ac71-a91626b110d1 could not be found. Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '2ba78845-4ce9-474d-ac71-a91626b110d1'} Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ba78845-4ce9-474d-ac71-a91626b110d1 could not be found. Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ba78845-4ce9-474d-ac71-a91626b110d1 could not be found. Sep 08 12:49:42.835788 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.839616 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:42.839616 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.839616 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:42.839616 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:42.839616 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:42.839616 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:42.839616 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:42.839616 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ba78845-4ce9-474d-ac71-a91626b110d1 could not be found. Sep 08 12:49:42.839616 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.839616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f249a852-54cb-4ab5-9f1f-f0fae7bed028 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Returning 404 to user: Instance 2ba78845-4ce9-474d-ac71-a91626b110d1 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:42.840987 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f249a852-54cb-4ab5-9f1f-f0fae7bed028 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1" status: 404 len: 111 microversion: 2.25 time: 0.124933 Sep 08 12:49:42.849047 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1143/2173] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:42 2022] GET /compute/v2.1/servers/2ba78845-4ce9-474d-ac71-a91626b110d1 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:49:42.864868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4450e3df-6dd2-4b32-9127-bd911e0a7eb6 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-40495064", "metadata": {"image_type": "test"}}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:42.871359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4450e3df-6dd2-4b32-9127-bd911e0a7eb6 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:42.885385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4450e3df-6dd2-4b32-9127-bd911e0a7eb6 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.886535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4450e3df-6dd2-4b32-9127-bd911e0a7eb6 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.887426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4450e3df-6dd2-4b32-9127-bd911e0a7eb6 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.889269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4450e3df-6dd2-4b32-9127-bd911e0a7eb6 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.890532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4450e3df-6dd2-4b32-9127-bd911e0a7eb6 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.892519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4450e3df-6dd2-4b32-9127-bd911e0a7eb6 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.928571 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-4450e3df-6dd2-4b32-9127-bd911e0a7eb6 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] HTTP exception thrown: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4450e3df-6dd2-4b32-9127-bd911e0a7eb6 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Request method failure captured: Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5/action HTTP/1.1 Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 110 Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeS3pK2HPwY-r-rhOMrDQAvhiz_o3SHX5chvz25bxPQ47jd21dpmSIc8_qBje1M-OmInIZvuJmLzjClXbZpRCcNKXGevizWp2PnBMKZgzFJro0m68gfdzeJggdA8qmpJOYWuL2hZkyFYDWJhhxgxEK5_UtM4rq0EikoXGmjxxcMJNgA Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: e6a4501165214cbbaedd633030e68a6b Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-40495064", "metadata": {"image_type": "test"}}} Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '7d1e44cb-d0d1-4c3a-9804-287bfe740bc5', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-40495064', 'metadata': {'image_type': 'test'}}}} Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 12:49:42.933792 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4450e3df-6dd2-4b32-9127-bd911e0a7eb6 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Returning 404 to user: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:42.937422 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4450e3df-6dd2-4b32-9127-bd911e0a7eb6 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "POST /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5/action" status: 404 len: 111 microversion: 2.1 time: 0.085655 Sep 08 12:49:42.938989 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1144/2174] 10.222.0.78 () {60 vars in 1279 bytes} [Thu Sep 8 12:49:42 2022] POST /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5/action => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:49:42.958233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b701a75-20a0-4a4d-bd42-ee2c2c99afc9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a2295e4ec3478fb86588f624650e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6e4f8a7d2b473c875460f24e685ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:42.968598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2cc8e27b-a333-486d-b40b-74a0d26b5cea tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:42.972298 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3b701a75-20a0-4a4d-bd42-ee2c2c99afc9 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 200 len: 1279 microversion: 2.1 time: 0.212381 Sep 08 12:49:42.973275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2cc8e27b-a333-486d-b40b-74a0d26b5cea tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:42.989662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cc8e27b-a333-486d-b40b-74a0d26b5cea tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.989662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cc8e27b-a333-486d-b40b-74a0d26b5cea tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.989662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cc8e27b-a333-486d-b40b-74a0d26b5cea tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.989662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cc8e27b-a333-486d-b40b-74a0d26b5cea tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:42.989662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cc8e27b-a333-486d-b40b-74a0d26b5cea tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:42.989662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cc8e27b-a333-486d-b40b-74a0d26b5cea tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:42.991544 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1031/2175] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:42 2022] GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 1279 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:42.997850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e8c452c9-78b5-41bc-909d-b8ac6a595524 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:42.998901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e8c452c9-78b5-41bc-909d-b8ac6a595524 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:43.010533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e8c452c9-78b5-41bc-909d-b8ac6a595524 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:43.011261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e8c452c9-78b5-41bc-909d-b8ac6a595524 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:43.012201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e8c452c9-78b5-41bc-909d-b8ac6a595524 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:43.013258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e8c452c9-78b5-41bc-909d-b8ac6a595524 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:43.013908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e8c452c9-78b5-41bc-909d-b8ac6a595524 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:43.014487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e8c452c9-78b5-41bc-909d-b8ac6a595524 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:43.144965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2cc8e27b-a333-486d-b40b-74a0d26b5cea tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:49:43.448992 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2cc8e27b-a333-486d-b40b-74a0d26b5cea tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 204 len: 0 microversion: 2.1 time: 0.495469 Sep 08 12:49:43.449730 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1145/2176] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:49:42 2022] DELETE /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:49:43.466379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f322a81-bdba-4e45-9ff1-71b97e27a69e tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Calling method '.version_select at 0x7fdb3f29ed30>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:43.477611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e8c452c9-78b5-41bc-909d-b8ac6a595524 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:43.522797 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e8c452c9-78b5-41bc-909d-b8ac6a595524 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 200 len: 1506 microversion: 2.1 time: 0.529532 Sep 08 12:49:43.523506 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1032/2177] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:42 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 1506 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:43.554450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fd45be5-3b05-4ce1-b37b-0753eff4fa06 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '.version_select at 0x7fdb3abdd550>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:43.599778 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1fd45be5-3b05-4ce1-b37b-0753eff4fa06 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2002878501" status: 204 len: 0 microversion: 2.25 time: 0.064404 Sep 08 12:49:43.601452 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1033/2178] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 12:49:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2002878501 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 12:49:43.612079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-87b9f306-2124-431c-9977-f98e697483ac tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-185407090", "metadata": {"image_type": "test"}}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:43.616253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-87b9f306-2124-431c-9977-f98e697483ac tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Failed to fetch instance by id tempest-invalid-1348480624 {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 12:49:43.617136 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-87b9f306-2124-431c-9977-f98e697483ac tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] HTTP exception thrown: Instance tempest-invalid-1348480624 could not be found. Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-87b9f306-2124-431c-9977-f98e697483ac tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Request method failure captured: Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/tempest-invalid-1348480624/action HTTP/1.1 Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 111 Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeS3pK2HPwY-r-rhOMrDQAvhiz_o3SHX5chvz25bxPQ47jd21dpmSIc8_qBje1M-OmInIZvuJmLzjClXbZpRCcNKXGevizWp2PnBMKZgzFJro0m68gfdzeJggdA8qmpJOYWuL2hZkyFYDWJhhxgxEK5_UtM4rq0EikoXGmjxxcMJNgA Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: e6a4501165214cbbaedd633030e68a6b Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-185407090", "metadata": {"image_type": "test"}}} Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance tempest-invalid-1348480624 could not be found. Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'tempest-invalid-1348480624', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-185407090', 'metadata': {'image_type': 'test'}}}} Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1348480624 could not be found. Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:49:43.619336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1348480624 could not be found. Sep 08 12:49:43.622914 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:43.622914 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:43.622914 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:43.622914 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:43.622914 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:43.622914 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:43.622914 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:43.622914 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:43.622914 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1348480624 could not be found. Sep 08 12:49:43.622914 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:43.628470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-87b9f306-2124-431c-9977-f98e697483ac tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Returning 404 to user: Instance tempest-invalid-1348480624 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:43.633522 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-87b9f306-2124-431c-9977-f98e697483ac tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "POST /compute/v2.1/servers/tempest-invalid-1348480624/action" status: 404 len: 101 microversion: 2.1 time: 0.027698 Sep 08 12:49:43.635575 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1034/2179] 10.222.0.78 () {60 vars in 1249 bytes} [Thu Sep 8 12:49:43 2022] POST /compute/v2.1/servers/tempest-invalid-1348480624/action => generated 101 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:49:43.648888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-78ed11c7-421e-49b2-9185-e16b837e5583 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:43.650124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-78ed11c7-421e-49b2-9185-e16b837e5583 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:43.662997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78ed11c7-421e-49b2-9185-e16b837e5583 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:43.663817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78ed11c7-421e-49b2-9185-e16b837e5583 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:43.664441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78ed11c7-421e-49b2-9185-e16b837e5583 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:43.667822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78ed11c7-421e-49b2-9185-e16b837e5583 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:43.670551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78ed11c7-421e-49b2-9185-e16b837e5583 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:43.671447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78ed11c7-421e-49b2-9185-e16b837e5583 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:43.819958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-78ed11c7-421e-49b2-9185-e16b837e5583 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lazy-loading 'services' on Instance uuid fc2e63e9-502b-4e71-8d22-cb9e9792e8db {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:49:43.859843 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-78ed11c7-421e-49b2-9185-e16b837e5583 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1929 microversion: 2.75 time: 0.220901 Sep 08 12:49:43.861729 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1035/2180] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:43 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1929 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:43.874886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.112"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:43.880095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:43.891808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:43.892643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:43.893275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:43.894274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:43.894755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:43.895429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:43.995396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "refresh_cache-5bfe69bb-91ad-499f-9f12-de0ac60519b6" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 12:49:43.997357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquired lock "refresh_cache-5bfe69bb-91ad-499f-9f12-de0ac60519b6" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 12:49:44.071391 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f322a81-bdba-4e45-9ff1-71b97e27a69e tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/1077b903-6415-4e3a-b02c-302a65c29885" status: 202 len: 0 microversion: 2.1 time: 0.614666 Sep 08 12:49:44.072574 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1146/2181] 10.222.0.78 () {58 vars in 1287 bytes} [Thu Sep 8 12:49:43 2022] DELETE /compute/v2.1/os-security-group-rules/1077b903-6415-4e3a-b02c-302a65c29885 => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:49:44.082544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-53ed69b7-8c4e-4b8b-808a-81b2a5792d3c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:44.083948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-53ed69b7-8c4e-4b8b-808a-81b2a5792d3c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:44.128219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53ed69b7-8c4e-4b8b-808a-81b2a5792d3c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:44.128958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53ed69b7-8c4e-4b8b-808a-81b2a5792d3c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:44.130019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53ed69b7-8c4e-4b8b-808a-81b2a5792d3c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:44.132199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53ed69b7-8c4e-4b8b-808a-81b2a5792d3c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:44.133504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53ed69b7-8c4e-4b8b-808a-81b2a5792d3c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:44.134685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53ed69b7-8c4e-4b8b-808a-81b2a5792d3c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:44.187184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-53ed69b7-8c4e-4b8b-808a-81b2a5792d3c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:49:44.356741 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-53ed69b7-8c4e-4b8b-808a-81b2a5792d3c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 204 len: 0 microversion: 2.1 time: 0.281984 Sep 08 12:49:44.358173 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1147/2182] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:49:44 2022] DELETE /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:49:44.367026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84f34608-c312-4543-b13c-779afedd859d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-947716870"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:44.370854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-84f34608-c312-4543-b13c-779afedd859d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 12:49:44.372826 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-84f34608-c312-4543-b13c-779afedd859d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84f34608-c312-4543-b13c-779afedd859d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Request method failure captured: Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 56 Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeS3pK2HPwY-r-rhOMrDQAvhiz_o3SHX5chvz25bxPQ47jd21dpmSIc8_qBje1M-OmInIZvuJmLzjClXbZpRCcNKXGevizWp2PnBMKZgzFJro0m68gfdzeJggdA8qmpJOYWuL2hZkyFYDWJhhxgxEK5_UtM4rq0EikoXGmjxxcMJNgA Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: e6a4501165214cbbaedd633030e68a6b Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: {"createImage": {"name": "tempest-test-snap-947716870"}} Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-947716870'}}} Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 12:49:44.375526 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:44.380075 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:44.380075 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:44.380075 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:44.380075 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:44.380075 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:44.380075 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:44.380075 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:44.380075 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 12:49:44.380075 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:44.383218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84f34608-c312-4543-b13c-779afedd859d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:44.384529 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-84f34608-c312-4543-b13c-779afedd859d tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.024768 Sep 08 12:49:44.390292 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1148/2183] 10.222.0.78 () {60 vars in 1275 bytes} [Thu Sep 8 12:49:44 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:49:44.405984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-22b334eb-1d7f-4782-9570-6f647ab3831e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:44.407713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-22b334eb-1d7f-4782-9570-6f647ab3831e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:44.417660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22b334eb-1d7f-4782-9570-6f647ab3831e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:44.418520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22b334eb-1d7f-4782-9570-6f647ab3831e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:44.419192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22b334eb-1d7f-4782-9570-6f647ab3831e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:44.420209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22b334eb-1d7f-4782-9570-6f647ab3831e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:44.420879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22b334eb-1d7f-4782-9570-6f647ab3831e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:44.421502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22b334eb-1d7f-4782-9570-6f647ab3831e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:44.630669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-22b334eb-1d7f-4782-9570-6f647ab3831e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a2295e4ec3478fb86588f624650e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6e4f8a7d2b473c875460f24e685ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:44.657852 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-22b334eb-1d7f-4782-9570-6f647ab3831e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 200 len: 1285 microversion: 2.1 time: 0.264587 Sep 08 12:49:44.660668 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1149/2184] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:44 2022] GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 1285 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:44.672272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e77141ce-27f6-4772-b467-febb0124d20e tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3f2ed700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1532561441", "description": "tempest-description-1546585982"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:45.525584 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e77141ce-27f6-4772-b467-febb0124d20e tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.857886 Sep 08 12:49:45.532543 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1150/2185] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:49:44 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:45.551616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5a1a0d4f-764e-4979-abe0-80687f18e605 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-240404972"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:45.554840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5a1a0d4f-764e-4979-abe0-80687f18e605 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 12:49:45.555479 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-5a1a0d4f-764e-4979-abe0-80687f18e605 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5a1a0d4f-764e-4979-abe0-80687f18e605 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Request method failure captured: Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 56 Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeS3pK2HPwY-r-rhOMrDQAvhiz_o3SHX5chvz25bxPQ47jd21dpmSIc8_qBje1M-OmInIZvuJmLzjClXbZpRCcNKXGevizWp2PnBMKZgzFJro0m68gfdzeJggdA8qmpJOYWuL2hZkyFYDWJhhxgxEK5_UtM4rq0EikoXGmjxxcMJNgA Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: e6a4501165214cbbaedd633030e68a6b Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: {"createImage": {"name": "tempest-test-snap-240404972"}} Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-240404972'}}} Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 12:49:45.557519 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:45.564240 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:45.564240 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:45.564240 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:45.564240 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:45.564240 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:45.564240 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:45.564240 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:45.564240 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Sep 08 12:49:45.564240 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:45.564240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5a1a0d4f-764e-4979-abe0-80687f18e605 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:45.564240 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5a1a0d4f-764e-4979-abe0-80687f18e605 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.025339 Sep 08 12:49:45.564240 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1151/2186] 10.222.0.78 () {60 vars in 1281 bytes} [Thu Sep 8 12:49:45 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:49:45.572945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-985017085", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "9324045c-e84a-4063-86c3-13924eff78b4"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:45.702219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] validate_networks() for [('9324045c-e84a-4063-86c3-13924eff78b4', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:49:48.066597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:49:48.068084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:49:48.068843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:49:48.070689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:49:48.071471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:49:48.083979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:48.084463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:48.084892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:48.086064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:48.086714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:48.087342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:48.112243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Getting quotas for project 0c2a7d092bfb409abbaa54af1841ac99. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:49:48.122660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Getting quotas for user 9e7b70f33287409794f79507bd31b81c and project 0c2a7d092bfb409abbaa54af1841ac99. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:49:48.144450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:49:48.147282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:49:48.178380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:INSERT=5 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:48.277969 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-81119e8e-3f2a-4da3-ae78-fba4046319b2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.716017 Sep 08 12:49:48.283103 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1152/2187] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:49:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:49:48.308888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-809066d2-37a3-4e09-bbf3-dc5981d3fb7c req-8d6e68db-e2c5-4f0a-851c-4c3ebe4575cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c50dcd06-1d5d-44ad-b802-4ef07c7bac31", "tag": "09c06616-5ed3-4b3a-86d4-642b9f89e269"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:48.382579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-809066d2-37a3-4e09-bbf3-dc5981d3fb7c req-8d6e68db-e2c5-4f0a-851c-4c3ebe4575cf service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:48.383150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-809066d2-37a3-4e09-bbf3-dc5981d3fb7c req-8d6e68db-e2c5-4f0a-851c-4c3ebe4575cf service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:48.383641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-809066d2-37a3-4e09-bbf3-dc5981d3fb7c req-8d6e68db-e2c5-4f0a-851c-4c3ebe4575cf service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:48.417526 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-809066d2-37a3-4e09-bbf3-dc5981d3fb7c req-8d6e68db-e2c5-4f0a-851c-4c3ebe4575cf service nova] Creating event network-changed:09c06616-5ed3-4b3a-86d4-642b9f89e269 for instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 on n-h1-852084-10 Sep 08 12:49:48.435735 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-809066d2-37a3-4e09-bbf3-dc5981d3fb7c req-8d6e68db-e2c5-4f0a-851c-4c3ebe4575cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147852 Sep 08 12:49:48.439254 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1153/2188] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:48.455036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d9afcfa2-b144-4c55-bf73-8403cd7619aa tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:48.455940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d9afcfa2-b144-4c55-bf73-8403cd7619aa tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:48.464642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9afcfa2-b144-4c55-bf73-8403cd7619aa tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:48.465392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9afcfa2-b144-4c55-bf73-8403cd7619aa tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:48.465839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9afcfa2-b144-4c55-bf73-8403cd7619aa tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:48.466382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9afcfa2-b144-4c55-bf73-8403cd7619aa tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:48.466811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9afcfa2-b144-4c55-bf73-8403cd7619aa tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:48.467670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9afcfa2-b144-4c55-bf73-8403cd7619aa tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:48.749600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Building network info cache for instance {{(pid=128971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 12:49:48.768384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=3,nova_cell1:RELEASE=3,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:48.889249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-d9afcfa2-b144-4c55-bf73-8403cd7619aa tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lazy-loading 'services' on Instance uuid fc2e63e9-502b-4e71-8d22-cb9e9792e8db {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:49:48.970761 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d9afcfa2-b144-4c55-bf73-8403cd7619aa tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1929 microversion: 2.75 time: 0.529215 Sep 08 12:49:48.974707 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1154/2189] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:48 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1929 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:48.994369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0de5fd12-80f7-4d6c-ac37-cd199291b7dd tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3f2da3a0>, body: {"security_group_rule": {"parent_group_id": "ea40ea38-ce28-4de4-ad39-9b5db8240ddb", "ip_protocol": "tcp", "from_port": 262537616, "to_port": 22}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:49.265498 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-0de5fd12-80f7-4d6c-ac37-cd199291b7dd tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] HTTP exception thrown: Invalid port range 262537616:22. Former value cannot be greater than the later Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0de5fd12-80f7-4d6c-ac37-cd199291b7dd tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Request method failure captured: Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 145 Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTb8Ko5dVXO9wNCJCefr56P-Sg4Z7FHdVbv5hRFZXpmfkoAOGtJ5kuPtpsUjecnpyMQ-WudEmMcYMs2z64aLX-v9mn-awO7YI6uqVKqm4wcsinOQiI9otsaxpNYVnhhiuYm-qkZJuOQbR4B9cwrcs7gA5EkAJfh-_8xz-BOiYmuwRw Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: ec985c7670dd47c0ab68614537d32028 Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: {"security_group_rule": {"parent_group_id": "ea40ea38-ce28-4de4-ad39-9b5db8240ddb", "ip_protocol": "tcp", "from_port": 262537616, "to_port": 22}} Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid port range 262537616:22. Former value cannot be greater than the later Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ea40ea38-ce28-4de4-ad39-9b5db8240ddb', 'ip_protocol': 'tcp', 'from_port': 262537616, 'to_port': 22}}} Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 262537616:22. Former value cannot be greater than the later Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 262537616:22. Former value cannot be greater than the later Sep 08 12:49:49.272067 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:49.287176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:49.287176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:49.287176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:49.287176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:49.287176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:49.287176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:49.287176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:49.287176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 262537616:22. Former value cannot be greater than the later Sep 08 12:49:49.287176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:49.287176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0de5fd12-80f7-4d6c-ac37-cd199291b7dd tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Returning 400 to user: Invalid port range 262537616:22. Former value cannot be greater than the later {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:49.287176 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0de5fd12-80f7-4d6c-ac37-cd199291b7dd tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.300830 Sep 08 12:49:49.287176 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1155/2190] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:49:48 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 310 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:49:49.297064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e2d256a-e3b6-4124-8d5b-c34c2b2b0ccc tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:49.297340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3e2d256a-e3b6-4124-8d5b-c34c2b2b0ccc tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:49.308422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e2d256a-e3b6-4124-8d5b-c34c2b2b0ccc tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:49.309034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e2d256a-e3b6-4124-8d5b-c34c2b2b0ccc tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:49.309531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e2d256a-e3b6-4124-8d5b-c34c2b2b0ccc tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:49.310607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e2d256a-e3b6-4124-8d5b-c34c2b2b0ccc tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:49.312172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e2d256a-e3b6-4124-8d5b-c34c2b2b0ccc tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:49.313642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e2d256a-e3b6-4124-8d5b-c34c2b2b0ccc tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:49.353130 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-3e2d256a-e3b6-4124-8d5b-c34c2b2b0ccc tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] HTTP exception thrown: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e2d256a-e3b6-4124-8d5b-c34c2b2b0ccc tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Request method failure captured: Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 HTTP/1.1 Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeS3pK2HPwY-r-rhOMrDQAvhiz_o3SHX5chvz25bxPQ47jd21dpmSIc8_qBje1M-OmInIZvuJmLzjClXbZpRCcNKXGevizWp2PnBMKZgzFJro0m68gfdzeJggdA8qmpJOYWuL2hZkyFYDWJhhxgxEK5_UtM4rq0EikoXGmjxxcMJNgA Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: e6a4501165214cbbaedd633030e68a6b Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '7d1e44cb-d0d1-4c3a-9804-287bfe740bc5'} Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:49:49.357081 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e2d256a-e3b6-4124-8d5b-c34c2b2b0ccc tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Returning 404 to user: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:49.370928 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3e2d256a-e3b6-4124-8d5b-c34c2b2b0ccc tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 404 len: 111 microversion: 2.1 time: 0.081712 Sep 08 12:49:49.373710 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1156/2191] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:49:49 2022] DELETE /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:49:49.385110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eb243972-1840-487b-b00d-a228f7550af6 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:49.386721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eb243972-1840-487b-b00d-a228f7550af6 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:49.402513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb243972-1840-487b-b00d-a228f7550af6 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:49.404822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb243972-1840-487b-b00d-a228f7550af6 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:49.407581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb243972-1840-487b-b00d-a228f7550af6 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:49.409733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb243972-1840-487b-b00d-a228f7550af6 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:49.410942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb243972-1840-487b-b00d-a228f7550af6 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:49.412120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb243972-1840-487b-b00d-a228f7550af6 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:49.896827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eb243972-1840-487b-b00d-a228f7550af6 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a2295e4ec3478fb86588f624650e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6e4f8a7d2b473c875460f24e685ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:49.929864 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eb243972-1840-487b-b00d-a228f7550af6 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 200 len: 1327 microversion: 2.1 time: 0.553215 Sep 08 12:49:49.933932 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1157/2192] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:49 2022] GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 1327 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:49.953583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bb1dfad1-4ebb-40de-bf5c-2e47331f5fcc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:49.958131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bb1dfad1-4ebb-40de-bf5c-2e47331f5fcc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:49.984523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb1dfad1-4ebb-40de-bf5c-2e47331f5fcc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:49.986153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb1dfad1-4ebb-40de-bf5c-2e47331f5fcc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:49.992407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb1dfad1-4ebb-40de-bf5c-2e47331f5fcc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:50.000716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb1dfad1-4ebb-40de-bf5c-2e47331f5fcc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:50.001278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb1dfad1-4ebb-40de-bf5c-2e47331f5fcc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:50.002195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb1dfad1-4ebb-40de-bf5c-2e47331f5fcc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:50.062255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bb1dfad1-4ebb-40de-bf5c-2e47331f5fcc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:49:50.114312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:50.195030 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bb1dfad1-4ebb-40de-bf5c-2e47331f5fcc tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 204 len: 0 microversion: 2.25 time: 0.256543 Sep 08 12:49:50.197228 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1158/2193] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:49:49 2022] DELETE /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 12:49:50.209128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c425c0ca-0b13-4b1b-921f-913144718d89 req-a6cbfc3d-276f-4841-b89d-cb9aa3d6851f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c50dcd06-1d5d-44ad-b802-4ef07c7bac31", "name": "network-vif-deleted", "tag": "09c06616-5ed3-4b3a-86d4-642b9f89e269"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:50.224299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c425c0ca-0b13-4b1b-921f-913144718d89 req-a6cbfc3d-276f-4841-b89d-cb9aa3d6851f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:50.225857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c425c0ca-0b13-4b1b-921f-913144718d89 req-a6cbfc3d-276f-4841-b89d-cb9aa3d6851f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:50.227877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c425c0ca-0b13-4b1b-921f-913144718d89 req-a6cbfc3d-276f-4841-b89d-cb9aa3d6851f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:50.247133 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c425c0ca-0b13-4b1b-921f-913144718d89 req-a6cbfc3d-276f-4841-b89d-cb9aa3d6851f service nova] Creating event network-vif-deleted:09c06616-5ed3-4b3a-86d4-642b9f89e269 for instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 on n-h1-852084-10 Sep 08 12:49:50.254757 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c425c0ca-0b13-4b1b-921f-913144718d89 req-a6cbfc3d-276f-4841-b89d-cb9aa3d6851f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054618 Sep 08 12:49:50.256025 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1159/2194] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:50.263958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9ff7443c-338a-4c4d-9636-c55ef9966523 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:50.265132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9ff7443c-338a-4c4d-9636-c55ef9966523 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:50.274921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ff7443c-338a-4c4d-9636-c55ef9966523 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:50.276424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ff7443c-338a-4c4d-9636-c55ef9966523 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:50.277302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ff7443c-338a-4c4d-9636-c55ef9966523 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:50.278764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ff7443c-338a-4c4d-9636-c55ef9966523 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:50.279360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ff7443c-338a-4c4d-9636-c55ef9966523 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:50.280073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ff7443c-338a-4c4d-9636-c55ef9966523 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:50.419347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9ff7443c-338a-4c4d-9636-c55ef9966523 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:50.431951 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9ff7443c-338a-4c4d-9636-c55ef9966523 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1269 microversion: 2.1 time: 0.173176 Sep 08 12:49:50.432312 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1160/2195] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:50 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1269 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:50.447684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6df62102-2be8-4f61-abdc-1adb60d587d3 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3f1dadc0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1035808391", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:50.450173 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6df62102-2be8-4f61-abdc-1adb60d587d3 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] HTTP exception thrown: Security group id should be uuid Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6df62102-2be8-4f61-abdc-1adb60d587d3 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Request method failure captured: Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 131 Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTb8Ko5dVXO9wNCJCefr56P-Sg4Z7FHdVbv5hRFZXpmfkoAOGtJ5kuPtpsUjecnpyMQ-WudEmMcYMs2z64aLX-v9mn-awO7YI6uqVKqm4wcsinOQiI9otsaxpNYVnhhiuYm-qkZJuOQbR4B9cwrcs7gA5EkAJfh-_8xz-BOiYmuwRw Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: ec985c7670dd47c0ab68614537d32028 Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1035808391", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: exception: Security group id should be uuid Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1035808391', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:50.453006 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:50.457225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Sep 08 12:49:50.457225 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:50.457225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6df62102-2be8-4f61-abdc-1adb60d587d3 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Returning 400 to user: Security group id should be uuid {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:50.457225 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6df62102-2be8-4f61-abdc-1adb60d587d3 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.022221 Sep 08 12:49:50.460323 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1161/2196] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:49:50 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:49:50.466850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5760a310-bc6e-40e0-9799-0ae021447792 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:50.467646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5760a310-bc6e-40e0-9799-0ae021447792 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] [instance: 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:50.477667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5760a310-bc6e-40e0-9799-0ae021447792 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:50.478177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5760a310-bc6e-40e0-9799-0ae021447792 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:50.478910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5760a310-bc6e-40e0-9799-0ae021447792 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:50.479728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5760a310-bc6e-40e0-9799-0ae021447792 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:50.480282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5760a310-bc6e-40e0-9799-0ae021447792 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:50.481094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5760a310-bc6e-40e0-9799-0ae021447792 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:50.517856 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-5760a310-bc6e-40e0-9799-0ae021447792 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] HTTP exception thrown: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5760a310-bc6e-40e0-9799-0ae021447792 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Request method failure captured: Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 HTTP/1.1 Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeS3pK2HPwY-r-rhOMrDQAvhiz_o3SHX5chvz25bxPQ47jd21dpmSIc8_qBje1M-OmInIZvuJmLzjClXbZpRCcNKXGevizWp2PnBMKZgzFJro0m68gfdzeJggdA8qmpJOYWuL2hZkyFYDWJhhxgxEK5_UtM4rq0EikoXGmjxxcMJNgA Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f42c21dc89784818ae3f51b9086771d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f42c21dc89784818ae3f51b9086771d7 Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-87601900 Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: e6a4501165214cbbaedd633030e68a6b Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesNegativeTestJSON-87601900-project Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '7d1e44cb-d0d1-4c3a-9804-287bfe740bc5'} Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:50.520160 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:50.523857 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:50.523857 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:50.523857 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:50.523857 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:50.523857 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:50.523857 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. Sep 08 12:49:50.523857 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:50.523857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5760a310-bc6e-40e0-9799-0ae021447792 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] Returning 404 to user: Instance 7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:50.523857 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5760a310-bc6e-40e0-9799-0ae021447792 tempest-ImagesNegativeTestJSON-87601900 tempest-ImagesNegativeTestJSON-87601900-project] 10.222.0.78 "GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5" status: 404 len: 111 microversion: 2.1 time: 0.060502 Sep 08 12:49:50.523857 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1162/2197] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:50 2022] GET /compute/v2.1/servers/7d1e44cb-d0d1-4c3a-9804-287bfe740bc5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:49:50.528059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-751f4476-f82a-4301-820f-09601725663c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:50.528769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-751f4476-f82a-4301-820f-09601725663c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:50.536681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-751f4476-f82a-4301-820f-09601725663c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:50.537195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-751f4476-f82a-4301-820f-09601725663c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:50.537782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-751f4476-f82a-4301-820f-09601725663c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:50.538527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-751f4476-f82a-4301-820f-09601725663c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:50.538993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-751f4476-f82a-4301-820f-09601725663c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:50.539457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-751f4476-f82a-4301-820f-09601725663c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:50.685812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-751f4476-f82a-4301-820f-09601725663c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lazy-loading 'services' on Instance uuid fc2e63e9-502b-4e71-8d22-cb9e9792e8db {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:49:50.708569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Updating instance_info_cache with network_info: [{"id": "feb64804-e1ff-419a-8a16-60a42fef7a86", "address": "fa:16:3e:5c:e5:d5", "network": {"id": "682d96b1-a973-4824-9a27-17bd1d4dbbfc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2087556098-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "111d6d19644b4164a4e623bc7ea07dbf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfeb64804-e1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 12:49:50.718989 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-751f4476-f82a-4301-820f-09601725663c tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1929 microversion: 2.75 time: 0.194732 Sep 08 12:49:50.720582 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1163/2198] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:50 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1929 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:50.731346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8827f498-55dc-44ba-9dd8-24e404bd9ceb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:50.732452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8827f498-55dc-44ba-9dd8-24e404bd9ceb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:50.744476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Releasing lock "refresh_cache-5bfe69bb-91ad-499f-9f12-de0ac60519b6" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 12:49:50.747334 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f12f3ae6-39b4-45e7-8787-a2f9cf3c3f20 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "POST /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6/action" status: 202 len: 0 microversion: 2.1 time: 6.882387 Sep 08 12:49:50.749667 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1036/2199] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:49:43 2022] POST /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6/action => generated 0 bytes in 6886 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 12:49:50.752493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8827f498-55dc-44ba-9dd8-24e404bd9ceb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:50.754776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8827f498-55dc-44ba-9dd8-24e404bd9ceb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:50.755794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8827f498-55dc-44ba-9dd8-24e404bd9ceb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:50.756825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8827f498-55dc-44ba-9dd8-24e404bd9ceb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:50.757438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8827f498-55dc-44ba-9dd8-24e404bd9ceb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:50.758098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8827f498-55dc-44ba-9dd8-24e404bd9ceb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:50.766046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c9419788-62b7-412c-af75-df254cfbc516 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3b47cd30>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-830521966", "description": "tempest-description-1766737800"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:51.153495 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c9419788-62b7-412c-af75-df254cfbc516 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.401551 Sep 08 12:49:51.154882 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1037/2200] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:49:50 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:51.161065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-fb7c0f63-7c37-4839-91e0-ad73dc0ee31b req-2f1c6a77-0636-4515-b3a6-1f0496ebbdcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6afa649b-c753-458a-9be6-2e4d3fdfb25b", "name": "network-vif-deleted", "tag": "39228a6d-960b-4a1a-a56d-f8eba7c2e0cc"}, {"name": "network-changed", "server_uuid": "5bfe69bb-91ad-499f-9f12-de0ac60519b6", "tag": "feb64804-e1ff-419a-8a16-60a42fef7a86"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:51.173422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8827f498-55dc-44ba-9dd8-24e404bd9ceb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:51.177935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fb7c0f63-7c37-4839-91e0-ad73dc0ee31b req-2f1c6a77-0636-4515-b3a6-1f0496ebbdcc service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:51.179067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fb7c0f63-7c37-4839-91e0-ad73dc0ee31b req-2f1c6a77-0636-4515-b3a6-1f0496ebbdcc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:51.179770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fb7c0f63-7c37-4839-91e0-ad73dc0ee31b req-2f1c6a77-0636-4515-b3a6-1f0496ebbdcc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:51.217751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8827f498-55dc-44ba-9dd8-24e404bd9ceb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:51.221122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8827f498-55dc-44ba-9dd8-24e404bd9ceb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:51.224944 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-fb7c0f63-7c37-4839-91e0-ad73dc0ee31b req-2f1c6a77-0636-4515-b3a6-1f0496ebbdcc service nova] Creating event network-vif-deleted:39228a6d-960b-4a1a-a56d-f8eba7c2e0cc for instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b on n-h2-852084-10 Sep 08 12:49:51.226235 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-fb7c0f63-7c37-4839-91e0-ad73dc0ee31b req-2f1c6a77-0636-4515-b3a6-1f0496ebbdcc service nova] Creating event network-changed:feb64804-e1ff-419a-8a16-60a42fef7a86 for instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 on n-h1-852084-10 Sep 08 12:49:51.228156 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8827f498-55dc-44ba-9dd8-24e404bd9ceb tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1548 microversion: 2.25 time: 0.505735 Sep 08 12:49:51.229793 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1164/2201] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:50 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1548 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:51.236605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f7d28f3c-a277-43b5-bdc6-a37c8ca49d19 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '.version_select at 0x7fdb363fa550>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:51.258214 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-fb7c0f63-7c37-4839-91e0-ad73dc0ee31b req-2f1c6a77-0636-4515-b3a6-1f0496ebbdcc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.101064 Sep 08 12:49:51.264531 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1038/2202] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:51.279558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-49ff07df-7ea9-478e-a1e3-ac35a54f4fe2 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:51.280853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-49ff07df-7ea9-478e-a1e3-ac35a54f4fe2 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:51.292397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ff07df-7ea9-478e-a1e3-ac35a54f4fe2 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:51.293747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ff07df-7ea9-478e-a1e3-ac35a54f4fe2 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:51.294440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ff07df-7ea9-478e-a1e3-ac35a54f4fe2 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:51.295675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ff07df-7ea9-478e-a1e3-ac35a54f4fe2 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:51.296069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ff07df-7ea9-478e-a1e3-ac35a54f4fe2 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:51.296509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49ff07df-7ea9-478e-a1e3-ac35a54f4fe2 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:52.125590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-49ff07df-7ea9-478e-a1e3-ac35a54f4fe2 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a2295e4ec3478fb86588f624650e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6e4f8a7d2b473c875460f24e685ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:52.152703 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-49ff07df-7ea9-478e-a1e3-ac35a54f4fe2 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 200 len: 1327 microversion: 2.1 time: 0.885482 Sep 08 12:49:52.163730 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1039/2203] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:51 2022] GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 1327 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:52.196518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-333b3cd4-71bb-4196-a070-d6312e2e86c0 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3affac10>, body: {"security_group_rule": {"parent_group_id": "a8945ea4-eb95-4e4e-a449-2c06a553f4cc", "ip_protocol": "tempest-999-307619301", "from_port": 22, "to_port": 22}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:52.388585 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-333b3cd4-71bb-4196-a070-d6312e2e86c0 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] HTTP exception thrown: Invalid IP protocol tempest-999-307619301. Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-333b3cd4-71bb-4196-a070-d6312e2e86c0 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Request method failure captured: Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 156 Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeTb8Ko5dVXO9wNCJCefr56P-Sg4Z7FHdVbv5hRFZXpmfkoAOGtJ5kuPtpsUjecnpyMQ-WudEmMcYMs2z64aLX-v9mn-awO7YI6uqVKqm4wcsinOQiI9otsaxpNYVnhhiuYm-qkZJuOQbR4B9cwrcs7gA5EkAJfh-_8xz-BOiYmuwRw Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: ec985c7670dd47c0ab68614537d32028 Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: {"security_group_rule": {"parent_group_id": "a8945ea4-eb95-4e4e-a449-2c06a553f4cc", "ip_protocol": "tempest-999-307619301", "from_port": 22, "to_port": 22}} Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid IP protocol tempest-999-307619301. Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a8945ea4-eb95-4e4e-a449-2c06a553f4cc', 'ip_protocol': 'tempest-999-307619301', 'from_port': 22, 'to_port': 22}}} Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-307619301. Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-307619301. Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:52.393329 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:52.396995 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:52.396995 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:52.396995 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:52.396995 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:52.396995 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:52.396995 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:52.396995 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-307619301. Sep 08 12:49:52.396995 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:49:52.396995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-333b3cd4-71bb-4196-a070-d6312e2e86c0 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Returning 400 to user: Invalid IP protocol tempest-999-307619301. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:52.396995 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-333b3cd4-71bb-4196-a070-d6312e2e86c0 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.229959 Sep 08 12:49:52.396995 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1040/2204] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:49:52 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 232 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:49:52.409723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-996a1183-0559-4b23-aa7c-4deb1ee26379 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:52.410372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-996a1183-0559-4b23-aa7c-4deb1ee26379 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:52.492904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-996a1183-0559-4b23-aa7c-4deb1ee26379 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:52.493796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-996a1183-0559-4b23-aa7c-4deb1ee26379 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:52.494612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-996a1183-0559-4b23-aa7c-4deb1ee26379 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:52.521806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-996a1183-0559-4b23-aa7c-4deb1ee26379 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:52.524189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-996a1183-0559-4b23-aa7c-4deb1ee26379 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:52.527136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-996a1183-0559-4b23-aa7c-4deb1ee26379 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:52.628734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:52.659971 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f7d28f3c-a277-43b5-bdc6-a37c8ca49d19 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/b14e74a9-7636-4b9d-bd74-3b101c54556c" status: 200 len: 184 microversion: 2.1 time: 1.428942 Sep 08 12:49:52.669927 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1165/2205] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:49:51 2022] GET /compute/v2.1/os-floating-ips/b14e74a9-7636-4b9d-bd74-3b101c54556c => generated 184 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:52.671791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:52.677839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7da5fe1a-e809-45c4-b1cb-beec7bfff7c3 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:52.678755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7da5fe1a-e809-45c4-b1cb-beec7bfff7c3 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:52.705367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7da5fe1a-e809-45c4-b1cb-beec7bfff7c3 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:52.706422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7da5fe1a-e809-45c4-b1cb-beec7bfff7c3 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:52.707623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7da5fe1a-e809-45c4-b1cb-beec7bfff7c3 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:52.709461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7da5fe1a-e809-45c4-b1cb-beec7bfff7c3 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:52.710645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7da5fe1a-e809-45c4-b1cb-beec7bfff7c3 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:52.711929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7da5fe1a-e809-45c4-b1cb-beec7bfff7c3 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:52.768252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-996a1183-0559-4b23-aa7c-4deb1ee26379 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:52.796248 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-996a1183-0559-4b23-aa7c-4deb1ee26379 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1275 microversion: 2.1 time: 0.397711 Sep 08 12:49:52.801949 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1041/2206] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:52 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1275 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:52.813172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7aef8735-0980-427d-822f-8d30d317feff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:52.814626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7aef8735-0980-427d-822f-8d30d317feff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:52.828793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aef8735-0980-427d-822f-8d30d317feff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:52.836639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aef8735-0980-427d-822f-8d30d317feff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:52.837903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aef8735-0980-427d-822f-8d30d317feff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:52.840153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aef8735-0980-427d-822f-8d30d317feff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:52.841323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aef8735-0980-427d-822f-8d30d317feff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:52.843268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aef8735-0980-427d-822f-8d30d317feff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:52.903541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-7da5fe1a-e809-45c4-b1cb-beec7bfff7c3 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lazy-loading 'services' on Instance uuid fc2e63e9-502b-4e71-8d22-cb9e9792e8db {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:49:52.933884 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7da5fe1a-e809-45c4-b1cb-beec7bfff7c3 tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1935 microversion: 2.75 time: 0.262013 Sep 08 12:49:52.935256 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1166/2207] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:52 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1935 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:52.943445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b2de975c-7ac5-4672-94f7-463d8e64d004 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3f29e9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-465932389", "description": "tempest-description-1491127407"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:53.429859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7aef8735-0980-427d-822f-8d30d317feff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:53.451911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7aef8735-0980-427d-822f-8d30d317feff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:53.455070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7aef8735-0980-427d-822f-8d30d317feff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:53.457755 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7aef8735-0980-427d-822f-8d30d317feff tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 200 len: 1548 microversion: 2.25 time: 0.653576 Sep 08 12:49:53.458763 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1042/2208] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:52 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 1548 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:53.465547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.112"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:53.895748 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b2de975c-7ac5-4672-94f7-463d8e64d004 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.956233 Sep 08 12:49:53.897602 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1167/2209] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:49:52 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:53.905944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a9a89796-d9b3-4256-96c3-c6a90f98e59d req-4fa2b458-cde0-4ad5-82ea-53f37df7d301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bea1ac03-81e8-4d96-b385-2f7286ab0292", "tag": "88e3afe8-358b-4fc1-8612-e67dde20f1fd"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:53.965866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a9a89796-d9b3-4256-96c3-c6a90f98e59d req-4fa2b458-cde0-4ad5-82ea-53f37df7d301 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:53.966985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a9a89796-d9b3-4256-96c3-c6a90f98e59d req-4fa2b458-cde0-4ad5-82ea-53f37df7d301 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:53.973189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a9a89796-d9b3-4256-96c3-c6a90f98e59d req-4fa2b458-cde0-4ad5-82ea-53f37df7d301 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:54.027648 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a9a89796-d9b3-4256-96c3-c6a90f98e59d req-4fa2b458-cde0-4ad5-82ea-53f37df7d301 service nova] Creating event network-changed:88e3afe8-358b-4fc1-8612-e67dde20f1fd for instance bea1ac03-81e8-4d96-b385-2f7286ab0292 on n-h1-852084-10 Sep 08 12:49:54.050509 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a9a89796-d9b3-4256-96c3-c6a90f98e59d req-4fa2b458-cde0-4ad5-82ea-53f37df7d301 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146842 Sep 08 12:49:54.059079 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1168/2210] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:54.088050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8c758ec1-93cb-47e3-b58c-986470d61427 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:54.090360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8c758ec1-93cb-47e3-b58c-986470d61427 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:54.145778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c758ec1-93cb-47e3-b58c-986470d61427 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:54.146982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c758ec1-93cb-47e3-b58c-986470d61427 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:54.155705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c758ec1-93cb-47e3-b58c-986470d61427 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:54.157264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c758ec1-93cb-47e3-b58c-986470d61427 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:54.158111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c758ec1-93cb-47e3-b58c-986470d61427 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:54.161828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c758ec1-93cb-47e3-b58c-986470d61427 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:54.390627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:54.405592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:54.408732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:54.409622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:54.413375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:54.414114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:54.417285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:55.032251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8c758ec1-93cb-47e3-b58c-986470d61427 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a2295e4ec3478fb86588f624650e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6e4f8a7d2b473c875460f24e685ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:55.088212 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8c758ec1-93cb-47e3-b58c-986470d61427 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 200 len: 1327 microversion: 2.1 time: 1.022342 Sep 08 12:49:55.104492 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1169/2211] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:54 2022] GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 1327 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:55.155615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-82dea9d5-6eeb-4d55-b5f9-a2ba255000e3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:55.157878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-82dea9d5-6eeb-4d55-b5f9-a2ba255000e3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:55.184902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82dea9d5-6eeb-4d55-b5f9-a2ba255000e3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:55.187704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82dea9d5-6eeb-4d55-b5f9-a2ba255000e3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:55.191665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82dea9d5-6eeb-4d55-b5f9-a2ba255000e3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:55.193720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82dea9d5-6eeb-4d55-b5f9-a2ba255000e3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:55.198524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82dea9d5-6eeb-4d55-b5f9-a2ba255000e3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:55.199892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82dea9d5-6eeb-4d55-b5f9-a2ba255000e3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:55.648480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-82dea9d5-6eeb-4d55-b5f9-a2ba255000e3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:55.664120 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-82dea9d5-6eeb-4d55-b5f9-a2ba255000e3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1275 microversion: 2.1 time: 0.557083 Sep 08 12:49:55.681101 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1170/2212] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:55 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1275 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:55.708810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6009b3d2-7579-4a31-8092-126a5e9e76c9 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3f165040>, body: {"security_group_rule": {"parent_group_id": "c5901e28-d6fd-4620-b52f-562b67c3f2aa", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:55.838817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "refresh_cache-5bfe69bb-91ad-499f-9f12-de0ac60519b6" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 12:49:55.839820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquired lock "refresh_cache-5bfe69bb-91ad-499f-9f12-de0ac60519b6" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 12:49:55.964142 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6009b3d2-7579-4a31-8092-126a5e9e76c9 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6009b3d2-7579-4a31-8092-126a5e9e76c9 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Request method failure captured: Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 138 Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTb8Ko5dVXO9wNCJCefr56P-Sg4Z7FHdVbv5hRFZXpmfkoAOGtJ5kuPtpsUjecnpyMQ-WudEmMcYMs2z64aLX-v9mn-awO7YI6uqVKqm4wcsinOQiI9otsaxpNYVnhhiuYm-qkZJuOQbR4B9cwrcs7gA5EkAJfh-_8xz-BOiYmuwRw Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: ec985c7670dd47c0ab68614537d32028 Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: {"security_group_rule": {"parent_group_id": "c5901e28-d6fd-4620-b52f-562b67c3f2aa", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'c5901e28-d6fd-4620-b52f-562b67c3f2aa', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 12:49:55.965820 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:55.974337 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:55.974337 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:55.974337 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:55.974337 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:55.974337 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:55.974337 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:55.974337 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:55.974337 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Sep 08 12:49:55.974337 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:55.974337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6009b3d2-7579-4a31-8092-126a5e9e76c9 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:55.974337 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6009b3d2-7579-4a31-8092-126a5e9e76c9 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.284341 Sep 08 12:49:55.974337 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1171/2213] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:49:55 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 287 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:49:55.979542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bd0d5a67-dd9f-44fd-989b-b327ff10c0fb tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:55.981606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bd0d5a67-dd9f-44fd-989b-b327ff10c0fb tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:56.000811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd0d5a67-dd9f-44fd-989b-b327ff10c0fb tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:56.001410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd0d5a67-dd9f-44fd-989b-b327ff10c0fb tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:56.001912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd0d5a67-dd9f-44fd-989b-b327ff10c0fb tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:56.002667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd0d5a67-dd9f-44fd-989b-b327ff10c0fb tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:56.007506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd0d5a67-dd9f-44fd-989b-b327ff10c0fb tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:56.014536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd0d5a67-dd9f-44fd-989b-b327ff10c0fb tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:56.312358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-bd0d5a67-dd9f-44fd-989b-b327ff10c0fb tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] Lazy-loading 'services' on Instance uuid fc2e63e9-502b-4e71-8d22-cb9e9792e8db {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:49:56.359169 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bd0d5a67-dd9f-44fd-989b-b327ff10c0fb tempest-ServersAdmin275Test-1275453428 tempest-ServersAdmin275Test-1275453428-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1920 microversion: 2.75 time: 0.388237 Sep 08 12:49:56.363678 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1172/2214] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:55 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1920 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:49:56.369203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-8330e983-2a46-468d-a463-1455fbb4b383 req-5aa675b2-815c-446b-8772-6a9448a6a878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c71e5bb7-a289-4944-926a-bee8b5bfe8ee", "name": "network-vif-deleted", "tag": "5d38cff6-9d90-48f1-9f72-666a7a5acdc6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:56.388724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8330e983-2a46-468d-a463-1455fbb4b383 req-5aa675b2-815c-446b-8772-6a9448a6a878 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:56.389466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8330e983-2a46-468d-a463-1455fbb4b383 req-5aa675b2-815c-446b-8772-6a9448a6a878 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:56.390200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8330e983-2a46-468d-a463-1455fbb4b383 req-5aa675b2-815c-446b-8772-6a9448a6a878 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:56.418462 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-8330e983-2a46-468d-a463-1455fbb4b383 req-5aa675b2-815c-446b-8772-6a9448a6a878 service nova] Creating event network-vif-deleted:5d38cff6-9d90-48f1-9f72-666a7a5acdc6 for instance c71e5bb7-a289-4944-926a-bee8b5bfe8ee on n-h2-852084-10 Sep 08 12:49:56.433106 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-8330e983-2a46-468d-a463-1455fbb4b383 req-5aa675b2-815c-446b-8772-6a9448a6a878 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069692 Sep 08 12:49:56.436468 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1173/2215] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:56.453884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0b8a18f0-6c57-4715-b7f1-4f21498ad7f0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:56.455459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0b8a18f0-6c57-4715-b7f1-4f21498ad7f0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: c71e5bb7-a289-4944-926a-bee8b5bfe8ee] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:56.467918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b8a18f0-6c57-4715-b7f1-4f21498ad7f0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:56.468817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b8a18f0-6c57-4715-b7f1-4f21498ad7f0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:56.470173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b8a18f0-6c57-4715-b7f1-4f21498ad7f0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:56.471582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b8a18f0-6c57-4715-b7f1-4f21498ad7f0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:56.472450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b8a18f0-6c57-4715-b7f1-4f21498ad7f0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:56.473349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b8a18f0-6c57-4715-b7f1-4f21498ad7f0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:56.502687 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-0b8a18f0-6c57-4715-b7f1-4f21498ad7f0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] HTTP exception thrown: Instance c71e5bb7-a289-4944-926a-bee8b5bfe8ee could not be found. Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0b8a18f0-6c57-4715-b7f1-4f21498ad7f0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Request method failure captured: Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee HTTP/1.1 Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeKxlpY1IbMyY5ZD8fhRJghwJHCqOAVJje9hTMCM6IyWpGbpVObcW8c1FqdL9mzvGHFLBpowN2NwMRcmp3G51ZYgQaV6YWezrqMNPxYd2W1oO67pJzCz7PUPEpLwIxcBuVLVsXQnXuWWdnFig4aff_iccKQRdBSMdPG4-ZDyiw3o_gM Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.25 Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: df5a27766c1942a8be6a78466f7e7192 Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-910002977 Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-910002977 Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: df5a27766c1942a8be6a78466f7e7192 Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-910002977 Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-LiveAutoBlockMigrationV225Test-910002977-project Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 8af088dfb51e4f729cc97fc91699a55f Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-910002977-project Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance c71e5bb7-a289-4944-926a-bee8b5bfe8ee could not be found. Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c71e5bb7-a289-4944-926a-bee8b5bfe8ee'} Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c71e5bb7-a289-4944-926a-bee8b5bfe8ee could not be found. Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c71e5bb7-a289-4944-926a-bee8b5bfe8ee could not be found. Sep 08 12:49:56.506151 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c71e5bb7-a289-4944-926a-bee8b5bfe8ee could not be found. Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0b8a18f0-6c57-4715-b7f1-4f21498ad7f0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Returning 404 to user: Instance c71e5bb7-a289-4944-926a-bee8b5bfe8ee could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0b8a18f0-6c57-4715-b7f1-4f21498ad7f0 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee" status: 404 len: 111 microversion: 2.25 time: 0.068674 Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1174/2216] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:49:56 2022] GET /compute/v2.1/servers/c71e5bb7-a289-4944-926a-bee8b5bfe8ee => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:49:56.522393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a3821540-cd1d-4780-99f3-547959ace544 req-14c3ad91-9edf-4437-bdfa-e73835703044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea1ac03-81e8-4d96-b385-2f7286ab0292", "name": "network-vif-plugged", "status": "completed", "tag": "88e3afe8-358b-4fc1-8612-e67dde20f1fd"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:56.538665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a3821540-cd1d-4780-99f3-547959ace544 req-14c3ad91-9edf-4437-bdfa-e73835703044 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:56.539585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a3821540-cd1d-4780-99f3-547959ace544 req-14c3ad91-9edf-4437-bdfa-e73835703044 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:56.540410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a3821540-cd1d-4780-99f3-547959ace544 req-14c3ad91-9edf-4437-bdfa-e73835703044 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:56.568947 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a3821540-cd1d-4780-99f3-547959ace544 req-14c3ad91-9edf-4437-bdfa-e73835703044 service nova] Creating event network-vif-plugged:88e3afe8-358b-4fc1-8612-e67dde20f1fd for instance bea1ac03-81e8-4d96-b385-2f7286ab0292 on n-h1-852084-10 Sep 08 12:49:56.577972 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a3821540-cd1d-4780-99f3-547959ace544 req-14c3ad91-9edf-4437-bdfa-e73835703044 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065101 Sep 08 12:49:56.579619 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1175/2217] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:49:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:56.590067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-080d8072-4c19-4226-812e-147b47d417c9 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3f1a5ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1861107068", "description": "tempest-description-1264164668"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:49:57.882290 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-080d8072-4c19-4226-812e-147b47d417c9 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.300456 Sep 08 12:49:57.883338 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1176/2218] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:49:56 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:49:57.889351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-87c302fb-a507-4f99-94ae-81290b39e552 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:57.890195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-87c302fb-a507-4f99-94ae-81290b39e552 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:57.909947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87c302fb-a507-4f99-94ae-81290b39e552 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:57.910834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87c302fb-a507-4f99-94ae-81290b39e552 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:57.915813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87c302fb-a507-4f99-94ae-81290b39e552 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:57.917647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87c302fb-a507-4f99-94ae-81290b39e552 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:57.920917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87c302fb-a507-4f99-94ae-81290b39e552 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:57.925272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87c302fb-a507-4f99-94ae-81290b39e552 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:58.100389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:58.141839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=11 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:58.695798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-87c302fb-a507-4f99-94ae-81290b39e552 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a2295e4ec3478fb86588f624650e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6e4f8a7d2b473c875460f24e685ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:49:58.741487 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-87c302fb-a507-4f99-94ae-81290b39e552 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 200 len: 1327 microversion: 2.1 time: 0.855078 Sep 08 12:49:58.748362 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1177/2219] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:57 2022] GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 1327 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:49:58.760826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a3b6835c-e4a8-4e56-937a-29b314b955ea tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:58.765155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a3b6835c-e4a8-4e56-937a-29b314b955ea tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:58.793638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b6835c-e4a8-4e56-937a-29b314b955ea tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:58.795326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b6835c-e4a8-4e56-937a-29b314b955ea tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:58.796523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b6835c-e4a8-4e56-937a-29b314b955ea tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:58.798882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b6835c-e4a8-4e56-937a-29b314b955ea tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:58.800148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b6835c-e4a8-4e56-937a-29b314b955ea tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:58.801318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b6835c-e4a8-4e56-937a-29b314b955ea tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:58.894069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Building network info cache for instance {{(pid=128971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 12:49:58.911277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a3b6835c-e4a8-4e56-937a-29b314b955ea tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:49:59.209281 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a3b6835c-e4a8-4e56-937a-29b314b955ea tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 204 len: 0 microversion: 2.75 time: 0.458024 Sep 08 12:49:59.224532 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1178/2220] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:49:58 2022] DELETE /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 12:49:59.236541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e4a4f19-74c4-4aa6-bb90-d872aeeee602 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:59.244996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e4a4f19-74c4-4aa6-bb90-d872aeeee602 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:59.277865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e4a4f19-74c4-4aa6-bb90-d872aeeee602 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:59.278753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e4a4f19-74c4-4aa6-bb90-d872aeeee602 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:59.279631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e4a4f19-74c4-4aa6-bb90-d872aeeee602 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:59.282168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e4a4f19-74c4-4aa6-bb90-d872aeeee602 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:59.289400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e4a4f19-74c4-4aa6-bb90-d872aeeee602 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:59.291983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e4a4f19-74c4-4aa6-bb90-d872aeeee602 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:59.398857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e4a4f19-74c4-4aa6-bb90-d872aeeee602 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:49:59.626695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:49:59.741087 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e4a4f19-74c4-4aa6-bb90-d872aeeee602 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "DELETE /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 204 len: 0 microversion: 2.25 time: 0.512497 Sep 08 12:49:59.742366 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1179/2221] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 12:49:59 2022] DELETE /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 12:49:59.758101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4afc297-1786-466a-9aeb-27e3f4a2e217 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:49:59.761369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e4afc297-1786-466a-9aeb-27e3f4a2e217 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:49:59.774508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4afc297-1786-466a-9aeb-27e3f4a2e217 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:59.779194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4afc297-1786-466a-9aeb-27e3f4a2e217 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:59.780201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4afc297-1786-466a-9aeb-27e3f4a2e217 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:49:59.783626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4afc297-1786-466a-9aeb-27e3f4a2e217 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:49:59.784462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4afc297-1786-466a-9aeb-27e3f4a2e217 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:49:59.796783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4afc297-1786-466a-9aeb-27e3f4a2e217 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:00.567276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e4afc297-1786-466a-9aeb-27e3f4a2e217 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:00.588019 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e4afc297-1786-466a-9aeb-27e3f4a2e217 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1317 microversion: 2.1 time: 0.842111 Sep 08 12:50:00.590034 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1180/2222] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:49:59 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1317 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:00.599685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a97327f1-e474-4377-9d80-1d53192706e7 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3f198670>, body: {"security_group_rule": {"parent_group_id": "478b691e-97e0-4cb9-84e7-356d09e374ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 218134849}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:00.946439 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-a97327f1-e474-4377-9d80-1d53192706e7 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] HTTP exception thrown: Invalid port range 22:218134849. Valid TCP ports should be between 1-65535 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a97327f1-e474-4377-9d80-1d53192706e7 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Request method failure captured: Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 145 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTb8Ko5dVXO9wNCJCefr56P-Sg4Z7FHdVbv5hRFZXpmfkoAOGtJ5kuPtpsUjecnpyMQ-WudEmMcYMs2z64aLX-v9mn-awO7YI6uqVKqm4wcsinOQiI9otsaxpNYVnhhiuYm-qkZJuOQbR4B9cwrcs7gA5EkAJfh-_8xz-BOiYmuwRw Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: ec985c7670dd47c0ab68614537d32028 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: {"security_group_rule": {"parent_group_id": "478b691e-97e0-4cb9-84e7-356d09e374ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 218134849}} Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid port range 22:218134849. Valid TCP ports should be between 1-65535 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'security_group_rule': {'parent_group_id': '478b691e-97e0-4cb9-84e7-356d09e374ac', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 218134849}}} Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:218134849. Valid TCP ports should be between 1-65535 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:218134849. Valid TCP ports should be between 1-65535 Sep 08 12:50:00.948533 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:00.953784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:00.953784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:00.953784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:00.953784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:00.953784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:00.953784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:00.953784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:00.953784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:218134849. Valid TCP ports should be between 1-65535 Sep 08 12:50:00.953784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:00.955778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a97327f1-e474-4377-9d80-1d53192706e7 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Returning 400 to user: Invalid port range 22:218134849. Valid TCP ports should be between 1-65535 {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:00.956905 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a97327f1-e474-4377-9d80-1d53192706e7 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 118 microversion: 2.1 time: 0.364901 Sep 08 12:50:00.958292 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1181/2223] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:50:00 2022] POST /compute/v2.1/os-security-group-rules => generated 118 bytes in 367 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:50:00.965756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d9cb5388-69ea-4b92-9486-5a8528a51d9a req-d9d918c2-a112-411b-8b31-c5ceb993d04a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfe69bb-91ad-499f-9f12-de0ac60519b6", "tag": "feb64804-e1ff-419a-8a16-60a42fef7a86"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:00.978381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d9cb5388-69ea-4b92-9486-5a8528a51d9a req-d9d918c2-a112-411b-8b31-c5ceb993d04a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:00.979198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d9cb5388-69ea-4b92-9486-5a8528a51d9a req-d9d918c2-a112-411b-8b31-c5ceb993d04a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:00.980035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d9cb5388-69ea-4b92-9486-5a8528a51d9a req-d9d918c2-a112-411b-8b31-c5ceb993d04a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:01.011105 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d9cb5388-69ea-4b92-9486-5a8528a51d9a req-d9d918c2-a112-411b-8b31-c5ceb993d04a service nova] Creating event network-changed:feb64804-e1ff-419a-8a16-60a42fef7a86 for instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 on n-h1-852084-10 Sep 08 12:50:01.028054 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d9cb5388-69ea-4b92-9486-5a8528a51d9a req-d9d918c2-a112-411b-8b31-c5ceb993d04a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067818 Sep 08 12:50:01.031207 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1182/2224] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:01.051724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ff0bee12-d2cb-4784-a5e1-3c2ca3907f2b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:01.052661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff0bee12-d2cb-4784-a5e1-3c2ca3907f2b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:01.083840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff0bee12-d2cb-4784-a5e1-3c2ca3907f2b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:01.084901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff0bee12-d2cb-4784-a5e1-3c2ca3907f2b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:01.085738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff0bee12-d2cb-4784-a5e1-3c2ca3907f2b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:01.087118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff0bee12-d2cb-4784-a5e1-3c2ca3907f2b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:01.088014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff0bee12-d2cb-4784-a5e1-3c2ca3907f2b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:01.088804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff0bee12-d2cb-4784-a5e1-3c2ca3907f2b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:01.189709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Updating instance_info_cache with network_info: [{"id": "feb64804-e1ff-419a-8a16-60a42fef7a86", "address": "fa:16:3e:5c:e5:d5", "network": {"id": "682d96b1-a973-4824-9a27-17bd1d4dbbfc", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-2087556098-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "111d6d19644b4164a4e623bc7ea07dbf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfeb64804-e1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 12:50:01.229900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Releasing lock "refresh_cache-5bfe69bb-91ad-499f-9f12-de0ac60519b6" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 12:50:01.232980 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0583c7de-6874-4338-a0fa-ecf6954e2485 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "POST /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6/action" status: 202 len: 0 microversion: 2.1 time: 7.770852 Sep 08 12:50:01.235521 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1043/2225] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:49:53 2022] POST /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6/action => generated 0 bytes in 7775 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 12:50:01.246768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6470fa9e-b620-4f15-8918-c20a7b531845 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:01.248228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6470fa9e-b620-4f15-8918-c20a7b531845 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:01.263440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6470fa9e-b620-4f15-8918-c20a7b531845 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:01.264536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6470fa9e-b620-4f15-8918-c20a7b531845 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:01.265481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6470fa9e-b620-4f15-8918-c20a7b531845 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:01.267676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6470fa9e-b620-4f15-8918-c20a7b531845 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:01.268450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6470fa9e-b620-4f15-8918-c20a7b531845 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:01.269383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6470fa9e-b620-4f15-8918-c20a7b531845 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:01.310062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ff0bee12-d2cb-4784-a5e1-3c2ca3907f2b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:01.356516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ff0bee12-d2cb-4784-a5e1-3c2ca3907f2b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:01.361440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ff0bee12-d2cb-4784-a5e1-3c2ca3907f2b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d3bdb8a171c435aa2f008e767324543', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ccd022b4a3402a8f20565df6b160e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:01.375861 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ff0bee12-d2cb-4784-a5e1-3c2ca3907f2b tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 200 len: 1443 microversion: 2.75 time: 0.341053 Sep 08 12:50:01.405090 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1183/2226] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:50:01 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 1443 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:50:01.417618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f8273e33-fd0c-4b1c-9840-e3ca3f76967b tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:01.419473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f8273e33-fd0c-4b1c-9840-e3ca3f76967b tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:01.429179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8273e33-fd0c-4b1c-9840-e3ca3f76967b tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:01.430413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8273e33-fd0c-4b1c-9840-e3ca3f76967b tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:01.431964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8273e33-fd0c-4b1c-9840-e3ca3f76967b tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:01.438514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8273e33-fd0c-4b1c-9840-e3ca3f76967b tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:01.439458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8273e33-fd0c-4b1c-9840-e3ca3f76967b tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:01.440331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8273e33-fd0c-4b1c-9840-e3ca3f76967b tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:02.245504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f8273e33-fd0c-4b1c-9840-e3ca3f76967b tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a2295e4ec3478fb86588f624650e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6e4f8a7d2b473c875460f24e685ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:02.291473 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f8273e33-fd0c-4b1c-9840-e3ca3f76967b tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 200 len: 1527 microversion: 2.1 time: 0.884216 Sep 08 12:50:02.296151 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1184/2227] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:01 2022] GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 1527 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:02.305752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-77bb5aa4-1ea7-454d-b981-1a292d767ae9 req-7ddcfba0-2c6c-4f8d-952f-e27f9b9df680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0aac929c-34e0-46b4-b2ed-be01e53a5b48", "tag": "ef87dc69-90b0-4619-9709-b2f42201a6ac"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:02.309140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6470fa9e-b620-4f15-8918-c20a7b531845 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:02.342578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-77bb5aa4-1ea7-454d-b981-1a292d767ae9 req-7ddcfba0-2c6c-4f8d-952f-e27f9b9df680 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:02.343595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-77bb5aa4-1ea7-454d-b981-1a292d767ae9 req-7ddcfba0-2c6c-4f8d-952f-e27f9b9df680 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:02.346798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6470fa9e-b620-4f15-8918-c20a7b531845 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:02.347568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-77bb5aa4-1ea7-454d-b981-1a292d767ae9 req-7ddcfba0-2c6c-4f8d-952f-e27f9b9df680 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:02.354168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6470fa9e-b620-4f15-8918-c20a7b531845 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:02.361615 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6470fa9e-b620-4f15-8918-c20a7b531845 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1563 microversion: 2.25 time: 1.123987 Sep 08 12:50:02.364093 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1044/2228] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:50:01 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1563 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:50:02.387619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f88661f-6b78-4532-8717-1bae219a07ab tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Action: 'create', calling method: .version_select at 0x7fdb3ae09430>, body: {"security_group_rule": {"parent_group_id": "510d77a9-ae48-4db1-8130-d1d60f0b19e1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:02.399672 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-77bb5aa4-1ea7-454d-b981-1a292d767ae9 req-7ddcfba0-2c6c-4f8d-952f-e27f9b9df680 service nova] Creating event network-changed:ef87dc69-90b0-4619-9709-b2f42201a6ac for instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 on n-h1-852084-10 Sep 08 12:50:02.431646 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-77bb5aa4-1ea7-454d-b981-1a292d767ae9 req-7ddcfba0-2c6c-4f8d-952f-e27f9b9df680 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132106 Sep 08 12:50:02.433746 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1185/2229] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:02.445584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c23c758-a834-4ac8-9174-99a8749a30bc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:02.447104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6c23c758-a834-4ac8-9174-99a8749a30bc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:02.461810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c23c758-a834-4ac8-9174-99a8749a30bc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:02.463215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c23c758-a834-4ac8-9174-99a8749a30bc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:02.464883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c23c758-a834-4ac8-9174-99a8749a30bc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:02.468320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG neutronclient.v2_0.client [None req-2f88661f-6b78-4532-8717-1bae219a07ab tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 510d77a9-ae48-4db1-8130-d1d60f0b19e1 does not exist", "detail": ""}} {{(pid=128971) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:50:02.469934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.security_group_api [None req-2f88661f-6b78-4532-8717-1bae219a07ab tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Neutron security group 510d77a9-ae48-4db1-8130-d1d60f0b19e1 not found {{(pid=128971) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:50:02.471267 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-2f88661f-6b78-4532-8717-1bae219a07ab tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] HTTP exception thrown: Security group 510d77a9-ae48-4db1-8130-d1d60f0b19e1 does not exist Sep 08 12:50:02.471267 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-ade4614d-dccc-4c96-af99-3ac6d3ed9724'] Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f88661f-6b78-4532-8717-1bae219a07ab tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Request method failure captured: Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 138 Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeTb8Ko5dVXO9wNCJCefr56P-Sg4Z7FHdVbv5hRFZXpmfkoAOGtJ5kuPtpsUjecnpyMQ-WudEmMcYMs2z64aLX-v9mn-awO7YI6uqVKqm4wcsinOQiI9otsaxpNYVnhhiuYm-qkZJuOQbR4B9cwrcs7gA5EkAJfh-_8xz-BOiYmuwRw Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: ec985c7670dd47c0ab68614537d32028 Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: {"security_group_rule": {"parent_group_id": "510d77a9-ae48-4db1-8130-d1d60f0b19e1", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: exception: Security group 510d77a9-ae48-4db1-8130-d1d60f0b19e1 does not exist Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-ade4614d-dccc-4c96-af99-3ac6d3ed9724'] Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'security_group_rule': {'parent_group_id': '510d77a9-ae48-4db1-8130-d1d60f0b19e1', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:50:02.475718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 510d77a9-ae48-4db1-8130-d1d60f0b19e1 does not exist Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ade4614d-dccc-4c96-af99-3ac6d3ed9724'] Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 510d77a9-ae48-4db1-8130-d1d60f0b19e1 does not exist Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ade4614d-dccc-4c96-af99-3ac6d3ed9724'] Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 510d77a9-ae48-4db1-8130-d1d60f0b19e1 does not exist Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ade4614d-dccc-4c96-af99-3ac6d3ed9724'] Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 510d77a9-ae48-4db1-8130-d1d60f0b19e1 does not exist Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ade4614d-dccc-4c96-af99-3ac6d3ed9724'] Sep 08 12:50:02.482943 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:02.495358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f88661f-6b78-4532-8717-1bae219a07ab tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Returning 404 to user: Security group 510d77a9-ae48-4db1-8130-d1d60f0b19e1 does not exist Sep 08 12:50:02.495358 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-ade4614d-dccc-4c96-af99-3ac6d3ed9724'] {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:02.500919 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f88661f-6b78-4532-8717-1bae219a07ab tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.124765 Sep 08 12:50:02.501153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c23c758-a834-4ac8-9174-99a8749a30bc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:02.501153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c23c758-a834-4ac8-9174-99a8749a30bc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:02.501153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c23c758-a834-4ac8-9174-99a8749a30bc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:02.503212 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1045/2230] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:50:02 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:50:02.516010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a32838b8-15db-4eec-8567-a5e03bd8b0d1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:02.520335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a32838b8-15db-4eec-8567-a5e03bd8b0d1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:02.523659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:02.533636 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6c23c758-a834-4ac8-9174-99a8749a30bc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] HTTP exception thrown: Instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 could not be found. Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c23c758-a834-4ac8-9174-99a8749a30bc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Request method failure captured: Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 HTTP/1.1 Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeR1IXHSCL4T_0-k4BIFUTBsP8L3-cxGhkRdZjYdL1efvbPk_5tuUjqAxn27exlNZA8RamhG6s4cSkXHYOtsX1gxo77O5Q9NAzb0SUDVLx46NtAGBI0X85vzGWd8U6RD7aw9xs9h16EM8AStuAXdNwqpKkE2d9wddOL2QQlqEeASvtg Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 111d6d19644b4164a4e623bc7ea07dbf Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1499655394 Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1499655394 Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 111d6d19644b4164a4e623bc7ea07dbf Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1499655394 Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-FloatingIPsAssociationTestJSON-1499655394-project Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d728c4e964f44edf9f8c5114032a4fbb Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1499655394-project Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 could not be found. Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c50dcd06-1d5d-44ad-b802-4ef07c7bac31'} Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 could not be found. Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:50:02.537509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:50:02.544876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 could not be found. Sep 08 12:50:02.544876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:02.544876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:02.544876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:02.544876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:02.544876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:02.544876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:02.544876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:02.544876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:02.544876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 could not be found. Sep 08 12:50:02.544876 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:02.546062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a32838b8-15db-4eec-8567-a5e03bd8b0d1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:02.546062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a32838b8-15db-4eec-8567-a5e03bd8b0d1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:02.546062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a32838b8-15db-4eec-8567-a5e03bd8b0d1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:02.549257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c23c758-a834-4ac8-9174-99a8749a30bc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Returning 404 to user: Instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:02.549544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a32838b8-15db-4eec-8567-a5e03bd8b0d1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:02.551641 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6c23c758-a834-4ac8-9174-99a8749a30bc tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 404 len: 111 microversion: 2.1 time: 0.114984 Sep 08 12:50:02.552467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a32838b8-15db-4eec-8567-a5e03bd8b0d1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:02.555850 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1186/2231] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:50:02 2022] DELETE /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:50:02.556999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a32838b8-15db-4eec-8567-a5e03bd8b0d1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:02.562308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-19f797b0-4c76-47af-bf36-f74bcb5cc478 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:02.564572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-19f797b0-4c76-47af-bf36-f74bcb5cc478 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:02.579986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19f797b0-4c76-47af-bf36-f74bcb5cc478 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:02.580961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19f797b0-4c76-47af-bf36-f74bcb5cc478 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:02.581770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19f797b0-4c76-47af-bf36-f74bcb5cc478 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:02.583249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19f797b0-4c76-47af-bf36-f74bcb5cc478 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:02.588650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19f797b0-4c76-47af-bf36-f74bcb5cc478 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:02.596530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19f797b0-4c76-47af-bf36-f74bcb5cc478 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:03.810671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a32838b8-15db-4eec-8567-a5e03bd8b0d1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:03.839646 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a32838b8-15db-4eec-8567-a5e03bd8b0d1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1317 microversion: 2.1 time: 1.333537 Sep 08 12:50:03.841739 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1046/2232] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:02 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1317 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:03.853884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1421caea-b154-4253-a4da-e0aab903ef06 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:03.855375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1421caea-b154-4253-a4da-e0aab903ef06 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] [instance: fc2e63e9-502b-4e71-8d22-cb9e9792e8db] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:03.878251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1421caea-b154-4253-a4da-e0aab903ef06 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:03.879666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1421caea-b154-4253-a4da-e0aab903ef06 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:03.880745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1421caea-b154-4253-a4da-e0aab903ef06 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:03.883773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1421caea-b154-4253-a4da-e0aab903ef06 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:03.885176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1421caea-b154-4253-a4da-e0aab903ef06 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:03.886928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1421caea-b154-4253-a4da-e0aab903ef06 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:03.921023 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1421caea-b154-4253-a4da-e0aab903ef06 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] HTTP exception thrown: Instance fc2e63e9-502b-4e71-8d22-cb9e9792e8db could not be found. Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1421caea-b154-4253-a4da-e0aab903ef06 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Request method failure captured: Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db HTTP/1.1 Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeShNKNCWleEAJvyNN8WygFNwqtpQQ1x7Je0y5Xj90Rq4u9gmricGnyaWvSuRuM19kzWMSOpqZP3CbdBwB0-RcpUaKxtlMwb8o6NUcjiYmp9xka4vPH_b_lWvv8VpbAuzsJodAd5MBRDH_yclHBDXj-OSEgZdItpGBJbO8v67VpD2I0 Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.75 Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 56ccd022b4a3402a8f20565df6b160e5 Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersAdmin275Test-2040601650 Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_56ccd022b4a3402a8f20565df6b160e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/56ccd022b4a3402a8f20565df6b160e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56ccd022b4a3402a8f20565df6b160e5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/56ccd022b4a3402a8f20565df6b160e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersAdmin275Test-2040601650 Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 56ccd022b4a3402a8f20565df6b160e5 Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersAdmin275Test-2040601650 Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersAdmin275Test-2040601650-project Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 0d3bdb8a171c435aa2f008e767324543 Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersAdmin275Test-2040601650-project Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance fc2e63e9-502b-4e71-8d22-cb9e9792e8db could not be found. Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'fc2e63e9-502b-4e71-8d22-cb9e9792e8db'} Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc2e63e9-502b-4e71-8d22-cb9e9792e8db could not be found. Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc2e63e9-502b-4e71-8d22-cb9e9792e8db could not be found. Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:03.924634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:03.929365 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:03.929365 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:03.929365 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:03.929365 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:03.929365 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:03.929365 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc2e63e9-502b-4e71-8d22-cb9e9792e8db could not be found. Sep 08 12:50:03.929365 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:03.934954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1421caea-b154-4253-a4da-e0aab903ef06 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] Returning 404 to user: Instance fc2e63e9-502b-4e71-8d22-cb9e9792e8db could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:03.945504 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1421caea-b154-4253-a4da-e0aab903ef06 tempest-ServersAdmin275Test-2040601650 tempest-ServersAdmin275Test-2040601650-project] 10.222.0.78 "GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db" status: 404 len: 111 microversion: 2.75 time: 0.101280 Sep 08 12:50:03.947200 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1047/2233] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:50:03 2022] GET /compute/v2.1/servers/fc2e63e9-502b-4e71-8d22-cb9e9792e8db => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:50:03.961893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-962afb92-52ee-4828-a5e9-8a4d0a811657 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Calling method '.version_select at 0x7fdb3ac03940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:04.053702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG neutronclient.v2_0.client [None req-962afb92-52ee-4828-a5e9-8a4d0a811657 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule efc44a4c-3582-472d-a14c-bab188ce262f does not exist", "detail": ""}} {{(pid=128971) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:50:04.054939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.security_group_api [None req-962afb92-52ee-4828-a5e9-8a4d0a811657 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Neutron security group rule efc44a4c-3582-472d-a14c-bab188ce262f not found {{(pid=128971) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Sep 08 12:50:04.055903 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-962afb92-52ee-4828-a5e9-8a4d0a811657 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] HTTP exception thrown: Security group rule efc44a4c-3582-472d-a14c-bab188ce262f does not exist Sep 08 12:50:04.055903 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-e486f0af-0140-4cd9-804c-38fa473fd741'] Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-962afb92-52ee-4828-a5e9-8a4d0a811657 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Request method failure captured: Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-security-group-rules/efc44a4c-3582-472d-a14c-bab188ce262f HTTP/1.1 Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeTb8Ko5dVXO9wNCJCefr56P-Sg4Z7FHdVbv5hRFZXpmfkoAOGtJ5kuPtpsUjecnpyMQ-WudEmMcYMs2z64aLX-v9mn-awO7YI6uqVKqm4wcsinOQiI9otsaxpNYVnhhiuYm-qkZJuOQbR4B9cwrcs7gA5EkAJfh-_8xz-BOiYmuwRw Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c500d40c1e204e6a90e86f7b20ff5ec8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c500d40c1e204e6a90e86f7b20ff5ec8 Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539 Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: ec985c7670dd47c0ab68614537d32028 Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-644408539-project Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: exception: Security group rule efc44a4c-3582-472d-a14c-bab188ce262f does not exist Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-e486f0af-0140-4cd9-804c-38fa473fd741'] Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'efc44a4c-3582-472d-a14c-bab188ce262f'} Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:50:04.058735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule efc44a4c-3582-472d-a14c-bab188ce262f does not exist Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e486f0af-0140-4cd9-804c-38fa473fd741'] Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule efc44a4c-3582-472d-a14c-bab188ce262f does not exist Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e486f0af-0140-4cd9-804c-38fa473fd741'] Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule efc44a4c-3582-472d-a14c-bab188ce262f does not exist Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e486f0af-0140-4cd9-804c-38fa473fd741'] Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule efc44a4c-3582-472d-a14c-bab188ce262f does not exist Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e486f0af-0140-4cd9-804c-38fa473fd741'] Sep 08 12:50:04.062256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:04.069719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-962afb92-52ee-4828-a5e9-8a4d0a811657 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Returning 404 to user: Security group rule efc44a4c-3582-472d-a14c-bab188ce262f does not exist Sep 08 12:50:04.069719 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-e486f0af-0140-4cd9-804c-38fa473fd741'] {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:04.071057 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-962afb92-52ee-4828-a5e9-8a4d0a811657 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/efc44a4c-3582-472d-a14c-bab188ce262f" status: 404 len: 199 microversion: 2.1 time: 0.122228 Sep 08 12:50:04.079436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-19f797b0-4c76-47af-bf36-f74bcb5cc478 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a2295e4ec3478fb86588f624650e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6e4f8a7d2b473c875460f24e685ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:04.083013 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1048/2234] 10.222.0.78 () {58 vars in 1287 bytes} [Thu Sep 8 12:50:03 2022] DELETE /compute/v2.1/os-security-group-rules/efc44a4c-3582-472d-a14c-bab188ce262f => generated 199 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:50:04.095444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aab4e095-0753-46d9-9571-8ac74b6f1814 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:04.097572 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-19f797b0-4c76-47af-bf36-f74bcb5cc478 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 200 len: 1527 microversion: 2.1 time: 1.542647 Sep 08 12:50:04.098282 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1187/2235] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:02 2022] GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 1527 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:04.105123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-aab4e095-0753-46d9-9571-8ac74b6f1814 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: c50dcd06-1d5d-44ad-b802-4ef07c7bac31] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:04.113799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4e6b6e5-f7f9-4012-8ac2-62d92e2da433 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:04.114764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a4e6b6e5-f7f9-4012-8ac2-62d92e2da433 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:04.127956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aab4e095-0753-46d9-9571-8ac74b6f1814 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:04.140503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aab4e095-0753-46d9-9571-8ac74b6f1814 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:04.142280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aab4e095-0753-46d9-9571-8ac74b6f1814 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:04.143335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aab4e095-0753-46d9-9571-8ac74b6f1814 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:04.144037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aab4e095-0753-46d9-9571-8ac74b6f1814 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:04.144682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aab4e095-0753-46d9-9571-8ac74b6f1814 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:04.181966 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-aab4e095-0753-46d9-9571-8ac74b6f1814 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] HTTP exception thrown: Instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 could not be found. Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aab4e095-0753-46d9-9571-8ac74b6f1814 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Request method failure captured: Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 HTTP/1.1 Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeR1IXHSCL4T_0-k4BIFUTBsP8L3-cxGhkRdZjYdL1efvbPk_5tuUjqAxn27exlNZA8RamhG6s4cSkXHYOtsX1gxo77O5Q9NAzb0SUDVLx46NtAGBI0X85vzGWd8U6RD7aw9xs9h16EM8AStuAXdNwqpKkE2d9wddOL2QQlqEeASvtg Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 111d6d19644b4164a4e623bc7ea07dbf Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1499655394 Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1499655394 Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 111d6d19644b4164a4e623bc7ea07dbf Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1499655394 Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FloatingIPsAssociationTestJSON-1499655394-project Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d728c4e964f44edf9f8c5114032a4fbb Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1499655394-project Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 could not be found. Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'c50dcd06-1d5d-44ad-b802-4ef07c7bac31'} Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 could not be found. Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 could not be found. Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:04.183970 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:04.188270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:04.188270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:04.188270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:04.188270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:04.188270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:04.188270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:04.188270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 could not be found. Sep 08 12:50:04.188270 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:04.188702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4e6b6e5-f7f9-4012-8ac2-62d92e2da433 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:04.188702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4e6b6e5-f7f9-4012-8ac2-62d92e2da433 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:04.188702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4e6b6e5-f7f9-4012-8ac2-62d92e2da433 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:04.188702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4e6b6e5-f7f9-4012-8ac2-62d92e2da433 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:04.191892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4e6b6e5-f7f9-4012-8ac2-62d92e2da433 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:04.192378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aab4e095-0753-46d9-9571-8ac74b6f1814 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Returning 404 to user: Instance c50dcd06-1d5d-44ad-b802-4ef07c7bac31 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:04.192724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4e6b6e5-f7f9-4012-8ac2-62d92e2da433 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:04.193810 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-aab4e095-0753-46d9-9571-8ac74b6f1814 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31" status: 404 len: 111 microversion: 2.1 time: 0.109288 Sep 08 12:50:04.200656 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1049/2236] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:04 2022] GET /compute/v2.1/servers/c50dcd06-1d5d-44ad-b802-4ef07c7bac31 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:50:04.207805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a2820431-1e2e-4d20-91e7-ca8fec59220c tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Calling method '.version_select at 0x7fdb3abb5b80>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:04.973285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4e6b6e5-f7f9-4012-8ac2-62d92e2da433 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:05.001560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4e6b6e5-f7f9-4012-8ac2-62d92e2da433 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:05.005528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4e6b6e5-f7f9-4012-8ac2-62d92e2da433 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8af088dfb51e4f729cc97fc91699a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'df5a27766c1942a8be6a78466f7e7192', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:05.009326 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a4e6b6e5-f7f9-4012-8ac2-62d92e2da433 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 200 len: 1346 microversion: 2.25 time: 0.908814 Sep 08 12:50:05.012119 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1188/2237] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:50:04 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 1346 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:50:05.028302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-0f9452bd-d5cd-4970-99fe-0f90aa3908d6 req-2be75de8-1ce3-4d30-852a-2a31c72eb3e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60526de3-67cc-4bf8-911d-590f531d0130", "name": "network-vif-deleted", "tag": "fbd4d925-0ef2-4240-a577-779541fca496"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:05.082015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0f9452bd-d5cd-4970-99fe-0f90aa3908d6 req-2be75de8-1ce3-4d30-852a-2a31c72eb3e3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:05.093636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0f9452bd-d5cd-4970-99fe-0f90aa3908d6 req-2be75de8-1ce3-4d30-852a-2a31c72eb3e3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:05.093636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0f9452bd-d5cd-4970-99fe-0f90aa3908d6 req-2be75de8-1ce3-4d30-852a-2a31c72eb3e3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:05.121905 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-0f9452bd-d5cd-4970-99fe-0f90aa3908d6 req-2be75de8-1ce3-4d30-852a-2a31c72eb3e3 service nova] Creating event network-vif-deleted:fbd4d925-0ef2-4240-a577-779541fca496 for instance 60526de3-67cc-4bf8-911d-590f531d0130 on n-h2-852084-10 Sep 08 12:50:05.137244 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-0f9452bd-d5cd-4970-99fe-0f90aa3908d6 req-2be75de8-1ce3-4d30-852a-2a31c72eb3e3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122966 Sep 08 12:50:05.138228 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1189/2238] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:05.562183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-03bfb563-52d3-4249-b930-72cc13a2c440 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:05.566913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-03bfb563-52d3-4249-b930-72cc13a2c440 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:05.582696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03bfb563-52d3-4249-b930-72cc13a2c440 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:05.584121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03bfb563-52d3-4249-b930-72cc13a2c440 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:05.586664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03bfb563-52d3-4249-b930-72cc13a2c440 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:05.588515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03bfb563-52d3-4249-b930-72cc13a2c440 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:05.589676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03bfb563-52d3-4249-b930-72cc13a2c440 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:05.591670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03bfb563-52d3-4249-b930-72cc13a2c440 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:05.642649 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-03bfb563-52d3-4249-b930-72cc13a2c440 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] HTTP exception thrown: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-03bfb563-52d3-4249-b930-72cc13a2c440 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Request method failure captured: Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 HTTP/1.1 Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTfIrbamTa42HQ4Xdc0n2hvv2ItpC_oFW-qkMap35qzM-OKXePAkW5fYx4n7EtPVkRBr0dD6OWHWybK4wYSFlCCEP68NURoNglRIR-4YsZVor0mUz99V5bPGG1RVu3g-sGYwygT45tM4Qo7-vVCNdIu0B4DRktk6fRPpfxB7w68iGg Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 31360745b2204774814e632826fac084 Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1347641912 Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31360745b2204774814e632826fac084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31360745b2204774814e632826fac084"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31360745b2204774814e632826fac084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31360745b2204774814e632826fac084"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1347641912 Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 31360745b2204774814e632826fac084 Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1347641912 Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1347641912-project Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 69c6cc39273940909eef536e736b8053 Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1347641912-project Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'bea1ac03-81e8-4d96-b385-2f7286ab0292'} Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:50:05.647879 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:50:05.660456 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:05.660456 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:05.660456 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:05.660456 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:05.660456 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:05.660456 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:05.660456 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:05.660456 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:05.660456 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:05.660456 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:05.660456 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:05.670907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-03bfb563-52d3-4249-b930-72cc13a2c440 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Returning 404 to user: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:05.670907 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-03bfb563-52d3-4249-b930-72cc13a2c440 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 404 len: 111 microversion: 2.1 time: 0.522601 Sep 08 12:50:05.677383 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1190/2239] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:50:05 2022] DELETE /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 111 bytes in 537 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:50:05.689336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28de75c7-db91-4889-accd-6b95d7a52d1f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '.version_select at 0x7fdb373635e0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:06.353519 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a2820431-1e2e-4d20-91e7-ca8fec59220c tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/478b691e-97e0-4cb9-84e7-356d09e374ac" status: 202 len: 0 microversion: 2.1 time: 2.150692 Sep 08 12:50:06.354590 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1050/2240] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:50:04 2022] DELETE /compute/v2.1/os-security-groups/478b691e-97e0-4cb9-84e7-356d09e374ac => generated 0 bytes in 2153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:50:06.376314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b9fb5ff-149b-43b8-96f1-f45312cd6c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:06.380740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6b9fb5ff-149b-43b8-96f1-f45312cd6c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:06.414798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b9fb5ff-149b-43b8-96f1-f45312cd6c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:06.420551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b9fb5ff-149b-43b8-96f1-f45312cd6c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:06.423920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b9fb5ff-149b-43b8-96f1-f45312cd6c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:06.427545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b9fb5ff-149b-43b8-96f1-f45312cd6c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:06.432353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b9fb5ff-149b-43b8-96f1-f45312cd6c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:06.433479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b9fb5ff-149b-43b8-96f1-f45312cd6c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:07.182041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6b9fb5ff-149b-43b8-96f1-f45312cd6c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:07.202198 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6b9fb5ff-149b-43b8-96f1-f45312cd6c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1317 microversion: 2.1 time: 0.844779 Sep 08 12:50:07.206167 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1051/2241] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:06 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1317 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:07.221440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8ef50abc-719d-42ab-8dbf-a06c129d76af tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:07.225295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8ef50abc-719d-42ab-8dbf-a06c129d76af tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:07.240878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ef50abc-719d-42ab-8dbf-a06c129d76af tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:07.243278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ef50abc-719d-42ab-8dbf-a06c129d76af tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:07.244538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ef50abc-719d-42ab-8dbf-a06c129d76af tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:07.246973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ef50abc-719d-42ab-8dbf-a06c129d76af tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:07.248271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ef50abc-719d-42ab-8dbf-a06c129d76af tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:07.249568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ef50abc-719d-42ab-8dbf-a06c129d76af tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:07.881280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8ef50abc-719d-42ab-8dbf-a06c129d76af tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a2295e4ec3478fb86588f624650e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6e4f8a7d2b473c875460f24e685ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:07.896766 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8ef50abc-719d-42ab-8dbf-a06c129d76af tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 200 len: 1527 microversion: 2.1 time: 0.688369 Sep 08 12:50:07.898502 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1052/2242] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:07 2022] GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 1527 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:07.905408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fd013cb-a36b-4d42-8119-77f6e020d871 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:07.907012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1fd013cb-a36b-4d42-8119-77f6e020d871 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] [instance: 60526de3-67cc-4bf8-911d-590f531d0130] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:07.916702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fd013cb-a36b-4d42-8119-77f6e020d871 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:07.917712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fd013cb-a36b-4d42-8119-77f6e020d871 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:07.918617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fd013cb-a36b-4d42-8119-77f6e020d871 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:07.919993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fd013cb-a36b-4d42-8119-77f6e020d871 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:07.920980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fd013cb-a36b-4d42-8119-77f6e020d871 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:07.921803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fd013cb-a36b-4d42-8119-77f6e020d871 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:07.971872 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1fd013cb-a36b-4d42-8119-77f6e020d871 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] HTTP exception thrown: Instance 60526de3-67cc-4bf8-911d-590f531d0130 could not be found. Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fd013cb-a36b-4d42-8119-77f6e020d871 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Request method failure captured: Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 HTTP/1.1 Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeKxlpY1IbMyY5ZD8fhRJghwJHCqOAVJje9hTMCM6IyWpGbpVObcW8c1FqdL9mzvGHFLBpowN2NwMRcmp3G51ZYgQaV6YWezrqMNPxYd2W1oO67pJzCz7PUPEpLwIxcBuVLVsXQnXuWWdnFig4aff_iccKQRdBSMdPG4-ZDyiw3o_gM Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.25 Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: df5a27766c1942a8be6a78466f7e7192 Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-910002977 Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/df5a27766c1942a8be6a78466f7e7192"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-910002977 Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: df5a27766c1942a8be6a78466f7e7192 Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-910002977 Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-LiveAutoBlockMigrationV225Test-910002977-project Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 8af088dfb51e4f729cc97fc91699a55f Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-910002977-project Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 60526de3-67cc-4bf8-911d-590f531d0130 could not be found. Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '60526de3-67cc-4bf8-911d-590f531d0130'} Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60526de3-67cc-4bf8-911d-590f531d0130 could not be found. Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60526de3-67cc-4bf8-911d-590f531d0130 could not be found. Sep 08 12:50:07.976383 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:08.009512 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:08.009512 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:08.009512 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:08.009512 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:08.009512 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:08.009512 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:08.009512 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:08.009512 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60526de3-67cc-4bf8-911d-590f531d0130 could not be found. Sep 08 12:50:08.009512 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:08.009512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fd013cb-a36b-4d42-8119-77f6e020d871 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] Returning 404 to user: Instance 60526de3-67cc-4bf8-911d-590f531d0130 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:08.009512 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1fd013cb-a36b-4d42-8119-77f6e020d871 tempest-LiveAutoBlockMigrationV225Test-910002977 tempest-LiveAutoBlockMigrationV225Test-910002977-project] 10.222.0.78 "GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130" status: 404 len: 111 microversion: 2.25 time: 0.092699 Sep 08 12:50:08.009512 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1053/2243] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:50:07 2022] GET /compute/v2.1/servers/60526de3-67cc-4bf8-911d-590f531d0130 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:50:08.017814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ee96c9b2-d047-4941-973e-4f780c7bcb33 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Calling method '.version_select at 0x7fdb3ae09a60>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:08.832073 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-28de75c7-db91-4889-accd-6b95d7a52d1f tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/b14e74a9-7636-4b9d-bd74-3b101c54556c" status: 202 len: 0 microversion: 2.1 time: 3.154164 Sep 08 12:50:08.840058 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1191/2244] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:50:05 2022] DELETE /compute/v2.1/os-floating-ips/b14e74a9-7636-4b9d-bd74-3b101c54556c => generated 0 bytes in 3163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:50:08.862256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7f7f13b0-4476-4adf-af9b-6998db403c54 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Action: 'update', calling method: >, body: {"server": {"name": "bea1ac03-81e8-4d96-b385-2f7286ab0292_new"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:08.885029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7f7f13b0-4476-4adf-af9b-6998db403c54 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:08.915294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f7f13b0-4476-4adf-af9b-6998db403c54 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:08.917972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f7f13b0-4476-4adf-af9b-6998db403c54 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:08.918641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f7f13b0-4476-4adf-af9b-6998db403c54 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:08.919462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f7f13b0-4476-4adf-af9b-6998db403c54 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:08.919934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f7f13b0-4476-4adf-af9b-6998db403c54 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:08.920391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f7f13b0-4476-4adf-af9b-6998db403c54 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:08.973939 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-7f7f13b0-4476-4adf-af9b-6998db403c54 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] HTTP exception thrown: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:08.977343 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ee96c9b2-d047-4941-973e-4f780c7bcb33 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/c5901e28-d6fd-4620-b52f-562b67c3f2aa" status: 202 len: 0 microversion: 2.1 time: 0.976467 Sep 08 12:50:08.978464 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1054/2245] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:50:07 2022] DELETE /compute/v2.1/os-security-groups/c5901e28-d6fd-4620-b52f-562b67c3f2aa => generated 0 bytes in 983 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7f7f13b0-4476-4adf-af9b-6998db403c54 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Request method failure captured: Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 HTTP/1.1 Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 64 Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeTfIrbamTa42HQ4Xdc0n2hvv2ItpC_oFW-qkMap35qzM-OKXePAkW5fYx4n7EtPVkRBr0dD6OWHWybK4wYSFlCCEP68NURoNglRIR-4YsZVor0mUz99V5bPGG1RVu3g-sGYwygT45tM4Qo7-vVCNdIu0B4DRktk6fRPpfxB7w68iGg Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 31360745b2204774814e632826fac084 Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1347641912 Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_31360745b2204774814e632826fac084"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/31360745b2204774814e632826fac084"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31360745b2204774814e632826fac084"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/31360745b2204774814e632826fac084"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1347641912 Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 31360745b2204774814e632826fac084 Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1347641912 Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1347641912-project Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 69c6cc39273940909eef536e736b8053 Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1347641912-project Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "bea1ac03-81e8-4d96-b385-2f7286ab0292_new"}} Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'bea1ac03-81e8-4d96-b385-2f7286ab0292', 'body': {'server': {'name': 'bea1ac03-81e8-4d96-b385-2f7286ab0292_new'}}} Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:50:08.983149 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:08.988409 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:08.993226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7f7f13b0-4476-4adf-af9b-6998db403c54 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] Returning 404 to user: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:08.995130 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7f7f13b0-4476-4adf-af9b-6998db403c54 tempest-ServersNegativeTestMultiTenantJSON-1347641912 tempest-ServersNegativeTestMultiTenantJSON-1347641912-project] 10.222.0.78 "PUT /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 404 len: 111 microversion: 2.1 time: 0.152684 Sep 08 12:50:08.997281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0e28c16a-9c24-4542-881e-96c1c29e0be2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:08.998210 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1192/2246] 10.222.0.78 () {60 vars in 1256 bytes} [Thu Sep 8 12:50:08 2022] PUT /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:50:09.008080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0e28c16a-9c24-4542-881e-96c1c29e0be2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:09.015970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-160586e9-bbd2-4372-b329-f381d2487240 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:09.016850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-160586e9-bbd2-4372-b329-f381d2487240 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:09.036156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-160586e9-bbd2-4372-b329-f381d2487240 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:09.037689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-160586e9-bbd2-4372-b329-f381d2487240 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:09.039812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-160586e9-bbd2-4372-b329-f381d2487240 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:09.040892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-160586e9-bbd2-4372-b329-f381d2487240 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:09.041417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-160586e9-bbd2-4372-b329-f381d2487240 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:09.041986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-160586e9-bbd2-4372-b329-f381d2487240 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:09.057945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e28c16a-9c24-4542-881e-96c1c29e0be2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:09.058804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e28c16a-9c24-4542-881e-96c1c29e0be2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:09.063101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e28c16a-9c24-4542-881e-96c1c29e0be2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:09.069687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e28c16a-9c24-4542-881e-96c1c29e0be2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:09.074849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e28c16a-9c24-4542-881e-96c1c29e0be2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:09.076373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e28c16a-9c24-4542-881e-96c1c29e0be2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:09.111886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-160586e9-bbd2-4372-b329-f381d2487240 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:50:09.382156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=95,nova_api:UPDATE=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:09.393961 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-160586e9-bbd2-4372-b329-f381d2487240 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 204 len: 0 microversion: 2.1 time: 0.392340 Sep 08 12:50:09.395792 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1193/2247] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:50:08 2022] DELETE /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:50:09.406604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a2349a86-54e5-4f02-950d-6d82614eb3d6 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Calling method '.version_select at 0x7fdb3f12a790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:09.588567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0e28c16a-9c24-4542-881e-96c1c29e0be2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:09.621465 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0e28c16a-9c24-4542-881e-96c1c29e0be2 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1317 microversion: 2.1 time: 0.640309 Sep 08 12:50:09.623983 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1055/2248] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:08 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1317 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:09.635124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-58a93dc3-99da-49ca-a613-a42e56f48f0e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:09.637108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-58a93dc3-99da-49ca-a613-a42e56f48f0e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:09.650828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58a93dc3-99da-49ca-a613-a42e56f48f0e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:09.652268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58a93dc3-99da-49ca-a613-a42e56f48f0e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:09.653368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58a93dc3-99da-49ca-a613-a42e56f48f0e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:09.655171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58a93dc3-99da-49ca-a613-a42e56f48f0e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:09.656750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58a93dc3-99da-49ca-a613-a42e56f48f0e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:09.657966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58a93dc3-99da-49ca-a613-a42e56f48f0e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:09.742954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-58a93dc3-99da-49ca-a613-a42e56f48f0e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:50:09.923894 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-58a93dc3-99da-49ca-a613-a42e56f48f0e tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 204 len: 0 microversion: 2.1 time: 0.294938 Sep 08 12:50:09.925703 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1056/2249] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:50:09 2022] DELETE /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:50:09.940439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-720a67fb-8825-4738-b04c-e492854433ae req-bcfe3fc1-5533-415d-a178-e9d2a63659d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aac929c-34e0-46b4-b2ed-be01e53a5b48", "name": "network-vif-plugged", "status": "completed", "tag": "ef87dc69-90b0-4619-9709-b2f42201a6ac"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:09.953365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-720a67fb-8825-4738-b04c-e492854433ae req-bcfe3fc1-5533-415d-a178-e9d2a63659d3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:09.954196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-720a67fb-8825-4738-b04c-e492854433ae req-bcfe3fc1-5533-415d-a178-e9d2a63659d3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:09.955378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-720a67fb-8825-4738-b04c-e492854433ae req-bcfe3fc1-5533-415d-a178-e9d2a63659d3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:09.976834 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a2349a86-54e5-4f02-950d-6d82614eb3d6 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/a8945ea4-eb95-4e4e-a449-2c06a553f4cc" status: 202 len: 0 microversion: 2.1 time: 0.578742 Sep 08 12:50:09.978282 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-720a67fb-8825-4738-b04c-e492854433ae req-bcfe3fc1-5533-415d-a178-e9d2a63659d3 service nova] Creating event network-vif-plugged:ef87dc69-90b0-4619-9709-b2f42201a6ac for instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 on n-h1-852084-10 Sep 08 12:50:09.980435 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1194/2250] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:50:09 2022] DELETE /compute/v2.1/os-security-groups/a8945ea4-eb95-4e4e-a449-2c06a553f4cc => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:50:09.990332 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-720a67fb-8825-4738-b04c-e492854433ae req-bcfe3fc1-5533-415d-a178-e9d2a63659d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062465 Sep 08 12:50:09.991072 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1057/2251] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:10.009442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2c3de755-b721-4e57-83fc-05ae285e8aae tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:10.017137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2c3de755-b721-4e57-83fc-05ae285e8aae tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:10.033586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3de755-b721-4e57-83fc-05ae285e8aae tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:10.035334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3de755-b721-4e57-83fc-05ae285e8aae tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:10.036276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3de755-b721-4e57-83fc-05ae285e8aae tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:10.037988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3de755-b721-4e57-83fc-05ae285e8aae tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:10.038472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3de755-b721-4e57-83fc-05ae285e8aae tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:10.038917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3de755-b721-4e57-83fc-05ae285e8aae tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:10.360235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c3de755-b721-4e57-83fc-05ae285e8aae tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:10.376690 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2c3de755-b721-4e57-83fc-05ae285e8aae tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 200 len: 1526 microversion: 2.1 time: 0.383323 Sep 08 12:50:10.391878 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1058/2252] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:09 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 1526 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:10.468014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-47afcdac-2084-4fdf-a9de-bd6886943fbc tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Calling method '.version_select at 0x7fdb3f126280>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:10.545334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG neutronclient.v2_0.client [None req-47afcdac-2084-4fdf-a9de-bd6886943fbc tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 00a23aa9-57a7-44e2-bd3d-68a21133744c does not exist", "detail": ""}} {{(pid=128970) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:50:10.548232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.security_group_api [None req-47afcdac-2084-4fdf-a9de-bd6886943fbc tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Neutron security group 00a23aa9-57a7-44e2-bd3d-68a21133744c not found {{(pid=128970) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:50:10.549877 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-47afcdac-2084-4fdf-a9de-bd6886943fbc tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] HTTP exception thrown: Security group 00a23aa9-57a7-44e2-bd3d-68a21133744c does not exist Sep 08 12:50:10.549877 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-aaa8bc21-8512-462a-9e12-0fd8b6dede65'] Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-47afcdac-2084-4fdf-a9de-bd6886943fbc tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Request method failure captured: Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/os-security-groups/00a23aa9-57a7-44e2-bd3d-68a21133744c HTTP/1.1 Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeUAi3EhtLlrSw4EiW0Fb-CbzWV8WDmN7qJda9tAaWAGzcEq_5mZEEYsAvBgG-48e8d86cUGWuALuENyH1NLA3pWeLBQ-V4Fie6Gfc7534ShoxpZ06sqz89byeesUs5awy9v3H7q72byFNLqCYJbnCjZQcFD1l_-kS98iLVUcjMIb-Y Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 6684ba23af6e4c3ca9441a32292cd50d Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-507956097 Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-507956097 Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 6684ba23af6e4c3ca9441a32292cd50d Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-507956097 Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsNegativeTestJSON-507956097-project Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 22a91fc7ffbd4ae2bdcd7822358c8c37 Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-507956097-project Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: exception: Security group 00a23aa9-57a7-44e2-bd3d-68a21133744c does not exist Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-aaa8bc21-8512-462a-9e12-0fd8b6dede65'] Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '00a23aa9-57a7-44e2-bd3d-68a21133744c'} Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:50:10.563714 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 00a23aa9-57a7-44e2-bd3d-68a21133744c does not exist Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aaa8bc21-8512-462a-9e12-0fd8b6dede65'] Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 00a23aa9-57a7-44e2-bd3d-68a21133744c does not exist Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aaa8bc21-8512-462a-9e12-0fd8b6dede65'] Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 00a23aa9-57a7-44e2-bd3d-68a21133744c does not exist Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aaa8bc21-8512-462a-9e12-0fd8b6dede65'] Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 00a23aa9-57a7-44e2-bd3d-68a21133744c does not exist Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-aaa8bc21-8512-462a-9e12-0fd8b6dede65'] Sep 08 12:50:10.573317 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:10.579608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-47afcdac-2084-4fdf-a9de-bd6886943fbc tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Returning 404 to user: Security group 00a23aa9-57a7-44e2-bd3d-68a21133744c does not exist Sep 08 12:50:10.579608 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-aaa8bc21-8512-462a-9e12-0fd8b6dede65'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:10.581181 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-47afcdac-2084-4fdf-a9de-bd6886943fbc tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/00a23aa9-57a7-44e2-bd3d-68a21133744c" status: 404 len: 194 microversion: 2.1 time: 0.597625 Sep 08 12:50:10.583872 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1195/2253] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:50:09 2022] DELETE /compute/v2.1/os-security-groups/00a23aa9-57a7-44e2-bd3d-68a21133744c => generated 194 bytes in 602 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:50:10.599698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-80af7313-439f-44fa-990c-0da93ead949c tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:10.601989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-80af7313-439f-44fa-990c-0da93ead949c tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:10.619483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80af7313-439f-44fa-990c-0da93ead949c tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:10.621029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80af7313-439f-44fa-990c-0da93ead949c tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:10.622080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80af7313-439f-44fa-990c-0da93ead949c tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:10.623504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80af7313-439f-44fa-990c-0da93ead949c tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:10.625426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80af7313-439f-44fa-990c-0da93ead949c tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:10.626424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80af7313-439f-44fa-990c-0da93ead949c tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:10.988861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-227293289", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:11.143423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-80af7313-439f-44fa-990c-0da93ead949c tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a2295e4ec3478fb86588f624650e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6e4f8a7d2b473c875460f24e685ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:11.164646 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-80af7313-439f-44fa-990c-0da93ead949c tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 200 len: 1533 microversion: 2.1 time: 0.574102 Sep 08 12:50:11.165673 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1196/2254] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:10 2022] GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 1533 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:11.174942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:50:11.181723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-21702f03-e909-4a3a-b86a-8d2d112993f2 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Calling method '.version_select at 0x7fdb3f1269d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:11.835666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:50:11.836383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:50:11.837253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:50:11.837983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:50:11.838720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:50:11.893371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:11.895205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:11.896478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:11.899376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:11.900783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:11.902410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:11.973968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Getting quotas for project a856789ce4f64b95823378a2600f6878. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:50:11.988187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Getting quotas for user 22b4be40ad8640e59bef7ed17f9bfda0 and project a856789ce4f64b95823378a2600f6878. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:50:12.023529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:50:12.028111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:50:12.170526 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ba6253a0-3a7c-4a40-ba72-b2e66e3107f7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.776040 Sep 08 12:50:12.172460 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1059/2255] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:50:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:50:12.183101 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bab25f2d-2bd4-4aca-be27-4b5133c8085e tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.008526 Sep 08 12:50:12.185822 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1060/2256] 10.222.0.78 () {58 vars in 1164 bytes} [Thu Sep 8 12:50:12 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 12:50:12.200163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d6fdaa80-c14d-44a3-8c12-e1a1d60faa4c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:12.202006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d6fdaa80-c14d-44a3-8c12-e1a1d60faa4c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:12.219117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6fdaa80-c14d-44a3-8c12-e1a1d60faa4c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:12.220604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6fdaa80-c14d-44a3-8c12-e1a1d60faa4c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:12.221727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6fdaa80-c14d-44a3-8c12-e1a1d60faa4c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:12.223722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6fdaa80-c14d-44a3-8c12-e1a1d60faa4c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:12.225184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6fdaa80-c14d-44a3-8c12-e1a1d60faa4c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:12.226629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6fdaa80-c14d-44a3-8c12-e1a1d60faa4c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:12.240420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:12.425267 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-21702f03-e909-4a3a-b86a-8d2d112993f2 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/ea40ea38-ce28-4de4-ad39-9b5db8240ddb" status: 202 len: 0 microversion: 2.1 time: 1.257535 Sep 08 12:50:12.426752 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1197/2257] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:50:11 2022] DELETE /compute/v2.1/os-security-groups/ea40ea38-ce28-4de4-ad39-9b5db8240ddb => generated 0 bytes in 1260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:50:12.453970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-24b0128f-584e-4ef3-8a1e-d592ec757e29 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:12.455164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-24b0128f-584e-4ef3-8a1e-d592ec757e29 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:12.494567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24b0128f-584e-4ef3-8a1e-d592ec757e29 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:12.495581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24b0128f-584e-4ef3-8a1e-d592ec757e29 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:12.496389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24b0128f-584e-4ef3-8a1e-d592ec757e29 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:12.499267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24b0128f-584e-4ef3-8a1e-d592ec757e29 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:12.500293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24b0128f-584e-4ef3-8a1e-d592ec757e29 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:12.504452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24b0128f-584e-4ef3-8a1e-d592ec757e29 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:13.191786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d6fdaa80-c14d-44a3-8c12-e1a1d60faa4c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:13.235116 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d6fdaa80-c14d-44a3-8c12-e1a1d60faa4c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1317 microversion: 2.1 time: 1.045994 Sep 08 12:50:13.261171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-24b0128f-584e-4ef3-8a1e-d592ec757e29 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd728c4e964f44edf9f8c5114032a4fbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '111d6d19644b4164a4e623bc7ea07dbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:13.261573 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1061/2258] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:12 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1317 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:13.283622 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-24b0128f-584e-4ef3-8a1e-d592ec757e29 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 200 len: 1526 microversion: 2.1 time: 0.854224 Sep 08 12:50:13.290114 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1198/2259] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:12 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 1526 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:13.307130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8312cff5-4f4d-48db-8637-801f997b1742 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:13.309064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8312cff5-4f4d-48db-8637-801f997b1742 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:13.313563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-85370aad-7c8f-4af8-acd3-6fb7761636cd tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Calling method '.version_select at 0x7fdb3f12fc10>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:14.245229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8312cff5-4f4d-48db-8637-801f997b1742 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:14.299103 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8312cff5-4f4d-48db-8637-801f997b1742 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1216 microversion: 2.1 time: 1.020232 Sep 08 12:50:14.325044 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1062/2260] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:13 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1216 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:14.343692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f23af37f-1b24-4590-8ab1-a2f5b306811f tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:14.344924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f23af37f-1b24-4590-8ab1-a2f5b306811f tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:14.353155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f23af37f-1b24-4590-8ab1-a2f5b306811f tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:14.354050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f23af37f-1b24-4590-8ab1-a2f5b306811f tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:14.356535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f23af37f-1b24-4590-8ab1-a2f5b306811f tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:14.369343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f23af37f-1b24-4590-8ab1-a2f5b306811f tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:14.370257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f23af37f-1b24-4590-8ab1-a2f5b306811f tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:14.371786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f23af37f-1b24-4590-8ab1-a2f5b306811f tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:14.634303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f23af37f-1b24-4590-8ab1-a2f5b306811f tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55a2295e4ec3478fb86588f624650e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6e4f8a7d2b473c875460f24e685ee2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:14.652045 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f23af37f-1b24-4590-8ab1-a2f5b306811f tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 200 len: 1491 microversion: 2.1 time: 0.325235 Sep 08 12:50:14.660283 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1063/2261] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:14 2022] GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 1491 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:14.681208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e2afbc97-39d1-4cf6-8bf1-f9a4e7853971 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] Calling method '.version_select at 0x7fdb3ad263a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:15.393554 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-85370aad-7c8f-4af8-acd3-6fb7761636cd tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 2.100196 Sep 08 12:50:15.394431 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1199/2262] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:50:13 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:15.817388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1893259756", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:15.991836 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e2afbc97-39d1-4cf6-8bf1-f9a4e7853971 tempest-SecurityGroupRulesNegativeTestJSON-644408539 tempest-SecurityGroupRulesNegativeTestJSON-644408539-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/5a4e09f8-dd27-4947-968b-1a3e5b4e46a7" status: 202 len: 0 microversion: 2.1 time: 1.326941 Sep 08 12:50:16.009164 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1064/2263] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:50:14 2022] DELETE /compute/v2.1/os-security-groups/5a4e09f8-dd27-4947-968b-1a3e5b4e46a7 => generated 0 bytes in 1348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:50:16.023851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-484d4296-f760-43b3-a504-887e3e6c6a0f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:16.028974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-484d4296-f760-43b3-a504-887e3e6c6a0f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:16.071310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-484d4296-f760-43b3-a504-887e3e6c6a0f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:16.072522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-484d4296-f760-43b3-a504-887e3e6c6a0f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:16.075891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-484d4296-f760-43b3-a504-887e3e6c6a0f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:16.082046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:50:16.082421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-484d4296-f760-43b3-a504-887e3e6c6a0f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:16.083899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-484d4296-f760-43b3-a504-887e3e6c6a0f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:16.094332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-484d4296-f760-43b3-a504-887e3e6c6a0f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:16.962636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-484d4296-f760-43b3-a504-887e3e6c6a0f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:16.993783 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-484d4296-f760-43b3-a504-887e3e6c6a0f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1507 microversion: 2.1 time: 0.982532 Sep 08 12:50:16.996546 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1065/2264] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:16 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1507 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:17.033197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b3b5d6cb-4ac8-40c2-bb63-31b99c2b77c3 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:17.035100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b3b5d6cb-4ac8-40c2-bb63-31b99c2b77c3 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] [instance: 5bfe69bb-91ad-499f-9f12-de0ac60519b6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:17.049591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3b5d6cb-4ac8-40c2-bb63-31b99c2b77c3 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:17.050589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3b5d6cb-4ac8-40c2-bb63-31b99c2b77c3 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:17.051781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3b5d6cb-4ac8-40c2-bb63-31b99c2b77c3 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:17.053772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3b5d6cb-4ac8-40c2-bb63-31b99c2b77c3 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:17.055733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3b5d6cb-4ac8-40c2-bb63-31b99c2b77c3 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:17.060851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:50:17.061614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:50:17.062697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:50:17.063173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:50:17.064568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:50:17.065747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3b5d6cb-4ac8-40c2-bb63-31b99c2b77c3 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:17.089441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:17.090351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:17.090720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:17.096304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:17.096962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:17.097456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:17.102170 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-b3b5d6cb-4ac8-40c2-bb63-31b99c2b77c3 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] HTTP exception thrown: Instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 could not be found. Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b3b5d6cb-4ac8-40c2-bb63-31b99c2b77c3 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Request method failure captured: Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 HTTP/1.1 Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeR1IXHSCL4T_0-k4BIFUTBsP8L3-cxGhkRdZjYdL1efvbPk_5tuUjqAxn27exlNZA8RamhG6s4cSkXHYOtsX1gxo77O5Q9NAzb0SUDVLx46NtAGBI0X85vzGWd8U6RD7aw9xs9h16EM8AStuAXdNwqpKkE2d9wddOL2QQlqEeASvtg Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 111d6d19644b4164a4e623bc7ea07dbf Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1499655394 Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/111d6d19644b4164a4e623bc7ea07dbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1499655394 Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 111d6d19644b4164a4e623bc7ea07dbf Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1499655394 Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FloatingIPsAssociationTestJSON-1499655394-project Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d728c4e964f44edf9f8c5114032a4fbb Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1499655394-project Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 could not be found. Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '5bfe69bb-91ad-499f-9f12-de0ac60519b6'} Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 could not be found. Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 could not be found. Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:17.107155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:17.115061 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:17.115061 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:17.115061 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:17.115061 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:17.115061 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:17.115061 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:17.115061 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 could not be found. Sep 08 12:50:17.115061 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:17.117564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b3b5d6cb-4ac8-40c2-bb63-31b99c2b77c3 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] Returning 404 to user: Instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:17.126004 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b3b5d6cb-4ac8-40c2-bb63-31b99c2b77c3 tempest-FloatingIPsAssociationTestJSON-1499655394 tempest-FloatingIPsAssociationTestJSON-1499655394-project] 10.222.0.78 "GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6" status: 404 len: 111 microversion: 2.1 time: 0.126357 Sep 08 12:50:17.133719 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1066/2265] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:16 2022] GET /compute/v2.1/servers/5bfe69bb-91ad-499f-9f12-de0ac60519b6 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:50:17.160015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-6559a9e1-741a-40aa-9e2b-4221c3b45a12 req-20801eb0-ed74-4963-8760-bfe8c27753fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfe69bb-91ad-499f-9f12-de0ac60519b6", "name": "network-vif-deleted", "tag": "feb64804-e1ff-419a-8a16-60a42fef7a86"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:17.176297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Getting quotas for project d9dedae99bc2492c850c6bb721928d6e. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:50:17.189206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6559a9e1-741a-40aa-9e2b-4221c3b45a12 req-20801eb0-ed74-4963-8760-bfe8c27753fd service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:17.189704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6559a9e1-741a-40aa-9e2b-4221c3b45a12 req-20801eb0-ed74-4963-8760-bfe8c27753fd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:17.190148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6559a9e1-741a-40aa-9e2b-4221c3b45a12 req-20801eb0-ed74-4963-8760-bfe8c27753fd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:17.206327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Getting quotas for user 6859ddadc55d43d4b245ba732b478226 and project d9dedae99bc2492c850c6bb721928d6e. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:50:17.249681 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-6559a9e1-741a-40aa-9e2b-4221c3b45a12 req-20801eb0-ed74-4963-8760-bfe8c27753fd service nova] Creating event network-vif-deleted:feb64804-e1ff-419a-8a16-60a42fef7a86 for instance 5bfe69bb-91ad-499f-9f12-de0ac60519b6 on n-h1-852084-10 Sep 08 12:50:17.260386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:50:17.270182 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-6559a9e1-741a-40aa-9e2b-4221c3b45a12 req-20801eb0-ed74-4963-8760-bfe8c27753fd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136286 Sep 08 12:50:17.270918 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1067/2266] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:17.273820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:50:17.283925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e3b10134-36d5-4c72-a8f1-240c5aabe00b req-e9ecdee8-40ed-4dff-a7ad-d549786a4a53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea1ac03-81e8-4d96-b385-2f7286ab0292", "name": "network-vif-deleted", "tag": "88e3afe8-358b-4fc1-8612-e67dde20f1fd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:17.324348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e3b10134-36d5-4c72-a8f1-240c5aabe00b req-e9ecdee8-40ed-4dff-a7ad-d549786a4a53 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:17.326202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e3b10134-36d5-4c72-a8f1-240c5aabe00b req-e9ecdee8-40ed-4dff-a7ad-d549786a4a53 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:17.327335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e3b10134-36d5-4c72-a8f1-240c5aabe00b req-e9ecdee8-40ed-4dff-a7ad-d549786a4a53 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:17.353416 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e3b10134-36d5-4c72-a8f1-240c5aabe00b req-e9ecdee8-40ed-4dff-a7ad-d549786a4a53 service nova] Creating event network-vif-deleted:88e3afe8-358b-4fc1-8612-e67dde20f1fd for instance bea1ac03-81e8-4d96-b385-2f7286ab0292 on n-h1-852084-10 Sep 08 12:50:17.375490 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e3b10134-36d5-4c72-a8f1-240c5aabe00b req-e9ecdee8-40ed-4dff-a7ad-d549786a4a53 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101954 Sep 08 12:50:17.377483 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1068/2267] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:17.387725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d9e5f489-5b38-4b33-bf46-f6e49fa208ef tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:17.389346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d9e5f489-5b38-4b33-bf46-f6e49fa208ef tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:17.414676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9e5f489-5b38-4b33-bf46-f6e49fa208ef tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:17.415887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9e5f489-5b38-4b33-bf46-f6e49fa208ef tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:17.418884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9e5f489-5b38-4b33-bf46-f6e49fa208ef tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:17.428294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9e5f489-5b38-4b33-bf46-f6e49fa208ef tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:17.429483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9e5f489-5b38-4b33-bf46-f6e49fa208ef tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:17.430450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9e5f489-5b38-4b33-bf46-f6e49fa208ef tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:17.466030 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9b7130e7-2cc8-4e3d-9883-b4a0cd70651d tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.069838 Sep 08 12:50:17.469459 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1200/2268] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:50:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:50:17.480569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5bf926c4-6588-4532-8dba-fe7d473f6caa tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Calling method '.version_select at 0x7fdb3f156b80>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:17.768839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d9e5f489-5b38-4b33-bf46-f6e49fa208ef tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:17.791431 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d9e5f489-5b38-4b33-bf46-f6e49fa208ef tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1274 microversion: 2.1 time: 0.408087 Sep 08 12:50:17.792260 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1069/2269] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:17 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1274 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:17.810389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad5c02a6-13df-4199-865e-65a1b9ddb299 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:17.820257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad5c02a6-13df-4199-865e-65a1b9ddb299 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] [instance: bea1ac03-81e8-4d96-b385-2f7286ab0292] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:17.836369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad5c02a6-13df-4199-865e-65a1b9ddb299 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:17.842328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad5c02a6-13df-4199-865e-65a1b9ddb299 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:17.843815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad5c02a6-13df-4199-865e-65a1b9ddb299 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:17.846123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad5c02a6-13df-4199-865e-65a1b9ddb299 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:17.846883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad5c02a6-13df-4199-865e-65a1b9ddb299 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:17.847593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad5c02a6-13df-4199-865e-65a1b9ddb299 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:17.875958 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-ad5c02a6-13df-4199-865e-65a1b9ddb299 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] HTTP exception thrown: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad5c02a6-13df-4199-865e-65a1b9ddb299 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Request method failure captured: Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 HTTP/1.1 Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeTB8oT4lN3ZmcxumuHZt0kd67G0Mjr6cGOT5CgnSUjiWVE0gXTBWl3qPvsU8hMaBBcB3Koz6_AD6K_BoL6Vy8oQveJRzsSGAWE7NzARWtPtXIoEOYUGry_ep780WON-XCC1I9Tet0d6uMwCBLeu3RFlabCph3xETtTpgTIuKa8_hKs Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4f6e4f8a7d2b473c875460f24e685ee2 Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1900953225 Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4f6e4f8a7d2b473c875460f24e685ee2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4f6e4f8a7d2b473c875460f24e685ee2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4f6e4f8a7d2b473c875460f24e685ee2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4f6e4f8a7d2b473c875460f24e685ee2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1900953225 Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4f6e4f8a7d2b473c875460f24e685ee2 Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1900953225 Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1900953225-project Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 55a2295e4ec3478fb86588f624650e01 Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1900953225-project Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'bea1ac03-81e8-4d96-b385-2f7286ab0292'} Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:17.885015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:17.892515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:17.892515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:17.892515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:17.892515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:17.892515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:17.892515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:17.892515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:17.892515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. Sep 08 12:50:17.892515 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:17.892515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad5c02a6-13df-4199-865e-65a1b9ddb299 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] Returning 404 to user: Instance bea1ac03-81e8-4d96-b385-2f7286ab0292 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:17.892515 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad5c02a6-13df-4199-865e-65a1b9ddb299 tempest-ServersNegativeTestMultiTenantJSON-1900953225 tempest-ServersNegativeTestMultiTenantJSON-1900953225-project] 10.222.0.78 "GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292" status: 404 len: 111 microversion: 2.1 time: 0.091585 Sep 08 12:50:17.895826 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1070/2270] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:17 2022] GET /compute/v2.1/servers/bea1ac03-81e8-4d96-b385-2f7286ab0292 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:50:17.898757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a4f3e652-6484-4d12-83fe-eb94cf7a355b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:17.902425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a4f3e652-6484-4d12-83fe-eb94cf7a355b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:17.916352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4f3e652-6484-4d12-83fe-eb94cf7a355b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:17.917558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4f3e652-6484-4d12-83fe-eb94cf7a355b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:17.918707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4f3e652-6484-4d12-83fe-eb94cf7a355b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:17.920229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4f3e652-6484-4d12-83fe-eb94cf7a355b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:17.921402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4f3e652-6484-4d12-83fe-eb94cf7a355b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:17.922478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4f3e652-6484-4d12-83fe-eb94cf7a355b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:18.465061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG neutronclient.v2_0.client [None req-5bf926c4-6588-4532-8dba-fe7d473f6caa tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128970) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:50:18.467733 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-5bf926c4-6588-4532-8dba-fe7d473f6caa tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] HTTP exception thrown: Insufficient rights for removing default security group. Sep 08 12:50:18.467733 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-684359b8-1a84-469f-bc5e-719aacb10826'] Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5bf926c4-6588-4532-8dba-fe7d473f6caa tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Request method failure captured: Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/os-security-groups/cbf64ad4-1f77-4469-b852-0fec27097826 HTTP/1.1 Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeUAi3EhtLlrSw4EiW0Fb-CbzWV8WDmN7qJda9tAaWAGzcEq_5mZEEYsAvBgG-48e8d86cUGWuALuENyH1NLA3pWeLBQ-V4Fie6Gfc7534ShoxpZ06sqz89byeesUs5awy9v3H7q72byFNLqCYJbnCjZQcFD1l_-kS98iLVUcjMIb-Y Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 6684ba23af6e4c3ca9441a32292cd50d Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-507956097 Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-507956097 Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 6684ba23af6e4c3ca9441a32292cd50d Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-507956097 Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsNegativeTestJSON-507956097-project Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 22a91fc7ffbd4ae2bdcd7822358c8c37 Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-507956097-project Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: exception: Insufficient rights for removing default security group. Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-684359b8-1a84-469f-bc5e-719aacb10826'] Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'cbf64ad4-1f77-4469-b852-0fec27097826'} Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:50:18.472624 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-684359b8-1a84-469f-bc5e-719aacb10826'] Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-684359b8-1a84-469f-bc5e-719aacb10826'] Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-684359b8-1a84-469f-bc5e-719aacb10826'] Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-684359b8-1a84-469f-bc5e-719aacb10826'] Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5bf926c4-6588-4532-8dba-fe7d473f6caa tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Returning 400 to user: Insufficient rights for removing default security group. Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-684359b8-1a84-469f-bc5e-719aacb10826'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:18.478817 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5bf926c4-6588-4532-8dba-fe7d473f6caa tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/cbf64ad4-1f77-4469-b852-0fec27097826" status: 400 len: 182 microversion: 2.1 time: 1.006128 Sep 08 12:50:18.504694 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1201/2271] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:50:17 2022] DELETE /compute/v2.1/os-security-groups/cbf64ad4-1f77-4469-b852-0fec27097826 => generated 182 bytes in 1010 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:50:18.504694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e512aff4-04ef-4900-80ff-1261d7b21cb4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:18.504694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e512aff4-04ef-4900-80ff-1261d7b21cb4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:18.575371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a4f3e652-6484-4d12-83fe-eb94cf7a355b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:18.607125 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a4f3e652-6484-4d12-83fe-eb94cf7a355b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1507 microversion: 2.1 time: 0.712229 Sep 08 12:50:18.623848 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1071/2272] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:17 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1507 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:18.641767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d4684f1-ddbc-42d9-941d-adb79a091cd8 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Calling method '.version_select at 0x7fdb3adbc1f0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:18.781749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e512aff4-04ef-4900-80ff-1261d7b21cb4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:18.820134 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e512aff4-04ef-4900-80ff-1261d7b21cb4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1222 microversion: 2.1 time: 0.334225 Sep 08 12:50:18.821247 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1202/2273] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:18 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1222 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:18.874711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG neutronclient.v2_0.client [None req-4d4684f1-ddbc-42d9-941d-adb79a091cd8 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d6242998-cb10-4336-bc2f-5c583ab4e87f does not exist", "detail": ""}} {{(pid=128971) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:50:18.875368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.security_group_api [None req-4d4684f1-ddbc-42d9-941d-adb79a091cd8 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Neutron security group d6242998-cb10-4336-bc2f-5c583ab4e87f not found {{(pid=128971) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:50:18.876040 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-4d4684f1-ddbc-42d9-941d-adb79a091cd8 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] HTTP exception thrown: Security group d6242998-cb10-4336-bc2f-5c583ab4e87f does not exist Sep 08 12:50:18.876040 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-bb4ea324-0467-4147-87b2-5aacbace03ed'] Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d4684f1-ddbc-42d9-941d-adb79a091cd8 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Request method failure captured: Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-security-groups/d6242998-cb10-4336-bc2f-5c583ab4e87f HTTP/1.1 Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeUAi3EhtLlrSw4EiW0Fb-CbzWV8WDmN7qJda9tAaWAGzcEq_5mZEEYsAvBgG-48e8d86cUGWuALuENyH1NLA3pWeLBQ-V4Fie6Gfc7534ShoxpZ06sqz89byeesUs5awy9v3H7q72byFNLqCYJbnCjZQcFD1l_-kS98iLVUcjMIb-Y Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 6684ba23af6e4c3ca9441a32292cd50d Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-507956097 Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-507956097 Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 6684ba23af6e4c3ca9441a32292cd50d Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-507956097 Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-SecurityGroupsNegativeTestJSON-507956097-project Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 22a91fc7ffbd4ae2bdcd7822358c8c37 Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-507956097-project Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: exception: Security group d6242998-cb10-4336-bc2f-5c583ab4e87f does not exist Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-bb4ea324-0467-4147-87b2-5aacbace03ed'] Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'd6242998-cb10-4336-bc2f-5c583ab4e87f'} Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:50:18.879387 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d6242998-cb10-4336-bc2f-5c583ab4e87f does not exist Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb4ea324-0467-4147-87b2-5aacbace03ed'] Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d6242998-cb10-4336-bc2f-5c583ab4e87f does not exist Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb4ea324-0467-4147-87b2-5aacbace03ed'] Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d6242998-cb10-4336-bc2f-5c583ab4e87f does not exist Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb4ea324-0467-4147-87b2-5aacbace03ed'] Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d6242998-cb10-4336-bc2f-5c583ab4e87f does not exist Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb4ea324-0467-4147-87b2-5aacbace03ed'] Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d4684f1-ddbc-42d9-941d-adb79a091cd8 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Returning 404 to user: Security group d6242998-cb10-4336-bc2f-5c583ab4e87f does not exist Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-bb4ea324-0467-4147-87b2-5aacbace03ed'] {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:18.883663 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4d4684f1-ddbc-42d9-941d-adb79a091cd8 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/d6242998-cb10-4336-bc2f-5c583ab4e87f" status: 404 len: 194 microversion: 2.1 time: 0.255872 Sep 08 12:50:18.888225 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1072/2274] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 12:50:18 2022] GET /compute/v2.1/os-security-groups/d6242998-cb10-4336-bc2f-5c583ab4e87f => generated 194 bytes in 264 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:50:18.892504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-056761dc-cac3-4184-86d3-2c8b751226e5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:18.894515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-19585ffd-ae83-4e3b-8cd6-26e46d245801 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:18.895155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-19585ffd-ae83-4e3b-8cd6-26e46d245801 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:18.904292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-056761dc-cac3-4184-86d3-2c8b751226e5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:18.909409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19585ffd-ae83-4e3b-8cd6-26e46d245801 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:18.909825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19585ffd-ae83-4e3b-8cd6-26e46d245801 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:18.910795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19585ffd-ae83-4e3b-8cd6-26e46d245801 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:18.911692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19585ffd-ae83-4e3b-8cd6-26e46d245801 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:18.912256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19585ffd-ae83-4e3b-8cd6-26e46d245801 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:18.912783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19585ffd-ae83-4e3b-8cd6-26e46d245801 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:18.950195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-056761dc-cac3-4184-86d3-2c8b751226e5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:18.955972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-056761dc-cac3-4184-86d3-2c8b751226e5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:18.958560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-056761dc-cac3-4184-86d3-2c8b751226e5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:18.960004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-056761dc-cac3-4184-86d3-2c8b751226e5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:18.960690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-056761dc-cac3-4184-86d3-2c8b751226e5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:18.971135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-056761dc-cac3-4184-86d3-2c8b751226e5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:19.150363 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-056761dc-cac3-4184-86d3-2c8b751226e5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "PUT /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1079 microversion: 2.1 time: 0.295246 Sep 08 12:50:19.163267 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1203/2275] 10.222.0.78 () {60 vars in 1256 bytes} [Thu Sep 8 12:50:18 2022] PUT /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1079 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:19.168030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28ede7bd-5314-4366-9d6e-135f35154489 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Action: 'update', calling method: .version_select at 0x7fdb3f12a5e0>, body: {"security_group": {"name": "tempest-sg-597996332", "description": "tempest-description-1060552969"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:19.178613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-19585ffd-ae83-4e3b-8cd6-26e46d245801 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:19.198432 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-19585ffd-ae83-4e3b-8cd6-26e46d245801 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1274 microversion: 2.1 time: 0.308435 Sep 08 12:50:19.199655 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1073/2276] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:18 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1274 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:19.205274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-516c0fa5-1b63-4059-b64e-ffd4ebec25ab tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:19.206841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-516c0fa5-1b63-4059-b64e-ffd4ebec25ab tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:19.221986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-516c0fa5-1b63-4059-b64e-ffd4ebec25ab tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:19.227690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-516c0fa5-1b63-4059-b64e-ffd4ebec25ab tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:19.228604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-516c0fa5-1b63-4059-b64e-ffd4ebec25ab tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:19.229724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-516c0fa5-1b63-4059-b64e-ffd4ebec25ab tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:19.230446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-516c0fa5-1b63-4059-b64e-ffd4ebec25ab tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:19.231138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-516c0fa5-1b63-4059-b64e-ffd4ebec25ab tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:19.292836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG neutronclient.v2_0.client [None req-28ede7bd-5314-4366-9d6e-135f35154489 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b8325c15-f90e-476d-b468-9719be9ee920 does not exist", "detail": ""}} {{(pid=128970) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:50:19.293941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.security_group_api [None req-28ede7bd-5314-4366-9d6e-135f35154489 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Neutron security group b8325c15-f90e-476d-b468-9719be9ee920 not found {{(pid=128970) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:50:19.294909 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-28ede7bd-5314-4366-9d6e-135f35154489 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] HTTP exception thrown: Security group b8325c15-f90e-476d-b468-9719be9ee920 does not exist Sep 08 12:50:19.294909 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-6de3c345-fcd0-4e81-9815-e2df1dc5fe23'] Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28ede7bd-5314-4366-9d6e-135f35154489 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Request method failure captured: Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/os-security-groups/b8325c15-f90e-476d-b468-9719be9ee920 HTTP/1.1 Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 101 Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeUAi3EhtLlrSw4EiW0Fb-CbzWV8WDmN7qJda9tAaWAGzcEq_5mZEEYsAvBgG-48e8d86cUGWuALuENyH1NLA3pWeLBQ-V4Fie6Gfc7534ShoxpZ06sqz89byeesUs5awy9v3H7q72byFNLqCYJbnCjZQcFD1l_-kS98iLVUcjMIb-Y Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 6684ba23af6e4c3ca9441a32292cd50d Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-507956097 Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6684ba23af6e4c3ca9441a32292cd50d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-507956097 Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 6684ba23af6e4c3ca9441a32292cd50d Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-507956097 Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsNegativeTestJSON-507956097-project Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 22a91fc7ffbd4ae2bdcd7822358c8c37 Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-507956097-project Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: {"security_group": {"name": "tempest-sg-597996332", "description": "tempest-description-1060552969"}} Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: exception: Security group b8325c15-f90e-476d-b468-9719be9ee920 does not exist Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-6de3c345-fcd0-4e81-9815-e2df1dc5fe23'] Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'b8325c15-f90e-476d-b468-9719be9ee920', 'body': {'security_group': {'name': 'tempest-sg-597996332', 'description': 'tempest-description-1060552969'}}} Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:50:19.299639 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b8325c15-f90e-476d-b468-9719be9ee920 does not exist Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6de3c345-fcd0-4e81-9815-e2df1dc5fe23'] Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b8325c15-f90e-476d-b468-9719be9ee920 does not exist Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6de3c345-fcd0-4e81-9815-e2df1dc5fe23'] Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b8325c15-f90e-476d-b468-9719be9ee920 does not exist Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6de3c345-fcd0-4e81-9815-e2df1dc5fe23'] Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b8325c15-f90e-476d-b468-9719be9ee920 does not exist Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6de3c345-fcd0-4e81-9815-e2df1dc5fe23'] Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28ede7bd-5314-4366-9d6e-135f35154489 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] Returning 404 to user: Security group b8325c15-f90e-476d-b468-9719be9ee920 does not exist Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-6de3c345-fcd0-4e81-9815-e2df1dc5fe23'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:19.303637 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-28ede7bd-5314-4366-9d6e-135f35154489 tempest-SecurityGroupsNegativeTestJSON-507956097 tempest-SecurityGroupsNegativeTestJSON-507956097-project] 10.222.0.78 "PUT /compute/v2.1/os-security-groups/b8325c15-f90e-476d-b468-9719be9ee920" status: 404 len: 194 microversion: 2.1 time: 0.147332 Sep 08 12:50:19.322826 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1204/2277] 10.222.0.78 () {60 vars in 1290 bytes} [Thu Sep 8 12:50:19 2022] PUT /compute/v2.1/os-security-groups/b8325c15-f90e-476d-b468-9719be9ee920 => generated 194 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:50:19.884170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ccbba73f-cc87-4c77-a990-788ae1897738 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:19.885757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ccbba73f-cc87-4c77-a990-788ae1897738 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:19.913101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccbba73f-cc87-4c77-a990-788ae1897738 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:19.916920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccbba73f-cc87-4c77-a990-788ae1897738 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:19.918285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccbba73f-cc87-4c77-a990-788ae1897738 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:19.920028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccbba73f-cc87-4c77-a990-788ae1897738 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:19.922056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccbba73f-cc87-4c77-a990-788ae1897738 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:19.923212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccbba73f-cc87-4c77-a990-788ae1897738 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:20.182439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-516c0fa5-1b63-4059-b64e-ffd4ebec25ab tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:20.203787 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-516c0fa5-1b63-4059-b64e-ffd4ebec25ab tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1505 microversion: 2.1 time: 1.002417 Sep 08 12:50:20.221552 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1074/2278] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:19 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1505 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:20.226373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ccbba73f-cc87-4c77-a990-788ae1897738 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:20.240563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a87a54ea-0ce7-4742-9a2f-dd81a78143aa tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:20.248212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a87a54ea-0ce7-4742-9a2f-dd81a78143aa tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:20.258595 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ccbba73f-cc87-4c77-a990-788ae1897738 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1274 microversion: 2.1 time: 0.389988 Sep 08 12:50:20.260829 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1205/2279] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:19 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1274 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:20.272180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c97b6ab7-b382-455d-bc3b-55fbe5e013f3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:20.273566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c97b6ab7-b382-455d-bc3b-55fbe5e013f3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:20.284514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c97b6ab7-b382-455d-bc3b-55fbe5e013f3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:20.285680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c97b6ab7-b382-455d-bc3b-55fbe5e013f3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:20.286578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c97b6ab7-b382-455d-bc3b-55fbe5e013f3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:20.288602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c97b6ab7-b382-455d-bc3b-55fbe5e013f3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:20.289594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c97b6ab7-b382-455d-bc3b-55fbe5e013f3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:20.290471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c97b6ab7-b382-455d-bc3b-55fbe5e013f3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:20.293596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a87a54ea-0ce7-4742-9a2f-dd81a78143aa tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:20.295029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a87a54ea-0ce7-4742-9a2f-dd81a78143aa tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:20.296681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a87a54ea-0ce7-4742-9a2f-dd81a78143aa tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:20.298288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a87a54ea-0ce7-4742-9a2f-dd81a78143aa tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:20.299463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a87a54ea-0ce7-4742-9a2f-dd81a78143aa tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:20.300519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a87a54ea-0ce7-4742-9a2f-dd81a78143aa tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:21.137731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a87a54ea-0ce7-4742-9a2f-dd81a78143aa tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:21.149278 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a87a54ea-0ce7-4742-9a2f-dd81a78143aa tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1316 microversion: 2.1 time: 0.922683 Sep 08 12:50:21.150134 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1075/2280] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:20 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1316 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:21.163125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c97b6ab7-b382-455d-bc3b-55fbe5e013f3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:21.179978 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c97b6ab7-b382-455d-bc3b-55fbe5e013f3 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1505 microversion: 2.1 time: 0.917453 Sep 08 12:50:21.181203 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1206/2281] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:20 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1505 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:21.224742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:21.230722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:21.242274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:21.243180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:21.243786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:21.245280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:21.246262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:21.247297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:21.305654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-24a33d2c-91aa-4c20-b399-f8c8f5525678 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:21.329760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-24a33d2c-91aa-4c20-b399-f8c8f5525678 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:21.358293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24a33d2c-91aa-4c20-b399-f8c8f5525678 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:21.359759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24a33d2c-91aa-4c20-b399-f8c8f5525678 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:21.360548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24a33d2c-91aa-4c20-b399-f8c8f5525678 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:21.368554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24a33d2c-91aa-4c20-b399-f8c8f5525678 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:21.370249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24a33d2c-91aa-4c20-b399-f8c8f5525678 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:21.371526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24a33d2c-91aa-4c20-b399-f8c8f5525678 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:21.394591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:50:21.395074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:50:21.395603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:50:21.396266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:50:21.396891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:50:21.420859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:21.500605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:21.512112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:21.515100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:21.516459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:21.518267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:21.519417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:21.520345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:21.579443 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f6adacf5-c7b0-4bb5-909b-adf590f5ca99 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "POST /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48/action" status: 202 len: 1111 microversion: 2.1 time: 0.362057 Sep 08 12:50:21.580989 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1076/2282] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:50:21 2022] POST /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48/action => generated 1111 bytes in 365 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 08 12:50:21.608989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-013b037e-482d-48d6-aaaf-851b346db449 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:21.610611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-013b037e-482d-48d6-aaaf-851b346db449 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:21.623135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-013b037e-482d-48d6-aaaf-851b346db449 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:21.626173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-013b037e-482d-48d6-aaaf-851b346db449 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:21.626961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-013b037e-482d-48d6-aaaf-851b346db449 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:21.629441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-013b037e-482d-48d6-aaaf-851b346db449 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:21.630453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-013b037e-482d-48d6-aaaf-851b346db449 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:21.631360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-013b037e-482d-48d6-aaaf-851b346db449 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:21.837590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-24a33d2c-91aa-4c20-b399-f8c8f5525678 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:21.864923 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-24a33d2c-91aa-4c20-b399-f8c8f5525678 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1280 microversion: 2.1 time: 0.568278 Sep 08 12:50:21.865960 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1207/2283] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:21 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1280 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:21.922668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:22.194386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a1854c53-aa28-466e-8ca2-98f771ee45a3 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:22.196076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a1854c53-aa28-466e-8ca2-98f771ee45a3 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:22.211692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1854c53-aa28-466e-8ca2-98f771ee45a3 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:22.213205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1854c53-aa28-466e-8ca2-98f771ee45a3 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:22.214615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1854c53-aa28-466e-8ca2-98f771ee45a3 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:22.216262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1854c53-aa28-466e-8ca2-98f771ee45a3 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:22.217518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1854c53-aa28-466e-8ca2-98f771ee45a3 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:22.218847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1854c53-aa28-466e-8ca2-98f771ee45a3 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:22.456665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-013b037e-482d-48d6-aaaf-851b346db449 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:22.480295 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-013b037e-482d-48d6-aaaf-851b346db449 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1516 microversion: 2.1 time: 0.879739 Sep 08 12:50:22.488472 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1077/2284] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:21 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1516 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:22.818844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a1854c53-aa28-466e-8ca2-98f771ee45a3 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:22.835721 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a1854c53-aa28-466e-8ca2-98f771ee45a3 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1316 microversion: 2.1 time: 0.649998 Sep 08 12:50:22.836737 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1208/2285] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:22 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1316 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:50:22.918454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f3b49bcb-0047-4e4a-8fce-eef06a10ff6e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:22.920168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f3b49bcb-0047-4e4a-8fce-eef06a10ff6e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:22.939114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3b49bcb-0047-4e4a-8fce-eef06a10ff6e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:22.940039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3b49bcb-0047-4e4a-8fce-eef06a10ff6e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:22.940832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3b49bcb-0047-4e4a-8fce-eef06a10ff6e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:22.942218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3b49bcb-0047-4e4a-8fce-eef06a10ff6e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:22.944369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3b49bcb-0047-4e4a-8fce-eef06a10ff6e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:22.945367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3b49bcb-0047-4e4a-8fce-eef06a10ff6e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:23.123742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f3b49bcb-0047-4e4a-8fce-eef06a10ff6e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:23.145089 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f3b49bcb-0047-4e4a-8fce-eef06a10ff6e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1280 microversion: 2.1 time: 0.246404 Sep 08 12:50:23.172762 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1078/2286] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:22 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1280 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:50:23.523690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9129ecea-eef0-4646-af20-5650c233995e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:23.525077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9129ecea-eef0-4646-af20-5650c233995e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:23.540356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9129ecea-eef0-4646-af20-5650c233995e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:23.544672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9129ecea-eef0-4646-af20-5650c233995e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:23.546806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9129ecea-eef0-4646-af20-5650c233995e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:23.548850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9129ecea-eef0-4646-af20-5650c233995e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:23.552483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9129ecea-eef0-4646-af20-5650c233995e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:23.554040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9129ecea-eef0-4646-af20-5650c233995e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:23.872436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-840ca86f-809b-4a34-89fe-0dc5602638e4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:23.873861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-840ca86f-809b-4a34-89fe-0dc5602638e4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:23.885292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-840ca86f-809b-4a34-89fe-0dc5602638e4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:23.886687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-840ca86f-809b-4a34-89fe-0dc5602638e4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:23.887886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-840ca86f-809b-4a34-89fe-0dc5602638e4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:23.889164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-840ca86f-809b-4a34-89fe-0dc5602638e4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:23.891215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-840ca86f-809b-4a34-89fe-0dc5602638e4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:23.892583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-840ca86f-809b-4a34-89fe-0dc5602638e4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:24.263307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:24.368440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9129ecea-eef0-4646-af20-5650c233995e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:24.403786 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9129ecea-eef0-4646-af20-5650c233995e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1516 microversion: 2.1 time: 0.888981 Sep 08 12:50:24.420728 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1209/2287] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:23 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1516 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:24.453637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0e4ed906-644f-453b-9229-8c4e58ec6d5c tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:24.454783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0e4ed906-644f-453b-9229-8c4e58ec6d5c tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:24.470861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e4ed906-644f-453b-9229-8c4e58ec6d5c tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:24.472252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e4ed906-644f-453b-9229-8c4e58ec6d5c tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:24.473342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e4ed906-644f-453b-9229-8c4e58ec6d5c tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:24.476936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e4ed906-644f-453b-9229-8c4e58ec6d5c tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:24.478237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e4ed906-644f-453b-9229-8c4e58ec6d5c tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:24.479383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e4ed906-644f-453b-9229-8c4e58ec6d5c tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:24.750915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0e4ed906-644f-453b-9229-8c4e58ec6d5c tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:24.762133 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0e4ed906-644f-453b-9229-8c4e58ec6d5c tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1280 microversion: 2.1 time: 0.339080 Sep 08 12:50:24.763522 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1210/2288] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:24 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1280 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:24.936267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-840ca86f-809b-4a34-89fe-0dc5602638e4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:24.957069 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-840ca86f-809b-4a34-89fe-0dc5602638e4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1316 microversion: 2.1 time: 1.091700 Sep 08 12:50:24.958606 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1079/2289] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:23 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1316 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:25.207460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-93f889d7-05cd-4632-8398-5c404f9134cb req-c7e69ba4-961d-407c-9774-ca3ee13ac7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "883b526c-7f9c-4fe9-b5ad-26aa46f05f78", "tag": "4573b7c0-61ea-430d-b283-e6fc56ec3979"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:25.255689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-93f889d7-05cd-4632-8398-5c404f9134cb req-c7e69ba4-961d-407c-9774-ca3ee13ac7e9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:25.256854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-93f889d7-05cd-4632-8398-5c404f9134cb req-c7e69ba4-961d-407c-9774-ca3ee13ac7e9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:25.258118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-93f889d7-05cd-4632-8398-5c404f9134cb req-c7e69ba4-961d-407c-9774-ca3ee13ac7e9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:25.285075 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-93f889d7-05cd-4632-8398-5c404f9134cb req-c7e69ba4-961d-407c-9774-ca3ee13ac7e9 service nova] Creating event network-changed:4573b7c0-61ea-430d-b283-e6fc56ec3979 for instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 on n-h2-852084-10 Sep 08 12:50:25.294904 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-93f889d7-05cd-4632-8398-5c404f9134cb req-c7e69ba4-961d-407c-9774-ca3ee13ac7e9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097534 Sep 08 12:50:25.297152 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1211/2290] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:25.461187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e5e98589-918c-4729-bc9a-188526140750 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:25.462818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e5e98589-918c-4729-bc9a-188526140750 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:25.475705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5e98589-918c-4729-bc9a-188526140750 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:25.477129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5e98589-918c-4729-bc9a-188526140750 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:25.478261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5e98589-918c-4729-bc9a-188526140750 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:25.479958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5e98589-918c-4729-bc9a-188526140750 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:25.481106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5e98589-918c-4729-bc9a-188526140750 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:25.482199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5e98589-918c-4729-bc9a-188526140750 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:25.810402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2cb171bb-c9e6-4e2c-823e-d8985477577f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:25.813924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2cb171bb-c9e6-4e2c-823e-d8985477577f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:25.836895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cb171bb-c9e6-4e2c-823e-d8985477577f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:25.838499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cb171bb-c9e6-4e2c-823e-d8985477577f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:25.839882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cb171bb-c9e6-4e2c-823e-d8985477577f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:25.841609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cb171bb-c9e6-4e2c-823e-d8985477577f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:25.843368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cb171bb-c9e6-4e2c-823e-d8985477577f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:25.844814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cb171bb-c9e6-4e2c-823e-d8985477577f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:26.090377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2cb171bb-c9e6-4e2c-823e-d8985477577f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:26.106201 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2cb171bb-c9e6-4e2c-823e-d8985477577f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1280 microversion: 2.1 time: 0.312532 Sep 08 12:50:26.107495 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1212/2291] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:25 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1280 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:50:26.123505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bf47f03a-c31d-405b-ba8d-ee4fd5470e92 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:26.129565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bf47f03a-c31d-405b-ba8d-ee4fd5470e92 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:26.154113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf47f03a-c31d-405b-ba8d-ee4fd5470e92 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:26.154492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf47f03a-c31d-405b-ba8d-ee4fd5470e92 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:26.157499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf47f03a-c31d-405b-ba8d-ee4fd5470e92 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:26.159138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf47f03a-c31d-405b-ba8d-ee4fd5470e92 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:26.162039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf47f03a-c31d-405b-ba8d-ee4fd5470e92 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:26.166123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf47f03a-c31d-405b-ba8d-ee4fd5470e92 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:26.673891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bf47f03a-c31d-405b-ba8d-ee4fd5470e92 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:26.709780 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bf47f03a-c31d-405b-ba8d-ee4fd5470e92 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1316 microversion: 2.1 time: 0.597501 Sep 08 12:50:26.714140 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1213/2292] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:26 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1316 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:26.816446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e5e98589-918c-4729-bc9a-188526140750 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:26.834889 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e5e98589-918c-4729-bc9a-188526140750 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1516 microversion: 2.1 time: 1.381038 Sep 08 12:50:26.835539 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1080/2293] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:25 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1516 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:27.151636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e58d2a1-38f7-44e1-b881-87e8e690a806 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:27.153825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9e58d2a1-38f7-44e1-b881-87e8e690a806 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:27.169690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:27.172760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e58d2a1-38f7-44e1-b881-87e8e690a806 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:27.173265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e58d2a1-38f7-44e1-b881-87e8e690a806 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:27.173716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e58d2a1-38f7-44e1-b881-87e8e690a806 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:27.174463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e58d2a1-38f7-44e1-b881-87e8e690a806 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:27.174919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e58d2a1-38f7-44e1-b881-87e8e690a806 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:27.176146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e58d2a1-38f7-44e1-b881-87e8e690a806 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:27.748800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db47cbd5-f917-4f1c-966e-571250b262bb tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:27.749710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-db47cbd5-f917-4f1c-966e-571250b262bb tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:27.763781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db47cbd5-f917-4f1c-966e-571250b262bb tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:27.767146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db47cbd5-f917-4f1c-966e-571250b262bb tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:27.768408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db47cbd5-f917-4f1c-966e-571250b262bb tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:27.769568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db47cbd5-f917-4f1c-966e-571250b262bb tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:27.770645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db47cbd5-f917-4f1c-966e-571250b262bb tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:27.771308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db47cbd5-f917-4f1c-966e-571250b262bb tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:27.826275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:27.935475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9e58d2a1-38f7-44e1-b881-87e8e690a806 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:27.947704 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e58d2a1-38f7-44e1-b881-87e8e690a806 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1322 microversion: 2.1 time: 0.800238 Sep 08 12:50:27.960242 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1214/2294] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:27 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1322 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:27.980179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-96d17e73-9125-46e5-894c-65454979af3e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:27.986557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-96d17e73-9125-46e5-894c-65454979af3e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:27.999522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96d17e73-9125-46e5-894c-65454979af3e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:28.000368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96d17e73-9125-46e5-894c-65454979af3e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:28.001007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96d17e73-9125-46e5-894c-65454979af3e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:28.001928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96d17e73-9125-46e5-894c-65454979af3e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:28.002635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96d17e73-9125-46e5-894c-65454979af3e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:28.003358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96d17e73-9125-46e5-894c-65454979af3e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:28.331429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-db47cbd5-f917-4f1c-966e-571250b262bb tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:28.369790 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-db47cbd5-f917-4f1c-966e-571250b262bb tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1316 microversion: 2.1 time: 0.624478 Sep 08 12:50:28.375618 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1081/2295] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:27 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1316 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:50:28.435976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-96d17e73-9125-46e5-894c-65454979af3e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:28.457814 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-96d17e73-9125-46e5-894c-65454979af3e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1516 microversion: 2.1 time: 0.495262 Sep 08 12:50:28.461471 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1215/2296] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:27 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1516 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:28.985684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-671124fd-84c0-4788-8bf3-e00f40280dfa tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:28.989306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-671124fd-84c0-4788-8bf3-e00f40280dfa tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:29.023500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-671124fd-84c0-4788-8bf3-e00f40280dfa tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:29.024880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-671124fd-84c0-4788-8bf3-e00f40280dfa tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:29.026015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-671124fd-84c0-4788-8bf3-e00f40280dfa tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:29.027862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-671124fd-84c0-4788-8bf3-e00f40280dfa tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:29.029177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-671124fd-84c0-4788-8bf3-e00f40280dfa tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:29.031050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-671124fd-84c0-4788-8bf3-e00f40280dfa tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:29.397127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-87ae3159-c689-4add-a11b-9c286ef20e0c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:29.398181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-87ae3159-c689-4add-a11b-9c286ef20e0c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:29.405012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:29.409256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87ae3159-c689-4add-a11b-9c286ef20e0c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:29.410151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87ae3159-c689-4add-a11b-9c286ef20e0c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:29.410837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87ae3159-c689-4add-a11b-9c286ef20e0c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:29.411993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87ae3159-c689-4add-a11b-9c286ef20e0c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:29.412840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87ae3159-c689-4add-a11b-9c286ef20e0c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:29.413598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87ae3159-c689-4add-a11b-9c286ef20e0c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:29.801391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-671124fd-84c0-4788-8bf3-e00f40280dfa tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:29.818334 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-671124fd-84c0-4788-8bf3-e00f40280dfa tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1322 microversion: 2.1 time: 0.841631 Sep 08 12:50:29.831446 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1082/2297] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:28 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1322 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:29.856019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c92716df-c386-4e58-872b-4686c68ceda1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:29.858555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c92716df-c386-4e58-872b-4686c68ceda1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:29.923634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c92716df-c386-4e58-872b-4686c68ceda1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:29.925336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c92716df-c386-4e58-872b-4686c68ceda1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:29.926456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c92716df-c386-4e58-872b-4686c68ceda1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:29.927995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c92716df-c386-4e58-872b-4686c68ceda1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:29.928799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c92716df-c386-4e58-872b-4686c68ceda1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:29.929689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c92716df-c386-4e58-872b-4686c68ceda1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:30.013638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-87ae3159-c689-4add-a11b-9c286ef20e0c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:30.024815 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-87ae3159-c689-4add-a11b-9c286ef20e0c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1316 microversion: 2.1 time: 0.631851 Sep 08 12:50:30.035708 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1216/2298] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:29 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:30.868473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d9f2b0e4-f872-4fe3-ad10-023b2158b937 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:30.869600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d9f2b0e4-f872-4fe3-ad10-023b2158b937 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:30.878444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9f2b0e4-f872-4fe3-ad10-023b2158b937 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:30.879391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9f2b0e4-f872-4fe3-ad10-023b2158b937 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:30.880167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9f2b0e4-f872-4fe3-ad10-023b2158b937 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:30.881177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9f2b0e4-f872-4fe3-ad10-023b2158b937 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:30.881942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9f2b0e4-f872-4fe3-ad10-023b2158b937 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:30.882607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9f2b0e4-f872-4fe3-ad10-023b2158b937 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:31.318267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c92716df-c386-4e58-872b-4686c68ceda1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:31.350962 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c92716df-c386-4e58-872b-4686c68ceda1 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1516 microversion: 2.1 time: 1.517131 Sep 08 12:50:31.351881 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1083/2299] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:29 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1516 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:31.364739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b75c9e53-5b60-4be8-a9cd-f8d639f845e2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:31.367059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b75c9e53-5b60-4be8-a9cd-f8d639f845e2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:31.384634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b75c9e53-5b60-4be8-a9cd-f8d639f845e2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:31.386603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b75c9e53-5b60-4be8-a9cd-f8d639f845e2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:31.388215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b75c9e53-5b60-4be8-a9cd-f8d639f845e2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:31.390298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b75c9e53-5b60-4be8-a9cd-f8d639f845e2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:31.392600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b75c9e53-5b60-4be8-a9cd-f8d639f845e2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:31.396596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b75c9e53-5b60-4be8-a9cd-f8d639f845e2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:32.021441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d9f2b0e4-f872-4fe3-ad10-023b2158b937 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:32.050450 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d9f2b0e4-f872-4fe3-ad10-023b2158b937 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1322 microversion: 2.1 time: 1.186737 Sep 08 12:50:32.051603 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1217/2300] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:30 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1322 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:50:32.066450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-31a8344e-fed3-41bc-88b9-69315fcf69dd req-ff477a8f-bd6a-4807-b70b-b194f9e46e23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96af37e5-73b1-44a9-bdd6-7bdc5508b677", "tag": "fd4ccce2-9d29-4795-817f-fa28b9ea9b80"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:32.113079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-31a8344e-fed3-41bc-88b9-69315fcf69dd req-ff477a8f-bd6a-4807-b70b-b194f9e46e23 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:32.114137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-31a8344e-fed3-41bc-88b9-69315fcf69dd req-ff477a8f-bd6a-4807-b70b-b194f9e46e23 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:32.114856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-31a8344e-fed3-41bc-88b9-69315fcf69dd req-ff477a8f-bd6a-4807-b70b-b194f9e46e23 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:32.143423 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-31a8344e-fed3-41bc-88b9-69315fcf69dd req-ff477a8f-bd6a-4807-b70b-b194f9e46e23 service nova] Creating event network-changed:fd4ccce2-9d29-4795-817f-fa28b9ea9b80 for instance 96af37e5-73b1-44a9-bdd6-7bdc5508b677 on n-h1-852084-10 Sep 08 12:50:32.153963 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-31a8344e-fed3-41bc-88b9-69315fcf69dd req-ff477a8f-bd6a-4807-b70b-b194f9e46e23 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099939 Sep 08 12:50:32.155977 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1218/2301] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:32.402225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a26786fd-d501-421f-806b-2862cc356cf6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:32.410095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a26786fd-d501-421f-806b-2862cc356cf6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:32.432476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a26786fd-d501-421f-806b-2862cc356cf6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:32.432989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a26786fd-d501-421f-806b-2862cc356cf6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:32.433437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a26786fd-d501-421f-806b-2862cc356cf6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:32.434321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a26786fd-d501-421f-806b-2862cc356cf6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:32.434760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a26786fd-d501-421f-806b-2862cc356cf6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:32.435685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a26786fd-d501-421f-806b-2862cc356cf6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:32.710165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b75c9e53-5b60-4be8-a9cd-f8d639f845e2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:32.734177 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b75c9e53-5b60-4be8-a9cd-f8d639f845e2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1316 microversion: 2.1 time: 1.374856 Sep 08 12:50:32.759292 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1084/2302] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:31 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1316 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:33.105433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7b9f518e-fd31-4b72-8f65-7017b8b37865 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:33.108746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7b9f518e-fd31-4b72-8f65-7017b8b37865 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:33.117934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:33.147572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b9f518e-fd31-4b72-8f65-7017b8b37865 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:33.150540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b9f518e-fd31-4b72-8f65-7017b8b37865 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:33.151452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b9f518e-fd31-4b72-8f65-7017b8b37865 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:33.152823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b9f518e-fd31-4b72-8f65-7017b8b37865 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:33.153755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b9f518e-fd31-4b72-8f65-7017b8b37865 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:33.154559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b9f518e-fd31-4b72-8f65-7017b8b37865 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:33.416638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a26786fd-d501-421f-806b-2862cc356cf6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:33.464928 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a26786fd-d501-421f-806b-2862cc356cf6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1516 microversion: 2.1 time: 1.069068 Sep 08 12:50:33.468057 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1219/2303] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:32 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1516 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:50:33.795445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-239c6154-c1c3-40cb-809a-d2d64102b8c2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:33.808579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-239c6154-c1c3-40cb-809a-d2d64102b8c2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:33.816538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-239c6154-c1c3-40cb-809a-d2d64102b8c2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:33.817434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-239c6154-c1c3-40cb-809a-d2d64102b8c2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:33.818262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-239c6154-c1c3-40cb-809a-d2d64102b8c2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:33.819296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-239c6154-c1c3-40cb-809a-d2d64102b8c2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:33.819961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-239c6154-c1c3-40cb-809a-d2d64102b8c2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:33.821525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-239c6154-c1c3-40cb-809a-d2d64102b8c2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:34.106356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7b9f518e-fd31-4b72-8f65-7017b8b37865 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:34.158943 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7b9f518e-fd31-4b72-8f65-7017b8b37865 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1322 microversion: 2.1 time: 1.061677 Sep 08 12:50:34.162423 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1085/2304] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:33 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1322 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:34.503587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0a91ebd4-2012-427a-b985-f3943d8bfe29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:34.505069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0a91ebd4-2012-427a-b985-f3943d8bfe29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:34.517008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a91ebd4-2012-427a-b985-f3943d8bfe29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:34.518776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a91ebd4-2012-427a-b985-f3943d8bfe29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:34.519926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a91ebd4-2012-427a-b985-f3943d8bfe29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:34.521499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a91ebd4-2012-427a-b985-f3943d8bfe29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:34.522604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a91ebd4-2012-427a-b985-f3943d8bfe29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:34.523647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a91ebd4-2012-427a-b985-f3943d8bfe29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:34.566094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-239c6154-c1c3-40cb-809a-d2d64102b8c2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:34.589542 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-239c6154-c1c3-40cb-809a-d2d64102b8c2 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1316 microversion: 2.1 time: 0.800148 Sep 08 12:50:34.592603 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1220/2305] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:33 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1316 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:50:35.093256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0a91ebd4-2012-427a-b985-f3943d8bfe29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:35.105627 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0a91ebd4-2012-427a-b985-f3943d8bfe29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1516 microversion: 2.1 time: 0.609540 Sep 08 12:50:35.127255 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1086/2306] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:34 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1516 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:35.190320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e6cc102-a887-42ab-8cda-625f14e9a874 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:35.191493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e6cc102-a887-42ab-8cda-625f14e9a874 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:35.218848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e6cc102-a887-42ab-8cda-625f14e9a874 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:35.219812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e6cc102-a887-42ab-8cda-625f14e9a874 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:35.220618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e6cc102-a887-42ab-8cda-625f14e9a874 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:35.221858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e6cc102-a887-42ab-8cda-625f14e9a874 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:35.222668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e6cc102-a887-42ab-8cda-625f14e9a874 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:35.223517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e6cc102-a887-42ab-8cda-625f14e9a874 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:35.628928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cf486215-d288-4b86-b831-1172f7ec7d86 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:35.629579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cf486215-d288-4b86-b831-1172f7ec7d86 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:35.639363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf486215-d288-4b86-b831-1172f7ec7d86 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:35.641066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf486215-d288-4b86-b831-1172f7ec7d86 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:35.642244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf486215-d288-4b86-b831-1172f7ec7d86 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:35.643207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf486215-d288-4b86-b831-1172f7ec7d86 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:35.643895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf486215-d288-4b86-b831-1172f7ec7d86 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:35.644520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf486215-d288-4b86-b831-1172f7ec7d86 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:36.387441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cf486215-d288-4b86-b831-1172f7ec7d86 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:36.424469 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cf486215-d288-4b86-b831-1172f7ec7d86 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1316 microversion: 2.1 time: 0.799331 Sep 08 12:50:36.425867 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1087/2307] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:35 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1316 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:36.440587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-935242a4-bc6f-4b64-b2e0-5a91a6911f86 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:36.442224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-935242a4-bc6f-4b64-b2e0-5a91a6911f86 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:36.461083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e6cc102-a887-42ab-8cda-625f14e9a874 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:36.474298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-935242a4-bc6f-4b64-b2e0-5a91a6911f86 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:36.477958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-935242a4-bc6f-4b64-b2e0-5a91a6911f86 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:36.481106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-935242a4-bc6f-4b64-b2e0-5a91a6911f86 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:36.490776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-935242a4-bc6f-4b64-b2e0-5a91a6911f86 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:36.496946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-935242a4-bc6f-4b64-b2e0-5a91a6911f86 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:36.498208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-935242a4-bc6f-4b64-b2e0-5a91a6911f86 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:36.506654 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e6cc102-a887-42ab-8cda-625f14e9a874 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1322 microversion: 2.1 time: 1.313010 Sep 08 12:50:36.520854 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1221/2308] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:35 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1322 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:36.888290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-935242a4-bc6f-4b64-b2e0-5a91a6911f86 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:36.909049 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-935242a4-bc6f-4b64-b2e0-5a91a6911f86 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1516 microversion: 2.1 time: 0.480440 Sep 08 12:50:36.910407 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1088/2309] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:36 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1516 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:37.484135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-62e71c59-b22a-4852-ae06-7ee566a63bd5 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:37.485237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-62e71c59-b22a-4852-ae06-7ee566a63bd5 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:37.510426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62e71c59-b22a-4852-ae06-7ee566a63bd5 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:37.524536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62e71c59-b22a-4852-ae06-7ee566a63bd5 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:37.525756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62e71c59-b22a-4852-ae06-7ee566a63bd5 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:37.527315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62e71c59-b22a-4852-ae06-7ee566a63bd5 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:37.528442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62e71c59-b22a-4852-ae06-7ee566a63bd5 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:37.529477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62e71c59-b22a-4852-ae06-7ee566a63bd5 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:37.562316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b8c111c0-df22-4e89-afbe-63d37134a63e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:37.565439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b8c111c0-df22-4e89-afbe-63d37134a63e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:37.593177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8c111c0-df22-4e89-afbe-63d37134a63e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:37.594466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8c111c0-df22-4e89-afbe-63d37134a63e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:37.604280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8c111c0-df22-4e89-afbe-63d37134a63e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:37.609598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8c111c0-df22-4e89-afbe-63d37134a63e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:37.610582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8c111c0-df22-4e89-afbe-63d37134a63e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:37.613979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8c111c0-df22-4e89-afbe-63d37134a63e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:38.585502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b8c111c0-df22-4e89-afbe-63d37134a63e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:38.613968 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b8c111c0-df22-4e89-afbe-63d37134a63e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1322 microversion: 2.1 time: 1.058994 Sep 08 12:50:38.615485 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1089/2310] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:37 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1322 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:38.643819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3d946842-94c8-4a01-a7cd-9a0dee8937b2 req-da201db4-a3d0-4410-ac0f-83adf58b2263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883b526c-7f9c-4fe9-b5ad-26aa46f05f78", "name": "network-vif-plugged", "status": "completed", "tag": "4573b7c0-61ea-430d-b283-e6fc56ec3979"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:38.679055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3d946842-94c8-4a01-a7cd-9a0dee8937b2 req-da201db4-a3d0-4410-ac0f-83adf58b2263 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:38.679859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3d946842-94c8-4a01-a7cd-9a0dee8937b2 req-da201db4-a3d0-4410-ac0f-83adf58b2263 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:38.685274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3d946842-94c8-4a01-a7cd-9a0dee8937b2 req-da201db4-a3d0-4410-ac0f-83adf58b2263 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:38.728609 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3d946842-94c8-4a01-a7cd-9a0dee8937b2 req-da201db4-a3d0-4410-ac0f-83adf58b2263 service nova] Creating event network-vif-plugged:4573b7c0-61ea-430d-b283-e6fc56ec3979 for instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 on n-h2-852084-10 Sep 08 12:50:38.756657 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3d946842-94c8-4a01-a7cd-9a0dee8937b2 req-da201db4-a3d0-4410-ac0f-83adf58b2263 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138741 Sep 08 12:50:38.758536 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1090/2311] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:50:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:38.788081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-df10daec-cb10-44d0-a647-8d115fcdd502 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:38.789983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-df10daec-cb10-44d0-a647-8d115fcdd502 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:38.804725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df10daec-cb10-44d0-a647-8d115fcdd502 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:38.806952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df10daec-cb10-44d0-a647-8d115fcdd502 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:38.808123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df10daec-cb10-44d0-a647-8d115fcdd502 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:38.809777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df10daec-cb10-44d0-a647-8d115fcdd502 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:38.810893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df10daec-cb10-44d0-a647-8d115fcdd502 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:38.812426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df10daec-cb10-44d0-a647-8d115fcdd502 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:38.848884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-62e71c59-b22a-4852-ae06-7ee566a63bd5 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:38.909455 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-62e71c59-b22a-4852-ae06-7ee566a63bd5 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1316 microversion: 2.1 time: 1.432265 Sep 08 12:50:38.913618 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1222/2312] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:37 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1316 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:50:39.666340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c2388065-dddd-4182-a8e2-c1d7bc989c76 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:39.668246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c2388065-dddd-4182-a8e2-c1d7bc989c76 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:39.694770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:39.721289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2388065-dddd-4182-a8e2-c1d7bc989c76 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:39.722167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2388065-dddd-4182-a8e2-c1d7bc989c76 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:39.722922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2388065-dddd-4182-a8e2-c1d7bc989c76 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:39.724222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2388065-dddd-4182-a8e2-c1d7bc989c76 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:39.725057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2388065-dddd-4182-a8e2-c1d7bc989c76 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:39.725827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2388065-dddd-4182-a8e2-c1d7bc989c76 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:39.769968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-df10daec-cb10-44d0-a647-8d115fcdd502 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:39.813151 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-df10daec-cb10-44d0-a647-8d115fcdd502 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1516 microversion: 2.1 time: 1.052170 Sep 08 12:50:39.835466 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1091/2313] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:38 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1516 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:39.968103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7adb90e6-cf37-4a96-ac9f-079356838e70 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:39.969166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7adb90e6-cf37-4a96-ac9f-079356838e70 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:39.993234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7adb90e6-cf37-4a96-ac9f-079356838e70 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:39.994059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7adb90e6-cf37-4a96-ac9f-079356838e70 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:39.998577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7adb90e6-cf37-4a96-ac9f-079356838e70 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:40.000165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7adb90e6-cf37-4a96-ac9f-079356838e70 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:40.003474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7adb90e6-cf37-4a96-ac9f-079356838e70 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:40.008954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7adb90e6-cf37-4a96-ac9f-079356838e70 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:40.298239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c2388065-dddd-4182-a8e2-c1d7bc989c76 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:40.337279 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c2388065-dddd-4182-a8e2-c1d7bc989c76 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1322 microversion: 2.1 time: 0.677988 Sep 08 12:50:40.356027 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1223/2314] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:39 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1322 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:40.441829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7adb90e6-cf37-4a96-ac9f-079356838e70 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:40.452471 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7adb90e6-cf37-4a96-ac9f-079356838e70 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1316 microversion: 2.1 time: 0.492930 Sep 08 12:50:40.455390 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1092/2315] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:39 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1316 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:40.857725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-53fdfd53-7f31-42f3-b1e6-e8f4c9201a93 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:40.858668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-53fdfd53-7f31-42f3-b1e6-e8f4c9201a93 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:40.877441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53fdfd53-7f31-42f3-b1e6-e8f4c9201a93 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:40.891406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53fdfd53-7f31-42f3-b1e6-e8f4c9201a93 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:40.892249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53fdfd53-7f31-42f3-b1e6-e8f4c9201a93 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:40.893611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53fdfd53-7f31-42f3-b1e6-e8f4c9201a93 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:40.894460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53fdfd53-7f31-42f3-b1e6-e8f4c9201a93 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:40.895774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53fdfd53-7f31-42f3-b1e6-e8f4c9201a93 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:40.930168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b7cd6b2f-3ea1-43ad-b4d6-9ca703364e26 req-89abc888-0ac4-4b81-9cf0-bfb5746364a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96af37e5-73b1-44a9-bdd6-7bdc5508b677", "name": "network-vif-plugged", "status": "completed", "tag": "fd4ccce2-9d29-4795-817f-fa28b9ea9b80"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:40.956380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b7cd6b2f-3ea1-43ad-b4d6-9ca703364e26 req-89abc888-0ac4-4b81-9cf0-bfb5746364a8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:40.959787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b7cd6b2f-3ea1-43ad-b4d6-9ca703364e26 req-89abc888-0ac4-4b81-9cf0-bfb5746364a8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:40.960679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b7cd6b2f-3ea1-43ad-b4d6-9ca703364e26 req-89abc888-0ac4-4b81-9cf0-bfb5746364a8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:40.985039 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b7cd6b2f-3ea1-43ad-b4d6-9ca703364e26 req-89abc888-0ac4-4b81-9cf0-bfb5746364a8 service nova] Creating event network-vif-plugged:fd4ccce2-9d29-4795-817f-fa28b9ea9b80 for instance 96af37e5-73b1-44a9-bdd6-7bdc5508b677 on n-h1-852084-10 Sep 08 12:50:40.992209 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b7cd6b2f-3ea1-43ad-b4d6-9ca703364e26 req-89abc888-0ac4-4b81-9cf0-bfb5746364a8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066764 Sep 08 12:50:40.993578 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1093/2316] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:50:41.345525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-53fdfd53-7f31-42f3-b1e6-e8f4c9201a93 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:41.364396 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-53fdfd53-7f31-42f3-b1e6-e8f4c9201a93 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1516 microversion: 2.1 time: 0.510624 Sep 08 12:50:41.365929 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1224/2317] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:40 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1516 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:50:41.382651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6a0ed85c-67f2-459b-a785-69182b21112a tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:41.383691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6a0ed85c-67f2-459b-a785-69182b21112a tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:41.393250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a0ed85c-67f2-459b-a785-69182b21112a tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:41.394016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a0ed85c-67f2-459b-a785-69182b21112a tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:41.394771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a0ed85c-67f2-459b-a785-69182b21112a tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:41.395681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a0ed85c-67f2-459b-a785-69182b21112a tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:41.396655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a0ed85c-67f2-459b-a785-69182b21112a tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:41.397756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a0ed85c-67f2-459b-a785-69182b21112a tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:41.481525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ebfb3e7-cc58-4b9e-afa4-28f31de4d22a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:41.483695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1ebfb3e7-cc58-4b9e-afa4-28f31de4d22a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:41.500192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ebfb3e7-cc58-4b9e-afa4-28f31de4d22a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:41.500685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ebfb3e7-cc58-4b9e-afa4-28f31de4d22a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:41.501224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ebfb3e7-cc58-4b9e-afa4-28f31de4d22a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:41.501985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ebfb3e7-cc58-4b9e-afa4-28f31de4d22a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:41.506745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ebfb3e7-cc58-4b9e-afa4-28f31de4d22a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:41.509391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ebfb3e7-cc58-4b9e-afa4-28f31de4d22a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:41.570648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:41.837523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6a0ed85c-67f2-459b-a785-69182b21112a tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:41.861790 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6a0ed85c-67f2-459b-a785-69182b21112a tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1322 microversion: 2.1 time: 0.484233 Sep 08 12:50:41.864808 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1094/2318] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:41 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1322 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:41.962329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1ebfb3e7-cc58-4b9e-afa4-28f31de4d22a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:41.980493 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1ebfb3e7-cc58-4b9e-afa4-28f31de4d22a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1465 microversion: 2.1 time: 0.506462 Sep 08 12:50:41.981746 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1225/2319] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:41 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1465 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:42.037575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ad08079-3da6-4255-924a-773531fe1c57 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-616548509", "metadata": {"image_type": "test"}}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:42.042298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ad08079-3da6-4255-924a-773531fe1c57 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:42.065616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ad08079-3da6-4255-924a-773531fe1c57 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:42.067052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ad08079-3da6-4255-924a-773531fe1c57 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:42.067841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ad08079-3da6-4255-924a-773531fe1c57 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:42.068744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ad08079-3da6-4255-924a-773531fe1c57 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:42.069311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ad08079-3da6-4255-924a-773531fe1c57 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:42.070537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ad08079-3da6-4255-924a-773531fe1c57 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:42.173579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-3ad08079-3da6-4255-924a-773531fe1c57 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Getting quotas for project a856789ce4f64b95823378a2600f6878. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:50:42.187059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-3ad08079-3da6-4255-924a-773531fe1c57 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Getting quotas for user 22b4be40ad8640e59bef7ed17f9bfda0 and project a856789ce4f64b95823378a2600f6878. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:50:42.394903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bc1f59f0-d27f-4dfe-9c4f-e4ae9e1a3fcd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:42.396876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bc1f59f0-d27f-4dfe-9c4f-e4ae9e1a3fcd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:42.416503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc1f59f0-d27f-4dfe-9c4f-e4ae9e1a3fcd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:42.422034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc1f59f0-d27f-4dfe-9c4f-e4ae9e1a3fcd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:42.422631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc1f59f0-d27f-4dfe-9c4f-e4ae9e1a3fcd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:42.423449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc1f59f0-d27f-4dfe-9c4f-e4ae9e1a3fcd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:42.423931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc1f59f0-d27f-4dfe-9c4f-e4ae9e1a3fcd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:42.424397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc1f59f0-d27f-4dfe-9c4f-e4ae9e1a3fcd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:42.592245 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ad08079-3da6-4255-924a-773531fe1c57 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "POST /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78/action" status: 202 len: 0 microversion: 2.1 time: 0.558676 Sep 08 12:50:42.598408 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1095/2320] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:50:42 2022] POST /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Sep 08 12:50:42.975746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c12f29a0-50d3-48fd-8013-b1f59ebec269 tempest-AZV2TestJSON-179110648 tempest-AZV2TestJSON-179110648-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:42.979361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c12f29a0-50d3-48fd-8013-b1f59ebec269 tempest-AZV2TestJSON-179110648 tempest-AZV2TestJSON-179110648-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:42.979901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c12f29a0-50d3-48fd-8013-b1f59ebec269 tempest-AZV2TestJSON-179110648 tempest-AZV2TestJSON-179110648-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:42.981442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c12f29a0-50d3-48fd-8013-b1f59ebec269 tempest-AZV2TestJSON-179110648 tempest-AZV2TestJSON-179110648-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:42.983557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c12f29a0-50d3-48fd-8013-b1f59ebec269 tempest-AZV2TestJSON-179110648 tempest-AZV2TestJSON-179110648-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:42.984061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c12f29a0-50d3-48fd-8013-b1f59ebec269 tempest-AZV2TestJSON-179110648 tempest-AZV2TestJSON-179110648-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:42.986062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c12f29a0-50d3-48fd-8013-b1f59ebec269 tempest-AZV2TestJSON-179110648 tempest-AZV2TestJSON-179110648-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:43.010950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bc1f59f0-d27f-4dfe-9c4f-e4ae9e1a3fcd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:43.032009 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bc1f59f0-d27f-4dfe-9c4f-e4ae9e1a3fcd tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1516 microversion: 2.1 time: 0.641335 Sep 08 12:50:43.033984 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1226/2321] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:42 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1516 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:50:43.061018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7643a2de-ed13-4df0-a306-07b0ad4b6d11 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f0bd820>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:43.096596 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c12f29a0-50d3-48fd-8013-b1f59ebec269 tempest-AZV2TestJSON-179110648 tempest-AZV2TestJSON-179110648-project] 10.222.0.78 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.496256 Sep 08 12:50:43.099556 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1096/2322] 10.222.0.78 () {58 vars in 1164 bytes} [Thu Sep 8 12:50:42 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:50:43.106297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-79b6ca78-c359-4f3a-9eab-f8c79860c3dc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:43.110323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-79b6ca78-c359-4f3a-9eab-f8c79860c3dc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:43.120807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79b6ca78-c359-4f3a-9eab-f8c79860c3dc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:43.121708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79b6ca78-c359-4f3a-9eab-f8c79860c3dc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:43.122498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79b6ca78-c359-4f3a-9eab-f8c79860c3dc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:43.123909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79b6ca78-c359-4f3a-9eab-f8c79860c3dc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:43.124775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79b6ca78-c359-4f3a-9eab-f8c79860c3dc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:43.125643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79b6ca78-c359-4f3a-9eab-f8c79860c3dc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:43.153474 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7643a2de-ed13-4df0-a306-07b0ad4b6d11 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.110457 Sep 08 12:50:43.158933 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1227/2323] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:50:43 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:43.807119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-79b6ca78-c359-4f3a-9eab-f8c79860c3dc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:43.823970 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-79b6ca78-c359-4f3a-9eab-f8c79860c3dc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1322 microversion: 2.1 time: 0.722397 Sep 08 12:50:43.839055 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1097/2324] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:43 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1322 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:44.082720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f751261f-eca1-4915-8912-b53f52ec93cc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:44.083674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f751261f-eca1-4915-8912-b53f52ec93cc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:44.121848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f751261f-eca1-4915-8912-b53f52ec93cc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:44.123164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f751261f-eca1-4915-8912-b53f52ec93cc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:44.124993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f751261f-eca1-4915-8912-b53f52ec93cc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:44.126698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f751261f-eca1-4915-8912-b53f52ec93cc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:44.129164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f751261f-eca1-4915-8912-b53f52ec93cc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:44.130357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f751261f-eca1-4915-8912-b53f52ec93cc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:44.188720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a7135e3e-14b3-43d2-bca3-06d8f9ef8488 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3a7783a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:44.334770 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a7135e3e-14b3-43d2-bca3-06d8f9ef8488 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.143730 Sep 08 12:50:44.336243 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1098/2325] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:50:44 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:44.622447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f751261f-eca1-4915-8912-b53f52ec93cc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:44.660173 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f751261f-eca1-4915-8912-b53f52ec93cc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1522 microversion: 2.1 time: 0.567464 Sep 08 12:50:44.662203 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1228/2326] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:44 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1522 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:44.856507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e71fe20f-c774-44b6-8d3f-d232f8b9cdfd tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:44.858709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e71fe20f-c774-44b6-8d3f-d232f8b9cdfd tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:44.893395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e71fe20f-c774-44b6-8d3f-d232f8b9cdfd tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:44.894891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e71fe20f-c774-44b6-8d3f-d232f8b9cdfd tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:44.896151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e71fe20f-c774-44b6-8d3f-d232f8b9cdfd tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:44.897660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e71fe20f-c774-44b6-8d3f-d232f8b9cdfd tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:44.901143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e71fe20f-c774-44b6-8d3f-d232f8b9cdfd tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:44.903742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e71fe20f-c774-44b6-8d3f-d232f8b9cdfd tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:44.921151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:50:45.362533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-58655f3c-9aab-420c-849e-cdd499c84918 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f156e50>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:45.458634 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-58655f3c-9aab-420c-849e-cdd499c84918 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.100600 Sep 08 12:50:45.460852 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1229/2327] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:50:45 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:45.693196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3dc80bf5-84ef-4c25-a787-36ad2e17696e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:45.694693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3dc80bf5-84ef-4c25-a787-36ad2e17696e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:45.722804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dc80bf5-84ef-4c25-a787-36ad2e17696e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:45.723842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dc80bf5-84ef-4c25-a787-36ad2e17696e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:45.724930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dc80bf5-84ef-4c25-a787-36ad2e17696e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:45.726630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dc80bf5-84ef-4c25-a787-36ad2e17696e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:45.732065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dc80bf5-84ef-4c25-a787-36ad2e17696e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:45.735026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dc80bf5-84ef-4c25-a787-36ad2e17696e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:46.170469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e71fe20f-c774-44b6-8d3f-d232f8b9cdfd tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:46.189433 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e71fe20f-c774-44b6-8d3f-d232f8b9cdfd tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1471 microversion: 2.1 time: 1.335567 Sep 08 12:50:46.194724 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1099/2328] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:44 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1471 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:50:46.614717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3dc80bf5-84ef-4c25-a787-36ad2e17696e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:46.645778 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3dc80bf5-84ef-4c25-a787-36ad2e17696e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1522 microversion: 2.1 time: 0.957563 Sep 08 12:50:46.651482 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1230/2329] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:45 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1522 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:50:46.670801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-29dcbe1f-ccac-43ee-8489-5a2ac9bdd793 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f0f1940>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:46.811704 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-29dcbe1f-ccac-43ee-8489-5a2ac9bdd793 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.157717 Sep 08 12:50:46.837007 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1231/2330] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:50:46 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:47.269639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b9076ae7-6945-4e1c-be80-f364ee1a6cbf tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:47.274801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b9076ae7-6945-4e1c-be80-f364ee1a6cbf tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] [instance: 08ee19e5-ea78-4978-850b-1f36e3d20298] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:47.307427 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-b9076ae7-6945-4e1c-be80-f364ee1a6cbf tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] HTTP exception thrown: Instance 08ee19e5-ea78-4978-850b-1f36e3d20298 could not be found. Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b9076ae7-6945-4e1c-be80-f364ee1a6cbf tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Request method failure captured: Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/08ee19e5-ea78-4978-850b-1f36e3d20298/action HTTP/1.1 Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 15 Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeUEayy4HbPzTbIaDThlPROzdiM_ftlgISXS8iKYWvmMS10EVeuJfZvzBLBehX2g4y6RE9N5g4yWZRW_U-T1EyXNWlLgTBviU4sEzc5flilDlKtcWuUwGZGagodpeS5v7-NwPtQywWOhGO9rq9X2dIaurQZ4z8l-8-69PFrfSEz2L3Q Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d076ba92c3944769911ea99df7c75db5 Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d076ba92c3944769911ea99df7c75db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d076ba92c3944769911ea99df7c75db5 Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersAdminNegativeTestJSON-632920252-project-admin Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 24f40301f9e947739dc815ef00599fb5 Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersAdminNegativeTestJSON-632920252-project-admin Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: {"migrate": {}} Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 08ee19e5-ea78-4978-850b-1f36e3d20298 could not be found. Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '08ee19e5-ea78-4978-850b-1f36e3d20298', 'body': {'migrate': {}}} Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08ee19e5-ea78-4978-850b-1f36e3d20298 could not be found. Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08ee19e5-ea78-4978-850b-1f36e3d20298 could not be found. Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:47.320906 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:47.329794 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:47.329794 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:47.329794 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:47.329794 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:47.329794 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08ee19e5-ea78-4978-850b-1f36e3d20298 could not be found. Sep 08 12:50:47.329794 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:50:47.332351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b9076ae7-6945-4e1c-be80-f364ee1a6cbf tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Returning 404 to user: Instance 08ee19e5-ea78-4978-850b-1f36e3d20298 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:47.334198 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b9076ae7-6945-4e1c-be80-f364ee1a6cbf tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/08ee19e5-ea78-4978-850b-1f36e3d20298/action" status: 404 len: 111 microversion: 2.1 time: 1.091261 Sep 08 12:50:47.355443 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1100/2331] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:50:46 2022] POST /compute/v2.1/servers/08ee19e5-ea78-4978-850b-1f36e3d20298/action => generated 111 bytes in 1112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 12:50:47.696596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8addcbb9-8f25-4ce3-96ed-f5763794f4ca tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:47.698577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8addcbb9-8f25-4ce3-96ed-f5763794f4ca tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:47.710715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8addcbb9-8f25-4ce3-96ed-f5763794f4ca tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:47.711591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8addcbb9-8f25-4ce3-96ed-f5763794f4ca tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:47.712308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8addcbb9-8f25-4ce3-96ed-f5763794f4ca tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:47.713416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8addcbb9-8f25-4ce3-96ed-f5763794f4ca tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:47.714267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8addcbb9-8f25-4ce3-96ed-f5763794f4ca tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:47.715461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8addcbb9-8f25-4ce3-96ed-f5763794f4ca tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:47.821257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-576590715", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:47.988626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:50:51.316741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8addcbb9-8f25-4ce3-96ed-f5763794f4ca tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:51.338825 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8addcbb9-8f25-4ce3-96ed-f5763794f4ca tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1522 microversion: 2.1 time: 3.645343 Sep 08 12:50:51.356404 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1232/2332] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:47 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1522 bytes in 3667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:51.370523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d2e54fef-1acc-4476-a1d8-d7a4ee446a6e tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f271940>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:51.616428 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d2e54fef-1acc-4476-a1d8-d7a4ee446a6e tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.258016 Sep 08 12:50:51.630103 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1233/2333] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:50:51 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:52.292983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:50:52.293803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:50:52.294663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:50:52.295539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:50:52.296353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:50:52.392239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:52.393156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:52.393986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:52.405683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:52.406335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:52.408040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:52.483749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Getting quotas for project d9dedae99bc2492c850c6bb721928d6e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:50:52.499828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Getting quotas for user 6859ddadc55d43d4b245ba732b478226 and project d9dedae99bc2492c850c6bb721928d6e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:50:52.523189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:50:52.526627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:50:52.664553 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-55210027-077f-484a-80a5-e68d625a04a2 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.847463 Sep 08 12:50:52.668909 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1101/2334] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:50:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 4853 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 12:50:52.683200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-342423e4-85bf-4f28-adfb-b9ea7aad9304 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:52.686533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-342423e4-85bf-4f28-adfb-b9ea7aad9304 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:52.722081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-342423e4-85bf-4f28-adfb-b9ea7aad9304 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:52.723449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-342423e4-85bf-4f28-adfb-b9ea7aad9304 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:52.733401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-342423e4-85bf-4f28-adfb-b9ea7aad9304 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:52.736321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-342423e4-85bf-4f28-adfb-b9ea7aad9304 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:52.740546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-342423e4-85bf-4f28-adfb-b9ea7aad9304 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:52.745051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-342423e4-85bf-4f28-adfb-b9ea7aad9304 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:53.037815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-11728e55-1550-410a-b03d-8a5e6729622d tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Calling method '.version_select at 0x7fdb3f188160>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:53.284197 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-11728e55-1550-410a-b03d-8a5e6729622d tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469" status: 200 len: 371 microversion: 2.1 time: 1.647545 Sep 08 12:50:53.284965 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1234/2335] 10.222.0.78 () {58 vars in 1242 bytes} [Thu Sep 8 12:50:51 2022] GET /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469 => generated 371 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:53.302333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3ef0abdb-90f9-40b5-adaf-f7ae4e4e13e0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f198550>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:53.620499 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3ef0abdb-90f9-40b5-adaf-f7ae4e4e13e0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.332851 Sep 08 12:50:53.621269 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1235/2336] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:50:53 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:53.628128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44987045-2d72-42b8-b3d7-61d87a27f893 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:53.643875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-44987045-2d72-42b8-b3d7-61d87a27f893 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:54.869881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-44987045-2d72-42b8-b3d7-61d87a27f893 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:54.883102 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44987045-2d72-42b8-b3d7-61d87a27f893 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1221 microversion: 2.1 time: 1.258748 Sep 08 12:50:54.900893 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1236/2337] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:53 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1221 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:54.921385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33f6aa7a-85bd-4529-915e-c8fd0c5c5cce tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3f2a2790>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:55.485432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-342423e4-85bf-4f28-adfb-b9ea7aad9304 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:55.563589 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-342423e4-85bf-4f28-adfb-b9ea7aad9304 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1522 microversion: 2.1 time: 2.889231 Sep 08 12:50:55.571322 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1102/2338] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:52 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1522 bytes in 2901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:55.612593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-8a1c92c8-5c29-437b-9700-ca4031c1513c req-3861c8d2-9a14-44b1-825c-cb87fef589c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883b526c-7f9c-4fe9-b5ad-26aa46f05f78", "name": "network-vif-plugged", "status": "completed", "tag": "4573b7c0-61ea-430d-b283-e6fc56ec3979"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:55.711910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8a1c92c8-5c29-437b-9700-ca4031c1513c req-3861c8d2-9a14-44b1-825c-cb87fef589c0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:55.714573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8a1c92c8-5c29-437b-9700-ca4031c1513c req-3861c8d2-9a14-44b1-825c-cb87fef589c0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:55.715430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8a1c92c8-5c29-437b-9700-ca4031c1513c req-3861c8d2-9a14-44b1-825c-cb87fef589c0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:55.782890 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-8a1c92c8-5c29-437b-9700-ca4031c1513c req-3861c8d2-9a14-44b1-825c-cb87fef589c0 service nova] Creating event network-vif-plugged:4573b7c0-61ea-430d-b283-e6fc56ec3979 for instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 on n-h2-852084-10 Sep 08 12:50:55.800664 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-8a1c92c8-5c29-437b-9700-ca4031c1513c req-3861c8d2-9a14-44b1-825c-cb87fef589c0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220364 Sep 08 12:50:55.805418 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1103/2339] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:55.823520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-106a1826-8072-4357-8522-07ed8c11fd83 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f1e6700>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:55.946493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33f6aa7a-85bd-4529-915e-c8fd0c5c5cce tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:55.947999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33f6aa7a-85bd-4529-915e-c8fd0c5c5cce tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:55.948613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33f6aa7a-85bd-4529-915e-c8fd0c5c5cce tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:55.950023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33f6aa7a-85bd-4529-915e-c8fd0c5c5cce tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:55.950698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33f6aa7a-85bd-4529-915e-c8fd0c5c5cce tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:55.952336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33f6aa7a-85bd-4529-915e-c8fd0c5c5cce tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:55.960322 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-106a1826-8072-4357-8522-07ed8c11fd83 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.151182 Sep 08 12:50:55.961768 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1104/2340] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:50:55 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:55.982843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c386b84c-5f7f-4529-a498-f615207372b3 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:55.989301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c386b84c-5f7f-4529-a498-f615207372b3 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:56.025433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c386b84c-5f7f-4529-a498-f615207372b3 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:56.031059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c386b84c-5f7f-4529-a498-f615207372b3 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:56.037022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c386b84c-5f7f-4529-a498-f615207372b3 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:56.051550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c386b84c-5f7f-4529-a498-f615207372b3 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:56.060103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c386b84c-5f7f-4529-a498-f615207372b3 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:56.061437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c386b84c-5f7f-4529-a498-f615207372b3 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:56.219707 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-33f6aa7a-85bd-4529-915e-c8fd0c5c5cce tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469" status: 200 len: 328 microversion: 2.1 time: 1.316709 Sep 08 12:50:56.226442 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1237/2341] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 12:50:54 2022] PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469 => generated 328 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:56.520920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c386b84c-5f7f-4529-a498-f615207372b3 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:56.574031 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c386b84c-5f7f-4529-a498-f615207372b3 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1273 microversion: 2.1 time: 0.596963 Sep 08 12:50:56.576929 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1105/2342] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:55 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1273 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:56.619831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-95fe2276-db7a-4922-979a-29307b7db1d5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:56.621159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-95fe2276-db7a-4922-979a-29307b7db1d5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:56.651801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-95fe2276-db7a-4922-979a-29307b7db1d5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:56.652178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-95fe2276-db7a-4922-979a-29307b7db1d5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:56.652984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-95fe2276-db7a-4922-979a-29307b7db1d5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:56.665003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-95fe2276-db7a-4922-979a-29307b7db1d5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:56.666274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-95fe2276-db7a-4922-979a-29307b7db1d5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:56.676008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-95fe2276-db7a-4922-979a-29307b7db1d5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:56.898268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-876012558", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:57.147810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:50:57.629175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-95fe2276-db7a-4922-979a-29307b7db1d5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:57.648631 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-95fe2276-db7a-4922-979a-29307b7db1d5 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1522 microversion: 2.1 time: 1.042800 Sep 08 12:50:57.671623 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1106/2343] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:56 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1522 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:57.689567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc3222de-f343-4738-9e3e-68deb3643188 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3ad33c10>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:57.822701 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cc3222de-f343-4738-9e3e-68deb3643188 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.148710 Sep 08 12:50:57.823941 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1107/2344] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:50:57 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:57.846085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b3d66162-0329-4dd9-b79f-caf0bbaafe0b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:57.855534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b3d66162-0329-4dd9-b79f-caf0bbaafe0b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:57.872235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3d66162-0329-4dd9-b79f-caf0bbaafe0b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:57.873281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3d66162-0329-4dd9-b79f-caf0bbaafe0b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:57.875809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3d66162-0329-4dd9-b79f-caf0bbaafe0b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:57.877720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3d66162-0329-4dd9-b79f-caf0bbaafe0b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:57.880512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3d66162-0329-4dd9-b79f-caf0bbaafe0b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:57.881330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3d66162-0329-4dd9-b79f-caf0bbaafe0b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:58.206390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b3d66162-0329-4dd9-b79f-caf0bbaafe0b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:50:58.242463 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b3d66162-0329-4dd9-b79f-caf0bbaafe0b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1279 microversion: 2.1 time: 0.406088 Sep 08 12:50:58.250882 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1108/2345] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:57 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1279 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:58.301138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:50:58.302481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:50:58.303144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:50:58.303848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:50:58.304887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:50:58.340607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:58.351551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:58.352338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:58.353373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:58.354036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:58.354637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:58.488420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Getting quotas for project 0a42aa36b19940bf8fd9f5818e24a469. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:50:58.527981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Getting quotas for user cdaee7826ecd47dc8517ba155e444e79 and project 0a42aa36b19940bf8fd9f5818e24a469. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:50:58.591258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.utils [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] cores quota exceeded for 0a42aa36b19940bf8fd9f5818e24a469, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128970) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 08 12:50:58.600044 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Request method failure captured: Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 144 Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeUl7K5iTyqqy79ZyteJeahQoPW2c695yQuFUQZt1xyTf-sJZXYlSjex5EbOztcRT2U4RXZrTHI7nRJRK3eEVYHQ3Dv8ENmFupwDYJ5Pi2yjkDWhlDPHRPX3dZlj74x-A4yTNeZx0llCqqPKMV567KdKcvX8sti5CP3sQxtzAJ2JHcY Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0a42aa36b19940bf8fd9f5818e24a469 Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-QuotasAdminNegativeTest-701928482 Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-QuotasAdminNegativeTest-701928482 Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0a42aa36b19940bf8fd9f5818e24a469 Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-701928482 Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-QuotasAdminNegativeTest-701928482-project Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: cdaee7826ecd47dc8517ba155e444e79 Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-QuotasAdminNegativeTest-701928482-project Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-876012558", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-876012558', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452'}}} Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 12:50:58.625982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Sep 08 12:50:58.630280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:50:58.635874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:50:58.637224 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b33c5942-aae0-4fa1-95f5-4df10d3630fe tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 2.151806 Sep 08 12:50:58.638982 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1238/2346] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:50:56 2022] POST /compute/v2.1/servers => generated 111 bytes in 2154 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:50:58.651396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cfd3ba19-63af-43c9-8cd3-e4ea920fa805 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3b1bf670>, body: {"quota_set": {"cores": 20}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:58.697838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7f889f31-6020-4481-b282-45d7bf3b1103 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:58.699247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7f889f31-6020-4481-b282-45d7bf3b1103 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:50:58.716807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f889f31-6020-4481-b282-45d7bf3b1103 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:58.717891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f889f31-6020-4481-b282-45d7bf3b1103 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:58.718642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f889f31-6020-4481-b282-45d7bf3b1103 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:58.725625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f889f31-6020-4481-b282-45d7bf3b1103 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:58.727906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f889f31-6020-4481-b282-45d7bf3b1103 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:58.728697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f889f31-6020-4481-b282-45d7bf3b1103 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:59.198459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfd3ba19-63af-43c9-8cd3-e4ea920fa805 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:59.200096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfd3ba19-63af-43c9-8cd3-e4ea920fa805 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:59.202578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfd3ba19-63af-43c9-8cd3-e4ea920fa805 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:59.204842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfd3ba19-63af-43c9-8cd3-e4ea920fa805 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:59.207943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfd3ba19-63af-43c9-8cd3-e4ea920fa805 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:59.214012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfd3ba19-63af-43c9-8cd3-e4ea920fa805 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:59.483831 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cfd3ba19-63af-43c9-8cd3-e4ea920fa805 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469" status: 200 len: 329 microversion: 2.1 time: 0.837855 Sep 08 12:50:59.500666 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1109/2347] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 12:50:58 2022] PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469 => generated 329 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:50:59.521023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-14ed04e6-e1be-4f35-bc6a-30d9d858f26d tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3af31310>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:50:59.691351 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-14ed04e6-e1be-4f35-bc6a-30d9d858f26d tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.188092 Sep 08 12:50:59.692493 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1110/2348] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:50:59 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:50:59.719335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-10037cf4-ef82-415f-b381-549d4aee4ec6 req-8b8c5850-d8f1-43a7-95bf-933bd7c86082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aac929c-34e0-46b4-b2ed-be01e53a5b48", "name": "network-vif-plugged", "status": "completed", "tag": "ef87dc69-90b0-4619-9709-b2f42201a6ac"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:50:59.794009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-10037cf4-ef82-415f-b381-549d4aee4ec6 req-8b8c5850-d8f1-43a7-95bf-933bd7c86082 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:50:59.807804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-10037cf4-ef82-415f-b381-549d4aee4ec6 req-8b8c5850-d8f1-43a7-95bf-933bd7c86082 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:50:59.809729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-10037cf4-ef82-415f-b381-549d4aee4ec6 req-8b8c5850-d8f1-43a7-95bf-933bd7c86082 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:50:59.908008 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-10037cf4-ef82-415f-b381-549d4aee4ec6 req-8b8c5850-d8f1-43a7-95bf-933bd7c86082 service nova] Creating event network-vif-plugged:ef87dc69-90b0-4619-9709-b2f42201a6ac for instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 on n-h1-852084-10 Sep 08 12:50:59.955431 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-10037cf4-ef82-415f-b381-549d4aee4ec6 req-8b8c5850-d8f1-43a7-95bf-933bd7c86082 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.252226 Sep 08 12:50:59.986854 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1111/2349] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:00.046739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e06c5540-d81d-4a6e-9645-aca511362959 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:00.057005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e06c5540-d81d-4a6e-9645-aca511362959 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:00.121148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e06c5540-d81d-4a6e-9645-aca511362959 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:00.122384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e06c5540-d81d-4a6e-9645-aca511362959 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:00.123261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e06c5540-d81d-4a6e-9645-aca511362959 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:00.124698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e06c5540-d81d-4a6e-9645-aca511362959 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:00.125516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e06c5540-d81d-4a6e-9645-aca511362959 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:00.151385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e06c5540-d81d-4a6e-9645-aca511362959 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:00.379514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7f889f31-6020-4481-b282-45d7bf3b1103 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:00.401584 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7f889f31-6020-4481-b282-45d7bf3b1103 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1522 microversion: 2.1 time: 1.707793 Sep 08 12:51:00.416815 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1239/2350] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:58 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1522 bytes in 1727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:00.448117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f78321a4-3339-426b-8463-d9ab7ec7efb5 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Calling method '.version_select at 0x7fdb35ea1940>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:00.730784 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f78321a4-3339-426b-8463-d9ab7ec7efb5 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469" status: 200 len: 371 microversion: 2.1 time: 0.312303 Sep 08 12:51:00.740840 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1240/2351] 10.222.0.78 () {58 vars in 1242 bytes} [Thu Sep 8 12:51:00 2022] GET /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469 => generated 371 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:00.751910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-86e76b1e-59b1-4e2f-ba77-27b0531698bd tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb35ea0dc0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:00.942108 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-86e76b1e-59b1-4e2f-ba77-27b0531698bd tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.194813 Sep 08 12:51:00.948589 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1241/2352] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:00 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:00.987931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f67dd40-a811-43a1-ad0d-91d2b735b556 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Action: 'update', calling method: .version_select at 0x7fdb35ea09d0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:01.158101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f67dd40-a811-43a1-ad0d-91d2b735b556 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:01.159109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f67dd40-a811-43a1-ad0d-91d2b735b556 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:01.159926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f67dd40-a811-43a1-ad0d-91d2b735b556 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:01.161018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f67dd40-a811-43a1-ad0d-91d2b735b556 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:01.161762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f67dd40-a811-43a1-ad0d-91d2b735b556 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:01.162539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f67dd40-a811-43a1-ad0d-91d2b735b556 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:01.285000 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1f67dd40-a811-43a1-ad0d-91d2b735b556 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469" status: 200 len: 328 microversion: 2.1 time: 0.330636 Sep 08 12:51:01.287134 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1242/2353] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 12:51:00 2022] PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469 => generated 328 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:01.426262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e06c5540-d81d-4a6e-9645-aca511362959 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:01.426262 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e06c5540-d81d-4a6e-9645-aca511362959 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1321 microversion: 2.1 time: 1.410775 Sep 08 12:51:01.426262 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1112/2354] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:50:59 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1321 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:01.440267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2001bc4a-f6b7-44b7-ae6f-966b8bd2c7df tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:01.441225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2001bc4a-f6b7-44b7-ae6f-966b8bd2c7df tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:01.458640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2001bc4a-f6b7-44b7-ae6f-966b8bd2c7df tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:01.462017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2001bc4a-f6b7-44b7-ae6f-966b8bd2c7df tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:01.462248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2001bc4a-f6b7-44b7-ae6f-966b8bd2c7df tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:01.466533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2001bc4a-f6b7-44b7-ae6f-966b8bd2c7df tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:01.467666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2001bc4a-f6b7-44b7-ae6f-966b8bd2c7df tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:01.468220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2001bc4a-f6b7-44b7-ae6f-966b8bd2c7df tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:01.617481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2000171726", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:01.739728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:51:01.898917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2001bc4a-f6b7-44b7-ae6f-966b8bd2c7df tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:01.909449 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2001bc4a-f6b7-44b7-ae6f-966b8bd2c7df tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1522 microversion: 2.1 time: 0.474836 Sep 08 12:51:01.936864 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1243/2355] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:01 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1522 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:01.972100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0604b196-784e-4658-844e-a26e0ebcf74c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb35ea0c10>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:02.073024 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0604b196-784e-4658-844e-a26e0ebcf74c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.106135 Sep 08 12:51:02.073525 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1244/2356] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:01 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:51:02.467645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0787858c-be1e-4137-ae17-28db6025260f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:02.474608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0787858c-be1e-4137-ae17-28db6025260f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:02.485132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0787858c-be1e-4137-ae17-28db6025260f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:02.496256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0787858c-be1e-4137-ae17-28db6025260f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:02.497285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0787858c-be1e-4137-ae17-28db6025260f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:02.504343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0787858c-be1e-4137-ae17-28db6025260f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:02.505794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0787858c-be1e-4137-ae17-28db6025260f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:02.506855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0787858c-be1e-4137-ae17-28db6025260f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:02.635558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:51:02.636111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:51:02.636702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:51:02.637521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:51:02.639063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:51:02.674297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:02.677635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:02.678230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:02.682215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:02.684029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:02.684762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:02.778414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Getting quotas for project 0a42aa36b19940bf8fd9f5818e24a469. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:51:02.787999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Getting quotas for user cdaee7826ecd47dc8517ba155e444e79 and project 0a42aa36b19940bf8fd9f5818e24a469. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:51:02.858179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.utils [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] instances quota exceeded for 0a42aa36b19940bf8fd9f5818e24a469, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128971) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 08 12:51:02.859972 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Request method failure captured: Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 145 Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeUl7K5iTyqqy79ZyteJeahQoPW2c695yQuFUQZt1xyTf-sJZXYlSjex5EbOztcRT2U4RXZrTHI7nRJRK3eEVYHQ3Dv8ENmFupwDYJ5Pi2yjkDWhlDPHRPX3dZlj74x-A4yTNeZx0llCqqPKMV567KdKcvX8sti5CP3sQxtzAJ2JHcY Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0a42aa36b19940bf8fd9f5818e24a469 Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-QuotasAdminNegativeTest-701928482 Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-QuotasAdminNegativeTest-701928482 Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0a42aa36b19940bf8fd9f5818e24a469 Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-701928482 Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-QuotasAdminNegativeTest-701928482-project Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: cdaee7826ecd47dc8517ba155e444e79 Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-QuotasAdminNegativeTest-701928482-project Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2000171726", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2000171726', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452'}}} Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 12:51:02.882257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Sep 08 12:51:02.887215 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:02.893823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:02.895308 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9db658df-2bad-44c2-846e-2aac72f2a81e tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.284390 Sep 08 12:51:02.897528 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1113/2357] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:51:01 2022] POST /compute/v2.1/servers => generated 119 bytes in 1287 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Sep 08 12:51:02.917044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-17a9cab0-1688-4dae-a112-84a234c600b3 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3f1a4940>, body: {"quota_set": {"instances": 10}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:03.074574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-17a9cab0-1688-4dae-a112-84a234c600b3 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:03.077881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-17a9cab0-1688-4dae-a112-84a234c600b3 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:03.078347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-17a9cab0-1688-4dae-a112-84a234c600b3 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:03.081968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-17a9cab0-1688-4dae-a112-84a234c600b3 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:03.083656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-17a9cab0-1688-4dae-a112-84a234c600b3 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:03.084142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-17a9cab0-1688-4dae-a112-84a234c600b3 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:03.136675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:03.201854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0787858c-be1e-4137-ae17-28db6025260f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:03.228122 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0787858c-be1e-4137-ae17-28db6025260f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1321 microversion: 2.1 time: 0.764109 Sep 08 12:51:03.229999 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1245/2358] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:02 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1321 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:51:03.252760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-375f7351-e7d9-4560-8fd3-133c400022b6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:03.261379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-375f7351-e7d9-4560-8fd3-133c400022b6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:03.280985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-375f7351-e7d9-4560-8fd3-133c400022b6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:03.282363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-375f7351-e7d9-4560-8fd3-133c400022b6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:03.285666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-375f7351-e7d9-4560-8fd3-133c400022b6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:03.287723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-375f7351-e7d9-4560-8fd3-133c400022b6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:03.299158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-375f7351-e7d9-4560-8fd3-133c400022b6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:03.300262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-375f7351-e7d9-4560-8fd3-133c400022b6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:03.305813 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-17a9cab0-1688-4dae-a112-84a234c600b3 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469" status: 200 len: 329 microversion: 2.1 time: 0.400395 Sep 08 12:51:03.322724 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1114/2359] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 12:51:02 2022] PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469 => generated 329 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:03.330507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9ab38538-cc7b-4339-a536-cb813489e62f tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f1b1f70>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:03.435582 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9ab38538-cc7b-4339-a536-cb813489e62f tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.124552 Sep 08 12:51:03.443339 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1115/2360] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:03 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:03.453150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3e03d4e7-c6d9-4d7b-8dd1-f448503fb88a tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Calling method '.version_select at 0x7fdb3f1a4e50>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:03.666701 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3e03d4e7-c6d9-4d7b-8dd1-f448503fb88a tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469" status: 200 len: 371 microversion: 2.1 time: 0.220803 Sep 08 12:51:03.671693 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1116/2361] 10.222.0.78 () {58 vars in 1242 bytes} [Thu Sep 8 12:51:03 2022] GET /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469 => generated 371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:03.710998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-68e1a5e3-d9d4-4faa-9260-9955e1194ed9 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3f286d30>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:03.877477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68e1a5e3-d9d4-4faa-9260-9955e1194ed9 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:03.881046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68e1a5e3-d9d4-4faa-9260-9955e1194ed9 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:03.883048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68e1a5e3-d9d4-4faa-9260-9955e1194ed9 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:03.884136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68e1a5e3-d9d4-4faa-9260-9955e1194ed9 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:03.886550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68e1a5e3-d9d4-4faa-9260-9955e1194ed9 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:03.887123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68e1a5e3-d9d4-4faa-9260-9955e1194ed9 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:04.050139 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-68e1a5e3-d9d4-4faa-9260-9955e1194ed9 tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469" status: 200 len: 325 microversion: 2.1 time: 0.370250 Sep 08 12:51:04.056981 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1117/2362] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 12:51:03 2022] PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469 => generated 325 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:04.203663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-375f7351-e7d9-4560-8fd3-133c400022b6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:04.231850 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-375f7351-e7d9-4560-8fd3-133c400022b6 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1522 microversion: 2.1 time: 0.971977 Sep 08 12:51:04.237868 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1246/2363] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:03 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1522 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:04.262454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f618c26d-9947-4fc2-aa6d-b80f338d101c tempest-ComputeTenantNetworksTest-1380891517 tempest-ComputeTenantNetworksTest-1380891517-project] Calling method '.version_select at 0x7fdb3f1b1a60>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:04.279844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1638561758", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:04.488056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:51:05.537634 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f618c26d-9947-4fc2-aa6d-b80f338d101c tempest-ComputeTenantNetworksTest-1380891517 tempest-ComputeTenantNetworksTest-1380891517-project] 10.222.0.78 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 1.478846 Sep 08 12:51:05.547720 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1118/2364] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:51:04 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:05.563841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c16a5d17-8e69-45d3-ac0b-97380399d6d4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:05.570092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c16a5d17-8e69-45d3-ac0b-97380399d6d4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:05.581988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c16a5d17-8e69-45d3-ac0b-97380399d6d4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:05.582490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c16a5d17-8e69-45d3-ac0b-97380399d6d4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:05.582984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c16a5d17-8e69-45d3-ac0b-97380399d6d4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:05.583861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c16a5d17-8e69-45d3-ac0b-97380399d6d4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:05.584333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c16a5d17-8e69-45d3-ac0b-97380399d6d4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:05.584768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c16a5d17-8e69-45d3-ac0b-97380399d6d4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:05.906376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:51:05.907634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:51:05.908349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:51:05.909088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:51:05.909721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:51:05.938027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:05.938936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:05.939754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:05.940963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:05.945695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:05.946552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:06.007699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Getting quotas for project 0a42aa36b19940bf8fd9f5818e24a469. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:51:06.017562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c16a5d17-8e69-45d3-ac0b-97380399d6d4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:06.021857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Getting quotas for user cdaee7826ecd47dc8517ba155e444e79 and project 0a42aa36b19940bf8fd9f5818e24a469. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:51:06.029080 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c16a5d17-8e69-45d3-ac0b-97380399d6d4 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1321 microversion: 2.1 time: 0.479408 Sep 08 12:51:06.036176 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1119/2365] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:05 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:06.054948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f54a21fb-6f84-46f4-83b6-d0000b8bcc5e tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f1b19d0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:06.077323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.utils [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] ram quota exceeded for 0a42aa36b19940bf8fd9f5818e24a469, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128970) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Sep 08 12:51:06.080531 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Request method failure captured: Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 145 Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeUl7K5iTyqqy79ZyteJeahQoPW2c695yQuFUQZt1xyTf-sJZXYlSjex5EbOztcRT2U4RXZrTHI7nRJRK3eEVYHQ3Dv8ENmFupwDYJ5Pi2yjkDWhlDPHRPX3dZlj74x-A4yTNeZx0llCqqPKMV567KdKcvX8sti5CP3sQxtzAJ2JHcY Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0a42aa36b19940bf8fd9f5818e24a469 Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-QuotasAdminNegativeTest-701928482 Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-QuotasAdminNegativeTest-701928482 Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0a42aa36b19940bf8fd9f5818e24a469 Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-701928482 Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-QuotasAdminNegativeTest-701928482-project Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: cdaee7826ecd47dc8517ba155e444e79 Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-QuotasAdminNegativeTest-701928482-project Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1638561758", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1638561758', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452'}}} Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 12:51:06.082911 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Sep 08 12:51:06.087656 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:06.092842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:06.093499 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2576a47b-44e5-4e86-8593-f65ce7ba88c6 tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.849419 Sep 08 12:51:06.098556 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1247/2366] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:51:04 2022] POST /compute/v2.1/servers => generated 110 bytes in 1860 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:51:06.115096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-37cc97a6-7cea-46de-9cc6-d38373fc3c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:06.119092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-37cc97a6-7cea-46de-9cc6-d38373fc3c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:06.135343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37cc97a6-7cea-46de-9cc6-d38373fc3c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:06.141636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37cc97a6-7cea-46de-9cc6-d38373fc3c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:06.142225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37cc97a6-7cea-46de-9cc6-d38373fc3c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:06.143278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37cc97a6-7cea-46de-9cc6-d38373fc3c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:06.144024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37cc97a6-7cea-46de-9cc6-d38373fc3c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:06.144547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37cc97a6-7cea-46de-9cc6-d38373fc3c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:06.210288 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f54a21fb-6f84-46f4-83b6-d0000b8bcc5e tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.166676 Sep 08 12:51:06.214031 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1120/2367] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:06 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:06.231113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a0da89f4-d72e-4123-92cb-33a2e7d129c3 tempest-ComputeTenantNetworksTest-1380891517 tempest-ComputeTenantNetworksTest-1380891517-project] Calling method '.version_select at 0x7fdb3f1b24c0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:07.088558 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a0da89f4-d72e-4123-92cb-33a2e7d129c3 tempest-ComputeTenantNetworksTest-1380891517 tempest-ComputeTenantNetworksTest-1380891517-project] 10.222.0.78 "GET /compute/v2.1/os-tenant-networks/dea85da9-5b08-4c9d-bd05-19ba3c82a966" status: 200 len: 139 microversion: 2.1 time: 0.868317 Sep 08 12:51:07.090424 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1121/2368] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 12:51:06 2022] GET /compute/v2.1/os-tenant-networks/dea85da9-5b08-4c9d-bd05-19ba3c82a966 => generated 139 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:07.097373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3bd023d4-cf32-4167-926f-a79dd07a16d9 req-178aa841-6444-46fb-a2f4-a4deb02d44df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e013eb03-cc1b-4f91-b8be-a2f1452a8397", "tag": "f3d6544c-d4d4-4764-97b8-2d6dcc1431af"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:07.132991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3bd023d4-cf32-4167-926f-a79dd07a16d9 req-178aa841-6444-46fb-a2f4-a4deb02d44df service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:07.144393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3bd023d4-cf32-4167-926f-a79dd07a16d9 req-178aa841-6444-46fb-a2f4-a4deb02d44df service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:07.165151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3bd023d4-cf32-4167-926f-a79dd07a16d9 req-178aa841-6444-46fb-a2f4-a4deb02d44df service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:07.179547 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3bd023d4-cf32-4167-926f-a79dd07a16d9 req-178aa841-6444-46fb-a2f4-a4deb02d44df service nova] Creating event network-changed:f3d6544c-d4d4-4764-97b8-2d6dcc1431af for instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 on n-h2-852084-10 Sep 08 12:51:07.205823 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3bd023d4-cf32-4167-926f-a79dd07a16d9 req-178aa841-6444-46fb-a2f4-a4deb02d44df service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112442 Sep 08 12:51:07.207447 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1122/2369] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:07.213562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-551fd549-550e-4e91-9b76-19ba2b5ab6db tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Action: 'update', calling method: .version_select at 0x7fdb3f1b2430>, body: {"quota_set": {"ram": 51200}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:07.438165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-551fd549-550e-4e91-9b76-19ba2b5ab6db tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:07.438957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-551fd549-550e-4e91-9b76-19ba2b5ab6db tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:07.439721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-551fd549-550e-4e91-9b76-19ba2b5ab6db tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:07.440946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-551fd549-550e-4e91-9b76-19ba2b5ab6db tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:07.441624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-551fd549-550e-4e91-9b76-19ba2b5ab6db tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:07.442178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-551fd549-550e-4e91-9b76-19ba2b5ab6db tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:07.474417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-37cc97a6-7cea-46de-9cc6-d38373fc3c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:07.495125 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-37cc97a6-7cea-46de-9cc6-d38373fc3c78 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1507 microversion: 2.1 time: 1.391349 Sep 08 12:51:07.500724 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1248/2370] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:06 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1507 bytes in 1398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:07.517964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-54fb0ecf-4d90-4eef-8956-20ba26bd4f01 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:07.520217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-54fb0ecf-4d90-4eef-8956-20ba26bd4f01 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:07.539553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54fb0ecf-4d90-4eef-8956-20ba26bd4f01 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:07.542287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54fb0ecf-4d90-4eef-8956-20ba26bd4f01 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:07.549200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54fb0ecf-4d90-4eef-8956-20ba26bd4f01 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:07.552936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54fb0ecf-4d90-4eef-8956-20ba26bd4f01 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:07.553567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54fb0ecf-4d90-4eef-8956-20ba26bd4f01 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:07.556011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54fb0ecf-4d90-4eef-8956-20ba26bd4f01 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:07.675042 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-551fd549-550e-4e91-9b76-19ba2b5ab6db tempest-QuotasAdminNegativeTest-1463583852 tempest-QuotasAdminNegativeTest-1463583852-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469" status: 200 len: 329 microversion: 2.1 time: 0.465751 Sep 08 12:51:07.676688 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1123/2371] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 12:51:07 2022] PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469 => generated 329 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:07.697395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0cf2eb91-ead1-4aa6-8b34-c1bdacc98327 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3a78b1f0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:07.867110 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0cf2eb91-ead1-4aa6-8b34-c1bdacc98327 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.187661 Sep 08 12:51:07.871604 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1124/2372] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:07 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:07.886030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36d5b52a-2f4e-4551-81ba-e58797489ded tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:07.886813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-36d5b52a-2f4e-4551-81ba-e58797489ded tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:07.920550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36d5b52a-2f4e-4551-81ba-e58797489ded tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:07.922641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36d5b52a-2f4e-4551-81ba-e58797489ded tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:07.924189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36d5b52a-2f4e-4551-81ba-e58797489ded tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:07.928382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36d5b52a-2f4e-4551-81ba-e58797489ded tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:07.929635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36d5b52a-2f4e-4551-81ba-e58797489ded tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:07.932463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36d5b52a-2f4e-4551-81ba-e58797489ded tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:08.871642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-36d5b52a-2f4e-4551-81ba-e58797489ded tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:08.929243 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36d5b52a-2f4e-4551-81ba-e58797489ded tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 200 len: 1507 microversion: 2.1 time: 1.055009 Sep 08 12:51:08.935623 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1125/2373] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:07 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 1507 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:08.954143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3a2da53e-6439-4e6f-8692-a0374b3903ff tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Action: 'update', calling method: .version_select at 0x7fdb3a778700>, body: {"quota_set": {"ram": 0}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:08.988101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3a2da53e-6439-4e6f-8692-a0374b3903ff tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'cdaee7826ecd47dc8517ba155e444e79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a42aa36b19940bf8fd9f5818e24a469', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3a2da53e-6439-4e6f-8692-a0374b3903ff tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Request method failure captured: Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: request: PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469 HTTP/1.1 Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 25 Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeUl7K5iTyqqy79ZyteJeahQoPW2c695yQuFUQZt1xyTf-sJZXYlSjex5EbOztcRT2U4RXZrTHI7nRJRK3eEVYHQ3Dv8ENmFupwDYJ5Pi2yjkDWhlDPHRPX3dZlj74x-A4yTNeZx0llCqqPKMV567KdKcvX8sti5CP3sQxtzAJ2JHcY Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0a42aa36b19940bf8fd9f5818e24a469 Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-QuotasAdminNegativeTest-701928482 Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0a42aa36b19940bf8fd9f5818e24a469"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-QuotasAdminNegativeTest-701928482 Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0a42aa36b19940bf8fd9f5818e24a469 Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-701928482 Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-QuotasAdminNegativeTest-701928482-project Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: cdaee7826ecd47dc8517ba155e444e79 Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-QuotasAdminNegativeTest-701928482-project Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: {"quota_set": {"ram": 0}} Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '0a42aa36b19940bf8fd9f5818e24a469', 'body': {'quota_set': {'ram': 0}}} Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:51:09.011189 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Sep 08 12:51:09.020010 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:09.030199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3a2da53e-6439-4e6f-8692-a0374b3903ff tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:09.033909 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3a2da53e-6439-4e6f-8692-a0374b3903ff tempest-QuotasAdminNegativeTest-701928482 tempest-QuotasAdminNegativeTest-701928482-project] 10.222.0.78 "PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469" status: 403 len: 116 microversion: 2.1 time: 0.094326 Sep 08 12:51:09.035204 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1126/2374] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 12:51:08 2022] PUT /compute/v2.1/os-quota-sets/0a42aa36b19940bf8fd9f5818e24a469 => generated 116 bytes in 99 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:51:09.057147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0126ba11-31c0-4a2f-b965-82642958632e tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3ae880d0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:09.128840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-54fb0ecf-4d90-4eef-8956-20ba26bd4f01 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:09.150662 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-54fb0ecf-4d90-4eef-8956-20ba26bd4f01 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1321 microversion: 2.1 time: 1.643890 Sep 08 12:51:09.158126 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1249/2375] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:07 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1321 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:09.178240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fe2f0aa7-009d-4b8b-b1b4-925f016ee4be tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:09.182865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fe2f0aa7-009d-4b8b-b1b4-925f016ee4be tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:09.212262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe2f0aa7-009d-4b8b-b1b4-925f016ee4be tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:09.213512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe2f0aa7-009d-4b8b-b1b4-925f016ee4be tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:09.218173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe2f0aa7-009d-4b8b-b1b4-925f016ee4be tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:09.220826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe2f0aa7-009d-4b8b-b1b4-925f016ee4be tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:09.224726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe2f0aa7-009d-4b8b-b1b4-925f016ee4be tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:09.225968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe2f0aa7-009d-4b8b-b1b4-925f016ee4be tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:09.267359 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0126ba11-31c0-4a2f-b965-82642958632e tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.227219 Sep 08 12:51:09.285015 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1127/2376] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:09 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:09.350368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fe2f0aa7-009d-4b8b-b1b4-925f016ee4be tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:51:09.746802 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fe2f0aa7-009d-4b8b-b1b4-925f016ee4be tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 204 len: 0 microversion: 2.1 time: 0.585765 Sep 08 12:51:09.749831 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1250/2377] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:51:09 2022] DELETE /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:51:10.189152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1638919067", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "9324045c-e84a-4063-86c3-13924eff78b4"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:10.201488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-928602d6-835d-4bcd-b199-ede7fb79dbb6 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:10.202379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-928602d6-835d-4bcd-b199-ede7fb79dbb6 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:10.239320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:10.247724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-928602d6-835d-4bcd-b199-ede7fb79dbb6 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:10.249650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-928602d6-835d-4bcd-b199-ede7fb79dbb6 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:10.254106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-928602d6-835d-4bcd-b199-ede7fb79dbb6 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:10.258873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-928602d6-835d-4bcd-b199-ede7fb79dbb6 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:10.261333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-928602d6-835d-4bcd-b199-ede7fb79dbb6 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:10.268435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-928602d6-835d-4bcd-b199-ede7fb79dbb6 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:10.402562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] validate_networks() for [('9324045c-e84a-4063-86c3-13924eff78b4', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:51:11.950847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-928602d6-835d-4bcd-b199-ede7fb79dbb6 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:11.953233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:11.974598 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-928602d6-835d-4bcd-b199-ede7fb79dbb6 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1321 microversion: 2.1 time: 1.775238 Sep 08 12:51:11.980099 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1251/2378] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:10 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1321 bytes in 1788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:11.986250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d9efcd49-7bcb-4f38-ad58-5e88989d65ec tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f2ed040>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:12.105226 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d9efcd49-7bcb-4f38-ad58-5e88989d65ec tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.123832 Sep 08 12:51:12.120142 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1252/2379] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:11 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:12.276106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:51:12.276657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:51:12.277102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:51:12.277600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:51:12.278212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:51:12.314645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:12.315188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:12.315744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:12.316681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:12.317192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:12.317784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:12.354525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=15 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:12.404907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Getting quotas for project 0c2a7d092bfb409abbaa54af1841ac99. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:51:12.424618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Getting quotas for user 9e7b70f33287409794f79507bd31b81c and project 0c2a7d092bfb409abbaa54af1841ac99. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:51:12.463582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:51:12.477938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:51:12.586601 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9b6ed2d3-7a1c-48b3-a219-6d9543059a4e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.417239 Sep 08 12:51:12.590022 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1128/2380] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:51:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 2422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:51:12.600833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b557d438-dc6d-4bb9-be8c-9b3031f7bd2b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:12.601527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b557d438-dc6d-4bb9-be8c-9b3031f7bd2b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:12.941615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b557d438-dc6d-4bb9-be8c-9b3031f7bd2b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:12.969738 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b557d438-dc6d-4bb9-be8c-9b3031f7bd2b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1218 microversion: 2.1 time: 0.374156 Sep 08 12:51:12.979805 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1253/2381] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:12 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1218 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:13.005070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a984fdf8-b65c-4f48-8f3c-827da3005957 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:13.005724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a984fdf8-b65c-4f48-8f3c-827da3005957 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:13.030054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a984fdf8-b65c-4f48-8f3c-827da3005957 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:13.030590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a984fdf8-b65c-4f48-8f3c-827da3005957 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:13.035052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a984fdf8-b65c-4f48-8f3c-827da3005957 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:13.035894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a984fdf8-b65c-4f48-8f3c-827da3005957 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:13.036399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a984fdf8-b65c-4f48-8f3c-827da3005957 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:13.042020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a984fdf8-b65c-4f48-8f3c-827da3005957 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:13.127885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84ea3c53-59d9-43d4-996f-225b166b34c6 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f2ed790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:13.300157 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-84ea3c53-59d9-43d4-996f-225b166b34c6 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.172781 Sep 08 12:51:13.301473 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1254/2382] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:13 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:13.789289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d763f1f5-4675-447c-9a84-ed30ebbb01e8 req-301a9b65-e99c-45ed-bc49-2d5ada74b82a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0aac929c-34e0-46b4-b2ed-be01e53a5b48", "name": "network-vif-deleted", "tag": "ef87dc69-90b0-4619-9709-b2f42201a6ac"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:13.849474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d763f1f5-4675-447c-9a84-ed30ebbb01e8 req-301a9b65-e99c-45ed-bc49-2d5ada74b82a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:13.851776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d763f1f5-4675-447c-9a84-ed30ebbb01e8 req-301a9b65-e99c-45ed-bc49-2d5ada74b82a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:13.852503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d763f1f5-4675-447c-9a84-ed30ebbb01e8 req-301a9b65-e99c-45ed-bc49-2d5ada74b82a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:13.910063 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d763f1f5-4675-447c-9a84-ed30ebbb01e8 req-301a9b65-e99c-45ed-bc49-2d5ada74b82a service nova] Creating event network-vif-deleted:ef87dc69-90b0-4619-9709-b2f42201a6ac for instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 on n-h1-852084-10 Sep 08 12:51:13.931928 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d763f1f5-4675-447c-9a84-ed30ebbb01e8 req-301a9b65-e99c-45ed-bc49-2d5ada74b82a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150740 Sep 08 12:51:13.938578 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1255/2383] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:51:14.014616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e53bf4e6-6fb9-4935-983e-eb9e9aa447de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:14.019084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e53bf4e6-6fb9-4935-983e-eb9e9aa447de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:14.635310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e53bf4e6-6fb9-4935-983e-eb9e9aa447de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:14.689638 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e53bf4e6-6fb9-4935-983e-eb9e9aa447de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1218 microversion: 2.1 time: 0.682719 Sep 08 12:51:14.697542 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1256/2384] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:14 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1218 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:14.751694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d6245cc5-333d-4dc7-9f32-e824bf857c3c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb35e84dc0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:14.789041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a984fdf8-b65c-4f48-8f3c-827da3005957 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:14.801002 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a984fdf8-b65c-4f48-8f3c-827da3005957 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1321 microversion: 2.1 time: 1.800040 Sep 08 12:51:14.805696 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1129/2385] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:12 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1321 bytes in 1806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:15.045876 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d6245cc5-333d-4dc7-9f32-e824bf857c3c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.340586 Sep 08 12:51:15.076249 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1257/2386] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:14 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:15.721948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2006e03d-4d3d-42ba-b6ba-1ddffc85be0a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:15.722674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2006e03d-4d3d-42ba-b6ba-1ddffc85be0a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:15.749215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2006e03d-4d3d-42ba-b6ba-1ddffc85be0a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:15.749757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2006e03d-4d3d-42ba-b6ba-1ddffc85be0a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:15.756380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2006e03d-4d3d-42ba-b6ba-1ddffc85be0a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:15.758916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2006e03d-4d3d-42ba-b6ba-1ddffc85be0a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:15.760761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2006e03d-4d3d-42ba-b6ba-1ddffc85be0a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:15.761451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2006e03d-4d3d-42ba-b6ba-1ddffc85be0a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:15.837566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2ff9e43b-9ca0-470c-a132-d10202f9012e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:15.838551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2ff9e43b-9ca0-470c-a132-d10202f9012e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:15.878357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ff9e43b-9ca0-470c-a132-d10202f9012e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:15.884309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ff9e43b-9ca0-470c-a132-d10202f9012e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:15.887715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ff9e43b-9ca0-470c-a132-d10202f9012e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:15.889267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ff9e43b-9ca0-470c-a132-d10202f9012e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:15.889768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ff9e43b-9ca0-470c-a132-d10202f9012e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:15.890217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ff9e43b-9ca0-470c-a132-d10202f9012e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:15.902148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=73 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:16.012738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:17.204904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2006e03d-4d3d-42ba-b6ba-1ddffc85be0a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:17.240898 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2006e03d-4d3d-42ba-b6ba-1ddffc85be0a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1270 microversion: 2.1 time: 1.522119 Sep 08 12:51:17.244762 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1130/2387] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:15 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1270 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:17.266139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4efb28d3-fa06-43f9-ac29-9adc4f6628ef tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3a781670>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:17.408375 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4efb28d3-fa06-43f9-ac29-9adc4f6628ef tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.154989 Sep 08 12:51:17.410298 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1131/2388] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:17 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:17.498164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2ff9e43b-9ca0-470c-a132-d10202f9012e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:17.509542 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2ff9e43b-9ca0-470c-a132-d10202f9012e tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1321 microversion: 2.1 time: 1.678028 Sep 08 12:51:17.528062 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1258/2389] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:15 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1321 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:17.543169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e9db7010-6396-4647-afe4-82b24d59a2a2 req-de36525d-2ca8-48a0-853a-8b1295a7f829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e013eb03-cc1b-4f91-b8be-a2f1452a8397", "name": "network-vif-plugged", "status": "completed", "tag": "f3d6544c-d4d4-4764-97b8-2d6dcc1431af"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:17.574486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e9db7010-6396-4647-afe4-82b24d59a2a2 req-de36525d-2ca8-48a0-853a-8b1295a7f829 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:17.574995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e9db7010-6396-4647-afe4-82b24d59a2a2 req-de36525d-2ca8-48a0-853a-8b1295a7f829 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:17.577166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e9db7010-6396-4647-afe4-82b24d59a2a2 req-de36525d-2ca8-48a0-853a-8b1295a7f829 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:17.609699 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e9db7010-6396-4647-afe4-82b24d59a2a2 req-de36525d-2ca8-48a0-853a-8b1295a7f829 service nova] Creating event network-vif-plugged:f3d6544c-d4d4-4764-97b8-2d6dcc1431af for instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 on n-h2-852084-10 Sep 08 12:51:17.624017 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e9db7010-6396-4647-afe4-82b24d59a2a2 req-de36525d-2ca8-48a0-853a-8b1295a7f829 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094190 Sep 08 12:51:17.625074 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1259/2390] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:17.857841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ccd0fb95-6ecf-46e2-8819-233bb6c13c9e tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Action: 'create', calling method: .version_select at 0x7fdb3f2a7790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1746293336"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:18.283600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a287eb99-93a0-42c5-a15d-8221b59aa5ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:18.293590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a287eb99-93a0-42c5-a15d-8221b59aa5ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:18.336846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a287eb99-93a0-42c5-a15d-8221b59aa5ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:18.344520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a287eb99-93a0-42c5-a15d-8221b59aa5ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:18.345070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a287eb99-93a0-42c5-a15d-8221b59aa5ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:18.345866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a287eb99-93a0-42c5-a15d-8221b59aa5ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:18.349916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a287eb99-93a0-42c5-a15d-8221b59aa5ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:18.350364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a287eb99-93a0-42c5-a15d-8221b59aa5ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:18.504773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a287eb99-93a0-42c5-a15d-8221b59aa5ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:18.534332 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a287eb99-93a0-42c5-a15d-8221b59aa5ae tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1276 microversion: 2.1 time: 0.256974 Sep 08 12:51:18.535145 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1260/2391] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:18 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1276 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:51:18.540159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7495e493-5574-4b28-9457-a333c2441c3c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb35eb89d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:18.647202 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ccd0fb95-6ecf-46e2-8819-233bb6c13c9e tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 1.234652 Sep 08 12:51:18.649036 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1132/2392] 10.222.0.78 () {60 vars in 1155 bytes} [Thu Sep 8 12:51:17 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 1237 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 12:51:18.660681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ae65fcc5-5a0b-4425-af34-f750ca2a73ef tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:18.664850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ae65fcc5-5a0b-4425-af34-f750ca2a73ef tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:18.676579 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7495e493-5574-4b28-9457-a333c2441c3c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.140266 Sep 08 12:51:18.680246 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1261/2393] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:18 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:18.724721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae65fcc5-5a0b-4425-af34-f750ca2a73ef tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:18.730681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae65fcc5-5a0b-4425-af34-f750ca2a73ef tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:18.733770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae65fcc5-5a0b-4425-af34-f750ca2a73ef tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:18.735038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae65fcc5-5a0b-4425-af34-f750ca2a73ef tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:18.739159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae65fcc5-5a0b-4425-af34-f750ca2a73ef tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:18.741008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae65fcc5-5a0b-4425-af34-f750ca2a73ef tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:18.742354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ff33eac8-26c5-4078-936f-96954eabf131 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb35ea0a60>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:18.997586 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ff33eac8-26c5-4078-936f-96954eabf131 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a" status: 200 len: 345 microversion: 2.1 time: 0.315138 Sep 08 12:51:18.998808 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1262/2394] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:51:18 2022] GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a => generated 345 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:19.292803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ae65fcc5-5a0b-4425-af34-f750ca2a73ef tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:19.312928 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ae65fcc5-5a0b-4425-af34-f750ca2a73ef tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1321 microversion: 2.1 time: 0.661245 Sep 08 12:51:19.314915 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1133/2395] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:18 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1321 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:19.588434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-92941912-fdfa-4285-b5c0-63485db553de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:19.592029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-92941912-fdfa-4285-b5c0-63485db553de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:19.673336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92941912-fdfa-4285-b5c0-63485db553de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:19.704386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01c8a164-3b09-4d25-938c-b7a23cc66da4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3a781700>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:19.727307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92941912-fdfa-4285-b5c0-63485db553de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.054s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:19.728694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92941912-fdfa-4285-b5c0-63485db553de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:19.734240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92941912-fdfa-4285-b5c0-63485db553de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:19.744281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92941912-fdfa-4285-b5c0-63485db553de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:19.749986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92941912-fdfa-4285-b5c0-63485db553de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:19.833427 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-01c8a164-3b09-4d25-938c-b7a23cc66da4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.135538 Sep 08 12:51:19.845965 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1134/2396] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:19 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:20.014793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7faac652-20a2-4459-8193-3ad6fb1acef4 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb3afd8ca0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:20.177315 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7faac652-20a2-4459-8193-3ad6fb1acef4 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a" status: 200 len: 345 microversion: 2.1 time: 0.167558 Sep 08 12:51:20.178008 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1135/2397] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:51:20 2022] GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:51:20.276354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-92941912-fdfa-4285-b5c0-63485db553de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:20.339904 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-92941912-fdfa-4285-b5c0-63485db553de tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1276 microversion: 2.1 time: 0.754875 Sep 08 12:51:20.348459 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1263/2398] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:19 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1276 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:20.368765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-37068188-dd46-4bad-9889-92bff761334b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:20.371601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-37068188-dd46-4bad-9889-92bff761334b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:20.396675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37068188-dd46-4bad-9889-92bff761334b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:20.399882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37068188-dd46-4bad-9889-92bff761334b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:20.401499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37068188-dd46-4bad-9889-92bff761334b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:20.406891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37068188-dd46-4bad-9889-92bff761334b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:20.408293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37068188-dd46-4bad-9889-92bff761334b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:20.409548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37068188-dd46-4bad-9889-92bff761334b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:20.499868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c6758856-b189-42ab-896c-469f9b703db3 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'create', calling method: .version_select at 0x7fdb3f1b1ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-854658842", "description": "tempest-description-1672758216"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:21.000974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-37068188-dd46-4bad-9889-92bff761334b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:21.052999 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-37068188-dd46-4bad-9889-92bff761334b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1471 microversion: 2.1 time: 0.700245 Sep 08 12:51:21.055825 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1264/2399] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:20 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1471 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:21.066138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7fca3365-6137-47aa-8850-210fecd10851 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb35eb8310>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:21.228318 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7fca3365-6137-47aa-8850-210fecd10851 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.169998 Sep 08 12:51:21.230060 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1265/2400] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:21 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:21.256009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e22d2a0-6548-4e0d-bebf-db3c8648c003 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:21.257519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8e22d2a0-6548-4e0d-bebf-db3c8648c003 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:21.316588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e22d2a0-6548-4e0d-bebf-db3c8648c003 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:21.325848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e22d2a0-6548-4e0d-bebf-db3c8648c003 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:21.327673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e22d2a0-6548-4e0d-bebf-db3c8648c003 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:21.332038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e22d2a0-6548-4e0d-bebf-db3c8648c003 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:21.347402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e22d2a0-6548-4e0d-bebf-db3c8648c003 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:21.352092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e22d2a0-6548-4e0d-bebf-db3c8648c003 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:21.439119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-8e22d2a0-6548-4e0d-bebf-db3c8648c003 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lazy-loading 'flavor' on Instance uuid e013eb03-cc1b-4f91-b8be-a2f1452a8397 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:51:21.692831 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8e22d2a0-6548-4e0d-bebf-db3c8648c003 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397/action" status: 202 len: 0 microversion: 2.1 time: 0.447811 Sep 08 12:51:21.695790 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1266/2401] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:51:21 2022] POST /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397/action => generated 0 bytes in 465 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:51:21.711898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d0b3df14-b98b-4bfe-9b65-b85aea38d556 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb35eb8940>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:21.987556 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d0b3df14-b98b-4bfe-9b65-b85aea38d556 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a" status: 200 len: 345 microversion: 2.1 time: 0.289531 Sep 08 12:51:21.988480 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1267/2402] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:51:21 2022] GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a => generated 345 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:21.993607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-02ea1d14-f203-4920-8187-f10ca42d4d85 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:21.995581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-02ea1d14-f203-4920-8187-f10ca42d4d85 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:22.009956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02ea1d14-f203-4920-8187-f10ca42d4d85 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:22.016326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02ea1d14-f203-4920-8187-f10ca42d4d85 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:22.017003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02ea1d14-f203-4920-8187-f10ca42d4d85 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:22.017923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02ea1d14-f203-4920-8187-f10ca42d4d85 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:22.018656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02ea1d14-f203-4920-8187-f10ca42d4d85 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:22.020356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02ea1d14-f203-4920-8187-f10ca42d4d85 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:22.361007 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c6758856-b189-42ab-896c-469f9b703db3 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.176430 Sep 08 12:51:22.361884 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1136/2403] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:51:20 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:22.376035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62645ffa-69be-4e4d-bbba-f52efbb38ec7 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:22.379554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-62645ffa-69be-4e4d-bbba-f52efbb38ec7 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:22.393441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:22.402725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62645ffa-69be-4e4d-bbba-f52efbb38ec7 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:22.404236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62645ffa-69be-4e4d-bbba-f52efbb38ec7 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:22.405016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62645ffa-69be-4e4d-bbba-f52efbb38ec7 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:22.407296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62645ffa-69be-4e4d-bbba-f52efbb38ec7 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:22.408395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62645ffa-69be-4e4d-bbba-f52efbb38ec7 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:22.409360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62645ffa-69be-4e4d-bbba-f52efbb38ec7 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:22.510802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=52 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:22.934392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-02ea1d14-f203-4920-8187-f10ca42d4d85 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:22.954515 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-02ea1d14-f203-4920-8187-f10ca42d4d85 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1318 microversion: 2.1 time: 0.964698 Sep 08 12:51:22.955129 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1268/2404] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:21 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1318 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:23.260621 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62645ffa-69be-4e4d-bbba-f52efbb38ec7 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1615 microversion: 2.1 time: 0.897373 Sep 08 12:51:23.264396 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1137/2405] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:22 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1615 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:23.274818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e20cae19-1fdb-4049-ab95-146c8262041a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3ad33820>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:23.389053 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e20cae19-1fdb-4049-ab95-146c8262041a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.123250 Sep 08 12:51:23.403979 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1138/2406] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:23 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:23.414016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ca5cb76f-e290-4c41-a07f-1998d5df47b7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'create', calling method: .version_select at 0x7fdb3a778ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1570167282", "description": "tempest-description-226711827"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:23.633059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-db3190db-2491-4273-bffc-28572675d42c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'create', calling method: .version_select at 0x7fdb3f16c9d0>, body: {"keypair": {"name": "tempest-keypair-1387000771", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvI8x0BHEUbX852zPhGB/8MmOpp5uFKPWlWwLKpDaNZaHWmnwrhGVL8uC3BTaM2HA86goWRjNlvPidERvBy1q5fnAqxsv0XGGAMhXmy4HcbLgk9VBpu2PaxRpIL3jAePw=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:23.674038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=39 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:23.705939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-db3190db-2491-4273-bffc-28572675d42c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Getting quotas for project 59dc0decb175444491383c39918c5b2e. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:51:23.738532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-db3190db-2491-4273-bffc-28572675d42c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Getting quotas for user 4140a06bc6934d7780ef9ff3e30e6dd5 and project 59dc0decb175444491383c39918c5b2e. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:51:23.810265 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-db3190db-2491-4273-bffc-28572675d42c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.853360 Sep 08 12:51:23.811450 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1269/2407] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:51:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:23.825669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e00e7d9-b38e-4d32-99db-4f3171ce9b61 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb3f12fe50>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:23.958687 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6e00e7d9-b38e-4d32-99db-4f3171ce9b61 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a" status: 200 len: 346 microversion: 2.1 time: 0.145775 Sep 08 12:51:23.961314 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1270/2408] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:51:23 2022] GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a => generated 346 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:23.967749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-db660fd1-111f-4058-abfe-2ac6e962a09c tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:23.968356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-db660fd1-111f-4058-abfe-2ac6e962a09c tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:23.991445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db660fd1-111f-4058-abfe-2ac6e962a09c tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:23.992248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db660fd1-111f-4058-abfe-2ac6e962a09c tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:23.992919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db660fd1-111f-4058-abfe-2ac6e962a09c tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:23.994046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db660fd1-111f-4058-abfe-2ac6e962a09c tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:23.998345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db660fd1-111f-4058-abfe-2ac6e962a09c tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:23.999073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db660fd1-111f-4058-abfe-2ac6e962a09c tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:24.901398 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-db660fd1-111f-4058-abfe-2ac6e962a09c tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] HTTP exception thrown: Cannot 'migrate' instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 while it is in vm_state suspended Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-db660fd1-111f-4058-abfe-2ac6e962a09c tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Request method failure captured: Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397/action HTTP/1.1 Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 15 Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeUEayy4HbPzTbIaDThlPROzdiM_ftlgISXS8iKYWvmMS10EVeuJfZvzBLBehX2g4y6RE9N5g4yWZRW_U-T1EyXNWlLgTBviU4sEzc5flilDlKtcWuUwGZGagodpeS5v7-NwPtQywWOhGO9rq9X2dIaurQZ4z8l-8-69PFrfSEz2L3Q Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d076ba92c3944769911ea99df7c75db5 Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d076ba92c3944769911ea99df7c75db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d076ba92c3944769911ea99df7c75db5 Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersAdminNegativeTestJSON-632920252-project-admin Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 24f40301f9e947739dc815ef00599fb5 Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersAdminNegativeTestJSON-632920252-project-admin Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: {"migrate": {}} Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: exception: Cannot 'migrate' instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 while it is in vm_state suspended Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'e013eb03-cc1b-4f91-b8be-a2f1452a8397', 'body': {'migrate': {}}} Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 in vm_state suspended. Cannot resize while the instance is in this state. Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:51:24.904865 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 while it is in vm_state suspended Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 while it is in vm_state suspended Sep 08 12:51:24.910284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:24.914419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-db660fd1-111f-4058-abfe-2ac6e962a09c tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Returning 409 to user: Cannot 'migrate' instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 while it is in vm_state suspended {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:24.915987 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-db660fd1-111f-4058-abfe-2ac6e962a09c tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397/action" status: 409 len: 148 microversion: 2.1 time: 0.953423 Sep 08 12:51:24.916824 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1271/2409] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:51:23 2022] POST /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397/action => generated 148 bytes in 955 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:51:24.926918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2cf9a513-c089-4494-92b2-3580eb1b1180 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Action: 'create', calling method: .version_select at 0x7fdb3f0bd0d0>, body: {"snapshot": {"volume_id": "193f1fa1-b6f8-4526-81bb-350f88e2787a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1507734526"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:25.540740 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2cf9a513-c089-4494-92b2-3580eb1b1180 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.621516 Sep 08 12:51:25.542055 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1272/2410] 10.222.0.78 () {60 vars in 1162 bytes} [Thu Sep 8 12:51:24 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:25.561593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-06fd2062-451f-40a8-9f4d-de6c1eab36f9 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:25.562373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-06fd2062-451f-40a8-9f4d-de6c1eab36f9 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:25.596195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06fd2062-451f-40a8-9f4d-de6c1eab36f9 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:25.596849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06fd2062-451f-40a8-9f4d-de6c1eab36f9 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:25.597322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06fd2062-451f-40a8-9f4d-de6c1eab36f9 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:25.602687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06fd2062-451f-40a8-9f4d-de6c1eab36f9 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:25.604403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06fd2062-451f-40a8-9f4d-de6c1eab36f9 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:25.606164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06fd2062-451f-40a8-9f4d-de6c1eab36f9 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:25.748771 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ca5cb76f-e290-4c41-a07f-1998d5df47b7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 2.343528 Sep 08 12:51:25.749842 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1139/2411] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:51:23 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 2345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:25.757628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-58711a77-765d-4c4e-8e71-dccba4795e41 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f1b2430>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:25.868447 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-58711a77-765d-4c4e-8e71-dccba4795e41 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.114741 Sep 08 12:51:25.883987 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1140/2412] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:25 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:25.957017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-042f6cda-10cc-413e-a6c8-f531582aecfb tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-042f6cda-10cc-413e-a6c8-f531582aecfb tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Request method failure captured: Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677/action HTTP/1.1 Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 39 Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeUEayy4HbPzTbIaDThlPROzdiM_ftlgISXS8iKYWvmMS10EVeuJfZvzBLBehX2g4y6RE9N5g4yWZRW_U-T1EyXNWlLgTBviU4sEzc5flilDlKtcWuUwGZGagodpeS5v7-NwPtQywWOhGO9rq9X2dIaurQZ4z8l-8-69PFrfSEz2L3Q Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d076ba92c3944769911ea99df7c75db5 Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d076ba92c3944769911ea99df7c75db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d076ba92c3944769911ea99df7c75db5 Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersAdminNegativeTestJSON-632920252-project-admin Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 24f40301f9e947739dc815ef00599fb5 Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersAdminNegativeTestJSON-632920252-project-admin Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: {"os-resetState": {"state": "invalid"}} Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '96af37e5-73b1-44a9-bdd6-7bdc5508b677', 'body': {'os-resetState': {'state': 'invalid'}}} Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'invalid' Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:51:25.984206 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:51:25.991967 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 08 12:51:25.991967 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:25.991967 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:25.991967 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:25.991967 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:25.991967 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:25.991967 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:25.991967 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:51:25.991967 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:51:25.991967 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Sep 08 12:51:25.991967 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:25.995394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-042f6cda-10cc-413e-a6c8-f531582aecfb tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:26.005934 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-042f6cda-10cc-413e-a6c8-f531582aecfb tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677/action" status: 400 len: 144 microversion: 2.1 time: 0.109056 Sep 08 12:51:26.012479 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1141/2413] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:51:25 2022] POST /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677/action => generated 144 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:51:26.028595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-06701255-ca5c-471e-98bd-1e7f6194c85c tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb3f1d21f0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:26.227667 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-06701255-ca5c-471e-98bd-1e7f6194c85c tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/099b7b3a-dd57-4b7a-8f18-f71e188665a2" status: 200 len: 287 microversion: 2.1 time: 0.212459 Sep 08 12:51:26.229314 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1142/2414] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Sep 8 12:51:26 2022] GET /compute/v2.1/os-snapshots/099b7b3a-dd57-4b7a-8f18-f71e188665a2 => generated 287 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:26.235961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c01b26ee-95e1-4514-9fd6-4f37049dc9ad req-5911e2e8-af80-4440-93ef-63b9547a4d51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "141ab14e-b6e6-467a-83f1-7dbbbb899158", "tag": "305e290f-8a75-4172-a7c0-6feb49a5e0ae"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:26.261461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c01b26ee-95e1-4514-9fd6-4f37049dc9ad req-5911e2e8-af80-4440-93ef-63b9547a4d51 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:26.269191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c01b26ee-95e1-4514-9fd6-4f37049dc9ad req-5911e2e8-af80-4440-93ef-63b9547a4d51 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:26.270162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c01b26ee-95e1-4514-9fd6-4f37049dc9ad req-5911e2e8-af80-4440-93ef-63b9547a4d51 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:26.310174 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c01b26ee-95e1-4514-9fd6-4f37049dc9ad req-5911e2e8-af80-4440-93ef-63b9547a4d51 service nova] Creating event network-changed:305e290f-8a75-4172-a7c0-6feb49a5e0ae for instance 141ab14e-b6e6-467a-83f1-7dbbbb899158 on n-h1-852084-10 Sep 08 12:51:26.335799 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c01b26ee-95e1-4514-9fd6-4f37049dc9ad req-5911e2e8-af80-4440-93ef-63b9547a4d51 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104116 Sep 08 12:51:26.342449 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1143/2415] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:26.370549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e870e706-5a3f-42b0-bc12-dd66639390a3 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e870e706-5a3f-42b0-bc12-dd66639390a3 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Request method failure captured: Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677/action HTTP/1.1 Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 31 Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeUEayy4HbPzTbIaDThlPROzdiM_ftlgISXS8iKYWvmMS10EVeuJfZvzBLBehX2g4y6RE9N5g4yWZRW_U-T1EyXNWlLgTBviU4sEzc5flilDlKtcWuUwGZGagodpeS5v7-NwPtQywWOhGO9rq9X2dIaurQZ4z8l-8-69PFrfSEz2L3Q Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d076ba92c3944769911ea99df7c75db5 Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d076ba92c3944769911ea99df7c75db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d076ba92c3944769911ea99df7c75db5 Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersAdminNegativeTestJSON-632920252-project-admin Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 24f40301f9e947739dc815ef00599fb5 Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersAdminNegativeTestJSON-632920252-project-admin Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: {"os-resetState": {"state": 1}} Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '96af37e5-73b1-44a9-bdd6-7bdc5508b677', 'body': {'os-resetState': {'state': 1}}} Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 1 Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 08 12:51:26.385968 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:26.391396 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:26.391396 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:26.391396 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:26.391396 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:26.391396 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:26.391396 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:51:26.391396 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:51:26.391396 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Sep 08 12:51:26.391396 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:26.391396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e870e706-5a3f-42b0-bc12-dd66639390a3 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:26.392033 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e870e706-5a3f-42b0-bc12-dd66639390a3 tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677/action" status: 400 len: 120 microversion: 2.1 time: 0.046041 Sep 08 12:51:26.406455 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1144/2416] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:51:26 2022] POST /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677/action => generated 120 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:51:26.425143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1702814291", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "5505b431-686a-457c-9712-0faff9f3c3fd"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:26.555946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] validate_networks() for [('5505b431-686a-457c-9712-0faff9f3c3fd', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:51:28.793280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-06fd2062-451f-40a8-9f4d-de6c1eab36f9 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:28.805844 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-06fd2062-451f-40a8-9f4d-de6c1eab36f9 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1318 microversion: 2.1 time: 3.252681 Sep 08 12:51:28.816699 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1273/2417] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:25 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1318 bytes in 3265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:28.826635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d94726b7-57d0-4e14-8873-0dd553f021c1 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb3f0ea940>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:28.931442 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d94726b7-57d0-4e14-8873-0dd553f021c1 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.113267 Sep 08 12:51:28.932287 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1274/2418] 10.222.0.78 () {58 vars in 1140 bytes} [Thu Sep 8 12:51:28 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:28.947792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c06b1bc9-005f-4427-8d7f-b051591633ea tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:28.950434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c06b1bc9-005f-4427-8d7f-b051591633ea tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Failed to fetch instance by id 999 {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 12:51:28.951152 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-c06b1bc9-005f-4427-8d7f-b051591633ea tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] HTTP exception thrown: Instance 999 could not be found. Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c06b1bc9-005f-4427-8d7f-b051591633ea tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Request method failure captured: Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 37 Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeUEayy4HbPzTbIaDThlPROzdiM_ftlgISXS8iKYWvmMS10EVeuJfZvzBLBehX2g4y6RE9N5g4yWZRW_U-T1EyXNWlLgTBviU4sEzc5flilDlKtcWuUwGZGagodpeS5v7-NwPtQywWOhGO9rq9X2dIaurQZ4z8l-8-69PFrfSEz2L3Q Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d076ba92c3944769911ea99df7c75db5 Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d076ba92c3944769911ea99df7c75db5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d076ba92c3944769911ea99df7c75db5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d076ba92c3944769911ea99df7c75db5 Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-632920252 Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersAdminNegativeTestJSON-632920252-project-admin Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 24f40301f9e947739dc815ef00599fb5 Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersAdminNegativeTestJSON-632920252-project-admin Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: {"os-resetState": {"state": "error"}} Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 999 could not be found. Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:28.957014 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:51:28.961266 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:51:28.961266 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 08 12:51:28.961266 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:28.962326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c06b1bc9-005f-4427-8d7f-b051591633ea tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:28.963393 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c06b1bc9-005f-4427-8d7f-b051591633ea tempest-ServersAdminNegativeTestJSON-632920252 tempest-ServersAdminNegativeTestJSON-632920252-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.029830 Sep 08 12:51:28.968755 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1275/2419] 10.222.0.78 () {60 vars in 1179 bytes} [Thu Sep 8 12:51:28 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:51:28.974683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-245bdf31-bdcb-4c36-8bdd-0f6746a9be53 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f165280>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:29.049467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:51:29.050276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:51:29.050464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:51:29.050771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:51:29.051206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:51:29.090447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:29.091117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:29.099867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:29.101237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:29.101996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:29.102709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:29.172345 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-245bdf31-bdcb-4c36-8bdd-0f6746a9be53 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1421 microversion: 2.1 time: 0.201991 Sep 08 12:51:29.187685 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1276/2420] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:28 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1421 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:29.214698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Getting quotas for project b4685a4a696449fd8fd85f135e05900b. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:51:29.250569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Getting quotas for user b78e89e2a3ff4ee4924306aad4fc13cf and project b4685a4a696449fd8fd85f135e05900b. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:51:29.345121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:51:29.354535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:51:29.660325 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8aae1e7c-7497-4585-a1db-9d8ee33e77cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.247601 Sep 08 12:51:29.668003 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1145/2421] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:51:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3261 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:51:29.737693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ca035f2b-75a4-4dee-af20-d18ed0d7b071 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb3f1a4a60>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:29.898739 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ca035f2b-75a4-4dee-af20-d18ed0d7b071 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/099b7b3a-dd57-4b7a-8f18-f71e188665a2" status: 200 len: 287 microversion: 2.1 time: 0.209954 Sep 08 12:51:29.900595 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1146/2422] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Sep 8 12:51:29 2022] GET /compute/v2.1/os-snapshots/099b7b3a-dd57-4b7a-8f18-f71e188665a2 => generated 287 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:29.991938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff88fd73-c827-4fac-9015-83e5f0ee606b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:30.026293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ff88fd73-c827-4fac-9015-83e5f0ee606b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:30.121303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff88fd73-c827-4fac-9015-83e5f0ee606b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:30.122808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff88fd73-c827-4fac-9015-83e5f0ee606b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:30.122808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff88fd73-c827-4fac-9015-83e5f0ee606b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:30.126690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff88fd73-c827-4fac-9015-83e5f0ee606b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:30.127216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff88fd73-c827-4fac-9015-83e5f0ee606b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:30.134666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff88fd73-c827-4fac-9015-83e5f0ee606b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:30.195299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-944511180", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:30.324593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ff88fd73-c827-4fac-9015-83e5f0ee606b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:51:30.490100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:51:30.611775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:30.624740 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ff88fd73-c827-4fac-9015-83e5f0ee606b tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 204 len: 0 microversion: 2.1 time: 0.719644 Sep 08 12:51:30.627071 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1147/2423] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:51:29 2022] DELETE /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:51:30.638676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-324dcfc4-aed6-42d6-be34-b3b961f7459b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:30.640923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-324dcfc4-aed6-42d6-be34-b3b961f7459b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:31.142107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-324dcfc4-aed6-42d6-be34-b3b961f7459b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:31.156521 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-324dcfc4-aed6-42d6-be34-b3b961f7459b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 200 len: 1216 microversion: 2.1 time: 0.527286 Sep 08 12:51:31.159380 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1148/2424] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:30 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 1216 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:31.174737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-25c26103-255f-4e35-b7ea-a62c12d52e1d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:31.176386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-25c26103-255f-4e35-b7ea-a62c12d52e1d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:31.194343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c26103-255f-4e35-b7ea-a62c12d52e1d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:31.195184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c26103-255f-4e35-b7ea-a62c12d52e1d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:31.197627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c26103-255f-4e35-b7ea-a62c12d52e1d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:31.199052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c26103-255f-4e35-b7ea-a62c12d52e1d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:31.200387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c26103-255f-4e35-b7ea-a62c12d52e1d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:31.202513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c26103-255f-4e35-b7ea-a62c12d52e1d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:31.645624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-25c26103-255f-4e35-b7ea-a62c12d52e1d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:31.677057 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-25c26103-255f-4e35-b7ea-a62c12d52e1d tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1318 microversion: 2.1 time: 0.514569 Sep 08 12:51:31.677979 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1149/2425] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:31 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1318 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:31.716377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-554d2bc8-5257-4f49-bce0-53a587202ca0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f1b2940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:31.738370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:51:31.739492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:51:31.740067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:51:31.740840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:51:31.741801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:51:31.758562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:31.760362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:31.761715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:31.763047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:31.764485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:31.766487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:31.801336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Getting quotas for project 6c7023382ac747a2a84467a1b13b3bdb. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:51:31.812994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Getting quotas for user 1ef692f2f2ae4e8190248fc0c1f967ee and project 6c7023382ac747a2a84467a1b13b3bdb. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:51:31.845199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:51:31.849961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:51:31.895197 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-554d2bc8-5257-4f49-bce0-53a587202ca0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1430 microversion: 2.1 time: 0.201058 Sep 08 12:51:31.901490 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1150/2426] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:31 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1430 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:31.937383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-950df054-f7ce-483b-94c4-f10a62b6471f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:31.939844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-950df054-f7ce-483b-94c4-f10a62b6471f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:31.978504 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6b7a0a32-d565-4481-b66a-5f3cbb213c00 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.789050 Sep 08 12:51:31.984276 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1277/2427] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:51:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 2796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:51:31.999031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-982575267", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "cdb1ed3b-ed33-4661-873e-5f5b6dd79de8"}, {"uuid": "24f3562c-939d-46f3-8218-275a75730986"}, {"uuid": "cdb1ed3b-ed33-4661-873e-5f5b6dd79de8"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:32.003108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-950df054-f7ce-483b-94c4-f10a62b6471f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:32.004090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-950df054-f7ce-483b-94c4-f10a62b6471f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:32.004919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-950df054-f7ce-483b-94c4-f10a62b6471f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:32.006263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-950df054-f7ce-483b-94c4-f10a62b6471f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:32.007164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-950df054-f7ce-483b-94c4-f10a62b6471f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:32.017720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-950df054-f7ce-483b-94c4-f10a62b6471f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:32.256031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] validate_networks() for [('cdb1ed3b-ed33-4661-873e-5f5b6dd79de8', None, None, None, None, None), ('24f3562c-939d-46f3-8218-275a75730986', None, None, None, None, None), ('cdb1ed3b-ed33-4661-873e-5f5b6dd79de8', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:51:32.328037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-950df054-f7ce-483b-94c4-f10a62b6471f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:32.350260 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-950df054-f7ce-483b-94c4-f10a62b6471f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 200 len: 1468 microversion: 2.1 time: 0.446916 Sep 08 12:51:32.350886 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1151/2428] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:31 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 1468 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:32.357031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-41decd15-13ff-4fa1-b2d0-fb2fa3902e78 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb3abdd550>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:32.459964 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-41decd15-13ff-4fa1-b2d0-fb2fa3902e78 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/099b7b3a-dd57-4b7a-8f18-f71e188665a2" status: 200 len: 288 microversion: 2.1 time: 0.102914 Sep 08 12:51:32.460689 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1152/2429] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Sep 8 12:51:32 2022] GET /compute/v2.1/os-snapshots/099b7b3a-dd57-4b7a-8f18-f71e188665a2 => generated 288 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:32.482011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38e7ce7b-659a-4fb7-9fd5-b43f97c6b4d6 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3a778c10>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:32.661736 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38e7ce7b-659a-4fb7-9fd5-b43f97c6b4d6 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 200 len: 1430 microversion: 2.1 time: 0.189811 Sep 08 12:51:32.667654 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1153/2430] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:32 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 1430 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:32.699518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1098257093", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:32.904306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:51:34.018958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:51:34.019767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:51:34.019916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:51:34.020534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:51:34.021076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:51:34.031790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:34.032520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:34.032976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:34.033793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:34.034257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:34.034888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:34.056132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Getting quotas for project 6c7023382ac747a2a84467a1b13b3bdb. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:51:34.063718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Getting quotas for user 1ef692f2f2ae4e8190248fc0c1f967ee and project 6c7023382ac747a2a84467a1b13b3bdb. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:51:34.080619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:51:34.083692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:51:34.154892 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b382350e-fdee-4cd0-a3e3-db6ea53c1dcb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.483286 Sep 08 12:51:34.157024 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1154/2431] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:51:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:51:34.169165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6cf5bc0e-6a23-4f7e-bb8e-10f5670d5566 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:34.170627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6cf5bc0e-6a23-4f7e-bb8e-10f5670d5566 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:34.185800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6cf5bc0e-6a23-4f7e-bb8e-10f5670d5566 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:34.186986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6cf5bc0e-6a23-4f7e-bb8e-10f5670d5566 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:34.188056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6cf5bc0e-6a23-4f7e-bb8e-10f5670d5566 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:34.189814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6cf5bc0e-6a23-4f7e-bb8e-10f5670d5566 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:34.191170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6cf5bc0e-6a23-4f7e-bb8e-10f5670d5566 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:34.192483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6cf5bc0e-6a23-4f7e-bb8e-10f5670d5566 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:34.335481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6cf5bc0e-6a23-4f7e-bb8e-10f5670d5566 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:34.360528 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6cf5bc0e-6a23-4f7e-bb8e-10f5670d5566 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 200 len: 1274 microversion: 2.1 time: 0.201373 Sep 08 12:51:34.378742 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1155/2432] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:34 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:34.412367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ea47f30b-ae59-4c68-9548-60a732657ecc tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb3ae88160>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:34.607621 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ea47f30b-ae59-4c68-9548-60a732657ecc tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/099b7b3a-dd57-4b7a-8f18-f71e188665a2" status: 202 len: 0 microversion: 2.1 time: 0.222989 Sep 08 12:51:34.609650 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1156/2433] 10.222.0.78 () {58 vars in 1254 bytes} [Thu Sep 8 12:51:34 2022] DELETE /compute/v2.1/os-snapshots/099b7b3a-dd57-4b7a-8f18-f71e188665a2 => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:51:34.630277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-79e25c72-fb6b-42e8-a87b-bc1ce06ecf5b tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:34.631732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-79e25c72-fb6b-42e8-a87b-bc1ce06ecf5b tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:34.661211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79e25c72-fb6b-42e8-a87b-bc1ce06ecf5b tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:34.662241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79e25c72-fb6b-42e8-a87b-bc1ce06ecf5b tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:34.663072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79e25c72-fb6b-42e8-a87b-bc1ce06ecf5b tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:34.664496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79e25c72-fb6b-42e8-a87b-bc1ce06ecf5b tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:34.665404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79e25c72-fb6b-42e8-a87b-bc1ce06ecf5b tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:34.666221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79e25c72-fb6b-42e8-a87b-bc1ce06ecf5b tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:36.247006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-79e25c72-fb6b-42e8-a87b-bc1ce06ecf5b tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:36.273367 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-79e25c72-fb6b-42e8-a87b-bc1ce06ecf5b tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1465 microversion: 2.1 time: 1.661766 Sep 08 12:51:36.273986 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1157/2434] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:34 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1465 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:36.346843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01c2ce39-c97a-409e-8422-345624af685a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:36.348274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-01c2ce39-c97a-409e-8422-345624af685a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:36.371152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01c2ce39-c97a-409e-8422-345624af685a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:36.372351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01c2ce39-c97a-409e-8422-345624af685a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:36.382411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01c2ce39-c97a-409e-8422-345624af685a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:36.384335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01c2ce39-c97a-409e-8422-345624af685a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:36.385189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01c2ce39-c97a-409e-8422-345624af685a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:36.385807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01c2ce39-c97a-409e-8422-345624af685a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:38.337543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-01c2ce39-c97a-409e-8422-345624af685a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:38.352122 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-01c2ce39-c97a-409e-8422-345624af685a tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1318 microversion: 2.1 time: 2.019166 Sep 08 12:51:38.352614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:51:38.353376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:51:38.355336 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1158/2435] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:36 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1318 bytes in 2081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:38.368639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:51:38.368639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:51:38.368639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:51:38.392213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-30bce8e1-dbe1-408b-92ca-38cad8e5d37f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:38.393412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-30bce8e1-dbe1-408b-92ca-38cad8e5d37f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: e013eb03-cc1b-4f91-b8be-a2f1452a8397] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:38.404922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:38.413145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:38.414032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:38.415587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:38.416484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:38.417453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:38.420064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-30bce8e1-dbe1-408b-92ca-38cad8e5d37f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:38.420984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-30bce8e1-dbe1-408b-92ca-38cad8e5d37f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:38.422587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-30bce8e1-dbe1-408b-92ca-38cad8e5d37f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:38.424231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-30bce8e1-dbe1-408b-92ca-38cad8e5d37f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:38.424920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-30bce8e1-dbe1-408b-92ca-38cad8e5d37f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:38.426324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-30bce8e1-dbe1-408b-92ca-38cad8e5d37f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:38.456059 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-30bce8e1-dbe1-408b-92ca-38cad8e5d37f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] HTTP exception thrown: Instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 could not be found. Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-30bce8e1-dbe1-408b-92ca-38cad8e5d37f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Request method failure captured: Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 HTTP/1.1 Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeUCmb7yvDT_P9wYsQoxuQvGB4KMBkOYSjECae_wOEveTmDc_uBBvkdY817gpRbWwp9i_fRMg9epLgnMsLC63P9KUJQLRH07dthhOT6ZuCvkQvo5TxhXzAoEjS-OeaDy3Fba5QXUuAufaxIbrSXpQPF2lRovffRksokwcRwPqiS_w4o Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d9dedae99bc2492c850c6bb721928d6e Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-812091835 Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d9dedae99bc2492c850c6bb721928d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d9dedae99bc2492c850c6bb721928d6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d9dedae99bc2492c850c6bb721928d6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d9dedae99bc2492c850c6bb721928d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersAdminNegativeTestJSON-812091835 Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d9dedae99bc2492c850c6bb721928d6e Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-812091835 Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersAdminNegativeTestJSON-812091835-project Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6859ddadc55d43d4b245ba732b478226 Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersAdminNegativeTestJSON-812091835-project Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 could not be found. Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'e013eb03-cc1b-4f91-b8be-a2f1452a8397'} Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 could not be found. Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 could not be found. Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:38.458408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:38.463894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:38.463894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:38.463894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:38.463894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:38.463894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:51:38.463894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:51:38.463894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 could not be found. Sep 08 12:51:38.463894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:38.478927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-30bce8e1-dbe1-408b-92ca-38cad8e5d37f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Returning 404 to user: Instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:38.480194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Getting quotas for project a2b4bb04764e484099a1380cee0343d9. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:51:38.480540 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-30bce8e1-dbe1-408b-92ca-38cad8e5d37f tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397" status: 404 len: 111 microversion: 2.1 time: 0.097937 Sep 08 12:51:38.482217 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1159/2436] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:38 2022] GET /compute/v2.1/servers/e013eb03-cc1b-4f91-b8be-a2f1452a8397 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:51:38.490341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Getting quotas for user 7063832f6c334d26bd0f30b5b16116b4 and project a2b4bb04764e484099a1380cee0343d9. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:51:38.497365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1125420134", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "82a4dc57-b1c7-4ce5-8528-3df2b0721b51"}], "security_groups": [{"name": "tempest-securitygroup--1237109724"}], "key_name": "tempest-keypair-1387000771", "user_data": "}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:38.508021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:51:38.510848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:51:38.605002 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-69326ec8-2ddd-4f62-808a-b7b49d3a624b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.618718 Sep 08 12:51:38.614418 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1278/2437] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:51:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 6629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:51:38.620538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-34147d1d-7c0f-4911-9db1-cc8ab54f1bad tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:38.621247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-34147d1d-7c0f-4911-9db1-cc8ab54f1bad tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:38.630264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34147d1d-7c0f-4911-9db1-cc8ab54f1bad tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:38.630775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34147d1d-7c0f-4911-9db1-cc8ab54f1bad tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:38.631430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34147d1d-7c0f-4911-9db1-cc8ab54f1bad tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:38.632454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34147d1d-7c0f-4911-9db1-cc8ab54f1bad tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:38.632983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34147d1d-7c0f-4911-9db1-cc8ab54f1bad tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:38.633529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34147d1d-7c0f-4911-9db1-cc8ab54f1bad tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:39.092249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] validate_networks() for [('82a4dc57-b1c7-4ce5-8528-3df2b0721b51', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:51:39.363894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-34147d1d-7c0f-4911-9db1-cc8ab54f1bad tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:39.378160 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-34147d1d-7c0f-4911-9db1-cc8ab54f1bad tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910" status: 200 len: 1314 microversion: 2.1 time: 0.761655 Sep 08 12:51:39.391290 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1279/2438] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:38 2022] GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910 => generated 1314 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:39.403299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ddf30dd-bca1-4933-b55e-1d7ec1cd9ee3 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb35e53ee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:39.448371 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6ddf30dd-bca1-4933-b55e-1d7ec1cd9ee3 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] HTTP exception thrown: Snapshot 099b7b3a-dd57-4b7a-8f18-f71e188665a2 could not be found. Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ddf30dd-bca1-4933-b55e-1d7ec1cd9ee3 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Request method failure captured: Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-snapshots/099b7b3a-dd57-4b7a-8f18-f71e188665a2 HTTP/1.1 Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVEiZcPwqm1Y9X5tul3uWXLxLB2sdRJKhTlq9fqzfgGrFyV4VdfVA9NFKl0VG8aaC6EQviOHVCFa0v1zIw61fG28rycLEh92Sa-ZMid_o5I_s9g2N7A_od0KPsr5N59qISpKvovuvFtRE5Q9UJwxvbE2XFV6zJn8TAhkpIeTptbXK0 Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a59dc1dc94fd48adad446ecb5a672d2c Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1408108162 Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1408108162 Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a59dc1dc94fd48adad446ecb5a672d2c Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1408108162 Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesSnapshotsTestJSON-1408108162-project Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 876866409c884dc6b5d1d7fc671ed0ae Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1408108162-project Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: exception: Snapshot 099b7b3a-dd57-4b7a-8f18-f71e188665a2 could not be found. Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '099b7b3a-dd57-4b7a-8f18-f71e188665a2'} Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 099b7b3a-dd57-4b7a-8f18-f71e188665a2 could not be found. (HTTP 404) (Request-ID: req-d59be767-5bbb-49fb-a2a6-9d604c9a3946) Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 12:51:39.455906 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 099b7b3a-dd57-4b7a-8f18-f71e188665a2 could not be found. Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 099b7b3a-dd57-4b7a-8f18-f71e188665a2 could not be found. Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 099b7b3a-dd57-4b7a-8f18-f71e188665a2 could not be found. Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ddf30dd-bca1-4933-b55e-1d7ec1cd9ee3 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Returning 404 to user: Snapshot 099b7b3a-dd57-4b7a-8f18-f71e188665a2 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:39.460762 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6ddf30dd-bca1-4933-b55e-1d7ec1cd9ee3 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/099b7b3a-dd57-4b7a-8f18-f71e188665a2" status: 404 len: 111 microversion: 2.1 time: 0.078675 Sep 08 12:51:39.463671 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1280/2439] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Sep 8 12:51:39 2022] GET /compute/v2.1/os-snapshots/099b7b3a-dd57-4b7a-8f18-f71e188665a2 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:51:39.472337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9d443e7f-31ad-4af4-a045-2cae4fbfdea4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:39.473494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9d443e7f-31ad-4af4-a045-2cae4fbfdea4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:39.487500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d443e7f-31ad-4af4-a045-2cae4fbfdea4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:39.488489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d443e7f-31ad-4af4-a045-2cae4fbfdea4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:39.489212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d443e7f-31ad-4af4-a045-2cae4fbfdea4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:39.490596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d443e7f-31ad-4af4-a045-2cae4fbfdea4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:39.491465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d443e7f-31ad-4af4-a045-2cae4fbfdea4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:39.492564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d443e7f-31ad-4af4-a045-2cae4fbfdea4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:40.265969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d443e7f-31ad-4af4-a045-2cae4fbfdea4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:40.292563 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9d443e7f-31ad-4af4-a045-2cae4fbfdea4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 200 len: 1316 microversion: 2.1 time: 0.829417 Sep 08 12:51:40.298484 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1281/2440] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:39 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 1316 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:40.304091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-669dd075-f227-4dd3-b293-d52b1e356792 req-0ca7b29e-0288-4471-9b3e-4deedfd6c966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "141ab14e-b6e6-467a-83f1-7dbbbb899158", "name": "network-vif-plugged", "status": "completed", "tag": "305e290f-8a75-4172-a7c0-6feb49a5e0ae"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:40.317705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-669dd075-f227-4dd3-b293-d52b1e356792 req-0ca7b29e-0288-4471-9b3e-4deedfd6c966 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:40.318603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-669dd075-f227-4dd3-b293-d52b1e356792 req-0ca7b29e-0288-4471-9b3e-4deedfd6c966 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:40.319344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-669dd075-f227-4dd3-b293-d52b1e356792 req-0ca7b29e-0288-4471-9b3e-4deedfd6c966 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:40.334628 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-669dd075-f227-4dd3-b293-d52b1e356792 req-0ca7b29e-0288-4471-9b3e-4deedfd6c966 service nova] Creating event network-vif-plugged:305e290f-8a75-4172-a7c0-6feb49a5e0ae for instance 141ab14e-b6e6-467a-83f1-7dbbbb899158 on n-h1-852084-10 Sep 08 12:51:40.344204 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-669dd075-f227-4dd3-b293-d52b1e356792 req-0ca7b29e-0288-4471-9b3e-4deedfd6c966 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043941 Sep 08 12:51:40.345611 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1282/2441] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:40.353457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1540dae1-c6b9-46ec-9a47-8084ecc038e9 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb35e204c0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:40.475266 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1540dae1-c6b9-46ec-9a47-8084ecc038e9 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/f54d39f0-e02f-4735-8a67-b5b40688d75d" status: 200 len: 784 microversion: 2.1 time: 0.121390 Sep 08 12:51:40.475266 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1283/2442] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:40 2022] GET /compute/v2.1/images/f54d39f0-e02f-4735-8a67-b5b40688d75d => generated 784 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:40.482421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-9eae7d95-a5fb-48a8-85c5-4b7782b81e89 req-beebfb42-83bc-4986-96ca-77cc254cfc37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e013eb03-cc1b-4f91-b8be-a2f1452a8397", "name": "network-vif-deleted", "tag": "f3d6544c-d4d4-4764-97b8-2d6dcc1431af"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:40.502502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=7 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:40.509964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9eae7d95-a5fb-48a8-85c5-4b7782b81e89 req-beebfb42-83bc-4986-96ca-77cc254cfc37 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:40.511077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9eae7d95-a5fb-48a8-85c5-4b7782b81e89 req-beebfb42-83bc-4986-96ca-77cc254cfc37 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:40.511979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9eae7d95-a5fb-48a8-85c5-4b7782b81e89 req-beebfb42-83bc-4986-96ca-77cc254cfc37 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:40.547569 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-9eae7d95-a5fb-48a8-85c5-4b7782b81e89 req-beebfb42-83bc-4986-96ca-77cc254cfc37 service nova] Creating event network-vif-deleted:f3d6544c-d4d4-4764-97b8-2d6dcc1431af for instance e013eb03-cc1b-4f91-b8be-a2f1452a8397 on n-h2-852084-10 Sep 08 12:51:40.559300 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-9eae7d95-a5fb-48a8-85c5-4b7782b81e89 req-beebfb42-83bc-4986-96ca-77cc254cfc37 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086504 Sep 08 12:51:40.560281 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1284/2443] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:40.571336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-57dfab75-a121-4acd-9efa-679676367bcc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:40.572780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-57dfab75-a121-4acd-9efa-679676367bcc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:40.585461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57dfab75-a121-4acd-9efa-679676367bcc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:40.586786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57dfab75-a121-4acd-9efa-679676367bcc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:40.587888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57dfab75-a121-4acd-9efa-679676367bcc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:40.589348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57dfab75-a121-4acd-9efa-679676367bcc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:40.590956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57dfab75-a121-4acd-9efa-679676367bcc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:40.591965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57dfab75-a121-4acd-9efa-679676367bcc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:40.642859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-57dfab75-a121-4acd-9efa-679676367bcc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:51:40.818495 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-57dfab75-a121-4acd-9efa-679676367bcc tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "DELETE /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 204 len: 0 microversion: 2.1 time: 0.254706 Sep 08 12:51:40.820497 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1285/2444] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:51:40 2022] DELETE /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:51:40.837914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b2300469-b052-4e69-a93f-b1d7913c68f2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:40.839810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b2300469-b052-4e69-a93f-b1d7913c68f2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:40.852473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2300469-b052-4e69-a93f-b1d7913c68f2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:40.853229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2300469-b052-4e69-a93f-b1d7913c68f2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:40.854042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2300469-b052-4e69-a93f-b1d7913c68f2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:40.855651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2300469-b052-4e69-a93f-b1d7913c68f2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:40.856702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2300469-b052-4e69-a93f-b1d7913c68f2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:40.857522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2300469-b052-4e69-a93f-b1d7913c68f2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:40.891083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:41.066726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b2300469-b052-4e69-a93f-b1d7913c68f2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:41.087854 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b2300469-b052-4e69-a93f-b1d7913c68f2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1270 microversion: 2.1 time: 0.262928 Sep 08 12:51:41.089468 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1286/2445] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:40 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1270 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:41.102858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a47509d3-c0f1-4896-928b-4b1ec84dec29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:41.104235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a47509d3-c0f1-4896-928b-4b1ec84dec29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:41.116679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a47509d3-c0f1-4896-928b-4b1ec84dec29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:41.117747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a47509d3-c0f1-4896-928b-4b1ec84dec29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:41.118682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a47509d3-c0f1-4896-928b-4b1ec84dec29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:41.120194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a47509d3-c0f1-4896-928b-4b1ec84dec29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:41.121608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a47509d3-c0f1-4896-928b-4b1ec84dec29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:41.128202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a47509d3-c0f1-4896-928b-4b1ec84dec29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:41.933875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:51:41.934462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:51:41.935195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:51:41.935661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:51:41.936103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:51:41.946699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:41.947196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:41.947682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:41.948485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:41.948958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:41.949394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:41.979882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Getting quotas for project 59dc0decb175444491383c39918c5b2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:51:41.990776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Getting quotas for user 4140a06bc6934d7780ef9ff3e30e6dd5 and project 59dc0decb175444491383c39918c5b2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:51:42.012354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:51:42.015802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:51:42.096734 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3417f10a-a46d-4a69-b0f6-e89ab20ac45c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 3.611063 Sep 08 12:51:42.097481 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1160/2446] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:51:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 3614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:51:42.110395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a47509d3-c0f1-4896-928b-4b1ec84dec29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:42.111269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2e68b909-5781-46b4-998d-ed7639bd6999 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb3f1e6e50>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:42.124583 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a47509d3-c0f1-4896-928b-4b1ec84dec29 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1318 microversion: 2.1 time: 1.033251 Sep 08 12:51:42.125403 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1287/2447] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:41 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1318 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:42.130695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c92def5d-1143-49b9-a992-67cf16c8661a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:42.138228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c92def5d-1143-49b9-a992-67cf16c8661a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:42.173644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c92def5d-1143-49b9-a992-67cf16c8661a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:42.175150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c92def5d-1143-49b9-a992-67cf16c8661a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:42.177427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c92def5d-1143-49b9-a992-67cf16c8661a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:42.178791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c92def5d-1143-49b9-a992-67cf16c8661a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:42.179713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c92def5d-1143-49b9-a992-67cf16c8661a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:42.180491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c92def5d-1143-49b9-a992-67cf16c8661a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:42.229626 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2e68b909-5781-46b4-998d-ed7639bd6999 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a" status: 202 len: 0 microversion: 2.1 time: 0.124041 Sep 08 12:51:42.235533 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1161/2448] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 12:51:42 2022] DELETE /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:51:42.242301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-80b488cb-2f7d-471c-9fd4-4f972198030d tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:42.255428 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-80b488cb-2f7d-471c-9fd4-4f972198030d tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018189 Sep 08 12:51:42.257565 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1162/2449] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:51:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:42.264421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-836128f5-9c67-43d9-9fde-b26d6bc9e367 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:42.265410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-836128f5-9c67-43d9-9fde-b26d6bc9e367 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:42.275009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-836128f5-9c67-43d9-9fde-b26d6bc9e367 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:42.276344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-836128f5-9c67-43d9-9fde-b26d6bc9e367 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:42.277159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-836128f5-9c67-43d9-9fde-b26d6bc9e367 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:42.278842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-836128f5-9c67-43d9-9fde-b26d6bc9e367 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:42.279615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-836128f5-9c67-43d9-9fde-b26d6bc9e367 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:42.280404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-836128f5-9c67-43d9-9fde-b26d6bc9e367 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:43.661652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c92def5d-1143-49b9-a992-67cf16c8661a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:43.685607 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c92def5d-1143-49b9-a992-67cf16c8661a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910" status: 200 len: 1314 microversion: 2.1 time: 1.558252 Sep 08 12:51:43.688104 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1288/2450] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:42 2022] GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910 => generated 1314 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:43.706169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-425a4687-92c2-4e3e-b267-3f85b0a355b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:43.707736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-425a4687-92c2-4e3e-b267-3f85b0a355b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:43.725156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425a4687-92c2-4e3e-b267-3f85b0a355b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:43.727407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425a4687-92c2-4e3e-b267-3f85b0a355b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:43.728285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425a4687-92c2-4e3e-b267-3f85b0a355b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:43.729923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425a4687-92c2-4e3e-b267-3f85b0a355b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:43.731408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425a4687-92c2-4e3e-b267-3f85b0a355b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:43.732247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425a4687-92c2-4e3e-b267-3f85b0a355b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:43.775726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-836128f5-9c67-43d9-9fde-b26d6bc9e367 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6859ddadc55d43d4b245ba732b478226', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9dedae99bc2492c850c6bb721928d6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:43.790966 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-836128f5-9c67-43d9-9fde-b26d6bc9e367 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 200 len: 1477 microversion: 2.1 time: 1.530228 Sep 08 12:51:43.792391 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1163/2451] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:42 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 1477 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:43.800297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-bf1da3a3-bc25-49c5-8d48-0d65cace6e0d req-de989add-2f00-4b22-a428-9582a26b61d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da5f8e14-96f2-45be-a26e-e5dc05ef7910", "tag": "3842a644-a231-4d26-bad9-66d212e8056f"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:43.843179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bf1da3a3-bc25-49c5-8d48-0d65cace6e0d req-de989add-2f00-4b22-a428-9582a26b61d0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:43.844122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bf1da3a3-bc25-49c5-8d48-0d65cace6e0d req-de989add-2f00-4b22-a428-9582a26b61d0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:43.844815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bf1da3a3-bc25-49c5-8d48-0d65cace6e0d req-de989add-2f00-4b22-a428-9582a26b61d0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:43.880809 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-bf1da3a3-bc25-49c5-8d48-0d65cace6e0d req-de989add-2f00-4b22-a428-9582a26b61d0 service nova] Creating event network-changed:3842a644-a231-4d26-bad9-66d212e8056f for instance da5f8e14-96f2-45be-a26e-e5dc05ef7910 on n-h1-852084-10 Sep 08 12:51:43.895901 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-bf1da3a3-bc25-49c5-8d48-0d65cace6e0d req-de989add-2f00-4b22-a428-9582a26b61d0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099879 Sep 08 12:51:43.921055 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1164/2452] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:43.937418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a22c3037-c847-4e8c-af71-2ce676fa4641 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:43.939462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a22c3037-c847-4e8c-af71-2ce676fa4641 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:43.961593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a22c3037-c847-4e8c-af71-2ce676fa4641 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:43.962508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a22c3037-c847-4e8c-af71-2ce676fa4641 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:43.963383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a22c3037-c847-4e8c-af71-2ce676fa4641 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:43.964536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a22c3037-c847-4e8c-af71-2ce676fa4641 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:43.966012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a22c3037-c847-4e8c-af71-2ce676fa4641 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:43.966856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a22c3037-c847-4e8c-af71-2ce676fa4641 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:44.164322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a22c3037-c847-4e8c-af71-2ce676fa4641 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:44.178316 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a22c3037-c847-4e8c-af71-2ce676fa4641 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1243 microversion: 2.1 time: 0.255198 Sep 08 12:51:44.179769 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1165/2453] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:43 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1243 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:44.189614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-02159179-83ac-4b5a-b76b-cf53a2152d7e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:44.190752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-02159179-83ac-4b5a-b76b-cf53a2152d7e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:44.202746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02159179-83ac-4b5a-b76b-cf53a2152d7e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:44.204171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02159179-83ac-4b5a-b76b-cf53a2152d7e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:44.204912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02159179-83ac-4b5a-b76b-cf53a2152d7e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:44.206521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02159179-83ac-4b5a-b76b-cf53a2152d7e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:44.207593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02159179-83ac-4b5a-b76b-cf53a2152d7e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:44.208386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02159179-83ac-4b5a-b76b-cf53a2152d7e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:44.439828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-02159179-83ac-4b5a-b76b-cf53a2152d7e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:44.446114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-425a4687-92c2-4e3e-b267-3f85b0a355b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:44.477441 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-425a4687-92c2-4e3e-b267-3f85b0a355b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 200 len: 1316 microversion: 2.1 time: 0.786237 Sep 08 12:51:44.478865 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1289/2454] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:43 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 1316 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:44.498837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f7da14fa-d072-47d6-bfe6-e61b8e2749cd tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb3725f820>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:44.518472 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-02159179-83ac-4b5a-b76b-cf53a2152d7e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1270 microversion: 2.1 time: 0.337038 Sep 08 12:51:44.525572 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1166/2455] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:44 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1270 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:44.555994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dcf6d1aa-56d5-4f83-9f2e-49baacee7a21 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3afd8160>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:44.733463 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f7da14fa-d072-47d6-bfe6-e61b8e2749cd tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a" status: 200 len: 345 microversion: 2.1 time: 0.250302 Sep 08 12:51:44.734509 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1290/2456] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:51:44 2022] GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a => generated 345 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:44.749934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2b2ce46a-4eba-4692-9942-6d1f2cfc2311 req-0e821a4b-f5ad-4243-98e4-0f12569b7800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883b526c-7f9c-4fe9-b5ad-26aa46f05f78", "name": "network-vif-unplugged", "status": "completed", "tag": "4573b7c0-61ea-430d-b283-e6fc56ec3979"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:44.806971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2b2ce46a-4eba-4692-9942-6d1f2cfc2311 req-0e821a4b-f5ad-4243-98e4-0f12569b7800 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:44.807932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2b2ce46a-4eba-4692-9942-6d1f2cfc2311 req-0e821a4b-f5ad-4243-98e4-0f12569b7800 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:44.808777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2b2ce46a-4eba-4692-9942-6d1f2cfc2311 req-0e821a4b-f5ad-4243-98e4-0f12569b7800 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:44.881953 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2b2ce46a-4eba-4692-9942-6d1f2cfc2311 req-0e821a4b-f5ad-4243-98e4-0f12569b7800 service nova] Creating event network-vif-unplugged:4573b7c0-61ea-430d-b283-e6fc56ec3979 for instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 on n-h2-852084-10 Sep 08 12:51:44.904756 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2b2ce46a-4eba-4692-9942-6d1f2cfc2311 req-0e821a4b-f5ad-4243-98e4-0f12569b7800 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.167510 Sep 08 12:51:44.905599 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1291/2457] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:44.928588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc91d910-ecc2-430f-9fda-1a49af5d6fef tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:44.944909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cc91d910-ecc2-430f-9fda-1a49af5d6fef tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:44.990661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc91d910-ecc2-430f-9fda-1a49af5d6fef tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:44.997280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc91d910-ecc2-430f-9fda-1a49af5d6fef tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:44.999909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc91d910-ecc2-430f-9fda-1a49af5d6fef tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:45.006246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc91d910-ecc2-430f-9fda-1a49af5d6fef tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:45.011446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc91d910-ecc2-430f-9fda-1a49af5d6fef tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:45.012966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc91d910-ecc2-430f-9fda-1a49af5d6fef tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:46.009226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cc91d910-ecc2-430f-9fda-1a49af5d6fef tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:46.039757 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc91d910-ecc2-430f-9fda-1a49af5d6fef tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1509 microversion: 2.1 time: 1.131891 Sep 08 12:51:46.064163 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1292/2458] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:44 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1509 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:46.087266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ea913ef7-14c6-4627-b0ed-d3015240fe94 req-48fd81e5-ba00-431a-8836-fb1c00c84d5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a460ded-9066-4972-a981-9295e353bb3c", "tag": "11c30836-eaf8-4c74-a70a-915fdf23e280"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:46.106231 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dcf6d1aa-56d5-4f83-9f2e-49baacee7a21 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "DELETE /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 204 len: 0 microversion: 2.1 time: 1.572009 Sep 08 12:51:46.107437 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1167/2459] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:44 2022] DELETE /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 0 bytes in 1580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:51:46.113530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e46e711-c87f-49f9-be0b-5d6488ed455b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:46.116134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8e46e711-c87f-49f9-be0b-5d6488ed455b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:46.124988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e46e711-c87f-49f9-be0b-5d6488ed455b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:46.125490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e46e711-c87f-49f9-be0b-5d6488ed455b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:46.126106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e46e711-c87f-49f9-be0b-5d6488ed455b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:46.127125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e46e711-c87f-49f9-be0b-5d6488ed455b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:46.127786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e46e711-c87f-49f9-be0b-5d6488ed455b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:46.128542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e46e711-c87f-49f9-be0b-5d6488ed455b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:46.135367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:46.155728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ea913ef7-14c6-4627-b0ed-d3015240fe94 req-48fd81e5-ba00-431a-8836-fb1c00c84d5a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:46.157920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ea913ef7-14c6-4627-b0ed-d3015240fe94 req-48fd81e5-ba00-431a-8836-fb1c00c84d5a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:46.162350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ea913ef7-14c6-4627-b0ed-d3015240fe94 req-48fd81e5-ba00-431a-8836-fb1c00c84d5a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:46.203829 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ea913ef7-14c6-4627-b0ed-d3015240fe94 req-48fd81e5-ba00-431a-8836-fb1c00c84d5a service nova] Creating event network-changed:11c30836-eaf8-4c74-a70a-915fdf23e280 for instance 0a460ded-9066-4972-a981-9295e353bb3c on n-h2-852084-10 Sep 08 12:51:46.232268 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ea913ef7-14c6-4627-b0ed-d3015240fe94 req-48fd81e5-ba00-431a-8836-fb1c00c84d5a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164891 Sep 08 12:51:46.233420 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1293/2460] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:46.241651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7bb1d3dd-7596-4f4e-805d-f57177fcf897 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:46.242900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7bb1d3dd-7596-4f4e-805d-f57177fcf897 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] [instance: 96af37e5-73b1-44a9-bdd6-7bdc5508b677] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:46.256493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bb1d3dd-7596-4f4e-805d-f57177fcf897 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:46.257396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bb1d3dd-7596-4f4e-805d-f57177fcf897 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:46.258612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bb1d3dd-7596-4f4e-805d-f57177fcf897 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:46.259602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bb1d3dd-7596-4f4e-805d-f57177fcf897 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:46.260322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bb1d3dd-7596-4f4e-805d-f57177fcf897 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:46.261087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bb1d3dd-7596-4f4e-805d-f57177fcf897 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:46.289265 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-7bb1d3dd-7596-4f4e-805d-f57177fcf897 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] HTTP exception thrown: Instance 96af37e5-73b1-44a9-bdd6-7bdc5508b677 could not be found. Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7bb1d3dd-7596-4f4e-805d-f57177fcf897 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Request method failure captured: Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 HTTP/1.1 Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeUCmb7yvDT_P9wYsQoxuQvGB4KMBkOYSjECae_wOEveTmDc_uBBvkdY817gpRbWwp9i_fRMg9epLgnMsLC63P9KUJQLRH07dthhOT6ZuCvkQvo5TxhXzAoEjS-OeaDy3Fba5QXUuAufaxIbrSXpQPF2lRovffRksokwcRwPqiS_w4o Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d9dedae99bc2492c850c6bb721928d6e Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-812091835 Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d9dedae99bc2492c850c6bb721928d6e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d9dedae99bc2492c850c6bb721928d6e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d9dedae99bc2492c850c6bb721928d6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d9dedae99bc2492c850c6bb721928d6e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersAdminNegativeTestJSON-812091835 Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d9dedae99bc2492c850c6bb721928d6e Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-812091835 Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersAdminNegativeTestJSON-812091835-project Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6859ddadc55d43d4b245ba732b478226 Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersAdminNegativeTestJSON-812091835-project Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 96af37e5-73b1-44a9-bdd6-7bdc5508b677 could not be found. Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '96af37e5-73b1-44a9-bdd6-7bdc5508b677'} Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96af37e5-73b1-44a9-bdd6-7bdc5508b677 could not be found. Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96af37e5-73b1-44a9-bdd6-7bdc5508b677 could not be found. Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:46.292659 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:46.302929 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:46.302929 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:46.302929 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:46.302929 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:46.302929 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:51:46.302929 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:51:46.302929 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96af37e5-73b1-44a9-bdd6-7bdc5508b677 could not be found. Sep 08 12:51:46.302929 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:46.302929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7bb1d3dd-7596-4f4e-805d-f57177fcf897 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] Returning 404 to user: Instance 96af37e5-73b1-44a9-bdd6-7bdc5508b677 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:46.302929 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7bb1d3dd-7596-4f4e-805d-f57177fcf897 tempest-ServersAdminNegativeTestJSON-812091835 tempest-ServersAdminNegativeTestJSON-812091835-project] 10.222.0.78 "GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677" status: 404 len: 111 microversion: 2.1 time: 0.060707 Sep 08 12:51:46.302929 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1294/2461] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:46 2022] GET /compute/v2.1/servers/96af37e5-73b1-44a9-bdd6-7bdc5508b677 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:51:46.307630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-71c41bf0-bedc-4d17-95f5-b21cc25831b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:46.307630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-71c41bf0-bedc-4d17-95f5-b21cc25831b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:46.316300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71c41bf0-bedc-4d17-95f5-b21cc25831b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:46.316990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71c41bf0-bedc-4d17-95f5-b21cc25831b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:46.317549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71c41bf0-bedc-4d17-95f5-b21cc25831b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:46.318420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71c41bf0-bedc-4d17-95f5-b21cc25831b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:46.319001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71c41bf0-bedc-4d17-95f5-b21cc25831b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:46.319947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71c41bf0-bedc-4d17-95f5-b21cc25831b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:47.025232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-71c41bf0-bedc-4d17-95f5-b21cc25831b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:47.063048 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-71c41bf0-bedc-4d17-95f5-b21cc25831b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1291 microversion: 2.1 time: 0.763830 Sep 08 12:51:47.065672 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1295/2462] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:46 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1291 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:47.074604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4d3664a7-5d84-4611-9b11-4ccfedfe69b7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:47.077161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4d3664a7-5d84-4611-9b11-4ccfedfe69b7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:47.092247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d3664a7-5d84-4611-9b11-4ccfedfe69b7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:47.093090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d3664a7-5d84-4611-9b11-4ccfedfe69b7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:47.094254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d3664a7-5d84-4611-9b11-4ccfedfe69b7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:47.095639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d3664a7-5d84-4611-9b11-4ccfedfe69b7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:47.096407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d3664a7-5d84-4611-9b11-4ccfedfe69b7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:47.097238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d3664a7-5d84-4611-9b11-4ccfedfe69b7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:47.160980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8e46e711-c87f-49f9-be0b-5d6488ed455b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:47.181225 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8e46e711-c87f-49f9-be0b-5d6488ed455b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910" status: 200 len: 1314 microversion: 2.1 time: 1.071291 Sep 08 12:51:47.191686 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1168/2463] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:46 2022] GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910 => generated 1314 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:47.219623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ae05a5d3-d9fd-4481-a118-785ca1bb66e1 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:47.223604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ae05a5d3-d9fd-4481-a118-785ca1bb66e1 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:47.254035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae05a5d3-d9fd-4481-a118-785ca1bb66e1 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:47.255531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae05a5d3-d9fd-4481-a118-785ca1bb66e1 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:47.256562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae05a5d3-d9fd-4481-a118-785ca1bb66e1 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:47.260263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae05a5d3-d9fd-4481-a118-785ca1bb66e1 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:47.261430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae05a5d3-d9fd-4481-a118-785ca1bb66e1 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:47.262423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae05a5d3-d9fd-4481-a118-785ca1bb66e1 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:48.445357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:48.502616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=15 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:48.543886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ae05a5d3-d9fd-4481-a118-785ca1bb66e1 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:48.578375 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ae05a5d3-d9fd-4481-a118-785ca1bb66e1 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1312 microversion: 2.1 time: 1.382964 Sep 08 12:51:48.586261 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1169/2464] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:47 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1312 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:48.608124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f7ed97ad-6657-40c4-90a7-04c15db06336 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb3ae889d0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:48.639139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4d3664a7-5d84-4611-9b11-4ccfedfe69b7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:48.650345 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4d3664a7-5d84-4611-9b11-4ccfedfe69b7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 200 len: 1316 microversion: 2.1 time: 1.581526 Sep 08 12:51:48.651053 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1296/2465] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:47 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 1316 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:48.680711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-518b8f22-b772-4a68-90e1-ecd768063e3d req-565c386e-78ee-4ad2-a532-f68ff19f70ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96af37e5-73b1-44a9-bdd6-7bdc5508b677", "name": "network-vif-deleted", "tag": "fd4ccce2-9d29-4795-817f-fa28b9ea9b80"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:48.718911 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-f7ed97ad-6657-40c4-90a7-04c15db06336 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] HTTP exception thrown: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:48.722292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-518b8f22-b772-4a68-90e1-ecd768063e3d req-565c386e-78ee-4ad2-a532-f68ff19f70ba service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:48.723194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-518b8f22-b772-4a68-90e1-ecd768063e3d req-565c386e-78ee-4ad2-a532-f68ff19f70ba service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:48.724041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-518b8f22-b772-4a68-90e1-ecd768063e3d req-565c386e-78ee-4ad2-a532-f68ff19f70ba service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f7ed97ad-6657-40c4-90a7-04c15db06336 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Request method failure captured: Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a HTTP/1.1 Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVEiZcPwqm1Y9X5tul3uWXLxLB2sdRJKhTlq9fqzfgGrFyV4VdfVA9NFKl0VG8aaC6EQviOHVCFa0v1zIw61fG28rycLEh92Sa-ZMid_o5I_s9g2N7A_od0KPsr5N59qISpKvovuvFtRE5Q9UJwxvbE2XFV6zJn8TAhkpIeTptbXK0 Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: a59dc1dc94fd48adad446ecb5a672d2c Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1408108162 Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1408108162 Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: a59dc1dc94fd48adad446ecb5a672d2c Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1408108162 Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-VolumesSnapshotsTestJSON-1408108162-project Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 876866409c884dc6b5d1d7fc671ed0ae Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1408108162-project Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: exception: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '193f1fa1-b6f8-4526-81bb-350f88e2787a'} Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. (HTTP 404) (Request-ID: req-afa36c5e-9bb6-4792-b000-4126244ca472) Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 12:51:48.753996 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:48.773952 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.780402 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-518b8f22-b772-4a68-90e1-ecd768063e3d req-565c386e-78ee-4ad2-a532-f68ff19f70ba service nova] Creating event network-vif-deleted:fd4ccce2-9d29-4795-817f-fa28b9ea9b80 for instance 96af37e5-73b1-44a9-bdd6-7bdc5508b677 on n-h1-852084-10 Sep 08 12:51:48.780744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f7ed97ad-6657-40c4-90a7-04c15db06336 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Returning 404 to user: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:48.781116 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-518b8f22-b772-4a68-90e1-ecd768063e3d req-565c386e-78ee-4ad2-a532-f68ff19f70ba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105664 Sep 08 12:51:48.781116 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1297/2466] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:48.781493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52ab957f-f88b-452e-9aea-0fc40031e014 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:48.782221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-52ab957f-f88b-452e-9aea-0fc40031e014 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:48.788162 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f7ed97ad-6657-40c4-90a7-04c15db06336 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a" status: 404 len: 109 microversion: 2.1 time: 0.199534 Sep 08 12:51:48.790090 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1170/2467] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:51:48 2022] GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a => generated 109 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:51:48.814093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52ab957f-f88b-452e-9aea-0fc40031e014 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:48.814992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52ab957f-f88b-452e-9aea-0fc40031e014 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:48.815183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52ab957f-f88b-452e-9aea-0fc40031e014 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:48.816043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52ab957f-f88b-452e-9aea-0fc40031e014 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:48.816545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52ab957f-f88b-452e-9aea-0fc40031e014 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:48.817158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52ab957f-f88b-452e-9aea-0fc40031e014 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:48.820421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e6bca508-7752-44ba-9310-7930c5174f9c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f1e68b0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:48.909189 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e6bca508-7752-44ba-9310-7930c5174f9c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] HTTP exception thrown: Image not found. Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e6bca508-7752-44ba-9310-7930c5174f9c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Request method failure captured: Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee HTTP/1.1 Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeUB5m6fZD6IRgIkF_gIn7f7tZ2S6TfC-tDEgh56INerE1zcKTK7MAVb96OEv5Da-BXXElIT32NheA4aRgqG9b_HLKiorZY4FpnMG6xndXu_TE7gX0-l0O66NQDP3uz2PJLB2DShrrkxBllx6_8xMEx30U75viuswOEk9yLnE56rQEM Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: a856789ce4f64b95823378a2600f6878 Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesOneServerTestJSON-447223846 Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a856789ce4f64b95823378a2600f6878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a856789ce4f64b95823378a2600f6878"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a856789ce4f64b95823378a2600f6878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a856789ce4f64b95823378a2600f6878"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesOneServerTestJSON-447223846 Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: a856789ce4f64b95823378a2600f6878 Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-447223846 Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesOneServerTestJSON-447223846-project Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 22b4be40ad8640e59bef7ed17f9bfda0 Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesOneServerTestJSON-447223846-project Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: exception: Image not found. Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '8fbd9829-dc3c-4619-8d34-b662d4f9beee'} Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8fbd9829-dc3c-4619-8d34-b662d4f9beee Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 12:51:48.914483 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8fbd9829-dc3c-4619-8d34-b662d4f9beee could not be found. Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:48.919210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e6bca508-7752-44ba-9310-7930c5174f9c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Returning 404 to user: Image not found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:48.927268 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e6bca508-7752-44ba-9310-7930c5174f9c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 404 len: 62 microversion: 2.1 time: 0.121141 Sep 08 12:51:48.927268 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1171/2468] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:48 2022] GET /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 62 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:51:48.947005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-332d9f14-070f-405d-8358-cd8e4f2f0b99 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:48.948478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-332d9f14-070f-405d-8358-cd8e4f2f0b99 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:49.007000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-332d9f14-070f-405d-8358-cd8e4f2f0b99 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:49.013810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-332d9f14-070f-405d-8358-cd8e4f2f0b99 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:49.014610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-332d9f14-070f-405d-8358-cd8e4f2f0b99 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:49.021666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-332d9f14-070f-405d-8358-cd8e4f2f0b99 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:49.022804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-332d9f14-070f-405d-8358-cd8e4f2f0b99 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:49.023662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-332d9f14-070f-405d-8358-cd8e4f2f0b99 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:49.537255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-52ab957f-f88b-452e-9aea-0fc40031e014 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:49.579381 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-52ab957f-f88b-452e-9aea-0fc40031e014 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1509 microversion: 2.1 time: 0.802369 Sep 08 12:51:49.581336 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1298/2469] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:48 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1509 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:49.592915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eed58df0-b4b7-4ddc-acb3-431909d4557f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:49.594407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eed58df0-b4b7-4ddc-acb3-431909d4557f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:49.610088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eed58df0-b4b7-4ddc-acb3-431909d4557f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:49.611448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eed58df0-b4b7-4ddc-acb3-431909d4557f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:49.612546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eed58df0-b4b7-4ddc-acb3-431909d4557f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:49.614109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eed58df0-b4b7-4ddc-acb3-431909d4557f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:49.615265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eed58df0-b4b7-4ddc-acb3-431909d4557f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:49.616330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eed58df0-b4b7-4ddc-acb3-431909d4557f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:49.811140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-332d9f14-070f-405d-8358-cd8e4f2f0b99 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:49.841879 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-332d9f14-070f-405d-8358-cd8e4f2f0b99 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1365 microversion: 2.1 time: 0.916762 Sep 08 12:51:49.863987 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1172/2470] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:48 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1365 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:49.889378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-6d0a2976-48ee-4833-b28a-ff18c14c664b req-f00704ba-5019-42f1-9019-05e782b9bdce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3250685a-8562-4deb-a070-5ef61a7adece", "tag": "abdffb77-d374-428a-a4ad-7dbf4411576c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:49.922518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6d0a2976-48ee-4833-b28a-ff18c14c664b req-f00704ba-5019-42f1-9019-05e782b9bdce service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:49.923863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6d0a2976-48ee-4833-b28a-ff18c14c664b req-f00704ba-5019-42f1-9019-05e782b9bdce service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:49.927673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6d0a2976-48ee-4833-b28a-ff18c14c664b req-f00704ba-5019-42f1-9019-05e782b9bdce service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:49.980316 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-6d0a2976-48ee-4833-b28a-ff18c14c664b req-f00704ba-5019-42f1-9019-05e782b9bdce service nova] Creating event network-changed:abdffb77-d374-428a-a4ad-7dbf4411576c for instance 3250685a-8562-4deb-a070-5ef61a7adece on n-h2-852084-10 Sep 08 12:51:49.988065 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-6d0a2976-48ee-4833-b28a-ff18c14c664b req-f00704ba-5019-42f1-9019-05e782b9bdce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120884 Sep 08 12:51:49.989268 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1173/2471] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:49.997245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6d991c6f-b480-4db5-acc1-600fc021fe03 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb3f148b80>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:50.090772 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-6d991c6f-b480-4db5-acc1-600fc021fe03 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] HTTP exception thrown: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6d991c6f-b480-4db5-acc1-600fc021fe03 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Request method failure captured: Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a HTTP/1.1 Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVEiZcPwqm1Y9X5tul3uWXLxLB2sdRJKhTlq9fqzfgGrFyV4VdfVA9NFKl0VG8aaC6EQviOHVCFa0v1zIw61fG28rycLEh92Sa-ZMid_o5I_s9g2N7A_od0KPsr5N59qISpKvovuvFtRE5Q9UJwxvbE2XFV6zJn8TAhkpIeTptbXK0 Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: a59dc1dc94fd48adad446ecb5a672d2c Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1408108162 Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1408108162 Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: a59dc1dc94fd48adad446ecb5a672d2c Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1408108162 Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-VolumesSnapshotsTestJSON-1408108162-project Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 876866409c884dc6b5d1d7fc671ed0ae Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1408108162-project Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: exception: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '193f1fa1-b6f8-4526-81bb-350f88e2787a'} Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. (HTTP 404) (Request-ID: req-f81ed2ce-29d0-44e9-91eb-9d5b9111754f) Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 12:51:50.095558 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:50.108180 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:51:50.117348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6d991c6f-b480-4db5-acc1-600fc021fe03 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Returning 404 to user: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:50.117348 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6d991c6f-b480-4db5-acc1-600fc021fe03 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a" status: 404 len: 109 microversion: 2.1 time: 0.125984 Sep 08 12:51:50.123707 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1174/2472] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 12:51:49 2022] DELETE /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a => generated 109 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:51:50.130237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-55687d56-ce1c-4089-ac57-96c8e0738ba4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-696716237"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:50.135948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-55687d56-ce1c-4089-ac57-96c8e0738ba4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:50.160544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55687d56-ce1c-4089-ac57-96c8e0738ba4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:50.162161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55687d56-ce1c-4089-ac57-96c8e0738ba4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:50.164504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55687d56-ce1c-4089-ac57-96c8e0738ba4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:50.166788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55687d56-ce1c-4089-ac57-96c8e0738ba4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:50.167700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55687d56-ce1c-4089-ac57-96c8e0738ba4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:50.168362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55687d56-ce1c-4089-ac57-96c8e0738ba4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:50.549783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eed58df0-b4b7-4ddc-acb3-431909d4557f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:50.572162 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eed58df0-b4b7-4ddc-acb3-431909d4557f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910" status: 200 len: 1314 microversion: 2.1 time: 0.987646 Sep 08 12:51:50.573322 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1299/2473] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:49 2022] GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910 => generated 1314 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:50.580798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-34e0a35b-714a-4cbd-b6c7-1c984355e4b5 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:50.581394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-34e0a35b-714a-4cbd-b6c7-1c984355e4b5 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:50.597016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34e0a35b-714a-4cbd-b6c7-1c984355e4b5 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:50.597684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34e0a35b-714a-4cbd-b6c7-1c984355e4b5 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:50.598214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34e0a35b-714a-4cbd-b6c7-1c984355e4b5 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:50.599351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34e0a35b-714a-4cbd-b6c7-1c984355e4b5 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:50.600178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34e0a35b-714a-4cbd-b6c7-1c984355e4b5 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:50.600921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34e0a35b-714a-4cbd-b6c7-1c984355e4b5 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:50.665673 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-55687d56-ce1c-4089-ac57-96c8e0738ba4 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "POST /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78/action" status: 202 len: 0 microversion: 2.1 time: 0.546422 Sep 08 12:51:50.666955 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1175/2474] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:51:50 2022] POST /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78/action => generated 0 bytes in 548 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 12:51:50.674798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a7f0125b-dcdc-4a10-864d-5b80835c3a22 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:50.683421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a7f0125b-dcdc-4a10-864d-5b80835c3a22 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:50.712612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7f0125b-dcdc-4a10-864d-5b80835c3a22 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:50.713449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7f0125b-dcdc-4a10-864d-5b80835c3a22 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:50.715703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7f0125b-dcdc-4a10-864d-5b80835c3a22 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:50.716823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7f0125b-dcdc-4a10-864d-5b80835c3a22 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:50.717547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7f0125b-dcdc-4a10-864d-5b80835c3a22 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:50.718483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7f0125b-dcdc-4a10-864d-5b80835c3a22 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:50.884278 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a7f0125b-dcdc-4a10-864d-5b80835c3a22 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "PUT /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1081 microversion: 2.1 time: 0.215159 Sep 08 12:51:50.888284 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1176/2475] 10.222.0.78 () {60 vars in 1256 bytes} [Thu Sep 8 12:51:50 2022] PUT /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1081 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:50.907037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3572be95-cb98-4b45-a568-79dcfb32f82a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:50.908486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3572be95-cb98-4b45-a568-79dcfb32f82a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:50.920288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3572be95-cb98-4b45-a568-79dcfb32f82a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:50.921544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3572be95-cb98-4b45-a568-79dcfb32f82a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:50.922579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3572be95-cb98-4b45-a568-79dcfb32f82a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:50.925125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3572be95-cb98-4b45-a568-79dcfb32f82a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:50.926841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3572be95-cb98-4b45-a568-79dcfb32f82a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:50.927975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3572be95-cb98-4b45-a568-79dcfb32f82a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:51.069185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-34e0a35b-714a-4cbd-b6c7-1c984355e4b5 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:51.082481 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-34e0a35b-714a-4cbd-b6c7-1c984355e4b5 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1333 microversion: 2.1 time: 0.505866 Sep 08 12:51:51.095465 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1300/2476] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:50 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1333 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:51.108551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-74588489-a1f2-44c2-8e1a-cd89d9cd7ab4 req-1273877a-8abb-4899-b004-e03ce04ef342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da5f8e14-96f2-45be-a26e-e5dc05ef7910", "name": "network-vif-plugged", "status": "completed", "tag": "3842a644-a231-4d26-bad9-66d212e8056f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:51.122024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-74588489-a1f2-44c2-8e1a-cd89d9cd7ab4 req-1273877a-8abb-4899-b004-e03ce04ef342 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:51.123275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-74588489-a1f2-44c2-8e1a-cd89d9cd7ab4 req-1273877a-8abb-4899-b004-e03ce04ef342 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:51.124122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-74588489-a1f2-44c2-8e1a-cd89d9cd7ab4 req-1273877a-8abb-4899-b004-e03ce04ef342 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:51.140162 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-74588489-a1f2-44c2-8e1a-cd89d9cd7ab4 req-1273877a-8abb-4899-b004-e03ce04ef342 service nova] Creating event network-vif-plugged:3842a644-a231-4d26-bad9-66d212e8056f for instance da5f8e14-96f2-45be-a26e-e5dc05ef7910 on n-h1-852084-10 Sep 08 12:51:51.147179 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-74588489-a1f2-44c2-8e1a-cd89d9cd7ab4 req-1273877a-8abb-4899-b004-e03ce04ef342 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049870 Sep 08 12:51:51.148928 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1301/2477] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:51.156082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-efee9f5a-54c8-4f51-b4be-6641cdef2299 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Calling method '.version_select at 0x7fdb35e20550>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:51.193394 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-efee9f5a-54c8-4f51-b4be-6641cdef2299 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] HTTP exception thrown: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-efee9f5a-54c8-4f51-b4be-6641cdef2299 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Request method failure captured: Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a HTTP/1.1 Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVEiZcPwqm1Y9X5tul3uWXLxLB2sdRJKhTlq9fqzfgGrFyV4VdfVA9NFKl0VG8aaC6EQviOHVCFa0v1zIw61fG28rycLEh92Sa-ZMid_o5I_s9g2N7A_od0KPsr5N59qISpKvovuvFtRE5Q9UJwxvbE2XFV6zJn8TAhkpIeTptbXK0 Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a59dc1dc94fd48adad446ecb5a672d2c Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1408108162 Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a59dc1dc94fd48adad446ecb5a672d2c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1408108162 Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a59dc1dc94fd48adad446ecb5a672d2c Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1408108162 Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesSnapshotsTestJSON-1408108162-project Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 876866409c884dc6b5d1d7fc671ed0ae Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1408108162-project Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: exception: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '193f1fa1-b6f8-4526-81bb-350f88e2787a'} Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. (HTTP 404) (Request-ID: req-61daac47-a593-4c12-a043-b7497cb125b3) Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 12:51:51.197197 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. Sep 08 12:51:51.203284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:51:51.210622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-efee9f5a-54c8-4f51-b4be-6641cdef2299 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] Returning 404 to user: Volume 193f1fa1-b6f8-4526-81bb-350f88e2787a could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:51:51.211858 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-efee9f5a-54c8-4f51-b4be-6641cdef2299 tempest-VolumesSnapshotsTestJSON-1408108162 tempest-VolumesSnapshotsTestJSON-1408108162-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a" status: 404 len: 109 microversion: 2.1 time: 0.061470 Sep 08 12:51:51.212856 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1302/2478] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:51:51 2022] GET /compute/v2.1/os-volumes/193f1fa1-b6f8-4526-81bb-350f88e2787a => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:51:51.219664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae97f964-219c-465c-8e59-a749443b5891 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb35e2d670>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:51.280738 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ae97f964-219c-465c-8e59-a749443b5891 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.066414 Sep 08 12:51:51.290157 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1303/2479] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:51 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:51.296438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9b14cda1-2868-4a05-a24e-d88a07b94a9c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:51.297499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9b14cda1-2868-4a05-a24e-d88a07b94a9c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:51.305493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b14cda1-2868-4a05-a24e-d88a07b94a9c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:51.306374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b14cda1-2868-4a05-a24e-d88a07b94a9c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:51.307013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b14cda1-2868-4a05-a24e-d88a07b94a9c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:51.314602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b14cda1-2868-4a05-a24e-d88a07b94a9c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:51.317214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b14cda1-2868-4a05-a24e-d88a07b94a9c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:51.319146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b14cda1-2868-4a05-a24e-d88a07b94a9c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:51.768356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3572be95-cb98-4b45-a568-79dcfb32f82a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:51.818407 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3572be95-cb98-4b45-a568-79dcfb32f82a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 200 len: 1316 microversion: 2.1 time: 0.924271 Sep 08 12:51:51.825315 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1177/2480] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:50 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 1316 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:51.847129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4edfab88-a4b8-426c-a633-b4e0b2d30067 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:51.848437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4edfab88-a4b8-426c-a633-b4e0b2d30067 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:51.881059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4edfab88-a4b8-426c-a633-b4e0b2d30067 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:51.882124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4edfab88-a4b8-426c-a633-b4e0b2d30067 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:51.882855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4edfab88-a4b8-426c-a633-b4e0b2d30067 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:51.885354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4edfab88-a4b8-426c-a633-b4e0b2d30067 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:51.887675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4edfab88-a4b8-426c-a633-b4e0b2d30067 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:51.890873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4edfab88-a4b8-426c-a633-b4e0b2d30067 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:51.943664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9b14cda1-2868-4a05-a24e-d88a07b94a9c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:51.958866 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9b14cda1-2868-4a05-a24e-d88a07b94a9c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1365 microversion: 2.1 time: 0.667251 Sep 08 12:51:51.968585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:51.975475 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1304/2481] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:51 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1365 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:52.003788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=20 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:52.004171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c184276f-9dfc-40d9-aad8-e6dcd623a31b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:52.005631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c184276f-9dfc-40d9-aad8-e6dcd623a31b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:52.022673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c184276f-9dfc-40d9-aad8-e6dcd623a31b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:52.023641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c184276f-9dfc-40d9-aad8-e6dcd623a31b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:52.024417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c184276f-9dfc-40d9-aad8-e6dcd623a31b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:52.025606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c184276f-9dfc-40d9-aad8-e6dcd623a31b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:52.028669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c184276f-9dfc-40d9-aad8-e6dcd623a31b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:52.029401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c184276f-9dfc-40d9-aad8-e6dcd623a31b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:52.592287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4edfab88-a4b8-426c-a633-b4e0b2d30067 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:52.608893 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4edfab88-a4b8-426c-a633-b4e0b2d30067 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1507 microversion: 2.1 time: 0.779847 Sep 08 12:51:52.609740 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1178/2482] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:51 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1507 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:52.623917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-8b358c8d-c357-4a5c-9e5b-5c3c614e3c07 req-80e9b7b7-51d1-49ac-bebf-d80896318667 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb01efa-03b9-40b6-901b-33e7d583b7c8", "tag": "6d98b289-22e2-4a8e-ba25-0857a1412c6b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:52.668148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8b358c8d-c357-4a5c-9e5b-5c3c614e3c07 req-80e9b7b7-51d1-49ac-bebf-d80896318667 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:52.669160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8b358c8d-c357-4a5c-9e5b-5c3c614e3c07 req-80e9b7b7-51d1-49ac-bebf-d80896318667 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:52.671752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c184276f-9dfc-40d9-aad8-e6dcd623a31b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:52.672526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8b358c8d-c357-4a5c-9e5b-5c3c614e3c07 req-80e9b7b7-51d1-49ac-bebf-d80896318667 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:52.700740 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c184276f-9dfc-40d9-aad8-e6dcd623a31b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910" status: 200 len: 1314 microversion: 2.1 time: 0.717983 Sep 08 12:51:52.705769 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1305/2483] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:51 2022] GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910 => generated 1314 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:52.724254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a2337619-54f7-4664-b18a-e985564d1c4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:52.728827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a2337619-54f7-4664-b18a-e985564d1c4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:52.757455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2337619-54f7-4664-b18a-e985564d1c4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:52.763681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2337619-54f7-4664-b18a-e985564d1c4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:52.765346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2337619-54f7-4664-b18a-e985564d1c4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:52.767247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2337619-54f7-4664-b18a-e985564d1c4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:52.768444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2337619-54f7-4664-b18a-e985564d1c4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:52.769756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2337619-54f7-4664-b18a-e985564d1c4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:52.794328 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-8b358c8d-c357-4a5c-9e5b-5c3c614e3c07 req-80e9b7b7-51d1-49ac-bebf-d80896318667 service nova] Creating event network-changed:6d98b289-22e2-4a8e-ba25-0857a1412c6b for instance abb01efa-03b9-40b6-901b-33e7d583b7c8 on n-h1-852084-10 Sep 08 12:51:52.847156 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-8b358c8d-c357-4a5c-9e5b-5c3c614e3c07 req-80e9b7b7-51d1-49ac-bebf-d80896318667 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233385 Sep 08 12:51:52.852995 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1179/2484] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:52.866491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-300c367a-4892-4d89-9f1d-2850a0a5f19c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f1b2160>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:52.971159 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-300c367a-4892-4d89-9f1d-2850a0a5f19c tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.115820 Sep 08 12:51:52.972245 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1180/2485] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:52 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:52.989789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c3b19df7-329d-4872-9c8b-6d39f8110687 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:52.991369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c3b19df7-329d-4872-9c8b-6d39f8110687 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:53.007929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3b19df7-329d-4872-9c8b-6d39f8110687 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:53.010376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3b19df7-329d-4872-9c8b-6d39f8110687 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:53.011141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3b19df7-329d-4872-9c8b-6d39f8110687 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:53.013498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3b19df7-329d-4872-9c8b-6d39f8110687 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:53.015287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3b19df7-329d-4872-9c8b-6d39f8110687 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:53.016347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3b19df7-329d-4872-9c8b-6d39f8110687 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:53.628047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a2337619-54f7-4664-b18a-e985564d1c4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:53.644739 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a2337619-54f7-4664-b18a-e985564d1c4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 0.937260 Sep 08 12:51:53.659804 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1306/2486] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:52 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:53.667459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2feb5b4f-5dcb-4442-ab4e-a62cead06722 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:53.668744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2feb5b4f-5dcb-4442-ab4e-a62cead06722 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:53.675658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2feb5b4f-5dcb-4442-ab4e-a62cead06722 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:53.676470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2feb5b4f-5dcb-4442-ab4e-a62cead06722 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:53.677111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2feb5b4f-5dcb-4442-ab4e-a62cead06722 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:53.678343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2feb5b4f-5dcb-4442-ab4e-a62cead06722 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:53.678996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2feb5b4f-5dcb-4442-ab4e-a62cead06722 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:53.679835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2feb5b4f-5dcb-4442-ab4e-a62cead06722 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:53.853479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c3b19df7-329d-4872-9c8b-6d39f8110687 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:53.863072 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c3b19df7-329d-4872-9c8b-6d39f8110687 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1507 microversion: 2.1 time: 0.888461 Sep 08 12:51:53.882276 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1181/2487] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:52 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1507 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:53.888040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-447a28ed-7c22-4957-be9a-cc92b8522f52 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:53.889029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-447a28ed-7c22-4957-be9a-cc92b8522f52 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:53.897320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-447a28ed-7c22-4957-be9a-cc92b8522f52 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:53.898106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-447a28ed-7c22-4957-be9a-cc92b8522f52 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:53.898813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-447a28ed-7c22-4957-be9a-cc92b8522f52 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:53.899791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-447a28ed-7c22-4957-be9a-cc92b8522f52 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:53.900574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-447a28ed-7c22-4957-be9a-cc92b8522f52 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:53.901225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-447a28ed-7c22-4957-be9a-cc92b8522f52 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:54.237363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2feb5b4f-5dcb-4442-ab4e-a62cead06722 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:54.248065 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2feb5b4f-5dcb-4442-ab4e-a62cead06722 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 200 len: 1316 microversion: 2.1 time: 0.586883 Sep 08 12:51:54.256250 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1307/2488] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:53 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 1316 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:54.265894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-6961b210-1c41-47f0-be99-7471957d40da req-874ae07f-7564-45c6-89e8-a33298e6563a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a460ded-9066-4972-a981-9295e353bb3c", "name": "network-vif-plugged", "status": "completed", "tag": "11c30836-eaf8-4c74-a70a-915fdf23e280"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:54.290412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6961b210-1c41-47f0-be99-7471957d40da req-874ae07f-7564-45c6-89e8-a33298e6563a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:54.291301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6961b210-1c41-47f0-be99-7471957d40da req-874ae07f-7564-45c6-89e8-a33298e6563a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:54.292003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6961b210-1c41-47f0-be99-7471957d40da req-874ae07f-7564-45c6-89e8-a33298e6563a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:54.338377 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-6961b210-1c41-47f0-be99-7471957d40da req-874ae07f-7564-45c6-89e8-a33298e6563a service nova] Creating event network-vif-plugged:11c30836-eaf8-4c74-a70a-915fdf23e280 for instance 0a460ded-9066-4972-a981-9295e353bb3c on n-h2-852084-10 Sep 08 12:51:54.362752 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-6961b210-1c41-47f0-be99-7471957d40da req-874ae07f-7564-45c6-89e8-a33298e6563a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095797 Sep 08 12:51:54.365998 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1308/2489] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:54.379813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-447a28ed-7c22-4957-be9a-cc92b8522f52 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:54.383484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bbfeb84e-3f08-486a-a93b-8243b14b5ba3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:54.395732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bbfeb84e-3f08-486a-a93b-8243b14b5ba3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:54.422048 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-447a28ed-7c22-4957-be9a-cc92b8522f52 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1365 microversion: 2.1 time: 0.538249 Sep 08 12:51:54.422576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbfeb84e-3f08-486a-a93b-8243b14b5ba3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:54.423324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbfeb84e-3f08-486a-a93b-8243b14b5ba3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:54.424316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbfeb84e-3f08-486a-a93b-8243b14b5ba3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:54.427531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbfeb84e-3f08-486a-a93b-8243b14b5ba3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:54.427724 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1182/2490] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:53 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1365 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:54.428857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbfeb84e-3f08-486a-a93b-8243b14b5ba3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:54.433030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbfeb84e-3f08-486a-a93b-8243b14b5ba3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:54.441010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bb458ac3-9d98-4d1c-b561-81a927bfef7e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:54.445763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bb458ac3-9d98-4d1c-b561-81a927bfef7e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:54.464896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb458ac3-9d98-4d1c-b561-81a927bfef7e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:54.469184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb458ac3-9d98-4d1c-b561-81a927bfef7e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:54.472342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb458ac3-9d98-4d1c-b561-81a927bfef7e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:54.475087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb458ac3-9d98-4d1c-b561-81a927bfef7e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:54.476723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb458ac3-9d98-4d1c-b561-81a927bfef7e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:54.477764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb458ac3-9d98-4d1c-b561-81a927bfef7e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:54.646265 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bb458ac3-9d98-4d1c-b561-81a927bfef7e tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "PUT /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1083 microversion: 2.1 time: 0.217240 Sep 08 12:51:54.671984 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1183/2491] 10.222.0.78 () {60 vars in 1256 bytes} [Thu Sep 8 12:51:54 2022] PUT /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1083 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:54.688896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f8ba30f-b51a-493b-8936-d68f85f7a2d7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3ac01e50>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:54.793432 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f8ba30f-b51a-493b-8936-d68f85f7a2d7 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.119770 Sep 08 12:51:54.794378 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1184/2492] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:54 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:54.800049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9ccb0d61-4278-4e7e-98e7-7d5d41c0a528 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:54.800676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9ccb0d61-4278-4e7e-98e7-7d5d41c0a528 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:54.808979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ccb0d61-4278-4e7e-98e7-7d5d41c0a528 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:54.809872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ccb0d61-4278-4e7e-98e7-7d5d41c0a528 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:54.810483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ccb0d61-4278-4e7e-98e7-7d5d41c0a528 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:54.812231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ccb0d61-4278-4e7e-98e7-7d5d41c0a528 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:54.812876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ccb0d61-4278-4e7e-98e7-7d5d41c0a528 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:54.813724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ccb0d61-4278-4e7e-98e7-7d5d41c0a528 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:55.367784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9ccb0d61-4278-4e7e-98e7-7d5d41c0a528 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:55.394718 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9ccb0d61-4278-4e7e-98e7-7d5d41c0a528 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 0.597708 Sep 08 12:51:55.421477 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1185/2493] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:54 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:55.427730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8f0ffa16-77e8-4327-a4a6-2701c280aa0b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:55.433424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8f0ffa16-77e8-4327-a4a6-2701c280aa0b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:55.447123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f0ffa16-77e8-4327-a4a6-2701c280aa0b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:55.453675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f0ffa16-77e8-4327-a4a6-2701c280aa0b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:55.454451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f0ffa16-77e8-4327-a4a6-2701c280aa0b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:55.455640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f0ffa16-77e8-4327-a4a6-2701c280aa0b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:55.456309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f0ffa16-77e8-4327-a4a6-2701c280aa0b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:55.457001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f0ffa16-77e8-4327-a4a6-2701c280aa0b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:55.464279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bbfeb84e-3f08-486a-a93b-8243b14b5ba3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:55.482371 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bbfeb84e-3f08-486a-a93b-8243b14b5ba3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910" status: 200 len: 1464 microversion: 2.1 time: 1.114049 Sep 08 12:51:55.486097 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1309/2494] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:54 2022] GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910 => generated 1464 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:55.494814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d38c5599-b43d-44a4-a79a-63bc40921daa tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:55.496376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d38c5599-b43d-44a4-a79a-63bc40921daa tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:55.521159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d38c5599-b43d-44a4-a79a-63bc40921daa tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:55.522228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d38c5599-b43d-44a4-a79a-63bc40921daa tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:55.524014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d38c5599-b43d-44a4-a79a-63bc40921daa tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:55.528025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d38c5599-b43d-44a4-a79a-63bc40921daa tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:55.530681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d38c5599-b43d-44a4-a79a-63bc40921daa tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:55.532846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d38c5599-b43d-44a4-a79a-63bc40921daa tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:55.581940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:56.572888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8f0ffa16-77e8-4327-a4a6-2701c280aa0b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:56.610800 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8f0ffa16-77e8-4327-a4a6-2701c280aa0b tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1509 microversion: 2.1 time: 1.183970 Sep 08 12:51:56.612579 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1186/2495] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:55 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1509 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:56.633956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3bce9ec9-b81c-4f09-9d6b-ff9cfc746282 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:56.635101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3bce9ec9-b81c-4f09-9d6b-ff9cfc746282 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:56.671780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bce9ec9-b81c-4f09-9d6b-ff9cfc746282 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:56.676597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bce9ec9-b81c-4f09-9d6b-ff9cfc746282 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:56.680136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bce9ec9-b81c-4f09-9d6b-ff9cfc746282 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:56.687453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bce9ec9-b81c-4f09-9d6b-ff9cfc746282 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:56.688722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bce9ec9-b81c-4f09-9d6b-ff9cfc746282 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:56.693271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bce9ec9-b81c-4f09-9d6b-ff9cfc746282 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:56.785415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d38c5599-b43d-44a4-a79a-63bc40921daa tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:56.820573 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d38c5599-b43d-44a4-a79a-63bc40921daa tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 200 len: 1316 microversion: 2.1 time: 1.332359 Sep 08 12:51:56.821736 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1310/2496] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:55 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 1316 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:56.834008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f44d18e1-31b5-45aa-a6b2-83fd4ed49b74 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:56.843857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f44d18e1-31b5-45aa-a6b2-83fd4ed49b74 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:56.881480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f44d18e1-31b5-45aa-a6b2-83fd4ed49b74 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:56.882331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f44d18e1-31b5-45aa-a6b2-83fd4ed49b74 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:56.883119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f44d18e1-31b5-45aa-a6b2-83fd4ed49b74 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:56.884777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f44d18e1-31b5-45aa-a6b2-83fd4ed49b74 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:56.885826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f44d18e1-31b5-45aa-a6b2-83fd4ed49b74 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:56.886622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f44d18e1-31b5-45aa-a6b2-83fd4ed49b74 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:57.813369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3bce9ec9-b81c-4f09-9d6b-ff9cfc746282 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:57.850315 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3bce9ec9-b81c-4f09-9d6b-ff9cfc746282 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1365 microversion: 2.1 time: 1.234610 Sep 08 12:51:57.870270 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1187/2497] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:56 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1365 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:57.900524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-80c0020f-b481-45dc-85d5-dddca96d79f8 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f1a4940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:58.012792 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-80c0020f-b481-45dc-85d5-dddca96d79f8 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.130415 Sep 08 12:51:58.014044 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1188/2498] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:57 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:58.031207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc852997-08d2-43fe-8908-297af01c6f4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:58.033002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cc852997-08d2-43fe-8908-297af01c6f4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:58.049980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc852997-08d2-43fe-8908-297af01c6f4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:58.051425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc852997-08d2-43fe-8908-297af01c6f4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:58.052635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc852997-08d2-43fe-8908-297af01c6f4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:58.054930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc852997-08d2-43fe-8908-297af01c6f4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:58.057121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc852997-08d2-43fe-8908-297af01c6f4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:58.058673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc852997-08d2-43fe-8908-297af01c6f4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:58.125966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:58.172661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f44d18e1-31b5-45aa-a6b2-83fd4ed49b74 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:58.184698 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f44d18e1-31b5-45aa-a6b2-83fd4ed49b74 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1313 microversion: 2.1 time: 1.359658 Sep 08 12:51:58.185467 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1311/2499] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:56 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1313 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:58.215746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-460f6890-e82e-408d-a2b3-d4dc7ec21c17 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:58.216607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-460f6890-e82e-408d-a2b3-d4dc7ec21c17 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:58.229312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-460f6890-e82e-408d-a2b3-d4dc7ec21c17 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:58.229842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-460f6890-e82e-408d-a2b3-d4dc7ec21c17 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:58.230476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-460f6890-e82e-408d-a2b3-d4dc7ec21c17 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:58.231260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-460f6890-e82e-408d-a2b3-d4dc7ec21c17 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:58.231736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-460f6890-e82e-408d-a2b3-d4dc7ec21c17 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:58.232190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-460f6890-e82e-408d-a2b3-d4dc7ec21c17 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:58.699432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cc852997-08d2-43fe-8908-297af01c6f4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:58.729035 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cc852997-08d2-43fe-8908-297af01c6f4b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 0.701518 Sep 08 12:51:58.729035 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1189/2500] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:58 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:58.740773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-4c61742c-f3a4-44cc-8069-e514552d0a51 req-edc2a26e-6224-489b-94d0-6e4750e83656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a028a63-83ed-4fbc-8ae9-fd5a7efe568c", "tag": "b1205a24-4dab-496d-ab9e-de43f7541dc8"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:58.746898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-460f6890-e82e-408d-a2b3-d4dc7ec21c17 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:58.760355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4c61742c-f3a4-44cc-8069-e514552d0a51 req-edc2a26e-6224-489b-94d0-6e4750e83656 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:58.760930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4c61742c-f3a4-44cc-8069-e514552d0a51 req-edc2a26e-6224-489b-94d0-6e4750e83656 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:58.762161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4c61742c-f3a4-44cc-8069-e514552d0a51 req-edc2a26e-6224-489b-94d0-6e4750e83656 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:58.783432 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-4c61742c-f3a4-44cc-8069-e514552d0a51 req-edc2a26e-6224-489b-94d0-6e4750e83656 service nova] Creating event network-changed:b1205a24-4dab-496d-ab9e-de43f7541dc8 for instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c on n-h2-852084-10 Sep 08 12:51:58.791514 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-4c61742c-f3a4-44cc-8069-e514552d0a51 req-edc2a26e-6224-489b-94d0-6e4750e83656 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068685 Sep 08 12:51:58.792774 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1190/2501] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:58.823154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3d313bcb-8a88-4a5d-b37a-e42bce6eb5dc tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:58.836438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3d313bcb-8a88-4a5d-b37a-e42bce6eb5dc tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:58.843940 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-460f6890-e82e-408d-a2b3-d4dc7ec21c17 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1509 microversion: 2.1 time: 0.656498 Sep 08 12:51:58.846979 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1312/2502] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:58 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1509 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:58.885637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-11ed01cc-bb88-44e1-b6ed-928822e19900 req-3f201085-5de0-4f86-afe0-b1bb6a45b227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb01efa-03b9-40b6-901b-33e7d583b7c8", "name": "network-vif-plugged", "status": "completed", "tag": "6d98b289-22e2-4a8e-ba25-0857a1412c6b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:51:58.900022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d313bcb-8a88-4a5d-b37a-e42bce6eb5dc tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:58.900705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d313bcb-8a88-4a5d-b37a-e42bce6eb5dc tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:58.901253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d313bcb-8a88-4a5d-b37a-e42bce6eb5dc tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:58.902160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d313bcb-8a88-4a5d-b37a-e42bce6eb5dc tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:58.903909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d313bcb-8a88-4a5d-b37a-e42bce6eb5dc tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:58.906264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d313bcb-8a88-4a5d-b37a-e42bce6eb5dc tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:58.948213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-11ed01cc-bb88-44e1-b6ed-928822e19900 req-3f201085-5de0-4f86-afe0-b1bb6a45b227 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:58.949774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-11ed01cc-bb88-44e1-b6ed-928822e19900 req-3f201085-5de0-4f86-afe0-b1bb6a45b227 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:58.951298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-11ed01cc-bb88-44e1-b6ed-928822e19900 req-3f201085-5de0-4f86-afe0-b1bb6a45b227 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:59.017141 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-11ed01cc-bb88-44e1-b6ed-928822e19900 req-3f201085-5de0-4f86-afe0-b1bb6a45b227 service nova] Creating event network-vif-plugged:6d98b289-22e2-4a8e-ba25-0857a1412c6b for instance abb01efa-03b9-40b6-901b-33e7d583b7c8 on n-h1-852084-10 Sep 08 12:51:59.039334 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-11ed01cc-bb88-44e1-b6ed-928822e19900 req-3f201085-5de0-4f86-afe0-b1bb6a45b227 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185216 Sep 08 12:51:59.063255 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1313/2503] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:59.088165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4eeec8a5-d5fe-493c-8ddf-e4b63673536a tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] Calling method '.version_select at 0x7fdb3f07a280>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:59.311104 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4eeec8a5-d5fe-493c-8ddf-e4b63673536a tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/7961667d-f51a-4c07-91a9-04b05202413a" status: 200 len: 351 microversion: 2.1 time: 0.244823 Sep 08 12:51:59.312624 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1314/2504] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:51:59 2022] GET /compute/v2.1/os-volumes/7961667d-f51a-4c07-91a9-04b05202413a => generated 351 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:51:59.322657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bff22dd8-7488-4d7b-ba0a-55781f388eac tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:59.323879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bff22dd8-7488-4d7b-ba0a-55781f388eac tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:59.338671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bff22dd8-7488-4d7b-ba0a-55781f388eac tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:59.340964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bff22dd8-7488-4d7b-ba0a-55781f388eac tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:59.341776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bff22dd8-7488-4d7b-ba0a-55781f388eac tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:59.345725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bff22dd8-7488-4d7b-ba0a-55781f388eac tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:59.346692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bff22dd8-7488-4d7b-ba0a-55781f388eac tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:59.348982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bff22dd8-7488-4d7b-ba0a-55781f388eac tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:59.420508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bff22dd8-7488-4d7b-ba0a-55781f388eac tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:51:59.754810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3d313bcb-8a88-4a5d-b37a-e42bce6eb5dc tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:51:59.767321 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3d313bcb-8a88-4a5d-b37a-e42bce6eb5dc tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 200 len: 1504 microversion: 2.1 time: 0.950410 Sep 08 12:51:59.772087 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1191/2505] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:58 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 1504 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:51:59.792945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-df7e3913-558c-494f-b016-ba571e28d8ae tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:51:59.795201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-df7e3913-558c-494f-b016-ba571e28d8ae tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:51:59.820779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:51:59.826256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df7e3913-558c-494f-b016-ba571e28d8ae tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:59.827136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df7e3913-558c-494f-b016-ba571e28d8ae tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:59.840655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df7e3913-558c-494f-b016-ba571e28d8ae tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:59.842550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df7e3913-558c-494f-b016-ba571e28d8ae tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:51:59.843567 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bff22dd8-7488-4d7b-ba0a-55781f388eac tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "DELETE /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 204 len: 0 microversion: 2.1 time: 0.528563 Sep 08 12:51:59.844868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df7e3913-558c-494f-b016-ba571e28d8ae tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:51:59.845189 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1315/2506] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:51:59 2022] DELETE /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:51:59.848570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df7e3913-558c-494f-b016-ba571e28d8ae tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:51:59.877051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-53035189-4c52-4edb-91e0-676ff3d93925 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb35e4fee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:00.039736 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-53035189-4c52-4edb-91e0-676ff3d93925 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.191598 Sep 08 12:52:00.051509 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1316/2507] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:51:59 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:00.071417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-18afc75a-6e95-4aa0-82be-6a03fb842de6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:00.072391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-18afc75a-6e95-4aa0-82be-6a03fb842de6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:00.092714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18afc75a-6e95-4aa0-82be-6a03fb842de6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:00.093259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18afc75a-6e95-4aa0-82be-6a03fb842de6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:00.093938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18afc75a-6e95-4aa0-82be-6a03fb842de6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:00.094896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18afc75a-6e95-4aa0-82be-6a03fb842de6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:00.095494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18afc75a-6e95-4aa0-82be-6a03fb842de6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:00.096001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18afc75a-6e95-4aa0-82be-6a03fb842de6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:00.413623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-18afc75a-6e95-4aa0-82be-6a03fb842de6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:00.448014 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-18afc75a-6e95-4aa0-82be-6a03fb842de6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1313 microversion: 2.1 time: 0.387402 Sep 08 12:52:00.449219 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1317/2508] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:00 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1313 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:00.483457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3dba919-dd43-47d8-8e4e-e6c35f8c540f tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:00.484111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e3dba919-dd43-47d8-8e4e-e6c35f8c540f tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:00.518732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3dba919-dd43-47d8-8e4e-e6c35f8c540f tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:00.519259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3dba919-dd43-47d8-8e4e-e6c35f8c540f tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:00.519728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3dba919-dd43-47d8-8e4e-e6c35f8c540f tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:00.520473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3dba919-dd43-47d8-8e4e-e6c35f8c540f tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:00.520943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3dba919-dd43-47d8-8e4e-e6c35f8c540f tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:00.521379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3dba919-dd43-47d8-8e4e-e6c35f8c540f tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:01.226541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-df7e3913-558c-494f-b016-ba571e28d8ae tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:01.245460 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-df7e3913-558c-494f-b016-ba571e28d8ae tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1365 microversion: 2.1 time: 1.471323 Sep 08 12:52:01.265302 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1192/2509] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:51:59 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1365 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:01.293467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f7732fd5-9f14-4123-bbec-a668fde0bebf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-854658842"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:01.294993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f7732fd5-9f14-4123-bbec-a668fde0bebf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:01.308355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7732fd5-9f14-4123-bbec-a668fde0bebf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:01.309708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7732fd5-9f14-4123-bbec-a668fde0bebf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:01.311782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7732fd5-9f14-4123-bbec-a668fde0bebf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:01.313883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7732fd5-9f14-4123-bbec-a668fde0bebf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:01.315115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7732fd5-9f14-4123-bbec-a668fde0bebf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:01.316441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7732fd5-9f14-4123-bbec-a668fde0bebf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:01.598183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e3dba919-dd43-47d8-8e4e-e6c35f8c540f tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:01.613561 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e3dba919-dd43-47d8-8e4e-e6c35f8c540f tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 1.163076 Sep 08 12:52:01.614713 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1318/2510] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:00 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:01.626195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4fafb95-6391-4823-be7a-91ede5d3677f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:01.643936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a4fafb95-6391-4823-be7a-91ede5d3677f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:01.671583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4fafb95-6391-4823-be7a-91ede5d3677f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:01.672640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4fafb95-6391-4823-be7a-91ede5d3677f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:01.674235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4fafb95-6391-4823-be7a-91ede5d3677f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:01.677572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4fafb95-6391-4823-be7a-91ede5d3677f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:01.683732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4fafb95-6391-4823-be7a-91ede5d3677f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:01.684450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4fafb95-6391-4823-be7a-91ede5d3677f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:01.764951 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.network.security_group_api [None req-f7732fd5-9f14-4123-bbec-a668fde0bebf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Adding security group bbd94580-bf4b-46af-a352-61a7fc13508d to port 11c30836-eaf8-4c74-a70a-915fdf23e280 Sep 08 12:52:01.789588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a4fafb95-6391-4823-be7a-91ede5d3677f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:52:01.936246 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.compute.api [None req-a4fafb95-6391-4823-be7a-91ede5d3677f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Instance is already in deleting state, ignoring this request Sep 08 12:52:01.940050 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a4fafb95-6391-4823-be7a-91ede5d3677f tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "DELETE /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 204 len: 0 microversion: 2.1 time: 0.320034 Sep 08 12:52:01.944712 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1319/2511] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:52:01 2022] DELETE /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:52:01.963541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0497901d-3e1e-4694-aee4-d9b8c4422c65 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f12ad30>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:02.070649 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0497901d-3e1e-4694-aee4-d9b8c4422c65 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.124050 Sep 08 12:52:02.076859 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1320/2512] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:52:01 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:02.093845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-fd8910cc-aa17-426a-a130-663700e7edb2 req-232fc33b-ccc4-4cda-9576-c7bf3b1c4947 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3250685a-8562-4deb-a070-5ef61a7adece", "name": "network-vif-plugged", "status": "completed", "tag": "abdffb77-d374-428a-a4ad-7dbf4411576c"}, {"server_uuid": "883b526c-7f9c-4fe9-b5ad-26aa46f05f78", "name": "network-vif-plugged", "status": "completed", "tag": "4573b7c0-61ea-430d-b283-e6fc56ec3979"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:02.152634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-fd8910cc-aa17-426a-a130-663700e7edb2 req-232fc33b-ccc4-4cda-9576-c7bf3b1c4947 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:02.153663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-fd8910cc-aa17-426a-a130-663700e7edb2 req-232fc33b-ccc4-4cda-9576-c7bf3b1c4947 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:02.154283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-fd8910cc-aa17-426a-a130-663700e7edb2 req-232fc33b-ccc4-4cda-9576-c7bf3b1c4947 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:02.186055 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-fd8910cc-aa17-426a-a130-663700e7edb2 req-232fc33b-ccc4-4cda-9576-c7bf3b1c4947 service nova] Creating event network-vif-plugged:abdffb77-d374-428a-a4ad-7dbf4411576c for instance 3250685a-8562-4deb-a070-5ef61a7adece on n-h2-852084-10 Sep 08 12:52:02.193303 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-fd8910cc-aa17-426a-a130-663700e7edb2 req-232fc33b-ccc4-4cda-9576-c7bf3b1c4947 service nova] Creating event network-vif-plugged:4573b7c0-61ea-430d-b283-e6fc56ec3979 for instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 on n-h2-852084-10 Sep 08 12:52:02.212983 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-fd8910cc-aa17-426a-a130-663700e7edb2 req-232fc33b-ccc4-4cda-9576-c7bf3b1c4947 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.134470 Sep 08 12:52:02.219990 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1321/2513] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:02.257583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4f864e3d-3270-47bd-a22c-cb48f52f055b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:02.266767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4f864e3d-3270-47bd-a22c-cb48f52f055b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:02.283917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f864e3d-3270-47bd-a22c-cb48f52f055b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:02.284806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f864e3d-3270-47bd-a22c-cb48f52f055b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:02.285540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f864e3d-3270-47bd-a22c-cb48f52f055b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:02.286633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f864e3d-3270-47bd-a22c-cb48f52f055b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:02.289910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f864e3d-3270-47bd-a22c-cb48f52f055b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:02.300152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f864e3d-3270-47bd-a22c-cb48f52f055b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:03.268119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4f864e3d-3270-47bd-a22c-cb48f52f055b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:03.283506 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4f864e3d-3270-47bd-a22c-cb48f52f055b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1313 microversion: 2.1 time: 1.061232 Sep 08 12:52:03.284469 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1322/2514] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:02 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1313 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:03.293637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-096afef8-775b-4dc9-839b-121b324a2257 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:03.294271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-096afef8-775b-4dc9-839b-121b324a2257 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:03.321539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-096afef8-775b-4dc9-839b-121b324a2257 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:03.322360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-096afef8-775b-4dc9-839b-121b324a2257 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:03.322806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-096afef8-775b-4dc9-839b-121b324a2257 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:03.323718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-096afef8-775b-4dc9-839b-121b324a2257 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:03.324231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-096afef8-775b-4dc9-839b-121b324a2257 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:03.324665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-096afef8-775b-4dc9-839b-121b324a2257 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:03.467319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-096afef8-775b-4dc9-839b-121b324a2257 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9e7b70f33287409794f79507bd31b81c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c2a7d092bfb409abbaa54af1841ac99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:03.478589 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-096afef8-775b-4dc9-839b-121b324a2257 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 200 len: 1473 microversion: 2.1 time: 0.192939 Sep 08 12:52:03.503273 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1323/2515] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:03 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 1473 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:03.509021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a1c21289-961a-476f-b7eb-0e874230a93a req-77ccefd8-9b40-4b52-b087-feded08d219a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a028a63-83ed-4fbc-8ae9-fd5a7efe568c", "tag": "9078770f-276a-4614-b856-97bd301c2e61"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:03.530675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a1c21289-961a-476f-b7eb-0e874230a93a req-77ccefd8-9b40-4b52-b087-feded08d219a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:03.533872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a1c21289-961a-476f-b7eb-0e874230a93a req-77ccefd8-9b40-4b52-b087-feded08d219a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:03.534471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a1c21289-961a-476f-b7eb-0e874230a93a req-77ccefd8-9b40-4b52-b087-feded08d219a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:03.597323 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a1c21289-961a-476f-b7eb-0e874230a93a req-77ccefd8-9b40-4b52-b087-feded08d219a service nova] Creating event network-changed:9078770f-276a-4614-b856-97bd301c2e61 for instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c on n-h2-852084-10 Sep 08 12:52:03.622937 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a1c21289-961a-476f-b7eb-0e874230a93a req-77ccefd8-9b40-4b52-b087-feded08d219a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123635 Sep 08 12:52:03.624245 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1324/2516] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:03.653901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-480e04ed-fe13-47fa-82c7-6225ec1b8528 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:03.654816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-480e04ed-fe13-47fa-82c7-6225ec1b8528 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:03.694439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-480e04ed-fe13-47fa-82c7-6225ec1b8528 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:03.710355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-480e04ed-fe13-47fa-82c7-6225ec1b8528 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:03.710915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-480e04ed-fe13-47fa-82c7-6225ec1b8528 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:03.711749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-480e04ed-fe13-47fa-82c7-6225ec1b8528 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:03.718017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-480e04ed-fe13-47fa-82c7-6225ec1b8528 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:03.718531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-480e04ed-fe13-47fa-82c7-6225ec1b8528 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:05.048813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-480e04ed-fe13-47fa-82c7-6225ec1b8528 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:05.068078 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-480e04ed-fe13-47fa-82c7-6225ec1b8528 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1552 microversion: 2.1 time: 1.442133 Sep 08 12:52:05.069490 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1325/2517] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:03 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1552 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:05.087082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-58da22c3-a811-4015-9f76-f4d14a9a5c93 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:05.094774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58da22c3-a811-4015-9f76-f4d14a9a5c93 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:05.126431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58da22c3-a811-4015-9f76-f4d14a9a5c93 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:05.128555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58da22c3-a811-4015-9f76-f4d14a9a5c93 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:05.132632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58da22c3-a811-4015-9f76-f4d14a9a5c93 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:05.134189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58da22c3-a811-4015-9f76-f4d14a9a5c93 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:05.134851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58da22c3-a811-4015-9f76-f4d14a9a5c93 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:05.135590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58da22c3-a811-4015-9f76-f4d14a9a5c93 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:05.496081 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f7732fd5-9f14-4123-bbec-a668fde0bebf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c/action" status: 202 len: 0 microversion: 2.1 time: 4.227833 Sep 08 12:52:05.498754 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1193/2518] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:52:01 2022] POST /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c/action => generated 0 bytes in 4232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:52:05.516575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b8000976-2c13-409b-b523-98872dd8b514 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f1b1e50>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:05.633232 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b8000976-2c13-409b-b523-98872dd8b514 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.132608 Sep 08 12:52:05.633847 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1194/2519] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:52:05 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:05.658390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0f5de4c2-28e6-439a-b8e6-a9181f1e3d91 req-04ee5e07-0a84-4e82-9219-348cf2840d45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "141ab14e-b6e6-467a-83f1-7dbbbb899158", "name": "network-vif-deleted", "tag": "305e290f-8a75-4172-a7c0-6feb49a5e0ae"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:05.694897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0f5de4c2-28e6-439a-b8e6-a9181f1e3d91 req-04ee5e07-0a84-4e82-9219-348cf2840d45 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:05.695720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0f5de4c2-28e6-439a-b8e6-a9181f1e3d91 req-04ee5e07-0a84-4e82-9219-348cf2840d45 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:05.696403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0f5de4c2-28e6-439a-b8e6-a9181f1e3d91 req-04ee5e07-0a84-4e82-9219-348cf2840d45 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:05.732047 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0f5de4c2-28e6-439a-b8e6-a9181f1e3d91 req-04ee5e07-0a84-4e82-9219-348cf2840d45 service nova] Creating event network-vif-deleted:305e290f-8a75-4172-a7c0-6feb49a5e0ae for instance 141ab14e-b6e6-467a-83f1-7dbbbb899158 on n-h1-852084-10 Sep 08 12:52:05.754679 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0f5de4c2-28e6-439a-b8e6-a9181f1e3d91 req-04ee5e07-0a84-4e82-9219-348cf2840d45 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119061 Sep 08 12:52:05.755874 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1195/2520] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:05.812751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f8411285-725f-4d82-8cd7-8ee6c218cad4 tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] Calling method '.version_select at 0x7fdb3f1404c0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:05.988163 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f8411285-725f-4d82-8cd7-8ee6c218cad4 tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/cef4c77a-4231-46a4-bc9d-4aaa549e4dab" status: 200 len: 350 microversion: 2.1 time: 0.230088 Sep 08 12:52:05.991066 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1196/2521] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:52:05 2022] GET /compute/v2.1/os-volumes/cef4c77a-4231-46a4-bc9d-4aaa549e4dab => generated 350 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:06.021820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c8cad122-7c3d-4e08-a32b-208fc48eca0e tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:06.025972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c8cad122-7c3d-4e08-a32b-208fc48eca0e tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:06.048113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8cad122-7c3d-4e08-a32b-208fc48eca0e tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:06.049416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8cad122-7c3d-4e08-a32b-208fc48eca0e tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:06.050599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8cad122-7c3d-4e08-a32b-208fc48eca0e tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:06.054061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8cad122-7c3d-4e08-a32b-208fc48eca0e tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:06.056156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8cad122-7c3d-4e08-a32b-208fc48eca0e tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:06.061469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8cad122-7c3d-4e08-a32b-208fc48eca0e tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:06.531994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-58da22c3-a811-4015-9f76-f4d14a9a5c93 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:06.562035 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-58da22c3-a811-4015-9f76-f4d14a9a5c93 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 1.490324 Sep 08 12:52:06.565809 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1326/2522] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:05 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:06.583519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-678301eb-3c10-4de9-9592-df9436e41c5c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:06.584998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-678301eb-3c10-4de9-9592-df9436e41c5c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 141ab14e-b6e6-467a-83f1-7dbbbb899158] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:06.602503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-678301eb-3c10-4de9-9592-df9436e41c5c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:06.603877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-678301eb-3c10-4de9-9592-df9436e41c5c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:06.606453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-678301eb-3c10-4de9-9592-df9436e41c5c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:06.608840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-678301eb-3c10-4de9-9592-df9436e41c5c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:06.610378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-678301eb-3c10-4de9-9592-df9436e41c5c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:06.611796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-678301eb-3c10-4de9-9592-df9436e41c5c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:06.652323 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-678301eb-3c10-4de9-9592-df9436e41c5c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] HTTP exception thrown: Instance 141ab14e-b6e6-467a-83f1-7dbbbb899158 could not be found. Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-678301eb-3c10-4de9-9592-df9436e41c5c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Request method failure captured: Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 HTTP/1.1 Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeSV3UE-_K9q7ncd4himqTVRnCVpCn86seHgNBeaVrrAF_cTXF3ZIYVKYokBDglgz9cZ0tGCYiH373QOrUl9R17tsF6ecOfVpHDbSZFgCYUfRh2KDBsKec2uylsMJjXVsG8IqEPQzL6ZGUi_9zEzPwiBJ0KxdT3BGvfKE8XJ-Rzu--I Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0c2a7d092bfb409abbaa54af1841ac99 Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0c2a7d092bfb409abbaa54af1841ac99 Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerDiskConfigTestJSON-25648581-project Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 9e7b70f33287409794f79507bd31b81c Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerDiskConfigTestJSON-25648581-project Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 141ab14e-b6e6-467a-83f1-7dbbbb899158 could not be found. Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '141ab14e-b6e6-467a-83f1-7dbbbb899158'} Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 141ab14e-b6e6-467a-83f1-7dbbbb899158 could not be found. Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 141ab14e-b6e6-467a-83f1-7dbbbb899158 could not be found. Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:06.670189 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:06.674784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:06.674784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:06.674784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:06.674784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:06.674784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:06.674784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 141ab14e-b6e6-467a-83f1-7dbbbb899158 could not be found. Sep 08 12:52:06.674784 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:06.677068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-678301eb-3c10-4de9-9592-df9436e41c5c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Returning 404 to user: Instance 141ab14e-b6e6-467a-83f1-7dbbbb899158 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:06.684753 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-678301eb-3c10-4de9-9592-df9436e41c5c tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158" status: 404 len: 111 microversion: 2.1 time: 0.117006 Sep 08 12:52:06.688440 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1327/2523] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:06 2022] GET /compute/v2.1/servers/141ab14e-b6e6-467a-83f1-7dbbbb899158 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:52:06.712560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2585cb9a-8745-4493-939d-050fb5f79eb1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:06.714019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2585cb9a-8745-4493-939d-050fb5f79eb1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:06.738831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2585cb9a-8745-4493-939d-050fb5f79eb1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:06.741947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2585cb9a-8745-4493-939d-050fb5f79eb1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:06.743599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2585cb9a-8745-4493-939d-050fb5f79eb1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:06.750235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2585cb9a-8745-4493-939d-050fb5f79eb1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:06.756552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2585cb9a-8745-4493-939d-050fb5f79eb1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:06.761639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2585cb9a-8745-4493-939d-050fb5f79eb1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:07.195764 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2585cb9a-8745-4493-939d-050fb5f79eb1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.503707 Sep 08 12:52:07.197281 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1328/2524] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 12:52:06 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/os-interface => generated 284 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:07.233497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f81ff15a-ebca-4a0f-a71a-bdc03bdd7889 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1570167282"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:07.240242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f81ff15a-ebca-4a0f-a71a-bdc03bdd7889 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:07.279296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f81ff15a-ebca-4a0f-a71a-bdc03bdd7889 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:07.284045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f81ff15a-ebca-4a0f-a71a-bdc03bdd7889 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:07.285227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f81ff15a-ebca-4a0f-a71a-bdc03bdd7889 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:07.286745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f81ff15a-ebca-4a0f-a71a-bdc03bdd7889 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:07.293672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f81ff15a-ebca-4a0f-a71a-bdc03bdd7889 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:07.298069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f81ff15a-ebca-4a0f-a71a-bdc03bdd7889 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:07.631449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c8cad122-7c3d-4e08-a32b-208fc48eca0e tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:07.651013 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c8cad122-7c3d-4e08-a32b-208fc48eca0e tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1313 microversion: 2.1 time: 1.657369 Sep 08 12:52:07.659796 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1197/2525] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:05 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1313 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:07.665607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-74d646bd-8e60-4c58-bfa4-7a80f2bd83fa req-888ecf68-2458-4332-a9c1-ea1b22d0ecd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a460ded-9066-4972-a981-9295e353bb3c", "tag": "11c30836-eaf8-4c74-a70a-915fdf23e280"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:07.729819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-74d646bd-8e60-4c58-bfa4-7a80f2bd83fa req-888ecf68-2458-4332-a9c1-ea1b22d0ecd1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:07.730332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-74d646bd-8e60-4c58-bfa4-7a80f2bd83fa req-888ecf68-2458-4332-a9c1-ea1b22d0ecd1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:07.730886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-74d646bd-8e60-4c58-bfa4-7a80f2bd83fa req-888ecf68-2458-4332-a9c1-ea1b22d0ecd1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:07.769595 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-74d646bd-8e60-4c58-bfa4-7a80f2bd83fa req-888ecf68-2458-4332-a9c1-ea1b22d0ecd1 service nova] Creating event network-changed:11c30836-eaf8-4c74-a70a-915fdf23e280 for instance 0a460ded-9066-4972-a981-9295e353bb3c on n-h2-852084-10 Sep 08 12:52:07.776281 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-74d646bd-8e60-4c58-bfa4-7a80f2bd83fa req-888ecf68-2458-4332-a9c1-ea1b22d0ecd1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115105 Sep 08 12:52:07.778338 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1198/2526] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:07.811015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4954a13a-aff8-4624-a503-7d82e3b0e990 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f140040>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:07.929342 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4954a13a-aff8-4624-a503-7d82e3b0e990 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.145986 Sep 08 12:52:07.937321 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1199/2527] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:52:07 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:07.970396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3d2a03fd-fb64-405d-bb36-faf50e5f0341 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:07.972591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3d2a03fd-fb64-405d-bb36-faf50e5f0341 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:07.985369 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.network.security_group_api [None req-f81ff15a-ebca-4a0f-a71a-bdc03bdd7889 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Adding security group c71d9fb5-30fa-4678-8588-08c0c6af6f4a to port 11c30836-eaf8-4c74-a70a-915fdf23e280 Sep 08 12:52:08.000887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d2a03fd-fb64-405d-bb36-faf50e5f0341 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:08.001897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d2a03fd-fb64-405d-bb36-faf50e5f0341 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:08.009880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d2a03fd-fb64-405d-bb36-faf50e5f0341 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:08.012016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d2a03fd-fb64-405d-bb36-faf50e5f0341 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:08.012868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d2a03fd-fb64-405d-bb36-faf50e5f0341 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:08.013669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d2a03fd-fb64-405d-bb36-faf50e5f0341 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:08.095483 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-3d2a03fd-fb64-405d-bb36-faf50e5f0341 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] HTTP exception thrown: Instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 could not be found. Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3d2a03fd-fb64-405d-bb36-faf50e5f0341 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Request method failure captured: Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 HTTP/1.1 Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeSV3UE-_K9q7ncd4himqTVRnCVpCn86seHgNBeaVrrAF_cTXF3ZIYVKYokBDglgz9cZ0tGCYiH373QOrUl9R17tsF6ecOfVpHDbSZFgCYUfRh2KDBsKec2uylsMJjXVsG8IqEPQzL6ZGUi_9zEzPwiBJ0KxdT3BGvfKE8XJ-Rzu--I Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0c2a7d092bfb409abbaa54af1841ac99 Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0c2a7d092bfb409abbaa54af1841ac99 Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerDiskConfigTestJSON-25648581-project Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9e7b70f33287409794f79507bd31b81c Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerDiskConfigTestJSON-25648581-project Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 could not be found. Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '0aac929c-34e0-46b4-b2ed-be01e53a5b48'} Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 could not be found. Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:52:08.103155 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:52:08.117695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 could not be found. Sep 08 12:52:08.117695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:08.117695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:08.117695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:08.117695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:08.117695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:08.117695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:08.117695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:08.117695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:08.117695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 could not be found. Sep 08 12:52:08.117695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:08.123879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3d2a03fd-fb64-405d-bb36-faf50e5f0341 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Returning 404 to user: Instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:08.130061 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3d2a03fd-fb64-405d-bb36-faf50e5f0341 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 404 len: 111 microversion: 2.1 time: 0.185971 Sep 08 12:52:08.134368 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1200/2528] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:52:07 2022] DELETE /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:52:08.145599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f73ffdcb-52f2-444a-8c24-6196637f38dc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:08.147206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f73ffdcb-52f2-444a-8c24-6196637f38dc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:08.159491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f73ffdcb-52f2-444a-8c24-6196637f38dc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:08.160953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f73ffdcb-52f2-444a-8c24-6196637f38dc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:08.162155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f73ffdcb-52f2-444a-8c24-6196637f38dc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:08.163879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f73ffdcb-52f2-444a-8c24-6196637f38dc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:08.165046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f73ffdcb-52f2-444a-8c24-6196637f38dc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:08.166195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f73ffdcb-52f2-444a-8c24-6196637f38dc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:09.493767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f73ffdcb-52f2-444a-8c24-6196637f38dc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:09.549288 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f73ffdcb-52f2-444a-8c24-6196637f38dc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 1.412405 Sep 08 12:52:09.559020 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1201/2529] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:08 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:09.571524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d2bca479-dc37-453e-a2b7-3e15b7f32ebc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:09.574448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d2bca479-dc37-453e-a2b7-3e15b7f32ebc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 0aac929c-34e0-46b4-b2ed-be01e53a5b48] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:09.609364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2bca479-dc37-453e-a2b7-3e15b7f32ebc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:09.612439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2bca479-dc37-453e-a2b7-3e15b7f32ebc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:09.613702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2bca479-dc37-453e-a2b7-3e15b7f32ebc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:09.625138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2bca479-dc37-453e-a2b7-3e15b7f32ebc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:09.626708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2bca479-dc37-453e-a2b7-3e15b7f32ebc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:09.628669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2bca479-dc37-453e-a2b7-3e15b7f32ebc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:09.748852 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-d2bca479-dc37-453e-a2b7-3e15b7f32ebc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] HTTP exception thrown: Instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 could not be found. Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d2bca479-dc37-453e-a2b7-3e15b7f32ebc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Request method failure captured: Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 HTTP/1.1 Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeSV3UE-_K9q7ncd4himqTVRnCVpCn86seHgNBeaVrrAF_cTXF3ZIYVKYokBDglgz9cZ0tGCYiH373QOrUl9R17tsF6ecOfVpHDbSZFgCYUfRh2KDBsKec2uylsMJjXVsG8IqEPQzL6ZGUi_9zEzPwiBJ0KxdT3BGvfKE8XJ-Rzu--I Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0c2a7d092bfb409abbaa54af1841ac99 Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0c2a7d092bfb409abbaa54af1841ac99 Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerDiskConfigTestJSON-25648581-project Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9e7b70f33287409794f79507bd31b81c Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerDiskConfigTestJSON-25648581-project Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 could not be found. Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '0aac929c-34e0-46b4-b2ed-be01e53a5b48'} Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 could not be found. Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 could not be found. Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:09.768890 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:09.779526 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:09.779526 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:09.779526 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:09.779526 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:09.779526 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:09.779526 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 could not be found. Sep 08 12:52:09.779526 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:09.779526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d2bca479-dc37-453e-a2b7-3e15b7f32ebc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Returning 404 to user: Instance 0aac929c-34e0-46b4-b2ed-be01e53a5b48 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:09.779526 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d2bca479-dc37-453e-a2b7-3e15b7f32ebc tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48" status: 404 len: 111 microversion: 2.1 time: 0.217378 Sep 08 12:52:09.781217 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1202/2530] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:09 2022] GET /compute/v2.1/servers/0aac929c-34e0-46b4-b2ed-be01e53a5b48 => generated 111 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:52:09.790938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e0869013-989e-4447-baca-61c1a8c2eed0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:09.791767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e0869013-989e-4447-baca-61c1a8c2eed0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:09.800807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0869013-989e-4447-baca-61c1a8c2eed0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:09.801621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0869013-989e-4447-baca-61c1a8c2eed0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:09.802245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0869013-989e-4447-baca-61c1a8c2eed0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:09.803515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0869013-989e-4447-baca-61c1a8c2eed0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:09.804258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0869013-989e-4447-baca-61c1a8c2eed0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:09.804980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0869013-989e-4447-baca-61c1a8c2eed0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:10.428621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e0869013-989e-4447-baca-61c1a8c2eed0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:10.444715 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e0869013-989e-4447-baca-61c1a8c2eed0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1462 microversion: 2.1 time: 0.659634 Sep 08 12:52:10.450827 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1203/2531] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:09 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1462 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:10.456382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d0e746bd-3393-440e-806f-34c0732d5350 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f148940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:10.608591 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d0e746bd-3393-440e-806f-34c0732d5350 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.156149 Sep 08 12:52:10.619926 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1204/2532] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:52:10 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:10.626751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-310821f5-c2f9-47e3-968a-b1af71e7a186 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:10.628094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-310821f5-c2f9-47e3-968a-b1af71e7a186 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:10.639014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-310821f5-c2f9-47e3-968a-b1af71e7a186 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:10.639963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-310821f5-c2f9-47e3-968a-b1af71e7a186 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:10.640835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-310821f5-c2f9-47e3-968a-b1af71e7a186 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:10.641914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-310821f5-c2f9-47e3-968a-b1af71e7a186 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:10.642827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-310821f5-c2f9-47e3-968a-b1af71e7a186 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:10.643516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-310821f5-c2f9-47e3-968a-b1af71e7a186 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:10.663370 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-310821f5-c2f9-47e3-968a-b1af71e7a186 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] HTTP exception thrown: Instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b could not be found. Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-310821f5-c2f9-47e3-968a-b1af71e7a186 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Request method failure captured: Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b HTTP/1.1 Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeSV3UE-_K9q7ncd4himqTVRnCVpCn86seHgNBeaVrrAF_cTXF3ZIYVKYokBDglgz9cZ0tGCYiH373QOrUl9R17tsF6ecOfVpHDbSZFgCYUfRh2KDBsKec2uylsMJjXVsG8IqEPQzL6ZGUi_9zEzPwiBJ0KxdT3BGvfKE8XJ-Rzu--I Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0c2a7d092bfb409abbaa54af1841ac99 Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0c2a7d092bfb409abbaa54af1841ac99 Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerDiskConfigTestJSON-25648581-project Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9e7b70f33287409794f79507bd31b81c Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerDiskConfigTestJSON-25648581-project Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b could not be found. Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '6afa649b-c753-458a-9be6-2e4d3fdfb25b'} Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b could not be found. Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:52:10.665449 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:52:10.669463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b could not be found. Sep 08 12:52:10.669463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:10.669463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:10.669463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:10.669463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:10.669463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:10.669463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:10.669463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:10.669463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:10.669463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b could not be found. Sep 08 12:52:10.669463 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:10.672343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-310821f5-c2f9-47e3-968a-b1af71e7a186 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Returning 404 to user: Instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:10.673850 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-310821f5-c2f9-47e3-968a-b1af71e7a186 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 404 len: 111 microversion: 2.1 time: 0.052240 Sep 08 12:52:10.678494 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1205/2533] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:52:10 2022] DELETE /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:52:10.684464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fb96d7a9-0eb5-43f9-a61f-3bb5124487b8 tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] Calling method '.version_select at 0x7fdb3f0bf0d0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:10.866402 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fb96d7a9-0eb5-43f9-a61f-3bb5124487b8 tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/01f67207-fbb1-4c2e-9a62-0d8a820e2ceb" status: 200 len: 350 microversion: 2.1 time: 0.186282 Sep 08 12:52:10.866992 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1206/2534] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:52:10 2022] GET /compute/v2.1/os-volumes/01f67207-fbb1-4c2e-9a62-0d8a820e2ceb => generated 350 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:10.879011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-22d7ceab-6e11-446d-85e4-2e44021d68be req-3403a96f-c171-4558-8f1d-3ecde318efa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a028a63-83ed-4fbc-8ae9-fd5a7efe568c", "tag": "e1423704-0403-4700-a477-a2467e273263"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:10.927956 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f81ff15a-ebca-4a0f-a71a-bdc03bdd7889 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c/action" status: 202 len: 0 microversion: 2.1 time: 3.728272 Sep 08 12:52:10.931318 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1329/2535] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:52:07 2022] POST /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c/action => generated 0 bytes in 3733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:52:10.933596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-22d7ceab-6e11-446d-85e4-2e44021d68be req-3403a96f-c171-4558-8f1d-3ecde318efa0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:10.934100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-22d7ceab-6e11-446d-85e4-2e44021d68be req-3403a96f-c171-4558-8f1d-3ecde318efa0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:10.944153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-22d7ceab-6e11-446d-85e4-2e44021d68be req-3403a96f-c171-4558-8f1d-3ecde318efa0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:10.945287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-10d11731-b6bb-4476-9b05-d62bc9fb299a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:10.947087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-10d11731-b6bb-4476-9b05-d62bc9fb299a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:10.958611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:52:10.962317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10d11731-b6bb-4476-9b05-d62bc9fb299a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:10.963465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10d11731-b6bb-4476-9b05-d62bc9fb299a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:10.964351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10d11731-b6bb-4476-9b05-d62bc9fb299a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:10.965610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10d11731-b6bb-4476-9b05-d62bc9fb299a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:10.966445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10d11731-b6bb-4476-9b05-d62bc9fb299a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:10.968154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10d11731-b6bb-4476-9b05-d62bc9fb299a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:10.999771 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-22d7ceab-6e11-446d-85e4-2e44021d68be req-3403a96f-c171-4558-8f1d-3ecde318efa0 service nova] Creating event network-changed:e1423704-0403-4700-a477-a2467e273263 for instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c on n-h2-852084-10 Sep 08 12:52:11.009481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:52:11.027376 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-22d7ceab-6e11-446d-85e4-2e44021d68be req-3403a96f-c171-4558-8f1d-3ecde318efa0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154355 Sep 08 12:52:11.037746 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1207/2536] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:11.055764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4872bd83-94ae-4136-8c6b-ac2bd644fa89 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:11.058038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4872bd83-94ae-4136-8c6b-ac2bd644fa89 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] [instance: 6afa649b-c753-458a-9be6-2e4d3fdfb25b] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:11.076422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4872bd83-94ae-4136-8c6b-ac2bd644fa89 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:11.077154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4872bd83-94ae-4136-8c6b-ac2bd644fa89 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:11.079973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4872bd83-94ae-4136-8c6b-ac2bd644fa89 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:11.082572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4872bd83-94ae-4136-8c6b-ac2bd644fa89 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:11.086626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4872bd83-94ae-4136-8c6b-ac2bd644fa89 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:11.087930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4872bd83-94ae-4136-8c6b-ac2bd644fa89 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:11.124490 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-4872bd83-94ae-4136-8c6b-ac2bd644fa89 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] HTTP exception thrown: Instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b could not be found. Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4872bd83-94ae-4136-8c6b-ac2bd644fa89 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Request method failure captured: Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b HTTP/1.1 Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeSV3UE-_K9q7ncd4himqTVRnCVpCn86seHgNBeaVrrAF_cTXF3ZIYVKYokBDglgz9cZ0tGCYiH373QOrUl9R17tsF6ecOfVpHDbSZFgCYUfRh2KDBsKec2uylsMJjXVsG8IqEPQzL6ZGUi_9zEzPwiBJ0KxdT3BGvfKE8XJ-Rzu--I Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0c2a7d092bfb409abbaa54af1841ac99 Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c2a7d092bfb409abbaa54af1841ac99"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0c2a7d092bfb409abbaa54af1841ac99 Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-25648581 Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerDiskConfigTestJSON-25648581-project Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9e7b70f33287409794f79507bd31b81c Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerDiskConfigTestJSON-25648581-project Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b could not be found. Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '6afa649b-c753-458a-9be6-2e4d3fdfb25b'} Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b could not be found. Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b could not be found. Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:11.127122 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:11.131319 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:11.131319 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:11.131319 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:11.131319 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:11.131319 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:11.131319 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b could not be found. Sep 08 12:52:11.131319 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:11.137433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4872bd83-94ae-4136-8c6b-ac2bd644fa89 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] Returning 404 to user: Instance 6afa649b-c753-458a-9be6-2e4d3fdfb25b could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:11.139567 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4872bd83-94ae-4136-8c6b-ac2bd644fa89 tempest-ServerDiskConfigTestJSON-25648581 tempest-ServerDiskConfigTestJSON-25648581-project] 10.222.0.78 "GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b" status: 404 len: 111 microversion: 2.1 time: 0.099137 Sep 08 12:52:11.141436 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1208/2537] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:11 2022] GET /compute/v2.1/servers/6afa649b-c753-458a-9be6-2e4d3fdfb25b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:52:11.148852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1299932471", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "3250685a-8562-4deb-a070-5ef61a7adece"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:11.261842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:52:12.951860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:52:12.952542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:52:12.952908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:52:12.953690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:52:12.954425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:52:12.981324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:12.982232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:12.982909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:12.984428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:12.992109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:12.993000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:13.026371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-10d11731-b6bb-4476-9b05-d62bc9fb299a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:13.054617 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-10d11731-b6bb-4476-9b05-d62bc9fb299a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 2.119906 Sep 08 12:52:13.062173 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1330/2538] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:10 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 2129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:13.110685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca8e2cd3-31dd-46aa-aa12-5c2a241746ac tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] Calling method '.version_select at 0x7fdb35e4f4c0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:13.117345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Getting quotas for project 6c7023382ac747a2a84467a1b13b3bdb. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:52:13.161428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Getting quotas for user 1ef692f2f2ae4e8190248fc0c1f967ee and project 6c7023382ac747a2a84467a1b13b3bdb. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:52:13.246963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:52:13.262174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:52:13.501691 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a4ace363-4072-4759-8ef8-ea548e8792a1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.358405 Sep 08 12:52:13.515332 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1209/2539] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:52:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:52:13.515841 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca8e2cd3-31dd-46aa-aa12-5c2a241746ac tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.426427 Sep 08 12:52:13.515841 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1331/2540] 10.222.0.78 () {58 vars in 1134 bytes} [Thu Sep 8 12:52:13 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:13.520990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9cd95ede-5619-440d-8f40-4d16ca9babfd tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb35eb8940>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:13.528145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0b9de2a-6692-4f28-a5d9-a8fd7e4f3ea5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:13.529063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0b9de2a-6692-4f28-a5d9-a8fd7e4f3ea5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:13.560479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b9de2a-6692-4f28-a5d9-a8fd7e4f3ea5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:13.561433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b9de2a-6692-4f28-a5d9-a8fd7e4f3ea5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:13.563352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b9de2a-6692-4f28-a5d9-a8fd7e4f3ea5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:13.564794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b9de2a-6692-4f28-a5d9-a8fd7e4f3ea5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:13.565645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b9de2a-6692-4f28-a5d9-a8fd7e4f3ea5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:13.566429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b9de2a-6692-4f28-a5d9-a8fd7e4f3ea5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:13.637271 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9cd95ede-5619-440d-8f40-4d16ca9babfd tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.131037 Sep 08 12:52:13.638429 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1332/2541] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:52:13 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:14.312600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-71931040-8ea4-410f-ab61-cd0f3d8f4afa tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] Action: 'create', calling method: .version_select at 0x7fdb35dc8160>, body: {"pool": null} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:14.638654 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0b9de2a-6692-4f28-a5d9-a8fd7e4f3ea5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 1.127409 Sep 08 12:52:14.653668 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1210/2542] 10.222.0.78 () {58 vars in 1293 bytes} [Thu Sep 8 12:52:13 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c/os-security-groups => generated 1157 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:14.661024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0380c08e-fbd0-466b-8a4d-0040bb76c383 req-7820fcb6-2941-492f-a05e-ae07bff8e946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abb01efa-03b9-40b6-901b-33e7d583b7c8", "tag": "6d98b289-22e2-4a8e-ba25-0857a1412c6b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:14.714436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0380c08e-fbd0-466b-8a4d-0040bb76c383 req-7820fcb6-2941-492f-a05e-ae07bff8e946 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:14.716739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0380c08e-fbd0-466b-8a4d-0040bb76c383 req-7820fcb6-2941-492f-a05e-ae07bff8e946 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:14.718740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0380c08e-fbd0-466b-8a4d-0040bb76c383 req-7820fcb6-2941-492f-a05e-ae07bff8e946 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:14.765098 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0380c08e-fbd0-466b-8a4d-0040bb76c383 req-7820fcb6-2941-492f-a05e-ae07bff8e946 service nova] Creating event network-changed:6d98b289-22e2-4a8e-ba25-0857a1412c6b for instance abb01efa-03b9-40b6-901b-33e7d583b7c8 on n-h1-852084-10 Sep 08 12:52:14.782571 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0380c08e-fbd0-466b-8a4d-0040bb76c383 req-7820fcb6-2941-492f-a05e-ae07bff8e946 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122929 Sep 08 12:52:14.784082 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1211/2543] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:14.809994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b70d1a45-84d6-4b55-8391-8a0d0764894b req-b2c6f62d-3488-4367-9469-a5b7099dec65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a460ded-9066-4972-a981-9295e353bb3c", "tag": "11c30836-eaf8-4c74-a70a-915fdf23e280"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:14.841554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b70d1a45-84d6-4b55-8391-8a0d0764894b req-b2c6f62d-3488-4367-9469-a5b7099dec65 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:14.845489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b70d1a45-84d6-4b55-8391-8a0d0764894b req-b2c6f62d-3488-4367-9469-a5b7099dec65 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:14.846436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b70d1a45-84d6-4b55-8391-8a0d0764894b req-b2c6f62d-3488-4367-9469-a5b7099dec65 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:14.898739 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b70d1a45-84d6-4b55-8391-8a0d0764894b req-b2c6f62d-3488-4367-9469-a5b7099dec65 service nova] Creating event network-changed:11c30836-eaf8-4c74-a70a-915fdf23e280 for instance 0a460ded-9066-4972-a981-9295e353bb3c on n-h2-852084-10 Sep 08 12:52:14.907155 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b70d1a45-84d6-4b55-8391-8a0d0764894b req-b2c6f62d-3488-4367-9469-a5b7099dec65 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116904 Sep 08 12:52:14.908700 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1212/2544] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:14.917943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-df02bd5e-41e9-4a3c-8795-c32435d63c65 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:14.919112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-df02bd5e-41e9-4a3c-8795-c32435d63c65 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:14.929361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df02bd5e-41e9-4a3c-8795-c32435d63c65 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:14.930467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df02bd5e-41e9-4a3c-8795-c32435d63c65 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:14.931179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df02bd5e-41e9-4a3c-8795-c32435d63c65 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:14.934478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df02bd5e-41e9-4a3c-8795-c32435d63c65 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:14.935771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df02bd5e-41e9-4a3c-8795-c32435d63c65 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:14.937265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df02bd5e-41e9-4a3c-8795-c32435d63c65 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:15.146940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-df02bd5e-41e9-4a3c-8795-c32435d63c65 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:15.162252 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-df02bd5e-41e9-4a3c-8795-c32435d63c65 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 200 len: 1218 microversion: 2.1 time: 0.249688 Sep 08 12:52:15.166051 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1213/2545] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:14 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 1218 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:15.177036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-807796dd-56a5-4400-8d59-9a8386c91969 tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] Calling method '.version_select at 0x7fdb3f132dc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:15.704358 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-807796dd-56a5-4400-8d59-9a8386c91969 tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.513754 Sep 08 12:52:15.705688 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1214/2546] 10.222.0.78 () {58 vars in 1149 bytes} [Thu Sep 8 12:52:15 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:15.724825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2e0ecb6f-f52b-4ecb-bfd1-0bc6f9fae5f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:15.729602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2e0ecb6f-f52b-4ecb-bfd1-0bc6f9fae5f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:15.794870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e0ecb6f-f52b-4ecb-bfd1-0bc6f9fae5f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:15.796447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e0ecb6f-f52b-4ecb-bfd1-0bc6f9fae5f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:15.805077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e0ecb6f-f52b-4ecb-bfd1-0bc6f9fae5f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:15.806946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e0ecb6f-f52b-4ecb-bfd1-0bc6f9fae5f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:15.810599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e0ecb6f-f52b-4ecb-bfd1-0bc6f9fae5f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:15.812875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e0ecb6f-f52b-4ecb-bfd1-0bc6f9fae5f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:17.307809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2e0ecb6f-f52b-4ecb-bfd1-0bc6f9fae5f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:17.318600 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2e0ecb6f-f52b-4ecb-bfd1-0bc6f9fae5f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 1.610424 Sep 08 12:52:17.320473 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1215/2547] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:15 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:17.326619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-89f0f904-e401-404c-a37c-5d7d800c912f tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'create', calling method: .version_select at 0x7fdb3f1b1ca0>, body: {"security_group": {"name": " tempest-securitygroup -672494104 ", "description": "tempest-description-1902128893"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:18.897489 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-89f0f904-e401-404c-a37c-5d7d800c912f tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.574769 Sep 08 12:52:18.899918 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1216/2548] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:52:17 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:18.914244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4a12c5b3-8814-4dd6-8464-6a4d7cef7a0a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3acdfb80>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:19.089655 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4a12c5b3-8814-4dd6-8464-6a4d7cef7a0a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.186892 Sep 08 12:52:19.091739 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1217/2549] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:52:18 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:19.101219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-06dab2fc-4231-46f8-8224-f7825faf7b4c tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] Calling method '.version_select at 0x7fdb3f1489d0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:19.475397 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-06dab2fc-4231-46f8-8224-f7825faf7b4c tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.380729 Sep 08 12:52:19.492447 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1218/2550] 10.222.0.78 () {58 vars in 1134 bytes} [Thu Sep 8 12:52:19 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:19.501873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-021e1c3a-789b-42c6-b077-2d3b0221b6c5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:19.504415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-021e1c3a-789b-42c6-b077-2d3b0221b6c5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:19.517674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-021e1c3a-789b-42c6-b077-2d3b0221b6c5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:19.520681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-021e1c3a-789b-42c6-b077-2d3b0221b6c5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:19.522140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-021e1c3a-789b-42c6-b077-2d3b0221b6c5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:19.524362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-021e1c3a-789b-42c6-b077-2d3b0221b6c5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:19.525874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-021e1c3a-789b-42c6-b077-2d3b0221b6c5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:19.529615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-021e1c3a-789b-42c6-b077-2d3b0221b6c5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:19.732184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-021e1c3a-789b-42c6-b077-2d3b0221b6c5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:19.798617 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-021e1c3a-789b-42c6-b077-2d3b0221b6c5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 200 len: 1272 microversion: 2.1 time: 0.303696 Sep 08 12:52:19.804063 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1219/2551] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:19 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 1272 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:19.830443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5f594709-438d-4bc6-8520-4027ccc4036b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:19.830982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5f594709-438d-4bc6-8520-4027ccc4036b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:19.865088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f594709-438d-4bc6-8520-4027ccc4036b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:19.865879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f594709-438d-4bc6-8520-4027ccc4036b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:19.866533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f594709-438d-4bc6-8520-4027ccc4036b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:19.867633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f594709-438d-4bc6-8520-4027ccc4036b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:19.868354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f594709-438d-4bc6-8520-4027ccc4036b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:19.869163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f594709-438d-4bc6-8520-4027ccc4036b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:20.496882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5f594709-438d-4bc6-8520-4027ccc4036b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:20.557078 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5f594709-438d-4bc6-8520-4027ccc4036b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 0.750696 Sep 08 12:52:20.570674 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1220/2552] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:19 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:20.648897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d19e42c6-b8d4-4371-a816-643afcca01df tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f132ca0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:21.056966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:52:21.427185 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d19e42c6-b8d4-4371-a816-643afcca01df tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/2061d986-c7e4-4ccf-af8d-113345c901dd" status: 200 len: 223 microversion: 2.1 time: 0.825492 Sep 08 12:52:21.442560 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1221/2553] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 12:52:20 2022] GET /compute/v2.1/os-security-groups/2061d986-c7e4-4ccf-af8d-113345c901dd => generated 223 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:21.451656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-628f10ea-72a7-4121-9fa3-753021724a40 tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] Calling method '.version_select at 0x7fdb3f0bf280>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:21.748076 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-628f10ea-72a7-4121-9fa3-753021724a40 tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.302767 Sep 08 12:52:21.764923 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1222/2554] 10.222.0.78 () {58 vars in 1167 bytes} [Thu Sep 8 12:52:21 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:21.785005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-06685752-04f8-45a3-a2ba-e4dd350bb8d1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f116790>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:21.907799 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-06685752-04f8-45a3-a2ba-e4dd350bb8d1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.140346 Sep 08 12:52:21.909597 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1223/2555] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:52:21 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:21.919148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-749345a2-a140-4931-aed6-797e749dc212 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:21.920738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-749345a2-a140-4931-aed6-797e749dc212 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:21.933439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-749345a2-a140-4931-aed6-797e749dc212 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:21.934643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-749345a2-a140-4931-aed6-797e749dc212 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:21.935692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-749345a2-a140-4931-aed6-797e749dc212 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:21.937539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-749345a2-a140-4931-aed6-797e749dc212 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:21.938544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-749345a2-a140-4931-aed6-797e749dc212 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:21.939625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-749345a2-a140-4931-aed6-797e749dc212 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:22.168953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-749345a2-a140-4931-aed6-797e749dc212 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:22.204947 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-749345a2-a140-4931-aed6-797e749dc212 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 200 len: 1272 microversion: 2.1 time: 0.293114 Sep 08 12:52:22.207922 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1224/2556] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:21 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 1272 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:22.237824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-acec5fcf-8964-43fc-aee7-a89b1f6c5aaa tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f1405e0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:22.486600 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-71931040-8ea4-410f-ab61-cd0f3d8f4afa tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 8.846423 Sep 08 12:52:22.496111 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1333/2557] 10.222.0.78 () {60 vars in 1170 bytes} [Thu Sep 8 12:52:13 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 8857 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:22.511545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b4610000-55ab-4fb7-a158-4edce61fa015 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:22.517950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b4610000-55ab-4fb7-a158-4edce61fa015 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:22.537865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4610000-55ab-4fb7-a158-4edce61fa015 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:22.538696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4610000-55ab-4fb7-a158-4edce61fa015 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:22.542124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4610000-55ab-4fb7-a158-4edce61fa015 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:22.546124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4610000-55ab-4fb7-a158-4edce61fa015 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:22.546889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4610000-55ab-4fb7-a158-4edce61fa015 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:22.547844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4610000-55ab-4fb7-a158-4edce61fa015 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:23.047669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:52:23.206083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:52:23.898189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b4610000-55ab-4fb7-a158-4edce61fa015 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:23.937259 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b4610000-55ab-4fb7-a158-4edce61fa015 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 1.436208 Sep 08 12:52:23.941505 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1334/2558] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:22 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:23.955392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4fdd48be-23f1-485b-9797-2f66e8da8375 tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] Calling method '.version_select at 0x7fdb35e4f940>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:24.250050 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4fdd48be-23f1-485b-9797-2f66e8da8375 tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.304418 Sep 08 12:52:24.267279 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1335/2559] 10.222.0.78 () {58 vars in 1170 bytes} [Thu Sep 8 12:52:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:24.267279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b931683c-9a56-466f-9ebe-654b9c1dd496 tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] Action: 'create', calling method: .version_select at 0x7fdb35eb8af0>, body: {"pool": null} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:25.551706 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-acec5fcf-8964-43fc-aee7-a89b1f6c5aaa tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/2061d986-c7e4-4ccf-af8d-113345c901dd" status: 202 len: 0 microversion: 2.1 time: 3.341520 Sep 08 12:52:25.558580 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1225/2560] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:52:22 2022] DELETE /compute/v2.1/os-security-groups/2061d986-c7e4-4ccf-af8d-113345c901dd => generated 0 bytes in 3350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:52:25.567761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fd23e9f-75e8-4784-9f67-92cdf4653e78 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f116940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:25.667978 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1fd23e9f-75e8-4784-9f67-92cdf4653e78 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.107370 Sep 08 12:52:25.669767 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1226/2561] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:52:25 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:25.678983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fbf8f0c8-dc0b-4aec-b4cc-bcdde0428aa2 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:25.681030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fbf8f0c8-dc0b-4aec-b4cc-bcdde0428aa2 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:25.699340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf8f0c8-dc0b-4aec-b4cc-bcdde0428aa2 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:25.700624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf8f0c8-dc0b-4aec-b4cc-bcdde0428aa2 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:25.701887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf8f0c8-dc0b-4aec-b4cc-bcdde0428aa2 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:25.703519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf8f0c8-dc0b-4aec-b4cc-bcdde0428aa2 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:25.709357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf8f0c8-dc0b-4aec-b4cc-bcdde0428aa2 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:25.710555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf8f0c8-dc0b-4aec-b4cc-bcdde0428aa2 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:26.518774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fbf8f0c8-dc0b-4aec-b4cc-bcdde0428aa2 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:26.537213 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fbf8f0c8-dc0b-4aec-b4cc-bcdde0428aa2 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 200 len: 1314 microversion: 2.1 time: 0.865598 Sep 08 12:52:26.539430 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1227/2562] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:25 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 1314 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:26.552380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c9124954-95fa-4713-b40f-bdc66f6e608a tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] Calling method '.version_select at 0x7fdb3f116b80>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:27.328182 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c9124954-95fa-4713-b40f-bdc66f6e608a tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.785244 Sep 08 12:52:27.329107 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1228/2563] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:52:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:27.350314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7c89d4e1-0032-4b21-be7f-b0a46d325f72 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:27.351532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7c89d4e1-0032-4b21-be7f-b0a46d325f72 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:27.373933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c89d4e1-0032-4b21-be7f-b0a46d325f72 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:27.374946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c89d4e1-0032-4b21-be7f-b0a46d325f72 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:27.378626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c89d4e1-0032-4b21-be7f-b0a46d325f72 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:27.383159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c89d4e1-0032-4b21-be7f-b0a46d325f72 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:27.387544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c89d4e1-0032-4b21-be7f-b0a46d325f72 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:27.389625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c89d4e1-0032-4b21-be7f-b0a46d325f72 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:27.451962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:52:28.057639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7c89d4e1-0032-4b21-be7f-b0a46d325f72 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:28.083776 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7c89d4e1-0032-4b21-be7f-b0a46d325f72 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 0.751848 Sep 08 12:52:28.100847 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1229/2564] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:27 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:28.124920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01adbae7-b3d1-47b4-9be8-ac55f064ef09 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3ad26f70>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:28.241170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG neutronclient.v2_0.client [None req-01adbae7-b3d1-47b4-9be8-ac55f064ef09 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist", "detail": ""}} {{(pid=128971) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:52:28.242160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.security_group_api [None req-01adbae7-b3d1-47b4-9be8-ac55f064ef09 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Neutron security group 2061d986-c7e4-4ccf-af8d-113345c901dd not found {{(pid=128971) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:52:28.243444 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-01adbae7-b3d1-47b4-9be8-ac55f064ef09 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:52:28.243444 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-1dd8712d-396e-48ff-9c18-50cedc03ad73'] Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01adbae7-b3d1-47b4-9be8-ac55f064ef09 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-security-groups/2061d986-c7e4-4ccf-af8d-113345c901dd HTTP/1.1 Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: exception: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-1dd8712d-396e-48ff-9c18-50cedc03ad73'] Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '2061d986-c7e4-4ccf-af8d-113345c901dd'} Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:52:28.248519 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dd8712d-396e-48ff-9c18-50cedc03ad73'] Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dd8712d-396e-48ff-9c18-50cedc03ad73'] Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dd8712d-396e-48ff-9c18-50cedc03ad73'] Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1dd8712d-396e-48ff-9c18-50cedc03ad73'] Sep 08 12:52:28.257029 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:28.266629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01adbae7-b3d1-47b4-9be8-ac55f064ef09 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:52:28.266629 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-1dd8712d-396e-48ff-9c18-50cedc03ad73'] {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:28.267213 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-01adbae7-b3d1-47b4-9be8-ac55f064ef09 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/2061d986-c7e4-4ccf-af8d-113345c901dd" status: 404 len: 194 microversion: 2.1 time: 0.160331 Sep 08 12:52:28.268645 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1230/2565] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 12:52:28 2022] GET /compute/v2.1/os-security-groups/2061d986-c7e4-4ccf-af8d-113345c901dd => generated 194 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:52:28.278125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e33b4550-59f9-44fd-84cf-ae3f8f44a98a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f0c5ee0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:28.426053 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e33b4550-59f9-44fd-84cf-ae3f8f44a98a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1426 microversion: 2.1 time: 0.155301 Sep 08 12:52:28.439287 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1231/2566] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:52:28 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1426 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:28.451983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-300b6dbe-111e-4960-9b48-c6a3d6df927a tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] Calling method '.version_select at 0x7fdb3f1403a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:28.660617 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-300b6dbe-111e-4960-9b48-c6a3d6df927a tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.222044 Sep 08 12:52:28.675839 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1232/2567] 10.222.0.78 () {58 vars in 1188 bytes} [Thu Sep 8 12:52:28 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:28.690002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d9fa6d06-a600-4812-ade8-41c7a307b791 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:28.691154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d9fa6d06-a600-4812-ade8-41c7a307b791 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:28.701889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9fa6d06-a600-4812-ade8-41c7a307b791 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:28.703186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9fa6d06-a600-4812-ade8-41c7a307b791 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:28.704372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9fa6d06-a600-4812-ade8-41c7a307b791 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:28.706076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9fa6d06-a600-4812-ade8-41c7a307b791 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:28.707390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9fa6d06-a600-4812-ade8-41c7a307b791 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:28.708520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9fa6d06-a600-4812-ade8-41c7a307b791 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:29.132059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d9fa6d06-a600-4812-ade8-41c7a307b791 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:29.146462 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d9fa6d06-a600-4812-ade8-41c7a307b791 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 200 len: 1314 microversion: 2.1 time: 0.463842 Sep 08 12:52:29.147722 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1233/2568] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:28 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:29.155698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e63a73b-f633-4877-a4c2-cb37d7cac0bb tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'create', calling method: .version_select at 0x7fdb3f140670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-118199145", "description": "tempest-description-32104402"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:29.585620 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b931683c-9a56-466f-9ebe-654b9c1dd496 tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.331601 Sep 08 12:52:29.592007 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1336/2569] 10.222.0.78 () {60 vars in 1170 bytes} [Thu Sep 8 12:52:24 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:29.601995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-542acce2-0dcd-4ed5-b5c5-1ac29408e25f req-024d2960-d656-4a58-85f4-fc11f38ecb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9439ff7-64b9-44b2-be82-45cd0328104e", "tag": "7569b872-ae85-4d31-96b7-c87c9571abaf"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:29.620639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-542acce2-0dcd-4ed5-b5c5-1ac29408e25f req-024d2960-d656-4a58-85f4-fc11f38ecb31 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:29.621668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-542acce2-0dcd-4ed5-b5c5-1ac29408e25f req-024d2960-d656-4a58-85f4-fc11f38ecb31 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:29.623494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-542acce2-0dcd-4ed5-b5c5-1ac29408e25f req-024d2960-d656-4a58-85f4-fc11f38ecb31 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:29.645063 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-542acce2-0dcd-4ed5-b5c5-1ac29408e25f req-024d2960-d656-4a58-85f4-fc11f38ecb31 service nova] Creating event network-changed:7569b872-ae85-4d31-96b7-c87c9571abaf for instance d9439ff7-64b9-44b2-be82-45cd0328104e on n-h2-852084-10 Sep 08 12:52:29.654912 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-542acce2-0dcd-4ed5-b5c5-1ac29408e25f req-024d2960-d656-4a58-85f4-fc11f38ecb31 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059327 Sep 08 12:52:29.656598 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1337/2570] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:29.664985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0beb8abc-ad9d-4197-813e-f384eeb3d1a8 tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] Calling method '.version_select at 0x7fdb35e4f790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:29.789887 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0beb8abc-ad9d-4197-813e-f384eeb3d1a8 tempest-VolumesTestJSON-1441004174 tempest-VolumesTestJSON-1441004174-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.131056 Sep 08 12:52:29.790997 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1338/2571] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 12:52:29 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:29.797916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cfc449ca-0e6a-4e23-a752-431a9f9a9a5c tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:29.800846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cfc449ca-0e6a-4e23-a752-431a9f9a9a5c tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:29.812247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfc449ca-0e6a-4e23-a752-431a9f9a9a5c tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:29.813603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfc449ca-0e6a-4e23-a752-431a9f9a9a5c tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:29.814713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfc449ca-0e6a-4e23-a752-431a9f9a9a5c tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:29.816057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfc449ca-0e6a-4e23-a752-431a9f9a9a5c tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:29.816912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfc449ca-0e6a-4e23-a752-431a9f9a9a5c tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:29.817441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfc449ca-0e6a-4e23-a752-431a9f9a9a5c tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:29.867758 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8e63a73b-f633-4877-a4c2-cb37d7cac0bb tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 241 microversion: 2.1 time: 0.717951 Sep 08 12:52:29.868735 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1234/2572] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:52:29 2022] POST /compute/v2.1/os-security-groups => generated 241 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:29.874512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1a2da53c-3db8-4c6e-a355-4e408a95ec90 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f148670>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:30.020048 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1a2da53c-3db8-4c6e-a355-4e408a95ec90 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1435 microversion: 2.1 time: 0.149169 Sep 08 12:52:30.020763 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1235/2573] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:52:29 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1435 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:30.034713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-992b269a-1d11-4bc4-a86e-22ccdea53599 tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] Action: 'create', calling method: .version_select at 0x7fdb3f0bf790>, body: {"pool": null} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:30.382915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cfc449ca-0e6a-4e23-a752-431a9f9a9a5c tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:30.401954 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cfc449ca-0e6a-4e23-a752-431a9f9a9a5c tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 0.608437 Sep 08 12:52:30.416219 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1339/2574] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:29 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:30.425485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-6e7ab9bc-069c-4828-b9b9-f5cbdae7049d req-d79cc6a7-f8dd-46f1-993d-1526d9e41bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a028a63-83ed-4fbc-8ae9-fd5a7efe568c", "name": "network-vif-plugged", "status": "completed", "tag": "e1423704-0403-4700-a477-a2467e273263"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:30.439786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6e7ab9bc-069c-4828-b9b9-f5cbdae7049d req-d79cc6a7-f8dd-46f1-993d-1526d9e41bbb service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:30.440685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6e7ab9bc-069c-4828-b9b9-f5cbdae7049d req-d79cc6a7-f8dd-46f1-993d-1526d9e41bbb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:30.441369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6e7ab9bc-069c-4828-b9b9-f5cbdae7049d req-d79cc6a7-f8dd-46f1-993d-1526d9e41bbb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:30.469569 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-6e7ab9bc-069c-4828-b9b9-f5cbdae7049d req-d79cc6a7-f8dd-46f1-993d-1526d9e41bbb service nova] Creating event network-vif-plugged:e1423704-0403-4700-a477-a2467e273263 for instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c on n-h2-852084-10 Sep 08 12:52:30.481862 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-6e7ab9bc-069c-4828-b9b9-f5cbdae7049d req-d79cc6a7-f8dd-46f1-993d-1526d9e41bbb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063861 Sep 08 12:52:30.482720 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1340/2575] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:30.488148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8576ee3-ee16-4515-bca6-ff6b413460b1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'create', calling method: .version_select at 0x7fdb35e4f430>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-920589592", "description": "tempest-description-1597217441"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:31.367537 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8576ee3-ee16-4515-bca6-ff6b413460b1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.883064 Sep 08 12:52:31.368549 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1341/2576] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:52:30 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:31.373252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-12740632-9b31-4181-b64a-9a41eab48ca1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f1a50d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:32.001552 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-12740632-9b31-4181-b64a-9a41eab48ca1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 200 len: 1435 microversion: 2.1 time: 0.632548 Sep 08 12:52:32.002898 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1342/2577] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:52:31 2022] GET /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 1435 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:32.009205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-310c8f86-9496-4d65-a2e0-cb59f194d2f5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:32.010895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-310c8f86-9496-4d65-a2e0-cb59f194d2f5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:32.020090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-310c8f86-9496-4d65-a2e0-cb59f194d2f5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:32.020866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-310c8f86-9496-4d65-a2e0-cb59f194d2f5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:32.021608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-310c8f86-9496-4d65-a2e0-cb59f194d2f5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:32.022545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-310c8f86-9496-4d65-a2e0-cb59f194d2f5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:32.023186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-310c8f86-9496-4d65-a2e0-cb59f194d2f5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:32.024440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-310c8f86-9496-4d65-a2e0-cb59f194d2f5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:32.754311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-310c8f86-9496-4d65-a2e0-cb59f194d2f5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:32.767577 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-310c8f86-9496-4d65-a2e0-cb59f194d2f5 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 200 len: 1314 microversion: 2.1 time: 0.763032 Sep 08 12:52:32.769966 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1343/2578] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:32 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 1314 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:32.788320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7cc7e056-ce27-471f-82a8-0b6f44c4d5df tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'create', calling method: .version_select at 0x7fdb3f1881f0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1322389300", "description": "tempest-description-260247609"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:33.588713 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7cc7e056-ce27-471f-82a8-0b6f44c4d5df tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.815017 Sep 08 12:52:33.590046 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1344/2579] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:52:32 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:33.595479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-531b9f67-3eab-45b2-92ac-26c47f6644c0 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:33.597205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-531b9f67-3eab-45b2-92ac-26c47f6644c0 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:33.614812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-531b9f67-3eab-45b2-92ac-26c47f6644c0 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:33.625638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-531b9f67-3eab-45b2-92ac-26c47f6644c0 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:33.625977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-531b9f67-3eab-45b2-92ac-26c47f6644c0 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:33.630284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-531b9f67-3eab-45b2-92ac-26c47f6644c0 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:33.631149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-531b9f67-3eab-45b2-92ac-26c47f6644c0 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:33.636261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-531b9f67-3eab-45b2-92ac-26c47f6644c0 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:34.482380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-531b9f67-3eab-45b2-92ac-26c47f6644c0 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:34.523035 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-531b9f67-3eab-45b2-92ac-26c47f6644c0 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1354 microversion: 2.1 time: 0.929634 Sep 08 12:52:34.525038 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1345/2580] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:33 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1354 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:34.554618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cec37419-f551-48b0-8aeb-844afd46b7e0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:34.556178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cec37419-f551-48b0-8aeb-844afd46b7e0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:34.579167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cec37419-f551-48b0-8aeb-844afd46b7e0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:34.582263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cec37419-f551-48b0-8aeb-844afd46b7e0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:34.583676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cec37419-f551-48b0-8aeb-844afd46b7e0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:34.585065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cec37419-f551-48b0-8aeb-844afd46b7e0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:34.586250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cec37419-f551-48b0-8aeb-844afd46b7e0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:34.587186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cec37419-f551-48b0-8aeb-844afd46b7e0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:34.669005 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-992b269a-1d11-4bc4-a86e-22ccdea53599 tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.645138 Sep 08 12:52:34.671829 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1236/2581] 10.222.0.78 () {60 vars in 1170 bytes} [Thu Sep 8 12:52:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4649 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:34.693720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-1b295135-687e-4ce5-8f57-482fd111810b req-3c83d4e1-6a5e-45f7-9078-f11724b2ce01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a028a63-83ed-4fbc-8ae9-fd5a7efe568c", "name": "network-vif-plugged", "status": "completed", "tag": "9078770f-276a-4614-b856-97bd301c2e61"}, {"server_uuid": "2a028a63-83ed-4fbc-8ae9-fd5a7efe568c", "name": "network-vif-plugged", "status": "completed", "tag": "b1205a24-4dab-496d-ab9e-de43f7541dc8"}, {"server_uuid": "883b526c-7f9c-4fe9-b5ad-26aa46f05f78", "name": "network-vif-unplugged", "status": "completed", "tag": "4573b7c0-61ea-430d-b283-e6fc56ec3979"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:34.729473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:52:34.764044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1b295135-687e-4ce5-8f57-482fd111810b req-3c83d4e1-6a5e-45f7-9078-f11724b2ce01 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:34.765418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1b295135-687e-4ce5-8f57-482fd111810b req-3c83d4e1-6a5e-45f7-9078-f11724b2ce01 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:34.771419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1b295135-687e-4ce5-8f57-482fd111810b req-3c83d4e1-6a5e-45f7-9078-f11724b2ce01 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:34.842725 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-1b295135-687e-4ce5-8f57-482fd111810b req-3c83d4e1-6a5e-45f7-9078-f11724b2ce01 service nova] Creating event network-vif-plugged:9078770f-276a-4614-b856-97bd301c2e61 for instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c on n-h2-852084-10 Sep 08 12:52:34.843789 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-1b295135-687e-4ce5-8f57-482fd111810b req-3c83d4e1-6a5e-45f7-9078-f11724b2ce01 service nova] Creating event network-vif-plugged:b1205a24-4dab-496d-ab9e-de43f7541dc8 for instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c on n-h2-852084-10 Sep 08 12:52:34.844706 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-1b295135-687e-4ce5-8f57-482fd111810b req-3c83d4e1-6a5e-45f7-9078-f11724b2ce01 service nova] Creating event network-vif-unplugged:4573b7c0-61ea-430d-b283-e6fc56ec3979 for instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 on n-h2-852084-10 Sep 08 12:52:34.883099 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-1b295135-687e-4ce5-8f57-482fd111810b req-3c83d4e1-6a5e-45f7-9078-f11724b2ce01 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.208606 Sep 08 12:52:34.888783 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1237/2582] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:34 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:34.905507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d2b36a68-1093-4148-b510-5826a5e5a1bc tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f0cddc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:35.083565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cec37419-f551-48b0-8aeb-844afd46b7e0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:35.112667 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cec37419-f551-48b0-8aeb-844afd46b7e0 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1465 microversion: 2.1 time: 0.577873 Sep 08 12:52:35.116522 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1346/2583] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:34 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1465 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:35.144416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7fae29ff-46bb-44a7-a33a-40aca3c9dff0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:35.145329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7fae29ff-46bb-44a7-a33a-40aca3c9dff0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:35.154263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fae29ff-46bb-44a7-a33a-40aca3c9dff0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:35.155031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fae29ff-46bb-44a7-a33a-40aca3c9dff0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:35.155652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fae29ff-46bb-44a7-a33a-40aca3c9dff0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:35.156555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fae29ff-46bb-44a7-a33a-40aca3c9dff0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:35.157187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fae29ff-46bb-44a7-a33a-40aca3c9dff0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:35.158131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fae29ff-46bb-44a7-a33a-40aca3c9dff0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:35.729227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7fae29ff-46bb-44a7-a33a-40aca3c9dff0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:35.746194 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7fae29ff-46bb-44a7-a33a-40aca3c9dff0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 200 len: 1314 microversion: 2.1 time: 0.623845 Sep 08 12:52:35.747946 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1347/2584] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:35 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 1314 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:35.809427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-68c1a6b0-d114-4fbf-8576-eb1a1c05d7f2 tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] Action: 'create', calling method: .version_select at 0x7fdb35e229d0>, body: {"pool": null} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:36.283689 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d2b36a68-1093-4148-b510-5826a5e5a1bc tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 1830 microversion: 2.1 time: 1.392968 Sep 08 12:52:36.284969 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1238/2585] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:52:34 2022] GET /compute/v2.1/os-security-groups => generated 1830 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:36.296383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-11a5f1d8-ec99-4fed-800f-5a0c6feee48b tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f1404c0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:37.303397 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-11a5f1d8-ec99-4fed-800f-5a0c6feee48b tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "DELETE /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5" status: 204 len: 0 microversion: 2.1 time: 1.016259 Sep 08 12:52:37.305220 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1239/2586] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:36 2022] DELETE /compute/v2.1/images/96cd739a-0595-451f-977b-8d1b22aabab5 => generated 0 bytes in 1019 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:52:37.328260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0a80d5e1-828e-4730-a45d-0da135f41638 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:37.332007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0a80d5e1-828e-4730-a45d-0da135f41638 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:37.355843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a80d5e1-828e-4730-a45d-0da135f41638 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:37.357173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a80d5e1-828e-4730-a45d-0da135f41638 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:37.358259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a80d5e1-828e-4730-a45d-0da135f41638 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:37.361526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a80d5e1-828e-4730-a45d-0da135f41638 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:37.364049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a80d5e1-828e-4730-a45d-0da135f41638 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:37.365566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a80d5e1-828e-4730-a45d-0da135f41638 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:37.991899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0a80d5e1-828e-4730-a45d-0da135f41638 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:38.019078 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0a80d5e1-828e-4730-a45d-0da135f41638 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1805 microversion: 2.1 time: 0.704179 Sep 08 12:52:38.020259 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1240/2587] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:37 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1805 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:38.026298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36d31f00-1011-48a6-92bd-d776b8c5148d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f148c10>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:38.515448 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36d31f00-1011-48a6-92bd-d776b8c5148d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/f3508352-518c-440d-9eaa-b8d34af32007" status: 202 len: 0 microversion: 2.1 time: 0.493585 Sep 08 12:52:38.517623 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1241/2588] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:52:38 2022] DELETE /compute/v2.1/os-security-groups/f3508352-518c-440d-9eaa-b8d34af32007 => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:52:38.525655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0ee45bd8-cba1-47b0-aac3-75eb08d7b337 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:38.527384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0ee45bd8-cba1-47b0-aac3-75eb08d7b337 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:38.547908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ee45bd8-cba1-47b0-aac3-75eb08d7b337 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:38.551057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ee45bd8-cba1-47b0-aac3-75eb08d7b337 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:38.553101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ee45bd8-cba1-47b0-aac3-75eb08d7b337 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:38.570692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ee45bd8-cba1-47b0-aac3-75eb08d7b337 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:38.574264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ee45bd8-cba1-47b0-aac3-75eb08d7b337 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:38.577027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ee45bd8-cba1-47b0-aac3-75eb08d7b337 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:39.552853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0ee45bd8-cba1-47b0-aac3-75eb08d7b337 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:39.566016 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0ee45bd8-cba1-47b0-aac3-75eb08d7b337 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 200 len: 1314 microversion: 2.1 time: 1.046734 Sep 08 12:52:39.583682 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1242/2589] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:38 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 1314 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:39.589543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-cdc0d9ad-1dd4-41d6-be5d-ad313e7b8f8f req-91b8b53c-a5d7-4412-9ec6-8c04f551bc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9439ff7-64b9-44b2-be82-45cd0328104e", "name": "network-vif-plugged", "status": "completed", "tag": "7569b872-ae85-4d31-96b7-c87c9571abaf"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:39.601512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cdc0d9ad-1dd4-41d6-be5d-ad313e7b8f8f req-91b8b53c-a5d7-4412-9ec6-8c04f551bc6b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:39.602376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cdc0d9ad-1dd4-41d6-be5d-ad313e7b8f8f req-91b8b53c-a5d7-4412-9ec6-8c04f551bc6b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:39.603154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cdc0d9ad-1dd4-41d6-be5d-ad313e7b8f8f req-91b8b53c-a5d7-4412-9ec6-8c04f551bc6b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:39.621026 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-cdc0d9ad-1dd4-41d6-be5d-ad313e7b8f8f req-91b8b53c-a5d7-4412-9ec6-8c04f551bc6b service nova] Creating event network-vif-plugged:7569b872-ae85-4d31-96b7-c87c9571abaf for instance d9439ff7-64b9-44b2-be82-45cd0328104e on n-h2-852084-10 Sep 08 12:52:39.635152 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-cdc0d9ad-1dd4-41d6-be5d-ad313e7b8f8f req-91b8b53c-a5d7-4412-9ec6-8c04f551bc6b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049061 Sep 08 12:52:39.645112 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1243/2590] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:39.659165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1710222c-6574-477d-afb2-43a6a1b6dc20 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '.version_select at 0x7fdb3f132e50>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:39.734512 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1710222c-6574-477d-afb2-43a6a1b6dc20 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] HTTP exception thrown: Image not found. Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1710222c-6574-477d-afb2-43a6a1b6dc20 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Request method failure captured: Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee HTTP/1.1 Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeUB5m6fZD6IRgIkF_gIn7f7tZ2S6TfC-tDEgh56INerE1zcKTK7MAVb96OEv5Da-BXXElIT32NheA4aRgqG9b_HLKiorZY4FpnMG6xndXu_TE7gX0-l0O66NQDP3uz2PJLB2DShrrkxBllx6_8xMEx30U75viuswOEk9yLnE56rQEM Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: a856789ce4f64b95823378a2600f6878 Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ImagesOneServerTestJSON-447223846 Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a856789ce4f64b95823378a2600f6878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a856789ce4f64b95823378a2600f6878"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a856789ce4f64b95823378a2600f6878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a856789ce4f64b95823378a2600f6878"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ImagesOneServerTestJSON-447223846 Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: a856789ce4f64b95823378a2600f6878 Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-447223846 Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ImagesOneServerTestJSON-447223846-project Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 22b4be40ad8640e59bef7ed17f9bfda0 Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ImagesOneServerTestJSON-447223846-project Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: exception: Image not found. Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '8fbd9829-dc3c-4619-8d34-b662d4f9beee'} Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 8fbd9829-dc3c-4619-8d34-b662d4f9beee to delete Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8fbd9829-dc3c-4619-8d34-b662d4f9beee could not be found. Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:39.738949 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:52:39.747208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:39.756129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1710222c-6574-477d-afb2-43a6a1b6dc20 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Returning 404 to user: Image not found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:39.758463 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1710222c-6574-477d-afb2-43a6a1b6dc20 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "DELETE /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee" status: 404 len: 62 microversion: 2.1 time: 0.110707 Sep 08 12:52:39.763264 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1244/2591] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:39 2022] DELETE /compute/v2.1/images/8fbd9829-dc3c-4619-8d34-b662d4f9beee => generated 62 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:52:39.785129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fdae9755-4a4a-444a-b85f-bd3dbc7bd833 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:39.786764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fdae9755-4a4a-444a-b85f-bd3dbc7bd833 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:39.835751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdae9755-4a4a-444a-b85f-bd3dbc7bd833 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:39.836985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdae9755-4a4a-444a-b85f-bd3dbc7bd833 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:39.841655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdae9755-4a4a-444a-b85f-bd3dbc7bd833 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:39.844860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdae9755-4a4a-444a-b85f-bd3dbc7bd833 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:39.850996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdae9755-4a4a-444a-b85f-bd3dbc7bd833 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:39.853271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdae9755-4a4a-444a-b85f-bd3dbc7bd833 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:39.929040 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fdae9755-4a4a-444a-b85f-bd3dbc7bd833 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c/ips" status: 200 len: 219 microversion: 2.1 time: 0.163282 Sep 08 12:52:39.929805 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1245/2592] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 12:52:39 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c/ips => generated 219 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:39.950890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ce498cfd-cebc-4cd6-8059-74301ce2d6e4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f132820>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:39.983582 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-68c1a6b0-d114-4fbf-8576-eb1a1c05d7f2 tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.186935 Sep 08 12:52:39.985748 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1348/2593] 10.222.0.78 () {60 vars in 1170 bytes} [Thu Sep 8 12:52:35 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:40.007098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f77dc5bf-e61b-4a15-b7fa-45160ea08048 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:40.008412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f77dc5bf-e61b-4a15-b7fa-45160ea08048 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:40.031197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f77dc5bf-e61b-4a15-b7fa-45160ea08048 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:40.031989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f77dc5bf-e61b-4a15-b7fa-45160ea08048 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:40.032649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f77dc5bf-e61b-4a15-b7fa-45160ea08048 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:40.033591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f77dc5bf-e61b-4a15-b7fa-45160ea08048 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:40.034235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f77dc5bf-e61b-4a15-b7fa-45160ea08048 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:40.034837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f77dc5bf-e61b-4a15-b7fa-45160ea08048 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:40.044331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG neutronclient.v2_0.client [None req-ce498cfd-cebc-4cd6-8059-74301ce2d6e4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist", "detail": ""}} {{(pid=128971) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:52:40.044938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.security_group_api [None req-ce498cfd-cebc-4cd6-8059-74301ce2d6e4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Neutron security group f3508352-518c-440d-9eaa-b8d34af32007 not found {{(pid=128971) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:52:40.045476 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-ce498cfd-cebc-4cd6-8059-74301ce2d6e4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:52:40.045476 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-eb45bee2-f81e-4be5-afd1-fa0225069d08'] Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ce498cfd-cebc-4cd6-8059-74301ce2d6e4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/os-security-groups/f3508352-518c-440d-9eaa-b8d34af32007 HTTP/1.1 Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: exception: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-eb45bee2-f81e-4be5-afd1-fa0225069d08'] Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'f3508352-518c-440d-9eaa-b8d34af32007'} Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:52:40.047646 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb45bee2-f81e-4be5-afd1-fa0225069d08'] Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb45bee2-f81e-4be5-afd1-fa0225069d08'] Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb45bee2-f81e-4be5-afd1-fa0225069d08'] Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eb45bee2-f81e-4be5-afd1-fa0225069d08'] Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ce498cfd-cebc-4cd6-8059-74301ce2d6e4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-eb45bee2-f81e-4be5-afd1-fa0225069d08'] {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:40.051886 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ce498cfd-cebc-4cd6-8059-74301ce2d6e4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/f3508352-518c-440d-9eaa-b8d34af32007" status: 404 len: 194 microversion: 2.1 time: 0.116430 Sep 08 12:52:40.054846 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1246/2594] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 12:52:39 2022] GET /compute/v2.1/os-security-groups/f3508352-518c-440d-9eaa-b8d34af32007 => generated 194 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:52:40.061670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-532726ca-e6eb-4734-a6a0-74328e9063c7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:40.062370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-532726ca-e6eb-4734-a6a0-74328e9063c7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:40.074736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-532726ca-e6eb-4734-a6a0-74328e9063c7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:40.074988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-532726ca-e6eb-4734-a6a0-74328e9063c7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:40.075610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-532726ca-e6eb-4734-a6a0-74328e9063c7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:40.076931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-532726ca-e6eb-4734-a6a0-74328e9063c7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:40.077507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-532726ca-e6eb-4734-a6a0-74328e9063c7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:40.078181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-532726ca-e6eb-4734-a6a0-74328e9063c7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:40.131432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f77dc5bf-e61b-4a15-b7fa-45160ea08048 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:52:40.149397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-532726ca-e6eb-4734-a6a0-74328e9063c7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:52:40.332592 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f77dc5bf-e61b-4a15-b7fa-45160ea08048 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "DELETE /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 204 len: 0 microversion: 2.1 time: 0.344800 Sep 08 12:52:40.333762 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1349/2595] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:52:39 2022] DELETE /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:52:40.346949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4f3a7214-2497-484f-b263-90198fdf7ab1 tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] Calling method '.version_select at 0x7fdb3761eee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:40.372311 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-532726ca-e6eb-4734-a6a0-74328e9063c7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 204 len: 0 microversion: 2.1 time: 0.309071 Sep 08 12:52:40.372311 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1247/2596] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:52:40 2022] DELETE /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:52:40.385926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2e473b80-3ac7-464e-8990-b3e3a2fdb1e1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f124ca0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:40.818618 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4f3a7214-2497-484f-b263-90198fdf7ab1 tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/8d877433-874a-49c4-bfe3-fa2c469a20b1" status: 200 len: 142 microversion: 2.1 time: 0.479277 Sep 08 12:52:40.819270 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1350/2597] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:52:40 2022] GET /compute/v2.1/os-floating-ips/8d877433-874a-49c4-bfe3-fa2c469a20b1 => generated 142 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:40.829569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4ad728a-ca85-4c19-ac1f-5501afe463e1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:40.831949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e4ad728a-ca85-4c19-ac1f-5501afe463e1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:40.858148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4ad728a-ca85-4c19-ac1f-5501afe463e1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:40.858735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4ad728a-ca85-4c19-ac1f-5501afe463e1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:40.859198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4ad728a-ca85-4c19-ac1f-5501afe463e1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:40.859980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4ad728a-ca85-4c19-ac1f-5501afe463e1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:40.860453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4ad728a-ca85-4c19-ac1f-5501afe463e1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:40.862733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4ad728a-ca85-4c19-ac1f-5501afe463e1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:41.112163 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2e473b80-3ac7-464e-8990-b3e3a2fdb1e1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/a7a8f14e-cab2-4768-b185-7da7961fa6aa" status: 202 len: 0 microversion: 2.1 time: 0.743085 Sep 08 12:52:41.116986 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1248/2598] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:52:40 2022] DELETE /compute/v2.1/os-security-groups/a7a8f14e-cab2-4768-b185-7da7961fa6aa => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:52:41.122505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-907d5d61-87c0-4e94-b263-73b1b34d7c59 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:41.123608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-907d5d61-87c0-4e94-b263-73b1b34d7c59 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:41.142437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-907d5d61-87c0-4e94-b263-73b1b34d7c59 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:41.143365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-907d5d61-87c0-4e94-b263-73b1b34d7c59 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:41.145245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-907d5d61-87c0-4e94-b263-73b1b34d7c59 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:41.151492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-907d5d61-87c0-4e94-b263-73b1b34d7c59 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:41.152383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-907d5d61-87c0-4e94-b263-73b1b34d7c59 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:41.153076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-907d5d61-87c0-4e94-b263-73b1b34d7c59 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:41.303134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e4ad728a-ca85-4c19-ac1f-5501afe463e1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:41.311140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:52:41.353225 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e4ad728a-ca85-4c19-ac1f-5501afe463e1 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1471 microversion: 2.1 time: 0.530794 Sep 08 12:52:41.353225 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1351/2599] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:40 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1471 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:41.369774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bf5ac79b-f82d-43b0-9c6b-a4728f84b082 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:41.383079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bf5ac79b-f82d-43b0-9c6b-a4728f84b082 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:41.419284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf5ac79b-f82d-43b0-9c6b-a4728f84b082 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:41.420383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf5ac79b-f82d-43b0-9c6b-a4728f84b082 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:41.421309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf5ac79b-f82d-43b0-9c6b-a4728f84b082 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:41.422765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf5ac79b-f82d-43b0-9c6b-a4728f84b082 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:41.424173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf5ac79b-f82d-43b0-9c6b-a4728f84b082 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:41.425291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf5ac79b-f82d-43b0-9c6b-a4728f84b082 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:41.708871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-907d5d61-87c0-4e94-b263-73b1b34d7c59 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:41.726899 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-907d5d61-87c0-4e94-b263-73b1b34d7c59 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1811 microversion: 2.1 time: 0.606375 Sep 08 12:52:41.731004 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1249/2600] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:41 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1811 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:41.747859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d21924f2-0448-4ba1-bfcd-06cc6a4b2b0c tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] Calling method '.version_select at 0x7fdb3f114940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:41.982920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bf5ac79b-f82d-43b0-9c6b-a4728f84b082 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:42.018833 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bf5ac79b-f82d-43b0-9c6b-a4728f84b082 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 200 len: 1314 microversion: 2.1 time: 0.655611 Sep 08 12:52:42.022172 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1352/2601] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:41 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 1314 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:42.033210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-882682bc-62c1-44b1-91bf-1aea3629de6f tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f12a5e0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:42.148123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG neutronclient.v2_0.client [None req-882682bc-62c1-44b1-91bf-1aea3629de6f tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist", "detail": ""}} {{(pid=128970) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:52:42.149359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.security_group_api [None req-882682bc-62c1-44b1-91bf-1aea3629de6f tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Neutron security group a7a8f14e-cab2-4768-b185-7da7961fa6aa not found {{(pid=128970) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:52:42.150826 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-882682bc-62c1-44b1-91bf-1aea3629de6f tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:52:42.150826 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-5892f726-d148-42bb-88c0-9d1b956ab9ea'] Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-882682bc-62c1-44b1-91bf-1aea3629de6f tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-security-groups/a7a8f14e-cab2-4768-b185-7da7961fa6aa HTTP/1.1 Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: exception: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-5892f726-d148-42bb-88c0-9d1b956ab9ea'] Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'a7a8f14e-cab2-4768-b185-7da7961fa6aa'} Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:52:42.156108 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5892f726-d148-42bb-88c0-9d1b956ab9ea'] Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5892f726-d148-42bb-88c0-9d1b956ab9ea'] Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5892f726-d148-42bb-88c0-9d1b956ab9ea'] Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5892f726-d148-42bb-88c0-9d1b956ab9ea'] Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-882682bc-62c1-44b1-91bf-1aea3629de6f tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-5892f726-d148-42bb-88c0-9d1b956ab9ea'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:42.166759 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-882682bc-62c1-44b1-91bf-1aea3629de6f tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/a7a8f14e-cab2-4768-b185-7da7961fa6aa" status: 404 len: 194 microversion: 2.1 time: 0.136487 Sep 08 12:52:42.178000 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1353/2602] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 12:52:42 2022] GET /compute/v2.1/os-security-groups/a7a8f14e-cab2-4768-b185-7da7961fa6aa => generated 194 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:52:42.184571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e5c940a6-fac8-44a1-ab32-3a4a3009344d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f1a5160>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:43.421065 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e5c940a6-fac8-44a1-ab32-3a4a3009344d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/d1dfd1a3-aa4a-4f00-a6d0-0555a966b507" status: 202 len: 0 microversion: 2.1 time: 1.240918 Sep 08 12:52:43.422798 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1354/2603] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:52:42 2022] DELETE /compute/v2.1/os-security-groups/d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 => generated 0 bytes in 1244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:52:43.841204 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d21924f2-0448-4ba1-bfcd-06cc6a4b2b0c tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/8d877433-874a-49c4-bfe3-fa2c469a20b1" status: 202 len: 0 microversion: 2.1 time: 2.108485 Sep 08 12:52:43.841916 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1250/2604] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:52:41 2022] DELETE /compute/v2.1/os-floating-ips/8d877433-874a-49c4-bfe3-fa2c469a20b1 => generated 0 bytes in 2110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:52:43.850684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-55f45d6c-d001-4772-bf9d-eb813ddff64a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:43.852483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-55f45d6c-d001-4772-bf9d-eb813ddff64a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:43.873645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f45d6c-d001-4772-bf9d-eb813ddff64a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:43.875164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f45d6c-d001-4772-bf9d-eb813ddff64a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:43.878928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f45d6c-d001-4772-bf9d-eb813ddff64a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:43.880335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f45d6c-d001-4772-bf9d-eb813ddff64a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:43.882303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f45d6c-d001-4772-bf9d-eb813ddff64a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:43.883134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f45d6c-d001-4772-bf9d-eb813ddff64a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:44.044996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-508253709", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "ff4921ec-042e-4a90-9e1c-5a3b1d585d4b"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:44.261629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] validate_networks() for [('ff4921ec-042e-4a90-9e1c-5a3b1d585d4b', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:52:44.490255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-55f45d6c-d001-4772-bf9d-eb813ddff64a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22b4be40ad8640e59bef7ed17f9bfda0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a856789ce4f64b95823378a2600f6878', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:44.525697 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-55f45d6c-d001-4772-bf9d-eb813ddff64a tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 200 len: 1471 microversion: 2.1 time: 0.681416 Sep 08 12:52:44.527769 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1251/2605] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:43 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 1471 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:44.544779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-baf4fa0f-7972-4170-a722-a6095545d94b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:44.546045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-baf4fa0f-7972-4170-a722-a6095545d94b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:44.562420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf4fa0f-7972-4170-a722-a6095545d94b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:44.563741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf4fa0f-7972-4170-a722-a6095545d94b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:44.567715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf4fa0f-7972-4170-a722-a6095545d94b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:44.569725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf4fa0f-7972-4170-a722-a6095545d94b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:44.573218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf4fa0f-7972-4170-a722-a6095545d94b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:44.574517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf4fa0f-7972-4170-a722-a6095545d94b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:45.314052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-baf4fa0f-7972-4170-a722-a6095545d94b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:45.337137 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-baf4fa0f-7972-4170-a722-a6095545d94b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1811 microversion: 2.1 time: 0.805392 Sep 08 12:52:45.339747 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1252/2606] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:44 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1811 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:45.352524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9f5dc81d-a5a8-44fe-915c-1c3f0dddd7e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:45.354963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9f5dc81d-a5a8-44fe-915c-1c3f0dddd7e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:45.369954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f5dc81d-a5a8-44fe-915c-1c3f0dddd7e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:45.371298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f5dc81d-a5a8-44fe-915c-1c3f0dddd7e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:45.372677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f5dc81d-a5a8-44fe-915c-1c3f0dddd7e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:45.374558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f5dc81d-a5a8-44fe-915c-1c3f0dddd7e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:45.375904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f5dc81d-a5a8-44fe-915c-1c3f0dddd7e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:45.377053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f5dc81d-a5a8-44fe-915c-1c3f0dddd7e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:45.968029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:52:45.968876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:52:45.970136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:52:45.970821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:52:45.971481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:52:45.983312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:45.984707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:45.985378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:45.987028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:45.987776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:45.988753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:46.009270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Getting quotas for project d49e8717cae0454e87b2e01790fc296c. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:52:46.013744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9f5dc81d-a5a8-44fe-915c-1c3f0dddd7e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:46.026830 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9f5dc81d-a5a8-44fe-915c-1c3f0dddd7e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.683963 Sep 08 12:52:46.027768 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1253/2607] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:45 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:46.029614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Getting quotas for user 3beb0e265d694cd3bf2f92e31ab95dfd and project d49e8717cae0454e87b2e01790fc296c. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:52:46.050142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5e951de9-ce55-46ac-859f-ba7bd9159629 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:46.053233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5e951de9-ce55-46ac-859f-ba7bd9159629 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:46.060833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Going to run 3 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:52:46.064331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e951de9-ce55-46ac-859f-ba7bd9159629 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:46.066590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 79750c09-f943-404e-ad11-211dbd9010e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:52:46.068328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e951de9-ce55-46ac-859f-ba7bd9159629 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:46.069127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e951de9-ce55-46ac-859f-ba7bd9159629 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:46.072335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e951de9-ce55-46ac-859f-ba7bd9159629 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:46.073054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e951de9-ce55-46ac-859f-ba7bd9159629 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:46.080293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e951de9-ce55-46ac-859f-ba7bd9159629 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:46.116246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=79750c09-f943-404e-ad11-211dbd9010e8,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:52:46.180599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: fbd99aba-87fc-409c-933d-9cd6b5b7240a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=73e10911-8428-4be8-b770-205b2d073655,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:52:46.367942 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a36ea9a6-fe90-4130-a5dc-5f934b6617de tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.943536 Sep 08 12:52:46.372395 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1355/2608] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:52:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:52:46.379431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fa703edc-b9e7-45e1-a318-9e3b4c839b22 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f1885e0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:46.706099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG neutronclient.v2_0.client [None req-fa703edc-b9e7-45e1-a318-9e3b4c839b22 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist", "detail": ""}} {{(pid=128970) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:52:46.707133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.security_group_api [None req-fa703edc-b9e7-45e1-a318-9e3b4c839b22 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Neutron security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 not found {{(pid=128970) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:52:46.708458 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-fa703edc-b9e7-45e1-a318-9e3b4c839b22 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:52:46.708458 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-5f9e0b67-9312-4c4d-aa34-f60ff9c0c4e7'] Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fa703edc-b9e7-45e1-a318-9e3b4c839b22 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-security-groups/d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 HTTP/1.1 Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: exception: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-5f9e0b67-9312-4c4d-aa34-f60ff9c0c4e7'] Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'd1dfd1a3-aa4a-4f00-a6d0-0555a966b507'} Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:52:46.711008 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f9e0b67-9312-4c4d-aa34-f60ff9c0c4e7'] Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f9e0b67-9312-4c4d-aa34-f60ff9c0c4e7'] Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f9e0b67-9312-4c4d-aa34-f60ff9c0c4e7'] Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5f9e0b67-9312-4c4d-aa34-f60ff9c0c4e7'] Sep 08 12:52:46.716074 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:46.720931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fa703edc-b9e7-45e1-a318-9e3b4c839b22 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:52:46.720931 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-5f9e0b67-9312-4c4d-aa34-f60ff9c0c4e7'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:46.722123 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fa703edc-b9e7-45e1-a318-9e3b4c839b22 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/d1dfd1a3-aa4a-4f00-a6d0-0555a966b507" status: 404 len: 194 microversion: 2.1 time: 0.348300 Sep 08 12:52:46.722876 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1356/2609] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 12:52:46 2022] GET /compute/v2.1/os-security-groups/d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 => generated 194 bytes in 350 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:52:46.748417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d76d1a36-8402-4af7-b8fc-ea3e406cd4e8 tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] Calling method '.version_select at 0x7fdb3f165550>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:47.817675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5e951de9-ce55-46ac-859f-ba7bd9159629 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:47.837864 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5e951de9-ce55-46ac-859f-ba7bd9159629 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 200 len: 1464 microversion: 2.1 time: 1.805865 Sep 08 12:52:47.840763 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1254/2610] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:46 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 1464 bytes in 1810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:48.049576 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d76d1a36-8402-4af7-b8fc-ea3e406cd4e8 tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 1.325351 Sep 08 12:52:48.051215 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1357/2611] 10.222.0.78 () {58 vars in 1164 bytes} [Thu Sep 8 12:52:46 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:52:48.061010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-23f993e2-562f-4f95-b92d-98e05ab12433 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:48.066189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-23f993e2-562f-4f95-b92d-98e05ab12433 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] [instance: 883b526c-7f9c-4fe9-b5ad-26aa46f05f78] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:48.082536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23f993e2-562f-4f95-b92d-98e05ab12433 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:48.083571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23f993e2-562f-4f95-b92d-98e05ab12433 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:48.084392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23f993e2-562f-4f95-b92d-98e05ab12433 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:48.085609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23f993e2-562f-4f95-b92d-98e05ab12433 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:48.085964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23f993e2-562f-4f95-b92d-98e05ab12433 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:48.088772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23f993e2-562f-4f95-b92d-98e05ab12433 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:48.109932 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-23f993e2-562f-4f95-b92d-98e05ab12433 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] HTTP exception thrown: Instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 could not be found. Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-23f993e2-562f-4f95-b92d-98e05ab12433 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Request method failure captured: Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 HTTP/1.1 Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeUB5m6fZD6IRgIkF_gIn7f7tZ2S6TfC-tDEgh56INerE1zcKTK7MAVb96OEv5Da-BXXElIT32NheA4aRgqG9b_HLKiorZY4FpnMG6xndXu_TE7gX0-l0O66NQDP3uz2PJLB2DShrrkxBllx6_8xMEx30U75viuswOEk9yLnE56rQEM Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a856789ce4f64b95823378a2600f6878 Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ImagesOneServerTestJSON-447223846 Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a856789ce4f64b95823378a2600f6878"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a856789ce4f64b95823378a2600f6878"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a856789ce4f64b95823378a2600f6878"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a856789ce4f64b95823378a2600f6878"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ImagesOneServerTestJSON-447223846 Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a856789ce4f64b95823378a2600f6878 Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-447223846 Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ImagesOneServerTestJSON-447223846-project Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 22b4be40ad8640e59bef7ed17f9bfda0 Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ImagesOneServerTestJSON-447223846-project Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 could not be found. Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '883b526c-7f9c-4fe9-b5ad-26aa46f05f78'} Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 could not be found. Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 could not be found. Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:48.111579 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:48.120956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:48.120956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:48.120956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:48.120956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:48.120956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:48.120956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 could not be found. Sep 08 12:52:48.120956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:48.120956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-23f993e2-562f-4f95-b92d-98e05ab12433 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] Returning 404 to user: Instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:48.120956 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-23f993e2-562f-4f95-b92d-98e05ab12433 tempest-ImagesOneServerTestJSON-447223846 tempest-ImagesOneServerTestJSON-447223846-project] 10.222.0.78 "GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78" status: 404 len: 111 microversion: 2.1 time: 0.060384 Sep 08 12:52:48.120956 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1358/2612] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:48 2022] GET /compute/v2.1/servers/883b526c-7f9c-4fe9-b5ad-26aa46f05f78 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:52:48.125189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6092a82f-eb56-4f92-b34f-a2c7fcc36116 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:48.125189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6092a82f-eb56-4f92-b34f-a2c7fcc36116 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:48.131085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6092a82f-eb56-4f92-b34f-a2c7fcc36116 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:48.131626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6092a82f-eb56-4f92-b34f-a2c7fcc36116 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:48.132561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6092a82f-eb56-4f92-b34f-a2c7fcc36116 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:48.133998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6092a82f-eb56-4f92-b34f-a2c7fcc36116 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:48.134529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6092a82f-eb56-4f92-b34f-a2c7fcc36116 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:48.135169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6092a82f-eb56-4f92-b34f-a2c7fcc36116 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:48.263550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0cd6ef45-ef95-4c99-9fc6-09164a62c2c9 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Action: 'create', calling method: .version_select at 0x7fdb3f1169d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1985946446", "metadata": {"Type": "work"}}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0cd6ef45-ef95-4c99-9fc6-09164a62c2c9 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Request method failure captured: Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 122 Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeWdejJSh7-MJ2zHEA9jUYMwE_QhAqTI5aKGa9hoNgtp27DEFiOpkuUqYEZcZnmFqFZfRQoOHTObr9M3csM7AkhfZfjFbaq2dW16dpzZkZ0ENtK0hZkNDMdg_FNkxpXOI3U5jSEyXlK5rCurEtHA7-ytoKCQVG6DOdxDJaAF25E2TYo Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b5ca2ee5541a48ba98c3c8e1f8361499 Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-VolumesNegativeTest-917975933 Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-VolumesNegativeTest-917975933 Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b5ca2ee5541a48ba98c3c8e1f8361499 Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-VolumesNegativeTest-917975933 Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-VolumesNegativeTest-917975933-project Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 0b0b89666e8545c1828718a18edfad09 Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-VolumesNegativeTest-917975933-project Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1985946446", "metadata": {"Type": "work"}}} Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1985946446', 'metadata': {'Type': 'work'}}}} Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi '#$%' Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:52:48.272962 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:52:48.279287 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 12:52:48.279287 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:48.279287 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:48.279287 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:48.279287 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:48.279287 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:48.279287 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:48.279287 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:52:48.279287 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:52:48.279287 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 08 12:52:48.279287 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:48.280545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0cd6ef45-ef95-4c99-9fc6-09164a62c2c9 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:48.286526 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0cd6ef45-ef95-4c99-9fc6-09164a62c2c9 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.443397 Sep 08 12:52:48.292088 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1255/2613] 10.222.0.78 () {60 vars in 1156 bytes} [Thu Sep 8 12:52:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 450 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:52:48.318436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2667d81d-4132-4927-aa86-3e44de6e7b96 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:48.325935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2667d81d-4132-4927-aa86-3e44de6e7b96 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:48.367094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2667d81d-4132-4927-aa86-3e44de6e7b96 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:48.368793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2667d81d-4132-4927-aa86-3e44de6e7b96 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:48.371671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2667d81d-4132-4927-aa86-3e44de6e7b96 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:48.378627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2667d81d-4132-4927-aa86-3e44de6e7b96 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:48.379668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2667d81d-4132-4927-aa86-3e44de6e7b96 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:48.380761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2667d81d-4132-4927-aa86-3e44de6e7b96 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:48.829303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6092a82f-eb56-4f92-b34f-a2c7fcc36116 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:48.848209 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6092a82f-eb56-4f92-b34f-a2c7fcc36116 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.729433 Sep 08 12:52:48.849492 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1359/2614] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:48 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:48.862093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-09e73ba7-b20c-4c69-b670-2a6887c9ae06 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:48.874566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-09e73ba7-b20c-4c69-b670-2a6887c9ae06 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:48.876985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-09e73ba7-b20c-4c69-b670-2a6887c9ae06 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Searching by: {'deleted': False, 'project_id': 'd49e8717cae0454e87b2e01790fc296c'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:52:48.885479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09e73ba7-b20c-4c69-b670-2a6887c9ae06 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:48.899897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09e73ba7-b20c-4c69-b670-2a6887c9ae06 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:48.903835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09e73ba7-b20c-4c69-b670-2a6887c9ae06 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:48.905657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09e73ba7-b20c-4c69-b670-2a6887c9ae06 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:48.909642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09e73ba7-b20c-4c69-b670-2a6887c9ae06 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:48.910237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09e73ba7-b20c-4c69-b670-2a6887c9ae06 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:48.955417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-09e73ba7-b20c-4c69-b670-2a6887c9ae06 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:52:48.996624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2667d81d-4132-4927-aa86-3e44de6e7b96 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:49.028887 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-09e73ba7-b20c-4c69-b670-2a6887c9ae06 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1015 microversion: 2.1 time: 0.173048 Sep 08 12:52:49.030747 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1360/2615] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 12:52:48 2022] GET /compute/v2.1/servers => generated 1015 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:49.031479 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2667d81d-4132-4927-aa86-3e44de6e7b96 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1790 microversion: 2.1 time: 0.735301 Sep 08 12:52:49.034735 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1256/2616] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:48 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1790 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:49.055216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c98fee48-35e4-43bd-bd69-65ac55dfcec8 req-c041ae29-63d5-4063-8148-cba754b2d587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "883b526c-7f9c-4fe9-b5ad-26aa46f05f78", "name": "network-vif-deleted", "tag": "4573b7c0-61ea-430d-b283-e6fc56ec3979"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:49.063399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fdfa5daa-58e4-4548-b331-2920f3278555 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f29e550>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:49.104607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c98fee48-35e4-43bd-bd69-65ac55dfcec8 req-c041ae29-63d5-4063-8148-cba754b2d587 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:49.105503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c98fee48-35e4-43bd-bd69-65ac55dfcec8 req-c041ae29-63d5-4063-8148-cba754b2d587 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:49.106082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c98fee48-35e4-43bd-bd69-65ac55dfcec8 req-c041ae29-63d5-4063-8148-cba754b2d587 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:49.130351 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c98fee48-35e4-43bd-bd69-65ac55dfcec8 req-c041ae29-63d5-4063-8148-cba754b2d587 service nova] Creating event network-vif-deleted:4573b7c0-61ea-430d-b283-e6fc56ec3979 for instance 883b526c-7f9c-4fe9-b5ad-26aa46f05f78 on n-h2-852084-10 Sep 08 12:52:49.146393 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c98fee48-35e4-43bd-bd69-65ac55dfcec8 req-c041ae29-63d5-4063-8148-cba754b2d587 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107207 Sep 08 12:52:49.147081 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1257/2617] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:49.162224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-77f352f0-e846-403e-a349-292d239a8365 req-6d6d7d74-9afd-4fde-a8fd-57f2a8dc7999 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a028a63-83ed-4fbc-8ae9-fd5a7efe568c", "name": "network-vif-unplugged", "status": "completed", "tag": "b1205a24-4dab-496d-ab9e-de43f7541dc8"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:49.179480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-77f352f0-e846-403e-a349-292d239a8365 req-6d6d7d74-9afd-4fde-a8fd-57f2a8dc7999 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:49.180511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-77f352f0-e846-403e-a349-292d239a8365 req-6d6d7d74-9afd-4fde-a8fd-57f2a8dc7999 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:49.181055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-77f352f0-e846-403e-a349-292d239a8365 req-6d6d7d74-9afd-4fde-a8fd-57f2a8dc7999 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:49.203446 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-77f352f0-e846-403e-a349-292d239a8365 req-6d6d7d74-9afd-4fde-a8fd-57f2a8dc7999 service nova] Creating event network-vif-unplugged:b1205a24-4dab-496d-ab9e-de43f7541dc8 for instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c on n-h2-852084-10 Sep 08 12:52:49.212062 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-77f352f0-e846-403e-a349-292d239a8365 req-6d6d7d74-9afd-4fde-a8fd-57f2a8dc7999 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061210 Sep 08 12:52:49.214435 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1258/2618] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:49.590992 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fdfa5daa-58e4-4548-b331-2920f3278555 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.541775 Sep 08 12:52:49.604898 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1361/2619] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 12:52:49 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:49.611942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bcb25ff2-ebe9-48f5-9d16-9e09df8d27fe tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] Calling method '.version_select at 0x7fdb3f188ee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:49.647807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9d5a9d7a-b466-4191-8da4-932d618a6d07 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:49.669442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9d5a9d7a-b466-4191-8da4-932d618a6d07 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Searching by: {'deleted': False, 'project_id': 'b6f8a86b272549d2a31a2727b8a3be75'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:52:49.714471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d5a9d7a-b466-4191-8da4-932d618a6d07 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:49.716807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d5a9d7a-b466-4191-8da4-932d618a6d07 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:49.718081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d5a9d7a-b466-4191-8da4-932d618a6d07 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:49.721381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d5a9d7a-b466-4191-8da4-932d618a6d07 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:49.723896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d5a9d7a-b466-4191-8da4-932d618a6d07 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:49.727165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d5a9d7a-b466-4191-8da4-932d618a6d07 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:49.802035 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9d5a9d7a-b466-4191-8da4-932d618a6d07 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.585730 Sep 08 12:52:49.804209 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1259/2620] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:52:49 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:52:49.811882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a074f525-d2d2-4cc1-aeff-dd700b511782 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Action: 'create', calling method: .version_select at 0x7fdb3f1168b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2078504210", "metadata": {"Type": "work"}}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a074f525-d2d2-4cc1-aeff-dd700b511782 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Request method failure captured: Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 120 Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeWdejJSh7-MJ2zHEA9jUYMwE_QhAqTI5aKGa9hoNgtp27DEFiOpkuUqYEZcZnmFqFZfRQoOHTObr9M3csM7AkhfZfjFbaq2dW16dpzZkZ0ENtK0hZkNDMdg_FNkxpXOI3U5jSEyXlK5rCurEtHA7-ytoKCQVG6DOdxDJaAF25E2TYo Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b5ca2ee5541a48ba98c3c8e1f8361499 Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-VolumesNegativeTest-917975933 Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-VolumesNegativeTest-917975933 Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b5ca2ee5541a48ba98c3c8e1f8361499 Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-VolumesNegativeTest-917975933 Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-VolumesNegativeTest-917975933-project Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 0b0b89666e8545c1828718a18edfad09 Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-VolumesNegativeTest-917975933-project Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2078504210", "metadata": {"Type": "work"}}} Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2078504210', 'metadata': {'Type': 'work'}}}} Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi '0' Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:52:49.820249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a074f525-d2d2-4cc1-aeff-dd700b511782 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:49.828565 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a074f525-d2d2-4cc1-aeff-dd700b511782 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.017979 Sep 08 12:52:49.834380 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1260/2621] 10.222.0.78 () {60 vars in 1156 bytes} [Thu Sep 8 12:52:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:52:49.842701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cb5bcf4d-28e9-4a27-a99f-d28756986faa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:49.843739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cb5bcf4d-28e9-4a27-a99f-d28756986faa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:49.854947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5bcf4d-28e9-4a27-a99f-d28756986faa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:49.855663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5bcf4d-28e9-4a27-a99f-d28756986faa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:49.856201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5bcf4d-28e9-4a27-a99f-d28756986faa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:49.857346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5bcf4d-28e9-4a27-a99f-d28756986faa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:49.857971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5bcf4d-28e9-4a27-a99f-d28756986faa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:49.858608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5bcf4d-28e9-4a27-a99f-d28756986faa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:50.288633 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bcb25ff2-ebe9-48f5-9d16-9e09df8d27fe tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.682265 Sep 08 12:52:50.292263 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1362/2622] 10.222.0.78 () {58 vars in 1149 bytes} [Thu Sep 8 12:52:49 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:50.307884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-51db7460-a19a-44d8-9ddc-970c7963cf65 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:50.308944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-51db7460-a19a-44d8-9ddc-970c7963cf65 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:50.315060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cb5bcf4d-28e9-4a27-a99f-d28756986faa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:50.326140 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cb5bcf4d-28e9-4a27-a99f-d28756986faa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.489161 Sep 08 12:52:50.326769 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1261/2623] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:49 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:50.346432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5bc71056-e3cd-415c-afa6-7ddc7fe65515 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'create', calling method: .version_select at 0x7fdb3f1168b0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1023438489", "description": "tempest-description-2049908678"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:50.352437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51db7460-a19a-44d8-9ddc-970c7963cf65 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:50.353823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51db7460-a19a-44d8-9ddc-970c7963cf65 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:50.354647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51db7460-a19a-44d8-9ddc-970c7963cf65 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:50.355602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51db7460-a19a-44d8-9ddc-970c7963cf65 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:50.361404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51db7460-a19a-44d8-9ddc-970c7963cf65 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:50.362145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51db7460-a19a-44d8-9ddc-970c7963cf65 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:50.472828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-51db7460-a19a-44d8-9ddc-970c7963cf65 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:50.488294 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-51db7460-a19a-44d8-9ddc-970c7963cf65 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655" status: 200 len: 1274 microversion: 2.1 time: 0.194455 Sep 08 12:52:50.503803 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1363/2624] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:50 2022] GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:50.511619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:50.519103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Searching by: {'deleted': False} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:52:50.526963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:50.527864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:50.528717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:50.529641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:50.530377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:50.531073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:50.725938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Listed batch of 9 results from cell out of 1000 limit. Returned 9 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:52:51.086337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:52:51.111346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:51.120289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:51.132312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:51.154194 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5bc71056-e3cd-415c-afa6-7ddc7fe65515 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.823440 Sep 08 12:52:51.156950 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1262/2625] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:52:50 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:51.166691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7ea3aea4-3b56-40b9-9cbc-3eb4a0707622 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Action: 'create', calling method: .version_select at 0x7fdb3f0d1b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1130227318", "metadata": {"Type": "work"}}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7ea3aea4-3b56-40b9-9cbc-3eb4a0707622 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Request method failure captured: Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 119 Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeWdejJSh7-MJ2zHEA9jUYMwE_QhAqTI5aKGa9hoNgtp27DEFiOpkuUqYEZcZnmFqFZfRQoOHTObr9M3csM7AkhfZfjFbaq2dW16dpzZkZ0ENtK0hZkNDMdg_FNkxpXOI3U5jSEyXlK5rCurEtHA7-ytoKCQVG6DOdxDJaAF25E2TYo Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b5ca2ee5541a48ba98c3c8e1f8361499 Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-VolumesNegativeTest-917975933 Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-VolumesNegativeTest-917975933 Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b5ca2ee5541a48ba98c3c8e1f8361499 Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-VolumesNegativeTest-917975933 Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-VolumesNegativeTest-917975933-project Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 0b0b89666e8545c1828718a18edfad09 Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-VolumesNegativeTest-917975933-project Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1130227318", "metadata": {"Type": "work"}}} Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1130227318', 'metadata': {'Type': 'work'}}}} Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi '' Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:52:51.178016 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:52:51.186561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 12:52:51.186561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:51.186561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:51.186561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:51.186561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:51.186561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:51.186561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:51.186561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:52:51.186561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:52:51.186561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 08 12:52:51.186561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:52:51.186561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7ea3aea4-3b56-40b9-9cbc-3eb4a0707622 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:51.190521 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7ea3aea4-3b56-40b9-9cbc-3eb4a0707622 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.031721 Sep 08 12:52:51.192584 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1263/2626] 10.222.0.78 () {60 vars in 1156 bytes} [Thu Sep 8 12:52:51 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:52:51.208990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:51.213652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:51.229029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:51.232665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:51.234810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:51.239592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:51.241291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:51.242902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:51.319558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:51.320125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:51.320729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:51.321538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lazy-loading 'fault' on Instance uuid 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:52:51.328723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:52:51.418442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:51.446943 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a84f3472-6d87-423f-b7e6-b0fd6cf11fcf tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 200 len: 1302 microversion: 2.1 time: 0.240593 Sep 08 12:52:51.447658 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1264/2627] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:51 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 1302 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:51.458083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a43b57c6-3b09-408e-bdd8-4abd00181a8b tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] Calling method '.version_select at 0x7fdb3f132700>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:52.898871 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-13b08165-d86a-4937-b486-a3217b384efc tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 14476 microversion: 2.1 time: 2.393548 Sep 08 12:52:52.900225 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1364/2628] 10.222.0.78 () {58 vars in 1171 bytes} [Thu Sep 8 12:52:50 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 14476 bytes in 2396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:52:52.937429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac9a4217-f7f5-4251-b60a-abd771131eb9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1055964138"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:52.948141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ac9a4217-f7f5-4251-b60a-abd771131eb9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:52.965733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac9a4217-f7f5-4251-b60a-abd771131eb9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:52.966756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac9a4217-f7f5-4251-b60a-abd771131eb9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:52.967877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac9a4217-f7f5-4251-b60a-abd771131eb9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:52.969478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac9a4217-f7f5-4251-b60a-abd771131eb9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:52.970441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac9a4217-f7f5-4251-b60a-abd771131eb9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:52.971052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac9a4217-f7f5-4251-b60a-abd771131eb9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:53.446937 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ac9a4217-f7f5-4251-b60a-abd771131eb9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.538604 Sep 08 12:52:53.460103 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1365/2629] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:52:52 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 08 12:52:53.476745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-18e938bd-97a2-4713-8c66-fcbaab0f5273 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'create', calling method: .version_select at 0x7fdb3f16cd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2077531967", "description": "tempest-description-1091999628"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:54.767209 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-18e938bd-97a2-4713-8c66-fcbaab0f5273 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.304584 Sep 08 12:52:54.769459 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1366/2630] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:52:53 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:54.789901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9110c70b-ef63-43e8-ac5f-b07c51c50ce5 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Calling method '.version_select at 0x7fdb3f1e1af0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:54.913847 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-9110c70b-ef63-43e8-ac5f-b07c51c50ce5 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] HTTP exception thrown: Volume tempest-invalid-1371193586 could not be found. Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9110c70b-ef63-43e8-ac5f-b07c51c50ce5 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Request method failure captured: Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1371193586 HTTP/1.1 Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeWdejJSh7-MJ2zHEA9jUYMwE_QhAqTI5aKGa9hoNgtp27DEFiOpkuUqYEZcZnmFqFZfRQoOHTObr9M3csM7AkhfZfjFbaq2dW16dpzZkZ0ENtK0hZkNDMdg_FNkxpXOI3U5jSEyXlK5rCurEtHA7-ytoKCQVG6DOdxDJaAF25E2TYo Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b5ca2ee5541a48ba98c3c8e1f8361499 Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesNegativeTest-917975933 Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesNegativeTest-917975933 Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b5ca2ee5541a48ba98c3c8e1f8361499 Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesNegativeTest-917975933 Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesNegativeTest-917975933-project Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 0b0b89666e8545c1828718a18edfad09 Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesNegativeTest-917975933-project Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: exception: Volume tempest-invalid-1371193586 could not be found. Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'tempest-invalid-1371193586'} Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1371193586 could not be found. (HTTP 404) (Request-ID: req-c1b15927-3226-452d-9d82-4db8682db364) Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 12:52:54.920552 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1371193586 could not be found. Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1371193586 could not be found. Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1371193586 could not be found. Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:54.932012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9110c70b-ef63-43e8-ac5f-b07c51c50ce5 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Returning 404 to user: Volume tempest-invalid-1371193586 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:54.941165 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9110c70b-ef63-43e8-ac5f-b07c51c50ce5 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1371193586" status: 404 len: 99 microversion: 2.1 time: 0.151547 Sep 08 12:52:54.942605 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1367/2631] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 12:52:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1371193586 => generated 99 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:52:54.958652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-221cde6c-71e4-40a8-b18e-488c9d929634 req-df475692-1f16-48e4-81b5-648bae712ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a028a63-83ed-4fbc-8ae9-fd5a7efe568c", "name": "network-vif-deleted", "tag": "9078770f-276a-4614-b856-97bd301c2e61"}, {"server_uuid": "2a028a63-83ed-4fbc-8ae9-fd5a7efe568c", "name": "network-vif-deleted", "tag": "b1205a24-4dab-496d-ab9e-de43f7541dc8"}, {"server_uuid": "2a028a63-83ed-4fbc-8ae9-fd5a7efe568c", "name": "network-vif-deleted", "tag": "e1423704-0403-4700-a477-a2467e273263"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:54.987525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-221cde6c-71e4-40a8-b18e-488c9d929634 req-df475692-1f16-48e4-81b5-648bae712ca8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:54.988527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-221cde6c-71e4-40a8-b18e-488c9d929634 req-df475692-1f16-48e4-81b5-648bae712ca8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:54.989321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-221cde6c-71e4-40a8-b18e-488c9d929634 req-df475692-1f16-48e4-81b5-648bae712ca8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:55.028372 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-221cde6c-71e4-40a8-b18e-488c9d929634 req-df475692-1f16-48e4-81b5-648bae712ca8 service nova] Creating event network-vif-deleted:9078770f-276a-4614-b856-97bd301c2e61 for instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c on n-h2-852084-10 Sep 08 12:52:55.029508 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-221cde6c-71e4-40a8-b18e-488c9d929634 req-df475692-1f16-48e4-81b5-648bae712ca8 service nova] Creating event network-vif-deleted:b1205a24-4dab-496d-ab9e-de43f7541dc8 for instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c on n-h2-852084-10 Sep 08 12:52:55.030536 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-221cde6c-71e4-40a8-b18e-488c9d929634 req-df475692-1f16-48e4-81b5-648bae712ca8 service nova] Creating event network-vif-deleted:e1423704-0403-4700-a477-a2467e273263 for instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c on n-h2-852084-10 Sep 08 12:52:55.043518 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-221cde6c-71e4-40a8-b18e-488c9d929634 req-df475692-1f16-48e4-81b5-648bae712ca8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.098314 Sep 08 12:52:55.045833 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1368/2632] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:55.047648 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a43b57c6-3b09-408e-bdd8-4abd00181a8b tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/feecee3f-4f2e-481f-86b7-d443b90482f4" status: 202 len: 0 microversion: 2.1 time: 3.598105 Sep 08 12:52:55.050499 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1265/2633] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:52:51 2022] DELETE /compute/v2.1/os-floating-ips/feecee3f-4f2e-481f-86b7-d443b90482f4 => generated 0 bytes in 3602 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:52:55.059332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b14a2162-ecc4-4eb0-ab1b-4462222c86d2 req-3722816b-6c4e-48ed-b254-702e283fd93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a028a63-83ed-4fbc-8ae9-fd5a7efe568c", "name": "network-vif-unplugged", "status": "completed", "tag": "e1423704-0403-4700-a477-a2467e273263"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:55.063314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d40a786b-8c72-4b99-8751-529e2137c837 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:55.068151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d40a786b-8c72-4b99-8751-529e2137c837 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:55.081908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b14a2162-ecc4-4eb0-ab1b-4462222c86d2 req-3722816b-6c4e-48ed-b254-702e283fd93c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:55.083360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b14a2162-ecc4-4eb0-ab1b-4462222c86d2 req-3722816b-6c4e-48ed-b254-702e283fd93c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:55.084814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b14a2162-ecc4-4eb0-ab1b-4462222c86d2 req-3722816b-6c4e-48ed-b254-702e283fd93c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:55.086558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d40a786b-8c72-4b99-8751-529e2137c837 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:55.088804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d40a786b-8c72-4b99-8751-529e2137c837 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:55.090038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d40a786b-8c72-4b99-8751-529e2137c837 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:55.092801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d40a786b-8c72-4b99-8751-529e2137c837 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:55.094170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d40a786b-8c72-4b99-8751-529e2137c837 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:55.095158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d40a786b-8c72-4b99-8751-529e2137c837 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:55.123596 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b14a2162-ecc4-4eb0-ab1b-4462222c86d2 req-3722816b-6c4e-48ed-b254-702e283fd93c service nova] Creating event network-vif-unplugged:e1423704-0403-4700-a477-a2467e273263 for instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c on n-h2-852084-10 Sep 08 12:52:55.143648 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b14a2162-ecc4-4eb0-ab1b-4462222c86d2 req-3722816b-6c4e-48ed-b254-702e283fd93c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090729 Sep 08 12:52:55.149061 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1369/2634] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:55.169532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f9874a26-3f5d-4c8b-83c3-b00c13a82e1d tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:55.171397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f9874a26-3f5d-4c8b-83c3-b00c13a82e1d tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:55.184469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9874a26-3f5d-4c8b-83c3-b00c13a82e1d tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:55.185697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9874a26-3f5d-4c8b-83c3-b00c13a82e1d tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:55.186704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9874a26-3f5d-4c8b-83c3-b00c13a82e1d tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:55.188291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9874a26-3f5d-4c8b-83c3-b00c13a82e1d tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:55.189423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9874a26-3f5d-4c8b-83c3-b00c13a82e1d tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:55.190160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9874a26-3f5d-4c8b-83c3-b00c13a82e1d tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:55.216116 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-f9874a26-3f5d-4c8b-83c3-b00c13a82e1d tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] HTTP exception thrown: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f9874a26-3f5d-4c8b-83c3-b00c13a82e1d tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Request method failure captured: Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c HTTP/1.1 Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeU_XtinJzfTr2r8jQ-dQM26ab93LNnZmWsVSl_w6BcZY6hr8Hd_kESK6HWkxAufGsC_i-TOYcrff_w1RbdrGa-ZJYI-rNoJYsIbF5uNhT6MeJHtt-iLaMGRkcqgtBdSCpcdE77UMlggicdA-yQRlY2p65jsUjIa7jFPFS5b9b9k7rI Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a2b4bb04764e484099a1380cee0343d9 Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestMultiNic-2053997464 Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestMultiNic-2053997464 Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a2b4bb04764e484099a1380cee0343d9 Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestMultiNic-2053997464 Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestMultiNic-2053997464-project Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7063832f6c334d26bd0f30b5b16116b4 Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestMultiNic-2053997464-project Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '2a028a63-83ed-4fbc-8ae9-fd5a7efe568c'} Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:52:55.220036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:55.226496 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:52:55.226496 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:52:55.226496 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:52:55.226496 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:52:55.226496 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:52:55.226496 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:52:55.226496 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:52:55.226496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f9874a26-3f5d-4c8b-83c3-b00c13a82e1d tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Returning 404 to user: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:52:55.226496 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f9874a26-3f5d-4c8b-83c3-b00c13a82e1d tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 404 len: 111 microversion: 2.1 time: 0.070708 Sep 08 12:52:55.226496 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1370/2635] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:55 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:52:55.236035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cef9028d-580d-4c63-9ed6-06aea26591d0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:55.246197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cef9028d-580d-4c63-9ed6-06aea26591d0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Searching by: {'deleted': False, 'project_id': 'b6f8a86b272549d2a31a2727b8a3be75'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:52:55.255036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cef9028d-580d-4c63-9ed6-06aea26591d0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:55.256952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cef9028d-580d-4c63-9ed6-06aea26591d0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:55.257832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cef9028d-580d-4c63-9ed6-06aea26591d0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:55.259923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cef9028d-580d-4c63-9ed6-06aea26591d0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:55.261087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cef9028d-580d-4c63-9ed6-06aea26591d0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:55.261927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cef9028d-580d-4c63-9ed6-06aea26591d0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:55.319205 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cef9028d-580d-4c63-9ed6-06aea26591d0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?tenant_id=6c7023382ac747a2a84467a1b13b3bdb" status: 200 len: 15 microversion: 2.1 time: 0.093509 Sep 08 12:52:55.321383 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1371/2636] 10.222.0.78 () {58 vars in 1231 bytes} [Thu Sep 8 12:52:55 2022] GET /compute/v2.1/servers/detail?tenant_id=6c7023382ac747a2a84467a1b13b3bdb => generated 15 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:52:55.350747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-acda7f60-12dd-46c3-a449-242bb0771e41 req-0b028b5f-f748-4095-acbb-b9dc4274d878 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79750c09-f943-404e-ad11-211dbd9010e8", "tag": "f6d3df96-4079-4a81-9573-322e42ef4c46"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:55.377216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-acda7f60-12dd-46c3-a449-242bb0771e41 req-0b028b5f-f748-4095-acbb-b9dc4274d878 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:55.377716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-acda7f60-12dd-46c3-a449-242bb0771e41 req-0b028b5f-f748-4095-acbb-b9dc4274d878 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:55.379061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-acda7f60-12dd-46c3-a449-242bb0771e41 req-0b028b5f-f748-4095-acbb-b9dc4274d878 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:55.418736 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-acda7f60-12dd-46c3-a449-242bb0771e41 req-0b028b5f-f748-4095-acbb-b9dc4274d878 service nova] Creating event network-changed:f6d3df96-4079-4a81-9573-322e42ef4c46 for instance 79750c09-f943-404e-ad11-211dbd9010e8 on n-h1-852084-10 Sep 08 12:52:55.428273 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-acda7f60-12dd-46c3-a449-242bb0771e41 req-0b028b5f-f748-4095-acbb-b9dc4274d878 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103661 Sep 08 12:52:55.429373 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1372/2637] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:52:55.438725 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5f228dca-28df-49b4-bb89-bf14d8fd02c5 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007284 Sep 08 12:52:55.447570 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1373/2638] 10.222.0.78 () {58 vars in 1140 bytes} [Thu Sep 8 12:52:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 12:52:55.458156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9cd577ac-9cd4-447c-bce9-35903c24bb4a tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] Calling method '.version_select at 0x7fdb35eb84c0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:55.765210 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 12:52:55.765784 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 12:52:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 (ip 10.222.0.78) !!! Sep 08 12:52:55.918379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d40a786b-8c72-4b99-8751-529e2137c837 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:52:55.937245 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d40a786b-8c72-4b99-8751-529e2137c837 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655" status: 200 len: 1322 microversion: 2.1 time: 0.884012 Sep 08 12:52:55.940928 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1266/2639] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:55 2022] GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 => generated 1322 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:52:55.953178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1182829281", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "5505b431-686a-457c-9712-0faff9f3c3fd"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:52:56.119454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] validate_networks() for [('5505b431-686a-457c-9712-0faff9f3c3fd', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:52:58.379496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:52:58.381160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:52:58.381740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:52:58.382403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:52:58.383148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:52:58.431611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:58.432541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:58.433389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:58.434383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:58.440033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:58.440773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:58.499702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Getting quotas for project b4685a4a696449fd8fd85f135e05900b. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:52:58.508077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Getting quotas for user b78e89e2a3ff4ee4924306aad4fc13cf and project b4685a4a696449fd8fd85f135e05900b. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:52:58.527191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:52:58.530292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:52:58.606260 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9d2caa33-caf7-47c0-946e-165ef7c11d65 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.662755 Sep 08 12:52:58.607456 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1267/2640] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:52:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:52:58.617148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:58.632616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Searching by: {'tenant_id': '6c7023382ac747a2a84467a1b13b3bdb', 'deleted': False} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:52:58.649189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:58.651356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:58.652891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:58.653975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:58.654670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:58.656067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:58.708943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:52:58.885427 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9cd577ac-9cd4-447c-bce9-35903c24bb4a tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/cd549c61-7e87-40a0-a225-2a6656a27fc1" status: 202 len: 0 microversion: 2.1 time: 3.435914 Sep 08 12:52:58.886827 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1374/2641] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:52:55 2022] DELETE /compute/v2.1/os-floating-ips/cd549c61-7e87-40a0-a225-2a6656a27fc1 => generated 0 bytes in 3438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:52:58.895564 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c316aeaf-c301-4422-b81f-2435ae4e90a5 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006504 Sep 08 12:52:58.897376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:58.898106 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1375/2642] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:52:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 08 12:52:58.902953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:58.905192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:58.914984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c2c18282-b6ea-4821-bbc0-9b15ef2b8042 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:52:58.926955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c2c18282-b6ea-4821-bbc0-9b15ef2b8042 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:52:58.954233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2c18282-b6ea-4821-bbc0-9b15ef2b8042 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:58.955295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2c18282-b6ea-4821-bbc0-9b15ef2b8042 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:58.956713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2c18282-b6ea-4821-bbc0-9b15ef2b8042 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:52:58.957809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2c18282-b6ea-4821-bbc0-9b15ef2b8042 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:52:58.960932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2c18282-b6ea-4821-bbc0-9b15ef2b8042 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:52:58.961852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2c18282-b6ea-4821-bbc0-9b15ef2b8042 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:00.857013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c2c18282-b6ea-4821-bbc0-9b15ef2b8042 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:00.888595 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5762afbc-bd9b-467a-91cc-20ca51fe0da0 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6c7023382ac747a2a84467a1b13b3bdb" status: 200 len: 4832 microversion: 2.1 time: 2.279553 Sep 08 12:53:00.900675 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1268/2643] 10.222.0.78 () {58 vars in 1257 bytes} [Thu Sep 8 12:52:58 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=6c7023382ac747a2a84467a1b13b3bdb => generated 4832 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:00.922539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2b4e9a09-218c-4fe6-95f8-6ed405c19fda req-209e64e3-0c8a-4918-9121-704b920ce1bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73e10911-8428-4be8-b770-205b2d073655", "tag": "bd414794-3cba-479e-b176-d26cafe61ec0"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:00.934579 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c2c18282-b6ea-4821-bbc0-9b15ef2b8042 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655" status: 200 len: 1322 microversion: 2.1 time: 2.023890 Sep 08 12:53:00.935983 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1376/2644] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:52:58 2022] GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 => generated 1322 bytes in 2037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:00.953981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5315b7c9-ef29-4b96-93a5-5f831cf3fc44 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:00.955657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5315b7c9-ef29-4b96-93a5-5f831cf3fc44 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:00.959173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2b4e9a09-218c-4fe6-95f8-6ed405c19fda req-209e64e3-0c8a-4918-9121-704b920ce1bf service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:00.967359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2b4e9a09-218c-4fe6-95f8-6ed405c19fda req-209e64e3-0c8a-4918-9121-704b920ce1bf service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:00.968300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2b4e9a09-218c-4fe6-95f8-6ed405c19fda req-209e64e3-0c8a-4918-9121-704b920ce1bf service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:00.983652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5315b7c9-ef29-4b96-93a5-5f831cf3fc44 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:00.987372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5315b7c9-ef29-4b96-93a5-5f831cf3fc44 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:00.989852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5315b7c9-ef29-4b96-93a5-5f831cf3fc44 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:00.990899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5315b7c9-ef29-4b96-93a5-5f831cf3fc44 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:00.992358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5315b7c9-ef29-4b96-93a5-5f831cf3fc44 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:00.993155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5315b7c9-ef29-4b96-93a5-5f831cf3fc44 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:01.011605 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2b4e9a09-218c-4fe6-95f8-6ed405c19fda req-209e64e3-0c8a-4918-9121-704b920ce1bf service nova] Creating event network-changed:bd414794-3cba-479e-b176-d26cafe61ec0 for instance 73e10911-8428-4be8-b770-205b2d073655 on n-h1-852084-10 Sep 08 12:53:01.047870 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2b4e9a09-218c-4fe6-95f8-6ed405c19fda req-209e64e3-0c8a-4918-9121-704b920ce1bf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136356 Sep 08 12:53:01.048948 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1269/2645] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:01.081292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-89298131-d2da-4d8a-9320-3b0b7d858b90 tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] Calling method '.version_select at 0x7fdb3f08fd30>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:01.104136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:01.235146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5315b7c9-ef29-4b96-93a5-5f831cf3fc44 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:01.247025 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5315b7c9-ef29-4b96-93a5-5f831cf3fc44 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1212 microversion: 2.1 time: 0.309232 Sep 08 12:53:01.253169 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1377/2646] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:00 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1212 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:01.269961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a79edf56-ef02-473a-b5f7-dca6cd1fb6c0 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Calling method '.version_select at 0x7fdb3f1a5790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:01.414814 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-a79edf56-ef02-473a-b5f7-dca6cd1fb6c0 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] HTTP exception thrown: Volume 1f2ac094-b434-4075-949f-0b062602f68e could not be found. Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a79edf56-ef02-473a-b5f7-dca6cd1fb6c0 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Request method failure captured: Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/os-volumes/1f2ac094-b434-4075-949f-0b062602f68e HTTP/1.1 Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeWdejJSh7-MJ2zHEA9jUYMwE_QhAqTI5aKGa9hoNgtp27DEFiOpkuUqYEZcZnmFqFZfRQoOHTObr9M3csM7AkhfZfjFbaq2dW16dpzZkZ0ENtK0hZkNDMdg_FNkxpXOI3U5jSEyXlK5rCurEtHA7-ytoKCQVG6DOdxDJaAF25E2TYo Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b5ca2ee5541a48ba98c3c8e1f8361499 Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesNegativeTest-917975933 Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesNegativeTest-917975933 Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b5ca2ee5541a48ba98c3c8e1f8361499 Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesNegativeTest-917975933 Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesNegativeTest-917975933-project Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 0b0b89666e8545c1828718a18edfad09 Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesNegativeTest-917975933-project Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: exception: Volume 1f2ac094-b434-4075-949f-0b062602f68e could not be found. Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '1f2ac094-b434-4075-949f-0b062602f68e'} Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1f2ac094-b434-4075-949f-0b062602f68e could not be found. (HTTP 404) (Request-ID: req-614bbd9d-d0e5-4d04-8514-cb5c9acc5ea4) Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 12:53:01.418528 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1f2ac094-b434-4075-949f-0b062602f68e could not be found. Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1f2ac094-b434-4075-949f-0b062602f68e could not be found. Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1f2ac094-b434-4075-949f-0b062602f68e could not be found. Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a79edf56-ef02-473a-b5f7-dca6cd1fb6c0 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Returning 404 to user: Volume 1f2ac094-b434-4075-949f-0b062602f68e could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a79edf56-ef02-473a-b5f7-dca6cd1fb6c0 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/1f2ac094-b434-4075-949f-0b062602f68e" status: 404 len: 109 microversion: 2.1 time: 0.163067 Sep 08 12:53:01.427914 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1378/2647] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 12:53:01 2022] DELETE /compute/v2.1/os-volumes/1f2ac094-b434-4075-949f-0b062602f68e => generated 109 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:53:01.433979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-95ec5a64-9ad3-4db0-9133-9b095b3d5d78 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:01.462957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-95ec5a64-9ad3-4db0-9133-9b095b3d5d78 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Searching by: {'tenant_id': 'b6f8a86b272549d2a31a2727b8a3be75', 'deleted': False} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:53:01.493833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95ec5a64-9ad3-4db0-9133-9b095b3d5d78 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:01.494324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95ec5a64-9ad3-4db0-9133-9b095b3d5d78 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:01.494927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95ec5a64-9ad3-4db0-9133-9b095b3d5d78 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:01.495790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95ec5a64-9ad3-4db0-9133-9b095b3d5d78 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:01.496247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95ec5a64-9ad3-4db0-9133-9b095b3d5d78 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:01.496699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95ec5a64-9ad3-4db0-9133-9b095b3d5d78 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:01.609876 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-95ec5a64-9ad3-4db0-9133-9b095b3d5d78 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b6f8a86b272549d2a31a2727b8a3be75" status: 200 len: 15 microversion: 2.1 time: 0.181067 Sep 08 12:53:01.624244 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1379/2648] 10.222.0.78 () {58 vars in 1257 bytes} [Thu Sep 8 12:53:01 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b6f8a86b272549d2a31a2727b8a3be75 => generated 15 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:53:01.637858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e94b613e-6c3a-4389-aad1-6e45722a7cd0 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Calling method '.version_select at 0x7fdb3f2a2ca0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:01.734327 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e94b613e-6c3a-4389-aad1-6e45722a7cd0 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] HTTP exception thrown: Volume 00e8c897-4016-4d9f-a70e-9abd2daf87a6 could not be found. Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e94b613e-6c3a-4389-aad1-6e45722a7cd0 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Request method failure captured: Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-volumes/00e8c897-4016-4d9f-a70e-9abd2daf87a6 HTTP/1.1 Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeWdejJSh7-MJ2zHEA9jUYMwE_QhAqTI5aKGa9hoNgtp27DEFiOpkuUqYEZcZnmFqFZfRQoOHTObr9M3csM7AkhfZfjFbaq2dW16dpzZkZ0ENtK0hZkNDMdg_FNkxpXOI3U5jSEyXlK5rCurEtHA7-ytoKCQVG6DOdxDJaAF25E2TYo Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b5ca2ee5541a48ba98c3c8e1f8361499 Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesNegativeTest-917975933 Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b5ca2ee5541a48ba98c3c8e1f8361499"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesNegativeTest-917975933 Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b5ca2ee5541a48ba98c3c8e1f8361499 Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesNegativeTest-917975933 Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesNegativeTest-917975933-project Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 0b0b89666e8545c1828718a18edfad09 Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesNegativeTest-917975933-project Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: exception: Volume 00e8c897-4016-4d9f-a70e-9abd2daf87a6 could not be found. Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '00e8c897-4016-4d9f-a70e-9abd2daf87a6'} Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 00e8c897-4016-4d9f-a70e-9abd2daf87a6 could not be found. (HTTP 404) (Request-ID: req-a0183709-7486-4b31-9123-d9ab23cb5ae1) Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 12:53:01.737345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 00e8c897-4016-4d9f-a70e-9abd2daf87a6 could not be found. Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 00e8c897-4016-4d9f-a70e-9abd2daf87a6 could not be found. Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 00e8c897-4016-4d9f-a70e-9abd2daf87a6 could not be found. Sep 08 12:53:01.741287 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:01.755593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e94b613e-6c3a-4389-aad1-6e45722a7cd0 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] Returning 404 to user: Volume 00e8c897-4016-4d9f-a70e-9abd2daf87a6 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:01.757024 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e94b613e-6c3a-4389-aad1-6e45722a7cd0 tempest-VolumesNegativeTest-917975933 tempest-VolumesNegativeTest-917975933-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/00e8c897-4016-4d9f-a70e-9abd2daf87a6" status: 404 len: 109 microversion: 2.1 time: 0.131608 Sep 08 12:53:01.758550 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1380/2649] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 12:53:01 2022] GET /compute/v2.1/os-volumes/00e8c897-4016-4d9f-a70e-9abd2daf87a6 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:53:01.782325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-687b0a7c-e71f-42e0-b02f-b749e4f97cb8 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:01.793579 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-687b0a7c-e71f-42e0-b02f-b749e4f97cb8 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.032875 Sep 08 12:53:01.804950 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1381/2650] 10.222.0.78 () {58 vars in 1189 bytes} [Thu Sep 8 12:53:01 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:53:01.836795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3194843c-c61c-4f0a-bb90-7ea2894702bf tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:01.840450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3194843c-c61c-4f0a-bb90-7ea2894702bf tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:01.864670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3194843c-c61c-4f0a-bb90-7ea2894702bf tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:01.870029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3194843c-c61c-4f0a-bb90-7ea2894702bf tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:01.871070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3194843c-c61c-4f0a-bb90-7ea2894702bf tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:01.872193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3194843c-c61c-4f0a-bb90-7ea2894702bf tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:01.874060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3194843c-c61c-4f0a-bb90-7ea2894702bf tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:01.874825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3194843c-c61c-4f0a-bb90-7ea2894702bf tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:02.082245 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3194843c-c61c-4f0a-bb90-7ea2894702bf tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action" status: 202 len: 0 microversion: 2.1 time: 0.252392 Sep 08 12:53:02.095676 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1382/2651] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:53:01 2022] POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:02.101186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8afd27c1-b1ad-48bc-92f7-626cfc356d3f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:02.101851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8afd27c1-b1ad-48bc-92f7-626cfc356d3f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:02.117183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8afd27c1-b1ad-48bc-92f7-626cfc356d3f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:02.117995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8afd27c1-b1ad-48bc-92f7-626cfc356d3f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:02.118701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8afd27c1-b1ad-48bc-92f7-626cfc356d3f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:02.122654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8afd27c1-b1ad-48bc-92f7-626cfc356d3f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:02.123484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8afd27c1-b1ad-48bc-92f7-626cfc356d3f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:02.124118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8afd27c1-b1ad-48bc-92f7-626cfc356d3f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:03.789121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8afd27c1-b1ad-48bc-92f7-626cfc356d3f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:03.828822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:03.837190 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8afd27c1-b1ad-48bc-92f7-626cfc356d3f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655" status: 200 len: 1322 microversion: 2.1 time: 1.740280 Sep 08 12:53:03.849765 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1383/2652] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:02 2022] GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 => generated 1322 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:03.883706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-25fc6336-9be9-4e06-abfc-ee13f311f3aa tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:03.891955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-25fc6336-9be9-4e06-abfc-ee13f311f3aa tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:03.893154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-25fc6336-9be9-4e06-abfc-ee13f311f3aa tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:53:03.901432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25fc6336-9be9-4e06-abfc-ee13f311f3aa tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:03.902467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25fc6336-9be9-4e06-abfc-ee13f311f3aa tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:03.903271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25fc6336-9be9-4e06-abfc-ee13f311f3aa tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:03.904506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25fc6336-9be9-4e06-abfc-ee13f311f3aa tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:03.905290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25fc6336-9be9-4e06-abfc-ee13f311f3aa tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:03.906038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25fc6336-9be9-4e06-abfc-ee13f311f3aa tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:03.942525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-25fc6336-9be9-4e06-abfc-ee13f311f3aa tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:53:03.983504 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-25fc6336-9be9-4e06-abfc-ee13f311f3aa tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.104475 Sep 08 12:53:03.991944 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1384/2653] 10.222.0.78 () {58 vars in 1150 bytes} [Thu Sep 8 12:53:03 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:03.999633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-5d1b1d3d-f88f-43de-adc6-29341fe3f029 req-095b1bb5-ed68-40a4-bf59-7e3f5513da30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb01efa-03b9-40b6-901b-33e7d583b7c8", "name": "network-vif-plugged", "status": "completed", "tag": "6d98b289-22e2-4a8e-ba25-0857a1412c6b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:04.011946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5d1b1d3d-f88f-43de-adc6-29341fe3f029 req-095b1bb5-ed68-40a4-bf59-7e3f5513da30 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:04.013090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5d1b1d3d-f88f-43de-adc6-29341fe3f029 req-095b1bb5-ed68-40a4-bf59-7e3f5513da30 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:04.013947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5d1b1d3d-f88f-43de-adc6-29341fe3f029 req-095b1bb5-ed68-40a4-bf59-7e3f5513da30 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:04.032331 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-5d1b1d3d-f88f-43de-adc6-29341fe3f029 req-095b1bb5-ed68-40a4-bf59-7e3f5513da30 service nova] Creating event network-vif-plugged:6d98b289-22e2-4a8e-ba25-0857a1412c6b for instance abb01efa-03b9-40b6-901b-33e7d583b7c8 on n-h1-852084-10 Sep 08 12:53:04.042164 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-5d1b1d3d-f88f-43de-adc6-29341fe3f029 req-095b1bb5-ed68-40a4-bf59-7e3f5513da30 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047638 Sep 08 12:53:04.043252 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1385/2654] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:04.051016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b6fcff69-c6f4-4aab-abb7-9b5a65f736cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:04.052533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b6fcff69-c6f4-4aab-abb7-9b5a65f736cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:04.062158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6fcff69-c6f4-4aab-abb7-9b5a65f736cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:04.063013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6fcff69-c6f4-4aab-abb7-9b5a65f736cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:04.063880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6fcff69-c6f4-4aab-abb7-9b5a65f736cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:04.065056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6fcff69-c6f4-4aab-abb7-9b5a65f736cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:04.065848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6fcff69-c6f4-4aab-abb7-9b5a65f736cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:04.066621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6fcff69-c6f4-4aab-abb7-9b5a65f736cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:04.309116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b6fcff69-c6f4-4aab-abb7-9b5a65f736cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:04.323024 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b6fcff69-c6f4-4aab-abb7-9b5a65f736cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1274 microversion: 2.1 time: 0.278119 Sep 08 12:53:04.324290 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1386/2655] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:04 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1274 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:04.344340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-615a6e0a-6886-4e3a-bd87-67cc7dd35f01 req-6032928f-2562-414d-96b1-771be51f9250 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbd99aba-87fc-409c-933d-9cd6b5b7240a", "tag": "268692c3-4721-4548-a1d6-bd081e18ab22"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:04.365734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-615a6e0a-6886-4e3a-bd87-67cc7dd35f01 req-6032928f-2562-414d-96b1-771be51f9250 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:04.366498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-615a6e0a-6886-4e3a-bd87-67cc7dd35f01 req-6032928f-2562-414d-96b1-771be51f9250 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:04.367162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-615a6e0a-6886-4e3a-bd87-67cc7dd35f01 req-6032928f-2562-414d-96b1-771be51f9250 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:04.393699 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-615a6e0a-6886-4e3a-bd87-67cc7dd35f01 req-6032928f-2562-414d-96b1-771be51f9250 service nova] Creating event network-changed:268692c3-4721-4548-a1d6-bd081e18ab22 for instance fbd99aba-87fc-409c-933d-9cd6b5b7240a on n-h1-852084-10 Sep 08 12:53:04.412558 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-615a6e0a-6886-4e3a-bd87-67cc7dd35f01 req-6032928f-2562-414d-96b1-771be51f9250 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086714 Sep 08 12:53:04.413841 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1387/2656] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:04.420137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-469288b8-a25e-40d1-934e-3d4555cd334d tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:04.433987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-469288b8-a25e-40d1-934e-3d4555cd334d tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:04.441289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-469288b8-a25e-40d1-934e-3d4555cd334d tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:04.442206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-469288b8-a25e-40d1-934e-3d4555cd334d tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:04.442851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-469288b8-a25e-40d1-934e-3d4555cd334d tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:04.444613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-469288b8-a25e-40d1-934e-3d4555cd334d tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:04.453490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-469288b8-a25e-40d1-934e-3d4555cd334d tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:04.454490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-469288b8-a25e-40d1-934e-3d4555cd334d tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:04.631984 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-469288b8-a25e-40d1-934e-3d4555cd334d tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action" status: 202 len: 0 microversion: 2.1 time: 0.216477 Sep 08 12:53:04.635710 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1388/2657] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:53:04 2022] POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:04.641263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a6fcfa4d-a1d7-4118-a7a4-9f7c12294c92 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:04.646140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a6fcfa4d-a1d7-4118-a7a4-9f7c12294c92 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:04.655642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6fcfa4d-a1d7-4118-a7a4-9f7c12294c92 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:04.656607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6fcfa4d-a1d7-4118-a7a4-9f7c12294c92 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:04.657220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6fcfa4d-a1d7-4118-a7a4-9f7c12294c92 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:04.658382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6fcfa4d-a1d7-4118-a7a4-9f7c12294c92 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:04.659050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6fcfa4d-a1d7-4118-a7a4-9f7c12294c92 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:04.659665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6fcfa4d-a1d7-4118-a7a4-9f7c12294c92 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:05.220273 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a6fcfa4d-a1d7-4118-a7a4-9f7c12294c92 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1615 microversion: 2.1 time: 0.579135 Sep 08 12:53:05.247928 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1389/2658] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:04 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1615 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:05.275320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-943cce84-c640-4b0e-940e-257d63c94ad6 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:05.276794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-943cce84-c640-4b0e-940e-257d63c94ad6 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:05.294896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-943cce84-c640-4b0e-940e-257d63c94ad6 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:05.296291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-943cce84-c640-4b0e-940e-257d63c94ad6 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:05.297387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-943cce84-c640-4b0e-940e-257d63c94ad6 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:05.298954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-943cce84-c640-4b0e-940e-257d63c94ad6 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:05.300053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-943cce84-c640-4b0e-940e-257d63c94ad6 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:05.301209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-943cce84-c640-4b0e-940e-257d63c94ad6 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:06.364741 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-89298131-d2da-4d8a-9320-3b0b7d858b90 tempest-FloatingIPDetailsTestJSON-1155849118 tempest-FloatingIPDetailsTestJSON-1155849118-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/e1c6fb02-4a95-4a52-9cfe-176b1111ffd1" status: 202 len: 0 microversion: 2.1 time: 5.314080 Sep 08 12:53:06.365608 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1270/2659] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:53:01 2022] DELETE /compute/v2.1/os-floating-ips/e1c6fb02-4a95-4a52-9cfe-176b1111ffd1 => generated 0 bytes in 5316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:06.371030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3f03084a-3545-4c43-9543-3946e570b655 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:06.372260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3f03084a-3545-4c43-9543-3946e570b655 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:06.389430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:06.418494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f03084a-3545-4c43-9543-3946e570b655 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:06.427376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f03084a-3545-4c43-9543-3946e570b655 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:06.432586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f03084a-3545-4c43-9543-3946e570b655 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:06.440777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f03084a-3545-4c43-9543-3946e570b655 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:06.441737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f03084a-3545-4c43-9543-3946e570b655 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:06.443035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f03084a-3545-4c43-9543-3946e570b655 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:07.094709 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3f03084a-3545-4c43-9543-3946e570b655 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1615 microversion: 2.1 time: 0.727556 Sep 08 12:53:07.100648 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1271/2660] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:06 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1615 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:07.112622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b53be8b-aa2b-427e-b5d5-19edf7a5309c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:07.115404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6b53be8b-aa2b-427e-b5d5-19edf7a5309c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:07.130723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b53be8b-aa2b-427e-b5d5-19edf7a5309c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:07.131591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b53be8b-aa2b-427e-b5d5-19edf7a5309c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:07.132231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b53be8b-aa2b-427e-b5d5-19edf7a5309c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:07.133441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-943cce84-c640-4b0e-940e-257d63c94ad6 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:07.134666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b53be8b-aa2b-427e-b5d5-19edf7a5309c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:07.135591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b53be8b-aa2b-427e-b5d5-19edf7a5309c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:07.136489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b53be8b-aa2b-427e-b5d5-19edf7a5309c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:07.185083 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-943cce84-c640-4b0e-940e-257d63c94ad6 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655" status: 200 len: 1322 microversion: 2.1 time: 1.921564 Sep 08 12:53:07.213167 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1390/2661] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:05 2022] GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 => generated 1322 bytes in 1964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:07.252834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-67cdfdd2-7ac5-4697-a047-fc1e3148dc67 req-d25b9ff8-07ec-4146-a09c-d46a67012b06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79750c09-f943-404e-ad11-211dbd9010e8", "name": "network-vif-plugged", "status": "completed", "tag": "f6d3df96-4079-4a81-9573-322e42ef4c46"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:07.332488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-67cdfdd2-7ac5-4697-a047-fc1e3148dc67 req-d25b9ff8-07ec-4146-a09c-d46a67012b06 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:07.333493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-67cdfdd2-7ac5-4697-a047-fc1e3148dc67 req-d25b9ff8-07ec-4146-a09c-d46a67012b06 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:07.337711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-67cdfdd2-7ac5-4697-a047-fc1e3148dc67 req-d25b9ff8-07ec-4146-a09c-d46a67012b06 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:07.442984 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-67cdfdd2-7ac5-4697-a047-fc1e3148dc67 req-d25b9ff8-07ec-4146-a09c-d46a67012b06 service nova] Creating event network-vif-plugged:f6d3df96-4079-4a81-9573-322e42ef4c46 for instance 79750c09-f943-404e-ad11-211dbd9010e8 on n-h1-852084-10 Sep 08 12:53:07.459078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6b53be8b-aa2b-427e-b5d5-19edf7a5309c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:07.472385 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6b53be8b-aa2b-427e-b5d5-19edf7a5309c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1316 microversion: 2.1 time: 0.369254 Sep 08 12:53:07.473675 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1272/2662] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:07 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1316 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:07.481300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62e05710-fe1f-4ed6-bf62-ed3c4ddeec44 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:07.492431 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-67cdfdd2-7ac5-4697-a047-fc1e3148dc67 req-d25b9ff8-07ec-4146-a09c-d46a67012b06 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274621 Sep 08 12:53:07.493486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-62e05710-fe1f-4ed6-bf62-ed3c4ddeec44 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Searching by: {'host': 'n-h2-852084-10', 'deleted': False} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:53:07.493656 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1391/2663] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:07.504290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e05710-fe1f-4ed6-bf62-ed3c4ddeec44 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:07.506874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e05710-fe1f-4ed6-bf62-ed3c4ddeec44 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:07.507614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e05710-fe1f-4ed6-bf62-ed3c4ddeec44 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:07.508646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e05710-fe1f-4ed6-bf62-ed3c4ddeec44 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:07.509302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e05710-fe1f-4ed6-bf62-ed3c4ddeec44 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:07.510128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e05710-fe1f-4ed6-bf62-ed3c4ddeec44 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:07.920117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-62e05710-fe1f-4ed6-bf62-ed3c4ddeec44 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Listed batch of 4 results from cell out of 1000 limit. Returned 4 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:53:08.238878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-54d212c9-faad-4ec7-8352-62aa2f54698f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:08.240205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-54d212c9-faad-4ec7-8352-62aa2f54698f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:08.266357 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62e05710-fe1f-4ed6-bf62-ed3c4ddeec44 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "GET /compute/v2.1/servers?host=n-h2-852084-10&all_tenants=1" status: 200 len: 1320 microversion: 2.1 time: 0.790308 Sep 08 12:53:08.289809 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1273/2664] 10.222.0.78 () {58 vars in 1192 bytes} [Thu Sep 8 12:53:07 2022] GET /compute/v2.1/servers?host=n-h2-852084-10&all_tenants=1 => generated 1320 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:08.304276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d212c9-faad-4ec7-8352-62aa2f54698f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:08.305159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d212c9-faad-4ec7-8352-62aa2f54698f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:08.305996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d212c9-faad-4ec7-8352-62aa2f54698f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:08.322825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d212c9-faad-4ec7-8352-62aa2f54698f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:08.324251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d212c9-faad-4ec7-8352-62aa2f54698f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:08.325311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d212c9-faad-4ec7-8352-62aa2f54698f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:08.362628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c2935fc1-13f8-4902-97f6-d060cc6b40c9 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:08.431440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c2935fc1-13f8-4902-97f6-d060cc6b40c9 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:53:08.484542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2935fc1-13f8-4902-97f6-d060cc6b40c9 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:08.492253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2935fc1-13f8-4902-97f6-d060cc6b40c9 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:08.492699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2935fc1-13f8-4902-97f6-d060cc6b40c9 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:08.499993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2935fc1-13f8-4902-97f6-d060cc6b40c9 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:08.500652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2935fc1-13f8-4902-97f6-d060cc6b40c9 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:08.501115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2935fc1-13f8-4902-97f6-d060cc6b40c9 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:08.685651 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c2935fc1-13f8-4902-97f6-d060cc6b40c9 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.380973 Sep 08 12:53:08.699015 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1274/2665] 10.222.0.78 () {58 vars in 1196 bytes} [Thu Sep 8 12:53:08 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:53:08.737141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5c0c4768-ff46-447c-ba92-dbc2bff7d1a1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:08.743476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5c0c4768-ff46-447c-ba92-dbc2bff7d1a1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:08.805158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c0c4768-ff46-447c-ba92-dbc2bff7d1a1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:08.809322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c0c4768-ff46-447c-ba92-dbc2bff7d1a1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:08.814075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c0c4768-ff46-447c-ba92-dbc2bff7d1a1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:08.815607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c0c4768-ff46-447c-ba92-dbc2bff7d1a1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:08.818288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c0c4768-ff46-447c-ba92-dbc2bff7d1a1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:08.819077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c0c4768-ff46-447c-ba92-dbc2bff7d1a1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:08.852293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:09.329010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-54d212c9-faad-4ec7-8352-62aa2f54698f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:09.405854 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-54d212c9-faad-4ec7-8352-62aa2f54698f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655" status: 200 len: 1322 microversion: 2.1 time: 1.175878 Sep 08 12:53:09.406088 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1392/2666] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:08 2022] GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 => generated 1322 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:09.454108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3cc21dc5-74fd-4908-9d4b-21290f1af97e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:09.471500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3cc21dc5-74fd-4908-9d4b-21290f1af97e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:09.518289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cc21dc5-74fd-4908-9d4b-21290f1af97e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:09.522301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cc21dc5-74fd-4908-9d4b-21290f1af97e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:09.523732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cc21dc5-74fd-4908-9d4b-21290f1af97e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:09.525922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cc21dc5-74fd-4908-9d4b-21290f1af97e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:09.527988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cc21dc5-74fd-4908-9d4b-21290f1af97e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:09.529101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cc21dc5-74fd-4908-9d4b-21290f1af97e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:09.836176 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3cc21dc5-74fd-4908-9d4b-21290f1af97e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action" status: 202 len: 0 microversion: 2.1 time: 0.410635 Sep 08 12:53:09.839287 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1393/2667] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:53:09 2022] POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:09.863637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:09.872556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:09.895024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:09.895591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:09.896042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:09.896816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:09.897294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:09.897831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:10.076863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:53:10.077703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:53:10.078457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:53:10.079111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:53:10.079884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:53:10.258453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:10.300636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:10.301679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:10.307991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:10.315931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:10.332736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:10.333819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:10.402209 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-47a5f9cf-c703-433a-b446-a0200fd5a9de tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action" status: 202 len: 1066 microversion: 2.1 time: 0.557270 Sep 08 12:53:10.408934 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1394/2668] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:53:09 2022] POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action => generated 1066 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 08 12:53:10.442475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-601a6f1c-825b-41d2-ba0c-8096d7dc138d tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:10.445259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-601a6f1c-825b-41d2-ba0c-8096d7dc138d tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:10.467403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-601a6f1c-825b-41d2-ba0c-8096d7dc138d tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:10.469693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-601a6f1c-825b-41d2-ba0c-8096d7dc138d tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:10.471444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-601a6f1c-825b-41d2-ba0c-8096d7dc138d tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:10.476369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-601a6f1c-825b-41d2-ba0c-8096d7dc138d tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:10.477217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-601a6f1c-825b-41d2-ba0c-8096d7dc138d tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:10.477877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-601a6f1c-825b-41d2-ba0c-8096d7dc138d tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:10.510584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5c0c4768-ff46-447c-ba92-dbc2bff7d1a1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:10.526008 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5c0c4768-ff46-447c-ba92-dbc2bff7d1a1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1316 microversion: 2.1 time: 1.817725 Sep 08 12:53:10.527410 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1275/2669] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:08 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1316 bytes in 1827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:10.533748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3706d2a0-53a0-4079-bfa6-4bee1f098e30 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:10.544498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3706d2a0-53a0-4079-bfa6-4bee1f098e30 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:10.569665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3706d2a0-53a0-4079-bfa6-4bee1f098e30 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:10.570708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3706d2a0-53a0-4079-bfa6-4bee1f098e30 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:10.573849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3706d2a0-53a0-4079-bfa6-4bee1f098e30 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:10.575076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3706d2a0-53a0-4079-bfa6-4bee1f098e30 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:10.575828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3706d2a0-53a0-4079-bfa6-4bee1f098e30 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:10.576532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3706d2a0-53a0-4079-bfa6-4bee1f098e30 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:11.115996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-601a6f1c-825b-41d2-ba0c-8096d7dc138d tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:11.133780 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-601a6f1c-825b-41d2-ba0c-8096d7dc138d tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655" status: 200 len: 1322 microversion: 2.1 time: 0.699253 Sep 08 12:53:11.138459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3706d2a0-53a0-4079-bfa6-4bee1f098e30 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:11.167620 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1395/2670] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:10 2022] GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 => generated 1322 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:11.170792 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3706d2a0-53a0-4079-bfa6-4bee1f098e30 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1470 microversion: 2.1 time: 0.640810 Sep 08 12:53:11.181656 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1276/2671] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:10 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1470 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:11.184739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-4e3eedc5-4bae-488e-af1f-5ab356866efb req-1b399de8-37d8-435a-8889-14ef34c75824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e10911-8428-4be8-b770-205b2d073655", "name": "network-vif-plugged", "status": "completed", "tag": "bd414794-3cba-479e-b176-d26cafe61ec0"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:11.207425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4e3eedc5-4bae-488e-af1f-5ab356866efb req-1b399de8-37d8-435a-8889-14ef34c75824 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:11.208514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4e3eedc5-4bae-488e-af1f-5ab356866efb req-1b399de8-37d8-435a-8889-14ef34c75824 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:11.209167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4e3eedc5-4bae-488e-af1f-5ab356866efb req-1b399de8-37d8-435a-8889-14ef34c75824 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:11.242394 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-4e3eedc5-4bae-488e-af1f-5ab356866efb req-1b399de8-37d8-435a-8889-14ef34c75824 service nova] Creating event network-vif-plugged:bd414794-3cba-479e-b176-d26cafe61ec0 for instance 73e10911-8428-4be8-b770-205b2d073655 on n-h1-852084-10 Sep 08 12:53:11.257004 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-4e3eedc5-4bae-488e-af1f-5ab356866efb req-1b399de8-37d8-435a-8889-14ef34c75824 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087490 Sep 08 12:53:11.266323 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1396/2672] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:11.558087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-160f06eb-2e64-48d0-a213-a6c4322ca355 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:11.559570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-160f06eb-2e64-48d0-a213-a6c4322ca355 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:11.572192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-160f06eb-2e64-48d0-a213-a6c4322ca355 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:11.575876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-160f06eb-2e64-48d0-a213-a6c4322ca355 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:11.579597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-160f06eb-2e64-48d0-a213-a6c4322ca355 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:11.582579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-160f06eb-2e64-48d0-a213-a6c4322ca355 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:11.587767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-160f06eb-2e64-48d0-a213-a6c4322ca355 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:11.588655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-160f06eb-2e64-48d0-a213-a6c4322ca355 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:12.178969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3308e9d5-ab3f-411d-9cdc-fc58f6babaf2 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:12.181866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3308e9d5-ab3f-411d-9cdc-fc58f6babaf2 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:12.202182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3308e9d5-ab3f-411d-9cdc-fc58f6babaf2 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:12.205447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3308e9d5-ab3f-411d-9cdc-fc58f6babaf2 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:12.206619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3308e9d5-ab3f-411d-9cdc-fc58f6babaf2 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:12.208484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3308e9d5-ab3f-411d-9cdc-fc58f6babaf2 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:12.214023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3308e9d5-ab3f-411d-9cdc-fc58f6babaf2 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:12.215135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3308e9d5-ab3f-411d-9cdc-fc58f6babaf2 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:12.834552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-160f06eb-2e64-48d0-a213-a6c4322ca355 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:12.884424 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-160f06eb-2e64-48d0-a213-a6c4322ca355 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1316 microversion: 2.1 time: 1.331609 Sep 08 12:53:12.912235 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1277/2673] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:11 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1316 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:53:12.946646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-407fa326-51ce-4dd9-b6ba-b90d4da9a9ae tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:12.948360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-407fa326-51ce-4dd9-b6ba-b90d4da9a9ae tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:12.967580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-407fa326-51ce-4dd9-b6ba-b90d4da9a9ae tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:12.968987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-407fa326-51ce-4dd9-b6ba-b90d4da9a9ae tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:12.970543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-407fa326-51ce-4dd9-b6ba-b90d4da9a9ae tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:12.972215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-407fa326-51ce-4dd9-b6ba-b90d4da9a9ae tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:12.974481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-407fa326-51ce-4dd9-b6ba-b90d4da9a9ae tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:12.977091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-407fa326-51ce-4dd9-b6ba-b90d4da9a9ae tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:13.123056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3308e9d5-ab3f-411d-9cdc-fc58f6babaf2 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:13.204403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:13.236581 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3308e9d5-ab3f-411d-9cdc-fc58f6babaf2 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655" status: 200 len: 1322 microversion: 2.1 time: 1.068251 Sep 08 12:53:13.262114 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1397/2674] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:12 2022] GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 => generated 1322 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:13.735470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-407fa326-51ce-4dd9-b6ba-b90d4da9a9ae tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:13.748841 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-407fa326-51ce-4dd9-b6ba-b90d4da9a9ae tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1470 microversion: 2.1 time: 0.832100 Sep 08 12:53:13.749524 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1278/2675] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:12 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1470 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:13.958391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c7664651-acd8-494c-ae62-a62a679900c0 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:13.961560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c7664651-acd8-494c-ae62-a62a679900c0 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:13.994195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=12 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:14.004788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7664651-acd8-494c-ae62-a62a679900c0 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:14.006608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7664651-acd8-494c-ae62-a62a679900c0 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:14.007361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7664651-acd8-494c-ae62-a62a679900c0 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:14.010331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7664651-acd8-494c-ae62-a62a679900c0 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:14.012422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7664651-acd8-494c-ae62-a62a679900c0 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:14.013856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7664651-acd8-494c-ae62-a62a679900c0 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:14.302875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0845e91c-5da6-4bbd-92cf-1ce2edd7be87 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:14.307349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0845e91c-5da6-4bbd-92cf-1ce2edd7be87 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:14.322715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0845e91c-5da6-4bbd-92cf-1ce2edd7be87 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:14.323803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0845e91c-5da6-4bbd-92cf-1ce2edd7be87 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:14.324634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0845e91c-5da6-4bbd-92cf-1ce2edd7be87 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:14.325565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0845e91c-5da6-4bbd-92cf-1ce2edd7be87 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:14.327862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0845e91c-5da6-4bbd-92cf-1ce2edd7be87 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:14.328624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0845e91c-5da6-4bbd-92cf-1ce2edd7be87 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:15.604546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c7664651-acd8-494c-ae62-a62a679900c0 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:15.619102 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c7664651-acd8-494c-ae62-a62a679900c0 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1316 microversion: 2.1 time: 1.673422 Sep 08 12:53:15.622423 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1398/2676] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:13 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1316 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:15.651689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b757549f-871e-45fc-aeeb-8001fdd19b86 req-82c934cf-9888-406e-86b8-21df28071b29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "303d9b60-22cb-426b-826b-b9a0465696a2", "tag": "dbebedc8-4112-4036-a8d1-e89f23b4fcb2"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:15.736686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b757549f-871e-45fc-aeeb-8001fdd19b86 req-82c934cf-9888-406e-86b8-21df28071b29 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:15.737564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b757549f-871e-45fc-aeeb-8001fdd19b86 req-82c934cf-9888-406e-86b8-21df28071b29 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:15.738371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b757549f-871e-45fc-aeeb-8001fdd19b86 req-82c934cf-9888-406e-86b8-21df28071b29 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:15.811778 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b757549f-871e-45fc-aeeb-8001fdd19b86 req-82c934cf-9888-406e-86b8-21df28071b29 service nova] Creating event network-changed:dbebedc8-4112-4036-a8d1-e89f23b4fcb2 for instance 303d9b60-22cb-426b-826b-b9a0465696a2 on n-h2-852084-10 Sep 08 12:53:15.840507 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b757549f-871e-45fc-aeeb-8001fdd19b86 req-82c934cf-9888-406e-86b8-21df28071b29 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214140 Sep 08 12:53:15.841999 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1399/2677] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:15.860563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a110799a-e8a8-410c-9cc1-554d86e5a7ab tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:15.861781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a110799a-e8a8-410c-9cc1-554d86e5a7ab tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:15.881700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a110799a-e8a8-410c-9cc1-554d86e5a7ab tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:15.885037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a110799a-e8a8-410c-9cc1-554d86e5a7ab tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:15.885712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a110799a-e8a8-410c-9cc1-554d86e5a7ab tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:15.888196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a110799a-e8a8-410c-9cc1-554d86e5a7ab tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:15.889110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a110799a-e8a8-410c-9cc1-554d86e5a7ab tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:15.892276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a110799a-e8a8-410c-9cc1-554d86e5a7ab tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:16.092040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0845e91c-5da6-4bbd-92cf-1ce2edd7be87 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:16.130142 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0845e91c-5da6-4bbd-92cf-1ce2edd7be87 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655" status: 200 len: 1516 microversion: 2.1 time: 1.831998 Sep 08 12:53:16.135415 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1279/2678] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:14 2022] GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 => generated 1516 bytes in 1839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:16.508072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a110799a-e8a8-410c-9cc1-554d86e5a7ab tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:16.527702 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a110799a-e8a8-410c-9cc1-554d86e5a7ab tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1470 microversion: 2.1 time: 0.680803 Sep 08 12:53:16.545231 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1400/2679] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:15 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1470 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:16.652235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-26a8d312-7eed-4ecb-b46a-f833a6559427 req-c3c6ff2a-18b0-4182-96d6-94aadad196b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd99aba-87fc-409c-933d-9cd6b5b7240a", "name": "network-vif-plugged", "status": "completed", "tag": "268692c3-4721-4548-a1d6-bd081e18ab22"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:16.771030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-26a8d312-7eed-4ecb-b46a-f833a6559427 req-c3c6ff2a-18b0-4182-96d6-94aadad196b9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:16.779651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-26a8d312-7eed-4ecb-b46a-f833a6559427 req-c3c6ff2a-18b0-4182-96d6-94aadad196b9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:16.785016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-26a8d312-7eed-4ecb-b46a-f833a6559427 req-c3c6ff2a-18b0-4182-96d6-94aadad196b9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:16.858026 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-26a8d312-7eed-4ecb-b46a-f833a6559427 req-c3c6ff2a-18b0-4182-96d6-94aadad196b9 service nova] Creating event network-vif-plugged:268692c3-4721-4548-a1d6-bd081e18ab22 for instance fbd99aba-87fc-409c-933d-9cd6b5b7240a on n-h1-852084-10 Sep 08 12:53:16.909154 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-26a8d312-7eed-4ecb-b46a-f833a6559427 req-c3c6ff2a-18b0-4182-96d6-94aadad196b9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.768571 Sep 08 12:53:16.926491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-de851552-6319-43b4-bd7b-773c8974f06e tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb3f188c10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-564205777", "description": "tempest-description-1233608951"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:16.931857 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1280/2680] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:16.991885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3547af31-1406-4b11-a1f5-27741b269649 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:17.000884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3547af31-1406-4b11-a1f5-27741b269649 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 79750c09-f943-404e-ad11-211dbd9010e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:17.057888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3547af31-1406-4b11-a1f5-27741b269649 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:17.058806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3547af31-1406-4b11-a1f5-27741b269649 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:17.070686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3547af31-1406-4b11-a1f5-27741b269649 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:17.079400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3547af31-1406-4b11-a1f5-27741b269649 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:17.085017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3547af31-1406-4b11-a1f5-27741b269649 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:17.090570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3547af31-1406-4b11-a1f5-27741b269649 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:18.096144 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-de851552-6319-43b4-bd7b-773c8974f06e tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.547739 Sep 08 12:53:18.096888 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1401/2681] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:53:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:18.103600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-37f296e8-25f3-4596-8daa-8a892901ac13 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:18.107416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-37f296e8-25f3-4596-8daa-8a892901ac13 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:18.143954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37f296e8-25f3-4596-8daa-8a892901ac13 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:18.144654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37f296e8-25f3-4596-8daa-8a892901ac13 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:18.145165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37f296e8-25f3-4596-8daa-8a892901ac13 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:18.146027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37f296e8-25f3-4596-8daa-8a892901ac13 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:18.146576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37f296e8-25f3-4596-8daa-8a892901ac13 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:18.147085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37f296e8-25f3-4596-8daa-8a892901ac13 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:18.276430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3547af31-1406-4b11-a1f5-27741b269649 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:18.312682 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3547af31-1406-4b11-a1f5-27741b269649 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8" status: 200 len: 1516 microversion: 2.1 time: 1.355157 Sep 08 12:53:18.320505 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1281/2682] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:16 2022] GET /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8 => generated 1516 bytes in 1386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:18.349968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec05ecf3-9daa-4de5-805e-37aa06e4778a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:18.360967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ec05ecf3-9daa-4de5-805e-37aa06e4778a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:18.426618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec05ecf3-9daa-4de5-805e-37aa06e4778a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:18.429439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec05ecf3-9daa-4de5-805e-37aa06e4778a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:18.430251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec05ecf3-9daa-4de5-805e-37aa06e4778a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:18.433373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec05ecf3-9daa-4de5-805e-37aa06e4778a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:18.436198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec05ecf3-9daa-4de5-805e-37aa06e4778a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:18.436983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec05ecf3-9daa-4de5-805e-37aa06e4778a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:18.606130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=10 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:18.866423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-37f296e8-25f3-4596-8daa-8a892901ac13 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:18.882339 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-37f296e8-25f3-4596-8daa-8a892901ac13 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1316 microversion: 2.1 time: 0.784178 Sep 08 12:53:18.884570 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1402/2683] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:18 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1316 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:18.915066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-88c12170-78e7-489a-937a-555c9d6813f3 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb3f0bd790>, body: {"security_group_rule": {"parent_group_id": "096cb59f-664a-4d70-a18b-03ffae21d6ac", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:19.343438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ec05ecf3-9daa-4de5-805e-37aa06e4778a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:19.362453 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ec05ecf3-9daa-4de5-805e-37aa06e4778a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1470 microversion: 2.1 time: 1.039557 Sep 08 12:53:19.390498 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1282/2684] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:18 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1470 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:19.403481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cacb5b26-2c0d-4592-822f-924ebd7407ba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:19.404444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cacb5b26-2c0d-4592-822f-924ebd7407ba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: fbd99aba-87fc-409c-933d-9cd6b5b7240a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:19.448346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cacb5b26-2c0d-4592-822f-924ebd7407ba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:19.448843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cacb5b26-2c0d-4592-822f-924ebd7407ba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:19.449281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cacb5b26-2c0d-4592-822f-924ebd7407ba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:19.458599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cacb5b26-2c0d-4592-822f-924ebd7407ba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:19.462073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cacb5b26-2c0d-4592-822f-924ebd7407ba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:19.463542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cacb5b26-2c0d-4592-822f-924ebd7407ba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:20.210147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cacb5b26-2c0d-4592-822f-924ebd7407ba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:20.240088 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cacb5b26-2c0d-4592-822f-924ebd7407ba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a" status: 200 len: 1322 microversion: 2.1 time: 0.847705 Sep 08 12:53:20.241225 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1283/2685] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:19 2022] GET /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a => generated 1322 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:20.253935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1418310580", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "98e79a6c-9643-4148-b63a-0d134c328b76"}, {"uuid": "758424aa-a57a-4ef4-9f5c-fa51e6f4348a"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:20.459186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] validate_networks() for [('98e79a6c-9643-4148-b63a-0d134c328b76', None, None, None, None, None), ('758424aa-a57a-4ef4-9f5c-fa51e6f4348a', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:53:20.660964 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-88c12170-78e7-489a-937a-555c9d6813f3 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.768489 Sep 08 12:53:20.662783 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1403/2686] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:53:18 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:20.669565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-85941952-f69a-4eba-ba23-00255d128675 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:20.670589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-85941952-f69a-4eba-ba23-00255d128675 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:20.693476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85941952-f69a-4eba-ba23-00255d128675 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:20.694354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85941952-f69a-4eba-ba23-00255d128675 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:20.699910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85941952-f69a-4eba-ba23-00255d128675 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:20.703877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85941952-f69a-4eba-ba23-00255d128675 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:20.704883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85941952-f69a-4eba-ba23-00255d128675 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:20.706253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85941952-f69a-4eba-ba23-00255d128675 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:22.277004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-85941952-f69a-4eba-ba23-00255d128675 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:22.353303 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-85941952-f69a-4eba-ba23-00255d128675 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1316 microversion: 2.1 time: 1.679106 Sep 08 12:53:22.361506 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1404/2687] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:20 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1316 bytes in 1697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:22.391991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5d36a1e5-5c96-4956-be30-7d9429591640 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:22.393329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5d36a1e5-5c96-4956-be30-7d9429591640 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:22.410596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=70 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:22.441966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d36a1e5-5c96-4956-be30-7d9429591640 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:22.443358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d36a1e5-5c96-4956-be30-7d9429591640 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:22.444549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d36a1e5-5c96-4956-be30-7d9429591640 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:22.447065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d36a1e5-5c96-4956-be30-7d9429591640 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:22.448428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d36a1e5-5c96-4956-be30-7d9429591640 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:22.466964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d36a1e5-5c96-4956-be30-7d9429591640 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:23.460865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5d36a1e5-5c96-4956-be30-7d9429591640 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:23.479820 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5d36a1e5-5c96-4956-be30-7d9429591640 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1470 microversion: 2.1 time: 1.106084 Sep 08 12:53:23.480863 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1405/2688] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:22 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1470 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:23.521722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9af07ac3-b6aa-499e-ba19-fa9a8fc73948 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb363fa700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-428175770", "description": "tempest-description-365896926"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:24.197238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:53:24.200116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:53:24.201809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:53:24.203002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:53:24.205579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:53:24.254484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:24.281250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:24.282563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:24.284430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:24.308840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:24.309420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:24.355325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:24.424499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Getting quotas for project a2b4bb04764e484099a1380cee0343d9. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:53:24.448616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Getting quotas for user 7063832f6c334d26bd0f30b5b16116b4 and project a2b4bb04764e484099a1380cee0343d9. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:53:24.553978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:53:24.556932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:53:24.830735 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d4e1ec5c-1474-4c9a-ade1-ce25bea0d004 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.583868 Sep 08 12:53:24.842675 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1284/2689] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:53:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:53:24.870246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a70ae19d-a8b1-4b5c-9283-7bc826bf0fba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:24.871028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a70ae19d-a8b1-4b5c-9283-7bc826bf0fba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: fbd99aba-87fc-409c-933d-9cd6b5b7240a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:24.908797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a70ae19d-a8b1-4b5c-9283-7bc826bf0fba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:24.908956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a70ae19d-a8b1-4b5c-9283-7bc826bf0fba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:24.909278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a70ae19d-a8b1-4b5c-9283-7bc826bf0fba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:24.916554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a70ae19d-a8b1-4b5c-9283-7bc826bf0fba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:24.917053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a70ae19d-a8b1-4b5c-9283-7bc826bf0fba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:24.929343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a70ae19d-a8b1-4b5c-9283-7bc826bf0fba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:24.975374 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9af07ac3-b6aa-499e-ba19-fa9a8fc73948 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.491507 Sep 08 12:53:24.975882 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1406/2690] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:53:23 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:24.981523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7111b0ed-262d-4552-ab0b-da5f17d96d9b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:24.982637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7111b0ed-262d-4552-ab0b-da5f17d96d9b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:25.019986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7111b0ed-262d-4552-ab0b-da5f17d96d9b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:25.020489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7111b0ed-262d-4552-ab0b-da5f17d96d9b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:25.028094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7111b0ed-262d-4552-ab0b-da5f17d96d9b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:25.036813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7111b0ed-262d-4552-ab0b-da5f17d96d9b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:25.037774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7111b0ed-262d-4552-ab0b-da5f17d96d9b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:25.041449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7111b0ed-262d-4552-ab0b-da5f17d96d9b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:25.894702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a70ae19d-a8b1-4b5c-9283-7bc826bf0fba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:25.908573 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a70ae19d-a8b1-4b5c-9283-7bc826bf0fba tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a" status: 200 len: 1515 microversion: 2.1 time: 1.065855 Sep 08 12:53:25.919014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7111b0ed-262d-4552-ab0b-da5f17d96d9b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:25.923019 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1285/2691] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:24 2022] GET /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a => generated 1515 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:25.931971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-23537cd2-35aa-4a2c-a167-90aad0baffa1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:25.946335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-23537cd2-35aa-4a2c-a167-90aad0baffa1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:25.966655 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7111b0ed-262d-4552-ab0b-da5f17d96d9b tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1316 microversion: 2.1 time: 0.989173 Sep 08 12:53:25.975340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23537cd2-35aa-4a2c-a167-90aad0baffa1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:25.982877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23537cd2-35aa-4a2c-a167-90aad0baffa1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:25.983807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23537cd2-35aa-4a2c-a167-90aad0baffa1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:25.985617 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1407/2692] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:24 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1316 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:25.988250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23537cd2-35aa-4a2c-a167-90aad0baffa1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:25.993186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23537cd2-35aa-4a2c-a167-90aad0baffa1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:25.995125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23537cd2-35aa-4a2c-a167-90aad0baffa1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:26.016805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-81672b2c-66dc-4860-b783-db4e46ab8a08 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:26.017843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-81672b2c-66dc-4860-b783-db4e46ab8a08 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:26.784014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-81672b2c-66dc-4860-b783-db4e46ab8a08 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:26.797861 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-81672b2c-66dc-4860-b783-db4e46ab8a08 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1213 microversion: 2.1 time: 0.807231 Sep 08 12:53:26.800515 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1408/2693] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:25 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1213 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:26.814791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0b07b843-84ed-41d9-88f7-495b1078c5be tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb3f2ede50>, body: {"security_group_rule": {"parent_group_id": "2ac9ae55-ad88-4413-a699-f5ececc9ea2d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:26.960859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-23537cd2-35aa-4a2c-a167-90aad0baffa1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:26.970811 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-23537cd2-35aa-4a2c-a167-90aad0baffa1 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1470 microversion: 2.1 time: 1.046349 Sep 08 12:53:26.981132 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1286/2694] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:25 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1470 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:27.004780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-37e0699a-50cd-474d-8f33-87234fbee83e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:27.005772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-37e0699a-50cd-474d-8f33-87234fbee83e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 79750c09-f943-404e-ad11-211dbd9010e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:27.029847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37e0699a-50cd-474d-8f33-87234fbee83e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:27.030335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37e0699a-50cd-474d-8f33-87234fbee83e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:27.030970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37e0699a-50cd-474d-8f33-87234fbee83e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:27.031916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37e0699a-50cd-474d-8f33-87234fbee83e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:27.032554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37e0699a-50cd-474d-8f33-87234fbee83e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:27.033149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37e0699a-50cd-474d-8f33-87234fbee83e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:27.096455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-37e0699a-50cd-474d-8f33-87234fbee83e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 79750c09-f943-404e-ad11-211dbd9010e8] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:53:27.515046 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-37e0699a-50cd-474d-8f33-87234fbee83e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "DELETE /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8" status: 204 len: 0 microversion: 2.1 time: 0.505645 Sep 08 12:53:27.537591 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1287/2695] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:53:26 2022] DELETE /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:27.582278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-495aacbf-2a44-4b97-b277-4ce3b3161b14 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:27.585079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-495aacbf-2a44-4b97-b277-4ce3b3161b14 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:27.608261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-495aacbf-2a44-4b97-b277-4ce3b3161b14 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:27.610468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-495aacbf-2a44-4b97-b277-4ce3b3161b14 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:27.614866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-495aacbf-2a44-4b97-b277-4ce3b3161b14 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:27.618284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-495aacbf-2a44-4b97-b277-4ce3b3161b14 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:27.619525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-495aacbf-2a44-4b97-b277-4ce3b3161b14 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:27.622559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-495aacbf-2a44-4b97-b277-4ce3b3161b14 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:27.730824 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0b07b843-84ed-41d9-88f7-495b1078c5be tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.929117 Sep 08 12:53:27.731621 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1409/2696] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:53:26 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:28.270808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-495aacbf-2a44-4b97-b277-4ce3b3161b14 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:28.281767 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-495aacbf-2a44-4b97-b277-4ce3b3161b14 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1316 microversion: 2.1 time: 0.735583 Sep 08 12:53:28.285825 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1288/2697] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:27 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1316 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:28.294417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7b36c71e-8396-4ee4-b18b-0e7366046356 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:28.316679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7b36c71e-8396-4ee4-b18b-0e7366046356 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 79750c09-f943-404e-ad11-211dbd9010e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:28.333950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b36c71e-8396-4ee4-b18b-0e7366046356 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:28.335048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b36c71e-8396-4ee4-b18b-0e7366046356 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:28.336919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b36c71e-8396-4ee4-b18b-0e7366046356 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:28.342170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b36c71e-8396-4ee4-b18b-0e7366046356 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:28.348145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b36c71e-8396-4ee4-b18b-0e7366046356 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:28.349109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b36c71e-8396-4ee4-b18b-0e7366046356 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:28.604982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-058a329f-03fa-4f04-9ecc-ee10a106bb9c tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Action: 'create', calling method: .version_select at 0x7fdb3f2d5dc0>, body: {"keypair": {"name": "tempest-keypair-272509801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCz4RfDiJ1Dnwef5+vcZhAqkrH1n/8sPSOf5FRZgp3w2l5gwbV43ydaJ+Wun2GVXsojhXHUTXejssjyGUU6+HG0+2koWyjsJVh4UQnZj/JkBlOBw1wdcVx2IVy8yZwq1nQ=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:28.674312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-058a329f-03fa-4f04-9ecc-ee10a106bb9c tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:53:28.692668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-058a329f-03fa-4f04-9ecc-ee10a106bb9c tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for user a1cb1faa2f56470689d731f6271d17b6 and project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:53:28.752473 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-058a329f-03fa-4f04-9ecc-ee10a106bb9c tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 1.019634 Sep 08 12:53:28.760996 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1410/2698] 10.222.0.78 () {62 vars in 1199 bytes} [Thu Sep 8 12:53:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1029 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 12:53:28.766697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bb493816-2dd1-4fd4-8ae0-89676a0dc7a4 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb3f0ea5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1014766487", "description": "tempest-description-767848691"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:29.188230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7b36c71e-8396-4ee4-b18b-0e7366046356 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:29.204154 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7b36c71e-8396-4ee4-b18b-0e7366046356 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8" status: 200 len: 1522 microversion: 2.1 time: 0.916763 Sep 08 12:53:29.204840 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1289/2699] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:28 2022] GET /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8 => generated 1522 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:29.234551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-41a8dd2e-4116-418b-af40-2ca812a33be7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:29.235188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-41a8dd2e-4116-418b-af40-2ca812a33be7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:29.251361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41a8dd2e-4116-418b-af40-2ca812a33be7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:29.252255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41a8dd2e-4116-418b-af40-2ca812a33be7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:29.252884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41a8dd2e-4116-418b-af40-2ca812a33be7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:29.253875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41a8dd2e-4116-418b-af40-2ca812a33be7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:29.254651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41a8dd2e-4116-418b-af40-2ca812a33be7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:29.255289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41a8dd2e-4116-418b-af40-2ca812a33be7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:29.431880 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bb493816-2dd1-4fd4-8ae0-89676a0dc7a4 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.669361 Sep 08 12:53:29.433190 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1411/2700] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:53:28 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:29.438322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e506a7b8-eb05-4107-b2c7-942a51252f68 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:29.439312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e506a7b8-eb05-4107-b2c7-942a51252f68 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:29.467534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e506a7b8-eb05-4107-b2c7-942a51252f68 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:29.468262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e506a7b8-eb05-4107-b2c7-942a51252f68 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:29.468723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e506a7b8-eb05-4107-b2c7-942a51252f68 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:29.469496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e506a7b8-eb05-4107-b2c7-942a51252f68 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:29.469974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e506a7b8-eb05-4107-b2c7-942a51252f68 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:29.470409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e506a7b8-eb05-4107-b2c7-942a51252f68 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:29.482791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-41a8dd2e-4116-418b-af40-2ca812a33be7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:29.500809 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-41a8dd2e-4116-418b-af40-2ca812a33be7 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1271 microversion: 2.1 time: 0.278149 Sep 08 12:53:29.505412 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1290/2701] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:29 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1271 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:29.526754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-04669eb7-0c59-40a5-aa05-523b66bcf0bc tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb3b08dee0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:29.558644 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-04669eb7-0c59-40a5-aa05-523b66bcf0bc tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-272509801" status: 200 len: 512 microversion: 2.2 time: 0.047912 Sep 08 12:53:29.569353 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1291/2702] 10.222.0.78 () {60 vars in 1255 bytes} [Thu Sep 8 12:53:29 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-272509801 => generated 512 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:29.575496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-8a9c0e8c-ec23-4ab9-aa31-782689bf27b2 req-681448fe-fea9-4994-9c93-6edaebd957c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303d9b60-22cb-426b-826b-b9a0465696a2", "name": "network-vif-plugged", "status": "completed", "tag": "dbebedc8-4112-4036-a8d1-e89f23b4fcb2"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:29.605898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8a9c0e8c-ec23-4ab9-aa31-782689bf27b2 req-681448fe-fea9-4994-9c93-6edaebd957c9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:29.606380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8a9c0e8c-ec23-4ab9-aa31-782689bf27b2 req-681448fe-fea9-4994-9c93-6edaebd957c9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:29.606822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8a9c0e8c-ec23-4ab9-aa31-782689bf27b2 req-681448fe-fea9-4994-9c93-6edaebd957c9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:29.624035 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-8a9c0e8c-ec23-4ab9-aa31-782689bf27b2 req-681448fe-fea9-4994-9c93-6edaebd957c9 service nova] Creating event network-vif-plugged:dbebedc8-4112-4036-a8d1-e89f23b4fcb2 for instance 303d9b60-22cb-426b-826b-b9a0465696a2 on n-h2-852084-10 Sep 08 12:53:29.632453 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-8a9c0e8c-ec23-4ab9-aa31-782689bf27b2 req-681448fe-fea9-4994-9c93-6edaebd957c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066565 Sep 08 12:53:29.634270 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1292/2703] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:29.641843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-43ff1df9-53bd-432d-be69-0dd55283123e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:29.642432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-43ff1df9-53bd-432d-be69-0dd55283123e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:29.655021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43ff1df9-53bd-432d-be69-0dd55283123e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:29.655993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43ff1df9-53bd-432d-be69-0dd55283123e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:29.656790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43ff1df9-53bd-432d-be69-0dd55283123e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:29.658428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43ff1df9-53bd-432d-be69-0dd55283123e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:29.661039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43ff1df9-53bd-432d-be69-0dd55283123e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:29.662567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43ff1df9-53bd-432d-be69-0dd55283123e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:30.489916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-43ff1df9-53bd-432d-be69-0dd55283123e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:30.506556 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-43ff1df9-53bd-432d-be69-0dd55283123e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1316 microversion: 2.1 time: 0.870671 Sep 08 12:53:30.508462 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1293/2704] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:29 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1316 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:30.528414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-feb3f0ce-e2bc-42a6-8f9a-7cabaf0d37ff tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb3f090a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-681288124", "description": "tempest-description-2077216141"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:30.599018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e506a7b8-eb05-4107-b2c7-942a51252f68 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:30.642723 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e506a7b8-eb05-4107-b2c7-942a51252f68 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1470 microversion: 2.1 time: 1.207496 Sep 08 12:53:30.644991 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1412/2705] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:29 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1470 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:30.655702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d05a8eb3-2dd1-4cab-b6fb-bc7e65a12682 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb3f2d5790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:30.709280 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d05a8eb3-2dd1-4cab-b6fb-bc7e65a12682 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-272509801" status: 204 len: 0 microversion: 2.2 time: 0.061084 Sep 08 12:53:30.711673 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1413/2706] 10.222.0.78 () {60 vars in 1258 bytes} [Thu Sep 8 12:53:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-272509801 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:30.756677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc64999c-c2e9-4b99-9d75-7cfe2101c919 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:30.760403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cc64999c-c2e9-4b99-9d75-7cfe2101c919 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 79750c09-f943-404e-ad11-211dbd9010e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:30.780846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc64999c-c2e9-4b99-9d75-7cfe2101c919 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:30.783669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc64999c-c2e9-4b99-9d75-7cfe2101c919 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:30.786162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc64999c-c2e9-4b99-9d75-7cfe2101c919 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:30.792237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc64999c-c2e9-4b99-9d75-7cfe2101c919 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:30.794046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc64999c-c2e9-4b99-9d75-7cfe2101c919 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:30.794754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc64999c-c2e9-4b99-9d75-7cfe2101c919 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:31.050107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cc64999c-c2e9-4b99-9d75-7cfe2101c919 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:31.078336 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc64999c-c2e9-4b99-9d75-7cfe2101c919 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8" status: 200 len: 1307 microversion: 2.1 time: 0.364708 Sep 08 12:53:31.092055 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1414/2707] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:30 2022] GET /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8 => generated 1307 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:31.105546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dc71412d-fd1e-4e1e-ba61-fcb4077bd0b9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:31.107624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dc71412d-fd1e-4e1e-ba61-fcb4077bd0b9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:31.118981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc71412d-fd1e-4e1e-ba61-fcb4077bd0b9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:31.119864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc71412d-fd1e-4e1e-ba61-fcb4077bd0b9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:31.120726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc71412d-fd1e-4e1e-ba61-fcb4077bd0b9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:31.121706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc71412d-fd1e-4e1e-ba61-fcb4077bd0b9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:31.122355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc71412d-fd1e-4e1e-ba61-fcb4077bd0b9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:31.123451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc71412d-fd1e-4e1e-ba61-fcb4077bd0b9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:31.252230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dc71412d-fd1e-4e1e-ba61-fcb4077bd0b9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:31.275527 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dc71412d-fd1e-4e1e-ba61-fcb4077bd0b9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1271 microversion: 2.1 time: 0.181789 Sep 08 12:53:31.276448 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1415/2708] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:31 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1271 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:31.372142 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-feb3f0ce-e2bc-42a6-8f9a-7cabaf0d37ff tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.862184 Sep 08 12:53:31.373786 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1294/2709] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:53:30 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:31.379214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-67760e31-f73b-4043-9db0-9362b0221181 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Action: 'create', calling method: .version_select at 0x7fdb3f095a60>, body: {"keypair": {"name": "tempest-keypair-137955780", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOez9156fLny90oUVb4GT9NEvFCY2KAEOGUnr8gp1FrvySwbDN7ZzvFvYlJlNlePdC4xhbNJ7E+1UPfBqENp2K2sbKvkqHjWH+slTg7E5IJjYIfTFg8amdiAgpJXF7MPQ=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:31.426467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-67760e31-f73b-4043-9db0-9362b0221181 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:53:31.439385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-67760e31-f73b-4043-9db0-9362b0221181 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for user a1cb1faa2f56470689d731f6271d17b6 and project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:53:31.490574 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-67760e31-f73b-4043-9db0-9362b0221181 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.2 time: 0.115339 Sep 08 12:53:31.493749 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1295/2710] 10.222.0.78 () {62 vars in 1199 bytes} [Thu Sep 8 12:53:31 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 12:53:31.500626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-42968ada-0405-49b9-9269-9124ce7ca269 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb3f0bfd30>, body: {"security_group_rule": {"parent_group_id": "f84dcab4-4f70-47b3-84a5-919b11ca1fad", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d9fb9209-6e02-41bf-a52e-dabe8d1d3461"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:31.534086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b0884a8d-8b9b-4ca2-ab60-8b8eebaf7f53 req-3cab24e7-6d0f-46bd-a21b-00f46c041c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79750c09-f943-404e-ad11-211dbd9010e8", "name": "network-vif-deleted", "tag": "f6d3df96-4079-4a81-9573-322e42ef4c46"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:31.552230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b0884a8d-8b9b-4ca2-ab60-8b8eebaf7f53 req-3cab24e7-6d0f-46bd-a21b-00f46c041c8c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:31.554354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b0884a8d-8b9b-4ca2-ab60-8b8eebaf7f53 req-3cab24e7-6d0f-46bd-a21b-00f46c041c8c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:31.555641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b0884a8d-8b9b-4ca2-ab60-8b8eebaf7f53 req-3cab24e7-6d0f-46bd-a21b-00f46c041c8c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:31.576915 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b0884a8d-8b9b-4ca2-ab60-8b8eebaf7f53 req-3cab24e7-6d0f-46bd-a21b-00f46c041c8c service nova] Creating event network-vif-deleted:f6d3df96-4079-4a81-9573-322e42ef4c46 for instance 79750c09-f943-404e-ad11-211dbd9010e8 on n-h1-852084-10 Sep 08 12:53:31.590390 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b0884a8d-8b9b-4ca2-ab60-8b8eebaf7f53 req-3cab24e7-6d0f-46bd-a21b-00f46c041c8c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.312572 Sep 08 12:53:31.592913 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1416/2711] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:31.601496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-140f6d05-8ee1-4a70-9593-b0db2abaf16a tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb3f1e1b80>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:31.678990 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-140f6d05-8ee1-4a70-9593-b0db2abaf16a tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-137955780" status: 204 len: 0 microversion: 2.2 time: 0.084410 Sep 08 12:53:31.688204 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1417/2712] 10.222.0.78 () {60 vars in 1258 bytes} [Thu Sep 8 12:53:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-137955780 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:31.702743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f8308ede-cedb-4e0c-a58d-9c76fa283d81 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:31.703518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f8308ede-cedb-4e0c-a58d-9c76fa283d81 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:31.724573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8308ede-cedb-4e0c-a58d-9c76fa283d81 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:31.725387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8308ede-cedb-4e0c-a58d-9c76fa283d81 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:31.725834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8308ede-cedb-4e0c-a58d-9c76fa283d81 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:31.726621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8308ede-cedb-4e0c-a58d-9c76fa283d81 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:31.727091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8308ede-cedb-4e0c-a58d-9c76fa283d81 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:31.735689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8308ede-cedb-4e0c-a58d-9c76fa283d81 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:32.436839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f8308ede-cedb-4e0c-a58d-9c76fa283d81 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:32.447806 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f8308ede-cedb-4e0c-a58d-9c76fa283d81 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1316 microversion: 2.1 time: 0.757995 Sep 08 12:53:32.451416 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1418/2713] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:31 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1316 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:32.457010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7bcd2246-a28d-4fc4-b16a-8d61845ca2d6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:32.457692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7bcd2246-a28d-4fc4-b16a-8d61845ca2d6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:32.486246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bcd2246-a28d-4fc4-b16a-8d61845ca2d6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:32.487498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bcd2246-a28d-4fc4-b16a-8d61845ca2d6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:32.488147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bcd2246-a28d-4fc4-b16a-8d61845ca2d6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:32.489255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bcd2246-a28d-4fc4-b16a-8d61845ca2d6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:32.489919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bcd2246-a28d-4fc4-b16a-8d61845ca2d6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:32.490344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bcd2246-a28d-4fc4-b16a-8d61845ca2d6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:32.801915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7bcd2246-a28d-4fc4-b16a-8d61845ca2d6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:32.818071 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7bcd2246-a28d-4fc4-b16a-8d61845ca2d6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1470 microversion: 2.1 time: 0.365018 Sep 08 12:53:32.819842 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1419/2714] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:32 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1470 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:32.835842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fba625eb-8c5b-4cda-af9b-0472f8905227 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Action: 'create', calling method: .version_select at 0x7fdb3f0ea3a0>, body: {"keypair": {"name": "tempest-keypair-954818925", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:32.907052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-fba625eb-8c5b-4cda-af9b-0472f8905227 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:53:32.918064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-fba625eb-8c5b-4cda-af9b-0472f8905227 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for user a1cb1faa2f56470689d731f6271d17b6 and project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:53:33.112907 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fba625eb-8c5b-4cda-af9b-0472f8905227 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.290051 Sep 08 12:53:33.115533 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1420/2715] 10.222.0.78 () {62 vars in 1199 bytes} [Thu Sep 8 12:53:32 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 295 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 12:53:33.174834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9313fff3-320a-4a00-a7ae-1248fdaae5f7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:33.174834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9313fff3-320a-4a00-a7ae-1248fdaae5f7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 79750c09-f943-404e-ad11-211dbd9010e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:33.174834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9313fff3-320a-4a00-a7ae-1248fdaae5f7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:33.174834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9313fff3-320a-4a00-a7ae-1248fdaae5f7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:33.174834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9313fff3-320a-4a00-a7ae-1248fdaae5f7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:33.174834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9313fff3-320a-4a00-a7ae-1248fdaae5f7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:33.174834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9313fff3-320a-4a00-a7ae-1248fdaae5f7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:33.174834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9313fff3-320a-4a00-a7ae-1248fdaae5f7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:33.178983 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-9313fff3-320a-4a00-a7ae-1248fdaae5f7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] HTTP exception thrown: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9313fff3-320a-4a00-a7ae-1248fdaae5f7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Request method failure captured: Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8 HTTP/1.1 Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeWaVm7fmtD9Wms8wxtEFJsPbX0YHvfp71TtA6Hwb_psRW1xlVGv5GwCWlm_0qVFnDzJm3U1sVmSXKSnnnkMX90fcd_25sEKdZktE3J_D8TIRi-g-9FSZYhQDahEUZRS5gGi8Q5VU3onwOXgQcdWb1tkmQBjxB5A3Ve8bKe-_m1ZgPc Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 3beb0e265d694cd3bf2f92e31ab95dfd Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '79750c09-f943-404e-ad11-211dbd9010e8'} Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:33.184035 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:33.191830 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:33.191830 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:33.191830 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:33.191830 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:33.191830 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:53:33.191830 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:53:33.191830 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:33.191830 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:33.194712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9313fff3-320a-4a00-a7ae-1248fdaae5f7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Returning 404 to user: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:33.196849 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9313fff3-320a-4a00-a7ae-1248fdaae5f7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8" status: 404 len: 111 microversion: 2.1 time: 0.077740 Sep 08 12:53:33.198713 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1421/2716] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:33 2022] GET /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:53:33.213974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be9f2d64-0f92-4595-b8bf-084c443f5193 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:33.214972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-be9f2d64-0f92-4595-b8bf-084c443f5193 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:33.232296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be9f2d64-0f92-4595-b8bf-084c443f5193 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:33.233156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be9f2d64-0f92-4595-b8bf-084c443f5193 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:33.233983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be9f2d64-0f92-4595-b8bf-084c443f5193 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:33.235207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be9f2d64-0f92-4595-b8bf-084c443f5193 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:33.236629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be9f2d64-0f92-4595-b8bf-084c443f5193 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:33.238309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be9f2d64-0f92-4595-b8bf-084c443f5193 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:33.412104 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-42968ada-0405-49b9-9269-9124ce7ca269 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.915996 Sep 08 12:53:33.418477 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1296/2717] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:53:31 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:33.440705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c9678af5-c627-4f29-a545-438d434cea2e tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb3ac01280>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:33.499067 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c9678af5-c627-4f29-a545-438d434cea2e tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-954818925" status: 204 len: 0 microversion: 2.2 time: 0.077983 Sep 08 12:53:33.508257 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1297/2718] 10.222.0.78 () {60 vars in 1258 bytes} [Thu Sep 8 12:53:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-954818925 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:33.548798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-65fc87f6-ebc4-400d-8613-614d5fd7f265 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:33.563676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-65fc87f6-ebc4-400d-8613-614d5fd7f265 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:33.565465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-65fc87f6-ebc4-400d-8613-614d5fd7f265 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'd49e8717cae0454e87b2e01790fc296c'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:53:33.575535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-be9f2d64-0f92-4595-b8bf-084c443f5193 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:33.600909 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-be9f2d64-0f92-4595-b8bf-084c443f5193 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1313 microversion: 2.1 time: 0.399789 Sep 08 12:53:33.603883 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1422/2719] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:33 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1313 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:33.616634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-580374fb-99a3-4e4b-b7d1-fbc43b6ea114 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb3f2d5550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2131992206", "description": "tempest-description-1087452389"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:33.636039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65fc87f6-ebc4-400d-8613-614d5fd7f265 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:33.637635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65fc87f6-ebc4-400d-8613-614d5fd7f265 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:33.639205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65fc87f6-ebc4-400d-8613-614d5fd7f265 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:33.641410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65fc87f6-ebc4-400d-8613-614d5fd7f265 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:33.642816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65fc87f6-ebc4-400d-8613-614d5fd7f265 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:33.645550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65fc87f6-ebc4-400d-8613-614d5fd7f265 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:33.875955 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-65fc87f6-ebc4-400d-8613-614d5fd7f265 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.373603 Sep 08 12:53:33.887203 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1298/2720] 10.222.0.78 () {58 vars in 1230 bytes} [Thu Sep 8 12:53:33 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:53:33.894489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e6a29c67-95d3-49b0-a8d7-81b38ec2d204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:33.896959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e6a29c67-95d3-49b0-a8d7-81b38ec2d204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:33.906940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e6a29c67-95d3-49b0-a8d7-81b38ec2d204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:33.907861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e6a29c67-95d3-49b0-a8d7-81b38ec2d204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:33.908521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e6a29c67-95d3-49b0-a8d7-81b38ec2d204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:33.909620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e6a29c67-95d3-49b0-a8d7-81b38ec2d204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:33.910980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e6a29c67-95d3-49b0-a8d7-81b38ec2d204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:33.911710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e6a29c67-95d3-49b0-a8d7-81b38ec2d204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:34.463628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e6a29c67-95d3-49b0-a8d7-81b38ec2d204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:34.474244 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e6a29c67-95d3-49b0-a8d7-81b38ec2d204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1503 microversion: 2.1 time: 0.585472 Sep 08 12:53:34.479784 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1299/2721] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:33 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1503 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:34.488150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1660199d-69f3-4e35-acb9-d11b6fb093f4 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Action: 'create', calling method: .version_select at 0x7fdb3abbaa60>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1677706138", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJS/raXM9fu4JLkrxrU9+ZsdPvqfV+71lqtXCdFi+SkfpocbKxVnL2M/PkTKj6Vn3yPMUB6zwimjs1sfPocX67UBO39ohbC89lEPdWkeYiaow35AgD2VLsG+C3gYYPIwA=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:34.491878 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-580374fb-99a3-4e4b-b7d1-fbc43b6ea114 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.885444 Sep 08 12:53:34.493350 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1423/2722] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:53:33 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:34.509782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-58b30bce-2645-4f3d-8572-80c28bf39a61 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:34.510414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58b30bce-2645-4f3d-8572-80c28bf39a61 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:34.523864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58b30bce-2645-4f3d-8572-80c28bf39a61 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:34.524386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58b30bce-2645-4f3d-8572-80c28bf39a61 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:34.524833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58b30bce-2645-4f3d-8572-80c28bf39a61 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:34.525653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58b30bce-2645-4f3d-8572-80c28bf39a61 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:34.526369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58b30bce-2645-4f3d-8572-80c28bf39a61 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:34.527032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58b30bce-2645-4f3d-8572-80c28bf39a61 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:34.538647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-1660199d-69f3-4e35-acb9-d11b6fb093f4 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:53:34.556866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-1660199d-69f3-4e35-acb9-d11b6fb093f4 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for user a1cb1faa2f56470689d731f6271d17b6 and project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:53:34.636339 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1660199d-69f3-4e35-acb9-d11b6fb093f4 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.154923 Sep 08 12:53:34.638259 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1300/2723] 10.222.0.78 () {62 vars in 1199 bytes} [Thu Sep 8 12:53:34 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 158 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 12:53:34.661810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c1dd8a5b-22bd-4b42-8af9-54281666d6d3 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c1dd8a5b-22bd-4b42-8af9-54281666d6d3 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Request method failure captured: Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeWaVm7fmtD9Wms8wxtEFJsPbX0YHvfp71TtA6Hwb_psRW1xlVGv5GwCWlm_0qVFnDzJm3U1sVmSXKSnnnkMX90fcd_25sEKdZktE3J_D8TIRi-g-9FSZYhQDahEUZRS5gGi8Q5VU3onwOXgQcdWb1tkmQBjxB5A3Ve8bKe-_m1ZgPc Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 3beb0e265d694cd3bf2f92e31ab95dfd Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: action_args: {} Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi '2011/01/01' Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 08 12:53:34.674936 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c1dd8a5b-22bd-4b42-8af9-54281666d6d3 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c1dd8a5b-22bd-4b42-8af9-54281666d6d3 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.032041 Sep 08 12:53:34.685718 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1301/2724] 10.222.0.78 () {58 vars in 1182 bytes} [Thu Sep 8 12:53:34 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 33 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:53:34.710697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c4b1207f-b02f-46ae-afa2-d0179fa013cb tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1023438489"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:34.710697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c4b1207f-b02f-46ae-afa2-d0179fa013cb tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:34.712974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4b1207f-b02f-46ae-afa2-d0179fa013cb tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:34.713488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4b1207f-b02f-46ae-afa2-d0179fa013cb tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:34.713930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4b1207f-b02f-46ae-afa2-d0179fa013cb tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:34.716174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4b1207f-b02f-46ae-afa2-d0179fa013cb tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:34.716668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4b1207f-b02f-46ae-afa2-d0179fa013cb tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:34.717144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4b1207f-b02f-46ae-afa2-d0179fa013cb tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:34.920971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-58b30bce-2645-4f3d-8572-80c28bf39a61 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:34.931568 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-58b30bce-2645-4f3d-8572-80c28bf39a61 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1470 microversion: 2.1 time: 0.436802 Sep 08 12:53:34.945730 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1424/2725] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:34 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1470 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:34.952663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c4b79a2-491f-4faf-95dd-bb59742735a4 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb3f271700>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-327827014", "description": "tempest-description-282886433"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:35.068721 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.network.security_group_api [None req-c4b1207f-b02f-46ae-afa2-d0179fa013cb tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Adding security group 47544d8f-6c23-4446-9f95-ca12bb3db608 to port dbebedc8-4112-4036-a8d1-e89f23b4fcb2 Sep 08 12:53:35.482567 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c4b79a2-491f-4faf-95dd-bb59742735a4 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.535558 Sep 08 12:53:35.483190 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1425/2726] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:53:34 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:35.488298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4b7f16e6-af8e-4f86-89f8-6da48ae97479 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:35.488925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4b7f16e6-af8e-4f86-89f8-6da48ae97479 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:35.505746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b7f16e6-af8e-4f86-89f8-6da48ae97479 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:35.506398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b7f16e6-af8e-4f86-89f8-6da48ae97479 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:35.506707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b7f16e6-af8e-4f86-89f8-6da48ae97479 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:35.507480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b7f16e6-af8e-4f86-89f8-6da48ae97479 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:35.507990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b7f16e6-af8e-4f86-89f8-6da48ae97479 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:35.511062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b7f16e6-af8e-4f86-89f8-6da48ae97479 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:35.913919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4b7f16e6-af8e-4f86-89f8-6da48ae97479 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:35.924126 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4b7f16e6-af8e-4f86-89f8-6da48ae97479 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1334 microversion: 2.1 time: 0.439739 Sep 08 12:53:35.925343 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1426/2727] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:35 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1334 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:35.961037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fd38eab7-7cca-403c-870f-c74d71e28082 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Action: 'create', calling method: .version_select at 0x7fdb3f07a310>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-927631231", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaT4oUNyghLM+idFehmElBle8gP+GGC8pJw4E4VqugVWYe9Qf/J389B0J2ZJ66CykVpPmKZdxVmxWZ6E8b4IHwtQHWF8I8aK/ghTvIyX2uY4Br+NmgtWdXeUlQRF3XYPg=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:35.992532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-fd38eab7-7cca-403c-870f-c74d71e28082 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:53:36.003496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-fd38eab7-7cca-403c-870f-c74d71e28082 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for user a1cb1faa2f56470689d731f6271d17b6 and project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:53:36.037245 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c4b1207f-b02f-46ae-afa2-d0179fa013cb tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2/action" status: 202 len: 0 microversion: 2.1 time: 1.346309 Sep 08 12:53:36.050816 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1302/2728] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:53:34 2022] POST /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2/action => generated 0 bytes in 1367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:36.065370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-011e03f4-fc5a-4398-b1ad-0fd195e13c4e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:36.066577 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fd38eab7-7cca-403c-870f-c74d71e28082 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.136804 Sep 08 12:53:36.069138 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1427/2729] 10.222.0.78 () {62 vars in 1199 bytes} [Thu Sep 8 12:53:35 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 12:53:36.079469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-011e03f4-fc5a-4398-b1ad-0fd195e13c4e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:36.080987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-46548404-e17d-4ef3-b67e-672fe0aff6e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:36.083786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-46548404-e17d-4ef3-b67e-672fe0aff6e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:36.084477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-011e03f4-fc5a-4398-b1ad-0fd195e13c4e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Searching by: {'deleted': False, 'project_id': 'd49e8717cae0454e87b2e01790fc296c'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:53:36.092161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:36.102094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46548404-e17d-4ef3-b67e-672fe0aff6e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:36.104932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46548404-e17d-4ef3-b67e-672fe0aff6e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:36.105801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46548404-e17d-4ef3-b67e-672fe0aff6e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:36.107571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46548404-e17d-4ef3-b67e-672fe0aff6e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:36.108722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46548404-e17d-4ef3-b67e-672fe0aff6e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:36.109977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46548404-e17d-4ef3-b67e-672fe0aff6e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:36.115763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-011e03f4-fc5a-4398-b1ad-0fd195e13c4e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:36.117530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-011e03f4-fc5a-4398-b1ad-0fd195e13c4e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:36.118600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-011e03f4-fc5a-4398-b1ad-0fd195e13c4e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:36.121893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-011e03f4-fc5a-4398-b1ad-0fd195e13c4e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:36.123123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-011e03f4-fc5a-4398-b1ad-0fd195e13c4e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:36.124737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-011e03f4-fc5a-4398-b1ad-0fd195e13c4e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:36.209125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-011e03f4-fc5a-4398-b1ad-0fd195e13c4e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:53:36.284650 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-011e03f4-fc5a-4398-b1ad-0fd195e13c4e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.231740 Sep 08 12:53:36.285621 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1303/2730] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 12:53:36 2022] GET /compute/v2.1/servers => generated 681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:36.298487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b51122b8-1969-4baa-af8e-5f8b66798d97 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb3f116dc0>, body: {"security_group_rule": {"parent_group_id": "10932c73-ab28-47cf-b467-21ee92187722", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "f7763fc1-53fb-4751-a195-1a437cde76f6"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:36.475352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-46548404-e17d-4ef3-b67e-672fe0aff6e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:36.487039 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-46548404-e17d-4ef3-b67e-672fe0aff6e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.416338 Sep 08 12:53:36.500185 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1428/2731] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:36 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:36.513969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c02cb902-a25a-4b21-92cb-34a130b76605 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:36.515960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c02cb902-a25a-4b21-92cb-34a130b76605 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:36.523912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c02cb902-a25a-4b21-92cb-34a130b76605 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:36.525022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c02cb902-a25a-4b21-92cb-34a130b76605 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:36.525689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c02cb902-a25a-4b21-92cb-34a130b76605 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:36.526768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c02cb902-a25a-4b21-92cb-34a130b76605 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:36.527630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c02cb902-a25a-4b21-92cb-34a130b76605 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:36.528446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c02cb902-a25a-4b21-92cb-34a130b76605 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:36.563533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:36.852291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c02cb902-a25a-4b21-92cb-34a130b76605 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:36.861160 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c02cb902-a25a-4b21-92cb-34a130b76605 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1470 microversion: 2.1 time: 0.359481 Sep 08 12:53:36.875136 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1429/2732] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:36 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1470 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:37.016811 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b51122b8-1969-4baa-af8e-5f8b66798d97 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.722036 Sep 08 12:53:37.017960 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1304/2733] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:53:36 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:37.024685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b90d3ce-49a3-4c24-8268-9b6f1b005373 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f08f1f0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:37.172512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG neutronclient.v2_0.client [None req-6b90d3ce-49a3-4c24-8268-9b6f1b005373 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 47544d8f-6c23-4446-9f95-ca12bb3db608 in use.", "detail": ""}} {{(pid=128971) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:53:37.173334 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-6b90d3ce-49a3-4c24-8268-9b6f1b005373 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Security Group 47544d8f-6c23-4446-9f95-ca12bb3db608 in use. Sep 08 12:53:37.173334 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-5525011b-1fb0-4585-a8cd-65b2f7f39f5b'] Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b90d3ce-49a3-4c24-8268-9b6f1b005373 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-security-groups/47544d8f-6c23-4446-9f95-ca12bb3db608 HTTP/1.1 Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: exception: Security Group 47544d8f-6c23-4446-9f95-ca12bb3db608 in use. Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-5525011b-1fb0-4585-a8cd-65b2f7f39f5b'] Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '47544d8f-6c23-4446-9f95-ca12bb3db608'} Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:53:37.175991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 47544d8f-6c23-4446-9f95-ca12bb3db608 in use. Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5525011b-1fb0-4585-a8cd-65b2f7f39f5b'] Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 47544d8f-6c23-4446-9f95-ca12bb3db608 in use. Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5525011b-1fb0-4585-a8cd-65b2f7f39f5b'] Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 47544d8f-6c23-4446-9f95-ca12bb3db608 in use. Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5525011b-1fb0-4585-a8cd-65b2f7f39f5b'] Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 47544d8f-6c23-4446-9f95-ca12bb3db608 in use. Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5525011b-1fb0-4585-a8cd-65b2f7f39f5b'] Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b90d3ce-49a3-4c24-8268-9b6f1b005373 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 400 to user: Security Group 47544d8f-6c23-4446-9f95-ca12bb3db608 in use. Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-5525011b-1fb0-4585-a8cd-65b2f7f39f5b'] {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6b90d3ce-49a3-4c24-8268-9b6f1b005373 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/47544d8f-6c23-4446-9f95-ca12bb3db608" status: 400 len: 185 microversion: 2.1 time: 0.158595 Sep 08 12:53:37.183186 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1305/2734] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:53:37 2022] DELETE /compute/v2.1/os-security-groups/47544d8f-6c23-4446-9f95-ca12bb3db608 => generated 185 bytes in 160 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:53:37.188863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-96992ab3-007c-4074-99ce-76332853f968 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Action: 'create', calling method: .version_select at 0x7fdb3f148430>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-142381423", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAX71xhDlv9bvfNXABtxwWy8VxIfC3CehFyUqOfXa7f+jow03kuIDsXRdil1024r4UMUK9rBYEeoV+f/vuCq2MuYv2HXEo3MC9RMzNPJULZjTDgRBUNGfREhonrJ0qBnQ=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:37.205917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-fbc086a5-a44a-45c5-8f83-6d0014970d51 req-f01ec166-2985-46c4-b4ce-0333371ef496 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "303d9b60-22cb-426b-826b-b9a0465696a2", "tag": "dbebedc8-4112-4036-a8d1-e89f23b4fcb2"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:37.220765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-fbc086a5-a44a-45c5-8f83-6d0014970d51 req-f01ec166-2985-46c4-b4ce-0333371ef496 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:37.221280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-fbc086a5-a44a-45c5-8f83-6d0014970d51 req-f01ec166-2985-46c4-b4ce-0333371ef496 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:37.221756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-fbc086a5-a44a-45c5-8f83-6d0014970d51 req-f01ec166-2985-46c4-b4ce-0333371ef496 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:37.229549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-96992ab3-007c-4074-99ce-76332853f968 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:53:37.243392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-96992ab3-007c-4074-99ce-76332853f968 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for user a1cb1faa2f56470689d731f6271d17b6 and project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:53:37.245618 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-fbc086a5-a44a-45c5-8f83-6d0014970d51 req-f01ec166-2985-46c4-b4ce-0333371ef496 service nova] Creating event network-changed:dbebedc8-4112-4036-a8d1-e89f23b4fcb2 for instance 303d9b60-22cb-426b-826b-b9a0465696a2 on n-h2-852084-10 Sep 08 12:53:37.251599 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-fbc086a5-a44a-45c5-8f83-6d0014970d51 req-f01ec166-2985-46c4-b4ce-0333371ef496 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.374543 Sep 08 12:53:37.252795 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1430/2735] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:37.259776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-92fcea23-08fc-4788-9532-8b147f7bd8b7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:37.265644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-92fcea23-08fc-4788-9532-8b147f7bd8b7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:37.266645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.compute.servers [None req-92fcea23-08fc-4788-9532-8b147f7bd8b7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Removing options 'limit' from query {{(pid=128970) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Sep 08 12:53:37.267591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-92fcea23-08fc-4788-9532-8b147f7bd8b7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Searching by: {'deleted': False, 'project_id': 'd49e8717cae0454e87b2e01790fc296c'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:53:37.274008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92fcea23-08fc-4788-9532-8b147f7bd8b7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:37.274599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92fcea23-08fc-4788-9532-8b147f7bd8b7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:37.275345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92fcea23-08fc-4788-9532-8b147f7bd8b7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:37.276671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92fcea23-08fc-4788-9532-8b147f7bd8b7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:37.277414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92fcea23-08fc-4788-9532-8b147f7bd8b7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:37.278090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92fcea23-08fc-4788-9532-8b147f7bd8b7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:37.309332 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-96992ab3-007c-4074-99ce-76332853f968 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.128875 Sep 08 12:53:37.310468 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1306/2736] 10.222.0.78 () {62 vars in 1199 bytes} [Thu Sep 8 12:53:37 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 12:53:37.321850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5eddfe24-11ff-41b5-bf11-53a9a423d60a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-333859059"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:37.325259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-92fcea23-08fc-4788-9532-8b147f7bd8b7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:53:37.326557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5eddfe24-11ff-41b5-bf11-53a9a423d60a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:37.335837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eddfe24-11ff-41b5-bf11-53a9a423d60a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:37.336983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eddfe24-11ff-41b5-bf11-53a9a423d60a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:37.337676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eddfe24-11ff-41b5-bf11-53a9a423d60a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:37.338544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eddfe24-11ff-41b5-bf11-53a9a423d60a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:37.339012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eddfe24-11ff-41b5-bf11-53a9a423d60a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:37.339468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eddfe24-11ff-41b5-bf11-53a9a423d60a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:37.364122 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-92fcea23-08fc-4788-9532-8b147f7bd8b7 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=102" status: 200 len: 681 microversion: 2.1 time: 0.109765 Sep 08 12:53:37.368535 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1431/2737] 10.222.0.78 () {58 vars in 1144 bytes} [Thu Sep 8 12:53:37 2022] GET /compute/v2.1/servers?limit=102 => generated 681 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:37.384794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-66dc823f-3cc2-4466-a9c9-15059a86e98a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:37.386573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-66dc823f-3cc2-4466-a9c9-15059a86e98a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:37.397380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66dc823f-3cc2-4466-a9c9-15059a86e98a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:37.398033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66dc823f-3cc2-4466-a9c9-15059a86e98a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:37.399898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66dc823f-3cc2-4466-a9c9-15059a86e98a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:37.401100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66dc823f-3cc2-4466-a9c9-15059a86e98a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:37.402657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66dc823f-3cc2-4466-a9c9-15059a86e98a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:37.404552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66dc823f-3cc2-4466-a9c9-15059a86e98a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:37.616584 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5eddfe24-11ff-41b5-bf11-53a9a423d60a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.303054 Sep 08 12:53:37.619068 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1307/2738] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:53:37 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 08 12:53:37.627757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c60fa8f1-3ffe-4dfc-ad42-2f0bef74d352 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Calling method '.version_select at 0x7fdb3a1ccee0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:38.017461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-66dc823f-3cc2-4466-a9c9-15059a86e98a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:38.030107 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-66dc823f-3cc2-4466-a9c9-15059a86e98a tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1334 microversion: 2.1 time: 0.659402 Sep 08 12:53:38.031335 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1432/2739] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:37 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1334 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:38.041792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b852bfe5-ef71-4a3a-9bc2-6eddccd1c350 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:38.048093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b852bfe5-ef71-4a3a-9bc2-6eddccd1c350 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:38.063315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b852bfe5-ef71-4a3a-9bc2-6eddccd1c350 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:38.064970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b852bfe5-ef71-4a3a-9bc2-6eddccd1c350 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:38.065856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b852bfe5-ef71-4a3a-9bc2-6eddccd1c350 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:38.068414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b852bfe5-ef71-4a3a-9bc2-6eddccd1c350 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:38.069625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b852bfe5-ef71-4a3a-9bc2-6eddccd1c350 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:38.070329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b852bfe5-ef71-4a3a-9bc2-6eddccd1c350 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:38.200982 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b852bfe5-ef71-4a3a-9bc2-6eddccd1c350 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2/action" status: 202 len: 0 microversion: 2.1 time: 0.167437 Sep 08 12:53:38.202161 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1433/2740] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:53:38 2022] POST /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2/action => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:38.211672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-51999242-8dad-4ca3-baba-97f052c235a5 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb3f2715e0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:38.221056 n-d-852084-10 devstack@n-api.service[128970]: WARNING oslo_db.sqlalchemy.utils [None req-51999242-8dad-4ca3-baba-97f052c235a5 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 12:53:38.233077 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-51999242-8dad-4ca3-baba-97f052c235a5 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.028986 Sep 08 12:53:38.234371 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1434/2741] 10.222.0.78 () {60 vars in 1177 bytes} [Thu Sep 8 12:53:38 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:38.244204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6962d80d-9653-4ac9-b296-7ce7cae1caa8 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6962d80d-9653-4ac9-b296-7ce7cae1caa8 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Request method failure captured: Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeWaVm7fmtD9Wms8wxtEFJsPbX0YHvfp71TtA6Hwb_psRW1xlVGv5GwCWlm_0qVFnDzJm3U1sVmSXKSnnnkMX90fcd_25sEKdZktE3J_D8TIRi-g-9FSZYhQDahEUZRS5gGi8Q5VU3onwOXgQcdWb1tkmQBjxB5A3Ve8bKe-_m1ZgPc Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 3beb0e265d694cd3bf2f92e31ab95dfd Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: action_args: {} Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi '-1' Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 08 12:53:38.249274 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Sep 08 12:53:38.253518 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.256279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6962d80d-9653-4ac9-b296-7ce7cae1caa8 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:38.257454 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6962d80d-9653-4ac9-b296-7ce7cae1caa8 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.021406 Sep 08 12:53:38.258291 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1435/2742] 10.222.0.78 () {58 vars in 1142 bytes} [Thu Sep 8 12:53:38 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:53:38.266488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e349689-ebf6-4715-9d9a-b85d25f50f54 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:38.267745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2e349689-ebf6-4715-9d9a-b85d25f50f54 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:38.276544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e349689-ebf6-4715-9d9a-b85d25f50f54 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:38.277051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e349689-ebf6-4715-9d9a-b85d25f50f54 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:38.277703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e349689-ebf6-4715-9d9a-b85d25f50f54 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:38.278635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e349689-ebf6-4715-9d9a-b85d25f50f54 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:38.279298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e349689-ebf6-4715-9d9a-b85d25f50f54 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:38.279920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e349689-ebf6-4715-9d9a-b85d25f50f54 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:38.554346 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c60fa8f1-3ffe-4dfc-ad42-2f0bef74d352 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/f7763fc1-53fb-4751-a195-1a437cde76f6" status: 202 len: 0 microversion: 2.1 time: 0.933341 Sep 08 12:53:38.555699 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1308/2743] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:53:37 2022] DELETE /compute/v2.1/os-security-groups/f7763fc1-53fb-4751-a195-1a437cde76f6 => generated 0 bytes in 936 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:38.567755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db570721-f103-482c-922f-7496f7d07e85 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:38.569279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-db570721-f103-482c-922f-7496f7d07e85 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:38.587827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db570721-f103-482c-922f-7496f7d07e85 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:38.589080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db570721-f103-482c-922f-7496f7d07e85 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:38.589860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db570721-f103-482c-922f-7496f7d07e85 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:38.591611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db570721-f103-482c-922f-7496f7d07e85 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:38.595585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db570721-f103-482c-922f-7496f7d07e85 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:38.596832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db570721-f103-482c-922f-7496f7d07e85 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:38.621514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2e349689-ebf6-4715-9d9a-b85d25f50f54 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:38.639466 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2e349689-ebf6-4715-9d9a-b85d25f50f54 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1476 microversion: 2.1 time: 0.378006 Sep 08 12:53:38.640215 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1436/2744] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:38 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:38.671737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-906f319f-ed39-4827-8340-31338e9477b1 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb363faaf0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:38.739721 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-906f319f-ed39-4827-8340-31338e9477b1 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-142381423" status: 204 len: 0 microversion: 2.2 time: 0.096805 Sep 08 12:53:38.741146 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1437/2745] 10.222.0.78 () {60 vars in 1318 bytes} [Thu Sep 8 12:53:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-142381423 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:38.752878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89915335-db79-47cf-9b67-75fc533671d3 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89915335-db79-47cf-9b67-75fc533671d3 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Request method failure captured: Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeWaVm7fmtD9Wms8wxtEFJsPbX0YHvfp71TtA6Hwb_psRW1xlVGv5GwCWlm_0qVFnDzJm3U1sVmSXKSnnnkMX90fcd_25sEKdZktE3J_D8TIRi-g-9FSZYhQDahEUZRS5gGi8Q5VU3onwOXgQcdWb1tkmQBjxB5A3Ve8bKe-_m1ZgPc Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 3beb0e265d694cd3bf2f92e31ab95dfd Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: action_args: {} Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'minimum': 0, Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance[0]: Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'testing' Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Sep 08 12:53:38.760065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89915335-db79-47cf-9b67-75fc533671d3 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-89915335-db79-47cf-9b67-75fc533671d3 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.019041 Sep 08 12:53:38.778103 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1438/2746] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:53:38 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:53:38.783314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d14fc9b3-634a-4ea0-a7a5-82304491f939 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Calling method '.version_select at 0x7fdb35e220d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:38.946694 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d14fc9b3-634a-4ea0-a7a5-82304491f939 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/10932c73-ab28-47cf-b467-21ee92187722" status: 200 len: 248 microversion: 2.1 time: 0.182325 Sep 08 12:53:38.947638 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1439/2747] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 12:53:38 2022] GET /compute/v2.1/os-security-groups/10932c73-ab28-47cf-b467-21ee92187722 => generated 248 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:38.962953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1b8e1020-748e-4419-99ed-dc2a4b8715dd tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb3f2ec310>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:38.987988 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1b8e1020-748e-4419-99ed-dc2a4b8715dd tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-927631231" status: 204 len: 0 microversion: 2.2 time: 0.039500 Sep 08 12:53:38.988603 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1440/2748] 10.222.0.78 () {60 vars in 1318 bytes} [Thu Sep 8 12:53:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-927631231 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:38.997737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-255be0b7-3d9f-4854-950e-e075a3a2d33f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:39.003375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-255be0b7-3d9f-4854-950e-e075a3a2d33f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:39.004184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-255be0b7-3d9f-4854-950e-e075a3a2d33f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'd49e8717cae0454e87b2e01790fc296c'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:53:39.013217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.compute.servers [None req-255be0b7-3d9f-4854-950e-e075a3a2d33f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Flavor 'non_existing_flavor' could not be found {{(pid=128970) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Sep 08 12:53:39.015482 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-255be0b7-3d9f-4854-950e-e075a3a2d33f tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.021144 Sep 08 12:53:39.016597 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1441/2749] 10.222.0.78 () {58 vars in 1178 bytes} [Thu Sep 8 12:53:38 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:53:39.022014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-284cd811-e8bf-4448-9e30-962a91e19633 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb3f2cbc10>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1638263284", "description": "tempest-description-1789448240"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:39.158847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-db570721-f103-482c-922f-7496f7d07e85 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:39.193516 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-db570721-f103-482c-922f-7496f7d07e85 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1574 microversion: 2.1 time: 0.634331 Sep 08 12:53:39.195113 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1309/2750] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:38 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1574 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:39.205284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-91cb6cd3-f663-450b-9920-6afc69f73d72 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb3b0d64c0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:39.255936 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-91cb6cd3-f663-450b-9920-6afc69f73d72 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1677706138" status: 204 len: 0 microversion: 2.2 time: 0.058254 Sep 08 12:53:39.256989 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1310/2751] 10.222.0.78 () {60 vars in 1321 bytes} [Thu Sep 8 12:53:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1677706138 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:39.276325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cafb3bd6-3f31-4092-bb54-a797f80e7e2e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:39.282153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cafb3bd6-3f31-4092-bb54-a797f80e7e2e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:39.283169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cafb3bd6-3f31-4092-bb54-a797f80e7e2e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'd49e8717cae0454e87b2e01790fc296c'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:53:39.293920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cafb3bd6-3f31-4092-bb54-a797f80e7e2e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:39.294421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cafb3bd6-3f31-4092-bb54-a797f80e7e2e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:39.294883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cafb3bd6-3f31-4092-bb54-a797f80e7e2e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:39.295792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cafb3bd6-3f31-4092-bb54-a797f80e7e2e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:39.296310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cafb3bd6-3f31-4092-bb54-a797f80e7e2e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:39.296743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cafb3bd6-3f31-4092-bb54-a797f80e7e2e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:39.453180 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cafb3bd6-3f31-4092-bb54-a797f80e7e2e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.193719 Sep 08 12:53:39.454461 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1311/2752] 10.222.0.78 () {58 vars in 1174 bytes} [Thu Sep 8 12:53:39 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:53:39.466618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c605efb6-892b-48ca-94e1-b84891f54e16 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:39.466618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c605efb6-892b-48ca-94e1-b84891f54e16 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:39.478891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c605efb6-892b-48ca-94e1-b84891f54e16 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:39.479775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c605efb6-892b-48ca-94e1-b84891f54e16 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:39.480510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c605efb6-892b-48ca-94e1-b84891f54e16 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:39.481773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c605efb6-892b-48ca-94e1-b84891f54e16 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:39.482593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c605efb6-892b-48ca-94e1-b84891f54e16 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:39.483352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c605efb6-892b-48ca-94e1-b84891f54e16 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:39.515213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:40.043000 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-284cd811-e8bf-4448-9e30-962a91e19633 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.024487 Sep 08 12:53:40.054293 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1442/2753] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:53:39 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:40.070993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-82a5c941-261b-4772-aa6f-4e7ac2adddca tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Action: 'create', calling method: .version_select at 0x7fdb3f29b430>, body: {"keypair": {"name": "tempest-keypair-1900687314", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6fJx2ofqojpLM6dx+1e9U7UK1Vksl8AIt8/1CW+jXbbNyCe6uWz7E5UhWME/hA024Sx/Tdn9QoKqgYIJiEO3pHrx4uidobh/WFPd09vsC+vKOl4AthDFsBjTOsibOiuw=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:40.078238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c605efb6-892b-48ca-94e1-b84891f54e16 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:40.098086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:40.121111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-82a5c941-261b-4772-aa6f-4e7ac2adddca tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:53:40.125601 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c605efb6-892b-48ca-94e1-b84891f54e16 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1334 microversion: 2.1 time: 0.666839 Sep 08 12:53:40.129631 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1312/2754] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:39 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1334 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:40.136524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-82a5c941-261b-4772-aa6f-4e7ac2adddca tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for user a1cb1faa2f56470689d731f6271d17b6 and project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:53:40.197469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3bba55f1-d126-4471-b567-50b0911b2184 req-a8f41b06-0367-4745-8c75-146b1106b4ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39255b9-9e73-414d-ad6e-74664c01ab24", "tag": "52cf1620-924c-49e0-b57e-68ee190bf8d1"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:40.244169 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-82a5c941-261b-4772-aa6f-4e7ac2adddca tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.195883 Sep 08 12:53:40.246647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3bba55f1-d126-4471-b567-50b0911b2184 req-a8f41b06-0367-4745-8c75-146b1106b4ee service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:40.247900 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1443/2755] 10.222.0.78 () {62 vars in 1199 bytes} [Thu Sep 8 12:53:40 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 202 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Sep 08 12:53:40.254618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3bba55f1-d126-4471-b567-50b0911b2184 req-a8f41b06-0367-4745-8c75-146b1106b4ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:40.267877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3bba55f1-d126-4471-b567-50b0911b2184 req-a8f41b06-0367-4745-8c75-146b1106b4ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:40.285085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a441c232-aca1-492e-bac3-0d3fef1ab791 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:40.295358 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3bba55f1-d126-4471-b567-50b0911b2184 req-a8f41b06-0367-4745-8c75-146b1106b4ee service nova] Creating event network-changed:52cf1620-924c-49e0-b57e-68ee190bf8d1 for instance d39255b9-9e73-414d-ad6e-74664c01ab24 on n-h2-852084-10 Sep 08 12:53:40.306039 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3bba55f1-d126-4471-b567-50b0911b2184 req-a8f41b06-0367-4745-8c75-146b1106b4ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.169446 Sep 08 12:53:40.306641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a441c232-aca1-492e-bac3-0d3fef1ab791 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:40.307969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a441c232-aca1-492e-bac3-0d3fef1ab791 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'd49e8717cae0454e87b2e01790fc296c'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:53:40.309238 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1313/2756] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:40.322249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ffd063bd-a08b-4f55-804e-a93a233c4a10 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:40.323957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ffd063bd-a08b-4f55-804e-a93a233c4a10 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:40.335738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a441c232-aca1-492e-bac3-0d3fef1ab791 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:40.337307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a441c232-aca1-492e-bac3-0d3fef1ab791 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:40.338100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a441c232-aca1-492e-bac3-0d3fef1ab791 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:40.339566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a441c232-aca1-492e-bac3-0d3fef1ab791 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:40.343041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffd063bd-a08b-4f55-804e-a93a233c4a10 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:40.345313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffd063bd-a08b-4f55-804e-a93a233c4a10 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:40.346323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a441c232-aca1-492e-bac3-0d3fef1ab791 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:40.347344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a441c232-aca1-492e-bac3-0d3fef1ab791 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:40.348082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffd063bd-a08b-4f55-804e-a93a233c4a10 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:40.350055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffd063bd-a08b-4f55-804e-a93a233c4a10 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:40.352709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffd063bd-a08b-4f55-804e-a93a233c4a10 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:40.353855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffd063bd-a08b-4f55-804e-a93a233c4a10 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:40.515363 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a441c232-aca1-492e-bac3-0d3fef1ab791 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.254441 Sep 08 12:53:40.516651 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1444/2757] 10.222.0.78 () {58 vars in 1184 bytes} [Thu Sep 8 12:53:40 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:53:40.521947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28a66294-c59b-49d2-ab42-e0277a61df2b tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb36db7b80>, body: {"security_group_rule": {"parent_group_id": "c9c8d41f-ffc3-41cd-9c97-667575aefd70", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:40.973946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ffd063bd-a08b-4f55-804e-a93a233c4a10 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:40.996399 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ffd063bd-a08b-4f55-804e-a93a233c4a10 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1476 microversion: 2.1 time: 0.684271 Sep 08 12:53:40.997448 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1314/2758] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:40 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1476 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:41.011300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a67601e-20c3-4704-bdb4-fc770987e230 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:41.012361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2a67601e-20c3-4704-bdb4-fc770987e230 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:41.021176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a67601e-20c3-4704-bdb4-fc770987e230 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:41.022401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a67601e-20c3-4704-bdb4-fc770987e230 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:41.023454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a67601e-20c3-4704-bdb4-fc770987e230 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:41.024918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a67601e-20c3-4704-bdb4-fc770987e230 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:41.025899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a67601e-20c3-4704-bdb4-fc770987e230 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:41.026825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a67601e-20c3-4704-bdb4-fc770987e230 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:41.649624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2a67601e-20c3-4704-bdb4-fc770987e230 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:41.670470 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a67601e-20c3-4704-bdb4-fc770987e230 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1574 microversion: 2.1 time: 0.671137 Sep 08 12:53:41.684585 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1315/2759] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:40 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1574 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:41.699876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-657746e5-627a-4147-8ba3-ea7f31817e26 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb3a113dc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:41.727946 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-657746e5-627a-4147-8ba3-ea7f31817e26 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-1900687314" status: 200 len: 513 microversion: 2.2 time: 0.036585 Sep 08 12:53:41.736370 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1316/2760] 10.222.0.78 () {60 vars in 1258 bytes} [Thu Sep 8 12:53:41 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1900687314 => generated 513 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:41.753537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-bad7276f-c2e5-4c17-9f58-d3f218655e43 req-a50a18d6-ae36-4450-a3dc-05aa0adc84e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb01efa-03b9-40b6-901b-33e7d583b7c8", "name": "network-vif-unplugged", "status": "completed", "tag": "6d98b289-22e2-4a8e-ba25-0857a1412c6b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:41.785028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bad7276f-c2e5-4c17-9f58-d3f218655e43 req-a50a18d6-ae36-4450-a3dc-05aa0adc84e5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:41.788400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bad7276f-c2e5-4c17-9f58-d3f218655e43 req-a50a18d6-ae36-4450-a3dc-05aa0adc84e5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:41.790505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bad7276f-c2e5-4c17-9f58-d3f218655e43 req-a50a18d6-ae36-4450-a3dc-05aa0adc84e5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:41.833293 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-28a66294-c59b-49d2-ab42-e0277a61df2b tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.315222 Sep 08 12:53:41.834124 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1445/2761] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:53:40 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:41.839979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:41.840276 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-bad7276f-c2e5-4c17-9f58-d3f218655e43 req-a50a18d6-ae36-4450-a3dc-05aa0adc84e5 service nova] Creating event network-vif-unplugged:6d98b289-22e2-4a8e-ba25-0857a1412c6b for instance abb01efa-03b9-40b6-901b-33e7d583b7c8 on n-h1-852084-10 Sep 08 12:53:41.846953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:41.848454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Searching by: {'deleted': False, 'project_id': 'd49e8717cae0454e87b2e01790fc296c'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:53:41.854209 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-bad7276f-c2e5-4c17-9f58-d3f218655e43 req-a50a18d6-ae36-4450-a3dc-05aa0adc84e5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114134 Sep 08 12:53:41.855857 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1317/2762] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:41.857901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:41.858654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:41.859442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:41.860471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:41.863388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:41.863908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:41.870913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-35afd615-395c-4fbb-8049-624b0131a932 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:41.872671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-35afd615-395c-4fbb-8049-624b0131a932 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:41.886044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35afd615-395c-4fbb-8049-624b0131a932 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:41.886966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35afd615-395c-4fbb-8049-624b0131a932 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:41.887764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35afd615-395c-4fbb-8049-624b0131a932 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:41.888960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35afd615-395c-4fbb-8049-624b0131a932 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:41.890227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35afd615-395c-4fbb-8049-624b0131a932 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:41.891544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35afd615-395c-4fbb-8049-624b0131a932 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:41.908188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:53:41.982961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:41.997190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:41.998112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:41.998914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:42.693902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-35afd615-395c-4fbb-8049-624b0131a932 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:42.712246 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-35afd615-395c-4fbb-8049-624b0131a932 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1334 microversion: 2.1 time: 0.849443 Sep 08 12:53:42.713260 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1318/2763] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:41 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1334 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:42.720079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cf5e609b-0ce7-4dee-b102-48d7f333756a tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb3f0bf310>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:42.725083 n-d-852084-10 devstack@n-api.service[128971]: WARNING oslo_db.sqlalchemy.utils [None req-cf5e609b-0ce7-4dee-b102-48d7f333756a tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 12:53:42.733087 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cf5e609b-0ce7-4dee-b102-48d7f333756a tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.018417 Sep 08 12:53:42.734384 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1319/2764] 10.222.0.78 () {60 vars in 1177 bytes} [Thu Sep 8 12:53:42 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:42.740358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-384b858b-b32d-4bcc-8d22-041f911aa414 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Action: 'create', calling method: .version_select at 0x7fdb3a109310>, body: {"security_group_rule": {"parent_group_id": "c9c8d41f-ffc3-41cd-9c97-667575aefd70", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:42.930548 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-242a40cc-a93e-4010-9a42-07aa39187483 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 1.095242 Sep 08 12:53:42.931439 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1446/2765] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:53:41 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:42.941349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5e129dde-1c1c-48e8-9152-f42fd473853a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:42.946540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5e129dde-1c1c-48e8-9152-f42fd473853a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:42.957400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e129dde-1c1c-48e8-9152-f42fd473853a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:42.961742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e129dde-1c1c-48e8-9152-f42fd473853a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:42.962361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e129dde-1c1c-48e8-9152-f42fd473853a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:42.963939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e129dde-1c1c-48e8-9152-f42fd473853a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:42.966138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e129dde-1c1c-48e8-9152-f42fd473853a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:42.969963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e129dde-1c1c-48e8-9152-f42fd473853a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:43.393287 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-384b858b-b32d-4bcc-8d22-041f911aa414 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.657338 Sep 08 12:53:43.394452 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1320/2766] 10.222.0.78 () {60 vars in 1195 bytes} [Thu Sep 8 12:53:42 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:43.400672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7c119c07-e9e5-48b1-9f92-c3051e42e4fb req-ad2195bb-b861-4329-86db-a6721cfd8ad6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d39255b9-9e73-414d-ad6e-74664c01ab24", "tag": "92e7277f-630b-4a44-a594-e381caaa441e"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:43.430484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7c119c07-e9e5-48b1-9f92-c3051e42e4fb req-ad2195bb-b861-4329-86db-a6721cfd8ad6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:43.434988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7c119c07-e9e5-48b1-9f92-c3051e42e4fb req-ad2195bb-b861-4329-86db-a6721cfd8ad6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:43.437747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7c119c07-e9e5-48b1-9f92-c3051e42e4fb req-ad2195bb-b861-4329-86db-a6721cfd8ad6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:43.466947 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7c119c07-e9e5-48b1-9f92-c3051e42e4fb req-ad2195bb-b861-4329-86db-a6721cfd8ad6 service nova] Creating event network-changed:92e7277f-630b-4a44-a594-e381caaa441e for instance d39255b9-9e73-414d-ad6e-74664c01ab24 on n-h2-852084-10 Sep 08 12:53:43.479800 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7c119c07-e9e5-48b1-9f92-c3051e42e4fb req-ad2195bb-b861-4329-86db-a6721cfd8ad6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083519 Sep 08 12:53:43.485722 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1321/2767] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:43.491612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-83d0cc57-c5ba-490b-a2d5-5d5f05da938d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:43.503205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5e129dde-1c1c-48e8-9152-f42fd473853a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:43.508320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-83d0cc57-c5ba-490b-a2d5-5d5f05da938d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:43.518333 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5e129dde-1c1c-48e8-9152-f42fd473853a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1476 microversion: 2.1 time: 0.585412 Sep 08 12:53:43.520321 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1447/2768] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:42 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1476 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:43.523265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d0cc57-c5ba-490b-a2d5-5d5f05da938d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:43.523921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d0cc57-c5ba-490b-a2d5-5d5f05da938d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:43.524491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d0cc57-c5ba-490b-a2d5-5d5f05da938d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:43.525315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d0cc57-c5ba-490b-a2d5-5d5f05da938d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:43.525889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d0cc57-c5ba-490b-a2d5-5d5f05da938d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:43.526433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d0cc57-c5ba-490b-a2d5-5d5f05da938d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:43.544170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-31f46b7c-17d2-4953-9c20-38aef48e221f tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb3f29bdc0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:43.604786 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-31f46b7c-17d2-4953-9c20-38aef48e221f tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900687314" status: 204 len: 0 microversion: 2.2 time: 0.081344 Sep 08 12:53:43.606035 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1448/2769] 10.222.0.78 () {60 vars in 1261 bytes} [Thu Sep 8 12:53:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900687314 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:43.631514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5e22a17b-ef76-4597-8f87-1293c70f2b68 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:43.652789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5e22a17b-ef76-4597-8f87-1293c70f2b68 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:43.660065 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5e22a17b-ef76-4597-8f87-1293c70f2b68 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.049641 Sep 08 12:53:43.671030 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1449/2770] 10.222.0.78 () {58 vars in 1178 bytes} [Thu Sep 8 12:53:43 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:53:43.689429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b3874244-0175-41e8-8829-f417f079add8 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Calling method '.version_select at 0x7fdb36d98550>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:43.890500 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b3874244-0175-41e8-8829-f417f079add8 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/c9c8d41f-ffc3-41cd-9c97-667575aefd70" status: 200 len: 665 microversion: 2.1 time: 0.216343 Sep 08 12:53:43.893204 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1450/2771] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 12:53:43 2022] GET /compute/v2.1/os-security-groups/c9c8d41f-ffc3-41cd-9c97-667575aefd70 => generated 665 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:43.903375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2bd4e6a7-2ce7-456a-875a-950384ca4db1 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Action: 'create', calling method: .version_select at 0x7fdb3f2cb160>, body: {"keypair": {"name": "tempest-keypair-1109268682", "type": "x509"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:43.937900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-2bd4e6a7-2ce7-456a-875a-950384ca4db1 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:53:43.952936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-2bd4e6a7-2ce7-456a-875a-950384ca4db1 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for user a1cb1faa2f56470689d731f6271d17b6 and project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:53:43.967088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-83d0cc57-c5ba-490b-a2d5-5d5f05da938d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:43.994310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.processutils [None req-2bd4e6a7-2ce7-456a-875a-950384ca4db1 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpuwg08qp_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpuwg08qp_/temp.key -subj /CN=a1cb1faa2f56470689d731f6271d17b6 -extensions v3_req_client {{(pid=128970) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 08 12:53:44.006431 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-83d0cc57-c5ba-490b-a2d5-5d5f05da938d tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1579 microversion: 2.1 time: 0.518811 Sep 08 12:53:44.016974 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1322/2772] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:43 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1579 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:44.027529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-60a8a970-3af1-44c7-923f-5077236a9019 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:44.057906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-60a8a970-3af1-44c7-923f-5077236a9019 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:44.064139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-60a8a970-3af1-44c7-923f-5077236a9019 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Searching by: {'deleted': False, 'project_id': 'd49e8717cae0454e87b2e01790fc296c'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:53:44.086711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-60a8a970-3af1-44c7-923f-5077236a9019 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:44.092740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-60a8a970-3af1-44c7-923f-5077236a9019 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:44.096361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-60a8a970-3af1-44c7-923f-5077236a9019 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:44.097725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-60a8a970-3af1-44c7-923f-5077236a9019 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:44.098542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-60a8a970-3af1-44c7-923f-5077236a9019 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:44.105222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-60a8a970-3af1-44c7-923f-5077236a9019 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:44.197840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-60a8a970-3af1-44c7-923f-5077236a9019 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:53:44.302044 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-60a8a970-3af1-44c7-923f-5077236a9019 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 681 microversion: 2.1 time: 0.281663 Sep 08 12:53:44.304977 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1323/2773] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 12:53:44 2022] GET /compute/v2.1/servers => generated 681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:44.317878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e838e204-7deb-49a8-9704-a72c763d5bda tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:44.319571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e838e204-7deb-49a8-9704-a72c763d5bda tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:44.338213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e838e204-7deb-49a8-9704-a72c763d5bda tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:44.339721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e838e204-7deb-49a8-9704-a72c763d5bda tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:44.341535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e838e204-7deb-49a8-9704-a72c763d5bda tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:44.343629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e838e204-7deb-49a8-9704-a72c763d5bda tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:44.345918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e838e204-7deb-49a8-9704-a72c763d5bda tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:44.349383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e838e204-7deb-49a8-9704-a72c763d5bda tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:44.577997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.processutils [None req-2bd4e6a7-2ce7-456a-875a-950384ca4db1 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpuwg08qp_/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpuwg08qp_/temp.key -subj /CN=a1cb1faa2f56470689d731f6271d17b6 -extensions v3_req_client" returned: 0 in 0.582s {{(pid=128970) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 08 12:53:44.581519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.processutils [None req-2bd4e6a7-2ce7-456a-875a-950384ca4db1 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpuwg08qp_/temp.key -password pass: {{(pid=128970) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Sep 08 12:53:44.692106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.processutils [None req-2bd4e6a7-2ce7-456a-875a-950384ca4db1 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpuwg08qp_/temp.key -password pass:" returned: 0 in 0.110s {{(pid=128970) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Sep 08 12:53:44.870737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-2bd4e6a7-2ce7-456a-875a-950384ca4db1 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:53:44.895416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-2bd4e6a7-2ce7-456a-875a-950384ca4db1 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Getting quotas for user a1cb1faa2f56470689d731f6271d17b6 and project f353f61270b84d7cb951f0a32ae8621c. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:53:44.908646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e838e204-7deb-49a8-9704-a72c763d5bda tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:44.940697 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e838e204-7deb-49a8-9704-a72c763d5bda tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1334 microversion: 2.1 time: 0.632155 Sep 08 12:53:44.941686 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1324/2774] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:44 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1334 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:44.959676 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2bd4e6a7-2ce7-456a-875a-950384ca4db1 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 1.064091 Sep 08 12:53:44.976442 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1451/2775] 10.222.0.78 () {62 vars in 1198 bytes} [Thu Sep 8 12:53:43 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 1082 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:44.981927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-63f50675-e14b-4f45-8477-3aea1e4be80e req-b06f629e-3e04-48a7-8ae3-bda5d5d95113 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3250685a-8562-4deb-a070-5ef61a7adece", "name": "network-vif-unplugged", "status": "completed", "tag": "abdffb77-d374-428a-a4ad-7dbf4411576c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:45.008312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-63f50675-e14b-4f45-8477-3aea1e4be80e req-b06f629e-3e04-48a7-8ae3-bda5d5d95113 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:45.009457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee50e02e-9225-41ca-8dca-2797b75e3a73 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Calling method '.version_select at 0x7fdb3f2a2e50>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:45.009756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-63f50675-e14b-4f45-8477-3aea1e4be80e req-b06f629e-3e04-48a7-8ae3-bda5d5d95113 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:45.011353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-63f50675-e14b-4f45-8477-3aea1e4be80e req-b06f629e-3e04-48a7-8ae3-bda5d5d95113 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:45.057129 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-63f50675-e14b-4f45-8477-3aea1e4be80e req-b06f629e-3e04-48a7-8ae3-bda5d5d95113 service nova] Creating event network-vif-unplugged:abdffb77-d374-428a-a4ad-7dbf4411576c for instance 3250685a-8562-4deb-a070-5ef61a7adece on n-h2-852084-10 Sep 08 12:53:45.110424 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-63f50675-e14b-4f45-8477-3aea1e4be80e req-b06f629e-3e04-48a7-8ae3-bda5d5d95113 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.137115 Sep 08 12:53:45.111622 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1325/2776] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:45.152267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-07396ccd-5b62-44de-8685-aeeb2d04bf51 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:45.153302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-07396ccd-5b62-44de-8685-aeeb2d04bf51 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: fbd99aba-87fc-409c-933d-9cd6b5b7240a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:45.171768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07396ccd-5b62-44de-8685-aeeb2d04bf51 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:45.173096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07396ccd-5b62-44de-8685-aeeb2d04bf51 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:45.174105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07396ccd-5b62-44de-8685-aeeb2d04bf51 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:45.176764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07396ccd-5b62-44de-8685-aeeb2d04bf51 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:45.177837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07396ccd-5b62-44de-8685-aeeb2d04bf51 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:45.178767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07396ccd-5b62-44de-8685-aeeb2d04bf51 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:45.230114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-07396ccd-5b62-44de-8685-aeeb2d04bf51 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: fbd99aba-87fc-409c-933d-9cd6b5b7240a] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:53:45.464967 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-07396ccd-5b62-44de-8685-aeeb2d04bf51 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a" status: 204 len: 0 microversion: 2.1 time: 0.347166 Sep 08 12:53:45.475381 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1326/2777] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:53:45 2022] DELETE /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:45.506915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92f14eeb-8a86-4ad4-b682-f7737e52a7b3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:45.512464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-92f14eeb-8a86-4ad4-b682-f7737e52a7b3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:45.548351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92f14eeb-8a86-4ad4-b682-f7737e52a7b3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:45.553501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92f14eeb-8a86-4ad4-b682-f7737e52a7b3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:45.554903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92f14eeb-8a86-4ad4-b682-f7737e52a7b3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:45.562937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92f14eeb-8a86-4ad4-b682-f7737e52a7b3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:45.563856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92f14eeb-8a86-4ad4-b682-f7737e52a7b3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:45.564533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92f14eeb-8a86-4ad4-b682-f7737e52a7b3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:46.228221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-92f14eeb-8a86-4ad4-b682-f7737e52a7b3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:46.264542 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92f14eeb-8a86-4ad4-b682-f7737e52a7b3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1476 microversion: 2.1 time: 0.784341 Sep 08 12:53:46.265633 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1327/2778] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:45 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1476 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:46.304081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-79c16aca-6aa6-44a0-9773-2610204c7078 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb3af31790>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:46.334948 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-79c16aca-6aa6-44a0-9773-2610204c7078 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs/tempest-keypair-1109268682" status: 200 len: 1534 microversion: 2.2 time: 0.054051 Sep 08 12:53:46.338348 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1328/2779] 10.222.0.78 () {60 vars in 1258 bytes} [Thu Sep 8 12:53:46 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1109268682 => generated 1534 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:46.358090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1c8f3c18-982f-4c50-b634-debcf090cd58 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:46.360415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1c8f3c18-982f-4c50-b634-debcf090cd58 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:46.374844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c8f3c18-982f-4c50-b634-debcf090cd58 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:46.376064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c8f3c18-982f-4c50-b634-debcf090cd58 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:46.377123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c8f3c18-982f-4c50-b634-debcf090cd58 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:46.378654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c8f3c18-982f-4c50-b634-debcf090cd58 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:46.381015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c8f3c18-982f-4c50-b634-debcf090cd58 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:46.382167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c8f3c18-982f-4c50-b634-debcf090cd58 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:46.400437 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee50e02e-9225-41ca-8dca-2797b75e3a73 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-group-rules/8680569a-49e2-42e6-9cea-a32c83398bf1" status: 202 len: 0 microversion: 2.1 time: 1.421633 Sep 08 12:53:46.402566 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1452/2780] 10.222.0.78 () {58 vars in 1287 bytes} [Thu Sep 8 12:53:44 2022] DELETE /compute/v2.1/os-security-group-rules/8680569a-49e2-42e6-9cea-a32c83398bf1 => generated 0 bytes in 1426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:46.424315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1b8f1c59-7566-437f-a916-8154f28e163e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:46.428620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1b8f1c59-7566-437f-a916-8154f28e163e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 79750c09-f943-404e-ad11-211dbd9010e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:46.464394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b8f1c59-7566-437f-a916-8154f28e163e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:46.468491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b8f1c59-7566-437f-a916-8154f28e163e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:46.469680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b8f1c59-7566-437f-a916-8154f28e163e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:46.473960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b8f1c59-7566-437f-a916-8154f28e163e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:46.475110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b8f1c59-7566-437f-a916-8154f28e163e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:46.480056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1b8f1c59-7566-437f-a916-8154f28e163e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:46.532602 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-1b8f1c59-7566-437f-a916-8154f28e163e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] HTTP exception thrown: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1b8f1c59-7566-437f-a916-8154f28e163e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Request method failure captured: Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8 HTTP/1.1 Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeWaVm7fmtD9Wms8wxtEFJsPbX0YHvfp71TtA6Hwb_psRW1xlVGv5GwCWlm_0qVFnDzJm3U1sVmSXKSnnnkMX90fcd_25sEKdZktE3J_D8TIRi-g-9FSZYhQDahEUZRS5gGi8Q5VU3onwOXgQcdWb1tkmQBjxB5A3Ve8bKe-_m1ZgPc Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 3beb0e265d694cd3bf2f92e31ab95dfd Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '79750c09-f943-404e-ad11-211dbd9010e8'} Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:53:46.536368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1b8f1c59-7566-437f-a916-8154f28e163e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Returning 404 to user: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1b8f1c59-7566-437f-a916-8154f28e163e tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "DELETE /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8" status: 404 len: 111 microversion: 2.1 time: 0.134555 Sep 08 12:53:46.542958 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1453/2781] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:53:46 2022] DELETE /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:53:46.553442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0967266e-c66a-4d47-b1d2-126d1024a205 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:46.555339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0967266e-c66a-4d47-b1d2-126d1024a205 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:46.568300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0967266e-c66a-4d47-b1d2-126d1024a205 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:46.569156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0967266e-c66a-4d47-b1d2-126d1024a205 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:46.571255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0967266e-c66a-4d47-b1d2-126d1024a205 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:46.573155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0967266e-c66a-4d47-b1d2-126d1024a205 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:46.574181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0967266e-c66a-4d47-b1d2-126d1024a205 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:46.575096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0967266e-c66a-4d47-b1d2-126d1024a205 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:47.264483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=18 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:47.599797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0967266e-c66a-4d47-b1d2-126d1024a205 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:47.668027 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0967266e-c66a-4d47-b1d2-126d1024a205 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1334 microversion: 2.1 time: 1.111668 Sep 08 12:53:47.671707 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1454/2782] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:46 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1334 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:47.697361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cf93f23c-68b6-465c-bc4d-cbbc24954d98 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb36c69e50>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:47.708226 n-d-852084-10 devstack@n-api.service[128970]: WARNING oslo_db.sqlalchemy.utils [None req-cf93f23c-68b6-465c-bc4d-cbbc24954d98 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 12:53:47.720287 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cf93f23c-68b6-465c-bc4d-cbbc24954d98 tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.045615 Sep 08 12:53:47.722514 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1455/2783] 10.222.0.78 () {60 vars in 1177 bytes} [Thu Sep 8 12:53:47 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:47.726840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1c8f3c18-982f-4c50-b634-debcf090cd58 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:47.733905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-838d8a58-d181-4a9e-8eea-a7f3b0b7ebfa tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Calling method '.version_select at 0x7fdb36b49040>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:47.737078 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1c8f3c18-982f-4c50-b634-debcf090cd58 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1572 microversion: 2.1 time: 1.395435 Sep 08 12:53:47.751332 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1329/2784] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:46 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1572 bytes in 1410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:47.768613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71075c5b-3893-4d77-a059-9f9d6079db41 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:47.773116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-71075c5b-3893-4d77-a059-9f9d6079db41 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:47.794259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71075c5b-3893-4d77-a059-9f9d6079db41 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:47.797770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71075c5b-3893-4d77-a059-9f9d6079db41 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:47.798491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71075c5b-3893-4d77-a059-9f9d6079db41 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:47.801043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71075c5b-3893-4d77-a059-9f9d6079db41 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:47.803633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71075c5b-3893-4d77-a059-9f9d6079db41 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:47.805026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71075c5b-3893-4d77-a059-9f9d6079db41 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:47.893145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-71075c5b-3893-4d77-a059-9f9d6079db41 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:53:48.126691 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-71075c5b-3893-4d77-a059-9f9d6079db41 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "DELETE /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655" status: 204 len: 0 microversion: 2.1 time: 0.373873 Sep 08 12:53:48.127488 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1330/2785] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:53:47 2022] DELETE /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:48.145097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-acd2d7ba-229a-4a16-aa18-611e4d32139e req-f8a42125-5c2d-4940-9b6d-9fb9e0fe0280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb01efa-03b9-40b6-901b-33e7d583b7c8", "name": "network-vif-plugged", "status": "completed", "tag": "6d98b289-22e2-4a8e-ba25-0857a1412c6b"}, {"server_uuid": "3250685a-8562-4deb-a070-5ef61a7adece", "name": "network-vif-plugged", "status": "completed", "tag": "abdffb77-d374-428a-a4ad-7dbf4411576c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:48.175407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-acd2d7ba-229a-4a16-aa18-611e4d32139e req-f8a42125-5c2d-4940-9b6d-9fb9e0fe0280 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:48.180431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-acd2d7ba-229a-4a16-aa18-611e4d32139e req-f8a42125-5c2d-4940-9b6d-9fb9e0fe0280 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:48.181156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-acd2d7ba-229a-4a16-aa18-611e4d32139e req-f8a42125-5c2d-4940-9b6d-9fb9e0fe0280 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:48.200932 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-acd2d7ba-229a-4a16-aa18-611e4d32139e req-f8a42125-5c2d-4940-9b6d-9fb9e0fe0280 service nova] Creating event network-vif-plugged:6d98b289-22e2-4a8e-ba25-0857a1412c6b for instance abb01efa-03b9-40b6-901b-33e7d583b7c8 on n-h1-852084-10 Sep 08 12:53:48.201957 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-acd2d7ba-229a-4a16-aa18-611e4d32139e req-f8a42125-5c2d-4940-9b6d-9fb9e0fe0280 service nova] Creating event network-vif-plugged:abdffb77-d374-428a-a4ad-7dbf4411576c for instance 3250685a-8562-4deb-a070-5ef61a7adece on n-h2-852084-10 Sep 08 12:53:48.214045 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-acd2d7ba-229a-4a16-aa18-611e4d32139e req-f8a42125-5c2d-4940-9b6d-9fb9e0fe0280 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083972 Sep 08 12:53:48.214883 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1331/2786] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:48.222240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3edcb4c9-3446-42d5-99fd-173ab44707cb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:48.223259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3edcb4c9-3446-42d5-99fd-173ab44707cb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:48.239278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3edcb4c9-3446-42d5-99fd-173ab44707cb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:48.239450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3edcb4c9-3446-42d5-99fd-173ab44707cb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:48.239911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3edcb4c9-3446-42d5-99fd-173ab44707cb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:48.240701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3edcb4c9-3446-42d5-99fd-173ab44707cb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:48.252570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3edcb4c9-3446-42d5-99fd-173ab44707cb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:48.253207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3edcb4c9-3446-42d5-99fd-173ab44707cb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:49.042973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3edcb4c9-3446-42d5-99fd-173ab44707cb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:49.047108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:49.069585 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3edcb4c9-3446-42d5-99fd-173ab44707cb tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1476 microversion: 2.1 time: 0.852743 Sep 08 12:53:49.070687 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1332/2787] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:48 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1476 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:49.095185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d8f9d47-efae-4a06-9883-a854eaf5733a tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] Calling method '.version_select at 0x7fdb3f1244c0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:49.170792 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1d8f9d47-efae-4a06-9883-a854eaf5733a tempest-KeyPairsV22TestJSON-1247318351 tempest-KeyPairsV22TestJSON-1247318351-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109268682" status: 204 len: 0 microversion: 2.2 time: 0.089391 Sep 08 12:53:49.172353 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1333/2788] 10.222.0.78 () {60 vars in 1261 bytes} [Thu Sep 8 12:53:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1109268682 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:49.217441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dea71356-e4fc-4910-a728-7670a0c4d80a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2077531967"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:49.237304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dea71356-e4fc-4910-a728-7670a0c4d80a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:49.279947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dea71356-e4fc-4910-a728-7670a0c4d80a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:49.280972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dea71356-e4fc-4910-a728-7670a0c4d80a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:49.281789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dea71356-e4fc-4910-a728-7670a0c4d80a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:49.283109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dea71356-e4fc-4910-a728-7670a0c4d80a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:49.287744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dea71356-e4fc-4910-a728-7670a0c4d80a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:49.289053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dea71356-e4fc-4910-a728-7670a0c4d80a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:49.306885 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-838d8a58-d181-4a9e-8eea-a7f3b0b7ebfa tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/c9c8d41f-ffc3-41cd-9c97-667575aefd70" status: 202 len: 0 microversion: 2.1 time: 1.582041 Sep 08 12:53:49.309084 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1456/2789] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:53:47 2022] DELETE /compute/v2.1/os-security-groups/c9c8d41f-ffc3-41cd-9c97-667575aefd70 => generated 0 bytes in 1586 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:49.318989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c0f68da5-c0e9-421f-81de-74c3c622825b tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:49.320103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c0f68da5-c0e9-421f-81de-74c3c622825b tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: fbd99aba-87fc-409c-933d-9cd6b5b7240a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:49.335188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0f68da5-c0e9-421f-81de-74c3c622825b tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:49.336228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0f68da5-c0e9-421f-81de-74c3c622825b tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:49.341446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0f68da5-c0e9-421f-81de-74c3c622825b tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:49.342746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0f68da5-c0e9-421f-81de-74c3c622825b tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:49.343875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0f68da5-c0e9-421f-81de-74c3c622825b tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:49.344707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0f68da5-c0e9-421f-81de-74c3c622825b tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:49.659868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c0f68da5-c0e9-421f-81de-74c3c622825b tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:49.680805 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c0f68da5-c0e9-421f-81de-74c3c622825b tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a" status: 200 len: 1479 microversion: 2.1 time: 0.370287 Sep 08 12:53:49.683804 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1457/2790] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:49 2022] GET /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a => generated 1479 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:49.696268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a3c5e611-ac14-47ac-94fe-fe884b8168c9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:49.703611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a3c5e611-ac14-47ac-94fe-fe884b8168c9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:49.745568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3c5e611-ac14-47ac-94fe-fe884b8168c9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:49.747869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3c5e611-ac14-47ac-94fe-fe884b8168c9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:49.751552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3c5e611-ac14-47ac-94fe-fe884b8168c9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:49.763917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3c5e611-ac14-47ac-94fe-fe884b8168c9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:49.764656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3c5e611-ac14-47ac-94fe-fe884b8168c9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:49.765695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3c5e611-ac14-47ac-94fe-fe884b8168c9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:49.883384 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.network.security_group_api [None req-dea71356-e4fc-4910-a728-7670a0c4d80a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Adding security group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 to port dbebedc8-4112-4036-a8d1-e89f23b4fcb2 Sep 08 12:53:50.747538 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dea71356-e4fc-4910-a728-7670a0c4d80a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2/action" status: 202 len: 0 microversion: 2.1 time: 1.573109 Sep 08 12:53:50.754236 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1334/2791] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:53:49 2022] POST /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2/action => generated 0 bytes in 1578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:50.760391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-78bb2dc8-2ce7-4737-b31e-ee2368fe103c req-d523f6cb-c895-4606-8a4f-7a14e0db2bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbd99aba-87fc-409c-933d-9cd6b5b7240a", "name": "network-vif-deleted", "tag": "268692c3-4721-4548-a1d6-bd081e18ab22"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:50.784187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-78bb2dc8-2ce7-4737-b31e-ee2368fe103c req-d523f6cb-c895-4606-8a4f-7a14e0db2bb4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:50.785610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-78bb2dc8-2ce7-4737-b31e-ee2368fe103c req-d523f6cb-c895-4606-8a4f-7a14e0db2bb4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:50.787028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-78bb2dc8-2ce7-4737-b31e-ee2368fe103c req-d523f6cb-c895-4606-8a4f-7a14e0db2bb4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:50.885556 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-78bb2dc8-2ce7-4737-b31e-ee2368fe103c req-d523f6cb-c895-4606-8a4f-7a14e0db2bb4 service nova] Creating event network-vif-deleted:268692c3-4721-4548-a1d6-bd081e18ab22 for instance fbd99aba-87fc-409c-933d-9cd6b5b7240a on n-h1-852084-10 Sep 08 12:53:50.914769 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-78bb2dc8-2ce7-4737-b31e-ee2368fe103c req-d523f6cb-c895-4606-8a4f-7a14e0db2bb4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158176 Sep 08 12:53:50.916703 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1335/2792] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:50.919911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a3c5e611-ac14-47ac-94fe-fe884b8168c9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:50.935185 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a3c5e611-ac14-47ac-94fe-fe884b8168c9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1334 microversion: 2.1 time: 1.249833 Sep 08 12:53:50.937114 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1458/2793] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:49 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1334 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:50.944713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1eae687a-a99e-4887-934b-44199c66723b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:50.946257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1eae687a-a99e-4887-934b-44199c66723b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:50.954575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8921db5f-f4de-4bab-af31-3c52e0923816 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Calling method '.version_select at 0x7fdb3a1cc430>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:50.964354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1eae687a-a99e-4887-934b-44199c66723b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:50.964868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1eae687a-a99e-4887-934b-44199c66723b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:50.965335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1eae687a-a99e-4887-934b-44199c66723b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:50.966086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1eae687a-a99e-4887-934b-44199c66723b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:50.966642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1eae687a-a99e-4887-934b-44199c66723b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:50.967101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1eae687a-a99e-4887-934b-44199c66723b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:51.015105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG neutronclient.v2_0.client [None req-8921db5f-f4de-4bab-af31-3c52e0923816 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f7763fc1-53fb-4751-a195-1a437cde76f6 does not exist", "detail": ""}} {{(pid=128971) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:53:51.018903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.security_group_api [None req-8921db5f-f4de-4bab-af31-3c52e0923816 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Neutron security group f7763fc1-53fb-4751-a195-1a437cde76f6 not found {{(pid=128971) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:53:51.020811 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-8921db5f-f4de-4bab-af31-3c52e0923816 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] HTTP exception thrown: Security group f7763fc1-53fb-4751-a195-1a437cde76f6 does not exist Sep 08 12:53:51.020811 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-bb679190-9837-4561-9b0d-febd2a8455cf'] Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8921db5f-f4de-4bab-af31-3c52e0923816 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Request method failure captured: Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-security-groups/f7763fc1-53fb-4751-a195-1a437cde76f6 HTTP/1.1 Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeW7iAotjAFoEAVyJ7k-WMdcDtD51BrgC_fiwgd_-St1alzoeb7VvOMuwD2O4Ib34ZtgeRZTNGfvJ8V_ufozgHesncR6W5Vt0d74TFWUA6woVs-PApVxmtfiIwuU0FO0mOMJSg4zjlYNZlkYehvtxUvv9iNvn0u1vhnxdDiAWh0wlIw Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d3c5574693a6453d890ac4d87d62d118 Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-1213665587 Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d3c5574693a6453d890ac4d87d62d118"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d3c5574693a6453d890ac4d87d62d118"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3c5574693a6453d890ac4d87d62d118"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d3c5574693a6453d890ac4d87d62d118"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-SecurityGroupRulesTestJSON-1213665587 Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d3c5574693a6453d890ac4d87d62d118 Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-1213665587 Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-SecurityGroupRulesTestJSON-1213665587-project Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 12c034674eca4313999d92418b034948 Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-SecurityGroupRulesTestJSON-1213665587-project Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: exception: Security group f7763fc1-53fb-4751-a195-1a437cde76f6 does not exist Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-bb679190-9837-4561-9b0d-febd2a8455cf'] Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'f7763fc1-53fb-4751-a195-1a437cde76f6'} Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:53:51.027077 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f7763fc1-53fb-4751-a195-1a437cde76f6 does not exist Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb679190-9837-4561-9b0d-febd2a8455cf'] Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f7763fc1-53fb-4751-a195-1a437cde76f6 does not exist Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb679190-9837-4561-9b0d-febd2a8455cf'] Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f7763fc1-53fb-4751-a195-1a437cde76f6 does not exist Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb679190-9837-4561-9b0d-febd2a8455cf'] Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f7763fc1-53fb-4751-a195-1a437cde76f6 does not exist Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb679190-9837-4561-9b0d-febd2a8455cf'] Sep 08 12:53:51.035633 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:51.044226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8921db5f-f4de-4bab-af31-3c52e0923816 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Returning 404 to user: Security group f7763fc1-53fb-4751-a195-1a437cde76f6 does not exist Sep 08 12:53:51.044226 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-bb679190-9837-4561-9b0d-febd2a8455cf'] {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:51.046370 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8921db5f-f4de-4bab-af31-3c52e0923816 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/f7763fc1-53fb-4751-a195-1a437cde76f6" status: 404 len: 194 microversion: 2.1 time: 0.124378 Sep 08 12:53:51.055536 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1336/2794] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:53:50 2022] DELETE /compute/v2.1/os-security-groups/f7763fc1-53fb-4751-a195-1a437cde76f6 => generated 194 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:53:51.069449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:51.071845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: fbd99aba-87fc-409c-933d-9cd6b5b7240a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:51.095008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:51.096415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:51.097578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:51.101000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:51.102645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:51.103977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:51.223964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:51.225813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:51.227995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:51.230118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lazy-loading 'fault' on Instance uuid fbd99aba-87fc-409c-933d-9cd6b5b7240a {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:53:51.325518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3beb0e265d694cd3bf2f92e31ab95dfd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd49e8717cae0454e87b2e01790fc296c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:51.353980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1eae687a-a99e-4887-934b-44199c66723b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:51.364778 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1eae687a-a99e-4887-934b-44199c66723b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1462 microversion: 2.1 time: 0.426159 Sep 08 12:53:51.367024 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1459/2795] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:50 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1462 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:51.376557 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2c435510-8866-4b11-879b-5812fa1cec36 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a" status: 200 len: 1312 microversion: 2.1 time: 0.313807 Sep 08 12:53:51.376709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8edf971-5960-4795-b725-6ed57f0430e9 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f2a20d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:51.376810 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1337/2796] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:51 2022] GET /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a => generated 1312 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:51.406380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-800a7599-d987-400c-8317-466bae23af31 req-a48f8d22-e52c-4c31-bfe7-81f3fd37dbe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "303d9b60-22cb-426b-826b-b9a0465696a2", "tag": "dbebedc8-4112-4036-a8d1-e89f23b4fcb2"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:51.420621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-800a7599-d987-400c-8317-466bae23af31 req-a48f8d22-e52c-4c31-bfe7-81f3fd37dbe5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:51.421623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-800a7599-d987-400c-8317-466bae23af31 req-a48f8d22-e52c-4c31-bfe7-81f3fd37dbe5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:51.423520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-800a7599-d987-400c-8317-466bae23af31 req-a48f8d22-e52c-4c31-bfe7-81f3fd37dbe5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:51.455680 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-800a7599-d987-400c-8317-466bae23af31 req-a48f8d22-e52c-4c31-bfe7-81f3fd37dbe5 service nova] Creating event network-changed:dbebedc8-4112-4036-a8d1-e89f23b4fcb2 for instance 303d9b60-22cb-426b-826b-b9a0465696a2 on n-h2-852084-10 Sep 08 12:53:51.483521 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-800a7599-d987-400c-8317-466bae23af31 req-a48f8d22-e52c-4c31-bfe7-81f3fd37dbe5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085944 Sep 08 12:53:51.486566 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1338/2797] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:51.514720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc4a74a0-3570-4046-a995-186ee55a6c73 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Calling method '.version_select at 0x7fdb3a1ccdc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:51.879304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:52.181289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG neutronclient.v2_0.client [None req-b8edf971-5960-4795-b725-6ed57f0430e9 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 in use.", "detail": ""}} {{(pid=128970) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:53:52.182237 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-b8edf971-5960-4795-b725-6ed57f0430e9 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Security Group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 in use. Sep 08 12:53:52.182237 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-e783698e-b7be-4ac4-b79f-aa8b3eeec0b9'] Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8edf971-5960-4795-b725-6ed57f0430e9 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/os-security-groups/89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 HTTP/1.1 Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: exception: Security Group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 in use. Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-e783698e-b7be-4ac4-b79f-aa8b3eeec0b9'] Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '89e07c98-e5ff-4455-87b7-c8e8ce54b5a6'} Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:53:52.187308 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 in use. Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e783698e-b7be-4ac4-b79f-aa8b3eeec0b9'] Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 in use. Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e783698e-b7be-4ac4-b79f-aa8b3eeec0b9'] Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 in use. Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e783698e-b7be-4ac4-b79f-aa8b3eeec0b9'] Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 in use. Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e783698e-b7be-4ac4-b79f-aa8b3eeec0b9'] Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8edf971-5960-4795-b725-6ed57f0430e9 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 400 to user: Security Group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 in use. Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-e783698e-b7be-4ac4-b79f-aa8b3eeec0b9'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8edf971-5960-4795-b725-6ed57f0430e9 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/89e07c98-e5ff-4455-87b7-c8e8ce54b5a6" status: 400 len: 185 microversion: 2.1 time: 0.821531 Sep 08 12:53:52.196494 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1460/2798] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:53:51 2022] DELETE /compute/v2.1/os-security-groups/89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 => generated 185 bytes in 827 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:53:52.208746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9c603afd-ea66-4ad2-be75-63e39c68af19 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:52.215056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9c603afd-ea66-4ad2-be75-63e39c68af19 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:52.246809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c603afd-ea66-4ad2-be75-63e39c68af19 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:52.249295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c603afd-ea66-4ad2-be75-63e39c68af19 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:52.255568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c603afd-ea66-4ad2-be75-63e39c68af19 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:52.259075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c603afd-ea66-4ad2-be75-63e39c68af19 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:52.259901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c603afd-ea66-4ad2-be75-63e39c68af19 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:52.260482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c603afd-ea66-4ad2-be75-63e39c68af19 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:53.445401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9c603afd-ea66-4ad2-be75-63e39c68af19 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:53.464838 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9c603afd-ea66-4ad2-be75-63e39c68af19 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1462 microversion: 2.1 time: 1.267721 Sep 08 12:53:53.465958 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1461/2799] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:52 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1462 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:53.471253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-af68f06f-38b4-4943-b9f6-b019debbbdb7 req-e6d56012-f4a6-4212-bf2f-2c6dcffb7ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39255b9-9e73-414d-ad6e-74664c01ab24", "name": "network-vif-plugged", "status": "completed", "tag": "52cf1620-924c-49e0-b57e-68ee190bf8d1"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:53.495501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-af68f06f-38b4-4943-b9f6-b019debbbdb7 req-e6d56012-f4a6-4212-bf2f-2c6dcffb7ead service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:53.505718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-af68f06f-38b4-4943-b9f6-b019debbbdb7 req-e6d56012-f4a6-4212-bf2f-2c6dcffb7ead service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:53.506832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-af68f06f-38b4-4943-b9f6-b019debbbdb7 req-e6d56012-f4a6-4212-bf2f-2c6dcffb7ead service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:53.549101 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-af68f06f-38b4-4943-b9f6-b019debbbdb7 req-e6d56012-f4a6-4212-bf2f-2c6dcffb7ead service nova] Creating event network-vif-plugged:52cf1620-924c-49e0-b57e-68ee190bf8d1 for instance d39255b9-9e73-414d-ad6e-74664c01ab24 on n-h2-852084-10 Sep 08 12:53:53.566471 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-af68f06f-38b4-4943-b9f6-b019debbbdb7 req-e6d56012-f4a6-4212-bf2f-2c6dcffb7ead service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096580 Sep 08 12:53:53.576043 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1462/2800] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:53.597169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2d2935cc-0a4b-42a1-816f-0c1140745cf2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:53.598202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2d2935cc-0a4b-42a1-816f-0c1140745cf2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:53.617862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d2935cc-0a4b-42a1-816f-0c1140745cf2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:53.620150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d2935cc-0a4b-42a1-816f-0c1140745cf2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:53.624422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d2935cc-0a4b-42a1-816f-0c1140745cf2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:53.626890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d2935cc-0a4b-42a1-816f-0c1140745cf2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:53.628064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d2935cc-0a4b-42a1-816f-0c1140745cf2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:53.628520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d2935cc-0a4b-42a1-816f-0c1140745cf2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:53.920771 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fc4a74a0-3570-4046-a995-186ee55a6c73 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/10932c73-ab28-47cf-b467-21ee92187722" status: 202 len: 0 microversion: 2.1 time: 2.430729 Sep 08 12:53:53.922191 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1339/2801] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:53:51 2022] DELETE /compute/v2.1/os-security-groups/10932c73-ab28-47cf-b467-21ee92187722 => generated 0 bytes in 2435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:53.941194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-65c5d133-eba0-44fd-9491-e34a4959ace8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:53.943391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-65c5d133-eba0-44fd-9491-e34a4959ace8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:53.984946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65c5d133-eba0-44fd-9491-e34a4959ace8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:53.985930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65c5d133-eba0-44fd-9491-e34a4959ace8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:53.986884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65c5d133-eba0-44fd-9491-e34a4959ace8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:53.988293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65c5d133-eba0-44fd-9491-e34a4959ace8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:53.989360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65c5d133-eba0-44fd-9491-e34a4959ace8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:53.990322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65c5d133-eba0-44fd-9491-e34a4959ace8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:54.094873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-65c5d133-eba0-44fd-9491-e34a4959ace8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:53:54.125535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=10 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:54.461109 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-65c5d133-eba0-44fd-9491-e34a4959ace8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 204 len: 0 microversion: 2.1 time: 0.536105 Sep 08 12:53:54.462944 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1340/2802] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:53:53 2022] DELETE /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:53:54.486471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1e8b7f9e-7644-4dcc-8069-6f7658e00733 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:54.487968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1e8b7f9e-7644-4dcc-8069-6f7658e00733 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: fbd99aba-87fc-409c-933d-9cd6b5b7240a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:54.505066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e8b7f9e-7644-4dcc-8069-6f7658e00733 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:54.507013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e8b7f9e-7644-4dcc-8069-6f7658e00733 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:54.508789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e8b7f9e-7644-4dcc-8069-6f7658e00733 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:54.510625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e8b7f9e-7644-4dcc-8069-6f7658e00733 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:54.512829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2d2935cc-0a4b-42a1-816f-0c1140745cf2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:54.513819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e8b7f9e-7644-4dcc-8069-6f7658e00733 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:54.516973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e8b7f9e-7644-4dcc-8069-6f7658e00733 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:54.532116 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2d2935cc-0a4b-42a1-816f-0c1140745cf2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1334 microversion: 2.1 time: 0.954199 Sep 08 12:53:54.533678 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1463/2803] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:53 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1334 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:54.542892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-80a28a8e-2303-4341-9818-e1ca9d4127de req-34ec5b5a-67d6-49ad-8f23-a34c1104318c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73e10911-8428-4be8-b770-205b2d073655", "name": "network-vif-deleted", "tag": "bd414794-3cba-479e-b176-d26cafe61ec0"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:54.554664 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1e8b7f9e-7644-4dcc-8069-6f7658e00733 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] HTTP exception thrown: Instance fbd99aba-87fc-409c-933d-9cd6b5b7240a could not be found. Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1e8b7f9e-7644-4dcc-8069-6f7658e00733 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Request method failure captured: Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a HTTP/1.1 Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeWaVm7fmtD9Wms8wxtEFJsPbX0YHvfp71TtA6Hwb_psRW1xlVGv5GwCWlm_0qVFnDzJm3U1sVmSXKSnnnkMX90fcd_25sEKdZktE3J_D8TIRi-g-9FSZYhQDahEUZRS5gGi8Q5VU3onwOXgQcdWb1tkmQBjxB5A3Ve8bKe-_m1ZgPc Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 3beb0e265d694cd3bf2f92e31ab95dfd Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance fbd99aba-87fc-409c-933d-9cd6b5b7240a could not be found. Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'fbd99aba-87fc-409c-933d-9cd6b5b7240a'} Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbd99aba-87fc-409c-933d-9cd6b5b7240a could not be found. Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbd99aba-87fc-409c-933d-9cd6b5b7240a could not be found. Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:54.556982 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:54.561898 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:54.561898 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:54.561898 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:54.561898 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:54.561898 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:53:54.561898 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:53:54.561898 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbd99aba-87fc-409c-933d-9cd6b5b7240a could not be found. Sep 08 12:53:54.561898 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:54.563694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1e8b7f9e-7644-4dcc-8069-6f7658e00733 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Returning 404 to user: Instance fbd99aba-87fc-409c-933d-9cd6b5b7240a could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:54.564864 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1e8b7f9e-7644-4dcc-8069-6f7658e00733 tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a" status: 404 len: 111 microversion: 2.1 time: 0.099811 Sep 08 12:53:54.565922 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1341/2804] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:54 2022] GET /compute/v2.1/servers/fbd99aba-87fc-409c-933d-9cd6b5b7240a => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:53:54.567954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-80a28a8e-2303-4341-9818-e1ca9d4127de req-34ec5b5a-67d6-49ad-8f23-a34c1104318c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:54.568984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-80a28a8e-2303-4341-9818-e1ca9d4127de req-34ec5b5a-67d6-49ad-8f23-a34c1104318c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:54.570274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-80a28a8e-2303-4341-9818-e1ca9d4127de req-34ec5b5a-67d6-49ad-8f23-a34c1104318c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:54.573424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:54.576573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:54.582644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=1,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:54.585020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:54.586717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:54.587424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:54.588382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:54.589053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:54.589709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:54.595602 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-80a28a8e-2303-4341-9818-e1ca9d4127de req-34ec5b5a-67d6-49ad-8f23-a34c1104318c service nova] Creating event network-vif-deleted:bd414794-3cba-479e-b176-d26cafe61ec0 for instance 73e10911-8428-4be8-b770-205b2d073655 on n-h1-852084-10 Sep 08 12:53:54.607195 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-80a28a8e-2303-4341-9818-e1ca9d4127de req-34ec5b5a-67d6-49ad-8f23-a34c1104318c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071045 Sep 08 12:53:54.608798 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1464/2805] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:54.630542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2cc9acc6-e057-46eb-8795-de8e6e654941 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Calling method '.version_select at 0x7fdb36b493a0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:54.750053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:53:54.751095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:53:54.752426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:53:54.753499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:53:54.754595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:53:54.911381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=28 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:54.952498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:54.975462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:54.976402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:54.977191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:54.986515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:54.990919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:54.995817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:55.102069 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a7d0d1df-c109-44a9-90d2-daa3129c40cd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action" status: 202 len: 1066 microversion: 2.1 time: 0.533005 Sep 08 12:53:55.103767 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1342/2806] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:53:54 2022] POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action => generated 1066 bytes in 537 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Sep 08 12:53:55.119648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-33d92d50-fb94-4e3b-abbf-3329829be334 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:55.123790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33d92d50-fb94-4e3b-abbf-3329829be334 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:55.140483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33d92d50-fb94-4e3b-abbf-3329829be334 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:55.143353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33d92d50-fb94-4e3b-abbf-3329829be334 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:55.144729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33d92d50-fb94-4e3b-abbf-3329829be334 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:55.146481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33d92d50-fb94-4e3b-abbf-3329829be334 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:55.147830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33d92d50-fb94-4e3b-abbf-3329829be334 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:55.149147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33d92d50-fb94-4e3b-abbf-3329829be334 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:55.453537 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2cc9acc6-e057-46eb-8795-de8e6e654941 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/d9fb9209-6e02-41bf-a52e-dabe8d1d3461" status: 202 len: 0 microversion: 2.1 time: 0.841700 Sep 08 12:53:55.455401 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1465/2807] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:53:54 2022] DELETE /compute/v2.1/os-security-groups/d9fb9209-6e02-41bf-a52e-dabe8d1d3461 => generated 0 bytes in 846 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:55.464703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a912e962-d12c-4822-aae1-9a954b75d8ca tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:55.472131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a912e962-d12c-4822-aae1-9a954b75d8ca tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 79750c09-f943-404e-ad11-211dbd9010e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:55.501313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a912e962-d12c-4822-aae1-9a954b75d8ca tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:55.503962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a912e962-d12c-4822-aae1-9a954b75d8ca tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:55.509943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a912e962-d12c-4822-aae1-9a954b75d8ca tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:55.515476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a912e962-d12c-4822-aae1-9a954b75d8ca tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:55.518028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a912e962-d12c-4822-aae1-9a954b75d8ca tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:55.521833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a912e962-d12c-4822-aae1-9a954b75d8ca tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:55.580286 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-a912e962-d12c-4822-aae1-9a954b75d8ca tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] HTTP exception thrown: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a912e962-d12c-4822-aae1-9a954b75d8ca tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Request method failure captured: Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8 HTTP/1.1 Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeWaVm7fmtD9Wms8wxtEFJsPbX0YHvfp71TtA6Hwb_psRW1xlVGv5GwCWlm_0qVFnDzJm3U1sVmSXKSnnnkMX90fcd_25sEKdZktE3J_D8TIRi-g-9FSZYhQDahEUZRS5gGi8Q5VU3onwOXgQcdWb1tkmQBjxB5A3Ve8bKe-_m1ZgPc Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 3beb0e265d694cd3bf2f92e31ab95dfd Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '79750c09-f943-404e-ad11-211dbd9010e8'} Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:55.584728 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:55.594157 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:55.594157 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:55.594157 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:55.594157 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:55.594157 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:53:55.594157 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:53:55.594157 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. Sep 08 12:53:55.594157 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:53:55.597344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a912e962-d12c-4822-aae1-9a954b75d8ca tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Returning 404 to user: Instance 79750c09-f943-404e-ad11-211dbd9010e8 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:55.599385 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a912e962-d12c-4822-aae1-9a954b75d8ca tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8" status: 404 len: 111 microversion: 2.1 time: 0.141646 Sep 08 12:53:55.600953 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1466/2808] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:55 2022] GET /compute/v2.1/servers/79750c09-f943-404e-ad11-211dbd9010e8 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:53:55.611214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e3c07ed-93f2-4cf0-98e2-393663a41f1c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:55.612841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8e3c07ed-93f2-4cf0-98e2-393663a41f1c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:55.627197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e3c07ed-93f2-4cf0-98e2-393663a41f1c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:55.635613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-33d92d50-fb94-4e3b-abbf-3329829be334 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:55.641760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e3c07ed-93f2-4cf0-98e2-393663a41f1c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:55.646275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e3c07ed-93f2-4cf0-98e2-393663a41f1c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:55.647863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e3c07ed-93f2-4cf0-98e2-393663a41f1c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:55.648701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e3c07ed-93f2-4cf0-98e2-393663a41f1c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:55.649487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e3c07ed-93f2-4cf0-98e2-393663a41f1c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:55.658857 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-33d92d50-fb94-4e3b-abbf-3329829be334 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1647 microversion: 2.1 time: 0.550280 Sep 08 12:53:55.676204 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1343/2809] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:55 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1647 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:55.699637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-37096789-e65d-4161-a4a5-98f58dbea303 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Calling method '.version_select at 0x7fdb3a067dc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:55.775802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:53:56.154507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8e3c07ed-93f2-4cf0-98e2-393663a41f1c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:56.174065 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8e3c07ed-93f2-4cf0-98e2-393663a41f1c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 0.571165 Sep 08 12:53:56.175001 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1467/2810] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:55 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:56.185934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-29689f64-6ba0-4647-ad1f-1517b065a8fc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:56.186836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-29689f64-6ba0-4647-ad1f-1517b065a8fc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:56.197881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29689f64-6ba0-4647-ad1f-1517b065a8fc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:56.198871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29689f64-6ba0-4647-ad1f-1517b065a8fc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:56.199542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29689f64-6ba0-4647-ad1f-1517b065a8fc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:56.200499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29689f64-6ba0-4647-ad1f-1517b065a8fc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:56.203316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29689f64-6ba0-4647-ad1f-1517b065a8fc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:56.206648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29689f64-6ba0-4647-ad1f-1517b065a8fc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:56.795792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-29689f64-6ba0-4647-ad1f-1517b065a8fc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:56.811024 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-29689f64-6ba0-4647-ad1f-1517b065a8fc tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1334 microversion: 2.1 time: 0.631888 Sep 08 12:53:56.816979 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1468/2811] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:56 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1334 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:56.831472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d9fcd7bf-0724-467e-913f-9fbaf34c0808 req-7d753556-9f8b-4c67-b5aa-cb5aaee3edc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39255b9-9e73-414d-ad6e-74664c01ab24", "name": "network-vif-plugged", "status": "completed", "tag": "92e7277f-630b-4a44-a594-e381caaa441e"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:53:56.857484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d9fcd7bf-0724-467e-913f-9fbaf34c0808 req-7d753556-9f8b-4c67-b5aa-cb5aaee3edc0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:56.858330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d9fcd7bf-0724-467e-913f-9fbaf34c0808 req-7d753556-9f8b-4c67-b5aa-cb5aaee3edc0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:56.859022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d9fcd7bf-0724-467e-913f-9fbaf34c0808 req-7d753556-9f8b-4c67-b5aa-cb5aaee3edc0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:56.866215 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-37096789-e65d-4161-a4a5-98f58dbea303 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/f84dcab4-4f70-47b3-84a5-919b11ca1fad" status: 202 len: 0 microversion: 2.1 time: 1.188068 Sep 08 12:53:56.866852 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1344/2812] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:53:55 2022] DELETE /compute/v2.1/os-security-groups/f84dcab4-4f70-47b3-84a5-919b11ca1fad => generated 0 bytes in 1190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:56.872796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eb811897-b198-4bd8-bd3c-a5feaa53675a tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:56.873507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eb811897-b198-4bd8-bd3c-a5feaa53675a tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] [instance: 73e10911-8428-4be8-b770-205b2d073655] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:56.887750 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d9fcd7bf-0724-467e-913f-9fbaf34c0808 req-7d753556-9f8b-4c67-b5aa-cb5aaee3edc0 service nova] Creating event network-vif-plugged:92e7277f-630b-4a44-a594-e381caaa441e for instance d39255b9-9e73-414d-ad6e-74664c01ab24 on n-h2-852084-10 Sep 08 12:53:56.890989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb811897-b198-4bd8-bd3c-a5feaa53675a tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:56.891551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb811897-b198-4bd8-bd3c-a5feaa53675a tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:56.892016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb811897-b198-4bd8-bd3c-a5feaa53675a tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:56.892804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb811897-b198-4bd8-bd3c-a5feaa53675a tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:56.893289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb811897-b198-4bd8-bd3c-a5feaa53675a tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:56.893735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb811897-b198-4bd8-bd3c-a5feaa53675a tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:56.907774 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d9fcd7bf-0724-467e-913f-9fbaf34c0808 req-7d753556-9f8b-4c67-b5aa-cb5aaee3edc0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087713 Sep 08 12:53:56.908852 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1469/2813] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:53:56.920591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e6d5fd9d-e102-48b3-a6d4-cb923df152c8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:56.926697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e6d5fd9d-e102-48b3-a6d4-cb923df152c8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:56.953490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6d5fd9d-e102-48b3-a6d4-cb923df152c8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:56.966062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6d5fd9d-e102-48b3-a6d4-cb923df152c8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:56.966786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6d5fd9d-e102-48b3-a6d4-cb923df152c8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:56.971893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6d5fd9d-e102-48b3-a6d4-cb923df152c8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:56.972563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6d5fd9d-e102-48b3-a6d4-cb923df152c8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:56.973139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6d5fd9d-e102-48b3-a6d4-cb923df152c8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:57.033801 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-eb811897-b198-4bd8-bd3c-a5feaa53675a tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] HTTP exception thrown: Instance 73e10911-8428-4be8-b770-205b2d073655 could not be found. Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eb811897-b198-4bd8-bd3c-a5feaa53675a tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Request method failure captured: Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 HTTP/1.1 Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeWaVm7fmtD9Wms8wxtEFJsPbX0YHvfp71TtA6Hwb_psRW1xlVGv5GwCWlm_0qVFnDzJm3U1sVmSXKSnnnkMX90fcd_25sEKdZktE3J_D8TIRi-g-9FSZYhQDahEUZRS5gGi8Q5VU3onwOXgQcdWb1tkmQBjxB5A3Ve8bKe-_m1ZgPc Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d49e8717cae0454e87b2e01790fc296c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: d49e8717cae0454e87b2e01790fc296c Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1363435491 Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 3beb0e265d694cd3bf2f92e31ab95dfd Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ListServersNegativeTestJSON-1363435491-project Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 73e10911-8428-4be8-b770-205b2d073655 could not be found. Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '73e10911-8428-4be8-b770-205b2d073655'} Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73e10911-8428-4be8-b770-205b2d073655 could not be found. Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73e10911-8428-4be8-b770-205b2d073655 could not be found. Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:57.049343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:53:57.053285 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:57.053285 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:53:57.053285 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:53:57.053285 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:53:57.053285 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:53:57.053285 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:53:57.053285 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73e10911-8428-4be8-b770-205b2d073655 could not be found. Sep 08 12:53:57.053285 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:53:57.060843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eb811897-b198-4bd8-bd3c-a5feaa53675a tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] Returning 404 to user: Instance 73e10911-8428-4be8-b770-205b2d073655 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:53:57.062249 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eb811897-b198-4bd8-bd3c-a5feaa53675a tempest-ListServersNegativeTestJSON-1363435491 tempest-ListServersNegativeTestJSON-1363435491-project] 10.222.0.78 "GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655" status: 404 len: 111 microversion: 2.1 time: 0.194341 Sep 08 12:53:57.068244 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1345/2814] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:56 2022] GET /compute/v2.1/servers/73e10911-8428-4be8-b770-205b2d073655 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:53:57.111275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d4032c6-c71f-49a9-820f-a8484c161d16 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Calling method '.version_select at 0x7fdb3a1ccd30>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:57.803998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6d5fd9d-e102-48b3-a6d4-cb923df152c8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:57.825482 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e6d5fd9d-e102-48b3-a6d4-cb923df152c8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1647 microversion: 2.1 time: 0.915057 Sep 08 12:53:57.831268 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1470/2815] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:56 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1647 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:57.858736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-36bdc19f-f693-4be2-9c67-cae2e2904e69 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:57.861168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-36bdc19f-f693-4be2-9c67-cae2e2904e69 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:57.876001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36bdc19f-f693-4be2-9c67-cae2e2904e69 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:57.877756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36bdc19f-f693-4be2-9c67-cae2e2904e69 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:57.879313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36bdc19f-f693-4be2-9c67-cae2e2904e69 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:57.882618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36bdc19f-f693-4be2-9c67-cae2e2904e69 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:57.885022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36bdc19f-f693-4be2-9c67-cae2e2904e69 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:57.886267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36bdc19f-f693-4be2-9c67-cae2e2904e69 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:58.624589 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4d4032c6-c71f-49a9-820f-a8484c161d16 tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/2ac9ae55-ad88-4413-a699-f5ececc9ea2d" status: 202 len: 0 microversion: 2.1 time: 1.552872 Sep 08 12:53:58.626137 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1346/2816] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:53:57 2022] DELETE /compute/v2.1/os-security-groups/2ac9ae55-ad88-4413-a699-f5ececc9ea2d => generated 0 bytes in 1557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:53:58.632683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-620d8da2-20e8-4115-9742-4be9486ca2e9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:58.633739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-620d8da2-20e8-4115-9742-4be9486ca2e9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:53:58.663459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-620d8da2-20e8-4115-9742-4be9486ca2e9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:58.667511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-620d8da2-20e8-4115-9742-4be9486ca2e9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:58.671860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-620d8da2-20e8-4115-9742-4be9486ca2e9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:58.674617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-620d8da2-20e8-4115-9742-4be9486ca2e9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:53:58.678422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-620d8da2-20e8-4115-9742-4be9486ca2e9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:53:58.682043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-36bdc19f-f693-4be2-9c67-cae2e2904e69 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:58.685143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-620d8da2-20e8-4115-9742-4be9486ca2e9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:53:58.742083 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-36bdc19f-f693-4be2-9c67-cae2e2904e69 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 0.903795 Sep 08 12:53:58.760243 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1471/2817] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:57 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:53:58.779168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e4a16a0-7936-4115-9b88-6e51abdca3fa tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] Calling method '.version_select at 0x7fdb36d650d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:53:59.907133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-620d8da2-20e8-4115-9742-4be9486ca2e9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:53:59.958414 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-620d8da2-20e8-4115-9742-4be9486ca2e9 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1334 microversion: 2.1 time: 1.330480 Sep 08 12:53:59.962041 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1347/2818] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:58 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1334 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:00.044614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7e1a7626-783a-4078-9479-ed396667c1b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:00.053349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7e1a7626-783a-4078-9479-ed396667c1b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:00.099350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e1a7626-783a-4078-9479-ed396667c1b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:00.099350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e1a7626-783a-4078-9479-ed396667c1b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:00.104350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e1a7626-783a-4078-9479-ed396667c1b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:00.111572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e1a7626-783a-4078-9479-ed396667c1b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:00.118336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e1a7626-783a-4078-9479-ed396667c1b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:00.120525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e1a7626-783a-4078-9479-ed396667c1b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:00.233942 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2e4a16a0-7936-4115-9b88-6e51abdca3fa tempest-SecurityGroupRulesTestJSON-1213665587 tempest-SecurityGroupRulesTestJSON-1213665587-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/096cb59f-664a-4d70-a18b-03ffae21d6ac" status: 202 len: 0 microversion: 2.1 time: 1.470837 Sep 08 12:54:00.235605 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1472/2819] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:53:58 2022] DELETE /compute/v2.1/os-security-groups/096cb59f-664a-4d70-a18b-03ffae21d6ac => generated 0 bytes in 1475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:54:00.245713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f4260bf4-aabf-4e30-8a6b-25f220529351 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:00.246415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f4260bf4-aabf-4e30-8a6b-25f220529351 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:00.262002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4260bf4-aabf-4e30-8a6b-25f220529351 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:00.262398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4260bf4-aabf-4e30-8a6b-25f220529351 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:00.263026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4260bf4-aabf-4e30-8a6b-25f220529351 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:00.263960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4260bf4-aabf-4e30-8a6b-25f220529351 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:00.270155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4260bf4-aabf-4e30-8a6b-25f220529351 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:00.270902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4260bf4-aabf-4e30-8a6b-25f220529351 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:00.570100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7e1a7626-783a-4078-9479-ed396667c1b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:00.590809 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7e1a7626-783a-4078-9479-ed396667c1b8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 200 len: 1301 microversion: 2.1 time: 0.578273 Sep 08 12:54:00.591450 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1348/2820] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:53:59 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 1301 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:00.616156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-d46c063f-514b-4305-99d1-952eb4c0d72e req-a17ff198-9d8a-4a85-8163-ed1efdfac2f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "303d9b60-22cb-426b-826b-b9a0465696a2", "name": "network-vif-deleted", "tag": "dbebedc8-4112-4036-a8d1-e89f23b4fcb2"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:00.668197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d46c063f-514b-4305-99d1-952eb4c0d72e req-a17ff198-9d8a-4a85-8163-ed1efdfac2f8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:00.671332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d46c063f-514b-4305-99d1-952eb4c0d72e req-a17ff198-9d8a-4a85-8163-ed1efdfac2f8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:00.672134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d46c063f-514b-4305-99d1-952eb4c0d72e req-a17ff198-9d8a-4a85-8163-ed1efdfac2f8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:00.720139 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d46c063f-514b-4305-99d1-952eb4c0d72e req-a17ff198-9d8a-4a85-8163-ed1efdfac2f8 service nova] Creating event network-vif-deleted:dbebedc8-4112-4036-a8d1-e89f23b4fcb2 for instance 303d9b60-22cb-426b-826b-b9a0465696a2 on n-h2-852084-10 Sep 08 12:54:00.743345 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-d46c063f-514b-4305-99d1-952eb4c0d72e req-a17ff198-9d8a-4a85-8163-ed1efdfac2f8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135682 Sep 08 12:54:00.744292 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1349/2821] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:01.007826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-847a1340-d0c9-43fc-9cc1-f01ee114d873 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:01.008639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-847a1340-d0c9-43fc-9cc1-f01ee114d873 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:01.029101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-847a1340-d0c9-43fc-9cc1-f01ee114d873 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:01.030222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-847a1340-d0c9-43fc-9cc1-f01ee114d873 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:01.030877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-847a1340-d0c9-43fc-9cc1-f01ee114d873 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:01.031913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-847a1340-d0c9-43fc-9cc1-f01ee114d873 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:01.032673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-847a1340-d0c9-43fc-9cc1-f01ee114d873 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:01.033374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-847a1340-d0c9-43fc-9cc1-f01ee114d873 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:01.728679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f4260bf4-aabf-4e30-8a6b-25f220529351 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:01.768835 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f4260bf4-aabf-4e30-8a6b-25f220529351 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 1.510439 Sep 08 12:54:01.768835 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1473/2822] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:00 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 1512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:01.768835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75ee2df5-1027-4a96-8106-63c3db9cbb66 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:01.768835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-75ee2df5-1027-4a96-8106-63c3db9cbb66 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:01.779972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75ee2df5-1027-4a96-8106-63c3db9cbb66 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:01.781041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75ee2df5-1027-4a96-8106-63c3db9cbb66 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:01.781728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75ee2df5-1027-4a96-8106-63c3db9cbb66 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:01.784166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75ee2df5-1027-4a96-8106-63c3db9cbb66 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:01.784961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75ee2df5-1027-4a96-8106-63c3db9cbb66 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:01.786086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75ee2df5-1027-4a96-8106-63c3db9cbb66 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:01.833475 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-75ee2df5-1027-4a96-8106-63c3db9cbb66 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75ee2df5-1027-4a96-8106-63c3db9cbb66 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 HTTP/1.1 Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '303d9b60-22cb-426b-826b-b9a0465696a2'} Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:01.836124 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:01.846314 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:01.846314 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:01.846314 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:01.846314 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:01.846314 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:01.846314 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:01.846314 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:01.846314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75ee2df5-1027-4a96-8106-63c3db9cbb66 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:01.846314 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-75ee2df5-1027-4a96-8106-63c3db9cbb66 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 404 len: 111 microversion: 2.1 time: 0.088700 Sep 08 12:54:01.846314 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1474/2823] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:01 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:01.856250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4852a94-da47-452a-9e0f-5fdb489afe54 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb36dec0d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:01.897312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-847a1340-d0c9-43fc-9cc1-f01ee114d873 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:01.906252 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-847a1340-d0c9-43fc-9cc1-f01ee114d873 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1670 microversion: 2.1 time: 0.904614 Sep 08 12:54:01.912359 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1350/2824] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:01 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1670 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:01.931923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d6b54c6-3d7a-4cfd-af36-02f9b46cc891 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:01.943316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d6b54c6-3d7a-4cfd-af36-02f9b46cc891 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:01.952988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d6b54c6-3d7a-4cfd-af36-02f9b46cc891 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:01.953882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d6b54c6-3d7a-4cfd-af36-02f9b46cc891 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:01.954553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d6b54c6-3d7a-4cfd-af36-02f9b46cc891 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:01.955521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d6b54c6-3d7a-4cfd-af36-02f9b46cc891 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:01.963732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d6b54c6-3d7a-4cfd-af36-02f9b46cc891 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:01.964547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d6b54c6-3d7a-4cfd-af36-02f9b46cc891 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:02.018884 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d6b54c6-3d7a-4cfd-af36-02f9b46cc891 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24/ips" status: 200 len: 180 microversion: 2.1 time: 0.093249 Sep 08 12:54:02.025255 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1351/2825] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 12:54:01 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24/ips => generated 180 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:54:02.037210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dfb16151-148c-4c4e-87ca-086037ff04f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:02.040861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dfb16151-148c-4c4e-87ca-086037ff04f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:02.057870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfb16151-148c-4c4e-87ca-086037ff04f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:02.058856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfb16151-148c-4c4e-87ca-086037ff04f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:02.059576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfb16151-148c-4c4e-87ca-086037ff04f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:02.062227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfb16151-148c-4c4e-87ca-086037ff04f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:02.062947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfb16151-148c-4c4e-87ca-086037ff04f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:02.063523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfb16151-148c-4c4e-87ca-086037ff04f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:02.129160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dfb16151-148c-4c4e-87ca-086037ff04f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:54:02.293736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:02.384710 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dfb16151-148c-4c4e-87ca-086037ff04f8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 204 len: 0 microversion: 2.1 time: 0.346769 Sep 08 12:54:02.385829 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1352/2826] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:54:02 2022] DELETE /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 12:54:02.435634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3727b0e0-c7e0-4421-86fa-ab4f9f2ad800 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:02.440637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3727b0e0-c7e0-4421-86fa-ab4f9f2ad800 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:02.472499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3727b0e0-c7e0-4421-86fa-ab4f9f2ad800 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:02.475646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3727b0e0-c7e0-4421-86fa-ab4f9f2ad800 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:02.477783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3727b0e0-c7e0-4421-86fa-ab4f9f2ad800 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:02.480840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3727b0e0-c7e0-4421-86fa-ab4f9f2ad800 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:02.484845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3727b0e0-c7e0-4421-86fa-ab4f9f2ad800 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:02.490488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3727b0e0-c7e0-4421-86fa-ab4f9f2ad800 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:03.219460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3727b0e0-c7e0-4421-86fa-ab4f9f2ad800 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:03.231070 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3727b0e0-c7e0-4421-86fa-ab4f9f2ad800 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1676 microversion: 2.1 time: 0.838690 Sep 08 12:54:03.237820 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1353/2827] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:02 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1676 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:54:03.251583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bfc34629-9979-4589-b7dd-024bffba83c3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:03.262592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bfc34629-9979-4589-b7dd-024bffba83c3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:03.299961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bfc34629-9979-4589-b7dd-024bffba83c3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:03.300668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bfc34629-9979-4589-b7dd-024bffba83c3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:03.301744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bfc34629-9979-4589-b7dd-024bffba83c3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:03.305570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bfc34629-9979-4589-b7dd-024bffba83c3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:03.307302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bfc34629-9979-4589-b7dd-024bffba83c3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:03.308501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bfc34629-9979-4589-b7dd-024bffba83c3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:03.458270 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e4852a94-da47-452a-9e0f-5fdb489afe54 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/47544d8f-6c23-4446-9f95-ca12bb3db608" status: 202 len: 0 microversion: 2.1 time: 1.613502 Sep 08 12:54:03.460732 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1475/2828] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:54:01 2022] DELETE /compute/v2.1/os-security-groups/47544d8f-6c23-4446-9f95-ca12bb3db608 => generated 0 bytes in 1617 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:54:03.470936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-376f6ab3-7525-4300-9cd6-6840cb108bf6 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb36dec3a0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:04.023250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bfc34629-9979-4589-b7dd-024bffba83c3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:04.047361 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bfc34629-9979-4589-b7dd-024bffba83c3 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 0.807657 Sep 08 12:54:04.054536 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1354/2829] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:03 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:04.278921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-72d32cad-d592-4f75-b8e2-796d5c2fd6c2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:04.280054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-72d32cad-d592-4f75-b8e2-796d5c2fd6c2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:04.295855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72d32cad-d592-4f75-b8e2-796d5c2fd6c2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:04.296701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72d32cad-d592-4f75-b8e2-796d5c2fd6c2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:04.297504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72d32cad-d592-4f75-b8e2-796d5c2fd6c2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:04.298800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72d32cad-d592-4f75-b8e2-796d5c2fd6c2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:04.320027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72d32cad-d592-4f75-b8e2-796d5c2fd6c2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:04.320581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72d32cad-d592-4f75-b8e2-796d5c2fd6c2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:05.608569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-72d32cad-d592-4f75-b8e2-796d5c2fd6c2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:05.652060 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-72d32cad-d592-4f75-b8e2-796d5c2fd6c2 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1676 microversion: 2.1 time: 1.376350 Sep 08 12:54:05.652060 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1355/2830] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:04 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1676 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:54:05.692153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-926025f8-6a38-47af-9b5e-36b770e82208 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:05.693334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-926025f8-6a38-47af-9b5e-36b770e82208 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:05.713580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-926025f8-6a38-47af-9b5e-36b770e82208 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:05.720191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-926025f8-6a38-47af-9b5e-36b770e82208 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:05.721303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-926025f8-6a38-47af-9b5e-36b770e82208 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:05.723066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-926025f8-6a38-47af-9b5e-36b770e82208 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:05.728827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-926025f8-6a38-47af-9b5e-36b770e82208 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:05.729872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-926025f8-6a38-47af-9b5e-36b770e82208 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:05.916171 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-376f6ab3-7525-4300-9cd6-6840cb108bf6 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/89e07c98-e5ff-4455-87b7-c8e8ce54b5a6" status: 202 len: 0 microversion: 2.1 time: 2.449559 Sep 08 12:54:05.917232 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1476/2831] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:54:03 2022] DELETE /compute/v2.1/os-security-groups/89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 => generated 0 bytes in 2452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 12:54:05.949140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-205a53e9-65e1-4661-8414-a65189d430cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'create', calling method: .version_select at 0x7fdb3f16c670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1363132777", "description": "tempest-description-2075166043"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:06.636212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-926025f8-6a38-47af-9b5e-36b770e82208 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:06.664782 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-926025f8-6a38-47af-9b5e-36b770e82208 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 0.995927 Sep 08 12:54:06.700159 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1356/2832] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:05 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:06.718671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fb8c9e3a-5858-4fb5-91a5-2df7b2aa4fd6 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:06.720180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fb8c9e3a-5858-4fb5-91a5-2df7b2aa4fd6 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:06.736213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb8c9e3a-5858-4fb5-91a5-2df7b2aa4fd6 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:06.737147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb8c9e3a-5858-4fb5-91a5-2df7b2aa4fd6 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:06.737788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb8c9e3a-5858-4fb5-91a5-2df7b2aa4fd6 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:06.738702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb8c9e3a-5858-4fb5-91a5-2df7b2aa4fd6 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:06.739452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb8c9e3a-5858-4fb5-91a5-2df7b2aa4fd6 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:06.740081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fb8c9e3a-5858-4fb5-91a5-2df7b2aa4fd6 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:07.651020 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-205a53e9-65e1-4661-8414-a65189d430cf tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.711953 Sep 08 12:54:07.653545 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1477/2833] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:54:05 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:07.685065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7894240e-1675-484c-b351-51b44a2aa89e req-ac3e23c8-73c1-4bad-86de-d84293c029e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39255b9-9e73-414d-ad6e-74664c01ab24", "name": "network-vif-unplugged", "status": "completed", "tag": "52cf1620-924c-49e0-b57e-68ee190bf8d1"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:07.759731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7894240e-1675-484c-b351-51b44a2aa89e req-ac3e23c8-73c1-4bad-86de-d84293c029e2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:07.761039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7894240e-1675-484c-b351-51b44a2aa89e req-ac3e23c8-73c1-4bad-86de-d84293c029e2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:07.762133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7894240e-1675-484c-b351-51b44a2aa89e req-ac3e23c8-73c1-4bad-86de-d84293c029e2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:07.854231 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7894240e-1675-484c-b351-51b44a2aa89e req-ac3e23c8-73c1-4bad-86de-d84293c029e2 service nova] Creating event network-vif-unplugged:52cf1620-924c-49e0-b57e-68ee190bf8d1 for instance d39255b9-9e73-414d-ad6e-74664c01ab24 on n-h2-852084-10 Sep 08 12:54:07.878091 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7894240e-1675-484c-b351-51b44a2aa89e req-ac3e23c8-73c1-4bad-86de-d84293c029e2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.221407 Sep 08 12:54:07.883725 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1478/2834] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:54:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:07.914587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-76ceaf14-8f2d-4f75-a571-1437bfc06cee tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Action: 'update', calling method: .version_select at 0x7fdb36d985e0>, body: {"security_group": {"name": "tempest-sg-hth-607569057", "description": "tempest-description-hth-1747061782"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:08.176754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fb8c9e3a-5858-4fb5-91a5-2df7b2aa4fd6 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:08.212604 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fb8c9e3a-5858-4fb5-91a5-2df7b2aa4fd6 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1676 microversion: 2.1 time: 1.510237 Sep 08 12:54:08.254453 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1357/2835] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:06 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1676 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:08.274533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-443994c0-03c1-4d74-ab37-358a324b53f8 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:08.276354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-443994c0-03c1-4d74-ab37-358a324b53f8 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:08.300725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-443994c0-03c1-4d74-ab37-358a324b53f8 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:08.304498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-443994c0-03c1-4d74-ab37-358a324b53f8 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:08.312640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-443994c0-03c1-4d74-ab37-358a324b53f8 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:08.317721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-443994c0-03c1-4d74-ab37-358a324b53f8 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:08.322117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-443994c0-03c1-4d74-ab37-358a324b53f8 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:08.329967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-443994c0-03c1-4d74-ab37-358a324b53f8 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:09.065569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-443994c0-03c1-4d74-ab37-358a324b53f8 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:09.081292 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-443994c0-03c1-4d74-ab37-358a324b53f8 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 0.824909 Sep 08 12:54:09.093023 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1358/2836] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:08 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:09.098466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e467ae70-3fbb-4068-b0c4-5e2fdc7df389 req-b18541c3-fd57-4e83-9f6e-b2f3cf640270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39255b9-9e73-414d-ad6e-74664c01ab24", "name": "network-vif-deleted", "tag": "92e7277f-630b-4a44-a594-e381caaa441e"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:09.125549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e467ae70-3fbb-4068-b0c4-5e2fdc7df389 req-b18541c3-fd57-4e83-9f6e-b2f3cf640270 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:09.126575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e467ae70-3fbb-4068-b0c4-5e2fdc7df389 req-b18541c3-fd57-4e83-9f6e-b2f3cf640270 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:09.127327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e467ae70-3fbb-4068-b0c4-5e2fdc7df389 req-b18541c3-fd57-4e83-9f6e-b2f3cf640270 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:09.152354 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e467ae70-3fbb-4068-b0c4-5e2fdc7df389 req-b18541c3-fd57-4e83-9f6e-b2f3cf640270 service nova] Creating event network-vif-deleted:92e7277f-630b-4a44-a594-e381caaa441e for instance d39255b9-9e73-414d-ad6e-74664c01ab24 on n-h2-852084-10 Sep 08 12:54:09.169883 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e467ae70-3fbb-4068-b0c4-5e2fdc7df389 req-b18541c3-fd57-4e83-9f6e-b2f3cf640270 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075102 Sep 08 12:54:09.175533 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1359/2837] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:54:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:09.265578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3b38110c-fc99-4d47-9fa3-aa2f4d5815d8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:09.281570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3b38110c-fc99-4d47-9fa3-aa2f4d5815d8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:09.295597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b38110c-fc99-4d47-9fa3-aa2f4d5815d8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:09.296495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b38110c-fc99-4d47-9fa3-aa2f4d5815d8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:09.297325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b38110c-fc99-4d47-9fa3-aa2f4d5815d8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:09.298656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b38110c-fc99-4d47-9fa3-aa2f4d5815d8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:09.311872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b38110c-fc99-4d47-9fa3-aa2f4d5815d8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:09.312817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b38110c-fc99-4d47-9fa3-aa2f4d5815d8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:09.682230 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-76ceaf14-8f2d-4f75-a571-1437bfc06cee tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "PUT /compute/v2.1/os-security-groups/eb562a86-e2c6-463a-a21d-2cec37577433" status: 200 len: 217 microversion: 2.1 time: 1.793036 Sep 08 12:54:09.683545 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1479/2838] 10.222.0.78 () {60 vars in 1290 bytes} [Thu Sep 8 12:54:07 2022] PUT /compute/v2.1/os-security-groups/eb562a86-e2c6-463a-a21d-2cec37577433 => generated 217 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:09.696939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fd1c85cc-4914-4e75-9535-6526c572bed4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3f2ec3a0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:10.607559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b38110c-fc99-4d47-9fa3-aa2f4d5815d8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:10.617663 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3b38110c-fc99-4d47-9fa3-aa2f4d5815d8 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1497 microversion: 2.1 time: 1.360552 Sep 08 12:54:10.626287 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1360/2839] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:09 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1497 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:54:10.632580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-452e8d08-8479-4206-a1a2-87d5e83af61f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:10.636285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-452e8d08-8479-4206-a1a2-87d5e83af61f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:10.651398 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fd1c85cc-4914-4e75-9535-6526c572bed4 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/os-security-groups/eb562a86-e2c6-463a-a21d-2cec37577433" status: 200 len: 217 microversion: 2.1 time: 0.958122 Sep 08 12:54:10.661637 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1480/2840] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 12:54:09 2022] GET /compute/v2.1/os-security-groups/eb562a86-e2c6-463a-a21d-2cec37577433 => generated 217 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:10.668132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aebefda0-0412-4ea3-8219-936cfe937b8f tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb36dec160>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:10.678316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-452e8d08-8479-4206-a1a2-87d5e83af61f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:10.704656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-452e8d08-8479-4206-a1a2-87d5e83af61f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:10.705410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-452e8d08-8479-4206-a1a2-87d5e83af61f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:10.705905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-452e8d08-8479-4206-a1a2-87d5e83af61f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:10.706377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-452e8d08-8479-4206-a1a2-87d5e83af61f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:10.706811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-452e8d08-8479-4206-a1a2-87d5e83af61f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:11.612883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-452e8d08-8479-4206-a1a2-87d5e83af61f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:11.623558 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-452e8d08-8479-4206-a1a2-87d5e83af61f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 0.994897 Sep 08 12:54:11.624182 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1361/2841] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:10 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:11.654516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cd303d95-db8b-4c71-8d6f-07c0ddee8b8b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:11.655133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cd303d95-db8b-4c71-8d6f-07c0ddee8b8b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:11.668201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd303d95-db8b-4c71-8d6f-07c0ddee8b8b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:11.668201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd303d95-db8b-4c71-8d6f-07c0ddee8b8b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:11.668201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd303d95-db8b-4c71-8d6f-07c0ddee8b8b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:11.678526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd303d95-db8b-4c71-8d6f-07c0ddee8b8b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:11.679114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd303d95-db8b-4c71-8d6f-07c0ddee8b8b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:11.692491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd303d95-db8b-4c71-8d6f-07c0ddee8b8b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:11.959425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cd303d95-db8b-4c71-8d6f-07c0ddee8b8b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:11.998779 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cd303d95-db8b-4c71-8d6f-07c0ddee8b8b tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1455 microversion: 2.1 time: 0.348413 Sep 08 12:54:12.003891 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1362/2842] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:11 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1455 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:54:12.146321 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aebefda0-0412-4ea3-8219-936cfe937b8f tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/eb562a86-e2c6-463a-a21d-2cec37577433" status: 202 len: 0 microversion: 2.1 time: 1.483186 Sep 08 12:54:12.151254 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1481/2843] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:54:10 2022] DELETE /compute/v2.1/os-security-groups/eb562a86-e2c6-463a-a21d-2cec37577433 => generated 0 bytes in 1489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:54:12.159878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a96aced1-5bb5-444c-b658-995100c97320 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:12.160662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a96aced1-5bb5-444c-b658-995100c97320 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:12.173634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a96aced1-5bb5-444c-b658-995100c97320 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:12.175012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a96aced1-5bb5-444c-b658-995100c97320 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:12.177454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a96aced1-5bb5-444c-b658-995100c97320 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:12.179402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a96aced1-5bb5-444c-b658-995100c97320 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:12.182549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a96aced1-5bb5-444c-b658-995100c97320 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:12.183527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a96aced1-5bb5-444c-b658-995100c97320 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:12.240001 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-a96aced1-5bb5-444c-b658-995100c97320 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a96aced1-5bb5-444c-b658-995100c97320 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 HTTP/1.1 Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '303d9b60-22cb-426b-826b-b9a0465696a2'} Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:54:12.242455 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:54:12.246850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:12.246850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.246850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:12.246850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.246850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.246850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:12.246850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:12.246850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:12.246850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:12.246850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:12.246850 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.249642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a96aced1-5bb5-444c-b658-995100c97320 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:12.251122 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a96aced1-5bb5-444c-b658-995100c97320 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 404 len: 111 microversion: 2.1 time: 0.095690 Sep 08 12:54:12.252639 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1363/2844] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:54:12 2022] DELETE /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:12.261184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b410697d-a837-4770-ba9c-749255e9c6f1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:12.262303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b410697d-a837-4770-ba9c-749255e9c6f1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 303d9b60-22cb-426b-826b-b9a0465696a2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:12.264954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:12.303384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b410697d-a837-4770-ba9c-749255e9c6f1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:12.313110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b410697d-a837-4770-ba9c-749255e9c6f1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:12.313965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b410697d-a837-4770-ba9c-749255e9c6f1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:12.314974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b410697d-a837-4770-ba9c-749255e9c6f1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:12.315658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b410697d-a837-4770-ba9c-749255e9c6f1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:12.316286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b410697d-a837-4770-ba9c-749255e9c6f1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:12.378115 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-b410697d-a837-4770-ba9c-749255e9c6f1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b410697d-a837-4770-ba9c-749255e9c6f1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 HTTP/1.1 Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '303d9b60-22cb-426b-826b-b9a0465696a2'} Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:12.388563 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.395017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.395017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:12.395017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:12.395017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:12.395017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:12.395017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. Sep 08 12:54:12.395017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.396039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b410697d-a837-4770-ba9c-749255e9c6f1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Instance 303d9b60-22cb-426b-826b-b9a0465696a2 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:12.396727 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b410697d-a837-4770-ba9c-749255e9c6f1 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2" status: 404 len: 111 microversion: 2.1 time: 0.140195 Sep 08 12:54:12.406016 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1482/2845] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:12 2022] GET /compute/v2.1/servers/303d9b60-22cb-426b-826b-b9a0465696a2 => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:12.412400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-26b7d6c7-e160-484b-b34c-5e058e0fe204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3a080310>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:12.437626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-97fd6b0e-0cef-47b1-ae0d-26a2c2e19931 req-36fdcf6b-9dd3-46a7-bf01-a683e1333d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d39255b9-9e73-414d-ad6e-74664c01ab24", "name": "network-vif-deleted", "tag": "52cf1620-924c-49e0-b57e-68ee190bf8d1"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:12.467408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97fd6b0e-0cef-47b1-ae0d-26a2c2e19931 req-36fdcf6b-9dd3-46a7-bf01-a683e1333d13 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:12.468380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97fd6b0e-0cef-47b1-ae0d-26a2c2e19931 req-36fdcf6b-9dd3-46a7-bf01-a683e1333d13 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:12.469016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97fd6b0e-0cef-47b1-ae0d-26a2c2e19931 req-36fdcf6b-9dd3-46a7-bf01-a683e1333d13 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:12.493852 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-97fd6b0e-0cef-47b1-ae0d-26a2c2e19931 req-36fdcf6b-9dd3-46a7-bf01-a683e1333d13 service nova] Creating event network-vif-deleted:52cf1620-924c-49e0-b57e-68ee190bf8d1 for instance d39255b9-9e73-414d-ad6e-74664c01ab24 on n-h2-852084-10 Sep 08 12:54:12.509935 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-97fd6b0e-0cef-47b1-ae0d-26a2c2e19931 req-36fdcf6b-9dd3-46a7-bf01-a683e1333d13 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071792 Sep 08 12:54:12.511453 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1483/2846] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:12.552751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG neutronclient.v2_0.client [None req-26b7d6c7-e160-484b-b34c-5e058e0fe204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 does not exist", "detail": ""}} {{(pid=128971) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:54:12.553424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.security_group_api [None req-26b7d6c7-e160-484b-b34c-5e058e0fe204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Neutron security group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 not found {{(pid=128971) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:54:12.554014 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-26b7d6c7-e160-484b-b34c-5e058e0fe204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Security group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 does not exist Sep 08 12:54:12.554014 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-2b109cda-dee3-4eb2-a8ba-92bb13b02090'] Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-26b7d6c7-e160-484b-b34c-5e058e0fe204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-security-groups/89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 HTTP/1.1 Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: exception: Security group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 does not exist Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-2b109cda-dee3-4eb2-a8ba-92bb13b02090'] Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '89e07c98-e5ff-4455-87b7-c8e8ce54b5a6'} Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:54:12.556747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 does not exist Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b109cda-dee3-4eb2-a8ba-92bb13b02090'] Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 does not exist Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b109cda-dee3-4eb2-a8ba-92bb13b02090'] Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 does not exist Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b109cda-dee3-4eb2-a8ba-92bb13b02090'] Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 does not exist Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2b109cda-dee3-4eb2-a8ba-92bb13b02090'] Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-26b7d6c7-e160-484b-b34c-5e058e0fe204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Security group 89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 does not exist Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-2b109cda-dee3-4eb2-a8ba-92bb13b02090'] {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-26b7d6c7-e160-484b-b34c-5e058e0fe204 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/89e07c98-e5ff-4455-87b7-c8e8ce54b5a6" status: 404 len: 194 microversion: 2.1 time: 0.151359 Sep 08 12:54:12.561732 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1364/2847] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:54:12 2022] DELETE /compute/v2.1/os-security-groups/89e07c98-e5ff-4455-87b7-c8e8ce54b5a6 => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:12.572690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4e300308-1533-4dbc-96b1-5811ee3a478a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb36518310>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:12.633295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG neutronclient.v2_0.client [None req-4e300308-1533-4dbc-96b1-5811ee3a478a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 47544d8f-6c23-4446-9f95-ca12bb3db608 does not exist", "detail": ""}} {{(pid=128970) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:54:12.634550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.security_group_api [None req-4e300308-1533-4dbc-96b1-5811ee3a478a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Neutron security group 47544d8f-6c23-4446-9f95-ca12bb3db608 not found {{(pid=128970) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:54:12.635432 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-4e300308-1533-4dbc-96b1-5811ee3a478a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Security group 47544d8f-6c23-4446-9f95-ca12bb3db608 does not exist Sep 08 12:54:12.635432 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-1b63d969-ae46-4f8d-976b-31ec5097c23e'] Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4e300308-1533-4dbc-96b1-5811ee3a478a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/os-security-groups/47544d8f-6c23-4446-9f95-ca12bb3db608 HTTP/1.1 Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: exception: Security group 47544d8f-6c23-4446-9f95-ca12bb3db608 does not exist Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-1b63d969-ae46-4f8d-976b-31ec5097c23e'] Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '47544d8f-6c23-4446-9f95-ca12bb3db608'} Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:54:12.637908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 47544d8f-6c23-4446-9f95-ca12bb3db608 does not exist Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b63d969-ae46-4f8d-976b-31ec5097c23e'] Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 47544d8f-6c23-4446-9f95-ca12bb3db608 does not exist Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b63d969-ae46-4f8d-976b-31ec5097c23e'] Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 47544d8f-6c23-4446-9f95-ca12bb3db608 does not exist Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b63d969-ae46-4f8d-976b-31ec5097c23e'] Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 47544d8f-6c23-4446-9f95-ca12bb3db608 does not exist Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1b63d969-ae46-4f8d-976b-31ec5097c23e'] Sep 08 12:54:12.641918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:12.646834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4e300308-1533-4dbc-96b1-5811ee3a478a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Security group 47544d8f-6c23-4446-9f95-ca12bb3db608 does not exist Sep 08 12:54:12.646834 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-1b63d969-ae46-4f8d-976b-31ec5097c23e'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:12.649650 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4e300308-1533-4dbc-96b1-5811ee3a478a tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/47544d8f-6c23-4446-9f95-ca12bb3db608" status: 404 len: 194 microversion: 2.1 time: 0.081969 Sep 08 12:54:12.651692 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1484/2848] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:54:12 2022] DELETE /compute/v2.1/os-security-groups/47544d8f-6c23-4446-9f95-ca12bb3db608 => generated 194 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:12.662452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c4acfdbe-f2cf-4c37-8344-43cbc347b4e5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3a108c10>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:12.671577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e9a12ed4-5bba-449c-a5ea-e6d37a739c3b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:12.673375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e9a12ed4-5bba-449c-a5ea-e6d37a739c3b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:12.712900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9a12ed4-5bba-449c-a5ea-e6d37a739c3b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:12.713808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9a12ed4-5bba-449c-a5ea-e6d37a739c3b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:12.716745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9a12ed4-5bba-449c-a5ea-e6d37a739c3b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:12.717892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9a12ed4-5bba-449c-a5ea-e6d37a739c3b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:12.718601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9a12ed4-5bba-449c-a5ea-e6d37a739c3b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:12.724596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9a12ed4-5bba-449c-a5ea-e6d37a739c3b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:13.239764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG neutronclient.v2_0.client [None req-c4acfdbe-f2cf-4c37-8344-43cbc347b4e5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist", "detail": ""}} {{(pid=128971) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:54:13.240425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.security_group_api [None req-c4acfdbe-f2cf-4c37-8344-43cbc347b4e5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Neutron security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 not found {{(pid=128971) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:54:13.242340 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-c4acfdbe-f2cf-4c37-8344-43cbc347b4e5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:54:13.242340 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-779f6d79-14e8-4c2c-8efa-5830239153a7'] Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c4acfdbe-f2cf-4c37-8344-43cbc347b4e5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-security-groups/d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 HTTP/1.1 Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: exception: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-779f6d79-14e8-4c2c-8efa-5830239153a7'] Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'd1dfd1a3-aa4a-4f00-a6d0-0555a966b507'} Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:54:13.244496 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-779f6d79-14e8-4c2c-8efa-5830239153a7'] Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-779f6d79-14e8-4c2c-8efa-5830239153a7'] Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-779f6d79-14e8-4c2c-8efa-5830239153a7'] Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-779f6d79-14e8-4c2c-8efa-5830239153a7'] Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c4acfdbe-f2cf-4c37-8344-43cbc347b4e5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Security group d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 does not exist Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: Neutron server returns request_ids: ['req-779f6d79-14e8-4c2c-8efa-5830239153a7'] {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c4acfdbe-f2cf-4c37-8344-43cbc347b4e5 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/d1dfd1a3-aa4a-4f00-a6d0-0555a966b507" status: 404 len: 194 microversion: 2.1 time: 0.590730 Sep 08 12:54:13.254355 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1365/2849] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:54:12 2022] DELETE /compute/v2.1/os-security-groups/d1dfd1a3-aa4a-4f00-a6d0-0555a966b507 => generated 194 bytes in 593 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:13.267156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:13.267156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:13.267156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:13.267156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:13.268104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:13.268328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:13.271972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:13.271972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:13.330928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:13.332402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:13.332402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:13.332402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lazy-loading 'fault' on Instance uuid d39255b9-9e73-414d-ad6e-74664c01ab24 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:54:13.534083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7063832f6c334d26bd0f30b5b16116b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2b4bb04764e484099a1380cee0343d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:13.551015 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2b86cafd-57a5-4305-a514-8ce01dd844ce tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 200 len: 1303 microversion: 2.1 time: 0.301250 Sep 08 12:54:13.566845 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1366/2850] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:13 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 1303 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:13.629639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e9a12ed4-5bba-449c-a5ea-e6d37a739c3b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:13.668998 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e9a12ed4-5bba-449c-a5ea-e6d37a739c3b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 0.999769 Sep 08 12:54:13.671171 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1485/2851] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:12 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:54:13.691059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60f66a51-74e9-4af6-9db6-a337752a8b5e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3666e160>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:13.861278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG neutronclient.v2_0.client [None req-60f66a51-74e9-4af6-9db6-a337752a8b5e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist", "detail": ""}} {{(pid=128970) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:54:13.863148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.security_group_api [None req-60f66a51-74e9-4af6-9db6-a337752a8b5e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Neutron security group a7a8f14e-cab2-4768-b185-7da7961fa6aa not found {{(pid=128970) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:54:13.864384 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-60f66a51-74e9-4af6-9db6-a337752a8b5e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:54:13.864384 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-b5f03664-c951-4d9e-b46d-fcd562595831'] Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60f66a51-74e9-4af6-9db6-a337752a8b5e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/os-security-groups/a7a8f14e-cab2-4768-b185-7da7961fa6aa HTTP/1.1 Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: exception: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-b5f03664-c951-4d9e-b46d-fcd562595831'] Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'a7a8f14e-cab2-4768-b185-7da7961fa6aa'} Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:54:13.868831 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5f03664-c951-4d9e-b46d-fcd562595831'] Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5f03664-c951-4d9e-b46d-fcd562595831'] Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5f03664-c951-4d9e-b46d-fcd562595831'] Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5f03664-c951-4d9e-b46d-fcd562595831'] Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60f66a51-74e9-4af6-9db6-a337752a8b5e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Security group a7a8f14e-cab2-4768-b185-7da7961fa6aa does not exist Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-b5f03664-c951-4d9e-b46d-fcd562595831'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:13.875674 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-60f66a51-74e9-4af6-9db6-a337752a8b5e tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/a7a8f14e-cab2-4768-b185-7da7961fa6aa" status: 404 len: 194 microversion: 2.1 time: 0.200619 Sep 08 12:54:13.885063 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1486/2852] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:54:13 2022] DELETE /compute/v2.1/os-security-groups/a7a8f14e-cab2-4768-b185-7da7961fa6aa => generated 194 bytes in 205 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:13.904420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-72526c4a-0d74-40ce-b6d8-96ac8bd2200c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb36bf3ca0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:13.978983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG neutronclient.v2_0.client [None req-72526c4a-0d74-40ce-b6d8-96ac8bd2200c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist", "detail": ""}} {{(pid=128970) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:54:13.980735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.security_group_api [None req-72526c4a-0d74-40ce-b6d8-96ac8bd2200c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Neutron security group f3508352-518c-440d-9eaa-b8d34af32007 not found {{(pid=128970) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:54:13.983569 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-72526c4a-0d74-40ce-b6d8-96ac8bd2200c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:54:13.983569 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-00a3bbbc-4b23-4279-96d7-380bba1f8fed'] Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-72526c4a-0d74-40ce-b6d8-96ac8bd2200c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/os-security-groups/f3508352-518c-440d-9eaa-b8d34af32007 HTTP/1.1 Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: exception: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-00a3bbbc-4b23-4279-96d7-380bba1f8fed'] Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'f3508352-518c-440d-9eaa-b8d34af32007'} Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:54:13.988180 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00a3bbbc-4b23-4279-96d7-380bba1f8fed'] Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00a3bbbc-4b23-4279-96d7-380bba1f8fed'] Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00a3bbbc-4b23-4279-96d7-380bba1f8fed'] Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00a3bbbc-4b23-4279-96d7-380bba1f8fed'] Sep 08 12:54:13.997922 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.008285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-72526c4a-0d74-40ce-b6d8-96ac8bd2200c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Security group f3508352-518c-440d-9eaa-b8d34af32007 does not exist Sep 08 12:54:14.008285 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-00a3bbbc-4b23-4279-96d7-380bba1f8fed'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:14.010861 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-72526c4a-0d74-40ce-b6d8-96ac8bd2200c tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/f3508352-518c-440d-9eaa-b8d34af32007" status: 404 len: 194 microversion: 2.1 time: 0.127302 Sep 08 12:54:14.012753 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1487/2853] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:54:13 2022] DELETE /compute/v2.1/os-security-groups/f3508352-518c-440d-9eaa-b8d34af32007 => generated 194 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:14.032265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-334747b9-56e0-41f6-8841-ce3357531268 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3666e8b0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:14.172989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG neutronclient.v2_0.client [None req-334747b9-56e0-41f6-8841-ce3357531268 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist", "detail": ""}} {{(pid=128970) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:54:14.174240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.security_group_api [None req-334747b9-56e0-41f6-8841-ce3357531268 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Neutron security group 2061d986-c7e4-4ccf-af8d-113345c901dd not found {{(pid=128970) get /opt/stack/nova/nova/network/security_group_api.py:313}} Sep 08 12:54:14.175565 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-334747b9-56e0-41f6-8841-ce3357531268 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:54:14.175565 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-0db08392-5181-46d7-b706-cc03118dea91'] Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-334747b9-56e0-41f6-8841-ce3357531268 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/os-security-groups/2061d986-c7e4-4ccf-af8d-113345c901dd HTTP/1.1 Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: exception: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-0db08392-5181-46d7-b706-cc03118dea91'] Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '2061d986-c7e4-4ccf-af8d-113345c901dd'} Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:54:14.181870 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0db08392-5181-46d7-b706-cc03118dea91'] Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0db08392-5181-46d7-b706-cc03118dea91'] Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0db08392-5181-46d7-b706-cc03118dea91'] Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0db08392-5181-46d7-b706-cc03118dea91'] Sep 08 12:54:14.189116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.197636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-334747b9-56e0-41f6-8841-ce3357531268 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Security group 2061d986-c7e4-4ccf-af8d-113345c901dd does not exist Sep 08 12:54:14.197636 n-d-852084-10 devstack@n-api.service[128970]: Neutron server returns request_ids: ['req-0db08392-5181-46d7-b706-cc03118dea91'] {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:14.202830 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-334747b9-56e0-41f6-8841-ce3357531268 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/2061d986-c7e4-4ccf-af8d-113345c901dd" status: 404 len: 194 microversion: 2.1 time: 0.184064 Sep 08 12:54:14.207792 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1488/2854] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:54:14 2022] DELETE /compute/v2.1/os-security-groups/2061d986-c7e4-4ccf-af8d-113345c901dd => generated 194 bytes in 191 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 12:54:14.234738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a77a7207-c2be-42a8-96eb-7e7218a3209a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:14.242438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a77a7207-c2be-42a8-96eb-7e7218a3209a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:14.282600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a77a7207-c2be-42a8-96eb-7e7218a3209a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:14.284399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a77a7207-c2be-42a8-96eb-7e7218a3209a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:14.284916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a77a7207-c2be-42a8-96eb-7e7218a3209a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:14.285697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a77a7207-c2be-42a8-96eb-7e7218a3209a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:14.286179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a77a7207-c2be-42a8-96eb-7e7218a3209a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:14.291384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a77a7207-c2be-42a8-96eb-7e7218a3209a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:14.398655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b1c1ae69-d759-4ec4-ae5f-686c6c725ed2 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Action: 'create', calling method: .version_select at 0x7fdb3a108430>, body: {"keypair": {"name": "tempest-keypair-496987803", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKGjTiaEyhxvQG3WECgWZ2KCwrNXKlt/+hdbuP//ytACWReaMEhGZwAI+c5K8hRLgfZunpVwi9ComqiwekAqFbSIUOokEjvn97ELG/OqY8mn8iXDN3Mniq7P9XyBGyu3Vw=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:14.432978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b1c1ae69-d759-4ec4-ae5f-686c6c725ed2 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Getting quotas for project 3957124a8f134e2c8043539232be46ce. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:54:14.458377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b1c1ae69-d759-4ec4-ae5f-686c6c725ed2 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Getting quotas for user b40d83cbf26d495fb66d0a78d211c41b and project 3957124a8f134e2c8043539232be46ce. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:54:14.498929 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b1c1ae69-d759-4ec4-ae5f-686c6c725ed2 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.923853 Sep 08 12:54:14.500330 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1367/2855] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:54:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:14.529393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-94ca526d-8995-427b-a005-148b838d1598 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:14.534355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-94ca526d-8995-427b-a005-148b838d1598 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:14.545930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ca526d-8995-427b-a005-148b838d1598 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:14.547396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ca526d-8995-427b-a005-148b838d1598 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:14.552031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ca526d-8995-427b-a005-148b838d1598 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:14.553497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ca526d-8995-427b-a005-148b838d1598 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:14.554248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ca526d-8995-427b-a005-148b838d1598 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:14.555251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ca526d-8995-427b-a005-148b838d1598 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:14.602531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-94ca526d-8995-427b-a005-148b838d1598 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:54:14.793623 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-94ca526d-8995-427b-a005-148b838d1598 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 204 len: 0 microversion: 2.1 time: 0.290480 Sep 08 12:54:14.795757 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1368/2856] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:54:14 2022] DELETE /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:54:14.810251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8ef1a973-1b67-49be-b77f-4aee532e4a32 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:14.815651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8ef1a973-1b67-49be-b77f-4aee532e4a32 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:14.834561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ef1a973-1b67-49be-b77f-4aee532e4a32 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:14.843378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a77a7207-c2be-42a8-96eb-7e7218a3209a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:14.848124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ef1a973-1b67-49be-b77f-4aee532e4a32 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:14.848593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ef1a973-1b67-49be-b77f-4aee532e4a32 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:14.849330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ef1a973-1b67-49be-b77f-4aee532e4a32 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:14.849817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ef1a973-1b67-49be-b77f-4aee532e4a32 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:14.850306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ef1a973-1b67-49be-b77f-4aee532e4a32 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:14.868135 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a77a7207-c2be-42a8-96eb-7e7218a3209a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.658566 Sep 08 12:54:14.871580 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1489/2857] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:14 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:14.889049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b3c761bb-2da6-4dce-aa2a-a59c4c8bada9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:14.889705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b3c761bb-2da6-4dce-aa2a-a59c4c8bada9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:14.906292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3c761bb-2da6-4dce-aa2a-a59c4c8bada9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:14.906812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3c761bb-2da6-4dce-aa2a-a59c4c8bada9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:14.909565 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-8ef1a973-1b67-49be-b77f-4aee532e4a32 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] HTTP exception thrown: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8ef1a973-1b67-49be-b77f-4aee532e4a32 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Request method failure captured: Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 HTTP/1.1 Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeU_XtinJzfTr2r8jQ-dQM26ab93LNnZmWsVSl_w6BcZY6hr8Hd_kESK6HWkxAufGsC_i-TOYcrff_w1RbdrGa-ZJYI-rNoJYsIbF5uNhT6MeJHtt-iLaMGRkcqgtBdSCpcdE77UMlggicdA-yQRlY2p65jsUjIa7jFPFS5b9b9k7rI Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: a2b4bb04764e484099a1380cee0343d9 Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: a2b4bb04764e484099a1380cee0343d9 Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestMultiNic-2053997464-project Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 7063832f6c334d26bd0f30b5b16116b4 Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestMultiNic-2053997464-project Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'd39255b9-9e73-414d-ad6e-74664c01ab24'} Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:14.911359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.920695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:14.920695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:14.920695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:14.920695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:14.920695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:14.920695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:14.920695 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:14.920695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8ef1a973-1b67-49be-b77f-4aee532e4a32 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Returning 404 to user: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:14.920695 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8ef1a973-1b67-49be-b77f-4aee532e4a32 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 404 len: 111 microversion: 2.1 time: 0.113716 Sep 08 12:54:14.920695 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1369/2858] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:14 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:14.922161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3c761bb-2da6-4dce-aa2a-a59c4c8bada9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:14.922161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3c761bb-2da6-4dce-aa2a-a59c4c8bada9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:14.922161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3c761bb-2da6-4dce-aa2a-a59c4c8bada9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:14.922161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3c761bb-2da6-4dce-aa2a-a59c4c8bada9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:14.943953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0aa2c0d4-700e-4701-8e3a-f248d1e98b98 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:14.959207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0aa2c0d4-700e-4701-8e3a-f248d1e98b98 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:14.977278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0aa2c0d4-700e-4701-8e3a-f248d1e98b98 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:14.977792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0aa2c0d4-700e-4701-8e3a-f248d1e98b98 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:14.978334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0aa2c0d4-700e-4701-8e3a-f248d1e98b98 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:14.989730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0aa2c0d4-700e-4701-8e3a-f248d1e98b98 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:14.990157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0aa2c0d4-700e-4701-8e3a-f248d1e98b98 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:14.994835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0aa2c0d4-700e-4701-8e3a-f248d1e98b98 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:15.443537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b3c761bb-2da6-4dce-aa2a-a59c4c8bada9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:15.472515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0aa2c0d4-700e-4701-8e3a-f248d1e98b98 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:15.480658 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b3c761bb-2da6-4dce-aa2a-a59c4c8bada9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 0.607552 Sep 08 12:54:15.481343 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1490/2859] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:14 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:15.498997 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0aa2c0d4-700e-4701-8e3a-f248d1e98b98 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 200 len: 1647 microversion: 2.1 time: 0.584185 Sep 08 12:54:15.512000 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1370/2860] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:14 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 1647 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:15.526032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-334bcceb-7017-4bb3-a2ae-4c1bf8e67497 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-1208313982"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:15.531558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-334bcceb-7017-4bb3-a2ae-4c1bf8e67497 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:15.572440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-334bcceb-7017-4bb3-a2ae-4c1bf8e67497 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:15.573228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-334bcceb-7017-4bb3-a2ae-4c1bf8e67497 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:15.573929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-334bcceb-7017-4bb3-a2ae-4c1bf8e67497 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:15.581717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-334bcceb-7017-4bb3-a2ae-4c1bf8e67497 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:15.582079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-334bcceb-7017-4bb3-a2ae-4c1bf8e67497 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:15.582759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-334bcceb-7017-4bb3-a2ae-4c1bf8e67497 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:16.215446 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-334bcceb-7017-4bb3-a2ae-4c1bf8e67497 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.715869 Sep 08 12:54:16.217840 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1491/2861] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:54:15 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Sep 08 12:54:16.232524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ebf4d4c-5858-4199-9944-8a93a0863311 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:16.237499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ebf4d4c-5858-4199-9944-8a93a0863311 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:16.273321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ebf4d4c-5858-4199-9944-8a93a0863311 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:16.273961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ebf4d4c-5858-4199-9944-8a93a0863311 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:16.274602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ebf4d4c-5858-4199-9944-8a93a0863311 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:16.275803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ebf4d4c-5858-4199-9944-8a93a0863311 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:16.284312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ebf4d4c-5858-4199-9944-8a93a0863311 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:16.286073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ebf4d4c-5858-4199-9944-8a93a0863311 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:16.513053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c21c68d-4e8f-42c0-9d7d-54f6359359a0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:16.514436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6c21c68d-4e8f-42c0-9d7d-54f6359359a0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:16.534024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c21c68d-4e8f-42c0-9d7d-54f6359359a0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:16.534789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c21c68d-4e8f-42c0-9d7d-54f6359359a0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:16.535438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c21c68d-4e8f-42c0-9d7d-54f6359359a0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:16.536421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c21c68d-4e8f-42c0-9d7d-54f6359359a0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:16.539335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c21c68d-4e8f-42c0-9d7d-54f6359359a0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:16.544017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c21c68d-4e8f-42c0-9d7d-54f6359359a0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:17.127985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ebf4d4c-5858-4199-9944-8a93a0863311 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:17.142286 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ebf4d4c-5858-4199-9944-8a93a0863311 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1680 microversion: 2.1 time: 0.918479 Sep 08 12:54:17.142899 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1371/2862] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:16 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1680 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:17.157718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ebb5cf71-e0d0-4590-9f90-b0215b480fa7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:17.158848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ebb5cf71-e0d0-4590-9f90-b0215b480fa7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:17.175147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebb5cf71-e0d0-4590-9f90-b0215b480fa7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:17.175733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebb5cf71-e0d0-4590-9f90-b0215b480fa7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:17.180037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebb5cf71-e0d0-4590-9f90-b0215b480fa7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:17.183618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebb5cf71-e0d0-4590-9f90-b0215b480fa7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:17.184846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebb5cf71-e0d0-4590-9f90-b0215b480fa7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:17.186643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebb5cf71-e0d0-4590-9f90-b0215b480fa7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:17.232512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:17.456235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6c21c68d-4e8f-42c0-9d7d-54f6359359a0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:17.471880 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6c21c68d-4e8f-42c0-9d7d-54f6359359a0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 0.963321 Sep 08 12:54:17.474561 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1492/2863] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:16 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:17.802765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ebb5cf71-e0d0-4590-9f90-b0215b480fa7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:17.818076 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ebb5cf71-e0d0-4590-9f90-b0215b480fa7 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 200 len: 1647 microversion: 2.1 time: 0.674041 Sep 08 12:54:17.821002 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1372/2864] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:17 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 1647 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:18.169573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-29cc1305-ede8-4c98-b310-f80778625e91 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:18.171200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-29cc1305-ede8-4c98-b310-f80778625e91 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:18.187955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29cc1305-ede8-4c98-b310-f80778625e91 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:18.188955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29cc1305-ede8-4c98-b310-f80778625e91 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:18.189679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29cc1305-ede8-4c98-b310-f80778625e91 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:18.190777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29cc1305-ede8-4c98-b310-f80778625e91 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:18.191545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29cc1305-ede8-4c98-b310-f80778625e91 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:18.192201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29cc1305-ede8-4c98-b310-f80778625e91 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:18.515568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b9c92db4-4fef-4a87-bcad-3d42ac02dd8a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:18.516675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b9c92db4-4fef-4a87-bcad-3d42ac02dd8a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:18.529767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9c92db4-4fef-4a87-bcad-3d42ac02dd8a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:18.533756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9c92db4-4fef-4a87-bcad-3d42ac02dd8a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:18.535290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9c92db4-4fef-4a87-bcad-3d42ac02dd8a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:18.540743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9c92db4-4fef-4a87-bcad-3d42ac02dd8a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:18.542673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9c92db4-4fef-4a87-bcad-3d42ac02dd8a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:18.544240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9c92db4-4fef-4a87-bcad-3d42ac02dd8a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:18.832336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-29cc1305-ede8-4c98-b310-f80778625e91 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:18.855139 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-29cc1305-ede8-4c98-b310-f80778625e91 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1688 microversion: 2.1 time: 0.690090 Sep 08 12:54:18.859388 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1493/2865] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:18 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1688 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:18.868510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-1d037fd4-ad17-405c-92b4-deadc16a1be4 req-f245c683-f355-410b-a462-199f5535f85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb01efa-03b9-40b6-901b-33e7d583b7c8", "name": "network-vif-unplugged", "status": "completed", "tag": "6d98b289-22e2-4a8e-ba25-0857a1412c6b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:18.887527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1d037fd4-ad17-405c-92b4-deadc16a1be4 req-f245c683-f355-410b-a462-199f5535f85d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:18.895492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1d037fd4-ad17-405c-92b4-deadc16a1be4 req-f245c683-f355-410b-a462-199f5535f85d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:18.897514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1d037fd4-ad17-405c-92b4-deadc16a1be4 req-f245c683-f355-410b-a462-199f5535f85d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:18.938471 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1d037fd4-ad17-405c-92b4-deadc16a1be4 req-f245c683-f355-410b-a462-199f5535f85d service nova] Creating event network-vif-unplugged:6d98b289-22e2-4a8e-ba25-0857a1412c6b for instance abb01efa-03b9-40b6-901b-33e7d583b7c8 on n-h1-852084-10 Sep 08 12:54:18.945541 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-1d037fd4-ad17-405c-92b4-deadc16a1be4 req-f245c683-f355-410b-a462-199f5535f85d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083779 Sep 08 12:54:18.946188 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1494/2866] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:54:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:18.956371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2623a6bd-3c2f-4506-98ae-d3b41cce8135 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:18.958218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2623a6bd-3c2f-4506-98ae-d3b41cce8135 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:18.968645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2623a6bd-3c2f-4506-98ae-d3b41cce8135 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:18.969866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2623a6bd-3c2f-4506-98ae-d3b41cce8135 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:18.970415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2623a6bd-3c2f-4506-98ae-d3b41cce8135 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:18.971292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2623a6bd-3c2f-4506-98ae-d3b41cce8135 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:18.972227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2623a6bd-3c2f-4506-98ae-d3b41cce8135 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:18.972739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2623a6bd-3c2f-4506-98ae-d3b41cce8135 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:19.732192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b9c92db4-4fef-4a87-bcad-3d42ac02dd8a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:19.743163 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b9c92db4-4fef-4a87-bcad-3d42ac02dd8a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 1.232817 Sep 08 12:54:19.743801 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1373/2867] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:18 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:19.763708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "63e1e3f8-3e6c-4df7-afe4-c0056ee190c5"}], "security_groups": [{"name": "tempest-securitygroup--1821230779"}], "key_name": "tempest-keypair-496987803", "user_data": "}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:20.151486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] validate_networks() for [('63e1e3f8-3e6c-4df7-afe4-c0056ee190c5', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:54:20.214425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2623a6bd-3c2f-4506-98ae-d3b41cce8135 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b78e89e2a3ff4ee4924306aad4fc13cf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4685a4a696449fd8fd85f135e05900b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:20.231437 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2623a6bd-3c2f-4506-98ae-d3b41cce8135 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 200 len: 1647 microversion: 2.1 time: 1.277604 Sep 08 12:54:20.270297 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1495/2868] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:18 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 1647 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:20.289371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-bf3b582c-48d6-411b-a742-39e9e83d933f req-3af1dcb2-d99a-4563-b836-f56eaf758c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a460ded-9066-4972-a981-9295e353bb3c", "name": "network-vif-deleted", "tag": "11c30836-eaf8-4c74-a70a-915fdf23e280"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:20.324241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bf3b582c-48d6-411b-a742-39e9e83d933f req-3af1dcb2-d99a-4563-b836-f56eaf758c09 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:20.325459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bf3b582c-48d6-411b-a742-39e9e83d933f req-3af1dcb2-d99a-4563-b836-f56eaf758c09 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:20.327130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bf3b582c-48d6-411b-a742-39e9e83d933f req-3af1dcb2-d99a-4563-b836-f56eaf758c09 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:20.363275 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-bf3b582c-48d6-411b-a742-39e9e83d933f req-3af1dcb2-d99a-4563-b836-f56eaf758c09 service nova] Creating event network-vif-deleted:11c30836-eaf8-4c74-a70a-915fdf23e280 for instance 0a460ded-9066-4972-a981-9295e353bb3c on n-h2-852084-10 Sep 08 12:54:20.376967 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-bf3b582c-48d6-411b-a742-39e9e83d933f req-3af1dcb2-d99a-4563-b836-f56eaf758c09 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098973 Sep 08 12:54:20.379202 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1496/2869] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:20.396988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f946703b-a747-46f3-98b1-559b2d4c90b5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:20.399101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f946703b-a747-46f3-98b1-559b2d4c90b5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:20.418348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f946703b-a747-46f3-98b1-559b2d4c90b5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:20.420944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f946703b-a747-46f3-98b1-559b2d4c90b5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:20.422832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f946703b-a747-46f3-98b1-559b2d4c90b5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:20.424817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f946703b-a747-46f3-98b1-559b2d4c90b5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:20.426897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f946703b-a747-46f3-98b1-559b2d4c90b5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:20.428026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f946703b-a747-46f3-98b1-559b2d4c90b5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:20.991869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f946703b-a747-46f3-98b1-559b2d4c90b5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:21.002466 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f946703b-a747-46f3-98b1-559b2d4c90b5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1683 microversion: 2.1 time: 0.616799 Sep 08 12:54:21.009453 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1497/2870] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:20 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1683 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:21.017657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-21ae3e34-52a8-47cc-89d6-000cb52ee389 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:21.022743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-21ae3e34-52a8-47cc-89d6-000cb52ee389 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:21.033206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21ae3e34-52a8-47cc-89d6-000cb52ee389 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:21.033870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21ae3e34-52a8-47cc-89d6-000cb52ee389 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:21.034476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21ae3e34-52a8-47cc-89d6-000cb52ee389 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:21.035491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21ae3e34-52a8-47cc-89d6-000cb52ee389 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:21.036087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21ae3e34-52a8-47cc-89d6-000cb52ee389 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:21.036634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21ae3e34-52a8-47cc-89d6-000cb52ee389 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:21.043027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:21.525513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-21ae3e34-52a8-47cc-89d6-000cb52ee389 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:21.545441 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-21ae3e34-52a8-47cc-89d6-000cb52ee389 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 0.534402 Sep 08 12:54:21.546088 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1498/2871] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:21 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:21.555451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e2dbaee2-8491-49cb-9d24-f01ff472bba8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:21.555451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e2dbaee2-8491-49cb-9d24-f01ff472bba8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] [instance: 0a460ded-9066-4972-a981-9295e353bb3c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:21.565405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2dbaee2-8491-49cb-9d24-f01ff472bba8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:21.572173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2dbaee2-8491-49cb-9d24-f01ff472bba8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:21.572914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2dbaee2-8491-49cb-9d24-f01ff472bba8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:21.573918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2dbaee2-8491-49cb-9d24-f01ff472bba8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:21.574578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2dbaee2-8491-49cb-9d24-f01ff472bba8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:21.575922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2dbaee2-8491-49cb-9d24-f01ff472bba8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:21.613084 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e2dbaee2-8491-49cb-9d24-f01ff472bba8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] HTTP exception thrown: Instance 0a460ded-9066-4972-a981-9295e353bb3c could not be found. Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e2dbaee2-8491-49cb-9d24-f01ff472bba8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Request method failure captured: Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c HTTP/1.1 Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVH0dUVmeOHHhmW9Z9tZTeKBvl79wvsJc50nOnRPc4YEUzDhRzPNt_-wRdlPMQGc_PggWn5NLtqFtZGhW2-myhfLPifEyAMkSGOmyp519t2s6bLZCm43hxWGc1MFz4UNn6Hgxmq7NN1snZDudLeq2T9q41eb_KXyp8am4ZjLeaM4do Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b4685a4a696449fd8fd85f135e05900b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b4685a4a696449fd8fd85f135e05900b Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-713755177 Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b78e89e2a3ff4ee4924306aad4fc13cf Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-SecurityGroupsTestJSON-713755177-project Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 0a460ded-9066-4972-a981-9295e353bb3c could not be found. Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '0a460ded-9066-4972-a981-9295e353bb3c'} Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a460ded-9066-4972-a981-9295e353bb3c could not be found. Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a460ded-9066-4972-a981-9295e353bb3c could not be found. Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:21.615131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:21.619931 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:21.619931 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:21.619931 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:21.619931 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:21.619931 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:21.619931 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a460ded-9066-4972-a981-9295e353bb3c could not be found. Sep 08 12:54:21.619931 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:21.621369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e2dbaee2-8491-49cb-9d24-f01ff472bba8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Returning 404 to user: Instance 0a460ded-9066-4972-a981-9295e353bb3c could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:21.622490 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e2dbaee2-8491-49cb-9d24-f01ff472bba8 tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c" status: 404 len: 111 microversion: 2.1 time: 0.075427 Sep 08 12:54:21.630626 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1499/2872] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:21 2022] GET /compute/v2.1/servers/0a460ded-9066-4972-a981-9295e353bb3c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:21.636654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-198e9ee4-d0a4-4814-ba94-882b942fd1ff tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb36c69670>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:22.058017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:54:22.060576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:54:22.061849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:54:22.062879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:54:22.063991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:54:22.157506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:22.168193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:22.172528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:22.186121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:22.192979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:22.195642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:22.328277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Getting quotas for project 3957124a8f134e2c8043539232be46ce. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:54:22.345845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Getting quotas for user b40d83cbf26d495fb66d0a78d211c41b and project 3957124a8f134e2c8043539232be46ce. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:54:22.398380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:54:22.406735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:54:22.550350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:22.637847 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-22cdb02b-edb6-44ce-92d3-49fa058fd9a6 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.889368 Sep 08 12:54:22.638714 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1374/2873] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:54:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 2894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:54:22.644173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0b5987fb-2148-4647-8e52-457be157f9ba tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:22.651160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0b5987fb-2148-4647-8e52-457be157f9ba tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:22.659860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0b5987fb-2148-4647-8e52-457be157f9ba tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:22.660739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0b5987fb-2148-4647-8e52-457be157f9ba tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:22.662570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0b5987fb-2148-4647-8e52-457be157f9ba tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:22.662570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0b5987fb-2148-4647-8e52-457be157f9ba tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:22.663162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0b5987fb-2148-4647-8e52-457be157f9ba tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:22.663907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0b5987fb-2148-4647-8e52-457be157f9ba tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:23.004879 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-198e9ee4-d0a4-4814-ba94-882b942fd1ff tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/c71d9fb5-30fa-4678-8588-08c0c6af6f4a" status: 202 len: 0 microversion: 2.1 time: 1.372133 Sep 08 12:54:23.006865 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1500/2874] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:54:21 2022] DELETE /compute/v2.1/os-security-groups/c71d9fb5-30fa-4678-8588-08c0c6af6f4a => generated 0 bytes in 1375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:54:23.013636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2b3da97a-3942-489b-ad6b-cb1119fff92c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:23.014676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2b3da97a-3942-489b-ad6b-cb1119fff92c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:23.045647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b3da97a-3942-489b-ad6b-cb1119fff92c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:23.046554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b3da97a-3942-489b-ad6b-cb1119fff92c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:23.051256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b3da97a-3942-489b-ad6b-cb1119fff92c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:23.057846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b3da97a-3942-489b-ad6b-cb1119fff92c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:23.058932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b3da97a-3942-489b-ad6b-cb1119fff92c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:23.059675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b3da97a-3942-489b-ad6b-cb1119fff92c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:23.767787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0b5987fb-2148-4647-8e52-457be157f9ba tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:23.804129 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0b5987fb-2148-4647-8e52-457be157f9ba tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1683 microversion: 2.1 time: 1.163648 Sep 08 12:54:23.806680 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1375/2875] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:22 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1683 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:23.835139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8af94eb0-71a8-409b-a0d2-52bfb188b8c9 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:23.837148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8af94eb0-71a8-409b-a0d2-52bfb188b8c9 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:24.083214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8af94eb0-71a8-409b-a0d2-52bfb188b8c9 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:24.092210 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8af94eb0-71a8-409b-a0d2-52bfb188b8c9 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1225 microversion: 2.1 time: 0.268824 Sep 08 12:54:24.115085 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1376/2876] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:23 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1225 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:24.122240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-53f6edc7-f506-4758-b6ce-15d52241b1ab tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] Calling method '.version_select at 0x7fdb3a080a60>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:24.823331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2b3da97a-3942-489b-ad6b-cb1119fff92c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:24.871312 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2b3da97a-3942-489b-ad6b-cb1119fff92c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 1.853208 Sep 08 12:54:24.877390 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1501/2877] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:23 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:24.907390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-62e3986f-9c64-421e-a148-cbc6ec2e9fc1 req-298170f2-48e9-4552-ab10-d2a87841685e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb01efa-03b9-40b6-901b-33e7d583b7c8", "name": "network-vif-plugged", "status": "completed", "tag": "6d98b289-22e2-4a8e-ba25-0857a1412c6b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:24.937470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-62e3986f-9c64-421e-a148-cbc6ec2e9fc1 req-298170f2-48e9-4552-ab10-d2a87841685e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:24.941252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-62e3986f-9c64-421e-a148-cbc6ec2e9fc1 req-298170f2-48e9-4552-ab10-d2a87841685e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:24.942706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-62e3986f-9c64-421e-a148-cbc6ec2e9fc1 req-298170f2-48e9-4552-ab10-d2a87841685e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:24.983096 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-62e3986f-9c64-421e-a148-cbc6ec2e9fc1 req-298170f2-48e9-4552-ab10-d2a87841685e service nova] Creating event network-vif-plugged:6d98b289-22e2-4a8e-ba25-0857a1412c6b for instance abb01efa-03b9-40b6-901b-33e7d583b7c8 on n-h1-852084-10 Sep 08 12:54:25.000710 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-62e3986f-9c64-421e-a148-cbc6ec2e9fc1 req-298170f2-48e9-4552-ab10-d2a87841685e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114037 Sep 08 12:54:25.001964 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1502/2878] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:25.018663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5ca47073-05a2-4cf9-943e-03cbf1f19422 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:25.022855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5ca47073-05a2-4cf9-943e-03cbf1f19422 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:25.053941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ca47073-05a2-4cf9-943e-03cbf1f19422 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:25.061448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ca47073-05a2-4cf9-943e-03cbf1f19422 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:25.064969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ca47073-05a2-4cf9-943e-03cbf1f19422 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:25.072702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ca47073-05a2-4cf9-943e-03cbf1f19422 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:25.077067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ca47073-05a2-4cf9-943e-03cbf1f19422 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:25.078657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ca47073-05a2-4cf9-943e-03cbf1f19422 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:25.144018 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-5ca47073-05a2-4cf9-943e-03cbf1f19422 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] HTTP exception thrown: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5ca47073-05a2-4cf9-943e-03cbf1f19422 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Request method failure captured: Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 HTTP/1.1 Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeU_XtinJzfTr2r8jQ-dQM26ab93LNnZmWsVSl_w6BcZY6hr8Hd_kESK6HWkxAufGsC_i-TOYcrff_w1RbdrGa-ZJYI-rNoJYsIbF5uNhT6MeJHtt-iLaMGRkcqgtBdSCpcdE77UMlggicdA-yQRlY2p65jsUjIa7jFPFS5b9b9k7rI Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a2b4bb04764e484099a1380cee0343d9 Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a2b4bb04764e484099a1380cee0343d9 Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestMultiNic-2053997464-project Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7063832f6c334d26bd0f30b5b16116b4 Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestMultiNic-2053997464-project Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'd39255b9-9e73-414d-ad6e-74664c01ab24'} Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:54:25.145836 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:54:25.149893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:25.149893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:25.149893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:25.149893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:25.149893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:25.149893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:25.149893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:25.149893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:25.149893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:25.149893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:25.149893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:25.150537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5ca47073-05a2-4cf9-943e-03cbf1f19422 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Returning 404 to user: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:25.154254 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5ca47073-05a2-4cf9-943e-03cbf1f19422 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 404 len: 111 microversion: 2.1 time: 0.147350 Sep 08 12:54:25.155447 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1503/2879] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:54:25 2022] DELETE /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:25.167988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-08253160-1ea8-403c-bd32-50645b84e3c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:25.173481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-08253160-1ea8-403c-bd32-50645b84e3c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:25.214573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08253160-1ea8-403c-bd32-50645b84e3c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:25.215918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08253160-1ea8-403c-bd32-50645b84e3c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:25.235796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08253160-1ea8-403c-bd32-50645b84e3c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:25.243141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08253160-1ea8-403c-bd32-50645b84e3c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:25.247106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08253160-1ea8-403c-bd32-50645b84e3c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:25.252328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08253160-1ea8-403c-bd32-50645b84e3c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:25.822369 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-53f6edc7-f506-4758-b6ce-15d52241b1ab tempest-SecurityGroupsTestJSON-713755177 tempest-SecurityGroupsTestJSON-713755177-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/bbd94580-bf4b-46af-a352-61a7fc13508d" status: 202 len: 0 microversion: 2.1 time: 1.704293 Sep 08 12:54:25.823666 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1377/2880] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 12:54:24 2022] DELETE /compute/v2.1/os-security-groups/bbd94580-bf4b-46af-a352-61a7fc13508d => generated 0 bytes in 1708 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:54:25.836125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d0ad601b-882d-4c21-98bd-0e6357f71c5b tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:25.836757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d0ad601b-882d-4c21-98bd-0e6357f71c5b tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:25.857794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0ad601b-882d-4c21-98bd-0e6357f71c5b tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:25.858581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0ad601b-882d-4c21-98bd-0e6357f71c5b tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:25.859193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0ad601b-882d-4c21-98bd-0e6357f71c5b tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:25.860161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0ad601b-882d-4c21-98bd-0e6357f71c5b tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:25.860804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0ad601b-882d-4c21-98bd-0e6357f71c5b tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:25.861428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0ad601b-882d-4c21-98bd-0e6357f71c5b tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:26.290882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d0ad601b-882d-4c21-98bd-0e6357f71c5b tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:26.305382 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d0ad601b-882d-4c21-98bd-0e6357f71c5b tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1295 microversion: 2.1 time: 0.478812 Sep 08 12:54:26.320249 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1378/2881] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:25 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1295 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:26.341729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-08253160-1ea8-403c-bd32-50645b84e3c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:26.344251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-82f46708-d6f2-4ea0-abf8-61ca7fc5743e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:26.344869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-82f46708-d6f2-4ea0-abf8-61ca7fc5743e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: d39255b9-9e73-414d-ad6e-74664c01ab24] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:26.361713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82f46708-d6f2-4ea0-abf8-61ca7fc5743e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:26.367437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82f46708-d6f2-4ea0-abf8-61ca7fc5743e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:26.368160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82f46708-d6f2-4ea0-abf8-61ca7fc5743e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:26.369095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82f46708-d6f2-4ea0-abf8-61ca7fc5743e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:26.369774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82f46708-d6f2-4ea0-abf8-61ca7fc5743e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:26.370371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82f46708-d6f2-4ea0-abf8-61ca7fc5743e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:26.404482 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-08253160-1ea8-403c-bd32-50645b84e3c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1683 microversion: 2.1 time: 1.237109 Sep 08 12:54:26.407059 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-82f46708-d6f2-4ea0-abf8-61ca7fc5743e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] HTTP exception thrown: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-82f46708-d6f2-4ea0-abf8-61ca7fc5743e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Request method failure captured: Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 HTTP/1.1 Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeU_XtinJzfTr2r8jQ-dQM26ab93LNnZmWsVSl_w6BcZY6hr8Hd_kESK6HWkxAufGsC_i-TOYcrff_w1RbdrGa-ZJYI-rNoJYsIbF5uNhT6MeJHtt-iLaMGRkcqgtBdSCpcdE77UMlggicdA-yQRlY2p65jsUjIa7jFPFS5b9b9k7rI Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: a2b4bb04764e484099a1380cee0343d9 Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: a2b4bb04764e484099a1380cee0343d9 Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestMultiNic-2053997464-project Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 7063832f6c334d26bd0f30b5b16116b4 Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestMultiNic-2053997464-project Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'd39255b9-9e73-414d-ad6e-74664c01ab24'} Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:26.414552 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.419142 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:26.419142 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:26.419142 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:26.419142 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:26.419142 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:26.419142 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. Sep 08 12:54:26.419142 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.421770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-82f46708-d6f2-4ea0-abf8-61ca7fc5743e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Returning 404 to user: Instance d39255b9-9e73-414d-ad6e-74664c01ab24 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:26.424840 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-82f46708-d6f2-4ea0-abf8-61ca7fc5743e tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24" status: 404 len: 111 microversion: 2.1 time: 0.097094 Sep 08 12:54:26.430470 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1379/2882] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:26 2022] GET /compute/v2.1/servers/d39255b9-9e73-414d-ad6e-74664c01ab24 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:26.431396 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1504/2883] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:25 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1683 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:26.436671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2a11db17-6c37-40ef-ab66-33b87a430d57 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:26.437113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-29a820e3-e4a7-40ee-9c87-ed4534b8a0d9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:26.437269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2a11db17-6c37-40ef-ab66-33b87a430d57 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:26.437715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-29a820e3-e4a7-40ee-9c87-ed4534b8a0d9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:26.453272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29a820e3-e4a7-40ee-9c87-ed4534b8a0d9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:26.453776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29a820e3-e4a7-40ee-9c87-ed4534b8a0d9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:26.454218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29a820e3-e4a7-40ee-9c87-ed4534b8a0d9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:26.454976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29a820e3-e4a7-40ee-9c87-ed4534b8a0d9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:26.455463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29a820e3-e4a7-40ee-9c87-ed4534b8a0d9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:26.455927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29a820e3-e4a7-40ee-9c87-ed4534b8a0d9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:26.486198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a11db17-6c37-40ef-ab66-33b87a430d57 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:26.487346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a11db17-6c37-40ef-ab66-33b87a430d57 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:26.491529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a11db17-6c37-40ef-ab66-33b87a430d57 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:26.497500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a11db17-6c37-40ef-ab66-33b87a430d57 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:26.500012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a11db17-6c37-40ef-ab66-33b87a430d57 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:26.502025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a11db17-6c37-40ef-ab66-33b87a430d57 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:26.560106 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-2a11db17-6c37-40ef-ab66-33b87a430d57 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] HTTP exception thrown: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2a11db17-6c37-40ef-ab66-33b87a430d57 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Request method failure captured: Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c HTTP/1.1 Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeU_XtinJzfTr2r8jQ-dQM26ab93LNnZmWsVSl_w6BcZY6hr8Hd_kESK6HWkxAufGsC_i-TOYcrff_w1RbdrGa-ZJYI-rNoJYsIbF5uNhT6MeJHtt-iLaMGRkcqgtBdSCpcdE77UMlggicdA-yQRlY2p65jsUjIa7jFPFS5b9b9k7rI Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a2b4bb04764e484099a1380cee0343d9 Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a2b4bb04764e484099a1380cee0343d9 Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestMultiNic-2053997464-project Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7063832f6c334d26bd0f30b5b16116b4 Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestMultiNic-2053997464-project Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '2a028a63-83ed-4fbc-8ae9-fd5a7efe568c'} Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:54:26.570832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:54:26.575279 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:54:26.575279 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.575279 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:26.575279 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.575279 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:26.575279 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:26.575279 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:26.575279 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:26.575279 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:26.575279 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:54:26.575279 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.580483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2a11db17-6c37-40ef-ab66-33b87a430d57 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Returning 404 to user: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:26.581692 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2a11db17-6c37-40ef-ab66-33b87a430d57 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 404 len: 111 microversion: 2.1 time: 0.149214 Sep 08 12:54:26.584113 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1505/2884] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:54:26 2022] DELETE /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:26.611637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89657688-97e7-49c6-afde-4da5dc59f090 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:26.613918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-89657688-97e7-49c6-afde-4da5dc59f090 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] [instance: 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:26.634458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89657688-97e7-49c6-afde-4da5dc59f090 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:26.634970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89657688-97e7-49c6-afde-4da5dc59f090 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:26.635577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89657688-97e7-49c6-afde-4da5dc59f090 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:26.640597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89657688-97e7-49c6-afde-4da5dc59f090 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:26.641417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89657688-97e7-49c6-afde-4da5dc59f090 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:26.641879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89657688-97e7-49c6-afde-4da5dc59f090 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:26.699654 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-89657688-97e7-49c6-afde-4da5dc59f090 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] HTTP exception thrown: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89657688-97e7-49c6-afde-4da5dc59f090 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Request method failure captured: Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c HTTP/1.1 Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeU_XtinJzfTr2r8jQ-dQM26ab93LNnZmWsVSl_w6BcZY6hr8Hd_kESK6HWkxAufGsC_i-TOYcrff_w1RbdrGa-ZJYI-rNoJYsIbF5uNhT6MeJHtt-iLaMGRkcqgtBdSCpcdE77UMlggicdA-yQRlY2p65jsUjIa7jFPFS5b9b9k7rI Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a2b4bb04764e484099a1380cee0343d9 Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a2b4bb04764e484099a1380cee0343d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a2b4bb04764e484099a1380cee0343d9 Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestMultiNic-2053997464 Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestMultiNic-2053997464-project Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7063832f6c334d26bd0f30b5b16116b4 Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestMultiNic-2053997464-project Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '2a028a63-83ed-4fbc-8ae9-fd5a7efe568c'} Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:26.709428 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.713551 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:26.713551 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:26.713551 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:26.713551 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:26.713551 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:26.713551 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. Sep 08 12:54:26.713551 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:26.713551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89657688-97e7-49c6-afde-4da5dc59f090 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] Returning 404 to user: Instance 2a028a63-83ed-4fbc-8ae9-fd5a7efe568c could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:26.713551 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-89657688-97e7-49c6-afde-4da5dc59f090 tempest-ServersTestMultiNic-2053997464 tempest-ServersTestMultiNic-2053997464-project] 10.222.0.78 "GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c" status: 404 len: 111 microversion: 2.1 time: 0.119893 Sep 08 12:54:26.722823 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1506/2885] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:26 2022] GET /compute/v2.1/servers/2a028a63-83ed-4fbc-8ae9-fd5a7efe568c => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:27.339299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44919bd5-f372-4237-a9d3-a9c3bd0c7b29 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:27.342599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-44919bd5-f372-4237-a9d3-a9c3bd0c7b29 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:27.364215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44919bd5-f372-4237-a9d3-a9c3bd0c7b29 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:27.364779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44919bd5-f372-4237-a9d3-a9c3bd0c7b29 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:27.365241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44919bd5-f372-4237-a9d3-a9c3bd0c7b29 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:27.368542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44919bd5-f372-4237-a9d3-a9c3bd0c7b29 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:27.369057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44919bd5-f372-4237-a9d3-a9c3bd0c7b29 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:27.372063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44919bd5-f372-4237-a9d3-a9c3bd0c7b29 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:28.090822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-44919bd5-f372-4237-a9d3-a9c3bd0c7b29 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:28.124129 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44919bd5-f372-4237-a9d3-a9c3bd0c7b29 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1283 microversion: 2.1 time: 0.793900 Sep 08 12:54:28.125685 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1507/2886] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:27 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1283 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:28.135150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bd4d4d7b-a1d8-411f-a3a0-65f689e3aa1c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:28.142072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bd4d4d7b-a1d8-411f-a3a0-65f689e3aa1c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:28.152278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd4d4d7b-a1d8-411f-a3a0-65f689e3aa1c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:28.153090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd4d4d7b-a1d8-411f-a3a0-65f689e3aa1c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:28.153941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd4d4d7b-a1d8-411f-a3a0-65f689e3aa1c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:28.155019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd4d4d7b-a1d8-411f-a3a0-65f689e3aa1c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:28.155801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd4d4d7b-a1d8-411f-a3a0-65f689e3aa1c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:28.156496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd4d4d7b-a1d8-411f-a3a0-65f689e3aa1c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:28.545628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-29a820e3-e4a7-40ee-9c87-ed4534b8a0d9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:28.567159 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-29a820e3-e4a7-40ee-9c87-ed4534b8a0d9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1471 microversion: 2.1 time: 2.133274 Sep 08 12:54:28.589782 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1380/2887] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:26 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1471 bytes in 2158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:29.114889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bd4d4d7b-a1d8-411f-a3a0-65f689e3aa1c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:29.127518 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bd4d4d7b-a1d8-411f-a3a0-65f689e3aa1c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1683 microversion: 2.1 time: 0.998727 Sep 08 12:54:29.143852 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1508/2888] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:28 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1683 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:29.172114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-98fb23b2-960c-4d3a-b931-35e87309581e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:29.181120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-98fb23b2-960c-4d3a-b931-35e87309581e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:29.229981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98fb23b2-960c-4d3a-b931-35e87309581e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:29.238158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98fb23b2-960c-4d3a-b931-35e87309581e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:29.245782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98fb23b2-960c-4d3a-b931-35e87309581e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:29.253754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98fb23b2-960c-4d3a-b931-35e87309581e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:29.256008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98fb23b2-960c-4d3a-b931-35e87309581e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:29.261378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98fb23b2-960c-4d3a-b931-35e87309581e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:29.597033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-50c562c0-e183-4e1a-bacd-f3c6d347bf96 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:29.597658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-50c562c0-e183-4e1a-bacd-f3c6d347bf96 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:29.623892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50c562c0-e183-4e1a-bacd-f3c6d347bf96 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:29.625410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50c562c0-e183-4e1a-bacd-f3c6d347bf96 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:29.626907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50c562c0-e183-4e1a-bacd-f3c6d347bf96 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:29.627984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50c562c0-e183-4e1a-bacd-f3c6d347bf96 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:29.628632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50c562c0-e183-4e1a-bacd-f3c6d347bf96 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:29.629264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-50c562c0-e183-4e1a-bacd-f3c6d347bf96 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:29.760247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-98fb23b2-960c-4d3a-b931-35e87309581e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:29.784472 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-98fb23b2-960c-4d3a-b931-35e87309581e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1283 microversion: 2.1 time: 0.618318 Sep 08 12:54:29.785536 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1381/2889] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:29 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1283 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:30.158892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2ad0ae5b-3125-4866-8828-c9e90e67470d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:30.159969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2ad0ae5b-3125-4866-8828-c9e90e67470d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:30.176787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ad0ae5b-3125-4866-8828-c9e90e67470d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:30.182753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ad0ae5b-3125-4866-8828-c9e90e67470d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:30.186202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ad0ae5b-3125-4866-8828-c9e90e67470d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:30.196358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ad0ae5b-3125-4866-8828-c9e90e67470d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:30.197458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ad0ae5b-3125-4866-8828-c9e90e67470d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:30.199115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ad0ae5b-3125-4866-8828-c9e90e67470d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:32.012274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-50c562c0-e183-4e1a-bacd-f3c6d347bf96 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:32.028994 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-50c562c0-e183-4e1a-bacd-f3c6d347bf96 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1477 microversion: 2.1 time: 2.431995 Sep 08 12:54:32.034621 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1509/2890] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:29 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1477 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:54:32.054387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e518b44-dc5e-4e19-9e0b-dcf8fc9f31c5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:32.056320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2e518b44-dc5e-4e19-9e0b-dcf8fc9f31c5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:32.092641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e518b44-dc5e-4e19-9e0b-dcf8fc9f31c5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:32.093938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e518b44-dc5e-4e19-9e0b-dcf8fc9f31c5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:32.097782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e518b44-dc5e-4e19-9e0b-dcf8fc9f31c5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:32.098627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e518b44-dc5e-4e19-9e0b-dcf8fc9f31c5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:32.099121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e518b44-dc5e-4e19-9e0b-dcf8fc9f31c5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:32.105335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e518b44-dc5e-4e19-9e0b-dcf8fc9f31c5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:32.288936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:33.252228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2ad0ae5b-3125-4866-8828-c9e90e67470d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:33.274640 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2ad0ae5b-3125-4866-8828-c9e90e67470d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1683 microversion: 2.1 time: 3.119895 Sep 08 12:54:33.282321 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1382/2891] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:30 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1683 bytes in 3128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:54:33.307197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8600fd9b-094a-4cd6-84ac-2c55c2ed79dc tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:33.308794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8600fd9b-094a-4cd6-84ac-2c55c2ed79dc tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:33.319981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8600fd9b-094a-4cd6-84ac-2c55c2ed79dc tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:33.329564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8600fd9b-094a-4cd6-84ac-2c55c2ed79dc tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:33.331579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8600fd9b-094a-4cd6-84ac-2c55c2ed79dc tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:33.332654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8600fd9b-094a-4cd6-84ac-2c55c2ed79dc tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:33.335407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8600fd9b-094a-4cd6-84ac-2c55c2ed79dc tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:33.337189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8600fd9b-094a-4cd6-84ac-2c55c2ed79dc tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:34.092173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=12 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:34.417024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2e518b44-dc5e-4e19-9e0b-dcf8fc9f31c5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:34.436781 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2e518b44-dc5e-4e19-9e0b-dcf8fc9f31c5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1351 microversion: 2.1 time: 2.400337 Sep 08 12:54:34.437539 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1510/2892] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:32 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1351 bytes in 2402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:34.449577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7fac3448-e861-4d62-9bba-2d540556d28d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:34.456812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7fac3448-e861-4d62-9bba-2d540556d28d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:34.473848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fac3448-e861-4d62-9bba-2d540556d28d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:34.474599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fac3448-e861-4d62-9bba-2d540556d28d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:34.480385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fac3448-e861-4d62-9bba-2d540556d28d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:34.481539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fac3448-e861-4d62-9bba-2d540556d28d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:34.482245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fac3448-e861-4d62-9bba-2d540556d28d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:34.482904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fac3448-e861-4d62-9bba-2d540556d28d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:34.976233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8600fd9b-094a-4cd6-84ac-2c55c2ed79dc tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:34.985944 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8600fd9b-094a-4cd6-84ac-2c55c2ed79dc tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1477 microversion: 2.1 time: 1.702023 Sep 08 12:54:34.986550 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1383/2893] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:33 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1477 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:35.008568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-5fd12557-44e8-41cc-9fd9-f21b037eb852 req-79c51b0d-15b8-416a-b3b7-9602475abbde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3250685a-8562-4deb-a070-5ef61a7adece", "name": "network-vif-plugged", "status": "completed", "tag": "abdffb77-d374-428a-a4ad-7dbf4411576c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:35.047553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5fd12557-44e8-41cc-9fd9-f21b037eb852 req-79c51b0d-15b8-416a-b3b7-9602475abbde service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:35.051664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5fd12557-44e8-41cc-9fd9-f21b037eb852 req-79c51b0d-15b8-416a-b3b7-9602475abbde service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:35.052531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5fd12557-44e8-41cc-9fd9-f21b037eb852 req-79c51b0d-15b8-416a-b3b7-9602475abbde service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:35.091011 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-5fd12557-44e8-41cc-9fd9-f21b037eb852 req-79c51b0d-15b8-416a-b3b7-9602475abbde service nova] Creating event network-vif-plugged:abdffb77-d374-428a-a4ad-7dbf4411576c for instance 3250685a-8562-4deb-a070-5ef61a7adece on n-h2-852084-10 Sep 08 12:54:35.104851 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-5fd12557-44e8-41cc-9fd9-f21b037eb852 req-79c51b0d-15b8-416a-b3b7-9602475abbde service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100023 Sep 08 12:54:35.111208 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1384/2894] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:35.464554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dfdba1c3-eba3-48ae-a4f4-4f56646563c8 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:35.465452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dfdba1c3-eba3-48ae-a4f4-4f56646563c8 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:35.482999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfdba1c3-eba3-48ae-a4f4-4f56646563c8 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:35.486938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfdba1c3-eba3-48ae-a4f4-4f56646563c8 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:35.487859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfdba1c3-eba3-48ae-a4f4-4f56646563c8 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:35.491287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfdba1c3-eba3-48ae-a4f4-4f56646563c8 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:35.492034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfdba1c3-eba3-48ae-a4f4-4f56646563c8 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:35.493026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dfdba1c3-eba3-48ae-a4f4-4f56646563c8 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:36.268407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dfdba1c3-eba3-48ae-a4f4-4f56646563c8 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:36.281523 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dfdba1c3-eba3-48ae-a4f4-4f56646563c8 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1351 microversion: 2.1 time: 0.822934 Sep 08 12:54:36.289390 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1385/2895] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:35 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1351 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:54:36.322057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7fac3448-e861-4d62-9bba-2d540556d28d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:36.363907 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7fac3448-e861-4d62-9bba-2d540556d28d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1683 microversion: 2.1 time: 1.925146 Sep 08 12:54:36.370318 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1511/2896] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:34 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1683 bytes in 1932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:36.397488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-259cbb9d-1242-483b-ae49-fc060498048f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:36.399049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-259cbb9d-1242-483b-ae49-fc060498048f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:36.425231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-259cbb9d-1242-483b-ae49-fc060498048f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:36.426147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-259cbb9d-1242-483b-ae49-fc060498048f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:36.426755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-259cbb9d-1242-483b-ae49-fc060498048f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:36.428277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-259cbb9d-1242-483b-ae49-fc060498048f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:36.429337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-259cbb9d-1242-483b-ae49-fc060498048f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:36.430101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-259cbb9d-1242-483b-ae49-fc060498048f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:36.858441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1424536489", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "223aa4ed-6fb0-4348-ba15-a38ce2a34e92"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:37.666376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-259cbb9d-1242-483b-ae49-fc060498048f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:37.682112 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-259cbb9d-1242-483b-ae49-fc060498048f tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1477 microversion: 2.1 time: 1.307693 Sep 08 12:54:37.696882 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1512/2897] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:36 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1477 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:37.730809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-43f902cd-c48b-4e54-8fb8-5cab719c4a05 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:37.731513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-43f902cd-c48b-4e54-8fb8-5cab719c4a05 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:37.762252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f902cd-c48b-4e54-8fb8-5cab719c4a05 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:37.768368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f902cd-c48b-4e54-8fb8-5cab719c4a05 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:37.770039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f902cd-c48b-4e54-8fb8-5cab719c4a05 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:37.771010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f902cd-c48b-4e54-8fb8-5cab719c4a05 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:37.772271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f902cd-c48b-4e54-8fb8-5cab719c4a05 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:37.772887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43f902cd-c48b-4e54-8fb8-5cab719c4a05 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:38.164080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] validate_networks() for [('223aa4ed-6fb0-4348-ba15-a38ce2a34e92', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:54:39.754360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-43f902cd-c48b-4e54-8fb8-5cab719c4a05 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:39.777379 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-43f902cd-c48b-4e54-8fb8-5cab719c4a05 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1351 microversion: 2.1 time: 2.075477 Sep 08 12:54:39.783716 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1513/2898] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:37 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1351 bytes in 2086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:39.797087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d46e57df-8df4-4908-9118-783937320527 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:39.799275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d46e57df-8df4-4908-9118-783937320527 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:39.828173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d46e57df-8df4-4908-9118-783937320527 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:39.829558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d46e57df-8df4-4908-9118-783937320527 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:39.831624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d46e57df-8df4-4908-9118-783937320527 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:39.832610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d46e57df-8df4-4908-9118-783937320527 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:39.835919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d46e57df-8df4-4908-9118-783937320527 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:39.836596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d46e57df-8df4-4908-9118-783937320527 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:40.589933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d46e57df-8df4-4908-9118-783937320527 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:40.633686 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d46e57df-8df4-4908-9118-783937320527 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1683 microversion: 2.1 time: 0.848121 Sep 08 12:54:40.667823 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1514/2899] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:39 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1683 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:40.703532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-835740a9-08b9-41a6-84a4-a678fb4c3d47 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:40.705231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-835740a9-08b9-41a6-84a4-a678fb4c3d47 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:40.755871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-835740a9-08b9-41a6-84a4-a678fb4c3d47 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:40.758359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-835740a9-08b9-41a6-84a4-a678fb4c3d47 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:40.759652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-835740a9-08b9-41a6-84a4-a678fb4c3d47 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:40.761235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-835740a9-08b9-41a6-84a4-a678fb4c3d47 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:40.764470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-835740a9-08b9-41a6-84a4-a678fb4c3d47 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:40.765820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-835740a9-08b9-41a6-84a4-a678fb4c3d47 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:40.955495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:54:40.960284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:54:40.967168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:54:40.970395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:54:40.972887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:54:41.055969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:41.059797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:41.061672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:41.064832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:41.066063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:41.070324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:41.225398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Getting quotas for project f5753cf1c1974c9bb5453393bab0770f. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:54:41.259786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Getting quotas for user 8094af07ac5340ee9a8c72a7ab625476 and project f5753cf1c1974c9bb5453393bab0770f. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:54:41.300592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Going to run 2 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:54:41.304215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 0429d874-2d6c-4e87-8985-019f7dd39997] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:54:41.355713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=0429d874-2d6c-4e87-8985-019f7dd39997,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:54:41.549648 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-233eb2ca-6afe-4d42-b189-07a006f916ec tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.258648 Sep 08 12:54:41.553119 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1386/2900] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:54:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 5262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:54:41.567289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4ac1c710-3241-4336-a283-3c4dc12be393 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:41.568733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ac1c710-3241-4336-a283-3c4dc12be393 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:41.593648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ac1c710-3241-4336-a283-3c4dc12be393 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:41.598082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ac1c710-3241-4336-a283-3c4dc12be393 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:41.600572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ac1c710-3241-4336-a283-3c4dc12be393 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:41.603444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ac1c710-3241-4336-a283-3c4dc12be393 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:41.605343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ac1c710-3241-4336-a283-3c4dc12be393 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:41.606102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ac1c710-3241-4336-a283-3c4dc12be393 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:42.199508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-835740a9-08b9-41a6-84a4-a678fb4c3d47 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:42.280720 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-835740a9-08b9-41a6-84a4-a678fb4c3d47 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1462 microversion: 2.1 time: 1.607701 Sep 08 12:54:42.291732 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1515/2901] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:40 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1462 bytes in 1622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:42.311938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f2ebbe96-97a8-4619-b448-255dc58bd056 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:42.312910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4ac1c710-3241-4336-a283-3c4dc12be393 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:42.330595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f2ebbe96-97a8-4619-b448-255dc58bd056 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:42.332415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f2ebbe96-97a8-4619-b448-255dc58bd056 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Searching by: {'deleted': False, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:54:42.340126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=58 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:42.358950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2ebbe96-97a8-4619-b448-255dc58bd056 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:42.359853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2ebbe96-97a8-4619-b448-255dc58bd056 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:42.360570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2ebbe96-97a8-4619-b448-255dc58bd056 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:42.368286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2ebbe96-97a8-4619-b448-255dc58bd056 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:42.369295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2ebbe96-97a8-4619-b448-255dc58bd056 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:42.369989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2ebbe96-97a8-4619-b448-255dc58bd056 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:42.376421 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4ac1c710-3241-4336-a283-3c4dc12be393 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1351 microversion: 2.1 time: 0.821481 Sep 08 12:54:42.399363 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1387/2902] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:41 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1351 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:42.423847 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f2ebbe96-97a8-4619-b448-255dc58bd056 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.126579 Sep 08 12:54:42.436173 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1516/2903] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 12:54:42 2022] GET /compute/v2.1/servers => generated 677 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:42.456444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0530bc1-c035-49f1-a832-6602c8b0e8f7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:42.457577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0530bc1-c035-49f1-a832-6602c8b0e8f7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:42.457701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bbffb1d2-64ea-4f09-9e94-4c4987730b7f tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:42.491889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bbffb1d2-64ea-4f09-9e94-4c4987730b7f tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:42.511749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbffb1d2-64ea-4f09-9e94-4c4987730b7f tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:42.514493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbffb1d2-64ea-4f09-9e94-4c4987730b7f tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:42.520924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbffb1d2-64ea-4f09-9e94-4c4987730b7f tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:42.522741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbffb1d2-64ea-4f09-9e94-4c4987730b7f tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:42.524616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbffb1d2-64ea-4f09-9e94-4c4987730b7f tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:42.527611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbffb1d2-64ea-4f09-9e94-4c4987730b7f tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:42.534609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0530bc1-c035-49f1-a832-6602c8b0e8f7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:42.548735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0530bc1-c035-49f1-a832-6602c8b0e8f7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:42.575383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0530bc1-c035-49f1-a832-6602c8b0e8f7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:42.595621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0530bc1-c035-49f1-a832-6602c8b0e8f7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:42.597184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0530bc1-c035-49f1-a832-6602c8b0e8f7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:42.611111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0530bc1-c035-49f1-a832-6602c8b0e8f7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:42.874940 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bbffb1d2-64ea-4f09-9e94-4c4987730b7f tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action" status: 202 len: 0 microversion: 2.1 time: 0.426700 Sep 08 12:54:42.878534 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1517/2904] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:54:42 2022] POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:54:42.904276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e65bdc7d-e864-4ad8-a413-484fc2931160 req-7667141a-7826-4cb5-a167-38b2aec67930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad991b2-93e9-4eac-ab38-e5d5ee91f569", "tag": "19b453c9-4a90-4750-9a45-d3bde1b6957d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:42.937957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e65bdc7d-e864-4ad8-a413-484fc2931160 req-7667141a-7826-4cb5-a167-38b2aec67930 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:42.940111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e65bdc7d-e864-4ad8-a413-484fc2931160 req-7667141a-7826-4cb5-a167-38b2aec67930 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:42.941412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e65bdc7d-e864-4ad8-a413-484fc2931160 req-7667141a-7826-4cb5-a167-38b2aec67930 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:42.959916 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e65bdc7d-e864-4ad8-a413-484fc2931160 req-7667141a-7826-4cb5-a167-38b2aec67930 service nova] Creating event network-changed:19b453c9-4a90-4750-9a45-d3bde1b6957d for instance aad991b2-93e9-4eac-ab38-e5d5ee91f569 on n-h1-852084-10 Sep 08 12:54:42.965619 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e65bdc7d-e864-4ad8-a413-484fc2931160 req-7667141a-7826-4cb5-a167-38b2aec67930 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084846 Sep 08 12:54:42.967180 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1518/2905] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:42.973617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8b3cd240-6ba6-4afc-b56a-16fdb08fe1c1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:42.975141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8b3cd240-6ba6-4afc-b56a-16fdb08fe1c1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:43.340644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8b3cd240-6ba6-4afc-b56a-16fdb08fe1c1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:43.349805 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8b3cd240-6ba6-4afc-b56a-16fdb08fe1c1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1220 microversion: 2.1 time: 0.380435 Sep 08 12:54:43.358450 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1519/2906] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:42 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1220 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:43.366384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:43.377641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:43.430634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:43.463265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:43.471096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:43.473585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:43.478304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:43.484571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:43.603928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:43.670253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:43.684158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:43.685508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:43.688001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lazy-loading 'fault' on Instance uuid 3250685a-8562-4deb-a070-5ef61a7adece {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:54:44.179582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0530bc1-c035-49f1-a832-6602c8b0e8f7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:44.197707 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0530bc1-c035-49f1-a832-6602c8b0e8f7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1683 microversion: 2.1 time: 1.788310 Sep 08 12:54:44.198782 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1388/2907] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:42 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1683 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:44.206523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7daecccf-66a5-47f0-8d56-675d8f44a059 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:44.232238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7daecccf-66a5-47f0-8d56-675d8f44a059 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:44.266705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7daecccf-66a5-47f0-8d56-675d8f44a059 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:44.273412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7daecccf-66a5-47f0-8d56-675d8f44a059 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:44.277838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7daecccf-66a5-47f0-8d56-675d8f44a059 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:44.279046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7daecccf-66a5-47f0-8d56-675d8f44a059 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:44.282745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7daecccf-66a5-47f0-8d56-675d8f44a059 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:44.287910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7daecccf-66a5-47f0-8d56-675d8f44a059 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:44.763030 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b63c5b18-a716-40c3-8b10-cf83c1a0ac2e tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1598 microversion: 2.1 time: 1.403350 Sep 08 12:54:44.779978 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1520/2908] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:43 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1598 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:44.781120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d7702110-231e-49f6-9540-b0b466fbfedf tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:44.784836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d7702110-231e-49f6-9540-b0b466fbfedf tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:44.810428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7702110-231e-49f6-9540-b0b466fbfedf tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:44.814077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7702110-231e-49f6-9540-b0b466fbfedf tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:44.815303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7702110-231e-49f6-9540-b0b466fbfedf tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:44.820375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7702110-231e-49f6-9540-b0b466fbfedf tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:44.821228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7702110-231e-49f6-9540-b0b466fbfedf tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:44.821875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7702110-231e-49f6-9540-b0b466fbfedf tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:44.878172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7daecccf-66a5-47f0-8d56-675d8f44a059 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:44.898244 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7daecccf-66a5-47f0-8d56-675d8f44a059 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1351 microversion: 2.1 time: 0.695576 Sep 08 12:54:44.911595 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1389/2909] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:44 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1351 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:44.923523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d401a706-3da0-42e5-a0db-6e9bbae9df42 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:44.945943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d401a706-3da0-42e5-a0db-6e9bbae9df42 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:44.984755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d401a706-3da0-42e5-a0db-6e9bbae9df42 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:44.991434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d401a706-3da0-42e5-a0db-6e9bbae9df42 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:44.992132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d401a706-3da0-42e5-a0db-6e9bbae9df42 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:45.004353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d401a706-3da0-42e5-a0db-6e9bbae9df42 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:45.010156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d401a706-3da0-42e5-a0db-6e9bbae9df42 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:45.010808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d401a706-3da0-42e5-a0db-6e9bbae9df42 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:45.288340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d7702110-231e-49f6-9540-b0b466fbfedf tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:45.296131 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d401a706-3da0-42e5-a0db-6e9bbae9df42 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action" status: 202 len: 0 microversion: 2.1 time: 0.382739 Sep 08 12:54:45.297425 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1390/2910] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:54:44 2022] POST /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:54:45.325581 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d7702110-231e-49f6-9540-b0b466fbfedf tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1224 microversion: 2.1 time: 0.556498 Sep 08 12:54:45.328474 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1521/2911] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:44 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1224 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:45.339422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-93965631-1f7e-4869-be4f-671ae29ca995 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:45.343955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7d10f4e7-7835-4aea-90be-b065ced7adaf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:45.344333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-93965631-1f7e-4869-be4f-671ae29ca995 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:45.348636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7d10f4e7-7835-4aea-90be-b065ced7adaf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:45.362029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93965631-1f7e-4869-be4f-671ae29ca995 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:45.363663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93965631-1f7e-4869-be4f-671ae29ca995 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:45.364281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93965631-1f7e-4869-be4f-671ae29ca995 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:45.365417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93965631-1f7e-4869-be4f-671ae29ca995 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:45.366097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93965631-1f7e-4869-be4f-671ae29ca995 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:45.366819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93965631-1f7e-4869-be4f-671ae29ca995 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:45.402195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d10f4e7-7835-4aea-90be-b065ced7adaf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:45.411549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d10f4e7-7835-4aea-90be-b065ced7adaf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:45.412714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d10f4e7-7835-4aea-90be-b065ced7adaf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:45.415375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d10f4e7-7835-4aea-90be-b065ced7adaf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:45.416166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d10f4e7-7835-4aea-90be-b065ced7adaf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:45.423651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d10f4e7-7835-4aea-90be-b065ced7adaf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:46.084882 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-93965631-1f7e-4869-be4f-671ae29ca995 tempest-ServersAdminTestJSON-1316777502 tempest-ServersAdminTestJSON-1316777502-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1615 microversion: 2.1 time: 0.750589 Sep 08 12:54:46.088477 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1522/2912] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:45 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1615 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:46.120669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-089d8fc6-c8f1-4bee-85f8-58eb9554ca17 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:46.129130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-089d8fc6-c8f1-4bee-85f8-58eb9554ca17 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:46.167885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-089d8fc6-c8f1-4bee-85f8-58eb9554ca17 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:46.169887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-089d8fc6-c8f1-4bee-85f8-58eb9554ca17 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:46.174695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-089d8fc6-c8f1-4bee-85f8-58eb9554ca17 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:46.180431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-089d8fc6-c8f1-4bee-85f8-58eb9554ca17 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:46.183554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-089d8fc6-c8f1-4bee-85f8-58eb9554ca17 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:46.186744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-089d8fc6-c8f1-4bee-85f8-58eb9554ca17 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:46.758308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7d10f4e7-7835-4aea-90be-b065ced7adaf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:46.811372 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7d10f4e7-7835-4aea-90be-b065ced7adaf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1683 microversion: 2.1 time: 1.504494 Sep 08 12:54:46.836321 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1391/2913] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:45 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1683 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:46.875345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b53d58e2-2b33-46c9-b49e-a1c7a551351a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:46.876794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b53d58e2-2b33-46c9-b49e-a1c7a551351a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:46.922535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b53d58e2-2b33-46c9-b49e-a1c7a551351a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:46.928177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b53d58e2-2b33-46c9-b49e-a1c7a551351a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:46.932683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b53d58e2-2b33-46c9-b49e-a1c7a551351a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:46.934657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b53d58e2-2b33-46c9-b49e-a1c7a551351a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:46.943742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b53d58e2-2b33-46c9-b49e-a1c7a551351a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:46.944991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b53d58e2-2b33-46c9-b49e-a1c7a551351a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:47.028657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:47.043062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b53d58e2-2b33-46c9-b49e-a1c7a551351a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:54:47.462579 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b53d58e2-2b33-46c9-b49e-a1c7a551351a tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 204 len: 0 microversion: 2.1 time: 0.623915 Sep 08 12:54:47.463500 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1392/2914] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:54:46 2022] DELETE /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:54:47.484146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9aef2df7-310e-40bf-aae1-a83c992c3edb tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:47.484975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9aef2df7-310e-40bf-aae1-a83c992c3edb tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:47.499195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aef2df7-310e-40bf-aae1-a83c992c3edb tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:47.499746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aef2df7-310e-40bf-aae1-a83c992c3edb tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:47.500203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aef2df7-310e-40bf-aae1-a83c992c3edb tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:47.501003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aef2df7-310e-40bf-aae1-a83c992c3edb tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:47.501427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aef2df7-310e-40bf-aae1-a83c992c3edb tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:47.501934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aef2df7-310e-40bf-aae1-a83c992c3edb tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:47.776475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-089d8fc6-c8f1-4bee-85f8-58eb9554ca17 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:47.809464 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-089d8fc6-c8f1-4bee-85f8-58eb9554ca17 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1351 microversion: 2.1 time: 1.718115 Sep 08 12:54:47.828017 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1523/2915] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:46 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1351 bytes in 1739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:47.861598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-74dbd726-244e-4596-8b69-a6a6e82888c6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:47.863158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-74dbd726-244e-4596-8b69-a6a6e82888c6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:47.893064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74dbd726-244e-4596-8b69-a6a6e82888c6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:47.893980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74dbd726-244e-4596-8b69-a6a6e82888c6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:47.894820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74dbd726-244e-4596-8b69-a6a6e82888c6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:47.896812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74dbd726-244e-4596-8b69-a6a6e82888c6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:47.897729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74dbd726-244e-4596-8b69-a6a6e82888c6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:47.907874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74dbd726-244e-4596-8b69-a6a6e82888c6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:48.475742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9aef2df7-310e-40bf-aae1-a83c992c3edb tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:48.485704 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9aef2df7-310e-40bf-aae1-a83c992c3edb tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1278 microversion: 2.1 time: 1.015019 Sep 08 12:54:48.496869 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1393/2916] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:47 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1278 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:48.502398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92045873-7ca8-45c5-9e61-73fdd69be302 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:48.503477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-92045873-7ca8-45c5-9e61-73fdd69be302 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:48.520334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92045873-7ca8-45c5-9e61-73fdd69be302 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:48.525417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92045873-7ca8-45c5-9e61-73fdd69be302 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:48.526504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92045873-7ca8-45c5-9e61-73fdd69be302 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:48.527558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92045873-7ca8-45c5-9e61-73fdd69be302 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:48.530661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92045873-7ca8-45c5-9e61-73fdd69be302 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:48.531513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92045873-7ca8-45c5-9e61-73fdd69be302 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:50.236699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-74dbd726-244e-4596-8b69-a6a6e82888c6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:50.256013 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-74dbd726-244e-4596-8b69-a6a6e82888c6 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 200 len: 1470 microversion: 2.1 time: 2.425200 Sep 08 12:54:50.272789 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1524/2917] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:47 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 1470 bytes in 2444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:50.278054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3fa49cea-a9d1-4aed-b7e2-3e08d3b9a3f0 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:50.278714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3fa49cea-a9d1-4aed-b7e2-3e08d3b9a3f0 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:50.287776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fa49cea-a9d1-4aed-b7e2-3e08d3b9a3f0 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:50.288298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fa49cea-a9d1-4aed-b7e2-3e08d3b9a3f0 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:50.288820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fa49cea-a9d1-4aed-b7e2-3e08d3b9a3f0 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:50.289573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fa49cea-a9d1-4aed-b7e2-3e08d3b9a3f0 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:50.290581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fa49cea-a9d1-4aed-b7e2-3e08d3b9a3f0 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:50.291360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fa49cea-a9d1-4aed-b7e2-3e08d3b9a3f0 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:50.638892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-92045873-7ca8-45c5-9e61-73fdd69be302 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:50.673001 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92045873-7ca8-45c5-9e61-73fdd69be302 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1683 microversion: 2.1 time: 2.173574 Sep 08 12:54:50.675819 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1394/2918] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:48 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1683 bytes in 2178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:50.689480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c0241356-ff8e-4493-8b1b-810946fba7f7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:50.691067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c0241356-ff8e-4493-8b1b-810946fba7f7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:50.721832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0241356-ff8e-4493-8b1b-810946fba7f7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:50.723303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0241356-ff8e-4493-8b1b-810946fba7f7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:50.724963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0241356-ff8e-4493-8b1b-810946fba7f7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:50.727692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0241356-ff8e-4493-8b1b-810946fba7f7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:50.729034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0241356-ff8e-4493-8b1b-810946fba7f7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:50.730147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0241356-ff8e-4493-8b1b-810946fba7f7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:51.175846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:51.290966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:51.339541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3fa49cea-a9d1-4aed-b7e2-3e08d3b9a3f0 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:51.355310 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3fa49cea-a9d1-4aed-b7e2-3e08d3b9a3f0 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1351 microversion: 2.1 time: 1.081200 Sep 08 12:54:51.381578 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1525/2919] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:50 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1351 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:51.398188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-915a8abc-afaf-4184-b616-fe0f4f45afd0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:51.403875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-915a8abc-afaf-4184-b616-fe0f4f45afd0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:51.431084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-915a8abc-afaf-4184-b616-fe0f4f45afd0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:51.435251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-915a8abc-afaf-4184-b616-fe0f4f45afd0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:51.439367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-915a8abc-afaf-4184-b616-fe0f4f45afd0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:51.442181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-915a8abc-afaf-4184-b616-fe0f4f45afd0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:51.446306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-915a8abc-afaf-4184-b616-fe0f4f45afd0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:51.448417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-915a8abc-afaf-4184-b616-fe0f4f45afd0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:51.727798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c0241356-ff8e-4493-8b1b-810946fba7f7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:51.777635 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c0241356-ff8e-4493-8b1b-810946fba7f7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1278 microversion: 2.1 time: 1.094885 Sep 08 12:54:51.780852 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1395/2920] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:50 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1278 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:51.793979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-641f0db9-4021-461a-bf6d-32d0190dc9d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:51.795657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-641f0db9-4021-461a-bf6d-32d0190dc9d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:51.811052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-641f0db9-4021-461a-bf6d-32d0190dc9d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:51.812511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-641f0db9-4021-461a-bf6d-32d0190dc9d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:51.814363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-641f0db9-4021-461a-bf6d-32d0190dc9d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:51.816814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-641f0db9-4021-461a-bf6d-32d0190dc9d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:51.818195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-641f0db9-4021-461a-bf6d-32d0190dc9d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:51.819607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-641f0db9-4021-461a-bf6d-32d0190dc9d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:52.386351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:53.345710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:54.673048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-915a8abc-afaf-4184-b616-fe0f4f45afd0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:54.701835 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-915a8abc-afaf-4184-b616-fe0f4f45afd0 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 200 len: 1470 microversion: 2.1 time: 3.318617 Sep 08 12:54:54.719562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-641f0db9-4021-461a-bf6d-32d0190dc9d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:54.720519 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1526/2921] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:51 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 1470 bytes in 3338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:54.729957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4458128f-0e65-4591-835e-ad11c60e3070 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:54.730906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4458128f-0e65-4591-835e-ad11c60e3070 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:54.737612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4458128f-0e65-4591-835e-ad11c60e3070 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:54.738610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4458128f-0e65-4591-835e-ad11c60e3070 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:54.739251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4458128f-0e65-4591-835e-ad11c60e3070 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:54.740765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4458128f-0e65-4591-835e-ad11c60e3070 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:54.741424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4458128f-0e65-4591-835e-ad11c60e3070 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:54.742032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4458128f-0e65-4591-835e-ad11c60e3070 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:54.794597 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-641f0db9-4021-461a-bf6d-32d0190dc9d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1683 microversion: 2.1 time: 3.005279 Sep 08 12:54:54.820766 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1396/2922] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:51 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1683 bytes in 3039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:54.863783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ffa957d4-9374-47b6-9cc1-7aef58a412c8 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:54.865539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ffa957d4-9374-47b6-9cc1-7aef58a412c8 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:54.870917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:54:54.896629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffa957d4-9374-47b6-9cc1-7aef58a412c8 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:54.920347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffa957d4-9374-47b6-9cc1-7aef58a412c8 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:54.921202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffa957d4-9374-47b6-9cc1-7aef58a412c8 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:54.923829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffa957d4-9374-47b6-9cc1-7aef58a412c8 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:54.925137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffa957d4-9374-47b6-9cc1-7aef58a412c8 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:54.930940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffa957d4-9374-47b6-9cc1-7aef58a412c8 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:55.496093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ffa957d4-9374-47b6-9cc1-7aef58a412c8 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:55.534798 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ffa957d4-9374-47b6-9cc1-7aef58a412c8 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1278 microversion: 2.1 time: 0.708478 Sep 08 12:54:55.573486 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1397/2923] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:54 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1278 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:56.265077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4458128f-0e65-4591-835e-ad11c60e3070 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:56.290580 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4458128f-0e65-4591-835e-ad11c60e3070 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1351 microversion: 2.1 time: 1.568102 Sep 08 12:54:56.295849 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1527/2924] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:54 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1351 bytes in 1574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:56.307147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-6ee75736-f8bd-47eb-a5fa-88f205b0ba40 req-b85e55c7-452a-439f-89fb-9498b30e6e26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad991b2-93e9-4eac-ab38-e5d5ee91f569", "name": "network-vif-plugged", "status": "completed", "tag": "19b453c9-4a90-4750-9a45-d3bde1b6957d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:56.319896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6ee75736-f8bd-47eb-a5fa-88f205b0ba40 req-b85e55c7-452a-439f-89fb-9498b30e6e26 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:56.322795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6ee75736-f8bd-47eb-a5fa-88f205b0ba40 req-b85e55c7-452a-439f-89fb-9498b30e6e26 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:56.323632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6ee75736-f8bd-47eb-a5fa-88f205b0ba40 req-b85e55c7-452a-439f-89fb-9498b30e6e26 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:56.340047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1703027125", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "dbd28b0c-6c95-45fa-bc88-dd4ecaae050a"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:56.382780 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-6ee75736-f8bd-47eb-a5fa-88f205b0ba40 req-b85e55c7-452a-439f-89fb-9498b30e6e26 service nova] Creating event network-vif-plugged:19b453c9-4a90-4750-9a45-d3bde1b6957d for instance aad991b2-93e9-4eac-ab38-e5d5ee91f569 on n-h1-852084-10 Sep 08 12:54:56.398772 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-6ee75736-f8bd-47eb-a5fa-88f205b0ba40 req-b85e55c7-452a-439f-89fb-9498b30e6e26 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098259 Sep 08 12:54:56.400794 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1528/2925] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:56.445931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c937eaf4-9b49-4acf-be22-542e6fc83ceb req-17ae51ef-a280-41ea-9e96-88ca7bbc678f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9439ff7-64b9-44b2-be82-45cd0328104e", "name": "network-vif-deleted", "tag": "7569b872-ae85-4d31-96b7-c87c9571abaf"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:54:56.517422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c937eaf4-9b49-4acf-be22-542e6fc83ceb req-17ae51ef-a280-41ea-9e96-88ca7bbc678f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:56.517857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c937eaf4-9b49-4acf-be22-542e6fc83ceb req-17ae51ef-a280-41ea-9e96-88ca7bbc678f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:56.518307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c937eaf4-9b49-4acf-be22-542e6fc83ceb req-17ae51ef-a280-41ea-9e96-88ca7bbc678f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:56.588832 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c937eaf4-9b49-4acf-be22-542e6fc83ceb req-17ae51ef-a280-41ea-9e96-88ca7bbc678f service nova] Creating event network-vif-deleted:7569b872-ae85-4d31-96b7-c87c9571abaf for instance d9439ff7-64b9-44b2-be82-45cd0328104e on n-h2-852084-10 Sep 08 12:54:56.595572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] validate_networks() for [('dbd28b0c-6c95-45fa-bc88-dd4ecaae050a', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:54:56.604788 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c937eaf4-9b49-4acf-be22-542e6fc83ceb req-17ae51ef-a280-41ea-9e96-88ca7bbc678f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177852 Sep 08 12:54:56.605785 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1529/2926] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:54:56.615187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f43e2edc-75c9-4247-96af-79c9202edecd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:56.616016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f43e2edc-75c9-4247-96af-79c9202edecd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: d9439ff7-64b9-44b2-be82-45cd0328104e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:56.631969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e2edc-75c9-4247-96af-79c9202edecd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:56.632476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e2edc-75c9-4247-96af-79c9202edecd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:56.632936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e2edc-75c9-4247-96af-79c9202edecd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:56.633692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e2edc-75c9-4247-96af-79c9202edecd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:56.643588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e2edc-75c9-4247-96af-79c9202edecd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:56.644599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43e2edc-75c9-4247-96af-79c9202edecd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:56.672675 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-f43e2edc-75c9-4247-96af-79c9202edecd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] HTTP exception thrown: Instance d9439ff7-64b9-44b2-be82-45cd0328104e could not be found. Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f43e2edc-75c9-4247-96af-79c9202edecd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Request method failure captured: Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e HTTP/1.1 Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVKvS-MuaBXAYO9hcdemg5kI_x1uS5rWz2oHDtQVovjNIZGtUCD6idseSQl5jylCXokVzaayaM1x6yr2i1v2Jls7CerFdgvraqiH5TbwyMyX3bqFtIDmsKyZ0sIcAUFBYGgJaLn7IH6x9lCmt1C-HRkfOvrXJoe6OgkQQqXpVlTa3Q Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 6c7023382ac747a2a84467a1b13b3bdb Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersAdminTestJSON-2046306070 Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c7023382ac747a2a84467a1b13b3bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c7023382ac747a2a84467a1b13b3bdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c7023382ac747a2a84467a1b13b3bdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c7023382ac747a2a84467a1b13b3bdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersAdminTestJSON-2046306070 Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 6c7023382ac747a2a84467a1b13b3bdb Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersAdminTestJSON-2046306070 Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersAdminTestJSON-2046306070-project Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 1ef692f2f2ae4e8190248fc0c1f967ee Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersAdminTestJSON-2046306070-project Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance d9439ff7-64b9-44b2-be82-45cd0328104e could not be found. Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'd9439ff7-64b9-44b2-be82-45cd0328104e'} Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9439ff7-64b9-44b2-be82-45cd0328104e could not be found. Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9439ff7-64b9-44b2-be82-45cd0328104e could not be found. Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:54:56.679080 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:56.683499 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:54:56.683499 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:54:56.683499 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:54:56.683499 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:54:56.683499 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:54:56.683499 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9439ff7-64b9-44b2-be82-45cd0328104e could not be found. Sep 08 12:54:56.683499 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:54:56.692313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f43e2edc-75c9-4247-96af-79c9202edecd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Returning 404 to user: Instance d9439ff7-64b9-44b2-be82-45cd0328104e could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:54:56.694201 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f43e2edc-75c9-4247-96af-79c9202edecd tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e" status: 404 len: 111 microversion: 2.1 time: 0.087049 Sep 08 12:54:56.711700 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1530/2927] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:56 2022] GET /compute/v2.1/servers/d9439ff7-64b9-44b2-be82-45cd0328104e => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:54:56.717761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-408a78c1-d42a-42fb-9c6f-b4d67a0a3d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:56.718800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-408a78c1-d42a-42fb-9c6f-b4d67a0a3d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:56.738641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-408a78c1-d42a-42fb-9c6f-b4d67a0a3d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:56.744283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-408a78c1-d42a-42fb-9c6f-b4d67a0a3d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:56.745077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-408a78c1-d42a-42fb-9c6f-b4d67a0a3d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:56.746242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-408a78c1-d42a-42fb-9c6f-b4d67a0a3d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:56.747140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-408a78c1-d42a-42fb-9c6f-b4d67a0a3d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:56.747843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-408a78c1-d42a-42fb-9c6f-b4d67a0a3d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:58.149644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:54:58.150841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:54:58.151658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:54:58.152307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:54:58.153095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:54:58.178379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:58.179309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:58.180123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:58.181186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:58.187383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:58.189010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:58.233738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:54:58.241779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for user d9a995d2889c47738ad0b5255445c5f0 and project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:54:58.257557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:54:58.260882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:54:58.517755 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-69d2b5f4-be51-4642-bfa8-5dd6674c867f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.932697 Sep 08 12:54:58.524759 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1398/2928] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:54:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 2949 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:54:58.544593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-408a78c1-d42a-42fb-9c6f-b4d67a0a3d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:54:58.576835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-88762567-6cbe-4b8e-80d5-355a5e676e1c tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:58.577490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-88762567-6cbe-4b8e-80d5-355a5e676e1c tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:58.588684 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-408a78c1-d42a-42fb-9c6f-b4d67a0a3d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1683 microversion: 2.1 time: 1.875429 Sep 08 12:54:58.589576 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1531/2929] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:56 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1683 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:54:58.605363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-07d06c46-3e9a-4ec8-90a4-11d3a9499bd9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:58.608075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-07d06c46-3e9a-4ec8-90a4-11d3a9499bd9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:58.623005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07d06c46-3e9a-4ec8-90a4-11d3a9499bd9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:58.625848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07d06c46-3e9a-4ec8-90a4-11d3a9499bd9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:58.628465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07d06c46-3e9a-4ec8-90a4-11d3a9499bd9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:58.633004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07d06c46-3e9a-4ec8-90a4-11d3a9499bd9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:58.633798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07d06c46-3e9a-4ec8-90a4-11d3a9499bd9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:58.638289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07d06c46-3e9a-4ec8-90a4-11d3a9499bd9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:58.702498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-07d06c46-3e9a-4ec8-90a4-11d3a9499bd9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:54:58.715627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88762567-6cbe-4b8e-80d5-355a5e676e1c tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:58.722202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88762567-6cbe-4b8e-80d5-355a5e676e1c tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:58.728187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88762567-6cbe-4b8e-80d5-355a5e676e1c tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:58.738819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88762567-6cbe-4b8e-80d5-355a5e676e1c tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:58.740578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88762567-6cbe-4b8e-80d5-355a5e676e1c tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:58.746753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88762567-6cbe-4b8e-80d5-355a5e676e1c tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:58.962824 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-07d06c46-3e9a-4ec8-90a4-11d3a9499bd9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "DELETE /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910" status: 204 len: 0 microversion: 2.1 time: 0.369644 Sep 08 12:54:58.971564 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1532/2930] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:54:58 2022] DELETE /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:54:58.995544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0d11ceb1-a677-47c1-9353-95da481fbce3 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:54:58.997890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0d11ceb1-a677-47c1-9353-95da481fbce3 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:54:59.014336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d11ceb1-a677-47c1-9353-95da481fbce3 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:59.014856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d11ceb1-a677-47c1-9353-95da481fbce3 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:59.015343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d11ceb1-a677-47c1-9353-95da481fbce3 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:54:59.016340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d11ceb1-a677-47c1-9353-95da481fbce3 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:54:59.016819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d11ceb1-a677-47c1-9353-95da481fbce3 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:54:59.017253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d11ceb1-a677-47c1-9353-95da481fbce3 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:00.319896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-88762567-6cbe-4b8e-80d5-355a5e676e1c tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:00.357792 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-88762567-6cbe-4b8e-80d5-355a5e676e1c tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1320 microversion: 2.1 time: 1.831394 Sep 08 12:55:00.363649 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1399/2931] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:58 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1320 bytes in 1840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:00.381781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7fc6e233-60f3-4c67-b42f-635544d68f7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:00.382932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7fc6e233-60f3-4c67-b42f-635544d68f7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:00.390920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fc6e233-60f3-4c67-b42f-635544d68f7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:00.392106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fc6e233-60f3-4c67-b42f-635544d68f7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:00.392761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fc6e233-60f3-4c67-b42f-635544d68f7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:00.393708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fc6e233-60f3-4c67-b42f-635544d68f7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:00.394356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fc6e233-60f3-4c67-b42f-635544d68f7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:00.394972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7fc6e233-60f3-4c67-b42f-635544d68f7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:00.580141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7fc6e233-60f3-4c67-b42f-635544d68f7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:00.603115 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7fc6e233-60f3-4c67-b42f-635544d68f7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1219 microversion: 2.1 time: 0.236559 Sep 08 12:55:00.603825 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1400/2932] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:00 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1219 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:00.612842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a222eaff-c778-40b1-8808-5468ec00390c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:00.613475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a222eaff-c778-40b1-8808-5468ec00390c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:00.629136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a222eaff-c778-40b1-8808-5468ec00390c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:00.629663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a222eaff-c778-40b1-8808-5468ec00390c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:00.633687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a222eaff-c778-40b1-8808-5468ec00390c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:00.634672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a222eaff-c778-40b1-8808-5468ec00390c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:00.635180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a222eaff-c778-40b1-8808-5468ec00390c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:00.637774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a222eaff-c778-40b1-8808-5468ec00390c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:00.672089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0d11ceb1-a677-47c1-9353-95da481fbce3 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:00.688718 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0d11ceb1-a677-47c1-9353-95da481fbce3 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1351 microversion: 2.1 time: 1.715419 Sep 08 12:55:00.694126 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1533/2933] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:54:58 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1351 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:00.699573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-000d0e12-99ec-4225-83e1-afa063230d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:00.718975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-000d0e12-99ec-4225-83e1-afa063230d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:00.746304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-000d0e12-99ec-4225-83e1-afa063230d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:00.747296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-000d0e12-99ec-4225-83e1-afa063230d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:00.752013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-000d0e12-99ec-4225-83e1-afa063230d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:00.753361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-000d0e12-99ec-4225-83e1-afa063230d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:00.755665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-000d0e12-99ec-4225-83e1-afa063230d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:00.757699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-000d0e12-99ec-4225-83e1-afa063230d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:01.512084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a222eaff-c778-40b1-8808-5468ec00390c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:01.523067 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a222eaff-c778-40b1-8808-5468ec00390c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910" status: 200 len: 1470 microversion: 2.1 time: 0.916976 Sep 08 12:55:01.526379 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1401/2934] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:00 2022] GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910 => generated 1470 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:01.545156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3de23abd-9ca4-4934-89cf-062a9f367740 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:01.546146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3de23abd-9ca4-4934-89cf-062a9f367740 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:01.554011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3de23abd-9ca4-4934-89cf-062a9f367740 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:01.554803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3de23abd-9ca4-4934-89cf-062a9f367740 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:01.555496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3de23abd-9ca4-4934-89cf-062a9f367740 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:01.556474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3de23abd-9ca4-4934-89cf-062a9f367740 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:01.557156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3de23abd-9ca4-4934-89cf-062a9f367740 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:01.557761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3de23abd-9ca4-4934-89cf-062a9f367740 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:01.728797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-000d0e12-99ec-4225-83e1-afa063230d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:01.738517 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-000d0e12-99ec-4225-83e1-afa063230d7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.042878 Sep 08 12:55:01.739142 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1534/2935] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:00 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:01.779973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a400f62f-6c26-48fb-ae89-710b80e31078 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:01.788180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a400f62f-6c26-48fb-ae89-710b80e31078 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:01.824365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a400f62f-6c26-48fb-ae89-710b80e31078 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:01.825494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a400f62f-6c26-48fb-ae89-710b80e31078 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:01.826287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a400f62f-6c26-48fb-ae89-710b80e31078 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:01.837145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a400f62f-6c26-48fb-ae89-710b80e31078 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:01.838473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a400f62f-6c26-48fb-ae89-710b80e31078 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:01.839612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a400f62f-6c26-48fb-ae89-710b80e31078 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:02.127218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a400f62f-6c26-48fb-ae89-710b80e31078 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:02.147306 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a400f62f-6c26-48fb-ae89-710b80e31078 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1267 microversion: 2.1 time: 0.385313 Sep 08 12:55:02.148244 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1535/2936] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:01 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1267 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:02.153669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3369d012-ed0a-4281-9f89-d5a0e90ad852 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:02.154169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3369d012-ed0a-4281-9f89-d5a0e90ad852 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:02.178201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3369d012-ed0a-4281-9f89-d5a0e90ad852 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:02.178934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3369d012-ed0a-4281-9f89-d5a0e90ad852 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:02.179741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3369d012-ed0a-4281-9f89-d5a0e90ad852 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:02.180509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3369d012-ed0a-4281-9f89-d5a0e90ad852 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:02.180984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3369d012-ed0a-4281-9f89-d5a0e90ad852 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:02.181404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3369d012-ed0a-4281-9f89-d5a0e90ad852 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:02.638279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3de23abd-9ca4-4934-89cf-062a9f367740 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:02.656301 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3de23abd-9ca4-4934-89cf-062a9f367740 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1320 microversion: 2.1 time: 1.128667 Sep 08 12:55:02.656918 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1402/2937] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:01 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1320 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:02.662316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7c04b999-b5cf-4842-9de6-15e465beec58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:02.662935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7c04b999-b5cf-4842-9de6-15e465beec58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:02.680034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c04b999-b5cf-4842-9de6-15e465beec58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:02.680534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c04b999-b5cf-4842-9de6-15e465beec58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:02.681188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c04b999-b5cf-4842-9de6-15e465beec58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:02.682261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c04b999-b5cf-4842-9de6-15e465beec58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:02.683712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c04b999-b5cf-4842-9de6-15e465beec58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:02.684579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c04b999-b5cf-4842-9de6-15e465beec58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:03.405890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3369d012-ed0a-4281-9f89-d5a0e90ad852 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:03.411485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:03.507001 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3369d012-ed0a-4281-9f89-d5a0e90ad852 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1541 microversion: 2.1 time: 1.337466 Sep 08 12:55:03.508800 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1536/2938] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:02 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1541 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:03.535441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-8a032ec7-f1b6-4c2a-9887-177edcc310fb req-b806f4af-1669-4df1-a78f-cfd40b2d6bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0429d874-2d6c-4e87-8985-019f7dd39997", "tag": "52260ece-2c3d-444c-a1e5-2dd56f0936d6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:03.646264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8a032ec7-f1b6-4c2a-9887-177edcc310fb req-b806f4af-1669-4df1-a78f-cfd40b2d6bc8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:03.648450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8a032ec7-f1b6-4c2a-9887-177edcc310fb req-b806f4af-1669-4df1-a78f-cfd40b2d6bc8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:03.655080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8a032ec7-f1b6-4c2a-9887-177edcc310fb req-b806f4af-1669-4df1-a78f-cfd40b2d6bc8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:03.725428 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-8a032ec7-f1b6-4c2a-9887-177edcc310fb req-b806f4af-1669-4df1-a78f-cfd40b2d6bc8 service nova] Creating event network-changed:52260ece-2c3d-444c-a1e5-2dd56f0936d6 for instance 0429d874-2d6c-4e87-8985-019f7dd39997 on n-h2-852084-10 Sep 08 12:55:03.782410 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-8a032ec7-f1b6-4c2a-9887-177edcc310fb req-b806f4af-1669-4df1-a78f-cfd40b2d6bc8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271395 Sep 08 12:55:03.806145 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1537/2939] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:03.833828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-59649ef0-4b39-492e-9c8b-8bedf97f4d51 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:03.834815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-59649ef0-4b39-492e-9c8b-8bedf97f4d51 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:03.934947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59649ef0-4b39-492e-9c8b-8bedf97f4d51 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:03.936482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59649ef0-4b39-492e-9c8b-8bedf97f4d51 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:03.939701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59649ef0-4b39-492e-9c8b-8bedf97f4d51 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:03.941650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59649ef0-4b39-492e-9c8b-8bedf97f4d51 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:03.942488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59649ef0-4b39-492e-9c8b-8bedf97f4d51 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:03.944025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59649ef0-4b39-492e-9c8b-8bedf97f4d51 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:04.200372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-59649ef0-4b39-492e-9c8b-8bedf97f4d51 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:04.221298 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-59649ef0-4b39-492e-9c8b-8bedf97f4d51 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910" status: 200 len: 1428 microversion: 2.1 time: 0.406273 Sep 08 12:55:04.240581 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1538/2940] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:03 2022] GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910 => generated 1428 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:04.275606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-4b01e1d9-8ad8-420c-8d08-c06d1a16ce7e req-84c2d1be-62d2-4b93-947c-b23e5b515787 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb01efa-03b9-40b6-901b-33e7d583b7c8", "name": "network-vif-unplugged", "status": "completed", "tag": "6d98b289-22e2-4a8e-ba25-0857a1412c6b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:04.300157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4b01e1d9-8ad8-420c-8d08-c06d1a16ce7e req-84c2d1be-62d2-4b93-947c-b23e5b515787 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:04.302103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4b01e1d9-8ad8-420c-8d08-c06d1a16ce7e req-84c2d1be-62d2-4b93-947c-b23e5b515787 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:04.303120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4b01e1d9-8ad8-420c-8d08-c06d1a16ce7e req-84c2d1be-62d2-4b93-947c-b23e5b515787 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:04.334270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7c04b999-b5cf-4842-9de6-15e465beec58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:04.361564 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-4b01e1d9-8ad8-420c-8d08-c06d1a16ce7e req-84c2d1be-62d2-4b93-947c-b23e5b515787 service nova] Creating event network-vif-unplugged:6d98b289-22e2-4a8e-ba25-0857a1412c6b for instance abb01efa-03b9-40b6-901b-33e7d583b7c8 on n-h1-852084-10 Sep 08 12:55:04.376044 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7c04b999-b5cf-4842-9de6-15e465beec58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.717561 Sep 08 12:55:04.377101 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1403/2941] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:02 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:04.390573 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-4b01e1d9-8ad8-420c-8d08-c06d1a16ce7e req-84c2d1be-62d2-4b93-947c-b23e5b515787 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142536 Sep 08 12:55:04.397821 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1539/2942] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:04.421612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c8e84dd2-c9aa-4da5-af90-77536e465002 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:04.429600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c8e84dd2-c9aa-4da5-af90-77536e465002 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:04.443934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-196c1ce2-0cd4-4291-a3e1-cc75bcee1295 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:04.445149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-196c1ce2-0cd4-4291-a3e1-cc75bcee1295 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:04.471155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8e84dd2-c9aa-4da5-af90-77536e465002 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:04.478760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8e84dd2-c9aa-4da5-af90-77536e465002 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:04.482989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8e84dd2-c9aa-4da5-af90-77536e465002 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:04.493171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8e84dd2-c9aa-4da5-af90-77536e465002 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:04.498471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-196c1ce2-0cd4-4291-a3e1-cc75bcee1295 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:04.499195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8e84dd2-c9aa-4da5-af90-77536e465002 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:04.503056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8e84dd2-c9aa-4da5-af90-77536e465002 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:04.510756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-196c1ce2-0cd4-4291-a3e1-cc75bcee1295 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:04.514900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-196c1ce2-0cd4-4291-a3e1-cc75bcee1295 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:04.517190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-196c1ce2-0cd4-4291-a3e1-cc75bcee1295 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:04.520658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-196c1ce2-0cd4-4291-a3e1-cc75bcee1295 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:04.527405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-196c1ce2-0cd4-4291-a3e1-cc75bcee1295 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:05.566871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c8e84dd2-c9aa-4da5-af90-77536e465002 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:05.586320 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c8e84dd2-c9aa-4da5-af90-77536e465002 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1273 microversion: 2.1 time: 1.198982 Sep 08 12:55:05.597331 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1404/2943] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:04 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1273 bytes in 1212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:05.609996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4c5a63ae-217f-4102-b9d5-19cea8a4e017 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:05.618962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4c5a63ae-217f-4102-b9d5-19cea8a4e017 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:05.639103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c5a63ae-217f-4102-b9d5-19cea8a4e017 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:05.640409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c5a63ae-217f-4102-b9d5-19cea8a4e017 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:05.641723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c5a63ae-217f-4102-b9d5-19cea8a4e017 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:05.643339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c5a63ae-217f-4102-b9d5-19cea8a4e017 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:05.644440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c5a63ae-217f-4102-b9d5-19cea8a4e017 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:05.645516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c5a63ae-217f-4102-b9d5-19cea8a4e017 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:05.957296 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-196c1ce2-0cd4-4291-a3e1-cc75bcee1295 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569/os-interface" status: 200 len: 285 microversion: 2.1 time: 1.553506 Sep 08 12:55:05.957296 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1540/2944] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 12:55:04 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569/os-interface => generated 285 bytes in 1556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:05.968211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:05.968856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:05.985246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:05.985761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:05.986211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:05.986967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:05.991846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:05.992332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:06.092018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:06.093253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:06.093253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:06.093522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lazy-loading 'fault' on Instance uuid da5f8e14-96f2-45be-a26e-e5dc05ef7910 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:55:06.657314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:06.674739 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ecd59e1f-9d99-461d-ade2-25579e1cc91c tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910" status: 200 len: 1304 microversion: 2.1 time: 0.710456 Sep 08 12:55:06.684003 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1541/2945] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:05 2022] GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910 => generated 1304 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:06.698948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-751ffdfb-463d-4f82-94d3-62f2d572dec8 req-f6dd470b-7634-4e31-ad5b-51283ca07a21 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86ab042-dd54-494c-b637-c3fab97d2558", "tag": "e849c7d8-4d1d-46d1-a095-5ff08f26ccab"}, {"server_uuid": "da5f8e14-96f2-45be-a26e-e5dc05ef7910", "name": "network-vif-deleted", "tag": "3842a644-a231-4d26-bad9-66d212e8056f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:06.747023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-751ffdfb-463d-4f82-94d3-62f2d572dec8 req-f6dd470b-7634-4e31-ad5b-51283ca07a21 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:06.749594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-751ffdfb-463d-4f82-94d3-62f2d572dec8 req-f6dd470b-7634-4e31-ad5b-51283ca07a21 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:06.770711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-751ffdfb-463d-4f82-94d3-62f2d572dec8 req-f6dd470b-7634-4e31-ad5b-51283ca07a21 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:06.804464 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-751ffdfb-463d-4f82-94d3-62f2d572dec8 req-f6dd470b-7634-4e31-ad5b-51283ca07a21 service nova] Creating event network-changed:e849c7d8-4d1d-46d1-a095-5ff08f26ccab for instance d86ab042-dd54-494c-b637-c3fab97d2558 on n-h2-852084-10 Sep 08 12:55:06.805397 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-751ffdfb-463d-4f82-94d3-62f2d572dec8 req-f6dd470b-7634-4e31-ad5b-51283ca07a21 service nova] Creating event network-vif-deleted:3842a644-a231-4d26-bad9-66d212e8056f for instance da5f8e14-96f2-45be-a26e-e5dc05ef7910 on n-h1-852084-10 Sep 08 12:55:06.816768 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-751ffdfb-463d-4f82-94d3-62f2d572dec8 req-f6dd470b-7634-4e31-ad5b-51283ca07a21 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.130409 Sep 08 12:55:06.818821 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1542/2946] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:06.828994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5576470d-7233-4339-bd74-520a6fb7962d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:06.830453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5576470d-7233-4339-bd74-520a6fb7962d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:06.841224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5576470d-7233-4339-bd74-520a6fb7962d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:06.842208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5576470d-7233-4339-bd74-520a6fb7962d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:06.842964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5576470d-7233-4339-bd74-520a6fb7962d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:06.847612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5576470d-7233-4339-bd74-520a6fb7962d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:06.848290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5576470d-7233-4339-bd74-520a6fb7962d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:06.849356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5576470d-7233-4339-bd74-520a6fb7962d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:07.003501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4c5a63ae-217f-4102-b9d5-19cea8a4e017 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:07.021373 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4c5a63ae-217f-4102-b9d5-19cea8a4e017 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1320 microversion: 2.1 time: 1.421322 Sep 08 12:55:07.022649 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1405/2947] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:05 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1320 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:07.050963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a4b7cf4a-9cd2-4969-9002-8ddf417235b8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:07.052562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a4b7cf4a-9cd2-4969-9002-8ddf417235b8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:07.061513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4b7cf4a-9cd2-4969-9002-8ddf417235b8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:07.062332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4b7cf4a-9cd2-4969-9002-8ddf417235b8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:07.062978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4b7cf4a-9cd2-4969-9002-8ddf417235b8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:07.064232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4b7cf4a-9cd2-4969-9002-8ddf417235b8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:07.064941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4b7cf4a-9cd2-4969-9002-8ddf417235b8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:07.065902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4b7cf4a-9cd2-4969-9002-8ddf417235b8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:07.679813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5576470d-7233-4339-bd74-520a6fb7962d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:07.702082 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5576470d-7233-4339-bd74-520a6fb7962d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1315 microversion: 2.1 time: 0.881052 Sep 08 12:55:07.703418 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1543/2948] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:06 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1315 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:07.730808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a4b7cf4a-9cd2-4969-9002-8ddf417235b8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:07.743380 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a4b7cf4a-9cd2-4969-9002-8ddf417235b8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.704900 Sep 08 12:55:07.765406 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1406/2949] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:07 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:07.789882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fbf4e581-2117-4af8-9d5b-ca110eb97be7 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:07.791115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fbf4e581-2117-4af8-9d5b-ca110eb97be7 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: da5f8e14-96f2-45be-a26e-e5dc05ef7910] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:07.809284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf4e581-2117-4af8-9d5b-ca110eb97be7 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:07.812113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf4e581-2117-4af8-9d5b-ca110eb97be7 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:07.814342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf4e581-2117-4af8-9d5b-ca110eb97be7 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:07.815266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf4e581-2117-4af8-9d5b-ca110eb97be7 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:07.819046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf4e581-2117-4af8-9d5b-ca110eb97be7 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:07.819661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf4e581-2117-4af8-9d5b-ca110eb97be7 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:07.857395 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-fbf4e581-2117-4af8-9d5b-ca110eb97be7 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] HTTP exception thrown: Instance da5f8e14-96f2-45be-a26e-e5dc05ef7910 could not be found. Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fbf4e581-2117-4af8-9d5b-ca110eb97be7 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Request method failure captured: Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910 HTTP/1.1 Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVKvS-MuaBXAYO9hcdemg5kI_x1uS5rWz2oHDtQVovjNIZGtUCD6idseSQl5jylCXokVzaayaM1x6yr2i1v2Jls7CerFdgvraqiH5TbwyMyX3bqFtIDmsKyZ0sIcAUFBYGgJaLn7IH6x9lCmt1C-HRkfOvrXJoe6OgkQQqXpVlTa3Q Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 6c7023382ac747a2a84467a1b13b3bdb Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersAdminTestJSON-2046306070 Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c7023382ac747a2a84467a1b13b3bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c7023382ac747a2a84467a1b13b3bdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c7023382ac747a2a84467a1b13b3bdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c7023382ac747a2a84467a1b13b3bdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersAdminTestJSON-2046306070 Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 6c7023382ac747a2a84467a1b13b3bdb Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersAdminTestJSON-2046306070 Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersAdminTestJSON-2046306070-project Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1ef692f2f2ae4e8190248fc0c1f967ee Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersAdminTestJSON-2046306070-project Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance da5f8e14-96f2-45be-a26e-e5dc05ef7910 could not be found. Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'da5f8e14-96f2-45be-a26e-e5dc05ef7910'} Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da5f8e14-96f2-45be-a26e-e5dc05ef7910 could not be found. Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da5f8e14-96f2-45be-a26e-e5dc05ef7910 could not be found. Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:07.859574 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:07.863839 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:07.863839 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:07.863839 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:07.863839 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:55:07.863839 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:55:07.863839 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da5f8e14-96f2-45be-a26e-e5dc05ef7910 could not be found. Sep 08 12:55:07.863839 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:07.865870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fbf4e581-2117-4af8-9d5b-ca110eb97be7 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Returning 404 to user: Instance da5f8e14-96f2-45be-a26e-e5dc05ef7910 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:55:07.876465 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fbf4e581-2117-4af8-9d5b-ca110eb97be7 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910" status: 404 len: 111 microversion: 2.1 time: 0.110539 Sep 08 12:55:07.881463 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1407/2950] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:07 2022] GET /compute/v2.1/servers/da5f8e14-96f2-45be-a26e-e5dc05ef7910 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:55:07.887022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-04df27e0-714c-4364-ba3d-8546e130a64b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:07.888137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-04df27e0-714c-4364-ba3d-8546e130a64b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:07.904579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04df27e0-714c-4364-ba3d-8546e130a64b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:07.905620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04df27e0-714c-4364-ba3d-8546e130a64b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:07.906304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04df27e0-714c-4364-ba3d-8546e130a64b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:07.907360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04df27e0-714c-4364-ba3d-8546e130a64b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:07.907970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04df27e0-714c-4364-ba3d-8546e130a64b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:07.908480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04df27e0-714c-4364-ba3d-8546e130a64b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:07.968846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:08.032805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8e0f2d7-a534-491b-a842-60996f0b62ea tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Action: 'create', calling method: .version_select at 0x7fdb36be8e50>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1995607091", "policies": ["affinity"]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:08.081574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b8e0f2d7-a534-491b-a842-60996f0b62ea tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:08.095886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b8e0f2d7-a534-491b-a842-60996f0b62ea tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:08.199396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:08.252635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:08.303587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b8e0f2d7-a534-491b-a842-60996f0b62ea tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:08.337373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b8e0f2d7-a534-491b-a842-60996f0b62ea tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:08.399067 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8e0f2d7-a534-491b-a842-60996f0b62ea tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.693792 Sep 08 12:55:08.400224 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1544/2951] 10.222.0.78 () {60 vars in 1174 bytes} [Thu Sep 8 12:55:07 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:08.420208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6444856a-65e2-4773-8387-d06f498aa2af tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:08.421145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6444856a-65e2-4773-8387-d06f498aa2af tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:08.458592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6444856a-65e2-4773-8387-d06f498aa2af tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:08.459550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6444856a-65e2-4773-8387-d06f498aa2af tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:08.460384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6444856a-65e2-4773-8387-d06f498aa2af tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:08.461751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6444856a-65e2-4773-8387-d06f498aa2af tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:08.462625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6444856a-65e2-4773-8387-d06f498aa2af tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:08.475553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6444856a-65e2-4773-8387-d06f498aa2af tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:08.581701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6444856a-65e2-4773-8387-d06f498aa2af tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:55:08.706478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:08.717194 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6444856a-65e2-4773-8387-d06f498aa2af tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 204 len: 0 microversion: 2.1 time: 0.312478 Sep 08 12:55:08.718760 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1545/2952] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:55:08 2022] DELETE /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:55:08.727510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b0a016e6-e827-42c5-ae0e-6a32bb2c93c2 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:08.728861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b0a016e6-e827-42c5-ae0e-6a32bb2c93c2 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:08.740339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0a016e6-e827-42c5-ae0e-6a32bb2c93c2 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:08.741232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0a016e6-e827-42c5-ae0e-6a32bb2c93c2 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:08.742053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0a016e6-e827-42c5-ae0e-6a32bb2c93c2 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:08.743818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0a016e6-e827-42c5-ae0e-6a32bb2c93c2 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:08.744981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0a016e6-e827-42c5-ae0e-6a32bb2c93c2 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:08.745689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0a016e6-e827-42c5-ae0e-6a32bb2c93c2 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:08.881932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-04df27e0-714c-4364-ba3d-8546e130a64b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:08.912317 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-04df27e0-714c-4364-ba3d-8546e130a64b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.028912 Sep 08 12:55:08.927915 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1408/2953] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:07 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:08.946498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8157e667-a452-41d3-946f-e3308ebccaca tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Action: 'create', calling method: .version_select at 0x7fdb3a0809d0>, body: {"server_group": {"name": "tempest-server-group-2038288478", "policies": ["affinity"]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:09.049849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-8157e667-a452-41d3-946f-e3308ebccaca tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:09.070869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-8157e667-a452-41d3-946f-e3308ebccaca tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:09.180910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-8157e667-a452-41d3-946f-e3308ebccaca tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:09.196697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-8157e667-a452-41d3-946f-e3308ebccaca tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:09.239434 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8157e667-a452-41d3-946f-e3308ebccaca tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.305315 Sep 08 12:55:09.243218 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1409/2954] 10.222.0.78 () {60 vars in 1173 bytes} [Thu Sep 8 12:55:08 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:09.253956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a7a9eef1-6498-4c5b-9b23-f6222f3d542b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:09.256162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a7a9eef1-6498-4c5b-9b23-f6222f3d542b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:09.278224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7a9eef1-6498-4c5b-9b23-f6222f3d542b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:09.280419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7a9eef1-6498-4c5b-9b23-f6222f3d542b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:09.281947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7a9eef1-6498-4c5b-9b23-f6222f3d542b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:09.284106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7a9eef1-6498-4c5b-9b23-f6222f3d542b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:09.300002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7a9eef1-6498-4c5b-9b23-f6222f3d542b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:09.300968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0a016e6-e827-42c5-ae0e-6a32bb2c93c2 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:09.302076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7a9eef1-6498-4c5b-9b23-f6222f3d542b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:09.314343 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b0a016e6-e827-42c5-ae0e-6a32bb2c93c2 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1320 microversion: 2.1 time: 0.592461 Sep 08 12:55:09.315817 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1546/2955] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:08 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1320 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:09.337005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-838b35a6-b931-43ad-9dfe-703915884de5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:09.342635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-838b35a6-b931-43ad-9dfe-703915884de5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:09.357148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-838b35a6-b931-43ad-9dfe-703915884de5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:09.366304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-838b35a6-b931-43ad-9dfe-703915884de5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:09.366883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-838b35a6-b931-43ad-9dfe-703915884de5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:09.367892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-838b35a6-b931-43ad-9dfe-703915884de5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:09.368417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-838b35a6-b931-43ad-9dfe-703915884de5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:09.368829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-838b35a6-b931-43ad-9dfe-703915884de5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:10.118834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a7a9eef1-6498-4c5b-9b23-f6222f3d542b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:10.144486 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a7a9eef1-6498-4c5b-9b23-f6222f3d542b tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1468 microversion: 2.1 time: 0.896636 Sep 08 12:55:10.146533 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1410/2956] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:09 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1468 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:10.165236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5919b172-f5bc-4749-a072-2577f3879596 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:10.165878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5919b172-f5bc-4749-a072-2577f3879596 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:10.183017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5919b172-f5bc-4749-a072-2577f3879596 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:10.184017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5919b172-f5bc-4749-a072-2577f3879596 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:10.184768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5919b172-f5bc-4749-a072-2577f3879596 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:10.185942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5919b172-f5bc-4749-a072-2577f3879596 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:10.187363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5919b172-f5bc-4749-a072-2577f3879596 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:10.188138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5919b172-f5bc-4749-a072-2577f3879596 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:10.310652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-838b35a6-b931-43ad-9dfe-703915884de5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:10.344145 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-838b35a6-b931-43ad-9dfe-703915884de5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1315 microversion: 2.1 time: 1.025125 Sep 08 12:55:10.346131 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1547/2957] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:09 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1315 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:10.355968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-85f3538b-8a80-4131-a4ac-acd348e2c1c2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Action: 'create', calling method: .version_select at 0x7fdb36b4eee0>, body: {"server_group": {"name": "tempest-server-group-2038288478", "policies": ["affinity"]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:10.434544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-85f3538b-8a80-4131-a4ac-acd348e2c1c2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:10.449253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-85f3538b-8a80-4131-a4ac-acd348e2c1c2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:10.549372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-85f3538b-8a80-4131-a4ac-acd348e2c1c2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:10.560025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-85f3538b-8a80-4131-a4ac-acd348e2c1c2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:10.581325 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-85f3538b-8a80-4131-a4ac-acd348e2c1c2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.233288 Sep 08 12:55:10.585061 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1548/2958] 10.222.0.78 () {60 vars in 1173 bytes} [Thu Sep 8 12:55:10 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:10.597277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-69402b23-ea2a-4aa3-b8cc-e6cfa8663ab8 req-8148961b-071f-4cb6-bf43-b98041d36b60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d4fc907-3c1f-461d-9346-9efed53d8190", "tag": "82fb07ba-b1e2-44d0-a550-ed2f7f408476"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:10.609956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-69402b23-ea2a-4aa3-b8cc-e6cfa8663ab8 req-8148961b-071f-4cb6-bf43-b98041d36b60 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:10.610842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-69402b23-ea2a-4aa3-b8cc-e6cfa8663ab8 req-8148961b-071f-4cb6-bf43-b98041d36b60 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:10.611755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-69402b23-ea2a-4aa3-b8cc-e6cfa8663ab8 req-8148961b-071f-4cb6-bf43-b98041d36b60 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:10.626909 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-69402b23-ea2a-4aa3-b8cc-e6cfa8663ab8 req-8148961b-071f-4cb6-bf43-b98041d36b60 service nova] Creating event network-changed:82fb07ba-b1e2-44d0-a550-ed2f7f408476 for instance 5d4fc907-3c1f-461d-9346-9efed53d8190 on n-h1-852084-10 Sep 08 12:55:10.633655 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-69402b23-ea2a-4aa3-b8cc-e6cfa8663ab8 req-8148961b-071f-4cb6-bf43-b98041d36b60 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040412 Sep 08 12:55:10.635116 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1549/2959] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:10.640790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-34873272-937e-454a-b845-929a5c52d4f5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:10.642011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-34873272-937e-454a-b845-929a5c52d4f5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:10.655987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34873272-937e-454a-b845-929a5c52d4f5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:10.656602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34873272-937e-454a-b845-929a5c52d4f5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:10.657273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34873272-937e-454a-b845-929a5c52d4f5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:10.660837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34873272-937e-454a-b845-929a5c52d4f5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:10.662360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34873272-937e-454a-b845-929a5c52d4f5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:10.663093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34873272-937e-454a-b845-929a5c52d4f5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:10.717723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5919b172-f5bc-4749-a072-2577f3879596 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:10.747098 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5919b172-f5bc-4749-a072-2577f3879596 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.597817 Sep 08 12:55:10.754227 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1411/2960] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:10 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:10.765739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38aaa58b-be1d-4dc7-a163-b8daccb1ffa2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:10.835769 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38aaa58b-be1d-4dc7-a163-b8daccb1ffa2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/35046623-11b2-4915-9ea8-68011b95e478" status: 204 len: 0 microversion: 2.1 time: 0.073145 Sep 08 12:55:10.838316 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1412/2961] 10.222.0.78 () {58 vars in 1266 bytes} [Thu Sep 8 12:55:10 2022] DELETE /compute/v2.1/os-server-groups/35046623-11b2-4915-9ea8-68011b95e478 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:55:10.850676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cdd5c155-f985-43dc-b4b7-e161ecfbf9b9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:10.854963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cdd5c155-f985-43dc-b4b7-e161ecfbf9b9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:10.869408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdd5c155-f985-43dc-b4b7-e161ecfbf9b9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:10.869408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdd5c155-f985-43dc-b4b7-e161ecfbf9b9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:10.869973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdd5c155-f985-43dc-b4b7-e161ecfbf9b9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:10.873989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdd5c155-f985-43dc-b4b7-e161ecfbf9b9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:10.873989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdd5c155-f985-43dc-b4b7-e161ecfbf9b9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:10.874429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdd5c155-f985-43dc-b4b7-e161ecfbf9b9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:11.067704 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cdd5c155-f985-43dc-b4b7-e161ecfbf9b9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.227067 Sep 08 12:55:11.088407 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1413/2962] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:55:10 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:55:11.108198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dfc1b3ce-ab6f-47c8-8a37-a9d9973ed99c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:11.183507 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dfc1b3ce-ab6f-47c8-8a37-a9d9973ed99c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 335 microversion: 2.1 time: 0.092244 Sep 08 12:55:11.191023 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1414/2963] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:55:11 2022] GET /compute/v2.1/os-server-groups => generated 335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:11.213323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-401f5c6f-0881-4721-b9e8-4ef56da143ff tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:11.221238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-401f5c6f-0881-4721-b9e8-4ef56da143ff tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:11.247627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-401f5c6f-0881-4721-b9e8-4ef56da143ff tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:11.248507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-401f5c6f-0881-4721-b9e8-4ef56da143ff tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:11.262213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-401f5c6f-0881-4721-b9e8-4ef56da143ff tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:11.264084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-401f5c6f-0881-4721-b9e8-4ef56da143ff tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:11.265181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-401f5c6f-0881-4721-b9e8-4ef56da143ff tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:11.266428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-401f5c6f-0881-4721-b9e8-4ef56da143ff tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:11.889116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-34873272-937e-454a-b845-929a5c52d4f5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:11.908490 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-34873272-937e-454a-b845-929a5c52d4f5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1320 microversion: 2.1 time: 1.271955 Sep 08 12:55:11.926748 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1550/2964] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:10 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1320 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:11.938190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-251e9597-b04a-4e84-a180-1f3660bf7d88 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:11.939204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-251e9597-b04a-4e84-a180-1f3660bf7d88 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:11.958797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-251e9597-b04a-4e84-a180-1f3660bf7d88 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:11.959714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-251e9597-b04a-4e84-a180-1f3660bf7d88 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:11.960342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-251e9597-b04a-4e84-a180-1f3660bf7d88 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:11.961303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-251e9597-b04a-4e84-a180-1f3660bf7d88 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:11.961959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-251e9597-b04a-4e84-a180-1f3660bf7d88 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:11.962572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-251e9597-b04a-4e84-a180-1f3660bf7d88 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:12.651742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-401f5c6f-0881-4721-b9e8-4ef56da143ff tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:12.680469 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-401f5c6f-0881-4721-b9e8-4ef56da143ff tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1672 microversion: 2.1 time: 1.487905 Sep 08 12:55:12.681096 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1415/2965] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:11 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1672 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:12.689086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-74fab4a5-63ad-4d19-ac3c-3d9898df6b69 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:12.758292 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-74fab4a5-63ad-4d19-ac3c-3d9898df6b69 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/5634e427-3ab5-449f-80c3-738256638aab" status: 204 len: 0 microversion: 2.1 time: 0.075919 Sep 08 12:55:12.762411 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1416/2966] 10.222.0.78 () {58 vars in 1266 bytes} [Thu Sep 8 12:55:12 2022] DELETE /compute/v2.1/os-server-groups/5634e427-3ab5-449f-80c3-738256638aab => generated 0 bytes in 78 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:55:12.768883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-837e3b00-4c9b-42a5-94a7-a51e249dec60 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:12.769888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-837e3b00-4c9b-42a5-94a7-a51e249dec60 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:12.780487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-837e3b00-4c9b-42a5-94a7-a51e249dec60 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:12.781412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-837e3b00-4c9b-42a5-94a7-a51e249dec60 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:12.783519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-837e3b00-4c9b-42a5-94a7-a51e249dec60 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:12.784665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-837e3b00-4c9b-42a5-94a7-a51e249dec60 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:12.785600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-837e3b00-4c9b-42a5-94a7-a51e249dec60 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:12.787484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-837e3b00-4c9b-42a5-94a7-a51e249dec60 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:13.111289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-251e9597-b04a-4e84-a180-1f3660bf7d88 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:13.126713 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-251e9597-b04a-4e84-a180-1f3660bf7d88 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1468 microversion: 2.1 time: 1.198501 Sep 08 12:55:13.130674 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1551/2967] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:11 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1468 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:13.142842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-34256b26-8ef8-412f-b1ed-a52db2da884e req-6dd74af5-35f1-4232-a311-383ecbf68440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aad991b2-93e9-4eac-ab38-e5d5ee91f569", "tag": "19b453c9-4a90-4750-9a45-d3bde1b6957d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:13.178527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-34256b26-8ef8-412f-b1ed-a52db2da884e req-6dd74af5-35f1-4232-a311-383ecbf68440 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:13.179543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-34256b26-8ef8-412f-b1ed-a52db2da884e req-6dd74af5-35f1-4232-a311-383ecbf68440 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:13.180426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-34256b26-8ef8-412f-b1ed-a52db2da884e req-6dd74af5-35f1-4232-a311-383ecbf68440 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:13.228857 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-34256b26-8ef8-412f-b1ed-a52db2da884e req-6dd74af5-35f1-4232-a311-383ecbf68440 service nova] Creating event network-changed:19b453c9-4a90-4750-9a45-d3bde1b6957d for instance aad991b2-93e9-4eac-ab38-e5d5ee91f569 on n-h1-852084-10 Sep 08 12:55:13.238499 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-34256b26-8ef8-412f-b1ed-a52db2da884e req-6dd74af5-35f1-4232-a311-383ecbf68440 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105873 Sep 08 12:55:13.240741 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1552/2968] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:13.265319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f2697fb0-2dd7-4eec-a176-27bdc17975b5 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:13.316315 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f2697fb0-2dd7-4eec-a176-27bdc17975b5 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.073489 Sep 08 12:55:13.321456 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1553/2969] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:55:13 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:13.334575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5a6ea7aa-4e1f-48e9-876a-418bbf860ddd tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:13.336066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5a6ea7aa-4e1f-48e9-876a-418bbf860ddd tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:13.350406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a6ea7aa-4e1f-48e9-876a-418bbf860ddd tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:13.351411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a6ea7aa-4e1f-48e9-876a-418bbf860ddd tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:13.352117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a6ea7aa-4e1f-48e9-876a-418bbf860ddd tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:13.353366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a6ea7aa-4e1f-48e9-876a-418bbf860ddd tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:13.354154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a6ea7aa-4e1f-48e9-876a-418bbf860ddd tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:13.355439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a6ea7aa-4e1f-48e9-876a-418bbf860ddd tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:13.448307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-837e3b00-4c9b-42a5-94a7-a51e249dec60 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:13.466081 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-837e3b00-4c9b-42a5-94a7-a51e249dec60 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1315 microversion: 2.1 time: 0.701909 Sep 08 12:55:13.479270 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1417/2970] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:12 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1315 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:13.479270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-58d51c82-d9fd-4784-9753-5fc380e62e14 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Action: 'create', calling method: .version_select at 0x7fdb3a04ddc0>, body: {"server_group": {"name": "tempest-server-group-1056867975", "policies": ["affinity"]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:13.528020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-58d51c82-d9fd-4784-9753-5fc380e62e14 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:13.534660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-58d51c82-d9fd-4784-9753-5fc380e62e14 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:13.540078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:13.608066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-58d51c82-d9fd-4784-9753-5fc380e62e14 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:13.616390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-58d51c82-d9fd-4784-9753-5fc380e62e14 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:13.637538 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-58d51c82-d9fd-4784-9753-5fc380e62e14 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.169350 Sep 08 12:55:13.638938 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1418/2971] 10.222.0.78 () {60 vars in 1173 bytes} [Thu Sep 8 12:55:13 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:13.650593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc8cd6de-a5e9-4798-a9e5-ef6aeef5d925 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:13.719046 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cc8cd6de-a5e9-4798-a9e5-ef6aeef5d925 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/5ca7deb0-626a-4fe2-ae13-0f74d5e5eb28" status: 204 len: 0 microversion: 2.1 time: 0.073355 Sep 08 12:55:13.720462 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1419/2972] 10.222.0.78 () {58 vars in 1266 bytes} [Thu Sep 8 12:55:13 2022] DELETE /compute/v2.1/os-server-groups/5ca7deb0-626a-4fe2-ae13-0f74d5e5eb28 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 12:55:13.733700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0454de1c-f0e4-4f06-a837-3b5f04052efe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:13.737545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0454de1c-f0e4-4f06-a837-3b5f04052efe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:13.763759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0454de1c-f0e4-4f06-a837-3b5f04052efe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:13.769858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0454de1c-f0e4-4f06-a837-3b5f04052efe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:13.777678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0454de1c-f0e4-4f06-a837-3b5f04052efe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:13.781470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0454de1c-f0e4-4f06-a837-3b5f04052efe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:13.782700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0454de1c-f0e4-4f06-a837-3b5f04052efe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:13.783884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0454de1c-f0e4-4f06-a837-3b5f04052efe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:14.144527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5a6ea7aa-4e1f-48e9-876a-418bbf860ddd tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:14.158622 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5a6ea7aa-4e1f-48e9-876a-418bbf860ddd tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1320 microversion: 2.1 time: 0.834264 Sep 08 12:55:14.160331 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1554/2973] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:13 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1320 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:14.167694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fef9ebe5-bf31-4c20-9704-f322542d45fc tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:14.182458 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fef9ebe5-bf31-4c20-9704-f322542d45fc tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.019475 Sep 08 12:55:14.184774 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1555/2974] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:55:14 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:14.190829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d518aca3-b114-4fc7-9cea-149079cb6b7d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:14.192860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d518aca3-b114-4fc7-9cea-149079cb6b7d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:14.211794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d518aca3-b114-4fc7-9cea-149079cb6b7d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:14.215664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d518aca3-b114-4fc7-9cea-149079cb6b7d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:14.219841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d518aca3-b114-4fc7-9cea-149079cb6b7d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:14.221970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d518aca3-b114-4fc7-9cea-149079cb6b7d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:14.224218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d518aca3-b114-4fc7-9cea-149079cb6b7d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:14.227435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d518aca3-b114-4fc7-9cea-149079cb6b7d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:14.527751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d518aca3-b114-4fc7-9cea-149079cb6b7d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:14.552138 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d518aca3-b114-4fc7-9cea-149079cb6b7d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1426 microversion: 2.1 time: 0.364951 Sep 08 12:55:14.554115 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1556/2975] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:14 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1426 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:14.569807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e875bf9-93c1-4a77-857c-7bfaddc87714 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Action: 'create', calling method: .version_select at 0x7fdb36dec4c0>, body: {"server_group": {"name": "tempest-server-group-879865313", "policies": ["anti-affinity"]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:14.606197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-7e875bf9-93c1-4a77-857c-7bfaddc87714 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:14.627505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-7e875bf9-93c1-4a77-857c-7bfaddc87714 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:14.752343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-7e875bf9-93c1-4a77-857c-7bfaddc87714 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:14.775880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-7e875bf9-93c1-4a77-857c-7bfaddc87714 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_groups'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:14.781485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0454de1c-f0e4-4f06-a837-3b5f04052efe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:14.801477 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0454de1c-f0e4-4f06-a837-3b5f04052efe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1672 microversion: 2.1 time: 1.079281 Sep 08 12:55:14.816034 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1420/2976] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:13 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1672 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:14.832915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a708cf3a-cc0c-4e6b-b6a2-860a2957aa03 req-634f9d0d-9d71-48e9-bf02-82733f2636a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3250685a-8562-4deb-a070-5ef61a7adece", "name": "network-vif-deleted", "tag": "abdffb77-d374-428a-a4ad-7dbf4411576c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:14.852933 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e875bf9-93c1-4a77-857c-7bfaddc87714 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 168 microversion: 2.1 time: 0.296242 Sep 08 12:55:14.854121 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1557/2977] 10.222.0.78 () {60 vars in 1173 bytes} [Thu Sep 8 12:55:14 2022] POST /compute/v2.1/os-server-groups => generated 168 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:14.882198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b56344b1-3882-43d1-95e9-9ce0668edb4a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:14.884228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a708cf3a-cc0c-4e6b-b6a2-860a2957aa03 req-634f9d0d-9d71-48e9-bf02-82733f2636a4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:14.884836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a708cf3a-cc0c-4e6b-b6a2-860a2957aa03 req-634f9d0d-9d71-48e9-bf02-82733f2636a4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:14.885979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a708cf3a-cc0c-4e6b-b6a2-860a2957aa03 req-634f9d0d-9d71-48e9-bf02-82733f2636a4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:14.886497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b56344b1-3882-43d1-95e9-9ce0668edb4a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:14.914516 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a708cf3a-cc0c-4e6b-b6a2-860a2957aa03 req-634f9d0d-9d71-48e9-bf02-82733f2636a4 service nova] Creating event network-vif-deleted:abdffb77-d374-428a-a4ad-7dbf4411576c for instance 3250685a-8562-4deb-a070-5ef61a7adece on n-h2-852084-10 Sep 08 12:55:14.925867 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a708cf3a-cc0c-4e6b-b6a2-860a2957aa03 req-634f9d0d-9d71-48e9-bf02-82733f2636a4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107481 Sep 08 12:55:14.927507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b56344b1-3882-43d1-95e9-9ce0668edb4a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:14.928416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b56344b1-3882-43d1-95e9-9ce0668edb4a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:14.929227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b56344b1-3882-43d1-95e9-9ce0668edb4a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:14.930546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b56344b1-3882-43d1-95e9-9ce0668edb4a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:14.931433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b56344b1-3882-43d1-95e9-9ce0668edb4a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:14.932259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b56344b1-3882-43d1-95e9-9ce0668edb4a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:14.934649 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1421/2978] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:14.946219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-16b59606-a4fe-4769-9c69-c585e3b0022f tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:14.998177 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-16b59606-a4fe-4769-9c69-c585e3b0022f tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/d0f136b9-ea71-4c00-bbf4-ed439156313d" status: 204 len: 0 microversion: 2.1 time: 0.060040 Sep 08 12:55:15.003142 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1422/2979] 10.222.0.78 () {58 vars in 1266 bytes} [Thu Sep 8 12:55:14 2022] DELETE /compute/v2.1/os-server-groups/d0f136b9-ea71-4c00-bbf4-ed439156313d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:55:15.018114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b690dbb6-e548-422d-9dfa-b36f094f3358 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:15.054857 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b690dbb6-e548-422d-9dfa-b36f094f3358 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.049344 Sep 08 12:55:15.055573 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1423/2980] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:55:15 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:15.200585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a1eb2c75-5d85-4c42-b8d3-5975ae96f899 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:15.202551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a1eb2c75-5d85-4c42-b8d3-5975ae96f899 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:15.216906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1eb2c75-5d85-4c42-b8d3-5975ae96f899 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:15.218469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1eb2c75-5d85-4c42-b8d3-5975ae96f899 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:15.224106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1eb2c75-5d85-4c42-b8d3-5975ae96f899 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:15.228970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1eb2c75-5d85-4c42-b8d3-5975ae96f899 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:15.233125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1eb2c75-5d85-4c42-b8d3-5975ae96f899 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:15.234365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1eb2c75-5d85-4c42-b8d3-5975ae96f899 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:15.343399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b56344b1-3882-43d1-95e9-9ce0668edb4a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:15.360594 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b56344b1-3882-43d1-95e9-9ce0668edb4a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1315 microversion: 2.1 time: 0.503428 Sep 08 12:55:15.361680 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1558/2981] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:14 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:15.367983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1612490194", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "105b9bdb-148f-4b61-98a9-48e1ad09d007"}]}, "os:scheduler_hints": {"group": "ef07e6b3-df91-4e2d-af0b-abb8af8e369a"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:15.492673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] validate_networks() for [('105b9bdb-148f-4b61-98a9-48e1ad09d007', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:55:15.619490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a1eb2c75-5d85-4c42-b8d3-5975ae96f899 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:15.677987 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a1eb2c75-5d85-4c42-b8d3-5975ae96f899 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1320 microversion: 2.1 time: 0.479501 Sep 08 12:55:15.682579 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1424/2982] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:15 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1320 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:55:15.703874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:15.705313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:15.737411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:15.742295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:15.743730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:15.745273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:15.749704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:15.753741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:15.867810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:15.868489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:15.869288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:15.870238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lazy-loading 'fault' on Instance uuid 3250685a-8562-4deb-a070-5ef61a7adece {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:55:15.982471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ef692f2f2ae4e8190248fc0c1f967ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7023382ac747a2a84467a1b13b3bdb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:15.995021 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-70e58e8b-50a7-4c2b-ab93-d0a501c5b8a9 tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 200 len: 1303 microversion: 2.1 time: 0.310386 Sep 08 12:55:16.012211 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1425/2983] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:15 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 1303 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:16.012211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ac883e59-65f1-47be-a1b5-14fe1641b743 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:16.012211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ac883e59-65f1-47be-a1b5-14fe1641b743 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:16.013879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac883e59-65f1-47be-a1b5-14fe1641b743 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:16.014927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac883e59-65f1-47be-a1b5-14fe1641b743 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:16.015253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac883e59-65f1-47be-a1b5-14fe1641b743 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:16.016652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac883e59-65f1-47be-a1b5-14fe1641b743 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:16.017362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac883e59-65f1-47be-a1b5-14fe1641b743 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:16.017597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac883e59-65f1-47be-a1b5-14fe1641b743 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:16.260747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ac883e59-65f1-47be-a1b5-14fe1641b743 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:16.269602 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ac883e59-65f1-47be-a1b5-14fe1641b743 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.272599 Sep 08 12:55:16.283284 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1426/2984] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:15 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:16.329521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7bb96c43-72ca-4fee-8158-7b1dccbe752f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:16.337449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7bb96c43-72ca-4fee-8158-7b1dccbe752f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:16.347807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bb96c43-72ca-4fee-8158-7b1dccbe752f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:16.349098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bb96c43-72ca-4fee-8158-7b1dccbe752f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:16.349639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bb96c43-72ca-4fee-8158-7b1dccbe752f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:16.350684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bb96c43-72ca-4fee-8158-7b1dccbe752f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:16.351090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bb96c43-72ca-4fee-8158-7b1dccbe752f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:16.351651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bb96c43-72ca-4fee-8158-7b1dccbe752f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:16.423804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:55:16.424898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:55:16.425544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:55:16.426147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:55:16.427334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:55:16.430068 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7bb96c43-72ca-4fee-8158-7b1dccbe752f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 200 len: 320 microversion: 2.1 time: 0.110366 Sep 08 12:55:16.435871 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1427/2985] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:55:16 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 320 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:16.442595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a9c60f9b-dbff-4268-b9a4-8ff03c8ca7f5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:16.461650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a9c60f9b-dbff-4268-b9a4-8ff03c8ca7f5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:16.475123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9c60f9b-dbff-4268-b9a4-8ff03c8ca7f5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:16.475608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9c60f9b-dbff-4268-b9a4-8ff03c8ca7f5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:16.476843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9c60f9b-dbff-4268-b9a4-8ff03c8ca7f5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:16.480892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9c60f9b-dbff-4268-b9a4-8ff03c8ca7f5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:16.482897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:16.483945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9c60f9b-dbff-4268-b9a4-8ff03c8ca7f5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:16.485774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9c60f9b-dbff-4268-b9a4-8ff03c8ca7f5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:16.485934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:16.488290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:16.491263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:16.492154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:16.492854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:16.526989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:16.543379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:16.582050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:55:16.590668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:55:16.691290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128970) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Sep 08 12:55:16.718536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:16.769828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_group_members'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:16.796432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_group_members'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:16.908967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_group_members'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:16.928468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Getting quotas for user 6efebdd08e4546079593c6a1cb852e96 and project 2a64b48a86d3445b8610aaa70845fc14. Resources: {'server_group_members'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:16.984556 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b7d3f803-dd48-40b2-881e-630d52b8988a tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.621371 Sep 08 12:55:16.992374 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1559/2986] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:55:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:55:16.997951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-456851d0-60fa-450a-b3ca-c464190d293c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:16.998814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-456851d0-60fa-450a-b3ca-c464190d293c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:17.012326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-456851d0-60fa-450a-b3ca-c464190d293c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:17.012847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-456851d0-60fa-450a-b3ca-c464190d293c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:17.016633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-456851d0-60fa-450a-b3ca-c464190d293c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:17.017608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-456851d0-60fa-450a-b3ca-c464190d293c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:17.018104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-456851d0-60fa-450a-b3ca-c464190d293c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:17.018568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-456851d0-60fa-450a-b3ca-c464190d293c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:17.063344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a9c60f9b-dbff-4268-b9a4-8ff03c8ca7f5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:17.083684 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a9c60f9b-dbff-4268-b9a4-8ff03c8ca7f5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1315 microversion: 2.1 time: 0.644846 Sep 08 12:55:17.084916 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1428/2987] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:16 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1315 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:17.394358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-456851d0-60fa-450a-b3ca-c464190d293c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:17.398037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:17.429480 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-456851d0-60fa-450a-b3ca-c464190d293c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.433915 Sep 08 12:55:17.430232 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1560/2988] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:16 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:17.463660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-16060563-4ce5-41e3-a0a9-479cd25a8f22 req-160821d0-6f8a-4b5d-b0e5-3c96e430db18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0429d874-2d6c-4e87-8985-019f7dd39997", "name": "network-vif-plugged", "status": "completed", "tag": "52260ece-2c3d-444c-a1e5-2dd56f0936d6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:17.493257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-16060563-4ce5-41e3-a0a9-479cd25a8f22 req-160821d0-6f8a-4b5d-b0e5-3c96e430db18 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:17.493753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-16060563-4ce5-41e3-a0a9-479cd25a8f22 req-160821d0-6f8a-4b5d-b0e5-3c96e430db18 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:17.495849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-16060563-4ce5-41e3-a0a9-479cd25a8f22 req-160821d0-6f8a-4b5d-b0e5-3c96e430db18 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:17.534889 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-16060563-4ce5-41e3-a0a9-479cd25a8f22 req-160821d0-6f8a-4b5d-b0e5-3c96e430db18 service nova] Creating event network-vif-plugged:52260ece-2c3d-444c-a1e5-2dd56f0936d6 for instance 0429d874-2d6c-4e87-8985-019f7dd39997 on n-h2-852084-10 Sep 08 12:55:17.547086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8bd6a268-9615-4ba6-9540-7edab2b45ef3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732-project-admin] Calling method '.version_select at 0x7fdb39fc41f0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:17.550901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd6a268-9615-4ba6-9540-7edab2b45ef3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:17.551846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd6a268-9615-4ba6-9540-7edab2b45ef3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:17.555049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd6a268-9615-4ba6-9540-7edab2b45ef3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:17.556064 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-16060563-4ce5-41e3-a0a9-479cd25a8f22 req-160821d0-6f8a-4b5d-b0e5-3c96e430db18 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108446 Sep 08 12:55:17.562552 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1561/2989] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:17.578427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4cb58981-4860-474d-989e-98b40aa59a70 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:17.580158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4cb58981-4860-474d-989e-98b40aa59a70 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:17.608291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cb58981-4860-474d-989e-98b40aa59a70 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:17.617203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd6a268-9615-4ba6-9540-7edab2b45ef3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:17.617833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cb58981-4860-474d-989e-98b40aa59a70 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:17.618310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd6a268-9615-4ba6-9540-7edab2b45ef3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:17.619031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd6a268-9615-4ba6-9540-7edab2b45ef3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:17.619271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cb58981-4860-474d-989e-98b40aa59a70 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:17.624010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cb58981-4860-474d-989e-98b40aa59a70 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:17.624547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cb58981-4860-474d-989e-98b40aa59a70 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:17.628938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cb58981-4860-474d-989e-98b40aa59a70 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:17.638165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd6a268-9615-4ba6-9540-7edab2b45ef3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:17.639186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd6a268-9615-4ba6-9540-7edab2b45ef3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:17.641118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bd6a268-9615-4ba6-9540-7edab2b45ef3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:17.661208 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8bd6a268-9615-4ba6-9540-7edab2b45ef3 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732 tempest-PortsAdminExtendedAttrsIpV6TestJSON-85332732-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.574703 Sep 08 12:55:17.662693 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1429/2990] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:55:17 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:17.700034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8a1173fc-3f56-4e50-9df3-1490fda05cce tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:17.701899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8a1173fc-3f56-4e50-9df3-1490fda05cce tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:18.189472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a1173fc-3f56-4e50-9df3-1490fda05cce tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:18.210921 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8a1173fc-3f56-4e50-9df3-1490fda05cce tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1213 microversion: 2.1 time: 0.544611 Sep 08 12:55:18.224059 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1430/2991] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:17 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1213 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:18.249348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-29620f2f-4acb-4489-8e41-eeb38d38454d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:18.249943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-29620f2f-4acb-4489-8e41-eeb38d38454d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] [instance: 3250685a-8562-4deb-a070-5ef61a7adece] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:18.265620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29620f2f-4acb-4489-8e41-eeb38d38454d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:18.276277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29620f2f-4acb-4489-8e41-eeb38d38454d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:18.277051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29620f2f-4acb-4489-8e41-eeb38d38454d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:18.278079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29620f2f-4acb-4489-8e41-eeb38d38454d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:18.278637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29620f2f-4acb-4489-8e41-eeb38d38454d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:18.279125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29620f2f-4acb-4489-8e41-eeb38d38454d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:18.854325 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-29620f2f-4acb-4489-8e41-eeb38d38454d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] HTTP exception thrown: Instance 3250685a-8562-4deb-a070-5ef61a7adece could not be found. Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-29620f2f-4acb-4489-8e41-eeb38d38454d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Request method failure captured: Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece HTTP/1.1 Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVKvS-MuaBXAYO9hcdemg5kI_x1uS5rWz2oHDtQVovjNIZGtUCD6idseSQl5jylCXokVzaayaM1x6yr2i1v2Jls7CerFdgvraqiH5TbwyMyX3bqFtIDmsKyZ0sIcAUFBYGgJaLn7IH6x9lCmt1C-HRkfOvrXJoe6OgkQQqXpVlTa3Q Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 6c7023382ac747a2a84467a1b13b3bdb Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersAdminTestJSON-2046306070 Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c7023382ac747a2a84467a1b13b3bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c7023382ac747a2a84467a1b13b3bdb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c7023382ac747a2a84467a1b13b3bdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c7023382ac747a2a84467a1b13b3bdb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersAdminTestJSON-2046306070 Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 6c7023382ac747a2a84467a1b13b3bdb Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersAdminTestJSON-2046306070 Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersAdminTestJSON-2046306070-project Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1ef692f2f2ae4e8190248fc0c1f967ee Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersAdminTestJSON-2046306070-project Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 3250685a-8562-4deb-a070-5ef61a7adece could not be found. Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '3250685a-8562-4deb-a070-5ef61a7adece'} Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3250685a-8562-4deb-a070-5ef61a7adece could not be found. Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3250685a-8562-4deb-a070-5ef61a7adece could not be found. Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:18.857007 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:18.861256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:18.861256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:18.861256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:18.861256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:55:18.861256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:55:18.861256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3250685a-8562-4deb-a070-5ef61a7adece could not be found. Sep 08 12:55:18.861256 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:18.865941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-29620f2f-4acb-4489-8e41-eeb38d38454d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] Returning 404 to user: Instance 3250685a-8562-4deb-a070-5ef61a7adece could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:55:18.867535 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-29620f2f-4acb-4489-8e41-eeb38d38454d tempest-ServersAdminTestJSON-2046306070 tempest-ServersAdminTestJSON-2046306070-project] 10.222.0.78 "GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece" status: 404 len: 111 microversion: 2.1 time: 0.641935 Sep 08 12:55:18.868847 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1431/2992] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:18 2022] GET /compute/v2.1/servers/3250685a-8562-4deb-a070-5ef61a7adece => generated 111 bytes in 644 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:55:18.880880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-417f78c4-f86c-4758-845f-390ef9a237b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:18.881763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-417f78c4-f86c-4758-845f-390ef9a237b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:18.897217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-417f78c4-f86c-4758-845f-390ef9a237b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:18.899763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-417f78c4-f86c-4758-845f-390ef9a237b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:18.905802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-417f78c4-f86c-4758-845f-390ef9a237b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:18.907296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-417f78c4-f86c-4758-845f-390ef9a237b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:18.908096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-417f78c4-f86c-4758-845f-390ef9a237b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:18.908807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-417f78c4-f86c-4758-845f-390ef9a237b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:18.946436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4cb58981-4860-474d-989e-98b40aa59a70 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:18.980365 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4cb58981-4860-474d-989e-98b40aa59a70 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1320 microversion: 2.1 time: 1.414190 Sep 08 12:55:18.997684 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1562/2993] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:17 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1320 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:19.057400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-29e4b52d-19ec-4286-8850-c58345dff570 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:19.060693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-29e4b52d-19ec-4286-8850-c58345dff570 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:19.090402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29e4b52d-19ec-4286-8850-c58345dff570 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:19.095785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29e4b52d-19ec-4286-8850-c58345dff570 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:19.096919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29e4b52d-19ec-4286-8850-c58345dff570 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:19.099035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29e4b52d-19ec-4286-8850-c58345dff570 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:19.103219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29e4b52d-19ec-4286-8850-c58345dff570 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:19.104396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29e4b52d-19ec-4286-8850-c58345dff570 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:20.464515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-417f78c4-f86c-4758-845f-390ef9a237b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:20.482069 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-417f78c4-f86c-4758-845f-390ef9a237b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.611626 Sep 08 12:55:20.489914 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1432/2994] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:18 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:20.515043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4929152d-4455-4f6b-8d34-e9a3a043e1eb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:20.518897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4929152d-4455-4f6b-8d34-e9a3a043e1eb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:20.536427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4929152d-4455-4f6b-8d34-e9a3a043e1eb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:20.539053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4929152d-4455-4f6b-8d34-e9a3a043e1eb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:20.542057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4929152d-4455-4f6b-8d34-e9a3a043e1eb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:20.547354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-29e4b52d-19ec-4286-8850-c58345dff570 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:20.557128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4929152d-4455-4f6b-8d34-e9a3a043e1eb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:20.559900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4929152d-4455-4f6b-8d34-e9a3a043e1eb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:20.563858 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-29e4b52d-19ec-4286-8850-c58345dff570 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1315 microversion: 2.1 time: 1.549315 Sep 08 12:55:20.565065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4929152d-4455-4f6b-8d34-e9a3a043e1eb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:20.568187 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1563/2995] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:19 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1315 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:20.579824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-174513d0-b1e3-4a0a-bedc-a0a219e5daff tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:20.584012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-174513d0-b1e3-4a0a-bedc-a0a219e5daff tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:20.616315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-174513d0-b1e3-4a0a-bedc-a0a219e5daff tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:20.618617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-174513d0-b1e3-4a0a-bedc-a0a219e5daff tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:20.622176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-174513d0-b1e3-4a0a-bedc-a0a219e5daff tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:20.626065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-174513d0-b1e3-4a0a-bedc-a0a219e5daff tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:20.627316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-174513d0-b1e3-4a0a-bedc-a0a219e5daff tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:20.628114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-174513d0-b1e3-4a0a-bedc-a0a219e5daff tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:21.382102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4929152d-4455-4f6b-8d34-e9a3a043e1eb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:21.406064 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4929152d-4455-4f6b-8d34-e9a3a043e1eb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1265 microversion: 2.1 time: 0.908923 Sep 08 12:55:21.427129 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1433/2996] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:20 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1265 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:21.427512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-d219b1d1-4561-4499-ad1c-577eae5518e8 req-083ba6f4-14e6-4650-a14a-2eeefdb264f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86ab042-dd54-494c-b637-c3fab97d2558", "name": "network-vif-plugged", "status": "completed", "tag": "e849c7d8-4d1d-46d1-a095-5ff08f26ccab"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:21.459566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d219b1d1-4561-4499-ad1c-577eae5518e8 req-083ba6f4-14e6-4650-a14a-2eeefdb264f2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:21.461964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d219b1d1-4561-4499-ad1c-577eae5518e8 req-083ba6f4-14e6-4650-a14a-2eeefdb264f2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:21.462792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d219b1d1-4561-4499-ad1c-577eae5518e8 req-083ba6f4-14e6-4650-a14a-2eeefdb264f2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:21.514636 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d219b1d1-4561-4499-ad1c-577eae5518e8 req-083ba6f4-14e6-4650-a14a-2eeefdb264f2 service nova] Creating event network-vif-plugged:e849c7d8-4d1d-46d1-a095-5ff08f26ccab for instance d86ab042-dd54-494c-b637-c3fab97d2558 on n-h2-852084-10 Sep 08 12:55:21.544129 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-d219b1d1-4561-4499-ad1c-577eae5518e8 req-083ba6f4-14e6-4650-a14a-2eeefdb264f2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127295 Sep 08 12:55:21.544952 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1434/2997] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:21.566947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-022e29d5-eedd-49c9-a901-6bc586583897 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:21.573715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-022e29d5-eedd-49c9-a901-6bc586583897 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:21.604871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-022e29d5-eedd-49c9-a901-6bc586583897 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:21.606476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-022e29d5-eedd-49c9-a901-6bc586583897 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:21.606926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-022e29d5-eedd-49c9-a901-6bc586583897 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:21.611182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-022e29d5-eedd-49c9-a901-6bc586583897 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:21.611855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-022e29d5-eedd-49c9-a901-6bc586583897 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:21.612302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-022e29d5-eedd-49c9-a901-6bc586583897 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:21.643079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:21.885237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-174513d0-b1e3-4a0a-bedc-a0a219e5daff tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:21.919478 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-174513d0-b1e3-4a0a-bedc-a0a219e5daff tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1320 microversion: 2.1 time: 1.349142 Sep 08 12:55:21.920183 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1564/2998] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:20 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1320 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:21.930299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-647f07ac-5b79-4318-a116-a08436f3417f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:21.931046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-647f07ac-5b79-4318-a116-a08436f3417f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:21.955665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-647f07ac-5b79-4318-a116-a08436f3417f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:21.956246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-647f07ac-5b79-4318-a116-a08436f3417f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:21.956695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-647f07ac-5b79-4318-a116-a08436f3417f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:21.962292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-647f07ac-5b79-4318-a116-a08436f3417f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:21.963359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-647f07ac-5b79-4318-a116-a08436f3417f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:21.963872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-647f07ac-5b79-4318-a116-a08436f3417f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:22.553674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-647f07ac-5b79-4318-a116-a08436f3417f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:22.569710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-022e29d5-eedd-49c9-a901-6bc586583897 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:22.586279 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-022e29d5-eedd-49c9-a901-6bc586583897 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.031735 Sep 08 12:55:22.588199 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1435/2999] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:21 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:22.592958 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-647f07ac-5b79-4318-a116-a08436f3417f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1315 microversion: 2.1 time: 0.671171 Sep 08 12:55:22.598520 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1565/3000] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:21 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1315 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:22.603029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0140a245-e90e-4236-a836-c05128891ff2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:22.604550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0140a245-e90e-4236-a836-c05128891ff2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:22.619559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0140a245-e90e-4236-a836-c05128891ff2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:22.620501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0140a245-e90e-4236-a836-c05128891ff2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:22.621179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0140a245-e90e-4236-a836-c05128891ff2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:22.622822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0140a245-e90e-4236-a836-c05128891ff2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:22.623738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0140a245-e90e-4236-a836-c05128891ff2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:22.624449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0140a245-e90e-4236-a836-c05128891ff2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:22.636602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4095e759-d34a-49b2-8d0c-ac56dfc9bfe6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:22.637597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4095e759-d34a-49b2-8d0c-ac56dfc9bfe6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:22.648328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4095e759-d34a-49b2-8d0c-ac56dfc9bfe6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:22.651454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4095e759-d34a-49b2-8d0c-ac56dfc9bfe6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:22.655454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4095e759-d34a-49b2-8d0c-ac56dfc9bfe6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:22.656673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4095e759-d34a-49b2-8d0c-ac56dfc9bfe6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:22.657382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4095e759-d34a-49b2-8d0c-ac56dfc9bfe6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:22.658058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4095e759-d34a-49b2-8d0c-ac56dfc9bfe6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:22.890639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0140a245-e90e-4236-a836-c05128891ff2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:22.954987 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0140a245-e90e-4236-a836-c05128891ff2 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1271 microversion: 2.1 time: 0.362550 Sep 08 12:55:22.956893 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1436/3001] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:22 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1271 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:22.996374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e3863a7-dfb4-4939-ad31-44530e4fba9a tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:22.998572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8e3863a7-dfb4-4939-ad31-44530e4fba9a tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:23.041820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e3863a7-dfb4-4939-ad31-44530e4fba9a tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:23.044572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e3863a7-dfb4-4939-ad31-44530e4fba9a tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:23.046300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e3863a7-dfb4-4939-ad31-44530e4fba9a tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:23.048075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e3863a7-dfb4-4939-ad31-44530e4fba9a tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:23.049517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e3863a7-dfb4-4939-ad31-44530e4fba9a tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:23.052179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e3863a7-dfb4-4939-ad31-44530e4fba9a tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:23.185074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4095e759-d34a-49b2-8d0c-ac56dfc9bfe6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:23.232268 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4095e759-d34a-49b2-8d0c-ac56dfc9bfe6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.599764 Sep 08 12:55:23.233287 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1566/3002] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:22 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:55:23.629163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-30edc8b7-9567-454c-b441-3ee1b548e86c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:23.631672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-30edc8b7-9567-454c-b441-3ee1b548e86c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:23.660596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-30edc8b7-9567-454c-b441-3ee1b548e86c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:23.661855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-30edc8b7-9567-454c-b441-3ee1b548e86c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:23.662917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-30edc8b7-9567-454c-b441-3ee1b548e86c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:23.664700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-30edc8b7-9567-454c-b441-3ee1b548e86c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:23.666404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-30edc8b7-9567-454c-b441-3ee1b548e86c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:23.667635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-30edc8b7-9567-454c-b441-3ee1b548e86c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:24.187446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8e3863a7-dfb4-4939-ad31-44530e4fba9a tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:24.216208 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8e3863a7-dfb4-4939-ad31-44530e4fba9a tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1320 microversion: 2.1 time: 1.249238 Sep 08 12:55:24.217187 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1437/3003] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:22 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1320 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:24.232598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-186601690", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "82a4dc57-b1c7-4ce5-8528-3df2b0721b51"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:24.282733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-30edc8b7-9567-454c-b441-3ee1b548e86c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:24.303026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] validate_networks() for [('82a4dc57-b1c7-4ce5-8528-3df2b0721b51', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:55:24.313231 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-30edc8b7-9567-454c-b441-3ee1b548e86c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1315 microversion: 2.1 time: 0.696691 Sep 08 12:55:24.332039 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1567/3004] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:23 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1315 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:55:24.332039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-73616975-5ace-41b7-bd3c-851ddb22248e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:24.332039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-73616975-5ace-41b7-bd3c-851ddb22248e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:24.332039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73616975-5ace-41b7-bd3c-851ddb22248e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:24.332576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73616975-5ace-41b7-bd3c-851ddb22248e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:24.333977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73616975-5ace-41b7-bd3c-851ddb22248e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:24.335171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73616975-5ace-41b7-bd3c-851ddb22248e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:24.335776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73616975-5ace-41b7-bd3c-851ddb22248e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:24.336222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73616975-5ace-41b7-bd3c-851ddb22248e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:24.885665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-73616975-5ace-41b7-bd3c-851ddb22248e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:24.920540 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-73616975-5ace-41b7-bd3c-851ddb22248e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1313 microversion: 2.1 time: 0.603176 Sep 08 12:55:24.939969 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1568/3005] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:24 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1313 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:24.946775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e727558f-f856-44b3-91e8-a1e61ee123a8 req-5728fe21-ba0f-417b-b58d-9a92d240f8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4fc907-3c1f-461d-9346-9efed53d8190", "name": "network-vif-plugged", "status": "completed", "tag": "82fb07ba-b1e2-44d0-a550-ed2f7f408476"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:24.961450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e727558f-f856-44b3-91e8-a1e61ee123a8 req-5728fe21-ba0f-417b-b58d-9a92d240f8d4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:24.963137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e727558f-f856-44b3-91e8-a1e61ee123a8 req-5728fe21-ba0f-417b-b58d-9a92d240f8d4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:24.964032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e727558f-f856-44b3-91e8-a1e61ee123a8 req-5728fe21-ba0f-417b-b58d-9a92d240f8d4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:24.979347 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e727558f-f856-44b3-91e8-a1e61ee123a8 req-5728fe21-ba0f-417b-b58d-9a92d240f8d4 service nova] Creating event network-vif-plugged:82fb07ba-b1e2-44d0-a550-ed2f7f408476 for instance 5d4fc907-3c1f-461d-9346-9efed53d8190 on n-h1-852084-10 Sep 08 12:55:24.997111 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e727558f-f856-44b3-91e8-a1e61ee123a8 req-5728fe21-ba0f-417b-b58d-9a92d240f8d4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055343 Sep 08 12:55:24.998117 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1569/3006] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:25.242718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c88ec811-8421-4937-8abf-6b880a8ac055 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:25.243477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c88ec811-8421-4937-8abf-6b880a8ac055 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:25.258791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c88ec811-8421-4937-8abf-6b880a8ac055 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:25.263305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c88ec811-8421-4937-8abf-6b880a8ac055 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:25.264732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c88ec811-8421-4937-8abf-6b880a8ac055 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:25.266627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c88ec811-8421-4937-8abf-6b880a8ac055 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:25.267583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c88ec811-8421-4937-8abf-6b880a8ac055 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:25.268222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c88ec811-8421-4937-8abf-6b880a8ac055 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:26.248269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:55:26.257862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:55:26.262681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:55:26.268206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:55:26.272430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:55:26.309540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:26.310533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:26.320782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:26.327563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:26.329281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:26.330050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:26.343152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c88ec811-8421-4937-8abf-6b880a8ac055 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:26.360536 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c88ec811-8421-4937-8abf-6b880a8ac055 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 200 len: 1508 microversion: 2.1 time: 1.123284 Sep 08 12:55:26.362726 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1570/3007] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:25 2022] GET /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 1508 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:55:26.368660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-198b86e2-190c-451c-9fc3-e83dc25e10ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:26.372568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-198b86e2-190c-451c-9fc3-e83dc25e10ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:26.389051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-198b86e2-190c-451c-9fc3-e83dc25e10ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:26.389555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-198b86e2-190c-451c-9fc3-e83dc25e10ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:26.389995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-198b86e2-190c-451c-9fc3-e83dc25e10ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:26.390904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-198b86e2-190c-451c-9fc3-e83dc25e10ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:26.391144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-198b86e2-190c-451c-9fc3-e83dc25e10ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:26.394001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Getting quotas for project 59dc0decb175444491383c39918c5b2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:26.394191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-198b86e2-190c-451c-9fc3-e83dc25e10ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:26.407949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Getting quotas for user 4140a06bc6934d7780ef9ff3e30e6dd5 and project 59dc0decb175444491383c39918c5b2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:26.468547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:55:26.475611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:55:26.515105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:26.565672 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-817bf1d4-1488-4b3a-a88c-3a62f711dbb0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.346203 Sep 08 12:55:26.570098 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1438/3008] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:55:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:55:26.576730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f1bd83c2-ddca-4966-9f5e-66b95c12a247 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:26.580585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f1bd83c2-ddca-4966-9f5e-66b95c12a247 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:26.600351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1bd83c2-ddca-4966-9f5e-66b95c12a247 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:26.600900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1bd83c2-ddca-4966-9f5e-66b95c12a247 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:26.601349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1bd83c2-ddca-4966-9f5e-66b95c12a247 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:26.602091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1bd83c2-ddca-4966-9f5e-66b95c12a247 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:26.606301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1bd83c2-ddca-4966-9f5e-66b95c12a247 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:26.606796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1bd83c2-ddca-4966-9f5e-66b95c12a247 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:26.911246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-198b86e2-190c-451c-9fc3-e83dc25e10ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:26.944306 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-198b86e2-190c-451c-9fc3-e83dc25e10ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1315 microversion: 2.1 time: 0.581070 Sep 08 12:55:26.944922 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1571/3009] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:26 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1315 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:26.981453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a518d553-4129-45c8-99db-d4c0a32aff42 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:26.982232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a518d553-4129-45c8-99db-d4c0a32aff42 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 0429d874-2d6c-4e87-8985-019f7dd39997] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:26.992561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=38 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:27.038518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a518d553-4129-45c8-99db-d4c0a32aff42 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:27.040139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a518d553-4129-45c8-99db-d4c0a32aff42 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:27.042648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a518d553-4129-45c8-99db-d4c0a32aff42 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:27.047984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a518d553-4129-45c8-99db-d4c0a32aff42 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:27.049276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a518d553-4129-45c8-99db-d4c0a32aff42 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:27.050850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a518d553-4129-45c8-99db-d4c0a32aff42 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:27.271561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f1bd83c2-ddca-4966-9f5e-66b95c12a247 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:27.324899 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f1bd83c2-ddca-4966-9f5e-66b95c12a247 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1313 microversion: 2.1 time: 0.752280 Sep 08 12:55:27.330841 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1439/3010] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:26 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1313 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:27.347781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-13a32967-e591-4bfb-bf62-dd5bf185231c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:27.354464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-13a32967-e591-4bfb-bf62-dd5bf185231c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:27.645697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-13a32967-e591-4bfb-bf62-dd5bf185231c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:27.669325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a518d553-4129-45c8-99db-d4c0a32aff42 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:27.670955 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-13a32967-e591-4bfb-bf62-dd5bf185231c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1214 microversion: 2.1 time: 0.336284 Sep 08 12:55:27.685526 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1440/3011] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:27 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1214 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:27.688221 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a518d553-4129-45c8-99db-d4c0a32aff42 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/0429d874-2d6c-4e87-8985-019f7dd39997" status: 200 len: 1508 microversion: 2.1 time: 0.722725 Sep 08 12:55:27.690503 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1572/3012] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:26 2022] GET /compute/v2.1/servers/0429d874-2d6c-4e87-8985-019f7dd39997 => generated 1508 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:27.753214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b63e33c6-b998-4a11-9920-8b620720bc56 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:27.753749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b63e33c6-b998-4a11-9920-8b620720bc56 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 0429d874-2d6c-4e87-8985-019f7dd39997] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:27.784518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63e33c6-b998-4a11-9920-8b620720bc56 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:27.790764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63e33c6-b998-4a11-9920-8b620720bc56 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:27.792330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63e33c6-b998-4a11-9920-8b620720bc56 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:27.794897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63e33c6-b998-4a11-9920-8b620720bc56 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:27.795868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63e33c6-b998-4a11-9920-8b620720bc56 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:27.802756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b63e33c6-b998-4a11-9920-8b620720bc56 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:27.917987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b63e33c6-b998-4a11-9920-8b620720bc56 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 0429d874-2d6c-4e87-8985-019f7dd39997] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:55:28.193579 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b63e33c6-b998-4a11-9920-8b620720bc56 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0429d874-2d6c-4e87-8985-019f7dd39997" status: 204 len: 0 microversion: 2.1 time: 0.461312 Sep 08 12:55:28.196206 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1573/3013] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:55:27 2022] DELETE /compute/v2.1/servers/0429d874-2d6c-4e87-8985-019f7dd39997 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 12:55:28.215041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-412610f0-7528-47ab-b151-5ab0035d8c97 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:28.215902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-412610f0-7528-47ab-b151-5ab0035d8c97 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:28.234730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-412610f0-7528-47ab-b151-5ab0035d8c97 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:28.236224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-412610f0-7528-47ab-b151-5ab0035d8c97 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:28.239130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-412610f0-7528-47ab-b151-5ab0035d8c97 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:28.241281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-412610f0-7528-47ab-b151-5ab0035d8c97 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:28.241952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-412610f0-7528-47ab-b151-5ab0035d8c97 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:28.242545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-412610f0-7528-47ab-b151-5ab0035d8c97 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:28.437772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6c527709-1301-4472-a5b9-ae1c3f3a365b tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:28.456279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c527709-1301-4472-a5b9-ae1c3f3a365b tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:28.458782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c527709-1301-4472-a5b9-ae1c3f3a365b tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:28.460845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c527709-1301-4472-a5b9-ae1c3f3a365b tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:28.465417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c527709-1301-4472-a5b9-ae1c3f3a365b tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:28.473703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c527709-1301-4472-a5b9-ae1c3f3a365b tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:28.476328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c527709-1301-4472-a5b9-ae1c3f3a365b tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:28.527278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5,nova_api:DELETE=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:28.549131 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6c527709-1301-4472-a5b9-ae1c3f3a365b tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.861539 Sep 08 12:55:28.550761 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1441/3014] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:27 2022] GET /compute/v2.1/os-services => generated 949 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:28.576073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36b03522-504a-40f3-a1f2-6d6911d446be tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:28.577375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-36b03522-504a-40f3-a1f2-6d6911d446be tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:28.592042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b03522-504a-40f3-a1f2-6d6911d446be tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:28.593444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b03522-504a-40f3-a1f2-6d6911d446be tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:28.594532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b03522-504a-40f3-a1f2-6d6911d446be tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:28.596345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b03522-504a-40f3-a1f2-6d6911d446be tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:28.597533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b03522-504a-40f3-a1f2-6d6911d446be tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:28.599132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b03522-504a-40f3-a1f2-6d6911d446be tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:28.691263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-36b03522-504a-40f3-a1f2-6d6911d446be tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: d86ab042-dd54-494c-b637-c3fab97d2558] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:55:28.874995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-412610f0-7528-47ab-b151-5ab0035d8c97 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:28.876083 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36b03522-504a-40f3-a1f2-6d6911d446be tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558" status: 204 len: 0 microversion: 2.1 time: 0.307334 Sep 08 12:55:28.887266 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1442/3015] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:55:28 2022] DELETE /compute/v2.1/servers/d86ab042-dd54-494c-b637-c3fab97d2558 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:55:28.896755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-42f05efb-98b2-4063-83e5-83a45265b17e req-a61dc364-dd52-4087-8211-b6aa07d7984f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c480f3-d35b-40e1-9930-b894bf174adb", "tag": "188ffb60-bcd5-43f8-8c63-20d0071dea67"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:28.929216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-42f05efb-98b2-4063-83e5-83a45265b17e req-a61dc364-dd52-4087-8211-b6aa07d7984f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:28.929695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-42f05efb-98b2-4063-83e5-83a45265b17e req-a61dc364-dd52-4087-8211-b6aa07d7984f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:28.937936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-42f05efb-98b2-4063-83e5-83a45265b17e req-a61dc364-dd52-4087-8211-b6aa07d7984f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:28.938133 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-412610f0-7528-47ab-b151-5ab0035d8c97 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1502 microversion: 2.1 time: 0.739472 Sep 08 12:55:28.955269 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1574/3016] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:28 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1502 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:28.963816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bc5db350-11db-4c8e-9d76-f8046a1dd85c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:28.964743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bc5db350-11db-4c8e-9d76-f8046a1dd85c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:28.977501 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-42f05efb-98b2-4063-83e5-83a45265b17e req-a61dc364-dd52-4087-8211-b6aa07d7984f service nova] Creating event network-changed:188ffb60-bcd5-43f8-8c63-20d0071dea67 for instance 69c480f3-d35b-40e1-9930-b894bf174adb on n-h2-852084-10 Sep 08 12:55:28.992080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc5db350-11db-4c8e-9d76-f8046a1dd85c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:28.994501 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-42f05efb-98b2-4063-83e5-83a45265b17e req-a61dc364-dd52-4087-8211-b6aa07d7984f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112623 Sep 08 12:55:28.996865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc5db350-11db-4c8e-9d76-f8046a1dd85c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:28.997897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc5db350-11db-4c8e-9d76-f8046a1dd85c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.000465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc5db350-11db-4c8e-9d76-f8046a1dd85c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.004825 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1443/3017] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:29.005582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc5db350-11db-4c8e-9d76-f8046a1dd85c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.006775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc5db350-11db-4c8e-9d76-f8046a1dd85c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.021485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b7485ec-5413-4fca-a966-d7a56be5c775 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:29.025839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b7485ec-5413-4fca-a966-d7a56be5c775 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.026431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b7485ec-5413-4fca-a966-d7a56be5c775 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.026948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b7485ec-5413-4fca-a966-d7a56be5c775 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.027826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b7485ec-5413-4fca-a966-d7a56be5c775 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.028367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b7485ec-5413-4fca-a966-d7a56be5c775 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.028858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b7485ec-5413-4fca-a966-d7a56be5c775 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.059295 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6b7485ec-5413-4fca-a966-d7a56be5c775 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.051113 Sep 08 12:55:29.060077 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1444/3018] 10.222.0.78 () {58 vars in 1170 bytes} [Thu Sep 8 12:55:29 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:29.076696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8dd6eb19-421b-45d7-bef6-80b229f1627d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:29.081152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8dd6eb19-421b-45d7-bef6-80b229f1627d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:29.096670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dd6eb19-421b-45d7-bef6-80b229f1627d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.097656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dd6eb19-421b-45d7-bef6-80b229f1627d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.098502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dd6eb19-421b-45d7-bef6-80b229f1627d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.099747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dd6eb19-421b-45d7-bef6-80b229f1627d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.100700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dd6eb19-421b-45d7-bef6-80b229f1627d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.112761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dd6eb19-421b-45d7-bef6-80b229f1627d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.284168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8dd6eb19-421b-45d7-bef6-80b229f1627d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:29.302175 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8dd6eb19-421b-45d7-bef6-80b229f1627d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1266 microversion: 2.1 time: 0.237058 Sep 08 12:55:29.305928 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1445/3019] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:29 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:29.326476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-21dd90b8-f24f-42fd-9f36-44e3676c44e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:29.330262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-21dd90b8-f24f-42fd-9f36-44e3676c44e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:29.358825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21dd90b8-f24f-42fd-9f36-44e3676c44e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.362264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21dd90b8-f24f-42fd-9f36-44e3676c44e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.362264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21dd90b8-f24f-42fd-9f36-44e3676c44e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.365436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21dd90b8-f24f-42fd-9f36-44e3676c44e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.365960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21dd90b8-f24f-42fd-9f36-44e3676c44e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.366412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21dd90b8-f24f-42fd-9f36-44e3676c44e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.431173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bc5db350-11db-4c8e-9d76-f8046a1dd85c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:29.439641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-21dd90b8-f24f-42fd-9f36-44e3676c44e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:55:29.444399 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bc5db350-11db-4c8e-9d76-f8046a1dd85c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1313 microversion: 2.1 time: 0.497131 Sep 08 12:55:29.447126 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1575/3020] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:28 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1313 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:29.470988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cb28513f-2735-45fa-846e-5a5d794843ba tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:29.497419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb28513f-2735-45fa-846e-5a5d794843ba tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.498654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb28513f-2735-45fa-846e-5a5d794843ba tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.499777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb28513f-2735-45fa-846e-5a5d794843ba tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.501647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb28513f-2735-45fa-846e-5a5d794843ba tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.503481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb28513f-2735-45fa-846e-5a5d794843ba tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.505251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb28513f-2735-45fa-846e-5a5d794843ba tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.580083 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cb28513f-2735-45fa-846e-5a5d794843ba tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.130693 Sep 08 12:55:29.581902 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1576/3021] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:29 2022] GET /compute/v2.1/os-services => generated 949 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:29.593194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-150527879", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "223aa4ed-6fb0-4348-ba15-a38ce2a34e92"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:29.725967 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-21dd90b8-f24f-42fd-9f36-44e3676c44e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 204 len: 0 microversion: 2.1 time: 0.418181 Sep 08 12:55:29.730005 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1446/3022] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:55:29 2022] DELETE /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:55:29.740238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6f965345-a607-4459-8940-9372c207a5ea tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:29.771832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f965345-a607-4459-8940-9372c207a5ea tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.773024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f965345-a607-4459-8940-9372c207a5ea tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.773982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f965345-a607-4459-8940-9372c207a5ea tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.775567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f965345-a607-4459-8940-9372c207a5ea tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.776612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f965345-a607-4459-8940-9372c207a5ea tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.777792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f965345-a607-4459-8940-9372c207a5ea tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.805454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] validate_networks() for [('223aa4ed-6fb0-4348-ba15-a38ce2a34e92', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:55:29.901591 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6f965345-a607-4459-8940-9372c207a5ea tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=n-d-852084-10&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.169402 Sep 08 12:55:29.916804 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1447/3023] 10.222.0.78 () {58 vars in 1196 bytes} [Thu Sep 8 12:55:29 2022] GET /compute/v2.1/os-services?host=n-d-852084-10&binary=xxx => generated 16 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:55:29.930788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4536aad5-3b3e-401b-81d5-4bd3e3cda405 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:29.932540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4536aad5-3b3e-401b-81d5-4bd3e3cda405 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:29.947308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4536aad5-3b3e-401b-81d5-4bd3e3cda405 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.949856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4536aad5-3b3e-401b-81d5-4bd3e3cda405 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.951089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4536aad5-3b3e-401b-81d5-4bd3e3cda405 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:29.952519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4536aad5-3b3e-401b-81d5-4bd3e3cda405 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:29.953376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4536aad5-3b3e-401b-81d5-4bd3e3cda405 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:29.955597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4536aad5-3b3e-401b-81d5-4bd3e3cda405 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:30.470653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4536aad5-3b3e-401b-81d5-4bd3e3cda405 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:30.522726 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4536aad5-3b3e-401b-81d5-4bd3e3cda405 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1508 microversion: 2.1 time: 0.601454 Sep 08 12:55:30.524928 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1448/3024] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:29 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1508 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:30.547054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e8d552bf-e49d-4132-8a5c-50053bda0002 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:30.576953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e8d552bf-e49d-4132-8a5c-50053bda0002 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:30.578413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e8d552bf-e49d-4132-8a5c-50053bda0002 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:30.579288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e8d552bf-e49d-4132-8a5c-50053bda0002 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:30.594980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e8d552bf-e49d-4132-8a5c-50053bda0002 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:30.596982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e8d552bf-e49d-4132-8a5c-50053bda0002 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:30.598676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e8d552bf-e49d-4132-8a5c-50053bda0002 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:30.681673 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e8d552bf-e49d-4132-8a5c-50053bda0002 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.154354 Sep 08 12:55:30.683323 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1449/3025] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:30 2022] GET /compute/v2.1/os-services => generated 949 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:30.701345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bcd2eef2-4658-47af-8856-3d118df7781c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:30.703474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bcd2eef2-4658-47af-8856-3d118df7781c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:30.719155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcd2eef2-4658-47af-8856-3d118df7781c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:30.722458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcd2eef2-4658-47af-8856-3d118df7781c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:30.723538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcd2eef2-4658-47af-8856-3d118df7781c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:30.724330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcd2eef2-4658-47af-8856-3d118df7781c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:30.724814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcd2eef2-4658-47af-8856-3d118df7781c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:30.725260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcd2eef2-4658-47af-8856-3d118df7781c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:31.149258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bcd2eef2-4658-47af-8856-3d118df7781c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:31.161930 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bcd2eef2-4658-47af-8856-3d118df7781c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1284 microversion: 2.1 time: 0.473880 Sep 08 12:55:31.162950 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1450/3026] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:30 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1284 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:31.184903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0d3c585f-ffcc-439d-bdff-c3a8e57270f6 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:31.195658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0d3c585f-ffcc-439d-bdff-c3a8e57270f6 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:31.209241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d3c585f-ffcc-439d-bdff-c3a8e57270f6 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:31.210526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d3c585f-ffcc-439d-bdff-c3a8e57270f6 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:31.214639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d3c585f-ffcc-439d-bdff-c3a8e57270f6 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:31.215618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d3c585f-ffcc-439d-bdff-c3a8e57270f6 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:31.217856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d3c585f-ffcc-439d-bdff-c3a8e57270f6 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:31.220645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d3c585f-ffcc-439d-bdff-c3a8e57270f6 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:32.935145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:55:32.936825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:55:32.937609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:55:32.938707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:55:32.939689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:55:33.009533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:33.010844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:33.011849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:33.013362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:33.014378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:33.015591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:33.061503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Getting quotas for project f5753cf1c1974c9bb5453393bab0770f. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:33.072143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Getting quotas for user 8094af07ac5340ee9a8c72a7ab625476 and project f5753cf1c1974c9bb5453393bab0770f. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:33.109304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Going to run 2 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:55:33.120630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 8f021d74-5cfc-4132-a8f4-ac61b49f8302] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:55:33.155660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0d3c585f-ffcc-439d-bdff-c3a8e57270f6 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:33.165692 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0d3c585f-ffcc-439d-bdff-c3a8e57270f6 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1313 microversion: 2.1 time: 1.986965 Sep 08 12:55:33.166317 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1451/3027] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:31 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1313 bytes in 2000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:33.175494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ba5a49ff-0cde-49e3-9b7d-2dd5d056f247 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:33.190897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba5a49ff-0cde-49e3-9b7d-2dd5d056f247 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:33.199672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba5a49ff-0cde-49e3-9b7d-2dd5d056f247 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:33.200251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba5a49ff-0cde-49e3-9b7d-2dd5d056f247 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:33.201665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba5a49ff-0cde-49e3-9b7d-2dd5d056f247 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:33.202529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba5a49ff-0cde-49e3-9b7d-2dd5d056f247 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:33.202985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba5a49ff-0cde-49e3-9b7d-2dd5d056f247 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:33.274448 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ba5a49ff-0cde-49e3-9b7d-2dd5d056f247 tempest-ServicesAdminNegativeTestJSON-533617798 tempest-ServicesAdminNegativeTestJSON-533617798-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.1 time: 0.102875 Sep 08 12:55:33.277415 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1452/3028] 10.222.0.78 () {58 vars in 1198 bytes} [Thu Sep 8 12:55:33 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:55:33.289728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a256313-fd0c-4cad-a6a7-ad706492606c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:33.290370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2a256313-fd0c-4cad-a6a7-ad706492606c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:33.298906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=8f021d74-5cfc-4132-a8f4-ac61b49f8302,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:55:33.309503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a256313-fd0c-4cad-a6a7-ad706492606c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:33.310047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a256313-fd0c-4cad-a6a7-ad706492606c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:33.310498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a256313-fd0c-4cad-a6a7-ad706492606c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:33.321115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a256313-fd0c-4cad-a6a7-ad706492606c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:33.321115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a256313-fd0c-4cad-a6a7-ad706492606c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:33.321115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a256313-fd0c-4cad-a6a7-ad706492606c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:33.475604 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1ac03b5d-2d12-4ea9-90a0-78dcdb9c1ca7 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 3.890183 Sep 08 12:55:33.482594 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1577/3029] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:55:29 2022] POST /compute/v2.1/servers => generated 32 bytes in 3900 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Sep 08 12:55:33.519158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bd1a43b5-68ec-4c40-a494-cf0eddc066c6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:33.521811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bd1a43b5-68ec-4c40-a494-cf0eddc066c6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:33.540388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd1a43b5-68ec-4c40-a494-cf0eddc066c6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:33.542095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd1a43b5-68ec-4c40-a494-cf0eddc066c6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:33.542887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd1a43b5-68ec-4c40-a494-cf0eddc066c6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:33.544251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd1a43b5-68ec-4c40-a494-cf0eddc066c6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:33.545336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd1a43b5-68ec-4c40-a494-cf0eddc066c6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:33.545988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd1a43b5-68ec-4c40-a494-cf0eddc066c6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:33.589802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:33.972090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bd1a43b5-68ec-4c40-a494-cf0eddc066c6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:33.986860 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bd1a43b5-68ec-4c40-a494-cf0eddc066c6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1272 microversion: 2.1 time: 0.502085 Sep 08 12:55:33.991034 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1578/3030] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:33 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1272 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:34.102861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2a256313-fd0c-4cad-a6a7-ad706492606c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:34.120960 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a256313-fd0c-4cad-a6a7-ad706492606c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1508 microversion: 2.1 time: 0.839036 Sep 08 12:55:34.122168 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1453/3031] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:33 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1508 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:34.164383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e9fe5e2b-94ce-40a4-bbbc-f7ac871b25d1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:34.186497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e9fe5e2b-94ce-40a4-bbbc-f7ac871b25d1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:34.187378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e9fe5e2b-94ce-40a4-bbbc-f7ac871b25d1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Searching by: {'deleted': False, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:55:34.241567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fe5e2b-94ce-40a4-bbbc-f7ac871b25d1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:34.242382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fe5e2b-94ce-40a4-bbbc-f7ac871b25d1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:34.247083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fe5e2b-94ce-40a4-bbbc-f7ac871b25d1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:34.251016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fe5e2b-94ce-40a4-bbbc-f7ac871b25d1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:34.252742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fe5e2b-94ce-40a4-bbbc-f7ac871b25d1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:34.253468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9fe5e2b-94ce-40a4-bbbc-f7ac871b25d1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:34.353667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:34.371756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-e9fe5e2b-94ce-40a4-bbbc-f7ac871b25d1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:55:34.496553 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e9fe5e2b-94ce-40a4-bbbc-f7ac871b25d1 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.371836 Sep 08 12:55:34.499007 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1454/3032] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 12:55:34 2022] GET /compute/v2.1/servers => generated 1335 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:34.519382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e753afea-919f-4574-ba32-fc0d677d8fae tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:34.519879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e753afea-919f-4574-ba32-fc0d677d8fae tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:34.557021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bbd4cc21-0de2-4564-8440-f4eea44ce523 tempest-ServicesAdminNegativeTestJSON-1149349445 tempest-ServicesAdminNegativeTestJSON-1149349445-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:34.561675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e753afea-919f-4574-ba32-fc0d677d8fae tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:34.562049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bbd4cc21-0de2-4564-8440-f4eea44ce523 tempest-ServicesAdminNegativeTestJSON-1149349445 tempest-ServicesAdminNegativeTestJSON-1149349445-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'd6f5f2f4f8a242e98e2d4456ca6edba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c18de5ee31d741dda02caac3a94c171e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:34.564476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e753afea-919f-4574-ba32-fc0d677d8fae tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:34.566349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e753afea-919f-4574-ba32-fc0d677d8fae tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:34.569057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e753afea-919f-4574-ba32-fc0d677d8fae tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bbd4cc21-0de2-4564-8440-f4eea44ce523 tempest-ServicesAdminNegativeTestJSON-1149349445 tempest-ServicesAdminNegativeTestJSON-1149349445-project] Request method failure captured: Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-services HTTP/1.1 Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeY9Vx_ALbs4bQkBHchr7DoZFvf75iup0Alkb5Xr3GxpWfIapTd0hFEIo73Bn5KDe7BXgjdcETg06Xs9gv1Rzj62D-UdyRtuwa-53-BjJnljyufuu0ZwLWneN_Au065T5cPgnkJvSRh66yoql7wHWQ0CZUNtGelTGDUZrUMRHx206q0 Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c18de5ee31d741dda02caac3a94c171e Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1149349445 Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c18de5ee31d741dda02caac3a94c171e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c18de5ee31d741dda02caac3a94c171e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c18de5ee31d741dda02caac3a94c171e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c18de5ee31d741dda02caac3a94c171e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1149349445 Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c18de5ee31d741dda02caac3a94c171e Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1149349445 Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServicesAdminNegativeTestJSON-1149349445-project Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d6f5f2f4f8a242e98e2d4456ca6edba9 Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1149349445-project Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: action_args: {} Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.force_reraise() Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise self.value Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.enforce( Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 12:55:34.571273 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:34.587699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:34.587699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:34.587699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:34.587699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:34.587699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:34.587699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Sep 08 12:55:34.587699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Sep 08 12:55:34.587699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Sep 08 12:55:34.587699 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:34.587699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bbd4cc21-0de2-4564-8440-f4eea44ce523 tempest-ServicesAdminNegativeTestJSON-1149349445 tempest-ServicesAdminNegativeTestJSON-1149349445-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:55:34.587699 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bbd4cc21-0de2-4564-8440-f4eea44ce523 tempest-ServicesAdminNegativeTestJSON-1149349445 tempest-ServicesAdminNegativeTestJSON-1149349445-project] 10.222.0.78 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.580764 Sep 08 12:55:34.587699 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1579/3033] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:33 2022] GET /compute/v2.1/os-services => generated 112 bytes in 585 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:55:34.595422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a3ae29fc-4b75-432d-af63-ba81e5dc5a41 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:34.595771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e753afea-919f-4574-ba32-fc0d677d8fae tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:34.595771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e753afea-919f-4574-ba32-fc0d677d8fae tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:34.596289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a3ae29fc-4b75-432d-af63-ba81e5dc5a41 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:34.976973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a3ae29fc-4b75-432d-af63-ba81e5dc5a41 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:34.996666 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a3ae29fc-4b75-432d-af63-ba81e5dc5a41 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1217 microversion: 2.1 time: 0.415924 Sep 08 12:55:34.998662 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1580/3034] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:34 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1217 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:35.047542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dc94909a-5784-4c43-a5d4-63cc106aceab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:35.050700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dc94909a-5784-4c43-a5d4-63cc106aceab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:35.071734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc94909a-5784-4c43-a5d4-63cc106aceab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:35.072596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc94909a-5784-4c43-a5d4-63cc106aceab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:35.073312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc94909a-5784-4c43-a5d4-63cc106aceab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:35.074459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc94909a-5784-4c43-a5d4-63cc106aceab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:35.075182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc94909a-5784-4c43-a5d4-63cc106aceab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:35.078337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc94909a-5784-4c43-a5d4-63cc106aceab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:36.141103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dc94909a-5784-4c43-a5d4-63cc106aceab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:36.177879 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dc94909a-5784-4c43-a5d4-63cc106aceab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1314 microversion: 2.1 time: 1.139612 Sep 08 12:55:36.196216 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1581/3035] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:35 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1314 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:36.232843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e753afea-919f-4574-ba32-fc0d677d8fae tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:36.234549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac69dc40-6dd5-480e-8c80-8b75f10583a8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:36.236245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ac69dc40-6dd5-480e-8c80-8b75f10583a8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:36.246048 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e753afea-919f-4574-ba32-fc0d677d8fae tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1313 microversion: 2.1 time: 1.743422 Sep 08 12:55:36.247023 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1455/3036] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:34 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1313 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:36.252478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac69dc40-6dd5-480e-8c80-8b75f10583a8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:36.253716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac69dc40-6dd5-480e-8c80-8b75f10583a8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:36.254766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac69dc40-6dd5-480e-8c80-8b75f10583a8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:36.256688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac69dc40-6dd5-480e-8c80-8b75f10583a8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:36.258695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac69dc40-6dd5-480e-8c80-8b75f10583a8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:36.260662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac69dc40-6dd5-480e-8c80-8b75f10583a8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:36.261858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-4c130c20-7c55-44a7-8af2-cc9c58d40efd req-6c216bf8-c588-4ba1-8aaa-faa059abe018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d4fc907-3c1f-461d-9346-9efed53d8190", "name": "network-vif-unplugged", "status": "completed", "tag": "82fb07ba-b1e2-44d0-a550-ed2f7f408476"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:36.289312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4c130c20-7c55-44a7-8af2-cc9c58d40efd req-6c216bf8-c588-4ba1-8aaa-faa059abe018 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:36.289806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4c130c20-7c55-44a7-8af2-cc9c58d40efd req-6c216bf8-c588-4ba1-8aaa-faa059abe018 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:36.290238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4c130c20-7c55-44a7-8af2-cc9c58d40efd req-6c216bf8-c588-4ba1-8aaa-faa059abe018 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:36.310209 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-4c130c20-7c55-44a7-8af2-cc9c58d40efd req-6c216bf8-c588-4ba1-8aaa-faa059abe018 service nova] Creating event network-vif-unplugged:82fb07ba-b1e2-44d0-a550-ed2f7f408476 for instance 5d4fc907-3c1f-461d-9346-9efed53d8190 on n-h1-852084-10 Sep 08 12:55:36.331888 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-4c130c20-7c55-44a7-8af2-cc9c58d40efd req-6c216bf8-c588-4ba1-8aaa-faa059abe018 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083103 Sep 08 12:55:36.332576 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1456/3037] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:36.338415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-077f75b3-d5e9-4855-a251-7b87ceed6771 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:36.348851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-077f75b3-d5e9-4855-a251-7b87ceed6771 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:36.366016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-077f75b3-d5e9-4855-a251-7b87ceed6771 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:36.366873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-077f75b3-d5e9-4855-a251-7b87ceed6771 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:36.367604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-077f75b3-d5e9-4855-a251-7b87ceed6771 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:36.368563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-077f75b3-d5e9-4855-a251-7b87ceed6771 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:36.372008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-077f75b3-d5e9-4855-a251-7b87ceed6771 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:36.372463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-077f75b3-d5e9-4855-a251-7b87ceed6771 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:37.029656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-077f75b3-d5e9-4855-a251-7b87ceed6771 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:37.072102 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-077f75b3-d5e9-4855-a251-7b87ceed6771 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1213 microversion: 2.1 time: 0.737770 Sep 08 12:55:37.110874 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1457/3038] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:36 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1213 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:37.120935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e2134449-6302-40ba-bcd2-0309426e846d req-9238b7dd-9d0b-48bf-be77-432de13b808b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86ab042-dd54-494c-b637-c3fab97d2558", "name": "network-vif-deleted", "tag": "e849c7d8-4d1d-46d1-a095-5ff08f26ccab"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:37.140789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e2134449-6302-40ba-bcd2-0309426e846d req-9238b7dd-9d0b-48bf-be77-432de13b808b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:37.142294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e2134449-6302-40ba-bcd2-0309426e846d req-9238b7dd-9d0b-48bf-be77-432de13b808b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:37.143341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e2134449-6302-40ba-bcd2-0309426e846d req-9238b7dd-9d0b-48bf-be77-432de13b808b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:37.213672 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e2134449-6302-40ba-bcd2-0309426e846d req-9238b7dd-9d0b-48bf-be77-432de13b808b service nova] Creating event network-vif-deleted:e849c7d8-4d1d-46d1-a095-5ff08f26ccab for instance d86ab042-dd54-494c-b637-c3fab97d2558 on n-h2-852084-10 Sep 08 12:55:37.254657 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e2134449-6302-40ba-bcd2-0309426e846d req-9238b7dd-9d0b-48bf-be77-432de13b808b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140718 Sep 08 12:55:37.260984 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1458/3039] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:37.287653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-32e45573-0d7e-4660-b278-63802f0cb0f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:37.308774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-32e45573-0d7e-4660-b278-63802f0cb0f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:37.323974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ac69dc40-6dd5-480e-8c80-8b75f10583a8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:37.337448 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ac69dc40-6dd5-480e-8c80-8b75f10583a8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1508 microversion: 2.1 time: 1.112791 Sep 08 12:55:37.339611 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1582/3040] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:36 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1508 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:37.345036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-40de05fa-8df6-4990-b3e4-529e045a40af tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:37.354308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32e45573-0d7e-4660-b278-63802f0cb0f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:37.356198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-40de05fa-8df6-4990-b3e4-529e045a40af tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:37.374874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40de05fa-8df6-4990-b3e4-529e045a40af tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:37.375600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40de05fa-8df6-4990-b3e4-529e045a40af tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:37.376233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40de05fa-8df6-4990-b3e4-529e045a40af tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:37.377155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40de05fa-8df6-4990-b3e4-529e045a40af tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:37.377790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40de05fa-8df6-4990-b3e4-529e045a40af tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:37.378243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32e45573-0d7e-4660-b278-63802f0cb0f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:37.378886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40de05fa-8df6-4990-b3e4-529e045a40af tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:37.380059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32e45573-0d7e-4660-b278-63802f0cb0f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:37.382834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32e45573-0d7e-4660-b278-63802f0cb0f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:37.387568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32e45573-0d7e-4660-b278-63802f0cb0f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:37.388959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32e45573-0d7e-4660-b278-63802f0cb0f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:37.652422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=26 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:37.888217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40de05fa-8df6-4990-b3e4-529e045a40af tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:37.898440 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-40de05fa-8df6-4990-b3e4-529e045a40af tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1313 microversion: 2.1 time: 0.557433 Sep 08 12:55:37.906593 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1583/3041] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:37 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1313 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:38.119464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60c09065-08fe-4248-82e0-e12977c9bb23 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:38.119983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-60c09065-08fe-4248-82e0-e12977c9bb23 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:38.151250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60c09065-08fe-4248-82e0-e12977c9bb23 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:38.152133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60c09065-08fe-4248-82e0-e12977c9bb23 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:38.158019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60c09065-08fe-4248-82e0-e12977c9bb23 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:38.161896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60c09065-08fe-4248-82e0-e12977c9bb23 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:38.168216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60c09065-08fe-4248-82e0-e12977c9bb23 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:38.169137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60c09065-08fe-4248-82e0-e12977c9bb23 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:38.201126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-32e45573-0d7e-4660-b278-63802f0cb0f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:38.212295 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-32e45573-0d7e-4660-b278-63802f0cb0f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1314 microversion: 2.1 time: 0.947969 Sep 08 12:55:38.218956 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1459/3042] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:37 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1314 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:38.389389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:38.391317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:38.406655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:38.407578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:38.412028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:38.413074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:38.414397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:38.414963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:38.469905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:38.472327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:38.473570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:38.474385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lazy-loading 'fault' on Instance uuid 5d4fc907-3c1f-461d-9346-9efed53d8190 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:55:38.609304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-60c09065-08fe-4248-82e0-e12977c9bb23 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:38.644109 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-60c09065-08fe-4248-82e0-e12977c9bb23 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1269 microversion: 2.1 time: 0.530265 Sep 08 12:55:38.650272 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1584/3043] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:38 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1269 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:38.666903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b1231897-140d-41db-9430-e4d010c04926 req-ad881f71-caa9-4f2c-b66f-409b1852760b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15036c65-9f70-4cce-bdc6-83a0ac87e853", "tag": "014fff2f-2919-4ee9-b667-4043981336b9"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:38.695694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:38.714555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b1231897-140d-41db-9430-e4d010c04926 req-ad881f71-caa9-4f2c-b66f-409b1852760b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:38.720490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b1231897-140d-41db-9430-e4d010c04926 req-ad881f71-caa9-4f2c-b66f-409b1852760b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:38.722986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b1231897-140d-41db-9430-e4d010c04926 req-ad881f71-caa9-4f2c-b66f-409b1852760b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:38.778104 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b1231897-140d-41db-9430-e4d010c04926 req-ad881f71-caa9-4f2c-b66f-409b1852760b service nova] Creating event network-changed:014fff2f-2919-4ee9-b667-4043981336b9 for instance 15036c65-9f70-4cce-bdc6-83a0ac87e853 on n-h1-852084-10 Sep 08 12:55:38.797155 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b1231897-140d-41db-9430-e4d010c04926 req-ad881f71-caa9-4f2c-b66f-409b1852760b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142720 Sep 08 12:55:38.797968 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1585/3044] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:38.886859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:38.909063 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3618a1eb-1f1d-4ce0-95a9-2bd0fa951c76 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 200 len: 1305 microversion: 2.1 time: 0.521915 Sep 08 12:55:38.923287 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1460/3045] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:38 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 1305 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:38.961163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-98e276ba-d2a2-4741-bd9b-b7c2c6084efb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:38.961905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-98e276ba-d2a2-4741-bd9b-b7c2c6084efb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:38.972751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-98e276ba-d2a2-4741-bd9b-b7c2c6084efb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:38.973570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-98e276ba-d2a2-4741-bd9b-b7c2c6084efb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:38.974316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-98e276ba-d2a2-4741-bd9b-b7c2c6084efb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:38.975580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-98e276ba-d2a2-4741-bd9b-b7c2c6084efb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:38.976341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-98e276ba-d2a2-4741-bd9b-b7c2c6084efb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:38.977101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-98e276ba-d2a2-4741-bd9b-b7c2c6084efb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:39.267740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2458ec2-0839-4b3f-a9b7-554f66f0eaab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:39.268805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2458ec2-0839-4b3f-a9b7-554f66f0eaab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:39.284919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2458ec2-0839-4b3f-a9b7-554f66f0eaab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:39.287090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2458ec2-0839-4b3f-a9b7-554f66f0eaab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:39.294807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2458ec2-0839-4b3f-a9b7-554f66f0eaab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:39.298558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2458ec2-0839-4b3f-a9b7-554f66f0eaab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:39.299569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2458ec2-0839-4b3f-a9b7-554f66f0eaab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:39.301835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2458ec2-0839-4b3f-a9b7-554f66f0eaab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:39.802409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-98e276ba-d2a2-4741-bd9b-b7c2c6084efb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:39.816114 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-98e276ba-d2a2-4741-bd9b-b7c2c6084efb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1313 microversion: 2.1 time: 0.860569 Sep 08 12:55:39.838866 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1586/3046] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:38 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1313 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:39.853215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-6e9997ab-7b5f-4c0f-8d4c-46eff6dd4c25 req-693e8625-097f-40e7-ade8-f2ee7b144416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0429d874-2d6c-4e87-8985-019f7dd39997", "name": "network-vif-deleted", "tag": "52260ece-2c3d-444c-a1e5-2dd56f0936d6"}, {"server_uuid": "5d4fc907-3c1f-461d-9346-9efed53d8190", "name": "network-vif-deleted", "tag": "82fb07ba-b1e2-44d0-a550-ed2f7f408476"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:39.904638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6e9997ab-7b5f-4c0f-8d4c-46eff6dd4c25 req-693e8625-097f-40e7-ade8-f2ee7b144416 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:39.905491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6e9997ab-7b5f-4c0f-8d4c-46eff6dd4c25 req-693e8625-097f-40e7-ade8-f2ee7b144416 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:39.906347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6e9997ab-7b5f-4c0f-8d4c-46eff6dd4c25 req-693e8625-097f-40e7-ade8-f2ee7b144416 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:39.966024 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-6e9997ab-7b5f-4c0f-8d4c-46eff6dd4c25 req-693e8625-097f-40e7-ade8-f2ee7b144416 service nova] Creating event network-vif-deleted:52260ece-2c3d-444c-a1e5-2dd56f0936d6 for instance 0429d874-2d6c-4e87-8985-019f7dd39997 on n-h2-852084-10 Sep 08 12:55:39.967656 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-6e9997ab-7b5f-4c0f-8d4c-46eff6dd4c25 req-693e8625-097f-40e7-ade8-f2ee7b144416 service nova] Creating event network-vif-deleted:82fb07ba-b1e2-44d0-a550-ed2f7f408476 for instance 5d4fc907-3c1f-461d-9346-9efed53d8190 on n-h1-852084-10 Sep 08 12:55:39.996146 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-6e9997ab-7b5f-4c0f-8d4c-46eff6dd4c25 req-693e8625-097f-40e7-ade8-f2ee7b144416 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.154848 Sep 08 12:55:40.012618 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1587/3047] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:40.025116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-47edf165-67d9-4175-8078-7a73e0d4e7b6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:40.026680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-47edf165-67d9-4175-8078-7a73e0d4e7b6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:40.053755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47edf165-67d9-4175-8078-7a73e0d4e7b6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:40.062186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47edf165-67d9-4175-8078-7a73e0d4e7b6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:40.063570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47edf165-67d9-4175-8078-7a73e0d4e7b6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:40.065523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47edf165-67d9-4175-8078-7a73e0d4e7b6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:40.067566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47edf165-67d9-4175-8078-7a73e0d4e7b6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:40.070785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47edf165-67d9-4175-8078-7a73e0d4e7b6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:40.341143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f2458ec2-0839-4b3f-a9b7-554f66f0eaab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:40.354020 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2458ec2-0839-4b3f-a9b7-554f66f0eaab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1314 microversion: 2.1 time: 1.090981 Sep 08 12:55:40.360458 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1461/3048] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:39 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1314 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:40.369690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-28f48921-4bd6-4a1c-9652-738a95d01da4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:40.382560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-28f48921-4bd6-4a1c-9652-738a95d01da4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:40.411028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28f48921-4bd6-4a1c-9652-738a95d01da4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:40.416594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28f48921-4bd6-4a1c-9652-738a95d01da4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:40.417459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28f48921-4bd6-4a1c-9652-738a95d01da4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:40.424543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28f48921-4bd6-4a1c-9652-738a95d01da4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:40.425417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28f48921-4bd6-4a1c-9652-738a95d01da4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:40.426249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28f48921-4bd6-4a1c-9652-738a95d01da4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:40.489692 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-28f48921-4bd6-4a1c-9652-738a95d01da4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-28f48921-4bd6-4a1c-9652-738a95d01da4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 HTTP/1.1 Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '5d4fc907-3c1f-461d-9346-9efed53d8190'} Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:40.493503 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:40.497641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:40.497641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:40.497641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:40.497641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:55:40.497641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:55:40.497641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 12:55:40.497641 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:40.497641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-28f48921-4bd6-4a1c-9652-738a95d01da4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:55:40.497641 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-28f48921-4bd6-4a1c-9652-738a95d01da4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 404 len: 111 microversion: 2.1 time: 0.134017 Sep 08 12:55:40.510428 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1462/3049] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:40 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:55:40.541055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-47edf165-67d9-4175-8078-7a73e0d4e7b6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:40.587166 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-47edf165-67d9-4175-8078-7a73e0d4e7b6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1275 microversion: 2.1 time: 0.566005 Sep 08 12:55:40.589601 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1588/3050] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:40 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1275 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:40.821637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-857798570", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "dbd28b0c-6c95-45fa-bc88-dd4ecaae050a"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:40.846666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e4fe8d8-a98d-4709-aef0-5805a83444ee tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:40.848011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9e4fe8d8-a98d-4709-aef0-5805a83444ee tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:40.861098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e4fe8d8-a98d-4709-aef0-5805a83444ee tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:40.861992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e4fe8d8-a98d-4709-aef0-5805a83444ee tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:40.862670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e4fe8d8-a98d-4709-aef0-5805a83444ee tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:40.870031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e4fe8d8-a98d-4709-aef0-5805a83444ee tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:40.870904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e4fe8d8-a98d-4709-aef0-5805a83444ee tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:40.871599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e4fe8d8-a98d-4709-aef0-5805a83444ee tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:41.017756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] validate_networks() for [('dbd28b0c-6c95-45fa-bc88-dd4ecaae050a', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:55:42.056476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9e4fe8d8-a98d-4709-aef0-5805a83444ee tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:42.096663 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e4fe8d8-a98d-4709-aef0-5805a83444ee tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1313 microversion: 2.1 time: 1.252651 Sep 08 12:55:42.113955 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1589/3051] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:40 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1313 bytes in 1272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:42.135424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5192b912-626a-4920-a319-cd2769778cf5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:42.139787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5192b912-626a-4920-a319-cd2769778cf5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:42.165111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5192b912-626a-4920-a319-cd2769778cf5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:42.169183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5192b912-626a-4920-a319-cd2769778cf5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:42.170151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5192b912-626a-4920-a319-cd2769778cf5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:42.171261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5192b912-626a-4920-a319-cd2769778cf5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:42.172043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5192b912-626a-4920-a319-cd2769778cf5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:42.172719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5192b912-626a-4920-a319-cd2769778cf5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:42.681725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5192b912-626a-4920-a319-cd2769778cf5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:42.701145 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5192b912-626a-4920-a319-cd2769778cf5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1314 microversion: 2.1 time: 0.582207 Sep 08 12:55:42.701145 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1590/3052] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:42 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1314 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:42.716994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-679c12ee-c4f6-4a8d-bcad-bed32d9ed68e tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:42.719944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-679c12ee-c4f6-4a8d-bcad-bed32d9ed68e tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:42.743846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-679c12ee-c4f6-4a8d-bcad-bed32d9ed68e tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:42.750375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-679c12ee-c4f6-4a8d-bcad-bed32d9ed68e tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:42.751122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-679c12ee-c4f6-4a8d-bcad-bed32d9ed68e tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:42.752141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-679c12ee-c4f6-4a8d-bcad-bed32d9ed68e tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:42.754708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-679c12ee-c4f6-4a8d-bcad-bed32d9ed68e tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:42.755762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-679c12ee-c4f6-4a8d-bcad-bed32d9ed68e tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:42.970430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-679c12ee-c4f6-4a8d-bcad-bed32d9ed68e tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:42.986039 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-679c12ee-c4f6-4a8d-bcad-bed32d9ed68e tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1275 microversion: 2.1 time: 0.286701 Sep 08 12:55:43.005598 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1591/3053] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:42 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1275 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:43.052188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:43.448744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:55:43.449826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:55:43.450606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:55:43.451184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:55:43.451787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:55:43.480661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:43.481240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:43.481772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:43.482557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:43.483032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:43.483558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:43.587753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:55:43.618173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for user d9a995d2889c47738ad0b5255445c5f0 and project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:55:43.678981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:55:43.681595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:55:43.812703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6977f749-0ae0-4c59-9242-987fdd67e92f tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:43.877597 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6977f749-0ae0-4c59-9242-987fdd67e92f tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.864663 Sep 08 12:55:43.879481 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ac247974-5bdd-42b5-a933-9a3a412e01f0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.063576 Sep 08 12:55:43.888020 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1463/3054] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:55:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 3073 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:55:43.893698 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1592/3055] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:43.925322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ccb03ac4-fa51-4e2b-b5cd-c1bfa9111423 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:43.932032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ccb03ac4-fa51-4e2b-b5cd-c1bfa9111423 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:43.937150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c1559f18-7156-473b-aa04-885c63b2dad0 req-75ffcc3b-6723-46c3-a24c-05ce4ab3b737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c480f3-d35b-40e1-9930-b894bf174adb", "name": "network-vif-plugged", "status": "completed", "tag": "188ffb60-bcd5-43f8-8c63-20d0071dea67"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:43.990111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb03ac4-fa51-4e2b-b5cd-c1bfa9111423 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:43.992430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb03ac4-fa51-4e2b-b5cd-c1bfa9111423 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:43.996240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb03ac4-fa51-4e2b-b5cd-c1bfa9111423 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:43.997717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb03ac4-fa51-4e2b-b5cd-c1bfa9111423 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:43.998662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb03ac4-fa51-4e2b-b5cd-c1bfa9111423 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:44.003063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c1559f18-7156-473b-aa04-885c63b2dad0 req-75ffcc3b-6723-46c3-a24c-05ce4ab3b737 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:44.009029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb03ac4-fa51-4e2b-b5cd-c1bfa9111423 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:44.014624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c1559f18-7156-473b-aa04-885c63b2dad0 req-75ffcc3b-6723-46c3-a24c-05ce4ab3b737 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:44.015511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c1559f18-7156-473b-aa04-885c63b2dad0 req-75ffcc3b-6723-46c3-a24c-05ce4ab3b737 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:44.096723 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c1559f18-7156-473b-aa04-885c63b2dad0 req-75ffcc3b-6723-46c3-a24c-05ce4ab3b737 service nova] Creating event network-vif-plugged:188ffb60-bcd5-43f8-8c63-20d0071dea67 for instance 69c480f3-d35b-40e1-9930-b894bf174adb on n-h2-852084-10 Sep 08 12:55:44.137741 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c1559f18-7156-473b-aa04-885c63b2dad0 req-75ffcc3b-6723-46c3-a24c-05ce4ab3b737 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244163 Sep 08 12:55:44.151600 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1464/3056] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:44.188520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01d1fe77-4337-48e3-9d34-02e829fc16e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:44.215536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-01d1fe77-4337-48e3-9d34-02e829fc16e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:44.241609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01d1fe77-4337-48e3-9d34-02e829fc16e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:44.243976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01d1fe77-4337-48e3-9d34-02e829fc16e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:44.245409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01d1fe77-4337-48e3-9d34-02e829fc16e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:44.248884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01d1fe77-4337-48e3-9d34-02e829fc16e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:44.257232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01d1fe77-4337-48e3-9d34-02e829fc16e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:44.258486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01d1fe77-4337-48e3-9d34-02e829fc16e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:44.988355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:45.322501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-01d1fe77-4337-48e3-9d34-02e829fc16e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:45.335755 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-01d1fe77-4337-48e3-9d34-02e829fc16e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1314 microversion: 2.1 time: 1.174076 Sep 08 12:55:45.338649 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1465/3057] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:44 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1314 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:45.355610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-09f85e4b-37bb-4f5d-87fc-4897e367757a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:45.356279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-09f85e4b-37bb-4f5d-87fc-4897e367757a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:45.389844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09f85e4b-37bb-4f5d-87fc-4897e367757a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:45.390503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09f85e4b-37bb-4f5d-87fc-4897e367757a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:45.390963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09f85e4b-37bb-4f5d-87fc-4897e367757a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:45.396052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09f85e4b-37bb-4f5d-87fc-4897e367757a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:45.396555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09f85e4b-37bb-4f5d-87fc-4897e367757a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:45.397025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09f85e4b-37bb-4f5d-87fc-4897e367757a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:45.423923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ccb03ac4-fa51-4e2b-b5cd-c1bfa9111423 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:45.443721 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ccb03ac4-fa51-4e2b-b5cd-c1bfa9111423 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1313 microversion: 2.1 time: 1.545846 Sep 08 12:55:45.458694 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1593/3058] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:43 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1313 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:45.469019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-627cfb77-70fc-408b-a7a9-8d07950d2be6 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:45.581943 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-627cfb77-70fc-408b-a7a9-8d07950d2be6 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.121243 Sep 08 12:55:45.584956 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1594/3059] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 12:55:45 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:45.610385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4295442d-ff0c-4c2f-ad95-57472e015822 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:45.616471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4295442d-ff0c-4c2f-ad95-57472e015822 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:45.646501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4295442d-ff0c-4c2f-ad95-57472e015822 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:45.646769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4295442d-ff0c-4c2f-ad95-57472e015822 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:45.655748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4295442d-ff0c-4c2f-ad95-57472e015822 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:45.659535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4295442d-ff0c-4c2f-ad95-57472e015822 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:45.661634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4295442d-ff0c-4c2f-ad95-57472e015822 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:45.662335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4295442d-ff0c-4c2f-ad95-57472e015822 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:45.779403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4295442d-ff0c-4c2f-ad95-57472e015822 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:55:45.927625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-09f85e4b-37bb-4f5d-87fc-4897e367757a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:45.944198 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-09f85e4b-37bb-4f5d-87fc-4897e367757a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1218 microversion: 2.1 time: 0.601750 Sep 08 12:55:45.958805 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1466/3060] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:45 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1218 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:45.958805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4a0dfb06-fc09-424e-9249-5af8d9bd7dd3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:45.960222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4a0dfb06-fc09-424e-9249-5af8d9bd7dd3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:45.976487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a0dfb06-fc09-424e-9249-5af8d9bd7dd3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:45.977002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a0dfb06-fc09-424e-9249-5af8d9bd7dd3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:45.977459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a0dfb06-fc09-424e-9249-5af8d9bd7dd3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:45.982596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a0dfb06-fc09-424e-9249-5af8d9bd7dd3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:45.983144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a0dfb06-fc09-424e-9249-5af8d9bd7dd3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:45.985037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a0dfb06-fc09-424e-9249-5af8d9bd7dd3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:46.211184 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4295442d-ff0c-4c2f-ad95-57472e015822 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 204 len: 0 microversion: 2.1 time: 0.624276 Sep 08 12:55:46.216025 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1595/3061] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:55:45 2022] DELETE /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:55:46.260991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-20e94fa4-0eef-4bf9-a13c-b6cb8d220f54 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:46.335619 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-20e94fa4-0eef-4bf9-a13c-b6cb8d220f54 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.112605 Sep 08 12:55:46.340448 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1596/3062] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:46.380556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f31cc2b-2ee1-4568-8700-3913846183e5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:46.382016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1f31cc2b-2ee1-4568-8700-3913846183e5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:46.426501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f31cc2b-2ee1-4568-8700-3913846183e5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:46.427122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f31cc2b-2ee1-4568-8700-3913846183e5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:46.428502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f31cc2b-2ee1-4568-8700-3913846183e5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:46.431191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f31cc2b-2ee1-4568-8700-3913846183e5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:46.435249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f31cc2b-2ee1-4568-8700-3913846183e5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:46.435764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f31cc2b-2ee1-4568-8700-3913846183e5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:47.128618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4a0dfb06-fc09-424e-9249-5af8d9bd7dd3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:47.138880 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4a0dfb06-fc09-424e-9249-5af8d9bd7dd3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1317 microversion: 2.1 time: 1.191114 Sep 08 12:55:47.139751 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1467/3063] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:45 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1317 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:47.146307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-47c774fc-46c0-4f19-88a3-bbc539e64671 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:47.156521 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-47c774fc-46c0-4f19-88a3-bbc539e64671 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015248 Sep 08 12:55:47.167555 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1468/3064] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:47.173361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-83ab7105-5399-4009-b28b-41ed448f8cab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:47.174409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-83ab7105-5399-4009-b28b-41ed448f8cab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:47.184427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83ab7105-5399-4009-b28b-41ed448f8cab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:47.185434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83ab7105-5399-4009-b28b-41ed448f8cab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:47.186229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83ab7105-5399-4009-b28b-41ed448f8cab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:47.187662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83ab7105-5399-4009-b28b-41ed448f8cab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:47.188572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83ab7105-5399-4009-b28b-41ed448f8cab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:47.189262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83ab7105-5399-4009-b28b-41ed448f8cab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:47.347861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1f31cc2b-2ee1-4568-8700-3913846183e5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:47.358520 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1f31cc2b-2ee1-4568-8700-3913846183e5 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1666 microversion: 2.1 time: 1.006987 Sep 08 12:55:47.360166 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1597/3065] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:46 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1666 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:47.365865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ed89b941-cb6a-40a3-a95f-4771a9155c24 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:47.366941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ed89b941-cb6a-40a3-a95f-4771a9155c24 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:47.375109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed89b941-cb6a-40a3-a95f-4771a9155c24 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:47.375952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed89b941-cb6a-40a3-a95f-4771a9155c24 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:47.376684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed89b941-cb6a-40a3-a95f-4771a9155c24 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:47.377686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed89b941-cb6a-40a3-a95f-4771a9155c24 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:47.378442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed89b941-cb6a-40a3-a95f-4771a9155c24 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:47.380047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed89b941-cb6a-40a3-a95f-4771a9155c24 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:48.332260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-83ab7105-5399-4009-b28b-41ed448f8cab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:48.345646 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-83ab7105-5399-4009-b28b-41ed448f8cab tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1314 microversion: 2.1 time: 1.176482 Sep 08 12:55:48.346959 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1469/3066] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:47 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1314 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:48.368415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ffda9c5c-d53b-4f4f-aba6-f2dd5836115e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:48.369052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ffda9c5c-d53b-4f4f-aba6-f2dd5836115e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:48.388402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffda9c5c-d53b-4f4f-aba6-f2dd5836115e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:48.390885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffda9c5c-d53b-4f4f-aba6-f2dd5836115e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:48.392761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffda9c5c-d53b-4f4f-aba6-f2dd5836115e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:48.393586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffda9c5c-d53b-4f4f-aba6-f2dd5836115e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:48.394080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffda9c5c-d53b-4f4f-aba6-f2dd5836115e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:48.398037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffda9c5c-d53b-4f4f-aba6-f2dd5836115e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:48.749914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ffda9c5c-d53b-4f4f-aba6-f2dd5836115e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:48.776155 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ffda9c5c-d53b-4f4f-aba6-f2dd5836115e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1272 microversion: 2.1 time: 0.425059 Sep 08 12:55:48.778625 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1470/3067] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:48 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1272 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:48.803464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-84a61c05-e96b-41ce-bfd5-fd604b4ee5d2 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:48.870820 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-84a61c05-e96b-41ce-bfd5-fd604b4ee5d2 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.090702 Sep 08 12:55:48.875699 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1471/3068] 10.222.0.78 () {58 vars in 1165 bytes} [Thu Sep 8 12:55:48 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:48.883927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bb240a0c-14bf-4a1e-841b-324bca662fed tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:48.885246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bb240a0c-14bf-4a1e-841b-324bca662fed tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:48.897527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb240a0c-14bf-4a1e-841b-324bca662fed tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:48.898040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb240a0c-14bf-4a1e-841b-324bca662fed tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:48.898677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb240a0c-14bf-4a1e-841b-324bca662fed tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:48.899900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb240a0c-14bf-4a1e-841b-324bca662fed tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:48.900908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb240a0c-14bf-4a1e-841b-324bca662fed tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:48.901630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb240a0c-14bf-4a1e-841b-324bca662fed tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:49.126642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ed89b941-cb6a-40a3-a95f-4771a9155c24 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:49.161622 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ed89b941-cb6a-40a3-a95f-4771a9155c24 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1498 microversion: 2.1 time: 1.799652 Sep 08 12:55:49.162323 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1598/3069] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:47 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1498 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:49.195731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-818d52cb-8c0f-4f38-8b21-c69603f48976 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:49.196374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-818d52cb-8c0f-4f38-8b21-c69603f48976 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:49.240329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-818d52cb-8c0f-4f38-8b21-c69603f48976 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:49.241357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-818d52cb-8c0f-4f38-8b21-c69603f48976 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:49.243300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-818d52cb-8c0f-4f38-8b21-c69603f48976 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:49.246825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-818d52cb-8c0f-4f38-8b21-c69603f48976 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:49.249859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-818d52cb-8c0f-4f38-8b21-c69603f48976 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:49.253063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-818d52cb-8c0f-4f38-8b21-c69603f48976 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:49.744461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-818d52cb-8c0f-4f38-8b21-c69603f48976 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:49.747082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:49.760034 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-818d52cb-8c0f-4f38-8b21-c69603f48976 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1598 microversion: 2.1 time: 0.592646 Sep 08 12:55:49.764069 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1599/3070] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:49 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1598 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:49.771968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-774bb83a-b26f-41ae-b0d7-e917792b3383 req-ce31b02a-6c94-426c-b2e8-307751cea2be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15036c65-9f70-4cce-bdc6-83a0ac87e853", "name": "network-vif-plugged", "status": "completed", "tag": "014fff2f-2919-4ee9-b667-4043981336b9"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:49.804596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-774bb83a-b26f-41ae-b0d7-e917792b3383 req-ce31b02a-6c94-426c-b2e8-307751cea2be service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:49.806655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-774bb83a-b26f-41ae-b0d7-e917792b3383 req-ce31b02a-6c94-426c-b2e8-307751cea2be service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:49.808716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-774bb83a-b26f-41ae-b0d7-e917792b3383 req-ce31b02a-6c94-426c-b2e8-307751cea2be service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:49.831146 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-774bb83a-b26f-41ae-b0d7-e917792b3383 req-ce31b02a-6c94-426c-b2e8-307751cea2be service nova] Creating event network-vif-plugged:014fff2f-2919-4ee9-b667-4043981336b9 for instance 15036c65-9f70-4cce-bdc6-83a0ac87e853 on n-h1-852084-10 Sep 08 12:55:49.840552 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-774bb83a-b26f-41ae-b0d7-e917792b3383 req-ce31b02a-6c94-426c-b2e8-307751cea2be service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071255 Sep 08 12:55:49.841502 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1600/3071] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:49.853511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f7a92883-1e68-4392-9edc-73c1596b2268 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:49.867865 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f7a92883-1e68-4392-9edc-73c1596b2268 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023056 Sep 08 12:55:49.868863 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1601/3072] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:49.874888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-45c41035-7231-4e34-8f9e-0b14cb227aa1 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:49.903705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bb240a0c-14bf-4a1e-841b-324bca662fed tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:49.905420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.compute.server_groups [None req-45c41035-7231-4e34-8f9e-0b14cb227aa1 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Querying cell eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) for 1 instances {{(pid=128970) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 12:55:49.906933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45c41035-7231-4e34-8f9e-0b14cb227aa1 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:49.907720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45c41035-7231-4e34-8f9e-0b14cb227aa1 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:49.909285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45c41035-7231-4e34-8f9e-0b14cb227aa1 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:49.918556 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bb240a0c-14bf-4a1e-841b-324bca662fed tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1317 microversion: 2.1 time: 1.041229 Sep 08 12:55:49.926430 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1472/3073] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:48 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1317 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:49.931815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e188e2e4-56a6-4ba6-a4d0-af67dd22f81d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:49.932734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e188e2e4-56a6-4ba6-a4d0-af67dd22f81d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:49.959710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:49.962039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e188e2e4-56a6-4ba6-a4d0-af67dd22f81d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:49.971310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e188e2e4-56a6-4ba6-a4d0-af67dd22f81d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:49.972036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e188e2e4-56a6-4ba6-a4d0-af67dd22f81d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:49.973588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e188e2e4-56a6-4ba6-a4d0-af67dd22f81d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:49.974241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e188e2e4-56a6-4ba6-a4d0-af67dd22f81d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:49.974855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e188e2e4-56a6-4ba6-a4d0-af67dd22f81d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:50.025523 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-45c41035-7231-4e34-8f9e-0b14cb227aa1 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/ef07e6b3-df91-4e2d-af0b-abb8af8e369a" status: 200 len: 222 microversion: 2.1 time: 0.154250 Sep 08 12:55:50.027948 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1602/3074] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:55:49 2022] GET /compute/v2.1/os-server-groups/ef07e6b3-df91-4e2d-af0b-abb8af8e369a => generated 222 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:50.047372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f1317c83-9660-4028-a7a5-904b8c22c3e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:50.050649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f1317c83-9660-4028-a7a5-904b8c22c3e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:50.066190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1317c83-9660-4028-a7a5-904b8c22c3e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:50.069474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1317c83-9660-4028-a7a5-904b8c22c3e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:50.071829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1317c83-9660-4028-a7a5-904b8c22c3e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:50.073525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1317c83-9660-4028-a7a5-904b8c22c3e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:50.074706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1317c83-9660-4028-a7a5-904b8c22c3e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:50.077235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1317c83-9660-4028-a7a5-904b8c22c3e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:50.432853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f1317c83-9660-4028-a7a5-904b8c22c3e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:50.449023 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f1317c83-9660-4028-a7a5-904b8c22c3e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1272 microversion: 2.1 time: 0.415368 Sep 08 12:55:50.463264 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1603/3075] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:50 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1272 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:50.470401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0c82a8f4-e024-4606-b5be-b421b1aab6bd tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:50.538812 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0c82a8f4-e024-4606-b5be-b421b1aab6bd tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.086024 Sep 08 12:55:50.550608 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1604/3076] 10.222.0.78 () {58 vars in 1169 bytes} [Thu Sep 8 12:55:50 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:50.551855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3cd6b1c1-e36d-4401-b770-120329ca9148 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:50.552382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3cd6b1c1-e36d-4401-b770-120329ca9148 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:50.576181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cd6b1c1-e36d-4401-b770-120329ca9148 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:50.576900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cd6b1c1-e36d-4401-b770-120329ca9148 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:50.577370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cd6b1c1-e36d-4401-b770-120329ca9148 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:50.578131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cd6b1c1-e36d-4401-b770-120329ca9148 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:50.578600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cd6b1c1-e36d-4401-b770-120329ca9148 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:50.579032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cd6b1c1-e36d-4401-b770-120329ca9148 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:50.644255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3cd6b1c1-e36d-4401-b770-120329ca9148 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:55:50.850207 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3cd6b1c1-e36d-4401-b770-120329ca9148 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "DELETE /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 204 len: 0 microversion: 2.1 time: 0.308608 Sep 08 12:55:50.851338 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1605/3077] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:55:50 2022] DELETE /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:55:50.869390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-87fa8d18-cbbf-4976-9c38-da6fedf41700 req-a8c2ec64-8f5b-4591-877d-814fde2d3a08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aad991b2-93e9-4eac-ab38-e5d5ee91f569", "name": "network-vif-deleted", "tag": "19b453c9-4a90-4750-9a45-d3bde1b6957d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:50.902033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-87fa8d18-cbbf-4976-9c38-da6fedf41700 req-a8c2ec64-8f5b-4591-877d-814fde2d3a08 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:50.902605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-87fa8d18-cbbf-4976-9c38-da6fedf41700 req-a8c2ec64-8f5b-4591-877d-814fde2d3a08 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:50.903052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-87fa8d18-cbbf-4976-9c38-da6fedf41700 req-a8c2ec64-8f5b-4591-877d-814fde2d3a08 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:50.931720 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-87fa8d18-cbbf-4976-9c38-da6fedf41700 req-a8c2ec64-8f5b-4591-877d-814fde2d3a08 service nova] Creating event network-vif-deleted:19b453c9-4a90-4750-9a45-d3bde1b6957d for instance aad991b2-93e9-4eac-ab38-e5d5ee91f569 on n-h1-852084-10 Sep 08 12:55:50.942143 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-87fa8d18-cbbf-4976-9c38-da6fedf41700 req-a8c2ec64-8f5b-4591-877d-814fde2d3a08 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085426 Sep 08 12:55:50.943451 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1606/3078] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:50.949227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-053dc959-f03a-4d2e-bc32-0255ea78af72 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:50.970695 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-053dc959-f03a-4d2e-bc32-0255ea78af72 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.025695 Sep 08 12:55:50.981657 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1607/3079] 10.222.0.78 () {58 vars in 1161 bytes} [Thu Sep 8 12:55:50 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:50.986888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a28aa6f8-fd5b-4e70-b64e-27475d83afb2 req-b92198a7-cb6d-488a-b2ec-18618d545069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f021d74-5cfc-4132-a8f4-ac61b49f8302", "tag": "0ea4e458-ce86-463d-b57e-0ebbf8afaac5"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:51.003470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a28aa6f8-fd5b-4e70-b64e-27475d83afb2 req-b92198a7-cb6d-488a-b2ec-18618d545069 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:51.010415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a28aa6f8-fd5b-4e70-b64e-27475d83afb2 req-b92198a7-cb6d-488a-b2ec-18618d545069 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:51.010755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a28aa6f8-fd5b-4e70-b64e-27475d83afb2 req-b92198a7-cb6d-488a-b2ec-18618d545069 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:51.026315 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a28aa6f8-fd5b-4e70-b64e-27475d83afb2 req-b92198a7-cb6d-488a-b2ec-18618d545069 service nova] Creating event network-changed:0ea4e458-ce86-463d-b57e-0ebbf8afaac5 for instance 8f021d74-5cfc-4132-a8f4-ac61b49f8302 on n-h2-852084-10 Sep 08 12:55:51.033413 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a28aa6f8-fd5b-4e70-b64e-27475d83afb2 req-b92198a7-cb6d-488a-b2ec-18618d545069 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050121 Sep 08 12:55:51.035356 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1608/3080] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:51.041592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:51.042790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:51.057127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:51.057577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:51.058222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:51.059160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:51.059819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:51.060925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:51.092310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e188e2e4-56a6-4ba6-a4d0-af67dd22f81d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:51.106437 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e188e2e4-56a6-4ba6-a4d0-af67dd22f81d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1314 microversion: 2.1 time: 1.178438 Sep 08 12:55:51.111953 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1473/3081] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:49 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1314 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:51.117970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d36cdc86-6dd8-44b8-b0fe-e7c2c80632f9 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:51.118582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d36cdc86-6dd8-44b8-b0fe-e7c2c80632f9 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:51.147187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d36cdc86-6dd8-44b8-b0fe-e7c2c80632f9 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:51.148587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d36cdc86-6dd8-44b8-b0fe-e7c2c80632f9 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:51.150416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d36cdc86-6dd8-44b8-b0fe-e7c2c80632f9 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:51.153387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d36cdc86-6dd8-44b8-b0fe-e7c2c80632f9 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:51.156019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d36cdc86-6dd8-44b8-b0fe-e7c2c80632f9 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:51.157655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d36cdc86-6dd8-44b8-b0fe-e7c2c80632f9 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:51.165060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:51.171782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:51.174759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:51.176298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lazy-loading 'fault' on Instance uuid aad991b2-93e9-4eac-ab38-e5d5ee91f569 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:55:51.313554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b40d83cbf26d495fb66d0a78d211c41b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3957124a8f134e2c8043539232be46ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:51.328121 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-626a6c29-b16c-4cc4-b835-70b25469905e tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 200 len: 1315 microversion: 2.1 time: 0.289839 Sep 08 12:55:51.328679 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1609/3082] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:51 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 1315 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:51.360801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1d636ad1-bbd1-4f1d-877f-0534e0ace416 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:51.364337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1d636ad1-bbd1-4f1d-877f-0534e0ace416 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:51.380330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d636ad1-bbd1-4f1d-877f-0534e0ace416 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:51.380835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d636ad1-bbd1-4f1d-877f-0534e0ace416 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:51.381313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d636ad1-bbd1-4f1d-877f-0534e0ace416 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:51.382393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d636ad1-bbd1-4f1d-877f-0534e0ace416 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:51.382578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d636ad1-bbd1-4f1d-877f-0534e0ace416 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:51.382907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d636ad1-bbd1-4f1d-877f-0534e0ace416 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:52.048467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d36cdc86-6dd8-44b8-b0fe-e7c2c80632f9 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:52.068567 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d36cdc86-6dd8-44b8-b0fe-e7c2c80632f9 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1504 microversion: 2.1 time: 0.954043 Sep 08 12:55:52.084283 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1474/3083] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:51 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1504 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:52.103625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-575fd294-c700-456c-93d2-68fa1e7d5d98 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:52.116126 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-575fd294-c700-456c-93d2-68fa1e7d5d98 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.030099 Sep 08 12:55:52.127104 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1475/3084] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:52.133704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-12416cf1-7e0b-4f2e-949d-0b78924ef017 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:52.134884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-12416cf1-7e0b-4f2e-949d-0b78924ef017 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:52.146507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12416cf1-7e0b-4f2e-949d-0b78924ef017 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:52.147449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12416cf1-7e0b-4f2e-949d-0b78924ef017 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:52.148760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12416cf1-7e0b-4f2e-949d-0b78924ef017 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:52.149921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12416cf1-7e0b-4f2e-949d-0b78924ef017 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:52.151425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12416cf1-7e0b-4f2e-949d-0b78924ef017 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:52.153014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12416cf1-7e0b-4f2e-949d-0b78924ef017 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:52.183887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:52.414092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-12416cf1-7e0b-4f2e-949d-0b78924ef017 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:52.431619 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-12416cf1-7e0b-4f2e-949d-0b78924ef017 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1272 microversion: 2.1 time: 0.302124 Sep 08 12:55:52.437224 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1476/3085] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:52 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1272 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:52.450106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8a275f23-db32-4b1b-808a-6fdca7ee750e tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:52.508455 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8a275f23-db32-4b1b-808a-6fdca7ee750e tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.069685 Sep 08 12:55:52.508990 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1477/3086] 10.222.0.78 () {58 vars in 1167 bytes} [Thu Sep 8 12:55:52 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:52.534469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-95747d48-2b4b-444a-9382-335b8eeba679 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:52.538367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-95747d48-2b4b-444a-9382-335b8eeba679 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:52.554450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-95747d48-2b4b-444a-9382-335b8eeba679 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:52.555471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-95747d48-2b4b-444a-9382-335b8eeba679 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:52.556114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-95747d48-2b4b-444a-9382-335b8eeba679 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:52.557019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-95747d48-2b4b-444a-9382-335b8eeba679 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:52.557643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-95747d48-2b4b-444a-9382-335b8eeba679 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:52.558232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-95747d48-2b4b-444a-9382-335b8eeba679 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:52.609139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1d636ad1-bbd1-4f1d-877f-0534e0ace416 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:52.655900 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1d636ad1-bbd1-4f1d-877f-0534e0ace416 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1317 microversion: 2.1 time: 1.305197 Sep 08 12:55:52.664810 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1610/3087] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:51 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1317 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:52.680317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33bf033b-3c41-4a14-aa40-d9fc7abb4a66 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:52.681121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-33bf033b-3c41-4a14-aa40-d9fc7abb4a66 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] [instance: aad991b2-93e9-4eac-ab38-e5d5ee91f569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:52.715401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33bf033b-3c41-4a14-aa40-d9fc7abb4a66 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:52.716452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33bf033b-3c41-4a14-aa40-d9fc7abb4a66 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:52.717467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33bf033b-3c41-4a14-aa40-d9fc7abb4a66 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:52.718477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33bf033b-3c41-4a14-aa40-d9fc7abb4a66 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:52.719276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33bf033b-3c41-4a14-aa40-d9fc7abb4a66 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:52.719928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33bf033b-3c41-4a14-aa40-d9fc7abb4a66 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:52.744082 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-33bf033b-3c41-4a14-aa40-d9fc7abb4a66 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] HTTP exception thrown: Instance aad991b2-93e9-4eac-ab38-e5d5ee91f569 could not be found. Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33bf033b-3c41-4a14-aa40-d9fc7abb4a66 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Request method failure captured: Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 HTTP/1.1 Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeX0GgPJplhFddZ5h_K20_HoV0ElVlc5LMBi0urOJVzCrA_U9xig-4t6fHWGZVS7idAEIFWsR3IaKbEBacKGjhfE-fTMlgn2cd5f9WeZZwiHvDsTXuYYzrHTTluqRwIibevbjtVfMEr2aARhfdMdqzRSyP5w7NpQVMv6uPYWY-OMfA4 Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 3957124a8f134e2c8043539232be46ce Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestFqdnHostnames-1141722941 Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3957124a8f134e2c8043539232be46ce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3957124a8f134e2c8043539232be46ce"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3957124a8f134e2c8043539232be46ce"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3957124a8f134e2c8043539232be46ce"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestFqdnHostnames-1141722941 Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 3957124a8f134e2c8043539232be46ce Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1141722941 Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestFqdnHostnames-1141722941-project Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b40d83cbf26d495fb66d0a78d211c41b Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestFqdnHostnames-1141722941-project Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance aad991b2-93e9-4eac-ab38-e5d5ee91f569 could not be found. Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'aad991b2-93e9-4eac-ab38-e5d5ee91f569'} Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aad991b2-93e9-4eac-ab38-e5d5ee91f569 could not be found. Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aad991b2-93e9-4eac-ab38-e5d5ee91f569 could not be found. Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:52.747036 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:52.752371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:52.752371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:52.752371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:52.752371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:55:52.752371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:55:52.752371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aad991b2-93e9-4eac-ab38-e5d5ee91f569 could not be found. Sep 08 12:55:52.752371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:52.755782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33bf033b-3c41-4a14-aa40-d9fc7abb4a66 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Returning 404 to user: Instance aad991b2-93e9-4eac-ab38-e5d5ee91f569 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:55:52.759206 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-33bf033b-3c41-4a14-aa40-d9fc7abb4a66 tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569" status: 404 len: 111 microversion: 2.1 time: 0.088952 Sep 08 12:55:52.760532 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1611/3088] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:52 2022] GET /compute/v2.1/servers/aad991b2-93e9-4eac-ab38-e5d5ee91f569 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:55:52.771527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b63a1cdf-685d-4b00-8a74-6b9ba28ebe4c tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:52.788867 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b63a1cdf-685d-4b00-8a74-6b9ba28ebe4c tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026810 Sep 08 12:55:52.790399 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1612/3089] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:52.801796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-45114708-4a47-466d-815f-058d4bb9badc tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] Calling method '.version_select at 0x7fdb377b78b0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:52.849742 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-45114708-4a47-466d-815f-058d4bb9badc tempest-ServersTestFqdnHostnames-1141722941 tempest-ServersTestFqdnHostnames-1141722941-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-496987803" status: 202 len: 0 microversion: 2.1 time: 0.057692 Sep 08 12:55:52.851677 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1613/3090] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 12:55:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-496987803 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:55:52.867072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca481c4d-8f6f-4740-9160-681f25ec0806 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:52.958759 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca481c4d-8f6f-4740-9160-681f25ec0806 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.103961 Sep 08 12:55:52.964350 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1614/3091] 10.222.0.78 () {58 vars in 1144 bytes} [Thu Sep 8 12:55:52 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:52.986076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-01178252-d1f6-44a2-b3c0-ffad6f93917c tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:53.025072 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-01178252-d1f6-44a2-b3c0-ffad6f93917c tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.048571 Sep 08 12:55:53.026989 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1615/3092] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:52 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:53.068654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8215f0d4-9025-48b3-a848-520102f8a563 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:53.163603 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8215f0d4-9025-48b3-a848-520102f8a563 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.126666 Sep 08 12:55:53.165358 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1616/3093] 10.222.0.78 () {58 vars in 1148 bytes} [Thu Sep 8 12:55:53 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:55:53.177253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d87affe4-b9e8-4e41-ab92-a3846c73bfeb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:53.179337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d87affe4-b9e8-4e41-ab92-a3846c73bfeb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:53.211915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d87affe4-b9e8-4e41-ab92-a3846c73bfeb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:53.213748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d87affe4-b9e8-4e41-ab92-a3846c73bfeb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:53.215607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d87affe4-b9e8-4e41-ab92-a3846c73bfeb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:53.217428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d87affe4-b9e8-4e41-ab92-a3846c73bfeb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:53.218768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d87affe4-b9e8-4e41-ab92-a3846c73bfeb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:53.223324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d87affe4-b9e8-4e41-ab92-a3846c73bfeb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:53.523906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=16 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:53.656298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:54.121856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-95747d48-2b4b-444a-9382-335b8eeba679 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:54.132920 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-95747d48-2b4b-444a-9382-335b8eeba679 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1501 microversion: 2.1 time: 1.606641 Sep 08 12:55:54.133572 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1478/3094] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:52 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1501 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:54.140267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-295f0024-32b0-45e7-a7f6-e0db7b03413d tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:54.158110 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-295f0024-32b0-45e7-a7f6-e0db7b03413d tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.021956 Sep 08 12:55:54.171100 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1479/3095] 10.222.0.78 () {58 vars in 1140 bytes} [Thu Sep 8 12:55:54 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:54.182207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0457f55f-2cf7-49d9-bc20-c4df6450066a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:54.183129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0457f55f-2cf7-49d9-bc20-c4df6450066a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:54.208980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0457f55f-2cf7-49d9-bc20-c4df6450066a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:54.209879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0457f55f-2cf7-49d9-bc20-c4df6450066a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:54.210666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0457f55f-2cf7-49d9-bc20-c4df6450066a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:54.225903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0457f55f-2cf7-49d9-bc20-c4df6450066a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:54.227261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0457f55f-2cf7-49d9-bc20-c4df6450066a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:54.228446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0457f55f-2cf7-49d9-bc20-c4df6450066a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:54.710746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d87affe4-b9e8-4e41-ab92-a3846c73bfeb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:54.728449 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d87affe4-b9e8-4e41-ab92-a3846c73bfeb tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1504 microversion: 2.1 time: 1.561198 Sep 08 12:55:54.729277 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1617/3096] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:53 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1504 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:54.734180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-037eb073-cc6f-4576-a601-993c9f90a6dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:54.734800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-037eb073-cc6f-4576-a601-993c9f90a6dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:54.760444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-037eb073-cc6f-4576-a601-993c9f90a6dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:54.761092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-037eb073-cc6f-4576-a601-993c9f90a6dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:54.761540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-037eb073-cc6f-4576-a601-993c9f90a6dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:54.762277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-037eb073-cc6f-4576-a601-993c9f90a6dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:54.762740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-037eb073-cc6f-4576-a601-993c9f90a6dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:54.763169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-037eb073-cc6f-4576-a601-993c9f90a6dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:55.393442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0457f55f-2cf7-49d9-bc20-c4df6450066a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:55.416086 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0457f55f-2cf7-49d9-bc20-c4df6450066a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1314 microversion: 2.1 time: 1.241881 Sep 08 12:55:55.419518 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1480/3097] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:54 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1314 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:55.426778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e40c4c27-c329-4fda-b95b-ab49fe51092a tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:55.440079 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e40c4c27-c329-4fda-b95b-ab49fe51092a tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018293 Sep 08 12:55:55.443617 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1481/3098] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:55 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:55.454308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7cc92be8-8d60-4f70-a511-e74abcfd81ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:55.471639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cc92be8-8d60-4f70-a511-e74abcfd81ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:55.475273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cc92be8-8d60-4f70-a511-e74abcfd81ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:55.476194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cc92be8-8d60-4f70-a511-e74abcfd81ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:55.512112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7cc92be8-8d60-4f70-a511-e74abcfd81ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Going to try to stop instance {{(pid=128971) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 12:55:55.606941 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7cc92be8-8d60-4f70-a511-e74abcfd81ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853/action" status: 202 len: 0 microversion: 2.1 time: 0.158416 Sep 08 12:55:55.609069 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1482/3099] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:55:55 2022] POST /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:55:55.627851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-505535c4-87cf-410e-8e8d-c482db0b836b req-b57e9e91-09bf-4215-85be-ecf8e5255410 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a3238c1-1ec9-4d45-8148-45e9047d3f6a", "tag": "df6655b2-552c-4b2a-9be0-50d7eee1996b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:55.653667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-505535c4-87cf-410e-8e8d-c482db0b836b req-b57e9e91-09bf-4215-85be-ecf8e5255410 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:55.655650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-505535c4-87cf-410e-8e8d-c482db0b836b req-b57e9e91-09bf-4215-85be-ecf8e5255410 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:55.656528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-505535c4-87cf-410e-8e8d-c482db0b836b req-b57e9e91-09bf-4215-85be-ecf8e5255410 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:55.675884 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-505535c4-87cf-410e-8e8d-c482db0b836b req-b57e9e91-09bf-4215-85be-ecf8e5255410 service nova] Creating event network-changed:df6655b2-552c-4b2a-9be0-50d7eee1996b for instance 3a3238c1-1ec9-4d45-8148-45e9047d3f6a on n-h2-852084-10 Sep 08 12:55:55.685531 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-505535c4-87cf-410e-8e8d-c482db0b836b req-b57e9e91-09bf-4215-85be-ecf8e5255410 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072867 Sep 08 12:55:55.687000 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1483/3100] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:55.696963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7e4428ae-00ed-49cb-9ba9-712131e3c8af tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:55.731785 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7e4428ae-00ed-49cb-9ba9-712131e3c8af tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.042866 Sep 08 12:55:55.733718 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1484/3101] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:55:55 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:55.741481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b719777d-6341-4e46-b7e9-9f272a014504 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:55.743111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b719777d-6341-4e46-b7e9-9f272a014504 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:55.752257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b719777d-6341-4e46-b7e9-9f272a014504 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:55.755088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b719777d-6341-4e46-b7e9-9f272a014504 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:55.755809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b719777d-6341-4e46-b7e9-9f272a014504 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:55.756744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b719777d-6341-4e46-b7e9-9f272a014504 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:55.757576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b719777d-6341-4e46-b7e9-9f272a014504 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:55.761039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b719777d-6341-4e46-b7e9-9f272a014504 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:55.792358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-037eb073-cc6f-4576-a601-993c9f90a6dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:55.801739 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-037eb073-cc6f-4576-a601-993c9f90a6dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1317 microversion: 2.1 time: 1.071306 Sep 08 12:55:55.830626 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1618/3102] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:54 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1317 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:55.844352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e005c77-a300-4502-a309-a878bd4e3154 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:55.900878 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e005c77-a300-4502-a309-a878bd4e3154 tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.068592 Sep 08 12:55:55.904095 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1619/3103] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:55:55 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:55.913993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aed6f27b-ed0e-43c2-931b-5d6e2169b60b tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:55.916892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aed6f27b-ed0e-43c2-931b-5d6e2169b60b tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:55.934442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aed6f27b-ed0e-43c2-931b-5d6e2169b60b tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:55.943133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aed6f27b-ed0e-43c2-931b-5d6e2169b60b tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:55.945767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aed6f27b-ed0e-43c2-931b-5d6e2169b60b tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:55.946874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aed6f27b-ed0e-43c2-931b-5d6e2169b60b tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:55.948987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aed6f27b-ed0e-43c2-931b-5d6e2169b60b tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:55.950433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aed6f27b-ed0e-43c2-931b-5d6e2169b60b tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:56.155596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aed6f27b-ed0e-43c2-931b-5d6e2169b60b tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efebdd08e4546079593c6a1cb852e96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a64b48a86d3445b8610aaa70845fc14', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:56.165066 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aed6f27b-ed0e-43c2-931b-5d6e2169b60b tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 200 len: 1462 microversion: 2.1 time: 0.259463 Sep 08 12:55:56.170284 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1620/3104] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:55 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 1462 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:56.175767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0bcc6fef-f9d8-4e59-88b1-d4ab0c3c087d tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:56.189100 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0bcc6fef-f9d8-4e59-88b1-d4ab0c3c087d tempest-FlavorsV2TestJSON-664957429 tempest-FlavorsV2TestJSON-664957429-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017648 Sep 08 12:55:56.190027 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1621/3105] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:55:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:56.444591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3397db18-088f-452c-afab-9bd1d3c0d5cb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:56.446934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3397db18-088f-452c-afab-9bd1d3c0d5cb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:56.456583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3397db18-088f-452c-afab-9bd1d3c0d5cb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:56.457097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3397db18-088f-452c-afab-9bd1d3c0d5cb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:56.457539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3397db18-088f-452c-afab-9bd1d3c0d5cb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:56.463852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3397db18-088f-452c-afab-9bd1d3c0d5cb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:56.464662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3397db18-088f-452c-afab-9bd1d3c0d5cb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:56.465317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3397db18-088f-452c-afab-9bd1d3c0d5cb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:58.101211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b719777d-6341-4e46-b7e9-9f272a014504 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:58.141859 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b719777d-6341-4e46-b7e9-9f272a014504 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 2.406214 Sep 08 12:55:58.143074 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1485/3106] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:55 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 2409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:58.150414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d91c37ac-64f7-4f68-8a0c-41df12722170 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:58.151661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d91c37ac-64f7-4f68-8a0c-41df12722170 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:58.160789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d91c37ac-64f7-4f68-8a0c-41df12722170 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:58.161711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d91c37ac-64f7-4f68-8a0c-41df12722170 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:58.162398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d91c37ac-64f7-4f68-8a0c-41df12722170 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:58.163926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d91c37ac-64f7-4f68-8a0c-41df12722170 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:58.164805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d91c37ac-64f7-4f68-8a0c-41df12722170 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:58.165470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d91c37ac-64f7-4f68-8a0c-41df12722170 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:58.604730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3397db18-088f-452c-afab-9bd1d3c0d5cb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:58.638516 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3397db18-088f-452c-afab-9bd1d3c0d5cb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1314 microversion: 2.1 time: 2.201156 Sep 08 12:55:58.639612 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1622/3107] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:56 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1314 bytes in 2203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:58.660422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b9e7452-7723-47e0-af97-deccb98b94e0 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:58.661443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7b9e7452-7723-47e0-af97-deccb98b94e0 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:58.676179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b9e7452-7723-47e0-af97-deccb98b94e0 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:58.677162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b9e7452-7723-47e0-af97-deccb98b94e0 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:58.677980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b9e7452-7723-47e0-af97-deccb98b94e0 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:58.681005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b9e7452-7723-47e0-af97-deccb98b94e0 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:58.682610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b9e7452-7723-47e0-af97-deccb98b94e0 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:58.683957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b9e7452-7723-47e0-af97-deccb98b94e0 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:58.705240 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-7b9e7452-7723-47e0-af97-deccb98b94e0 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] HTTP exception thrown: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b9e7452-7723-47e0-af97-deccb98b94e0 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Request method failure captured: Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb HTTP/1.1 Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYrofqvvSXYSUFNuPIozTtmSomdWTP0LGFXLPSEQ0-R2FfBnbo1skyENzPeNIPTm14uQz2uaPCYx5678aKff5f4FhLTgVRh5F2mzxjEWYvSLjx-EY_9JSqiA5tSTjnx6CcYkNzzX0kdkwpw5Y_i8yvnwYhQhZ0bj6WglElK2ApjYFw Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6efebdd08e4546079593c6a1cb852e96 Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '69c480f3-d35b-40e1-9930-b894bf174adb'} Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:58.707587 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:58.712097 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:58.712097 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:58.712097 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:58.712097 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:55:58.712097 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:55:58.712097 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:58.712097 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:58.716215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b9e7452-7723-47e0-af97-deccb98b94e0 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Returning 404 to user: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:55:58.717943 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7b9e7452-7723-47e0-af97-deccb98b94e0 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 404 len: 111 microversion: 2.1 time: 0.068112 Sep 08 12:55:58.726172 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1623/3108] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:58 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:55:58.736851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c09be1b7-c773-4444-9cf3-958326a438a0 req-20f4fbf0-62d7-4abf-82aa-dece73fc9b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c480f3-d35b-40e1-9930-b894bf174adb", "name": "network-vif-deleted", "tag": "188ffb60-bcd5-43f8-8c63-20d0071dea67"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:55:58.752284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c09be1b7-c773-4444-9cf3-958326a438a0 req-20f4fbf0-62d7-4abf-82aa-dece73fc9b79 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:58.753450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c09be1b7-c773-4444-9cf3-958326a438a0 req-20f4fbf0-62d7-4abf-82aa-dece73fc9b79 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:58.756017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c09be1b7-c773-4444-9cf3-958326a438a0 req-20f4fbf0-62d7-4abf-82aa-dece73fc9b79 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:58.786632 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c09be1b7-c773-4444-9cf3-958326a438a0 req-20f4fbf0-62d7-4abf-82aa-dece73fc9b79 service nova] Creating event network-vif-deleted:188ffb60-bcd5-43f8-8c63-20d0071dea67 for instance 69c480f3-d35b-40e1-9930-b894bf174adb on n-h2-852084-10 Sep 08 12:55:58.805616 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c09be1b7-c773-4444-9cf3-958326a438a0 req-20f4fbf0-62d7-4abf-82aa-dece73fc9b79 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075450 Sep 08 12:55:58.809167 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1624/3109] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:58.830863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e429f67e-7b06-4d67-83d9-72069f71e291 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:58.871453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:55:58.874022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.compute.server_groups [None req-e429f67e-7b06-4d67-83d9-72069f71e291 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Querying cell eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) for 1 instances {{(pid=128970) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 12:55:58.875026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e429f67e-7b06-4d67-83d9-72069f71e291 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:58.875771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e429f67e-7b06-4d67-83d9-72069f71e291 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:58.876416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e429f67e-7b06-4d67-83d9-72069f71e291 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:58.897466 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e429f67e-7b06-4d67-83d9-72069f71e291 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.086080 Sep 08 12:55:58.898757 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1625/3110] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 12:55:58 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:58.912909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e023f3a2-0535-4ec8-80bf-2e21cdc3bd1d tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:58.947849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.compute.server_groups [None req-e023f3a2-0535-4ec8-80bf-2e21cdc3bd1d tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Querying cell eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) for 1 instances {{(pid=128970) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Sep 08 12:55:58.949125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e023f3a2-0535-4ec8-80bf-2e21cdc3bd1d tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:58.949831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e023f3a2-0535-4ec8-80bf-2e21cdc3bd1d tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:58.950273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e023f3a2-0535-4ec8-80bf-2e21cdc3bd1d tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:58.966006 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e023f3a2-0535-4ec8-80bf-2e21cdc3bd1d tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/ef07e6b3-df91-4e2d-af0b-abb8af8e369a" status: 200 len: 184 microversion: 2.1 time: 0.058568 Sep 08 12:55:58.967097 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1626/3111] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:55:58 2022] GET /compute/v2.1/os-server-groups/ef07e6b3-df91-4e2d-af0b-abb8af8e369a => generated 184 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:55:58.980661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-730ab4fc-fcfa-4ad8-859c-2cbf35c75c34 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:58.981376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-730ab4fc-fcfa-4ad8-859c-2cbf35c75c34 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:58.999458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-730ab4fc-fcfa-4ad8-859c-2cbf35c75c34 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:59.000084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-730ab4fc-fcfa-4ad8-859c-2cbf35c75c34 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:59.000951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-730ab4fc-fcfa-4ad8-859c-2cbf35c75c34 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:59.002027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-730ab4fc-fcfa-4ad8-859c-2cbf35c75c34 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:59.002694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-730ab4fc-fcfa-4ad8-859c-2cbf35c75c34 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:59.003371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-730ab4fc-fcfa-4ad8-859c-2cbf35c75c34 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:59.022196 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-730ab4fc-fcfa-4ad8-859c-2cbf35c75c34 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] HTTP exception thrown: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-730ab4fc-fcfa-4ad8-859c-2cbf35c75c34 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Request method failure captured: Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb HTTP/1.1 Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYrofqvvSXYSUFNuPIozTtmSomdWTP0LGFXLPSEQ0-R2FfBnbo1skyENzPeNIPTm14uQz2uaPCYx5678aKff5f4FhLTgVRh5F2mzxjEWYvSLjx-EY_9JSqiA5tSTjnx6CcYkNzzX0kdkwpw5Y_i8yvnwYhQhZ0bj6WglElK2ApjYFw Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6efebdd08e4546079593c6a1cb852e96 Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '69c480f3-d35b-40e1-9930-b894bf174adb'} Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:55:59.023430 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:55:59.027377 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:59.027377 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.027377 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:59.027377 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.027377 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.027377 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:59.027377 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:59.027377 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:55:59.027377 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:55:59.027377 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:59.027377 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.030254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-730ab4fc-fcfa-4ad8-859c-2cbf35c75c34 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Returning 404 to user: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:55:59.031160 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-730ab4fc-fcfa-4ad8-859c-2cbf35c75c34 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "DELETE /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 404 len: 111 microversion: 2.1 time: 0.055139 Sep 08 12:55:59.031780 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1627/3112] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:55:58 2022] DELETE /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 12:55:59.044623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac5a45f7-35f2-42a9-98a2-eaec9b85626c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:59.045254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ac5a45f7-35f2-42a9-98a2-eaec9b85626c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] [instance: 69c480f3-d35b-40e1-9930-b894bf174adb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:59.052414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac5a45f7-35f2-42a9-98a2-eaec9b85626c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:59.053507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac5a45f7-35f2-42a9-98a2-eaec9b85626c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:59.054288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac5a45f7-35f2-42a9-98a2-eaec9b85626c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:59.055316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac5a45f7-35f2-42a9-98a2-eaec9b85626c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:59.056063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac5a45f7-35f2-42a9-98a2-eaec9b85626c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:59.056939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac5a45f7-35f2-42a9-98a2-eaec9b85626c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:59.072849 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-ac5a45f7-35f2-42a9-98a2-eaec9b85626c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] HTTP exception thrown: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac5a45f7-35f2-42a9-98a2-eaec9b85626c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Request method failure captured: Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb HTTP/1.1 Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYrofqvvSXYSUFNuPIozTtmSomdWTP0LGFXLPSEQ0-R2FfBnbo1skyENzPeNIPTm14uQz2uaPCYx5678aKff5f4FhLTgVRh5F2mzxjEWYvSLjx-EY_9JSqiA5tSTjnx6CcYkNzzX0kdkwpw5Y_i8yvnwYhQhZ0bj6WglElK2ApjYFw Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6efebdd08e4546079593c6a1cb852e96 Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '69c480f3-d35b-40e1-9930-b894bf174adb'} Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:59.075179 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.080512 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.080512 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:59.080512 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:59.080512 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:55:59.080512 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:55:59.080512 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. Sep 08 12:55:59.080512 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.080512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac5a45f7-35f2-42a9-98a2-eaec9b85626c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Returning 404 to user: Instance 69c480f3-d35b-40e1-9930-b894bf174adb could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:55:59.082254 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ac5a45f7-35f2-42a9-98a2-eaec9b85626c tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb" status: 404 len: 111 microversion: 2.1 time: 0.041137 Sep 08 12:55:59.083836 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1628/3113] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:59 2022] GET /compute/v2.1/servers/69c480f3-d35b-40e1-9930-b894bf174adb => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:55:59.084557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d91c37ac-64f7-4f68-8a0c-41df12722170 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:55:59.092887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e9d57688-c17a-4ba5-a14a-4b4ccb907a54 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:59.101435 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d91c37ac-64f7-4f68-8a0c-41df12722170 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1317 microversion: 2.1 time: 0.956752 Sep 08 12:55:59.107136 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e9d57688-c17a-4ba5-a14a-4b4ccb907a54 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] HTTP exception thrown: Instance group d0f136b9-ea71-4c00-bbf4-ed439156313d could not be found. Sep 08 12:55:59.116549 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1486/3114] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:58 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1317 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e9d57688-c17a-4ba5-a14a-4b4ccb907a54 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Request method failure captured: Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/os-server-groups/d0f136b9-ea71-4c00-bbf4-ed439156313d HTTP/1.1 Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYrofqvvSXYSUFNuPIozTtmSomdWTP0LGFXLPSEQ0-R2FfBnbo1skyENzPeNIPTm14uQz2uaPCYx5678aKff5f4FhLTgVRh5F2mzxjEWYvSLjx-EY_9JSqiA5tSTjnx6CcYkNzzX0kdkwpw5Y_i8yvnwYhQhZ0bj6WglElK2ApjYFw Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6efebdd08e4546079593c6a1cb852e96 Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance group d0f136b9-ea71-4c00-bbf4-ed439156313d could not be found. Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'd0f136b9-ea71-4c00-bbf4-ed439156313d'} Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d0f136b9-ea71-4c00-bbf4-ed439156313d could not be found. Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d0f136b9-ea71-4c00-bbf4-ed439156313d could not be found. Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.119119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.126373 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:59.126373 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:59.126373 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:55:59.126373 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:55:59.126373 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d0f136b9-ea71-4c00-bbf4-ed439156313d could not be found. Sep 08 12:55:59.126373 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.126373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e9d57688-c17a-4ba5-a14a-4b4ccb907a54 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Returning 404 to user: Instance group d0f136b9-ea71-4c00-bbf4-ed439156313d could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:55:59.126373 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e9d57688-c17a-4ba5-a14a-4b4ccb907a54 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/d0f136b9-ea71-4c00-bbf4-ed439156313d" status: 404 len: 117 microversion: 2.1 time: 0.033175 Sep 08 12:55:59.126373 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1629/3115] 10.222.0.78 () {58 vars in 1266 bytes} [Thu Sep 8 12:55:59 2022] DELETE /compute/v2.1/os-server-groups/d0f136b9-ea71-4c00-bbf4-ed439156313d => generated 117 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:55:59.136633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a59ce066-651c-482c-aad7-0374f822af0e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:59.145791 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-a59ce066-651c-482c-aad7-0374f822af0e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] HTTP exception thrown: Instance group 5ca7deb0-626a-4fe2-ae13-0f74d5e5eb28 could not be found. Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a59ce066-651c-482c-aad7-0374f822af0e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Request method failure captured: Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-server-groups/5ca7deb0-626a-4fe2-ae13-0f74d5e5eb28 HTTP/1.1 Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYrofqvvSXYSUFNuPIozTtmSomdWTP0LGFXLPSEQ0-R2FfBnbo1skyENzPeNIPTm14uQz2uaPCYx5678aKff5f4FhLTgVRh5F2mzxjEWYvSLjx-EY_9JSqiA5tSTjnx6CcYkNzzX0kdkwpw5Y_i8yvnwYhQhZ0bj6WglElK2ApjYFw Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6efebdd08e4546079593c6a1cb852e96 Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance group 5ca7deb0-626a-4fe2-ae13-0f74d5e5eb28 could not be found. Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '5ca7deb0-626a-4fe2-ae13-0f74d5e5eb28'} Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5ca7deb0-626a-4fe2-ae13-0f74d5e5eb28 could not be found. Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5ca7deb0-626a-4fe2-ae13-0f74d5e5eb28 could not be found. Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.149151 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.153951 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:59.153951 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:59.153951 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:55:59.153951 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:55:59.153951 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5ca7deb0-626a-4fe2-ae13-0f74d5e5eb28 could not be found. Sep 08 12:55:59.153951 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.161317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a59ce066-651c-482c-aad7-0374f822af0e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Returning 404 to user: Instance group 5ca7deb0-626a-4fe2-ae13-0f74d5e5eb28 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:55:59.169422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-122ce980-01a2-4f0c-ac2b-b732b352c19d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:59.173838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-122ce980-01a2-4f0c-ac2b-b732b352c19d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:59.177847 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a59ce066-651c-482c-aad7-0374f822af0e tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/5ca7deb0-626a-4fe2-ae13-0f74d5e5eb28" status: 404 len: 117 microversion: 2.1 time: 0.046842 Sep 08 12:55:59.181870 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1487/3116] 10.222.0.78 () {58 vars in 1266 bytes} [Thu Sep 8 12:55:59 2022] DELETE /compute/v2.1/os-server-groups/5ca7deb0-626a-4fe2-ae13-0f74d5e5eb28 => generated 117 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:55:59.189371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-122ce980-01a2-4f0c-ac2b-b732b352c19d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:59.191960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-122ce980-01a2-4f0c-ac2b-b732b352c19d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:59.193777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1efcb1cb-7b04-4640-bc29-98fbd1346ba1 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:59.194745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-122ce980-01a2-4f0c-ac2b-b732b352c19d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:59.195858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-122ce980-01a2-4f0c-ac2b-b732b352c19d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:59.197735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-122ce980-01a2-4f0c-ac2b-b732b352c19d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:59.201567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-122ce980-01a2-4f0c-ac2b-b732b352c19d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:59.217995 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1efcb1cb-7b04-4640-bc29-98fbd1346ba1 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] HTTP exception thrown: Instance group 5634e427-3ab5-449f-80c3-738256638aab could not be found. Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1efcb1cb-7b04-4640-bc29-98fbd1346ba1 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Request method failure captured: Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-server-groups/5634e427-3ab5-449f-80c3-738256638aab HTTP/1.1 Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYrofqvvSXYSUFNuPIozTtmSomdWTP0LGFXLPSEQ0-R2FfBnbo1skyENzPeNIPTm14uQz2uaPCYx5678aKff5f4FhLTgVRh5F2mzxjEWYvSLjx-EY_9JSqiA5tSTjnx6CcYkNzzX0kdkwpw5Y_i8yvnwYhQhZ0bj6WglElK2ApjYFw Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6efebdd08e4546079593c6a1cb852e96 Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance group 5634e427-3ab5-449f-80c3-738256638aab could not be found. Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '5634e427-3ab5-449f-80c3-738256638aab'} Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5634e427-3ab5-449f-80c3-738256638aab could not be found. Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5634e427-3ab5-449f-80c3-738256638aab could not be found. Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.219888 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.228154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:59.228154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:59.228154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:55:59.228154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:55:59.228154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5634e427-3ab5-449f-80c3-738256638aab could not be found. Sep 08 12:55:59.228154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.228154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1efcb1cb-7b04-4640-bc29-98fbd1346ba1 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Returning 404 to user: Instance group 5634e427-3ab5-449f-80c3-738256638aab could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:55:59.228154 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1efcb1cb-7b04-4640-bc29-98fbd1346ba1 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/5634e427-3ab5-449f-80c3-738256638aab" status: 404 len: 117 microversion: 2.1 time: 0.038150 Sep 08 12:55:59.228154 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1488/3117] 10.222.0.78 () {58 vars in 1266 bytes} [Thu Sep 8 12:55:59 2022] DELETE /compute/v2.1/os-server-groups/5634e427-3ab5-449f-80c3-738256638aab => generated 117 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:55:59.241718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d6d9710-65fd-4773-8aef-7de8cf92e602 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:59.256733 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-4d6d9710-65fd-4773-8aef-7de8cf92e602 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] HTTP exception thrown: Instance group 35046623-11b2-4915-9ea8-68011b95e478 could not be found. Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d6d9710-65fd-4773-8aef-7de8cf92e602 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Request method failure captured: Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-server-groups/35046623-11b2-4915-9ea8-68011b95e478 HTTP/1.1 Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYrofqvvSXYSUFNuPIozTtmSomdWTP0LGFXLPSEQ0-R2FfBnbo1skyENzPeNIPTm14uQz2uaPCYx5678aKff5f4FhLTgVRh5F2mzxjEWYvSLjx-EY_9JSqiA5tSTjnx6CcYkNzzX0kdkwpw5Y_i8yvnwYhQhZ0bj6WglElK2ApjYFw Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a64b48a86d3445b8610aaa70845fc14"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 2a64b48a86d3445b8610aaa70845fc14 Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerGroupTestJSON-924062652 Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6efebdd08e4546079593c6a1cb852e96 Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerGroupTestJSON-924062652-project Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance group 35046623-11b2-4915-9ea8-68011b95e478 could not be found. Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '35046623-11b2-4915-9ea8-68011b95e478'} Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 35046623-11b2-4915-9ea8-68011b95e478 could not be found. Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 35046623-11b2-4915-9ea8-68011b95e478 could not be found. Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.261100 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:55:59.265570 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:55:59.265570 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:55:59.265570 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:55:59.265570 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:55:59.265570 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 35046623-11b2-4915-9ea8-68011b95e478 could not be found. Sep 08 12:55:59.265570 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:55:59.265570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d6d9710-65fd-4773-8aef-7de8cf92e602 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Returning 404 to user: Instance group 35046623-11b2-4915-9ea8-68011b95e478 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:55:59.268366 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4d6d9710-65fd-4773-8aef-7de8cf92e602 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/35046623-11b2-4915-9ea8-68011b95e478" status: 404 len: 117 microversion: 2.1 time: 0.039617 Sep 08 12:55:59.272161 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1489/3118] 10.222.0.78 () {58 vars in 1266 bytes} [Thu Sep 8 12:55:59 2022] DELETE /compute/v2.1/os-server-groups/35046623-11b2-4915-9ea8-68011b95e478 => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:55:59.281699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-819ba995-c08e-487c-80ac-8f4c8a1f1337 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:59.338023 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-819ba995-c08e-487c-80ac-8f4c8a1f1337 tempest-ServerGroupTestJSON-924062652 tempest-ServerGroupTestJSON-924062652-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/ef07e6b3-df91-4e2d-af0b-abb8af8e369a" status: 204 len: 0 microversion: 2.1 time: 0.061932 Sep 08 12:55:59.338628 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1490/3119] 10.222.0.78 () {58 vars in 1266 bytes} [Thu Sep 8 12:55:59 2022] DELETE /compute/v2.1/os-server-groups/ef07e6b3-df91-4e2d-af0b-abb8af8e369a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:55:59.670058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4fda65dc-e376-40bd-bd70-bd628caf070f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:55:59.671553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4fda65dc-e376-40bd-bd70-bd628caf070f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:55:59.692291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fda65dc-e376-40bd-bd70-bd628caf070f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:59.693672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fda65dc-e376-40bd-bd70-bd628caf070f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:59.694610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fda65dc-e376-40bd-bd70-bd628caf070f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:55:59.696495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fda65dc-e376-40bd-bd70-bd628caf070f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:55:59.697404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fda65dc-e376-40bd-bd70-bd628caf070f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:55:59.699153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fda65dc-e376-40bd-bd70-bd628caf070f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:00.161705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-122ce980-01a2-4f0c-ac2b-b732b352c19d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:00.193312 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-122ce980-01a2-4f0c-ac2b-b732b352c19d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 1.029799 Sep 08 12:56:00.194505 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1630/3120] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:59 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:00.201657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3b71c89c-32ea-4caf-be62-571b1fd89447 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:00.202699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3b71c89c-32ea-4caf-be62-571b1fd89447 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:00.213424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b71c89c-32ea-4caf-be62-571b1fd89447 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:00.214317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b71c89c-32ea-4caf-be62-571b1fd89447 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:00.214997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b71c89c-32ea-4caf-be62-571b1fd89447 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:00.219325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b71c89c-32ea-4caf-be62-571b1fd89447 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:00.220463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b71c89c-32ea-4caf-be62-571b1fd89447 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:00.221429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b71c89c-32ea-4caf-be62-571b1fd89447 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:00.839060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4fda65dc-e376-40bd-bd70-bd628caf070f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:00.890972 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4fda65dc-e376-40bd-bd70-bd628caf070f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1314 microversion: 2.1 time: 1.229428 Sep 08 12:56:00.893068 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1491/3121] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:55:59 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1314 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:00.944226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-18092e6f-3154-4825-80f3-8962b36b716a req-9739abe9-be2c-4c24-a1c8-6fb946e7be28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3368fcc-195b-45a7-92da-7bd0f4337247", "tag": "a5c1871f-65d9-4128-935c-28aed8162d68"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:00.975501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-18092e6f-3154-4825-80f3-8962b36b716a req-9739abe9-be2c-4c24-a1c8-6fb946e7be28 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:00.976636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-18092e6f-3154-4825-80f3-8962b36b716a req-9739abe9-be2c-4c24-a1c8-6fb946e7be28 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:00.977533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-18092e6f-3154-4825-80f3-8962b36b716a req-9739abe9-be2c-4c24-a1c8-6fb946e7be28 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:01.009025 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-18092e6f-3154-4825-80f3-8962b36b716a req-9739abe9-be2c-4c24-a1c8-6fb946e7be28 service nova] Creating event network-changed:a5c1871f-65d9-4128-935c-28aed8162d68 for instance e3368fcc-195b-45a7-92da-7bd0f4337247 on n-h1-852084-10 Sep 08 12:56:01.020352 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-18092e6f-3154-4825-80f3-8962b36b716a req-9739abe9-be2c-4c24-a1c8-6fb946e7be28 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091788 Sep 08 12:56:01.024429 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1492/3122] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:56:01.527496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7d39c086-3e3b-4845-b947-8f852a79637c tempest-FlavorsV2NegativeTest-1657169931 tempest-FlavorsV2NegativeTest-1657169931-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:01.546892 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7d39c086-3e3b-4845-b947-8f852a79637c tempest-FlavorsV2NegativeTest-1657169931 tempest-FlavorsV2NegativeTest-1657169931-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.377715 Sep 08 12:56:01.579835 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1493/3123] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:56:01 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:56:01.595636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7a5b1035-b14d-49b2-8bb4-82372e086d05 req-d2395781-0a8a-44e5-ad7c-4abaa627a25a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f021d74-5cfc-4132-a8f4-ac61b49f8302", "name": "network-vif-plugged", "status": "completed", "tag": "0ea4e458-ce86-463d-b57e-0ebbf8afaac5"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:01.645891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7a5b1035-b14d-49b2-8bb4-82372e086d05 req-d2395781-0a8a-44e5-ad7c-4abaa627a25a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:01.646502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7a5b1035-b14d-49b2-8bb4-82372e086d05 req-d2395781-0a8a-44e5-ad7c-4abaa627a25a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:01.646969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7a5b1035-b14d-49b2-8bb4-82372e086d05 req-d2395781-0a8a-44e5-ad7c-4abaa627a25a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:01.671013 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7a5b1035-b14d-49b2-8bb4-82372e086d05 req-d2395781-0a8a-44e5-ad7c-4abaa627a25a service nova] Creating event network-vif-plugged:0ea4e458-ce86-463d-b57e-0ebbf8afaac5 for instance 8f021d74-5cfc-4132-a8f4-ac61b49f8302 on n-h2-852084-10 Sep 08 12:56:01.680405 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7a5b1035-b14d-49b2-8bb4-82372e086d05 req-d2395781-0a8a-44e5-ad7c-4abaa627a25a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091206 Sep 08 12:56:01.682225 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1494/3124] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:56:01.690497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6125481d-38ca-4da5-a36f-4a6c8dd8c7c8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:01.692399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6125481d-38ca-4da5-a36f-4a6c8dd8c7c8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:01.699742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6125481d-38ca-4da5-a36f-4a6c8dd8c7c8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:01.700542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6125481d-38ca-4da5-a36f-4a6c8dd8c7c8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:01.701174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6125481d-38ca-4da5-a36f-4a6c8dd8c7c8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:01.702378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6125481d-38ca-4da5-a36f-4a6c8dd8c7c8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:01.703039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6125481d-38ca-4da5-a36f-4a6c8dd8c7c8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:01.703672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6125481d-38ca-4da5-a36f-4a6c8dd8c7c8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:01.874148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3b71c89c-32ea-4caf-be62-571b1fd89447 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:01.961025 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3b71c89c-32ea-4caf-be62-571b1fd89447 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1317 microversion: 2.1 time: 1.751837 Sep 08 12:56:01.997136 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1631/3125] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:00 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1317 bytes in 1801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:02.029255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-93f0206b-4e85-4ccd-8c1f-22fb8903e325 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:02.031182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-93f0206b-4e85-4ccd-8c1f-22fb8903e325 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:02.053780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93f0206b-4e85-4ccd-8c1f-22fb8903e325 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:02.055433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93f0206b-4e85-4ccd-8c1f-22fb8903e325 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:02.055995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93f0206b-4e85-4ccd-8c1f-22fb8903e325 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:02.056766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93f0206b-4e85-4ccd-8c1f-22fb8903e325 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:02.059196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93f0206b-4e85-4ccd-8c1f-22fb8903e325 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:02.059684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93f0206b-4e85-4ccd-8c1f-22fb8903e325 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:02.079349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:56:02.643098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6125481d-38ca-4da5-a36f-4a6c8dd8c7c8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:02.733247 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6125481d-38ca-4da5-a36f-4a6c8dd8c7c8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 1.041991 Sep 08 12:56:02.735852 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1495/3126] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:01 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:02.818170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-93f0206b-4e85-4ccd-8c1f-22fb8903e325 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:02.833535 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-93f0206b-4e85-4ccd-8c1f-22fb8903e325 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1314 microversion: 2.1 time: 0.831781 Sep 08 12:56:02.851200 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1632/3127] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:01 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1314 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:02.955045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4e9b0ac9-2f6b-473b-9fde-fdea3a11389f tempest-FlavorsV2NegativeTest-1657169931 tempest-FlavorsV2NegativeTest-1657169931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-913642133", "imageRef": "483bb33a-85b0-4894-a5c9-e8a0645501e1", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:03.035169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-995701cb-7a3a-4321-990c-ea6b18825b08 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:03.037498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-995701cb-7a3a-4321-990c-ea6b18825b08 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:03.045375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-4e9b0ac9-2f6b-473b-9fde-fdea3a11389f tempest-FlavorsV2NegativeTest-1657169931 tempest-FlavorsV2NegativeTest-1657169931-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:56:03.074739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-995701cb-7a3a-4321-990c-ea6b18825b08 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:03.076105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-995701cb-7a3a-4321-990c-ea6b18825b08 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:03.077905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-995701cb-7a3a-4321-990c-ea6b18825b08 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:03.080115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-995701cb-7a3a-4321-990c-ea6b18825b08 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:03.081804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-995701cb-7a3a-4321-990c-ea6b18825b08 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:03.085966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-995701cb-7a3a-4321-990c-ea6b18825b08 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:03.677330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-995701cb-7a3a-4321-990c-ea6b18825b08 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:03.689695 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-995701cb-7a3a-4321-990c-ea6b18825b08 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1317 microversion: 2.1 time: 0.669927 Sep 08 12:56:03.721565 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1633/3128] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:03 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1317 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:03.783497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00f221ff-e10c-4c97-af49-151999654951 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:03.785082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00f221ff-e10c-4c97-af49-151999654951 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:03.792753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00f221ff-e10c-4c97-af49-151999654951 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:03.793711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00f221ff-e10c-4c97-af49-151999654951 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:03.795304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00f221ff-e10c-4c97-af49-151999654951 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:03.796315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00f221ff-e10c-4c97-af49-151999654951 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:03.796964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00f221ff-e10c-4c97-af49-151999654951 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:03.797601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00f221ff-e10c-4c97-af49-151999654951 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:03.810730 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-4e9b0ac9-2f6b-473b-9fde-fdea3a11389f tempest-FlavorsV2NegativeTest-1657169931 tempest-FlavorsV2NegativeTest-1657169931-project] HTTP exception thrown: Flavor's memory is too small for requested image. Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4e9b0ac9-2f6b-473b-9fde-fdea3a11389f tempest-FlavorsV2NegativeTest-1657169931 tempest-FlavorsV2NegativeTest-1657169931-project] Request method failure captured: Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 142 Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeZgTdL_Mw4sbmftwZ_R9j24bqD20O37qe0nWaGwEIm0wFJfOQqCENGre8u3D8Mix1VVWWNGunFHv6600K3cE_ncF-cFFm_NQ0sZslk9Zc6P_e0liGw42VVPdEC0m-bYNeY7vL7bFaEmj8yasR5JgrGxx_B-bTQikw9kYQ1C-LaLJho Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 746a89722d654f178c5e352456bef798 Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FlavorsV2NegativeTest-1657169931 Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_746a89722d654f178c5e352456bef798"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/746a89722d654f178c5e352456bef798"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/746a89722d654f178c5e352456bef798"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/746a89722d654f178c5e352456bef798"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FlavorsV2NegativeTest-1657169931 Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 746a89722d654f178c5e352456bef798 Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1657169931 Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FlavorsV2NegativeTest-1657169931-project Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6ca4f9c21a18414896e13d655a30c6f6 Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FlavorsV2NegativeTest-1657169931-project Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-913642133", "imageRef": "483bb33a-85b0-4894-a5c9-e8a0645501e1", "flavorRef": "452"}} Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: exception: Flavor's memory is too small for requested image. Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-913642133', 'imageRef': '483bb33a-85b0-4894-a5c9-e8a0645501e1', 'flavorRef': '452'}}} Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:56:03.812815 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4e9b0ac9-2f6b-473b-9fde-fdea3a11389f tempest-FlavorsV2NegativeTest-1657169931 tempest-FlavorsV2NegativeTest-1657169931-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:56:03.818547 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4e9b0ac9-2f6b-473b-9fde-fdea3a11389f tempest-FlavorsV2NegativeTest-1657169931 tempest-FlavorsV2NegativeTest-1657169931-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.863504 Sep 08 12:56:03.823274 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1496/3129] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:56:02 2022] POST /compute/v2.1/servers => generated 93 bytes in 870 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 12:56:03.859805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-645937e9-2641-4d5e-a017-2d6f365d0b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:03.860725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-645937e9-2641-4d5e-a017-2d6f365d0b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:03.870305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-645937e9-2641-4d5e-a017-2d6f365d0b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:03.871272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-645937e9-2641-4d5e-a017-2d6f365d0b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:03.873441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-645937e9-2641-4d5e-a017-2d6f365d0b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:03.874099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-645937e9-2641-4d5e-a017-2d6f365d0b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:03.875218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-645937e9-2641-4d5e-a017-2d6f365d0b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:03.876060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-645937e9-2641-4d5e-a017-2d6f365d0b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:04.201548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00f221ff-e10c-4c97-af49-151999654951 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:04.216463 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00f221ff-e10c-4c97-af49-151999654951 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 0.437816 Sep 08 12:56:04.220014 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1634/3130] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:03 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:04.310801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-645937e9-2641-4d5e-a017-2d6f365d0b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:04.322987 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-645937e9-2641-4d5e-a017-2d6f365d0b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1314 microversion: 2.1 time: 0.468508 Sep 08 12:56:04.323623 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1497/3131] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:03 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:04.722326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-837b488e-925e-406c-9f14-778cd1a17fe4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:04.723512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-837b488e-925e-406c-9f14-778cd1a17fe4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:04.732167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-837b488e-925e-406c-9f14-778cd1a17fe4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:04.733030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-837b488e-925e-406c-9f14-778cd1a17fe4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:04.733806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-837b488e-925e-406c-9f14-778cd1a17fe4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:04.734747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-837b488e-925e-406c-9f14-778cd1a17fe4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:04.735440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-837b488e-925e-406c-9f14-778cd1a17fe4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:04.736101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-837b488e-925e-406c-9f14-778cd1a17fe4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:05.010277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-85032bc3-41c1-4b7a-8cf3-d80826645847 req-25304eff-bfe3-41ab-9d7b-c847417c0c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3238c1-1ec9-4d45-8148-45e9047d3f6a", "name": "network-vif-plugged", "status": "completed", "tag": "df6655b2-552c-4b2a-9be0-50d7eee1996b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:05.042408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-85032bc3-41c1-4b7a-8cf3-d80826645847 req-25304eff-bfe3-41ab-9d7b-c847417c0c5f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:05.042925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-85032bc3-41c1-4b7a-8cf3-d80826645847 req-25304eff-bfe3-41ab-9d7b-c847417c0c5f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:05.055904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-85032bc3-41c1-4b7a-8cf3-d80826645847 req-25304eff-bfe3-41ab-9d7b-c847417c0c5f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:05.106015 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-85032bc3-41c1-4b7a-8cf3-d80826645847 req-25304eff-bfe3-41ab-9d7b-c847417c0c5f service nova] Creating event network-vif-plugged:df6655b2-552c-4b2a-9be0-50d7eee1996b for instance 3a3238c1-1ec9-4d45-8148-45e9047d3f6a on n-h2-852084-10 Sep 08 12:56:05.128735 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-85032bc3-41c1-4b7a-8cf3-d80826645847 req-25304eff-bfe3-41ab-9d7b-c847417c0c5f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121785 Sep 08 12:56:05.129708 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1498/3132] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:56:05.243898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9e0ac82b-eced-49f1-8172-95420b342c1a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:05.244844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9e0ac82b-eced-49f1-8172-95420b342c1a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:05.265199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e0ac82b-eced-49f1-8172-95420b342c1a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:05.266231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e0ac82b-eced-49f1-8172-95420b342c1a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:05.266948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e0ac82b-eced-49f1-8172-95420b342c1a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:05.269546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e0ac82b-eced-49f1-8172-95420b342c1a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:05.270315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e0ac82b-eced-49f1-8172-95420b342c1a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:05.270951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e0ac82b-eced-49f1-8172-95420b342c1a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:06.237469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-837b488e-925e-406c-9f14-778cd1a17fe4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:06.256723 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-837b488e-925e-406c-9f14-778cd1a17fe4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1317 microversion: 2.1 time: 1.544994 Sep 08 12:56:06.257488 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1635/3133] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:04 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1317 bytes in 1547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:06.262619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ba20b85-e94b-4753-91e4-6d672bb67b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:06.264608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6ba20b85-e94b-4753-91e4-6d672bb67b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:06.286036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ba20b85-e94b-4753-91e4-6d672bb67b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:06.286555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ba20b85-e94b-4753-91e4-6d672bb67b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:06.287012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ba20b85-e94b-4753-91e4-6d672bb67b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:06.287787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ba20b85-e94b-4753-91e4-6d672bb67b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:06.288252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ba20b85-e94b-4753-91e4-6d672bb67b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:06.288708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ba20b85-e94b-4753-91e4-6d672bb67b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:06.552900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9e0ac82b-eced-49f1-8172-95420b342c1a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:06.621441 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9e0ac82b-eced-49f1-8172-95420b342c1a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 1.382449 Sep 08 12:56:06.622071 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1499/3134] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:05 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:07.282902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-58b5e368-cab5-4c36-9dca-369f75ccf9dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:07.284124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-58b5e368-cab5-4c36-9dca-369f75ccf9dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:07.299086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58b5e368-cab5-4c36-9dca-369f75ccf9dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:07.299551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58b5e368-cab5-4c36-9dca-369f75ccf9dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:07.300430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58b5e368-cab5-4c36-9dca-369f75ccf9dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:07.301812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58b5e368-cab5-4c36-9dca-369f75ccf9dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:07.302826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58b5e368-cab5-4c36-9dca-369f75ccf9dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:07.303862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58b5e368-cab5-4c36-9dca-369f75ccf9dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:08.187096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6ba20b85-e94b-4753-91e4-6d672bb67b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:08.216053 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6ba20b85-e94b-4753-91e4-6d672bb67b3f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1314 microversion: 2.1 time: 1.944701 Sep 08 12:56:08.216547 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1636/3135] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:06 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1314 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:08.239158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dcb09893-ddc3-435f-872d-8763635a473c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:08.239925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dcb09893-ddc3-435f-872d-8763635a473c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:08.265170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcb09893-ddc3-435f-872d-8763635a473c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:08.265687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcb09893-ddc3-435f-872d-8763635a473c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:08.266148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcb09893-ddc3-435f-872d-8763635a473c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:08.267149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcb09893-ddc3-435f-872d-8763635a473c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:08.269807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcb09893-ddc3-435f-872d-8763635a473c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:08.270267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcb09893-ddc3-435f-872d-8763635a473c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:08.642497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-58b5e368-cab5-4c36-9dca-369f75ccf9dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:08.660931 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-58b5e368-cab5-4c36-9dca-369f75ccf9dc tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1317 microversion: 2.1 time: 1.383858 Sep 08 12:56:08.676545 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1500/3136] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:07 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1317 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:09.098144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dcb09893-ddc3-435f-872d-8763635a473c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:09.117682 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dcb09893-ddc3-435f-872d-8763635a473c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 0.886623 Sep 08 12:56:09.124590 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1637/3137] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:08 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:09.208080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-90d8382a-92ed-4d32-b099-8cecfcddcd96 req-a88eee05-ce42-476b-8642-be768e53a52b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3368fcc-195b-45a7-92da-7bd0f4337247", "name": "network-vif-plugged", "status": "completed", "tag": "a5c1871f-65d9-4128-935c-28aed8162d68"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:09.245495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d87cf08c-326c-4a9a-bc0c-94d1f84057bd tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:09.246294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d87cf08c-326c-4a9a-bc0c-94d1f84057bd tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:09.256835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-90d8382a-92ed-4d32-b099-8cecfcddcd96 req-a88eee05-ce42-476b-8642-be768e53a52b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:09.257329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-90d8382a-92ed-4d32-b099-8cecfcddcd96 req-a88eee05-ce42-476b-8642-be768e53a52b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:09.262526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d87cf08c-326c-4a9a-bc0c-94d1f84057bd tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:09.265799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-90d8382a-92ed-4d32-b099-8cecfcddcd96 req-a88eee05-ce42-476b-8642-be768e53a52b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:09.271539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d87cf08c-326c-4a9a-bc0c-94d1f84057bd tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:09.272206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d87cf08c-326c-4a9a-bc0c-94d1f84057bd tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:09.272986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d87cf08c-326c-4a9a-bc0c-94d1f84057bd tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:09.278567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d87cf08c-326c-4a9a-bc0c-94d1f84057bd tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:09.285488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d87cf08c-326c-4a9a-bc0c-94d1f84057bd tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:09.333026 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-90d8382a-92ed-4d32-b099-8cecfcddcd96 req-a88eee05-ce42-476b-8642-be768e53a52b service nova] Creating event network-vif-plugged:a5c1871f-65d9-4128-935c-28aed8162d68 for instance e3368fcc-195b-45a7-92da-7bd0f4337247 on n-h1-852084-10 Sep 08 12:56:09.376373 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-90d8382a-92ed-4d32-b099-8cecfcddcd96 req-a88eee05-ce42-476b-8642-be768e53a52b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167307 Sep 08 12:56:09.383383 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1501/3138] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:56:09.703153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92cefd31-2d6b-488e-b568-990527aaa320 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:09.705805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-92cefd31-2d6b-488e-b568-990527aaa320 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:09.739210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92cefd31-2d6b-488e-b568-990527aaa320 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:09.742547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92cefd31-2d6b-488e-b568-990527aaa320 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:09.745362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92cefd31-2d6b-488e-b568-990527aaa320 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:09.750047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92cefd31-2d6b-488e-b568-990527aaa320 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:09.751059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92cefd31-2d6b-488e-b568-990527aaa320 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:09.754019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92cefd31-2d6b-488e-b568-990527aaa320 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:10.745495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-92cefd31-2d6b-488e-b568-990527aaa320 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:10.748066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d87cf08c-326c-4a9a-bc0c-94d1f84057bd tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:10.760606 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92cefd31-2d6b-488e-b568-990527aaa320 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 200 len: 1505 microversion: 2.1 time: 1.075747 Sep 08 12:56:10.762824 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1502/3139] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:09 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 1505 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:10.796928 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d87cf08c-326c-4a9a-bc0c-94d1f84057bd tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1314 microversion: 2.1 time: 1.556125 Sep 08 12:56:10.798391 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1638/3140] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:09 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1314 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:10.807266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0c01e147-ec0f-465a-a563-3d68a83e47a7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:10.808792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0c01e147-ec0f-465a-a563-3d68a83e47a7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:10.819214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c01e147-ec0f-465a-a563-3d68a83e47a7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:10.820409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c01e147-ec0f-465a-a563-3d68a83e47a7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:10.821232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c01e147-ec0f-465a-a563-3d68a83e47a7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:10.822387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c01e147-ec0f-465a-a563-3d68a83e47a7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:10.823035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c01e147-ec0f-465a-a563-3d68a83e47a7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:10.823778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c01e147-ec0f-465a-a563-3d68a83e47a7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:10.845254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-28aaac4b-97ab-4ffe-90c4-a343f08e166b tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:10.850249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-28aaac4b-97ab-4ffe-90c4-a343f08e166b tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 8f021d74-5cfc-4132-a8f4-ac61b49f8302] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:10.878688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28aaac4b-97ab-4ffe-90c4-a343f08e166b tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:10.880307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28aaac4b-97ab-4ffe-90c4-a343f08e166b tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:10.881483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28aaac4b-97ab-4ffe-90c4-a343f08e166b tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:10.883399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28aaac4b-97ab-4ffe-90c4-a343f08e166b tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:10.885005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28aaac4b-97ab-4ffe-90c4-a343f08e166b tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:10.886937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28aaac4b-97ab-4ffe-90c4-a343f08e166b tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:11.355159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-28aaac4b-97ab-4ffe-90c4-a343f08e166b tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:11.364996 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-28aaac4b-97ab-4ffe-90c4-a343f08e166b tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302" status: 200 len: 1505 microversion: 2.1 time: 0.550499 Sep 08 12:56:11.371739 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1503/3141] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:10 2022] GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302 => generated 1505 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:11.437303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7ea0d4e1-6fe1-4c85-942d-f7baa2c1f8c6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:11.438023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0c01e147-ec0f-465a-a563-3d68a83e47a7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:11.438218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7ea0d4e1-6fe1-4c85-942d-f7baa2c1f8c6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 8f021d74-5cfc-4132-a8f4-ac61b49f8302] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:11.453202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ea0d4e1-6fe1-4c85-942d-f7baa2c1f8c6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:11.454584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ea0d4e1-6fe1-4c85-942d-f7baa2c1f8c6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:11.455655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ea0d4e1-6fe1-4c85-942d-f7baa2c1f8c6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:11.457779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ea0d4e1-6fe1-4c85-942d-f7baa2c1f8c6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:11.458929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ea0d4e1-6fe1-4c85-942d-f7baa2c1f8c6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:11.460426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ea0d4e1-6fe1-4c85-942d-f7baa2c1f8c6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:11.501789 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0c01e147-ec0f-465a-a563-3d68a83e47a7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 0.697112 Sep 08 12:56:11.519809 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1639/3142] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:10 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:11.608279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7ea0d4e1-6fe1-4c85-942d-f7baa2c1f8c6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 8f021d74-5cfc-4132-a8f4-ac61b49f8302] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:56:11.681541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:56:11.849746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9286c42f-ebcf-46cf-8e9d-454c62f54f78 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:11.853810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9286c42f-ebcf-46cf-8e9d-454c62f54f78 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:11.896214 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7ea0d4e1-6fe1-4c85-942d-f7baa2c1f8c6 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302" status: 204 len: 0 microversion: 2.1 time: 0.466929 Sep 08 12:56:11.902162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9286c42f-ebcf-46cf-8e9d-454c62f54f78 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:11.903130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9286c42f-ebcf-46cf-8e9d-454c62f54f78 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:11.906713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9286c42f-ebcf-46cf-8e9d-454c62f54f78 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:11.909619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9286c42f-ebcf-46cf-8e9d-454c62f54f78 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:11.914912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9286c42f-ebcf-46cf-8e9d-454c62f54f78 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:11.917496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9286c42f-ebcf-46cf-8e9d-454c62f54f78 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:11.922995 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1504/3143] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:56:11 2022] DELETE /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:56:11.962363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5d3c6fad-eb8e-433b-b597-f54ceb4ca936 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:11.982274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5d3c6fad-eb8e-433b-b597-f54ceb4ca936 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:12.011318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d3c6fad-eb8e-433b-b597-f54ceb4ca936 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:12.013005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d3c6fad-eb8e-433b-b597-f54ceb4ca936 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:12.014400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d3c6fad-eb8e-433b-b597-f54ceb4ca936 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:12.016129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d3c6fad-eb8e-433b-b597-f54ceb4ca936 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:12.017490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d3c6fad-eb8e-433b-b597-f54ceb4ca936 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:12.018849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d3c6fad-eb8e-433b-b597-f54ceb4ca936 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:12.108039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5d3c6fad-eb8e-433b-b597-f54ceb4ca936 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:56:12.299669 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5d3c6fad-eb8e-433b-b597-f54ceb4ca936 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 204 len: 0 microversion: 2.1 time: 0.374351 Sep 08 12:56:12.301214 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1505/3144] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:56:11 2022] DELETE /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:56:12.313407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3a12d30e-73e1-4f58-a70e-a9fd0c25c800 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:12.314364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3a12d30e-73e1-4f58-a70e-a9fd0c25c800 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 8f021d74-5cfc-4132-a8f4-ac61b49f8302] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:12.330159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a12d30e-73e1-4f58-a70e-a9fd0c25c800 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:12.330978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a12d30e-73e1-4f58-a70e-a9fd0c25c800 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:12.335938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a12d30e-73e1-4f58-a70e-a9fd0c25c800 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:12.337171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a12d30e-73e1-4f58-a70e-a9fd0c25c800 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:12.342724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a12d30e-73e1-4f58-a70e-a9fd0c25c800 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:12.345500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a12d30e-73e1-4f58-a70e-a9fd0c25c800 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:13.490137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9286c42f-ebcf-46cf-8e9d-454c62f54f78 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:13.504823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3a12d30e-73e1-4f58-a70e-a9fd0c25c800 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:13.531494 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9286c42f-ebcf-46cf-8e9d-454c62f54f78 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1314 microversion: 2.1 time: 1.690492 Sep 08 12:56:13.538645 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1640/3145] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:11 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1314 bytes in 1702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:13.539837 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3a12d30e-73e1-4f58-a70e-a9fd0c25c800 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302" status: 200 len: 1511 microversion: 2.1 time: 1.231271 Sep 08 12:56:13.544875 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1506/3146] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:12 2022] GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302 => generated 1511 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:13.589530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-21a52118-9152-4efb-8c68-9d4e3d8cd2f2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:13.592910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-21a52118-9152-4efb-8c68-9d4e3d8cd2f2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:13.634805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21a52118-9152-4efb-8c68-9d4e3d8cd2f2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:13.642189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21a52118-9152-4efb-8c68-9d4e3d8cd2f2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:13.642189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21a52118-9152-4efb-8c68-9d4e3d8cd2f2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:13.642189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21a52118-9152-4efb-8c68-9d4e3d8cd2f2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:13.644944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21a52118-9152-4efb-8c68-9d4e3d8cd2f2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:13.645519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21a52118-9152-4efb-8c68-9d4e3d8cd2f2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:14.119710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-21a52118-9152-4efb-8c68-9d4e3d8cd2f2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:14.140641 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-21a52118-9152-4efb-8c68-9d4e3d8cd2f2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 0.598290 Sep 08 12:56:14.143657 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1641/3147] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:13 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:14.576803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9d971bac-2e99-4cf8-aca8-93547ca4f313 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:14.578538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9d971bac-2e99-4cf8-aca8-93547ca4f313 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 8f021d74-5cfc-4132-a8f4-ac61b49f8302] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:14.586541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-73312aee-aad2-4164-aa1a-13032acb5b5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:14.587821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-73312aee-aad2-4164-aa1a-13032acb5b5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:14.590412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d971bac-2e99-4cf8-aca8-93547ca4f313 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:14.591243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d971bac-2e99-4cf8-aca8-93547ca4f313 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:14.591987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d971bac-2e99-4cf8-aca8-93547ca4f313 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:14.592963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d971bac-2e99-4cf8-aca8-93547ca4f313 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:14.593709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d971bac-2e99-4cf8-aca8-93547ca4f313 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:14.594363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d971bac-2e99-4cf8-aca8-93547ca4f313 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:14.631833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73312aee-aad2-4164-aa1a-13032acb5b5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:14.634280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73312aee-aad2-4164-aa1a-13032acb5b5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:14.637234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73312aee-aad2-4164-aa1a-13032acb5b5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:14.639560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73312aee-aad2-4164-aa1a-13032acb5b5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:14.650136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73312aee-aad2-4164-aa1a-13032acb5b5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:14.651452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73312aee-aad2-4164-aa1a-13032acb5b5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:15.166351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d971bac-2e99-4cf8-aca8-93547ca4f313 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:15.184467 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9d971bac-2e99-4cf8-aca8-93547ca4f313 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302" status: 200 len: 1511 microversion: 2.1 time: 0.612084 Sep 08 12:56:15.185240 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1642/3148] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:14 2022] GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302 => generated 1511 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:15.190128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8639398f-e7b7-4760-bfe4-af592c287b11 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:15.204055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8639398f-e7b7-4760-bfe4-af592c287b11 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:15.212015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8639398f-e7b7-4760-bfe4-af592c287b11 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:15.212676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8639398f-e7b7-4760-bfe4-af592c287b11 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:15.213227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8639398f-e7b7-4760-bfe4-af592c287b11 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:15.214076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8639398f-e7b7-4760-bfe4-af592c287b11 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:15.214657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8639398f-e7b7-4760-bfe4-af592c287b11 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:15.215198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8639398f-e7b7-4760-bfe4-af592c287b11 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:15.650691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-73312aee-aad2-4164-aa1a-13032acb5b5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:15.668779 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-73312aee-aad2-4164-aa1a-13032acb5b5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1501 microversion: 2.1 time: 1.095398 Sep 08 12:56:15.673069 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1507/3149] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:14 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1501 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:16.091473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8639398f-e7b7-4760-bfe4-af592c287b11 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:16.102828 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8639398f-e7b7-4760-bfe4-af592c287b11 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 0.916308 Sep 08 12:56:16.108815 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1643/3150] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:15 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:16.213074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7bd6899e-e0d2-4973-818b-d57958f6feb4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:16.213706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7bd6899e-e0d2-4973-818b-d57958f6feb4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 8f021d74-5cfc-4132-a8f4-ac61b49f8302] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:16.233597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bd6899e-e0d2-4973-818b-d57958f6feb4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:16.234105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bd6899e-e0d2-4973-818b-d57958f6feb4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:16.234781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bd6899e-e0d2-4973-818b-d57958f6feb4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:16.235815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bd6899e-e0d2-4973-818b-d57958f6feb4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:16.236472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bd6899e-e0d2-4973-818b-d57958f6feb4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:16.237586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bd6899e-e0d2-4973-818b-d57958f6feb4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:17.010590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7bd6899e-e0d2-4973-818b-d57958f6feb4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:17.032348 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7bd6899e-e0d2-4973-818b-d57958f6feb4 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302" status: 200 len: 1511 microversion: 2.1 time: 0.822785 Sep 08 12:56:17.045339 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1508/3151] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:16 2022] GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302 => generated 1511 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:17.166261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aaca450d-9218-456f-abaf-6d74f7e31d30 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:17.168162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aaca450d-9218-456f-abaf-6d74f7e31d30 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:17.188289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aaca450d-9218-456f-abaf-6d74f7e31d30 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:17.189014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aaca450d-9218-456f-abaf-6d74f7e31d30 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:17.189709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aaca450d-9218-456f-abaf-6d74f7e31d30 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:17.192544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aaca450d-9218-456f-abaf-6d74f7e31d30 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:17.194537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aaca450d-9218-456f-abaf-6d74f7e31d30 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:17.197550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aaca450d-9218-456f-abaf-6d74f7e31d30 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:17.211883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-973f55f7-d369-4229-afbc-bfadbd8b8b86 req-8fc9e5e0-3f59-48f2-89f7-64f2f557591b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f021d74-5cfc-4132-a8f4-ac61b49f8302", "name": "network-vif-deleted", "tag": "0ea4e458-ce86-463d-b57e-0ebbf8afaac5"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:17.259189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-973f55f7-d369-4229-afbc-bfadbd8b8b86 req-8fc9e5e0-3f59-48f2-89f7-64f2f557591b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:17.263192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-973f55f7-d369-4229-afbc-bfadbd8b8b86 req-8fc9e5e0-3f59-48f2-89f7-64f2f557591b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:17.265741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-973f55f7-d369-4229-afbc-bfadbd8b8b86 req-8fc9e5e0-3f59-48f2-89f7-64f2f557591b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:17.318616 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-973f55f7-d369-4229-afbc-bfadbd8b8b86 req-8fc9e5e0-3f59-48f2-89f7-64f2f557591b service nova] Creating event network-vif-deleted:0ea4e458-ce86-463d-b57e-0ebbf8afaac5 for instance 8f021d74-5cfc-4132-a8f4-ac61b49f8302 on n-h2-852084-10 Sep 08 12:56:17.354409 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-973f55f7-d369-4229-afbc-bfadbd8b8b86 req-8fc9e5e0-3f59-48f2-89f7-64f2f557591b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145890 Sep 08 12:56:17.360758 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1509/3152] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:56:17.894712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aaca450d-9218-456f-abaf-6d74f7e31d30 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:17.903980 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aaca450d-9218-456f-abaf-6d74f7e31d30 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 0.749556 Sep 08 12:56:17.904589 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1644/3153] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:17 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:18.066629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:18.068367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 8f021d74-5cfc-4132-a8f4-ac61b49f8302] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:18.111571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:18.112590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:18.113201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:18.114089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:18.114724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:18.115359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:18.185730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:18.186233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:18.187023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:18.187761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lazy-loading 'fault' on Instance uuid 8f021d74-5cfc-4132-a8f4-ac61b49f8302 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:56:18.376474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8094af07ac5340ee9a8c72a7ab625476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5753cf1c1974c9bb5453393bab0770f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:18.398978 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1f7655cf-5608-4f78-aeda-a02af4af2cd5 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302" status: 200 len: 1307 microversion: 2.1 time: 0.340236 Sep 08 12:56:18.403925 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1510/3154] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:18 2022] GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302 => generated 1307 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:18.933586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b6eff8c5-6c64-48ed-96a9-6bf8d917cc27 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:18.934902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b6eff8c5-6c64-48ed-96a9-6bf8d917cc27 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:18.946498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6eff8c5-6c64-48ed-96a9-6bf8d917cc27 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:18.952991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6eff8c5-6c64-48ed-96a9-6bf8d917cc27 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:18.954016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6eff8c5-6c64-48ed-96a9-6bf8d917cc27 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:18.955921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6eff8c5-6c64-48ed-96a9-6bf8d917cc27 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:18.959695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6eff8c5-6c64-48ed-96a9-6bf8d917cc27 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:18.960495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6eff8c5-6c64-48ed-96a9-6bf8d917cc27 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:19.283839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b6eff8c5-6c64-48ed-96a9-6bf8d917cc27 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:19.296819 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b6eff8c5-6c64-48ed-96a9-6bf8d917cc27 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 0.367107 Sep 08 12:56:19.298173 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1645/3155] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:18 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:19.438928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a84ca0c5-f10c-4bce-86b8-bc0b3b95b190 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:19.444675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a84ca0c5-f10c-4bce-86b8-bc0b3b95b190 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 8f021d74-5cfc-4132-a8f4-ac61b49f8302] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:19.472494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84ca0c5-f10c-4bce-86b8-bc0b3b95b190 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:19.473397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84ca0c5-f10c-4bce-86b8-bc0b3b95b190 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:19.474183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84ca0c5-f10c-4bce-86b8-bc0b3b95b190 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:19.475540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84ca0c5-f10c-4bce-86b8-bc0b3b95b190 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:19.476400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84ca0c5-f10c-4bce-86b8-bc0b3b95b190 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:19.477177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a84ca0c5-f10c-4bce-86b8-bc0b3b95b190 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:19.488131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f71c5965-cacc-4e8d-8a32-1539fab9c5ff req-7cad7950-71bf-4748-bf1d-1122c061d640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a3238c1-1ec9-4d45-8148-45e9047d3f6a", "name": "network-vif-deleted", "tag": "df6655b2-552c-4b2a-9be0-50d7eee1996b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:19.505556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f71c5965-cacc-4e8d-8a32-1539fab9c5ff req-7cad7950-71bf-4748-bf1d-1122c061d640 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:19.506252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f71c5965-cacc-4e8d-8a32-1539fab9c5ff req-7cad7950-71bf-4748-bf1d-1122c061d640 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:19.506793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f71c5965-cacc-4e8d-8a32-1539fab9c5ff req-7cad7950-71bf-4748-bf1d-1122c061d640 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:19.523817 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f71c5965-cacc-4e8d-8a32-1539fab9c5ff req-7cad7950-71bf-4748-bf1d-1122c061d640 service nova] Creating event network-vif-deleted:df6655b2-552c-4b2a-9be0-50d7eee1996b for instance 3a3238c1-1ec9-4d45-8148-45e9047d3f6a on n-h2-852084-10 Sep 08 12:56:19.531742 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f71c5965-cacc-4e8d-8a32-1539fab9c5ff req-7cad7950-71bf-4748-bf1d-1122c061d640 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048677 Sep 08 12:56:19.537642 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1646/3156] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:56:19.545169 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-a84ca0c5-f10c-4bce-86b8-bc0b3b95b190 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] HTTP exception thrown: Instance 8f021d74-5cfc-4132-a8f4-ac61b49f8302 could not be found. Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a84ca0c5-f10c-4bce-86b8-bc0b3b95b190 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Request method failure captured: Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302 HTTP/1.1 Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYLbYxC2KQLagaqGmYdtg7RgBevEWLaEgXPIYMTpYiciS40mAvVEtc80DwPbTQPlOYWluFP0FceJByQujY1BE-X2tcxHzN2W3Jmt8sUMrsRSwqvJI6IBEf32wG68AhpSTIUxb28a0l6UleQP88jVlHaMTdS0PjoD7Es4xUU0BPcZKE Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: f5753cf1c1974c9bb5453393bab0770f Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-MultipleCreateTestJSON-1976981797 Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f5753cf1c1974c9bb5453393bab0770f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f5753cf1c1974c9bb5453393bab0770f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f5753cf1c1974c9bb5453393bab0770f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f5753cf1c1974c9bb5453393bab0770f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-MultipleCreateTestJSON-1976981797 Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: f5753cf1c1974c9bb5453393bab0770f Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1976981797 Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-MultipleCreateTestJSON-1976981797-project Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 8094af07ac5340ee9a8c72a7ab625476 Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-MultipleCreateTestJSON-1976981797-project Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 8f021d74-5cfc-4132-a8f4-ac61b49f8302 could not be found. Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '8f021d74-5cfc-4132-a8f4-ac61b49f8302'} Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f021d74-5cfc-4132-a8f4-ac61b49f8302 could not be found. Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f021d74-5cfc-4132-a8f4-ac61b49f8302 could not be found. Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:56:19.556908 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:19.561312 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:19.561312 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:56:19.561312 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:56:19.561312 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:56:19.561312 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:56:19.561312 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f021d74-5cfc-4132-a8f4-ac61b49f8302 could not be found. Sep 08 12:56:19.561312 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:19.561312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a84ca0c5-f10c-4bce-86b8-bc0b3b95b190 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Returning 404 to user: Instance 8f021d74-5cfc-4132-a8f4-ac61b49f8302 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:56:19.561312 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a84ca0c5-f10c-4bce-86b8-bc0b3b95b190 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302" status: 404 len: 111 microversion: 2.1 time: 0.130855 Sep 08 12:56:19.561312 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1511/3157] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:19 2022] GET /compute/v2.1/servers/8f021d74-5cfc-4132-a8f4-ac61b49f8302 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:56:19.570852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e586077-c81a-482d-80c0-c7e4548378b3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:19.571639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6e586077-c81a-482d-80c0-c7e4548378b3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] [instance: 3a3238c1-1ec9-4d45-8148-45e9047d3f6a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:19.578615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e586077-c81a-482d-80c0-c7e4548378b3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:19.579126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e586077-c81a-482d-80c0-c7e4548378b3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:19.587406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e586077-c81a-482d-80c0-c7e4548378b3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:19.588379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e586077-c81a-482d-80c0-c7e4548378b3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:19.588884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e586077-c81a-482d-80c0-c7e4548378b3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:19.589402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e586077-c81a-482d-80c0-c7e4548378b3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:19.608194 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6e586077-c81a-482d-80c0-c7e4548378b3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] HTTP exception thrown: Instance 3a3238c1-1ec9-4d45-8148-45e9047d3f6a could not be found. Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e586077-c81a-482d-80c0-c7e4548378b3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Request method failure captured: Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a HTTP/1.1 Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYLbYxC2KQLagaqGmYdtg7RgBevEWLaEgXPIYMTpYiciS40mAvVEtc80DwPbTQPlOYWluFP0FceJByQujY1BE-X2tcxHzN2W3Jmt8sUMrsRSwqvJI6IBEf32wG68AhpSTIUxb28a0l6UleQP88jVlHaMTdS0PjoD7Es4xUU0BPcZKE Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f5753cf1c1974c9bb5453393bab0770f Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-MultipleCreateTestJSON-1976981797 Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f5753cf1c1974c9bb5453393bab0770f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f5753cf1c1974c9bb5453393bab0770f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f5753cf1c1974c9bb5453393bab0770f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f5753cf1c1974c9bb5453393bab0770f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-MultipleCreateTestJSON-1976981797 Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f5753cf1c1974c9bb5453393bab0770f Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1976981797 Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-MultipleCreateTestJSON-1976981797-project Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 8094af07ac5340ee9a8c72a7ab625476 Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-MultipleCreateTestJSON-1976981797-project Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 3a3238c1-1ec9-4d45-8148-45e9047d3f6a could not be found. Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '3a3238c1-1ec9-4d45-8148-45e9047d3f6a'} Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a3238c1-1ec9-4d45-8148-45e9047d3f6a could not be found. Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a3238c1-1ec9-4d45-8148-45e9047d3f6a could not be found. Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:56:19.615204 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:56:19.621672 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:19.621672 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:56:19.621672 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:56:19.621672 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:56:19.621672 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:56:19.621672 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a3238c1-1ec9-4d45-8148-45e9047d3f6a could not be found. Sep 08 12:56:19.621672 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:56:19.621672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e586077-c81a-482d-80c0-c7e4548378b3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] Returning 404 to user: Instance 3a3238c1-1ec9-4d45-8148-45e9047d3f6a could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:56:19.623878 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6e586077-c81a-482d-80c0-c7e4548378b3 tempest-MultipleCreateTestJSON-1976981797 tempest-MultipleCreateTestJSON-1976981797-project] 10.222.0.78 "GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a" status: 404 len: 111 microversion: 2.1 time: 0.053961 Sep 08 12:56:19.626440 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1647/3158] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:19 2022] GET /compute/v2.1/servers/3a3238c1-1ec9-4d45-8148-45e9047d3f6a => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:56:19.852889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc4b096a-4f26-49bd-a8a1-6aadf7075e5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22067a48-3771-4d2c-a8d3-05e7fedbbd27"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:19.858189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cc4b096a-4f26-49bd-a8a1-6aadf7075e5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:19.870840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:56:19.875685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc4b096a-4f26-49bd-a8a1-6aadf7075e5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:19.876990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc4b096a-4f26-49bd-a8a1-6aadf7075e5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:19.878077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc4b096a-4f26-49bd-a8a1-6aadf7075e5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:19.880068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc4b096a-4f26-49bd-a8a1-6aadf7075e5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:19.881492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc4b096a-4f26-49bd-a8a1-6aadf7075e5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:19.885284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc4b096a-4f26-49bd-a8a1-6aadf7075e5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:20.379478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8b8461f1-6e0f-49f2-a9db-b408fa030e98 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:20.387364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8b8461f1-6e0f-49f2-a9db-b408fa030e98 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:20.442747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b8461f1-6e0f-49f2-a9db-b408fa030e98 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:20.449240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b8461f1-6e0f-49f2-a9db-b408fa030e98 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:20.456679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b8461f1-6e0f-49f2-a9db-b408fa030e98 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:20.463107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b8461f1-6e0f-49f2-a9db-b408fa030e98 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:20.468931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b8461f1-6e0f-49f2-a9db-b408fa030e98 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:20.470642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b8461f1-6e0f-49f2-a9db-b408fa030e98 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:20.654933 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cc4b096a-4f26-49bd-a8a1-6aadf7075e5d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "POST /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.811102 Sep 08 12:56:20.657971 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1512/3159] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 12:56:19 2022] POST /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247/os-volume_attachments => generated 194 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:56:21.545799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8b8461f1-6e0f-49f2-a9db-b408fa030e98 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:21.561864 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8b8461f1-6e0f-49f2-a9db-b408fa030e98 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 1.211661 Sep 08 12:56:21.582808 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1648/3160] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:20 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:22.608476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dcbae04e-d423-4439-9c33-d6edbb16be1d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:22.609427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dcbae04e-d423-4439-9c33-d6edbb16be1d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:22.643704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcbae04e-d423-4439-9c33-d6edbb16be1d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:22.648125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcbae04e-d423-4439-9c33-d6edbb16be1d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:22.650340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcbae04e-d423-4439-9c33-d6edbb16be1d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:22.656687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcbae04e-d423-4439-9c33-d6edbb16be1d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:22.657538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcbae04e-d423-4439-9c33-d6edbb16be1d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:22.658201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcbae04e-d423-4439-9c33-d6edbb16be1d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:23.580732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dcbae04e-d423-4439-9c33-d6edbb16be1d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:23.628523 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dcbae04e-d423-4439-9c33-d6edbb16be1d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 1.034715 Sep 08 12:56:23.675494 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1513/3161] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:22 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:25.234570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e91247e-e372-4e05-a03e-24fc1774270f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:25.235941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e91247e-e372-4e05-a03e-24fc1774270f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:25.254395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e91247e-e372-4e05-a03e-24fc1774270f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:25.255010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e91247e-e372-4e05-a03e-24fc1774270f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:25.255504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e91247e-e372-4e05-a03e-24fc1774270f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:25.265051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e91247e-e372-4e05-a03e-24fc1774270f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:25.265641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e91247e-e372-4e05-a03e-24fc1774270f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:25.267562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e91247e-e372-4e05-a03e-24fc1774270f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:26.276622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e91247e-e372-4e05-a03e-24fc1774270f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:26.304299 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e91247e-e372-4e05-a03e-24fc1774270f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1511 microversion: 2.1 time: 1.627160 Sep 08 12:56:26.336265 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1649/3162] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:24 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1511 bytes in 1665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:27.363432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b2cea1c-45e5-4e8e-b784-45a9d1dfe14d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:27.367967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5b2cea1c-45e5-4e8e-b784-45a9d1dfe14d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:27.400156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b2cea1c-45e5-4e8e-b784-45a9d1dfe14d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:27.401567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b2cea1c-45e5-4e8e-b784-45a9d1dfe14d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:27.402677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b2cea1c-45e5-4e8e-b784-45a9d1dfe14d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:27.404344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b2cea1c-45e5-4e8e-b784-45a9d1dfe14d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:27.405533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b2cea1c-45e5-4e8e-b784-45a9d1dfe14d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:27.406555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b2cea1c-45e5-4e8e-b784-45a9d1dfe14d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:27.863141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5b2cea1c-45e5-4e8e-b784-45a9d1dfe14d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:27.904441 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5b2cea1c-45e5-4e8e-b784-45a9d1dfe14d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1488 microversion: 2.1 time: 0.554746 Sep 08 12:56:27.906131 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1514/3163] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:27 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1488 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:27.959349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e55c488-ffa3-4da8-8ab4-826d29df79ca tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:27.973455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e55c488-ffa3-4da8-8ab4-826d29df79ca tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:27.996169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e55c488-ffa3-4da8-8ab4-826d29df79ca tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:27.996790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e55c488-ffa3-4da8-8ab4-826d29df79ca tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:27.999511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e55c488-ffa3-4da8-8ab4-826d29df79ca tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:28.000332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e55c488-ffa3-4da8-8ab4-826d29df79ca tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:28.000819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e55c488-ffa3-4da8-8ab4-826d29df79ca tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:28.001257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e55c488-ffa3-4da8-8ab4-826d29df79ca tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:28.079478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:56:28.178306 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e55c488-ffa3-4da8-8ab4-826d29df79ca tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 200 len: 131 microversion: 2.1 time: 0.228312 Sep 08 12:56:28.180636 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1650/3164] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:56:27 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 131 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:56:28.195898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-667b32a1-0cd9-4b73-913f-348ec67958f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:28.196945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-667b32a1-0cd9-4b73-913f-348ec67958f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:28.219561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-667b32a1-0cd9-4b73-913f-348ec67958f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:28.220114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-667b32a1-0cd9-4b73-913f-348ec67958f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:28.220525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-667b32a1-0cd9-4b73-913f-348ec67958f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:28.221336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-667b32a1-0cd9-4b73-913f-348ec67958f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:28.221869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-667b32a1-0cd9-4b73-913f-348ec67958f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:28.222313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-667b32a1-0cd9-4b73-913f-348ec67958f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:28.586092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-667b32a1-0cd9-4b73-913f-348ec67958f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:28.600535 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-667b32a1-0cd9-4b73-913f-348ec67958f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.410826 Sep 08 12:56:28.604107 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1515/3165] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:28 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:28.654169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fdaabb34-a865-4caa-9e0c-0c36a865ccb3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:28.654915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fdaabb34-a865-4caa-9e0c-0c36a865ccb3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:28.663102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdaabb34-a865-4caa-9e0c-0c36a865ccb3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:28.663971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdaabb34-a865-4caa-9e0c-0c36a865ccb3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:28.664621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdaabb34-a865-4caa-9e0c-0c36a865ccb3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:28.665796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdaabb34-a865-4caa-9e0c-0c36a865ccb3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:28.666841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdaabb34-a865-4caa-9e0c-0c36a865ccb3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:28.667476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdaabb34-a865-4caa-9e0c-0c36a865ccb3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:29.082091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fdaabb34-a865-4caa-9e0c-0c36a865ccb3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:29.108848 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fdaabb34-a865-4caa-9e0c-0c36a865ccb3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.458778 Sep 08 12:56:29.109881 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1651/3166] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:28 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:29.168670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cd1a6327-9d07-43e7-b404-9f415620435b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:29.170611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cd1a6327-9d07-43e7-b404-9f415620435b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:29.183422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd1a6327-9d07-43e7-b404-9f415620435b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:29.184430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd1a6327-9d07-43e7-b404-9f415620435b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:29.185322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd1a6327-9d07-43e7-b404-9f415620435b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:29.190162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd1a6327-9d07-43e7-b404-9f415620435b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:29.193563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd1a6327-9d07-43e7-b404-9f415620435b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:29.196561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd1a6327-9d07-43e7-b404-9f415620435b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:29.671063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cd1a6327-9d07-43e7-b404-9f415620435b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:29.691997 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cd1a6327-9d07-43e7-b404-9f415620435b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.520285 Sep 08 12:56:29.691997 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1516/3167] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:29 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:29.713317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b015f068-cbaa-4fa7-a032-658e9671f474 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:29.713978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b015f068-cbaa-4fa7-a032-658e9671f474 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:29.718072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=55 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:56:29.734380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b015f068-cbaa-4fa7-a032-658e9671f474 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:29.737345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b015f068-cbaa-4fa7-a032-658e9671f474 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:29.737932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b015f068-cbaa-4fa7-a032-658e9671f474 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:29.741244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b015f068-cbaa-4fa7-a032-658e9671f474 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:29.741810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b015f068-cbaa-4fa7-a032-658e9671f474 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:29.742267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b015f068-cbaa-4fa7-a032-658e9671f474 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:30.160678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b015f068-cbaa-4fa7-a032-658e9671f474 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:30.193269 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b015f068-cbaa-4fa7-a032-658e9671f474 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.484449 Sep 08 12:56:30.209516 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1652/3168] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:29 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:30.555655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-430298279", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "82a4dc57-b1c7-4ce5-8528-3df2b0721b51"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:30.718426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] validate_networks() for [('82a4dc57-b1c7-4ce5-8528-3df2b0721b51', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:56:31.792782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:56:31.793486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:56:31.793751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:56:31.794176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:56:31.794595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:56:31.807998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:31.808504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:31.808958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:31.809787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:31.810259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:31.810695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:31.841840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Getting quotas for project 59dc0decb175444491383c39918c5b2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:56:31.852342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Getting quotas for user 4140a06bc6934d7780ef9ff3e30e6dd5 and project 59dc0decb175444491383c39918c5b2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:56:31.873314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:56:31.876893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:56:31.957291 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f90e4ffc-b8e4-4985-ac21-711dc20ab4d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.406181 Sep 08 12:56:31.960247 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1517/3169] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:56:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1410 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:56:31.980097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3dc5d9c2-0d5c-416c-a627-7a65c34577f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:31.984509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3dc5d9c2-0d5c-416c-a627-7a65c34577f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:32.141088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3dc5d9c2-0d5c-416c-a627-7a65c34577f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:32.173260 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3dc5d9c2-0d5c-416c-a627-7a65c34577f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1214 microversion: 2.1 time: 0.202368 Sep 08 12:56:32.177346 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1653/3170] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:31 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1214 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:33.223639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-40e0a70b-dc92-4a64-96d4-ff4dd994ff8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:33.225431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-40e0a70b-dc92-4a64-96d4-ff4dd994ff8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:33.234290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40e0a70b-dc92-4a64-96d4-ff4dd994ff8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:33.235019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40e0a70b-dc92-4a64-96d4-ff4dd994ff8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:33.235548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40e0a70b-dc92-4a64-96d4-ff4dd994ff8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:33.236365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40e0a70b-dc92-4a64-96d4-ff4dd994ff8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:33.237044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40e0a70b-dc92-4a64-96d4-ff4dd994ff8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:33.237551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40e0a70b-dc92-4a64-96d4-ff4dd994ff8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:33.330263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-40e0a70b-dc92-4a64-96d4-ff4dd994ff8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:33.342715 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-40e0a70b-dc92-4a64-96d4-ff4dd994ff8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1210 microversion: 2.1 time: 0.124336 Sep 08 12:56:33.361270 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1518/3171] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:33 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1210 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:34.376763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0d8b22b3-ae2f-4219-876b-ba2f210ec539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:34.380667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0d8b22b3-ae2f-4219-876b-ba2f210ec539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:34.415611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d8b22b3-ae2f-4219-876b-ba2f210ec539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:34.423588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d8b22b3-ae2f-4219-876b-ba2f210ec539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:34.426484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d8b22b3-ae2f-4219-876b-ba2f210ec539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:34.432008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d8b22b3-ae2f-4219-876b-ba2f210ec539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:34.433267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d8b22b3-ae2f-4219-876b-ba2f210ec539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:34.451527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d8b22b3-ae2f-4219-876b-ba2f210ec539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:34.888275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0d8b22b3-ae2f-4219-876b-ba2f210ec539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:34.920691 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0d8b22b3-ae2f-4219-876b-ba2f210ec539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1272 microversion: 2.1 time: 0.554699 Sep 08 12:56:34.923029 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1654/3172] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:34 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1272 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:35.951132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3b42e8e4-4705-4d20-bb37-5439e1864fea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:35.957857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3b42e8e4-4705-4d20-bb37-5439e1864fea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:35.986434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b42e8e4-4705-4d20-bb37-5439e1864fea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:35.988231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b42e8e4-4705-4d20-bb37-5439e1864fea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:35.990572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b42e8e4-4705-4d20-bb37-5439e1864fea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:35.992265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b42e8e4-4705-4d20-bb37-5439e1864fea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:35.993369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b42e8e4-4705-4d20-bb37-5439e1864fea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:35.995472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b42e8e4-4705-4d20-bb37-5439e1864fea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:36.019546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=93,nova_cell1:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:56:36.254223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b42e8e4-4705-4d20-bb37-5439e1864fea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:36.269233 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3b42e8e4-4705-4d20-bb37-5439e1864fea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1272 microversion: 2.1 time: 0.323123 Sep 08 12:56:36.277556 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1519/3173] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:35 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1272 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:37.306714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-77b0f86d-a4f0-42ff-a0bf-deb75eacf4a3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:37.312857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-77b0f86d-a4f0-42ff-a0bf-deb75eacf4a3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:37.355375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77b0f86d-a4f0-42ff-a0bf-deb75eacf4a3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:37.359619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77b0f86d-a4f0-42ff-a0bf-deb75eacf4a3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:37.360729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77b0f86d-a4f0-42ff-a0bf-deb75eacf4a3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:37.363157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77b0f86d-a4f0-42ff-a0bf-deb75eacf4a3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:37.364480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77b0f86d-a4f0-42ff-a0bf-deb75eacf4a3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:37.365524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77b0f86d-a4f0-42ff-a0bf-deb75eacf4a3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:39.067429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-57cc1954-971a-47bf-9f1e-1371c91245d4 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] Calling method '.version_select at 0x7fdb3f1165e0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:39.115740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-77b0f86d-a4f0-42ff-a0bf-deb75eacf4a3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:39.133766 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-77b0f86d-a4f0-42ff-a0bf-deb75eacf4a3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1314 microversion: 2.1 time: 1.834347 Sep 08 12:56:39.135987 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1655/3174] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:37 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1314 bytes in 1838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:39.274639 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-57cc1954-971a-47bf-9f1e-1371c91245d4 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.571855 Sep 08 12:56:39.278131 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1520/3175] 10.222.0.78 () {58 vars in 1149 bytes} [Thu Sep 8 12:56:38 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:56:39.306053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c5e41397-fd12-4676-be17-46311ffa18d1 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] Action: 'create', calling method: .version_select at 0x7fdb36401670>, body: {"pool": "non_exist_pool"} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:39.545734 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-c5e41397-fd12-4676-be17-46311ffa18d1 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] HTTP exception thrown: Floating IP pool not found. Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c5e41397-fd12-4676-be17-46311ffa18d1 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] Request method failure captured: Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 26 Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeaGAHQLTmpq9nrOu6YLYYscBP1o_USV5ltKp1w-OjJ8jPweLUXu6LrqT0lPOXBRu5TuohqtjqE6dmmaqWabCCwVraWGTUrTqm3I8iMdV0v8scwlipjWU6kwPv9rvKK26Hwp3IiJGTv5OxBSPJPCI9cPvAiPFZa11dhp8Fc4-OWXVyk Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 7579c25544b046c9b5eabcfbabfe7f68 Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2047111874 Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7579c25544b046c9b5eabcfbabfe7f68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7579c25544b046c9b5eabcfbabfe7f68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7579c25544b046c9b5eabcfbabfe7f68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7579c25544b046c9b5eabcfbabfe7f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2047111874 Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 7579c25544b046c9b5eabcfbabfe7f68 Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2047111874 Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-FloatingIPsNegativeTestJSON-2047111874-project Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 9fc2a3f438104d02b4086730ba95b9a0 Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2047111874-project Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: {"pool": "non_exist_pool"} Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: exception: Floating IP pool not found. Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'pool': 'non_exist_pool'}} Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:56:39.550603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:56:39.559711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Sep 08 12:56:39.559711 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:56:39.563355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c5e41397-fd12-4676-be17-46311ffa18d1 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] Returning 404 to user: Floating IP pool not found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:56:39.573666 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c5e41397-fd12-4676-be17-46311ffa18d1 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.279497 Sep 08 12:56:39.574986 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1656/3176] 10.222.0.78 () {60 vars in 1170 bytes} [Thu Sep 8 12:56:39 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 290 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 08 12:56:39.594753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-be05599a-1a17-450f-b9f1-af268c944e82 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] Calling method '.version_select at 0x7fdb39fc43a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:39.961485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG neutronclient.v2_0.client [None req-be05599a-1a17-450f-b9f1-af268c944e82 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1bab2da4-75b6-4329-8f6d-72b18072ae74 could not be found", "detail": ""}} {{(pid=128971) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:56:39.962426 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-be05599a-1a17-450f-b9f1-af268c944e82 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] HTTP exception thrown: Floating IP not found for ID 1bab2da4-75b6-4329-8f6d-72b18072ae74 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-be05599a-1a17-450f-b9f1-af268c944e82 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] Request method failure captured: Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-floating-ips/1bab2da4-75b6-4329-8f6d-72b18072ae74 HTTP/1.1 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaGAHQLTmpq9nrOu6YLYYscBP1o_USV5ltKp1w-OjJ8jPweLUXu6LrqT0lPOXBRu5TuohqtjqE6dmmaqWabCCwVraWGTUrTqm3I8iMdV0v8scwlipjWU6kwPv9rvKK26Hwp3IiJGTv5OxBSPJPCI9cPvAiPFZa11dhp8Fc4-OWXVyk Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 7579c25544b046c9b5eabcfbabfe7f68 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2047111874 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7579c25544b046c9b5eabcfbabfe7f68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7579c25544b046c9b5eabcfbabfe7f68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7579c25544b046c9b5eabcfbabfe7f68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7579c25544b046c9b5eabcfbabfe7f68"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2047111874 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 7579c25544b046c9b5eabcfbabfe7f68 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2047111874 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-FloatingIPsNegativeTestJSON-2047111874-project Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9fc2a3f438104d02b4086730ba95b9a0 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2047111874-project Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: exception: Floating IP not found for ID 1bab2da4-75b6-4329-8f6d-72b18072ae74 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '1bab2da4-75b6-4329-8f6d-72b18072ae74'} Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1bab2da4-75b6-4329-8f6d-72b18072ae74 could not be found Sep 08 12:56:39.964938 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6c2c2045-8c53-4846-9a1a-a853ea6294c9'] Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1bab2da4-75b6-4329-8f6d-72b18072ae74. Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1bab2da4-75b6-4329-8f6d-72b18072ae74 Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1bab2da4-75b6-4329-8f6d-72b18072ae74 Sep 08 12:56:39.969208 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:56:39.974800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-be05599a-1a17-450f-b9f1-af268c944e82 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] Returning 404 to user: Floating IP not found for ID 1bab2da4-75b6-4329-8f6d-72b18072ae74 {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:56:39.976001 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-be05599a-1a17-450f-b9f1-af268c944e82 tempest-FloatingIPsNegativeTestJSON-2047111874 tempest-FloatingIPsNegativeTestJSON-2047111874-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/1bab2da4-75b6-4329-8f6d-72b18072ae74" status: 404 len: 111 microversion: 2.1 time: 0.391556 Sep 08 12:56:39.977399 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1521/3177] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:56:39 2022] DELETE /compute/v2.1/os-floating-ips/1bab2da4-75b6-4329-8f6d-72b18072ae74 => generated 111 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:56:40.192163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a02287ef-baf9-4e14-a01b-94b1c8cfc1c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:40.197970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a02287ef-baf9-4e14-a01b-94b1c8cfc1c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:40.291562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a02287ef-baf9-4e14-a01b-94b1c8cfc1c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:40.299091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a02287ef-baf9-4e14-a01b-94b1c8cfc1c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:40.304043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a02287ef-baf9-4e14-a01b-94b1c8cfc1c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:40.307104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a02287ef-baf9-4e14-a01b-94b1c8cfc1c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:40.310026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a02287ef-baf9-4e14-a01b-94b1c8cfc1c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:40.315919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a02287ef-baf9-4e14-a01b-94b1c8cfc1c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:41.464086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-23689910-1869-48f7-8f9c-6518b00c8b2e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:41.465028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-23689910-1869-48f7-8f9c-6518b00c8b2e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:41.482801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23689910-1869-48f7-8f9c-6518b00c8b2e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:41.484246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23689910-1869-48f7-8f9c-6518b00c8b2e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:41.485267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23689910-1869-48f7-8f9c-6518b00c8b2e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:41.486720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23689910-1869-48f7-8f9c-6518b00c8b2e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:41.488459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23689910-1869-48f7-8f9c-6518b00c8b2e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:41.489279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23689910-1869-48f7-8f9c-6518b00c8b2e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:41.573205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-23689910-1869-48f7-8f9c-6518b00c8b2e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:56:41.805388 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-23689910-1869-48f7-8f9c-6518b00c8b2e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 204 len: 0 microversion: 2.1 time: 0.352469 Sep 08 12:56:41.815382 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1522/3178] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:56:41 2022] DELETE /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 12:56:41.843085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8352ba83-8c4e-4ac1-88d7-266f028204d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:41.844917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8352ba83-8c4e-4ac1-88d7-266f028204d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:41.857924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:56:41.863261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8352ba83-8c4e-4ac1-88d7-266f028204d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:41.864177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8352ba83-8c4e-4ac1-88d7-266f028204d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:41.865362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8352ba83-8c4e-4ac1-88d7-266f028204d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:41.867688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8352ba83-8c4e-4ac1-88d7-266f028204d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:41.868723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8352ba83-8c4e-4ac1-88d7-266f028204d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:41.869507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8352ba83-8c4e-4ac1-88d7-266f028204d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:41.872280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:56:42.169763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:56:42.654678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a02287ef-baf9-4e14-a01b-94b1c8cfc1c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:42.684192 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a02287ef-baf9-4e14-a01b-94b1c8cfc1c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1314 microversion: 2.1 time: 2.508374 Sep 08 12:56:42.691092 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1657/3179] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:40 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1314 bytes in 2517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:43.020032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8352ba83-8c4e-4ac1-88d7-266f028204d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:43.048854 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8352ba83-8c4e-4ac1-88d7-266f028204d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1553 microversion: 2.1 time: 1.220814 Sep 08 12:56:43.069011 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1523/3180] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:41 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1553 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:43.743407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eae582cc-130a-4279-8196-a6c415455508 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:43.744850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eae582cc-130a-4279-8196-a6c415455508 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:43.770442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eae582cc-130a-4279-8196-a6c415455508 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:43.771343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eae582cc-130a-4279-8196-a6c415455508 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:43.775635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eae582cc-130a-4279-8196-a6c415455508 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:43.779135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eae582cc-130a-4279-8196-a6c415455508 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:43.784584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eae582cc-130a-4279-8196-a6c415455508 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:43.785664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eae582cc-130a-4279-8196-a6c415455508 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:44.097595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dec7e94d-a503-4b82-9bd8-bf24e5668574 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:44.098526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dec7e94d-a503-4b82-9bd8-bf24e5668574 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:44.112865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dec7e94d-a503-4b82-9bd8-bf24e5668574 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:44.113538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dec7e94d-a503-4b82-9bd8-bf24e5668574 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:44.113997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dec7e94d-a503-4b82-9bd8-bf24e5668574 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:44.114771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dec7e94d-a503-4b82-9bd8-bf24e5668574 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:44.115275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dec7e94d-a503-4b82-9bd8-bf24e5668574 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:44.120810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dec7e94d-a503-4b82-9bd8-bf24e5668574 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:46.379144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dec7e94d-a503-4b82-9bd8-bf24e5668574 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:46.394938 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dec7e94d-a503-4b82-9bd8-bf24e5668574 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1553 microversion: 2.1 time: 2.301672 Sep 08 12:56:46.407698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eae582cc-130a-4279-8196-a6c415455508 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:46.415469 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1524/3181] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:44 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1553 bytes in 2322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:46.436177 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eae582cc-130a-4279-8196-a6c415455508 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1314 microversion: 2.1 time: 2.708210 Sep 08 12:56:46.442383 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1658/3182] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:43 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1314 bytes in 2716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:46.602055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-1305a887-ecd3-4883-b773-d66fe410b96d req-eb14c391-6255-4bf2-81b8-5fa9958dafb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b685045a-400a-4641-a603-1d2fea9bbcf1", "tag": "c78a1808-531d-4ec3-b753-f992ef457785"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:46.616447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1305a887-ecd3-4883-b773-d66fe410b96d req-eb14c391-6255-4bf2-81b8-5fa9958dafb9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:46.617308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1305a887-ecd3-4883-b773-d66fe410b96d req-eb14c391-6255-4bf2-81b8-5fa9958dafb9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:46.618031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1305a887-ecd3-4883-b773-d66fe410b96d req-eb14c391-6255-4bf2-81b8-5fa9958dafb9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:46.637337 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-1305a887-ecd3-4883-b773-d66fe410b96d req-eb14c391-6255-4bf2-81b8-5fa9958dafb9 service nova] Creating event network-changed:c78a1808-531d-4ec3-b753-f992ef457785 for instance b685045a-400a-4641-a603-1d2fea9bbcf1 on n-h2-852084-10 Sep 08 12:56:46.646353 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-1305a887-ecd3-4883-b773-d66fe410b96d req-eb14c391-6255-4bf2-81b8-5fa9958dafb9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048865 Sep 08 12:56:46.649287 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1525/3183] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:56:46.672136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ddd8617-7b31-4b5d-9bff-541ef5f596b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Action: 'create', calling method: .version_select at 0x7fdb3643e160>, body: {"keypair": {"name": "tempest-keypair-1857920673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYzZf5KGVmJfWUHOACns6IYAFTOuy6bq5KeTpjJa530pasxs3QGZs0jMvpFsuxdWarVUxxMwQSEOLUohfBWk2oWReQXLUbdkwAUxCGGDdEaXHDjUPp2tfgsvN9lFMIBfQ=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:46.712288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-8ddd8617-7b31-4b5d-9bff-541ef5f596b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Getting quotas for project dde98df8ff64478e93fde5f75096c60a. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:56:46.727080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-8ddd8617-7b31-4b5d-9bff-541ef5f596b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Getting quotas for user 39d5a18c9a8d462ca4e9fcdc74dfc8c2 and project dde98df8ff64478e93fde5f75096c60a. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:56:46.804199 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8ddd8617-7b31-4b5d-9bff-541ef5f596b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.150370 Sep 08 12:56:46.815610 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1659/3184] 10.222.0.78 () {62 vars in 1200 bytes} [Thu Sep 8 12:56:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 164 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 12:56:47.376585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b48294f7-528f-40a4-b2ad-05cca25f6132 req-af907161-f247-44c5-8c56-2e8c8757414a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3368fcc-195b-45a7-92da-7bd0f4337247", "name": "network-vif-unplugged", "status": "completed", "tag": "a5c1871f-65d9-4128-935c-28aed8162d68"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:47.410715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b48294f7-528f-40a4-b2ad-05cca25f6132 req-af907161-f247-44c5-8c56-2e8c8757414a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:47.411598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b48294f7-528f-40a4-b2ad-05cca25f6132 req-af907161-f247-44c5-8c56-2e8c8757414a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:47.411598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b48294f7-528f-40a4-b2ad-05cca25f6132 req-af907161-f247-44c5-8c56-2e8c8757414a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:47.423285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33381afb-8d55-49de-b4ee-349530bcc591 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:47.424168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-33381afb-8d55-49de-b4ee-349530bcc591 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:47.440975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33381afb-8d55-49de-b4ee-349530bcc591 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:47.441490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33381afb-8d55-49de-b4ee-349530bcc591 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:47.447687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33381afb-8d55-49de-b4ee-349530bcc591 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:47.449000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33381afb-8d55-49de-b4ee-349530bcc591 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:47.449505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33381afb-8d55-49de-b4ee-349530bcc591 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:47.453057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33381afb-8d55-49de-b4ee-349530bcc591 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:47.472801 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b48294f7-528f-40a4-b2ad-05cca25f6132 req-af907161-f247-44c5-8c56-2e8c8757414a service nova] Creating event network-vif-unplugged:a5c1871f-65d9-4128-935c-28aed8162d68 for instance e3368fcc-195b-45a7-92da-7bd0f4337247 on n-h1-852084-10 Sep 08 12:56:47.490051 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b48294f7-528f-40a4-b2ad-05cca25f6132 req-af907161-f247-44c5-8c56-2e8c8757414a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118924 Sep 08 12:56:47.490679 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1526/3185] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:56:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:56:47.496892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-68235349-5bb7-4148-b5b5-47415dcfe40e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:47.497871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-68235349-5bb7-4148-b5b5-47415dcfe40e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:47.506169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68235349-5bb7-4148-b5b5-47415dcfe40e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:47.506976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68235349-5bb7-4148-b5b5-47415dcfe40e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:47.507704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68235349-5bb7-4148-b5b5-47415dcfe40e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:47.508759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68235349-5bb7-4148-b5b5-47415dcfe40e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:47.509567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68235349-5bb7-4148-b5b5-47415dcfe40e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:47.510272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68235349-5bb7-4148-b5b5-47415dcfe40e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:48.458279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-68235349-5bb7-4148-b5b5-47415dcfe40e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:48.474106 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-68235349-5bb7-4148-b5b5-47415dcfe40e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1314 microversion: 2.1 time: 0.981911 Sep 08 12:56:48.475262 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1527/3186] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:47 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1314 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:48.509329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-33381afb-8d55-49de-b4ee-349530bcc591 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:48.535052 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-33381afb-8d55-49de-b4ee-349530bcc591 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1553 microversion: 2.1 time: 1.114457 Sep 08 12:56:48.579597 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1660/3187] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:47 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1553 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:49.536823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-18b50150-c8ae-44b0-a157-7005693f6c3c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:49.539321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-18b50150-c8ae-44b0-a157-7005693f6c3c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:49.573699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18b50150-c8ae-44b0-a157-7005693f6c3c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:49.581893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a267e987-3191-4f5a-a5f3-742cb4228ff1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:49.583200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a267e987-3191-4f5a-a5f3-742cb4228ff1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:49.590211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18b50150-c8ae-44b0-a157-7005693f6c3c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:49.590684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18b50150-c8ae-44b0-a157-7005693f6c3c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:49.591507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18b50150-c8ae-44b0-a157-7005693f6c3c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:49.593849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18b50150-c8ae-44b0-a157-7005693f6c3c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:49.594348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18b50150-c8ae-44b0-a157-7005693f6c3c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:49.598434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a267e987-3191-4f5a-a5f3-742cb4228ff1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:49.601744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a267e987-3191-4f5a-a5f3-742cb4228ff1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:49.602395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a267e987-3191-4f5a-a5f3-742cb4228ff1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:49.629637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a267e987-3191-4f5a-a5f3-742cb4228ff1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:49.634756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a267e987-3191-4f5a-a5f3-742cb4228ff1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:49.635681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a267e987-3191-4f5a-a5f3-742cb4228ff1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:50.814589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a267e987-3191-4f5a-a5f3-742cb4228ff1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:50.844794 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a267e987-3191-4f5a-a5f3-742cb4228ff1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1553 microversion: 2.1 time: 1.266499 Sep 08 12:56:50.847560 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1661/3188] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:49 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1553 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:51.896116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4f8cc4dc-67a1-4f38-af93-5da2d847e3f2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:51.896883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4f8cc4dc-67a1-4f38-af93-5da2d847e3f2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:51.918463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f8cc4dc-67a1-4f38-af93-5da2d847e3f2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:51.931490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f8cc4dc-67a1-4f38-af93-5da2d847e3f2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:51.935592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f8cc4dc-67a1-4f38-af93-5da2d847e3f2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:51.939287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f8cc4dc-67a1-4f38-af93-5da2d847e3f2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:51.939542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-18b50150-c8ae-44b0-a157-7005693f6c3c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:51.947286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f8cc4dc-67a1-4f38-af93-5da2d847e3f2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:51.951475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f8cc4dc-67a1-4f38-af93-5da2d847e3f2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:52.004046 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-18b50150-c8ae-44b0-a157-7005693f6c3c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1314 microversion: 2.1 time: 2.486614 Sep 08 12:56:52.005214 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1528/3189] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:49 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1314 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:52.140067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1092677482", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "d9909e00-b744-4175-b623-82d810661ea9"}, {"port": "9e7a5dd5-586c-40ea-b7f3-c11aacd5c5b0", "tag": "port-1"}, {"port": "a69fd5b9-294a-4234-9531-c82133ce0190", "tag": "port-2"}, {"uuid": "8fadeec2-c5fe-4338-9f30-b139b638ed33", "tag": "net-1"}, {"uuid": "8fadeec2-c5fe-4338-9f30-b139b638ed33"}, {"uuid": "df453de3-f434-42f7-aa66-6bd0570600d1", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "df453de3-f434-42f7-aa66-6bd0570600d1", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "488f42a6-0de8-4938-9b67-ba5a3ce94b82", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "74508aba-52c3-4763-8ef1-92b837deb012", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "66c25e51-2346-408e-bd84-3523f31e13a7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1904150918"}], "key_name": "tempest-keypair-1857920673", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:52.235750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:56:52.597832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4f8cc4dc-67a1-4f38-af93-5da2d847e3f2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:52.656196 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4f8cc4dc-67a1-4f38-af93-5da2d847e3f2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1511 microversion: 2.1 time: 0.784409 Sep 08 12:56:52.657039 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1662/3190] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:51 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1511 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:53.040004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-73f9b26f-f925-4898-b96a-9e74900a9dfa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:53.042413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-73f9b26f-f925-4898-b96a-9e74900a9dfa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:53.058428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73f9b26f-f925-4898-b96a-9e74900a9dfa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:53.059830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73f9b26f-f925-4898-b96a-9e74900a9dfa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:53.060920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73f9b26f-f925-4898-b96a-9e74900a9dfa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:53.064407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73f9b26f-f925-4898-b96a-9e74900a9dfa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:53.065688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73f9b26f-f925-4898-b96a-9e74900a9dfa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:53.066870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73f9b26f-f925-4898-b96a-9e74900a9dfa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:53.263020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] validate_networks() for [('d9909e00-b744-4175-b623-82d810661ea9', None, None, None, None, None), (None, None, '9e7a5dd5-586c-40ea-b7f3-c11aacd5c5b0', None, None, None), (None, None, 'a69fd5b9-294a-4234-9531-c82133ce0190', None, None, None), ('8fadeec2-c5fe-4338-9f30-b139b638ed33', None, None, None, None, None), ('8fadeec2-c5fe-4338-9f30-b139b638ed33', None, None, None, None, None), ('df453de3-f434-42f7-aa66-6bd0570600d1', '10.2.2.100', None, None, None, None), ('df453de3-f434-42f7-aa66-6bd0570600d1', '10.2.2.200', None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:56:55.243692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-73f9b26f-f925-4898-b96a-9e74900a9dfa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:55.273111 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-73f9b26f-f925-4898-b96a-9e74900a9dfa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1314 microversion: 2.1 time: 2.243966 Sep 08 12:56:55.274673 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1663/3191] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:53 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1314 bytes in 2247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:56:55.294822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3ac651e2-4bd6-4642-acdc-a6fe6605147a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:56:55.296063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3ac651e2-4bd6-4642-acdc-a6fe6605147a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:56:55.321193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ac651e2-4bd6-4642-acdc-a6fe6605147a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:55.322022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ac651e2-4bd6-4642-acdc-a6fe6605147a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:55.322896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ac651e2-4bd6-4642-acdc-a6fe6605147a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:55.337000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ac651e2-4bd6-4642-acdc-a6fe6605147a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:55.337918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ac651e2-4bd6-4642-acdc-a6fe6605147a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:55.338720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ac651e2-4bd6-4642-acdc-a6fe6605147a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:55.823164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3ac651e2-4bd6-4642-acdc-a6fe6605147a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:56:55.874619 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3ac651e2-4bd6-4642-acdc-a6fe6605147a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1345 microversion: 2.1 time: 0.596851 Sep 08 12:56:55.876397 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1664/3192] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:56:55 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1345 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:56:55.887026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b1aa9539-5973-4f9a-a040-c6a22950ec03 req-947b7588-8944-4285-917a-de3d0fda6d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3368fcc-195b-45a7-92da-7bd0f4337247", "name": "network-vif-deleted", "tag": "a5c1871f-65d9-4128-935c-28aed8162d68"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:55.909681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b1aa9539-5973-4f9a-a040-c6a22950ec03 req-947b7588-8944-4285-917a-de3d0fda6d9d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:56:55.910949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b1aa9539-5973-4f9a-a040-c6a22950ec03 req-947b7588-8944-4285-917a-de3d0fda6d9d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:56:55.912095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b1aa9539-5973-4f9a-a040-c6a22950ec03 req-947b7588-8944-4285-917a-de3d0fda6d9d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:56:55.934882 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b1aa9539-5973-4f9a-a040-c6a22950ec03 req-947b7588-8944-4285-917a-de3d0fda6d9d service nova] Creating event network-vif-deleted:a5c1871f-65d9-4128-935c-28aed8162d68 for instance e3368fcc-195b-45a7-92da-7bd0f4337247 on n-h1-852084-10 Sep 08 12:56:55.944902 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b1aa9539-5973-4f9a-a040-c6a22950ec03 req-947b7588-8944-4285-917a-de3d0fda6d9d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066008 Sep 08 12:56:55.946032 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1665/3193] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:56:56.475803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1403263835", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "e905a95c-2324-49bd-8a89-bae4286a1b74"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:56:56.727037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] validate_networks() for [('e905a95c-2324-49bd-8a89-bae4286a1b74', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:56:56.754241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:01.122204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:57:01.135424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:57:01.136827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:57:01.137853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:57:01.143913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:57:01.163401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:01.186065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:01.190396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:01.192681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:01.194448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:01.195669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:01.196734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:01.221712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=70 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:01.247270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:57:01.263706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for user 227ef616a0764f5eaff5988f8a470f0c and project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:57:01.309846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:57:01.315733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:57:01.417445 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-58475ce2-c4eb-4b83-9fab-4a25df0e6bd9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.447505 Sep 08 12:57:01.428737 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1666/3194] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:56:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 5482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:57:01.442938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-db852ed3-1815-454f-b675-ba4c5e0c955e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:01.443748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-db852ed3-1815-454f-b675-ba4c5e0c955e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:01.456396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db852ed3-1815-454f-b675-ba4c5e0c955e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:01.456879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db852ed3-1815-454f-b675-ba4c5e0c955e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:01.457281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db852ed3-1815-454f-b675-ba4c5e0c955e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:01.458233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db852ed3-1815-454f-b675-ba4c5e0c955e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:01.458740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db852ed3-1815-454f-b675-ba4c5e0c955e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:01.459257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db852ed3-1815-454f-b675-ba4c5e0c955e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:01.986000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:03.262188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-db852ed3-1815-454f-b675-ba4c5e0c955e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:03.305941 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-db852ed3-1815-454f-b675-ba4c5e0c955e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1314 microversion: 2.1 time: 1.874264 Sep 08 12:57:03.314904 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1667/3195] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:01 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1314 bytes in 1885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:03.344438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-483aab79-a49b-47a3-a7be-e5918ea5d67b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:03.346631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-483aab79-a49b-47a3-a7be-e5918ea5d67b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:03.398385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-483aab79-a49b-47a3-a7be-e5918ea5d67b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:03.400229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-483aab79-a49b-47a3-a7be-e5918ea5d67b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:03.401393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-483aab79-a49b-47a3-a7be-e5918ea5d67b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:03.403709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-483aab79-a49b-47a3-a7be-e5918ea5d67b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:03.408489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-483aab79-a49b-47a3-a7be-e5918ea5d67b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:03.410389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-483aab79-a49b-47a3-a7be-e5918ea5d67b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:04.439548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-483aab79-a49b-47a3-a7be-e5918ea5d67b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:04.470818 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-483aab79-a49b-47a3-a7be-e5918ea5d67b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 200 len: 1345 microversion: 2.1 time: 1.153212 Sep 08 12:57:04.489124 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1668/3196] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:03 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 1345 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:04.635944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1752610983", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "28402a4f-f36c-4550-9d01-5a5ffeae7aa0"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:04.813621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] validate_networks() for [('28402a4f-f36c-4550-9d01-5a5ffeae7aa0', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:57:07.387970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:57:07.389042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:57:07.389042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:57:07.389436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:57:07.389678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:57:07.412069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:07.412573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:07.413013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:07.413802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:07.414259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:07.414862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:07.425889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:07.475713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Getting quotas for project ddb59ad8531d447082e1f77207b3c656. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:57:07.491896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Getting quotas for user 5b997c71bc4b443bb6441ba1eeabab2d and project ddb59ad8531d447082e1f77207b3c656. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:57:07.555617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:57:07.566974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:57:07.757964 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1275f586-18e7-431e-9c40-4f647cf59318 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.266121 Sep 08 12:57:07.759209 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1669/3197] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:57:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3269 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:57:07.798312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-71c86b04-f9e4-4f46-a77a-7ea612772d8e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:07.800429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-71c86b04-f9e4-4f46-a77a-7ea612772d8e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:07.837776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71c86b04-f9e4-4f46-a77a-7ea612772d8e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:07.840231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71c86b04-f9e4-4f46-a77a-7ea612772d8e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:07.845333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71c86b04-f9e4-4f46-a77a-7ea612772d8e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:07.846773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71c86b04-f9e4-4f46-a77a-7ea612772d8e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:07.847998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71c86b04-f9e4-4f46-a77a-7ea612772d8e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:07.860088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71c86b04-f9e4-4f46-a77a-7ea612772d8e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:08.018558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-71c86b04-f9e4-4f46-a77a-7ea612772d8e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:08.055043 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-71c86b04-f9e4-4f46-a77a-7ea612772d8e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 200 len: 1251 microversion: 2.1 time: 0.289819 Sep 08 12:57:08.055751 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1670/3198] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:07 2022] GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 1251 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:08.087752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-10955e14-c38a-4cfb-b5ae-22bb5553fc75 req-35e295c7-e0af-4aa6-91ab-a6858e612e9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b685045a-400a-4641-a603-1d2fea9bbcf1", "name": "network-vif-plugged", "status": "completed", "tag": "c78a1808-531d-4ec3-b753-f992ef457785"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:08.119371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-10955e14-c38a-4cfb-b5ae-22bb5553fc75 req-35e295c7-e0af-4aa6-91ab-a6858e612e9c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:08.120735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-10955e14-c38a-4cfb-b5ae-22bb5553fc75 req-35e295c7-e0af-4aa6-91ab-a6858e612e9c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:08.121381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-10955e14-c38a-4cfb-b5ae-22bb5553fc75 req-35e295c7-e0af-4aa6-91ab-a6858e612e9c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:08.178655 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-10955e14-c38a-4cfb-b5ae-22bb5553fc75 req-35e295c7-e0af-4aa6-91ab-a6858e612e9c service nova] Creating event network-vif-plugged:c78a1808-531d-4ec3-b753-f992ef457785 for instance b685045a-400a-4641-a603-1d2fea9bbcf1 on n-h2-852084-10 Sep 08 12:57:08.192169 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-10955e14-c38a-4cfb-b5ae-22bb5553fc75 req-35e295c7-e0af-4aa6-91ab-a6858e612e9c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134777 Sep 08 12:57:08.199357 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1671/3199] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:08.212167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0455defa-856f-46ba-b8ec-d234569a3a10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:08.213398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0455defa-856f-46ba-b8ec-d234569a3a10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:08.235385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0455defa-856f-46ba-b8ec-d234569a3a10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:08.248155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0455defa-856f-46ba-b8ec-d234569a3a10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:08.255578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0455defa-856f-46ba-b8ec-d234569a3a10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:08.256738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0455defa-856f-46ba-b8ec-d234569a3a10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:08.259450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0455defa-856f-46ba-b8ec-d234569a3a10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:08.260866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0455defa-856f-46ba-b8ec-d234569a3a10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:09.661049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0455defa-856f-46ba-b8ec-d234569a3a10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:09.682784 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0455defa-856f-46ba-b8ec-d234569a3a10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1314 microversion: 2.1 time: 1.480471 Sep 08 12:57:09.701161 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1672/3200] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:08 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1314 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:09.732238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-656a5fa4-5cd4-473e-98f3-e3126070ee36 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:09.742121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-656a5fa4-5cd4-473e-98f3-e3126070ee36 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:09.761433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-656a5fa4-5cd4-473e-98f3-e3126070ee36 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:09.761943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-656a5fa4-5cd4-473e-98f3-e3126070ee36 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:09.765420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-656a5fa4-5cd4-473e-98f3-e3126070ee36 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:09.769682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-656a5fa4-5cd4-473e-98f3-e3126070ee36 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:09.773088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-656a5fa4-5cd4-473e-98f3-e3126070ee36 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:09.774570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-656a5fa4-5cd4-473e-98f3-e3126070ee36 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:09.815889 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-656a5fa4-5cd4-473e-98f3-e3126070ee36 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-656a5fa4-5cd4-473e-98f3-e3126070ee36 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 HTTP/1.1 Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'e3368fcc-195b-45a7-92da-7bd0f4337247'} Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:09.817982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:09.823449 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:09.823449 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:09.823449 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:09.823449 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:57:09.823449 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:57:09.823449 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 12:57:09.823449 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:09.825251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-656a5fa4-5cd4-473e-98f3-e3126070ee36 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:09.826381 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-656a5fa4-5cd4-473e-98f3-e3126070ee36 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 404 len: 111 microversion: 2.1 time: 0.109950 Sep 08 12:57:09.827558 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1673/3201] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:09 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:57:09.889287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:57:09.890251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:57:09.895619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:57:09.899904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:57:09.900634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:57:09.962278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:09.969318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:09.970261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:09.982572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:09.983522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:09.984591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:10.072116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Getting quotas for project dde98df8ff64478e93fde5f75096c60a. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:57:10.089549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Getting quotas for user 39d5a18c9a8d462ca4e9fcdc74dfc8c2 and project dde98df8ff64478e93fde5f75096c60a. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:57:10.667583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:57:10.671930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='488f42a6-0de8-4938-9b67-ba5a3ce94b82',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='74508aba-52c3-4763-8ef1-92b837deb012',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='66c25e51-2346-408e-bd84-3523f31e13a7',volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:57:10.695931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7fb0e6cb-4314-442c-ad66-7c54fb2daf12 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Action: 'create', calling method: .version_select at 0x7fdb3f0f1940>, body: {"keypair": {"name": "tempest-keypair-1622738502", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMVfoOnx777BMQ54c8j3of7mfo2fprN8XkocK/vIxAFzPjq1BnEIFXeBsbm7Q1jqJTb9lgl1gZJSQko2wdjSqsR8RVfmnm/or2V/QLvZvPsMcV19FGawoyutxBWw/VSAQ=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:10.779358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-7fb0e6cb-4314-442c-ad66-7c54fb2daf12 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Getting quotas for project 1abfd6549b7e464d8d3a17dbc72f227b. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:57:10.806458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-7fb0e6cb-4314-442c-ad66-7c54fb2daf12 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Getting quotas for user ef2a83052af5421bb6d637a5ae66f9c3 and project 1abfd6549b7e464d8d3a17dbc72f227b. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:57:10.907618 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7fb0e6cb-4314-442c-ad66-7c54fb2daf12 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.077283 Sep 08 12:57:10.923729 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1674/3202] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:57:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:10.938413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3f2b8830-8ca0-4984-b495-5fcc531a6375 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:10.942965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3f2b8830-8ca0-4984-b495-5fcc531a6375 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:10.963952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2b8830-8ca0-4984-b495-5fcc531a6375 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:10.965009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2b8830-8ca0-4984-b495-5fcc531a6375 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:10.965788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2b8830-8ca0-4984-b495-5fcc531a6375 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:10.968654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2b8830-8ca0-4984-b495-5fcc531a6375 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:10.971219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2b8830-8ca0-4984-b495-5fcc531a6375 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:10.972403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2b8830-8ca0-4984-b495-5fcc531a6375 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:11.329118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3f2b8830-8ca0-4984-b495-5fcc531a6375 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b997c71bc4b443bb6441ba1eeabab2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb59ad8531d447082e1f77207b3c656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:11.346800 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3f2b8830-8ca0-4984-b495-5fcc531a6375 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 200 len: 1294 microversion: 2.1 time: 0.421597 Sep 08 12:57:11.348302 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1675/3203] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:10 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 1294 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:11.354443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cbf464cf-38ec-4d88-9a7c-5ce04c8570ff tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:11.360985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cbf464cf-38ec-4d88-9a7c-5ce04c8570ff tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:11.374830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbf464cf-38ec-4d88-9a7c-5ce04c8570ff tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:11.377079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbf464cf-38ec-4d88-9a7c-5ce04c8570ff tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:11.379118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbf464cf-38ec-4d88-9a7c-5ce04c8570ff tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:11.381274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbf464cf-38ec-4d88-9a7c-5ce04c8570ff tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:11.382043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbf464cf-38ec-4d88-9a7c-5ce04c8570ff tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:11.382510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cbf464cf-38ec-4d88-9a7c-5ce04c8570ff tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:11.828808 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-75458ff5-98c8-42b6-8c88-6281ca78f7b1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 19.722991 Sep 08 12:57:11.832671 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1529/3204] 10.222.0.78 () {62 vars in 1189 bytes} [Thu Sep 8 12:56:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 19728 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 12:57:11.847253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-080946cb-bbe3-43e3-b922-2db144cd43ef tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:11.856659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-080946cb-bbe3-43e3-b922-2db144cd43ef tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:11.873655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-080946cb-bbe3-43e3-b922-2db144cd43ef tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:11.874152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-080946cb-bbe3-43e3-b922-2db144cd43ef tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:11.874613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-080946cb-bbe3-43e3-b922-2db144cd43ef tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:11.878102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-080946cb-bbe3-43e3-b922-2db144cd43ef tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:11.880729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-080946cb-bbe3-43e3-b922-2db144cd43ef tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:11.881516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-080946cb-bbe3-43e3-b922-2db144cd43ef tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:11.920326 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-080946cb-bbe3-43e3-b922-2db144cd43ef tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-080946cb-bbe3-43e3-b922-2db144cd43ef tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247/os-volume_attachments HTTP/1.1 Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'server_id': 'e3368fcc-195b-45a7-92da-7bd0f4337247'} Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:57:11.924129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-080946cb-bbe3-43e3-b922-2db144cd43ef tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:11.932034 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-080946cb-bbe3-43e3-b922-2db144cd43ef tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.093091 Sep 08 12:57:11.934038 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1530/3205] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 12:57:11 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247/os-volume_attachments => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:57:11.957464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d9bcdcee-c314-4787-b274-f14bf1d29393 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:11.959326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d9bcdcee-c314-4787-b274-f14bf1d29393 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:11.980401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9bcdcee-c314-4787-b274-f14bf1d29393 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:11.982706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9bcdcee-c314-4787-b274-f14bf1d29393 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:11.984093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9bcdcee-c314-4787-b274-f14bf1d29393 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:11.986539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9bcdcee-c314-4787-b274-f14bf1d29393 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:11.988044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9bcdcee-c314-4787-b274-f14bf1d29393 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:11.989270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9bcdcee-c314-4787-b274-f14bf1d29393 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:12.773213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cbf464cf-38ec-4d88-9a7c-5ce04c8570ff tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:12.782875 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cbf464cf-38ec-4d88-9a7c-5ce04c8570ff tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 200 len: 1293 microversion: 2.1 time: 1.433063 Sep 08 12:57:12.786470 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1676/3206] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:11 2022] GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 1293 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:12.802779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-03107fef-2db0-43e7-97bc-bc3679f26e4f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:12.806617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-03107fef-2db0-43e7-97bc-bc3679f26e4f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:13.327626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-03107fef-2db0-43e7-97bc-bc3679f26e4f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:13.366902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-03107fef-2db0-43e7-97bc-bc3679f26e4f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:13.370992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-03107fef-2db0-43e7-97bc-bc3679f26e4f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:13.373914 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-03107fef-2db0-43e7-97bc-bc3679f26e4f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1286 microversion: 2.42 time: 0.575056 Sep 08 12:57:13.375875 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1677/3207] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:12 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1286 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:13.385831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-236275767", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "dbd28b0c-6c95-45fa-bc88-dd4ecaae050a"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:13.613064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] validate_networks() for [('dbd28b0c-6c95-45fa-bc88-dd4ecaae050a', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:57:14.396856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d9bcdcee-c314-4787-b274-f14bf1d29393 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:14.424638 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d9bcdcee-c314-4787-b274-f14bf1d29393 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1501 microversion: 2.1 time: 2.480091 Sep 08 12:57:14.425681 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1531/3208] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:11 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1501 bytes in 2482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:14.463330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4f336cfa-e563-47bd-8f64-523f558c83ca tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:14.464690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4f336cfa-e563-47bd-8f64-523f558c83ca tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:14.494021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f336cfa-e563-47bd-8f64-523f558c83ca tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:14.495884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f336cfa-e563-47bd-8f64-523f558c83ca tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:14.497470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f336cfa-e563-47bd-8f64-523f558c83ca tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:14.514022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f336cfa-e563-47bd-8f64-523f558c83ca tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:14.515440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f336cfa-e563-47bd-8f64-523f558c83ca tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:14.516579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f336cfa-e563-47bd-8f64-523f558c83ca tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:14.975010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4f336cfa-e563-47bd-8f64-523f558c83ca tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b997c71bc4b443bb6441ba1eeabab2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb59ad8531d447082e1f77207b3c656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:14.985242 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4f336cfa-e563-47bd-8f64-523f558c83ca tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 200 len: 1282 microversion: 2.1 time: 0.553562 Sep 08 12:57:15.001235 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1532/3209] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:14 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 1282 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:15.033410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c9066f44-079b-4a1a-8198-d00f7b757ca3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:15.035019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c9066f44-079b-4a1a-8198-d00f7b757ca3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:15.055240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c9066f44-079b-4a1a-8198-d00f7b757ca3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:15.062205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c9066f44-079b-4a1a-8198-d00f7b757ca3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:15.064771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c9066f44-079b-4a1a-8198-d00f7b757ca3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:15.067395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c9066f44-079b-4a1a-8198-d00f7b757ca3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:15.068139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c9066f44-079b-4a1a-8198-d00f7b757ca3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:15.069266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c9066f44-079b-4a1a-8198-d00f7b757ca3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:15.881218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c9066f44-079b-4a1a-8198-d00f7b757ca3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:15.907919 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c9066f44-079b-4a1a-8198-d00f7b757ca3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 200 len: 1293 microversion: 2.1 time: 0.898692 Sep 08 12:57:15.916713 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1533/3210] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:15 2022] GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 1293 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:15.936803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ba19638c-2865-4951-bd2b-dede0f6fa005 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:15.937968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ba19638c-2865-4951-bd2b-dede0f6fa005 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:16.002820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba19638c-2865-4951-bd2b-dede0f6fa005 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:16.005040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba19638c-2865-4951-bd2b-dede0f6fa005 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:16.018682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba19638c-2865-4951-bd2b-dede0f6fa005 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:16.021089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba19638c-2865-4951-bd2b-dede0f6fa005 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:16.022111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba19638c-2865-4951-bd2b-dede0f6fa005 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:16.022915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba19638c-2865-4951-bd2b-dede0f6fa005 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:16.549021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ba19638c-2865-4951-bd2b-dede0f6fa005 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:16.565467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:57:16.566417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:57:16.567506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:57:16.568857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:57:16.569789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:57:16.613030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ba19638c-2865-4951-bd2b-dede0f6fa005 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:16.621758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ba19638c-2865-4951-bd2b-dede0f6fa005 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:16.622461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:16.625652 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ba19638c-2865-4951-bd2b-dede0f6fa005 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1594 microversion: 2.42 time: 0.707064 Sep 08 12:57:16.626967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:16.628054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:16.635579 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1534/3211] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:15 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1594 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:16.638086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:16.639564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:16.641056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:16.666630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-64c37859-c825-4495-9178-e860f10024ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:16.675350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-64c37859-c825-4495-9178-e860f10024ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:16.731567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64c37859-c825-4495-9178-e860f10024ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:16.735299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64c37859-c825-4495-9178-e860f10024ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:16.736524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64c37859-c825-4495-9178-e860f10024ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:16.740498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64c37859-c825-4495-9178-e860f10024ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:16.743058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64c37859-c825-4495-9178-e860f10024ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:16.746171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64c37859-c825-4495-9178-e860f10024ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:16.763911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:57:16.790545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for user d9a995d2889c47738ad0b5255445c5f0 and project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:57:16.839536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:57:16.847793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 9293faa9-998b-475e-886a-d72dee099818] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:57:16.881824 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-64c37859-c825-4495-9178-e860f10024ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1/action" status: 200 len: 14 microversion: 2.1 time: 0.243664 Sep 08 12:57:16.884395 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1535/3212] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:57:16 2022] POST /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1/action => generated 14 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:57:16.909599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a9d41a27-1039-4c97-ba36-ed9a99a1f39a tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:16.910429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a9d41a27-1039-4c97-ba36-ed9a99a1f39a tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:16.929010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9d41a27-1039-4c97-ba36-ed9a99a1f39a tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:16.937034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9d41a27-1039-4c97-ba36-ed9a99a1f39a tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:16.937764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9d41a27-1039-4c97-ba36-ed9a99a1f39a tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:16.941900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9d41a27-1039-4c97-ba36-ed9a99a1f39a tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:16.942547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9d41a27-1039-4c97-ba36-ed9a99a1f39a tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:16.943068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9d41a27-1039-4c97-ba36-ed9a99a1f39a tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:16.995370 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca53f273-2c57-4977-a38c-111dbc31ecdc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.617021 Sep 08 12:57:16.998525 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1678/3213] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:57:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 3621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:57:17.009917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-04740a34-bb7a-4fee-8ecd-0857b0dd1fc7 req-d626b3b3-794b-46c6-993b-4c2eacb3cfb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90a767f4-2dcd-4dff-b8a0-ad87d0864ee4", "tag": "8cb84f34-e16f-4afb-8a60-19a607783761"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:17.042423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-04740a34-bb7a-4fee-8ecd-0857b0dd1fc7 req-d626b3b3-794b-46c6-993b-4c2eacb3cfb8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:17.043800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-04740a34-bb7a-4fee-8ecd-0857b0dd1fc7 req-d626b3b3-794b-46c6-993b-4c2eacb3cfb8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:17.044799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-04740a34-bb7a-4fee-8ecd-0857b0dd1fc7 req-d626b3b3-794b-46c6-993b-4c2eacb3cfb8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:17.124769 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-04740a34-bb7a-4fee-8ecd-0857b0dd1fc7 req-d626b3b3-794b-46c6-993b-4c2eacb3cfb8 service nova] Creating event network-changed:8cb84f34-e16f-4afb-8a60-19a607783761 for instance 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 on n-h1-852084-10 Sep 08 12:57:17.156864 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-04740a34-bb7a-4fee-8ecd-0857b0dd1fc7 req-d626b3b3-794b-46c6-993b-4c2eacb3cfb8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141952 Sep 08 12:57:17.158849 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1679/3214] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:17.196759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f388d779-9c73-4d36-891a-0c09f69aeead tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:17.206894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f388d779-9c73-4d36-891a-0c09f69aeead tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:17.242762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f388d779-9c73-4d36-891a-0c09f69aeead tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:17.243259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f388d779-9c73-4d36-891a-0c09f69aeead tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:17.244087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f388d779-9c73-4d36-891a-0c09f69aeead tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:17.252734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f388d779-9c73-4d36-891a-0c09f69aeead tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:17.255985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f388d779-9c73-4d36-891a-0c09f69aeead tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:17.260752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f388d779-9c73-4d36-891a-0c09f69aeead tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:17.628918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a9d41a27-1039-4c97-ba36-ed9a99a1f39a tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b997c71bc4b443bb6441ba1eeabab2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb59ad8531d447082e1f77207b3c656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:17.647075 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a9d41a27-1039-4c97-ba36-ed9a99a1f39a tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 200 len: 1324 microversion: 2.1 time: 0.760143 Sep 08 12:57:17.649064 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1536/3215] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:16 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 1324 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:17.661463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a1f7ed2f-fe2b-489c-b2f3-cbca6d5be132 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:17.663679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a1f7ed2f-fe2b-489c-b2f3-cbca6d5be132 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 9293faa9-998b-475e-886a-d72dee099818] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:17.804586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a1f7ed2f-fe2b-489c-b2f3-cbca6d5be132 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:17.818423 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a1f7ed2f-fe2b-489c-b2f3-cbca6d5be132 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818" status: 200 len: 1214 microversion: 2.1 time: 0.164855 Sep 08 12:57:17.820293 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1537/3216] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:17 2022] GET /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818 => generated 1214 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:17.838712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a98d30f1-001c-493c-8326-919030a10e0b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:17.839759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a98d30f1-001c-493c-8326-919030a10e0b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:17.858321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a98d30f1-001c-493c-8326-919030a10e0b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:17.858994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a98d30f1-001c-493c-8326-919030a10e0b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:17.860166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a98d30f1-001c-493c-8326-919030a10e0b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:17.862637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a98d30f1-001c-493c-8326-919030a10e0b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:17.864131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a98d30f1-001c-493c-8326-919030a10e0b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:17.864873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a98d30f1-001c-493c-8326-919030a10e0b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:18.057525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a98d30f1-001c-493c-8326-919030a10e0b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:18.070385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a98d30f1-001c-493c-8326-919030a10e0b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:18.082408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a98d30f1-001c-493c-8326-919030a10e0b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:18.088568 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a98d30f1-001c-493c-8326-919030a10e0b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1594 microversion: 2.42 time: 0.265499 Sep 08 12:57:18.094553 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1538/3217] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:17 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1594 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:18.118680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c7a228e4-d382-4e49-9cfd-446a8ffa6d7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:18.119610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c7a228e4-d382-4e49-9cfd-446a8ffa6d7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 9293faa9-998b-475e-886a-d72dee099818] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:18.185904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c7a228e4-d382-4e49-9cfd-446a8ffa6d7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 9293faa9-998b-475e-886a-d72dee099818] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:57:18.240469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f388d779-9c73-4d36-891a-0c09f69aeead tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:18.297018 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f388d779-9c73-4d36-891a-0c09f69aeead tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 200 len: 1293 microversion: 2.1 time: 1.135799 Sep 08 12:57:18.303895 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1680/3218] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:17 2022] GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 1293 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:18.318514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-34daa4b6-2dce-4cd7-a725-719fd2334cea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:18.324411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-34daa4b6-2dce-4cd7-a725-719fd2334cea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:18.340846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34daa4b6-2dce-4cd7-a725-719fd2334cea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:18.341358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34daa4b6-2dce-4cd7-a725-719fd2334cea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:18.341784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34daa4b6-2dce-4cd7-a725-719fd2334cea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:18.342533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34daa4b6-2dce-4cd7-a725-719fd2334cea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:18.360117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34daa4b6-2dce-4cd7-a725-719fd2334cea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:18.361344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34daa4b6-2dce-4cd7-a725-719fd2334cea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:18.499057 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-34daa4b6-2dce-4cd7-a725-719fd2334cea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1/action" status: 200 len: 14 microversion: 2.1 time: 0.191887 Sep 08 12:57:18.500307 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1681/3219] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:57:18 2022] POST /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:57:18.678261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-399d4655-97a8-494c-88ad-809d8a054071 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:18.678998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-399d4655-97a8-494c-88ad-809d8a054071 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:18.690163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-399d4655-97a8-494c-88ad-809d8a054071 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:18.690567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-399d4655-97a8-494c-88ad-809d8a054071 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:18.691016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-399d4655-97a8-494c-88ad-809d8a054071 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:18.706442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-399d4655-97a8-494c-88ad-809d8a054071 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:18.707037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-399d4655-97a8-494c-88ad-809d8a054071 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:18.710215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-399d4655-97a8-494c-88ad-809d8a054071 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:18.810621 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.scheduler.client.report [None req-c7a228e4-d382-4e49-9cfd-446a8ffa6d7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Deleted allocations for instance 9293faa9-998b-475e-886a-d72dee099818 Sep 08 12:57:18.864437 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c7a228e4-d382-4e49-9cfd-446a8ffa6d7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818" status: 204 len: 0 microversion: 2.1 time: 0.767683 Sep 08 12:57:18.865293 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1539/3220] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:57:18 2022] DELETE /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818 => generated 0 bytes in 770 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:57:18.874759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fd1d1661-1f0e-4e46-87da-9c2c2c5dd5ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:18.876613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fd1d1661-1f0e-4e46-87da-9c2c2c5dd5ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 9293faa9-998b-475e-886a-d72dee099818] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:18.885168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd1d1661-1f0e-4e46-87da-9c2c2c5dd5ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:18.886209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd1d1661-1f0e-4e46-87da-9c2c2c5dd5ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:18.886912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd1d1661-1f0e-4e46-87da-9c2c2c5dd5ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:18.888317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd1d1661-1f0e-4e46-87da-9c2c2c5dd5ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:18.889194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd1d1661-1f0e-4e46-87da-9c2c2c5dd5ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:18.889905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd1d1661-1f0e-4e46-87da-9c2c2c5dd5ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:18.908466 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-fd1d1661-1f0e-4e46-87da-9c2c2c5dd5ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fd1d1661-1f0e-4e46-87da-9c2c2c5dd5ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818 HTTP/1.1 Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '9293faa9-998b-475e-886a-d72dee099818'} Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:18.910853 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:18.916490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:18.916490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:18.916490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:18.916490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:57:18.916490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:57:18.916490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 12:57:18.916490 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:18.919189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fd1d1661-1f0e-4e46-87da-9c2c2c5dd5ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:18.920478 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fd1d1661-1f0e-4e46-87da-9c2c2c5dd5ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818" status: 404 len: 111 microversion: 2.1 time: 0.050330 Sep 08 12:57:18.921318 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1540/3221] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:18 2022] GET /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:57:18.991033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-945060158", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "dbd28b0c-6c95-45fa-bc88-dd4ecaae050a"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:19.060124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] validate_networks() for [('dbd28b0c-6c95-45fa-bc88-dd4ecaae050a', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:57:20.015900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:20.086176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-399d4655-97a8-494c-88ad-809d8a054071 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b997c71bc4b443bb6441ba1eeabab2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb59ad8531d447082e1f77207b3c656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:20.104374 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-399d4655-97a8-494c-88ad-809d8a054071 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 200 len: 1324 microversion: 2.1 time: 1.428401 Sep 08 12:57:20.106584 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1682/3222] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:18 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 1324 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:57:20.127625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2ba973d5-8293-4879-bbf0-0e1437dfd5e3 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:20.128396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2ba973d5-8293-4879-bbf0-0e1437dfd5e3 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:20.155419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ba973d5-8293-4879-bbf0-0e1437dfd5e3 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:20.162148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ba973d5-8293-4879-bbf0-0e1437dfd5e3 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:20.162652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ba973d5-8293-4879-bbf0-0e1437dfd5e3 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:20.165465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ba973d5-8293-4879-bbf0-0e1437dfd5e3 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:20.165975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ba973d5-8293-4879-bbf0-0e1437dfd5e3 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:20.166436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ba973d5-8293-4879-bbf0-0e1437dfd5e3 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:20.349907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2ba973d5-8293-4879-bbf0-0e1437dfd5e3 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:20.376201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2ba973d5-8293-4879-bbf0-0e1437dfd5e3 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:20.378113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2ba973d5-8293-4879-bbf0-0e1437dfd5e3 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:20.379683 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2ba973d5-8293-4879-bbf0-0e1437dfd5e3 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1594 microversion: 2.42 time: 0.269370 Sep 08 12:57:20.393925 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1683/3223] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:20 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1594 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:20.393925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-32374b53-571c-4934-9858-25c87a867b7d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:20.393925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-32374b53-571c-4934-9858-25c87a867b7d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:20.405481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32374b53-571c-4934-9858-25c87a867b7d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:20.406007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32374b53-571c-4934-9858-25c87a867b7d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:20.406572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32374b53-571c-4934-9858-25c87a867b7d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:20.407976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32374b53-571c-4934-9858-25c87a867b7d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:20.412001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32374b53-571c-4934-9858-25c87a867b7d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:20.412615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32374b53-571c-4934-9858-25c87a867b7d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:20.917767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-32374b53-571c-4934-9858-25c87a867b7d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:20.943435 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-32374b53-571c-4934-9858-25c87a867b7d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 200 len: 1293 microversion: 2.1 time: 0.558071 Sep 08 12:57:20.944329 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1684/3224] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:20 2022] GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 1293 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:20.966311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae392cb2-f14b-46f0-a501-49cc3c8d6a7e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:20.970314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ae392cb2-f14b-46f0-a501-49cc3c8d6a7e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:20.988206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae392cb2-f14b-46f0-a501-49cc3c8d6a7e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:20.991606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae392cb2-f14b-46f0-a501-49cc3c8d6a7e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:20.992364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae392cb2-f14b-46f0-a501-49cc3c8d6a7e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:20.998316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae392cb2-f14b-46f0-a501-49cc3c8d6a7e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:20.999480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae392cb2-f14b-46f0-a501-49cc3c8d6a7e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:21.002426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae392cb2-f14b-46f0-a501-49cc3c8d6a7e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:21.099745 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ae392cb2-f14b-46f0-a501-49cc3c8d6a7e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1/action" status: 200 len: 14 microversion: 2.1 time: 0.153116 Sep 08 12:57:21.101792 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1685/3225] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:57:20 2022] POST /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1/action => generated 14 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 12:57:21.112128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1717038331", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "19772a64-a8de-4b39-8236-1222cb3472a3"}], "security_groups": [{"name": "tempest-securitygroup--328556441"}], "key_name": "tempest-keypair-1622738502", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:21.498284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] validate_networks() for [('19772a64-a8de-4b39-8236-1222cb3472a3', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:57:21.726944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:57:21.727752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:57:21.728606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:57:21.729772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:57:21.731171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:57:21.766667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:21.768292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:21.769436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:21.771317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:21.772465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:21.773817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:21.828843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:57:21.862912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for user d9a995d2889c47738ad0b5255445c5f0 and project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:57:21.912321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:57:21.915827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:57:22.000743 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-706209ac-39fb-440d-8608-c978d1327f8b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.016797 Sep 08 12:57:22.006419 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1541/3226] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:57:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 3024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 12:57:22.022644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3427fcb1-26c8-46a5-b3e6-d79a9e895ea7 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:22.023991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3427fcb1-26c8-46a5-b3e6-d79a9e895ea7 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:22.084231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3427fcb1-26c8-46a5-b3e6-d79a9e895ea7 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:22.086094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3427fcb1-26c8-46a5-b3e6-d79a9e895ea7 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:22.092353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3427fcb1-26c8-46a5-b3e6-d79a9e895ea7 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:22.093428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3427fcb1-26c8-46a5-b3e6-d79a9e895ea7 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:22.097041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3427fcb1-26c8-46a5-b3e6-d79a9e895ea7 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:22.098310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3427fcb1-26c8-46a5-b3e6-d79a9e895ea7 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:23.441170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3427fcb1-26c8-46a5-b3e6-d79a9e895ea7 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b997c71bc4b443bb6441ba1eeabab2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb59ad8531d447082e1f77207b3c656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:23.456579 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3427fcb1-26c8-46a5-b3e6-d79a9e895ea7 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 200 len: 1324 microversion: 2.1 time: 1.446937 Sep 08 12:57:23.464609 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1542/3227] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:22 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 1324 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:23.484014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-86ed8e2b-c317-4006-9084-7af96877e65a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:23.485390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-86ed8e2b-c317-4006-9084-7af96877e65a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:23.505950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86ed8e2b-c317-4006-9084-7af96877e65a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:23.508149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86ed8e2b-c317-4006-9084-7af96877e65a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:23.510927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86ed8e2b-c317-4006-9084-7af96877e65a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:23.514070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86ed8e2b-c317-4006-9084-7af96877e65a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:23.515983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86ed8e2b-c317-4006-9084-7af96877e65a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:23.517284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86ed8e2b-c317-4006-9084-7af96877e65a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:24.646482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-86ed8e2b-c317-4006-9084-7af96877e65a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:24.686512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-86ed8e2b-c317-4006-9084-7af96877e65a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:24.690543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-86ed8e2b-c317-4006-9084-7af96877e65a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:24.703808 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-86ed8e2b-c317-4006-9084-7af96877e65a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1709 microversion: 2.42 time: 1.237286 Sep 08 12:57:24.719980 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1543/3228] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:23 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1709 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:24.752345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c3dacc1a-c781-4814-9a47-bb8abb8033bd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:24.753459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c3dacc1a-c781-4814-9a47-bb8abb8033bd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:24.775708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3dacc1a-c781-4814-9a47-bb8abb8033bd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:24.777294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3dacc1a-c781-4814-9a47-bb8abb8033bd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:24.778136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3dacc1a-c781-4814-9a47-bb8abb8033bd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:24.779877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3dacc1a-c781-4814-9a47-bb8abb8033bd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:24.780822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3dacc1a-c781-4814-9a47-bb8abb8033bd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:24.781939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3dacc1a-c781-4814-9a47-bb8abb8033bd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:26.041019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c3dacc1a-c781-4814-9a47-bb8abb8033bd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:26.056199 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c3dacc1a-c781-4814-9a47-bb8abb8033bd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 200 len: 1293 microversion: 2.1 time: 1.334504 Sep 08 12:57:26.057233 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1544/3229] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:24 2022] GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 1293 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:26.062110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f9835eb4-791e-47b0-a34f-08ab65dae294 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:26.064370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f9835eb4-791e-47b0-a34f-08ab65dae294 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:26.086132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9835eb4-791e-47b0-a34f-08ab65dae294 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:26.086908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9835eb4-791e-47b0-a34f-08ab65dae294 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:26.087602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9835eb4-791e-47b0-a34f-08ab65dae294 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:26.088596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9835eb4-791e-47b0-a34f-08ab65dae294 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:26.089721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9835eb4-791e-47b0-a34f-08ab65dae294 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:26.090163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9835eb4-791e-47b0-a34f-08ab65dae294 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:26.510937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f9835eb4-791e-47b0-a34f-08ab65dae294 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:26.529363 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f9835eb4-791e-47b0-a34f-08ab65dae294 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1272 microversion: 2.1 time: 0.470609 Sep 08 12:57:26.554048 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1545/3230] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:26 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1272 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:26.574993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2a82fc9-161b-4274-954a-856ca581b6ac tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:26.580815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2a82fc9-161b-4274-954a-856ca581b6ac tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:26.617307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2a82fc9-161b-4274-954a-856ca581b6ac tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:26.622067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2a82fc9-161b-4274-954a-856ca581b6ac tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:26.623462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2a82fc9-161b-4274-954a-856ca581b6ac tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:26.627967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2a82fc9-161b-4274-954a-856ca581b6ac tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:26.633555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2a82fc9-161b-4274-954a-856ca581b6ac tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:26.634363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2a82fc9-161b-4274-954a-856ca581b6ac tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:26.648080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Getting quotas for project 1abfd6549b7e464d8d3a17dbc72f227b. Resources: dict_keys(['metadata_items']) {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:57:26.672761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Getting quotas for user ef2a83052af5421bb6d637a5ae66f9c3 and project 1abfd6549b7e464d8d3a17dbc72f227b. Resources: dict_keys(['metadata_items']) {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:57:26.693737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:26.723352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:26.745147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:57:26.745571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:57:26.749809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:57:26.750556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:57:26.751213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:57:26.780525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=29 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:26.793051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:26.808008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:26.808008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:26.808008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:26.808008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:26.808008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:26.818755 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2a82fc9-161b-4274-954a-856ca581b6ac tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1/action" status: 200 len: 16401 microversion: 2.1 time: 0.261102 Sep 08 12:57:26.821368 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1546/3231] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:57:26 2022] POST /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1/action => generated 16401 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 12:57:26.830529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-96bf72a8-402b-468b-af54-b912aec49326 req-6b116a3c-bcad-4e4e-b40c-81ea1193e961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "041b58e4-953e-4b1f-b52d-246d904017f5", "tag": "17631661-1b8c-43ed-a8eb-f66a4dc71eee"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:26.861988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Getting quotas for project 1abfd6549b7e464d8d3a17dbc72f227b. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:57:26.865055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-96bf72a8-402b-468b-af54-b912aec49326 req-6b116a3c-bcad-4e4e-b40c-81ea1193e961 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:26.865643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-96bf72a8-402b-468b-af54-b912aec49326 req-6b116a3c-bcad-4e4e-b40c-81ea1193e961 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:26.866143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-96bf72a8-402b-468b-af54-b912aec49326 req-6b116a3c-bcad-4e4e-b40c-81ea1193e961 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:26.877893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Getting quotas for user ef2a83052af5421bb6d637a5ae66f9c3 and project 1abfd6549b7e464d8d3a17dbc72f227b. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:57:26.896772 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-96bf72a8-402b-468b-af54-b912aec49326 req-6b116a3c-bcad-4e4e-b40c-81ea1193e961 service nova] Creating event network-changed:17631661-1b8c-43ed-a8eb-f66a4dc71eee for instance 041b58e4-953e-4b1f-b52d-246d904017f5 on n-h2-852084-10 Sep 08 12:57:26.913326 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-96bf72a8-402b-468b-af54-b912aec49326 req-6b116a3c-bcad-4e4e-b40c-81ea1193e961 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090292 Sep 08 12:57:26.914703 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1547/3232] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:26.916137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:57:26.919327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:57:26.922577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a6c1cb68-d5cd-407a-940c-12489638d30e req-bb30103e-f1a1-4fe1-ba1a-d8c2e622a7c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a767f4-2dcd-4dff-b8a0-ad87d0864ee4", "name": "network-vif-plugged", "status": "completed", "tag": "8cb84f34-e16f-4afb-8a60-19a607783761"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:26.953023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a6c1cb68-d5cd-407a-940c-12489638d30e req-bb30103e-f1a1-4fe1-ba1a-d8c2e622a7c9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:26.953698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a6c1cb68-d5cd-407a-940c-12489638d30e req-bb30103e-f1a1-4fe1-ba1a-d8c2e622a7c9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:26.954277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a6c1cb68-d5cd-407a-940c-12489638d30e req-bb30103e-f1a1-4fe1-ba1a-d8c2e622a7c9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:26.977739 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a6c1cb68-d5cd-407a-940c-12489638d30e req-bb30103e-f1a1-4fe1-ba1a-d8c2e622a7c9 service nova] Creating event network-vif-plugged:8cb84f34-e16f-4afb-8a60-19a607783761 for instance 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 on n-h1-852084-10 Sep 08 12:57:26.988586 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a6c1cb68-d5cd-407a-940c-12489638d30e req-bb30103e-f1a1-4fe1-ba1a-d8c2e622a7c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072094 Sep 08 12:57:26.992273 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1548/3233] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:26.998297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9a5a52da-7479-4e42-9abf-683ed1c4f670 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:26.999690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9a5a52da-7479-4e42-9abf-683ed1c4f670 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:27.008462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a5a52da-7479-4e42-9abf-683ed1c4f670 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:27.010408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a5a52da-7479-4e42-9abf-683ed1c4f670 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:27.011192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a5a52da-7479-4e42-9abf-683ed1c4f670 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:27.012244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a5a52da-7479-4e42-9abf-683ed1c4f670 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:27.013019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a5a52da-7479-4e42-9abf-683ed1c4f670 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:27.013707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a5a52da-7479-4e42-9abf-683ed1c4f670 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:27.036044 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-03781743-1a85-43fd-8de6-2b3659939627 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 5.932079 Sep 08 12:57:27.037376 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1686/3234] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:57:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 5935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:57:27.042627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-80af1b29-c5eb-417e-85bf-fbcc0376616a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:27.049333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-80af1b29-c5eb-417e-85bf-fbcc0376616a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:27.061193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80af1b29-c5eb-417e-85bf-fbcc0376616a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:27.065145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80af1b29-c5eb-417e-85bf-fbcc0376616a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:27.066744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80af1b29-c5eb-417e-85bf-fbcc0376616a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:27.071304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80af1b29-c5eb-417e-85bf-fbcc0376616a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:27.072156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80af1b29-c5eb-417e-85bf-fbcc0376616a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:27.078617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80af1b29-c5eb-417e-85bf-fbcc0376616a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:28.326410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-80af1b29-c5eb-417e-85bf-fbcc0376616a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:28.337684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-80af1b29-c5eb-417e-85bf-fbcc0376616a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:28.339269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-80af1b29-c5eb-417e-85bf-fbcc0376616a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:28.340542 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-80af1b29-c5eb-417e-85bf-fbcc0376616a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1803 microversion: 2.42 time: 1.301862 Sep 08 12:57:28.355894 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1687/3235] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:27 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1803 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:28.542501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d2f08f31-a10d-4ac6-8987-5d31dd069128 tempest-FloatingIPDetailsNegativeTestJSON-228749029 tempest-FloatingIPDetailsNegativeTestJSON-228749029-project] Calling method '.version_select at 0x7fdb35e2d160>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:28.870409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9a5a52da-7479-4e42-9abf-683ed1c4f670 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b997c71bc4b443bb6441ba1eeabab2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb59ad8531d447082e1f77207b3c656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:28.900389 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9a5a52da-7479-4e42-9abf-683ed1c4f670 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 200 len: 1324 microversion: 2.1 time: 1.903787 Sep 08 12:57:28.912730 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1549/3236] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:26 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 1324 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:28.930283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-59f506c1-b5d8-4f11-8026-b5edb19f16fc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:28.933465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-59f506c1-b5d8-4f11-8026-b5edb19f16fc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:28.952785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59f506c1-b5d8-4f11-8026-b5edb19f16fc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:28.953749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59f506c1-b5d8-4f11-8026-b5edb19f16fc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:28.954581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59f506c1-b5d8-4f11-8026-b5edb19f16fc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:28.956153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59f506c1-b5d8-4f11-8026-b5edb19f16fc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:28.957773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59f506c1-b5d8-4f11-8026-b5edb19f16fc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:28.958773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59f506c1-b5d8-4f11-8026-b5edb19f16fc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:28.964482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG neutronclient.v2_0.client [None req-d2f08f31-a10d-4ac6-8987-5d31dd069128 tempest-FloatingIPDetailsNegativeTestJSON-228749029 tempest-FloatingIPDetailsNegativeTestJSON-228749029-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 872643c8-4a32-44aa-9037-e471d89ca20b could not be found", "detail": ""}} {{(pid=128970) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Sep 08 12:57:28.966575 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-d2f08f31-a10d-4ac6-8987-5d31dd069128 tempest-FloatingIPDetailsNegativeTestJSON-228749029 tempest-FloatingIPDetailsNegativeTestJSON-228749029-project] HTTP exception thrown: Floating IP not found for ID 872643c8-4a32-44aa-9037-e471d89ca20b Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d2f08f31-a10d-4ac6-8987-5d31dd069128 tempest-FloatingIPDetailsNegativeTestJSON-228749029 tempest-FloatingIPDetailsNegativeTestJSON-228749029-project] Request method failure captured: Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-floating-ips/872643c8-4a32-44aa-9037-e471d89ca20b HTTP/1.1 Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGea1nvLbwp9dkNEJ4pQJTJUPVg2kD-F2pHjrnNqcAEZFRScRvEaGINY0Rti-eg-sHBEOP-cvRIyTIXujQsa26sCexiD5WKQ1rawTOms3vMTES-qbGBZMpuQzQzSRjCeXmOtXC1T5BkAmw2U_nthGZ8Y3wtH6HQo2jvoT1n41-L3X2aI Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0c0af6a6d9b9419d81ed5c3f4ea59f9f Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-228749029 Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0c0af6a6d9b9419d81ed5c3f4ea59f9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0c0af6a6d9b9419d81ed5c3f4ea59f9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c0af6a6d9b9419d81ed5c3f4ea59f9f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0c0af6a6d9b9419d81ed5c3f4ea59f9f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-228749029 Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0c0af6a6d9b9419d81ed5c3f4ea59f9f Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-228749029 Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-228749029-project Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7cf674b819c14b40b374a2c419f9ed3e Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-228749029-project Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: exception: Floating IP not found for ID 872643c8-4a32-44aa-9037-e471d89ca20b Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '872643c8-4a32-44aa-9037-e471d89ca20b'} Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 872643c8-4a32-44aa-9037-e471d89ca20b could not be found Sep 08 12:57:28.970158 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e31775ba-4dc1-41b2-968c-f4267b41e1d0'] Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 872643c8-4a32-44aa-9037-e471d89ca20b. Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 872643c8-4a32-44aa-9037-e471d89ca20b Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 872643c8-4a32-44aa-9037-e471d89ca20b Sep 08 12:57:28.975706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:28.984688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d2f08f31-a10d-4ac6-8987-5d31dd069128 tempest-FloatingIPDetailsNegativeTestJSON-228749029 tempest-FloatingIPDetailsNegativeTestJSON-228749029-project] Returning 404 to user: Floating IP not found for ID 872643c8-4a32-44aa-9037-e471d89ca20b {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:28.986384 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d2f08f31-a10d-4ac6-8987-5d31dd069128 tempest-FloatingIPDetailsNegativeTestJSON-228749029 tempest-FloatingIPDetailsNegativeTestJSON-228749029-project] 10.222.0.78 "GET /compute/v2.1/os-floating-ips/872643c8-4a32-44aa-9037-e471d89ca20b" status: 404 len: 111 microversion: 2.1 time: 0.629093 Sep 08 12:57:28.993533 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1688/3237] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Sep 8 12:57:28 2022] GET /compute/v2.1/os-floating-ips/872643c8-4a32-44aa-9037-e471d89ca20b => generated 111 bytes in 637 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:57:29.008353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ebdd7848-3e99-4907-b843-7e179fa19b38 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:29.012949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ebdd7848-3e99-4907-b843-7e179fa19b38 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:29.057171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdd7848-3e99-4907-b843-7e179fa19b38 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:29.068325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdd7848-3e99-4907-b843-7e179fa19b38 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:29.068873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdd7848-3e99-4907-b843-7e179fa19b38 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:29.069606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdd7848-3e99-4907-b843-7e179fa19b38 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:29.070093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdd7848-3e99-4907-b843-7e179fa19b38 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:29.070528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdd7848-3e99-4907-b843-7e179fa19b38 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:29.953427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ebdd7848-3e99-4907-b843-7e179fa19b38 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:30.011199 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ebdd7848-3e99-4907-b843-7e179fa19b38 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 200 len: 1322 microversion: 2.1 time: 1.013413 Sep 08 12:57:30.015416 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1689/3238] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:28 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 1322 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:30.037229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-39e535a3-ce9a-4b2b-a65b-2bafdf4eb2ed tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:30.040927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-39e535a3-ce9a-4b2b-a65b-2bafdf4eb2ed tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:30.061515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39e535a3-ce9a-4b2b-a65b-2bafdf4eb2ed tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:30.063051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39e535a3-ce9a-4b2b-a65b-2bafdf4eb2ed tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:30.064499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39e535a3-ce9a-4b2b-a65b-2bafdf4eb2ed tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:30.066747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39e535a3-ce9a-4b2b-a65b-2bafdf4eb2ed tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:30.068142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39e535a3-ce9a-4b2b-a65b-2bafdf4eb2ed tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:30.069503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39e535a3-ce9a-4b2b-a65b-2bafdf4eb2ed tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:31.809540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:31.885418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=16 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:31.946813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-59f506c1-b5d8-4f11-8026-b5edb19f16fc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:31.982556 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-59f506c1-b5d8-4f11-8026-b5edb19f16fc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 3.065663 Sep 08 12:57:31.983859 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1550/3239] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:28 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 3070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:32.006669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f4ef8df3-5293-4a6c-b150-5f9efc6f97b5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:32.013415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f4ef8df3-5293-4a6c-b150-5f9efc6f97b5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:32.052401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4ef8df3-5293-4a6c-b150-5f9efc6f97b5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:32.053435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4ef8df3-5293-4a6c-b150-5f9efc6f97b5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:32.054380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4ef8df3-5293-4a6c-b150-5f9efc6f97b5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:32.057655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4ef8df3-5293-4a6c-b150-5f9efc6f97b5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:32.058440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4ef8df3-5293-4a6c-b150-5f9efc6f97b5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:32.062581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4ef8df3-5293-4a6c-b150-5f9efc6f97b5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:32.071092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=93 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:32.647394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-39e535a3-ce9a-4b2b-a65b-2bafdf4eb2ed tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:32.659284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:32.700839 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-39e535a3-ce9a-4b2b-a65b-2bafdf4eb2ed tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 200 len: 1475 microversion: 2.1 time: 2.674055 Sep 08 12:57:32.702154 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1690/3240] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:30 2022] GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 1475 bytes in 2677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:32.720500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3d96f0c2-87e9-444f-b1b5-ec948a94aae6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:32.722008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3d96f0c2-87e9-444f-b1b5-ec948a94aae6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:32.751533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d96f0c2-87e9-444f-b1b5-ec948a94aae6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:32.752571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d96f0c2-87e9-444f-b1b5-ec948a94aae6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:32.753461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d96f0c2-87e9-444f-b1b5-ec948a94aae6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:32.755068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d96f0c2-87e9-444f-b1b5-ec948a94aae6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:32.762801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d96f0c2-87e9-444f-b1b5-ec948a94aae6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:32.764452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d96f0c2-87e9-444f-b1b5-ec948a94aae6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:32.905411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f4ef8df3-5293-4a6c-b150-5f9efc6f97b5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:32.926424 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f4ef8df3-5293-4a6c-b150-5f9efc6f97b5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1314 microversion: 2.1 time: 0.935589 Sep 08 12:57:32.960304 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1551/3241] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:31 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1314 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:32.978052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8426455a-073b-4f77-8fa5-9b39e610eb71 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:32.979668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8426455a-073b-4f77-8fa5-9b39e610eb71 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:33.000247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8426455a-073b-4f77-8fa5-9b39e610eb71 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:33.002743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8426455a-073b-4f77-8fa5-9b39e610eb71 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:33.003894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8426455a-073b-4f77-8fa5-9b39e610eb71 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:33.005462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8426455a-073b-4f77-8fa5-9b39e610eb71 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:33.006594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8426455a-073b-4f77-8fa5-9b39e610eb71 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:33.011328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8426455a-073b-4f77-8fa5-9b39e610eb71 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:34.653767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3d96f0c2-87e9-444f-b1b5-ec948a94aae6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:34.675986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3d96f0c2-87e9-444f-b1b5-ec948a94aae6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:34.680236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3d96f0c2-87e9-444f-b1b5-ec948a94aae6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:34.702452 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3d96f0c2-87e9-444f-b1b5-ec948a94aae6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1871 microversion: 2.42 time: 1.982663 Sep 08 12:57:34.727123 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1691/3242] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:32 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1871 bytes in 2024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:34.763697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d0c9e17d-3a19-44d1-ad48-41f39b51d05b req-51e72286-7da7-4965-9e7f-d1c983dd9fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "tag": "3466f05e-6efb-423f-9ac1-92190128aa45"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:34.799766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d0c9e17d-3a19-44d1-ad48-41f39b51d05b req-51e72286-7da7-4965-9e7f-d1c983dd9fd0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:34.801639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d0c9e17d-3a19-44d1-ad48-41f39b51d05b req-51e72286-7da7-4965-9e7f-d1c983dd9fd0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:34.802865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d0c9e17d-3a19-44d1-ad48-41f39b51d05b req-51e72286-7da7-4965-9e7f-d1c983dd9fd0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:34.829151 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d0c9e17d-3a19-44d1-ad48-41f39b51d05b req-51e72286-7da7-4965-9e7f-d1c983dd9fd0 service nova] Creating event network-changed:3466f05e-6efb-423f-9ac1-92190128aa45 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:57:34.839823 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d0c9e17d-3a19-44d1-ad48-41f39b51d05b req-51e72286-7da7-4965-9e7f-d1c983dd9fd0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099432 Sep 08 12:57:34.841755 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1692/3243] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:34.852722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-64488ba5-0150-414d-af6f-449abf043fd5 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:34.854480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-64488ba5-0150-414d-af6f-449abf043fd5 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:34.867532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64488ba5-0150-414d-af6f-449abf043fd5 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:34.868803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64488ba5-0150-414d-af6f-449abf043fd5 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:34.869902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64488ba5-0150-414d-af6f-449abf043fd5 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:34.871594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64488ba5-0150-414d-af6f-449abf043fd5 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:34.872742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64488ba5-0150-414d-af6f-449abf043fd5 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:34.873789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64488ba5-0150-414d-af6f-449abf043fd5 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:35.163930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8426455a-073b-4f77-8fa5-9b39e610eb71 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b997c71bc4b443bb6441ba1eeabab2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb59ad8531d447082e1f77207b3c656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:35.178417 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8426455a-073b-4f77-8fa5-9b39e610eb71 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 200 len: 1324 microversion: 2.1 time: 2.216158 Sep 08 12:57:35.196586 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1552/3244] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:32 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 1324 bytes in 2232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:35.209506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38128470-da90-47bc-a762-3d78ff732fb8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:35.211346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-38128470-da90-47bc-a762-3d78ff732fb8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:35.226827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38128470-da90-47bc-a762-3d78ff732fb8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:35.229345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38128470-da90-47bc-a762-3d78ff732fb8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:35.230566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38128470-da90-47bc-a762-3d78ff732fb8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:35.232281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38128470-da90-47bc-a762-3d78ff732fb8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:35.234472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38128470-da90-47bc-a762-3d78ff732fb8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:35.235720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38128470-da90-47bc-a762-3d78ff732fb8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:36.134218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-64488ba5-0150-414d-af6f-449abf043fd5 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:36.155691 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-64488ba5-0150-414d-af6f-449abf043fd5 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 200 len: 1395 microversion: 2.1 time: 1.310072 Sep 08 12:57:36.159183 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1693/3245] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:34 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 1395 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:36.164226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38128470-da90-47bc-a762-3d78ff732fb8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:36.173698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2065126952", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:36.230066 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38128470-da90-47bc-a762-3d78ff732fb8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.031439 Sep 08 12:57:36.234840 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1553/3246] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:35 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:36.261436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-1a1cf2bc-569b-4580-94b9-e3396efa8afd req-4e47d33e-93d9-4cd1-8cf9-b339b09da2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041b58e4-953e-4b1f-b52d-246d904017f5", "name": "network-vif-plugged", "status": "completed", "tag": "17631661-1b8c-43ed-a8eb-f66a4dc71eee"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:36.320180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1a1cf2bc-569b-4580-94b9-e3396efa8afd req-4e47d33e-93d9-4cd1-8cf9-b339b09da2d5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:36.321645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1a1cf2bc-569b-4580-94b9-e3396efa8afd req-4e47d33e-93d9-4cd1-8cf9-b339b09da2d5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:36.324552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1a1cf2bc-569b-4580-94b9-e3396efa8afd req-4e47d33e-93d9-4cd1-8cf9-b339b09da2d5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:36.335165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] validate_networks() for [('e905a95c-2324-49bd-8a89-bae4286a1b74', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:57:36.369680 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-1a1cf2bc-569b-4580-94b9-e3396efa8afd req-4e47d33e-93d9-4cd1-8cf9-b339b09da2d5 service nova] Creating event network-vif-plugged:17631661-1b8c-43ed-a8eb-f66a4dc71eee for instance 041b58e4-953e-4b1f-b52d-246d904017f5 on n-h2-852084-10 Sep 08 12:57:36.390065 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-1a1cf2bc-569b-4580-94b9-e3396efa8afd req-4e47d33e-93d9-4cd1-8cf9-b339b09da2d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150573 Sep 08 12:57:36.397048 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1554/3247] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:36.423521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63501e40-0afd-4e79-ac0a-8f490939c1e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:36.425220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-63501e40-0afd-4e79-ac0a-8f490939c1e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:36.441145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63501e40-0afd-4e79-ac0a-8f490939c1e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:36.454984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63501e40-0afd-4e79-ac0a-8f490939c1e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:36.456364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63501e40-0afd-4e79-ac0a-8f490939c1e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:36.457999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63501e40-0afd-4e79-ac0a-8f490939c1e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:36.459896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63501e40-0afd-4e79-ac0a-8f490939c1e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:36.461120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63501e40-0afd-4e79-ac0a-8f490939c1e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:36.843474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:36.896808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=5 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:37.143853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-63501e40-0afd-4e79-ac0a-8f490939c1e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:37.161237 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-63501e40-0afd-4e79-ac0a-8f490939c1e3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1314 microversion: 2.1 time: 0.760810 Sep 08 12:57:37.162259 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1555/3248] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:36 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:37.179643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f46a826a-8e1c-4666-8bdc-6be76276ef04 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:37.181254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f46a826a-8e1c-4666-8bdc-6be76276ef04 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:37.197652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f46a826a-8e1c-4666-8bdc-6be76276ef04 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:37.198643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f46a826a-8e1c-4666-8bdc-6be76276ef04 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:37.199502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f46a826a-8e1c-4666-8bdc-6be76276ef04 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:37.200641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f46a826a-8e1c-4666-8bdc-6be76276ef04 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:37.206996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f46a826a-8e1c-4666-8bdc-6be76276ef04 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:37.208085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f46a826a-8e1c-4666-8bdc-6be76276ef04 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:38.164822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f46a826a-8e1c-4666-8bdc-6be76276ef04 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:38.187290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f46a826a-8e1c-4666-8bdc-6be76276ef04 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:38.190342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f46a826a-8e1c-4666-8bdc-6be76276ef04 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:38.194801 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f46a826a-8e1c-4666-8bdc-6be76276ef04 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1892 microversion: 2.42 time: 1.031063 Sep 08 12:57:38.220979 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1556/3249] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:37 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1892 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:38.226578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a1567a6b-d65e-4995-8db6-2956a59f39b2 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:38.232834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a1567a6b-d65e-4995-8db6-2956a59f39b2 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:38.252936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:38.255026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1567a6b-d65e-4995-8db6-2956a59f39b2 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:38.255790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1567a6b-d65e-4995-8db6-2956a59f39b2 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:38.256488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1567a6b-d65e-4995-8db6-2956a59f39b2 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:38.257428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1567a6b-d65e-4995-8db6-2956a59f39b2 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:38.258333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1567a6b-d65e-4995-8db6-2956a59f39b2 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:38.258974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1567a6b-d65e-4995-8db6-2956a59f39b2 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:38.771190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a1567a6b-d65e-4995-8db6-2956a59f39b2 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b997c71bc4b443bb6441ba1eeabab2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb59ad8531d447082e1f77207b3c656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:38.774514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:57:38.776246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:57:38.776956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:57:38.778116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:57:38.778905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:57:38.791759 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a1567a6b-d65e-4995-8db6-2956a59f39b2 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 200 len: 1324 microversion: 2.1 time: 0.569122 Sep 08 12:57:38.793145 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1557/3250] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:38 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 1324 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:38.806875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8531c66f-b8fa-4409-a53e-de368b40584d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:38.807998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8531c66f-b8fa-4409-a53e-de368b40584d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:38.824374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8531c66f-b8fa-4409-a53e-de368b40584d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:38.827606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8531c66f-b8fa-4409-a53e-de368b40584d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:38.828369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8531c66f-b8fa-4409-a53e-de368b40584d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:38.829842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8531c66f-b8fa-4409-a53e-de368b40584d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:38.836147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8531c66f-b8fa-4409-a53e-de368b40584d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:38.837091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8531c66f-b8fa-4409-a53e-de368b40584d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:38.885880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:38.888834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:38.890715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:38.895821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:38.896720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:38.897371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:38.926762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:57:38.942382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for user 227ef616a0764f5eaff5988f8a470f0c and project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:57:38.986958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:57:38.997973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3bef90cd-775a-486e-afe2-8af6f9bbfbd0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:57:39.152194 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-52a33485-1110-45e6-85d5-431a944cb90a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.990177 Sep 08 12:57:39.160726 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1694/3251] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:57:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3000 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:57:39.193554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-8890fd84-964f-4782-8c0d-207cf490973d req-c851e79c-91fb-4fa4-bc05-192711dceb0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "tag": "9e7a5dd5-586c-40ea-b7f3-c11aacd5c5b0"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:39.232101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8890fd84-964f-4782-8c0d-207cf490973d req-c851e79c-91fb-4fa4-bc05-192711dceb0d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:39.232527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8890fd84-964f-4782-8c0d-207cf490973d req-c851e79c-91fb-4fa4-bc05-192711dceb0d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:39.236083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8890fd84-964f-4782-8c0d-207cf490973d req-c851e79c-91fb-4fa4-bc05-192711dceb0d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:39.254398 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-8890fd84-964f-4782-8c0d-207cf490973d req-c851e79c-91fb-4fa4-bc05-192711dceb0d service nova] Creating event network-changed:9e7a5dd5-586c-40ea-b7f3-c11aacd5c5b0 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:57:39.260609 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-8890fd84-964f-4782-8c0d-207cf490973d req-c851e79c-91fb-4fa4-bc05-192711dceb0d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097091 Sep 08 12:57:39.262100 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1695/3252] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:39.268522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ba66e994-b15a-4e83-a200-6d1ec1371af1 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:39.277480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ba66e994-b15a-4e83-a200-6d1ec1371af1 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:39.289166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba66e994-b15a-4e83-a200-6d1ec1371af1 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:39.289945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba66e994-b15a-4e83-a200-6d1ec1371af1 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:39.290588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba66e994-b15a-4e83-a200-6d1ec1371af1 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:39.292946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba66e994-b15a-4e83-a200-6d1ec1371af1 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:39.293657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba66e994-b15a-4e83-a200-6d1ec1371af1 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:39.294270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba66e994-b15a-4e83-a200-6d1ec1371af1 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:39.430269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8531c66f-b8fa-4409-a53e-de368b40584d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:39.439718 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8531c66f-b8fa-4409-a53e-de368b40584d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.644713 Sep 08 12:57:39.440350 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1558/3253] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:38 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:39.453581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-37402c6a-1f25-41e1-a45d-8380f404fe57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:39.454342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-37402c6a-1f25-41e1-a45d-8380f404fe57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:39.486094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37402c6a-1f25-41e1-a45d-8380f404fe57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:39.486518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37402c6a-1f25-41e1-a45d-8380f404fe57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:39.486984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37402c6a-1f25-41e1-a45d-8380f404fe57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:39.500303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37402c6a-1f25-41e1-a45d-8380f404fe57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:39.501307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37402c6a-1f25-41e1-a45d-8380f404fe57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:39.501762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37402c6a-1f25-41e1-a45d-8380f404fe57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:40.155777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ba66e994-b15a-4e83-a200-6d1ec1371af1 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:40.170452 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ba66e994-b15a-4e83-a200-6d1ec1371af1 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 200 len: 1395 microversion: 2.1 time: 0.906726 Sep 08 12:57:40.171167 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1696/3254] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:39 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 1395 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:40.176742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7e98ab1a-0eef-4e3a-a122-d55b63e85636 req-b4701ec9-c337-41f0-ae22-3caf25b9a63c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b876ea7-4998-44bb-818e-0a43fa411bb9", "tag": "64ee14bc-76ce-49fc-a895-3b1655046453"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:40.185551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-37402c6a-1f25-41e1-a45d-8380f404fe57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:40.194347 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-37402c6a-1f25-41e1-a45d-8380f404fe57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1314 microversion: 2.1 time: 0.744695 Sep 08 12:57:40.199844 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1559/3255] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:39 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1314 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:40.202798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7e98ab1a-0eef-4e3a-a122-d55b63e85636 req-b4701ec9-c337-41f0-ae22-3caf25b9a63c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:40.205141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7e98ab1a-0eef-4e3a-a122-d55b63e85636 req-b4701ec9-c337-41f0-ae22-3caf25b9a63c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:40.206205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7e98ab1a-0eef-4e3a-a122-d55b63e85636 req-b4701ec9-c337-41f0-ae22-3caf25b9a63c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:40.209208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-40b3f60c-3275-47de-ad00-c6116f697b35 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:40.216108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-40b3f60c-3275-47de-ad00-c6116f697b35 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3bef90cd-775a-486e-afe2-8af6f9bbfbd0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:40.231108 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7e98ab1a-0eef-4e3a-a122-d55b63e85636 req-b4701ec9-c337-41f0-ae22-3caf25b9a63c service nova] Creating event network-changed:64ee14bc-76ce-49fc-a895-3b1655046453 for instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 on n-h2-852084-10 Sep 08 12:57:40.257486 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7e98ab1a-0eef-4e3a-a122-d55b63e85636 req-b4701ec9-c337-41f0-ae22-3caf25b9a63c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084902 Sep 08 12:57:40.258634 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1697/3256] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:40.262728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-40b3f60c-3275-47de-ad00-c6116f697b35 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3bef90cd-775a-486e-afe2-8af6f9bbfbd0] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:57:40.278823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e52425ea-14a4-46de-ba37-327af75eccb2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:40.279819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e52425ea-14a4-46de-ba37-327af75eccb2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:40.298461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e52425ea-14a4-46de-ba37-327af75eccb2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:40.299439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e52425ea-14a4-46de-ba37-327af75eccb2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:40.300167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e52425ea-14a4-46de-ba37-327af75eccb2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:40.301223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e52425ea-14a4-46de-ba37-327af75eccb2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:40.301957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e52425ea-14a4-46de-ba37-327af75eccb2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:40.303570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e52425ea-14a4-46de-ba37-327af75eccb2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:40.438297 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.scheduler.client.report [None req-40b3f60c-3275-47de-ad00-c6116f697b35 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Deleted allocations for instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 Sep 08 12:57:40.472343 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-40b3f60c-3275-47de-ad00-c6116f697b35 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3bef90cd-775a-486e-afe2-8af6f9bbfbd0" status: 204 len: 0 microversion: 2.1 time: 0.271001 Sep 08 12:57:40.473324 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1560/3257] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:57:40 2022] DELETE /compute/v2.1/servers/3bef90cd-775a-486e-afe2-8af6f9bbfbd0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:57:40.478544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-72f69e8a-9715-4a93-98cf-83c4ad7e5b04 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:40.479765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-72f69e8a-9715-4a93-98cf-83c4ad7e5b04 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:40.499118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72f69e8a-9715-4a93-98cf-83c4ad7e5b04 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:40.500108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72f69e8a-9715-4a93-98cf-83c4ad7e5b04 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:40.501432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72f69e8a-9715-4a93-98cf-83c4ad7e5b04 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:40.509180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72f69e8a-9715-4a93-98cf-83c4ad7e5b04 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:40.516111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72f69e8a-9715-4a93-98cf-83c4ad7e5b04 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:40.517074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72f69e8a-9715-4a93-98cf-83c4ad7e5b04 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:41.457091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e52425ea-14a4-46de-ba37-327af75eccb2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:41.464217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-72f69e8a-9715-4a93-98cf-83c4ad7e5b04 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:41.473907 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-72f69e8a-9715-4a93-98cf-83c4ad7e5b04 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.999210 Sep 08 12:57:41.474757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e52425ea-14a4-46de-ba37-327af75eccb2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:41.476681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e52425ea-14a4-46de-ba37-327af75eccb2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:41.477970 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e52425ea-14a4-46de-ba37-327af75eccb2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1892 microversion: 2.42 time: 1.217948 Sep 08 12:57:41.484144 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1698/3258] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:40 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1892 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:41.491956 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1561/3259] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:40 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:41.499265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e239b1fb-1376-4cb5-a990-583f3dbbcef1 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:41.499265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e239b1fb-1376-4cb5-a990-583f3dbbcef1 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:41.510316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e57230e9-738c-4430-8bcd-66e1ab861718 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:41.512327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e239b1fb-1376-4cb5-a990-583f3dbbcef1 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:41.514713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e239b1fb-1376-4cb5-a990-583f3dbbcef1 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:41.515109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e57230e9-738c-4430-8bcd-66e1ab861718 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3bef90cd-775a-486e-afe2-8af6f9bbfbd0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:41.515621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e239b1fb-1376-4cb5-a990-583f3dbbcef1 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:41.517939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e239b1fb-1376-4cb5-a990-583f3dbbcef1 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:41.520901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e239b1fb-1376-4cb5-a990-583f3dbbcef1 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:41.521991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e239b1fb-1376-4cb5-a990-583f3dbbcef1 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:41.547937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e57230e9-738c-4430-8bcd-66e1ab861718 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:41.550236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e57230e9-738c-4430-8bcd-66e1ab861718 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:41.551483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e57230e9-738c-4430-8bcd-66e1ab861718 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:41.553319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e57230e9-738c-4430-8bcd-66e1ab861718 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:41.555158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e57230e9-738c-4430-8bcd-66e1ab861718 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:41.556252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e57230e9-738c-4430-8bcd-66e1ab861718 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:41.589183 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e57230e9-738c-4430-8bcd-66e1ab861718 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e57230e9-738c-4430-8bcd-66e1ab861718 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/3bef90cd-775a-486e-afe2-8af6f9bbfbd0 HTTP/1.1 Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '3bef90cd-775a-486e-afe2-8af6f9bbfbd0'} Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:41.593197 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:41.607097 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:41.607097 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:41.607097 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:57:41.607097 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:57:41.607097 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 12:57:41.607097 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:41.607097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e57230e9-738c-4430-8bcd-66e1ab861718 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:41.607097 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e57230e9-738c-4430-8bcd-66e1ab861718 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef90cd-775a-486e-afe2-8af6f9bbfbd0" status: 404 len: 111 microversion: 2.1 time: 0.104659 Sep 08 12:57:41.611421 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1562/3260] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:41 2022] GET /compute/v2.1/servers/3bef90cd-775a-486e-afe2-8af6f9bbfbd0 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:57:41.618587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a72c61f-6c58-44b7-acff-fabfee6d54cd tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:41.624778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2a72c61f-6c58-44b7-acff-fabfee6d54cd tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:41.648513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a72c61f-6c58-44b7-acff-fabfee6d54cd tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:41.649054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a72c61f-6c58-44b7-acff-fabfee6d54cd tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:41.651735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a72c61f-6c58-44b7-acff-fabfee6d54cd tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:41.651735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a72c61f-6c58-44b7-acff-fabfee6d54cd tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:41.652201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a72c61f-6c58-44b7-acff-fabfee6d54cd tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:41.653562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a72c61f-6c58-44b7-acff-fabfee6d54cd tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:42.178504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e239b1fb-1376-4cb5-a990-583f3dbbcef1 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b997c71bc4b443bb6441ba1eeabab2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb59ad8531d447082e1f77207b3c656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:42.194372 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e239b1fb-1376-4cb5-a990-583f3dbbcef1 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 200 len: 1520 microversion: 2.1 time: 0.708621 Sep 08 12:57:42.197317 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1699/3261] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:41 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 1520 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:42.215612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-23495671-a482-4736-be0e-7be617591397 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:42.218079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-23495671-a482-4736-be0e-7be617591397 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:42.271882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23495671-a482-4736-be0e-7be617591397 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:42.274443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23495671-a482-4736-be0e-7be617591397 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:42.276702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23495671-a482-4736-be0e-7be617591397 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:42.283755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23495671-a482-4736-be0e-7be617591397 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:42.284645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23495671-a482-4736-be0e-7be617591397 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:42.285312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23495671-a482-4736-be0e-7be617591397 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:42.352777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2a72c61f-6c58-44b7-acff-fabfee6d54cd tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:42.379693 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a72c61f-6c58-44b7-acff-fabfee6d54cd tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 200 len: 1395 microversion: 2.1 time: 0.752435 Sep 08 12:57:42.380473 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1563/3262] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:41 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 1395 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:42.402599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-adf2971f-0024-4442-b3d5-e8418236430b req-69c5d2a0-1561-4646-9c5f-b28f9330c900 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "tag": "a69fd5b9-294a-4234-9531-c82133ce0190"}, {"name": "network-changed", "server_uuid": "54768ef6-04c1-4a48-be47-c6286e20b1ef", "tag": "3cb24870-537c-488f-a27b-9c4e2eb374c1"}, {"name": "network-changed", "server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "tag": "73bd7edb-2a02-4b55-9210-60c0c223d930"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:42.416422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-adf2971f-0024-4442-b3d5-e8418236430b req-69c5d2a0-1561-4646-9c5f-b28f9330c900 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:42.417199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-adf2971f-0024-4442-b3d5-e8418236430b req-69c5d2a0-1561-4646-9c5f-b28f9330c900 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:42.418509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-adf2971f-0024-4442-b3d5-e8418236430b req-69c5d2a0-1561-4646-9c5f-b28f9330c900 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:42.434733 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-adf2971f-0024-4442-b3d5-e8418236430b req-69c5d2a0-1561-4646-9c5f-b28f9330c900 service nova] Creating event network-changed:a69fd5b9-294a-4234-9531-c82133ce0190 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:57:42.435599 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-adf2971f-0024-4442-b3d5-e8418236430b req-69c5d2a0-1561-4646-9c5f-b28f9330c900 service nova] Creating event network-changed:3cb24870-537c-488f-a27b-9c4e2eb374c1 for instance 54768ef6-04c1-4a48-be47-c6286e20b1ef on n-h1-852084-10 Sep 08 12:57:42.436315 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-adf2971f-0024-4442-b3d5-e8418236430b req-69c5d2a0-1561-4646-9c5f-b28f9330c900 service nova] Creating event network-changed:73bd7edb-2a02-4b55-9210-60c0c223d930 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:57:42.444116 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-adf2971f-0024-4442-b3d5-e8418236430b req-69c5d2a0-1561-4646-9c5f-b28f9330c900 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.050428 Sep 08 12:57:42.445331 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1564/3263] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:42.451204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-59deeca9-5aff-479f-9795-a1c12b8add68 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:42.452684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-59deeca9-5aff-479f-9795-a1c12b8add68 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:42.480040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59deeca9-5aff-479f-9795-a1c12b8add68 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:42.481391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59deeca9-5aff-479f-9795-a1c12b8add68 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:42.482651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59deeca9-5aff-479f-9795-a1c12b8add68 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:42.484205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59deeca9-5aff-479f-9795-a1c12b8add68 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:42.485038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59deeca9-5aff-479f-9795-a1c12b8add68 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:42.486118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59deeca9-5aff-479f-9795-a1c12b8add68 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:42.576999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-59deeca9-5aff-479f-9795-a1c12b8add68 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Locking {{(pid=128971) lock /opt/stack/nova/nova/compute/api.py:4845}} Sep 08 12:57:42.668695 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-59deeca9-5aff-479f-9795-a1c12b8add68 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.221624 Sep 08 12:57:42.669345 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1565/3264] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:57:42 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:57:42.678243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-767071433", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "e905a95c-2324-49bd-8a89-bae4286a1b74"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:42.764448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] validate_networks() for [('e905a95c-2324-49bd-8a89-bae4286a1b74', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:57:43.880997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-23495671-a482-4736-be0e-7be617591397 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:43.921288 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-23495671-a482-4736-be0e-7be617591397 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1314 microversion: 2.1 time: 1.720727 Sep 08 12:57:43.951660 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1700/3265] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:42 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1314 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:43.973578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0aecc620-a9d9-44e2-a76f-cc3c9ad23c27 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1809727115", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "28402a4f-f36c-4550-9d01-5a5ffeae7aa0"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0aecc620-a9d9-44e2-a76f-cc3c9ad23c27 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Request method failure captured: Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 243 Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeabUqz08ExQ1779qG-O32erZJHQ39EnundSJPpzxHqFzEKHUrb2QX4luHDgWKbgR4lkFIBKquv8Su_tg6EmobqPCxY57pkjiTENK9ouQvk2VUBoVVBX0w27zhcj7HbygAd2VJQWdEF6uOHcm0JlrCe44Xr-_Gf3Y4kWw1Kx1JACLYk Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 5b997c71bc4b443bb6441ba1eeabab2d Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1809727115", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "28402a4f-f36c-4550-9d01-5a5ffeae7aa0"}]}} Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1809727115', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '28402a4f-f36c-4550-9d01-5a5ffeae7aa0'}]}}} Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'': 'data1'} Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:57:44.002670 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:44.012544 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:44.018155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0aecc620-a9d9-44e2-a76f-cc3c9ad23c27 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:44.019962 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0aecc620-a9d9-44e2-a76f-cc3c9ad23c27 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.066053 Sep 08 12:57:44.021674 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1701/3266] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:57:43 2022] POST /compute/v2.1/servers => generated 175 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:57:44.038603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a6611d92-d50b-4517-aa17-89faff891722 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:44.040120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a6611d92-d50b-4517-aa17-89faff891722 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:44.053024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6611d92-d50b-4517-aa17-89faff891722 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:44.055932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6611d92-d50b-4517-aa17-89faff891722 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:44.058439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6611d92-d50b-4517-aa17-89faff891722 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:44.059465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6611d92-d50b-4517-aa17-89faff891722 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:44.062973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6611d92-d50b-4517-aa17-89faff891722 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:44.064692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6611d92-d50b-4517-aa17-89faff891722 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:44.965879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a6611d92-d50b-4517-aa17-89faff891722 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:44.980097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a6611d92-d50b-4517-aa17-89faff891722 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:44.982868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a6611d92-d50b-4517-aa17-89faff891722 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:44.984478 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a6611d92-d50b-4517-aa17-89faff891722 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1892 microversion: 2.42 time: 0.960646 Sep 08 12:57:44.991340 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1702/3267] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:44 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1892 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:45.012431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fa4a4b38-8207-4a84-b286-adf0d5b3d4ed tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:45.013413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fa4a4b38-8207-4a84-b286-adf0d5b3d4ed tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:45.022103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa4a4b38-8207-4a84-b286-adf0d5b3d4ed tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:45.024376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa4a4b38-8207-4a84-b286-adf0d5b3d4ed tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:45.025086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa4a4b38-8207-4a84-b286-adf0d5b3d4ed tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:45.026050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa4a4b38-8207-4a84-b286-adf0d5b3d4ed tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:45.026777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa4a4b38-8207-4a84-b286-adf0d5b3d4ed tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:45.028172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa4a4b38-8207-4a84-b286-adf0d5b3d4ed tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:45.862179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:57:45.863542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:57:45.864131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:57:45.864566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:57:45.865430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:57:45.876349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:45.876950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:45.877404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:45.878157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:45.878615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:45.879074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:45.900958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:57:45.910199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for user 227ef616a0764f5eaff5988f8a470f0c and project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:57:45.925281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:57:45.927822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:57:45.965341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fa4a4b38-8207-4a84-b286-adf0d5b3d4ed tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:45.982017 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fa4a4b38-8207-4a84-b286-adf0d5b3d4ed tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.977818 Sep 08 12:57:45.983706 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1703/3268] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:44 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:45.999186 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b4ac51d8-7aab-4b47-a843-a0e913b9f077 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.326692 Sep 08 12:57:46.001141 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1566/3269] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:57:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:57:46.008200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-129e1425-13da-4a67-b005-27677e5552f6 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:46.009055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-129e1425-13da-4a67-b005-27677e5552f6 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 9bb7688b-693b-4694-b64c-846ead24940a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:46.009413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b224157d-3f23-4ee3-b75e-26bdabc01a4b tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:46.010546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b224157d-3f23-4ee3-b75e-26bdabc01a4b tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:46.018385 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-129e1425-13da-4a67-b005-27677e5552f6 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] HTTP exception thrown: Instance 9bb7688b-693b-4694-b64c-846ead24940a could not be found. Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-129e1425-13da-4a67-b005-27677e5552f6 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Request method failure captured: Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/9bb7688b-693b-4694-b64c-846ead24940a/metadata HTTP/1.1 Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeabUqz08ExQ1779qG-O32erZJHQ39EnundSJPpzxHqFzEKHUrb2QX4luHDgWKbgR4lkFIBKquv8Su_tg6EmobqPCxY57pkjiTENK9ouQvk2VUBoVVBX0w27zhcj7HbygAd2VJQWdEF6uOHcm0JlrCe44Xr-_Gf3Y4kWw1Kx1JACLYk Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 5b997c71bc4b443bb6441ba1eeabab2d Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 9bb7688b-693b-4694-b64c-846ead24940a could not be found. Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'server_id': '9bb7688b-693b-4694-b64c-846ead24940a'} Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bb7688b-693b-4694-b64c-846ead24940a could not be found. Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bb7688b-693b-4694-b64c-846ead24940a could not be found. Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:46.024743 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:46.031182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:57:46.031182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:57:46.031182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bb7688b-693b-4694-b64c-846ead24940a could not be found. Sep 08 12:57:46.031182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:46.032563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-129e1425-13da-4a67-b005-27677e5552f6 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Returning 404 to user: Instance 9bb7688b-693b-4694-b64c-846ead24940a could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:46.033981 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-129e1425-13da-4a67-b005-27677e5552f6 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/9bb7688b-693b-4694-b64c-846ead24940a/metadata" status: 404 len: 111 microversion: 2.1 time: 0.031167 Sep 08 12:57:46.036389 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1567/3270] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 12:57:46 2022] GET /compute/v2.1/servers/9bb7688b-693b-4694-b64c-846ead24940a/metadata => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:57:46.046643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bc9f4e35-23ab-410f-9b00-f5a6bf1305ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:46.047724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bc9f4e35-23ab-410f-9b00-f5a6bf1305ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:46.049878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b224157d-3f23-4ee3-b75e-26bdabc01a4b tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:46.050796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b224157d-3f23-4ee3-b75e-26bdabc01a4b tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:46.058250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b224157d-3f23-4ee3-b75e-26bdabc01a4b tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:46.061333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b224157d-3f23-4ee3-b75e-26bdabc01a4b tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:46.062481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b224157d-3f23-4ee3-b75e-26bdabc01a4b tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:46.064172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b224157d-3f23-4ee3-b75e-26bdabc01a4b tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:46.068719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc9f4e35-23ab-410f-9b00-f5a6bf1305ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:46.071047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc9f4e35-23ab-410f-9b00-f5a6bf1305ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:46.076456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc9f4e35-23ab-410f-9b00-f5a6bf1305ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:46.077355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc9f4e35-23ab-410f-9b00-f5a6bf1305ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:46.077857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc9f4e35-23ab-410f-9b00-f5a6bf1305ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:46.078307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc9f4e35-23ab-410f-9b00-f5a6bf1305ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:46.740307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bc9f4e35-23ab-410f-9b00-f5a6bf1305ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:46.758091 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bc9f4e35-23ab-410f-9b00-f5a6bf1305ed tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1314 microversion: 2.1 time: 0.720133 Sep 08 12:57:46.760113 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1568/3271] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:46 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:46.784153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b224157d-3f23-4ee3-b75e-26bdabc01a4b tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:46.813592 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b224157d-3f23-4ee3-b75e-26bdabc01a4b tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 200 len: 1395 microversion: 2.1 time: 0.827059 Sep 08 12:57:46.814986 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1704/3272] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:45 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 1395 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:46.842371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-85e98523-6453-4e9f-aa7a-30333013321c req-72ee9138-2c17-4f79-b961-9499d5212352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54768ef6-04c1-4a48-be47-c6286e20b1ef", "name": "network-vif-plugged", "status": "completed", "tag": "3cb24870-537c-488f-a27b-9c4e2eb374c1"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:46.871773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-85e98523-6453-4e9f-aa7a-30333013321c req-72ee9138-2c17-4f79-b961-9499d5212352 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:46.873326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-85e98523-6453-4e9f-aa7a-30333013321c req-72ee9138-2c17-4f79-b961-9499d5212352 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:46.874522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-85e98523-6453-4e9f-aa7a-30333013321c req-72ee9138-2c17-4f79-b961-9499d5212352 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:46.901041 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-85e98523-6453-4e9f-aa7a-30333013321c req-72ee9138-2c17-4f79-b961-9499d5212352 service nova] Creating event network-vif-plugged:3cb24870-537c-488f-a27b-9c4e2eb374c1 for instance 54768ef6-04c1-4a48-be47-c6286e20b1ef on n-h1-852084-10 Sep 08 12:57:46.911138 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-85e98523-6453-4e9f-aa7a-30333013321c req-72ee9138-2c17-4f79-b961-9499d5212352 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094003 Sep 08 12:57:46.913543 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1705/3273] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:46.928450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ba1abeb1-62dc-42ca-b749-c7f3c4d833de tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:46.947261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba1abeb1-62dc-42ca-b749-c7f3c4d833de tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:46.948816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba1abeb1-62dc-42ca-b749-c7f3c4d833de tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:46.949990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ba1abeb1-62dc-42ca-b749-c7f3c4d833de tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:47.010569 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-ba1abeb1-62dc-42ca-b749-c7f3c4d833de tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] HTTP exception thrown: Instance abb01efa-03b9-40b6-901b-33e7d583b7c8 is locked Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ba1abeb1-62dc-42ca-b749-c7f3c4d833de tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Request method failure captured: Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action HTTP/1.1 Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 15 Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVJlpIUu4I3etLbEARIZH8KBjvhrlSlsNaLxWsUVVjxg7DGa1gDBkjoWynkMnF04mkRKPOu0mP64ZnQqdnNZ67aOntgfBqoqUU7VATzwJXlIjY4wY2V0n8uOV_tKF-BjMvxYlC2i-O3RjgSypdvXI4jXqJB4nuGXejMn4MVXpX9mCw Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 59dc0decb175444491383c39918c5b2e Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerActionsTestJSON-204893554 Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_59dc0decb175444491383c39918c5b2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/59dc0decb175444491383c39918c5b2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59dc0decb175444491383c39918c5b2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59dc0decb175444491383c39918c5b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerActionsTestJSON-204893554 Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 59dc0decb175444491383c39918c5b2e Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerActionsTestJSON-204893554 Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerActionsTestJSON-204893554-project Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 4140a06bc6934d7780ef9ff3e30e6dd5 Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerActionsTestJSON-204893554-project Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: {"os-stop": {}} Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance abb01efa-03b9-40b6-901b-33e7d583b7c8 is locked Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'abb01efa-03b9-40b6-901b-33e7d583b7c8', 'body': {'os-stop': {}}} Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance abb01efa-03b9-40b6-901b-33e7d583b7c8 is locked Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance abb01efa-03b9-40b6-901b-33e7d583b7c8 is locked Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb01efa-03b9-40b6-901b-33e7d583b7c8 is locked Sep 08 12:57:47.014056 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.034433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ba1abeb1-62dc-42ca-b749-c7f3c4d833de tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Returning 409 to user: Instance abb01efa-03b9-40b6-901b-33e7d583b7c8 is locked {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:47.034433 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ba1abeb1-62dc-42ca-b749-c7f3c4d833de tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 409 len: 107 microversion: 2.1 time: 0.102463 Sep 08 12:57:47.034433 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1706/3274] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:57:46 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 107 bytes in 108 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:57:47.035509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8f4e2201-eed4-4a49-b14c-fb62c15c32d9 tempest-ListImageFiltersNegativeTestJSON-280689927 tempest-ListImageFiltersNegativeTestJSON-280689927-project] Calling method '.version_select at 0x7fdb3a7813a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:47.036336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-072e339c-6f72-469b-b5eb-1ff2fc025f82 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:47.036336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-072e339c-6f72-469b-b5eb-1ff2fc025f82 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:47.038677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-072e339c-6f72-469b-b5eb-1ff2fc025f82 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:47.039140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-072e339c-6f72-469b-b5eb-1ff2fc025f82 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:47.039822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-072e339c-6f72-469b-b5eb-1ff2fc025f82 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:47.040581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-072e339c-6f72-469b-b5eb-1ff2fc025f82 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:47.041046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-072e339c-6f72-469b-b5eb-1ff2fc025f82 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:47.041476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-072e339c-6f72-469b-b5eb-1ff2fc025f82 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:47.085990 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-8f4e2201-eed4-4a49-b14c-fb62c15c32d9 tempest-ListImageFiltersNegativeTestJSON-280689927 tempest-ListImageFiltersNegativeTestJSON-280689927-project] HTTP exception thrown: Image not found. Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8f4e2201-eed4-4a49-b14c-fb62c15c32d9 tempest-ListImageFiltersNegativeTestJSON-280689927 tempest-ListImageFiltersNegativeTestJSON-280689927-project] Request method failure captured: Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/images/abf28a3f-4879-40a5-8c52-4b07ae4832c8 HTTP/1.1 Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGebJUpIioJD_e6JFsx1CkufJz36MpMPpFBSbiNhNZIfZuw-MBukxnogUOYbCsjSH86xLGAKi6VdsqfgnhC31xhYViBIqHcQ57mH6hdCWr1xFldjO8fzotf6OmMLA4k4lthUQXn2Ktb5GXyHq2BhI7lNj0IKdULhr37Mw1Gn4KdHC2bM Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 332f38a967a24294a0ad98a10f9cde08 Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-280689927 Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_332f38a967a24294a0ad98a10f9cde08"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/332f38a967a24294a0ad98a10f9cde08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/332f38a967a24294a0ad98a10f9cde08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/332f38a967a24294a0ad98a10f9cde08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-280689927 Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 332f38a967a24294a0ad98a10f9cde08 Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-280689927 Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ListImageFiltersNegativeTestJSON-280689927-project Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 8fa6ff017556473db02bd796eb07505e Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-280689927-project Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: exception: Image not found. Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'abf28a3f-4879-40a5-8c52-4b07ae4832c8'} Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID abf28a3f-4879-40a5-8c52-4b07ae4832c8 Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Sep 08 12:57:47.088179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._get(image_id) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image abf28a3f-4879-40a5-8c52-4b07ae4832c8 could not be found. Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8f4e2201-eed4-4a49-b14c-fb62c15c32d9 tempest-ListImageFiltersNegativeTestJSON-280689927 tempest-ListImageFiltersNegativeTestJSON-280689927-project] Returning 404 to user: Image not found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8f4e2201-eed4-4a49-b14c-fb62c15c32d9 tempest-ListImageFiltersNegativeTestJSON-280689927 tempest-ListImageFiltersNegativeTestJSON-280689927-project] 10.222.0.78 "GET /compute/v2.1/images/abf28a3f-4879-40a5-8c52-4b07ae4832c8" status: 404 len: 62 microversion: 2.1 time: 0.328421 Sep 08 12:57:47.100128 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1569/3275] 10.222.0.78 () {58 vars in 1233 bytes} [Thu Sep 8 12:57:46 2022] GET /compute/v2.1/images/abf28a3f-4879-40a5-8c52-4b07ae4832c8 => generated 62 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:57:47.112749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ea4dcc71-31c2-4daf-ae4f-8f91b31b4ffe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:47.112749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ea4dcc71-31c2-4daf-ae4f-8f91b31b4ffe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:47.112749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea4dcc71-31c2-4daf-ae4f-8f91b31b4ffe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:47.112749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea4dcc71-31c2-4daf-ae4f-8f91b31b4ffe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:47.113739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea4dcc71-31c2-4daf-ae4f-8f91b31b4ffe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:47.113739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea4dcc71-31c2-4daf-ae4f-8f91b31b4ffe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:47.114348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea4dcc71-31c2-4daf-ae4f-8f91b31b4ffe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:47.114636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea4dcc71-31c2-4daf-ae4f-8f91b31b4ffe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:47.210467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-072e339c-6f72-469b-b5eb-1ff2fc025f82 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:47.222714 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-072e339c-6f72-469b-b5eb-1ff2fc025f82 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1224 microversion: 2.1 time: 0.198914 Sep 08 12:57:47.227000 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1707/3276] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:47 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1224 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:47.245676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2cfdfb3c-5c78-43e0-a315-b1bd1d374252 req-474be995-1fc4-4875-bc9e-fe1d83694267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "tag": "1a42ecce-f9f7-442b-a7d5-6607113087a7"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:47.283147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2cfdfb3c-5c78-43e0-a315-b1bd1d374252 req-474be995-1fc4-4875-bc9e-fe1d83694267 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:47.285201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2cfdfb3c-5c78-43e0-a315-b1bd1d374252 req-474be995-1fc4-4875-bc9e-fe1d83694267 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:47.285927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2cfdfb3c-5c78-43e0-a315-b1bd1d374252 req-474be995-1fc4-4875-bc9e-fe1d83694267 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:47.303714 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2cfdfb3c-5c78-43e0-a315-b1bd1d374252 req-474be995-1fc4-4875-bc9e-fe1d83694267 service nova] Creating event network-changed:1a42ecce-f9f7-442b-a7d5-6607113087a7 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:57:47.318838 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2cfdfb3c-5c78-43e0-a315-b1bd1d374252 req-474be995-1fc4-4875-bc9e-fe1d83694267 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089864 Sep 08 12:57:47.321454 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1708/3277] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:47.354505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b1ee491a-cbcf-4340-a45d-3f0a2cea2224 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1204520932", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "28402a4f-f36c-4550-9d01-5a5ffeae7aa0"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b1ee491a-cbcf-4340-a45d-3f0a2cea2224 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Request method failure captured: Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 499 Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeabUqz08ExQ1779qG-O32erZJHQ39EnundSJPpzxHqFzEKHUrb2QX4luHDgWKbgR4lkFIBKquv8Su_tg6EmobqPCxY57pkjiTENK9ouQvk2VUBoVVBX0w27zhcj7HbygAd2VJQWdEF6uOHcm0JlrCe44Xr-_Gf3Y4kWw1Kx1JACLYk Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 5b997c71bc4b443bb6441ba1eeabab2d Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1204520932", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "28402a4f-f36c-4550-9d01-5a5ffeae7aa0"}]}} Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1204520932', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '28402a4f-f36c-4550-9d01-5a5ffeae7aa0'}]}}} Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 12:57:47.364706 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:47.369399 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.374261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b1ee491a-cbcf-4340-a45d-3f0a2cea2224 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:47.375169 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b1ee491a-cbcf-4340-a45d-3f0a2cea2224 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.031475 Sep 08 12:57:47.379831 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1709/3278] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:57:47 2022] POST /compute/v2.1/servers => generated 687 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:57:47.387680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ff70bbf2-9497-4c9c-83cc-9b60b4f99076 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:47.388932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff70bbf2-9497-4c9c-83cc-9b60b4f99076 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:47.415964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff70bbf2-9497-4c9c-83cc-9b60b4f99076 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:47.418683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff70bbf2-9497-4c9c-83cc-9b60b4f99076 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:47.421277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff70bbf2-9497-4c9c-83cc-9b60b4f99076 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:47.425739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff70bbf2-9497-4c9c-83cc-9b60b4f99076 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:47.428811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff70bbf2-9497-4c9c-83cc-9b60b4f99076 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:47.430665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff70bbf2-9497-4c9c-83cc-9b60b4f99076 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:47.598893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff70bbf2-9497-4c9c-83cc-9b60b4f99076 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Unlocking {{(pid=128970) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 08 12:57:47.763979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ea4dcc71-31c2-4daf-ae4f-8f91b31b4ffe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:47.769379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:47.783764 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ff70bbf2-9497-4c9c-83cc-9b60b4f99076 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.400753 Sep 08 12:57:47.789423 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1710/3279] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:57:47 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:57:47.793180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ea4dcc71-31c2-4daf-ae4f-8f91b31b4ffe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:47.795497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e0587be3-10ba-4e4c-b471-4bd5097ba492 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-966861059", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "28402a4f-f36c-4550-9d01-5a5ffeae7aa0"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:47.798787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ea4dcc71-31c2-4daf-ae4f-8f91b31b4ffe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e0587be3-10ba-4e4c-b471-4bd5097ba492 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Request method failure captured: Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 499 Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeabUqz08ExQ1779qG-O32erZJHQ39EnundSJPpzxHqFzEKHUrb2QX4luHDgWKbgR4lkFIBKquv8Su_tg6EmobqPCxY57pkjiTENK9ouQvk2VUBoVVBX0w27zhcj7HbygAd2VJQWdEF6uOHcm0JlrCe44Xr-_Gf3Y4kWw1Kx1JACLYk Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 5b997c71bc4b443bb6441ba1eeabab2d Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-966861059", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "28402a4f-f36c-4550-9d01-5a5ffeae7aa0"}]}} Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-966861059', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '28402a4f-f36c-4550-9d01-5a5ffeae7aa0'}]}}} Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 12:57:47.801710 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:47.805276 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:47.809903 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ea4dcc71-31c2-4daf-ae4f-8f91b31b4ffe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.712671 Sep 08 12:57:47.811548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e0587be3-10ba-4e4c-b471-4bd5097ba492 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:47.812782 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e0587be3-10ba-4e4c-b471-4bd5097ba492 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.021879 Sep 08 12:57:47.813912 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1711/3280] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:57:47 2022] POST /compute/v2.1/servers => generated 689 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 12:57:47.821355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c4e51197-1706-4b91-b0b1-988e0803487d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:47.824932 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1570/3281] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:47 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:47.836752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c4e51197-1706-4b91-b0b1-988e0803487d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:47.858473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4e51197-1706-4b91-b0b1-988e0803487d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:47.859055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-699958a4-9afa-454c-b01a-a2d0da93d301 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:47.868941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4e51197-1706-4b91-b0b1-988e0803487d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:47.869764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4e51197-1706-4b91-b0b1-988e0803487d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:47.872264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4e51197-1706-4b91-b0b1-988e0803487d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:47.873270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-699958a4-9afa-454c-b01a-a2d0da93d301 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:47.873832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4e51197-1706-4b91-b0b1-988e0803487d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:47.874658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-699958a4-9afa-454c-b01a-a2d0da93d301 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:47.876141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-699958a4-9afa-454c-b01a-a2d0da93d301 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:47.877186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4e51197-1706-4b91-b0b1-988e0803487d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:47.900856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:47.935215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-699958a4-9afa-454c-b01a-a2d0da93d301 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Going to try to stop instance {{(pid=128971) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 12:57:48.040076 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-699958a4-9afa-454c-b01a-a2d0da93d301 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.212760 Sep 08 12:57:48.041161 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1571/3282] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:57:47 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:57:48.053295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f8f16766-9663-468d-9346-e18d00490c2c tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:48.055161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f8f16766-9663-468d-9346-e18d00490c2c tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:48.070074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8f16766-9663-468d-9346-e18d00490c2c tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:48.071522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8f16766-9663-468d-9346-e18d00490c2c tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:48.072570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8f16766-9663-468d-9346-e18d00490c2c tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:48.074154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8f16766-9663-468d-9346-e18d00490c2c tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:48.075289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8f16766-9663-468d-9346-e18d00490c2c tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:48.076444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f8f16766-9663-468d-9346-e18d00490c2c tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:48.465876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c4e51197-1706-4b91-b0b1-988e0803487d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:48.475869 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c4e51197-1706-4b91-b0b1-988e0803487d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1314 microversion: 2.1 time: 0.660382 Sep 08 12:57:48.476662 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1712/3283] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:47 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:48.482393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-61d9b277-e24d-4d3e-bebb-63b06aa95a13 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1961140959", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "28402a4f-f36c-4550-9d01-5a5ffeae7aa0"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-61d9b277-e24d-4d3e-bebb-63b06aa95a13 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Request method failure captured: Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 754 Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeabUqz08ExQ1779qG-O32erZJHQ39EnundSJPpzxHqFzEKHUrb2QX4luHDgWKbgR4lkFIBKquv8Su_tg6EmobqPCxY57pkjiTENK9ouQvk2VUBoVVBX0w27zhcj7HbygAd2VJQWdEF6uOHcm0JlrCe44Xr-_Gf3Y4kWw1Kx1JACLYk Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 5b997c71bc4b443bb6441ba1eeabab2d Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1961140959", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "28402a4f-f36c-4550-9d01-5a5ffeae7aa0"}]}} Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1961140959', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '28402a4f-f36c-4550-9d01-5a5ffeae7aa0'}]}}} Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:57:48.488470 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:57:48.491597 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:57:48.494832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:48.494832 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.497850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-61d9b277-e24d-4d3e-bebb-63b06aa95a13 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:48.499127 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-61d9b277-e24d-4d3e-bebb-63b06aa95a13 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.021214 Sep 08 12:57:48.510343 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1713/3284] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:57:48 2022] POST /compute/v2.1/servers => generated 1197 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 08 12:57:48.516045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-47f5e2ec-24c9-4c97-a685-9f56fc9174a4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:48.516680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-47f5e2ec-24c9-4c97-a685-9f56fc9174a4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:48.526592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47f5e2ec-24c9-4c97-a685-9f56fc9174a4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:48.527095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47f5e2ec-24c9-4c97-a685-9f56fc9174a4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:48.527777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47f5e2ec-24c9-4c97-a685-9f56fc9174a4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:48.528917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47f5e2ec-24c9-4c97-a685-9f56fc9174a4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:48.529620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47f5e2ec-24c9-4c97-a685-9f56fc9174a4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:48.530393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47f5e2ec-24c9-4c97-a685-9f56fc9174a4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:48.656406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f8f16766-9663-468d-9346-e18d00490c2c tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:48.670575 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f8f16766-9663-468d-9346-e18d00490c2c tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 200 len: 1395 microversion: 2.1 time: 0.626292 Sep 08 12:57:48.697336 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1572/3285] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:48 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 1395 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:48.736502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dcbf16bb-cbf0-4748-8b95-9581b1d745b0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:48.738099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dcbf16bb-cbf0-4748-8b95-9581b1d745b0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:48.750981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcbf16bb-cbf0-4748-8b95-9581b1d745b0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:48.752521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcbf16bb-cbf0-4748-8b95-9581b1d745b0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:48.753185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcbf16bb-cbf0-4748-8b95-9581b1d745b0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:48.754426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcbf16bb-cbf0-4748-8b95-9581b1d745b0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:48.755084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcbf16bb-cbf0-4748-8b95-9581b1d745b0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:48.756637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcbf16bb-cbf0-4748-8b95-9581b1d745b0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:48.910115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:48.934313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dcbf16bb-cbf0-4748-8b95-9581b1d745b0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:48.951086 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dcbf16bb-cbf0-4748-8b95-9581b1d745b0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1278 microversion: 2.1 time: 0.250467 Sep 08 12:57:48.955604 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1573/3286] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:48 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:48.964801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44c817c8-1893-4e1e-82d6-a008851942fa tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1378867896", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "28402a4f-f36c-4550-9d01-5a5ffeae7aa0"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:48.968670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44c817c8-1893-4e1e-82d6-a008851942fa tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Request method failure captured: Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 1266 Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeabUqz08ExQ1779qG-O32erZJHQ39EnundSJPpzxHqFzEKHUrb2QX4luHDgWKbgR4lkFIBKquv8Su_tg6EmobqPCxY57pkjiTENK9ouQvk2VUBoVVBX0w27zhcj7HbygAd2VJQWdEF6uOHcm0JlrCe44Xr-_Gf3Y4kWw1Kx1JACLYk Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 5b997c71bc4b443bb6441ba1eeabab2d Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1378867896", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "28402a4f-f36c-4550-9d01-5a5ffeae7aa0"}]}} Sep 08 12:57:48.976869 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1378867896', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '28402a4f-f36c-4550-9d01-5a5ffeae7aa0'}]}}} Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'type': 'object'} Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.981529 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 12:57:48.989600 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 12:57:48.998145 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Sep 08 12:57:48.998145 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:48.998145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44c817c8-1893-4e1e-82d6-a008851942fa tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:48.998145 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-44c817c8-1893-4e1e-82d6-a008851942fa tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.031804 Sep 08 12:57:48.998145 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1574/3287] 10.222.0.78 () {60 vars in 1148 bytes} [Thu Sep 8 12:57:48 2022] POST /compute/v2.1/servers => generated 2221 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Sep 08 12:57:49.007010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-acdf37db-8d66-4d93-9591-5028f55a3dbc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:49.009502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-47f5e2ec-24c9-4c97-a685-9f56fc9174a4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:49.012776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-acdf37db-8d66-4d93-9591-5028f55a3dbc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:49.022096 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-47f5e2ec-24c9-4c97-a685-9f56fc9174a4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1680 microversion: 2.1 time: 0.509819 Sep 08 12:57:49.022777 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1714/3288] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:48 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1680 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:49.029024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2e82dad3-8e97-4f73-894d-6de064fde945 req-153e044f-e963-4191-ac2b-23a9dab4dc3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b876ea7-4998-44bb-818e-0a43fa411bb9", "name": "network-vif-plugged", "status": "completed", "tag": "64ee14bc-76ce-49fc-a895-3b1655046453"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:49.033100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acdf37db-8d66-4d93-9591-5028f55a3dbc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:49.033614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acdf37db-8d66-4d93-9591-5028f55a3dbc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:49.034063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acdf37db-8d66-4d93-9591-5028f55a3dbc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:49.034815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acdf37db-8d66-4d93-9591-5028f55a3dbc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:49.035310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acdf37db-8d66-4d93-9591-5028f55a3dbc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:49.035752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acdf37db-8d66-4d93-9591-5028f55a3dbc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:49.056870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2e82dad3-8e97-4f73-894d-6de064fde945 req-153e044f-e963-4191-ac2b-23a9dab4dc3a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:49.058305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2e82dad3-8e97-4f73-894d-6de064fde945 req-153e044f-e963-4191-ac2b-23a9dab4dc3a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:49.058999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2e82dad3-8e97-4f73-894d-6de064fde945 req-153e044f-e963-4191-ac2b-23a9dab4dc3a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:49.077090 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2e82dad3-8e97-4f73-894d-6de064fde945 req-153e044f-e963-4191-ac2b-23a9dab4dc3a service nova] Creating event network-vif-plugged:64ee14bc-76ce-49fc-a895-3b1655046453 for instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 on n-h2-852084-10 Sep 08 12:57:49.088584 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2e82dad3-8e97-4f73-894d-6de064fde945 req-153e044f-e963-4191-ac2b-23a9dab4dc3a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064146 Sep 08 12:57:49.089633 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1715/3289] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:49.097991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6a13526-152a-4d7c-b18e-2c964b501b5c tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:49.099014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f6a13526-152a-4d7c-b18e-2c964b501b5c tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 43be2f87-955d-4d8c-81bf-f7dd4e6b80b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:49.106280 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-f6a13526-152a-4d7c-b18e-2c964b501b5c tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] HTTP exception thrown: Instance 43be2f87-955d-4d8c-81bf-f7dd4e6b80b2 could not be found. Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6a13526-152a-4d7c-b18e-2c964b501b5c tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Request method failure captured: Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/43be2f87-955d-4d8c-81bf-f7dd4e6b80b2/metadata/test2 HTTP/1.1 Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeabUqz08ExQ1779qG-O32erZJHQ39EnundSJPpzxHqFzEKHUrb2QX4luHDgWKbgR4lkFIBKquv8Su_tg6EmobqPCxY57pkjiTENK9ouQvk2VUBoVVBX0w27zhcj7HbygAd2VJQWdEF6uOHcm0JlrCe44Xr-_Gf3Y4kWw1Kx1JACLYk Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 5b997c71bc4b443bb6441ba1eeabab2d Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 43be2f87-955d-4d8c-81bf-f7dd4e6b80b2 could not be found. Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'server_id': '43be2f87-955d-4d8c-81bf-f7dd4e6b80b2', 'id': 'test2'} Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43be2f87-955d-4d8c-81bf-f7dd4e6b80b2 could not be found. Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43be2f87-955d-4d8c-81bf-f7dd4e6b80b2 could not be found. Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:49.110324 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:49.115002 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:57:49.115002 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:57:49.115002 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43be2f87-955d-4d8c-81bf-f7dd4e6b80b2 could not be found. Sep 08 12:57:49.115002 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:57:49.118358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6a13526-152a-4d7c-b18e-2c964b501b5c tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Returning 404 to user: Instance 43be2f87-955d-4d8c-81bf-f7dd4e6b80b2 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:49.120193 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f6a13526-152a-4d7c-b18e-2c964b501b5c tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/43be2f87-955d-4d8c-81bf-f7dd4e6b80b2/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.028531 Sep 08 12:57:49.143138 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1716/3290] 10.222.0.78 () {58 vars in 1281 bytes} [Thu Sep 8 12:57:49 2022] GET /compute/v2.1/servers/43be2f87-955d-4d8c-81bf-f7dd4e6b80b2/metadata/test2 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:57:49.160079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f76b4020-dacc-46a1-8070-ddd5923061c5 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:49.166204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f76b4020-dacc-46a1-8070-ddd5923061c5 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:49.192556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f76b4020-dacc-46a1-8070-ddd5923061c5 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:49.194069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f76b4020-dacc-46a1-8070-ddd5923061c5 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:49.195443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f76b4020-dacc-46a1-8070-ddd5923061c5 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:49.196661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f76b4020-dacc-46a1-8070-ddd5923061c5 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:49.197477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f76b4020-dacc-46a1-8070-ddd5923061c5 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:49.198433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f76b4020-dacc-46a1-8070-ddd5923061c5 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:49.317872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f76b4020-dacc-46a1-8070-ddd5923061c5 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:57:49.567769 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f76b4020-dacc-46a1-8070-ddd5923061c5 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "DELETE /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 204 len: 0 microversion: 2.1 time: 0.422507 Sep 08 12:57:49.569974 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1717/3291] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:57:49 2022] DELETE /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:57:49.580843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-fb4edd39-de5b-4a04-98c9-193b1cb206dd req-f227a12a-0d30-432f-a5d8-addde25fce98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "tag": "4b26731c-bba7-426c-9edd-565f551fa508"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:49.614570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-fb4edd39-de5b-4a04-98c9-193b1cb206dd req-f227a12a-0d30-432f-a5d8-addde25fce98 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:49.616323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-fb4edd39-de5b-4a04-98c9-193b1cb206dd req-f227a12a-0d30-432f-a5d8-addde25fce98 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:49.617805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-fb4edd39-de5b-4a04-98c9-193b1cb206dd req-f227a12a-0d30-432f-a5d8-addde25fce98 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:49.648559 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-fb4edd39-de5b-4a04-98c9-193b1cb206dd req-f227a12a-0d30-432f-a5d8-addde25fce98 service nova] Creating event network-changed:4b26731c-bba7-426c-9edd-565f551fa508 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:57:49.657035 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-fb4edd39-de5b-4a04-98c9-193b1cb206dd req-f227a12a-0d30-432f-a5d8-addde25fce98 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084310 Sep 08 12:57:49.658131 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1718/3292] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:49.665060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-54bf3291-d4c8-4cb8-9ede-31c8107cadf1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:49.666449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-54bf3291-d4c8-4cb8-9ede-31c8107cadf1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:49.675342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54bf3291-d4c8-4cb8-9ede-31c8107cadf1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:49.676207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54bf3291-d4c8-4cb8-9ede-31c8107cadf1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:49.676840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54bf3291-d4c8-4cb8-9ede-31c8107cadf1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:49.677789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54bf3291-d4c8-4cb8-9ede-31c8107cadf1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:49.678454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54bf3291-d4c8-4cb8-9ede-31c8107cadf1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:49.679372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54bf3291-d4c8-4cb8-9ede-31c8107cadf1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:49.923606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-acdf37db-8d66-4d93-9591-5028f55a3dbc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:49.936053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-acdf37db-8d66-4d93-9591-5028f55a3dbc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:49.938369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-acdf37db-8d66-4d93-9591-5028f55a3dbc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:49.940099 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-acdf37db-8d66-4d93-9591-5028f55a3dbc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.944765 Sep 08 12:57:49.952337 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1575/3293] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:48 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:49.965941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-65af851c-d786-4414-98f7-b891756f300b tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:49.967058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-65af851c-d786-4414-98f7-b891756f300b tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:49.983389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65af851c-d786-4414-98f7-b891756f300b tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:49.984339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65af851c-d786-4414-98f7-b891756f300b tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:49.985129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65af851c-d786-4414-98f7-b891756f300b tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:49.986171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65af851c-d786-4414-98f7-b891756f300b tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:49.986763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65af851c-d786-4414-98f7-b891756f300b tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:49.987304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65af851c-d786-4414-98f7-b891756f300b tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:50.405935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-54bf3291-d4c8-4cb8-9ede-31c8107cadf1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:50.420299 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-54bf3291-d4c8-4cb8-9ede-31c8107cadf1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1314 microversion: 2.1 time: 0.759020 Sep 08 12:57:50.421719 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1719/3294] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:49 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1314 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:50.431630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-daaae19f-14c3-4e35-93c7-79b170a40040 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:50.433263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-daaae19f-14c3-4e35-93c7-79b170a40040 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:50.446518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-daaae19f-14c3-4e35-93c7-79b170a40040 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:50.447817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-daaae19f-14c3-4e35-93c7-79b170a40040 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:50.448614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-daaae19f-14c3-4e35-93c7-79b170a40040 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:50.450222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-daaae19f-14c3-4e35-93c7-79b170a40040 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:50.451051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-daaae19f-14c3-4e35-93c7-79b170a40040 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:50.452082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-daaae19f-14c3-4e35-93c7-79b170a40040 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:50.630574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-65af851c-d786-4414-98f7-b891756f300b tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b997c71bc4b443bb6441ba1eeabab2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb59ad8531d447082e1f77207b3c656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:50.643134 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-65af851c-d786-4414-98f7-b891756f300b tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 200 len: 1526 microversion: 2.1 time: 0.688955 Sep 08 12:57:50.644770 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1576/3295] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:49 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 1526 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:50.656117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9118b735-77c9-4da2-a973-dec743934a28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:50.657234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9118b735-77c9-4da2-a973-dec743934a28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:50.669823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9118b735-77c9-4da2-a973-dec743934a28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:50.671114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9118b735-77c9-4da2-a973-dec743934a28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:50.673241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9118b735-77c9-4da2-a973-dec743934a28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:50.675692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9118b735-77c9-4da2-a973-dec743934a28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:50.676994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9118b735-77c9-4da2-a973-dec743934a28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:50.678142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9118b735-77c9-4da2-a973-dec743934a28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:50.908879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-daaae19f-14c3-4e35-93c7-79b170a40040 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:50.924874 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-daaae19f-14c3-4e35-93c7-79b170a40040 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 200 len: 1577 microversion: 2.1 time: 0.501127 Sep 08 12:57:50.925808 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1720/3296] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:50 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 1577 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:50.941174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-29c113c4-8e4c-4dc9-83c6-3432bf78ab3f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:50.941771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-29c113c4-8e4c-4dc9-83c6-3432bf78ab3f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:50.968145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29c113c4-8e4c-4dc9-83c6-3432bf78ab3f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:50.968678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29c113c4-8e4c-4dc9-83c6-3432bf78ab3f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:50.969182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29c113c4-8e4c-4dc9-83c6-3432bf78ab3f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:50.970303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29c113c4-8e4c-4dc9-83c6-3432bf78ab3f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:50.970467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29c113c4-8e4c-4dc9-83c6-3432bf78ab3f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:50.970854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29c113c4-8e4c-4dc9-83c6-3432bf78ab3f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:51.364241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9118b735-77c9-4da2-a973-dec743934a28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:51.378758 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9118b735-77c9-4da2-a973-dec743934a28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1320 microversion: 2.1 time: 0.731902 Sep 08 12:57:51.379607 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1577/3297] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:50 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1320 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:51.592416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-61d24441-a2d1-477f-9ce0-cbf0279b0b0d tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] Calling method '.version_select at 0x7fdb3af65c10>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:51.607893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61d24441-a2d1-477f-9ce0-cbf0279b0b0d tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:51.608914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61d24441-a2d1-477f-9ce0-cbf0279b0b0d tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:51.609616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61d24441-a2d1-477f-9ce0-cbf0279b0b0d tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:51.610627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61d24441-a2d1-477f-9ce0-cbf0279b0b0d tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:51.611334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61d24441-a2d1-477f-9ce0-cbf0279b0b0d tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:51.612049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61d24441-a2d1-477f-9ce0-cbf0279b0b0d tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:51.654054 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-61d24441-a2d1-477f-9ce0-cbf0279b0b0d tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] 10.222.0.78 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.272828 Sep 08 12:57:51.655055 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1578/3298] 10.222.0.78 () {58 vars in 1122 bytes} [Thu Sep 8 12:57:51 2022] GET /compute/v2.1/limits => generated 511 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:51.661550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ba2ec352-76c4-401a-a565-97e2f84d7469 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:51.662486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ba2ec352-76c4-401a-a565-97e2f84d7469 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:51.670092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba2ec352-76c4-401a-a565-97e2f84d7469 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:51.671543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba2ec352-76c4-401a-a565-97e2f84d7469 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:51.672338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba2ec352-76c4-401a-a565-97e2f84d7469 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:51.673378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba2ec352-76c4-401a-a565-97e2f84d7469 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:51.674106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba2ec352-76c4-401a-a565-97e2f84d7469 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:51.674914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba2ec352-76c4-401a-a565-97e2f84d7469 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:51.978283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-29c113c4-8e4c-4dc9-83c6-3432bf78ab3f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:51.994655 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-29c113c4-8e4c-4dc9-83c6-3432bf78ab3f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1680 microversion: 2.1 time: 1.067311 Sep 08 12:57:51.996109 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1721/3299] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:50 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1680 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:52.014793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c946b44a-2244-488c-a754-df6018669049 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:52.017079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c946b44a-2244-488c-a754-df6018669049 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:52.039963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c946b44a-2244-488c-a754-df6018669049 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:52.040848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c946b44a-2244-488c-a754-df6018669049 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:52.041447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c946b44a-2244-488c-a754-df6018669049 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:52.042436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c946b44a-2244-488c-a754-df6018669049 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:52.043121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c946b44a-2244-488c-a754-df6018669049 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:52.043941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c946b44a-2244-488c-a754-df6018669049 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:52.130092 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ba2ec352-76c4-401a-a565-97e2f84d7469 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.473352 Sep 08 12:57:52.130997 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1579/3300] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 12:57:51 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef/os-interface => generated 285 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:52.144312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8c0c028a-e217-40f8-9443-c7f8857f62eb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:52.145438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8c0c028a-e217-40f8-9443-c7f8857f62eb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:52.163186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c0c028a-e217-40f8-9443-c7f8857f62eb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:52.163751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c0c028a-e217-40f8-9443-c7f8857f62eb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:52.164338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c0c028a-e217-40f8-9443-c7f8857f62eb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:52.165338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c0c028a-e217-40f8-9443-c7f8857f62eb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:52.166000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c0c028a-e217-40f8-9443-c7f8857f62eb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:52.166613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8c0c028a-e217-40f8-9443-c7f8857f62eb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:52.688662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c946b44a-2244-488c-a754-df6018669049 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:52.721928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c946b44a-2244-488c-a754-df6018669049 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:52.724036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c946b44a-2244-488c-a754-df6018669049 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:52.725963 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c946b44a-2244-488c-a754-df6018669049 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.727798 Sep 08 12:57:52.727669 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1722/3301] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:51 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:52.736195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8d515bb8-38b4-4be5-8994-af1b100be8fb tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:52.737124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8d515bb8-38b4-4be5-8994-af1b100be8fb tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:52.739990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:52.758043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8c0c028a-e217-40f8-9443-c7f8857f62eb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:52.772022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d515bb8-38b4-4be5-8994-af1b100be8fb tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:52.772952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d515bb8-38b4-4be5-8994-af1b100be8fb tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:52.774430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d515bb8-38b4-4be5-8994-af1b100be8fb tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:52.776466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d515bb8-38b4-4be5-8994-af1b100be8fb tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:52.777572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d515bb8-38b4-4be5-8994-af1b100be8fb tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:52.778290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d515bb8-38b4-4be5-8994-af1b100be8fb tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:52.787077 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8c0c028a-e217-40f8-9443-c7f8857f62eb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1501 microversion: 2.1 time: 0.652980 Sep 08 12:57:52.789324 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1580/3302] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:52 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1501 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:52.807770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fb904184-d07e-4d99-9b62-3e8d8dd10d12 tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-745610077", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:52.875803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-fb904184-d07e-4d99-9b62-3e8d8dd10d12 tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:57:53.597467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8d515bb8-38b4-4be5-8994-af1b100be8fb tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b997c71bc4b443bb6441ba1eeabab2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb59ad8531d447082e1f77207b3c656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:53.624180 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8d515bb8-38b4-4be5-8994-af1b100be8fb tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 200 len: 1526 microversion: 2.1 time: 0.892682 Sep 08 12:57:53.625749 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1723/3303] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:52 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 1526 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:53.638861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bc3f714a-37e6-48e2-906e-7dba55987be0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:53.643365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bc3f714a-37e6-48e2-906e-7dba55987be0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:53.661881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc3f714a-37e6-48e2-906e-7dba55987be0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:53.663371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc3f714a-37e6-48e2-906e-7dba55987be0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:53.663371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc3f714a-37e6-48e2-906e-7dba55987be0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:53.664116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc3f714a-37e6-48e2-906e-7dba55987be0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:53.667600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc3f714a-37e6-48e2-906e-7dba55987be0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:53.668003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bc3f714a-37e6-48e2-906e-7dba55987be0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:53.930247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-fb904184-d07e-4d99-9b62-3e8d8dd10d12 tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] Getting quotas for project f0dc4b1b9d6b407db9bc5b9c84f064a8. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:57:53.943042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-fb904184-d07e-4d99-9b62-3e8d8dd10d12 tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] Getting quotas for user f307687237d746e592878a44b0244f37 and project f0dc4b1b9d6b407db9bc5b9c84f064a8. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:57:54.014946 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-fb904184-d07e-4d99-9b62-3e8d8dd10d12 tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fb904184-d07e-4d99-9b62-3e8d8dd10d12 tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] Request method failure captured: Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 1751 Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGebOsXL4ero5voP9iVh6z3gADCYjS81fhhTy2UenwpXnF6qvb389Zg-KP-rrnvN51pRxG3XN0ANEc64xkIN5rV1aC7FeXvbCMMMJeu_vKYSbTmdhJ5iEwePl93ECBVvdDgnxDE2ZHvU41AvlJkQkVya_Uqt6BLU8zF3E7LhkW_B5Zdk Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: f0dc4b1b9d6b407db9bc5b9c84f064a8 Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1523864540 Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f0dc4b1b9d6b407db9bc5b9c84f064a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f0dc4b1b9d6b407db9bc5b9c84f064a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0dc4b1b9d6b407db9bc5b9c84f064a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f0dc4b1b9d6b407db9bc5b9c84f064a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1523864540 Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: f0dc4b1b9d6b407db9bc5b9c84f064a8 Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1523864540 Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: f307687237d746e592878a44b0244f37 Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-745610077", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:57:54.022045 n-d-852084-10 devstack@n-api.service[128971]: exception: Maximum number of metadata items exceeds 128 Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-745610077', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:57:54.027068 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fb904184-d07e-4d99-9b62-3e8d8dd10d12 tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:54.040272 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fb904184-d07e-4d99-9b62-3e8d8dd10d12 tempest-AbsoluteLimitsNegativeTestJSON-1523864540 tempest-AbsoluteLimitsNegativeTestJSON-1523864540-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.235383 Sep 08 12:57:54.048030 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1581/3304] 10.222.0.78 () {60 vars in 1148 bytes} [Thu Sep 8 12:57:52 2022] POST /compute/v2.1/servers => generated 87 bytes in 1253 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Sep 08 12:57:54.055753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-27441945-232c-4ce1-b5d2-0287b49b1b41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:54.056110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-27441945-232c-4ce1-b5d2-0287b49b1b41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:54.073037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27441945-232c-4ce1-b5d2-0287b49b1b41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:54.074088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27441945-232c-4ce1-b5d2-0287b49b1b41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:54.076285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27441945-232c-4ce1-b5d2-0287b49b1b41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:54.078097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27441945-232c-4ce1-b5d2-0287b49b1b41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:54.079664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27441945-232c-4ce1-b5d2-0287b49b1b41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:54.081101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27441945-232c-4ce1-b5d2-0287b49b1b41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:54.238540 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-27441945-232c-4ce1-b5d2-0287b49b1b41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "POST /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9/action" status: 202 len: 0 microversion: 2.1 time: 0.183505 Sep 08 12:57:54.240914 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1582/3305] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:57:54 2022] POST /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:57:54.254456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-cbb7dd8b-a596-459d-a804-21ef17244d34 req-f6dd5ad0-6873-45bf-934c-ba8bd1bd2328 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "tag": "a4326ea5-099a-4095-b74c-dfca6dbbcf45"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:54.272414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cbb7dd8b-a596-459d-a804-21ef17244d34 req-f6dd5ad0-6873-45bf-934c-ba8bd1bd2328 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:54.273787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cbb7dd8b-a596-459d-a804-21ef17244d34 req-f6dd5ad0-6873-45bf-934c-ba8bd1bd2328 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:54.274463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cbb7dd8b-a596-459d-a804-21ef17244d34 req-f6dd5ad0-6873-45bf-934c-ba8bd1bd2328 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:54.292148 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-cbb7dd8b-a596-459d-a804-21ef17244d34 req-f6dd5ad0-6873-45bf-934c-ba8bd1bd2328 service nova] Creating event network-changed:a4326ea5-099a-4095-b74c-dfca6dbbcf45 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:57:54.302228 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-cbb7dd8b-a596-459d-a804-21ef17244d34 req-f6dd5ad0-6873-45bf-934c-ba8bd1bd2328 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053459 Sep 08 12:57:54.303874 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1583/3306] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:54.310802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-30b182b1-1ac6-4005-999a-255db71e7368 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:54.312253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-30b182b1-1ac6-4005-999a-255db71e7368 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:54.324204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-30b182b1-1ac6-4005-999a-255db71e7368 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:54.325515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-30b182b1-1ac6-4005-999a-255db71e7368 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:54.326524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-30b182b1-1ac6-4005-999a-255db71e7368 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:54.327842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-30b182b1-1ac6-4005-999a-255db71e7368 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:54.329214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-30b182b1-1ac6-4005-999a-255db71e7368 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:54.330025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-30b182b1-1ac6-4005-999a-255db71e7368 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:54.370838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bc3f714a-37e6-48e2-906e-7dba55987be0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:54.380366 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bc3f714a-37e6-48e2-906e-7dba55987be0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1320 microversion: 2.1 time: 0.752676 Sep 08 12:57:54.389741 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1724/3307] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:53 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1320 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:54.414544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f91d00bc-c73a-4207-b215-9a8d36286fb5 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:54.417562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f91d00bc-c73a-4207-b215-9a8d36286fb5 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:54.430374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f91d00bc-c73a-4207-b215-9a8d36286fb5 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:54.431687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f91d00bc-c73a-4207-b215-9a8d36286fb5 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:54.433321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f91d00bc-c73a-4207-b215-9a8d36286fb5 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:54.434548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f91d00bc-c73a-4207-b215-9a8d36286fb5 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:54.435953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f91d00bc-c73a-4207-b215-9a8d36286fb5 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:54.437647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f91d00bc-c73a-4207-b215-9a8d36286fb5 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:54.840039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-30b182b1-1ac6-4005-999a-255db71e7368 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:54.850427 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-30b182b1-1ac6-4005-999a-255db71e7368 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1680 microversion: 2.1 time: 0.544768 Sep 08 12:57:54.851093 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1584/3308] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:54 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1680 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:54.871113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b401bc0d-7193-42b0-8c94-3f956aebfcf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:54.871811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b401bc0d-7193-42b0-8c94-3f956aebfcf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:54.891804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b401bc0d-7193-42b0-8c94-3f956aebfcf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:54.891804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b401bc0d-7193-42b0-8c94-3f956aebfcf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:54.891804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b401bc0d-7193-42b0-8c94-3f956aebfcf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:54.891804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b401bc0d-7193-42b0-8c94-3f956aebfcf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:54.891804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b401bc0d-7193-42b0-8c94-3f956aebfcf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:54.891804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b401bc0d-7193-42b0-8c94-3f956aebfcf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:55.054972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f91d00bc-c73a-4207-b215-9a8d36286fb5 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:55.074862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f91d00bc-c73a-4207-b215-9a8d36286fb5 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:55.078788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f91d00bc-c73a-4207-b215-9a8d36286fb5 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:55.081708 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f91d00bc-c73a-4207-b215-9a8d36286fb5 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.690370 Sep 08 12:57:55.083749 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1725/3309] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:54 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:55.093580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:55.095413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:55.107668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:55.108716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:55.110227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:55.111751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:55.112821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:55.113710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:55.172464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:55.173434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:55.174283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:55.175049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lazy-loading 'fault' on Instance uuid 041b58e4-953e-4b1f-b52d-246d904017f5 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:57:55.317763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b997c71bc4b443bb6441ba1eeabab2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ddb59ad8531d447082e1f77207b3c656', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:55.382366 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eb85807f-bb8d-421a-a7ff-d438ec5cd8c8 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 200 len: 1314 microversion: 2.1 time: 0.294928 Sep 08 12:57:55.386998 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1726/3310] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:55 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:55.405077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b401bc0d-7193-42b0-8c94-3f956aebfcf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:55.467137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84be4487-016f-40d6-bb76-1a9cead7187f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:55.471357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-84be4487-016f-40d6-bb76-1a9cead7187f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:55.477727 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b401bc0d-7193-42b0-8c94-3f956aebfcf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1486 microversion: 2.1 time: 0.617989 Sep 08 12:57:55.481975 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1585/3311] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:54 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1486 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:55.493913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84be4487-016f-40d6-bb76-1a9cead7187f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:55.495415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84be4487-016f-40d6-bb76-1a9cead7187f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:55.499770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84be4487-016f-40d6-bb76-1a9cead7187f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:55.502292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84be4487-016f-40d6-bb76-1a9cead7187f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:55.515639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-280b4e59-b2f3-4451-bfa1-6c22735751b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:55.518729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84be4487-016f-40d6-bb76-1a9cead7187f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:55.520378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84be4487-016f-40d6-bb76-1a9cead7187f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:55.522784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-280b4e59-b2f3-4451-bfa1-6c22735751b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:55.544346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-280b4e59-b2f3-4451-bfa1-6c22735751b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:55.545710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-280b4e59-b2f3-4451-bfa1-6c22735751b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:55.547639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-280b4e59-b2f3-4451-bfa1-6c22735751b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:55.565928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-280b4e59-b2f3-4451-bfa1-6c22735751b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:55.567489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-280b4e59-b2f3-4451-bfa1-6c22735751b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:55.571957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-280b4e59-b2f3-4451-bfa1-6c22735751b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:55.645884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-280b4e59-b2f3-4451-bfa1-6c22735751b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:57:55.807895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:55.816045 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-280b4e59-b2f3-4451-bfa1-6c22735751b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 204 len: 0 microversion: 2.1 time: 0.310072 Sep 08 12:57:55.820497 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1586/3312] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:57:55 2022] DELETE /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:57:55.831510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-202b95d7-4462-4626-a754-d2ec191ce971 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:55.833905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-202b95d7-4462-4626-a754-d2ec191ce971 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:55.848082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202b95d7-4462-4626-a754-d2ec191ce971 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:55.848747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202b95d7-4462-4626-a754-d2ec191ce971 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:55.849296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202b95d7-4462-4626-a754-d2ec191ce971 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:55.850170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202b95d7-4462-4626-a754-d2ec191ce971 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:55.851008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202b95d7-4462-4626-a754-d2ec191ce971 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:55.851570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202b95d7-4462-4626-a754-d2ec191ce971 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:55.879204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:56.274649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-84be4487-016f-40d6-bb76-1a9cead7187f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:56.285098 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-84be4487-016f-40d6-bb76-1a9cead7187f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1320 microversion: 2.1 time: 0.866201 Sep 08 12:57:56.299761 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1727/3313] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:55 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1320 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:56.304845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-202b95d7-4462-4626-a754-d2ec191ce971 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:56.307691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a5a0a160-bf7b-49d5-99cb-92944eeadd38 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:56.308723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a5a0a160-bf7b-49d5-99cb-92944eeadd38 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:56.315974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5a0a160-bf7b-49d5-99cb-92944eeadd38 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:56.316245 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-202b95d7-4462-4626-a754-d2ec191ce971 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1492 microversion: 2.1 time: 0.493082 Sep 08 12:57:56.317048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5a0a160-bf7b-49d5-99cb-92944eeadd38 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:56.317743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5a0a160-bf7b-49d5-99cb-92944eeadd38 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:56.318774 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1587/3314] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:55 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1492 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:56.318920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5a0a160-bf7b-49d5-99cb-92944eeadd38 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:56.319690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5a0a160-bf7b-49d5-99cb-92944eeadd38 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:56.320362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5a0a160-bf7b-49d5-99cb-92944eeadd38 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:56.332177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ded3f093-92af-4bd0-ad1e-ca927777199e tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:56.332822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ded3f093-92af-4bd0-ad1e-ca927777199e tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:56.364652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ded3f093-92af-4bd0-ad1e-ca927777199e tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:56.365177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ded3f093-92af-4bd0-ad1e-ca927777199e tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:56.368959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ded3f093-92af-4bd0-ad1e-ca927777199e tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:56.369945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ded3f093-92af-4bd0-ad1e-ca927777199e tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:56.370437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ded3f093-92af-4bd0-ad1e-ca927777199e tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:56.370886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ded3f093-92af-4bd0-ad1e-ca927777199e tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:56.731218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a5a0a160-bf7b-49d5-99cb-92944eeadd38 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:56.742597 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a5a0a160-bf7b-49d5-99cb-92944eeadd38 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1680 microversion: 2.1 time: 0.441320 Sep 08 12:57:56.743212 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1728/3315] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:56 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1680 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:56.753175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c78f57c1-d05d-4fe4-9ecf-36f09ba8d7d3 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:56.753800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c78f57c1-d05d-4fe4-9ecf-36f09ba8d7d3 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:56.766915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c78f57c1-d05d-4fe4-9ecf-36f09ba8d7d3 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:56.767952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c78f57c1-d05d-4fe4-9ecf-36f09ba8d7d3 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:56.768550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c78f57c1-d05d-4fe4-9ecf-36f09ba8d7d3 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:56.769735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c78f57c1-d05d-4fe4-9ecf-36f09ba8d7d3 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:56.770309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c78f57c1-d05d-4fe4-9ecf-36f09ba8d7d3 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:56.770915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c78f57c1-d05d-4fe4-9ecf-36f09ba8d7d3 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:57.041785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ded3f093-92af-4bd0-ad1e-ca927777199e tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:57.057605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ded3f093-92af-4bd0-ad1e-ca927777199e tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:57.059171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ded3f093-92af-4bd0-ad1e-ca927777199e tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:57.068763 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ded3f093-92af-4bd0-ad1e-ca927777199e tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.748707 Sep 08 12:57:57.069367 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1588/3316] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:56 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:57:57.076397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-de866233-d102-4f2b-a1a5-3450b59afd18 req-5eecd271-55dd-497b-af12-f15807acd45d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54768ef6-04c1-4a48-be47-c6286e20b1ef", "tag": "3cb24870-537c-488f-a27b-9c4e2eb374c1"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:57.107944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-de866233-d102-4f2b-a1a5-3450b59afd18 req-5eecd271-55dd-497b-af12-f15807acd45d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:57.108442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-de866233-d102-4f2b-a1a5-3450b59afd18 req-5eecd271-55dd-497b-af12-f15807acd45d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:57.108880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-de866233-d102-4f2b-a1a5-3450b59afd18 req-5eecd271-55dd-497b-af12-f15807acd45d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:57.134073 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-de866233-d102-4f2b-a1a5-3450b59afd18 req-5eecd271-55dd-497b-af12-f15807acd45d service nova] Creating event network-changed:3cb24870-537c-488f-a27b-9c4e2eb374c1 for instance 54768ef6-04c1-4a48-be47-c6286e20b1ef on n-h1-852084-10 Sep 08 12:57:57.147797 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-de866233-d102-4f2b-a1a5-3450b59afd18 req-5eecd271-55dd-497b-af12-f15807acd45d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075212 Sep 08 12:57:57.150552 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1589/3317] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:57.161864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-d833135b-b9e3-4843-a79d-c7deaf0f5625 req-63462775-006a-405f-b475-d07e9f928e67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "041b58e4-953e-4b1f-b52d-246d904017f5", "name": "network-vif-deleted", "tag": "17631661-1b8c-43ed-a8eb-f66a4dc71eee"}, {"name": "network-changed", "server_uuid": "cdf026f9-c479-4ace-bc9a-232c26f2e862", "tag": "93fb265a-f5fb-45e0-a146-65ebecfe3f57"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:57:57.191372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d833135b-b9e3-4843-a79d-c7deaf0f5625 req-63462775-006a-405f-b475-d07e9f928e67 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:57.192498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d833135b-b9e3-4843-a79d-c7deaf0f5625 req-63462775-006a-405f-b475-d07e9f928e67 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:57.196324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d833135b-b9e3-4843-a79d-c7deaf0f5625 req-63462775-006a-405f-b475-d07e9f928e67 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:57.224671 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d833135b-b9e3-4843-a79d-c7deaf0f5625 req-63462775-006a-405f-b475-d07e9f928e67 service nova] Creating event network-vif-deleted:17631661-1b8c-43ed-a8eb-f66a4dc71eee for instance 041b58e4-953e-4b1f-b52d-246d904017f5 on n-h2-852084-10 Sep 08 12:57:57.225658 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d833135b-b9e3-4843-a79d-c7deaf0f5625 req-63462775-006a-405f-b475-d07e9f928e67 service nova] Creating event network-changed:93fb265a-f5fb-45e0-a146-65ebecfe3f57 for instance cdf026f9-c479-4ace-bc9a-232c26f2e862 on n-h2-852084-10 Sep 08 12:57:57.235726 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-d833135b-b9e3-4843-a79d-c7deaf0f5625 req-63462775-006a-405f-b475-d07e9f928e67 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.083266 Sep 08 12:57:57.251756 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1590/3318] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:57:57.270850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fe439c25-0c4e-4e43-a030-d8854adfbd97 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:57.271805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fe439c25-0c4e-4e43-a030-d8854adfbd97 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] [instance: 041b58e4-953e-4b1f-b52d-246d904017f5] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:57.285877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe439c25-0c4e-4e43-a030-d8854adfbd97 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:57.288159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe439c25-0c4e-4e43-a030-d8854adfbd97 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:57.291694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe439c25-0c4e-4e43-a030-d8854adfbd97 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:57.294910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe439c25-0c4e-4e43-a030-d8854adfbd97 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:57.296605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe439c25-0c4e-4e43-a030-d8854adfbd97 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:57.298654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe439c25-0c4e-4e43-a030-d8854adfbd97 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:57.332564 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-fe439c25-0c4e-4e43-a030-d8854adfbd97 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] HTTP exception thrown: Instance 041b58e4-953e-4b1f-b52d-246d904017f5 could not be found. Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fe439c25-0c4e-4e43-a030-d8854adfbd97 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Request method failure captured: Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 HTTP/1.1 Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeabUqz08ExQ1779qG-O32erZJHQ39EnundSJPpzxHqFzEKHUrb2QX4luHDgWKbgR4lkFIBKquv8Su_tg6EmobqPCxY57pkjiTENK9ouQvk2VUBoVVBX0w27zhcj7HbygAd2VJQWdEF6uOHcm0JlrCe44Xr-_Gf3Y4kWw1Kx1JACLYk Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ddb59ad8531d447082e1f77207b3c656"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ddb59ad8531d447082e1f77207b3c656 Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-88544734 Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 5b997c71bc4b443bb6441ba1eeabab2d Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-88544734-project Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 041b58e4-953e-4b1f-b52d-246d904017f5 could not be found. Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '041b58e4-953e-4b1f-b52d-246d904017f5'} Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 041b58e4-953e-4b1f-b52d-246d904017f5 could not be found. Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 041b58e4-953e-4b1f-b52d-246d904017f5 could not be found. Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:57.334491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:57:57.342721 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:57.342721 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:57:57.342721 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:57:57.342721 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:57:57.342721 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:57:57.342721 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:57:57.342721 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 041b58e4-953e-4b1f-b52d-246d904017f5 could not be found. Sep 08 12:57:57.342721 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 12:57:57.342721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fe439c25-0c4e-4e43-a030-d8854adfbd97 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] Returning 404 to user: Instance 041b58e4-953e-4b1f-b52d-246d904017f5 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:57:57.342721 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fe439c25-0c4e-4e43-a030-d8854adfbd97 tempest-ServerMetadataNegativeTestJSON-88544734 tempest-ServerMetadataNegativeTestJSON-88544734-project] 10.222.0.78 "GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5" status: 404 len: 111 microversion: 2.1 time: 0.084667 Sep 08 12:57:57.344654 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1591/3319] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:57 2022] GET /compute/v2.1/servers/041b58e4-953e-4b1f-b52d-246d904017f5 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:57:57.350383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c8e77a97-0026-4290-9811-f9666999fd0a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:57.350562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c8e77a97-0026-4290-9811-f9666999fd0a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:57.357389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8e77a97-0026-4290-9811-f9666999fd0a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:57.357969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8e77a97-0026-4290-9811-f9666999fd0a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:57.358817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8e77a97-0026-4290-9811-f9666999fd0a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:57.360095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8e77a97-0026-4290-9811-f9666999fd0a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:57.360840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8e77a97-0026-4290-9811-f9666999fd0a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:57.361376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c8e77a97-0026-4290-9811-f9666999fd0a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:57.597438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c78f57c1-d05d-4fe4-9ecf-36f09ba8d7d3 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:57.644139 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c78f57c1-d05d-4fe4-9ecf-36f09ba8d7d3 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 200 len: 1577 microversion: 2.1 time: 0.893486 Sep 08 12:57:57.645897 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1729/3320] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:56 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 1577 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:57.652296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-260028a3-e760-44f2-8758-46a647a88780 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:57.653087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-260028a3-e760-44f2-8758-46a647a88780 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:57.665508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-260028a3-e760-44f2-8758-46a647a88780 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:57.666472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-260028a3-e760-44f2-8758-46a647a88780 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:57.667369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-260028a3-e760-44f2-8758-46a647a88780 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:57.668620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-260028a3-e760-44f2-8758-46a647a88780 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:57.669347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-260028a3-e760-44f2-8758-46a647a88780 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:57.670038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-260028a3-e760-44f2-8758-46a647a88780 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:57.689348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:57:58.268861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c8e77a97-0026-4290-9811-f9666999fd0a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:58.288181 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c8e77a97-0026-4290-9811-f9666999fd0a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1320 microversion: 2.1 time: 0.941743 Sep 08 12:57:58.309327 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1592/3321] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:57 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1320 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:58.336812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-af8902b5-af50-44f8-a14a-45dfe46b19b3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:58.338866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-af8902b5-af50-44f8-a14a-45dfe46b19b3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:58.366285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af8902b5-af50-44f8-a14a-45dfe46b19b3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:58.371938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af8902b5-af50-44f8-a14a-45dfe46b19b3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:58.373292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af8902b5-af50-44f8-a14a-45dfe46b19b3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:58.377119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af8902b5-af50-44f8-a14a-45dfe46b19b3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:58.390260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af8902b5-af50-44f8-a14a-45dfe46b19b3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:58.391814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af8902b5-af50-44f8-a14a-45dfe46b19b3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:59.063180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-260028a3-e760-44f2-8758-46a647a88780 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:59.080222 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-260028a3-e760-44f2-8758-46a647a88780 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1492 microversion: 2.1 time: 1.432158 Sep 08 12:57:59.081399 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1730/3322] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:57 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1492 bytes in 1435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:59.090548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f1f1d436-5c35-49ce-a3fc-16f8c3a79ccb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:59.092564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f1f1d436-5c35-49ce-a3fc-16f8c3a79ccb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:59.104746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1f1d436-5c35-49ce-a3fc-16f8c3a79ccb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:59.106455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1f1d436-5c35-49ce-a3fc-16f8c3a79ccb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:59.107207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1f1d436-5c35-49ce-a3fc-16f8c3a79ccb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:59.110767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1f1d436-5c35-49ce-a3fc-16f8c3a79ccb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:59.111729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1f1d436-5c35-49ce-a3fc-16f8c3a79ccb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:59.112514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1f1d436-5c35-49ce-a3fc-16f8c3a79ccb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:59.604457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-af8902b5-af50-44f8-a14a-45dfe46b19b3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:59.637389 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-af8902b5-af50-44f8-a14a-45dfe46b19b3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1680 microversion: 2.1 time: 1.326242 Sep 08 12:57:59.639579 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1593/3323] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:58 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1680 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:57:59.663629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-855b15fd-f566-4a0d-8fed-672d3c98be57 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:57:59.668157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-855b15fd-f566-4a0d-8fed-672d3c98be57 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:57:59.711198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-855b15fd-f566-4a0d-8fed-672d3c98be57 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:59.719652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-855b15fd-f566-4a0d-8fed-672d3c98be57 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:59.721203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-855b15fd-f566-4a0d-8fed-672d3c98be57 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:59.723174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-855b15fd-f566-4a0d-8fed-672d3c98be57 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:57:59.725385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-855b15fd-f566-4a0d-8fed-672d3c98be57 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:57:59.726540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-855b15fd-f566-4a0d-8fed-672d3c98be57 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:57:59.760254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f1f1d436-5c35-49ce-a3fc-16f8c3a79ccb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:59.775375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f1f1d436-5c35-49ce-a3fc-16f8c3a79ccb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:59.780041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f1f1d436-5c35-49ce-a3fc-16f8c3a79ccb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:57:59.784082 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f1f1d436-5c35-49ce-a3fc-16f8c3a79ccb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.700492 Sep 08 12:57:59.784977 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1731/3324] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:57:59 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:00.123092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5661b26c-1ef2-454c-8873-debdcf2719b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:00.124218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5661b26c-1ef2-454c-8873-debdcf2719b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:00.139261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5661b26c-1ef2-454c-8873-debdcf2719b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:00.142286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5661b26c-1ef2-454c-8873-debdcf2719b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:00.143772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5661b26c-1ef2-454c-8873-debdcf2719b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:00.145827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5661b26c-1ef2-454c-8873-debdcf2719b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:00.147109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5661b26c-1ef2-454c-8873-debdcf2719b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:00.152942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5661b26c-1ef2-454c-8873-debdcf2719b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:00.446644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-855b15fd-f566-4a0d-8fed-672d3c98be57 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:00.462585 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-855b15fd-f566-4a0d-8fed-672d3c98be57 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1320 microversion: 2.1 time: 0.818516 Sep 08 12:58:00.465145 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1594/3325] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:57:59 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1320 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:00.753026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-58676c7d-ea2a-4345-ada5-02c7c1d32300 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:00.754834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-58676c7d-ea2a-4345-ada5-02c7c1d32300 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:00.778790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58676c7d-ea2a-4345-ada5-02c7c1d32300 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:00.779607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58676c7d-ea2a-4345-ada5-02c7c1d32300 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:00.780745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58676c7d-ea2a-4345-ada5-02c7c1d32300 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:00.783069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58676c7d-ea2a-4345-ada5-02c7c1d32300 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:00.784065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58676c7d-ea2a-4345-ada5-02c7c1d32300 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:00.785158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58676c7d-ea2a-4345-ada5-02c7c1d32300 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:00.883258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5661b26c-1ef2-454c-8873-debdcf2719b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:00.904322 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5661b26c-1ef2-454c-8873-debdcf2719b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 200 len: 1492 microversion: 2.1 time: 0.782507 Sep 08 12:58:00.907606 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1732/3326] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:00 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 1492 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:58:00.917099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5008040b-2e52-404c-b304-59ba5b07b273 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:00.918614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5008040b-2e52-404c-b304-59ba5b07b273 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:00.934662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5008040b-2e52-404c-b304-59ba5b07b273 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:00.936059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5008040b-2e52-404c-b304-59ba5b07b273 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:00.938064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5008040b-2e52-404c-b304-59ba5b07b273 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:00.941923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5008040b-2e52-404c-b304-59ba5b07b273 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:00.944959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5008040b-2e52-404c-b304-59ba5b07b273 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:00.947943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5008040b-2e52-404c-b304-59ba5b07b273 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:01.584122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-58676c7d-ea2a-4345-ada5-02c7c1d32300 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:01.614526 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-58676c7d-ea2a-4345-ada5-02c7c1d32300 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1657 microversion: 2.1 time: 0.874870 Sep 08 12:58:01.618825 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1595/3327] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:00 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1657 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:58:01.637847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-fc5eb4ff-a4f8-4c3c-bdf7-ef469e60ffe9 req-cd4d0ab4-0e43-4ad6-af83-67451e412019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b876ea7-4998-44bb-818e-0a43fa411bb9", "name": "network-vif-deleted", "tag": "64ee14bc-76ce-49fc-a895-3b1655046453"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:01.665373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:01.670679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fc5eb4ff-a4f8-4c3c-bdf7-ef469e60ffe9 req-cd4d0ab4-0e43-4ad6-af83-67451e412019 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:01.672691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fc5eb4ff-a4f8-4c3c-bdf7-ef469e60ffe9 req-cd4d0ab4-0e43-4ad6-af83-67451e412019 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:01.673909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fc5eb4ff-a4f8-4c3c-bdf7-ef469e60ffe9 req-cd4d0ab4-0e43-4ad6-af83-67451e412019 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:01.754272 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-fc5eb4ff-a4f8-4c3c-bdf7-ef469e60ffe9 req-cd4d0ab4-0e43-4ad6-af83-67451e412019 service nova] Creating event network-vif-deleted:64ee14bc-76ce-49fc-a895-3b1655046453 for instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 on n-h2-852084-10 Sep 08 12:58:01.776027 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-fc5eb4ff-a4f8-4c3c-bdf7-ef469e60ffe9 req-cd4d0ab4-0e43-4ad6-af83-67451e412019 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152452 Sep 08 12:58:01.781387 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1596/3328] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:01.812968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8496c504-733f-4d93-9cf9-99cbb2b867fd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:01.814576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8496c504-733f-4d93-9cf9-99cbb2b867fd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:01.827705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5008040b-2e52-404c-b304-59ba5b07b273 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:01.833339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8496c504-733f-4d93-9cf9-99cbb2b867fd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:01.834852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8496c504-733f-4d93-9cf9-99cbb2b867fd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:01.837566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8496c504-733f-4d93-9cf9-99cbb2b867fd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:01.840298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8496c504-733f-4d93-9cf9-99cbb2b867fd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:01.842083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8496c504-733f-4d93-9cf9-99cbb2b867fd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:01.843906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8496c504-733f-4d93-9cf9-99cbb2b867fd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:01.849464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5008040b-2e52-404c-b304-59ba5b07b273 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:01.853422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5008040b-2e52-404c-b304-59ba5b07b273 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:01.858304 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5008040b-2e52-404c-b304-59ba5b07b273 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.949044 Sep 08 12:58:01.860577 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1733/3329] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:00 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:01.885196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0e80b78c-dd69-4014-be06-75eb34329bc3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:01.903522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e80b78c-dd69-4014-be06-75eb34329bc3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:01.904439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e80b78c-dd69-4014-be06-75eb34329bc3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:01.905291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e80b78c-dd69-4014-be06-75eb34329bc3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:01.967757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0e80b78c-dd69-4014-be06-75eb34329bc3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Going to try to start instance {{(pid=128970) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 12:58:02.132364 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0e80b78c-dd69-4014-be06-75eb34329bc3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.267255 Sep 08 12:58:02.136058 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1734/3330] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:58:01 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:58:02.173986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e021878-5f78-416c-8092-68ff5012c42f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:02.179597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8e021878-5f78-416c-8092-68ff5012c42f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:02.195997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e021878-5f78-416c-8092-68ff5012c42f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:02.197522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e021878-5f78-416c-8092-68ff5012c42f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:02.198616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e021878-5f78-416c-8092-68ff5012c42f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:02.200397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e021878-5f78-416c-8092-68ff5012c42f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:02.202785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e021878-5f78-416c-8092-68ff5012c42f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:02.205354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e021878-5f78-416c-8092-68ff5012c42f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:02.245560 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-8e021878-5f78-416c-8092-68ff5012c42f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e021878-5f78-416c-8092-68ff5012c42f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 HTTP/1.1 Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '4b876ea7-4998-44bb-818e-0a43fa411bb9'} Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:58:02.251471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:02.261754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:58:02.261754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:58:02.261754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:58:02.261754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:58:02.261754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:58:02.261754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 12:58:02.261754 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:02.266551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e021878-5f78-416c-8092-68ff5012c42f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:58:02.269034 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8e021878-5f78-416c-8092-68ff5012c42f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 404 len: 111 microversion: 2.1 time: 0.130786 Sep 08 12:58:02.271207 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1735/3331] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:02 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:58:02.302750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a363929f-6442-4006-ab25-b397a369d36f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:02.310137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a363929f-6442-4006-ab25-b397a369d36f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:02.340203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a363929f-6442-4006-ab25-b397a369d36f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:02.344021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a363929f-6442-4006-ab25-b397a369d36f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:02.344899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a363929f-6442-4006-ab25-b397a369d36f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:02.347350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a363929f-6442-4006-ab25-b397a369d36f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:02.348535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a363929f-6442-4006-ab25-b397a369d36f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:02.349902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a363929f-6442-4006-ab25-b397a369d36f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:02.685409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8496c504-733f-4d93-9cf9-99cbb2b867fd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:02.698296 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8496c504-733f-4d93-9cf9-99cbb2b867fd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1320 microversion: 2.1 time: 0.914844 Sep 08 12:58:02.705620 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1597/3332] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:01 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1320 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:02.711562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1835801605", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "dbd28b0c-6c95-45fa-bc88-dd4ecaae050a"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:02.819758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] validate_networks() for [('dbd28b0c-6c95-45fa-bc88-dd4ecaae050a', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:58:03.477940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a363929f-6442-4006-ab25-b397a369d36f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:03.509957 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a363929f-6442-4006-ab25-b397a369d36f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1666 microversion: 2.1 time: 1.235851 Sep 08 12:58:03.511747 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1736/3333] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:02 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1666 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:03.530927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-78915963-6a9f-4a45-b970-ec84e3edfe92 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:03.534433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-78915963-6a9f-4a45-b970-ec84e3edfe92 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:03.552656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78915963-6a9f-4a45-b970-ec84e3edfe92 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:03.554296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78915963-6a9f-4a45-b970-ec84e3edfe92 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:03.555668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78915963-6a9f-4a45-b970-ec84e3edfe92 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:03.559678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78915963-6a9f-4a45-b970-ec84e3edfe92 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:03.563418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78915963-6a9f-4a45-b970-ec84e3edfe92 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:03.564752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78915963-6a9f-4a45-b970-ec84e3edfe92 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:04.001988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=14 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:04.241373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-78915963-6a9f-4a45-b970-ec84e3edfe92 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:04.272828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-78915963-6a9f-4a45-b970-ec84e3edfe92 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:04.275167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-78915963-6a9f-4a45-b970-ec84e3edfe92 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:04.279462 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-78915963-6a9f-4a45-b970-ec84e3edfe92 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.765214 Sep 08 12:58:04.280546 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1737/3334] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:03 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:04.295833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d6e0da9a-2762-4fa7-ae91-1ccd07f1969a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:04.297253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d6e0da9a-2762-4fa7-ae91-1ccd07f1969a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:04.315014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6e0da9a-2762-4fa7-ae91-1ccd07f1969a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:04.315378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6e0da9a-2762-4fa7-ae91-1ccd07f1969a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:04.317978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6e0da9a-2762-4fa7-ae91-1ccd07f1969a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:04.319082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6e0da9a-2762-4fa7-ae91-1ccd07f1969a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:04.321252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6e0da9a-2762-4fa7-ae91-1ccd07f1969a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:04.327399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6e0da9a-2762-4fa7-ae91-1ccd07f1969a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:04.870331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:58:04.870758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:58:04.871275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:58:04.871831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:58:04.872347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:58:04.900625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:04.901548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:04.902098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:04.903193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:04.904572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:04.905163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:04.938333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:58:04.939858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d6e0da9a-2762-4fa7-ae91-1ccd07f1969a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:04.947154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for user d9a995d2889c47738ad0b5255445c5f0 and project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:58:04.951414 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d6e0da9a-2762-4fa7-ae91-1ccd07f1969a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1320 microversion: 2.1 time: 0.666868 Sep 08 12:58:04.963566 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1738/3335] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:04 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1320 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:04.972246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c4395237-2da1-4b81-8100-315c72232f45 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:04.972246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c4395237-2da1-4b81-8100-315c72232f45 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:04.972561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:58:04.977702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:58:04.981824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4395237-2da1-4b81-8100-315c72232f45 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:04.982334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4395237-2da1-4b81-8100-315c72232f45 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:04.982778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4395237-2da1-4b81-8100-315c72232f45 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:04.984289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4395237-2da1-4b81-8100-315c72232f45 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:04.984789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4395237-2da1-4b81-8100-315c72232f45 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:04.985223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4395237-2da1-4b81-8100-315c72232f45 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:05.116587 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ab806517-4317-4e95-93b5-48dbf4502e54 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.409165 Sep 08 12:58:05.117502 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1598/3336] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 2411 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:58:05.134099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e49fda33-e61a-47d0-84c5-7ba37758806c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:05.135592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e49fda33-e61a-47d0-84c5-7ba37758806c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:05.321742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e49fda33-e61a-47d0-84c5-7ba37758806c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:05.349515 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e49fda33-e61a-47d0-84c5-7ba37758806c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1215 microversion: 2.1 time: 0.215660 Sep 08 12:58:05.368397 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1599/3337] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:05 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1215 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:05.387781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bca569c7-fc1f-46f2-a38f-0c7e372da149 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:05.388940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bca569c7-fc1f-46f2-a38f-0c7e372da149 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:05.421387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bca569c7-fc1f-46f2-a38f-0c7e372da149 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:05.422957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bca569c7-fc1f-46f2-a38f-0c7e372da149 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:05.424880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bca569c7-fc1f-46f2-a38f-0c7e372da149 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:05.425617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bca569c7-fc1f-46f2-a38f-0c7e372da149 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:05.429615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bca569c7-fc1f-46f2-a38f-0c7e372da149 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:05.430413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bca569c7-fc1f-46f2-a38f-0c7e372da149 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:05.655942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c4395237-2da1-4b81-8100-315c72232f45 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:05.672978 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c4395237-2da1-4b81-8100-315c72232f45 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1666 microversion: 2.1 time: 0.709880 Sep 08 12:58:05.674266 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1739/3338] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:04 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1666 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:05.920703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-1649a83e-3f36-4898-9c43-7df7d95a6a9e req-ba4e9768-5e8c-49ed-a2e3-1104b7e1e153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf026f9-c479-4ace-bc9a-232c26f2e862", "name": "network-vif-plugged", "status": "completed", "tag": "93fb265a-f5fb-45e0-a146-65ebecfe3f57"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:05.999496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1649a83e-3f36-4898-9c43-7df7d95a6a9e req-ba4e9768-5e8c-49ed-a2e3-1104b7e1e153 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:06.007624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1649a83e-3f36-4898-9c43-7df7d95a6a9e req-ba4e9768-5e8c-49ed-a2e3-1104b7e1e153 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:06.008548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1649a83e-3f36-4898-9c43-7df7d95a6a9e req-ba4e9768-5e8c-49ed-a2e3-1104b7e1e153 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:06.057868 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1649a83e-3f36-4898-9c43-7df7d95a6a9e req-ba4e9768-5e8c-49ed-a2e3-1104b7e1e153 service nova] Creating event network-vif-plugged:93fb265a-f5fb-45e0-a146-65ebecfe3f57 for instance cdf026f9-c479-4ace-bc9a-232c26f2e862 on n-h2-852084-10 Sep 08 12:58:06.067793 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-1649a83e-3f36-4898-9c43-7df7d95a6a9e req-ba4e9768-5e8c-49ed-a2e3-1104b7e1e153 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158108 Sep 08 12:58:06.069779 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1740/3339] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:06.086765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1a90fdb0-e094-4830-af46-9cb84c91c436 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:06.089275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1a90fdb0-e094-4830-af46-9cb84c91c436 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:06.104221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a90fdb0-e094-4830-af46-9cb84c91c436 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:06.106223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a90fdb0-e094-4830-af46-9cb84c91c436 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:06.111684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a90fdb0-e094-4830-af46-9cb84c91c436 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:06.115850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a90fdb0-e094-4830-af46-9cb84c91c436 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:06.116709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a90fdb0-e094-4830-af46-9cb84c91c436 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:06.121076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a90fdb0-e094-4830-af46-9cb84c91c436 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:06.635712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bca569c7-fc1f-46f2-a38f-0c7e372da149 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:06.699733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bca569c7-fc1f-46f2-a38f-0c7e372da149 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:06.708415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bca569c7-fc1f-46f2-a38f-0c7e372da149 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:06.710823 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bca569c7-fc1f-46f2-a38f-0c7e372da149 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.340415 Sep 08 12:58:06.721128 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1600/3340] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:05 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:06.727446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-af0adb83-c3a6-41ec-9a87-9cb207db1f65 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:06.730324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-af0adb83-c3a6-41ec-9a87-9cb207db1f65 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:06.746657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a90fdb0-e094-4830-af46-9cb84c91c436 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:06.760008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af0adb83-c3a6-41ec-9a87-9cb207db1f65 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:06.760579 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1a90fdb0-e094-4830-af46-9cb84c91c436 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1320 microversion: 2.1 time: 0.688556 Sep 08 12:58:06.763102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af0adb83-c3a6-41ec-9a87-9cb207db1f65 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:06.766515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af0adb83-c3a6-41ec-9a87-9cb207db1f65 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:06.767549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af0adb83-c3a6-41ec-9a87-9cb207db1f65 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:06.769261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af0adb83-c3a6-41ec-9a87-9cb207db1f65 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:06.772642 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1741/3341] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:06 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1320 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:06.782954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af0adb83-c3a6-41ec-9a87-9cb207db1f65 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:06.800422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dcff8b8d-f538-42a5-b1c6-ab2e49559040 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:06.805718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dcff8b8d-f538-42a5-b1c6-ab2e49559040 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:06.836240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcff8b8d-f538-42a5-b1c6-ab2e49559040 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:06.836743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcff8b8d-f538-42a5-b1c6-ab2e49559040 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:06.837305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcff8b8d-f538-42a5-b1c6-ab2e49559040 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:06.838030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcff8b8d-f538-42a5-b1c6-ab2e49559040 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:06.838614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcff8b8d-f538-42a5-b1c6-ab2e49559040 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:06.839046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcff8b8d-f538-42a5-b1c6-ab2e49559040 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:06.898949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-af0adb83-c3a6-41ec-9a87-9cb207db1f65 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:06.912876 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-af0adb83-c3a6-41ec-9a87-9cb207db1f65 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1267 microversion: 2.1 time: 0.189896 Sep 08 12:58:06.916471 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1601/3342] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:06 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1267 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:07.133886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dcff8b8d-f538-42a5-b1c6-ab2e49559040 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:07.154522 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dcff8b8d-f538-42a5-b1c6-ab2e49559040 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.377225 Sep 08 12:58:07.175879 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1742/3343] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:06 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:07.205606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c2ae6751-6f21-4b03-b4cd-fe669e7d8103 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:07.206868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c2ae6751-6f21-4b03-b4cd-fe669e7d8103 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:07.229216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2ae6751-6f21-4b03-b4cd-fe669e7d8103 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:07.230807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2ae6751-6f21-4b03-b4cd-fe669e7d8103 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:07.231552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2ae6751-6f21-4b03-b4cd-fe669e7d8103 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:07.232561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2ae6751-6f21-4b03-b4cd-fe669e7d8103 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:07.233323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2ae6751-6f21-4b03-b4cd-fe669e7d8103 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:07.233957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2ae6751-6f21-4b03-b4cd-fe669e7d8103 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:07.758718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ad511119-dde3-4f7e-985a-f8965b5f3b5a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:07.759979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ad511119-dde3-4f7e-985a-f8965b5f3b5a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:07.773572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad511119-dde3-4f7e-985a-f8965b5f3b5a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:07.774432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad511119-dde3-4f7e-985a-f8965b5f3b5a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:07.779610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad511119-dde3-4f7e-985a-f8965b5f3b5a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:07.780846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad511119-dde3-4f7e-985a-f8965b5f3b5a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:07.781659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad511119-dde3-4f7e-985a-f8965b5f3b5a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:07.782375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad511119-dde3-4f7e-985a-f8965b5f3b5a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:08.278987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c2ae6751-6f21-4b03-b4cd-fe669e7d8103 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:08.289475 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c2ae6751-6f21-4b03-b4cd-fe669e7d8103 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.093868 Sep 08 12:58:08.290765 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1602/3344] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:07 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:08.298311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4847ffa-b724-4681-ba78-ccb93985470c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:08.299771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b4847ffa-b724-4681-ba78-ccb93985470c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:08.308659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4847ffa-b724-4681-ba78-ccb93985470c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:08.309744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4847ffa-b724-4681-ba78-ccb93985470c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:08.310393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4847ffa-b724-4681-ba78-ccb93985470c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:08.311416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4847ffa-b724-4681-ba78-ccb93985470c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:08.312083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4847ffa-b724-4681-ba78-ccb93985470c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:08.313466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4847ffa-b724-4681-ba78-ccb93985470c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:09.386361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ad511119-dde3-4f7e-985a-f8965b5f3b5a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:09.398004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ad511119-dde3-4f7e-985a-f8965b5f3b5a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:09.400217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ad511119-dde3-4f7e-985a-f8965b5f3b5a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:09.401932 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ad511119-dde3-4f7e-985a-f8965b5f3b5a tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.647507 Sep 08 12:58:09.426585 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1743/3345] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:07 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 12:58:09.436660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c7463620-1117-429c-a20d-ee8f91a29712 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:09.439342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c7463620-1117-429c-a20d-ee8f91a29712 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:09.445930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b4847ffa-b724-4681-ba78-ccb93985470c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:09.447496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7463620-1117-429c-a20d-ee8f91a29712 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:09.448221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7463620-1117-429c-a20d-ee8f91a29712 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:09.448849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7463620-1117-429c-a20d-ee8f91a29712 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:09.449753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7463620-1117-429c-a20d-ee8f91a29712 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:09.450444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7463620-1117-429c-a20d-ee8f91a29712 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:09.451038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7463620-1117-429c-a20d-ee8f91a29712 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:09.474381 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b4847ffa-b724-4681-ba78-ccb93985470c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1501 microversion: 2.1 time: 1.181801 Sep 08 12:58:09.475625 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1603/3346] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:08 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1501 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:09.485414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cb5c42c3-e753-43f7-a7a1-9aafff5800fe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:09.496937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cb5c42c3-e753-43f7-a7a1-9aafff5800fe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:09.521924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5c42c3-e753-43f7-a7a1-9aafff5800fe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:09.522822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5c42c3-e753-43f7-a7a1-9aafff5800fe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:09.523687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5c42c3-e753-43f7-a7a1-9aafff5800fe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:09.525506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5c42c3-e753-43f7-a7a1-9aafff5800fe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:09.526666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5c42c3-e753-43f7-a7a1-9aafff5800fe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:09.527908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb5c42c3-e753-43f7-a7a1-9aafff5800fe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:09.628376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cb5c42c3-e753-43f7-a7a1-9aafff5800fe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Unlocking {{(pid=128971) unlock /opt/stack/nova/nova/compute/api.py:4874}} Sep 08 12:58:09.642345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c7463620-1117-429c-a20d-ee8f91a29712 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:09.653186 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c7463620-1117-429c-a20d-ee8f91a29712 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1273 microversion: 2.1 time: 0.225261 Sep 08 12:58:09.658762 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1744/3347] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:09 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1273 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:09.676571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2a4634b3-c8c3-4ef8-888c-38d2997688a2 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:09.677365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2a4634b3-c8c3-4ef8-888c-38d2997688a2 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:09.693203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a4634b3-c8c3-4ef8-888c-38d2997688a2 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:09.693769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a4634b3-c8c3-4ef8-888c-38d2997688a2 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:09.694786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a4634b3-c8c3-4ef8-888c-38d2997688a2 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:09.695869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a4634b3-c8c3-4ef8-888c-38d2997688a2 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:09.699563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a4634b3-c8c3-4ef8-888c-38d2997688a2 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:09.700285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a4634b3-c8c3-4ef8-888c-38d2997688a2 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:09.761791 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cb5c42c3-e753-43f7-a7a1-9aafff5800fe tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.284374 Sep 08 12:58:09.762485 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1604/3348] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:58:09 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:58:09.775870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a3af6ce4-61f7-47f7-8a54-e4071298aa95 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:09.776514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a3af6ce4-61f7-47f7-8a54-e4071298aa95 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:09.801090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3af6ce4-61f7-47f7-8a54-e4071298aa95 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:09.801519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3af6ce4-61f7-47f7-8a54-e4071298aa95 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:09.801999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3af6ce4-61f7-47f7-8a54-e4071298aa95 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:09.802760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3af6ce4-61f7-47f7-8a54-e4071298aa95 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:09.803284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3af6ce4-61f7-47f7-8a54-e4071298aa95 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:09.803691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3af6ce4-61f7-47f7-8a54-e4071298aa95 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:10.548496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2a4634b3-c8c3-4ef8-888c-38d2997688a2 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:10.560242 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2a4634b3-c8c3-4ef8-888c-38d2997688a2 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1501 microversion: 2.1 time: 0.899840 Sep 08 12:58:10.561605 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1745/3349] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:09 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1501 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:10.582927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aa11c6bb-3658-43c0-9b23-abf19a7a2f8d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:10.583934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aa11c6bb-3658-43c0-9b23-abf19a7a2f8d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:10.595098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa11c6bb-3658-43c0-9b23-abf19a7a2f8d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:10.595936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa11c6bb-3658-43c0-9b23-abf19a7a2f8d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:10.596579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa11c6bb-3658-43c0-9b23-abf19a7a2f8d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:10.597790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa11c6bb-3658-43c0-9b23-abf19a7a2f8d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:10.598648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa11c6bb-3658-43c0-9b23-abf19a7a2f8d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:10.600040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa11c6bb-3658-43c0-9b23-abf19a7a2f8d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:10.928011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a3af6ce4-61f7-47f7-8a54-e4071298aa95 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:10.941019 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a3af6ce4-61f7-47f7-8a54-e4071298aa95 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.168988 Sep 08 12:58:10.955264 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1605/3350] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:09 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:10.955264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-524f879c-89e8-495a-93ea-71daad92a3a6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:10.955264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-524f879c-89e8-495a-93ea-71daad92a3a6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:10.967282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-524f879c-89e8-495a-93ea-71daad92a3a6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:10.967282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-524f879c-89e8-495a-93ea-71daad92a3a6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:10.967766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-524f879c-89e8-495a-93ea-71daad92a3a6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:10.968959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-524f879c-89e8-495a-93ea-71daad92a3a6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:10.970038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-524f879c-89e8-495a-93ea-71daad92a3a6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:10.971070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-524f879c-89e8-495a-93ea-71daad92a3a6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:10.985011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:11.014007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-524f879c-89e8-495a-93ea-71daad92a3a6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:58:11.134317 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-524f879c-89e8-495a-93ea-71daad92a3a6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 204 len: 0 microversion: 2.1 time: 0.189859 Sep 08 12:58:11.135453 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1606/3351] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:58:10 2022] DELETE /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:58:11.143740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f618aa04-fc14-47eb-802d-419c1abcefb7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:11.145916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f618aa04-fc14-47eb-802d-419c1abcefb7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:11.154220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f618aa04-fc14-47eb-802d-419c1abcefb7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:11.155255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f618aa04-fc14-47eb-802d-419c1abcefb7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:11.156512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f618aa04-fc14-47eb-802d-419c1abcefb7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:11.157711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f618aa04-fc14-47eb-802d-419c1abcefb7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:11.158478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f618aa04-fc14-47eb-802d-419c1abcefb7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:11.159537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f618aa04-fc14-47eb-802d-419c1abcefb7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:11.718480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f618aa04-fc14-47eb-802d-419c1abcefb7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:11.722190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aa11c6bb-3658-43c0-9b23-abf19a7a2f8d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:11.743074 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f618aa04-fc14-47eb-802d-419c1abcefb7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1273 microversion: 2.1 time: 0.605444 Sep 08 12:58:11.760158 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1607/3352] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:11 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1273 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:11.760158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e82e3c46-9cbf-4cd1-a441-f702deacd514 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:11.760158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e82e3c46-9cbf-4cd1-a441-f702deacd514 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:11.766235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aa11c6bb-3658-43c0-9b23-abf19a7a2f8d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:11.776248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aa11c6bb-3658-43c0-9b23-abf19a7a2f8d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:11.776630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e82e3c46-9cbf-4cd1-a441-f702deacd514 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:11.785613 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aa11c6bb-3658-43c0-9b23-abf19a7a2f8d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.221262 Sep 08 12:58:11.791046 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1746/3353] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:10 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:11.794637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e82e3c46-9cbf-4cd1-a441-f702deacd514 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:11.818497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e82e3c46-9cbf-4cd1-a441-f702deacd514 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:11.818497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e82e3c46-9cbf-4cd1-a441-f702deacd514 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:11.818497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e82e3c46-9cbf-4cd1-a441-f702deacd514 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:11.818497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e82e3c46-9cbf-4cd1-a441-f702deacd514 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:11.829035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00d0bb1f-72f2-46c4-85ca-f82f253aec54 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:11.831846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00d0bb1f-72f2-46c4-85ca-f82f253aec54 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:11.846008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00d0bb1f-72f2-46c4-85ca-f82f253aec54 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:11.848133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00d0bb1f-72f2-46c4-85ca-f82f253aec54 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:11.849275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00d0bb1f-72f2-46c4-85ca-f82f253aec54 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:11.851191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00d0bb1f-72f2-46c4-85ca-f82f253aec54 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:11.852348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00d0bb1f-72f2-46c4-85ca-f82f253aec54 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:11.853320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00d0bb1f-72f2-46c4-85ca-f82f253aec54 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:11.909914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:13.060577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00d0bb1f-72f2-46c4-85ca-f82f253aec54 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:13.073228 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00d0bb1f-72f2-46c4-85ca-f82f253aec54 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1507 microversion: 2.1 time: 1.279783 Sep 08 12:58:13.074226 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1747/3354] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:11 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1507 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:13.084733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2ca9acbe-0465-451e-9554-8657c477d6c5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:13.085945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2ca9acbe-0465-451e-9554-8657c477d6c5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:13.102864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e82e3c46-9cbf-4cd1-a441-f702deacd514 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:13.110944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ca9acbe-0465-451e-9554-8657c477d6c5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:13.113141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ca9acbe-0465-451e-9554-8657c477d6c5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:13.113725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ca9acbe-0465-451e-9554-8657c477d6c5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:13.115087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ca9acbe-0465-451e-9554-8657c477d6c5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:13.118499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ca9acbe-0465-451e-9554-8657c477d6c5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:13.120114 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e82e3c46-9cbf-4cd1-a441-f702deacd514 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.371414 Sep 08 12:58:13.121929 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1608/3355] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:11 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:13.127492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ca9acbe-0465-451e-9554-8657c477d6c5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:13.141234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a7905506-4ce6-4bd7-bb38-52c0458be109 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:13.143391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a7905506-4ce6-4bd7-bb38-52c0458be109 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:13.156724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7905506-4ce6-4bd7-bb38-52c0458be109 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:13.157621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7905506-4ce6-4bd7-bb38-52c0458be109 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:13.163897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7905506-4ce6-4bd7-bb38-52c0458be109 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:13.167080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7905506-4ce6-4bd7-bb38-52c0458be109 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:13.169648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7905506-4ce6-4bd7-bb38-52c0458be109 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:13.170779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7905506-4ce6-4bd7-bb38-52c0458be109 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:13.999409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2ca9acbe-0465-451e-9554-8657c477d6c5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:14.011842 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2ca9acbe-0465-451e-9554-8657c477d6c5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1315 microversion: 2.1 time: 0.933801 Sep 08 12:58:14.013245 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1748/3356] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:13 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:14.019776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5aec6ee4-8cfc-4797-afad-4d5b1c168250 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:14.022371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5aec6ee4-8cfc-4797-afad-4d5b1c168250 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:14.033627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5aec6ee4-8cfc-4797-afad-4d5b1c168250 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:14.034420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5aec6ee4-8cfc-4797-afad-4d5b1c168250 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:14.035095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5aec6ee4-8cfc-4797-afad-4d5b1c168250 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:14.036145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5aec6ee4-8cfc-4797-afad-4d5b1c168250 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:14.036904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5aec6ee4-8cfc-4797-afad-4d5b1c168250 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:14.037741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5aec6ee4-8cfc-4797-afad-4d5b1c168250 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:14.136618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a7905506-4ce6-4bd7-bb38-52c0458be109 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:14.148208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a7905506-4ce6-4bd7-bb38-52c0458be109 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:14.150609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a7905506-4ce6-4bd7-bb38-52c0458be109 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:14.152230 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a7905506-4ce6-4bd7-bb38-52c0458be109 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.028317 Sep 08 12:58:14.153502 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1609/3357] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:13 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:14.161990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e53b2696-1d9c-46ed-b6b3-e15986821ed0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:14.162616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e53b2696-1d9c-46ed-b6b3-e15986821ed0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:14.178532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e53b2696-1d9c-46ed-b6b3-e15986821ed0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:14.179154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e53b2696-1d9c-46ed-b6b3-e15986821ed0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:14.181976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e53b2696-1d9c-46ed-b6b3-e15986821ed0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:14.184070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e53b2696-1d9c-46ed-b6b3-e15986821ed0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:14.185154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e53b2696-1d9c-46ed-b6b3-e15986821ed0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:14.185591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e53b2696-1d9c-46ed-b6b3-e15986821ed0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:14.719843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5aec6ee4-8cfc-4797-afad-4d5b1c168250 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:14.748423 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5aec6ee4-8cfc-4797-afad-4d5b1c168250 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.732083 Sep 08 12:58:14.750482 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1749/3358] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:14 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:14.772825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-70fe2e98-d715-4237-9e71-5184c686f3b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:14.773288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-70fe2e98-d715-4237-9e71-5184c686f3b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:14.780167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70fe2e98-d715-4237-9e71-5184c686f3b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:14.781059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70fe2e98-d715-4237-9e71-5184c686f3b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:14.781506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70fe2e98-d715-4237-9e71-5184c686f3b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:14.782468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70fe2e98-d715-4237-9e71-5184c686f3b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:14.782934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70fe2e98-d715-4237-9e71-5184c686f3b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:14.783402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70fe2e98-d715-4237-9e71-5184c686f3b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:14.874532 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-70fe2e98-d715-4237-9e71-5184c686f3b0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.106054 Sep 08 12:58:14.879361 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1750/3359] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:58:14 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 12:58:14.886332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3856e0c1-c68e-4325-aaa4-379fb596a9bf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:14.887359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3856e0c1-c68e-4325-aaa4-379fb596a9bf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:14.898585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3856e0c1-c68e-4325-aaa4-379fb596a9bf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:14.899654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3856e0c1-c68e-4325-aaa4-379fb596a9bf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:14.900460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3856e0c1-c68e-4325-aaa4-379fb596a9bf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:14.901566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3856e0c1-c68e-4325-aaa4-379fb596a9bf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:14.902477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3856e0c1-c68e-4325-aaa4-379fb596a9bf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:14.903306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3856e0c1-c68e-4325-aaa4-379fb596a9bf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:14.922809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:15.009877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e53b2696-1d9c-46ed-b6b3-e15986821ed0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:15.020880 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e53b2696-1d9c-46ed-b6b3-e15986821ed0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1507 microversion: 2.1 time: 0.865912 Sep 08 12:58:15.021774 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1610/3360] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:14 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1507 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:15.069100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e88bea1a-2ffe-4959-bdf4-07cfed3de5da tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:15.070163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e88bea1a-2ffe-4959-bdf4-07cfed3de5da tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:15.094546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e88bea1a-2ffe-4959-bdf4-07cfed3de5da tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:15.096567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e88bea1a-2ffe-4959-bdf4-07cfed3de5da tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:15.097990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e88bea1a-2ffe-4959-bdf4-07cfed3de5da tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:15.099957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e88bea1a-2ffe-4959-bdf4-07cfed3de5da tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:15.102051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e88bea1a-2ffe-4959-bdf4-07cfed3de5da tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:15.103678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e88bea1a-2ffe-4959-bdf4-07cfed3de5da tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:15.344561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:15.982690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3856e0c1-c68e-4325-aaa4-379fb596a9bf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:15.996384 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3856e0c1-c68e-4325-aaa4-379fb596a9bf tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1675 microversion: 2.1 time: 1.115049 Sep 08 12:58:16.016303 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1751/3361] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:14 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1675 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:16.042454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a799abb9-6951-41d8-a02b-9f92bda19663 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:16.043749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a799abb9-6951-41d8-a02b-9f92bda19663 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:16.066304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a799abb9-6951-41d8-a02b-9f92bda19663 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:16.067462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a799abb9-6951-41d8-a02b-9f92bda19663 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:16.073210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a799abb9-6951-41d8-a02b-9f92bda19663 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:16.074837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a799abb9-6951-41d8-a02b-9f92bda19663 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:16.076052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a799abb9-6951-41d8-a02b-9f92bda19663 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:16.080027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a799abb9-6951-41d8-a02b-9f92bda19663 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:16.380038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e88bea1a-2ffe-4959-bdf4-07cfed3de5da tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:16.405884 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e88bea1a-2ffe-4959-bdf4-07cfed3de5da tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1315 microversion: 2.1 time: 1.357199 Sep 08 12:58:16.429384 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1611/3362] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:15 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1315 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:58:16.433953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0a9f20a1-4cfe-45f9-a24e-84dc8227b8df req-e921cd79-856f-4014-9e84-c181d6eed5f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdf026f9-c479-4ace-bc9a-232c26f2e862", "name": "network-vif-deleted", "tag": "93fb265a-f5fb-45e0-a146-65ebecfe3f57"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:16.459526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0a9f20a1-4cfe-45f9-a24e-84dc8227b8df req-e921cd79-856f-4014-9e84-c181d6eed5f6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:16.460595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0a9f20a1-4cfe-45f9-a24e-84dc8227b8df req-e921cd79-856f-4014-9e84-c181d6eed5f6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:16.461387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0a9f20a1-4cfe-45f9-a24e-84dc8227b8df req-e921cd79-856f-4014-9e84-c181d6eed5f6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:16.500105 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0a9f20a1-4cfe-45f9-a24e-84dc8227b8df req-e921cd79-856f-4014-9e84-c181d6eed5f6 service nova] Creating event network-vif-deleted:93fb265a-f5fb-45e0-a146-65ebecfe3f57 for instance cdf026f9-c479-4ace-bc9a-232c26f2e862 on n-h2-852084-10 Sep 08 12:58:16.520810 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0a9f20a1-4cfe-45f9-a24e-84dc8227b8df req-e921cd79-856f-4014-9e84-c181d6eed5f6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098744 Sep 08 12:58:16.524081 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1612/3363] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:16.549321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:16.550470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:16.565887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:16.566817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:16.567761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:16.569606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:16.570861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:16.571940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:16.651128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:16.652493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:16.653558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:16.655019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lazy-loading 'fault' on Instance uuid cdf026f9-c479-4ace-bc9a-232c26f2e862 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:58:16.819060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:16.833365 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-226f1aae-bb7e-47e4-9c0e-dec2c80008a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 200 len: 1310 microversion: 2.1 time: 0.306585 Sep 08 12:58:16.835195 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1613/3364] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:16 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 1310 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:17.038540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d6e4e01d-6e39-4681-a056-4ffaa60ed361 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:17.039551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d6e4e01d-6e39-4681-a056-4ffaa60ed361 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:17.046828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6e4e01d-6e39-4681-a056-4ffaa60ed361 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:17.047707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6e4e01d-6e39-4681-a056-4ffaa60ed361 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:17.048302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6e4e01d-6e39-4681-a056-4ffaa60ed361 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:17.049080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6e4e01d-6e39-4681-a056-4ffaa60ed361 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:17.050067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6e4e01d-6e39-4681-a056-4ffaa60ed361 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:17.050647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6e4e01d-6e39-4681-a056-4ffaa60ed361 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:17.140747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a799abb9-6951-41d8-a02b-9f92bda19663 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:17.157119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a799abb9-6951-41d8-a02b-9f92bda19663 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:17.161347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a799abb9-6951-41d8-a02b-9f92bda19663 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:17.164593 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a799abb9-6951-41d8-a02b-9f92bda19663 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.146666 Sep 08 12:58:17.165645 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1752/3365] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:16 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:17.459189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-63fc2a54-36b5-454a-9586-bb8409e560d4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:17.460422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-63fc2a54-36b5-454a-9586-bb8409e560d4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:17.476580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63fc2a54-36b5-454a-9586-bb8409e560d4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:17.478880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63fc2a54-36b5-454a-9586-bb8409e560d4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:17.480165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63fc2a54-36b5-454a-9586-bb8409e560d4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:17.481849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63fc2a54-36b5-454a-9586-bb8409e560d4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:17.483021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63fc2a54-36b5-454a-9586-bb8409e560d4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:17.484239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63fc2a54-36b5-454a-9586-bb8409e560d4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:17.907896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d6e4e01d-6e39-4681-a056-4ffaa60ed361 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:17.919347 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d6e4e01d-6e39-4681-a056-4ffaa60ed361 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1655 microversion: 2.1 time: 0.884849 Sep 08 12:58:17.920976 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1614/3366] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:17 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1655 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:58:18.136979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1c1bbcb2-da47-4b6d-8c28-c8807c63cf7b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Action: 'create', calling method: .version_select at 0x7fdb3ac01160>, body: {"keypair": {"name": "tempest-keypair-1427006036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLI05Glhwfvj6ttsAC/WMFizkeTSJUBqAFMmgArJDji+EQ+4inqTi9GXYiN6dBdc60rZpNkeuXCVnKMk7OpJUpd6FQpMjb3yUT/AooeBl8eQjbRqWaXDhQmTGp3sNuZ1Q=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:18.158462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-1c1bbcb2-da47-4b6d-8c28-c8807c63cf7b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Getting quotas for project 74106d62b334496789cc796af8d57108. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:58:18.167343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-1c1bbcb2-da47-4b6d-8c28-c8807c63cf7b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Getting quotas for user 2a4f6ebbc0454860bd27ce22250b92d2 and project 74106d62b334496789cc796af8d57108. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:58:18.175360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-63fc2a54-36b5-454a-9586-bb8409e560d4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:18.204333 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-63fc2a54-36b5-454a-9586-bb8409e560d4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1315 microversion: 2.1 time: 0.752651 Sep 08 12:58:18.212631 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1753/3367] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:17 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:58:18.226365 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1c1bbcb2-da47-4b6d-8c28-c8807c63cf7b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.303161 Sep 08 12:58:18.229182 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1615/3368] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:58:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:18.230696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e7fe0aa-6f42-4493-8a35-2847667f3646 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:18.232087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6e7fe0aa-6f42-4493-8a35-2847667f3646 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:18.238059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-be050b1e-9953-479b-9811-0ca8140e5b63 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:18.238866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-be050b1e-9953-479b-9811-0ca8140e5b63 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:18.240288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e7fe0aa-6f42-4493-8a35-2847667f3646 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:18.240796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e7fe0aa-6f42-4493-8a35-2847667f3646 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:18.241287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e7fe0aa-6f42-4493-8a35-2847667f3646 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:18.242010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e7fe0aa-6f42-4493-8a35-2847667f3646 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:18.242663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e7fe0aa-6f42-4493-8a35-2847667f3646 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:18.243288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e7fe0aa-6f42-4493-8a35-2847667f3646 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:18.250724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be050b1e-9953-479b-9811-0ca8140e5b63 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:18.251261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be050b1e-9953-479b-9811-0ca8140e5b63 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:18.251896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be050b1e-9953-479b-9811-0ca8140e5b63 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:18.253076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be050b1e-9953-479b-9811-0ca8140e5b63 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:18.253903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be050b1e-9953-479b-9811-0ca8140e5b63 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:18.254510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be050b1e-9953-479b-9811-0ca8140e5b63 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:18.264700 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6e7fe0aa-6f42-4493-8a35-2847667f3646 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e7fe0aa-6f42-4493-8a35-2847667f3646 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 HTTP/1.1 Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'cdf026f9-c479-4ace-bc9a-232c26f2e862'} Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:18.266501 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:58:18.272110 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:58:18.272110 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:58:18.272110 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:58:18.272110 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:58:18.272110 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 12:58:18.272110 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:18.273475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e7fe0aa-6f42-4493-8a35-2847667f3646 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:58:18.276036 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6e7fe0aa-6f42-4493-8a35-2847667f3646 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 404 len: 111 microversion: 2.1 time: 0.056035 Sep 08 12:58:18.290926 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1754/3369] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:18 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:58:18.294947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-55bc1268-5087-4e91-8932-51e56e65fde0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:18.295359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-55bc1268-5087-4e91-8932-51e56e65fde0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:18.322003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55bc1268-5087-4e91-8932-51e56e65fde0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:18.323839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55bc1268-5087-4e91-8932-51e56e65fde0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:18.324928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55bc1268-5087-4e91-8932-51e56e65fde0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:18.326339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55bc1268-5087-4e91-8932-51e56e65fde0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:18.328327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55bc1268-5087-4e91-8932-51e56e65fde0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:18.329344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55bc1268-5087-4e91-8932-51e56e65fde0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:18.402291 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-be050b1e-9953-479b-9811-0ca8140e5b63 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.171494 Sep 08 12:58:18.403801 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1616/3370] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:58:18 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:58:18.415020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c3a7a13a-6803-4aa9-a970-2b5be4badf28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'create', calling method: .version_select at 0x7fdb3afa31f0>, body: {"keypair": {"name": "tempest-key-781520443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECp9xJF56K66U51uA1Jrgu0VlblDoc1Z64XJ13g6WQuj9zZ7FCoqIOlgBYHNs/KWhp/iud3i1pBBp54UGEZoHQc79ke1/nx2vaqkmQ3jSQFGFdmhRmuxtYscFGfJriGLQ=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:18.461258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c3a7a13a-6803-4aa9-a970-2b5be4badf28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:58:18.471190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:18.480524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c3a7a13a-6803-4aa9-a970-2b5be4badf28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for user 227ef616a0764f5eaff5988f8a470f0c and project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:58:18.545810 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c3a7a13a-6803-4aa9-a970-2b5be4badf28 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.139795 Sep 08 12:58:18.548507 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1617/3371] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 12:58:18 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:18.564003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d1c7794a-312d-46a1-bd75-7683d3cc9152 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:18.565968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d1c7794a-312d-46a1-bd75-7683d3cc9152 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:18.580372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1c7794a-312d-46a1-bd75-7683d3cc9152 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:18.581268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1c7794a-312d-46a1-bd75-7683d3cc9152 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:18.582424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1c7794a-312d-46a1-bd75-7683d3cc9152 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:18.585161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1c7794a-312d-46a1-bd75-7683d3cc9152 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:18.586779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1c7794a-312d-46a1-bd75-7683d3cc9152 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:18.588409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1c7794a-312d-46a1-bd75-7683d3cc9152 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:19.036922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-55bc1268-5087-4e91-8932-51e56e65fde0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:19.059355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-55bc1268-5087-4e91-8932-51e56e65fde0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:19.062485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-55bc1268-5087-4e91-8932-51e56e65fde0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:19.068773 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-55bc1268-5087-4e91-8932-51e56e65fde0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.782546 Sep 08 12:58:19.070180 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1755/3372] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:18 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:19.094956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-43ede759-f1b5-49aa-977e-6702fe4bdf21 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '.version_select at 0x7fdb35c9e5e0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:19.120849 n-d-852084-10 devstack@n-api.service[128970]: WARNING oslo_db.sqlalchemy.utils [None req-43ede759-f1b5-49aa-977e-6702fe4bdf21 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Unique keys not in sort_keys. The sorting order may be unstable. Sep 08 12:58:19.142835 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-43ede759-f1b5-49aa-977e-6702fe4bdf21 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.060847 Sep 08 12:58:19.145347 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1756/3373] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:58:19 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:19.176848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-cb87c9d3-e245-45a4-af5b-fcc6faf69c4d req-1b10a96d-f9ce-4eb4-b373-85e0bad2e24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd61063e-36fc-477d-8522-b95318528acd", "tag": "1d545eb1-3599-4f99-9fcc-5cc1c14cd7d6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:19.199828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cb87c9d3-e245-45a4-af5b-fcc6faf69c4d req-1b10a96d-f9ce-4eb4-b373-85e0bad2e24f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:19.201885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cb87c9d3-e245-45a4-af5b-fcc6faf69c4d req-1b10a96d-f9ce-4eb4-b373-85e0bad2e24f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:19.203102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cb87c9d3-e245-45a4-af5b-fcc6faf69c4d req-1b10a96d-f9ce-4eb4-b373-85e0bad2e24f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:19.217533 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-cb87c9d3-e245-45a4-af5b-fcc6faf69c4d req-1b10a96d-f9ce-4eb4-b373-85e0bad2e24f service nova] Creating event network-changed:1d545eb1-3599-4f99-9fcc-5cc1c14cd7d6 for instance bd61063e-36fc-477d-8522-b95318528acd on n-h2-852084-10 Sep 08 12:58:19.226024 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-cb87c9d3-e245-45a4-af5b-fcc6faf69c4d req-1b10a96d-f9ce-4eb4-b373-85e0bad2e24f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078764 Sep 08 12:58:19.227349 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1757/3374] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:19.254961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-57aa6704-1649-41a5-926e-a44c82d2d78d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:19.257424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-57aa6704-1649-41a5-926e-a44c82d2d78d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:19.274207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57aa6704-1649-41a5-926e-a44c82d2d78d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:19.279944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57aa6704-1649-41a5-926e-a44c82d2d78d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:19.281439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57aa6704-1649-41a5-926e-a44c82d2d78d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:19.284179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57aa6704-1649-41a5-926e-a44c82d2d78d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:19.287031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57aa6704-1649-41a5-926e-a44c82d2d78d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:19.287902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57aa6704-1649-41a5-926e-a44c82d2d78d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:19.481174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d1c7794a-312d-46a1-bd75-7683d3cc9152 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:19.510141 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d1c7794a-312d-46a1-bd75-7683d3cc9152 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1662 microversion: 2.1 time: 0.958930 Sep 08 12:58:19.536920 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1618/3375] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:18 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1662 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:19.588679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1486228318", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "key_name": "tempest-key-781520443", "networks": [{"uuid": "e905a95c-2324-49bd-8a89-bae4286a1b74"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:19.749561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] validate_networks() for [('e905a95c-2324-49bd-8a89-bae4286a1b74', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:58:20.221962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-57aa6704-1649-41a5-926e-a44c82d2d78d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:20.269496 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-57aa6704-1649-41a5-926e-a44c82d2d78d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1315 microversion: 2.1 time: 1.027999 Sep 08 12:58:20.290667 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1758/3376] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:19 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1315 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:20.313513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c1c2a81b-410c-4b9a-b5df-a31361e20742 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:20.315188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c1c2a81b-410c-4b9a-b5df-a31361e20742 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:20.330547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1c2a81b-410c-4b9a-b5df-a31361e20742 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:20.331743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1c2a81b-410c-4b9a-b5df-a31361e20742 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:20.332911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1c2a81b-410c-4b9a-b5df-a31361e20742 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:20.335694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1c2a81b-410c-4b9a-b5df-a31361e20742 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:20.336824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1c2a81b-410c-4b9a-b5df-a31361e20742 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:20.337763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1c2a81b-410c-4b9a-b5df-a31361e20742 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:21.803057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c1c2a81b-410c-4b9a-b5df-a31361e20742 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:21.823904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c1c2a81b-410c-4b9a-b5df-a31361e20742 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:21.825679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c1c2a81b-410c-4b9a-b5df-a31361e20742 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:21.841773 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c1c2a81b-410c-4b9a-b5df-a31361e20742 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.538952 Sep 08 12:58:21.844172 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1759/3377] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:20 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:21.869957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2f8de869-9708-4d3c-b78c-942eec4975d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:21.871593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2f8de869-9708-4d3c-b78c-942eec4975d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:21.887139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f8de869-9708-4d3c-b78c-942eec4975d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:21.894326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f8de869-9708-4d3c-b78c-942eec4975d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:21.895564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f8de869-9708-4d3c-b78c-942eec4975d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:21.897318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f8de869-9708-4d3c-b78c-942eec4975d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:21.898201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f8de869-9708-4d3c-b78c-942eec4975d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:21.898992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f8de869-9708-4d3c-b78c-942eec4975d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:22.606177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:58:22.607123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:58:22.607991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:58:22.609006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:58:22.609964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:58:22.644489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:22.653711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:22.655007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:22.660568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:22.662353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:22.665508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:22.767586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:58:22.776767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2f8de869-9708-4d3c-b78c-942eec4975d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:22.796258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for user 227ef616a0764f5eaff5988f8a470f0c and project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:58:22.806098 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2f8de869-9708-4d3c-b78c-942eec4975d4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.957778 Sep 08 12:58:22.826271 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1760/3378] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:21 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:22.855739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8db3dd09-f14f-4d92-be73-71af092d2b37 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:22.867477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8db3dd09-f14f-4d92-be73-71af092d2b37 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:22.878605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:58:22.891986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=78 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:22.895453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:58:22.909052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8db3dd09-f14f-4d92-be73-71af092d2b37 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:22.913133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8db3dd09-f14f-4d92-be73-71af092d2b37 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:22.913583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8db3dd09-f14f-4d92-be73-71af092d2b37 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:22.918516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8db3dd09-f14f-4d92-be73-71af092d2b37 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:22.922417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8db3dd09-f14f-4d92-be73-71af092d2b37 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:22.923874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8db3dd09-f14f-4d92-be73-71af092d2b37 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:23.123499 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6fad8b37-2834-4d97-b0eb-6670f924a58c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.562257 Sep 08 12:58:23.140048 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1619/3379] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:58:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3602 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:58:23.162608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d3c89d8-4b22-4998-8cc6-88f01af91542 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:23.168266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d3c89d8-4b22-4998-8cc6-88f01af91542 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:23.193162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3c89d8-4b22-4998-8cc6-88f01af91542 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:23.195510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3c89d8-4b22-4998-8cc6-88f01af91542 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:23.196844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3c89d8-4b22-4998-8cc6-88f01af91542 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:23.198473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3c89d8-4b22-4998-8cc6-88f01af91542 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:23.201802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3c89d8-4b22-4998-8cc6-88f01af91542 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:23.204674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d3c89d8-4b22-4998-8cc6-88f01af91542 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:23.705032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8db3dd09-f14f-4d92-be73-71af092d2b37 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:23.741119 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8db3dd09-f14f-4d92-be73-71af092d2b37 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1315 microversion: 2.1 time: 0.902345 Sep 08 12:58:23.742460 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1761/3380] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:22 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1315 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:23.770033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-01d6c25f-cfda-4a85-a9fb-5a8202ebb382 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:23.771584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-01d6c25f-cfda-4a85-a9fb-5a8202ebb382 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:23.790416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01d6c25f-cfda-4a85-a9fb-5a8202ebb382 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:23.796959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01d6c25f-cfda-4a85-a9fb-5a8202ebb382 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:23.798072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01d6c25f-cfda-4a85-a9fb-5a8202ebb382 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:23.800275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01d6c25f-cfda-4a85-a9fb-5a8202ebb382 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:23.801271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01d6c25f-cfda-4a85-a9fb-5a8202ebb382 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:23.804800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01d6c25f-cfda-4a85-a9fb-5a8202ebb382 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:24.484562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8d3c89d8-4b22-4998-8cc6-88f01af91542 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:24.503933 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d3c89d8-4b22-4998-8cc6-88f01af91542 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.360087 Sep 08 12:58:24.509148 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1620/3381] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:23 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:24.520230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-09834b7e-7e94-415b-a47f-f4f72f3fda40 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:24.523685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-09834b7e-7e94-415b-a47f-f4f72f3fda40 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:24.547189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09834b7e-7e94-415b-a47f-f4f72f3fda40 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:24.548274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09834b7e-7e94-415b-a47f-f4f72f3fda40 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:24.552605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09834b7e-7e94-415b-a47f-f4f72f3fda40 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:24.553962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09834b7e-7e94-415b-a47f-f4f72f3fda40 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:24.556460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09834b7e-7e94-415b-a47f-f4f72f3fda40 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:24.567913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09834b7e-7e94-415b-a47f-f4f72f3fda40 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:24.766947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-01d6c25f-cfda-4a85-a9fb-5a8202ebb382 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:24.782185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-01d6c25f-cfda-4a85-a9fb-5a8202ebb382 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:24.791574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-01d6c25f-cfda-4a85-a9fb-5a8202ebb382 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:24.792809 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-01d6c25f-cfda-4a85-a9fb-5a8202ebb382 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.048377 Sep 08 12:58:24.797274 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1762/3382] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:23 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:24.805207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-09834b7e-7e94-415b-a47f-f4f72f3fda40 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:24.846239 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-09834b7e-7e94-415b-a47f-f4f72f3fda40 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1224 microversion: 2.1 time: 0.323052 Sep 08 12:58:24.865096 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1621/3383] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:24 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1224 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:24.892190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b2b5f2ff-bd71-4e9f-89a6-fc169ce9dad9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:24.906057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b2b5f2ff-bd71-4e9f-89a6-fc169ce9dad9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:24.914184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2b5f2ff-bd71-4e9f-89a6-fc169ce9dad9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:24.914703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2b5f2ff-bd71-4e9f-89a6-fc169ce9dad9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:24.915161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2b5f2ff-bd71-4e9f-89a6-fc169ce9dad9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:24.916018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2b5f2ff-bd71-4e9f-89a6-fc169ce9dad9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:24.916495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2b5f2ff-bd71-4e9f-89a6-fc169ce9dad9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:24.916938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2b5f2ff-bd71-4e9f-89a6-fc169ce9dad9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:25.059194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-1873377888", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:25.134017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] validate_networks() for [('30eb2b31-0a15-49dd-bbbe-8448f143ce05', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:58:25.708950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b2b5f2ff-bd71-4e9f-89a6-fc169ce9dad9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:25.733423 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b2b5f2ff-bd71-4e9f-89a6-fc169ce9dad9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.866590 Sep 08 12:58:25.734488 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1622/3384] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:24 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:25.739877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fe5fd8f-07c0-4bd7-b2c8-23600efa8b2a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:25.740900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1fe5fd8f-07c0-4bd7-b2c8-23600efa8b2a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:25.747880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fe5fd8f-07c0-4bd7-b2c8-23600efa8b2a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:25.748780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fe5fd8f-07c0-4bd7-b2c8-23600efa8b2a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:25.750010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fe5fd8f-07c0-4bd7-b2c8-23600efa8b2a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:25.751003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fe5fd8f-07c0-4bd7-b2c8-23600efa8b2a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:25.754441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fe5fd8f-07c0-4bd7-b2c8-23600efa8b2a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:25.755216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fe5fd8f-07c0-4bd7-b2c8-23600efa8b2a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:25.768925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:26.380112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1fe5fd8f-07c0-4bd7-b2c8-23600efa8b2a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:26.416835 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1fe5fd8f-07c0-4bd7-b2c8-23600efa8b2a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1315 microversion: 2.1 time: 0.678203 Sep 08 12:58:26.433128 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1623/3385] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:25 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1315 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:26.458748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-224c9bb2-ef41-4d41-ab49-8e901089e312 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:26.463327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-224c9bb2-ef41-4d41-ab49-8e901089e312 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:26.483456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-224c9bb2-ef41-4d41-ab49-8e901089e312 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:26.484415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-224c9bb2-ef41-4d41-ab49-8e901089e312 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:26.485171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-224c9bb2-ef41-4d41-ab49-8e901089e312 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:26.486234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-224c9bb2-ef41-4d41-ab49-8e901089e312 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:26.486923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-224c9bb2-ef41-4d41-ab49-8e901089e312 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:26.487643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-224c9bb2-ef41-4d41-ab49-8e901089e312 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:27.142705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:58:27.143929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:58:27.145609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:58:27.146869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:58:27.149462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:58:27.157897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-224c9bb2-ef41-4d41-ab49-8e901089e312 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:27.184704 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-224c9bb2-ef41-4d41-ab49-8e901089e312 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.749839 Sep 08 12:58:27.188417 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1624/3386] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:26 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:27.194352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4e43e229-cf7a-4fc1-bc9d-2b842a34ab76 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:27.195001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4e43e229-cf7a-4fc1-bc9d-2b842a34ab76 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:27.212221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e43e229-cf7a-4fc1-bc9d-2b842a34ab76 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:27.215585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e43e229-cf7a-4fc1-bc9d-2b842a34ab76 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:27.216358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e43e229-cf7a-4fc1-bc9d-2b842a34ab76 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:27.218900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e43e229-cf7a-4fc1-bc9d-2b842a34ab76 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:27.221261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e43e229-cf7a-4fc1-bc9d-2b842a34ab76 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:27.223763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e43e229-cf7a-4fc1-bc9d-2b842a34ab76 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:27.226102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:27.227422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:27.228562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:27.230884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:27.232582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:27.234281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:27.287763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Getting quotas for project d208955d80a140f18307d2702bd79d19. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:58:27.300684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Getting quotas for user a1f5d0ff6047495387025f0ad90e8bbd and project d208955d80a140f18307d2702bd79d19. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:58:27.339037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:58:27.344897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:58:27.438246 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e7966848-1e8b-4806-8f4e-f37b5aa96e31 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.639729 Sep 08 12:58:27.446075 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1763/3387] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:58:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 2648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:58:27.453297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-08c20c1c-653f-4edd-804d-9da58861d890 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:27.454354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-08c20c1c-653f-4edd-804d-9da58861d890 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:27.465210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08c20c1c-653f-4edd-804d-9da58861d890 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:27.466434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08c20c1c-653f-4edd-804d-9da58861d890 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:27.467535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08c20c1c-653f-4edd-804d-9da58861d890 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:27.468687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08c20c1c-653f-4edd-804d-9da58861d890 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:27.469440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08c20c1c-653f-4edd-804d-9da58861d890 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:27.470121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08c20c1c-653f-4edd-804d-9da58861d890 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:27.852764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-08c20c1c-653f-4edd-804d-9da58861d890 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:27.885170 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-08c20c1c-653f-4edd-804d-9da58861d890 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1286 microversion: 2.1 time: 0.436723 Sep 08 12:58:27.886307 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1764/3388] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:27 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1286 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:27.917725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f3f4af71-518d-4dce-8cb0-8194aab766dc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:27.926198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f3f4af71-518d-4dce-8cb0-8194aab766dc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:27.957665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3f4af71-518d-4dce-8cb0-8194aab766dc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:27.958291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3f4af71-518d-4dce-8cb0-8194aab766dc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:27.958817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3f4af71-518d-4dce-8cb0-8194aab766dc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:27.962876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3f4af71-518d-4dce-8cb0-8194aab766dc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:27.980156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3f4af71-518d-4dce-8cb0-8194aab766dc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:27.985596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3f4af71-518d-4dce-8cb0-8194aab766dc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:28.486434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4e43e229-cf7a-4fc1-bc9d-2b842a34ab76 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:28.523460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4e43e229-cf7a-4fc1-bc9d-2b842a34ab76 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:28.527671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4e43e229-cf7a-4fc1-bc9d-2b842a34ab76 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:28.538250 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4e43e229-cf7a-4fc1-bc9d-2b842a34ab76 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.348070 Sep 08 12:58:28.539873 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1625/3389] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:27 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:28.587579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-20843c1c-b47f-46b4-9aee-7c71bab66491 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:28.595866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-20843c1c-b47f-46b4-9aee-7c71bab66491 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:28.659767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f3f4af71-518d-4dce-8cb0-8194aab766dc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:28.718898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:28.734062 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f3f4af71-518d-4dce-8cb0-8194aab766dc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.821460 Sep 08 12:58:28.761253 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1765/3390] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:27 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:28.804732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c4b50c02-03ee-4e2f-995e-dccf9e7cfaff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:28.808511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c4b50c02-03ee-4e2f-995e-dccf9e7cfaff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:28.835672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4b50c02-03ee-4e2f-995e-dccf9e7cfaff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:28.841243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4b50c02-03ee-4e2f-995e-dccf9e7cfaff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:28.842606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4b50c02-03ee-4e2f-995e-dccf9e7cfaff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:28.850587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4b50c02-03ee-4e2f-995e-dccf9e7cfaff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:28.852017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4b50c02-03ee-4e2f-995e-dccf9e7cfaff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:28.857456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4b50c02-03ee-4e2f-995e-dccf9e7cfaff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:29.623183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-20843c1c-b47f-46b4-9aee-7c71bab66491 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:29.660173 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-20843c1c-b47f-46b4-9aee-7c71bab66491 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1223 microversion: 2.1 time: 1.105531 Sep 08 12:58:29.667291 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1626/3391] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:28 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1223 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:29.688048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2bd626df-c004-40f5-85f4-1a789fa97a5d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:29.690576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2bd626df-c004-40f5-85f4-1a789fa97a5d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:29.734659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bd626df-c004-40f5-85f4-1a789fa97a5d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:29.735827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bd626df-c004-40f5-85f4-1a789fa97a5d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:29.738846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bd626df-c004-40f5-85f4-1a789fa97a5d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:29.740699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bd626df-c004-40f5-85f4-1a789fa97a5d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:29.745600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bd626df-c004-40f5-85f4-1a789fa97a5d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:29.750224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bd626df-c004-40f5-85f4-1a789fa97a5d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:30.081765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c4b50c02-03ee-4e2f-995e-dccf9e7cfaff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:30.112904 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c4b50c02-03ee-4e2f-995e-dccf9e7cfaff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1315 microversion: 2.1 time: 1.348865 Sep 08 12:58:30.128411 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1766/3392] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:28 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1315 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:30.137735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-97ea9291-8292-4be6-bdd7-94a7d950fd90 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:30.138757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-97ea9291-8292-4be6-bdd7-94a7d950fd90 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:30.164063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97ea9291-8292-4be6-bdd7-94a7d950fd90 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:30.165884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97ea9291-8292-4be6-bdd7-94a7d950fd90 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:30.168278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97ea9291-8292-4be6-bdd7-94a7d950fd90 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:30.175678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97ea9291-8292-4be6-bdd7-94a7d950fd90 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:30.179092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97ea9291-8292-4be6-bdd7-94a7d950fd90 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:30.181143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97ea9291-8292-4be6-bdd7-94a7d950fd90 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:31.378970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2bd626df-c004-40f5-85f4-1a789fa97a5d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:31.401457 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2bd626df-c004-40f5-85f4-1a789fa97a5d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.731505 Sep 08 12:58:31.402481 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1627/3393] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:29 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:31.410386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-33eb22b3-68d9-4ffd-965d-8d7e932d13e7 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:31.426560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33eb22b3-68d9-4ffd-965d-8d7e932d13e7 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:31.445265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33eb22b3-68d9-4ffd-965d-8d7e932d13e7 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:31.446064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33eb22b3-68d9-4ffd-965d-8d7e932d13e7 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:31.446851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33eb22b3-68d9-4ffd-965d-8d7e932d13e7 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:31.448105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33eb22b3-68d9-4ffd-965d-8d7e932d13e7 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:31.448897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33eb22b3-68d9-4ffd-965d-8d7e932d13e7 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:31.449663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33eb22b3-68d9-4ffd-965d-8d7e932d13e7 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:31.503167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-97ea9291-8292-4be6-bdd7-94a7d950fd90 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:31.531344 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-97ea9291-8292-4be6-bdd7-94a7d950fd90 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1328 microversion: 2.1 time: 1.399361 Sep 08 12:58:31.547302 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1767/3394] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:30 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1328 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:31.556342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8fd9167b-89c6-4f9f-bf91-12e80e66a765 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:31.558005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8fd9167b-89c6-4f9f-bf91-12e80e66a765 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:31.581043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fd9167b-89c6-4f9f-bf91-12e80e66a765 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:31.586133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fd9167b-89c6-4f9f-bf91-12e80e66a765 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:31.587451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fd9167b-89c6-4f9f-bf91-12e80e66a765 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:31.589172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fd9167b-89c6-4f9f-bf91-12e80e66a765 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:31.592078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fd9167b-89c6-4f9f-bf91-12e80e66a765 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:31.596207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fd9167b-89c6-4f9f-bf91-12e80e66a765 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:31.969237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8fd9167b-89c6-4f9f-bf91-12e80e66a765 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:31.992684 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8fd9167b-89c6-4f9f-bf91-12e80e66a765 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1281 microversion: 2.1 time: 0.442108 Sep 08 12:58:32.011012 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1768/3395] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:31 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1281 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:32.047060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0db1af58-09b9-41f3-aa1b-ba6666a981b1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:32.048938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0db1af58-09b9-41f3-aa1b-ba6666a981b1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:32.062909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0db1af58-09b9-41f3-aa1b-ba6666a981b1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:32.065342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0db1af58-09b9-41f3-aa1b-ba6666a981b1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:32.066482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0db1af58-09b9-41f3-aa1b-ba6666a981b1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:32.068235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0db1af58-09b9-41f3-aa1b-ba6666a981b1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:32.069608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0db1af58-09b9-41f3-aa1b-ba6666a981b1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:32.070740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0db1af58-09b9-41f3-aa1b-ba6666a981b1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:32.719590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:33.011529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0db1af58-09b9-41f3-aa1b-ba6666a981b1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:33.070131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-33eb22b3-68d9-4ffd-965d-8d7e932d13e7 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:33.087638 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0db1af58-09b9-41f3-aa1b-ba6666a981b1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1315 microversion: 2.1 time: 1.072072 Sep 08 12:58:33.092616 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1769/3396] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:32 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1315 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:33.122589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-33eb22b3-68d9-4ffd-965d-8d7e932d13e7 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:33.125099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e1d72e50-7ebf-4cf8-9c9a-7ee0f9f6ca89 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:33.132524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-33eb22b3-68d9-4ffd-965d-8d7e932d13e7 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:33.134136 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-33eb22b3-68d9-4ffd-965d-8d7e932d13e7 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.730330 Sep 08 12:58:33.147269 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1628/3397] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:31 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:33.147574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e1d72e50-7ebf-4cf8-9c9a-7ee0f9f6ca89 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:33.147574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e1d72e50-7ebf-4cf8-9c9a-7ee0f9f6ca89 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Searching by: {'deleted': False, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:58:33.152098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-13b0a7d0-af23-44f2-8bc2-354091a968a5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:33.163265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-13b0a7d0-af23-44f2-8bc2-354091a968a5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:33.163615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1d72e50-7ebf-4cf8-9c9a-7ee0f9f6ca89 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:33.163615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1d72e50-7ebf-4cf8-9c9a-7ee0f9f6ca89 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:33.163615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1d72e50-7ebf-4cf8-9c9a-7ee0f9f6ca89 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:33.164008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13b0a7d0-af23-44f2-8bc2-354091a968a5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:33.164141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13b0a7d0-af23-44f2-8bc2-354091a968a5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:33.164623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1d72e50-7ebf-4cf8-9c9a-7ee0f9f6ca89 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:33.164798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13b0a7d0-af23-44f2-8bc2-354091a968a5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:33.165489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1d72e50-7ebf-4cf8-9c9a-7ee0f9f6ca89 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:33.165832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13b0a7d0-af23-44f2-8bc2-354091a968a5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:33.166275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1d72e50-7ebf-4cf8-9c9a-7ee0f9f6ca89 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:33.166529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13b0a7d0-af23-44f2-8bc2-354091a968a5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:33.167190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13b0a7d0-af23-44f2-8bc2-354091a968a5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:33.270854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-e1d72e50-7ebf-4cf8-9c9a-7ee0f9f6ca89 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:58:33.338466 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e1d72e50-7ebf-4cf8-9c9a-7ee0f9f6ca89 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.243639 Sep 08 12:58:33.340401 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1770/3398] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 12:58:33 2022] GET /compute/v2.1/servers => generated 334 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:33.350166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0049a83d-68cc-4ab4-b3c8-f6db1849f14c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:33.353258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0049a83d-68cc-4ab4-b3c8-f6db1849f14c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:33.366223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0049a83d-68cc-4ab4-b3c8-f6db1849f14c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:33.367647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0049a83d-68cc-4ab4-b3c8-f6db1849f14c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:33.368732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0049a83d-68cc-4ab4-b3c8-f6db1849f14c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:33.370394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0049a83d-68cc-4ab4-b3c8-f6db1849f14c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:33.371599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0049a83d-68cc-4ab4-b3c8-f6db1849f14c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:33.372687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0049a83d-68cc-4ab4-b3c8-f6db1849f14c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:33.553510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0049a83d-68cc-4ab4-b3c8-f6db1849f14c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:33.590858 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0049a83d-68cc-4ab4-b3c8-f6db1849f14c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1281 microversion: 2.1 time: 0.246637 Sep 08 12:58:33.595971 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1771/3399] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:33 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1281 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:33.623849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:33.650836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:33.653076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Searching by: {'deleted': False, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 12:58:33.685369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:33.686414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:33.687102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:33.688208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:33.691329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:33.691329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:33.796658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 12:58:33.901737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:33.947497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:33.948367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:33.949138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:34.014036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-13b0a7d0-af23-44f2-8bc2-354091a968a5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:34.041548 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-13b0a7d0-af23-44f2-8bc2-354091a968a5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1328 microversion: 2.1 time: 0.905193 Sep 08 12:58:34.045301 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1629/3400] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:33 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1328 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:34.250123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-35f9373e-d4f5-4d6e-921f-beb124b91a77 req-dc58243b-07ba-498c-b8fc-905b016277eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd61063e-36fc-477d-8522-b95318528acd", "name": "network-vif-plugged", "status": "completed", "tag": "1d545eb1-3599-4f99-9fcc-5cc1c14cd7d6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:34.335109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-35f9373e-d4f5-4d6e-921f-beb124b91a77 req-dc58243b-07ba-498c-b8fc-905b016277eb service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:34.336338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-35f9373e-d4f5-4d6e-921f-beb124b91a77 req-dc58243b-07ba-498c-b8fc-905b016277eb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:34.339575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-35f9373e-d4f5-4d6e-921f-beb124b91a77 req-dc58243b-07ba-498c-b8fc-905b016277eb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:34.424269 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-35f9373e-d4f5-4d6e-921f-beb124b91a77 req-dc58243b-07ba-498c-b8fc-905b016277eb service nova] Creating event network-vif-plugged:1d545eb1-3599-4f99-9fcc-5cc1c14cd7d6 for instance bd61063e-36fc-477d-8522-b95318528acd on n-h2-852084-10 Sep 08 12:58:34.447765 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-35f9373e-d4f5-4d6e-921f-beb124b91a77 req-dc58243b-07ba-498c-b8fc-905b016277eb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.400967 Sep 08 12:58:34.450045 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1630/3401] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:34.462817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc773fea-b429-4de2-a1c8-de217fb10a9d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:34.464944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cc773fea-b429-4de2-a1c8-de217fb10a9d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:34.487030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc773fea-b429-4de2-a1c8-de217fb10a9d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:34.489702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc773fea-b429-4de2-a1c8-de217fb10a9d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:34.491667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc773fea-b429-4de2-a1c8-de217fb10a9d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:34.510725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc773fea-b429-4de2-a1c8-de217fb10a9d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:34.511958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc773fea-b429-4de2-a1c8-de217fb10a9d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:34.512748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc773fea-b429-4de2-a1c8-de217fb10a9d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:34.970676 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-59d9e3b0-3c66-479e-a166-38154d42fe82 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 1699 microversion: 2.1 time: 1.371115 Sep 08 12:58:34.972501 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1772/3402] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 12:58:33 2022] GET /compute/v2.1/servers/detail => generated 1699 bytes in 1376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:34.977885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d19ebe66-932b-43ef-9a74-123f8f79e5e2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:34.978824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d19ebe66-932b-43ef-9a74-123f8f79e5e2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:34.994590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d19ebe66-932b-43ef-9a74-123f8f79e5e2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:34.998052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d19ebe66-932b-43ef-9a74-123f8f79e5e2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:34.998816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d19ebe66-932b-43ef-9a74-123f8f79e5e2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:35.000428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d19ebe66-932b-43ef-9a74-123f8f79e5e2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:35.004694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d19ebe66-932b-43ef-9a74-123f8f79e5e2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:35.005467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d19ebe66-932b-43ef-9a74-123f8f79e5e2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:35.728493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cc773fea-b429-4de2-a1c8-de217fb10a9d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:35.761278 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cc773fea-b429-4de2-a1c8-de217fb10a9d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1315 microversion: 2.1 time: 1.303611 Sep 08 12:58:35.761278 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1631/3403] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:34 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1315 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:35.770507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-26b4c3b3-496c-44df-abed-183036340853 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:35.771536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-26b4c3b3-496c-44df-abed-183036340853 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:35.801031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26b4c3b3-496c-44df-abed-183036340853 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:35.801844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26b4c3b3-496c-44df-abed-183036340853 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:35.806890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26b4c3b3-496c-44df-abed-183036340853 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:35.809814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26b4c3b3-496c-44df-abed-183036340853 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:35.812326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26b4c3b3-496c-44df-abed-183036340853 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:35.816467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26b4c3b3-496c-44df-abed-183036340853 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:36.655554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d19ebe66-932b-43ef-9a74-123f8f79e5e2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:36.666027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d19ebe66-932b-43ef-9a74-123f8f79e5e2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:36.677414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d19ebe66-932b-43ef-9a74-123f8f79e5e2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:36.678885 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d19ebe66-932b-43ef-9a74-123f8f79e5e2 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.705042 Sep 08 12:58:36.682542 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1773/3404] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:34 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:36.696778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-dd390009-b69c-4870-85fa-456737a182c3 req-9a2f121a-a160-45ec-9727-f5f2959c253c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "302204af-5f35-498f-95f0-d0c03f99db4d", "tag": "ab03ff55-1f51-42da-a6b5-bb779cfab5f6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:36.720421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dd390009-b69c-4870-85fa-456737a182c3 req-9a2f121a-a160-45ec-9727-f5f2959c253c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:36.720976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dd390009-b69c-4870-85fa-456737a182c3 req-9a2f121a-a160-45ec-9727-f5f2959c253c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:36.721440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dd390009-b69c-4870-85fa-456737a182c3 req-9a2f121a-a160-45ec-9727-f5f2959c253c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:36.757747 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-dd390009-b69c-4870-85fa-456737a182c3 req-9a2f121a-a160-45ec-9727-f5f2959c253c service nova] Creating event network-changed:ab03ff55-1f51-42da-a6b5-bb779cfab5f6 for instance 302204af-5f35-498f-95f0-d0c03f99db4d on n-h2-852084-10 Sep 08 12:58:36.776419 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-dd390009-b69c-4870-85fa-456737a182c3 req-9a2f121a-a160-45ec-9727-f5f2959c253c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092472 Sep 08 12:58:36.777066 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1774/3405] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:36.785839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-df24f08a-458c-4cb6-9333-9c107529a623 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:36.808195 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-df24f08a-458c-4cb6-9333-9c107529a623 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.029756 Sep 08 12:58:36.810146 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1775/3406] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 12:58:36 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:36.827543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7a807a81-fa47-4518-9645-efd0cf447458 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:36.830399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7a807a81-fa47-4518-9645-efd0cf447458 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:36.846415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a807a81-fa47-4518-9645-efd0cf447458 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:36.849160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a807a81-fa47-4518-9645-efd0cf447458 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:36.852178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a807a81-fa47-4518-9645-efd0cf447458 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:36.854238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a807a81-fa47-4518-9645-efd0cf447458 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:36.855427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a807a81-fa47-4518-9645-efd0cf447458 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:36.856817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a807a81-fa47-4518-9645-efd0cf447458 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:36.941080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-26b4c3b3-496c-44df-abed-183036340853 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:36.964859 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-26b4c3b3-496c-44df-abed-183036340853 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1323 microversion: 2.1 time: 1.201753 Sep 08 12:58:36.983707 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1632/3407] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:35 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1323 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:37.007593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad93b3fa-78d4-4345-88ad-4bd20afab6fc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:37.009246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad93b3fa-78d4-4345-88ad-4bd20afab6fc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:37.027052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad93b3fa-78d4-4345-88ad-4bd20afab6fc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:37.028107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad93b3fa-78d4-4345-88ad-4bd20afab6fc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:37.029023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad93b3fa-78d4-4345-88ad-4bd20afab6fc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:37.034488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad93b3fa-78d4-4345-88ad-4bd20afab6fc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:37.035828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad93b3fa-78d4-4345-88ad-4bd20afab6fc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:37.038262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad93b3fa-78d4-4345-88ad-4bd20afab6fc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:37.964501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ad93b3fa-78d4-4345-88ad-4bd20afab6fc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:37.979982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7a807a81-fa47-4518-9645-efd0cf447458 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:37.996763 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7a807a81-fa47-4518-9645-efd0cf447458 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1328 microversion: 2.1 time: 1.175385 Sep 08 12:58:37.998609 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1776/3408] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:36 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1328 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:38.007499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ddb9e228-14cd-4353-af06-96d4b2fae955 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:38.008690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ddb9e228-14cd-4353-af06-96d4b2fae955 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:38.019435 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad93b3fa-78d4-4345-88ad-4bd20afab6fc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1315 microversion: 2.1 time: 1.012861 Sep 08 12:58:38.020685 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1633/3409] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:36 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1315 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:38.033452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddb9e228-14cd-4353-af06-96d4b2fae955 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:38.047265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddb9e228-14cd-4353-af06-96d4b2fae955 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:38.048722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddb9e228-14cd-4353-af06-96d4b2fae955 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:38.049455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d3a4266-3619-481d-8e3e-58b9164419c9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:38.050682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddb9e228-14cd-4353-af06-96d4b2fae955 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:38.051010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4d3a4266-3619-481d-8e3e-58b9164419c9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:38.052285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddb9e228-14cd-4353-af06-96d4b2fae955 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:38.056227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddb9e228-14cd-4353-af06-96d4b2fae955 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:38.065260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d3a4266-3619-481d-8e3e-58b9164419c9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:38.066697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d3a4266-3619-481d-8e3e-58b9164419c9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:38.067704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d3a4266-3619-481d-8e3e-58b9164419c9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:38.069173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d3a4266-3619-481d-8e3e-58b9164419c9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:38.070117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d3a4266-3619-481d-8e3e-58b9164419c9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:38.071657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d3a4266-3619-481d-8e3e-58b9164419c9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:38.145864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ddb9e228-14cd-4353-af06-96d4b2fae955 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:58:38.443358 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ddb9e228-14cd-4353-af06-96d4b2fae955 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "DELETE /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 204 len: 0 microversion: 2.1 time: 0.439976 Sep 08 12:58:38.445202 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1777/3410] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:58:37 2022] DELETE /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:58:38.459313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9669550d-7dbe-4055-b81a-adffbe846e27 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:38.462130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9669550d-7dbe-4055-b81a-adffbe846e27 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:38.477119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9669550d-7dbe-4055-b81a-adffbe846e27 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:38.478423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9669550d-7dbe-4055-b81a-adffbe846e27 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:38.479274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9669550d-7dbe-4055-b81a-adffbe846e27 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:38.481602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9669550d-7dbe-4055-b81a-adffbe846e27 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:38.482965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9669550d-7dbe-4055-b81a-adffbe846e27 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:38.484484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9669550d-7dbe-4055-b81a-adffbe846e27 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:38.591655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4d3a4266-3619-481d-8e3e-58b9164419c9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:38.610484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4d3a4266-3619-481d-8e3e-58b9164419c9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:38.612725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4d3a4266-3619-481d-8e3e-58b9164419c9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:38.617299 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4d3a4266-3619-481d-8e3e-58b9164419c9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.595009 Sep 08 12:58:38.622446 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1634/3411] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:38 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:38.628413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-850f0a93-2f93-4dd6-9952-46d905fd58d2 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:38.633004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-850f0a93-2f93-4dd6-9952-46d905fd58d2 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:38.652905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-850f0a93-2f93-4dd6-9952-46d905fd58d2 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:38.653722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-850f0a93-2f93-4dd6-9952-46d905fd58d2 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:38.654379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-850f0a93-2f93-4dd6-9952-46d905fd58d2 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:38.655625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-850f0a93-2f93-4dd6-9952-46d905fd58d2 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:38.656388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-850f0a93-2f93-4dd6-9952-46d905fd58d2 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:38.657108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-850f0a93-2f93-4dd6-9952-46d905fd58d2 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:39.140831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9669550d-7dbe-4055-b81a-adffbe846e27 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:39.165867 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9669550d-7dbe-4055-b81a-adffbe846e27 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1323 microversion: 2.1 time: 0.718078 Sep 08 12:58:39.175372 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1778/3412] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:38 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1323 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:39.197048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00cdfded-c17d-4a8a-9628-73e98f8d60c5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:39.198650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00cdfded-c17d-4a8a-9628-73e98f8d60c5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:39.217444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00cdfded-c17d-4a8a-9628-73e98f8d60c5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:39.218541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00cdfded-c17d-4a8a-9628-73e98f8d60c5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:39.219006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00cdfded-c17d-4a8a-9628-73e98f8d60c5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:39.219793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00cdfded-c17d-4a8a-9628-73e98f8d60c5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:39.220258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00cdfded-c17d-4a8a-9628-73e98f8d60c5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:39.220869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00cdfded-c17d-4a8a-9628-73e98f8d60c5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:39.524545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-850f0a93-2f93-4dd6-9952-46d905fd58d2 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:39.534494 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-850f0a93-2f93-4dd6-9952-46d905fd58d2 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 200 len: 1702 microversion: 2.1 time: 0.910362 Sep 08 12:58:39.535879 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1635/3413] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:38 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 1702 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:39.541125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9d0db4f0-d094-4991-9411-a51ee69a3924 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:39.542088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9d0db4f0-d094-4991-9411-a51ee69a3924 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:39.553335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d0db4f0-d094-4991-9411-a51ee69a3924 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:39.553845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d0db4f0-d094-4991-9411-a51ee69a3924 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:39.554296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d0db4f0-d094-4991-9411-a51ee69a3924 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:39.557823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d0db4f0-d094-4991-9411-a51ee69a3924 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:39.558472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d0db4f0-d094-4991-9411-a51ee69a3924 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:39.558934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d0db4f0-d094-4991-9411-a51ee69a3924 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:39.658127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=16 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:39.784233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00cdfded-c17d-4a8a-9628-73e98f8d60c5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:39.824262 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00cdfded-c17d-4a8a-9628-73e98f8d60c5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1328 microversion: 2.1 time: 0.646317 Sep 08 12:58:39.829693 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1779/3414] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:39 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1328 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:39.858335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2d924007-813b-4291-b7b8-5345811e488f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:39.863082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2d924007-813b-4291-b7b8-5345811e488f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:39.880978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d924007-813b-4291-b7b8-5345811e488f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:39.882221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d924007-813b-4291-b7b8-5345811e488f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:39.883808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d924007-813b-4291-b7b8-5345811e488f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:39.885717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d924007-813b-4291-b7b8-5345811e488f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:39.887693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d924007-813b-4291-b7b8-5345811e488f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:39.889206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d924007-813b-4291-b7b8-5345811e488f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:40.174467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9d0db4f0-d094-4991-9411-a51ee69a3924 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:40.189891 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9d0db4f0-d094-4991-9411-a51ee69a3924 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1502 microversion: 2.1 time: 0.652662 Sep 08 12:58:40.203874 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1636/3415] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:39 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1502 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:40.216005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-be77eebc-2f1e-472e-890c-94c2f4e342a7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:40.218715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-be77eebc-2f1e-472e-890c-94c2f4e342a7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:40.227310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be77eebc-2f1e-472e-890c-94c2f4e342a7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:40.228168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be77eebc-2f1e-472e-890c-94c2f4e342a7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:40.228872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be77eebc-2f1e-472e-890c-94c2f4e342a7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:40.230029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be77eebc-2f1e-472e-890c-94c2f4e342a7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:40.230699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be77eebc-2f1e-472e-890c-94c2f4e342a7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:40.231331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be77eebc-2f1e-472e-890c-94c2f4e342a7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:40.979458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2d924007-813b-4291-b7b8-5345811e488f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:40.992588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2d924007-813b-4291-b7b8-5345811e488f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:40.995633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2d924007-813b-4291-b7b8-5345811e488f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:40.997247 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2d924007-813b-4291-b7b8-5345811e488f tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.165467 Sep 08 12:58:41.000042 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1780/3416] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:39 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:41.006000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bb47e1d5-29a1-4a7a-b927-f01ef4b10484 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:41.006843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bb47e1d5-29a1-4a7a-b927-f01ef4b10484 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:41.015172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb47e1d5-29a1-4a7a-b927-f01ef4b10484 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:41.016089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb47e1d5-29a1-4a7a-b927-f01ef4b10484 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:41.016696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb47e1d5-29a1-4a7a-b927-f01ef4b10484 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:41.017951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb47e1d5-29a1-4a7a-b927-f01ef4b10484 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:41.018855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb47e1d5-29a1-4a7a-b927-f01ef4b10484 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:41.019696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb47e1d5-29a1-4a7a-b927-f01ef4b10484 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:41.057775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:41.067834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-bb47e1d5-29a1-4a7a-b927-f01ef4b10484 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lazy-loading 'flavor' on Instance uuid bd61063e-36fc-477d-8522-b95318528acd {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:58:41.088827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-be77eebc-2f1e-472e-890c-94c2f4e342a7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:41.106347 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-be77eebc-2f1e-472e-890c-94c2f4e342a7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1323 microversion: 2.1 time: 0.901186 Sep 08 12:58:41.107325 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1637/3417] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:40 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1323 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:41.337478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-ddde75d5-0aec-4180-9aa3-12a2146673df req-669bfe9e-70ce-43ca-aaee-4d63528b3c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb61c338-cf63-45dc-97e7-a9b6ad019a63", "tag": "8ca3eda9-46fb-4ca4-8f47-250b1d3ba400"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:41.386169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ddde75d5-0aec-4180-9aa3-12a2146673df req-669bfe9e-70ce-43ca-aaee-4d63528b3c5e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:41.386927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ddde75d5-0aec-4180-9aa3-12a2146673df req-669bfe9e-70ce-43ca-aaee-4d63528b3c5e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:41.399440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ddde75d5-0aec-4180-9aa3-12a2146673df req-669bfe9e-70ce-43ca-aaee-4d63528b3c5e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:41.461336 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-ddde75d5-0aec-4180-9aa3-12a2146673df req-669bfe9e-70ce-43ca-aaee-4d63528b3c5e service nova] Creating event network-changed:8ca3eda9-46fb-4ca4-8f47-250b1d3ba400 for instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 on n-h2-852084-10 Sep 08 12:58:41.473415 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-ddde75d5-0aec-4180-9aa3-12a2146673df req-669bfe9e-70ce-43ca-aaee-4d63528b3c5e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.364075 Sep 08 12:58:41.482425 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1638/3418] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:41.505135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-91efede0-a8ec-474e-8b85-91a21b92372e tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:41.506472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-91efede0-a8ec-474e-8b85-91a21b92372e tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:41.511028 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bb47e1d5-29a1-4a7a-b927-f01ef4b10484 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "POST /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd/action" status: 202 len: 0 microversion: 2.1 time: 0.508896 Sep 08 12:58:41.530316 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1781/3419] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:58:41 2022] POST /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:58:41.530544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91efede0-a8ec-474e-8b85-91a21b92372e tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:41.531334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91efede0-a8ec-474e-8b85-91a21b92372e tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:41.532129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91efede0-a8ec-474e-8b85-91a21b92372e tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:41.540566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91efede0-a8ec-474e-8b85-91a21b92372e tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:41.544469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91efede0-a8ec-474e-8b85-91a21b92372e tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:41.545933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91efede0-a8ec-474e-8b85-91a21b92372e tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:41.550444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0e1396b2-2995-4e90-9b67-df0562196599 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:41.551894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0e1396b2-2995-4e90-9b67-df0562196599 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:41.574511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e1396b2-2995-4e90-9b67-df0562196599 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:41.578466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e1396b2-2995-4e90-9b67-df0562196599 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:41.579997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e1396b2-2995-4e90-9b67-df0562196599 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:41.581422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e1396b2-2995-4e90-9b67-df0562196599 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:41.582098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e1396b2-2995-4e90-9b67-df0562196599 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:41.582707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e1396b2-2995-4e90-9b67-df0562196599 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:42.553714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-91efede0-a8ec-474e-8b85-91a21b92372e tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:42.576210 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-91efede0-a8ec-474e-8b85-91a21b92372e tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 200 len: 1702 microversion: 2.1 time: 1.091429 Sep 08 12:58:42.577601 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1639/3420] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:41 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 1702 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:42.582787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-21827326-db46-49a6-8863-8df4ce4304f3 req-67cb159a-634f-496f-8d33-f34e572736d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-plugged", "status": "completed", "tag": "a69fd5b9-294a-4234-9531-c82133ce0190"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:42.605763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-21827326-db46-49a6-8863-8df4ce4304f3 req-67cb159a-634f-496f-8d33-f34e572736d6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:42.607770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-21827326-db46-49a6-8863-8df4ce4304f3 req-67cb159a-634f-496f-8d33-f34e572736d6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:42.609121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-21827326-db46-49a6-8863-8df4ce4304f3 req-67cb159a-634f-496f-8d33-f34e572736d6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:42.616205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0e1396b2-2995-4e90-9b67-df0562196599 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:42.634106 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0e1396b2-2995-4e90-9b67-df0562196599 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1328 microversion: 2.1 time: 1.100254 Sep 08 12:58:42.640415 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1782/3421] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:41 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1328 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:42.652506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9c0310c7-65a2-4f73-bd3f-7edc4ff8fa4d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:42.656217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9c0310c7-65a2-4f73-bd3f-7edc4ff8fa4d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:42.669862 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-21827326-db46-49a6-8863-8df4ce4304f3 req-67cb159a-634f-496f-8d33-f34e572736d6 service nova] Creating event network-vif-plugged:a69fd5b9-294a-4234-9531-c82133ce0190 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:58:42.676584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c0310c7-65a2-4f73-bd3f-7edc4ff8fa4d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:42.677705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c0310c7-65a2-4f73-bd3f-7edc4ff8fa4d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:42.678430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c0310c7-65a2-4f73-bd3f-7edc4ff8fa4d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:42.679441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c0310c7-65a2-4f73-bd3f-7edc4ff8fa4d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:42.682395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c0310c7-65a2-4f73-bd3f-7edc4ff8fa4d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:42.683120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c0310c7-65a2-4f73-bd3f-7edc4ff8fa4d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:42.713481 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-21827326-db46-49a6-8863-8df4ce4304f3 req-67cb159a-634f-496f-8d33-f34e572736d6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132282 Sep 08 12:58:42.729805 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1640/3422] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:42.768521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b84a5ea-4ec6-4ef2-8014-98d782167246 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:42.774867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6b84a5ea-4ec6-4ef2-8014-98d782167246 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:42.820991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b84a5ea-4ec6-4ef2-8014-98d782167246 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:42.828042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b84a5ea-4ec6-4ef2-8014-98d782167246 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:42.832834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b84a5ea-4ec6-4ef2-8014-98d782167246 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:42.841114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b84a5ea-4ec6-4ef2-8014-98d782167246 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:42.845245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b84a5ea-4ec6-4ef2-8014-98d782167246 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:42.850150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b84a5ea-4ec6-4ef2-8014-98d782167246 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:43.711661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:43.893668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:44.164050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6b84a5ea-4ec6-4ef2-8014-98d782167246 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:44.205012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6b84a5ea-4ec6-4ef2-8014-98d782167246 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:44.216901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6b84a5ea-4ec6-4ef2-8014-98d782167246 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:44.221055 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6b84a5ea-4ec6-4ef2-8014-98d782167246 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.484864 Sep 08 12:58:44.223363 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1641/3423] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:42 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:44.233994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-623cf423-e91f-483e-9bfd-5240421f5728 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:44.243554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-623cf423-e91f-483e-9bfd-5240421f5728 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:44.255326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-623cf423-e91f-483e-9bfd-5240421f5728 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:44.257454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-623cf423-e91f-483e-9bfd-5240421f5728 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:44.258566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-623cf423-e91f-483e-9bfd-5240421f5728 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:44.260423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-623cf423-e91f-483e-9bfd-5240421f5728 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:44.261983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-623cf423-e91f-483e-9bfd-5240421f5728 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:44.263600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-623cf423-e91f-483e-9bfd-5240421f5728 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:44.698731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9c0310c7-65a2-4f73-bd3f-7edc4ff8fa4d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:44.735686 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9c0310c7-65a2-4f73-bd3f-7edc4ff8fa4d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 2.093156 Sep 08 12:58:44.738513 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1783/3424] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:42 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 2097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:44.767520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-11195112-bbdf-4eea-98c7-b7a7e66b34c0 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:44.770270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-11195112-bbdf-4eea-98c7-b7a7e66b34c0 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:44.807672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11195112-bbdf-4eea-98c7-b7a7e66b34c0 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:44.817936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11195112-bbdf-4eea-98c7-b7a7e66b34c0 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:44.818737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11195112-bbdf-4eea-98c7-b7a7e66b34c0 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:44.821251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11195112-bbdf-4eea-98c7-b7a7e66b34c0 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:44.824388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11195112-bbdf-4eea-98c7-b7a7e66b34c0 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:44.825018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11195112-bbdf-4eea-98c7-b7a7e66b34c0 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:45.211315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-11195112-bbdf-4eea-98c7-b7a7e66b34c0 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:45.228865 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-11195112-bbdf-4eea-98c7-b7a7e66b34c0 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 200 len: 1635 microversion: 2.1 time: 0.467952 Sep 08 12:58:45.241620 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1784/3425] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:44 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 1635 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:45.253762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-623cf423-e91f-483e-9bfd-5240421f5728 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:45.269962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-80d721bf-a741-4848-883d-fc855d866ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:45.270109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:45.270856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-80d721bf-a741-4848-883d-fc855d866ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:45.297719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80d721bf-a741-4848-883d-fc855d866ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:45.301091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80d721bf-a741-4848-883d-fc855d866ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:45.302085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80d721bf-a741-4848-883d-fc855d866ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:45.303858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80d721bf-a741-4848-883d-fc855d866ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:45.305056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80d721bf-a741-4848-883d-fc855d866ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:45.306073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80d721bf-a741-4848-883d-fc855d866ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:45.317660 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-623cf423-e91f-483e-9bfd-5240421f5728 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1323 microversion: 2.1 time: 1.091946 Sep 08 12:58:45.318047 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1642/3426] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:44 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1323 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:45.341427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-cba3edc1-b225-49e4-b707-82253fb22a6e req-477e01d5-29a1-4afe-88ed-113ebb3cd7ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-plugged", "status": "completed", "tag": "9e7a5dd5-586c-40ea-b7f3-c11aacd5c5b0"}, {"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-plugged", "status": "completed", "tag": "73bd7edb-2a02-4b55-9210-60c0c223d930"}, {"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-plugged", "status": "completed", "tag": "3466f05e-6efb-423f-9ac1-92190128aa45"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:45.368022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cba3edc1-b225-49e4-b707-82253fb22a6e req-477e01d5-29a1-4afe-88ed-113ebb3cd7ad service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:45.368561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cba3edc1-b225-49e4-b707-82253fb22a6e req-477e01d5-29a1-4afe-88ed-113ebb3cd7ad service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:45.369006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cba3edc1-b225-49e4-b707-82253fb22a6e req-477e01d5-29a1-4afe-88ed-113ebb3cd7ad service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:45.403852 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-cba3edc1-b225-49e4-b707-82253fb22a6e req-477e01d5-29a1-4afe-88ed-113ebb3cd7ad service nova] Creating event network-vif-plugged:9e7a5dd5-586c-40ea-b7f3-c11aacd5c5b0 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:58:45.406435 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-cba3edc1-b225-49e4-b707-82253fb22a6e req-477e01d5-29a1-4afe-88ed-113ebb3cd7ad service nova] Creating event network-vif-plugged:73bd7edb-2a02-4b55-9210-60c0c223d930 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:58:45.408096 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-cba3edc1-b225-49e4-b707-82253fb22a6e req-477e01d5-29a1-4afe-88ed-113ebb3cd7ad service nova] Creating event network-vif-plugged:3466f05e-6efb-423f-9ac1-92190128aa45 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:58:45.425166 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-cba3edc1-b225-49e4-b707-82253fb22a6e req-477e01d5-29a1-4afe-88ed-113ebb3cd7ad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.104731 Sep 08 12:58:45.428762 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1643/3427] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:45.451585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1014f49b-04ce-4b99-be51-bea27ea5153c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:45.456712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1014f49b-04ce-4b99-be51-bea27ea5153c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:45.483143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1014f49b-04ce-4b99-be51-bea27ea5153c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:45.485976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1014f49b-04ce-4b99-be51-bea27ea5153c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:45.487628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1014f49b-04ce-4b99-be51-bea27ea5153c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:45.490158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1014f49b-04ce-4b99-be51-bea27ea5153c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:45.491399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1014f49b-04ce-4b99-be51-bea27ea5153c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:45.492920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1014f49b-04ce-4b99-be51-bea27ea5153c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:45.955398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-80d721bf-a741-4848-883d-fc855d866ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:46.016497 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-80d721bf-a741-4848-883d-fc855d866ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1328 microversion: 2.1 time: 0.773516 Sep 08 12:58:46.017134 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1785/3428] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:45 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1328 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:46.043272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-6a7a91e7-28a3-4643-a59f-5c1ef9db4d69 req-0499c8dd-89f3-4d4a-a184-a12a590177a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54768ef6-04c1-4a48-be47-c6286e20b1ef", "name": "network-vif-deleted", "tag": "3cb24870-537c-488f-a27b-9c4e2eb374c1"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:46.059002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6a7a91e7-28a3-4643-a59f-5c1ef9db4d69 req-0499c8dd-89f3-4d4a-a184-a12a590177a5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:46.060474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6a7a91e7-28a3-4643-a59f-5c1ef9db4d69 req-0499c8dd-89f3-4d4a-a184-a12a590177a5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:46.062112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6a7a91e7-28a3-4643-a59f-5c1ef9db4d69 req-0499c8dd-89f3-4d4a-a184-a12a590177a5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:46.082098 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-6a7a91e7-28a3-4643-a59f-5c1ef9db4d69 req-0499c8dd-89f3-4d4a-a184-a12a590177a5 service nova] Creating event network-vif-deleted:3cb24870-537c-488f-a27b-9c4e2eb374c1 for instance 54768ef6-04c1-4a48-be47-c6286e20b1ef on n-h1-852084-10 Sep 08 12:58:46.104234 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-6a7a91e7-28a3-4643-a59f-5c1ef9db4d69 req-0499c8dd-89f3-4d4a-a184-a12a590177a5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085053 Sep 08 12:58:46.114754 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1786/3429] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:46.117346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1014f49b-04ce-4b99-be51-bea27ea5153c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:46.126743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-38dc7938-92c1-45d8-8d35-b7729698d3c9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:46.128101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-38dc7938-92c1-45d8-8d35-b7729698d3c9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:46.134746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1014f49b-04ce-4b99-be51-bea27ea5153c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:46.139644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1014f49b-04ce-4b99-be51-bea27ea5153c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:46.146320 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1014f49b-04ce-4b99-be51-bea27ea5153c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.712373 Sep 08 12:58:46.147502 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1644/3430] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:45 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:46.159654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38dc7938-92c1-45d8-8d35-b7729698d3c9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:46.160538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38dc7938-92c1-45d8-8d35-b7729698d3c9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:46.161344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38dc7938-92c1-45d8-8d35-b7729698d3c9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:46.162658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38dc7938-92c1-45d8-8d35-b7729698d3c9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:46.163576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38dc7938-92c1-45d8-8d35-b7729698d3c9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:46.164401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38dc7938-92c1-45d8-8d35-b7729698d3c9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:46.264102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:46.266188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:46.291271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:46.294733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:46.299981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:46.301708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:46.305016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:46.308395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:46.414933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:46.415489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:46.415940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:46.416409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lazy-loading 'fault' on Instance uuid 54768ef6-04c1-4a48-be47-c6286e20b1ef {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:58:46.921126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef2a83052af5421bb6d637a5ae66f9c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1abfd6549b7e464d8d3a17dbc72f227b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:46.941527 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0c638613-68f9-4a49-9f80-dda37c31dd66 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 200 len: 1360 microversion: 2.1 time: 0.686042 Sep 08 12:58:46.945432 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1645/3431] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:46 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 1360 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:46.955117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ebe7fb6-6f48-48b9-a4df-6f24f338443f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:46.956089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ebe7fb6-6f48-48b9-a4df-6f24f338443f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:46.976428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ebe7fb6-6f48-48b9-a4df-6f24f338443f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:46.978166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ebe7fb6-6f48-48b9-a4df-6f24f338443f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:46.982821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ebe7fb6-6f48-48b9-a4df-6f24f338443f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:46.984971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ebe7fb6-6f48-48b9-a4df-6f24f338443f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:46.988603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ebe7fb6-6f48-48b9-a4df-6f24f338443f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:46.989858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ebe7fb6-6f48-48b9-a4df-6f24f338443f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:47.181146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-38dc7938-92c1-45d8-8d35-b7729698d3c9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:47.217553 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-38dc7938-92c1-45d8-8d35-b7729698d3c9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 1.099567 Sep 08 12:58:47.220255 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1787/3432] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:46 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:47.245766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-941ca01b-f8fc-461e-859c-cfe222bb1323 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:47.247351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-941ca01b-f8fc-461e-859c-cfe222bb1323 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:47.281152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-941ca01b-f8fc-461e-859c-cfe222bb1323 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:47.281687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-941ca01b-f8fc-461e-859c-cfe222bb1323 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:47.282156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-941ca01b-f8fc-461e-859c-cfe222bb1323 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:47.288508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-941ca01b-f8fc-461e-859c-cfe222bb1323 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:47.289214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-941ca01b-f8fc-461e-859c-cfe222bb1323 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:47.289671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-941ca01b-f8fc-461e-859c-cfe222bb1323 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:47.755851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ebe7fb6-6f48-48b9-a4df-6f24f338443f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:47.788410 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ebe7fb6-6f48-48b9-a4df-6f24f338443f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1323 microversion: 2.1 time: 0.833433 Sep 08 12:58:47.790056 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1646/3433] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:46 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1323 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:47.799685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f21179c7-ae65-4691-8405-0ce7abd56bfe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:47.800785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f21179c7-ae65-4691-8405-0ce7abd56bfe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:47.863040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f21179c7-ae65-4691-8405-0ce7abd56bfe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:47.864014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f21179c7-ae65-4691-8405-0ce7abd56bfe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:47.864911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f21179c7-ae65-4691-8405-0ce7abd56bfe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:47.866146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f21179c7-ae65-4691-8405-0ce7abd56bfe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:47.867033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f21179c7-ae65-4691-8405-0ce7abd56bfe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:47.867848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f21179c7-ae65-4691-8405-0ce7abd56bfe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:48.004488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-941ca01b-f8fc-461e-859c-cfe222bb1323 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:48.050587 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-941ca01b-f8fc-461e-859c-cfe222bb1323 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1328 microversion: 2.1 time: 0.828044 Sep 08 12:58:48.068339 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1788/3434] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:47 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1328 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:48.099699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-306c2505-21cd-45ae-96e9-40aa1fdd88f5 req-e084a2c3-fca9-4264-ade2-034cb837d424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-plugged", "status": "completed", "tag": "1a42ecce-f9f7-442b-a7d5-6607113087a7"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:48.122121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-306c2505-21cd-45ae-96e9-40aa1fdd88f5 req-e084a2c3-fca9-4264-ade2-034cb837d424 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:48.123526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-306c2505-21cd-45ae-96e9-40aa1fdd88f5 req-e084a2c3-fca9-4264-ade2-034cb837d424 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:48.124739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-306c2505-21cd-45ae-96e9-40aa1fdd88f5 req-e084a2c3-fca9-4264-ade2-034cb837d424 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:48.149740 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-306c2505-21cd-45ae-96e9-40aa1fdd88f5 req-e084a2c3-fca9-4264-ade2-034cb837d424 service nova] Creating event network-vif-plugged:1a42ecce-f9f7-442b-a7d5-6607113087a7 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:58:48.170246 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-306c2505-21cd-45ae-96e9-40aa1fdd88f5 req-e084a2c3-fca9-4264-ade2-034cb837d424 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078338 Sep 08 12:58:48.178361 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1789/3435] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:48.190332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2cbeab44-7db0-4782-a78b-d5613c02bc43 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:48.193452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2cbeab44-7db0-4782-a78b-d5613c02bc43 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] [instance: 54768ef6-04c1-4a48-be47-c6286e20b1ef] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:48.216622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cbeab44-7db0-4782-a78b-d5613c02bc43 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:48.226089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cbeab44-7db0-4782-a78b-d5613c02bc43 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:48.226298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cbeab44-7db0-4782-a78b-d5613c02bc43 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:48.227075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cbeab44-7db0-4782-a78b-d5613c02bc43 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:48.227595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cbeab44-7db0-4782-a78b-d5613c02bc43 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:48.228043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2cbeab44-7db0-4782-a78b-d5613c02bc43 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:48.271584 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-2cbeab44-7db0-4782-a78b-d5613c02bc43 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] HTTP exception thrown: Instance 54768ef6-04c1-4a48-be47-c6286e20b1ef could not be found. Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2cbeab44-7db0-4782-a78b-d5613c02bc43 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Request method failure captured: Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef HTTP/1.1 Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeah1FDbjfLoJs5bmE-SrvdQsDGhQBPtLb7sjAXGf8Flr_nswwAHhMXTvORfIpkKMR59VQ56-PCq7q4OjSSkFCdxaITyoQq9C68njrFTJdNyYyB0ShxrXSxU0LtCLysMl9RfWUT2mSM-ef0ECx67XqU6GtSkuPwGn5EkOM7syAFIywA Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 1abfd6549b7e464d8d3a17dbc72f227b Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestJSON-1723185665 Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1abfd6549b7e464d8d3a17dbc72f227b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1abfd6549b7e464d8d3a17dbc72f227b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1abfd6549b7e464d8d3a17dbc72f227b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1abfd6549b7e464d8d3a17dbc72f227b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestJSON-1723185665 Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 1abfd6549b7e464d8d3a17dbc72f227b Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestJSON-1723185665 Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestJSON-1723185665-project Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: ef2a83052af5421bb6d637a5ae66f9c3 Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestJSON-1723185665-project Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 54768ef6-04c1-4a48-be47-c6286e20b1ef could not be found. Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '54768ef6-04c1-4a48-be47-c6286e20b1ef'} Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54768ef6-04c1-4a48-be47-c6286e20b1ef could not be found. Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54768ef6-04c1-4a48-be47-c6286e20b1ef could not be found. Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:58:48.275517 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:48.286194 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:58:48.286194 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:58:48.286194 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:58:48.286194 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:58:48.286194 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:58:48.286194 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54768ef6-04c1-4a48-be47-c6286e20b1ef could not be found. Sep 08 12:58:48.286194 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:58:48.286194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2cbeab44-7db0-4782-a78b-d5613c02bc43 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Returning 404 to user: Instance 54768ef6-04c1-4a48-be47-c6286e20b1ef could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:58:48.286194 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2cbeab44-7db0-4782-a78b-d5613c02bc43 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef" status: 404 len: 111 microversion: 2.1 time: 0.103297 Sep 08 12:58:48.286194 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1790/3436] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:48 2022] GET /compute/v2.1/servers/54768ef6-04c1-4a48-be47-c6286e20b1ef => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:58:48.291874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f2ff327-3d95-4887-bfae-92103c02a9cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:48.293369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1f2ff327-3d95-4887-bfae-92103c02a9cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:48.304372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f2ff327-3d95-4887-bfae-92103c02a9cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:48.304796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f2ff327-3d95-4887-bfae-92103c02a9cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:48.305258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f2ff327-3d95-4887-bfae-92103c02a9cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:48.306127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f2ff327-3d95-4887-bfae-92103c02a9cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:48.306597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f2ff327-3d95-4887-bfae-92103c02a9cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:48.307586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f2ff327-3d95-4887-bfae-92103c02a9cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:49.047857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1f2ff327-3d95-4887-bfae-92103c02a9cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:49.057287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f21179c7-ae65-4691-8405-0ce7abd56bfe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:49.069596 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1f2ff327-3d95-4887-bfae-92103c02a9cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 0.780165 Sep 08 12:58:49.083417 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1791/3437] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:48 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:49.083417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-762b1625-b961-49fd-95da-d80e2090f3e5 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] Calling method '.version_select at 0x7fdb35c0bdc0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:49.092073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f21179c7-ae65-4691-8405-0ce7abd56bfe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:49.095473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f21179c7-ae65-4691-8405-0ce7abd56bfe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:49.097641 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f21179c7-ae65-4691-8405-0ce7abd56bfe tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 1.305695 Sep 08 12:58:49.105843 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1647/3438] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:47 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:49.126286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-649da4f2-342f-42ca-8ce1-8dc02e32ebe9 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:49.130623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-649da4f2-342f-42ca-8ce1-8dc02e32ebe9 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:49.143896 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-762b1625-b961-49fd-95da-d80e2090f3e5 tempest-ServersTestJSON-1723185665 tempest-ServersTestJSON-1723185665-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1622738502" status: 202 len: 0 microversion: 2.1 time: 0.069989 Sep 08 12:58:49.150485 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1792/3439] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Sep 8 12:58:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1622738502 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:58:49.154635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f8c2e058-ce8b-4ed9-a77e-e5dcbd317ed3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:49.155851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f8c2e058-ce8b-4ed9-a77e-e5dcbd317ed3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:49.156651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:49.163324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8c2e058-ce8b-4ed9-a77e-e5dcbd317ed3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:49.163864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8c2e058-ce8b-4ed9-a77e-e5dcbd317ed3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:49.164307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8c2e058-ce8b-4ed9-a77e-e5dcbd317ed3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:49.164945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-649da4f2-342f-42ca-8ce1-8dc02e32ebe9 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:49.165191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8c2e058-ce8b-4ed9-a77e-e5dcbd317ed3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:49.165490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8c2e058-ce8b-4ed9-a77e-e5dcbd317ed3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:49.166086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8c2e058-ce8b-4ed9-a77e-e5dcbd317ed3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:49.170530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-649da4f2-342f-42ca-8ce1-8dc02e32ebe9 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:49.174578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-649da4f2-342f-42ca-8ce1-8dc02e32ebe9 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:49.177937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-649da4f2-342f-42ca-8ce1-8dc02e32ebe9 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:49.179215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-649da4f2-342f-42ca-8ce1-8dc02e32ebe9 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:49.181542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-649da4f2-342f-42ca-8ce1-8dc02e32ebe9 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:49.555883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-649da4f2-342f-42ca-8ce1-8dc02e32ebe9 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:49.572525 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-649da4f2-342f-42ca-8ce1-8dc02e32ebe9 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1323 microversion: 2.1 time: 0.462399 Sep 08 12:58:49.575590 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1648/3440] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:49 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1323 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:49.606198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f8c2e058-ce8b-4ed9-a77e-e5dcbd317ed3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:49.624098 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f8c2e058-ce8b-4ed9-a77e-e5dcbd317ed3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1328 microversion: 2.1 time: 0.473302 Sep 08 12:58:49.632757 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1793/3441] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:49 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1328 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:50.101350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5c5bc848-c0a1-4237-9ff8-0e110a4855e0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:50.104036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5c5bc848-c0a1-4237-9ff8-0e110a4855e0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:50.110385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c5bc848-c0a1-4237-9ff8-0e110a4855e0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:50.111434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c5bc848-c0a1-4237-9ff8-0e110a4855e0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:50.112506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c5bc848-c0a1-4237-9ff8-0e110a4855e0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:50.114157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c5bc848-c0a1-4237-9ff8-0e110a4855e0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:50.115399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c5bc848-c0a1-4237-9ff8-0e110a4855e0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:50.116512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c5bc848-c0a1-4237-9ff8-0e110a4855e0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:50.149864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d2e0abcb-31f0-402b-8e98-7835257d3394 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:50.158430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d2e0abcb-31f0-402b-8e98-7835257d3394 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:50.178763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2e0abcb-31f0-402b-8e98-7835257d3394 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:50.186497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2e0abcb-31f0-402b-8e98-7835257d3394 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:50.187163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2e0abcb-31f0-402b-8e98-7835257d3394 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:50.189134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2e0abcb-31f0-402b-8e98-7835257d3394 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:50.190161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2e0abcb-31f0-402b-8e98-7835257d3394 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:50.190986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2e0abcb-31f0-402b-8e98-7835257d3394 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:50.423133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5c5bc848-c0a1-4237-9ff8-0e110a4855e0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:50.439634 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5c5bc848-c0a1-4237-9ff8-0e110a4855e0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 0.336130 Sep 08 12:58:50.439634 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1649/3442] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:50 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:58:50.582920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c22e9b17-f48d-47c2-b62e-3d1a707df85f req-7136baa4-f30b-4929-9dd7-f8396f383f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302204af-5f35-498f-95f0-d0c03f99db4d", "name": "network-vif-plugged", "status": "completed", "tag": "ab03ff55-1f51-42da-a6b5-bb779cfab5f6"}, {"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-plugged", "status": "completed", "tag": "a4326ea5-099a-4095-b74c-dfca6dbbcf45"}, {"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-plugged", "status": "completed", "tag": "4b26731c-bba7-426c-9edd-565f551fa508"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:50.605964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c22e9b17-f48d-47c2-b62e-3d1a707df85f req-7136baa4-f30b-4929-9dd7-f8396f383f0d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:50.606627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c22e9b17-f48d-47c2-b62e-3d1a707df85f req-7136baa4-f30b-4929-9dd7-f8396f383f0d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:50.607402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c22e9b17-f48d-47c2-b62e-3d1a707df85f req-7136baa4-f30b-4929-9dd7-f8396f383f0d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:50.638926 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c22e9b17-f48d-47c2-b62e-3d1a707df85f req-7136baa4-f30b-4929-9dd7-f8396f383f0d service nova] Creating event network-vif-plugged:ab03ff55-1f51-42da-a6b5-bb779cfab5f6 for instance 302204af-5f35-498f-95f0-d0c03f99db4d on n-h2-852084-10 Sep 08 12:58:50.640187 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c22e9b17-f48d-47c2-b62e-3d1a707df85f req-7136baa4-f30b-4929-9dd7-f8396f383f0d service nova] Creating event network-vif-plugged:a4326ea5-099a-4095-b74c-dfca6dbbcf45 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:58:50.646963 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c22e9b17-f48d-47c2-b62e-3d1a707df85f req-7136baa4-f30b-4929-9dd7-f8396f383f0d service nova] Creating event network-vif-plugged:4b26731c-bba7-426c-9edd-565f551fa508 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:58:50.666560 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c22e9b17-f48d-47c2-b62e-3d1a707df85f req-7136baa4-f30b-4929-9dd7-f8396f383f0d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.087460 Sep 08 12:58:50.667706 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1650/3443] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 12:58:50.669971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d2e0abcb-31f0-402b-8e98-7835257d3394 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:50.675435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-86b50ad8-18fd-4863-882c-4b291d2080a6 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:50.684911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-86b50ad8-18fd-4863-882c-4b291d2080a6 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:50.706575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86b50ad8-18fd-4863-882c-4b291d2080a6 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:50.707402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86b50ad8-18fd-4863-882c-4b291d2080a6 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:50.708056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86b50ad8-18fd-4863-882c-4b291d2080a6 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:50.710470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86b50ad8-18fd-4863-882c-4b291d2080a6 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:50.711835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86b50ad8-18fd-4863-882c-4b291d2080a6 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:50.712288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86b50ad8-18fd-4863-882c-4b291d2080a6 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:50.772559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d2e0abcb-31f0-402b-8e98-7835257d3394 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:50.785688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d2e0abcb-31f0-402b-8e98-7835257d3394 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:50.796706 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d2e0abcb-31f0-402b-8e98-7835257d3394 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.670091 Sep 08 12:58:50.828130 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1794/3444] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:50 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:50.857853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-280aea60-001c-48fd-861e-c089d2e83073 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:50.864234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-280aea60-001c-48fd-861e-c089d2e83073 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:50.894938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-280aea60-001c-48fd-861e-c089d2e83073 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:50.895836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-280aea60-001c-48fd-861e-c089d2e83073 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:50.896626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-280aea60-001c-48fd-861e-c089d2e83073 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:50.898619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-280aea60-001c-48fd-861e-c089d2e83073 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:50.899769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-280aea60-001c-48fd-861e-c089d2e83073 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:50.900808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-280aea60-001c-48fd-861e-c089d2e83073 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:51.459343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-280aea60-001c-48fd-861e-c089d2e83073 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:51.481680 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-280aea60-001c-48fd-861e-c089d2e83073 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1328 microversion: 2.1 time: 0.637920 Sep 08 12:58:51.483976 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1795/3445] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:50 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1328 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:51.497880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca030ca3-341f-463a-aca5-6feb324d82ad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:51.499803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ca030ca3-341f-463a-aca5-6feb324d82ad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:51.515171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca030ca3-341f-463a-aca5-6feb324d82ad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:51.516741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca030ca3-341f-463a-aca5-6feb324d82ad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:51.519820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca030ca3-341f-463a-aca5-6feb324d82ad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:51.521485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca030ca3-341f-463a-aca5-6feb324d82ad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:51.522626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca030ca3-341f-463a-aca5-6feb324d82ad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:51.524396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca030ca3-341f-463a-aca5-6feb324d82ad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:51.533332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-86b50ad8-18fd-4863-882c-4b291d2080a6 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:51.564214 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-86b50ad8-18fd-4863-882c-4b291d2080a6 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1323 microversion: 2.1 time: 0.894466 Sep 08 12:58:51.578278 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1651/3446] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:50 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1323 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:51.653107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71760510-9cc6-4cb4-80b2-72eb42055892 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:51.658430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-71760510-9cc6-4cb4-80b2-72eb42055892 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:51.671414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71760510-9cc6-4cb4-80b2-72eb42055892 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:51.672726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71760510-9cc6-4cb4-80b2-72eb42055892 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:51.673833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71760510-9cc6-4cb4-80b2-72eb42055892 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:51.675548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71760510-9cc6-4cb4-80b2-72eb42055892 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:51.676635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71760510-9cc6-4cb4-80b2-72eb42055892 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:51.677753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71760510-9cc6-4cb4-80b2-72eb42055892 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:51.739068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ca030ca3-341f-463a-aca5-6feb324d82ad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:51.755325 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca030ca3-341f-463a-aca5-6feb324d82ad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 0.268717 Sep 08 12:58:51.756794 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1796/3447] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:51 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:51.836193 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-71760510-9cc6-4cb4-80b2-72eb42055892 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.190228 Sep 08 12:58:51.836615 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1652/3448] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:58:51 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:58:51.847580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e88fd93e-74e8-4c8b-bac3-14c52eae2268 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:51.848240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e88fd93e-74e8-4c8b-bac3-14c52eae2268 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:51.857121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c2af5cd8-a8c1-4acc-9d34-3ec8cfeb65fa tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:51.857835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c2af5cd8-a8c1-4acc-9d34-3ec8cfeb65fa tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:51.863357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e88fd93e-74e8-4c8b-bac3-14c52eae2268 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:51.864295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e88fd93e-74e8-4c8b-bac3-14c52eae2268 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:51.864745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e88fd93e-74e8-4c8b-bac3-14c52eae2268 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:51.865561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e88fd93e-74e8-4c8b-bac3-14c52eae2268 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:51.866022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e88fd93e-74e8-4c8b-bac3-14c52eae2268 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:51.866492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e88fd93e-74e8-4c8b-bac3-14c52eae2268 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:51.879213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2af5cd8-a8c1-4acc-9d34-3ec8cfeb65fa tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:51.880727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2af5cd8-a8c1-4acc-9d34-3ec8cfeb65fa tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:51.881510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2af5cd8-a8c1-4acc-9d34-3ec8cfeb65fa tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:51.885056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2af5cd8-a8c1-4acc-9d34-3ec8cfeb65fa tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:51.886117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2af5cd8-a8c1-4acc-9d34-3ec8cfeb65fa tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:51.888216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2af5cd8-a8c1-4acc-9d34-3ec8cfeb65fa tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:52.263578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e88fd93e-74e8-4c8b-bac3-14c52eae2268 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:52.275523 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e88fd93e-74e8-4c8b-bac3-14c52eae2268 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1672 microversion: 2.1 time: 0.433094 Sep 08 12:58:52.277161 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1797/3449] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:51 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1672 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:58:52.284566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c2af5cd8-a8c1-4acc-9d34-3ec8cfeb65fa tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:52.297023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c2af5cd8-a8c1-4acc-9d34-3ec8cfeb65fa tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:52.299120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c2af5cd8-a8c1-4acc-9d34-3ec8cfeb65fa tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:52.300873 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c2af5cd8-a8c1-4acc-9d34-3ec8cfeb65fa tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1880 microversion: 2.42 time: 0.448245 Sep 08 12:58:52.315634 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1653/3450] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:51 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1880 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:52.532342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c751b5d-a88b-4457-b535-e62c7ecdc259 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:52.533484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6c751b5d-a88b-4457-b535-e62c7ecdc259 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:52.561963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c751b5d-a88b-4457-b535-e62c7ecdc259 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:52.568599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c751b5d-a88b-4457-b535-e62c7ecdc259 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:52.569945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c751b5d-a88b-4457-b535-e62c7ecdc259 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:52.571649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c751b5d-a88b-4457-b535-e62c7ecdc259 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:52.575322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c751b5d-a88b-4457-b535-e62c7ecdc259 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:52.576473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c751b5d-a88b-4457-b535-e62c7ecdc259 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:52.620954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5743dc7-aaf9-46c2-bb49-859ea4dc24a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:52.624610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c5743dc7-aaf9-46c2-bb49-859ea4dc24a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:52.641084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5743dc7-aaf9-46c2-bb49-859ea4dc24a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:52.642330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5743dc7-aaf9-46c2-bb49-859ea4dc24a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:52.650505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5743dc7-aaf9-46c2-bb49-859ea4dc24a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:52.652330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5743dc7-aaf9-46c2-bb49-859ea4dc24a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:52.653506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5743dc7-aaf9-46c2-bb49-859ea4dc24a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:52.654609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5743dc7-aaf9-46c2-bb49-859ea4dc24a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:53.090915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c5743dc7-aaf9-46c2-bb49-859ea4dc24a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:53.092267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6c751b5d-a88b-4457-b535-e62c7ecdc259 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:53.101938 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6c751b5d-a88b-4457-b535-e62c7ecdc259 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1328 microversion: 2.1 time: 0.576791 Sep 08 12:58:53.103282 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1798/3451] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:52 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1328 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:53.108970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-603abada-40d0-47fd-b2eb-ee61fd0e8da5 req-f5bb2650-00b9-4f15-a949-c7d228423114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb61c338-cf63-45dc-97e7-a9b6ad019a63", "name": "network-vif-plugged", "status": "completed", "tag": "8ca3eda9-46fb-4ca4-8f47-250b1d3ba400"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:53.118751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:53.121671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-603abada-40d0-47fd-b2eb-ee61fd0e8da5 req-f5bb2650-00b9-4f15-a949-c7d228423114 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:53.123213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-603abada-40d0-47fd-b2eb-ee61fd0e8da5 req-f5bb2650-00b9-4f15-a949-c7d228423114 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:53.124720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-603abada-40d0-47fd-b2eb-ee61fd0e8da5 req-f5bb2650-00b9-4f15-a949-c7d228423114 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:53.133181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:53.146061 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-603abada-40d0-47fd-b2eb-ee61fd0e8da5 req-f5bb2650-00b9-4f15-a949-c7d228423114 service nova] Creating event network-vif-plugged:8ca3eda9-46fb-4ca4-8f47-250b1d3ba400 for instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 on n-h2-852084-10 Sep 08 12:58:53.159944 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c5743dc7-aaf9-46c2-bb49-859ea4dc24a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1323 microversion: 2.1 time: 0.548285 Sep 08 12:58:53.170457 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1654/3452] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:52 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1323 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:53.180183 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-603abada-40d0-47fd-b2eb-ee61fd0e8da5 req-f5bb2650-00b9-4f15-a949-c7d228423114 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048008 Sep 08 12:58:53.181736 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1799/3453] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:58:53.206078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54dfcb23-3bce-460b-b979-8eb12920cb04 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:53.207779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54dfcb23-3bce-460b-b979-8eb12920cb04 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:53.248114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54dfcb23-3bce-460b-b979-8eb12920cb04 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:53.251309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54dfcb23-3bce-460b-b979-8eb12920cb04 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:53.255594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54dfcb23-3bce-460b-b979-8eb12920cb04 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:53.258115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54dfcb23-3bce-460b-b979-8eb12920cb04 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:53.263295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54dfcb23-3bce-460b-b979-8eb12920cb04 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:53.267549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54dfcb23-3bce-460b-b979-8eb12920cb04 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:53.318814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4aa1ba19-9641-45a8-a1bc-7afc63229507 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:53.319752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4aa1ba19-9641-45a8-a1bc-7afc63229507 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:53.331640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa1ba19-9641-45a8-a1bc-7afc63229507 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:53.335283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa1ba19-9641-45a8-a1bc-7afc63229507 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:53.336241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa1ba19-9641-45a8-a1bc-7afc63229507 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:53.337469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa1ba19-9641-45a8-a1bc-7afc63229507 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:53.339350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa1ba19-9641-45a8-a1bc-7afc63229507 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:53.340088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa1ba19-9641-45a8-a1bc-7afc63229507 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:54.003973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4aa1ba19-9641-45a8-a1bc-7afc63229507 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:54.011639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54dfcb23-3bce-460b-b979-8eb12920cb04 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:54.028147 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4aa1ba19-9641-45a8-a1bc-7afc63229507 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1672 microversion: 2.1 time: 0.713442 Sep 08 12:58:54.047262 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54dfcb23-3bce-460b-b979-8eb12920cb04 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 0.858319 Sep 08 12:58:54.047262 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1655/3454] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:53 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:54.047262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-005bb915-b83b-418a-babb-7754c096b486 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:54.047262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-005bb915-b83b-418a-babb-7754c096b486 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:54.049307 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1800/3455] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:53 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1672 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:54.051418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-005bb915-b83b-418a-babb-7754c096b486 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:54.052338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-005bb915-b83b-418a-babb-7754c096b486 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:54.053044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-005bb915-b83b-418a-babb-7754c096b486 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:54.054869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-005bb915-b83b-418a-babb-7754c096b486 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:54.055872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-005bb915-b83b-418a-babb-7754c096b486 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:54.056977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-005bb915-b83b-418a-babb-7754c096b486 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:54.156479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-13816535-fec0-4886-8ed1-e7cd9cab282b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:54.157316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-13816535-fec0-4886-8ed1-e7cd9cab282b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:54.166005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13816535-fec0-4886-8ed1-e7cd9cab282b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:54.166669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13816535-fec0-4886-8ed1-e7cd9cab282b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:54.167216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13816535-fec0-4886-8ed1-e7cd9cab282b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:54.168163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13816535-fec0-4886-8ed1-e7cd9cab282b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:54.182269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13816535-fec0-4886-8ed1-e7cd9cab282b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:54.183747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13816535-fec0-4886-8ed1-e7cd9cab282b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:54.578395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-005bb915-b83b-418a-babb-7754c096b486 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:54.593485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-005bb915-b83b-418a-babb-7754c096b486 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:54.595075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-005bb915-b83b-418a-babb-7754c096b486 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:54.596477 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-005bb915-b83b-418a-babb-7754c096b486 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 2838 microversion: 2.42 time: 0.564056 Sep 08 12:58:54.615831 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1656/3456] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:58:54 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 2838 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:54.625374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eae3f4c7-4e99-4db0-8057-6ac2b44397fa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:54.631707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eae3f4c7-4e99-4db0-8057-6ac2b44397fa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:54.634799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-13816535-fec0-4886-8ed1-e7cd9cab282b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:54.640113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eae3f4c7-4e99-4db0-8057-6ac2b44397fa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:54.641252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eae3f4c7-4e99-4db0-8057-6ac2b44397fa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:54.641815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eae3f4c7-4e99-4db0-8057-6ac2b44397fa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:54.642582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eae3f4c7-4e99-4db0-8057-6ac2b44397fa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:54.643050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eae3f4c7-4e99-4db0-8057-6ac2b44397fa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:54.643793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eae3f4c7-4e99-4db0-8057-6ac2b44397fa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:54.658406 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-13816535-fec0-4886-8ed1-e7cd9cab282b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1510 microversion: 2.1 time: 0.500681 Sep 08 12:58:54.672678 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1801/3457] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:54 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1510 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:58:54.692051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d1908b02-9fa2-493d-bc8e-6d78bf111448 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:54.692552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d1908b02-9fa2-493d-bc8e-6d78bf111448 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:54.705801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1908b02-9fa2-493d-bc8e-6d78bf111448 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:54.706330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1908b02-9fa2-493d-bc8e-6d78bf111448 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:54.706810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1908b02-9fa2-493d-bc8e-6d78bf111448 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:54.707573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1908b02-9fa2-493d-bc8e-6d78bf111448 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:54.708051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1908b02-9fa2-493d-bc8e-6d78bf111448 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:54.708482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1908b02-9fa2-493d-bc8e-6d78bf111448 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:55.015100 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d1908b02-9fa2-493d-bc8e-6d78bf111448 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.340154 Sep 08 12:58:55.016454 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1802/3458] 10.222.0.78 () {60 vars in 1316 bytes} [Thu Sep 8 12:58:54 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6/os-interface => generated 1831 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:58:55.023052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-37f6ad35-26a4-4b61-9a1b-612da2ed4221 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:55.024803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-37f6ad35-26a4-4b61-9a1b-612da2ed4221 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:55.034159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37f6ad35-26a4-4b61-9a1b-612da2ed4221 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:55.035078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37f6ad35-26a4-4b61-9a1b-612da2ed4221 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:55.036179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37f6ad35-26a4-4b61-9a1b-612da2ed4221 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:55.039265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37f6ad35-26a4-4b61-9a1b-612da2ed4221 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:55.040576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37f6ad35-26a4-4b61-9a1b-612da2ed4221 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:55.041706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37f6ad35-26a4-4b61-9a1b-612da2ed4221 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:55.206687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eae3f4c7-4e99-4db0-8057-6ac2b44397fa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:55.216367 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eae3f4c7-4e99-4db0-8057-6ac2b44397fa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1323 microversion: 2.1 time: 0.599234 Sep 08 12:58:55.221439 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1657/3459] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:54 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1323 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:55.226893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1a8727e4-a554-432f-8093-585907cf5003 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:55.233959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1a8727e4-a554-432f-8093-585907cf5003 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:55.245673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a8727e4-a554-432f-8093-585907cf5003 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:55.246511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a8727e4-a554-432f-8093-585907cf5003 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:55.247149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a8727e4-a554-432f-8093-585907cf5003 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:55.249228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a8727e4-a554-432f-8093-585907cf5003 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:55.250022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a8727e4-a554-432f-8093-585907cf5003 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:55.250649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a8727e4-a554-432f-8093-585907cf5003 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:55.329114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-37f6ad35-26a4-4b61-9a1b-612da2ed4221 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:55.340015 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-37f6ad35-26a4-4b61-9a1b-612da2ed4221 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1510 microversion: 2.1 time: 0.322021 Sep 08 12:58:55.341386 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1803/3460] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:55 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1510 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:55.347099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c75b20ca-4145-43ab-99d5-2ffb57a33e31 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:55.348167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c75b20ca-4145-43ab-99d5-2ffb57a33e31 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:55.355090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c75b20ca-4145-43ab-99d5-2ffb57a33e31 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:55.356078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c75b20ca-4145-43ab-99d5-2ffb57a33e31 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:55.356857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c75b20ca-4145-43ab-99d5-2ffb57a33e31 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:55.357894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c75b20ca-4145-43ab-99d5-2ffb57a33e31 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:55.358637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c75b20ca-4145-43ab-99d5-2ffb57a33e31 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:55.359371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c75b20ca-4145-43ab-99d5-2ffb57a33e31 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:55.502217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1a8727e4-a554-432f-8093-585907cf5003 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:55.517256 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1a8727e4-a554-432f-8093-585907cf5003 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1677 microversion: 2.1 time: 0.294077 Sep 08 12:58:55.537295 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1658/3461] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:55 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1677 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:55.562625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7226bd10-3bab-4cd3-956c-6573ba99c89f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:55.563758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7226bd10-3bab-4cd3-956c-6573ba99c89f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:55.600197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7226bd10-3bab-4cd3-956c-6573ba99c89f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:55.602404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7226bd10-3bab-4cd3-956c-6573ba99c89f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:55.603262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7226bd10-3bab-4cd3-956c-6573ba99c89f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:55.604592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7226bd10-3bab-4cd3-956c-6573ba99c89f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:55.605553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7226bd10-3bab-4cd3-956c-6573ba99c89f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:55.607363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7226bd10-3bab-4cd3-956c-6573ba99c89f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:55.656292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:58:55.657059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c75b20ca-4145-43ab-99d5-2ffb57a33e31 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:55.667298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7226bd10-3bab-4cd3-956c-6573ba99c89f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:58:55.681040 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c75b20ca-4145-43ab-99d5-2ffb57a33e31 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 0.337711 Sep 08 12:58:55.683696 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1804/3462] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:55 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:55.791130 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7226bd10-3bab-4cd3-956c-6573ba99c89f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 204 len: 0 microversion: 2.1 time: 0.250897 Sep 08 12:58:55.792374 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1659/3463] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:58:55 2022] DELETE /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:58:55.804970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f0883c15-8bd2-4a63-a2e7-d6d066906546 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:55.806867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f0883c15-8bd2-4a63-a2e7-d6d066906546 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:55.817487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0883c15-8bd2-4a63-a2e7-d6d066906546 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:55.818216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0883c15-8bd2-4a63-a2e7-d6d066906546 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:55.818956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0883c15-8bd2-4a63-a2e7-d6d066906546 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:55.820278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0883c15-8bd2-4a63-a2e7-d6d066906546 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:55.821097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0883c15-8bd2-4a63-a2e7-d6d066906546 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:55.822826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0883c15-8bd2-4a63-a2e7-d6d066906546 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:56.091737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f0883c15-8bd2-4a63-a2e7-d6d066906546 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:56.110955 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f0883c15-8bd2-4a63-a2e7-d6d066906546 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1516 microversion: 2.1 time: 0.313449 Sep 08 12:58:56.112561 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1805/3464] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:55 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:56.242269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5fb47291-e471-45e1-8141-92b9b77f6941 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:56.243840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5fb47291-e471-45e1-8141-92b9b77f6941 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:56.253582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fb47291-e471-45e1-8141-92b9b77f6941 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:56.254408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fb47291-e471-45e1-8141-92b9b77f6941 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:56.255056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fb47291-e471-45e1-8141-92b9b77f6941 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:56.257025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fb47291-e471-45e1-8141-92b9b77f6941 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:56.257882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fb47291-e471-45e1-8141-92b9b77f6941 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:56.258573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fb47291-e471-45e1-8141-92b9b77f6941 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:56.515011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5fb47291-e471-45e1-8141-92b9b77f6941 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:56.526446 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5fb47291-e471-45e1-8141-92b9b77f6941 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1518 microversion: 2.1 time: 0.288224 Sep 08 12:58:56.545173 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1660/3465] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:56 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1518 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:58:56.552104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-16fa22fd-be5c-4c80-ac5d-efaaf86a7885 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:58:56.555400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-16fa22fd-be5c-4c80-ac5d-efaaf86a7885 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:56.564304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16fa22fd-be5c-4c80-ac5d-efaaf86a7885 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:56.570726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d52c0d20-7dab-4f77-a439-c3d9e3edf909 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:56.572150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d52c0d20-7dab-4f77-a439-c3d9e3edf909 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:56.576328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16fa22fd-be5c-4c80-ac5d-efaaf86a7885 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:56.577189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16fa22fd-be5c-4c80-ac5d-efaaf86a7885 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:56.578262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16fa22fd-be5c-4c80-ac5d-efaaf86a7885 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:56.578933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16fa22fd-be5c-4c80-ac5d-efaaf86a7885 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:56.580860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16fa22fd-be5c-4c80-ac5d-efaaf86a7885 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:56.589957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d52c0d20-7dab-4f77-a439-c3d9e3edf909 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:56.591030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d52c0d20-7dab-4f77-a439-c3d9e3edf909 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:56.592683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d52c0d20-7dab-4f77-a439-c3d9e3edf909 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:56.593779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d52c0d20-7dab-4f77-a439-c3d9e3edf909 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:56.611825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d52c0d20-7dab-4f77-a439-c3d9e3edf909 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:56.614801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d52c0d20-7dab-4f77-a439-c3d9e3edf909 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:56.671197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-16fa22fd-be5c-4c80-ac5d-efaaf86a7885 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lazy-loading 'flavor' on Instance uuid bb61c338-cf63-45dc-97e7-a9b6ad019a63 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:58:56.885667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d52c0d20-7dab-4f77-a439-c3d9e3edf909 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:56.897872 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-16fa22fd-be5c-4c80-ac5d-efaaf86a7885 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "POST /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63/action" status: 200 len: 32 microversion: 2.1 time: 0.349080 Sep 08 12:58:56.901254 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1806/3466] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:58:56 2022] POST /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63/action => generated 32 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 12:58:56.916036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac340440-686a-434b-bd2d-8bb935650c57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:56.917156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ac340440-686a-434b-bd2d-8bb935650c57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:56.922080 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d52c0d20-7dab-4f77-a439-c3d9e3edf909 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1677 microversion: 2.1 time: 0.355574 Sep 08 12:58:56.924030 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1661/3467] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:56 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1677 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:58:56.933598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac340440-686a-434b-bd2d-8bb935650c57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:56.934099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac340440-686a-434b-bd2d-8bb935650c57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:56.934549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac340440-686a-434b-bd2d-8bb935650c57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:56.935288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac340440-686a-434b-bd2d-8bb935650c57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:56.935566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-41eef931-ee30-4c51-ae78-511709daf4ee tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:56.937012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-41eef931-ee30-4c51-ae78-511709daf4ee tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:56.938258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac340440-686a-434b-bd2d-8bb935650c57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:56.938786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac340440-686a-434b-bd2d-8bb935650c57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:56.954603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41eef931-ee30-4c51-ae78-511709daf4ee tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:56.955985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41eef931-ee30-4c51-ae78-511709daf4ee tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:56.957016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41eef931-ee30-4c51-ae78-511709daf4ee tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:56.958564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41eef931-ee30-4c51-ae78-511709daf4ee tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:56.960852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41eef931-ee30-4c51-ae78-511709daf4ee tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:56.962548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41eef931-ee30-4c51-ae78-511709daf4ee tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:57.453928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-41eef931-ee30-4c51-ae78-511709daf4ee tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:57.468611 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-41eef931-ee30-4c51-ae78-511709daf4ee tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 0.542572 Sep 08 12:58:57.473303 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1662/3468] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:56 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:57.494382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-202ed06b-5e81-44d4-a869-c7395e242343 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:57.498064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-202ed06b-5e81-44d4-a869-c7395e242343 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:57.512438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202ed06b-5e81-44d4-a869-c7395e242343 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:57.515850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202ed06b-5e81-44d4-a869-c7395e242343 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:57.518198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202ed06b-5e81-44d4-a869-c7395e242343 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:57.519501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202ed06b-5e81-44d4-a869-c7395e242343 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:57.520210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202ed06b-5e81-44d4-a869-c7395e242343 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:57.521014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202ed06b-5e81-44d4-a869-c7395e242343 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:57.802832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ac340440-686a-434b-bd2d-8bb935650c57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:57.821684 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ac340440-686a-434b-bd2d-8bb935650c57 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 0.918580 Sep 08 12:58:57.834949 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1807/3469] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:56 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:57.969437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9f4f5e84-fbca-4d0a-9331-ba8221951704 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:57.970453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9f4f5e84-fbca-4d0a-9331-ba8221951704 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:57.982092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f4f5e84-fbca-4d0a-9331-ba8221951704 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:57.984840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f4f5e84-fbca-4d0a-9331-ba8221951704 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:57.985585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f4f5e84-fbca-4d0a-9331-ba8221951704 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:57.988865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f4f5e84-fbca-4d0a-9331-ba8221951704 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:57.989633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f4f5e84-fbca-4d0a-9331-ba8221951704 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:57.992061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f4f5e84-fbca-4d0a-9331-ba8221951704 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:58.984163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-202ed06b-5e81-44d4-a869-c7395e242343 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:59.013815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9f4f5e84-fbca-4d0a-9331-ba8221951704 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:59.020857 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-202ed06b-5e81-44d4-a869-c7395e242343 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1516 microversion: 2.1 time: 1.544547 Sep 08 12:58:59.026101 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9f4f5e84-fbca-4d0a-9331-ba8221951704 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1677 microversion: 2.1 time: 1.060868 Sep 08 12:58:59.026802 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1663/3470] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:57 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1516 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:59.035460 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1808/3471] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:57 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1677 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:58:59.047282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a1d1cfab-43c6-485e-ae08-fa30b2781740 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:59.050601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a1d1cfab-43c6-485e-ae08-fa30b2781740 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:59.061101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-410b331b-ab61-49e5-8e3b-55d5fa91ec41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:58:59.062246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-410b331b-ab61-49e5-8e3b-55d5fa91ec41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:58:59.080828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-410b331b-ab61-49e5-8e3b-55d5fa91ec41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:59.085610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1d1cfab-43c6-485e-ae08-fa30b2781740 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:59.086557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1d1cfab-43c6-485e-ae08-fa30b2781740 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:59.087074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-410b331b-ab61-49e5-8e3b-55d5fa91ec41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:59.088056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-410b331b-ab61-49e5-8e3b-55d5fa91ec41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:59.088915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-410b331b-ab61-49e5-8e3b-55d5fa91ec41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:59.089385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-410b331b-ab61-49e5-8e3b-55d5fa91ec41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:59.090008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-410b331b-ab61-49e5-8e3b-55d5fa91ec41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:59.096989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1d1cfab-43c6-485e-ae08-fa30b2781740 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:59.098636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1d1cfab-43c6-485e-ae08-fa30b2781740 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:58:59.099556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1d1cfab-43c6-485e-ae08-fa30b2781740 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:58:59.100353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1d1cfab-43c6-485e-ae08-fa30b2781740 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:58:59.752048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-410b331b-ab61-49e5-8e3b-55d5fa91ec41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:59.766317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a1d1cfab-43c6-485e-ae08-fa30b2781740 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:58:59.815892 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-410b331b-ab61-49e5-8e3b-55d5fa91ec41 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 0.776170 Sep 08 12:58:59.816294 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a1d1cfab-43c6-485e-ae08-fa30b2781740 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 0.781650 Sep 08 12:58:59.817724 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1664/3472] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:59 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:58:59.850581 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1809/3473] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:58:59 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:00.063160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f066ce70-cd12-467a-ba07-f71ac1c6a14a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:00.079816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f066ce70-cd12-467a-ba07-f71ac1c6a14a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:00.120272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a5f3d886-59ae-4d6f-bdb6-cbb902d5b66a req-bfabee38-1b37-420f-9587-804467576fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "tag": "3466f05e-6efb-423f-9ac1-92190128aa45"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:00.150967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f066ce70-cd12-467a-ba07-f71ac1c6a14a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:00.152115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f066ce70-cd12-467a-ba07-f71ac1c6a14a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:00.153062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f066ce70-cd12-467a-ba07-f71ac1c6a14a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:00.154503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f066ce70-cd12-467a-ba07-f71ac1c6a14a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:00.166815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f066ce70-cd12-467a-ba07-f71ac1c6a14a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:00.176383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f066ce70-cd12-467a-ba07-f71ac1c6a14a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:00.193102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a5f3d886-59ae-4d6f-bdb6-cbb902d5b66a req-bfabee38-1b37-420f-9587-804467576fd7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:00.208443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a5f3d886-59ae-4d6f-bdb6-cbb902d5b66a req-bfabee38-1b37-420f-9587-804467576fd7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:00.216440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a5f3d886-59ae-4d6f-bdb6-cbb902d5b66a req-bfabee38-1b37-420f-9587-804467576fd7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:00.322511 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a5f3d886-59ae-4d6f-bdb6-cbb902d5b66a req-bfabee38-1b37-420f-9587-804467576fd7 service nova] Creating event network-changed:3466f05e-6efb-423f-9ac1-92190128aa45 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 12:59:00.366519 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a5f3d886-59ae-4d6f-bdb6-cbb902d5b66a req-bfabee38-1b37-420f-9587-804467576fd7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.501155 Sep 08 12:59:00.374944 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1810/3474] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:00.432457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52ea47f1-9273-4e1b-b9bd-3649439021b5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:00.436484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-52ea47f1-9273-4e1b-b9bd-3649439021b5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:00.469767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52ea47f1-9273-4e1b-b9bd-3649439021b5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:00.480364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52ea47f1-9273-4e1b-b9bd-3649439021b5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:00.484428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52ea47f1-9273-4e1b-b9bd-3649439021b5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:00.486089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52ea47f1-9273-4e1b-b9bd-3649439021b5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:00.491302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52ea47f1-9273-4e1b-b9bd-3649439021b5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:00.496874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52ea47f1-9273-4e1b-b9bd-3649439021b5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:00.863777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-52ea47f1-9273-4e1b-b9bd-3649439021b5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:00.927280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f066ce70-cd12-467a-ba07-f71ac1c6a14a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:00.935749 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-52ea47f1-9273-4e1b-b9bd-3649439021b5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1474 microversion: 2.1 time: 0.555972 Sep 08 12:59:00.941354 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f066ce70-cd12-467a-ba07-f71ac1c6a14a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1677 microversion: 2.1 time: 0.891553 Sep 08 12:59:00.944007 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1811/3475] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:00 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1474 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:00.948656 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1665/3476] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:00 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1677 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:00.961586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7da0dc57-0464-4ddc-9bd1-b11a1907a505 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:00.962240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7da0dc57-0464-4ddc-9bd1-b11a1907a505 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:00.975823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7da0dc57-0464-4ddc-9bd1-b11a1907a505 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:00.976333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7da0dc57-0464-4ddc-9bd1-b11a1907a505 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:00.976790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7da0dc57-0464-4ddc-9bd1-b11a1907a505 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:00.977545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7da0dc57-0464-4ddc-9bd1-b11a1907a505 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:00.978015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7da0dc57-0464-4ddc-9bd1-b11a1907a505 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:00.978447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7da0dc57-0464-4ddc-9bd1-b11a1907a505 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:01.041824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-95d5fbcc-7c25-4664-b625-0fb552aecbbc req-beea1911-9f6e-498d-9b27-fbea3e059ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "302204af-5f35-498f-95f0-d0c03f99db4d", "name": "network-vif-deleted", "tag": "ab03ff55-1f51-42da-a6b5-bb779cfab5f6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:01.085648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-95d5fbcc-7c25-4664-b625-0fb552aecbbc req-beea1911-9f6e-498d-9b27-fbea3e059ce9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:01.090329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-95d5fbcc-7c25-4664-b625-0fb552aecbbc req-beea1911-9f6e-498d-9b27-fbea3e059ce9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:01.091591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-95d5fbcc-7c25-4664-b625-0fb552aecbbc req-beea1911-9f6e-498d-9b27-fbea3e059ce9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:01.143701 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-95d5fbcc-7c25-4664-b625-0fb552aecbbc req-beea1911-9f6e-498d-9b27-fbea3e059ce9 service nova] Creating event network-vif-deleted:ab03ff55-1f51-42da-a6b5-bb779cfab5f6 for instance 302204af-5f35-498f-95f0-d0c03f99db4d on n-h2-852084-10 Sep 08 12:59:01.170070 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-95d5fbcc-7c25-4664-b625-0fb552aecbbc req-beea1911-9f6e-498d-9b27-fbea3e059ce9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219847 Sep 08 12:59:01.176085 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1812/3477] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:59:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:01.200728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2d0b8299-ec09-4d67-9841-abc2567493d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:01.204555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2d0b8299-ec09-4d67-9841-abc2567493d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:01.231559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d0b8299-ec09-4d67-9841-abc2567493d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:01.233406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d0b8299-ec09-4d67-9841-abc2567493d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:01.234482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d0b8299-ec09-4d67-9841-abc2567493d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:01.236100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d0b8299-ec09-4d67-9841-abc2567493d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:01.237261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d0b8299-ec09-4d67-9841-abc2567493d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:01.238325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d0b8299-ec09-4d67-9841-abc2567493d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:02.110175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7da0dc57-0464-4ddc-9bd1-b11a1907a505 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:02.127158 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7da0dc57-0464-4ddc-9bd1-b11a1907a505 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 1.170396 Sep 08 12:59:02.128579 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1666/3478] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:00 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:02.134509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:02.136075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:02.154299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2d0b8299-ec09-4d67-9841-abc2567493d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:02.165520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:02.172019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:02.175496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:02.178723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:02.182927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:02.184110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:02.215773 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2d0b8299-ec09-4d67-9841-abc2567493d3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 1.036834 Sep 08 12:59:02.222330 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1813/3479] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:01 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:02.261335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:02.261879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:02.262276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:02.262954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lazy-loading 'fault' on Instance uuid 302204af-5f35-498f-95f0-d0c03f99db4d {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 12:59:02.272519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e8695a1-1d2d-47dc-b900-633b77f8cec1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:02.277897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2e8695a1-1d2d-47dc-b900-633b77f8cec1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:02.314145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e8695a1-1d2d-47dc-b900-633b77f8cec1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:02.314997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e8695a1-1d2d-47dc-b900-633b77f8cec1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:02.315703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e8695a1-1d2d-47dc-b900-633b77f8cec1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:02.317145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e8695a1-1d2d-47dc-b900-633b77f8cec1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:02.317857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e8695a1-1d2d-47dc-b900-633b77f8cec1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:02.318571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e8695a1-1d2d-47dc-b900-633b77f8cec1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:02.379069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:02.403979 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1f7928f2-fbb8-4210-9652-12f024b79ae0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 200 len: 1318 microversion: 2.1 time: 0.269361 Sep 08 12:59:02.408431 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1667/3480] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:02 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:02.730341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1678382866", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "e42a03e0-f5a8-43ba-9725-51d67d76359d"}], "security_groups": [{"name": "tempest-securitygroup--85030922"}], "key_name": "tempest-keypair-1427006036", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "2fd2a35c-af79-42ae-965b-6bbe3fb75c1a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:02.957535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2e8695a1-1d2d-47dc-b900-633b77f8cec1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:02.980909 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2e8695a1-1d2d-47dc-b900-633b77f8cec1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.756456 Sep 08 12:59:02.986885 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1814/3481] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:02 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:03.188726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b23db9f-5ca1-4bb5-9a01-284b7291f9a0 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:03.197815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7b23db9f-5ca1-4bb5-9a01-284b7291f9a0 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:03.216659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b23db9f-5ca1-4bb5-9a01-284b7291f9a0 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:03.218358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b23db9f-5ca1-4bb5-9a01-284b7291f9a0 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:03.219180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b23db9f-5ca1-4bb5-9a01-284b7291f9a0 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:03.220415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b23db9f-5ca1-4bb5-9a01-284b7291f9a0 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:03.221323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b23db9f-5ca1-4bb5-9a01-284b7291f9a0 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:03.222079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b23db9f-5ca1-4bb5-9a01-284b7291f9a0 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:03.251576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] validate_networks() for [('e42a03e0-f5a8-43ba-9725-51d67d76359d', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:59:03.593277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b23db9f-5ca1-4bb5-9a01-284b7291f9a0 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:03.610374 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7b23db9f-5ca1-4bb5-9a01-284b7291f9a0 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 0.440018 Sep 08 12:59:03.611608 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1815/3482] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:03 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:59:03.620317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-782f4985-9b9d-4520-9a64-9265cc519dd2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:03.621242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-782f4985-9b9d-4520-9a64-9265cc519dd2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:03.638610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-782f4985-9b9d-4520-9a64-9265cc519dd2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:03.640824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-782f4985-9b9d-4520-9a64-9265cc519dd2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:03.641732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-782f4985-9b9d-4520-9a64-9265cc519dd2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:03.643110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-782f4985-9b9d-4520-9a64-9265cc519dd2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:03.644341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-782f4985-9b9d-4520-9a64-9265cc519dd2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:03.645456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-782f4985-9b9d-4520-9a64-9265cc519dd2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:03.654194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:04.060137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-782f4985-9b9d-4520-9a64-9265cc519dd2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:04.086528 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-782f4985-9b9d-4520-9a64-9265cc519dd2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 0.473028 Sep 08 12:59:04.087816 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1816/3483] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:03 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:04.105094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ffca57a4-cfe6-44e5-b022-b39978d96265 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:04.106743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ffca57a4-cfe6-44e5-b022-b39978d96265 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:04.121153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffca57a4-cfe6-44e5-b022-b39978d96265 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:04.122679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffca57a4-cfe6-44e5-b022-b39978d96265 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:04.123892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffca57a4-cfe6-44e5-b022-b39978d96265 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:04.125607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffca57a4-cfe6-44e5-b022-b39978d96265 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:04.126792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffca57a4-cfe6-44e5-b022-b39978d96265 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:04.127987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ffca57a4-cfe6-44e5-b022-b39978d96265 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:04.162585 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-ffca57a4-cfe6-44e5-b022-b39978d96265 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ffca57a4-cfe6-44e5-b022-b39978d96265 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d HTTP/1.1 Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '302204af-5f35-498f-95f0-d0c03f99db4d'} Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:59:04.165995 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 12:59:04.183808 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 12:59:04.183808 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 12:59:04.183808 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 12:59:04.183808 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 12:59:04.183808 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 12:59:04.183808 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 12:59:04.183808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ffca57a4-cfe6-44e5-b022-b39978d96265 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 12:59:04.183808 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ffca57a4-cfe6-44e5-b022-b39978d96265 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 404 len: 111 microversion: 2.1 time: 0.083359 Sep 08 12:59:04.183808 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1817/3484] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:04 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 12:59:04.191442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5bc79d46-0b8f-442d-bcb7-e25f3a32c38c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '.version_select at 0x7fdb3c8b4ca0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:04.234620 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5bc79d46-0b8f-442d-bcb7-e25f3a32c38c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-key-781520443" status: 202 len: 0 microversion: 2.1 time: 0.052559 Sep 08 12:59:04.235470 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1818/3485] 10.222.0.78 () {58 vars in 1206 bytes} [Thu Sep 8 12:59:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-781520443 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:59:04.290153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Getting quotas for project 74106d62b334496789cc796af8d57108. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:59:04.298325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Getting quotas for user 2a4f6ebbc0454860bd27ce22250b92d2 and project 74106d62b334496789cc796af8d57108. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:59:04.319430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:59:04.319854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:59:04.320332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:59:04.321569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:59:04.322138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:59:04.337171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:04.337678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:04.338404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:04.339194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:04.339698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:04.340131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:04.370572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Getting quotas for project 74106d62b334496789cc796af8d57108. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:59:04.379421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Getting quotas for user 2a4f6ebbc0454860bd27ce22250b92d2 and project 74106d62b334496789cc796af8d57108. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:59:04.413958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-905276522", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "e905a95c-2324-49bd-8a89-bae4286a1b74"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:04.498154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:59:04.501189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2fd2a35c-af79-42ae-965b-6bbe3fb75c1a',volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:59:04.514490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] validate_networks() for [('e905a95c-2324-49bd-8a89-bae4286a1b74', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:59:04.806119 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-84f088b2-c010-4681-9d98-089e056c72e7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.085167 Sep 08 12:59:04.807068 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1668/3486] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:59:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 2087 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:59:04.813832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3bfa61a4-b2d0-470d-9961-51188270daab tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:04.814463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3bfa61a4-b2d0-470d-9961-51188270daab tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:04.822464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bfa61a4-b2d0-470d-9961-51188270daab tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:04.822964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bfa61a4-b2d0-470d-9961-51188270daab tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:04.823560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bfa61a4-b2d0-470d-9961-51188270daab tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:04.824272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bfa61a4-b2d0-470d-9961-51188270daab tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:04.824740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bfa61a4-b2d0-470d-9961-51188270daab tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:04.825168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bfa61a4-b2d0-470d-9961-51188270daab tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:05.243593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3bfa61a4-b2d0-470d-9961-51188270daab tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:05.268852 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3bfa61a4-b2d0-470d-9961-51188270daab tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 0.460061 Sep 08 12:59:05.280346 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1669/3487] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:04 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:05.293068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0b39edc-3efc-40d9-a2fb-0a439c08df42 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:05.294123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0b39edc-3efc-40d9-a2fb-0a439c08df42 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:05.491087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0b39edc-3efc-40d9-a2fb-0a439c08df42 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:05.509346 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0b39edc-3efc-40d9-a2fb-0a439c08df42 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1122 microversion: 2.1 time: 0.227205 Sep 08 12:59:05.510378 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1670/3488] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:05 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1122 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:05.573819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f076ac8a-0056-43cb-acc2-cedfd66e92c2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:05.575006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f076ac8a-0056-43cb-acc2-cedfd66e92c2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:05.607571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f076ac8a-0056-43cb-acc2-cedfd66e92c2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:05.608222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f076ac8a-0056-43cb-acc2-cedfd66e92c2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:05.608680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f076ac8a-0056-43cb-acc2-cedfd66e92c2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:05.612867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f076ac8a-0056-43cb-acc2-cedfd66e92c2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:05.614184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f076ac8a-0056-43cb-acc2-cedfd66e92c2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:05.614398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:59:05.615342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f076ac8a-0056-43cb-acc2-cedfd66e92c2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:05.615532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:59:05.624387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:59:05.625198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:59:05.625973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:59:05.695526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:05.696507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:05.700530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:05.702444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:05.702951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:05.707177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:05.781416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:59:05.795121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for user 227ef616a0764f5eaff5988f8a470f0c and project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:59:05.831061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:59:05.836348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:59:05.861363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f076ac8a-0056-43cb-acc2-cedfd66e92c2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:05.870262 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f076ac8a-0056-43cb-acc2-cedfd66e92c2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 0.322736 Sep 08 12:59:05.870860 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1671/3489] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:05 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:05.913980 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3c38f64a-0ff3-4596-a9d3-8d783ca127ac tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.506435 Sep 08 12:59:05.915343 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1819/3490] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1509 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:59:05.933655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4e02bdc1-aa34-416f-9fda-4d9d9981e49b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:05.935165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4e02bdc1-aa34-416f-9fda-4d9d9981e49b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:06.024702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4e02bdc1-aa34-416f-9fda-4d9d9981e49b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:06.033868 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4e02bdc1-aa34-416f-9fda-4d9d9981e49b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1208 microversion: 2.1 time: 0.110340 Sep 08 12:59:06.047985 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1672/3491] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:05 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1208 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:59:06.294591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eeed44eb-4065-463f-bcf6-e737fc436208 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:06.295809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eeed44eb-4065-463f-bcf6-e737fc436208 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:06.323335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eeed44eb-4065-463f-bcf6-e737fc436208 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:06.323991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eeed44eb-4065-463f-bcf6-e737fc436208 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:06.324388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eeed44eb-4065-463f-bcf6-e737fc436208 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:06.325153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eeed44eb-4065-463f-bcf6-e737fc436208 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:06.325622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eeed44eb-4065-463f-bcf6-e737fc436208 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:06.326322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eeed44eb-4065-463f-bcf6-e737fc436208 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:06.549976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d1700cfd-b09e-4f79-a527-b19c24e40cd5 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:06.551413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d1700cfd-b09e-4f79-a527-b19c24e40cd5 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:06.568910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1700cfd-b09e-4f79-a527-b19c24e40cd5 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:06.571027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1700cfd-b09e-4f79-a527-b19c24e40cd5 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:06.573385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1700cfd-b09e-4f79-a527-b19c24e40cd5 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:06.575018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1700cfd-b09e-4f79-a527-b19c24e40cd5 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:06.576899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1700cfd-b09e-4f79-a527-b19c24e40cd5 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:06.577747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1700cfd-b09e-4f79-a527-b19c24e40cd5 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:06.685793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eeed44eb-4065-463f-bcf6-e737fc436208 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:06.700473 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eeed44eb-4065-463f-bcf6-e737fc436208 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 0.410500 Sep 08 12:59:06.716030 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1820/3492] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:06 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:06.760831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d1700cfd-b09e-4f79-a527-b19c24e40cd5 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:06.773573 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d1700cfd-b09e-4f79-a527-b19c24e40cd5 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1220 microversion: 2.1 time: 0.230035 Sep 08 12:59:06.775782 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1673/3493] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:06 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1220 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:06.911165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-269a5a79-ec4a-427f-8382-686988757096 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:06.911815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-269a5a79-ec4a-427f-8382-686988757096 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:06.920634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-269a5a79-ec4a-427f-8382-686988757096 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:06.921777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-269a5a79-ec4a-427f-8382-686988757096 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:06.922360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-269a5a79-ec4a-427f-8382-686988757096 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:06.923199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-269a5a79-ec4a-427f-8382-686988757096 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:06.923748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-269a5a79-ec4a-427f-8382-686988757096 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:06.924301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-269a5a79-ec4a-427f-8382-686988757096 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:07.062018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-82eb9e58-ac8a-4e34-92f3-ca5dd000048e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:07.063337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-82eb9e58-ac8a-4e34-92f3-ca5dd000048e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:07.073655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82eb9e58-ac8a-4e34-92f3-ca5dd000048e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:07.074156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82eb9e58-ac8a-4e34-92f3-ca5dd000048e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:07.074679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82eb9e58-ac8a-4e34-92f3-ca5dd000048e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:07.075657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82eb9e58-ac8a-4e34-92f3-ca5dd000048e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:07.076242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82eb9e58-ac8a-4e34-92f3-ca5dd000048e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:07.077470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82eb9e58-ac8a-4e34-92f3-ca5dd000048e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:07.156647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-269a5a79-ec4a-427f-8382-686988757096 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:07.174966 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-269a5a79-ec4a-427f-8382-686988757096 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1508 microversion: 2.1 time: 0.266327 Sep 08 12:59:07.200748 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1821/3494] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:06 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1508 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:07.229343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-82eb9e58-ac8a-4e34-92f3-ca5dd000048e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:07.239202 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-82eb9e58-ac8a-4e34-92f3-ca5dd000048e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1204 microversion: 2.1 time: 0.182789 Sep 08 12:59:07.255318 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1674/3495] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:07 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1204 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:07.733965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0808663c-a466-474b-bc48-a8b2194a4bfa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:07.736345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0808663c-a466-474b-bc48-a8b2194a4bfa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:07.755282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0808663c-a466-474b-bc48-a8b2194a4bfa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:07.755855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0808663c-a466-474b-bc48-a8b2194a4bfa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:07.756309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0808663c-a466-474b-bc48-a8b2194a4bfa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:07.757061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0808663c-a466-474b-bc48-a8b2194a4bfa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:07.757639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0808663c-a466-474b-bc48-a8b2194a4bfa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:07.758080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0808663c-a466-474b-bc48-a8b2194a4bfa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:07.801346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db189c3c-1879-433b-a557-9dd381261fc2 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:07.803153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-db189c3c-1879-433b-a557-9dd381261fc2 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:07.812711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db189c3c-1879-433b-a557-9dd381261fc2 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:07.813619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db189c3c-1879-433b-a557-9dd381261fc2 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:07.814316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db189c3c-1879-433b-a557-9dd381261fc2 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:07.815664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db189c3c-1879-433b-a557-9dd381261fc2 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:07.816475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db189c3c-1879-433b-a557-9dd381261fc2 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:07.817197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db189c3c-1879-433b-a557-9dd381261fc2 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:08.044564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-db189c3c-1879-433b-a557-9dd381261fc2 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:08.067893 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-db189c3c-1879-433b-a557-9dd381261fc2 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1238 microversion: 2.1 time: 0.270643 Sep 08 12:59:08.068977 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1675/3496] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:07 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1238 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:08.206744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0808663c-a466-474b-bc48-a8b2194a4bfa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:08.215612 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0808663c-a466-474b-bc48-a8b2194a4bfa tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 0.489288 Sep 08 12:59:08.222248 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1822/3497] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:07 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:08.260618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bd3d9e75-f80b-42b3-a08b-62a0bfafd52d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:08.262022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bd3d9e75-f80b-42b3-a08b-62a0bfafd52d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:08.270675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee380323-41f5-45f5-aca7-25531d515d03 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:08.271672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ee380323-41f5-45f5-aca7-25531d515d03 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:08.276244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd3d9e75-f80b-42b3-a08b-62a0bfafd52d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:08.278281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd3d9e75-f80b-42b3-a08b-62a0bfafd52d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:08.281148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd3d9e75-f80b-42b3-a08b-62a0bfafd52d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:08.283116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd3d9e75-f80b-42b3-a08b-62a0bfafd52d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:08.284379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd3d9e75-f80b-42b3-a08b-62a0bfafd52d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:08.285470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd3d9e75-f80b-42b3-a08b-62a0bfafd52d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:08.292117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee380323-41f5-45f5-aca7-25531d515d03 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:08.293649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee380323-41f5-45f5-aca7-25531d515d03 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:08.294615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee380323-41f5-45f5-aca7-25531d515d03 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:08.299388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee380323-41f5-45f5-aca7-25531d515d03 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:08.300522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee380323-41f5-45f5-aca7-25531d515d03 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:08.302316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee380323-41f5-45f5-aca7-25531d515d03 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:08.526285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ee380323-41f5-45f5-aca7-25531d515d03 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:08.557870 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee380323-41f5-45f5-aca7-25531d515d03 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1268 microversion: 2.1 time: 0.291965 Sep 08 12:59:08.559113 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1823/3498] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:08 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1268 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:59:08.944608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bd3d9e75-f80b-42b3-a08b-62a0bfafd52d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:08.967944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:08.975907 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bd3d9e75-f80b-42b3-a08b-62a0bfafd52d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1529 microversion: 2.1 time: 0.756365 Sep 08 12:59:08.976645 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1676/3499] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:08 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1529 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:09.100518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-91afbe81-1c4a-4d15-a81c-9c7d4e8273bd tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:09.105946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-91afbe81-1c4a-4d15-a81c-9c7d4e8273bd tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:09.141698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91afbe81-1c4a-4d15-a81c-9c7d4e8273bd tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:09.149655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91afbe81-1c4a-4d15-a81c-9c7d4e8273bd tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:09.150856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91afbe81-1c4a-4d15-a81c-9c7d4e8273bd tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:09.152497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91afbe81-1c4a-4d15-a81c-9c7d4e8273bd tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:09.154798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91afbe81-1c4a-4d15-a81c-9c7d4e8273bd tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:09.157986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91afbe81-1c4a-4d15-a81c-9c7d4e8273bd tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:09.265060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-629ede27-8a69-4579-936a-b571c4659134 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:09.265819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-629ede27-8a69-4579-936a-b571c4659134 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:09.291049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-629ede27-8a69-4579-936a-b571c4659134 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:09.291666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-629ede27-8a69-4579-936a-b571c4659134 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:09.292116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-629ede27-8a69-4579-936a-b571c4659134 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:09.300988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-629ede27-8a69-4579-936a-b571c4659134 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:09.305679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-629ede27-8a69-4579-936a-b571c4659134 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:09.306950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-629ede27-8a69-4579-936a-b571c4659134 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:09.920755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-629ede27-8a69-4579-936a-b571c4659134 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:09.940969 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-629ede27-8a69-4579-936a-b571c4659134 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 0.679767 Sep 08 12:59:09.945743 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1677/3500] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:09 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:09.959033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-64f4272c-a13b-4116-a9ed-861708e78af3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:09.964854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-64f4272c-a13b-4116-a9ed-861708e78af3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:10.018306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64f4272c-a13b-4116-a9ed-861708e78af3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:10.026789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64f4272c-a13b-4116-a9ed-861708e78af3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:10.027315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64f4272c-a13b-4116-a9ed-861708e78af3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:10.029501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64f4272c-a13b-4116-a9ed-861708e78af3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:10.031334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64f4272c-a13b-4116-a9ed-861708e78af3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:10.032054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64f4272c-a13b-4116-a9ed-861708e78af3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:10.139733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-91afbe81-1c4a-4d15-a81c-9c7d4e8273bd tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:10.149335 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-91afbe81-1c4a-4d15-a81c-9c7d4e8273bd tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1304 microversion: 2.1 time: 1.057701 Sep 08 12:59:10.149987 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1824/3501] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:09 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1304 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:10.165639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75d0f467-0d98-4ed3-9eb2-004b9e22b954 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:10.167391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-75d0f467-0d98-4ed3-9eb2-004b9e22b954 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:10.176894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75d0f467-0d98-4ed3-9eb2-004b9e22b954 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:10.177809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75d0f467-0d98-4ed3-9eb2-004b9e22b954 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:10.178658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75d0f467-0d98-4ed3-9eb2-004b9e22b954 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:10.179758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75d0f467-0d98-4ed3-9eb2-004b9e22b954 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:10.180481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75d0f467-0d98-4ed3-9eb2-004b9e22b954 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:10.181135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75d0f467-0d98-4ed3-9eb2-004b9e22b954 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:10.985730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-64f4272c-a13b-4116-a9ed-861708e78af3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:11.004805 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-64f4272c-a13b-4116-a9ed-861708e78af3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1266 microversion: 2.1 time: 1.057784 Sep 08 12:59:11.022873 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1678/3502] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:09 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1266 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:11.053463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-567de75e-9cce-41fe-bd6c-6db233f488ef tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:11.056435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-567de75e-9cce-41fe-bd6c-6db233f488ef tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:11.086734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-567de75e-9cce-41fe-bd6c-6db233f488ef tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:11.089588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-567de75e-9cce-41fe-bd6c-6db233f488ef tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:11.090154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-567de75e-9cce-41fe-bd6c-6db233f488ef tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:11.090939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-567de75e-9cce-41fe-bd6c-6db233f488ef tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:11.093821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-567de75e-9cce-41fe-bd6c-6db233f488ef tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:11.094299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-567de75e-9cce-41fe-bd6c-6db233f488ef tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:11.925743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-75d0f467-0d98-4ed3-9eb2-004b9e22b954 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:11.939727 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-75d0f467-0d98-4ed3-9eb2-004b9e22b954 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 1.788529 Sep 08 12:59:11.940341 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1825/3503] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:10 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:11.951798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33eb9209-4789-43dd-b56f-24e0d0f24137 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:11.956417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-33eb9209-4789-43dd-b56f-24e0d0f24137 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:11.975483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33eb9209-4789-43dd-b56f-24e0d0f24137 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:11.980589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33eb9209-4789-43dd-b56f-24e0d0f24137 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:11.984540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33eb9209-4789-43dd-b56f-24e0d0f24137 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:11.985657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33eb9209-4789-43dd-b56f-24e0d0f24137 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:11.986331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33eb9209-4789-43dd-b56f-24e0d0f24137 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:11.986955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33eb9209-4789-43dd-b56f-24e0d0f24137 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:12.750555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-567de75e-9cce-41fe-bd6c-6db233f488ef tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:12.804572 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-567de75e-9cce-41fe-bd6c-6db233f488ef tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 1.779649 Sep 08 12:59:12.806526 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1679/3504] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:11 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:12.842545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-08068fc5-1bbf-4988-9336-7f8ba04a3806 req-060e86aa-80d8-4e1d-ab65-c3a39f6164a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd61063e-36fc-477d-8522-b95318528acd", "name": "network-vif-plugged", "status": "completed", "tag": "1d545eb1-3599-4f99-9fcc-5cc1c14cd7d6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:12.868474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:12.873870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-08068fc5-1bbf-4988-9336-7f8ba04a3806 req-060e86aa-80d8-4e1d-ab65-c3a39f6164a0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:12.877501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-08068fc5-1bbf-4988-9336-7f8ba04a3806 req-060e86aa-80d8-4e1d-ab65-c3a39f6164a0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:12.879920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-08068fc5-1bbf-4988-9336-7f8ba04a3806 req-060e86aa-80d8-4e1d-ab65-c3a39f6164a0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:12.910932 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-08068fc5-1bbf-4988-9336-7f8ba04a3806 req-060e86aa-80d8-4e1d-ab65-c3a39f6164a0 service nova] Creating event network-vif-plugged:1d545eb1-3599-4f99-9fcc-5cc1c14cd7d6 for instance bd61063e-36fc-477d-8522-b95318528acd on n-h2-852084-10 Sep 08 12:59:12.918494 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-08068fc5-1bbf-4988-9336-7f8ba04a3806 req-060e86aa-80d8-4e1d-ab65-c3a39f6164a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104231 Sep 08 12:59:12.921261 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1680/3505] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:59:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:12.934158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2e86303f-4df3-4d1d-8188-6d9e7cac832b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:12.936453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2e86303f-4df3-4d1d-8188-6d9e7cac832b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:12.949034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e86303f-4df3-4d1d-8188-6d9e7cac832b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:12.949892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e86303f-4df3-4d1d-8188-6d9e7cac832b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:12.951043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e86303f-4df3-4d1d-8188-6d9e7cac832b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:12.953263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e86303f-4df3-4d1d-8188-6d9e7cac832b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:12.953972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e86303f-4df3-4d1d-8188-6d9e7cac832b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:12.954599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e86303f-4df3-4d1d-8188-6d9e7cac832b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:13.147690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-33eb9209-4789-43dd-b56f-24e0d0f24137 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:13.177263 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-33eb9209-4789-43dd-b56f-24e0d0f24137 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1304 microversion: 2.1 time: 1.235215 Sep 08 12:59:13.191864 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1826/3506] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:11 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1304 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:13.209120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0e2903ff-5c41-4bf3-b092-2b6acb617322 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:13.211999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0e2903ff-5c41-4bf3-b092-2b6acb617322 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:13.245278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e2903ff-5c41-4bf3-b092-2b6acb617322 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:13.258874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e2903ff-5c41-4bf3-b092-2b6acb617322 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:13.259375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e2903ff-5c41-4bf3-b092-2b6acb617322 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:13.260145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e2903ff-5c41-4bf3-b092-2b6acb617322 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:13.260616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e2903ff-5c41-4bf3-b092-2b6acb617322 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:13.265973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e2903ff-5c41-4bf3-b092-2b6acb617322 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:13.759822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2e86303f-4df3-4d1d-8188-6d9e7cac832b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:13.804006 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2e86303f-4df3-4d1d-8188-6d9e7cac832b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1308 microversion: 2.1 time: 0.879366 Sep 08 12:59:13.838955 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1681/3507] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:12 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1308 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:13.866286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2cec439-6982-4cd9-9be8-95ec0fb6c8a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:13.874263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2cec439-6982-4cd9-9be8-95ec0fb6c8a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:13.906953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2cec439-6982-4cd9-9be8-95ec0fb6c8a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:13.907523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2cec439-6982-4cd9-9be8-95ec0fb6c8a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:13.913173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2cec439-6982-4cd9-9be8-95ec0fb6c8a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:13.914521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2cec439-6982-4cd9-9be8-95ec0fb6c8a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:13.915250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2cec439-6982-4cd9-9be8-95ec0fb6c8a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:13.915887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2cec439-6982-4cd9-9be8-95ec0fb6c8a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:14.354899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:14.904153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f2cec439-6982-4cd9-9be8-95ec0fb6c8a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:14.918564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0e2903ff-5c41-4bf3-b092-2b6acb617322 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:14.937031 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0e2903ff-5c41-4bf3-b092-2b6acb617322 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 1.743071 Sep 08 12:59:14.939552 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2cec439-6982-4cd9-9be8-95ec0fb6c8a8 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 1.080345 Sep 08 12:59:14.951780 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1827/3508] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:13 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 1748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:14.953650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-db1b6245-cd6e-4899-b3e7-042cb4f24af2 req-c641950d-92c8-4477-9bb1-3cb8d64badf6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccf7350-edf4-471c-8050-c3f5c15b4921", "tag": "237533ab-a565-46f1-9f7a-774c5326474d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:14.954389 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1682/3509] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:13 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:14.994407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-223bf02c-8841-46be-b16b-80d1bfb57e89 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:14.995616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-223bf02c-8841-46be-b16b-80d1bfb57e89 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:14.996342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-db1b6245-cd6e-4899-b3e7-042cb4f24af2 req-c641950d-92c8-4477-9bb1-3cb8d64badf6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:15.002894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-db1b6245-cd6e-4899-b3e7-042cb4f24af2 req-c641950d-92c8-4477-9bb1-3cb8d64badf6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:15.003469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-db1b6245-cd6e-4899-b3e7-042cb4f24af2 req-c641950d-92c8-4477-9bb1-3cb8d64badf6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:15.028727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-223bf02c-8841-46be-b16b-80d1bfb57e89 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:15.034637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-223bf02c-8841-46be-b16b-80d1bfb57e89 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:15.035950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-223bf02c-8841-46be-b16b-80d1bfb57e89 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:15.040028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-223bf02c-8841-46be-b16b-80d1bfb57e89 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:15.043814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-223bf02c-8841-46be-b16b-80d1bfb57e89 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:15.045717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-223bf02c-8841-46be-b16b-80d1bfb57e89 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:15.050004 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-db1b6245-cd6e-4899-b3e7-042cb4f24af2 req-c641950d-92c8-4477-9bb1-3cb8d64badf6 service nova] Creating event network-changed:237533ab-a565-46f1-9f7a-774c5326474d for instance 5ccf7350-edf4-471c-8050-c3f5c15b4921 on n-h1-852084-10 Sep 08 12:59:15.077227 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-db1b6245-cd6e-4899-b3e7-042cb4f24af2 req-c641950d-92c8-4477-9bb1-3cb8d64badf6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131628 Sep 08 12:59:15.081046 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1828/3510] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:59:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:15.105077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7485e671-ee7d-40d8-8779-a9943fa598b7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:15.109015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7485e671-ee7d-40d8-8779-a9943fa598b7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:15.141701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7485e671-ee7d-40d8-8779-a9943fa598b7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:15.145563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7485e671-ee7d-40d8-8779-a9943fa598b7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:15.150561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7485e671-ee7d-40d8-8779-a9943fa598b7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:15.156875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7485e671-ee7d-40d8-8779-a9943fa598b7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:15.158301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7485e671-ee7d-40d8-8779-a9943fa598b7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:15.158793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7485e671-ee7d-40d8-8779-a9943fa598b7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:15.736269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:15.816317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:15.957393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-223bf02c-8841-46be-b16b-80d1bfb57e89 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:15.982136 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-223bf02c-8841-46be-b16b-80d1bfb57e89 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1304 microversion: 2.1 time: 1.024405 Sep 08 12:59:15.986363 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1683/3511] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:14 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1304 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:16.004240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d15b5d99-93c3-4321-8620-9ca68d8cf3e4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:16.004240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d15b5d99-93c3-4321-8620-9ca68d8cf3e4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:16.029605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=14 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:16.032384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d15b5d99-93c3-4321-8620-9ca68d8cf3e4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:16.032919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d15b5d99-93c3-4321-8620-9ca68d8cf3e4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:16.036921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d15b5d99-93c3-4321-8620-9ca68d8cf3e4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:16.037747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d15b5d99-93c3-4321-8620-9ca68d8cf3e4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:16.038246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d15b5d99-93c3-4321-8620-9ca68d8cf3e4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:16.038704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d15b5d99-93c3-4321-8620-9ca68d8cf3e4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:16.065302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7485e671-ee7d-40d8-8779-a9943fa598b7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:16.077847 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7485e671-ee7d-40d8-8779-a9943fa598b7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1308 microversion: 2.1 time: 0.994661 Sep 08 12:59:16.083540 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1829/3512] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:15 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1308 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:16.099895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f3e0cded-2d7b-483a-88e6-5f5c170a622b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:16.100595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f3e0cded-2d7b-483a-88e6-5f5c170a622b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:16.136578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3e0cded-2d7b-483a-88e6-5f5c170a622b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:16.137090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3e0cded-2d7b-483a-88e6-5f5c170a622b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:16.137554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3e0cded-2d7b-483a-88e6-5f5c170a622b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:16.138306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3e0cded-2d7b-483a-88e6-5f5c170a622b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:16.146434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3e0cded-2d7b-483a-88e6-5f5c170a622b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:16.147005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3e0cded-2d7b-483a-88e6-5f5c170a622b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:16.923423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f3e0cded-2d7b-483a-88e6-5f5c170a622b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:16.967374 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f3e0cded-2d7b-483a-88e6-5f5c170a622b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 0.881317 Sep 08 12:59:16.969039 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1830/3513] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:16 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:17.021689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-0b0e75e3-0db4-49bd-a909-6238c4942bd5 req-d5f6a8cc-95cc-4cde-bbf7-261638d6110c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f5c17a5-8282-4299-b6c1-13159d0a3a7a", "tag": "8c808abb-3d3c-4c13-b0fa-a96783346388"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:17.045476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0b0e75e3-0db4-49bd-a909-6238c4942bd5 req-d5f6a8cc-95cc-4cde-bbf7-261638d6110c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:17.046824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0b0e75e3-0db4-49bd-a909-6238c4942bd5 req-d5f6a8cc-95cc-4cde-bbf7-261638d6110c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:17.049492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0b0e75e3-0db4-49bd-a909-6238c4942bd5 req-d5f6a8cc-95cc-4cde-bbf7-261638d6110c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:17.079482 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-0b0e75e3-0db4-49bd-a909-6238c4942bd5 req-d5f6a8cc-95cc-4cde-bbf7-261638d6110c service nova] Creating event network-changed:8c808abb-3d3c-4c13-b0fa-a96783346388 for instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a on n-h1-852084-10 Sep 08 12:59:17.104348 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-0b0e75e3-0db4-49bd-a909-6238c4942bd5 req-d5f6a8cc-95cc-4cde-bbf7-261638d6110c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103423 Sep 08 12:59:17.109719 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1831/3514] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:17.126349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9979f6c5-f525-4087-9ff9-202681d6fafe tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:17.129018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9979f6c5-f525-4087-9ff9-202681d6fafe tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:17.142418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9979f6c5-f525-4087-9ff9-202681d6fafe tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:17.143561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9979f6c5-f525-4087-9ff9-202681d6fafe tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:17.144810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9979f6c5-f525-4087-9ff9-202681d6fafe tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:17.146310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9979f6c5-f525-4087-9ff9-202681d6fafe tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:17.148444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9979f6c5-f525-4087-9ff9-202681d6fafe tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:17.149419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9979f6c5-f525-4087-9ff9-202681d6fafe tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:17.528171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d15b5d99-93c3-4321-8620-9ca68d8cf3e4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:17.567538 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d15b5d99-93c3-4321-8620-9ca68d8cf3e4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 1.577707 Sep 08 12:59:17.572698 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1684/3515] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:15 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:17.588976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7482a540-e2db-4f4f-af6e-11fe18745a31 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:17.593357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7482a540-e2db-4f4f-af6e-11fe18745a31 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:17.614815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7482a540-e2db-4f4f-af6e-11fe18745a31 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:17.617106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7482a540-e2db-4f4f-af6e-11fe18745a31 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:17.620343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7482a540-e2db-4f4f-af6e-11fe18745a31 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:17.624086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7482a540-e2db-4f4f-af6e-11fe18745a31 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:17.625806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7482a540-e2db-4f4f-af6e-11fe18745a31 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:17.648384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7482a540-e2db-4f4f-af6e-11fe18745a31 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:18.070142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9979f6c5-f525-4087-9ff9-202681d6fafe tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:18.103323 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9979f6c5-f525-4087-9ff9-202681d6fafe tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1304 microversion: 2.1 time: 0.989619 Sep 08 12:59:18.104613 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1832/3516] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:17 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1304 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:18.121685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8cf45e8f-059f-470a-8223-cb4ce638b9bf tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:18.123025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8cf45e8f-059f-470a-8223-cb4ce638b9bf tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:18.139171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cf45e8f-059f-470a-8223-cb4ce638b9bf tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:18.140193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cf45e8f-059f-470a-8223-cb4ce638b9bf tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:18.141055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cf45e8f-059f-470a-8223-cb4ce638b9bf tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:18.142272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cf45e8f-059f-470a-8223-cb4ce638b9bf tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:18.143314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cf45e8f-059f-470a-8223-cb4ce638b9bf tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:18.144393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cf45e8f-059f-470a-8223-cb4ce638b9bf tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:18.534410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7482a540-e2db-4f4f-af6e-11fe18745a31 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:18.545554 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7482a540-e2db-4f4f-af6e-11fe18745a31 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1308 microversion: 2.1 time: 0.966902 Sep 08 12:59:18.546346 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1685/3517] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:17 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1308 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:18.599691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8cf45e8f-059f-470a-8223-cb4ce638b9bf tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:18.604732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cfa0ee7c-2a4a-4a95-b4ec-10dd14a4326f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:18.605810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cfa0ee7c-2a4a-4a95-b4ec-10dd14a4326f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:18.621824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfa0ee7c-2a4a-4a95-b4ec-10dd14a4326f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:18.623021 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8cf45e8f-059f-470a-8223-cb4ce638b9bf tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 0.511703 Sep 08 12:59:18.624038 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1833/3518] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:18 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:18.625568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfa0ee7c-2a4a-4a95-b4ec-10dd14a4326f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:18.626272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfa0ee7c-2a4a-4a95-b4ec-10dd14a4326f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:18.628131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfa0ee7c-2a4a-4a95-b4ec-10dd14a4326f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:18.631366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfa0ee7c-2a4a-4a95-b4ec-10dd14a4326f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:18.632454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfa0ee7c-2a4a-4a95-b4ec-10dd14a4326f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:18.869679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cfa0ee7c-2a4a-4a95-b4ec-10dd14a4326f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:18.884083 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cfa0ee7c-2a4a-4a95-b4ec-10dd14a4326f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 0.289055 Sep 08 12:59:18.887455 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1686/3519] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:18 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:19.131550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4f034694-1998-446e-83e9-fd18d345dcac tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:19.132764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4f034694-1998-446e-83e9-fd18d345dcac tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:19.144927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f034694-1998-446e-83e9-fd18d345dcac tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:19.146042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f034694-1998-446e-83e9-fd18d345dcac tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:19.152184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f034694-1998-446e-83e9-fd18d345dcac tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:19.153293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f034694-1998-446e-83e9-fd18d345dcac tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:19.153964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f034694-1998-446e-83e9-fd18d345dcac tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:19.155400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f034694-1998-446e-83e9-fd18d345dcac tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:19.592096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3de5cce-d490-478b-9df0-1976620c1ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:19.598155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d3de5cce-d490-478b-9df0-1976620c1ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:19.613268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3de5cce-d490-478b-9df0-1976620c1ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:19.614982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3de5cce-d490-478b-9df0-1976620c1ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:19.625517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3de5cce-d490-478b-9df0-1976620c1ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:19.628575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3de5cce-d490-478b-9df0-1976620c1ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:19.631337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3de5cce-d490-478b-9df0-1976620c1ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:19.631337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3de5cce-d490-478b-9df0-1976620c1ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:20.216425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d3de5cce-d490-478b-9df0-1976620c1ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:20.232499 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3de5cce-d490-478b-9df0-1976620c1ce9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1308 microversion: 2.1 time: 0.650835 Sep 08 12:59:20.244156 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1687/3520] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:19 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1308 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:20.259268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d9cc85ad-07b1-473c-afda-42513458ae75 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:20.261014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d9cc85ad-07b1-473c-afda-42513458ae75 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:20.267428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4f034694-1998-446e-83e9-fd18d345dcac tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:20.280651 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4f034694-1998-446e-83e9-fd18d345dcac tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1304 microversion: 2.1 time: 1.154662 Sep 08 12:59:20.281935 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1834/3521] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:19 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1304 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:59:20.286614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9cc85ad-07b1-473c-afda-42513458ae75 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:20.288304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-958495a7-0dcc-4adf-b148-764bf9100c83 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:20.289209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-958495a7-0dcc-4adf-b148-764bf9100c83 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:20.291581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9cc85ad-07b1-473c-afda-42513458ae75 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:20.293423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9cc85ad-07b1-473c-afda-42513458ae75 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:20.297671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9cc85ad-07b1-473c-afda-42513458ae75 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:20.298487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-958495a7-0dcc-4adf-b148-764bf9100c83 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:20.299250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-958495a7-0dcc-4adf-b148-764bf9100c83 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:20.299925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-958495a7-0dcc-4adf-b148-764bf9100c83 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:20.300620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9cc85ad-07b1-473c-afda-42513458ae75 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:20.301307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-958495a7-0dcc-4adf-b148-764bf9100c83 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:20.301995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-958495a7-0dcc-4adf-b148-764bf9100c83 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:20.302667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-958495a7-0dcc-4adf-b148-764bf9100c83 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:20.307436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9cc85ad-07b1-473c-afda-42513458ae75 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:21.167890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-958495a7-0dcc-4adf-b148-764bf9100c83 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:21.172835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d9cc85ad-07b1-473c-afda-42513458ae75 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:21.184899 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d9cc85ad-07b1-473c-afda-42513458ae75 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 0.939179 Sep 08 12:59:21.191250 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1688/3522] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:20 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:21.212984 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-958495a7-0dcc-4adf-b148-764bf9100c83 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 0.929253 Sep 08 12:59:21.218669 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1835/3523] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:20 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:21.277976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-793f2c3b-645b-46e5-8a2c-b5a5eb2e11a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:21.279542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-793f2c3b-645b-46e5-8a2c-b5a5eb2e11a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:21.308794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-793f2c3b-645b-46e5-8a2c-b5a5eb2e11a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:21.312744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-793f2c3b-645b-46e5-8a2c-b5a5eb2e11a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:21.314325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-42d97afd-070e-4a64-8a3d-b46c4202f12f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:21.315043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-793f2c3b-645b-46e5-8a2c-b5a5eb2e11a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:21.317882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-42d97afd-070e-4a64-8a3d-b46c4202f12f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:21.320173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-793f2c3b-645b-46e5-8a2c-b5a5eb2e11a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:21.325868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-793f2c3b-645b-46e5-8a2c-b5a5eb2e11a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:21.332259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-793f2c3b-645b-46e5-8a2c-b5a5eb2e11a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:21.367085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42d97afd-070e-4a64-8a3d-b46c4202f12f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:21.398687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42d97afd-070e-4a64-8a3d-b46c4202f12f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.031s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:21.399525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42d97afd-070e-4a64-8a3d-b46c4202f12f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:21.400999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42d97afd-070e-4a64-8a3d-b46c4202f12f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:21.401890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42d97afd-070e-4a64-8a3d-b46c4202f12f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:21.402689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42d97afd-070e-4a64-8a3d-b46c4202f12f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:21.523514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:22.526235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-793f2c3b-645b-46e5-8a2c-b5a5eb2e11a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:22.563451 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-793f2c3b-645b-46e5-8a2c-b5a5eb2e11a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1308 microversion: 2.1 time: 1.292025 Sep 08 12:59:22.568893 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1689/3524] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:21 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1308 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:22.589650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2068e561-9bc2-43e2-b244-4159255ed091 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:22.591353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2068e561-9bc2-43e2-b244-4159255ed091 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:22.608280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2068e561-9bc2-43e2-b244-4159255ed091 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:22.609759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2068e561-9bc2-43e2-b244-4159255ed091 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:22.610975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2068e561-9bc2-43e2-b244-4159255ed091 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:22.612973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2068e561-9bc2-43e2-b244-4159255ed091 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:22.614263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2068e561-9bc2-43e2-b244-4159255ed091 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:22.615265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2068e561-9bc2-43e2-b244-4159255ed091 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:22.692112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-42d97afd-070e-4a64-8a3d-b46c4202f12f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:22.721825 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-42d97afd-070e-4a64-8a3d-b46c4202f12f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1292 microversion: 2.1 time: 1.414031 Sep 08 12:59:22.740080 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1836/3525] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:21 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1292 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 12:59:22.760955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f326b811-fd40-4fbd-9b21-fd43dae6be7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:22.770705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f326b811-fd40-4fbd-9b21-fd43dae6be7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:22.783793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f326b811-fd40-4fbd-9b21-fd43dae6be7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:22.785483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f326b811-fd40-4fbd-9b21-fd43dae6be7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:22.787327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f326b811-fd40-4fbd-9b21-fd43dae6be7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:22.790869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f326b811-fd40-4fbd-9b21-fd43dae6be7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:22.792340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f326b811-fd40-4fbd-9b21-fd43dae6be7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:22.794504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f326b811-fd40-4fbd-9b21-fd43dae6be7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:24.001447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f326b811-fd40-4fbd-9b21-fd43dae6be7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:24.050726 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f326b811-fd40-4fbd-9b21-fd43dae6be7d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 1.303070 Sep 08 12:59:24.051873 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1837/3526] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:22 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:24.059849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2068e561-9bc2-43e2-b244-4159255ed091 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:24.081242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26cc6aee-118e-4299-8017-650fd6bef823 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:24.083109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-26cc6aee-118e-4299-8017-650fd6bef823 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:24.101951 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2068e561-9bc2-43e2-b244-4159255ed091 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 1.516163 Sep 08 12:59:24.103934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:24.107679 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1690/3527] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:22 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 1537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:24.112267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26cc6aee-118e-4299-8017-650fd6bef823 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:24.113747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26cc6aee-118e-4299-8017-650fd6bef823 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:24.114841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26cc6aee-118e-4299-8017-650fd6bef823 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:24.116655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26cc6aee-118e-4299-8017-650fd6bef823 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:24.117788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26cc6aee-118e-4299-8017-650fd6bef823 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:24.118827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26cc6aee-118e-4299-8017-650fd6bef823 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:24.134731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bbfd0d7f-c423-48c3-8b8c-0026dcc5e3c7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:24.137706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bbfd0d7f-c423-48c3-8b8c-0026dcc5e3c7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:24.178964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbfd0d7f-c423-48c3-8b8c-0026dcc5e3c7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:24.183689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbfd0d7f-c423-48c3-8b8c-0026dcc5e3c7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:24.188594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbfd0d7f-c423-48c3-8b8c-0026dcc5e3c7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:24.194005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbfd0d7f-c423-48c3-8b8c-0026dcc5e3c7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:24.199773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbfd0d7f-c423-48c3-8b8c-0026dcc5e3c7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:24.199773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbfd0d7f-c423-48c3-8b8c-0026dcc5e3c7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:24.835679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26cc6aee-118e-4299-8017-650fd6bef823 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:24.866909 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-26cc6aee-118e-4299-8017-650fd6bef823 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1308 microversion: 2.1 time: 0.811130 Sep 08 12:59:24.879085 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1838/3528] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:24 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1308 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:24.895984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-0b288dc8-def4-4d91-84c1-09780dd3ea6c req-d5dea851-4ce8-45ac-9f6c-905bc7e6cd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5c17a5-8282-4299-b6c1-13159d0a3a7a", "name": "network-vif-plugged", "status": "completed", "tag": "8c808abb-3d3c-4c13-b0fa-a96783346388"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:24.936877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0b288dc8-def4-4d91-84c1-09780dd3ea6c req-d5dea851-4ce8-45ac-9f6c-905bc7e6cd88 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:24.938728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0b288dc8-def4-4d91-84c1-09780dd3ea6c req-d5dea851-4ce8-45ac-9f6c-905bc7e6cd88 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:24.942288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0b288dc8-def4-4d91-84c1-09780dd3ea6c req-d5dea851-4ce8-45ac-9f6c-905bc7e6cd88 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:24.950700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bbfd0d7f-c423-48c3-8b8c-0026dcc5e3c7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:24.996587 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bbfd0d7f-c423-48c3-8b8c-0026dcc5e3c7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1292 microversion: 2.1 time: 0.883667 Sep 08 12:59:24.997088 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-0b288dc8-def4-4d91-84c1-09780dd3ea6c req-d5dea851-4ce8-45ac-9f6c-905bc7e6cd88 service nova] Creating event network-vif-plugged:8c808abb-3d3c-4c13-b0fa-a96783346388 for instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a on n-h1-852084-10 Sep 08 12:59:24.997427 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1691/3529] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:24 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1292 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:25.019646 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-0b288dc8-def4-4d91-84c1-09780dd3ea6c req-d5dea851-4ce8-45ac-9f6c-905bc7e6cd88 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135942 Sep 08 12:59:25.037382 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1839/3530] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:25.102578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f4822fb1-5344-47e0-a707-1eb2b385285b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:25.117239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f4822fb1-5344-47e0-a707-1eb2b385285b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:25.139198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7bf8fb96-e041-4ce9-aa1c-df68eaa35adc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:25.140860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7bf8fb96-e041-4ce9-aa1c-df68eaa35adc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:25.166791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4822fb1-5344-47e0-a707-1eb2b385285b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:25.167414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4822fb1-5344-47e0-a707-1eb2b385285b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:25.167898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4822fb1-5344-47e0-a707-1eb2b385285b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:25.168713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4822fb1-5344-47e0-a707-1eb2b385285b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:25.169203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4822fb1-5344-47e0-a707-1eb2b385285b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:25.170244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4822fb1-5344-47e0-a707-1eb2b385285b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:25.187461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bf8fb96-e041-4ce9-aa1c-df68eaa35adc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:25.188449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bf8fb96-e041-4ce9-aa1c-df68eaa35adc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:25.188919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bf8fb96-e041-4ce9-aa1c-df68eaa35adc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:25.189925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bf8fb96-e041-4ce9-aa1c-df68eaa35adc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:25.190665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bf8fb96-e041-4ce9-aa1c-df68eaa35adc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:25.214627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bf8fb96-e041-4ce9-aa1c-df68eaa35adc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:25.941138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7bf8fb96-e041-4ce9-aa1c-df68eaa35adc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:25.957771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f4822fb1-5344-47e0-a707-1eb2b385285b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:25.995679 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f4822fb1-5344-47e0-a707-1eb2b385285b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 0.897652 Sep 08 12:59:25.998263 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1692/3531] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:25 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:26.026586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-adc09670-4326-4cea-acdb-cdd5c2e3b227 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:26.035799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-adc09670-4326-4cea-acdb-cdd5c2e3b227 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:26.036813 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7bf8fb96-e041-4ce9-aa1c-df68eaa35adc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 0.899066 Sep 08 12:59:26.047806 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1840/3532] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:25 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:26.098741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-61727b1f-05fe-400d-b23b-20dbf40a0f3b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:26.102337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-adc09670-4326-4cea-acdb-cdd5c2e3b227 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:26.104764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-adc09670-4326-4cea-acdb-cdd5c2e3b227 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:26.110066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-adc09670-4326-4cea-acdb-cdd5c2e3b227 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:26.111317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-61727b1f-05fe-400d-b23b-20dbf40a0f3b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:26.113294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-adc09670-4326-4cea-acdb-cdd5c2e3b227 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:26.118370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-adc09670-4326-4cea-acdb-cdd5c2e3b227 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:26.119641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-adc09670-4326-4cea-acdb-cdd5c2e3b227 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:26.150951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61727b1f-05fe-400d-b23b-20dbf40a0f3b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:26.155349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61727b1f-05fe-400d-b23b-20dbf40a0f3b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:26.160054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61727b1f-05fe-400d-b23b-20dbf40a0f3b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:26.165264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61727b1f-05fe-400d-b23b-20dbf40a0f3b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:26.170081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61727b1f-05fe-400d-b23b-20dbf40a0f3b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:26.181124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61727b1f-05fe-400d-b23b-20dbf40a0f3b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:27.053720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-adc09670-4326-4cea-acdb-cdd5c2e3b227 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:27.093477 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-adc09670-4326-4cea-acdb-cdd5c2e3b227 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1308 microversion: 2.1 time: 1.089603 Sep 08 12:59:27.094782 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1693/3533] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:25 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1308 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:27.101548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-53b3b0bb-ed2c-4e57-ba19-e494ca1dc653 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:27.102429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-53b3b0bb-ed2c-4e57-ba19-e494ca1dc653 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:27.111112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-53b3b0bb-ed2c-4e57-ba19-e494ca1dc653 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:27.112539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-53b3b0bb-ed2c-4e57-ba19-e494ca1dc653 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:27.113211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-53b3b0bb-ed2c-4e57-ba19-e494ca1dc653 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:27.114151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-53b3b0bb-ed2c-4e57-ba19-e494ca1dc653 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:27.114798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-53b3b0bb-ed2c-4e57-ba19-e494ca1dc653 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:27.115467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-53b3b0bb-ed2c-4e57-ba19-e494ca1dc653 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:27.135053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-61727b1f-05fe-400d-b23b-20dbf40a0f3b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:27.151780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:27.179125 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-61727b1f-05fe-400d-b23b-20dbf40a0f3b tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1292 microversion: 2.1 time: 1.121866 Sep 08 12:59:27.195324 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1841/3534] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:26 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1292 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:27.241112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-14d8ac3d-45a3-47e4-9483-7a52d146e2dc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:27.247082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-14d8ac3d-45a3-47e4-9483-7a52d146e2dc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:27.267491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14d8ac3d-45a3-47e4-9483-7a52d146e2dc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:27.269006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14d8ac3d-45a3-47e4-9483-7a52d146e2dc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:27.270263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14d8ac3d-45a3-47e4-9483-7a52d146e2dc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:27.272350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14d8ac3d-45a3-47e4-9483-7a52d146e2dc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:27.273442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14d8ac3d-45a3-47e4-9483-7a52d146e2dc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:27.275184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14d8ac3d-45a3-47e4-9483-7a52d146e2dc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:27.949964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-53b3b0bb-ed2c-4e57-ba19-e494ca1dc653 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:27.953536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-14d8ac3d-45a3-47e4-9483-7a52d146e2dc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:27.992247 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-53b3b0bb-ed2c-4e57-ba19-e494ca1dc653 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 0.892298 Sep 08 12:59:27.996855 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-14d8ac3d-45a3-47e4-9483-7a52d146e2dc tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1524 microversion: 2.1 time: 0.793690 Sep 08 12:59:27.998094 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1842/3535] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:27 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1524 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:28.031274 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1694/3536] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:27 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:28.139973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-37907db0-c8c0-4e59-9ded-8781e0ae2c94 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:28.140830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-37907db0-c8c0-4e59-9ded-8781e0ae2c94 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:28.157507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37907db0-c8c0-4e59-9ded-8781e0ae2c94 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:28.157933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37907db0-c8c0-4e59-9ded-8781e0ae2c94 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:28.158379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37907db0-c8c0-4e59-9ded-8781e0ae2c94 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:28.159604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37907db0-c8c0-4e59-9ded-8781e0ae2c94 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:28.168652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37907db0-c8c0-4e59-9ded-8781e0ae2c94 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:28.173941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37907db0-c8c0-4e59-9ded-8781e0ae2c94 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:28.236561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7b8c6c9c-8c9c-47d0-ab8f-701890f97b3e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:28.248970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7b8c6c9c-8c9c-47d0-ab8f-701890f97b3e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:28.308337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b8c6c9c-8c9c-47d0-ab8f-701890f97b3e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:28.315473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b8c6c9c-8c9c-47d0-ab8f-701890f97b3e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:28.322976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b8c6c9c-8c9c-47d0-ab8f-701890f97b3e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:28.327052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b8c6c9c-8c9c-47d0-ab8f-701890f97b3e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:28.332738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b8c6c9c-8c9c-47d0-ab8f-701890f97b3e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:28.344239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b8c6c9c-8c9c-47d0-ab8f-701890f97b3e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:29.336592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7b8c6c9c-8c9c-47d0-ab8f-701890f97b3e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:29.345939 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7b8c6c9c-8c9c-47d0-ab8f-701890f97b3e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1292 microversion: 2.1 time: 1.129651 Sep 08 12:59:29.358334 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1695/3537] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:28 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1292 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:29.366393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a8d89793-6ce1-4d97-9390-19d9e9d8eae2 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:29.371350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-37907db0-c8c0-4e59-9ded-8781e0ae2c94 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:29.380609 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-37907db0-c8c0-4e59-9ded-8781e0ae2c94 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1489 microversion: 2.1 time: 1.244767 Sep 08 12:59:29.396259 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1843/3538] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:28 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1489 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:29.411744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a8d89793-6ce1-4d97-9390-19d9e9d8eae2 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:29.430643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-630cf152-4edf-401b-b5eb-5746c6018959 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:29.452077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-630cf152-4edf-401b-b5eb-5746c6018959 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:29.465996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8d89793-6ce1-4d97-9390-19d9e9d8eae2 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:29.472113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8d89793-6ce1-4d97-9390-19d9e9d8eae2 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:29.476445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8d89793-6ce1-4d97-9390-19d9e9d8eae2 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:29.481010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8d89793-6ce1-4d97-9390-19d9e9d8eae2 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:29.486993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8d89793-6ce1-4d97-9390-19d9e9d8eae2 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:29.493799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8d89793-6ce1-4d97-9390-19d9e9d8eae2 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:29.498315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-630cf152-4edf-401b-b5eb-5746c6018959 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:29.520047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-630cf152-4edf-401b-b5eb-5746c6018959 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:29.524461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-630cf152-4edf-401b-b5eb-5746c6018959 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:29.530623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-630cf152-4edf-401b-b5eb-5746c6018959 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:29.543000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-630cf152-4edf-401b-b5eb-5746c6018959 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:29.544385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-630cf152-4edf-401b-b5eb-5746c6018959 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:30.557422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-630cf152-4edf-401b-b5eb-5746c6018959 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:30.558517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a8d89793-6ce1-4d97-9390-19d9e9d8eae2 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:30.583185 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a8d89793-6ce1-4d97-9390-19d9e9d8eae2 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1504 microversion: 2.1 time: 1.220515 Sep 08 12:59:30.590597 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1696/3539] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:29 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1504 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:30.603344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-905276522", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "e905a95c-2324-49bd-8a89-bae4286a1b74"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:30.672097 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-630cf152-4edf-401b-b5eb-5746c6018959 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 1.263923 Sep 08 12:59:30.675843 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1844/3540] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:29 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:30.700468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7a829a02-a9b3-4090-a680-66c0fe1d2f7a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:30.704689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7a829a02-a9b3-4090-a680-66c0fe1d2f7a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:30.750055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a829a02-a9b3-4090-a680-66c0fe1d2f7a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:30.755855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a829a02-a9b3-4090-a680-66c0fe1d2f7a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:30.767945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a829a02-a9b3-4090-a680-66c0fe1d2f7a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:30.776831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a829a02-a9b3-4090-a680-66c0fe1d2f7a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:30.788522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a829a02-a9b3-4090-a680-66c0fe1d2f7a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:30.799900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a829a02-a9b3-4090-a680-66c0fe1d2f7a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:30.949138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] validate_networks() for [('e905a95c-2324-49bd-8a89-bae4286a1b74', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:59:31.448124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7a829a02-a9b3-4090-a680-66c0fe1d2f7a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:31.478412 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7a829a02-a9b3-4090-a680-66c0fe1d2f7a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1292 microversion: 2.1 time: 0.798931 Sep 08 12:59:31.491752 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1845/3541] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:30 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1292 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:31.504151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75d3c52d-5e91-43c1-9a08-1c6701f56df6 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Action: 'create', calling method: .version_select at 0x7fdb370a0e50>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1842094942", "description": "tempest-description-1067187084"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:33.585817 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-75d3c52d-5e91-43c1-9a08-1c6701f56df6 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 2.092158 Sep 08 12:59:33.586955 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1846/3542] 10.222.0.78 () {60 vars in 1180 bytes} [Thu Sep 8 12:59:31 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:33.592596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c2b0b79-7235-4a09-a551-b9cb16084cad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:33.593238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6c2b0b79-7235-4a09-a551-b9cb16084cad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:33.609016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c2b0b79-7235-4a09-a551-b9cb16084cad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:33.609606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c2b0b79-7235-4a09-a551-b9cb16084cad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:33.610067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c2b0b79-7235-4a09-a551-b9cb16084cad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:33.610821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c2b0b79-7235-4a09-a551-b9cb16084cad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:33.615064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c2b0b79-7235-4a09-a551-b9cb16084cad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:33.615869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c2b0b79-7235-4a09-a551-b9cb16084cad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:34.147203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:59:34.148275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:59:34.148934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:59:34.149512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:59:34.150133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:59:34.159467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6c2b0b79-7235-4a09-a551-b9cb16084cad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:34.171498 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6c2b0b79-7235-4a09-a551-b9cb16084cad tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 0.583420 Sep 08 12:59:34.188760 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1847/3543] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:33 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:34.194031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-21d5f94a-8081-41c4-a9f9-6aab25333d5d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:34.194980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-21d5f94a-8081-41c4-a9f9-6aab25333d5d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:34.201884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21d5f94a-8081-41c4-a9f9-6aab25333d5d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:34.202706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21d5f94a-8081-41c4-a9f9-6aab25333d5d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:34.203368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21d5f94a-8081-41c4-a9f9-6aab25333d5d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:34.203850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:34.204501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21d5f94a-8081-41c4-a9f9-6aab25333d5d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:34.205143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21d5f94a-8081-41c4-a9f9-6aab25333d5d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:34.205644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:34.205971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21d5f94a-8081-41c4-a9f9-6aab25333d5d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:34.206946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:34.209049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:34.212810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:34.213617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:34.289096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:59:34.312844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for user 227ef616a0764f5eaff5988f8a470f0c and project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:59:34.351769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:59:34.353924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:59:34.465244 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-04ae31d8-dbe9-4b52-bada-c3b15112d8e7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.872654 Sep 08 12:59:34.467362 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1697/3544] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:59:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 3875 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:59:34.472473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-654c325a-9fa2-46e6-a230-6ab4a2e786ac req-76d89672-3cb5-4301-b481-39dc97c21710 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccf7350-edf4-471c-8050-c3f5c15b4921", "name": "network-vif-plugged", "status": "completed", "tag": "237533ab-a565-46f1-9f7a-774c5326474d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:34.507567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-654c325a-9fa2-46e6-a230-6ab4a2e786ac req-76d89672-3cb5-4301-b481-39dc97c21710 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:34.508389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-654c325a-9fa2-46e6-a230-6ab4a2e786ac req-76d89672-3cb5-4301-b481-39dc97c21710 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:34.509000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-654c325a-9fa2-46e6-a230-6ab4a2e786ac req-76d89672-3cb5-4301-b481-39dc97c21710 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:34.530328 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-654c325a-9fa2-46e6-a230-6ab4a2e786ac req-76d89672-3cb5-4301-b481-39dc97c21710 service nova] Creating event network-vif-plugged:237533ab-a565-46f1-9f7a-774c5326474d for instance 5ccf7350-edf4-471c-8050-c3f5c15b4921 on n-h1-852084-10 Sep 08 12:59:34.541161 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-654c325a-9fa2-46e6-a230-6ab4a2e786ac req-76d89672-3cb5-4301-b481-39dc97c21710 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072183 Sep 08 12:59:34.543594 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1698/3545] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:34.559864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b29329ca-cc86-41e0-860a-69b70255a31f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1842094942"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:34.562306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b29329ca-cc86-41e0-860a-69b70255a31f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:34.575531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b29329ca-cc86-41e0-860a-69b70255a31f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:34.576339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b29329ca-cc86-41e0-860a-69b70255a31f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:34.588017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b29329ca-cc86-41e0-860a-69b70255a31f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:34.589147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b29329ca-cc86-41e0-860a-69b70255a31f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:34.589826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b29329ca-cc86-41e0-860a-69b70255a31f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:34.590455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b29329ca-cc86-41e0-860a-69b70255a31f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:34.675957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-21d5f94a-8081-41c4-a9f9-6aab25333d5d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:34.696459 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-21d5f94a-8081-41c4-a9f9-6aab25333d5d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1292 microversion: 2.1 time: 0.506182 Sep 08 12:59:34.707919 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1848/3546] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:34 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1292 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:34.733036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-88dc8672-04b3-42c1-950c-8d8ff330e738 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:34.738753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-88dc8672-04b3-42c1-950c-8d8ff330e738 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:34.995314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-88dc8672-04b3-42c1-950c-8d8ff330e738 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:35.082146 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-88dc8672-04b3-42c1-950c-8d8ff330e738 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 200 len: 1208 microversion: 2.1 time: 0.362792 Sep 08 12:59:35.097477 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1849/3547] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:34 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 1208 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:35.196515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2f9dbf43-37ff-406e-af30-521120137ca8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:35.197332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2f9dbf43-37ff-406e-af30-521120137ca8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:35.215041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f9dbf43-37ff-406e-af30-521120137ca8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:35.216067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f9dbf43-37ff-406e-af30-521120137ca8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:35.221101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f9dbf43-37ff-406e-af30-521120137ca8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:35.225641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f9dbf43-37ff-406e-af30-521120137ca8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:35.226584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f9dbf43-37ff-406e-af30-521120137ca8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:35.235540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f9dbf43-37ff-406e-af30-521120137ca8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:35.373781 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.network.security_group_api [None req-b29329ca-cc86-41e0-860a-69b70255a31f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Adding security group d428c39d-cdf6-438f-b345-3c58ab0d1f76 to port 8ca3eda9-46fb-4ca4-8f47-250b1d3ba400 Sep 08 12:59:36.444938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2f9dbf43-37ff-406e-af30-521120137ca8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:36.462112 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2f9dbf43-37ff-406e-af30-521120137ca8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 1.269564 Sep 08 12:59:36.471903 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1850/3548] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:35 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:36.493520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-597dc0fb-2adb-4872-a36f-902f5b66805a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:36.494233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-597dc0fb-2adb-4872-a36f-902f5b66805a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:36.514259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-597dc0fb-2adb-4872-a36f-902f5b66805a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:36.515964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-597dc0fb-2adb-4872-a36f-902f5b66805a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:36.517717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-597dc0fb-2adb-4872-a36f-902f5b66805a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:36.522352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-597dc0fb-2adb-4872-a36f-902f5b66805a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:36.524602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-597dc0fb-2adb-4872-a36f-902f5b66805a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:36.525933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-597dc0fb-2adb-4872-a36f-902f5b66805a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:37.154412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-597dc0fb-2adb-4872-a36f-902f5b66805a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:37.189420 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-597dc0fb-2adb-4872-a36f-902f5b66805a tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1292 microversion: 2.1 time: 0.715216 Sep 08 12:59:37.192704 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1851/3549] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:36 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1292 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:37.219871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ebdc41f6-848b-4b84-ad69-f761c84d9149 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:37.221013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ebdc41f6-848b-4b84-ad69-f761c84d9149 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:37.275528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdc41f6-848b-4b84-ad69-f761c84d9149 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:37.279203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdc41f6-848b-4b84-ad69-f761c84d9149 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:37.280067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdc41f6-848b-4b84-ad69-f761c84d9149 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:37.281137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdc41f6-848b-4b84-ad69-f761c84d9149 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:37.282118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdc41f6-848b-4b84-ad69-f761c84d9149 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:37.282907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebdc41f6-848b-4b84-ad69-f761c84d9149 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:37.795053 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b29329ca-cc86-41e0-860a-69b70255a31f tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "POST /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63/action" status: 202 len: 0 microversion: 2.1 time: 3.248654 Sep 08 12:59:37.797752 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1699/3550] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:59:34 2022] POST /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63/action => generated 0 bytes in 3253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:59:37.822894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0033808d-f4c6-475b-9f4b-d6847773281b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:37.827996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0033808d-f4c6-475b-9f4b-d6847773281b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:37.868318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0033808d-f4c6-475b-9f4b-d6847773281b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:37.870751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0033808d-f4c6-475b-9f4b-d6847773281b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:37.874275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0033808d-f4c6-475b-9f4b-d6847773281b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:37.883775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0033808d-f4c6-475b-9f4b-d6847773281b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:37.885819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0033808d-f4c6-475b-9f4b-d6847773281b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:37.887101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0033808d-f4c6-475b-9f4b-d6847773281b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:37.915379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ebdc41f6-848b-4b84-ad69-f761c84d9149 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:37.941785 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ebdc41f6-848b-4b84-ad69-f761c84d9149 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.744986 Sep 08 12:59:37.955336 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1852/3551] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:37 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:37.964637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bfbdbfa8-5095-4438-9502-74b566ab8767 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:37.967807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bfbdbfa8-5095-4438-9502-74b566ab8767 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:38.027580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfbdbfa8-5095-4438-9502-74b566ab8767 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:38.039136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfbdbfa8-5095-4438-9502-74b566ab8767 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:38.040681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfbdbfa8-5095-4438-9502-74b566ab8767 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:38.059766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfbdbfa8-5095-4438-9502-74b566ab8767 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:38.066835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfbdbfa8-5095-4438-9502-74b566ab8767 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:38.070967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfbdbfa8-5095-4438-9502-74b566ab8767 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:38.283662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0033808d-f4c6-475b-9f4b-d6847773281b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:38.307985 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0033808d-f4c6-475b-9f4b-d6847773281b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 200 len: 1260 microversion: 2.1 time: 0.501639 Sep 08 12:59:38.313610 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1700/3552] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:37 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 1260 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:38.341394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-055f9edf-cce2-45a8-8bc4-bc3718e58b7b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1842094942"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:38.342007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-055f9edf-cce2-45a8-8bc4-bc3718e58b7b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:38.353405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-055f9edf-cce2-45a8-8bc4-bc3718e58b7b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:38.355062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-055f9edf-cce2-45a8-8bc4-bc3718e58b7b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:38.356251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-055f9edf-cce2-45a8-8bc4-bc3718e58b7b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:38.367455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-055f9edf-cce2-45a8-8bc4-bc3718e58b7b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:38.374126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-055f9edf-cce2-45a8-8bc4-bc3718e58b7b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:38.376411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-055f9edf-cce2-45a8-8bc4-bc3718e58b7b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:39.017736 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.network.security_group_api [None req-055f9edf-cce2-45a8-8bc4-bc3718e58b7b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Removing security group d428c39d-cdf6-438f-b345-3c58ab0d1f76 from port 8ca3eda9-46fb-4ca4-8f47-250b1d3ba400 Sep 08 12:59:39.130676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bfbdbfa8-5095-4438-9502-74b566ab8767 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:39.168629 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bfbdbfa8-5095-4438-9502-74b566ab8767 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 1.219701 Sep 08 12:59:39.172970 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1853/3553] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:37 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:39.187750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-0d8efd85-88c5-48fe-b141-b313f3151316 req-bf5b02bd-7188-4a98-b221-f03fa463eb4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb61c338-cf63-45dc-97e7-a9b6ad019a63", "tag": "8ca3eda9-46fb-4ca4-8f47-250b1d3ba400"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:39.209480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0d8efd85-88c5-48fe-b141-b313f3151316 req-bf5b02bd-7188-4a98-b221-f03fa463eb4b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:39.210580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0d8efd85-88c5-48fe-b141-b313f3151316 req-bf5b02bd-7188-4a98-b221-f03fa463eb4b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:39.212587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0d8efd85-88c5-48fe-b141-b313f3151316 req-bf5b02bd-7188-4a98-b221-f03fa463eb4b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:39.233079 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-0d8efd85-88c5-48fe-b141-b313f3151316 req-bf5b02bd-7188-4a98-b221-f03fa463eb4b service nova] Creating event network-changed:8ca3eda9-46fb-4ca4-8f47-250b1d3ba400 for instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 on n-h2-852084-10 Sep 08 12:59:39.241616 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-0d8efd85-88c5-48fe-b141-b313f3151316 req-bf5b02bd-7188-4a98-b221-f03fa463eb4b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065156 Sep 08 12:59:39.243858 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1854/3554] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:39.254449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79dbb34b-a59e-42d0-bc56-727cbfb71707 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:39.255677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-79dbb34b-a59e-42d0-bc56-727cbfb71707 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:39.292272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79dbb34b-a59e-42d0-bc56-727cbfb71707 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:39.293175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79dbb34b-a59e-42d0-bc56-727cbfb71707 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:39.293990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79dbb34b-a59e-42d0-bc56-727cbfb71707 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:39.295950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79dbb34b-a59e-42d0-bc56-727cbfb71707 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:39.296797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79dbb34b-a59e-42d0-bc56-727cbfb71707 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:39.297631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79dbb34b-a59e-42d0-bc56-727cbfb71707 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:40.494142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-79dbb34b-a59e-42d0-bc56-727cbfb71707 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:40.510132 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-79dbb34b-a59e-42d0-bc56-727cbfb71707 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.261155 Sep 08 12:59:40.511206 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1855/3555] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:39 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:40.518883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d91e6543-60ba-44a5-9b19-7a3b7693abe7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:40.519931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d91e6543-60ba-44a5-9b19-7a3b7693abe7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:40.546902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d91e6543-60ba-44a5-9b19-7a3b7693abe7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:40.547609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d91e6543-60ba-44a5-9b19-7a3b7693abe7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:40.548343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d91e6543-60ba-44a5-9b19-7a3b7693abe7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:40.549310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d91e6543-60ba-44a5-9b19-7a3b7693abe7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:40.550519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d91e6543-60ba-44a5-9b19-7a3b7693abe7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:40.552913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d91e6543-60ba-44a5-9b19-7a3b7693abe7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:40.638752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:41.529741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d91e6543-60ba-44a5-9b19-7a3b7693abe7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:41.552945 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d91e6543-60ba-44a5-9b19-7a3b7693abe7 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1483 microversion: 2.1 time: 1.040215 Sep 08 12:59:41.554581 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1856/3556] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:40 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1483 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:41.564669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79ee5440-97f8-4801-b3ad-b357af3ef409 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:41.566146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-79ee5440-97f8-4801-b3ad-b357af3ef409 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:41.578342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79ee5440-97f8-4801-b3ad-b357af3ef409 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:41.579597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79ee5440-97f8-4801-b3ad-b357af3ef409 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:41.580475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79ee5440-97f8-4801-b3ad-b357af3ef409 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:41.581587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79ee5440-97f8-4801-b3ad-b357af3ef409 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:41.582317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79ee5440-97f8-4801-b3ad-b357af3ef409 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:41.582967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79ee5440-97f8-4801-b3ad-b357af3ef409 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:41.776166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-79ee5440-97f8-4801-b3ad-b357af3ef409 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:41.798492 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-79ee5440-97f8-4801-b3ad-b357af3ef409 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 200 len: 1266 microversion: 2.1 time: 0.241880 Sep 08 12:59:41.811725 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1857/3557] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:41 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:41.823109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-77d0f210-9ae1-467d-9087-0bdbb9901cac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:41.823800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-77d0f210-9ae1-467d-9087-0bdbb9901cac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:41.843176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77d0f210-9ae1-467d-9087-0bdbb9901cac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:41.843752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77d0f210-9ae1-467d-9087-0bdbb9901cac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:41.844290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77d0f210-9ae1-467d-9087-0bdbb9901cac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:41.845603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77d0f210-9ae1-467d-9087-0bdbb9901cac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:41.846122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77d0f210-9ae1-467d-9087-0bdbb9901cac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:41.846567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77d0f210-9ae1-467d-9087-0bdbb9901cac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:41.903510 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-055f9edf-cce2-45a8-8bc4-bc3718e58b7b tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "POST /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63/action" status: 202 len: 0 microversion: 2.1 time: 3.586905 Sep 08 12:59:41.908884 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1701/3558] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:59:38 2022] POST /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63/action => generated 0 bytes in 3594 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 12:59:41.914102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01f80a02-91aa-4ff0-a127-ffe688d0c967 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:41.914746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-01f80a02-91aa-4ff0-a127-ffe688d0c967 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:41.933196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01f80a02-91aa-4ff0-a127-ffe688d0c967 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:41.933715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01f80a02-91aa-4ff0-a127-ffe688d0c967 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:41.934177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01f80a02-91aa-4ff0-a127-ffe688d0c967 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:41.934983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01f80a02-91aa-4ff0-a127-ffe688d0c967 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:41.935491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01f80a02-91aa-4ff0-a127-ffe688d0c967 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:41.935943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01f80a02-91aa-4ff0-a127-ffe688d0c967 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:43.609602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-01f80a02-91aa-4ff0-a127-ffe688d0c967 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:43.637379 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-01f80a02-91aa-4ff0-a127-ffe688d0c967 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.726161 Sep 08 12:59:43.637989 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1702/3559] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:41 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:43.664915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0c0780f3-d46a-4d82-bbd1-22f7e0e48a33 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:43.669805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0c0780f3-d46a-4d82-bbd1-22f7e0e48a33 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:43.695939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:43.717027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c0780f3-d46a-4d82-bbd1-22f7e0e48a33 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:43.717960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c0780f3-d46a-4d82-bbd1-22f7e0e48a33 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:43.718787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c0780f3-d46a-4d82-bbd1-22f7e0e48a33 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:43.725495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c0780f3-d46a-4d82-bbd1-22f7e0e48a33 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:43.728715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c0780f3-d46a-4d82-bbd1-22f7e0e48a33 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:43.731584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c0780f3-d46a-4d82-bbd1-22f7e0e48a33 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:43.947946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-77d0f210-9ae1-467d-9087-0bdbb9901cac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:43.972445 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-77d0f210-9ae1-467d-9087-0bdbb9901cac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1524 microversion: 2.1 time: 2.159325 Sep 08 12:59:43.973214 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1858/3560] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:41 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1524 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:43.978258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e259df19-1529-4b51-b034-1deb8d0af6a1 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Action: 'create', calling method: .version_select at 0x7fdb35beb670>, body: {"pool": null} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:44.235760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:44.339432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:44.457390 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0c0780f3-d46a-4d82-bbd1-22f7e0e48a33 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.814661 Sep 08 12:59:44.461054 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1703/3561] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 12:59:43 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921/os-interface => generated 284 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:44.520865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-466ea527-6a2f-4fa3-b538-be47bf2414e1 req-68dac8d1-c3bf-4e2f-aa24-2087f7f4d8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb61c338-cf63-45dc-97e7-a9b6ad019a63", "tag": "8ca3eda9-46fb-4ca4-8f47-250b1d3ba400"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:44.588701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-466ea527-6a2f-4fa3-b538-be47bf2414e1 req-68dac8d1-c3bf-4e2f-aa24-2087f7f4d8d4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:44.589733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-466ea527-6a2f-4fa3-b538-be47bf2414e1 req-68dac8d1-c3bf-4e2f-aa24-2087f7f4d8d4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:44.594025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-466ea527-6a2f-4fa3-b538-be47bf2414e1 req-68dac8d1-c3bf-4e2f-aa24-2087f7f4d8d4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:44.683366 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-466ea527-6a2f-4fa3-b538-be47bf2414e1 req-68dac8d1-c3bf-4e2f-aa24-2087f7f4d8d4 service nova] Creating event network-changed:8ca3eda9-46fb-4ca4-8f47-250b1d3ba400 for instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 on n-h2-852084-10 Sep 08 12:59:44.731218 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-466ea527-6a2f-4fa3-b538-be47bf2414e1 req-68dac8d1-c3bf-4e2f-aa24-2087f7f4d8d4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.259562 Sep 08 12:59:44.732982 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1704/3562] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:44.796407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a754c649-ff1e-4937-9678-6504242c0278 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:44.803688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a754c649-ff1e-4937-9678-6504242c0278 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:44.824500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a754c649-ff1e-4937-9678-6504242c0278 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:44.826590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a754c649-ff1e-4937-9678-6504242c0278 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:44.831398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a754c649-ff1e-4937-9678-6504242c0278 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:44.834730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a754c649-ff1e-4937-9678-6504242c0278 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:44.836083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a754c649-ff1e-4937-9678-6504242c0278 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:44.837973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a754c649-ff1e-4937-9678-6504242c0278 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:45.020323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:46.283842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a754c649-ff1e-4937-9678-6504242c0278 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:46.305367 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a754c649-ff1e-4937-9678-6504242c0278 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 200 len: 1308 microversion: 2.1 time: 1.551788 Sep 08 12:59:46.323999 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1705/3563] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:44 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 1308 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:46.333142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cd529cc0-82ef-499d-973b-f6cfb4608614 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:46.334828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cd529cc0-82ef-499d-973b-f6cfb4608614 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:46.349829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd529cc0-82ef-499d-973b-f6cfb4608614 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:46.351383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd529cc0-82ef-499d-973b-f6cfb4608614 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:46.353678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd529cc0-82ef-499d-973b-f6cfb4608614 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:46.357317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd529cc0-82ef-499d-973b-f6cfb4608614 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:46.359721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd529cc0-82ef-499d-973b-f6cfb4608614 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:46.361039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd529cc0-82ef-499d-973b-f6cfb4608614 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:47.120529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cd529cc0-82ef-499d-973b-f6cfb4608614 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:47.130607 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cd529cc0-82ef-499d-973b-f6cfb4608614 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.804351 Sep 08 12:59:47.131762 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1706/3564] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:46 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:47.137090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1f24ab30-7d4a-4984-9fcb-543db953a7a5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:47.138925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1f24ab30-7d4a-4984-9fcb-543db953a7a5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:47.156461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f24ab30-7d4a-4984-9fcb-543db953a7a5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:47.157526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f24ab30-7d4a-4984-9fcb-543db953a7a5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:47.158332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f24ab30-7d4a-4984-9fcb-543db953a7a5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:47.159939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f24ab30-7d4a-4984-9fcb-543db953a7a5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:47.160663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f24ab30-7d4a-4984-9fcb-543db953a7a5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:47.161591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f24ab30-7d4a-4984-9fcb-543db953a7a5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:48.353470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1f24ab30-7d4a-4984-9fcb-543db953a7a5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:48.373709 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1f24ab30-7d4a-4984-9fcb-543db953a7a5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1506 microversion: 2.1 time: 1.237498 Sep 08 12:59:48.374506 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1707/3565] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:47 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1506 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:48.390853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b936a0dc-0962-4916-a195-da6fb583334b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:48.393001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b936a0dc-0962-4916-a195-da6fb583334b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:48.418236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b936a0dc-0962-4916-a195-da6fb583334b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:48.420575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b936a0dc-0962-4916-a195-da6fb583334b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:48.423717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b936a0dc-0962-4916-a195-da6fb583334b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:48.425542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b936a0dc-0962-4916-a195-da6fb583334b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:48.429231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b936a0dc-0962-4916-a195-da6fb583334b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:48.430198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b936a0dc-0962-4916-a195-da6fb583334b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:50.045286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b936a0dc-0962-4916-a195-da6fb583334b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:50.061573 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b936a0dc-0962-4916-a195-da6fb583334b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 200 len: 1308 microversion: 2.1 time: 1.685011 Sep 08 12:59:50.062760 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1708/3566] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:48 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 1308 bytes in 1688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:50.089955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1317992280", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "82a4dc57-b1c7-4ce5-8528-3df2b0721b51"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:50.187296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] validate_networks() for [('82a4dc57-b1c7-4ce5-8528-3df2b0721b51', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 12:59:51.828569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=41 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:52.525257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 12:59:52.527010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 12:59:52.528200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 12:59:52.530030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 12:59:52.532077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 12:59:52.558427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:52.560791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:52.564293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:52.566639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:52.568487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:52.570013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:52.640171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Getting quotas for project 59dc0decb175444491383c39918c5b2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 12:59:52.660641 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e259df19-1529-4b51-b034-1deb8d0af6a1 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 8.685791 Sep 08 12:59:52.676888 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1859/3567] 10.222.0.78 () {60 vars in 1170 bytes} [Thu Sep 8 12:59:43 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 8703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:52.693506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Getting quotas for user 4140a06bc6934d7780ef9ff3e30e6dd5 and project 59dc0decb175444491383c39918c5b2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 12:59:52.717271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-13a2b276-bbad-4ba9-a090-f7a1e4f943f0 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:52.723822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-13a2b276-bbad-4ba9-a090-f7a1e4f943f0 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:52.748542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13a2b276-bbad-4ba9-a090-f7a1e4f943f0 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:52.749442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 12:59:52.749660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13a2b276-bbad-4ba9-a090-f7a1e4f943f0 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:52.749955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13a2b276-bbad-4ba9-a090-f7a1e4f943f0 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:52.753584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13a2b276-bbad-4ba9-a090-f7a1e4f943f0 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:52.754186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13a2b276-bbad-4ba9-a090-f7a1e4f943f0 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:52.754669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-13a2b276-bbad-4ba9-a090-f7a1e4f943f0 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:52.755036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 12:59:52.938224 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ac5b4a31-9485-46a9-ab6c-65fd59c08616 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.873570 Sep 08 12:59:52.956233 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1709/3568] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 12:59:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 2890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 12:59:52.970884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-171f99c8-c380-424f-b72d-b2bed56dad32 req-0b58482f-9df4-4716-a1df-20755d93aaa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccf7350-edf4-471c-8050-c3f5c15b4921", "tag": "237533ab-a565-46f1-9f7a-774c5326474d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:53.030586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-171f99c8-c380-424f-b72d-b2bed56dad32 req-0b58482f-9df4-4716-a1df-20755d93aaa1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:53.035162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-171f99c8-c380-424f-b72d-b2bed56dad32 req-0b58482f-9df4-4716-a1df-20755d93aaa1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:53.036130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-171f99c8-c380-424f-b72d-b2bed56dad32 req-0b58482f-9df4-4716-a1df-20755d93aaa1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:53.083951 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-171f99c8-c380-424f-b72d-b2bed56dad32 req-0b58482f-9df4-4716-a1df-20755d93aaa1 service nova] Creating event network-changed:237533ab-a565-46f1-9f7a-774c5326474d for instance 5ccf7350-edf4-471c-8050-c3f5c15b4921 on n-h1-852084-10 Sep 08 12:59:53.097401 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-171f99c8-c380-424f-b72d-b2bed56dad32 req-0b58482f-9df4-4716-a1df-20755d93aaa1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138101 Sep 08 12:59:53.109790 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1710/3569] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:53.124264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c93b4076-6cf5-4194-a076-812113f6a177 req-3f572cde-2b87-4332-9095-fef4268f320b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd61063e-36fc-477d-8522-b95318528acd", "name": "network-vif-unplugged", "status": "completed", "tag": "1d545eb1-3599-4f99-9fcc-5cc1c14cd7d6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:53.148214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c93b4076-6cf5-4194-a076-812113f6a177 req-3f572cde-2b87-4332-9095-fef4268f320b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:53.148711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c93b4076-6cf5-4194-a076-812113f6a177 req-3f572cde-2b87-4332-9095-fef4268f320b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:53.149202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c93b4076-6cf5-4194-a076-812113f6a177 req-3f572cde-2b87-4332-9095-fef4268f320b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:53.178001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.compute.server_external_events [req-c93b4076-6cf5-4194-a076-812113f6a177 req-3f572cde-2b87-4332-9095-fef4268f320b service nova] Unable to find a host for instance bd61063e-36fc-477d-8522-b95318528acd. Dropping event network-vif-unplugged {{(pid=128971) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 12:59:53.180872 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c93b4076-6cf5-4194-a076-812113f6a177 req-3f572cde-2b87-4332-9095-fef4268f320b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.067169 Sep 08 12:59:53.182083 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1711/3570] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 12:59:53.188527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9a6ab99d-9dc1-4f62-ac38-0cf7a7928580 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:53.189558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9a6ab99d-9dc1-4f62-ac38-0cf7a7928580 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:53.197927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a6ab99d-9dc1-4f62-ac38-0cf7a7928580 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:53.202982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a6ab99d-9dc1-4f62-ac38-0cf7a7928580 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:53.203822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a6ab99d-9dc1-4f62-ac38-0cf7a7928580 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:53.204776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a6ab99d-9dc1-4f62-ac38-0cf7a7928580 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:53.210633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a6ab99d-9dc1-4f62-ac38-0cf7a7928580 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:53.211078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a6ab99d-9dc1-4f62-ac38-0cf7a7928580 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:53.243485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-13a2b276-bbad-4ba9-a090-f7a1e4f943f0 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:53.279817 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-13a2b276-bbad-4ba9-a090-f7a1e4f943f0 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1483 microversion: 2.1 time: 0.600577 Sep 08 12:59:53.284658 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1860/3571] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:52 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1483 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:53.294521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dddcc4bf-1d51-4dc9-9268-4bc93755efab tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:53.295163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dddcc4bf-1d51-4dc9-9268-4bc93755efab tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:53.319508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dddcc4bf-1d51-4dc9-9268-4bc93755efab tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:53.320027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dddcc4bf-1d51-4dc9-9268-4bc93755efab tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:53.320486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dddcc4bf-1d51-4dc9-9268-4bc93755efab tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:53.321278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dddcc4bf-1d51-4dc9-9268-4bc93755efab tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:53.321725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dddcc4bf-1d51-4dc9-9268-4bc93755efab tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:53.322164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dddcc4bf-1d51-4dc9-9268-4bc93755efab tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:53.569416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9a6ab99d-9dc1-4f62-ac38-0cf7a7928580 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:53.598496 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9a6ab99d-9dc1-4f62-ac38-0cf7a7928580 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 200 len: 1449 microversion: 2.1 time: 0.412823 Sep 08 12:59:53.601558 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1712/3572] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:53 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 1449 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:53.618861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0e614f36-e77c-4195-9e0a-49e887b769cf tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:53.619672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0e614f36-e77c-4195-9e0a-49e887b769cf tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:53.629914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e614f36-e77c-4195-9e0a-49e887b769cf tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:53.630528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e614f36-e77c-4195-9e0a-49e887b769cf tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:53.631302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e614f36-e77c-4195-9e0a-49e887b769cf tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:53.632299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e614f36-e77c-4195-9e0a-49e887b769cf tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:53.633010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e614f36-e77c-4195-9e0a-49e887b769cf tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:53.633670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e614f36-e77c-4195-9e0a-49e887b769cf tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:53.749712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dddcc4bf-1d51-4dc9-9268-4bc93755efab tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:53.783285 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dddcc4bf-1d51-4dc9-9268-4bc93755efab tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 200 len: 1308 microversion: 2.1 time: 0.496610 Sep 08 12:59:53.785795 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1861/3573] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:53 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 1308 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:53.820048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-3aed59f8-c28f-4c6e-943e-19da397ebdee req-fcc5c26b-3d62-4c6f-9932-aacff1bf2b45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "273397f3-2f7d-430f-845c-d365c2bc6412", "tag": "1ed2c51c-d29f-4f5f-83c8-1f81a1b43b82"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:53.864648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3aed59f8-c28f-4c6e-943e-19da397ebdee req-fcc5c26b-3d62-4c6f-9932-aacff1bf2b45 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:53.868671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3aed59f8-c28f-4c6e-943e-19da397ebdee req-fcc5c26b-3d62-4c6f-9932-aacff1bf2b45 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:53.870283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3aed59f8-c28f-4c6e-943e-19da397ebdee req-fcc5c26b-3d62-4c6f-9932-aacff1bf2b45 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:53.900240 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-3aed59f8-c28f-4c6e-943e-19da397ebdee req-fcc5c26b-3d62-4c6f-9932-aacff1bf2b45 service nova] Creating event network-changed:1ed2c51c-d29f-4f5f-83c8-1f81a1b43b82 for instance 273397f3-2f7d-430f-845c-d365c2bc6412 on n-h1-852084-10 Sep 08 12:59:53.913031 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-3aed59f8-c28f-4c6e-943e-19da397ebdee req-fcc5c26b-3d62-4c6f-9932-aacff1bf2b45 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121180 Sep 08 12:59:53.915646 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1862/3574] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 12:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 12:59:53.928944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.4.63"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 12:59:53.935822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:53.951451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:53.952816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:53.954302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:53.956099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:53.957574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:53.958650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:54.033590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "refresh_cache-bb61c338-cf63-45dc-97e7-a9b6ad019a63" {{(pid=128970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 12:59:54.036004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquired lock "refresh_cache-bb61c338-cf63-45dc-97e7-a9b6ad019a63" {{(pid=128970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 12:59:54.167296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0e614f36-e77c-4195-9e0a-49e887b769cf tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:54.181965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0e614f36-e77c-4195-9e0a-49e887b769cf tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:54.191830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0e614f36-e77c-4195-9e0a-49e887b769cf tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:54.196941 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0e614f36-e77c-4195-9e0a-49e887b769cf tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 2957 microversion: 2.42 time: 0.588377 Sep 08 12:59:54.197613 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1713/3575] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 12:59:53 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 2957 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:59:54.219420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec6e4edb-c8a9-4b78-9e7b-2d2654e17796 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:54.227906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ec6e4edb-c8a9-4b78-9e7b-2d2654e17796 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:54.252934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec6e4edb-c8a9-4b78-9e7b-2d2654e17796 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:54.254116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec6e4edb-c8a9-4b78-9e7b-2d2654e17796 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:54.257251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec6e4edb-c8a9-4b78-9e7b-2d2654e17796 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:54.261314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec6e4edb-c8a9-4b78-9e7b-2d2654e17796 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:54.262772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec6e4edb-c8a9-4b78-9e7b-2d2654e17796 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:54.267730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec6e4edb-c8a9-4b78-9e7b-2d2654e17796 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:54.538353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ec6e4edb-c8a9-4b78-9e7b-2d2654e17796 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 12:59:54.581593 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ec6e4edb-c8a9-4b78-9e7b-2d2654e17796 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 200 len: 1219 microversion: 2.1 time: 0.355766 Sep 08 12:59:54.582859 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1714/3576] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:54 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 1219 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 12:59:54.610466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:54.611605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:54.661134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:54.664610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:54.666415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:54.670725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:54.672657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:54.675520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:54.763919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 12:59:54.776862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 12:59:54.789574 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.compute.api [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Working on deleting snapshot 972e41eb-9a95-4397-b328-f624b42501e1 from shelved instance... Sep 08 12:59:56.197403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Doing local delete in cell eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) {{(pid=128971) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 08 12:59:56.199958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:56.201732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:56.203840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:56.205148 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.compute.api [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 08 12:59:56.219890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] deallocate_for_instance() {{(pid=128971) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 08 12:59:59.006326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Updating instance_info_cache with network_info: [] {{(pid=128971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 12:59:59.515473 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-12941187-d936-4c8e-bfa4-bb59d4667830 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 204 len: 0 microversion: 2.1 time: 4.930782 Sep 08 12:59:59.517135 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1715/3577] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 12:59:54 2022] DELETE /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 0 bytes in 4934 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 12:59:59.530035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-50cf8232-846e-4043-8e61-4ab444ff3b18 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:59.531080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-50cf8232-846e-4043-8e61-4ab444ff3b18 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:59.553614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50cf8232-846e-4043-8e61-4ab444ff3b18 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:59.554299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50cf8232-846e-4043-8e61-4ab444ff3b18 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:59.557215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50cf8232-846e-4043-8e61-4ab444ff3b18 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:59.558503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50cf8232-846e-4043-8e61-4ab444ff3b18 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:59.560245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50cf8232-846e-4043-8e61-4ab444ff3b18 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:59.560704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50cf8232-846e-4043-8e61-4ab444ff3b18 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:59.580578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Building network info cache for instance {{(pid=128970) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 12:59:59.844679 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-50cf8232-846e-4043-8e61-4ab444ff3b18 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.325507 Sep 08 12:59:59.857154 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1716/3578] 10.222.0.78 () {60 vars in 1316 bytes} [Thu Sep 8 12:59:59 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6/os-interface => generated 1831 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 12:59:59.872006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5c2a5f52-3efb-44a5-bbf6-9cd0217d7336 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 12:59:59.873683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5c2a5f52-3efb-44a5-bbf6-9cd0217d7336 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 12:59:59.901770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c2a5f52-3efb-44a5-bbf6-9cd0217d7336 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:59.905739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c2a5f52-3efb-44a5-bbf6-9cd0217d7336 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:59.906744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c2a5f52-3efb-44a5-bbf6-9cd0217d7336 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 12:59:59.911455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c2a5f52-3efb-44a5-bbf6-9cd0217d7336 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 12:59:59.914036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c2a5f52-3efb-44a5-bbf6-9cd0217d7336 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 12:59:59.914864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5c2a5f52-3efb-44a5-bbf6-9cd0217d7336 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:00.365032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5c2a5f52-3efb-44a5-bbf6-9cd0217d7336 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:00.399903 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5c2a5f52-3efb-44a5-bbf6-9cd0217d7336 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 200 len: 1308 microversion: 2.1 time: 0.537335 Sep 08 13:00:00.407367 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1717/3579] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 12:59:59 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 1308 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:00.407367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5bcaf1e1-1565-4873-9317-999e0ff57e8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:00.407900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5bcaf1e1-1565-4873-9317-999e0ff57e8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:00.420330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bcaf1e1-1565-4873-9317-999e0ff57e8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:00.420823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bcaf1e1-1565-4873-9317-999e0ff57e8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:00.421989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bcaf1e1-1565-4873-9317-999e0ff57e8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:00.424848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bcaf1e1-1565-4873-9317-999e0ff57e8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:00.430777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bcaf1e1-1565-4873-9317-999e0ff57e8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:00.431409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5bcaf1e1-1565-4873-9317-999e0ff57e8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:01.906035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5bcaf1e1-1565-4873-9317-999e0ff57e8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:01.976437 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5bcaf1e1-1565-4873-9317-999e0ff57e8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 200 len: 1315 microversion: 2.1 time: 1.573011 Sep 08 13:00:01.987528 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1718/3580] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:00 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 1315 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:02.032301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-621c72fb-a3aa-434f-83cf-a4ad60ede542 req-16e46c2d-11c2-4d1b-bce6-8db235d9c31b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd61063e-36fc-477d-8522-b95318528acd", "name": "network-vif-deleted", "tag": "1d545eb1-3599-4f99-9fcc-5cc1c14cd7d6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:02.067767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-621c72fb-a3aa-434f-83cf-a4ad60ede542 req-16e46c2d-11c2-4d1b-bce6-8db235d9c31b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:02.069062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-621c72fb-a3aa-434f-83cf-a4ad60ede542 req-16e46c2d-11c2-4d1b-bce6-8db235d9c31b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:02.070076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-621c72fb-a3aa-434f-83cf-a4ad60ede542 req-16e46c2d-11c2-4d1b-bce6-8db235d9c31b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:02.124155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.compute.server_external_events [req-621c72fb-a3aa-434f-83cf-a4ad60ede542 req-16e46c2d-11c2-4d1b-bce6-8db235d9c31b service nova] Unable to find a host for instance bd61063e-36fc-477d-8522-b95318528acd. Dropping event network-vif-deleted {{(pid=128971) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 13:00:02.131847 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-621c72fb-a3aa-434f-83cf-a4ad60ede542 req-16e46c2d-11c2-4d1b-bce6-8db235d9c31b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.105725 Sep 08 13:00:02.133767 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1719/3581] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 145 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 13:00:02.157426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b105e6b0-7e05-49d3-b3f2-aca71be81512 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:02.160949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b105e6b0-7e05-49d3-b3f2-aca71be81512 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:02.183782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b105e6b0-7e05-49d3-b3f2-aca71be81512 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:02.191385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b105e6b0-7e05-49d3-b3f2-aca71be81512 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:02.194349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b105e6b0-7e05-49d3-b3f2-aca71be81512 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:02.196463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b105e6b0-7e05-49d3-b3f2-aca71be81512 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:02.197773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b105e6b0-7e05-49d3-b3f2-aca71be81512 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:02.202824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b105e6b0-7e05-49d3-b3f2-aca71be81512 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:02.265057 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-b105e6b0-7e05-49d3-b3f2-aca71be81512 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b105e6b0-7e05-49d3-b3f2-aca71be81512 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd HTTP/1.1 Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'bd61063e-36fc-477d-8522-b95318528acd'} Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:00:02.271073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:02.288076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:02.288076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:00:02.288076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:00:02.288076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:00:02.288076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:00:02.288076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:00:02.288076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:02.299766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b105e6b0-7e05-49d3-b3f2-aca71be81512 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:00:02.300863 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b105e6b0-7e05-49d3-b3f2-aca71be81512 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 404 len: 111 microversion: 2.1 time: 0.164310 Sep 08 13:00:02.308956 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1720/3582] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:02 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 111 bytes in 174 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:00:02.319123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-227e1e74-3468-4597-9d7f-06b4b83ae7fb req-64d4068e-fd84-4e4e-8efe-8abd0fab8dfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273397f3-2f7d-430f-845c-d365c2bc6412", "name": "network-vif-plugged", "status": "completed", "tag": "1ed2c51c-d29f-4f5f-83c8-1f81a1b43b82"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:02.372397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-227e1e74-3468-4597-9d7f-06b4b83ae7fb req-64d4068e-fd84-4e4e-8efe-8abd0fab8dfc service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:02.373260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-227e1e74-3468-4597-9d7f-06b4b83ae7fb req-64d4068e-fd84-4e4e-8efe-8abd0fab8dfc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:02.374048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-227e1e74-3468-4597-9d7f-06b4b83ae7fb req-64d4068e-fd84-4e4e-8efe-8abd0fab8dfc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:02.427463 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-227e1e74-3468-4597-9d7f-06b4b83ae7fb req-64d4068e-fd84-4e4e-8efe-8abd0fab8dfc service nova] Creating event network-vif-plugged:1ed2c51c-d29f-4f5f-83c8-1f81a1b43b82 for instance 273397f3-2f7d-430f-845c-d365c2bc6412 on n-h1-852084-10 Sep 08 13:00:02.447280 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-227e1e74-3468-4597-9d7f-06b4b83ae7fb req-64d4068e-fd84-4e4e-8efe-8abd0fab8dfc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134405 Sep 08 13:00:02.448422 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1721/3583] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:00:02.473642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-98747b39-f54f-4731-b083-0570b9208e7f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:02.475031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-98747b39-f54f-4731-b083-0570b9208e7f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:02.543160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98747b39-f54f-4731-b083-0570b9208e7f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:02.544897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98747b39-f54f-4731-b083-0570b9208e7f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:02.549206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98747b39-f54f-4731-b083-0570b9208e7f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:02.559083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98747b39-f54f-4731-b083-0570b9208e7f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:02.560883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98747b39-f54f-4731-b083-0570b9208e7f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:02.562317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98747b39-f54f-4731-b083-0570b9208e7f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:02.657406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:02.733418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:02.869490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Updating instance_info_cache with network_info: [{"id": "8ca3eda9-46fb-4ca4-8f47-250b1d3ba400", "address": "fa:16:3e:b9:d0:1d", "network": {"id": "30eb2b31-0a15-49dd-bbbe-8448f143ce05", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1000839090-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d208955d80a140f18307d2702bd79d19", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8ca3eda9-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128970) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 13:00:02.930543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Releasing lock "refresh_cache-bb61c338-cf63-45dc-97e7-a9b6ad019a63" {{(pid=128970) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 13:00:02.938428 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9a3758f0-cf9d-4ed4-b26c-7edc50f5f51c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "POST /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63/action" status: 202 len: 0 microversion: 2.1 time: 9.014771 Sep 08 13:00:02.941177 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1863/3584] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 12:59:53 2022] POST /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63/action => generated 0 bytes in 9024 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 13:00:02.971592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1688856966", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "dbd28b0c-6c95-45fa-bc88-dd4ecaae050a"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:03.076761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-98747b39-f54f-4731-b083-0570b9208e7f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:03.100037 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-98747b39-f54f-4731-b083-0570b9208e7f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 200 len: 1308 microversion: 2.1 time: 0.648662 Sep 08 13:00:03.101132 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1722/3585] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:02 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 1308 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:03.107519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.4.63"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:03.175304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] validate_networks() for [('dbd28b0c-6c95-45fa-bc88-dd4ecaae050a', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:00:03.558131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:03.565719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:03.566443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:03.567090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:03.568066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:03.568715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:03.569316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:04.239994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "refresh_cache-bb61c338-cf63-45dc-97e7-a9b6ad019a63" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 08 13:00:04.242924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquired lock "refresh_cache-bb61c338-cf63-45dc-97e7-a9b6ad019a63" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 08 13:00:04.568790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:00:04.570931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:00:04.575916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:00:04.577494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:00:04.580786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:00:04.635398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:04.640398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:04.646174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:04.648322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:04.655626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:04.659712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:04.756937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:00:04.801504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for user d9a995d2889c47738ad0b5255445c5f0 and project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:00:04.846023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:00:04.852237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:00:04.927825 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b5c582bd-8f00-4e2a-af50-09455bb7162b tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.976228 Sep 08 13:00:04.929527 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1864/3586] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:00:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:00:04.938751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a3b83895-d318-4ae9-b406-655dd20014a5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:04.939825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a3b83895-d318-4ae9-b406-655dd20014a5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:04.949994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b83895-d318-4ae9-b406-655dd20014a5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:04.951513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b83895-d318-4ae9-b406-655dd20014a5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:04.952547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b83895-d318-4ae9-b406-655dd20014a5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:04.953732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b83895-d318-4ae9-b406-655dd20014a5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:04.954698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b83895-d318-4ae9-b406-655dd20014a5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:04.955670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b83895-d318-4ae9-b406-655dd20014a5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:05.418234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a3b83895-d318-4ae9-b406-655dd20014a5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:05.435128 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a3b83895-d318-4ae9-b406-655dd20014a5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 200 len: 1315 microversion: 2.1 time: 0.502104 Sep 08 13:00:05.438681 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1865/3587] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:04 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:05.457011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c1228609-ae4c-4aab-ba12-b427f654bacb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:05.457661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c1228609-ae4c-4aab-ba12-b427f654bacb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:05.464867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1228609-ae4c-4aab-ba12-b427f654bacb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:05.466456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1228609-ae4c-4aab-ba12-b427f654bacb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:05.467104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1228609-ae4c-4aab-ba12-b427f654bacb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:05.468345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1228609-ae4c-4aab-ba12-b427f654bacb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:05.469133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1228609-ae4c-4aab-ba12-b427f654bacb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:05.469761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1228609-ae4c-4aab-ba12-b427f654bacb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:05.958221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c1228609-ae4c-4aab-ba12-b427f654bacb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:05.971681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Building network info cache for instance {{(pid=128971) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Sep 08 13:00:05.973730 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c1228609-ae4c-4aab-ba12-b427f654bacb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 200 len: 1489 microversion: 2.1 time: 0.531772 Sep 08 13:00:05.976739 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1866/3588] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:05 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 1489 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:05.989233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-79b97af9-553b-43e5-95bd-f5dd0ea9c020 req-451c44a1-142c-42e7-a501-d36ef587a2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb61c338-cf63-45dc-97e7-a9b6ad019a63", "tag": "8ca3eda9-46fb-4ca4-8f47-250b1d3ba400"}, {"name": "network-changed", "server_uuid": "307b0e06-8473-44e0-90d1-25e6bbf73210", "tag": "405b7b07-1d3d-4562-b0ae-fafd46ae290c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:06.041628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-79b97af9-553b-43e5-95bd-f5dd0ea9c020 req-451c44a1-142c-42e7-a501-d36ef587a2d9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:06.042505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-79b97af9-553b-43e5-95bd-f5dd0ea9c020 req-451c44a1-142c-42e7-a501-d36ef587a2d9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:06.043286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-79b97af9-553b-43e5-95bd-f5dd0ea9c020 req-451c44a1-142c-42e7-a501-d36ef587a2d9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:06.060568 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-79b97af9-553b-43e5-95bd-f5dd0ea9c020 req-451c44a1-142c-42e7-a501-d36ef587a2d9 service nova] Creating event network-changed:8ca3eda9-46fb-4ca4-8f47-250b1d3ba400 for instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 on n-h2-852084-10 Sep 08 13:00:06.062408 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-79b97af9-553b-43e5-95bd-f5dd0ea9c020 req-451c44a1-142c-42e7-a501-d36ef587a2d9 service nova] Creating event network-changed:405b7b07-1d3d-4562-b0ae-fafd46ae290c for instance 307b0e06-8473-44e0-90d1-25e6bbf73210 on n-h2-852084-10 Sep 08 13:00:06.077775 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-79b97af9-553b-43e5-95bd-f5dd0ea9c020 req-451c44a1-142c-42e7-a501-d36ef587a2d9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.099395 Sep 08 13:00:06.081513 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1867/3589] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:05 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:00:06.097102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ea3cc06f-0d40-4d2f-95a9-d58f77cf7eb4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:06.101678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ea3cc06f-0d40-4d2f-95a9-d58f77cf7eb4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:06.124536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea3cc06f-0d40-4d2f-95a9-d58f77cf7eb4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:06.128500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea3cc06f-0d40-4d2f-95a9-d58f77cf7eb4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:06.129426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea3cc06f-0d40-4d2f-95a9-d58f77cf7eb4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:06.131971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea3cc06f-0d40-4d2f-95a9-d58f77cf7eb4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:06.133099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea3cc06f-0d40-4d2f-95a9-d58f77cf7eb4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:06.133805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea3cc06f-0d40-4d2f-95a9-d58f77cf7eb4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:06.386900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ea3cc06f-0d40-4d2f-95a9-d58f77cf7eb4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:06.417616 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ea3cc06f-0d40-4d2f-95a9-d58f77cf7eb4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1211 microversion: 2.1 time: 0.333324 Sep 08 13:00:06.418845 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1868/3590] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:06 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1211 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:06.444149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-979a32da-fa34-4a52-97fe-ea61fa7be6a4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:06.452159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-979a32da-fa34-4a52-97fe-ea61fa7be6a4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:06.475735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-979a32da-fa34-4a52-97fe-ea61fa7be6a4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:06.476566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-979a32da-fa34-4a52-97fe-ea61fa7be6a4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:06.477391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-979a32da-fa34-4a52-97fe-ea61fa7be6a4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:06.478783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-979a32da-fa34-4a52-97fe-ea61fa7be6a4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:06.492039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-979a32da-fa34-4a52-97fe-ea61fa7be6a4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:06.492967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-979a32da-fa34-4a52-97fe-ea61fa7be6a4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:07.776582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-979a32da-fa34-4a52-97fe-ea61fa7be6a4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:07.790530 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-979a32da-fa34-4a52-97fe-ea61fa7be6a4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1489 microversion: 2.1 time: 1.370062 Sep 08 13:00:07.810891 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1869/3591] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:06 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1489 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:07.831188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-81f9ec75-c64f-4704-9a28-e518bbba968a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:07.831188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-81f9ec75-c64f-4704-9a28-e518bbba968a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:07.844662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81f9ec75-c64f-4704-9a28-e518bbba968a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:07.845185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81f9ec75-c64f-4704-9a28-e518bbba968a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:07.845643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81f9ec75-c64f-4704-9a28-e518bbba968a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:07.863301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81f9ec75-c64f-4704-9a28-e518bbba968a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:07.863301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81f9ec75-c64f-4704-9a28-e518bbba968a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:07.863301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81f9ec75-c64f-4704-9a28-e518bbba968a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:08.510840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-81f9ec75-c64f-4704-9a28-e518bbba968a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:08.527168 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-81f9ec75-c64f-4704-9a28-e518bbba968a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 200 len: 1315 microversion: 2.1 time: 0.714966 Sep 08 13:00:08.542157 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1870/3592] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:07 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 1315 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:08.548841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f982abc9-b940-42ca-8179-b975ba39e2a4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:08.549897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f982abc9-b940-42ca-8179-b975ba39e2a4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:08.557147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f982abc9-b940-42ca-8179-b975ba39e2a4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:08.558011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f982abc9-b940-42ca-8179-b975ba39e2a4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:08.558675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f982abc9-b940-42ca-8179-b975ba39e2a4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:08.560242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f982abc9-b940-42ca-8179-b975ba39e2a4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:08.560931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f982abc9-b940-42ca-8179-b975ba39e2a4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:08.561570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f982abc9-b940-42ca-8179-b975ba39e2a4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:09.320364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f982abc9-b940-42ca-8179-b975ba39e2a4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:09.337705 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f982abc9-b940-42ca-8179-b975ba39e2a4 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1273 microversion: 2.1 time: 0.794303 Sep 08 13:00:09.352286 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1871/3593] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:08 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1273 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:09.369596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8d76680f-267d-44a0-a925-9f4b6df9ca8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:09.370665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8d76680f-267d-44a0-a925-9f4b6df9ca8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:09.380477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d76680f-267d-44a0-a925-9f4b6df9ca8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:09.382970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d76680f-267d-44a0-a925-9f4b6df9ca8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:09.384214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d76680f-267d-44a0-a925-9f4b6df9ca8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:09.385495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d76680f-267d-44a0-a925-9f4b6df9ca8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:09.386230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d76680f-267d-44a0-a925-9f4b6df9ca8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:09.387003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d76680f-267d-44a0-a925-9f4b6df9ca8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:09.821687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Updating instance_info_cache with network_info: [{"id": "8ca3eda9-46fb-4ca4-8f47-250b1d3ba400", "address": "fa:16:3e:b9:d0:1d", "network": {"id": "30eb2b31-0a15-49dd-bbbe-8448f143ce05", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1000839090-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.2", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d208955d80a140f18307d2702bd79d19", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap8ca3eda9-46", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128971) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 13:00:09.841674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Releasing lock "refresh_cache-bb61c338-cf63-45dc-97e7-a9b6ad019a63" {{(pid=128971) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 08 13:00:09.843464 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fd7d8dcf-266a-4bcf-9db6-e0cd57db943e tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "POST /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63/action" status: 202 len: 0 microversion: 2.1 time: 6.740625 Sep 08 13:00:09.845246 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1723/3594] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:00:03 2022] POST /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63/action => generated 0 bytes in 6743 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Sep 08 13:00:09.855302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-cc47f218-6a97-4a5d-85bc-7bac3ba735d0 req-88c222b8-1f8c-49be-aefb-ce70cdfa8806 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb61c338-cf63-45dc-97e7-a9b6ad019a63", "tag": "8ca3eda9-46fb-4ca4-8f47-250b1d3ba400"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:09.880931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cc47f218-6a97-4a5d-85bc-7bac3ba735d0 req-88c222b8-1f8c-49be-aefb-ce70cdfa8806 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:09.882620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cc47f218-6a97-4a5d-85bc-7bac3ba735d0 req-88c222b8-1f8c-49be-aefb-ce70cdfa8806 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:09.883728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cc47f218-6a97-4a5d-85bc-7bac3ba735d0 req-88c222b8-1f8c-49be-aefb-ce70cdfa8806 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:09.907914 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-cc47f218-6a97-4a5d-85bc-7bac3ba735d0 req-88c222b8-1f8c-49be-aefb-ce70cdfa8806 service nova] Creating event network-changed:8ca3eda9-46fb-4ca4-8f47-250b1d3ba400 for instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 on n-h2-852084-10 Sep 08 13:00:09.921889 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-cc47f218-6a97-4a5d-85bc-7bac3ba735d0 req-88c222b8-1f8c-49be-aefb-ce70cdfa8806 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073776 Sep 08 13:00:09.924080 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1724/3595] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:00:09.940349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e81e1bb4-8c1e-45e1-80a9-dabe3f75d806 req-d999c02f-9395-4a67-a9f5-f832f59d2051 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307b0e06-8473-44e0-90d1-25e6bbf73210", "name": "network-vif-plugged", "status": "completed", "tag": "405b7b07-1d3d-4562-b0ae-fafd46ae290c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:09.972060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e81e1bb4-8c1e-45e1-80a9-dabe3f75d806 req-d999c02f-9395-4a67-a9f5-f832f59d2051 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:09.973706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e81e1bb4-8c1e-45e1-80a9-dabe3f75d806 req-d999c02f-9395-4a67-a9f5-f832f59d2051 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:09.975195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e81e1bb4-8c1e-45e1-80a9-dabe3f75d806 req-d999c02f-9395-4a67-a9f5-f832f59d2051 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:10.004034 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e81e1bb4-8c1e-45e1-80a9-dabe3f75d806 req-d999c02f-9395-4a67-a9f5-f832f59d2051 service nova] Creating event network-vif-plugged:405b7b07-1d3d-4562-b0ae-fafd46ae290c for instance 307b0e06-8473-44e0-90d1-25e6bbf73210 on n-h2-852084-10 Sep 08 13:00:10.022815 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e81e1bb4-8c1e-45e1-80a9-dabe3f75d806 req-d999c02f-9395-4a67-a9f5-f832f59d2051 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088708 Sep 08 13:00:10.024811 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1725/3596] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:00:10.039637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3bfba80f-bbec-427c-8fe6-dff1b225a43e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:10.040557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3bfba80f-bbec-427c-8fe6-dff1b225a43e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:10.063022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bfba80f-bbec-427c-8fe6-dff1b225a43e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:10.082531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bfba80f-bbec-427c-8fe6-dff1b225a43e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:10.087613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8d76680f-267d-44a0-a925-9f4b6df9ca8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:10.088477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bfba80f-bbec-427c-8fe6-dff1b225a43e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:10.090334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bfba80f-bbec-427c-8fe6-dff1b225a43e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:10.091547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bfba80f-bbec-427c-8fe6-dff1b225a43e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:10.098853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bfba80f-bbec-427c-8fe6-dff1b225a43e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:10.102123 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8d76680f-267d-44a0-a925-9f4b6df9ca8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 200 len: 1489 microversion: 2.1 time: 0.743093 Sep 08 13:00:10.123676 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1872/3597] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:09 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 1489 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:10.139523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33d1e841-39f4-4dc9-9100-0438c85782a4 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '.version_select at 0x7fdb36464c10>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:11.008127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3bfba80f-bbec-427c-8fe6-dff1b225a43e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:11.040056 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3bfba80f-bbec-427c-8fe6-dff1b225a43e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 200 len: 1315 microversion: 2.1 time: 1.011813 Sep 08 13:00:11.045030 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1726/3598] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:10 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 1315 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:11.056812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8a50d1d4-13ac-4715-8616-400ddadfbdf7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:11.065802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8a50d1d4-13ac-4715-8616-400ddadfbdf7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:11.078116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a50d1d4-13ac-4715-8616-400ddadfbdf7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:11.079130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a50d1d4-13ac-4715-8616-400ddadfbdf7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:11.080309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a50d1d4-13ac-4715-8616-400ddadfbdf7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:11.081648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a50d1d4-13ac-4715-8616-400ddadfbdf7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:11.082911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a50d1d4-13ac-4715-8616-400ddadfbdf7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:11.083914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a50d1d4-13ac-4715-8616-400ddadfbdf7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:11.148315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8a50d1d4-13ac-4715-8616-400ddadfbdf7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:00:11.281626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=17,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:11.359010 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8a50d1d4-13ac-4715-8616-400ddadfbdf7 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 204 len: 0 microversion: 2.1 time: 0.310374 Sep 08 13:00:11.365922 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1727/3599] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:00:11 2022] DELETE /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:00:11.378773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-018663d4-a990-4abf-b8f6-76a85675c33a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:11.380502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-018663d4-a990-4abf-b8f6-76a85675c33a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:11.399120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-018663d4-a990-4abf-b8f6-76a85675c33a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:11.400040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-018663d4-a990-4abf-b8f6-76a85675c33a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:11.400808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-018663d4-a990-4abf-b8f6-76a85675c33a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:11.402449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-018663d4-a990-4abf-b8f6-76a85675c33a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:11.403730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-018663d4-a990-4abf-b8f6-76a85675c33a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:11.404837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-018663d4-a990-4abf-b8f6-76a85675c33a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:12.842291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-018663d4-a990-4abf-b8f6-76a85675c33a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:12.854887 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-018663d4-a990-4abf-b8f6-76a85675c33a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1315 microversion: 2.1 time: 1.485380 Sep 08 13:00:12.855838 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1728/3600] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:11 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1315 bytes in 1489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:12.877474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d4d9864d-6f47-4483-b85c-959556d2aabc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:12.879043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d4d9864d-6f47-4483-b85c-959556d2aabc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:12.899615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4d9864d-6f47-4483-b85c-959556d2aabc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:12.901294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4d9864d-6f47-4483-b85c-959556d2aabc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:12.901977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4d9864d-6f47-4483-b85c-959556d2aabc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:12.903395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4d9864d-6f47-4483-b85c-959556d2aabc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:12.903900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4d9864d-6f47-4483-b85c-959556d2aabc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:12.904350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4d9864d-6f47-4483-b85c-959556d2aabc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:13.841582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d4d9864d-6f47-4483-b85c-959556d2aabc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:13.872343 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d4d9864d-6f47-4483-b85c-959556d2aabc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 200 len: 1495 microversion: 2.1 time: 1.011341 Sep 08 13:00:13.875569 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1729/3601] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:12 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 1495 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:13.890014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-68b68706-1c4d-4dfd-8ebb-979f0d4a27fd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:13.893118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-68b68706-1c4d-4dfd-8ebb-979f0d4a27fd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:13.909322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:13.918464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68b68706-1c4d-4dfd-8ebb-979f0d4a27fd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:13.924694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68b68706-1c4d-4dfd-8ebb-979f0d4a27fd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:13.927662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68b68706-1c4d-4dfd-8ebb-979f0d4a27fd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:13.935664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68b68706-1c4d-4dfd-8ebb-979f0d4a27fd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:13.936634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68b68706-1c4d-4dfd-8ebb-979f0d4a27fd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:13.939022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68b68706-1c4d-4dfd-8ebb-979f0d4a27fd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:14.604537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-68b68706-1c4d-4dfd-8ebb-979f0d4a27fd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:14.614016 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-68b68706-1c4d-4dfd-8ebb-979f0d4a27fd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 200 len: 1503 microversion: 2.1 time: 0.736431 Sep 08 13:00:14.623379 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1730/3602] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:13 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 1503 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:14.634252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5148fd45-a96f-45dd-a95c-4ec3c1635dae tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:14.635484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5148fd45-a96f-45dd-a95c-4ec3c1635dae tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:14.644639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5148fd45-a96f-45dd-a95c-4ec3c1635dae tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:14.645306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5148fd45-a96f-45dd-a95c-4ec3c1635dae tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:14.645932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5148fd45-a96f-45dd-a95c-4ec3c1635dae tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:14.646985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5148fd45-a96f-45dd-a95c-4ec3c1635dae tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:14.647722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5148fd45-a96f-45dd-a95c-4ec3c1635dae tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:14.648279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5148fd45-a96f-45dd-a95c-4ec3c1635dae tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:14.727184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:14.836103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:14.884628 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-33d1e841-39f4-4dc9-9100-0438c85782a4 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "DELETE /compute/v2.1/os-floating-ips/e5a15eea-ee4e-4a71-9fa1-85a112bc7194" status: 202 len: 0 microversion: 2.1 time: 4.750451 Sep 08 13:00:14.885583 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1873/3603] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 13:00:10 2022] DELETE /compute/v2.1/os-floating-ips/e5a15eea-ee4e-4a71-9fa1-85a112bc7194 => generated 0 bytes in 4761 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:00:14.897110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-357b204c-7410-4422-b295-a3bb7cd59575 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:14.898188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-357b204c-7410-4422-b295-a3bb7cd59575 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:14.906710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-357b204c-7410-4422-b295-a3bb7cd59575 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:14.907976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-357b204c-7410-4422-b295-a3bb7cd59575 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:14.909446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-357b204c-7410-4422-b295-a3bb7cd59575 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:14.910929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-357b204c-7410-4422-b295-a3bb7cd59575 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:14.911688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-357b204c-7410-4422-b295-a3bb7cd59575 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:14.912447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-357b204c-7410-4422-b295-a3bb7cd59575 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:14.917842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=83,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:15.425321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5148fd45-a96f-45dd-a95c-4ec3c1635dae tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:15.442158 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5148fd45-a96f-45dd-a95c-4ec3c1635dae tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1315 microversion: 2.1 time: 0.812930 Sep 08 13:00:15.443322 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1731/3604] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:14 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:15.460419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-28dd8980-1c70-431b-8903-a723990dae47 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '.version_select at 0x7fdb3af0ac10>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:15.786090 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.network.security_group_api [None req-357b204c-7410-4422-b295-a3bb7cd59575 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Removing security group 4a721289-9141-4dab-9b4b-8284482920ed from port 405b7b07-1d3d-4562-b0ae-fafd46ae290c Sep 08 13:00:16.760446 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-28dd8980-1c70-431b-8903-a723990dae47 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "DELETE /compute/v2.1/os-security-groups/d428c39d-cdf6-438f-b345-3c58ab0d1f76" status: 202 len: 0 microversion: 2.1 time: 1.314188 Sep 08 13:00:16.764565 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1732/3605] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 13:00:15 2022] DELETE /compute/v2.1/os-security-groups/d428c39d-cdf6-438f-b345-3c58ab0d1f76 => generated 0 bytes in 1320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:00:16.781802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:16.786791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:16.827710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:16.829335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:16.830848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:16.833493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:16.835987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:16.839083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:16.952402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:16.953353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:16.961074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:16.961925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lazy-loading 'fault' on Instance uuid 273397f3-2f7d-430f-845c-d365c2bc6412 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:00:17.071950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:17.088400 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3339a4ac-ffe1-49e8-b99b-e3a5df031e87 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 200 len: 1298 microversion: 2.1 time: 0.321840 Sep 08 13:00:17.089224 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1733/3606] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:16 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 1298 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:17.113713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2eeafdbf-5ca4-43dd-be28-e78b29a666c5 req-00cac816-5406-497a-acd6-e3b060936d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "273397f3-2f7d-430f-845c-d365c2bc6412", "name": "network-vif-deleted", "tag": "1ed2c51c-d29f-4f5f-83c8-1f81a1b43b82"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:17.125239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2eeafdbf-5ca4-43dd-be28-e78b29a666c5 req-00cac816-5406-497a-acd6-e3b060936d30 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:17.126414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2eeafdbf-5ca4-43dd-be28-e78b29a666c5 req-00cac816-5406-497a-acd6-e3b060936d30 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:17.127082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2eeafdbf-5ca4-43dd-be28-e78b29a666c5 req-00cac816-5406-497a-acd6-e3b060936d30 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:17.143887 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2eeafdbf-5ca4-43dd-be28-e78b29a666c5 req-00cac816-5406-497a-acd6-e3b060936d30 service nova] Creating event network-vif-deleted:1ed2c51c-d29f-4f5f-83c8-1f81a1b43b82 for instance 273397f3-2f7d-430f-845c-d365c2bc6412 on n-h1-852084-10 Sep 08 13:00:17.151568 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2eeafdbf-5ca4-43dd-be28-e78b29a666c5 req-00cac816-5406-497a-acd6-e3b060936d30 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045170 Sep 08 13:00:17.152538 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1734/3607] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:00:17.159966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3371b1f5-838d-4bf0-bd4e-98582f028aaf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:17.161052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3371b1f5-838d-4bf0-bd4e-98582f028aaf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:17.171111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3371b1f5-838d-4bf0-bd4e-98582f028aaf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:17.171960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3371b1f5-838d-4bf0-bd4e-98582f028aaf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:17.172581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3371b1f5-838d-4bf0-bd4e-98582f028aaf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:17.173762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3371b1f5-838d-4bf0-bd4e-98582f028aaf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:17.174481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3371b1f5-838d-4bf0-bd4e-98582f028aaf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:17.175091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3371b1f5-838d-4bf0-bd4e-98582f028aaf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:17.209186 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-357b204c-7410-4422-b295-a3bb7cd59575 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210/action" status: 202 len: 0 microversion: 2.1 time: 2.320866 Sep 08 13:00:17.210415 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1874/3608] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:00:14 2022] POST /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210/action => generated 0 bytes in 2324 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:00:17.216936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-43c59d70-649c-4b49-851a-560c285ee93a tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:17.217820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-43c59d70-649c-4b49-851a-560c285ee93a tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:17.237102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43c59d70-649c-4b49-851a-560c285ee93a tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:17.238183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43c59d70-649c-4b49-851a-560c285ee93a tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:17.238987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43c59d70-649c-4b49-851a-560c285ee93a tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:17.248289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43c59d70-649c-4b49-851a-560c285ee93a tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:17.248544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43c59d70-649c-4b49-851a-560c285ee93a tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:17.249510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43c59d70-649c-4b49-851a-560c285ee93a tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:17.306638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-43c59d70-649c-4b49-851a-560c285ee93a tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:00:17.421651 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-43c59d70-649c-4b49-851a-560c285ee93a tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 204 len: 0 microversion: 2.1 time: 0.209650 Sep 08 13:00:17.422759 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1875/3609] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:00:17 2022] DELETE /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:00:17.431892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-38874ebb-cb53-4a3e-8173-a20095a51191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:17.433227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-38874ebb-cb53-4a3e-8173-a20095a51191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:17.442747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38874ebb-cb53-4a3e-8173-a20095a51191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:17.443755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38874ebb-cb53-4a3e-8173-a20095a51191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:17.444441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38874ebb-cb53-4a3e-8173-a20095a51191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:17.445416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38874ebb-cb53-4a3e-8173-a20095a51191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:17.446233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38874ebb-cb53-4a3e-8173-a20095a51191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:17.446951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38874ebb-cb53-4a3e-8173-a20095a51191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:17.760608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-38874ebb-cb53-4a3e-8173-a20095a51191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:17.791777 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-38874ebb-cb53-4a3e-8173-a20095a51191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 200 len: 1461 microversion: 2.1 time: 0.364568 Sep 08 13:00:17.818463 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1876/3610] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:17 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 1461 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:17.832859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ccb1a4be-0ff7-4930-b222-66b95d9ec5e7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:17.834008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ccb1a4be-0ff7-4930-b222-66b95d9ec5e7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:17.853231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb1a4be-0ff7-4930-b222-66b95d9ec5e7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:17.853978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb1a4be-0ff7-4930-b222-66b95d9ec5e7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:17.855279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb1a4be-0ff7-4930-b222-66b95d9ec5e7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:17.857188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb1a4be-0ff7-4930-b222-66b95d9ec5e7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:17.861360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb1a4be-0ff7-4930-b222-66b95d9ec5e7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:17.864226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccb1a4be-0ff7-4930-b222-66b95d9ec5e7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:17.866236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3371b1f5-838d-4bf0-bd4e-98582f028aaf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:17.886010 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3371b1f5-838d-4bf0-bd4e-98582f028aaf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1315 microversion: 2.1 time: 0.731047 Sep 08 13:00:17.888518 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1735/3611] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:17 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1315 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:17.900828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8b7ca7a8-fc98-4c42-9fb7-b6cd98524468 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:17.902374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8b7ca7a8-fc98-4c42-9fb7-b6cd98524468 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:17.917139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b7ca7a8-fc98-4c42-9fb7-b6cd98524468 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:17.920350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b7ca7a8-fc98-4c42-9fb7-b6cd98524468 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:17.921829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b7ca7a8-fc98-4c42-9fb7-b6cd98524468 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:17.924045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b7ca7a8-fc98-4c42-9fb7-b6cd98524468 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:17.925967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b7ca7a8-fc98-4c42-9fb7-b6cd98524468 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:17.927159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b7ca7a8-fc98-4c42-9fb7-b6cd98524468 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:18.372241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ccb1a4be-0ff7-4930-b222-66b95d9ec5e7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:18.379053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8b7ca7a8-fc98-4c42-9fb7-b6cd98524468 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:18.396527 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8b7ca7a8-fc98-4c42-9fb7-b6cd98524468 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.505535 Sep 08 13:00:18.398042 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1736/3612] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:17 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:18.410205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-47594ee2-c631-4e4d-b562-47c9b3edab99 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:18.411503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-47594ee2-c631-4e4d-b562-47c9b3edab99 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:18.429368 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ccb1a4be-0ff7-4930-b222-66b95d9ec5e7 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1510 microversion: 2.1 time: 0.609163 Sep 08 13:00:18.430022 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1877/3613] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:17 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1510 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:18.447752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47594ee2-c631-4e4d-b562-47c9b3edab99 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:18.448598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47594ee2-c631-4e4d-b562-47c9b3edab99 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:18.459416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47594ee2-c631-4e4d-b562-47c9b3edab99 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:18.464250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47594ee2-c631-4e4d-b562-47c9b3edab99 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:18.466414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47594ee2-c631-4e4d-b562-47c9b3edab99 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:18.467137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47594ee2-c631-4e4d-b562-47c9b3edab99 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:18.482197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-64138277-990f-4f90-b836-188c37433559 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:18.486736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-64138277-990f-4f90-b836-188c37433559 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:18.501804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64138277-990f-4f90-b836-188c37433559 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:18.502224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64138277-990f-4f90-b836-188c37433559 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:18.503753 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-47594ee2-c631-4e4d-b562-47c9b3edab99 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-47594ee2-c631-4e4d-b562-47c9b3edab99 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 HTTP/1.1 Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '273397f3-2f7d-430f-845c-d365c2bc6412'} Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:18.505748 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:18.511005 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:00:18.511005 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:00:18.511005 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:00:18.511005 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:00:18.511005 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:00:18.511005 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:18.512858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64138277-990f-4f90-b836-188c37433559 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:18.513546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64138277-990f-4f90-b836-188c37433559 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:18.514277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64138277-990f-4f90-b836-188c37433559 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:18.514794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64138277-990f-4f90-b836-188c37433559 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:18.520535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-47594ee2-c631-4e4d-b562-47c9b3edab99 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:00:18.521709 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-47594ee2-c631-4e4d-b562-47c9b3edab99 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 404 len: 111 microversion: 2.1 time: 0.122205 Sep 08 13:00:18.523138 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1737/3614] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:18 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:00:18.534637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-14a8d803-0e8f-4104-8924-0d679ae75225 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:18.535287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-14a8d803-0e8f-4104-8924-0d679ae75225 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:18.542210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14a8d803-0e8f-4104-8924-0d679ae75225 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:18.543773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14a8d803-0e8f-4104-8924-0d679ae75225 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:18.544337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14a8d803-0e8f-4104-8924-0d679ae75225 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:18.545206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14a8d803-0e8f-4104-8924-0d679ae75225 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:18.545789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14a8d803-0e8f-4104-8924-0d679ae75225 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:18.546308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14a8d803-0e8f-4104-8924-0d679ae75225 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:18.593450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-14a8d803-0e8f-4104-8924-0d679ae75225 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:00:18.798960 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-14a8d803-0e8f-4104-8924-0d679ae75225 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 204 len: 0 microversion: 2.1 time: 0.268020 Sep 08 13:00:18.800268 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1738/3615] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:00:18 2022] DELETE /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:00:18.813279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-64138277-990f-4f90-b836-188c37433559 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:18.817828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4e76fd0a-b253-4638-8275-eb7f902eb0a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:18.820882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4e76fd0a-b253-4638-8275-eb7f902eb0a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:18.826911 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-64138277-990f-4f90-b836-188c37433559 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.364259 Sep 08 13:00:18.827621 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1878/3616] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:18 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:00:18.832807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e76fd0a-b253-4638-8275-eb7f902eb0a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:18.834114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e76fd0a-b253-4638-8275-eb7f902eb0a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:18.835212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e76fd0a-b253-4638-8275-eb7f902eb0a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:18.836962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e76fd0a-b253-4638-8275-eb7f902eb0a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:18.838150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e76fd0a-b253-4638-8275-eb7f902eb0a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:18.839183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e76fd0a-b253-4638-8275-eb7f902eb0a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:18.866296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b081d62f-b14a-4a87-9355-a74e930784ef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:18.867290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b081d62f-b14a-4a87-9355-a74e930784ef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:18.877791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b081d62f-b14a-4a87-9355-a74e930784ef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:18.878183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b081d62f-b14a-4a87-9355-a74e930784ef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:18.878807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b081d62f-b14a-4a87-9355-a74e930784ef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:18.880468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b081d62f-b14a-4a87-9355-a74e930784ef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:18.881299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b081d62f-b14a-4a87-9355-a74e930784ef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:18.882090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b081d62f-b14a-4a87-9355-a74e930784ef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:19.190889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4e76fd0a-b253-4638-8275-eb7f902eb0a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:19.210943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b081d62f-b14a-4a87-9355-a74e930784ef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:19.220337 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4e76fd0a-b253-4638-8275-eb7f902eb0a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1495 microversion: 2.1 time: 0.411005 Sep 08 13:00:19.220718 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b081d62f-b14a-4a87-9355-a74e930784ef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.363992 Sep 08 13:00:19.221414 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1879/3617] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:18 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:00:19.235898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-917bed4d-9144-424c-9d09-88ddfdb8a95f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:19.236880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-917bed4d-9144-424c-9d09-88ddfdb8a95f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:19.240538 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1739/3618] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:18 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1495 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:19.249914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-917bed4d-9144-424c-9d09-88ddfdb8a95f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:19.250493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-917bed4d-9144-424c-9d09-88ddfdb8a95f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:19.250865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-917bed4d-9144-424c-9d09-88ddfdb8a95f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:19.251875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-917bed4d-9144-424c-9d09-88ddfdb8a95f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:19.252555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-917bed4d-9144-424c-9d09-88ddfdb8a95f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:19.253208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-917bed4d-9144-424c-9d09-88ddfdb8a95f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:19.269005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-5bd7a145-6991-4e86-be08-04fd92b272c9 req-53eb53d6-b909-40b5-a863-20627411743d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26138bc0-1c3e-4a40-9945-448c5db3a424", "tag": "5552ed95-bafa-47a0-ab3e-40fd5cfe2a59"}, {"name": "network-changed", "server_uuid": "307b0e06-8473-44e0-90d1-25e6bbf73210", "tag": "405b7b07-1d3d-4562-b0ae-fafd46ae290c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:19.310662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5bd7a145-6991-4e86-be08-04fd92b272c9 req-53eb53d6-b909-40b5-a863-20627411743d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:19.312451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5bd7a145-6991-4e86-be08-04fd92b272c9 req-53eb53d6-b909-40b5-a863-20627411743d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:19.313540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5bd7a145-6991-4e86-be08-04fd92b272c9 req-53eb53d6-b909-40b5-a863-20627411743d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:19.351877 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-5bd7a145-6991-4e86-be08-04fd92b272c9 req-53eb53d6-b909-40b5-a863-20627411743d service nova] Creating event network-changed:5552ed95-bafa-47a0-ab3e-40fd5cfe2a59 for instance 26138bc0-1c3e-4a40-9945-448c5db3a424 on n-h2-852084-10 Sep 08 13:00:19.357085 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-5bd7a145-6991-4e86-be08-04fd92b272c9 req-53eb53d6-b909-40b5-a863-20627411743d service nova] Creating event network-changed:405b7b07-1d3d-4562-b0ae-fafd46ae290c for instance 307b0e06-8473-44e0-90d1-25e6bbf73210 on n-h2-852084-10 Sep 08 13:00:19.392175 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-5bd7a145-6991-4e86-be08-04fd92b272c9 req-53eb53d6-b909-40b5-a863-20627411743d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.139171 Sep 08 13:00:19.396711 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1740/3619] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:00:19.410476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3967036c-2bb2-4ed4-908e-5082b33d9407 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:19.419913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3967036c-2bb2-4ed4-908e-5082b33d9407 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:19.451735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3967036c-2bb2-4ed4-908e-5082b33d9407 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:19.454051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3967036c-2bb2-4ed4-908e-5082b33d9407 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:19.455634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3967036c-2bb2-4ed4-908e-5082b33d9407 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:19.457997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3967036c-2bb2-4ed4-908e-5082b33d9407 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:19.459269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3967036c-2bb2-4ed4-908e-5082b33d9407 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:19.461797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3967036c-2bb2-4ed4-908e-5082b33d9407 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:19.594526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-917bed4d-9144-424c-9d09-88ddfdb8a95f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:19.613061 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-917bed4d-9144-424c-9d09-88ddfdb8a95f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1315 microversion: 2.1 time: 0.388597 Sep 08 13:00:19.615091 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1880/3620] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:19 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:19.629167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1e15ed47-bbbf-44c2-a745-f406cd3c350c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:19.630984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1e15ed47-bbbf-44c2-a745-f406cd3c350c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:19.642393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e15ed47-bbbf-44c2-a745-f406cd3c350c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:19.643432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e15ed47-bbbf-44c2-a745-f406cd3c350c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:19.644174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e15ed47-bbbf-44c2-a745-f406cd3c350c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:19.645630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e15ed47-bbbf-44c2-a745-f406cd3c350c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:19.646517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e15ed47-bbbf-44c2-a745-f406cd3c350c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:19.647560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e15ed47-bbbf-44c2-a745-f406cd3c350c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:20.085637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3967036c-2bb2-4ed4-908e-5082b33d9407 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:20.095535 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3967036c-2bb2-4ed4-908e-5082b33d9407 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.696553 Sep 08 13:00:20.097624 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1741/3621] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:19 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:20.180561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1e15ed47-bbbf-44c2-a745-f406cd3c350c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:20.198286 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1e15ed47-bbbf-44c2-a745-f406cd3c350c tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1510 microversion: 2.1 time: 0.579887 Sep 08 13:00:20.207997 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1881/3622] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:19 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1510 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:20.265587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b7e04411-8a4a-4f92-95fe-dd03eaf7f0cc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:20.266807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b7e04411-8a4a-4f92-95fe-dd03eaf7f0cc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:20.284914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7e04411-8a4a-4f92-95fe-dd03eaf7f0cc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:20.285421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7e04411-8a4a-4f92-95fe-dd03eaf7f0cc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:20.285866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7e04411-8a4a-4f92-95fe-dd03eaf7f0cc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:20.286602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7e04411-8a4a-4f92-95fe-dd03eaf7f0cc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:20.287063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7e04411-8a4a-4f92-95fe-dd03eaf7f0cc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:20.288727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7e04411-8a4a-4f92-95fe-dd03eaf7f0cc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:20.543899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1568284275", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "82a4dc57-b1c7-4ce5-8528-3df2b0721b51"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:20.693601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] validate_networks() for [('82a4dc57-b1c7-4ce5-8528-3df2b0721b51', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:00:21.111391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b7e04411-8a4a-4f92-95fe-dd03eaf7f0cc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:21.141837 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b7e04411-8a4a-4f92-95fe-dd03eaf7f0cc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1495 microversion: 2.1 time: 0.884644 Sep 08 13:00:21.147473 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1742/3623] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:20 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1495 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:00:21.170137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-127ec1bd-d03b-4854-aac6-42e6a46c30b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:21.174854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-127ec1bd-d03b-4854-aac6-42e6a46c30b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:21.201302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-127ec1bd-d03b-4854-aac6-42e6a46c30b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:21.203072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-127ec1bd-d03b-4854-aac6-42e6a46c30b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:21.206337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-127ec1bd-d03b-4854-aac6-42e6a46c30b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:21.208903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-127ec1bd-d03b-4854-aac6-42e6a46c30b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:21.210184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-127ec1bd-d03b-4854-aac6-42e6a46c30b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:21.211910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-127ec1bd-d03b-4854-aac6-42e6a46c30b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:22.388280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-127ec1bd-d03b-4854-aac6-42e6a46c30b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:22.409138 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-127ec1bd-d03b-4854-aac6-42e6a46c30b6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1315 microversion: 2.1 time: 1.259141 Sep 08 13:00:22.410504 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1743/3624] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:21 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1315 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:22.419827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dea68ffe-6bce-42e2-9f2a-9390fc0c6342 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:22.421633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dea68ffe-6bce-42e2-9f2a-9390fc0c6342 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:22.451869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dea68ffe-6bce-42e2-9f2a-9390fc0c6342 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:22.454290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dea68ffe-6bce-42e2-9f2a-9390fc0c6342 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:22.455137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dea68ffe-6bce-42e2-9f2a-9390fc0c6342 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:22.456810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dea68ffe-6bce-42e2-9f2a-9390fc0c6342 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:22.462714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dea68ffe-6bce-42e2-9f2a-9390fc0c6342 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:22.465022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dea68ffe-6bce-42e2-9f2a-9390fc0c6342 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:22.738255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dea68ffe-6bce-42e2-9f2a-9390fc0c6342 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1f5d0ff6047495387025f0ad90e8bbd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd208955d80a140f18307d2702bd79d19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:22.765641 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dea68ffe-6bce-42e2-9f2a-9390fc0c6342 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 200 len: 1468 microversion: 2.1 time: 0.350366 Sep 08 13:00:22.774671 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1744/3625] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:22 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 1468 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:22.800716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b8b8bb32-4852-4d55-875e-921d61f35a67 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:22.802450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b8b8bb32-4852-4d55-875e-921d61f35a67 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:22.842606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8b8bb32-4852-4d55-875e-921d61f35a67 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:22.844664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8b8bb32-4852-4d55-875e-921d61f35a67 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:22.847535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8b8bb32-4852-4d55-875e-921d61f35a67 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:22.850460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8b8bb32-4852-4d55-875e-921d61f35a67 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:22.857851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8b8bb32-4852-4d55-875e-921d61f35a67 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:22.858804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8b8bb32-4852-4d55-875e-921d61f35a67 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:22.905074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:23.025075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:00:23.026038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:00:23.026714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:00:23.027275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:00:23.028573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:00:23.057329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:23.101659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b8b8bb32-4852-4d55-875e-921d61f35a67 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:23.109721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:23.113637 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b8b8bb32-4852-4d55-875e-921d61f35a67 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1453 microversion: 2.1 time: 0.334861 Sep 08 13:00:23.113921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:23.114106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:23.120583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:23.121596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:23.122295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:23.134434 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1745/3626] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:22 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1453 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:23.139470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3dcb9332-ff34-48e5-ab86-a7bdb0267367 req-92996dd9-1199-4eb8-b8b9-3160f0c9b432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb61c338-cf63-45dc-97e7-a9b6ad019a63", "name": "network-vif-deleted", "tag": "8ca3eda9-46fb-4ca4-8f47-250b1d3ba400"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:23.182763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3dcb9332-ff34-48e5-ab86-a7bdb0267367 req-92996dd9-1199-4eb8-b8b9-3160f0c9b432 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:23.183249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3dcb9332-ff34-48e5-ab86-a7bdb0267367 req-92996dd9-1199-4eb8-b8b9-3160f0c9b432 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:23.183726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3dcb9332-ff34-48e5-ab86-a7bdb0267367 req-92996dd9-1199-4eb8-b8b9-3160f0c9b432 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:23.213808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Getting quotas for project 59dc0decb175444491383c39918c5b2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:00:23.227858 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3dcb9332-ff34-48e5-ab86-a7bdb0267367 req-92996dd9-1199-4eb8-b8b9-3160f0c9b432 service nova] Creating event network-vif-deleted:8ca3eda9-46fb-4ca4-8f47-250b1d3ba400 for instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 on n-h2-852084-10 Sep 08 13:00:23.253625 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3dcb9332-ff34-48e5-ab86-a7bdb0267367 req-92996dd9-1199-4eb8-b8b9-3160f0c9b432 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117332 Sep 08 13:00:23.256197 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1746/3627] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:00:23.264804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Getting quotas for user 4140a06bc6934d7780ef9ff3e30e6dd5 and project 59dc0decb175444491383c39918c5b2e. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:00:23.380860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:00:23.383955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:00:23.477016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b8490df3-e2f2-4998-8d4c-959f83b0d8c3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:23.496562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b8490df3-e2f2-4998-8d4c-959f83b0d8c3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:23.560861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8490df3-e2f2-4998-8d4c-959f83b0d8c3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:23.561918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8490df3-e2f2-4998-8d4c-959f83b0d8c3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:23.570329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8490df3-e2f2-4998-8d4c-959f83b0d8c3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:23.571814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8490df3-e2f2-4998-8d4c-959f83b0d8c3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:23.572767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8490df3-e2f2-4998-8d4c-959f83b0d8c3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:23.573580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8490df3-e2f2-4998-8d4c-959f83b0d8c3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:23.679789 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3dec4661-5717-4fe7-b35f-9abd1a829cb4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.149117 Sep 08 13:00:23.695990 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1882/3628] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:00:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3166 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:00:23.721935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-88e9b37e-8506-4c87-b126-4bb3b9381dde tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:23.723671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-88e9b37e-8506-4c87-b126-4bb3b9381dde tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:24.218824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-88e9b37e-8506-4c87-b126-4bb3b9381dde tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:24.263636 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-88e9b37e-8506-4c87-b126-4bb3b9381dde tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1215 microversion: 2.1 time: 0.565872 Sep 08 13:00:24.268702 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1883/3629] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:23 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1215 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:24.305417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d34bb7b-999c-4367-91ee-2b88c3869741 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:24.307026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6d34bb7b-999c-4367-91ee-2b88c3869741 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] [instance: bb61c338-cf63-45dc-97e7-a9b6ad019a63] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:24.330734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d34bb7b-999c-4367-91ee-2b88c3869741 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:24.331633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d34bb7b-999c-4367-91ee-2b88c3869741 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:24.335376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d34bb7b-999c-4367-91ee-2b88c3869741 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:24.336837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d34bb7b-999c-4367-91ee-2b88c3869741 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:24.337679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d34bb7b-999c-4367-91ee-2b88c3869741 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:24.338729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d34bb7b-999c-4367-91ee-2b88c3869741 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:24.386489 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6d34bb7b-999c-4367-91ee-2b88c3869741 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] HTTP exception thrown: Instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 could not be found. Sep 08 13:00:24.402386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b8490df3-e2f2-4998-8d4c-959f83b0d8c3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:24.417113 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b8490df3-e2f2-4998-8d4c-959f83b0d8c3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1315 microversion: 2.1 time: 0.959187 Sep 08 13:00:24.420916 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1747/3630] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:23 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1315 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d34bb7b-999c-4367-91ee-2b88c3869741 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Request method failure captured: Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 HTTP/1.1 Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGebwrVajYkV68Tg38pcIwqGv7tS-FJ19CGv7BwJ1gO_Izwb0jBM_kKssES8XpvnnvsXcPri4XftikK_n8t5982udy8AdhkbDJ2-EtwGiwPhNiqPJjmS7WsriWwIQUtzYmv25qFGDt2kjzcifPxc7RSyfvmAVKTQbd-iKwCIfOQgLvGA Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d208955d80a140f18307d2702bd79d19 Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-1629007520 Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d208955d80a140f18307d2702bd79d19"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d208955d80a140f18307d2702bd79d19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d208955d80a140f18307d2702bd79d19"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d208955d80a140f18307d2702bd79d19"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-1629007520 Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d208955d80a140f18307d2702bd79d19 Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-1629007520 Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerRescueTestJSONUnderV235-1629007520-project Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: a1f5d0ff6047495387025f0ad90e8bbd Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-1629007520-project Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 could not be found. Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'bb61c338-cf63-45dc-97e7-a9b6ad019a63'} Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 could not be found. Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 could not be found. Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:00:24.422467 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:00:24.439159 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:00:24.439159 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:24.439159 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:00:24.439159 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:00:24.439159 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:00:24.439159 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:00:24.439159 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 could not be found. Sep 08 13:00:24.439159 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:00:24.440620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:24.440620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:24.442974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d34bb7b-999c-4367-91ee-2b88c3869741 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] Returning 404 to user: Instance bb61c338-cf63-45dc-97e7-a9b6ad019a63 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:00:24.444931 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6d34bb7b-999c-4367-91ee-2b88c3869741 tempest-ServerRescueTestJSONUnderV235-1629007520 tempest-ServerRescueTestJSONUnderV235-1629007520-project] 10.222.0.78 "GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63" status: 404 len: 111 microversion: 2.1 time: 0.173824 Sep 08 13:00:24.449016 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1884/3631] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:24 2022] GET /compute/v2.1/servers/bb61c338-cf63-45dc-97e7-a9b6ad019a63 => generated 111 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:00:24.458702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:24.459253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:24.463968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:24.464731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:24.465979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:24.468295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:24.632255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:24.643854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:24.645041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:24.645932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lazy-loading 'fault' on Instance uuid 4f5c17a5-8282-4299-b6c1-13159d0a3a7a {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:00:24.883352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:24.909240 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-46590b70-0a2c-4f92-86cf-aa882131766b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 200 len: 1298 microversion: 2.1 time: 0.485122 Sep 08 13:00:24.916109 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1748/3632] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:24 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 1298 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:25.320848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b176f6bc-c45e-4df6-844b-721389bb40c0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:25.321811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b176f6bc-c45e-4df6-844b-721389bb40c0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:25.399682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b74fbd42-dc0b-4a0b-aaa6-703cd45fc93e req-b035e496-1ed6-49d2-a860-7c657df2b1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f5c17a5-8282-4299-b6c1-13159d0a3a7a", "name": "network-vif-deleted", "tag": "8c808abb-3d3c-4c13-b0fa-a96783346388"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:25.402088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b176f6bc-c45e-4df6-844b-721389bb40c0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:25.415097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b176f6bc-c45e-4df6-844b-721389bb40c0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:25.418849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b176f6bc-c45e-4df6-844b-721389bb40c0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:25.438846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b176f6bc-c45e-4df6-844b-721389bb40c0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:25.467727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b176f6bc-c45e-4df6-844b-721389bb40c0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:25.469085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b176f6bc-c45e-4df6-844b-721389bb40c0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:25.513600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b74fbd42-dc0b-4a0b-aaa6-703cd45fc93e req-b035e496-1ed6-49d2-a860-7c657df2b1ee service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:25.517225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b74fbd42-dc0b-4a0b-aaa6-703cd45fc93e req-b035e496-1ed6-49d2-a860-7c657df2b1ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:25.520791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b74fbd42-dc0b-4a0b-aaa6-703cd45fc93e req-b035e496-1ed6-49d2-a860-7c657df2b1ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:25.608211 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b74fbd42-dc0b-4a0b-aaa6-703cd45fc93e req-b035e496-1ed6-49d2-a860-7c657df2b1ee service nova] Creating event network-vif-deleted:8c808abb-3d3c-4c13-b0fa-a96783346388 for instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a on n-h1-852084-10 Sep 08 13:00:25.651282 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b74fbd42-dc0b-4a0b-aaa6-703cd45fc93e req-b035e496-1ed6-49d2-a860-7c657df2b1ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.259524 Sep 08 13:00:25.654859 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1749/3633] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:00:25.687739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8b2b654b-d08c-4b17-91d5-d2fe71ea23ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:25.689493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8b2b654b-d08c-4b17-91d5-d2fe71ea23ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:25.733123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b2b654b-d08c-4b17-91d5-d2fe71ea23ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:25.735474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b2b654b-d08c-4b17-91d5-d2fe71ea23ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:25.736593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b2b654b-d08c-4b17-91d5-d2fe71ea23ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:25.737653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b2b654b-d08c-4b17-91d5-d2fe71ea23ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:25.740636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b2b654b-d08c-4b17-91d5-d2fe71ea23ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:25.745087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b2b654b-d08c-4b17-91d5-d2fe71ea23ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:25.934952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b176f6bc-c45e-4df6-844b-721389bb40c0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:25.988992 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b176f6bc-c45e-4df6-844b-721389bb40c0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1211 microversion: 2.1 time: 0.661638 Sep 08 13:00:25.998447 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1885/3634] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:25 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1211 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:00:26.026063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e001d8ad-fc12-4675-8956-ef946a683048 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:26.027120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e001d8ad-fc12-4675-8956-ef946a683048 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:26.079863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e001d8ad-fc12-4675-8956-ef946a683048 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:26.081842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e001d8ad-fc12-4675-8956-ef946a683048 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:26.082961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e001d8ad-fc12-4675-8956-ef946a683048 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:26.084907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e001d8ad-fc12-4675-8956-ef946a683048 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:26.085566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e001d8ad-fc12-4675-8956-ef946a683048 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:26.086357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e001d8ad-fc12-4675-8956-ef946a683048 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:26.149234 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e001d8ad-fc12-4675-8956-ef946a683048 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e001d8ad-fc12-4675-8956-ef946a683048 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a HTTP/1.1 Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '4f5c17a5-8282-4299-b6c1-13159d0a3a7a'} Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:00:26.154694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:26.164819 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:00:26.164819 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:00:26.164819 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:00:26.164819 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:00:26.164819 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:00:26.164819 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:00:26.164819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e001d8ad-fc12-4675-8956-ef946a683048 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:00:26.164819 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e001d8ad-fc12-4675-8956-ef946a683048 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 404 len: 111 microversion: 2.1 time: 0.160333 Sep 08 13:00:26.167770 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1886/3635] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:25 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:00:26.179362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-93cc1c8f-e466-4049-83b8-5972b49c2ee7 req-755e628a-e1b5-436d-9bcc-55597646bd22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26138bc0-1c3e-4a40-9945-448c5db3a424", "name": "network-vif-plugged", "status": "completed", "tag": "5552ed95-bafa-47a0-ab3e-40fd5cfe2a59"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:26.205939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-93cc1c8f-e466-4049-83b8-5972b49c2ee7 req-755e628a-e1b5-436d-9bcc-55597646bd22 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:26.207965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-93cc1c8f-e466-4049-83b8-5972b49c2ee7 req-755e628a-e1b5-436d-9bcc-55597646bd22 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:26.208800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-93cc1c8f-e466-4049-83b8-5972b49c2ee7 req-755e628a-e1b5-436d-9bcc-55597646bd22 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:26.250433 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-93cc1c8f-e466-4049-83b8-5972b49c2ee7 req-755e628a-e1b5-436d-9bcc-55597646bd22 service nova] Creating event network-vif-plugged:5552ed95-bafa-47a0-ab3e-40fd5cfe2a59 for instance 26138bc0-1c3e-4a40-9945-448c5db3a424 on n-h2-852084-10 Sep 08 13:00:26.263128 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-93cc1c8f-e466-4049-83b8-5972b49c2ee7 req-755e628a-e1b5-436d-9bcc-55597646bd22 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089736 Sep 08 13:00:26.273128 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1887/3636] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:00:26.597654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1107151934", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "e905a95c-2324-49bd-8a89-bae4286a1b74"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:26.670434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8b2b654b-d08c-4b17-91d5-d2fe71ea23ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:26.699790 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8b2b654b-d08c-4b17-91d5-d2fe71ea23ff tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1315 microversion: 2.1 time: 1.040871 Sep 08 13:00:26.701176 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1750/3637] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:25 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1315 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:26.770765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] validate_networks() for [('e905a95c-2324-49bd-8a89-bae4286a1b74', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:00:27.041259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-11bdc10b-b56a-43a5-b918-15fdcc821a45 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:27.052578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-11bdc10b-b56a-43a5-b918-15fdcc821a45 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:27.063356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-11bdc10b-b56a-43a5-b918-15fdcc821a45 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Searching by: {'deleted': False, 'project_id': '74106d62b334496789cc796af8d57108'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 13:00:27.087672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-11bdc10b-b56a-43a5-b918-15fdcc821a45 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:27.092825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-11bdc10b-b56a-43a5-b918-15fdcc821a45 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:27.097244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-11bdc10b-b56a-43a5-b918-15fdcc821a45 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:27.098109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-11bdc10b-b56a-43a5-b918-15fdcc821a45 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:27.098596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-11bdc10b-b56a-43a5-b918-15fdcc821a45 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:27.099030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-11bdc10b-b56a-43a5-b918-15fdcc821a45 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:27.195038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-11bdc10b-b56a-43a5-b918-15fdcc821a45 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 13:00:27.259315 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-11bdc10b-b56a-43a5-b918-15fdcc821a45 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.224600 Sep 08 13:00:27.260568 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1751/3638] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 13:00:27 2022] GET /compute/v2.1/servers => generated 344 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:00:27.266535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d445e7fb-e9f3-4ec3-a4d6-724ef93306f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:27.267515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d445e7fb-e9f3-4ec3-a4d6-724ef93306f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:27.276344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d445e7fb-e9f3-4ec3-a4d6-724ef93306f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:27.278441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d445e7fb-e9f3-4ec3-a4d6-724ef93306f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:27.280009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d445e7fb-e9f3-4ec3-a4d6-724ef93306f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:27.281239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d445e7fb-e9f3-4ec3-a4d6-724ef93306f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:27.282601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d445e7fb-e9f3-4ec3-a4d6-724ef93306f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:27.285904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d445e7fb-e9f3-4ec3-a4d6-724ef93306f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:27.391085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d445e7fb-e9f3-4ec3-a4d6-724ef93306f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:27.407753 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d445e7fb-e9f3-4ec3-a4d6-724ef93306f1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1267 microversion: 2.1 time: 0.145501 Sep 08 13:00:27.422232 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1752/3639] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:27 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:27.422232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:27.427798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:00:27.428916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:00:27.429571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:00:27.430211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:00:27.430812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:00:27.441815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:27.447251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Searching by: {'deleted': False, 'project_id': '74106d62b334496789cc796af8d57108'} {{(pid=128971) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 13:00:27.453291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:27.455912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:27.458116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:27.460146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:27.462052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:27.463033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:27.463732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:27.464553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:27.468069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:27.469531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:27.472241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:27.472960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:27.515658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:00:27.529639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for user 227ef616a0764f5eaff5988f8a470f0c and project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:00:27.533536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.multi_cell_list [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128971) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 13:00:27.586843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:00:27.595947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:00:27.655243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:27.662647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:27.666406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:27.667090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:27.764613 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a5351b09-83e6-498d-9367-6a1f94157eca tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.171416 Sep 08 13:00:27.773524 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1888/3640] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:00:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:00:27.788176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-87eb794c-0472-4d22-8bef-f555c4e6280a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:27.789832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-87eb794c-0472-4d22-8bef-f555c4e6280a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:27.813564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87eb794c-0472-4d22-8bef-f555c4e6280a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:27.814341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87eb794c-0472-4d22-8bef-f555c4e6280a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:27.814962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87eb794c-0472-4d22-8bef-f555c4e6280a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:27.816761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87eb794c-0472-4d22-8bef-f555c4e6280a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:27.817445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87eb794c-0472-4d22-8bef-f555c4e6280a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:27.818048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87eb794c-0472-4d22-8bef-f555c4e6280a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:28.532063 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0a8b9ce8-b7dd-4ca3-9baa-de1e250b8184 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 1.119513 Sep 08 13:00:28.536040 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1753/3641] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 13:00:27 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:28.573567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cb2b09fb-2406-415e-9d0d-9929c192f1e5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:28.577168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cb2b09fb-2406-415e-9d0d-9929c192f1e5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:28.625676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-87eb794c-0472-4d22-8bef-f555c4e6280a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:28.725674 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-87eb794c-0472-4d22-8bef-f555c4e6280a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1315 microversion: 2.1 time: 0.945409 Sep 08 13:00:28.767901 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1889/3642] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:27 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1315 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:28.792071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84f8b293-baf7-4690-8a63-a76309326cb2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:28.797249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-84f8b293-baf7-4690-8a63-a76309326cb2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:28.813834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84f8b293-baf7-4690-8a63-a76309326cb2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:28.815348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84f8b293-baf7-4690-8a63-a76309326cb2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:28.816843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84f8b293-baf7-4690-8a63-a76309326cb2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:28.819431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84f8b293-baf7-4690-8a63-a76309326cb2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:28.821111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84f8b293-baf7-4690-8a63-a76309326cb2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:28.822691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84f8b293-baf7-4690-8a63-a76309326cb2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:28.900277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cb2b09fb-2406-415e-9d0d-9929c192f1e5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:28.909538 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cb2b09fb-2406-415e-9d0d-9929c192f1e5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1209 microversion: 2.1 time: 0.370825 Sep 08 13:00:28.929474 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1754/3643] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:28 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1209 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:28.929474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b24a0bad-2372-4551-9724-49de6b23380d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:28.939677 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b24a0bad-2372-4551-9724-49de6b23380d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025718 Sep 08 13:00:28.947794 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1755/3644] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 13:00:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:00:29.048652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-84f8b293-baf7-4690-8a63-a76309326cb2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:29.081857 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-84f8b293-baf7-4690-8a63-a76309326cb2 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1273 microversion: 2.1 time: 0.302638 Sep 08 13:00:29.082930 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1890/3645] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:28 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1273 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:29.318645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4ae9ed0a-e4c9-45c3-9313-6de8401c48de tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:29.319473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ae9ed0a-e4c9-45c3-9313-6de8401c48de tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:29.332473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ae9ed0a-e4c9-45c3-9313-6de8401c48de tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:29.333289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ae9ed0a-e4c9-45c3-9313-6de8401c48de tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:29.333899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ae9ed0a-e4c9-45c3-9313-6de8401c48de tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:29.334849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ae9ed0a-e4c9-45c3-9313-6de8401c48de tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:29.337505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ae9ed0a-e4c9-45c3-9313-6de8401c48de tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:29.339550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ae9ed0a-e4c9-45c3-9313-6de8401c48de tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:29.401706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ae9ed0a-e4c9-45c3-9313-6de8401c48de tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:00:29.541288 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4ae9ed0a-e4c9-45c3-9313-6de8401c48de tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 204 len: 0 microversion: 2.1 time: 0.227904 Sep 08 13:00:29.549121 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1756/3646] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:00:29 2022] DELETE /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:00:29.555148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-703b550c-ec3d-4870-8ce8-4af2d37af8af tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:29.556506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-703b550c-ec3d-4870-8ce8-4af2d37af8af tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:29.571064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-703b550c-ec3d-4870-8ce8-4af2d37af8af tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:29.571791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-703b550c-ec3d-4870-8ce8-4af2d37af8af tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:29.572252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-703b550c-ec3d-4870-8ce8-4af2d37af8af tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:29.573090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-703b550c-ec3d-4870-8ce8-4af2d37af8af tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:29.673935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-703b550c-ec3d-4870-8ce8-4af2d37af8af tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:29.673935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-703b550c-ec3d-4870-8ce8-4af2d37af8af tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:29.784503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b8b89404-cb9c-417b-abe1-98a32eecd3cc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:29.785514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b8b89404-cb9c-417b-abe1-98a32eecd3cc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:29.798285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8b89404-cb9c-417b-abe1-98a32eecd3cc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:29.799031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8b89404-cb9c-417b-abe1-98a32eecd3cc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:29.799731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8b89404-cb9c-417b-abe1-98a32eecd3cc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:29.810015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8b89404-cb9c-417b-abe1-98a32eecd3cc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:29.811114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8b89404-cb9c-417b-abe1-98a32eecd3cc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:29.812241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8b89404-cb9c-417b-abe1-98a32eecd3cc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:30.016560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-703b550c-ec3d-4870-8ce8-4af2d37af8af tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:30.033731 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-703b550c-ec3d-4870-8ce8-4af2d37af8af tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1607 microversion: 2.1 time: 0.483157 Sep 08 13:00:30.034518 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1891/3647] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:29 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1607 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:00:30.039733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ec78b7cb-e006-4711-8d9d-5148c7a89cfe tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:30.040370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ec78b7cb-e006-4711-8d9d-5148c7a89cfe tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:30.065703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec78b7cb-e006-4711-8d9d-5148c7a89cfe tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:30.066479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec78b7cb-e006-4711-8d9d-5148c7a89cfe tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:30.067067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec78b7cb-e006-4711-8d9d-5148c7a89cfe tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:30.072342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec78b7cb-e006-4711-8d9d-5148c7a89cfe tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:30.073085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec78b7cb-e006-4711-8d9d-5148c7a89cfe tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:30.073692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec78b7cb-e006-4711-8d9d-5148c7a89cfe tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:30.170220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b8b89404-cb9c-417b-abe1-98a32eecd3cc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:30.179540 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b8b89404-cb9c-417b-abe1-98a32eecd3cc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1501 microversion: 2.1 time: 0.399034 Sep 08 13:00:30.185080 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1757/3648] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:29 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1501 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:30.190420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a1046473-35d9-4bbf-8ebe-8de0fd5ee0bc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:30.191053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a1046473-35d9-4bbf-8ebe-8de0fd5ee0bc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:30.212971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1046473-35d9-4bbf-8ebe-8de0fd5ee0bc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:30.213488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1046473-35d9-4bbf-8ebe-8de0fd5ee0bc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:30.213932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1046473-35d9-4bbf-8ebe-8de0fd5ee0bc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:30.224448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1046473-35d9-4bbf-8ebe-8de0fd5ee0bc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:30.225214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1046473-35d9-4bbf-8ebe-8de0fd5ee0bc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:30.225830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1046473-35d9-4bbf-8ebe-8de0fd5ee0bc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:30.261278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ec78b7cb-e006-4711-8d9d-5148c7a89cfe tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:30.280473 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ec78b7cb-e006-4711-8d9d-5148c7a89cfe tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1261 microversion: 2.1 time: 0.244515 Sep 08 13:00:30.290545 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1892/3649] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:30 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1261 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:30.301945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-500d8327-b3e8-43e1-8ce9-4d776f869e4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:30.315050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-500d8327-b3e8-43e1-8ce9-4d776f869e4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:30.315711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-500d8327-b3e8-43e1-8ce9-4d776f869e4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:30.316243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-500d8327-b3e8-43e1-8ce9-4d776f869e4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:30.376333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a1046473-35d9-4bbf-8ebe-8de0fd5ee0bc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:30.391140 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a1046473-35d9-4bbf-8ebe-8de0fd5ee0bc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1273 microversion: 2.1 time: 0.202842 Sep 08 13:00:30.391843 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1758/3650] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:30 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1273 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:30.392504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-500d8327-b3e8-43e1-8ce9-4d776f869e4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Going to try to stop instance {{(pid=128970) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 13:00:30.396686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:30.516175 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-500d8327-b3e8-43e1-8ce9-4d776f869e4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "POST /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424/action" status: 202 len: 0 microversion: 2.1 time: 0.222215 Sep 08 13:00:30.523343 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1893/3651] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:00:30 2022] POST /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:00:30.526331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-81a589da-d1e2-4297-b9d9-1c49e186072d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:30.527075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-81a589da-d1e2-4297-b9d9-1c49e186072d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:30.543005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81a589da-d1e2-4297-b9d9-1c49e186072d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:30.545425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81a589da-d1e2-4297-b9d9-1c49e186072d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:30.548872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81a589da-d1e2-4297-b9d9-1c49e186072d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:30.549866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81a589da-d1e2-4297-b9d9-1c49e186072d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:30.552396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81a589da-d1e2-4297-b9d9-1c49e186072d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:30.557321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81a589da-d1e2-4297-b9d9-1c49e186072d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:31.081420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6079f7d4-2742-4099-8cd0-edc96db7daf6 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:31.082905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6079f7d4-2742-4099-8cd0-edc96db7daf6 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:31.102484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6079f7d4-2742-4099-8cd0-edc96db7daf6 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:31.108121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6079f7d4-2742-4099-8cd0-edc96db7daf6 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:31.111876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6079f7d4-2742-4099-8cd0-edc96db7daf6 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:31.114631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6079f7d4-2742-4099-8cd0-edc96db7daf6 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:31.116555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6079f7d4-2742-4099-8cd0-edc96db7daf6 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:31.117757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6079f7d4-2742-4099-8cd0-edc96db7daf6 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:31.887635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6079f7d4-2742-4099-8cd0-edc96db7daf6 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:31.928439 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6079f7d4-2742-4099-8cd0-edc96db7daf6 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1607 microversion: 2.1 time: 0.848518 Sep 08 13:00:31.930385 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1894/3652] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:31 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1607 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:31.950754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1e3610c3-729d-4e54-8c46-600f5c15f433 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:31.952656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1e3610c3-729d-4e54-8c46-600f5c15f433 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:31.974918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e3610c3-729d-4e54-8c46-600f5c15f433 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:31.975741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e3610c3-729d-4e54-8c46-600f5c15f433 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:31.976610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e3610c3-729d-4e54-8c46-600f5c15f433 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:31.978240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e3610c3-729d-4e54-8c46-600f5c15f433 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:31.979370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e3610c3-729d-4e54-8c46-600f5c15f433 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:31.982985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e3610c3-729d-4e54-8c46-600f5c15f433 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:32.355988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1e3610c3-729d-4e54-8c46-600f5c15f433 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:32.370705 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1e3610c3-729d-4e54-8c46-600f5c15f433 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1267 microversion: 2.1 time: 0.438654 Sep 08 13:00:32.372018 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1895/3653] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:31 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1267 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:32.383622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c0feb034-3b5c-4619-96ea-6a83b34407f8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:32.385636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c0feb034-3b5c-4619-96ea-6a83b34407f8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:32.432639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0feb034-3b5c-4619-96ea-6a83b34407f8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:32.438802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0feb034-3b5c-4619-96ea-6a83b34407f8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:32.439660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0feb034-3b5c-4619-96ea-6a83b34407f8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:32.441117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0feb034-3b5c-4619-96ea-6a83b34407f8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:32.447130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0feb034-3b5c-4619-96ea-6a83b34407f8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:32.448572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0feb034-3b5c-4619-96ea-6a83b34407f8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:32.479061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-81a589da-d1e2-4297-b9d9-1c49e186072d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:32.524045 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-81a589da-d1e2-4297-b9d9-1c49e186072d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1511 microversion: 2.1 time: 1.993587 Sep 08 13:00:32.525279 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1759/3654] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:30 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1511 bytes in 2004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:32.973498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-00c402ea-35ae-46a3-b4ee-cd615f1ac6ae tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:32.974288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-00c402ea-35ae-46a3-b4ee-cd615f1ac6ae tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:32.982681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00c402ea-35ae-46a3-b4ee-cd615f1ac6ae tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:32.983463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00c402ea-35ae-46a3-b4ee-cd615f1ac6ae tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:32.984001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00c402ea-35ae-46a3-b4ee-cd615f1ac6ae tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:32.984830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00c402ea-35ae-46a3-b4ee-cd615f1ac6ae tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:32.985524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00c402ea-35ae-46a3-b4ee-cd615f1ac6ae tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:32.986157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00c402ea-35ae-46a3-b4ee-cd615f1ac6ae tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:33.141279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c0feb034-3b5c-4619-96ea-6a83b34407f8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:33.157684 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c0feb034-3b5c-4619-96ea-6a83b34407f8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1315 microversion: 2.1 time: 0.783631 Sep 08 13:00:33.158442 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1896/3655] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:32 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1315 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:33.167099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2204f163-2e6a-46d7-950c-29ad8b94df8d req-590f8455-2885-4687-ac4a-2bdf0025536e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50a71f0f-f2e1-45b0-9c8d-fee16d9b4840", "tag": "9881bbfc-f0e8-43c0-a5c4-68f7e0961d4e"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:33.228528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2204f163-2e6a-46d7-950c-29ad8b94df8d req-590f8455-2885-4687-ac4a-2bdf0025536e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:33.230816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2204f163-2e6a-46d7-950c-29ad8b94df8d req-590f8455-2885-4687-ac4a-2bdf0025536e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:33.231976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2204f163-2e6a-46d7-950c-29ad8b94df8d req-590f8455-2885-4687-ac4a-2bdf0025536e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:33.270505 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2204f163-2e6a-46d7-950c-29ad8b94df8d req-590f8455-2885-4687-ac4a-2bdf0025536e service nova] Creating event network-changed:9881bbfc-f0e8-43c0-a5c4-68f7e0961d4e for instance 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 on n-h1-852084-10 Sep 08 13:00:33.284908 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2204f163-2e6a-46d7-950c-29ad8b94df8d req-590f8455-2885-4687-ac4a-2bdf0025536e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123743 Sep 08 13:00:33.286804 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1897/3656] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:00:33.443908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7a8439db-0286-4bec-b63f-1cd3f8b5fb43 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:33.452538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7a8439db-0286-4bec-b63f-1cd3f8b5fb43 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:33.514436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a8439db-0286-4bec-b63f-1cd3f8b5fb43 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:33.515211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a8439db-0286-4bec-b63f-1cd3f8b5fb43 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:33.515870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a8439db-0286-4bec-b63f-1cd3f8b5fb43 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:33.516874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a8439db-0286-4bec-b63f-1cd3f8b5fb43 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:33.520354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a8439db-0286-4bec-b63f-1cd3f8b5fb43 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:33.521023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a8439db-0286-4bec-b63f-1cd3f8b5fb43 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:33.646353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-00c402ea-35ae-46a3-b4ee-cd615f1ac6ae tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:33.662679 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-00c402ea-35ae-46a3-b4ee-cd615f1ac6ae tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1607 microversion: 2.1 time: 0.693318 Sep 08 13:00:33.666448 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1760/3657] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:32 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1607 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:33.674125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-067eb668-d7fc-4eb7-a34f-bae1e6b7c5f3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:33.675165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-067eb668-d7fc-4eb7-a34f-bae1e6b7c5f3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:33.686049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-067eb668-d7fc-4eb7-a34f-bae1e6b7c5f3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:33.687101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-067eb668-d7fc-4eb7-a34f-bae1e6b7c5f3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:33.688168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-067eb668-d7fc-4eb7-a34f-bae1e6b7c5f3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:33.705104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-067eb668-d7fc-4eb7-a34f-bae1e6b7c5f3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:33.708286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-067eb668-d7fc-4eb7-a34f-bae1e6b7c5f3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:33.713804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-067eb668-d7fc-4eb7-a34f-bae1e6b7c5f3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:34.206408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7a8439db-0286-4bec-b63f-1cd3f8b5fb43 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:34.222422 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7a8439db-0286-4bec-b63f-1cd3f8b5fb43 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1267 microversion: 2.1 time: 0.802728 Sep 08 13:00:34.223845 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1898/3658] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:33 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1267 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:34.242677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-14f0c94a-8d1a-4627-89d6-8182942545eb tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:34.245571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-14f0c94a-8d1a-4627-89d6-8182942545eb tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:34.273353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14f0c94a-8d1a-4627-89d6-8182942545eb tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:34.276612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14f0c94a-8d1a-4627-89d6-8182942545eb tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:34.278756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14f0c94a-8d1a-4627-89d6-8182942545eb tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:34.282654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14f0c94a-8d1a-4627-89d6-8182942545eb tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:34.283469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14f0c94a-8d1a-4627-89d6-8182942545eb tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:34.284032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14f0c94a-8d1a-4627-89d6-8182942545eb tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:34.588071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-067eb668-d7fc-4eb7-a34f-bae1e6b7c5f3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:34.616370 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-067eb668-d7fc-4eb7-a34f-bae1e6b7c5f3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1511 microversion: 2.1 time: 0.945748 Sep 08 13:00:34.643703 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1761/3659] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:33 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1511 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:34.717091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-761a1b5e-d7af-4e69-b608-cb73359bac64 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:34.718038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-761a1b5e-d7af-4e69-b608-cb73359bac64 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:34.733802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-761a1b5e-d7af-4e69-b608-cb73359bac64 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:34.734477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-761a1b5e-d7af-4e69-b608-cb73359bac64 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:34.735043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-761a1b5e-d7af-4e69-b608-cb73359bac64 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:34.735839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-761a1b5e-d7af-4e69-b608-cb73359bac64 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:34.736322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-761a1b5e-d7af-4e69-b608-cb73359bac64 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:34.741454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-761a1b5e-d7af-4e69-b608-cb73359bac64 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:34.748396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:34.769313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-14f0c94a-8d1a-4627-89d6-8182942545eb tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:34.820569 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-14f0c94a-8d1a-4627-89d6-8182942545eb tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1315 microversion: 2.1 time: 0.591944 Sep 08 13:00:34.860319 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1899/3660] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:34 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:34.912041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-761a1b5e-d7af-4e69-b608-cb73359bac64 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:34.923762 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-761a1b5e-d7af-4e69-b608-cb73359bac64 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1541 microversion: 2.1 time: 0.212694 Sep 08 13:00:34.928071 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1762/3661] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:34 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1541 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:35.303090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-24086d12-06ba-449f-8947-4f3d6e28fa8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:35.307714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-24086d12-06ba-449f-8947-4f3d6e28fa8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:35.345631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24086d12-06ba-449f-8947-4f3d6e28fa8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:35.346797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24086d12-06ba-449f-8947-4f3d6e28fa8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:35.350239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24086d12-06ba-449f-8947-4f3d6e28fa8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:35.361855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24086d12-06ba-449f-8947-4f3d6e28fa8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:35.362836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24086d12-06ba-449f-8947-4f3d6e28fa8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:35.368229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24086d12-06ba-449f-8947-4f3d6e28fa8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:35.537667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-343dfc27-8c26-4d0c-b4b5-7dbddad19a92 req-95624204-cdfb-40b1-a42f-70001c209aaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccf7350-edf4-471c-8050-c3f5c15b4921", "name": "network-vif-deleted", "tag": "237533ab-a565-46f1-9f7a-774c5326474d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:35.643925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-343dfc27-8c26-4d0c-b4b5-7dbddad19a92 req-95624204-cdfb-40b1-a42f-70001c209aaa service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:35.645559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-343dfc27-8c26-4d0c-b4b5-7dbddad19a92 req-95624204-cdfb-40b1-a42f-70001c209aaa service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:35.646931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-343dfc27-8c26-4d0c-b4b5-7dbddad19a92 req-95624204-cdfb-40b1-a42f-70001c209aaa service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:35.749624 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-343dfc27-8c26-4d0c-b4b5-7dbddad19a92 req-95624204-cdfb-40b1-a42f-70001c209aaa service nova] Creating event network-vif-deleted:237533ab-a565-46f1-9f7a-774c5326474d for instance 5ccf7350-edf4-471c-8050-c3f5c15b4921 on n-h1-852084-10 Sep 08 13:00:35.797172 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-343dfc27-8c26-4d0c-b4b5-7dbddad19a92 req-95624204-cdfb-40b1-a42f-70001c209aaa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.270667 Sep 08 13:00:35.802625 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1763/3662] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:00:35.818642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9758e597-40ce-479d-a57a-93a89b3de49d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:35.833510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9758e597-40ce-479d-a57a-93a89b3de49d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:35.865321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9758e597-40ce-479d-a57a-93a89b3de49d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:35.875632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9758e597-40ce-479d-a57a-93a89b3de49d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:35.875632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9758e597-40ce-479d-a57a-93a89b3de49d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:35.875632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9758e597-40ce-479d-a57a-93a89b3de49d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:35.876435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9758e597-40ce-479d-a57a-93a89b3de49d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:35.877179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9758e597-40ce-479d-a57a-93a89b3de49d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:36.329312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-24086d12-06ba-449f-8947-4f3d6e28fa8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:36.369139 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-24086d12-06ba-449f-8947-4f3d6e28fa8f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1309 microversion: 2.1 time: 1.102908 Sep 08 13:00:36.371700 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1900/3663] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:35 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1309 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:36.385679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eb58506d-5de5-4adf-8329-c49b1184b005 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:36.387769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eb58506d-5de5-4adf-8329-c49b1184b005 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:36.429527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb58506d-5de5-4adf-8329-c49b1184b005 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:36.430518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb58506d-5de5-4adf-8329-c49b1184b005 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:36.431885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb58506d-5de5-4adf-8329-c49b1184b005 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:36.435763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb58506d-5de5-4adf-8329-c49b1184b005 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:36.438551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb58506d-5de5-4adf-8329-c49b1184b005 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:36.440643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb58506d-5de5-4adf-8329-c49b1184b005 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:36.591771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9758e597-40ce-479d-a57a-93a89b3de49d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:36.601888 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9758e597-40ce-479d-a57a-93a89b3de49d tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1511 microversion: 2.1 time: 0.797138 Sep 08 13:00:36.611093 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1764/3664] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:35 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1511 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:36.624154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e18bcaa7-0e3c-452a-a3e7-f2e2dc5e71bf tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:36.629175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e18bcaa7-0e3c-452a-a3e7-f2e2dc5e71bf tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:36.651193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e18bcaa7-0e3c-452a-a3e7-f2e2dc5e71bf tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:36.655631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e18bcaa7-0e3c-452a-a3e7-f2e2dc5e71bf tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:36.665244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e18bcaa7-0e3c-452a-a3e7-f2e2dc5e71bf tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:36.670531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e18bcaa7-0e3c-452a-a3e7-f2e2dc5e71bf tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:36.671603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e18bcaa7-0e3c-452a-a3e7-f2e2dc5e71bf tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:36.679384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e18bcaa7-0e3c-452a-a3e7-f2e2dc5e71bf tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:36.973545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e18bcaa7-0e3c-452a-a3e7-f2e2dc5e71bf tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:36.992627 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e18bcaa7-0e3c-452a-a3e7-f2e2dc5e71bf tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1253 microversion: 2.1 time: 0.377082 Sep 08 13:00:36.994585 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1765/3665] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:36 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1253 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:37.413449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9fa12f84-cc8e-40dc-b85e-4b513029d939 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:37.414072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9fa12f84-cc8e-40dc-b85e-4b513029d939 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:37.436036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fa12f84-cc8e-40dc-b85e-4b513029d939 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:37.440827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fa12f84-cc8e-40dc-b85e-4b513029d939 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:37.444078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fa12f84-cc8e-40dc-b85e-4b513029d939 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:37.444959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fa12f84-cc8e-40dc-b85e-4b513029d939 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:37.445467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fa12f84-cc8e-40dc-b85e-4b513029d939 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:37.445914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fa12f84-cc8e-40dc-b85e-4b513029d939 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:37.495238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:37.518745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:37.552276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=14 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:38.190462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eb58506d-5de5-4adf-8329-c49b1184b005 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:38.204360 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eb58506d-5de5-4adf-8329-c49b1184b005 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1315 microversion: 2.1 time: 1.828503 Sep 08 13:00:38.206223 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1901/3666] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:36 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1315 bytes in 1834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:38.220917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1d6dbf5c-ffff-4ceb-9311-d4d7807246de tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:38.221573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1d6dbf5c-ffff-4ceb-9311-d4d7807246de tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:38.258935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d6dbf5c-ffff-4ceb-9311-d4d7807246de tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:38.262410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d6dbf5c-ffff-4ceb-9311-d4d7807246de tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:38.262686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9fa12f84-cc8e-40dc-b85e-4b513029d939 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:38.263265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d6dbf5c-ffff-4ceb-9311-d4d7807246de tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:38.270721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d6dbf5c-ffff-4ceb-9311-d4d7807246de tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:38.273225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d6dbf5c-ffff-4ceb-9311-d4d7807246de tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:38.278487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d6dbf5c-ffff-4ceb-9311-d4d7807246de tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:38.278781 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9fa12f84-cc8e-40dc-b85e-4b513029d939 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1309 microversion: 2.1 time: 0.871054 Sep 08 13:00:38.281756 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1766/3667] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:37 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1309 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:38.286704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6271d8ae-c145-41b0-8a69-a519259ff90e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:38.287361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6271d8ae-c145-41b0-8a69-a519259ff90e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:38.314811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6271d8ae-c145-41b0-8a69-a519259ff90e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:38.315408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6271d8ae-c145-41b0-8a69-a519259ff90e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:38.315863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6271d8ae-c145-41b0-8a69-a519259ff90e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:38.316749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6271d8ae-c145-41b0-8a69-a519259ff90e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:38.317296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6271d8ae-c145-41b0-8a69-a519259ff90e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:38.317780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6271d8ae-c145-41b0-8a69-a519259ff90e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:38.613303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6271d8ae-c145-41b0-8a69-a519259ff90e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:38.656703 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6271d8ae-c145-41b0-8a69-a519259ff90e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1253 microversion: 2.1 time: 0.371190 Sep 08 13:00:38.661175 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1767/3668] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:38 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1253 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:39.254354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3e5d6da4-d95f-4b5a-b6f9-a75eac707b2c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:39.261118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3e5d6da4-d95f-4b5a-b6f9-a75eac707b2c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:39.301156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:39.319430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e5d6da4-d95f-4b5a-b6f9-a75eac707b2c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:39.320679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e5d6da4-d95f-4b5a-b6f9-a75eac707b2c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:39.321716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e5d6da4-d95f-4b5a-b6f9-a75eac707b2c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:39.326529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e5d6da4-d95f-4b5a-b6f9-a75eac707b2c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:39.330067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e5d6da4-d95f-4b5a-b6f9-a75eac707b2c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:39.331841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e5d6da4-d95f-4b5a-b6f9-a75eac707b2c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:39.402853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1d6dbf5c-ffff-4ceb-9311-d4d7807246de tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:39.417321 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1d6dbf5c-ffff-4ceb-9311-d4d7807246de tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1511 microversion: 2.1 time: 1.208070 Sep 08 13:00:39.453124 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1902/3669] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:38 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1511 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:39.467337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aba0f499-17c2-4edd-8c8c-ceeed32a4a7e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:39.468562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aba0f499-17c2-4edd-8c8c-ceeed32a4a7e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:39.479360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aba0f499-17c2-4edd-8c8c-ceeed32a4a7e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:39.484920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aba0f499-17c2-4edd-8c8c-ceeed32a4a7e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:39.485608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aba0f499-17c2-4edd-8c8c-ceeed32a4a7e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:39.492295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aba0f499-17c2-4edd-8c8c-ceeed32a4a7e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:39.493281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aba0f499-17c2-4edd-8c8c-ceeed32a4a7e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:39.494241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aba0f499-17c2-4edd-8c8c-ceeed32a4a7e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:40.218893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3e5d6da4-d95f-4b5a-b6f9-a75eac707b2c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:40.237892 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3e5d6da4-d95f-4b5a-b6f9-a75eac707b2c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1315 microversion: 2.1 time: 0.994329 Sep 08 13:00:40.242439 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1768/3670] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:39 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1315 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:40.257511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-61b6d367-1226-411a-9e8e-6814be64f3fc tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:40.260123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-61b6d367-1226-411a-9e8e-6814be64f3fc tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:40.270782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61b6d367-1226-411a-9e8e-6814be64f3fc tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:40.271609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61b6d367-1226-411a-9e8e-6814be64f3fc tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:40.272325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61b6d367-1226-411a-9e8e-6814be64f3fc tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:40.273540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61b6d367-1226-411a-9e8e-6814be64f3fc tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:40.274268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61b6d367-1226-411a-9e8e-6814be64f3fc tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:40.275040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61b6d367-1226-411a-9e8e-6814be64f3fc tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:40.609120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-61b6d367-1226-411a-9e8e-6814be64f3fc tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:40.628249 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-61b6d367-1226-411a-9e8e-6814be64f3fc tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1253 microversion: 2.1 time: 0.382232 Sep 08 13:00:40.645313 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1769/3671] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:40 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1253 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:40.671700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d34ca3d0-b507-4cf8-b3f4-e061b43d25ac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:40.675681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d34ca3d0-b507-4cf8-b3f4-e061b43d25ac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:40.693308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d34ca3d0-b507-4cf8-b3f4-e061b43d25ac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:40.696471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d34ca3d0-b507-4cf8-b3f4-e061b43d25ac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:40.704387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d34ca3d0-b507-4cf8-b3f4-e061b43d25ac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:40.706139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d34ca3d0-b507-4cf8-b3f4-e061b43d25ac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:40.707603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d34ca3d0-b507-4cf8-b3f4-e061b43d25ac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:40.708770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d34ca3d0-b507-4cf8-b3f4-e061b43d25ac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:40.764151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aba0f499-17c2-4edd-8c8c-ceeed32a4a7e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:40.805699 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aba0f499-17c2-4edd-8c8c-ceeed32a4a7e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1309 microversion: 2.1 time: 1.350003 Sep 08 13:00:40.814976 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1903/3672] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:39 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1309 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:40.856259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-3aa554bf-1caf-448e-9d2b-ba8b85ed6625 req-6faa1440-e49b-4fbe-ad5d-292502feeab2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acd6d509-a7c8-41ce-a825-5ce961e6c87e", "tag": "5c985af5-ad2e-4df7-b859-92c36237b686"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:40.901751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3aa554bf-1caf-448e-9d2b-ba8b85ed6625 req-6faa1440-e49b-4fbe-ad5d-292502feeab2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:40.906291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3aa554bf-1caf-448e-9d2b-ba8b85ed6625 req-6faa1440-e49b-4fbe-ad5d-292502feeab2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:40.907472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3aa554bf-1caf-448e-9d2b-ba8b85ed6625 req-6faa1440-e49b-4fbe-ad5d-292502feeab2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:40.932768 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-3aa554bf-1caf-448e-9d2b-ba8b85ed6625 req-6faa1440-e49b-4fbe-ad5d-292502feeab2 service nova] Creating event network-changed:5c985af5-ad2e-4df7-b859-92c36237b686 for instance acd6d509-a7c8-41ce-a825-5ce961e6c87e on n-h2-852084-10 Sep 08 13:00:40.949336 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-3aa554bf-1caf-448e-9d2b-ba8b85ed6625 req-6faa1440-e49b-4fbe-ad5d-292502feeab2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103021 Sep 08 13:00:40.952204 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1904/3673] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:00:41.276209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a89f9cc8-310d-499e-b3f8-2522f6b242c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:41.289342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a89f9cc8-310d-499e-b3f8-2522f6b242c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:41.321753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a89f9cc8-310d-499e-b3f8-2522f6b242c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:41.326780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a89f9cc8-310d-499e-b3f8-2522f6b242c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:41.330196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a89f9cc8-310d-499e-b3f8-2522f6b242c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:41.334210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a89f9cc8-310d-499e-b3f8-2522f6b242c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:41.338865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a89f9cc8-310d-499e-b3f8-2522f6b242c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:41.344926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a89f9cc8-310d-499e-b3f8-2522f6b242c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:41.687355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d34ca3d0-b507-4cf8-b3f4-e061b43d25ac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:41.703987 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d34ca3d0-b507-4cf8-b3f4-e061b43d25ac tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1511 microversion: 2.1 time: 1.056358 Sep 08 13:00:41.722883 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1770/3674] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:40 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1511 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:41.738327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-47207444-6c19-445d-ab23-88d3671e760e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:41.740042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-47207444-6c19-445d-ab23-88d3671e760e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:41.763362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:41.768695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47207444-6c19-445d-ab23-88d3671e760e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:41.769214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47207444-6c19-445d-ab23-88d3671e760e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:41.769664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47207444-6c19-445d-ab23-88d3671e760e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:41.773203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47207444-6c19-445d-ab23-88d3671e760e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:41.773692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47207444-6c19-445d-ab23-88d3671e760e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:41.774129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47207444-6c19-445d-ab23-88d3671e760e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:43.441683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-47207444-6c19-445d-ab23-88d3671e760e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:43.463505 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-47207444-6c19-445d-ab23-88d3671e760e tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1253 microversion: 2.1 time: 1.737939 Sep 08 13:00:43.480536 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1771/3675] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:41 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1253 bytes in 1757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:43.488310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cac8fc2c-93b2-4b3b-aee6-eb068f3cfebb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:43.489457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cac8fc2c-93b2-4b3b-aee6-eb068f3cfebb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:43.500718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cac8fc2c-93b2-4b3b-aee6-eb068f3cfebb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:43.502424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cac8fc2c-93b2-4b3b-aee6-eb068f3cfebb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:43.503140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cac8fc2c-93b2-4b3b-aee6-eb068f3cfebb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:43.504222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cac8fc2c-93b2-4b3b-aee6-eb068f3cfebb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:43.505145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cac8fc2c-93b2-4b3b-aee6-eb068f3cfebb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:43.505791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cac8fc2c-93b2-4b3b-aee6-eb068f3cfebb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:43.511167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a89f9cc8-310d-499e-b3f8-2522f6b242c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:43.528969 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a89f9cc8-310d-499e-b3f8-2522f6b242c1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1315 microversion: 2.1 time: 2.263598 Sep 08 13:00:43.536987 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1905/3676] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:41 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1315 bytes in 2273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:43.565607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-188ffee7-2edf-49b1-b239-553a417b2173 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Action: 'create', calling method: .version_select at 0x7fdb37104af0>, body: {"keypair": {"name": "tempest-keypair-1235785080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMUrW1i6XPMLctbEwUEzx42jGpJuVACvYHLMnvqqzZUlGNGXX/Wn4RQqFaEY7O7Y8/Xicvzp3zmBJncvgKSrlzSWCCuG31ooVzo/Xe9852cht/WzU03uRHyD9IXJJa1zlA=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:43.596154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-188ffee7-2edf-49b1-b239-553a417b2173 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Getting quotas for project af85d8df0c104c1b901eac2599721972. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:00:43.604824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-188ffee7-2edf-49b1-b239-553a417b2173 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Getting quotas for user 9c69cb225dfb433b9f2f026d2b0122af and project af85d8df0c104c1b901eac2599721972. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:00:43.672572 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-188ffee7-2edf-49b1-b239-553a417b2173 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.113739 Sep 08 13:00:43.673229 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1906/3677] 10.222.0.78 () {62 vars in 1200 bytes} [Thu Sep 8 13:00:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 13:00:43.707213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c04e63bc-e843-4908-8294-c889008da740 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:43.710938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c04e63bc-e843-4908-8294-c889008da740 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:43.738281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c04e63bc-e843-4908-8294-c889008da740 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:43.739066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c04e63bc-e843-4908-8294-c889008da740 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:43.739668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c04e63bc-e843-4908-8294-c889008da740 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:43.743493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c04e63bc-e843-4908-8294-c889008da740 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:43.744156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c04e63bc-e843-4908-8294-c889008da740 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:43.747196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c04e63bc-e843-4908-8294-c889008da740 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:44.125480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cac8fc2c-93b2-4b3b-aee6-eb068f3cfebb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:44.139866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c04e63bc-e843-4908-8294-c889008da740 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:44.142978 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cac8fc2c-93b2-4b3b-aee6-eb068f3cfebb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1309 microversion: 2.1 time: 0.660716 Sep 08 13:00:44.144248 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1772/3678] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:43 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1309 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:44.151780 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c04e63bc-e843-4908-8294-c889008da740 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1511 microversion: 2.1 time: 0.477226 Sep 08 13:00:44.164652 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1907/3679] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:43 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1511 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:44.488861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9fb02221-ba6f-4f33-a5f0-2aaa57edd90f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:44.490650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9fb02221-ba6f-4f33-a5f0-2aaa57edd90f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:44.511918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fb02221-ba6f-4f33-a5f0-2aaa57edd90f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:44.516907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fb02221-ba6f-4f33-a5f0-2aaa57edd90f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:44.517714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fb02221-ba6f-4f33-a5f0-2aaa57edd90f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:44.523818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fb02221-ba6f-4f33-a5f0-2aaa57edd90f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:44.524718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fb02221-ba6f-4f33-a5f0-2aaa57edd90f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:44.525397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fb02221-ba6f-4f33-a5f0-2aaa57edd90f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:44.563997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a72f7ca3-b9f9-40b9-856b-7e2ce43220e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:44.564952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a72f7ca3-b9f9-40b9-856b-7e2ce43220e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:44.583557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a72f7ca3-b9f9-40b9-856b-7e2ce43220e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:44.585384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a72f7ca3-b9f9-40b9-856b-7e2ce43220e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:44.585949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a72f7ca3-b9f9-40b9-856b-7e2ce43220e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:44.588854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a72f7ca3-b9f9-40b9-856b-7e2ce43220e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:44.589824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a72f7ca3-b9f9-40b9-856b-7e2ce43220e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:44.592761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a72f7ca3-b9f9-40b9-856b-7e2ce43220e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:44.779529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9fb02221-ba6f-4f33-a5f0-2aaa57edd90f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:44.797503 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9fb02221-ba6f-4f33-a5f0-2aaa57edd90f tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1253 microversion: 2.1 time: 0.313394 Sep 08 13:00:44.798468 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1773/3680] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:44 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1253 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:00:45.061486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-efc9f2a3-b359-4390-a9a9-340669ff2a9e req-90178314-f96a-41d3-a52f-0b824cff3ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a71f0f-f2e1-45b0-9c8d-fee16d9b4840", "name": "network-vif-plugged", "status": "completed", "tag": "9881bbfc-f0e8-43c0-a5c4-68f7e0961d4e"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:45.088591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-efc9f2a3-b359-4390-a9a9-340669ff2a9e req-90178314-f96a-41d3-a52f-0b824cff3ade service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:45.089334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-efc9f2a3-b359-4390-a9a9-340669ff2a9e req-90178314-f96a-41d3-a52f-0b824cff3ade service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:45.089966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-efc9f2a3-b359-4390-a9a9-340669ff2a9e req-90178314-f96a-41d3-a52f-0b824cff3ade service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:45.133822 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-efc9f2a3-b359-4390-a9a9-340669ff2a9e req-90178314-f96a-41d3-a52f-0b824cff3ade service nova] Creating event network-vif-plugged:9881bbfc-f0e8-43c0-a5c4-68f7e0961d4e for instance 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 on n-h1-852084-10 Sep 08 13:00:45.147771 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-efc9f2a3-b359-4390-a9a9-340669ff2a9e req-90178314-f96a-41d3-a52f-0b824cff3ade service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090858 Sep 08 13:00:45.152938 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1774/3681] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:00:45.178989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-43ab8c72-b244-47f5-b8b3-b52e0b5cfd64 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:45.180196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-43ab8c72-b244-47f5-b8b3-b52e0b5cfd64 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:45.201629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43ab8c72-b244-47f5-b8b3-b52e0b5cfd64 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:45.202329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43ab8c72-b244-47f5-b8b3-b52e0b5cfd64 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:45.202964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43ab8c72-b244-47f5-b8b3-b52e0b5cfd64 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:45.203949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43ab8c72-b244-47f5-b8b3-b52e0b5cfd64 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:45.216019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43ab8c72-b244-47f5-b8b3-b52e0b5cfd64 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:45.216903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-43ab8c72-b244-47f5-b8b3-b52e0b5cfd64 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:45.629995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a72f7ca3-b9f9-40b9-856b-7e2ce43220e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:45.675307 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a72f7ca3-b9f9-40b9-856b-7e2ce43220e3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1315 microversion: 2.1 time: 1.115978 Sep 08 13:00:45.679293 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1908/3682] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:44 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1315 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:00:45.716330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b35fd472-8dd5-45ad-949c-8d9e9abe119c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:45.719094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b35fd472-8dd5-45ad-949c-8d9e9abe119c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:45.733246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b35fd472-8dd5-45ad-949c-8d9e9abe119c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:45.734601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b35fd472-8dd5-45ad-949c-8d9e9abe119c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:45.736482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b35fd472-8dd5-45ad-949c-8d9e9abe119c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:45.738002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b35fd472-8dd5-45ad-949c-8d9e9abe119c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:45.738970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b35fd472-8dd5-45ad-949c-8d9e9abe119c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:45.740194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b35fd472-8dd5-45ad-949c-8d9e9abe119c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:46.105375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-43ab8c72-b244-47f5-b8b3-b52e0b5cfd64 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:46.119859 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-43ab8c72-b244-47f5-b8b3-b52e0b5cfd64 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1511 microversion: 2.1 time: 0.945233 Sep 08 13:00:46.123419 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1775/3683] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:45 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1511 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:00:46.134023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-215df48f-25d2-44c5-bce3-2256d6262d7d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:46.134646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-215df48f-25d2-44c5-bce3-2256d6262d7d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:46.178192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-215df48f-25d2-44c5-bce3-2256d6262d7d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:46.180093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-215df48f-25d2-44c5-bce3-2256d6262d7d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:46.181817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-215df48f-25d2-44c5-bce3-2256d6262d7d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:46.188456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-215df48f-25d2-44c5-bce3-2256d6262d7d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:46.189185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-215df48f-25d2-44c5-bce3-2256d6262d7d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:46.189781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-215df48f-25d2-44c5-bce3-2256d6262d7d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:46.630049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-215df48f-25d2-44c5-bce3-2256d6262d7d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:46.643831 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-215df48f-25d2-44c5-bce3-2256d6262d7d tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1253 microversion: 2.1 time: 0.519130 Sep 08 13:00:46.647639 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1776/3684] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:46 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1253 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:46.711505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0182154a-31ba-45b8-8960-e3be6d1f1b58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:46.712405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0182154a-31ba-45b8-8960-e3be6d1f1b58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:46.719550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0182154a-31ba-45b8-8960-e3be6d1f1b58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:46.720372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0182154a-31ba-45b8-8960-e3be6d1f1b58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:46.721002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0182154a-31ba-45b8-8960-e3be6d1f1b58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:46.721895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0182154a-31ba-45b8-8960-e3be6d1f1b58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:46.722518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0182154a-31ba-45b8-8960-e3be6d1f1b58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:46.723145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0182154a-31ba-45b8-8960-e3be6d1f1b58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:46.790067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b35fd472-8dd5-45ad-949c-8d9e9abe119c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:46.824536 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b35fd472-8dd5-45ad-949c-8d9e9abe119c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1309 microversion: 2.1 time: 1.138567 Sep 08 13:00:46.857262 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1909/3685] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:45 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1309 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:47.148192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3b15c7f1-8ab9-42c2-853f-b56b52061080 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:47.149145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3b15c7f1-8ab9-42c2-853f-b56b52061080 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:47.157100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b15c7f1-8ab9-42c2-853f-b56b52061080 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:47.158304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b15c7f1-8ab9-42c2-853f-b56b52061080 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:47.158985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b15c7f1-8ab9-42c2-853f-b56b52061080 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:47.160037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b15c7f1-8ab9-42c2-853f-b56b52061080 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:47.160775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b15c7f1-8ab9-42c2-853f-b56b52061080 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:47.161431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b15c7f1-8ab9-42c2-853f-b56b52061080 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:47.354103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0182154a-31ba-45b8-8960-e3be6d1f1b58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:47.374704 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0182154a-31ba-45b8-8960-e3be6d1f1b58 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1315 microversion: 2.1 time: 0.667725 Sep 08 13:00:47.396099 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1777/3686] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:46 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:47.574972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3b15c7f1-8ab9-42c2-853f-b56b52061080 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:47.594559 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3b15c7f1-8ab9-42c2-853f-b56b52061080 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1511 microversion: 2.1 time: 0.445003 Sep 08 13:00:47.604244 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1910/3687] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:47 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:00:47.679944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d7d6d70b-3241-4e20-acf8-e22e73f38318 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:47.681012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d7d6d70b-3241-4e20-acf8-e22e73f38318 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:47.707000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7d6d70b-3241-4e20-acf8-e22e73f38318 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:47.711201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7d6d70b-3241-4e20-acf8-e22e73f38318 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:47.711753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7d6d70b-3241-4e20-acf8-e22e73f38318 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:47.712520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7d6d70b-3241-4e20-acf8-e22e73f38318 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:47.713002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7d6d70b-3241-4e20-acf8-e22e73f38318 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:47.713438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7d6d70b-3241-4e20-acf8-e22e73f38318 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:47.877251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a0b8dc3c-ebe5-4598-8e3c-5374c99e4a10 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:47.879855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a0b8dc3c-ebe5-4598-8e3c-5374c99e4a10 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:47.892667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b8dc3c-ebe5-4598-8e3c-5374c99e4a10 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:47.893584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b8dc3c-ebe5-4598-8e3c-5374c99e4a10 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:47.894276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b8dc3c-ebe5-4598-8e3c-5374c99e4a10 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:47.895832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b8dc3c-ebe5-4598-8e3c-5374c99e4a10 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:47.897132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b8dc3c-ebe5-4598-8e3c-5374c99e4a10 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:47.897813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b8dc3c-ebe5-4598-8e3c-5374c99e4a10 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:47.980187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d7d6d70b-3241-4e20-acf8-e22e73f38318 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:48.001508 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d7d6d70b-3241-4e20-acf8-e22e73f38318 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1253 microversion: 2.1 time: 0.327562 Sep 08 13:00:48.005933 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1778/3688] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:47 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1253 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:48.180860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a0b8dc3c-ebe5-4598-8e3c-5374c99e4a10 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:48.187290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:48.203804 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a0b8dc3c-ebe5-4598-8e3c-5374c99e4a10 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1309 microversion: 2.1 time: 0.336331 Sep 08 13:00:48.213610 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1911/3689] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:47 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1309 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:48.414991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-83e26100-6197-4a3f-a364-e2c10e2e8539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:48.416444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-83e26100-6197-4a3f-a364-e2c10e2e8539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:48.431653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83e26100-6197-4a3f-a364-e2c10e2e8539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:48.432582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83e26100-6197-4a3f-a364-e2c10e2e8539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:48.433842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83e26100-6197-4a3f-a364-e2c10e2e8539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:48.434853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83e26100-6197-4a3f-a364-e2c10e2e8539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:48.435623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83e26100-6197-4a3f-a364-e2c10e2e8539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:48.436307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83e26100-6197-4a3f-a364-e2c10e2e8539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:48.622840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5996180a-58d0-4a81-ae2b-f46ea5dd5c2c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:48.630272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5996180a-58d0-4a81-ae2b-f46ea5dd5c2c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:48.673954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5996180a-58d0-4a81-ae2b-f46ea5dd5c2c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:48.709226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5996180a-58d0-4a81-ae2b-f46ea5dd5c2c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:48.710053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5996180a-58d0-4a81-ae2b-f46ea5dd5c2c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:48.711468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5996180a-58d0-4a81-ae2b-f46ea5dd5c2c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:48.717108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-83e26100-6197-4a3f-a364-e2c10e2e8539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:48.723008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5996180a-58d0-4a81-ae2b-f46ea5dd5c2c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:48.725426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5996180a-58d0-4a81-ae2b-f46ea5dd5c2c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:48.751553 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-83e26100-6197-4a3f-a364-e2c10e2e8539 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1503 microversion: 2.1 time: 0.334723 Sep 08 13:00:48.753348 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1779/3690] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:48 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:00:48.807949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-318f2971-9028-4777-83da-50fbc76a81ce tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:48.810084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-318f2971-9028-4777-83da-50fbc76a81ce tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:48.841599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-318f2971-9028-4777-83da-50fbc76a81ce tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:48.842755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-318f2971-9028-4777-83da-50fbc76a81ce tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:48.843770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-318f2971-9028-4777-83da-50fbc76a81ce tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:48.846828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-318f2971-9028-4777-83da-50fbc76a81ce tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:48.848013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-318f2971-9028-4777-83da-50fbc76a81ce tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:48.849051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-318f2971-9028-4777-83da-50fbc76a81ce tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:48.864268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:49.113142 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-318f2971-9028-4777-83da-50fbc76a81ce tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840/action" status: 202 len: 0 microversion: 2.1 time: 0.316972 Sep 08 13:00:49.115021 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1780/3691] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:00:48 2022] POST /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:00:49.141424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5996180a-58d0-4a81-ae2b-f46ea5dd5c2c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:49.143676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:49.149460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:49.163602 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5996180a-58d0-4a81-ae2b-f46ea5dd5c2c tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1511 microversion: 2.1 time: 0.550311 Sep 08 13:00:49.166334 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1912/3692] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:48 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1511 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:49.174078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ec137faa-5a61-4a2c-88ad-caff25614f8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:49.175056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ec137faa-5a61-4a2c-88ad-caff25614f8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:49.185452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:49.188349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec137faa-5a61-4a2c-88ad-caff25614f8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:49.189419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec137faa-5a61-4a2c-88ad-caff25614f8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:49.190151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec137faa-5a61-4a2c-88ad-caff25614f8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:49.191605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec137faa-5a61-4a2c-88ad-caff25614f8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:49.192505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec137faa-5a61-4a2c-88ad-caff25614f8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:49.193353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec137faa-5a61-4a2c-88ad-caff25614f8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:49.209663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:49.210528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:49.211337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:49.212622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:49.215545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:49.216641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:49.315519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:49.328219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:49.328883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:49.330597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lazy-loading 'fault' on Instance uuid 5ccf7350-edf4-471c-8050-c3f5c15b4921 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:00:49.585005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ec137faa-5a61-4a2c-88ad-caff25614f8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:49.603290 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ec137faa-5a61-4a2c-88ad-caff25614f8a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1508 microversion: 2.1 time: 0.432225 Sep 08 13:00:49.606415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a4f6ebbc0454860bd27ce22250b92d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74106d62b334496789cc796af8d57108', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:49.608531 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1913/3693] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:49 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1508 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:49.614517 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7f6a91da-0050-488d-bbe6-3126cf5763ef tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 200 len: 1212 microversion: 2.1 time: 0.497158 Sep 08 13:00:49.622502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9b039245-204f-40cb-b16b-cab0a515edb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:49.623282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9b039245-204f-40cb-b16b-cab0a515edb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:49.629390 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1781/3694] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:49 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 1212 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:49.653721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b039245-204f-40cb-b16b-cab0a515edb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:49.658249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b039245-204f-40cb-b16b-cab0a515edb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:49.666228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b039245-204f-40cb-b16b-cab0a515edb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:49.673290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b039245-204f-40cb-b16b-cab0a515edb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:49.674279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b039245-204f-40cb-b16b-cab0a515edb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:49.674901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b039245-204f-40cb-b16b-cab0a515edb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:49.972535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-bf22d6e4-dbbe-4be6-a4e7-8b19204c3989 req-6b48baf3-9252-4c60-b972-84ce82f4dd71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd6d509-a7c8-41ce-a825-5ce961e6c87e", "name": "network-vif-plugged", "status": "completed", "tag": "5c985af5-ad2e-4df7-b859-92c36237b686"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:49.991412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bf22d6e4-dbbe-4be6-a4e7-8b19204c3989 req-6b48baf3-9252-4c60-b972-84ce82f4dd71 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:49.991892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bf22d6e4-dbbe-4be6-a4e7-8b19204c3989 req-6b48baf3-9252-4c60-b972-84ce82f4dd71 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:49.992321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bf22d6e4-dbbe-4be6-a4e7-8b19204c3989 req-6b48baf3-9252-4c60-b972-84ce82f4dd71 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:50.012523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9b039245-204f-40cb-b16b-cab0a515edb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:50.026788 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-bf22d6e4-dbbe-4be6-a4e7-8b19204c3989 req-6b48baf3-9252-4c60-b972-84ce82f4dd71 service nova] Creating event network-vif-plugged:5c985af5-ad2e-4df7-b859-92c36237b686 for instance acd6d509-a7c8-41ce-a825-5ce961e6c87e on n-h2-852084-10 Sep 08 13:00:50.029602 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9b039245-204f-40cb-b16b-cab0a515edb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1309 microversion: 2.1 time: 0.419583 Sep 08 13:00:50.031038 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1914/3695] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:49 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1309 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:50.045418 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-bf22d6e4-dbbe-4be6-a4e7-8b19204c3989 req-6b48baf3-9252-4c60-b972-84ce82f4dd71 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074452 Sep 08 13:00:50.053337 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1782/3696] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:00:50.103472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-2020418494", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "e0ca96c0-dab8-4bce-8b34-9db6232d276d"}, {"port": "400054e7-5c99-4a0d-a1c6-9d75e7b50cfa", "tag": "port-1"}, {"port": "d6b44d0c-7c17-4ee4-b680-3ecb83966756", "tag": "port-2"}, {"uuid": "11aab1c4-3e22-4055-9419-ab127a05cf02", "tag": "net-1"}, {"uuid": "11aab1c4-3e22-4055-9419-ab127a05cf02"}, {"uuid": "b218492c-7b56-4369-9e31-434d75283d1d", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "b218492c-7b56-4369-9e31-434d75283d1d", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5a8d2674-25f5-41f1-9e5e-828c21946895", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "13fbc7b3-0714-4207-9fef-ca7ddd595566", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "a23a5c9a-b874-4905-abc9-bc1158af738c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--505099226"}], "key_name": "tempest-keypair-1235785080", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:50.213548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-83d1b16e-0ca6-4172-bb03-9f453bfc9424 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:50.214187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-83d1b16e-0ca6-4172-bb03-9f453bfc9424 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:50.225435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d1b16e-0ca6-4172-bb03-9f453bfc9424 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:50.225975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d1b16e-0ca6-4172-bb03-9f453bfc9424 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:50.226419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d1b16e-0ca6-4172-bb03-9f453bfc9424 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:50.227807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d1b16e-0ca6-4172-bb03-9f453bfc9424 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:50.228732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d1b16e-0ca6-4172-bb03-9f453bfc9424 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:50.229706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83d1b16e-0ca6-4172-bb03-9f453bfc9424 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:50.626841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] validate_networks() for [('e0ca96c0-dab8-4bce-8b34-9db6232d276d', None, None, None, None, None), (None, None, '400054e7-5c99-4a0d-a1c6-9d75e7b50cfa', None, None, None), (None, None, 'd6b44d0c-7c17-4ee4-b680-3ecb83966756', None, None, None), ('11aab1c4-3e22-4055-9419-ab127a05cf02', None, None, None, None, None), ('11aab1c4-3e22-4055-9419-ab127a05cf02', None, None, None, None, None), ('b218492c-7b56-4369-9e31-434d75283d1d', '10.2.2.100', None, None, None, None), ('b218492c-7b56-4369-9e31-434d75283d1d', '10.2.2.200', None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:00:51.008964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-83d1b16e-0ca6-4172-bb03-9f453bfc9424 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:51.041288 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-83d1b16e-0ca6-4172-bb03-9f453bfc9424 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1511 microversion: 2.1 time: 0.826113 Sep 08 13:00:51.043365 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1783/3697] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:50 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1511 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:00:51.064299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5250d50a-97d9-45b5-bd4a-6aa203cabc3e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:51.065725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5250d50a-97d9-45b5-bd4a-6aa203cabc3e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:51.078404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5250d50a-97d9-45b5-bd4a-6aa203cabc3e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:51.080324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5250d50a-97d9-45b5-bd4a-6aa203cabc3e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:51.081585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5250d50a-97d9-45b5-bd4a-6aa203cabc3e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:51.083127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5250d50a-97d9-45b5-bd4a-6aa203cabc3e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:51.084480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5250d50a-97d9-45b5-bd4a-6aa203cabc3e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:51.085518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5250d50a-97d9-45b5-bd4a-6aa203cabc3e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:51.746545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5250d50a-97d9-45b5-bd4a-6aa203cabc3e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:51.763793 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5250d50a-97d9-45b5-bd4a-6aa203cabc3e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1488 microversion: 2.1 time: 0.709121 Sep 08 13:00:51.779434 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1784/3698] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:51 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1488 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:51.798336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-75e6c238-ff14-4efb-8a4b-59908373fd40 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:51.798336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-75e6c238-ff14-4efb-8a4b-59908373fd40 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] [instance: 5ccf7350-edf4-471c-8050-c3f5c15b4921] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:51.828871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75e6c238-ff14-4efb-8a4b-59908373fd40 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:51.829757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75e6c238-ff14-4efb-8a4b-59908373fd40 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:51.830553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75e6c238-ff14-4efb-8a4b-59908373fd40 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:51.831912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75e6c238-ff14-4efb-8a4b-59908373fd40 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:51.832776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75e6c238-ff14-4efb-8a4b-59908373fd40 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:51.833564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75e6c238-ff14-4efb-8a4b-59908373fd40 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:51.902483 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-75e6c238-ff14-4efb-8a4b-59908373fd40 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] HTTP exception thrown: Instance 5ccf7350-edf4-471c-8050-c3f5c15b4921 could not be found. Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-75e6c238-ff14-4efb-8a4b-59908373fd40 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Request method failure captured: Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 HTTP/1.1 Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGebpLmRWErWb19kNFDEU6VX4K7U3YWcS86l3oECNBjfIZwSzu0a3qP9QJZqQUAsi0Hl4SJv-JYWC78QSqaB0TL33QkG7FyV42VrPh-NmJEgpozKk9Al9584AcPhzUs480ldbCPV2FkHk_aq1oyAr3Fwvd7YF9DZJoQnuJDiFHC5byOs Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 74106d62b334496789cc796af8d57108 Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestBootFromVolume-1382792758 Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_74106d62b334496789cc796af8d57108"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/74106d62b334496789cc796af8d57108"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74106d62b334496789cc796af8d57108"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/74106d62b334496789cc796af8d57108"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestBootFromVolume-1382792758 Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 74106d62b334496789cc796af8d57108 Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1382792758 Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestBootFromVolume-1382792758-project Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2a4f6ebbc0454860bd27ce22250b92d2 Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestBootFromVolume-1382792758-project Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 5ccf7350-edf4-471c-8050-c3f5c15b4921 could not be found. Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '5ccf7350-edf4-471c-8050-c3f5c15b4921'} Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ccf7350-edf4-471c-8050-c3f5c15b4921 could not be found. Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ccf7350-edf4-471c-8050-c3f5c15b4921 could not be found. Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:00:51.916103 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:51.921350 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:00:51.921350 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:00:51.921350 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:00:51.921350 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:00:51.921350 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:00:51.921350 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ccf7350-edf4-471c-8050-c3f5c15b4921 could not be found. Sep 08 13:00:51.921350 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:00:51.921350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-75e6c238-ff14-4efb-8a4b-59908373fd40 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Returning 404 to user: Instance 5ccf7350-edf4-471c-8050-c3f5c15b4921 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:00:51.921350 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-75e6c238-ff14-4efb-8a4b-59908373fd40 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921" status: 404 len: 111 microversion: 2.1 time: 0.141091 Sep 08 13:00:51.932064 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1785/3699] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:51 2022] GET /compute/v2.1/servers/5ccf7350-edf4-471c-8050-c3f5c15b4921 => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:00:51.937215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6a8a584b-a623-4b33-b99e-6267b253e15d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:51.937873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6a8a584b-a623-4b33-b99e-6267b253e15d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:51.967707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a8a584b-a623-4b33-b99e-6267b253e15d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:51.968213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a8a584b-a623-4b33-b99e-6267b253e15d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:51.968661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a8a584b-a623-4b33-b99e-6267b253e15d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:51.969398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a8a584b-a623-4b33-b99e-6267b253e15d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:51.969864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a8a584b-a623-4b33-b99e-6267b253e15d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:51.970296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a8a584b-a623-4b33-b99e-6267b253e15d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:52.681689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6a8a584b-a623-4b33-b99e-6267b253e15d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:52.719389 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6a8a584b-a623-4b33-b99e-6267b253e15d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1309 microversion: 2.1 time: 0.786131 Sep 08 13:00:52.720536 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1786/3700] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:51 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1309 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:52.761154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4f92e3f2-49a7-41c7-9026-10d65e70332c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:52.762037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4f92e3f2-49a7-41c7-9026-10d65e70332c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:52.787635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f92e3f2-49a7-41c7-9026-10d65e70332c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:52.801106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f92e3f2-49a7-41c7-9026-10d65e70332c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:52.802088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f92e3f2-49a7-41c7-9026-10d65e70332c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:52.805297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f92e3f2-49a7-41c7-9026-10d65e70332c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:52.806331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f92e3f2-49a7-41c7-9026-10d65e70332c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:52.811143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f92e3f2-49a7-41c7-9026-10d65e70332c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:52.864935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-4f92e3f2-49a7-41c7-9026-10d65e70332c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lazy-loading 'flavor' on Instance uuid 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:00:53.547119 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4f92e3f2-49a7-41c7-9026-10d65e70332c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840/action" status: 202 len: 0 microversion: 2.1 time: 0.809359 Sep 08 13:00:53.553589 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1787/3701] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:00:52 2022] POST /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:00:53.565323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-29bd2700-9998-420f-ab01-369f6c6b6878 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] Calling method '.version_select at 0x7fdb39e74af0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:53.617353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:53.660893 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-29bd2700-9998-420f-ab01-369f6c6b6878 tempest-ServersTestBootFromVolume-1382792758 tempest-ServersTestBootFromVolume-1382792758-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427006036" status: 202 len: 0 microversion: 2.1 time: 0.101500 Sep 08 13:00:53.664796 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1788/3702] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Sep 8 13:00:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1427006036 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:00:53.699633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-325cc76e-833f-4c52-9a6a-510a910f9ea2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:53.708535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-325cc76e-833f-4c52-9a6a-510a910f9ea2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:53.736791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-325cc76e-833f-4c52-9a6a-510a910f9ea2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:53.738557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-325cc76e-833f-4c52-9a6a-510a910f9ea2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:53.740852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-325cc76e-833f-4c52-9a6a-510a910f9ea2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:53.742638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-325cc76e-833f-4c52-9a6a-510a910f9ea2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:53.745483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-325cc76e-833f-4c52-9a6a-510a910f9ea2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:53.747187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-325cc76e-833f-4c52-9a6a-510a910f9ea2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:54.861373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-325cc76e-833f-4c52-9a6a-510a910f9ea2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:54.922970 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-325cc76e-833f-4c52-9a6a-510a910f9ea2 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1511 microversion: 2.1 time: 1.254348 Sep 08 13:00:54.932427 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1789/3703] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:53 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1511 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:54.947116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-99d3c415-6484-4f3b-9153-c0cf6ff16b6f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:54.967943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-99d3c415-6484-4f3b-9153-c0cf6ff16b6f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:54.985770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99d3c415-6484-4f3b-9153-c0cf6ff16b6f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:54.986886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99d3c415-6484-4f3b-9153-c0cf6ff16b6f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:54.998980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99d3c415-6484-4f3b-9153-c0cf6ff16b6f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:55.000749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99d3c415-6484-4f3b-9153-c0cf6ff16b6f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:55.002052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99d3c415-6484-4f3b-9153-c0cf6ff16b6f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:55.003128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99d3c415-6484-4f3b-9153-c0cf6ff16b6f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:55.959401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-99d3c415-6484-4f3b-9153-c0cf6ff16b6f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:55.986585 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-99d3c415-6484-4f3b-9153-c0cf6ff16b6f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1515 microversion: 2.1 time: 1.045272 Sep 08 13:00:55.992402 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1790/3704] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:54 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1515 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:56.005776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3094358-f068-4d28-8d89-bd0b37888893 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:56.029214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d3094358-f068-4d28-8d89-bd0b37888893 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:56.049768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3094358-f068-4d28-8d89-bd0b37888893 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:56.050310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3094358-f068-4d28-8d89-bd0b37888893 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:56.050784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3094358-f068-4d28-8d89-bd0b37888893 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:56.051616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3094358-f068-4d28-8d89-bd0b37888893 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:56.052100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3094358-f068-4d28-8d89-bd0b37888893 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:56.052539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3094358-f068-4d28-8d89-bd0b37888893 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:57.017303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d3094358-f068-4d28-8d89-bd0b37888893 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:57.030349 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3094358-f068-4d28-8d89-bd0b37888893 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1490 microversion: 2.1 time: 1.032002 Sep 08 13:00:57.036384 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1791/3705] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:55 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1490 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:57.041993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-78d2ba40-2b54-4846-958c-7ab39e35486f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:57.052580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-78d2ba40-2b54-4846-958c-7ab39e35486f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:57.065214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78d2ba40-2b54-4846-958c-7ab39e35486f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:57.065998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78d2ba40-2b54-4846-958c-7ab39e35486f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:57.066815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78d2ba40-2b54-4846-958c-7ab39e35486f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:57.067955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78d2ba40-2b54-4846-958c-7ab39e35486f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:57.072260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78d2ba40-2b54-4846-958c-7ab39e35486f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:57.073717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78d2ba40-2b54-4846-958c-7ab39e35486f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:57.131741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:00:57.132163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:00:57.132647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:00:57.133063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:00:57.133493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:00:57.178797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:57.179749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:57.187396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:57.197362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:57.198590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:57.199714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:57.279783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Getting quotas for project af85d8df0c104c1b901eac2599721972. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:00:57.303647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Getting quotas for user 9c69cb225dfb433b9f2f026d2b0122af and project af85d8df0c104c1b901eac2599721972. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:00:57.409145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-78d2ba40-2b54-4846-958c-7ab39e35486f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:57.423186 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-78d2ba40-2b54-4846-958c-7ab39e35486f tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1488 microversion: 2.1 time: 0.385331 Sep 08 13:00:57.423948 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1792/3706] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:57 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1488 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:57.439496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ebfce944-4d74-4179-a443-25bf9712dc82 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:57.440142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ebfce944-4d74-4179-a443-25bf9712dc82 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:57.449323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfce944-4d74-4179-a443-25bf9712dc82 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:57.450075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfce944-4d74-4179-a443-25bf9712dc82 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:57.450674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfce944-4d74-4179-a443-25bf9712dc82 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:57.451895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfce944-4d74-4179-a443-25bf9712dc82 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:57.452523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfce944-4d74-4179-a443-25bf9712dc82 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:57.453106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfce944-4d74-4179-a443-25bf9712dc82 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:57.834174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ebfce944-4d74-4179-a443-25bf9712dc82 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:57.855671 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ebfce944-4d74-4179-a443-25bf9712dc82 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1510 microversion: 2.1 time: 0.430500 Sep 08 13:00:57.882714 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1793/3707] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:57 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1510 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:57.900143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f606dc62-375a-469f-b473-8ab287219f96 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:57.911177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f606dc62-375a-469f-b473-8ab287219f96 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:57.930649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:00:57.946283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5a8d2674-25f5-41f1-9e5e-828c21946895',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='13fbc7b3-0714-4207-9fef-ca7ddd595566',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a23a5c9a-b874-4905-abc9-bc1158af738c',volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:00:57.957324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f606dc62-375a-469f-b473-8ab287219f96 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:57.957963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f606dc62-375a-469f-b473-8ab287219f96 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:57.958744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f606dc62-375a-469f-b473-8ab287219f96 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:57.982509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f606dc62-375a-469f-b473-8ab287219f96 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:57.983467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f606dc62-375a-469f-b473-8ab287219f96 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:57.984281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f606dc62-375a-469f-b473-8ab287219f96 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:58.266236 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f606dc62-375a-469f-b473-8ab287219f96 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "PUT /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1085 microversion: 2.1 time: 0.381675 Sep 08 13:00:58.269442 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1794/3708] 10.222.0.78 () {60 vars in 1256 bytes} [Thu Sep 8 13:00:57 2022] PUT /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1085 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:58.287119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-13d87ec6-6a75-447a-910a-6bc6051349ca tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:58.289811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-13d87ec6-6a75-447a-910a-6bc6051349ca tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:58.313158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13d87ec6-6a75-447a-910a-6bc6051349ca tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:58.314008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13d87ec6-6a75-447a-910a-6bc6051349ca tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:58.316689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13d87ec6-6a75-447a-910a-6bc6051349ca tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:58.317862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13d87ec6-6a75-447a-910a-6bc6051349ca tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:58.320252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13d87ec6-6a75-447a-910a-6bc6051349ca tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:58.323029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13d87ec6-6a75-447a-910a-6bc6051349ca tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:58.387849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:00:58.400841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-13d87ec6-6a75-447a-910a-6bc6051349ca tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:00:58.761420 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-13d87ec6-6a75-447a-910a-6bc6051349ca tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 204 len: 0 microversion: 2.1 time: 0.488690 Sep 08 13:00:58.762684 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1795/3709] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:00:58 2022] DELETE /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:00:58.774533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b8465d0-bf24-499f-998b-3524397fa585 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:58.778500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5b8465d0-bf24-499f-998b-3524397fa585 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:58.796813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b8465d0-bf24-499f-998b-3524397fa585 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:58.798558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b8465d0-bf24-499f-998b-3524397fa585 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:58.799020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b8465d0-bf24-499f-998b-3524397fa585 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:58.802973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b8465d0-bf24-499f-998b-3524397fa585 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:58.804942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b8465d0-bf24-499f-998b-3524397fa585 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:58.805416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b8465d0-bf24-499f-998b-3524397fa585 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:59.166525 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b95fb7c1-e1c9-4ff5-8177-fbe739d63388 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 9.067413 Sep 08 13:00:59.178258 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1915/3710] 10.222.0.78 () {62 vars in 1189 bytes} [Thu Sep 8 13:00:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 9080 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 13:00:59.193375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-189a3f90-4449-47ff-b9e3-5a74338e5531 req-fa66365d-a14f-4278-bda0-fb14a44a0a5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a71f0f-f2e1-45b0-9c8d-fee16d9b4840", "name": "network-vif-plugged", "status": "completed", "tag": "9881bbfc-f0e8-43c0-a5c4-68f7e0961d4e"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:00:59.251426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-189a3f90-4449-47ff-b9e3-5a74338e5531 req-fa66365d-a14f-4278-bda0-fb14a44a0a5a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:59.252340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-189a3f90-4449-47ff-b9e3-5a74338e5531 req-fa66365d-a14f-4278-bda0-fb14a44a0a5a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:59.253135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-189a3f90-4449-47ff-b9e3-5a74338e5531 req-fa66365d-a14f-4278-bda0-fb14a44a0a5a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:59.310284 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-189a3f90-4449-47ff-b9e3-5a74338e5531 req-fa66365d-a14f-4278-bda0-fb14a44a0a5a service nova] Creating event network-vif-plugged:9881bbfc-f0e8-43c0-a5c4-68f7e0961d4e for instance 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 on n-h1-852084-10 Sep 08 13:00:59.330347 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-189a3f90-4449-47ff-b9e3-5a74338e5531 req-fa66365d-a14f-4278-bda0-fb14a44a0a5a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148963 Sep 08 13:00:59.335090 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1916/3711] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:00:59.369409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5d80213c-640e-44e8-b7db-d7b6a226fd70 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:59.371073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5d80213c-640e-44e8-b7db-d7b6a226fd70 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:59.387080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d80213c-640e-44e8-b7db-d7b6a226fd70 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:59.388637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d80213c-640e-44e8-b7db-d7b6a226fd70 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:59.389874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d80213c-640e-44e8-b7db-d7b6a226fd70 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:59.393388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d80213c-640e-44e8-b7db-d7b6a226fd70 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:59.394533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d80213c-640e-44e8-b7db-d7b6a226fd70 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:59.396040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d80213c-640e-44e8-b7db-d7b6a226fd70 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:59.774131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5b8465d0-bf24-499f-998b-3524397fa585 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:00:59.794747 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5b8465d0-bf24-499f-998b-3524397fa585 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1511 microversion: 2.1 time: 1.030660 Sep 08 13:00:59.795396 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1796/3712] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:58 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1511 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:00:59.821863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-971f857a-6d50-44e4-a655-696157e576f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:00:59.822562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-971f857a-6d50-44e4-a655-696157e576f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:00:59.829886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-971f857a-6d50-44e4-a655-696157e576f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:59.830410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-971f857a-6d50-44e4-a655-696157e576f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:59.830850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-971f857a-6d50-44e4-a655-696157e576f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:00:59.831648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-971f857a-6d50-44e4-a655-696157e576f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:00:59.832127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-971f857a-6d50-44e4-a655-696157e576f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:00:59.832601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-971f857a-6d50-44e4-a655-696157e576f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:00.016896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5d80213c-640e-44e8-b7db-d7b6a226fd70 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:00.036012 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5d80213c-640e-44e8-b7db-d7b6a226fd70 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1494 microversion: 2.1 time: 0.697190 Sep 08 13:01:00.037949 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1917/3713] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:59 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1494 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:00.071942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-36dbc4f9-83b7-4427-9254-df07760ce575 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:00.078169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-36dbc4f9-83b7-4427-9254-df07760ce575 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:01.500758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-36dbc4f9-83b7-4427-9254-df07760ce575 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:01.518105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-36dbc4f9-83b7-4427-9254-df07760ce575 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:01.520307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-36dbc4f9-83b7-4427-9254-df07760ce575 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:01.528688 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-36dbc4f9-83b7-4427-9254-df07760ce575 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1286 microversion: 2.32 time: 1.487413 Sep 08 13:01:01.540464 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1918/3714] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:00 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1286 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:01.737265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-971f857a-6d50-44e4-a655-696157e576f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:01.751216 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-971f857a-6d50-44e4-a655-696157e576f6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1510 microversion: 2.1 time: 1.931721 Sep 08 13:01:01.753565 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1797/3715] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:00:59 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1510 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:01.772076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d34ba4db-498e-4889-9c1f-b0d641bfaee3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:01.773176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d34ba4db-498e-4889-9c1f-b0d641bfaee3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:01.787168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d34ba4db-498e-4889-9c1f-b0d641bfaee3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:01.788213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d34ba4db-498e-4889-9c1f-b0d641bfaee3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:01.791345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d34ba4db-498e-4889-9c1f-b0d641bfaee3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:01.793873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d34ba4db-498e-4889-9c1f-b0d641bfaee3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:01.796424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d34ba4db-498e-4889-9c1f-b0d641bfaee3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:01.798685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d34ba4db-498e-4889-9c1f-b0d641bfaee3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:02.314343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1332592207", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "e92c66f0-bb1c-477f-a3d7-9d0485546a7e"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:02.411831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] validate_networks() for [('e92c66f0-bb1c-477f-a3d7-9d0485546a7e', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:01:03.008698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d34ba4db-498e-4889-9c1f-b0d641bfaee3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:03.022585 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d34ba4db-498e-4889-9c1f-b0d641bfaee3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1511 microversion: 2.1 time: 1.265723 Sep 08 13:01:03.030578 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1798/3716] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:01 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1511 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:03.040888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-412327fb-87c9-44be-bbcc-7b6a18505cf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:03.043117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-412327fb-87c9-44be-bbcc-7b6a18505cf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:03.059554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-412327fb-87c9-44be-bbcc-7b6a18505cf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:03.061299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-412327fb-87c9-44be-bbcc-7b6a18505cf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:03.063622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-412327fb-87c9-44be-bbcc-7b6a18505cf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:03.065684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-412327fb-87c9-44be-bbcc-7b6a18505cf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:03.071949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-412327fb-87c9-44be-bbcc-7b6a18505cf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:03.072956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-412327fb-87c9-44be-bbcc-7b6a18505cf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:04.097103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-412327fb-87c9-44be-bbcc-7b6a18505cf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:04.129609 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-412327fb-87c9-44be-bbcc-7b6a18505cf6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 200 len: 1494 microversion: 2.1 time: 1.097335 Sep 08 13:01:04.138116 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1799/3717] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:03 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 1494 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:04.142493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fe7a579-b903-4c2f-a6ff-d3ba97f70f47 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:04.143137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1fe7a579-b903-4c2f-a6ff-d3ba97f70f47 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:04.161951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fe7a579-b903-4c2f-a6ff-d3ba97f70f47 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:04.162875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fe7a579-b903-4c2f-a6ff-d3ba97f70f47 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:04.164981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fe7a579-b903-4c2f-a6ff-d3ba97f70f47 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:04.165823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fe7a579-b903-4c2f-a6ff-d3ba97f70f47 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:04.172255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fe7a579-b903-4c2f-a6ff-d3ba97f70f47 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:04.173128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fe7a579-b903-4c2f-a6ff-d3ba97f70f47 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:04.534999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1fe7a579-b903-4c2f-a6ff-d3ba97f70f47 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:04.550751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1fe7a579-b903-4c2f-a6ff-d3ba97f70f47 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:04.552560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1fe7a579-b903-4c2f-a6ff-d3ba97f70f47 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:04.571628 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1fe7a579-b903-4c2f-a6ff-d3ba97f70f47 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1594 microversion: 2.32 time: 0.415625 Sep 08 13:01:04.572675 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1800/3718] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:04 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1594 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:04.578573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9541354b-8d79-44ec-8a76-f1deb8d2d5b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:04.579296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9541354b-8d79-44ec-8a76-f1deb8d2d5b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:04.586043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9541354b-8d79-44ec-8a76-f1deb8d2d5b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:04.586557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9541354b-8d79-44ec-8a76-f1deb8d2d5b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:04.587007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9541354b-8d79-44ec-8a76-f1deb8d2d5b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:04.587778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9541354b-8d79-44ec-8a76-f1deb8d2d5b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:04.588247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9541354b-8d79-44ec-8a76-f1deb8d2d5b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:04.588683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9541354b-8d79-44ec-8a76-f1deb8d2d5b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:05.595605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9541354b-8d79-44ec-8a76-f1deb8d2d5b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:05.603606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:01:05.605580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:01:05.606651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:01:05.608041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:01:05.609323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:01:05.632050 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9541354b-8d79-44ec-8a76-f1deb8d2d5b4 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1510 microversion: 2.1 time: 1.058171 Sep 08 13:01:05.634350 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1801/3719] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:04 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1510 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:05.648337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-59c5d799-2f6f-4330-903c-0a7d6fc2c623 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:05.650674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:05.652230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:05.652967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:05.653943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-59c5d799-2f6f-4330-903c-0a7d6fc2c623 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:05.654906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:05.657300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:05.657915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:05.670003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59c5d799-2f6f-4330-903c-0a7d6fc2c623 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:05.671276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59c5d799-2f6f-4330-903c-0a7d6fc2c623 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:05.671957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59c5d799-2f6f-4330-903c-0a7d6fc2c623 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:05.672879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59c5d799-2f6f-4330-903c-0a7d6fc2c623 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:05.674161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59c5d799-2f6f-4330-903c-0a7d6fc2c623 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:05.674846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59c5d799-2f6f-4330-903c-0a7d6fc2c623 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:05.685408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Getting quotas for project 3948abe98684425b94b9295399dc48d8. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:01:05.703911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Getting quotas for user 33aab271f5894598b1d4c1748482c324 and project 3948abe98684425b94b9295399dc48d8. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:01:05.740008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:01:05.745754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:01:05.756083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-59c5d799-2f6f-4330-903c-0a7d6fc2c623 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:01:05.847642 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7eb43e01-5c29-4461-bc3d-7171853b5016 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 4.302878 Sep 08 13:01:05.848813 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1919/3720] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 13:01:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4308 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 13:01:05.863350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-464cc6db-2880-41ff-bd12-77d584cbc612 req-ccded035-d481-4fda-a004-7be4869603b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26138bc0-1c3e-4a40-9945-448c5db3a424", "name": "network-vif-unplugged", "status": "completed", "tag": "5552ed95-bafa-47a0-ab3e-40fd5cfe2a59"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:05.898768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-464cc6db-2880-41ff-bd12-77d584cbc612 req-ccded035-d481-4fda-a004-7be4869603b3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:05.904813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-464cc6db-2880-41ff-bd12-77d584cbc612 req-ccded035-d481-4fda-a004-7be4869603b3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:05.907430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-464cc6db-2880-41ff-bd12-77d584cbc612 req-ccded035-d481-4fda-a004-7be4869603b3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:05.961803 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-464cc6db-2880-41ff-bd12-77d584cbc612 req-ccded035-d481-4fda-a004-7be4869603b3 service nova] Creating event network-vif-unplugged:5552ed95-bafa-47a0-ab3e-40fd5cfe2a59 for instance 26138bc0-1c3e-4a40-9945-448c5db3a424 on n-h2-852084-10 Sep 08 13:01:05.962598 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-59c5d799-2f6f-4330-903c-0a7d6fc2c623 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 204 len: 0 microversion: 2.1 time: 0.326649 Sep 08 13:01:05.963211 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1802/3721] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:01:05 2022] DELETE /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:01:05.972989 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-464cc6db-2880-41ff-bd12-77d584cbc612 req-ccded035-d481-4fda-a004-7be4869603b3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121214 Sep 08 13:01:05.974949 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1920/3722] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:05.982287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3164b4d5-bb0d-4ae8-bfcf-c6b9ae3a602f req-f2907382-9cb5-4a22-9637-4cefeaf78b98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26138bc0-1c3e-4a40-9945-448c5db3a424", "name": "network-vif-deleted", "tag": "5552ed95-bafa-47a0-ab3e-40fd5cfe2a59"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:05.988667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-86dc957e-5af4-4e5e-87dc-f161ee427a19 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:05.989640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-86dc957e-5af4-4e5e-87dc-f161ee427a19 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:06.000422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86dc957e-5af4-4e5e-87dc-f161ee427a19 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:06.001258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86dc957e-5af4-4e5e-87dc-f161ee427a19 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:06.001862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86dc957e-5af4-4e5e-87dc-f161ee427a19 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:06.002782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86dc957e-5af4-4e5e-87dc-f161ee427a19 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:06.003489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86dc957e-5af4-4e5e-87dc-f161ee427a19 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:06.004110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86dc957e-5af4-4e5e-87dc-f161ee427a19 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:06.007621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3164b4d5-bb0d-4ae8-bfcf-c6b9ae3a602f req-f2907382-9cb5-4a22-9637-4cefeaf78b98 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:06.008112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3164b4d5-bb0d-4ae8-bfcf-c6b9ae3a602f req-f2907382-9cb5-4a22-9637-4cefeaf78b98 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:06.008561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3164b4d5-bb0d-4ae8-bfcf-c6b9ae3a602f req-f2907382-9cb5-4a22-9637-4cefeaf78b98 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:06.029283 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-86dc957e-5af4-4e5e-87dc-f161ee427a19 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-86dc957e-5af4-4e5e-87dc-f161ee427a19 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 HTTP/1.1 Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '26138bc0-1c3e-4a40-9945-448c5db3a424'} Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:01:06.031590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:06.035119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:06.035119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:01:06.035119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:01:06.035119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:01:06.035119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:01:06.035119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:01:06.035119 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:06.036922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-86dc957e-5af4-4e5e-87dc-f161ee427a19 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:01:06.038005 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-86dc957e-5af4-4e5e-87dc-f161ee427a19 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 404 len: 111 microversion: 2.1 time: 0.056397 Sep 08 13:01:06.039121 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1921/3723] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:05 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:01:06.045064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0fb1a2e2-806f-4690-aaaf-ea90535c226e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:06.045951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0fb1a2e2-806f-4690-aaaf-ea90535c226e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:06.054150 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3164b4d5-bb0d-4ae8-bfcf-c6b9ae3a602f req-f2907382-9cb5-4a22-9637-4cefeaf78b98 service nova] Creating event network-vif-deleted:5552ed95-bafa-47a0-ab3e-40fd5cfe2a59 for instance 26138bc0-1c3e-4a40-9945-448c5db3a424 on n-h2-852084-10 Sep 08 13:01:06.054617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fb1a2e2-806f-4690-aaaf-ea90535c226e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:06.055303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fb1a2e2-806f-4690-aaaf-ea90535c226e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:06.055910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fb1a2e2-806f-4690-aaaf-ea90535c226e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:06.056793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fb1a2e2-806f-4690-aaaf-ea90535c226e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:06.058169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fb1a2e2-806f-4690-aaaf-ea90535c226e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:06.058804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fb1a2e2-806f-4690-aaaf-ea90535c226e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:06.069555 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3164b4d5-bb0d-4ae8-bfcf-c6b9ae3a602f req-f2907382-9cb5-4a22-9637-4cefeaf78b98 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093212 Sep 08 13:01:06.071354 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1803/3724] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:06.082574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5e432bb5-bac7-4754-b5b4-47841c8ccaac tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:06.083725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5e432bb5-bac7-4754-b5b4-47841c8ccaac tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:06.634461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0fb1a2e2-806f-4690-aaaf-ea90535c226e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:06.673246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0fb1a2e2-806f-4690-aaaf-ea90535c226e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:06.685644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0fb1a2e2-806f-4690-aaaf-ea90535c226e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:06.740080 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0fb1a2e2-806f-4690-aaaf-ea90535c226e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1594 microversion: 2.32 time: 0.647648 Sep 08 13:01:06.741397 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1922/3725] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:06 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1594 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:06.755949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a0b005ea-6f9a-4579-86e0-1f5f6075f1f8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:06.757082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a0b005ea-6f9a-4579-86e0-1f5f6075f1f8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:06.784487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b005ea-6f9a-4579-86e0-1f5f6075f1f8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:06.784487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b005ea-6f9a-4579-86e0-1f5f6075f1f8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:06.784487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b005ea-6f9a-4579-86e0-1f5f6075f1f8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:06.784487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b005ea-6f9a-4579-86e0-1f5f6075f1f8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:06.784487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b005ea-6f9a-4579-86e0-1f5f6075f1f8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:06.784487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b005ea-6f9a-4579-86e0-1f5f6075f1f8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:06.979628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5e432bb5-bac7-4754-b5b4-47841c8ccaac tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:07.022956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5e432bb5-bac7-4754-b5b4-47841c8ccaac tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:07.033816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5e432bb5-bac7-4754-b5b4-47841c8ccaac tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:07.037581 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5e432bb5-bac7-4754-b5b4-47841c8ccaac tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc" status: 200 len: 1262 microversion: 2.26 time: 0.963153 Sep 08 13:01:07.052392 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1804/3726] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:06 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc => generated 1262 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:07.099170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-553403981", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "dbd28b0c-6c95-45fa-bc88-dd4ecaae050a"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:07.310544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] validate_networks() for [('dbd28b0c-6c95-45fa-bc88-dd4ecaae050a', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:01:08.492330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a0b005ea-6f9a-4579-86e0-1f5f6075f1f8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:08.530298 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a0b005ea-6f9a-4579-86e0-1f5f6075f1f8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 200 len: 1517 microversion: 2.1 time: 1.786162 Sep 08 13:01:08.535691 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1923/3727] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:06 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 1517 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:08.553721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f668c4c0-422a-4f1c-9726-d627e80b5d62 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:08.557282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f668c4c0-422a-4f1c-9726-d627e80b5d62 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:08.589772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f668c4c0-422a-4f1c-9726-d627e80b5d62 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:08.590821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f668c4c0-422a-4f1c-9726-d627e80b5d62 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:08.591469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f668c4c0-422a-4f1c-9726-d627e80b5d62 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:08.597235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f668c4c0-422a-4f1c-9726-d627e80b5d62 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:08.597235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f668c4c0-422a-4f1c-9726-d627e80b5d62 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:08.598017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f668c4c0-422a-4f1c-9726-d627e80b5d62 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:12.026669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f668c4c0-422a-4f1c-9726-d627e80b5d62 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:12.071023 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f668c4c0-422a-4f1c-9726-d627e80b5d62 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1510 microversion: 2.1 time: 3.531757 Sep 08 13:01:12.075462 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1924/3728] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:08 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1510 bytes in 3539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:12.102200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e6537353-2f84-43ac-ac83-0c347422cda7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:12.105525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e6537353-2f84-43ac-ac83-0c347422cda7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:12.169372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6537353-2f84-43ac-ac83-0c347422cda7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:12.170979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6537353-2f84-43ac-ac83-0c347422cda7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:12.176202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6537353-2f84-43ac-ac83-0c347422cda7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:12.180203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6537353-2f84-43ac-ac83-0c347422cda7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:12.181685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6537353-2f84-43ac-ac83-0c347422cda7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:12.186910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6537353-2f84-43ac-ac83-0c347422cda7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:12.937593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:01:12.947499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:01:12.951092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:01:12.953182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:01:12.959420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:01:12.984214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=85,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:13.029095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:13.033907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:13.035542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:13.045215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:13.046708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:13.048597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:13.167993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:01:13.191171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Getting quotas for user d9a995d2889c47738ad0b5255445c5f0 and project ea5d4df4f22d4af3a40af8a9ab306bd0. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:01:13.238900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:01:13.246362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:01:13.398171 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dc3f1ca3-be9d-46f5-b00b-59b5ffbede12 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.318577 Sep 08 13:01:13.399031 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1805/3729] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:01:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 6346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:01:13.421431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0aecd08-3893-4c28-9c69-4d3186d8b019 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:13.429217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0aecd08-3893-4c28-9c69-4d3186d8b019 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:13.449354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0aecd08-3893-4c28-9c69-4d3186d8b019 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:13.452386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0aecd08-3893-4c28-9c69-4d3186d8b019 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:13.456062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0aecd08-3893-4c28-9c69-4d3186d8b019 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:13.460211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0aecd08-3893-4c28-9c69-4d3186d8b019 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:13.462814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0aecd08-3893-4c28-9c69-4d3186d8b019 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:13.467865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0aecd08-3893-4c28-9c69-4d3186d8b019 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:13.530414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6537353-2f84-43ac-ac83-0c347422cda7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:13.619256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6537353-2f84-43ac-ac83-0c347422cda7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:13.622279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6537353-2f84-43ac-ac83-0c347422cda7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:13.627807 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e6537353-2f84-43ac-ac83-0c347422cda7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1661 microversion: 2.32 time: 1.543612 Sep 08 13:01:13.645649 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1925/3730] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:12 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1661 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:13.658941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c5098ef-3790-4f46-9ea4-c763375ebee5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:13.660400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6c5098ef-3790-4f46-9ea4-c763375ebee5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:13.669660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c5098ef-3790-4f46-9ea4-c763375ebee5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:13.671778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c5098ef-3790-4f46-9ea4-c763375ebee5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:13.676355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c5098ef-3790-4f46-9ea4-c763375ebee5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:13.677501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c5098ef-3790-4f46-9ea4-c763375ebee5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:13.678475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c5098ef-3790-4f46-9ea4-c763375ebee5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:13.679162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c5098ef-3790-4f46-9ea4-c763375ebee5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:13.754186 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6c5098ef-3790-4f46-9ea4-c763375ebee5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c5098ef-3790-4f46-9ea4-c763375ebee5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e HTTP/1.1 Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'acd6d509-a7c8-41ce-a825-5ce961e6c87e'} Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:13.755751 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:13.761116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:01:13.761116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:01:13.761116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:01:13.761116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:01:13.761116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:01:13.761116 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:13.771921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c5098ef-3790-4f46-9ea4-c763375ebee5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:01:13.773591 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6c5098ef-3790-4f46-9ea4-c763375ebee5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 404 len: 111 microversion: 2.1 time: 0.126043 Sep 08 13:01:13.774417 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1926/3731] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:13 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:01:13.790810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-61857f3e-e304-4a7f-b074-9ad9beb1e033 req-ade3a8f5-8b70-44a8-b464-53a78c9afc66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd6d509-a7c8-41ce-a825-5ce961e6c87e", "name": "network-vif-unplugged", "status": "completed", "tag": "5c985af5-ad2e-4df7-b859-92c36237b686"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:13.818055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-61857f3e-e304-4a7f-b074-9ad9beb1e033 req-ade3a8f5-8b70-44a8-b464-53a78c9afc66 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:13.818560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-61857f3e-e304-4a7f-b074-9ad9beb1e033 req-ade3a8f5-8b70-44a8-b464-53a78c9afc66 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:13.819013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-61857f3e-e304-4a7f-b074-9ad9beb1e033 req-ade3a8f5-8b70-44a8-b464-53a78c9afc66 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:13.856476 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-61857f3e-e304-4a7f-b074-9ad9beb1e033 req-ade3a8f5-8b70-44a8-b464-53a78c9afc66 service nova] Creating event network-vif-unplugged:5c985af5-ad2e-4df7-b859-92c36237b686 for instance acd6d509-a7c8-41ce-a825-5ce961e6c87e on n-h2-852084-10 Sep 08 13:01:13.871268 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-61857f3e-e304-4a7f-b074-9ad9beb1e033 req-ade3a8f5-8b70-44a8-b464-53a78c9afc66 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095168 Sep 08 13:01:13.877539 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1927/3732] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:13.884620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-773e04b7-5cad-4851-8d03-dc89d1c049df req-a7ed872f-baed-430a-b3cb-d4c2cead2f02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acd6d509-a7c8-41ce-a825-5ce961e6c87e", "name": "network-vif-deleted", "tag": "5c985af5-ad2e-4df7-b859-92c36237b686"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:13.898554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-773e04b7-5cad-4851-8d03-dc89d1c049df req-a7ed872f-baed-430a-b3cb-d4c2cead2f02 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:13.899605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-773e04b7-5cad-4851-8d03-dc89d1c049df req-a7ed872f-baed-430a-b3cb-d4c2cead2f02 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:13.900279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-773e04b7-5cad-4851-8d03-dc89d1c049df req-a7ed872f-baed-430a-b3cb-d4c2cead2f02 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:13.916926 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-773e04b7-5cad-4851-8d03-dc89d1c049df req-a7ed872f-baed-430a-b3cb-d4c2cead2f02 service nova] Creating event network-vif-deleted:5c985af5-ad2e-4df7-b859-92c36237b686 for instance acd6d509-a7c8-41ce-a825-5ce961e6c87e on n-h2-852084-10 Sep 08 13:01:13.933938 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-773e04b7-5cad-4851-8d03-dc89d1c049df req-a7ed872f-baed-430a-b3cb-d4c2cead2f02 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052853 Sep 08 13:01:13.940338 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1928/3733] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:13.952148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d334019-0f5b-4006-9ca7-e914834002d0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:13.957551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6d334019-0f5b-4006-9ca7-e914834002d0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:13.973941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d334019-0f5b-4006-9ca7-e914834002d0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:13.976307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d334019-0f5b-4006-9ca7-e914834002d0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:13.977818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d334019-0f5b-4006-9ca7-e914834002d0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:13.978789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d334019-0f5b-4006-9ca7-e914834002d0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:13.981150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d334019-0f5b-4006-9ca7-e914834002d0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:13.982580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d334019-0f5b-4006-9ca7-e914834002d0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:14.661848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0aecd08-3893-4c28-9c69-4d3186d8b019 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:14.673428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0aecd08-3893-4c28-9c69-4d3186d8b019 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:14.675007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0aecd08-3893-4c28-9c69-4d3186d8b019 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:14.684813 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0aecd08-3893-4c28-9c69-4d3186d8b019 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc" status: 200 len: 1362 microversion: 2.26 time: 1.279828 Sep 08 13:01:14.685424 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1806/3734] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:13 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc => generated 1362 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:14.696242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62331c04-f8a9-434d-a48a-17cc4057fae1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:14.704245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-62331c04-f8a9-434d-a48a-17cc4057fae1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:14.940774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d334019-0f5b-4006-9ca7-e914834002d0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:14.966950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-62331c04-f8a9-434d-a48a-17cc4057fae1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:15.014371 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6d334019-0f5b-4006-9ca7-e914834002d0 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1510 microversion: 2.1 time: 1.072215 Sep 08 13:01:15.017786 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62331c04-f8a9-434d-a48a-17cc4057fae1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 200 len: 1214 microversion: 2.1 time: 0.330434 Sep 08 13:01:15.023526 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1807/3735] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:14 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 1214 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:15.029420 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1929/3736] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:13 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1510 bytes in 1088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:15.048867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1962522732", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "e905a95c-2324-49bd-8a89-bae4286a1b74"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:15.057370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c4d28ab4-037b-4195-aeaa-c940d515328a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:15.068241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c4d28ab4-037b-4195-aeaa-c940d515328a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:15.113105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4d28ab4-037b-4195-aeaa-c940d515328a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:15.113974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4d28ab4-037b-4195-aeaa-c940d515328a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:15.114781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4d28ab4-037b-4195-aeaa-c940d515328a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:15.140613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4d28ab4-037b-4195-aeaa-c940d515328a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:15.141614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4d28ab4-037b-4195-aeaa-c940d515328a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:15.142443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c4d28ab4-037b-4195-aeaa-c940d515328a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:15.366046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] validate_networks() for [('e905a95c-2324-49bd-8a89-bae4286a1b74', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:01:15.669938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:15.727773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=14 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:17.195666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c4d28ab4-037b-4195-aeaa-c940d515328a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:17.224822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c4d28ab4-037b-4195-aeaa-c940d515328a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:17.226576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c4d28ab4-037b-4195-aeaa-c940d515328a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:17.242097 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c4d28ab4-037b-4195-aeaa-c940d515328a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1707 microversion: 2.32 time: 2.196795 Sep 08 13:01:17.242983 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1930/3737] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:15 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1707 bytes in 2213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:17.266270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-153ecade-b6f9-4dd2-9427-55ed66768922 req-769d52dc-6055-4ad9-ba99-837834b54c8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b55b70b2-cc64-458a-976c-c8f901eb30cc", "tag": "9e9f9bc7-0c81-42d8-957c-cea9ca39c459"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:17.294926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-153ecade-b6f9-4dd2-9427-55ed66768922 req-769d52dc-6055-4ad9-ba99-837834b54c8e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:17.295504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-153ecade-b6f9-4dd2-9427-55ed66768922 req-769d52dc-6055-4ad9-ba99-837834b54c8e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:17.295951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-153ecade-b6f9-4dd2-9427-55ed66768922 req-769d52dc-6055-4ad9-ba99-837834b54c8e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:17.322229 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-153ecade-b6f9-4dd2-9427-55ed66768922 req-769d52dc-6055-4ad9-ba99-837834b54c8e service nova] Creating event network-changed:9e9f9bc7-0c81-42d8-957c-cea9ca39c459 for instance b55b70b2-cc64-458a-976c-c8f901eb30cc on n-h1-852084-10 Sep 08 13:01:17.337392 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-153ecade-b6f9-4dd2-9427-55ed66768922 req-769d52dc-6055-4ad9-ba99-837834b54c8e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087395 Sep 08 13:01:17.341640 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1931/3738] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:17.349414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f92768f0-358d-421d-8874-8166f5044353 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:17.350564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f92768f0-358d-421d-8874-8166f5044353 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:17.359309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f92768f0-358d-421d-8874-8166f5044353 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:17.360345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f92768f0-358d-421d-8874-8166f5044353 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:17.361021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f92768f0-358d-421d-8874-8166f5044353 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:17.361981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f92768f0-358d-421d-8874-8166f5044353 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:17.362646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f92768f0-358d-421d-8874-8166f5044353 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:17.363340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f92768f0-358d-421d-8874-8166f5044353 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:18.723396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f92768f0-358d-421d-8874-8166f5044353 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:18.752846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f92768f0-358d-421d-8874-8166f5044353 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:18.772796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f92768f0-358d-421d-8874-8166f5044353 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:18.775103 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f92768f0-358d-421d-8874-8166f5044353 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc" status: 200 len: 1362 microversion: 2.26 time: 1.431502 Sep 08 13:01:18.791205 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1932/3739] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:17 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc => generated 1362 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:18.827599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-10ef551b-0ec9-40f7-967e-f7afbed2ec77 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:18.828591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-10ef551b-0ec9-40f7-967e-f7afbed2ec77 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:18.874494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10ef551b-0ec9-40f7-967e-f7afbed2ec77 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:18.875002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10ef551b-0ec9-40f7-967e-f7afbed2ec77 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:18.875484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10ef551b-0ec9-40f7-967e-f7afbed2ec77 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:18.876231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10ef551b-0ec9-40f7-967e-f7afbed2ec77 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:18.876701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10ef551b-0ec9-40f7-967e-f7afbed2ec77 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:18.877142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10ef551b-0ec9-40f7-967e-f7afbed2ec77 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:18.901034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=86 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:19.235884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:01:19.236775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:01:19.237287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:01:19.238210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:01:19.238805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:01:19.259901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:19.260223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:19.264764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:19.265721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:19.266222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:19.266677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:19.281951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-10ef551b-0ec9-40f7-967e-f7afbed2ec77 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:19.327670 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-10ef551b-0ec9-40f7-967e-f7afbed2ec77 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 200 len: 1272 microversion: 2.1 time: 0.535768 Sep 08 13:01:19.328969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:01:19.361205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Getting quotas for user 227ef616a0764f5eaff5988f8a470f0c and project 547655f80d6f4dabad7b7a2c659853b1. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:01:19.374359 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1933/3740] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:18 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 1272 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:19.404208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:01:19.407340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9d217e6e-528e-45b8-8636-d22feeed798b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:19.408492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:01:19.411075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9d217e6e-528e-45b8-8636-d22feeed798b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:19.440458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:19.447968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d217e6e-528e-45b8-8636-d22feeed798b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:19.449461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d217e6e-528e-45b8-8636-d22feeed798b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:19.454563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d217e6e-528e-45b8-8636-d22feeed798b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:19.459902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d217e6e-528e-45b8-8636-d22feeed798b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:19.461667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d217e6e-528e-45b8-8636-d22feeed798b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:19.462582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d217e6e-528e-45b8-8636-d22feeed798b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:19.603889 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e34a505-e993-4143-81bb-42a8292cdd53 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.575261 Sep 08 13:01:19.624561 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1808/3741] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 4597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:01:19.639677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-65b511b8-7d3b-4e40-845b-02ef793b8a8e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:19.641761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-65b511b8-7d3b-4e40-845b-02ef793b8a8e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:19.678834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65b511b8-7d3b-4e40-845b-02ef793b8a8e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:19.680534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65b511b8-7d3b-4e40-845b-02ef793b8a8e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:19.681682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65b511b8-7d3b-4e40-845b-02ef793b8a8e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:19.683408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65b511b8-7d3b-4e40-845b-02ef793b8a8e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:19.691616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65b511b8-7d3b-4e40-845b-02ef793b8a8e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:19.692852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65b511b8-7d3b-4e40-845b-02ef793b8a8e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:21.735762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d217e6e-528e-45b8-8636-d22feeed798b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:21.834692 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9d217e6e-528e-45b8-8636-d22feeed798b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1510 microversion: 2.1 time: 2.456200 Sep 08 13:01:21.846825 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1934/3742] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:19 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1510 bytes in 2472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:21.884926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f27574e4-5e76-4026-960f-f2e0ce9473d9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:21.892787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f27574e4-5e76-4026-960f-f2e0ce9473d9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:21.937695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f27574e4-5e76-4026-960f-f2e0ce9473d9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:21.938592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f27574e4-5e76-4026-960f-f2e0ce9473d9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:21.939670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f27574e4-5e76-4026-960f-f2e0ce9473d9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:21.976685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f27574e4-5e76-4026-960f-f2e0ce9473d9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:21.988409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f27574e4-5e76-4026-960f-f2e0ce9473d9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:21.989354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f27574e4-5e76-4026-960f-f2e0ce9473d9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:22.614960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f27574e4-5e76-4026-960f-f2e0ce9473d9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:22.634239 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f27574e4-5e76-4026-960f-f2e0ce9473d9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1205 microversion: 2.1 time: 0.782470 Sep 08 13:01:22.637733 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1935/3743] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:21 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1205 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:22.646111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a8c384c8-5777-4ef7-98c0-ae41ed21f59d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:22.647039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a8c384c8-5777-4ef7-98c0-ae41ed21f59d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:22.668732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c384c8-5777-4ef7-98c0-ae41ed21f59d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:22.669794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c384c8-5777-4ef7-98c0-ae41ed21f59d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:22.672902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c384c8-5777-4ef7-98c0-ae41ed21f59d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:22.676289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c384c8-5777-4ef7-98c0-ae41ed21f59d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:22.708338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c384c8-5777-4ef7-98c0-ae41ed21f59d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:22.715925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c384c8-5777-4ef7-98c0-ae41ed21f59d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:22.938497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-65b511b8-7d3b-4e40-845b-02ef793b8a8e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:22.972060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-65b511b8-7d3b-4e40-845b-02ef793b8a8e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:22.976442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-65b511b8-7d3b-4e40-845b-02ef793b8a8e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:22.979474 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-65b511b8-7d3b-4e40-845b-02ef793b8a8e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1753 microversion: 2.32 time: 3.352463 Sep 08 13:01:22.984186 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1809/3744] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:19 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1753 bytes in 3358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:22.995017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63cdc32f-dc4c-4dcb-8b65-db590fd37668 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:22.996718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-63cdc32f-dc4c-4dcb-8b65-db590fd37668 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:23.053959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63cdc32f-dc4c-4dcb-8b65-db590fd37668 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:23.070964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63cdc32f-dc4c-4dcb-8b65-db590fd37668 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:23.073535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63cdc32f-dc4c-4dcb-8b65-db590fd37668 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:23.074920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63cdc32f-dc4c-4dcb-8b65-db590fd37668 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:23.105903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63cdc32f-dc4c-4dcb-8b65-db590fd37668 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:23.110273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63cdc32f-dc4c-4dcb-8b65-db590fd37668 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:23.453962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a8c384c8-5777-4ef7-98c0-ae41ed21f59d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:23.467399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a8c384c8-5777-4ef7-98c0-ae41ed21f59d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:23.470515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a8c384c8-5777-4ef7-98c0-ae41ed21f59d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:23.482818 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a8c384c8-5777-4ef7-98c0-ae41ed21f59d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc" status: 200 len: 1362 microversion: 2.26 time: 0.837970 Sep 08 13:01:23.498962 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1936/3745] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:22 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc => generated 1362 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:23.527035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc717bed-4e38-4948-959f-ea561e9a2e56 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:23.528550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cc717bed-4e38-4948-959f-ea561e9a2e56 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:23.566310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc717bed-4e38-4948-959f-ea561e9a2e56 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:23.567913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc717bed-4e38-4948-959f-ea561e9a2e56 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:23.574941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc717bed-4e38-4948-959f-ea561e9a2e56 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:23.578461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc717bed-4e38-4948-959f-ea561e9a2e56 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:23.583354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc717bed-4e38-4948-959f-ea561e9a2e56 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:23.586590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc717bed-4e38-4948-959f-ea561e9a2e56 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:24.924825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cc717bed-4e38-4948-959f-ea561e9a2e56 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:24.941895 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc717bed-4e38-4948-959f-ea561e9a2e56 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1510 microversion: 2.1 time: 1.440058 Sep 08 13:01:24.943760 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1937/3746] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:23 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1510 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:24.970855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60065f8e-3101-401f-8dc4-bc127ba103e9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:24.971894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-60065f8e-3101-401f-8dc4-bc127ba103e9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:24.989534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60065f8e-3101-401f-8dc4-bc127ba103e9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:24.991150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60065f8e-3101-401f-8dc4-bc127ba103e9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:24.993670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60065f8e-3101-401f-8dc4-bc127ba103e9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:24.995189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60065f8e-3101-401f-8dc4-bc127ba103e9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:24.997785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60065f8e-3101-401f-8dc4-bc127ba103e9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:25.002838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60065f8e-3101-401f-8dc4-bc127ba103e9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:25.106489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-63cdc32f-dc4c-4dcb-8b65-db590fd37668 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:25.125443 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-63cdc32f-dc4c-4dcb-8b65-db590fd37668 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 200 len: 1314 microversion: 2.1 time: 2.138676 Sep 08 13:01:25.144109 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1810/3747] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:22 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 1314 bytes in 2159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:25.162002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5378800f-bd1a-47a3-918f-8d488db5ac80 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:25.163990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5378800f-bd1a-47a3-918f-8d488db5ac80 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:25.180415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5378800f-bd1a-47a3-918f-8d488db5ac80 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:25.181876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5378800f-bd1a-47a3-918f-8d488db5ac80 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:25.184067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5378800f-bd1a-47a3-918f-8d488db5ac80 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:25.185831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5378800f-bd1a-47a3-918f-8d488db5ac80 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:25.187018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5378800f-bd1a-47a3-918f-8d488db5ac80 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:25.188808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5378800f-bd1a-47a3-918f-8d488db5ac80 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:25.301685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-60065f8e-3101-401f-8dc4-bc127ba103e9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:25.334189 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-60065f8e-3101-401f-8dc4-bc127ba103e9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1267 microversion: 2.1 time: 0.387619 Sep 08 13:01:25.348069 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1938/3748] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:24 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1267 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:25.381084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-05dadda0-7004-412e-bb50-f55a2d74ec92 req-934a0624-f1d7-44ff-8ee7-99f354cf7231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55b70b2-cc64-458a-976c-c8f901eb30cc", "name": "network-vif-plugged", "status": "completed", "tag": "9e9f9bc7-0c81-42d8-957c-cea9ca39c459"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:25.400913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-05dadda0-7004-412e-bb50-f55a2d74ec92 req-934a0624-f1d7-44ff-8ee7-99f354cf7231 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:25.402031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-05dadda0-7004-412e-bb50-f55a2d74ec92 req-934a0624-f1d7-44ff-8ee7-99f354cf7231 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:25.403188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-05dadda0-7004-412e-bb50-f55a2d74ec92 req-934a0624-f1d7-44ff-8ee7-99f354cf7231 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:25.428198 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-05dadda0-7004-412e-bb50-f55a2d74ec92 req-934a0624-f1d7-44ff-8ee7-99f354cf7231 service nova] Creating event network-vif-plugged:9e9f9bc7-0c81-42d8-957c-cea9ca39c459 for instance b55b70b2-cc64-458a-976c-c8f901eb30cc on n-h1-852084-10 Sep 08 13:01:25.439622 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-05dadda0-7004-412e-bb50-f55a2d74ec92 req-934a0624-f1d7-44ff-8ee7-99f354cf7231 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089059 Sep 08 13:01:25.444488 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1939/3749] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:25.496471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b72b26a2-a71a-45c3-95da-cfedbed2e8b5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:25.497919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b72b26a2-a71a-45c3-95da-cfedbed2e8b5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:25.521553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b72b26a2-a71a-45c3-95da-cfedbed2e8b5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:25.525110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b72b26a2-a71a-45c3-95da-cfedbed2e8b5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:25.526478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b72b26a2-a71a-45c3-95da-cfedbed2e8b5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:25.528430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b72b26a2-a71a-45c3-95da-cfedbed2e8b5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:25.529573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b72b26a2-a71a-45c3-95da-cfedbed2e8b5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:25.530686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b72b26a2-a71a-45c3-95da-cfedbed2e8b5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:27.184011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5378800f-bd1a-47a3-918f-8d488db5ac80 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:27.207322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5378800f-bd1a-47a3-918f-8d488db5ac80 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:27.222782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5378800f-bd1a-47a3-918f-8d488db5ac80 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:27.231373 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5378800f-bd1a-47a3-918f-8d488db5ac80 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1753 microversion: 2.32 time: 2.081594 Sep 08 13:01:27.233051 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1811/3750] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:25 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1753 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:27.715096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b72b26a2-a71a-45c3-95da-cfedbed2e8b5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:27.775854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b72b26a2-a71a-45c3-95da-cfedbed2e8b5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:27.779628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b72b26a2-a71a-45c3-95da-cfedbed2e8b5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:27.780085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d2fcef99-73ba-49a9-9632-023ddbf5115f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:27.780735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d2fcef99-73ba-49a9-9632-023ddbf5115f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:27.781838 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b72b26a2-a71a-45c3-95da-cfedbed2e8b5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc" status: 200 len: 1362 microversion: 2.26 time: 2.335646 Sep 08 13:01:27.782799 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1940/3751] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:25 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc => generated 1362 bytes in 2338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:27.795596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2fcef99-73ba-49a9-9632-023ddbf5115f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:27.795596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2fcef99-73ba-49a9-9632-023ddbf5115f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:27.795596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2fcef99-73ba-49a9-9632-023ddbf5115f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:27.795596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2fcef99-73ba-49a9-9632-023ddbf5115f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:27.795596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2fcef99-73ba-49a9-9632-023ddbf5115f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:27.795596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2fcef99-73ba-49a9-9632-023ddbf5115f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:27.806218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d8903209-d983-4b5f-81a2-70f5118e81b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:27.807154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d8903209-d983-4b5f-81a2-70f5118e81b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:27.824504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8903209-d983-4b5f-81a2-70f5118e81b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:27.825255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8903209-d983-4b5f-81a2-70f5118e81b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:27.826437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8903209-d983-4b5f-81a2-70f5118e81b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:27.827543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8903209-d983-4b5f-81a2-70f5118e81b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:27.828230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8903209-d983-4b5f-81a2-70f5118e81b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:27.831817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:27.832682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8903209-d983-4b5f-81a2-70f5118e81b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:29.304214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:29.319002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d2fcef99-73ba-49a9-9632-023ddbf5115f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:29.355597 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d2fcef99-73ba-49a9-9632-023ddbf5115f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1510 microversion: 2.1 time: 2.116431 Sep 08 13:01:29.362096 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1812/3752] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:27 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1510 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:29.415828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-189a1c8d-40db-483e-b0b5-d1cddbd8253c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:29.419065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-189a1c8d-40db-483e-b0b5-d1cddbd8253c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:29.433405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d8903209-d983-4b5f-81a2-70f5118e81b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:29.436452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=16 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:29.461220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-189a1c8d-40db-483e-b0b5-d1cddbd8253c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:29.463188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-189a1c8d-40db-483e-b0b5-d1cddbd8253c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:29.464449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-189a1c8d-40db-483e-b0b5-d1cddbd8253c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:29.466212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-189a1c8d-40db-483e-b0b5-d1cddbd8253c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:29.467461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-189a1c8d-40db-483e-b0b5-d1cddbd8253c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:29.468588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-189a1c8d-40db-483e-b0b5-d1cddbd8253c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:29.506394 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d8903209-d983-4b5f-81a2-70f5118e81b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 200 len: 1314 microversion: 2.1 time: 1.710371 Sep 08 13:01:29.562346 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1941/3753] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:27 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 1314 bytes in 1777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:29.578204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac9c24cb-a675-4dca-af74-7a0632ab1156 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:29.584279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ac9c24cb-a675-4dca-af74-7a0632ab1156 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:29.599450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac9c24cb-a675-4dca-af74-7a0632ab1156 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:29.600254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac9c24cb-a675-4dca-af74-7a0632ab1156 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:29.600878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac9c24cb-a675-4dca-af74-7a0632ab1156 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:29.603965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac9c24cb-a675-4dca-af74-7a0632ab1156 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:29.605830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac9c24cb-a675-4dca-af74-7a0632ab1156 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:29.611636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac9c24cb-a675-4dca-af74-7a0632ab1156 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:29.913524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-189a1c8d-40db-483e-b0b5-d1cddbd8253c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:29.926857 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-189a1c8d-40db-483e-b0b5-d1cddbd8253c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1267 microversion: 2.1 time: 0.560884 Sep 08 13:01:29.935271 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1813/3754] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:29 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1267 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:29.940808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0596c86f-2d2a-4a93-933d-9c902d2683ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:29.946797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0596c86f-2d2a-4a93-933d-9c902d2683ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:29.965605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0596c86f-2d2a-4a93-933d-9c902d2683ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:29.966391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0596c86f-2d2a-4a93-933d-9c902d2683ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:29.966995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0596c86f-2d2a-4a93-933d-9c902d2683ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:29.968033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0596c86f-2d2a-4a93-933d-9c902d2683ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:29.973248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0596c86f-2d2a-4a93-933d-9c902d2683ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:29.973942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0596c86f-2d2a-4a93-933d-9c902d2683ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:30.341333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ac9c24cb-a675-4dca-af74-7a0632ab1156 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:30.362109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ac9c24cb-a675-4dca-af74-7a0632ab1156 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:30.368579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ac9c24cb-a675-4dca-af74-7a0632ab1156 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:30.389758 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ac9c24cb-a675-4dca-af74-7a0632ab1156 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1753 microversion: 2.32 time: 0.804631 Sep 08 13:01:30.414725 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1942/3755] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:29 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1753 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:30.430692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac630131-23ad-4e8a-b0a9-b4760e95e64e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:30.432835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ac630131-23ad-4e8a-b0a9-b4760e95e64e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:30.449891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac630131-23ad-4e8a-b0a9-b4760e95e64e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:30.455393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac630131-23ad-4e8a-b0a9-b4760e95e64e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:30.457811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac630131-23ad-4e8a-b0a9-b4760e95e64e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:30.458704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac630131-23ad-4e8a-b0a9-b4760e95e64e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:30.460487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac630131-23ad-4e8a-b0a9-b4760e95e64e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:30.461421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac630131-23ad-4e8a-b0a9-b4760e95e64e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:30.988235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0596c86f-2d2a-4a93-933d-9c902d2683ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:31.009263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0596c86f-2d2a-4a93-933d-9c902d2683ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:31.014703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0596c86f-2d2a-4a93-933d-9c902d2683ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:31.018986 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0596c86f-2d2a-4a93-933d-9c902d2683ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc" status: 200 len: 1546 microversion: 2.26 time: 1.081909 Sep 08 13:01:31.020984 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1814/3756] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:29 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc => generated 1546 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:31.035970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4eb30e7-7af1-4645-814a-9a34d43f81e6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:31.037041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b4eb30e7-7af1-4645-814a-9a34d43f81e6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:31.052721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4eb30e7-7af1-4645-814a-9a34d43f81e6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:31.053715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4eb30e7-7af1-4645-814a-9a34d43f81e6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:31.055798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4eb30e7-7af1-4645-814a-9a34d43f81e6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:31.056913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4eb30e7-7af1-4645-814a-9a34d43f81e6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:31.059579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4eb30e7-7af1-4645-814a-9a34d43f81e6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:31.062153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4eb30e7-7af1-4645-814a-9a34d43f81e6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:31.596940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ac630131-23ad-4e8a-b0a9-b4760e95e64e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:31.641032 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ac630131-23ad-4e8a-b0a9-b4760e95e64e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1510 microversion: 2.1 time: 1.218675 Sep 08 13:01:31.641875 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1943/3757] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:30 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1510 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:31.661395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-61d64486-006c-4383-9f13-704bb8bcf274 req-430eb613-c93d-495f-b520-044ee7d0e8aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92200cbf-d743-4f7f-8ec7-69b062da1b7f", "tag": "7264a794-1f88-4052-acd7-4e6ef91155f4"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:31.716155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-61d64486-006c-4383-9f13-704bb8bcf274 req-430eb613-c93d-495f-b520-044ee7d0e8aa service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:31.720531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-61d64486-006c-4383-9f13-704bb8bcf274 req-430eb613-c93d-495f-b520-044ee7d0e8aa service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:31.721030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-61d64486-006c-4383-9f13-704bb8bcf274 req-430eb613-c93d-495f-b520-044ee7d0e8aa service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:31.769011 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-61d64486-006c-4383-9f13-704bb8bcf274 req-430eb613-c93d-495f-b520-044ee7d0e8aa service nova] Creating event network-changed:7264a794-1f88-4052-acd7-4e6ef91155f4 for instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f on n-h2-852084-10 Sep 08 13:01:31.783212 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-61d64486-006c-4383-9f13-704bb8bcf274 req-430eb613-c93d-495f-b520-044ee7d0e8aa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139585 Sep 08 13:01:31.784596 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1944/3758] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:31.794542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8283f0a-37af-47e4-b47c-8e860512818d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:31.795307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b8283f0a-37af-47e4-b47c-8e860512818d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:31.821501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8283f0a-37af-47e4-b47c-8e860512818d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:31.824359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8283f0a-37af-47e4-b47c-8e860512818d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:31.828894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8283f0a-37af-47e4-b47c-8e860512818d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:31.830300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8283f0a-37af-47e4-b47c-8e860512818d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:31.830970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8283f0a-37af-47e4-b47c-8e860512818d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:31.831645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8283f0a-37af-47e4-b47c-8e860512818d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:32.252333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b4eb30e7-7af1-4645-814a-9a34d43f81e6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:32.291493 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b4eb30e7-7af1-4645-814a-9a34d43f81e6 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 200 len: 1314 microversion: 2.1 time: 1.262490 Sep 08 13:01:32.293358 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1815/3759] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:31 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 1314 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:32.323759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb39e3b550>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:32.361655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:32.362583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:32.371735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:32.372857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:32.392772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:32.393966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:32.395165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:32.397144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:32.398332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:32.399378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:32.460495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:32.461212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:32.461827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:32.491807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:32.493474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:32.495210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:32.586418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:32.659839 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a524b171-a21f-43d4-b260-36e9ef456ae0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-282240839" status: 201 len: 0 microversion: 2.26 time: 0.363902 Sep 08 13:01:32.662419 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1816/3760] 10.222.0.78 () {62 vars in 1377 bytes} [Thu Sep 8 13:01:32 2022] PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-282240839 => generated 0 bytes in 368 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 08 13:01:32.703427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8f50856a-13a3-42ed-ba06-1aececb2e760 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:32.728653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8f50856a-13a3-42ed-ba06-1aececb2e760 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:32.765748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f50856a-13a3-42ed-ba06-1aececb2e760 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:32.766659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f50856a-13a3-42ed-ba06-1aececb2e760 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:32.767561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f50856a-13a3-42ed-ba06-1aececb2e760 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:32.768991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f50856a-13a3-42ed-ba06-1aececb2e760 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:32.770414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f50856a-13a3-42ed-ba06-1aececb2e760 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:32.771718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f50856a-13a3-42ed-ba06-1aececb2e760 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:32.838377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b8283f0a-37af-47e4-b47c-8e860512818d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:32.860494 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8283f0a-37af-47e4-b47c-8e860512818d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1309 microversion: 2.1 time: 1.073810 Sep 08 13:01:32.865135 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1945/3761] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:31 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1309 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:32.875385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bce4f08b-95c2-462a-87f7-e1c7c0b31d1a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb3742c8b0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:32.893409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bce4f08b-95c2-462a-87f7-e1c7c0b31d1a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:32.893810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bce4f08b-95c2-462a-87f7-e1c7c0b31d1a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:32.897131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bce4f08b-95c2-462a-87f7-e1c7c0b31d1a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:32.947736 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bce4f08b-95c2-462a-87f7-e1c7c0b31d1a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-282240839" status: 204 len: 0 microversion: 2.26 time: 0.079978 Sep 08 13:01:32.950162 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1946/3762] 10.222.0.78 () {60 vars in 1358 bytes} [Thu Sep 8 13:01:32 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-282240839 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:01:32.972756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-af2270d8-3692-417c-ab4e-46c4e21415d6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:32.973477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-af2270d8-3692-417c-ab4e-46c4e21415d6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:32.995751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af2270d8-3692-417c-ab4e-46c4e21415d6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:32.996404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af2270d8-3692-417c-ab4e-46c4e21415d6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:32.996872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af2270d8-3692-417c-ab4e-46c4e21415d6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:32.997654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af2270d8-3692-417c-ab4e-46c4e21415d6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:32.998300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af2270d8-3692-417c-ab4e-46c4e21415d6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:32.999687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af2270d8-3692-417c-ab4e-46c4e21415d6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:33.566128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-af2270d8-3692-417c-ab4e-46c4e21415d6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:33.579047 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-af2270d8-3692-417c-ab4e-46c4e21415d6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1507 microversion: 2.1 time: 0.626452 Sep 08 13:01:33.586215 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1947/3763] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:32 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1507 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:33.604091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb36efaf70>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:33.604473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8f50856a-13a3-42ed-ba06-1aececb2e760 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:33.646695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:33.648835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:33.649465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8f50856a-13a3-42ed-ba06-1aececb2e760 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:33.652466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:33.653389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:33.662909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8f50856a-13a3-42ed-ba06-1aececb2e760 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:33.665229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:33.665379 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8f50856a-13a3-42ed-ba06-1aececb2e760 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1799 microversion: 2.32 time: 0.980454 Sep 08 13:01:33.666166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:33.666922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:33.667966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:33.668668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:33.669346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:33.707018 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1817/3764] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:32 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1799 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:33.750949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e55cff28-d0c4-468f-a6d6-c7c8aff217b0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:33.751735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:33.752500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e55cff28-d0c4-468f-a6d6-c7c8aff217b0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:33.752651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:33.764502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:33.775595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e55cff28-d0c4-468f-a6d6-c7c8aff217b0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:33.777377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e55cff28-d0c4-468f-a6d6-c7c8aff217b0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:33.778072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e55cff28-d0c4-468f-a6d6-c7c8aff217b0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:33.779008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e55cff28-d0c4-468f-a6d6-c7c8aff217b0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:33.779727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e55cff28-d0c4-468f-a6d6-c7c8aff217b0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:33.780639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e55cff28-d0c4-468f-a6d6-c7c8aff217b0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:33.813146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:33.884375 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c3b749f4-cff8-45db-9654-ad90360f3d2e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags" status: 204 len: 0 microversion: 2.26 time: 0.292534 Sep 08 13:01:33.887524 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1948/3765] 10.222.0.78 () {60 vars in 1295 bytes} [Thu Sep 8 13:01:33 2022] DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:01:33.913450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c4f0113-1a87-415e-9d46-d2ece44c8cfa tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:33.915028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5c4f0113-1a87-415e-9d46-d2ece44c8cfa tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:33.936548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c4f0113-1a87-415e-9d46-d2ece44c8cfa tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:33.937766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c4f0113-1a87-415e-9d46-d2ece44c8cfa tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:33.949054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c4f0113-1a87-415e-9d46-d2ece44c8cfa tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:33.950556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c4f0113-1a87-415e-9d46-d2ece44c8cfa tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:33.951736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c4f0113-1a87-415e-9d46-d2ece44c8cfa tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:33.952807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c4f0113-1a87-415e-9d46-d2ece44c8cfa tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:34.196777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e55cff28-d0c4-468f-a6d6-c7c8aff217b0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:34.207470 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e55cff28-d0c4-468f-a6d6-c7c8aff217b0 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 200 len: 1314 microversion: 2.1 time: 0.506404 Sep 08 13:01:34.227600 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1818/3766] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:33 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:34.233909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a7c2eef-fdd2-4445-8dc4-3296c0cc89cc tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb39e62430>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:34.257014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a7c2eef-fdd2-4445-8dc4-3296c0cc89cc tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:34.257950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a7c2eef-fdd2-4445-8dc4-3296c0cc89cc tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:34.258644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a7c2eef-fdd2-4445-8dc4-3296c0cc89cc tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:34.283262 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a7c2eef-fdd2-4445-8dc4-3296c0cc89cc tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags" status: 200 len: 12 microversion: 2.26 time: 0.053082 Sep 08 13:01:34.287701 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1819/3767] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Sep 8 13:01:34 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags => generated 12 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:34.318994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb39dc4040>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:34.352505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:34.353547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:34.355096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:34.355874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:34.370459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:34.370459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:34.382949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:34.383606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:34.384418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:34.387533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:34.472536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:34.473695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:34.474346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:34.508811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:34.510564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:34.516743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:34.602093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:34.632308 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92941019-62b9-4c91-89f2-20f6d24ff998 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-891465820" status: 201 len: 0 microversion: 2.26 time: 0.329839 Sep 08 13:01:34.635196 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1820/3768] 10.222.0.78 () {62 vars in 1377 bytes} [Thu Sep 8 13:01:34 2022] PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-891465820 => generated 0 bytes in 341 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 08 13:01:34.655856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dc10429b-7c25-4e71-a02e-87b422640d07 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:34.656870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dc10429b-7c25-4e71-a02e-87b422640d07 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:34.670048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc10429b-7c25-4e71-a02e-87b422640d07 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:34.670437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc10429b-7c25-4e71-a02e-87b422640d07 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:34.671420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc10429b-7c25-4e71-a02e-87b422640d07 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:34.673300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc10429b-7c25-4e71-a02e-87b422640d07 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:34.673766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc10429b-7c25-4e71-a02e-87b422640d07 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:34.674315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc10429b-7c25-4e71-a02e-87b422640d07 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:34.765639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5c4f0113-1a87-415e-9d46-d2ece44c8cfa tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:34.778924 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c4f0113-1a87-415e-9d46-d2ece44c8cfa tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1309 microversion: 2.1 time: 0.885376 Sep 08 13:01:34.784041 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1949/3769] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:33 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1309 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:34.798461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6324d30f-8c8a-41cf-b244-29dae500be4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb37006dc0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:34.813278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6324d30f-8c8a-41cf-b244-29dae500be4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:34.815349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6324d30f-8c8a-41cf-b244-29dae500be4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:34.818513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6324d30f-8c8a-41cf-b244-29dae500be4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:34.861487 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6324d30f-8c8a-41cf-b244-29dae500be4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags" status: 200 len: 35 microversion: 2.26 time: 0.075845 Sep 08 13:01:34.865081 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1950/3770] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Sep 8 13:01:34 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags => generated 35 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:34.889769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f670d926-380d-43b8-8ca6-f30c3969cb63 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:34.891516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f670d926-380d-43b8-8ca6-f30c3969cb63 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:34.904597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f670d926-380d-43b8-8ca6-f30c3969cb63 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:34.905592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f670d926-380d-43b8-8ca6-f30c3969cb63 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:34.906816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f670d926-380d-43b8-8ca6-f30c3969cb63 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:34.911915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f670d926-380d-43b8-8ca6-f30c3969cb63 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:34.912886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f670d926-380d-43b8-8ca6-f30c3969cb63 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:34.913572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f670d926-380d-43b8-8ca6-f30c3969cb63 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:34.970060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=99,nova_cell1:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:36.504362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dc10429b-7c25-4e71-a02e-87b422640d07 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:36.526378 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dc10429b-7c25-4e71-a02e-87b422640d07 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1507 microversion: 2.1 time: 1.887624 Sep 08 13:01:36.527150 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1821/3771] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:34 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1507 bytes in 1891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:36.548733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb39de31f0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:36.568138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f670d926-380d-43b8-8ca6-f30c3969cb63 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:36.583156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:36.587089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f670d926-380d-43b8-8ca6-f30c3969cb63 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:36.588472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:36.589827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:36.590174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f670d926-380d-43b8-8ca6-f30c3969cb63 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:36.590937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:36.607711 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f670d926-380d-43b8-8ca6-f30c3969cb63 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1799 microversion: 2.32 time: 1.715346 Sep 08 13:01:36.609329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:36.609913 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1951/3772] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:34 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1799 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:36.610373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:36.611045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:36.612099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:36.612799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:36.615204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:36.669932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44766b1b-3a34-4e1d-a069-a9e7a7dfa634 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:36.671152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-44766b1b-3a34-4e1d-a069-a9e7a7dfa634 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:36.671351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:36.671932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:36.672908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:36.701672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44766b1b-3a34-4e1d-a069-a9e7a7dfa634 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:36.709221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44766b1b-3a34-4e1d-a069-a9e7a7dfa634 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:36.709652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44766b1b-3a34-4e1d-a069-a9e7a7dfa634 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:36.715014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44766b1b-3a34-4e1d-a069-a9e7a7dfa634 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:36.719375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44766b1b-3a34-4e1d-a069-a9e7a7dfa634 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:36.720890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44766b1b-3a34-4e1d-a069-a9e7a7dfa634 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:36.785519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:36.826932 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-56733dd2-6d78-4711-ab3d-204cfd206cbf tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-891465820" status: 204 len: 0 microversion: 2.26 time: 0.298571 Sep 08 13:01:36.835559 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1822/3773] 10.222.0.78 () {60 vars in 1361 bytes} [Thu Sep 8 13:01:36 2022] DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-891465820 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:01:36.855139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e7d86fcc-57ce-47fb-bfb3-c10f5e2760f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:36.858258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e7d86fcc-57ce-47fb-bfb3-c10f5e2760f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:36.882214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7d86fcc-57ce-47fb-bfb3-c10f5e2760f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:36.882936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7d86fcc-57ce-47fb-bfb3-c10f5e2760f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:36.884092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7d86fcc-57ce-47fb-bfb3-c10f5e2760f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:36.886663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7d86fcc-57ce-47fb-bfb3-c10f5e2760f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:36.888064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7d86fcc-57ce-47fb-bfb3-c10f5e2760f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:36.889111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7d86fcc-57ce-47fb-bfb3-c10f5e2760f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:37.726394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e7d86fcc-57ce-47fb-bfb3-c10f5e2760f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:37.750829 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e7d86fcc-57ce-47fb-bfb3-c10f5e2760f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1309 microversion: 2.1 time: 0.913560 Sep 08 13:01:37.753014 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1823/3774] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:36 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1309 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:37.764507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-62f35f13-c28d-48af-a867-35b2a6719e3f req-e76f317d-3bdb-494b-937b-67781b7d3ce1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a71f0f-f2e1-45b0-9c8d-fee16d9b4840", "name": "network-vif-unplugged", "status": "completed", "tag": "9881bbfc-f0e8-43c0-a5c4-68f7e0961d4e"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:37.803450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-62f35f13-c28d-48af-a867-35b2a6719e3f req-e76f317d-3bdb-494b-937b-67781b7d3ce1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:37.810165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-62f35f13-c28d-48af-a867-35b2a6719e3f req-e76f317d-3bdb-494b-937b-67781b7d3ce1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:37.810629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-62f35f13-c28d-48af-a867-35b2a6719e3f req-e76f317d-3bdb-494b-937b-67781b7d3ce1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:37.835165 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-62f35f13-c28d-48af-a867-35b2a6719e3f req-e76f317d-3bdb-494b-937b-67781b7d3ce1 service nova] Creating event network-vif-unplugged:9881bbfc-f0e8-43c0-a5c4-68f7e0961d4e for instance 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 on n-h1-852084-10 Sep 08 13:01:37.850563 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-62f35f13-c28d-48af-a867-35b2a6719e3f req-e76f317d-3bdb-494b-937b-67781b7d3ce1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092695 Sep 08 13:01:37.854074 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1824/3775] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:37.870184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-798ddb88-fe97-40ff-a4f5-1bc5d46706ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb39e04ee0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:37.894786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-798ddb88-fe97-40ff-a4f5-1bc5d46706ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:37.896940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-798ddb88-fe97-40ff-a4f5-1bc5d46706ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:37.899473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-798ddb88-fe97-40ff-a4f5-1bc5d46706ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:37.955807 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-798ddb88-fe97-40ff-a4f5-1bc5d46706ad tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags" status: 200 len: 12 microversion: 2.26 time: 0.101366 Sep 08 13:01:37.960942 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1825/3776] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Sep 8 13:01:37 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags => generated 12 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:37.988789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1815c284-2967-47ad-b036-5088f359d55a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:37.993509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1815c284-2967-47ad-b036-5088f359d55a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:38.022368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1815c284-2967-47ad-b036-5088f359d55a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:38.028010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1815c284-2967-47ad-b036-5088f359d55a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:38.030623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1815c284-2967-47ad-b036-5088f359d55a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:38.036300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1815c284-2967-47ad-b036-5088f359d55a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:38.040889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1815c284-2967-47ad-b036-5088f359d55a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:38.043997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1815c284-2967-47ad-b036-5088f359d55a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:38.071247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2,nova_cell1:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:38.804467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-44766b1b-3a34-4e1d-a069-a9e7a7dfa634 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:38.828136 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44766b1b-3a34-4e1d-a069-a9e7a7dfa634 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 200 len: 1314 microversion: 2.1 time: 2.186021 Sep 08 13:01:38.835896 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1952/3777] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:36 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 1314 bytes in 2225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:38.859770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c8ab9f20-03ce-4a92-9d60-42d103e13db7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:38.876034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c8ab9f20-03ce-4a92-9d60-42d103e13db7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:38.894936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8ab9f20-03ce-4a92-9d60-42d103e13db7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:38.897527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8ab9f20-03ce-4a92-9d60-42d103e13db7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:38.900896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8ab9f20-03ce-4a92-9d60-42d103e13db7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:38.902923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8ab9f20-03ce-4a92-9d60-42d103e13db7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:38.904256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8ab9f20-03ce-4a92-9d60-42d103e13db7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:38.905411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8ab9f20-03ce-4a92-9d60-42d103e13db7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:39.269592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1815c284-2967-47ad-b036-5088f359d55a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:39.305340 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1815c284-2967-47ad-b036-5088f359d55a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 200 len: 1510 microversion: 2.1 time: 1.341383 Sep 08 13:01:39.328115 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1826/3778] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:37 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 1510 bytes in 1366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:39.359790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb39e14820>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:39.378962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:39.381433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:39.382165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:39.383044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:39.397111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:39.398648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:39.399759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:39.401879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:39.402721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:39.403564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:39.473022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:39.473844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:39.474623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:39.492198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:39.511311 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-48d31135-68bc-4f7d-a5d9-57de8b1ee9e0 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags" status: 204 len: 0 microversion: 2.26 time: 0.181490 Sep 08 13:01:39.512402 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1827/3779] 10.222.0.78 () {60 vars in 1295 bytes} [Thu Sep 8 13:01:39 2022] DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags => generated 0 bytes in 184 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:01:39.525687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-15823b7b-a049-44cb-908d-99145e1b8fd5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:39.527693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-15823b7b-a049-44cb-908d-99145e1b8fd5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:39.535330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15823b7b-a049-44cb-908d-99145e1b8fd5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:39.536259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15823b7b-a049-44cb-908d-99145e1b8fd5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:39.537056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15823b7b-a049-44cb-908d-99145e1b8fd5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:39.538183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15823b7b-a049-44cb-908d-99145e1b8fd5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:39.538965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15823b7b-a049-44cb-908d-99145e1b8fd5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:39.539823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15823b7b-a049-44cb-908d-99145e1b8fd5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:40.555698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-15823b7b-a049-44cb-908d-99145e1b8fd5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:40.581984 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-15823b7b-a049-44cb-908d-99145e1b8fd5 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1309 microversion: 2.1 time: 1.067889 Sep 08 13:01:40.583106 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1828/3780] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:39 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1309 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:40.602022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e927652c-b63d-46b8-92f7-aa8b3bb1598f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:40.603152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e927652c-b63d-46b8-92f7-aa8b3bb1598f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:40.630038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c8ab9f20-03ce-4a92-9d60-42d103e13db7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:40.630937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e927652c-b63d-46b8-92f7-aa8b3bb1598f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:40.631183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e927652c-b63d-46b8-92f7-aa8b3bb1598f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:40.632570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e927652c-b63d-46b8-92f7-aa8b3bb1598f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:40.634882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e927652c-b63d-46b8-92f7-aa8b3bb1598f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:40.636827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e927652c-b63d-46b8-92f7-aa8b3bb1598f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:40.638113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e927652c-b63d-46b8-92f7-aa8b3bb1598f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:40.650295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c8ab9f20-03ce-4a92-9d60-42d103e13db7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:40.664571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c8ab9f20-03ce-4a92-9d60-42d103e13db7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:40.665885 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c8ab9f20-03ce-4a92-9d60-42d103e13db7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1845 microversion: 2.32 time: 1.824321 Sep 08 13:01:40.694065 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1953/3781] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:38 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1845 bytes in 1853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:40.706509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-185a49a4-f9e2-4269-aadf-d063869473b5 req-e145a8fc-f279-41e7-80d6-9737a98958d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3433475a-6253-474c-9bdc-734b385ae282", "tag": "790a60f6-25f6-497c-88dc-c28896334bc6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:40.750398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-185a49a4-f9e2-4269-aadf-d063869473b5 req-e145a8fc-f279-41e7-80d6-9737a98958d7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:40.750904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-185a49a4-f9e2-4269-aadf-d063869473b5 req-e145a8fc-f279-41e7-80d6-9737a98958d7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:40.758380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-185a49a4-f9e2-4269-aadf-d063869473b5 req-e145a8fc-f279-41e7-80d6-9737a98958d7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:40.804258 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-185a49a4-f9e2-4269-aadf-d063869473b5 req-e145a8fc-f279-41e7-80d6-9737a98958d7 service nova] Creating event network-changed:790a60f6-25f6-497c-88dc-c28896334bc6 for instance 3433475a-6253-474c-9bdc-734b385ae282 on n-h2-852084-10 Sep 08 13:01:40.820459 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-185a49a4-f9e2-4269-aadf-d063869473b5 req-e145a8fc-f279-41e7-80d6-9737a98958d7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121287 Sep 08 13:01:40.822718 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1954/3782] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:40.837887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb36b64700>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:40.879295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:40.881066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:40.883079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:40.884014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:40.900926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:40.902817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:40.905297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:40.906418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:40.909094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:40.910804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:41.013242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:41.013778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:41.014240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:41.055905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:41.060362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:41.061252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:41.217127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:41.281863 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9ef2f867-9805-4e23-b510-cd90e017e335 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-216286235" status: 201 len: 0 microversion: 2.26 time: 0.457089 Sep 08 13:01:41.282808 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1955/3783] 10.222.0.78 () {62 vars in 1377 bytes} [Thu Sep 8 13:01:40 2022] PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-216286235 => generated 0 bytes in 460 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 08 13:01:41.306192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e927652c-b63d-46b8-92f7-aa8b3bb1598f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:41.310396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fbe63b8e-a422-4d99-a662-b251e91e03e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:41.316755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fbe63b8e-a422-4d99-a662-b251e91e03e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:41.319125 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e927652c-b63d-46b8-92f7-aa8b3bb1598f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.734436 Sep 08 13:01:41.331338 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1829/3784] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:40 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:41.337049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-4e6ea6ef-8e4e-4f3b-b7f8-ac17f3f2809e req-c8b18f6f-bd33-4d47-8758-8706b8184a6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92200cbf-d743-4f7f-8ec7-69b062da1b7f", "name": "network-vif-plugged", "status": "completed", "tag": "7264a794-1f88-4052-acd7-4e6ef91155f4"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:41.351765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbe63b8e-a422-4d99-a662-b251e91e03e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:41.354982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbe63b8e-a422-4d99-a662-b251e91e03e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:41.355850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbe63b8e-a422-4d99-a662-b251e91e03e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:41.357171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbe63b8e-a422-4d99-a662-b251e91e03e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:41.358504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbe63b8e-a422-4d99-a662-b251e91e03e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:41.361495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbe63b8e-a422-4d99-a662-b251e91e03e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:41.363808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4e6ea6ef-8e4e-4f3b-b7f8-ac17f3f2809e req-c8b18f6f-bd33-4d47-8758-8706b8184a6e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:41.365930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4e6ea6ef-8e4e-4f3b-b7f8-ac17f3f2809e req-c8b18f6f-bd33-4d47-8758-8706b8184a6e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:41.367062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4e6ea6ef-8e4e-4f3b-b7f8-ac17f3f2809e req-c8b18f6f-bd33-4d47-8758-8706b8184a6e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:41.413816 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-4e6ea6ef-8e4e-4f3b-b7f8-ac17f3f2809e req-c8b18f6f-bd33-4d47-8758-8706b8184a6e service nova] Creating event network-vif-plugged:7264a794-1f88-4052-acd7-4e6ef91155f4 for instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f on n-h2-852084-10 Sep 08 13:01:41.431401 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-4e6ea6ef-8e4e-4f3b-b7f8-ac17f3f2809e req-c8b18f6f-bd33-4d47-8758-8706b8184a6e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105539 Sep 08 13:01:41.434161 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1830/3785] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:41.473318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb39d71280>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:41.533781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:41.534999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:41.540757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:41.546586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:41.582622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:41.583677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:41.586142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:41.587543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:41.589531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:41.590802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:41.674683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:41.675739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:41.677479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:41.712575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:41.715933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:41.716963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:41.794676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:41.829666 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ba41ee44-9c99-41d1-8d13-4b348fd3ec98 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-1148979260" status: 201 len: 0 microversion: 2.26 time: 0.382219 Sep 08 13:01:41.832092 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1831/3786] 10.222.0.78 () {62 vars in 1380 bytes} [Thu Sep 8 13:01:41 2022] PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-1148979260 => generated 0 bytes in 397 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 08 13:01:41.842298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-197a264b-fbd2-4597-9627-e56c2fabd1e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:41.846862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-197a264b-fbd2-4597-9627-e56c2fabd1e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:41.860549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-197a264b-fbd2-4597-9627-e56c2fabd1e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:41.860549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-197a264b-fbd2-4597-9627-e56c2fabd1e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:41.861981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-197a264b-fbd2-4597-9627-e56c2fabd1e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:41.863198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-197a264b-fbd2-4597-9627-e56c2fabd1e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:41.872869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-197a264b-fbd2-4597-9627-e56c2fabd1e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:41.873523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-197a264b-fbd2-4597-9627-e56c2fabd1e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:42.227500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fbe63b8e-a422-4d99-a662-b251e91e03e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:42.248612 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fbe63b8e-a422-4d99-a662-b251e91e03e1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 200 len: 1314 microversion: 2.1 time: 0.963677 Sep 08 13:01:42.249165 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1956/3787] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:41 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 1314 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:42.286841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7d020f32-5c82-4360-aa3e-5ebaea2675d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:42.287524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7d020f32-5c82-4360-aa3e-5ebaea2675d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:42.317426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d020f32-5c82-4360-aa3e-5ebaea2675d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:42.318008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d020f32-5c82-4360-aa3e-5ebaea2675d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:42.318571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d020f32-5c82-4360-aa3e-5ebaea2675d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:42.319211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d020f32-5c82-4360-aa3e-5ebaea2675d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:42.321323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d020f32-5c82-4360-aa3e-5ebaea2675d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:42.322092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d020f32-5c82-4360-aa3e-5ebaea2675d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:42.765839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-197a264b-fbd2-4597-9627-e56c2fabd1e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:42.789203 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-197a264b-fbd2-4597-9627-e56c2fabd1e5 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.955666 Sep 08 13:01:42.799753 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1832/3788] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:41 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:42.821631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6328d54d-aa16-4763-8c09-e06b9a5d9f37 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:42.822511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6328d54d-aa16-4763-8c09-e06b9a5d9f37 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:42.851962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6328d54d-aa16-4763-8c09-e06b9a5d9f37 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:42.855280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6328d54d-aa16-4763-8c09-e06b9a5d9f37 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:42.858343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6328d54d-aa16-4763-8c09-e06b9a5d9f37 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:42.865905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6328d54d-aa16-4763-8c09-e06b9a5d9f37 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:42.866691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6328d54d-aa16-4763-8c09-e06b9a5d9f37 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:42.884541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6328d54d-aa16-4763-8c09-e06b9a5d9f37 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:42.947074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7d020f32-5c82-4360-aa3e-5ebaea2675d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:42.962344 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7d020f32-5c82-4360-aa3e-5ebaea2675d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1309 microversion: 2.1 time: 0.688635 Sep 08 13:01:42.964058 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1957/3789] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:42 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1309 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:42.976987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb3712ddc0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:43.015258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:43.016121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:43.018674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:43.019603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:43.051438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:43.052306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:43.053099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:43.054428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:43.055868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:43.056784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:43.130735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:43.132937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:43.134100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:43.193140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:43.267774 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-846b3459-46fc-4115-9d03-88fe9c0a5e30 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags" status: 204 len: 0 microversion: 2.26 time: 0.299703 Sep 08 13:01:43.273817 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1958/3790] 10.222.0.78 () {60 vars in 1295 bytes} [Thu Sep 8 13:01:42 2022] DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:01:43.291317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-916077bb-cfe1-4802-a179-238f2cd02b90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:43.298042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-916077bb-cfe1-4802-a179-238f2cd02b90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:43.322295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-916077bb-cfe1-4802-a179-238f2cd02b90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:43.330447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-916077bb-cfe1-4802-a179-238f2cd02b90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:43.331710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-916077bb-cfe1-4802-a179-238f2cd02b90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:43.333278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-916077bb-cfe1-4802-a179-238f2cd02b90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:43.335499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-916077bb-cfe1-4802-a179-238f2cd02b90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:43.339474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-916077bb-cfe1-4802-a179-238f2cd02b90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:44.770957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-916077bb-cfe1-4802-a179-238f2cd02b90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:44.803856 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-916077bb-cfe1-4802-a179-238f2cd02b90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.527390 Sep 08 13:01:44.806373 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1959/3791] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:43 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:44.825527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-901cadfa-63a3-4015-bce1-f8290be07bbc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:44.837268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-901cadfa-63a3-4015-bce1-f8290be07bbc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:44.855267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-901cadfa-63a3-4015-bce1-f8290be07bbc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:44.858378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-901cadfa-63a3-4015-bce1-f8290be07bbc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:44.859954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-901cadfa-63a3-4015-bce1-f8290be07bbc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:44.861880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-901cadfa-63a3-4015-bce1-f8290be07bbc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:44.864085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-901cadfa-63a3-4015-bce1-f8290be07bbc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:44.865279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-901cadfa-63a3-4015-bce1-f8290be07bbc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:44.928665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6328d54d-aa16-4763-8c09-e06b9a5d9f37 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:45.004804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6328d54d-aa16-4763-8c09-e06b9a5d9f37 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:45.017304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6328d54d-aa16-4763-8c09-e06b9a5d9f37 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:45.026200 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6328d54d-aa16-4763-8c09-e06b9a5d9f37 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1845 microversion: 2.32 time: 2.220031 Sep 08 13:01:45.028657 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1833/3792] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:42 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1845 bytes in 2229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:45.045359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7a1a9da7-f0a2-4dad-8c9e-ee0790afe705 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb39e13940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:45.056260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:45.067345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a1a9da7-f0a2-4dad-8c9e-ee0790afe705 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:45.069719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a1a9da7-f0a2-4dad-8c9e-ee0790afe705 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:45.071414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a1a9da7-f0a2-4dad-8c9e-ee0790afe705 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:45.102521 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7a1a9da7-f0a2-4dad-8c9e-ee0790afe705 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags" status: 200 len: 12 microversion: 2.26 time: 0.069769 Sep 08 13:01:45.113931 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1834/3793] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Sep 8 13:01:45 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags => generated 12 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:45.830806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1906244361", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "f90be2be-1e4e-41cf-88fd-de19caf73073"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:45.942651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] validate_networks() for [('f90be2be-1e4e-41cf-88fd-de19caf73073', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:01:45.998188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-901cadfa-63a3-4015-bce1-f8290be07bbc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:46.030751 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-901cadfa-63a3-4015-bce1-f8290be07bbc tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 200 len: 1500 microversion: 2.1 time: 1.220146 Sep 08 13:01:46.031821 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1960/3794] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:44 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 1500 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:46.041077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f1c2b568-54cb-4919-972d-068c7ca3f36b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:46.046501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f1c2b568-54cb-4919-972d-068c7ca3f36b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:46.060300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1c2b568-54cb-4919-972d-068c7ca3f36b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:46.068226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1c2b568-54cb-4919-972d-068c7ca3f36b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:46.069069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1c2b568-54cb-4919-972d-068c7ca3f36b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:46.070246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1c2b568-54cb-4919-972d-068c7ca3f36b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:46.070937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1c2b568-54cb-4919-972d-068c7ca3f36b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:46.071614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1c2b568-54cb-4919-972d-068c7ca3f36b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:47.132511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f1c2b568-54cb-4919-972d-068c7ca3f36b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:47.151596 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f1c2b568-54cb-4919-972d-068c7ca3f36b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1309 microversion: 2.1 time: 1.117236 Sep 08 13:01:47.167938 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1961/3795] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:46 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1309 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:47.200049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e2ec3643-40ca-4107-be82-97f11a442c37 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:47.202011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e2ec3643-40ca-4107-be82-97f11a442c37 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:47.214888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2ec3643-40ca-4107-be82-97f11a442c37 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:47.217047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2ec3643-40ca-4107-be82-97f11a442c37 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:47.218298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2ec3643-40ca-4107-be82-97f11a442c37 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:47.220420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2ec3643-40ca-4107-be82-97f11a442c37 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:47.221718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2ec3643-40ca-4107-be82-97f11a442c37 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:47.222826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2ec3643-40ca-4107-be82-97f11a442c37 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:47.617061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e2ec3643-40ca-4107-be82-97f11a442c37 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:47.648859 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e2ec3643-40ca-4107-be82-97f11a442c37 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.478372 Sep 08 13:01:47.652214 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1962/3796] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:47 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:47.658705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb36518310>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:47.675837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:47.678620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:47.680416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:47.681309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:47.700395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:47.702348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:47.704247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:47.705485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:47.705997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:47.706440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:47.756144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:47.757826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:47.759359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:47.764611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:01:47.766120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:01:47.766541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:01:47.767040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:01:47.768266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:01:47.795998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:47.796154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:47.796154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:47.796154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:47.796154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:47.796154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:47.796154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:47.818385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Getting quotas for project 927079ee4f8f49dfbb3809a990902f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:01:47.830463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Getting quotas for user f434bb7b512646df85ba9aeaecc3762e and project 927079ee4f8f49dfbb3809a990902f5a. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:01:47.840074 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c5bcfacc-91f8-4739-a737-4e1010adad79 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags" status: 204 len: 0 microversion: 2.26 time: 0.185268 Sep 08 13:01:47.849383 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1963/3797] 10.222.0.78 () {60 vars in 1295 bytes} [Thu Sep 8 13:01:47 2022] DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:01:47.863727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:01:47.866527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c8f630b3-5bdf-4a0e-ba7c-0fc105390ac7 req-cb609d77-699c-4593-9c63-fcc80ce3670b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "tag": "df47dbce-98af-457f-b820-6f3eed3fb9db"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:47.869097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:01:47.910242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c8f630b3-5bdf-4a0e-ba7c-0fc105390ac7 req-cb609d77-699c-4593-9c63-fcc80ce3670b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:47.917665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c8f630b3-5bdf-4a0e-ba7c-0fc105390ac7 req-cb609d77-699c-4593-9c63-fcc80ce3670b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:47.919328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c8f630b3-5bdf-4a0e-ba7c-0fc105390ac7 req-cb609d77-699c-4593-9c63-fcc80ce3670b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:47.966386 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c8f630b3-5bdf-4a0e-ba7c-0fc105390ac7 req-cb609d77-699c-4593-9c63-fcc80ce3670b service nova] Creating event network-changed:df47dbce-98af-457f-b820-6f3eed3fb9db for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:01:47.984309 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-31a14733-23c4-4ca9-a27b-db71c0d0f845 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.865133 Sep 08 13:01:47.986619 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1835/3798] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:01:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2872 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:01:47.993155 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c8f630b3-5bdf-4a0e-ba7c-0fc105390ac7 req-cb609d77-699c-4593-9c63-fcc80ce3670b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141623 Sep 08 13:01:47.994184 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1964/3799] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:48.000610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9ce25074-e530-4092-8eab-f58ebac64d4e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:48.001639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9ce25074-e530-4092-8eab-f58ebac64d4e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:48.011533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1c25e179-26e4-4f4e-831c-f33b7758bfe3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:48.016016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1c25e179-26e4-4f4e-831c-f33b7758bfe3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:48.017711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ce25074-e530-4092-8eab-f58ebac64d4e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:48.018415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ce25074-e530-4092-8eab-f58ebac64d4e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:48.019071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ce25074-e530-4092-8eab-f58ebac64d4e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:48.020031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ce25074-e530-4092-8eab-f58ebac64d4e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:48.024024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ce25074-e530-4092-8eab-f58ebac64d4e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:48.024736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ce25074-e530-4092-8eab-f58ebac64d4e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:48.040022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c25e179-26e4-4f4e-831c-f33b7758bfe3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:48.054039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c25e179-26e4-4f4e-831c-f33b7758bfe3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:48.055559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c25e179-26e4-4f4e-831c-f33b7758bfe3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:48.058757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c25e179-26e4-4f4e-831c-f33b7758bfe3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:48.061127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c25e179-26e4-4f4e-831c-f33b7758bfe3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:48.066230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c25e179-26e4-4f4e-831c-f33b7758bfe3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:48.158128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-1c25e179-26e4-4f4e-831c-f33b7758bfe3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lazy-loading 'flavor' on Instance uuid 92200cbf-d743-4f7f-8ec7-69b062da1b7f {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:48.374621 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1c25e179-26e4-4f4e-831c-f33b7758bfe3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "POST /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f/action" status: 202 len: 0 microversion: 2.1 time: 0.383259 Sep 08 13:01:48.381084 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1836/3800] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:01:47 2022] POST /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f/action => generated 0 bytes in 387 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:01:48.430407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d696ad9-bcbf-4525-a9d4-df6c33f8d71a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:48.461894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d696ad9-bcbf-4525-a9d4-df6c33f8d71a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:48.462865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d696ad9-bcbf-4525-a9d4-df6c33f8d71a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:48.464708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d696ad9-bcbf-4525-a9d4-df6c33f8d71a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:48.555195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1d696ad9-bcbf-4525-a9d4-df6c33f8d71a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Going to try to stop instance {{(pid=128971) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 13:01:48.800385 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1d696ad9-bcbf-4525-a9d4-df6c33f8d71a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.420356 Sep 08 13:01:48.801428 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1837/3801] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:01:48 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:01:48.826929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb39dcf9d0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:48.860299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:48.860704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:48.861253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:48.861874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:48.880643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:48.881441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:48.882139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:48.883451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:48.884096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:48.884794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:49.051474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:49.052117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:49.057806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:49.085519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:49.086505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:49.089037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:49.115149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=90,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:UPDATE=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:49.191011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:49.250745 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cd239542-b4cb-4eec-ac8e-0b3b7581c0f8 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-1363643942" status: 201 len: 0 microversion: 2.26 time: 0.446924 Sep 08 13:01:49.252489 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1838/3802] 10.222.0.78 () {62 vars in 1380 bytes} [Thu Sep 8 13:01:48 2022] PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-1363643942 => generated 0 bytes in 450 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Sep 08 13:01:49.262504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d6d0cef5-e5b7-4a1c-90e0-e64f2db4566e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:49.264841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d6d0cef5-e5b7-4a1c-90e0-e64f2db4566e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:49.342071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9ce25074-e530-4092-8eab-f58ebac64d4e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:49.364964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9ce25074-e530-4092-8eab-f58ebac64d4e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:49.377701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d6d0cef5-e5b7-4a1c-90e0-e64f2db4566e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f434bb7b512646df85ba9aeaecc3762e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '927079ee4f8f49dfbb3809a990902f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:49.386439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9ce25074-e530-4092-8eab-f58ebac64d4e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:49.389077 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9ce25074-e530-4092-8eab-f58ebac64d4e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1854 microversion: 2.32 time: 1.392339 Sep 08 13:01:49.391322 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1965/3803] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:47 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1854 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:49.403966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da76e1eb-b19f-4ee3-a057-5052e7fb7b24 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:49.405563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-da76e1eb-b19f-4ee3-a057-5052e7fb7b24 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:49.418380 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d6d0cef5-e5b7-4a1c-90e0-e64f2db4566e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 200 len: 1225 microversion: 2.1 time: 0.159726 Sep 08 13:01:49.419357 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1839/3804] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:49 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 1225 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:49.422722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da76e1eb-b19f-4ee3-a057-5052e7fb7b24 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:49.425411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e1a422a3-e2f3-4682-b5f8-d25f7ff2daf3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:49.426357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e1a422a3-e2f3-4682-b5f8-d25f7ff2daf3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:49.430742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da76e1eb-b19f-4ee3-a057-5052e7fb7b24 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:49.431856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da76e1eb-b19f-4ee3-a057-5052e7fb7b24 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:49.435782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1a422a3-e2f3-4682-b5f8-d25f7ff2daf3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:49.436649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1a422a3-e2f3-4682-b5f8-d25f7ff2daf3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:49.437235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da76e1eb-b19f-4ee3-a057-5052e7fb7b24 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:49.438318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da76e1eb-b19f-4ee3-a057-5052e7fb7b24 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:49.439164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1a422a3-e2f3-4682-b5f8-d25f7ff2daf3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:49.440188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1a422a3-e2f3-4682-b5f8-d25f7ff2daf3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:49.440980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1a422a3-e2f3-4682-b5f8-d25f7ff2daf3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:49.441350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1a422a3-e2f3-4682-b5f8-d25f7ff2daf3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:49.448441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da76e1eb-b19f-4ee3-a057-5052e7fb7b24 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:49.974291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e1a422a3-e2f3-4682-b5f8-d25f7ff2daf3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:49.980520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-da76e1eb-b19f-4ee3-a057-5052e7fb7b24 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:49.991762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:50.004705 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-da76e1eb-b19f-4ee3-a057-5052e7fb7b24 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1309 microversion: 2.1 time: 0.610995 Sep 08 13:01:50.010792 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e1a422a3-e2f3-4682-b5f8-d25f7ff2daf3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 200 len: 1491 microversion: 2.1 time: 0.589028 Sep 08 13:01:50.013186 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1840/3805] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:49 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 1491 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:50.015986 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1966/3806] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:49 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1309 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:50.032998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b33f92bd-fe63-4989-85bc-4eaa822fe4ff req-1056ca1b-c266-48a9-a122-3d5d32153d76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3433475a-6253-474c-9bdc-734b385ae282", "name": "network-vif-plugged", "status": "completed", "tag": "790a60f6-25f6-497c-88dc-c28896334bc6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:50.061916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-791e8ac5-4ed0-4fe4-9cfe-0937430199ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:50.079903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-791e8ac5-4ed0-4fe4-9cfe-0937430199ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:50.087001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b33f92bd-fe63-4989-85bc-4eaa822fe4ff req-1056ca1b-c266-48a9-a122-3d5d32153d76 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:50.087733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b33f92bd-fe63-4989-85bc-4eaa822fe4ff req-1056ca1b-c266-48a9-a122-3d5d32153d76 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:50.088823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=74 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:50.092579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b33f92bd-fe63-4989-85bc-4eaa822fe4ff req-1056ca1b-c266-48a9-a122-3d5d32153d76 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:50.103259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-791e8ac5-4ed0-4fe4-9cfe-0937430199ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:50.104558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-791e8ac5-4ed0-4fe4-9cfe-0937430199ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:50.114967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-791e8ac5-4ed0-4fe4-9cfe-0937430199ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:50.118641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-791e8ac5-4ed0-4fe4-9cfe-0937430199ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:50.120624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-791e8ac5-4ed0-4fe4-9cfe-0937430199ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:50.123639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-791e8ac5-4ed0-4fe4-9cfe-0937430199ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:50.130054 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b33f92bd-fe63-4989-85bc-4eaa822fe4ff req-1056ca1b-c266-48a9-a122-3d5d32153d76 service nova] Creating event network-vif-plugged:790a60f6-25f6-497c-88dc-c28896334bc6 for instance 3433475a-6253-474c-9bdc-734b385ae282 on n-h2-852084-10 Sep 08 13:01:50.143300 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b33f92bd-fe63-4989-85bc-4eaa822fe4ff req-1056ca1b-c266-48a9-a122-3d5d32153d76 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123341 Sep 08 13:01:50.152419 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1841/3807] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:50.165170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb3a0373a0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:50.219998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:50.226803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:50.228304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:50.230321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:50.247107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:50.248796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:50.249893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:50.251449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:50.252499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:50.253451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:50.314684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:50.315956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:50.316919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:50.340644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:50.341785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:50.342744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:50.422726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:50.456348 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3e299915-eb6e-466d-9d47-4201c61cd19e tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-410471501" status: 201 len: 0 microversion: 2.26 time: 0.301669 Sep 08 13:01:50.465030 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1842/3808] 10.222.0.78 () {62 vars in 1377 bytes} [Thu Sep 8 13:01:50 2022] PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags/tempest-tag-410471501 => generated 0 bytes in 304 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Sep 08 13:01:50.467014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-df1ce0ec-4c21-4609-ab58-04ea30df68db tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:50.471749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-df1ce0ec-4c21-4609-ab58-04ea30df68db tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:50.494065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df1ce0ec-4c21-4609-ab58-04ea30df68db tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:50.494751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df1ce0ec-4c21-4609-ab58-04ea30df68db tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:50.495056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df1ce0ec-4c21-4609-ab58-04ea30df68db tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:50.498448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df1ce0ec-4c21-4609-ab58-04ea30df68db tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:50.498723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df1ce0ec-4c21-4609-ab58-04ea30df68db tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:50.499173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-df1ce0ec-4c21-4609-ab58-04ea30df68db tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:50.613272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-df1ce0ec-4c21-4609-ab58-04ea30df68db tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:01:50.835802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-791e8ac5-4ed0-4fe4-9cfe-0937430199ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:50.851505 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-791e8ac5-4ed0-4fe4-9cfe-0937430199ea tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1680 microversion: 2.1 time: 0.833869 Sep 08 13:01:50.857564 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1967/3809] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:50 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1680 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:50.881229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e8e7b922-717a-4599-b4d3-97aa69da5886 req-58bf8f0f-13a9-4510-90f5-caac7869c245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "tag": "400054e7-5c99-4a0d-a1c6-9d75e7b50cfa"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:50.893405 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-df1ce0ec-4c21-4609-ab58-04ea30df68db tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 204 len: 0 microversion: 2.1 time: 0.432471 Sep 08 13:01:50.915739 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1843/3810] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:01:50 2022] DELETE /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:01:50.941293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e8e7b922-717a-4599-b4d3-97aa69da5886 req-58bf8f0f-13a9-4510-90f5-caac7869c245 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:50.945582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e8e7b922-717a-4599-b4d3-97aa69da5886 req-58bf8f0f-13a9-4510-90f5-caac7869c245 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:50.946085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e8e7b922-717a-4599-b4d3-97aa69da5886 req-58bf8f0f-13a9-4510-90f5-caac7869c245 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:50.946344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fe9ea521-53d7-4872-b770-1fb4826b70ea tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:50.953256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fe9ea521-53d7-4872-b770-1fb4826b70ea tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:50.970639 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e8e7b922-717a-4599-b4d3-97aa69da5886 req-58bf8f0f-13a9-4510-90f5-caac7869c245 service nova] Creating event network-changed:400054e7-5c99-4a0d-a1c6-9d75e7b50cfa for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:01:50.988906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe9ea521-53d7-4872-b770-1fb4826b70ea tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:50.989879 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e8e7b922-717a-4599-b4d3-97aa69da5886 req-58bf8f0f-13a9-4510-90f5-caac7869c245 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129893 Sep 08 13:01:50.997231 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1968/3811] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:51.009493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8de81fc0-0f9f-454f-9b0c-bc0b58d82923 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:51.012034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe9ea521-53d7-4872-b770-1fb4826b70ea tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:51.013088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe9ea521-53d7-4872-b770-1fb4826b70ea tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:51.014665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe9ea521-53d7-4872-b770-1fb4826b70ea tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:51.015341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8de81fc0-0f9f-454f-9b0c-bc0b58d82923 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:51.015786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe9ea521-53d7-4872-b770-1fb4826b70ea tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:51.016958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe9ea521-53d7-4872-b770-1fb4826b70ea tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:51.028786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8de81fc0-0f9f-454f-9b0c-bc0b58d82923 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:51.030227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8de81fc0-0f9f-454f-9b0c-bc0b58d82923 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:51.030923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8de81fc0-0f9f-454f-9b0c-bc0b58d82923 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:51.031949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8de81fc0-0f9f-454f-9b0c-bc0b58d82923 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:51.032609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8de81fc0-0f9f-454f-9b0c-bc0b58d82923 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:51.033227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8de81fc0-0f9f-454f-9b0c-bc0b58d82923 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:51.230476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8de81fc0-0f9f-454f-9b0c-bc0b58d82923 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f434bb7b512646df85ba9aeaecc3762e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '927079ee4f8f49dfbb3809a990902f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:51.261158 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8de81fc0-0f9f-454f-9b0c-bc0b58d82923 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 200 len: 1295 microversion: 2.1 time: 0.256071 Sep 08 13:01:51.263389 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1969/3812] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:50 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 1295 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:51.272721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Action: 'update_all', calling method: .version_select at 0x7fdb35be81f0>, body: {"tags": ["tempest-tag-1288709106", "tempest-tag-1009447823"]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:51.292479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:51.293970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:51.295298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:51.296518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:51.320884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:51.323523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:51.324734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:51.329447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:51.330952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:51.334748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:51.434447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:51.437994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:51.440216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:51.540560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:51.599534 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-def14abd-8215-43bb-9cbe-a21042f561cd tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags" status: 200 len: 62 microversion: 2.26 time: 0.333270 Sep 08 13:01:51.602305 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1970/3813] 10.222.0.78 () {62 vars in 1312 bytes} [Thu Sep 8 13:01:51 2022] PUT /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags => generated 62 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:51.614204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f92efba5-2178-4823-9ed6-ee2d47f45c61 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:51.622164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f92efba5-2178-4823-9ed6-ee2d47f45c61 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:51.640361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f92efba5-2178-4823-9ed6-ee2d47f45c61 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:51.643625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f92efba5-2178-4823-9ed6-ee2d47f45c61 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:51.646100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f92efba5-2178-4823-9ed6-ee2d47f45c61 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:51.647754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f92efba5-2178-4823-9ed6-ee2d47f45c61 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:51.648832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f92efba5-2178-4823-9ed6-ee2d47f45c61 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:51.650000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f92efba5-2178-4823-9ed6-ee2d47f45c61 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:52.058698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fe9ea521-53d7-4872-b770-1fb4826b70ea tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:52.085099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fe9ea521-53d7-4872-b770-1fb4826b70ea tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:52.091184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fe9ea521-53d7-4872-b770-1fb4826b70ea tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:52.093924 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fe9ea521-53d7-4872-b770-1fb4826b70ea tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.172223 Sep 08 13:01:52.095904 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1844/3814] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:50 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:52.120400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-73e484cb-65e6-437f-94ff-2b00dd1bf8db tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:52.122865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-73e484cb-65e6-437f-94ff-2b00dd1bf8db tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:52.137005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f92efba5-2178-4823-9ed6-ee2d47f45c61 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:52.141220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73e484cb-65e6-437f-94ff-2b00dd1bf8db tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:52.141730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73e484cb-65e6-437f-94ff-2b00dd1bf8db tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:52.142176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73e484cb-65e6-437f-94ff-2b00dd1bf8db tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:52.143010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73e484cb-65e6-437f-94ff-2b00dd1bf8db tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:52.143381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73e484cb-65e6-437f-94ff-2b00dd1bf8db tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:52.143819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73e484cb-65e6-437f-94ff-2b00dd1bf8db tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:52.156610 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f92efba5-2178-4823-9ed6-ee2d47f45c61 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 200 len: 1497 microversion: 2.1 time: 0.550438 Sep 08 13:01:52.161916 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1971/3815] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:51 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 1497 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:52.177163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cedc4603-37e2-4106-b1ef-ee77db82e508 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb36ec2c10>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:52.219066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cedc4603-37e2-4106-b1ef-ee77db82e508 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:52.222637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cedc4603-37e2-4106-b1ef-ee77db82e508 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:52.223526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cedc4603-37e2-4106-b1ef-ee77db82e508 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:52.266064 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cedc4603-37e2-4106-b1ef-ee77db82e508 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags" status: 200 len: 62 microversion: 2.26 time: 0.098233 Sep 08 13:01:52.267848 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1972/3816] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Sep 8 13:01:52 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags => generated 62 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:52.290455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4892399b-2dcd-44c5-8556-4dd49b4bd2e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:52.294327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4892399b-2dcd-44c5-8556-4dd49b4bd2e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:52.320568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4892399b-2dcd-44c5-8556-4dd49b4bd2e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:52.321634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4892399b-2dcd-44c5-8556-4dd49b4bd2e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:52.324068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4892399b-2dcd-44c5-8556-4dd49b4bd2e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:52.328414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4892399b-2dcd-44c5-8556-4dd49b4bd2e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:52.329385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4892399b-2dcd-44c5-8556-4dd49b4bd2e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:52.334009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4892399b-2dcd-44c5-8556-4dd49b4bd2e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:53.145180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-73e484cb-65e6-437f-94ff-2b00dd1bf8db tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:53.159826 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-73e484cb-65e6-437f-94ff-2b00dd1bf8db tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1309 microversion: 2.1 time: 1.060279 Sep 08 13:01:53.161405 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1845/3817] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:52 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1309 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:53.168032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f5b69c37-0131-4678-bd61-8405cfbef5e9 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:53.169690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f5b69c37-0131-4678-bd61-8405cfbef5e9 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:53.195621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5b69c37-0131-4678-bd61-8405cfbef5e9 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:53.198718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5b69c37-0131-4678-bd61-8405cfbef5e9 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:53.199572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5b69c37-0131-4678-bd61-8405cfbef5e9 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:53.200833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5b69c37-0131-4678-bd61-8405cfbef5e9 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:53.201719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5b69c37-0131-4678-bd61-8405cfbef5e9 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:53.202482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5b69c37-0131-4678-bd61-8405cfbef5e9 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:53.246016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4892399b-2dcd-44c5-8556-4dd49b4bd2e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:53.270662 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4892399b-2dcd-44c5-8556-4dd49b4bd2e8 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1680 microversion: 2.1 time: 1.001212 Sep 08 13:01:53.283830 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1973/3818] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:52 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1680 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:53.287950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '.version_select at 0x7fdb36b4e4c0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:53.304345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:53.305503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:53.306283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:53.307179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:53.320473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:53.322845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:53.323705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:53.325146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:53.326059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:53.327061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:53.375796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:53.376863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:53.377486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:53.420990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'flavor' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:01:53.446430 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f155eed-ae53-493e-b46b-784dd88b9f09 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags" status: 204 len: 0 microversion: 2.26 time: 0.168264 Sep 08 13:01:53.448397 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1974/3819] 10.222.0.78 () {60 vars in 1295 bytes} [Thu Sep 8 13:01:53 2022] DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc/tags => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:01:53.455149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7e37cd06-9781-4868-8686-a22f80a8b4da req-0794b483-4388-41ec-933c-2f9a43833d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "tag": "d6b44d0c-7c17-4ee4-b680-3ecb83966756"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:53.469440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7e37cd06-9781-4868-8686-a22f80a8b4da req-0794b483-4388-41ec-933c-2f9a43833d94 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:53.470372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7e37cd06-9781-4868-8686-a22f80a8b4da req-0794b483-4388-41ec-933c-2f9a43833d94 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:53.471024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7e37cd06-9781-4868-8686-a22f80a8b4da req-0794b483-4388-41ec-933c-2f9a43833d94 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:53.491219 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7e37cd06-9781-4868-8686-a22f80a8b4da req-0794b483-4388-41ec-933c-2f9a43833d94 service nova] Creating event network-changed:d6b44d0c-7c17-4ee4-b680-3ecb83966756 for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:01:53.502328 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7e37cd06-9781-4868-8686-a22f80a8b4da req-0794b483-4388-41ec-933c-2f9a43833d94 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051724 Sep 08 13:01:53.504439 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1975/3820] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:53.516643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a82f60d0-2ad8-40e0-a7ee-068f10d9794c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:53.518050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a82f60d0-2ad8-40e0-a7ee-068f10d9794c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:53.530347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a82f60d0-2ad8-40e0-a7ee-068f10d9794c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:53.531312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a82f60d0-2ad8-40e0-a7ee-068f10d9794c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:53.532079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a82f60d0-2ad8-40e0-a7ee-068f10d9794c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:53.533374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a82f60d0-2ad8-40e0-a7ee-068f10d9794c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:53.534221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a82f60d0-2ad8-40e0-a7ee-068f10d9794c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:53.535014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a82f60d0-2ad8-40e0-a7ee-068f10d9794c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:54.251553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f5b69c37-0131-4678-bd61-8405cfbef5e9 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f434bb7b512646df85ba9aeaecc3762e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '927079ee4f8f49dfbb3809a990902f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:54.277451 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f5b69c37-0131-4678-bd61-8405cfbef5e9 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 200 len: 1325 microversion: 2.1 time: 1.113947 Sep 08 13:01:54.278539 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1846/3821] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:53 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 1325 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:54.295898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4ce40697-5330-4fba-976e-0f951feebbf5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:54.297570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ce40697-5330-4fba-976e-0f951feebbf5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:54.310758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ce40697-5330-4fba-976e-0f951feebbf5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:54.312034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ce40697-5330-4fba-976e-0f951feebbf5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:54.313157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ce40697-5330-4fba-976e-0f951feebbf5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:54.314803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ce40697-5330-4fba-976e-0f951feebbf5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:54.315742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ce40697-5330-4fba-976e-0f951feebbf5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:54.316543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ce40697-5330-4fba-976e-0f951feebbf5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:54.468785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a82f60d0-2ad8-40e0-a7ee-068f10d9794c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:54.492639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a82f60d0-2ad8-40e0-a7ee-068f10d9794c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:54.497584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a82f60d0-2ad8-40e0-a7ee-068f10d9794c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:54.501492 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a82f60d0-2ad8-40e0-a7ee-068f10d9794c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.994826 Sep 08 13:01:54.516320 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1976/3822] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:53 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:54.552461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a7124e7e-5b45-4055-8e48-1951a03a484b tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:54.554322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a7124e7e-5b45-4055-8e48-1951a03a484b tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:54.573145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a7124e7e-5b45-4055-8e48-1951a03a484b tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:54.577041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a7124e7e-5b45-4055-8e48-1951a03a484b tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:54.578229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a7124e7e-5b45-4055-8e48-1951a03a484b tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:54.579934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a7124e7e-5b45-4055-8e48-1951a03a484b tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:54.581337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a7124e7e-5b45-4055-8e48-1951a03a484b tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:54.582432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a7124e7e-5b45-4055-8e48-1951a03a484b tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:54.664083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a7124e7e-5b45-4055-8e48-1951a03a484b tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:01:54.866349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4ce40697-5330-4fba-976e-0f951feebbf5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9a995d2889c47738ad0b5255445c5f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea5d4df4f22d4af3a40af8a9ab306bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:54.881517 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4ce40697-5330-4fba-976e-0f951feebbf5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 200 len: 1497 microversion: 2.1 time: 0.596516 Sep 08 13:01:54.883558 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1847/3823] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:54 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 1497 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:54.893772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-874335e1-be9c-4ce0-9571-c7f31923e8ac req-d6cdb7f2-f2e5-4bf8-82dc-0957d70bd321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e316df8-77a2-4365-9e83-ce0ce8eb4aa0", "tag": "74a0642e-189b-4606-bf7e-42c94d73f877"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:54.933901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-874335e1-be9c-4ce0-9571-c7f31923e8ac req-d6cdb7f2-f2e5-4bf8-82dc-0957d70bd321 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:54.934150 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a7124e7e-5b45-4055-8e48-1951a03a484b tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc" status: 204 len: 0 microversion: 2.26 time: 0.403183 Sep 08 13:01:54.937645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-874335e1-be9c-4ce0-9571-c7f31923e8ac req-d6cdb7f2-f2e5-4bf8-82dc-0957d70bd321 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:54.938905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-874335e1-be9c-4ce0-9571-c7f31923e8ac req-d6cdb7f2-f2e5-4bf8-82dc-0957d70bd321 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:54.942696 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1977/3824] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:01:54 2022] DELETE /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:01:54.954165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c71a02cb-7d7f-4934-b66f-91675310018d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:54.956000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c71a02cb-7d7f-4934-b66f-91675310018d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:54.968768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c71a02cb-7d7f-4934-b66f-91675310018d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:54.969639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c71a02cb-7d7f-4934-b66f-91675310018d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:54.970391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c71a02cb-7d7f-4934-b66f-91675310018d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:54.972122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c71a02cb-7d7f-4934-b66f-91675310018d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:54.973019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c71a02cb-7d7f-4934-b66f-91675310018d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:54.973765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c71a02cb-7d7f-4934-b66f-91675310018d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:54.974164 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-874335e1-be9c-4ce0-9571-c7f31923e8ac req-d6cdb7f2-f2e5-4bf8-82dc-0957d70bd321 service nova] Creating event network-changed:74a0642e-189b-4606-bf7e-42c94d73f877 for instance 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 on n-h1-852084-10 Sep 08 13:01:54.986900 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-874335e1-be9c-4ce0-9571-c7f31923e8ac req-d6cdb7f2-f2e5-4bf8-82dc-0957d70bd321 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100114 Sep 08 13:01:54.988242 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1848/3825] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:54.996667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9c7a3519-f2ea-4eae-b141-bb4e171366d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:54.998228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9c7a3519-f2ea-4eae-b141-bb4e171366d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:55.012805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c7a3519-f2ea-4eae-b141-bb4e171366d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:55.013617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c7a3519-f2ea-4eae-b141-bb4e171366d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:55.014459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c7a3519-f2ea-4eae-b141-bb4e171366d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:55.015623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c7a3519-f2ea-4eae-b141-bb4e171366d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:55.016353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c7a3519-f2ea-4eae-b141-bb4e171366d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:55.017134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c7a3519-f2ea-4eae-b141-bb4e171366d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:55.608108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c71a02cb-7d7f-4934-b66f-91675310018d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:55.609067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9c7a3519-f2ea-4eae-b141-bb4e171366d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:55.622173 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c71a02cb-7d7f-4934-b66f-91675310018d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1491 microversion: 2.1 time: 0.677193 Sep 08 13:01:55.622734 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1978/3826] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:54 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1491 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:55.649659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-25f3e906-7710-4e3c-9ee8-35d99c164d4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:55.650289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-25f3e906-7710-4e3c-9ee8-35d99c164d4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:55.659279 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9c7a3519-f2ea-4eae-b141-bb4e171366d7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1680 microversion: 2.1 time: 0.668836 Sep 08 13:01:55.670598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25f3e906-7710-4e3c-9ee8-35d99c164d4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:55.671099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25f3e906-7710-4e3c-9ee8-35d99c164d4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:55.671576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25f3e906-7710-4e3c-9ee8-35d99c164d4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:55.672296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25f3e906-7710-4e3c-9ee8-35d99c164d4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:55.672770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25f3e906-7710-4e3c-9ee8-35d99c164d4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:55.673250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25f3e906-7710-4e3c-9ee8-35d99c164d4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:55.676654 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1849/3827] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:54 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1680 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:55.694610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9077ea82-7c8a-4599-9496-e311b7f19c11 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:55.696850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9077ea82-7c8a-4599-9496-e311b7f19c11 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:55.721420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9077ea82-7c8a-4599-9496-e311b7f19c11 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:55.722285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9077ea82-7c8a-4599-9496-e311b7f19c11 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:55.724726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9077ea82-7c8a-4599-9496-e311b7f19c11 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:55.726672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9077ea82-7c8a-4599-9496-e311b7f19c11 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:55.727961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9077ea82-7c8a-4599-9496-e311b7f19c11 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:55.730936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9077ea82-7c8a-4599-9496-e311b7f19c11 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:56.113963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-25f3e906-7710-4e3c-9ee8-35d99c164d4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:56.142770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-25f3e906-7710-4e3c-9ee8-35d99c164d4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:56.146053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-25f3e906-7710-4e3c-9ee8-35d99c164d4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:56.148848 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-25f3e906-7710-4e3c-9ee8-35d99c164d4a tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc" status: 200 len: 1552 microversion: 2.26 time: 0.503332 Sep 08 13:01:56.149945 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1979/3828] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:55 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc => generated 1552 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:56.165012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6032e547-14db-435e-b4e1-a16cde2006c1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:56.167117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6032e547-14db-435e-b4e1-a16cde2006c1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:56.181119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6032e547-14db-435e-b4e1-a16cde2006c1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:56.182342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6032e547-14db-435e-b4e1-a16cde2006c1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:56.183139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6032e547-14db-435e-b4e1-a16cde2006c1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:56.184486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6032e547-14db-435e-b4e1-a16cde2006c1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:56.185313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6032e547-14db-435e-b4e1-a16cde2006c1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:56.186433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6032e547-14db-435e-b4e1-a16cde2006c1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:56.404653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9077ea82-7c8a-4599-9496-e311b7f19c11 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f434bb7b512646df85ba9aeaecc3762e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '927079ee4f8f49dfbb3809a990902f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:56.437031 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9077ea82-7c8a-4599-9496-e311b7f19c11 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 200 len: 1325 microversion: 2.1 time: 0.746061 Sep 08 13:01:56.450419 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1850/3829] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:55 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 1325 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:56.461303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-6c02c69f-371c-449c-9e13-878840f809ce req-15ea45bd-8768-402a-be68-a0b96620f308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92200cbf-d743-4f7f-8ec7-69b062da1b7f", "name": "network-vif-deleted", "tag": "7264a794-1f88-4052-acd7-4e6ef91155f4"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:56.501187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6c02c69f-371c-449c-9e13-878840f809ce req-15ea45bd-8768-402a-be68-a0b96620f308 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:56.502295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6c02c69f-371c-449c-9e13-878840f809ce req-15ea45bd-8768-402a-be68-a0b96620f308 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:56.504455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6c02c69f-371c-449c-9e13-878840f809ce req-15ea45bd-8768-402a-be68-a0b96620f308 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:56.528227 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-6c02c69f-371c-449c-9e13-878840f809ce req-15ea45bd-8768-402a-be68-a0b96620f308 service nova] Creating event network-vif-deleted:7264a794-1f88-4052-acd7-4e6ef91155f4 for instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f on n-h2-852084-10 Sep 08 13:01:56.536892 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-6c02c69f-371c-449c-9e13-878840f809ce req-15ea45bd-8768-402a-be68-a0b96620f308 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083490 Sep 08 13:01:56.538957 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1851/3830] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:56.759194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6032e547-14db-435e-b4e1-a16cde2006c1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:56.788655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6032e547-14db-435e-b4e1-a16cde2006c1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:56.793466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6032e547-14db-435e-b4e1-a16cde2006c1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:56.796310 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6032e547-14db-435e-b4e1-a16cde2006c1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.638871 Sep 08 13:01:56.797872 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1980/3831] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:56 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:56.808826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3500fcb-5677-41eb-ba9d-210240451c1e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:56.810574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e3500fcb-5677-41eb-ba9d-210240451c1e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:56.825770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3500fcb-5677-41eb-ba9d-210240451c1e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:56.827435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3500fcb-5677-41eb-ba9d-210240451c1e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:56.829218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3500fcb-5677-41eb-ba9d-210240451c1e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:56.830801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3500fcb-5677-41eb-ba9d-210240451c1e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:56.831887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3500fcb-5677-41eb-ba9d-210240451c1e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:56.833039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3500fcb-5677-41eb-ba9d-210240451c1e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:56.867279 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e3500fcb-5677-41eb-ba9d-210240451c1e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3500fcb-5677-41eb-ba9d-210240451c1e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f HTTP/1.1 Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '92200cbf-d743-4f7f-8ec7-69b062da1b7f'} Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:01:56.871368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:56.878969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:56.878969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:01:56.878969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:01:56.878969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:01:56.878969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:01:56.878969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:56.878969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:56.883723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3500fcb-5677-41eb-ba9d-210240451c1e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:01:56.885668 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e3500fcb-5677-41eb-ba9d-210240451c1e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 404 len: 111 microversion: 2.1 time: 0.085232 Sep 08 13:01:56.886760 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1981/3832] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:56 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:01:56.898201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f415990b-a44b-4c57-a044-7235d5f02b70 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:56.899920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f415990b-a44b-4c57-a044-7235d5f02b70 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:56.914132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f415990b-a44b-4c57-a044-7235d5f02b70 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:56.915470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f415990b-a44b-4c57-a044-7235d5f02b70 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:56.917048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f415990b-a44b-4c57-a044-7235d5f02b70 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:56.918768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f415990b-a44b-4c57-a044-7235d5f02b70 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:56.919928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f415990b-a44b-4c57-a044-7235d5f02b70 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:56.920984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f415990b-a44b-4c57-a044-7235d5f02b70 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:56.986713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8fd3d725-2351-497a-aaf5-41f55af0d6cf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-832364659"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:56.990460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8fd3d725-2351-497a-aaf5-41f55af0d6cf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:56.998892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fd3d725-2351-497a-aaf5-41f55af0d6cf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:56.999506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fd3d725-2351-497a-aaf5-41f55af0d6cf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:57.000188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fd3d725-2351-497a-aaf5-41f55af0d6cf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:57.000974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fd3d725-2351-497a-aaf5-41f55af0d6cf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:57.001501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fd3d725-2351-497a-aaf5-41f55af0d6cf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:57.001996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fd3d725-2351-497a-aaf5-41f55af0d6cf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:57.144768 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8fd3d725-2351-497a-aaf5-41f55af0d6cf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "PUT /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1075 microversion: 2.1 time: 0.603361 Sep 08 13:01:57.146061 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1852/3833] 10.222.0.78 () {60 vars in 1256 bytes} [Thu Sep 8 13:01:56 2022] PUT /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1075 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:57.181687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ce24583c-75a2-4da3-aaf9-14f4d506c1a1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:57.183109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ce24583c-75a2-4da3-aaf9-14f4d506c1a1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:57.204207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce24583c-75a2-4da3-aaf9-14f4d506c1a1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:57.207512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce24583c-75a2-4da3-aaf9-14f4d506c1a1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:57.208807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce24583c-75a2-4da3-aaf9-14f4d506c1a1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:57.210437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce24583c-75a2-4da3-aaf9-14f4d506c1a1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:57.211623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce24583c-75a2-4da3-aaf9-14f4d506c1a1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:57.212588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce24583c-75a2-4da3-aaf9-14f4d506c1a1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:57.222174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:INSERT=3,nova_cell1:RELEASE=2,nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:57.248881 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-ce24583c-75a2-4da3-aaf9-14f4d506c1a1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ce24583c-75a2-4da3-aaf9-14f4d506c1a1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f HTTP/1.1 Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '92200cbf-d743-4f7f-8ec7-69b062da1b7f'} Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:01:57.252550 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:01:57.260127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:57.260127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:01:57.260127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:01:57.260127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:01:57.260127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:57.260127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:01:57.260127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:01:57.260127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:01:57.260127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:01:57.260127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:57.260127 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:01:57.260127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ce24583c-75a2-4da3-aaf9-14f4d506c1a1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:01:57.262707 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ce24583c-75a2-4da3-aaf9-14f4d506c1a1 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 404 len: 111 microversion: 2.1 time: 0.091218 Sep 08 13:01:57.265607 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1853/3834] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:01:57 2022] DELETE /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:01:57.284416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-56313b0b-0673-43dd-accc-59feaf78e80a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:57.285611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-56313b0b-0673-43dd-accc-59feaf78e80a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:57.302178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56313b0b-0673-43dd-accc-59feaf78e80a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:57.305197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56313b0b-0673-43dd-accc-59feaf78e80a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:57.306794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56313b0b-0673-43dd-accc-59feaf78e80a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:57.308788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56313b0b-0673-43dd-accc-59feaf78e80a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:57.311439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56313b0b-0673-43dd-accc-59feaf78e80a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:57.313624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56313b0b-0673-43dd-accc-59feaf78e80a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:57.801291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:57.918033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f415990b-a44b-4c57-a044-7235d5f02b70 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:57.923269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:DELETE=2,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:57.935276 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f415990b-a44b-4c57-a044-7235d5f02b70 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1680 microversion: 2.1 time: 1.046321 Sep 08 13:01:57.952029 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1982/3835] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:56 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1680 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:57.972857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3f2a1083-571d-43bd-8e52-6da8bc4a9a8d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:57.974165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3f2a1083-571d-43bd-8e52-6da8bc4a9a8d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:57.989956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2a1083-571d-43bd-8e52-6da8bc4a9a8d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:57.991263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2a1083-571d-43bd-8e52-6da8bc4a9a8d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:57.992047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2a1083-571d-43bd-8e52-6da8bc4a9a8d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:57.993452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2a1083-571d-43bd-8e52-6da8bc4a9a8d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:57.994279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2a1083-571d-43bd-8e52-6da8bc4a9a8d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:57.995332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2a1083-571d-43bd-8e52-6da8bc4a9a8d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:58.057336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-56313b0b-0673-43dd-accc-59feaf78e80a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:58.079628 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-56313b0b-0673-43dd-accc-59feaf78e80a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1501 microversion: 2.1 time: 0.811928 Sep 08 13:01:58.080526 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1854/3836] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:57 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1501 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:58.085859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9542b285-3135-4d46-8a11-bdc66a2e17cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:58.086754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9542b285-3135-4d46-8a11-bdc66a2e17cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 92200cbf-d743-4f7f-8ec7-69b062da1b7f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:58.095124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9542b285-3135-4d46-8a11-bdc66a2e17cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:58.095994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9542b285-3135-4d46-8a11-bdc66a2e17cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:58.096598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9542b285-3135-4d46-8a11-bdc66a2e17cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:58.097651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9542b285-3135-4d46-8a11-bdc66a2e17cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:58.098640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9542b285-3135-4d46-8a11-bdc66a2e17cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:58.099271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9542b285-3135-4d46-8a11-bdc66a2e17cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:58.118673 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-9542b285-3135-4d46-8a11-bdc66a2e17cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9542b285-3135-4d46-8a11-bdc66a2e17cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f HTTP/1.1 Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '92200cbf-d743-4f7f-8ec7-69b062da1b7f'} Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:01:58.120804 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:01:58.124715 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:58.124715 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:01:58.124715 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:01:58.124715 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:01:58.124715 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:01:58.124715 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. Sep 08 13:01:58.124715 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:01:58.126853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9542b285-3135-4d46-8a11-bdc66a2e17cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 92200cbf-d743-4f7f-8ec7-69b062da1b7f could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:01:58.128125 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9542b285-3135-4d46-8a11-bdc66a2e17cf tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f" status: 404 len: 111 microversion: 2.1 time: 0.046367 Sep 08 13:01:58.129028 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1855/3837] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:58 2022] GET /compute/v2.1/servers/92200cbf-d743-4f7f-8ec7-69b062da1b7f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:01:58.138410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-493806aa-1339-4b56-8f2d-e7c29f482435 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:58.139969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-493806aa-1339-4b56-8f2d-e7c29f482435 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:58.153142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-493806aa-1339-4b56-8f2d-e7c29f482435 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:58.153995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-493806aa-1339-4b56-8f2d-e7c29f482435 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:58.154703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-493806aa-1339-4b56-8f2d-e7c29f482435 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:58.155693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-493806aa-1339-4b56-8f2d-e7c29f482435 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:58.165173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-493806aa-1339-4b56-8f2d-e7c29f482435 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:58.165957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-493806aa-1339-4b56-8f2d-e7c29f482435 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:58.472518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3f2a1083-571d-43bd-8e52-6da8bc4a9a8d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:58.482848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3f2a1083-571d-43bd-8e52-6da8bc4a9a8d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:58.494521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3f2a1083-571d-43bd-8e52-6da8bc4a9a8d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:58.495923 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3f2a1083-571d-43bd-8e52-6da8bc4a9a8d tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc" status: 200 len: 1552 microversion: 2.26 time: 0.542076 Sep 08 13:01:58.496514 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1983/3838] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:57 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc => generated 1552 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:58.520245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b6275d5a-91ce-4450-91bf-0dce1e2c109d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:58.521523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b6275d5a-91ce-4450-91bf-0dce1e2c109d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:58.529171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6275d5a-91ce-4450-91bf-0dce1e2c109d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:58.530080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6275d5a-91ce-4450-91bf-0dce1e2c109d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:58.530751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6275d5a-91ce-4450-91bf-0dce1e2c109d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:58.531799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6275d5a-91ce-4450-91bf-0dce1e2c109d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:58.532507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6275d5a-91ce-4450-91bf-0dce1e2c109d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:58.533152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6275d5a-91ce-4450-91bf-0dce1e2c109d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:58.972334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-493806aa-1339-4b56-8f2d-e7c29f482435 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f434bb7b512646df85ba9aeaecc3762e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '927079ee4f8f49dfbb3809a990902f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:59.004946 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-493806aa-1339-4b56-8f2d-e7c29f482435 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 200 len: 1325 microversion: 2.1 time: 0.869965 Sep 08 13:01:59.006374 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1856/3839] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:58 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 1325 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:59.025583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3c0c03f5-019c-4d4e-b24d-266c59a9b608 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:59.027788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3c0c03f5-019c-4d4e-b24d-266c59a9b608 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:59.057716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c0c03f5-019c-4d4e-b24d-266c59a9b608 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:59.063449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c0c03f5-019c-4d4e-b24d-266c59a9b608 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:59.067461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c0c03f5-019c-4d4e-b24d-266c59a9b608 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:59.069233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c0c03f5-019c-4d4e-b24d-266c59a9b608 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:59.091932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c0c03f5-019c-4d4e-b24d-266c59a9b608 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:59.092660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c0c03f5-019c-4d4e-b24d-266c59a9b608 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:59.413715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:01:59.443971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b6275d5a-91ce-4450-91bf-0dce1e2c109d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:59.505557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b6275d5a-91ce-4450-91bf-0dce1e2c109d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:59.509409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b6275d5a-91ce-4450-91bf-0dce1e2c109d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:59.512255 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b6275d5a-91ce-4450-91bf-0dce1e2c109d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.998438 Sep 08 13:01:59.528382 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1984/3840] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:58 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:01:59.545206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6db8470c-5698-40c3-befa-84e2f69b5b62 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:59.546129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6db8470c-5698-40c3-befa-84e2f69b5b62 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:59.564875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6db8470c-5698-40c3-befa-84e2f69b5b62 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:59.568981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6db8470c-5698-40c3-befa-84e2f69b5b62 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:59.569766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6db8470c-5698-40c3-befa-84e2f69b5b62 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:59.571099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6db8470c-5698-40c3-befa-84e2f69b5b62 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:59.572471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6db8470c-5698-40c3-befa-84e2f69b5b62 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:59.572984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6db8470c-5698-40c3-befa-84e2f69b5b62 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:59.594672 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6db8470c-5698-40c3-befa-84e2f69b5b62 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6db8470c-5698-40c3-befa-84e2f69b5b62 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 HTTP/1.1 Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '26138bc0-1c3e-4a40-9945-448c5db3a424'} Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:01:59.596730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6db8470c-5698-40c3-befa-84e2f69b5b62 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6db8470c-5698-40c3-befa-84e2f69b5b62 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 404 len: 111 microversion: 2.1 time: 0.069142 Sep 08 13:01:59.607602 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1985/3841] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:01:59 2022] DELETE /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:01:59.612958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-84b9283b-dddf-4f87-a1bc-95be3eb999f3 req-20e2f378-97eb-424b-9bde-c35119ff2f0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "tag": "8a64c4ec-96a3-4c30-bb50-fded084669fd"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:59.623625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-84b9283b-dddf-4f87-a1bc-95be3eb999f3 req-20e2f378-97eb-424b-9bde-c35119ff2f0a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:59.624270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-84b9283b-dddf-4f87-a1bc-95be3eb999f3 req-20e2f378-97eb-424b-9bde-c35119ff2f0a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:59.625612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-84b9283b-dddf-4f87-a1bc-95be3eb999f3 req-20e2f378-97eb-424b-9bde-c35119ff2f0a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:59.650259 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-84b9283b-dddf-4f87-a1bc-95be3eb999f3 req-20e2f378-97eb-424b-9bde-c35119ff2f0a service nova] Creating event network-changed:8a64c4ec-96a3-4c30-bb50-fded084669fd for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:01:59.680250 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-84b9283b-dddf-4f87-a1bc-95be3eb999f3 req-20e2f378-97eb-424b-9bde-c35119ff2f0a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056381 Sep 08 13:01:59.684619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3c0c03f5-019c-4d4e-b24d-266c59a9b608 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:01:59.704564 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3c0c03f5-019c-4d4e-b24d-266c59a9b608 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1501 microversion: 2.1 time: 0.696283 Sep 08 13:01:59.705929 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1857/3842] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:59 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1501 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:01:59.711052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-47b4e313-000b-4dba-a567-d6ce796fab9f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:59.712302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-47b4e313-000b-4dba-a567-d6ce796fab9f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:59.728077 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1986/3843] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:59.730569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47b4e313-000b-4dba-a567-d6ce796fab9f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:59.731427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47b4e313-000b-4dba-a567-d6ce796fab9f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:59.732159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47b4e313-000b-4dba-a567-d6ce796fab9f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:59.733155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47b4e313-000b-4dba-a567-d6ce796fab9f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:59.733862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47b4e313-000b-4dba-a567-d6ce796fab9f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:59.736640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47b4e313-000b-4dba-a567-d6ce796fab9f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:59.748881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d42d7560-7988-4c9d-841c-37aae09d1691 req-9a83f5f0-ee6a-4ec4-932e-6f1120ffde27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b55b70b2-cc64-458a-976c-c8f901eb30cc", "name": "network-vif-deleted", "tag": "9e9f9bc7-0c81-42d8-957c-cea9ca39c459"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:01:59.776946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d42d7560-7988-4c9d-841c-37aae09d1691 req-9a83f5f0-ee6a-4ec4-932e-6f1120ffde27 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:59.777458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d42d7560-7988-4c9d-841c-37aae09d1691 req-9a83f5f0-ee6a-4ec4-932e-6f1120ffde27 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:59.780793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d42d7560-7988-4c9d-841c-37aae09d1691 req-9a83f5f0-ee6a-4ec4-932e-6f1120ffde27 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:59.812073 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d42d7560-7988-4c9d-841c-37aae09d1691 req-9a83f5f0-ee6a-4ec4-932e-6f1120ffde27 service nova] Creating event network-vif-deleted:9e9f9bc7-0c81-42d8-957c-cea9ca39c459 for instance b55b70b2-cc64-458a-976c-c8f901eb30cc on n-h1-852084-10 Sep 08 13:01:59.827929 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d42d7560-7988-4c9d-841c-37aae09d1691 req-9a83f5f0-ee6a-4ec4-932e-6f1120ffde27 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096788 Sep 08 13:01:59.829525 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1987/3844] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:01:59.845842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:01:59.848381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:01:59.863547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:59.864804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:59.865876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:59.868285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:59.869516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:59.870550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:59.954019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:01:59.955359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:01:59.956260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:01:59.957115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lazy-loading 'fault' on Instance uuid b55b70b2-cc64-458a-976c-c8f901eb30cc {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:02:00.221568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:00.246041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:00.249898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33aab271f5894598b1d4c1748482c324', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3948abe98684425b94b9295399dc48d8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:00.252225 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f496abc1-04d6-49e8-839a-bbe6eba92b28 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc" status: 200 len: 1352 microversion: 2.26 time: 0.418796 Sep 08 13:02:00.253011 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1988/3845] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:01:59 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc => generated 1352 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:00.273231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4d012d6-6ef9-4e0d-8f4c-dd0affe0e6a9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:00.274803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a4d012d6-6ef9-4e0d-8f4c-dd0affe0e6a9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 26138bc0-1c3e-4a40-9945-448c5db3a424] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:00.291443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4d012d6-6ef9-4e0d-8f4c-dd0affe0e6a9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:00.293407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4d012d6-6ef9-4e0d-8f4c-dd0affe0e6a9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:00.294447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4d012d6-6ef9-4e0d-8f4c-dd0affe0e6a9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:00.295668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4d012d6-6ef9-4e0d-8f4c-dd0affe0e6a9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:00.296704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4d012d6-6ef9-4e0d-8f4c-dd0affe0e6a9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:00.297728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4d012d6-6ef9-4e0d-8f4c-dd0affe0e6a9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:00.330670 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-a4d012d6-6ef9-4e0d-8f4c-dd0affe0e6a9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4d012d6-6ef9-4e0d-8f4c-dd0affe0e6a9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 HTTP/1.1 Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '26138bc0-1c3e-4a40-9945-448c5db3a424'} Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:00.343746 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:00.351631 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:00.351631 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:00.351631 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:00.351631 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:00.351631 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:00.351631 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. Sep 08 13:02:00.351631 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:00.353953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4d012d6-6ef9-4e0d-8f4c-dd0affe0e6a9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 26138bc0-1c3e-4a40-9945-448c5db3a424 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:00.355953 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a4d012d6-6ef9-4e0d-8f4c-dd0affe0e6a9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424" status: 404 len: 111 microversion: 2.1 time: 0.096901 Sep 08 13:02:00.357702 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1989/3846] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:00 2022] GET /compute/v2.1/servers/26138bc0-1c3e-4a40-9945-448c5db3a424 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:00.371665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da986933-d56d-4ae6-b436-cf7f09cfafaf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:00.383103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da986933-d56d-4ae6-b436-cf7f09cfafaf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:00.384118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da986933-d56d-4ae6-b436-cf7f09cfafaf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:00.385377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da986933-d56d-4ae6-b436-cf7f09cfafaf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:00.454260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-da986933-d56d-4ae6-b436-cf7f09cfafaf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Going to try to stop instance {{(pid=128970) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 13:02:00.586997 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-da986933-d56d-4ae6-b436-cf7f09cfafaf tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "POST /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282/action" status: 202 len: 0 microversion: 2.1 time: 0.226678 Sep 08 13:02:00.593422 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1990/3847] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:02:00 2022] POST /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:02:00.617934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f0e378d0-53cd-4c10-9b60-c3c72c956d76 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:00.620026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f0e378d0-53cd-4c10-9b60-c3c72c956d76 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:00.645407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0e378d0-53cd-4c10-9b60-c3c72c956d76 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:00.653996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0e378d0-53cd-4c10-9b60-c3c72c956d76 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:00.654960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0e378d0-53cd-4c10-9b60-c3c72c956d76 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:00.659323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0e378d0-53cd-4c10-9b60-c3c72c956d76 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:00.660359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0e378d0-53cd-4c10-9b60-c3c72c956d76 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:00.661140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0e378d0-53cd-4c10-9b60-c3c72c956d76 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:00.751892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-47b4e313-000b-4dba-a567-d6ce796fab9f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:00.788063 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-47b4e313-000b-4dba-a567-d6ce796fab9f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1657 microversion: 2.1 time: 1.080115 Sep 08 13:02:00.789927 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1858/3848] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:01:59 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1657 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:00.804086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-daef20ca-fcc3-4c4e-9624-dced8ad79ae7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:00.805458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-daef20ca-fcc3-4c4e-9624-dced8ad79ae7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:00.827307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-daef20ca-fcc3-4c4e-9624-dced8ad79ae7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:00.828653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-daef20ca-fcc3-4c4e-9624-dced8ad79ae7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:00.830425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-daef20ca-fcc3-4c4e-9624-dced8ad79ae7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:00.838625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-daef20ca-fcc3-4c4e-9624-dced8ad79ae7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:00.840524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-daef20ca-fcc3-4c4e-9624-dced8ad79ae7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:00.841755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-daef20ca-fcc3-4c4e-9624-dced8ad79ae7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:00.894180 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-daef20ca-fcc3-4c4e-9624-dced8ad79ae7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-daef20ca-fcc3-4c4e-9624-dced8ad79ae7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd HTTP/1.1 Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'bd61063e-36fc-477d-8522-b95318528acd'} Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:00.898177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-daef20ca-fcc3-4c4e-9624-dced8ad79ae7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-daef20ca-fcc3-4c4e-9624-dced8ad79ae7 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 404 len: 111 microversion: 2.1 time: 0.112391 Sep 08 13:02:00.908589 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1859/3849] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:00 2022] DELETE /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:00.919399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-80326349-e9ea-4c36-aaff-4bfb5b126e5c req-2cfaf816-d1fa-4092-b8b4-2c4f48c9991a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e316df8-77a2-4365-9e83-ce0ce8eb4aa0", "name": "network-vif-plugged", "status": "completed", "tag": "74a0642e-189b-4606-bf7e-42c94d73f877"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:00.939575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-80326349-e9ea-4c36-aaff-4bfb5b126e5c req-2cfaf816-d1fa-4092-b8b4-2c4f48c9991a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:00.940696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-80326349-e9ea-4c36-aaff-4bfb5b126e5c req-2cfaf816-d1fa-4092-b8b4-2c4f48c9991a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:00.942163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-80326349-e9ea-4c36-aaff-4bfb5b126e5c req-2cfaf816-d1fa-4092-b8b4-2c4f48c9991a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:00.969244 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-80326349-e9ea-4c36-aaff-4bfb5b126e5c req-2cfaf816-d1fa-4092-b8b4-2c4f48c9991a service nova] Creating event network-vif-plugged:74a0642e-189b-4606-bf7e-42c94d73f877 for instance 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 on n-h1-852084-10 Sep 08 13:02:00.980242 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-80326349-e9ea-4c36-aaff-4bfb5b126e5c req-2cfaf816-d1fa-4092-b8b4-2c4f48c9991a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067971 Sep 08 13:02:00.988629 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1860/3850] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:01.000288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f7239f68-2666-449b-b42f-1fe384bcbc02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:01.004194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f7239f68-2666-449b-b42f-1fe384bcbc02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:01.020690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7239f68-2666-449b-b42f-1fe384bcbc02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:01.022795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7239f68-2666-449b-b42f-1fe384bcbc02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:01.026010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7239f68-2666-449b-b42f-1fe384bcbc02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:01.027962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7239f68-2666-449b-b42f-1fe384bcbc02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:01.029252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7239f68-2666-449b-b42f-1fe384bcbc02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:01.030085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7239f68-2666-449b-b42f-1fe384bcbc02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:01.622890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f0e378d0-53cd-4c10-9b60-c3c72c956d76 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f434bb7b512646df85ba9aeaecc3762e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '927079ee4f8f49dfbb3809a990902f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:01.660456 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f0e378d0-53cd-4c10-9b60-c3c72c956d76 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 200 len: 1325 microversion: 2.1 time: 1.060860 Sep 08 13:02:01.665731 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1991/3851] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:00 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 1325 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:01.688635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5b8d875d-ecda-42a7-8643-497799db1727 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:01.689338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5b8d875d-ecda-42a7-8643-497799db1727 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:01.707268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b8d875d-ecda-42a7-8643-497799db1727 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:01.707268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b8d875d-ecda-42a7-8643-497799db1727 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:01.707268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b8d875d-ecda-42a7-8643-497799db1727 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:01.707885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b8d875d-ecda-42a7-8643-497799db1727 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:01.708111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b8d875d-ecda-42a7-8643-497799db1727 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:01.709331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b8d875d-ecda-42a7-8643-497799db1727 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:01.793627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f7239f68-2666-449b-b42f-1fe384bcbc02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:01.846044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f7239f68-2666-449b-b42f-1fe384bcbc02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:01.848341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f7239f68-2666-449b-b42f-1fe384bcbc02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:01.849891 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f7239f68-2666-449b-b42f-1fe384bcbc02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.858579 Sep 08 13:02:01.852421 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1861/3852] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:00 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:01.863030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db6c85bc-4ecd-4192-bdcf-b5e50223c71b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:01.884207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db6c85bc-4ecd-4192-bdcf-b5e50223c71b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:01.885718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db6c85bc-4ecd-4192-bdcf-b5e50223c71b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:01.886400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db6c85bc-4ecd-4192-bdcf-b5e50223c71b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:02.449914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5b8d875d-ecda-42a7-8643-497799db1727 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:02.481915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-db6c85bc-4ecd-4192-bdcf-b5e50223c71b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Going to try to start instance {{(pid=128971) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 13:02:02.492741 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5b8d875d-ecda-42a7-8643-497799db1727 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1511 microversion: 2.1 time: 0.811823 Sep 08 13:02:02.506465 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1992/3853] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:01 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1511 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:02.522830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1d7941bc-bba3-4aa3-bfbe-f17c57ce686a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:02.537147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1d7941bc-bba3-4aa3-bfbe-f17c57ce686a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: bd61063e-36fc-477d-8522-b95318528acd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:02.568307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d7941bc-bba3-4aa3-bfbe-f17c57ce686a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:02.569970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d7941bc-bba3-4aa3-bfbe-f17c57ce686a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:02.571134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d7941bc-bba3-4aa3-bfbe-f17c57ce686a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:02.576708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d7941bc-bba3-4aa3-bfbe-f17c57ce686a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:02.578463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d7941bc-bba3-4aa3-bfbe-f17c57ce686a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:02.581063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d7941bc-bba3-4aa3-bfbe-f17c57ce686a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:02.631613 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-db6c85bc-4ecd-4192-bdcf-b5e50223c71b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.773226 Sep 08 13:02:02.634074 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-1d7941bc-bba3-4aa3-bfbe-f17c57ce686a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:02:02.639263 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1862/3854] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:02:01 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1d7941bc-bba3-4aa3-bfbe-f17c57ce686a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd HTTP/1.1 Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'bd61063e-36fc-477d-8522-b95318528acd'} Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:02.640845 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.649077 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:02.649077 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:02.649077 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:02.649077 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:02.649077 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:02.649077 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. Sep 08 13:02:02.649077 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.649077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1d7941bc-bba3-4aa3-bfbe-f17c57ce686a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance bd61063e-36fc-477d-8522-b95318528acd could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:02.649077 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1d7941bc-bba3-4aa3-bfbe-f17c57ce686a tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd" status: 404 len: 111 microversion: 2.1 time: 0.134250 Sep 08 13:02:02.649077 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1993/3855] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:02 2022] GET /compute/v2.1/servers/bd61063e-36fc-477d-8522-b95318528acd => generated 111 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:02.651671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2e7b26fc-8ccd-4329-8a78-ead6d556a7a8 req-e0ce29e7-dc60-43d5-bb26-3e195073b750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "tag": "b39d12c4-c98a-488f-9b41-a3704a8cd72f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:02.664076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0474e94f-b230-47ea-8b91-0a5df0c8ccc5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:02.665551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0474e94f-b230-47ea-8b91-0a5df0c8ccc5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] [instance: b55b70b2-cc64-458a-976c-c8f901eb30cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:02.667451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2e7b26fc-8ccd-4329-8a78-ead6d556a7a8 req-e0ce29e7-dc60-43d5-bb26-3e195073b750 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:02.668008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2e7b26fc-8ccd-4329-8a78-ead6d556a7a8 req-e0ce29e7-dc60-43d5-bb26-3e195073b750 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:02.668463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2e7b26fc-8ccd-4329-8a78-ead6d556a7a8 req-e0ce29e7-dc60-43d5-bb26-3e195073b750 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:02.686717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0474e94f-b230-47ea-8b91-0a5df0c8ccc5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:02.692032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0474e94f-b230-47ea-8b91-0a5df0c8ccc5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:02.693205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0474e94f-b230-47ea-8b91-0a5df0c8ccc5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:02.697226 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2e7b26fc-8ccd-4329-8a78-ead6d556a7a8 req-e0ce29e7-dc60-43d5-bb26-3e195073b750 service nova] Creating event network-changed:b39d12c4-c98a-488f-9b41-a3704a8cd72f for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:02:02.697960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0474e94f-b230-47ea-8b91-0a5df0c8ccc5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:02.698217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0474e94f-b230-47ea-8b91-0a5df0c8ccc5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:02.703672 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2e7b26fc-8ccd-4329-8a78-ead6d556a7a8 req-e0ce29e7-dc60-43d5-bb26-3e195073b750 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058186 Sep 08 13:02:02.704762 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1994/3856] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:02.710645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0474e94f-b230-47ea-8b91-0a5df0c8ccc5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:02.714674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9f7bb435-73cf-4fea-a8bc-2c57cf810690 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:02.717342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9f7bb435-73cf-4fea-a8bc-2c57cf810690 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:02.732790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f7bb435-73cf-4fea-a8bc-2c57cf810690 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:02.733016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f7bb435-73cf-4fea-a8bc-2c57cf810690 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:02.733968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f7bb435-73cf-4fea-a8bc-2c57cf810690 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:02.734625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f7bb435-73cf-4fea-a8bc-2c57cf810690 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:02.735187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f7bb435-73cf-4fea-a8bc-2c57cf810690 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:02.735670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f7bb435-73cf-4fea-a8bc-2c57cf810690 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:02.782990 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-0474e94f-b230-47ea-8b91-0a5df0c8ccc5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] HTTP exception thrown: Instance b55b70b2-cc64-458a-976c-c8f901eb30cc could not be found. Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0474e94f-b230-47ea-8b91-0a5df0c8ccc5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Request method failure captured: Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc HTTP/1.1 Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeeKL5uFReFw1jtGbxL_z98TtxSU8zymwHw8FIysulJLLQyns9uAYPZTkv7G_NKxVYfYWyqCG_N8u6hZMotQ8ydL-i2EtUVbDH-JH8Z4iDv60_MAQk-GzZq3w2tAyRAmH1CtEWhl-VTWo-MY-wBg0CwwittPalbKEPqt4Ltw-5VaZiU Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.26 Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 3948abe98684425b94b9295399dc48d8 Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerTagsTestJSON-1888877560 Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3948abe98684425b94b9295399dc48d8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3948abe98684425b94b9295399dc48d8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3948abe98684425b94b9295399dc48d8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3948abe98684425b94b9295399dc48d8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerTagsTestJSON-1888877560 Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 3948abe98684425b94b9295399dc48d8 Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerTagsTestJSON-1888877560 Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerTagsTestJSON-1888877560-project Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 33aab271f5894598b1d4c1748482c324 Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerTagsTestJSON-1888877560-project Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance b55b70b2-cc64-458a-976c-c8f901eb30cc could not be found. Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'b55b70b2-cc64-458a-976c-c8f901eb30cc'} Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b55b70b2-cc64-458a-976c-c8f901eb30cc could not be found. Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b55b70b2-cc64-458a-976c-c8f901eb30cc could not be found. Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:02.789750 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.799940 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:02.799940 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:02.799940 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:02.799940 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:02.799940 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:02.799940 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b55b70b2-cc64-458a-976c-c8f901eb30cc could not be found. Sep 08 13:02:02.799940 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.808639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0474e94f-b230-47ea-8b91-0a5df0c8ccc5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] Returning 404 to user: Instance b55b70b2-cc64-458a-976c-c8f901eb30cc could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:02.810220 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0474e94f-b230-47ea-8b91-0a5df0c8ccc5 tempest-ServerTagsTestJSON-1888877560 tempest-ServerTagsTestJSON-1888877560-project] 10.222.0.78 "GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc" status: 404 len: 111 microversion: 2.26 time: 0.168637 Sep 08 13:02:02.811298 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1863/3857] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:02 2022] GET /compute/v2.1/servers/b55b70b2-cc64-458a-976c-c8f901eb30cc => generated 111 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:02:02.828407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5d860f50-a5c2-423f-985c-760e7ea3bc4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:02.828954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5d860f50-a5c2-423f-985c-760e7ea3bc4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:02.838549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d860f50-a5c2-423f-985c-760e7ea3bc4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:02.839131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d860f50-a5c2-423f-985c-760e7ea3bc4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:02.839646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d860f50-a5c2-423f-985c-760e7ea3bc4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:02.840576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d860f50-a5c2-423f-985c-760e7ea3bc4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:02.841131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d860f50-a5c2-423f-985c-760e7ea3bc4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:02.841573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d860f50-a5c2-423f-985c-760e7ea3bc4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:02.866424 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-5d860f50-a5c2-423f-985c-760e7ea3bc4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5d860f50-a5c2-423f-985c-760e7ea3bc4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 HTTP/1.1 Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '4b876ea7-4998-44bb-818e-0a43fa411bb9'} Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:02.868299 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:02.872619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 13:02:02.872619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.872619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:02.872619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.872619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:02.872619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:02.872619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:02.872619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:02.872619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:02.872619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 13:02:02.872619 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:02.874177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5d860f50-a5c2-423f-985c-760e7ea3bc4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:02.875284 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5d860f50-a5c2-423f-985c-760e7ea3bc4e tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 404 len: 111 microversion: 2.1 time: 0.058292 Sep 08 13:02:02.879806 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1864/3858] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:02 2022] DELETE /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:02.886119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-98fccd3d-f258-4f5a-b265-ebb8572deb4c tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:02.887511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-98fccd3d-f258-4f5a-b265-ebb8572deb4c tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:02.898954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98fccd3d-f258-4f5a-b265-ebb8572deb4c tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:02.899898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98fccd3d-f258-4f5a-b265-ebb8572deb4c tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:02.900749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98fccd3d-f258-4f5a-b265-ebb8572deb4c tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:02.901794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98fccd3d-f258-4f5a-b265-ebb8572deb4c tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:02.902527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98fccd3d-f258-4f5a-b265-ebb8572deb4c tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:02.903299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98fccd3d-f258-4f5a-b265-ebb8572deb4c tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:03.412802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9f7bb435-73cf-4fea-a8bc-2c57cf810690 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:03.439565 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9f7bb435-73cf-4fea-a8bc-2c57cf810690 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1666 microversion: 2.1 time: 0.733002 Sep 08 13:02:03.441788 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1995/3859] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:02 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1666 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:03.452336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2af2b833-da4f-47f4-9535-b776b41871b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:03.454063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2af2b833-da4f-47f4-9535-b776b41871b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 4b876ea7-4998-44bb-818e-0a43fa411bb9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:03.473678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-98fccd3d-f258-4f5a-b265-ebb8572deb4c tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f434bb7b512646df85ba9aeaecc3762e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '927079ee4f8f49dfbb3809a990902f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:03.474350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2af2b833-da4f-47f4-9535-b776b41871b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:03.475668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2af2b833-da4f-47f4-9535-b776b41871b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:03.476955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2af2b833-da4f-47f4-9535-b776b41871b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:03.479585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2af2b833-da4f-47f4-9535-b776b41871b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:03.480786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2af2b833-da4f-47f4-9535-b776b41871b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:03.482275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2af2b833-da4f-47f4-9535-b776b41871b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:03.489797 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-98fccd3d-f258-4f5a-b265-ebb8572deb4c tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 200 len: 1522 microversion: 2.1 time: 0.608459 Sep 08 13:02:03.490434 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1865/3860] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:02 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 1522 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:03.496012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d8f9d921-09b8-448c-9215-5188fc1b1742 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:03.496388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d8f9d921-09b8-448c-9215-5188fc1b1742 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:03.512616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8f9d921-09b8-448c-9215-5188fc1b1742 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:03.513118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8f9d921-09b8-448c-9215-5188fc1b1742 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:03.513785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8f9d921-09b8-448c-9215-5188fc1b1742 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:03.514694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8f9d921-09b8-448c-9215-5188fc1b1742 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:03.516336 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-2af2b833-da4f-47f4-9535-b776b41871b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2af2b833-da4f-47f4-9535-b776b41871b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 HTTP/1.1 Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '4b876ea7-4998-44bb-818e-0a43fa411bb9'} Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:03.520452 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.530835 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:03.530835 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:03.530835 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:03.530835 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:03.530835 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:03.530835 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. Sep 08 13:02:03.530835 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.532285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8f9d921-09b8-448c-9215-5188fc1b1742 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:03.532285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8f9d921-09b8-448c-9215-5188fc1b1742 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:03.532726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2af2b833-da4f-47f4-9535-b776b41871b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 4b876ea7-4998-44bb-818e-0a43fa411bb9 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:03.536801 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2af2b833-da4f-47f4-9535-b776b41871b3 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9" status: 404 len: 111 microversion: 2.1 time: 0.090947 Sep 08 13:02:03.539924 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1996/3861] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:03 2022] GET /compute/v2.1/servers/4b876ea7-4998-44bb-818e-0a43fa411bb9 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:03.563293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26a0fe48-115d-4b35-8e7d-7a35b2599299 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:03.564653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-26a0fe48-115d-4b35-8e7d-7a35b2599299 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:03.598719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26a0fe48-115d-4b35-8e7d-7a35b2599299 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:03.599611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26a0fe48-115d-4b35-8e7d-7a35b2599299 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:03.600395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26a0fe48-115d-4b35-8e7d-7a35b2599299 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:03.601581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26a0fe48-115d-4b35-8e7d-7a35b2599299 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:03.611015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26a0fe48-115d-4b35-8e7d-7a35b2599299 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:03.612791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26a0fe48-115d-4b35-8e7d-7a35b2599299 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:03.762719 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-26a0fe48-115d-4b35-8e7d-7a35b2599299 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] HTTP exception thrown: Action 999 not found Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26a0fe48-115d-4b35-8e7d-7a35b2599299 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Request method failure captured: Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0/os-instance-actions/999 HTTP/1.1 Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGee3vfMpq8GdwOcQOjXCLnot1QcatEIWXgK-jyEXBDC2jbI6O1RRliwzyiDwNQePRlJwzFBOpnU-6Yj0WT8fYxYdBE-iP8-7Uf2DlzpysI4h0c5ahEFw82UbYSgbV4knK-R-Azes-rhNwnaPmF3nNy4J1-gljjc0SAovOTJy41FVZ9E Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 927079ee4f8f49dfbb3809a990902f5a Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1102622088 Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_927079ee4f8f49dfbb3809a990902f5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/927079ee4f8f49dfbb3809a990902f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/927079ee4f8f49dfbb3809a990902f5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/927079ee4f8f49dfbb3809a990902f5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1102622088 Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 927079ee4f8f49dfbb3809a990902f5a Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1102622088 Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-InstanceActionsNegativeTestJSON-1102622088-project Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: f434bb7b512646df85ba9aeaecc3762e Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1102622088-project Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: exception: Action 999 not found Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'server_id': '3e316df8-77a2-4365-9e83-ce0ce8eb4aa0', 'id': '999'} Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Sep 08 13:02:03.771727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.775971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26a0fe48-115d-4b35-8e7d-7a35b2599299 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Returning 404 to user: Action 999 not found {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:03.775971 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-26a0fe48-115d-4b35-8e7d-7a35b2599299 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.231809 Sep 08 13:02:03.781452 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1997/3862] 10.222.0.78 () {58 vars in 1308 bytes} [Thu Sep 8 13:02:03 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0/os-instance-actions/999 => generated 66 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:02:03.797346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee84e7c4-9e2d-4db4-9d4f-5cfac72260e9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:03.798427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ee84e7c4-9e2d-4db4-9d4f-5cfac72260e9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 9293faa9-998b-475e-886a-d72dee099818] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:03.811923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee84e7c4-9e2d-4db4-9d4f-5cfac72260e9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:03.815013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee84e7c4-9e2d-4db4-9d4f-5cfac72260e9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:03.815013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee84e7c4-9e2d-4db4-9d4f-5cfac72260e9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:03.817103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee84e7c4-9e2d-4db4-9d4f-5cfac72260e9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:03.817103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee84e7c4-9e2d-4db4-9d4f-5cfac72260e9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:03.817532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee84e7c4-9e2d-4db4-9d4f-5cfac72260e9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:03.856394 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-ee84e7c4-9e2d-4db4-9d4f-5cfac72260e9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee84e7c4-9e2d-4db4-9d4f-5cfac72260e9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818 HTTP/1.1 Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '9293faa9-998b-475e-886a-d72dee099818'} Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:03.859965 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee84e7c4-9e2d-4db4-9d4f-5cfac72260e9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee84e7c4-9e2d-4db4-9d4f-5cfac72260e9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818" status: 404 len: 111 microversion: 2.1 time: 0.081225 Sep 08 13:02:03.866388 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1998/3863] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:03 2022] DELETE /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:03.888720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-82df5139-292d-4f8d-9413-558513847ea9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:03.889958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-82df5139-292d-4f8d-9413-558513847ea9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:03.909738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82df5139-292d-4f8d-9413-558513847ea9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:03.910912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82df5139-292d-4f8d-9413-558513847ea9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:03.912163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82df5139-292d-4f8d-9413-558513847ea9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:03.913637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82df5139-292d-4f8d-9413-558513847ea9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:03.914564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82df5139-292d-4f8d-9413-558513847ea9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:03.918846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82df5139-292d-4f8d-9413-558513847ea9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:04.230032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d8f9d921-09b8-448c-9215-5188fc1b1742 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:04.255898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d8f9d921-09b8-448c-9215-5188fc1b1742 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:04.261254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d8f9d921-09b8-448c-9215-5188fc1b1742 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:04.266250 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d8f9d921-09b8-448c-9215-5188fc1b1742 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.772965 Sep 08 13:02:04.268400 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1866/3864] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:03 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:04.279920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff8f569f-4c8d-4925-8f18-f8be6114d9bb tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '.version_select at 0x7fdb39dc45e0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:04.281896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ff8f569f-4c8d-4925-8f18-f8be6114d9bb tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: cb134d3a-b0c5-4187-a15a-844dc25148c3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:04.295625 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-ff8f569f-4c8d-4925-8f18-f8be6114d9bb tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] HTTP exception thrown: Instance cb134d3a-b0c5-4187-a15a-844dc25148c3 could not be found. Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff8f569f-4c8d-4925-8f18-f8be6114d9bb tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Request method failure captured: Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/cb134d3a-b0c5-4187-a15a-844dc25148c3/os-instance-actions HTTP/1.1 Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGee3vfMpq8GdwOcQOjXCLnot1QcatEIWXgK-jyEXBDC2jbI6O1RRliwzyiDwNQePRlJwzFBOpnU-6Yj0WT8fYxYdBE-iP8-7Uf2DlzpysI4h0c5ahEFw82UbYSgbV4knK-R-Azes-rhNwnaPmF3nNy4J1-gljjc0SAovOTJy41FVZ9E Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 927079ee4f8f49dfbb3809a990902f5a Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1102622088 Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_927079ee4f8f49dfbb3809a990902f5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/927079ee4f8f49dfbb3809a990902f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/927079ee4f8f49dfbb3809a990902f5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/927079ee4f8f49dfbb3809a990902f5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1102622088 Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 927079ee4f8f49dfbb3809a990902f5a Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1102622088 Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-InstanceActionsNegativeTestJSON-1102622088-project Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: f434bb7b512646df85ba9aeaecc3762e Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1102622088-project Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: method: Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance cb134d3a-b0c5-4187-a15a-844dc25148c3 could not be found. Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'server_id': 'cb134d3a-b0c5-4187-a15a-844dc25148c3'} Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb134d3a-b0c5-4187-a15a-844dc25148c3 could not be found. Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:04.299083 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:04.308601 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb134d3a-b0c5-4187-a15a-844dc25148c3 could not be found. Sep 08 13:02:04.308601 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:04.308601 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:04.308601 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:04.308601 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:04.308601 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:04.308601 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:04.308601 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:04.308601 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:04.308601 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb134d3a-b0c5-4187-a15a-844dc25148c3 could not be found. Sep 08 13:02:04.308601 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:04.312670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff8f569f-4c8d-4925-8f18-f8be6114d9bb tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Returning 404 to user: Instance cb134d3a-b0c5-4187-a15a-844dc25148c3 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:04.314797 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ff8f569f-4c8d-4925-8f18-f8be6114d9bb tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/cb134d3a-b0c5-4187-a15a-844dc25148c3/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.043645 Sep 08 13:02:04.321871 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1867/3865] 10.222.0.78 () {58 vars in 1296 bytes} [Thu Sep 8 13:02:04 2022] GET /compute/v2.1/servers/cb134d3a-b0c5-4187-a15a-844dc25148c3/os-instance-actions => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:04.325303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-82df5139-292d-4f8d-9413-558513847ea9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:04.336885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8736e2a0-993b-4a05-928a-03a9890619b9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:04.337607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8736e2a0-993b-4a05-928a-03a9890619b9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 9293faa9-998b-475e-886a-d72dee099818] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:04.337980 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-82df5139-292d-4f8d-9413-558513847ea9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1511 microversion: 2.1 time: 0.459797 Sep 08 13:02:04.352563 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 1999/3866] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:03 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:04.352930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8736e2a0-993b-4a05-928a-03a9890619b9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:04.353922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8736e2a0-993b-4a05-928a-03a9890619b9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:04.354377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8736e2a0-993b-4a05-928a-03a9890619b9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:04.359455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8736e2a0-993b-4a05-928a-03a9890619b9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:04.360780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8736e2a0-993b-4a05-928a-03a9890619b9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:04.360780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8736e2a0-993b-4a05-928a-03a9890619b9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:04.363261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cd430db4-f692-4f1f-b812-30cab692d29b tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:04.363817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cd430db4-f692-4f1f-b812-30cab692d29b tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:04.371631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd430db4-f692-4f1f-b812-30cab692d29b tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:04.373490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd430db4-f692-4f1f-b812-30cab692d29b tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:04.374149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd430db4-f692-4f1f-b812-30cab692d29b tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:04.375068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd430db4-f692-4f1f-b812-30cab692d29b tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:04.375770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd430db4-f692-4f1f-b812-30cab692d29b tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:04.376459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd430db4-f692-4f1f-b812-30cab692d29b tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:04.385414 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-8736e2a0-993b-4a05-928a-03a9890619b9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8736e2a0-993b-4a05-928a-03a9890619b9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818 HTTP/1.1 Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '9293faa9-998b-475e-886a-d72dee099818'} Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:04.387351 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:04.391385 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:04.391385 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:04.391385 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:04.391385 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:04.391385 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:04.391385 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. Sep 08 13:02:04.391385 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:04.393289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8736e2a0-993b-4a05-928a-03a9890619b9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 9293faa9-998b-475e-886a-d72dee099818 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:04.394400 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8736e2a0-993b-4a05-928a-03a9890619b9 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818" status: 404 len: 111 microversion: 2.1 time: 0.071372 Sep 08 13:02:04.395531 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1868/3867] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:04 2022] GET /compute/v2.1/servers/9293faa9-998b-475e-886a-d72dee099818 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:04.446981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cd430db4-f692-4f1f-b812-30cab692d29b tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:02:04.491437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ee5b74f5-bf2a-441f-b587-9eef24788421 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:04.491437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ee5b74f5-bf2a-441f-b587-9eef24788421 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:04.508584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee5b74f5-bf2a-441f-b587-9eef24788421 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:04.512498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee5b74f5-bf2a-441f-b587-9eef24788421 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:04.514675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee5b74f5-bf2a-441f-b587-9eef24788421 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:04.516469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee5b74f5-bf2a-441f-b587-9eef24788421 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:04.519836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee5b74f5-bf2a-441f-b587-9eef24788421 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:04.520648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee5b74f5-bf2a-441f-b587-9eef24788421 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:04.637626 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cd430db4-f692-4f1f-b812-30cab692d29b tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 204 len: 0 microversion: 2.1 time: 0.282311 Sep 08 13:02:04.638322 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2000/3868] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:04 2022] DELETE /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:02:04.650011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d93465c0-4972-425c-87d7-c29013334138 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:04.652117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d93465c0-4972-425c-87d7-c29013334138 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:04.670856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d93465c0-4972-425c-87d7-c29013334138 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:04.672522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d93465c0-4972-425c-87d7-c29013334138 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:04.673322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d93465c0-4972-425c-87d7-c29013334138 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:04.674280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d93465c0-4972-425c-87d7-c29013334138 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:04.675110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d93465c0-4972-425c-87d7-c29013334138 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:04.675951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d93465c0-4972-425c-87d7-c29013334138 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:04.988003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d93465c0-4972-425c-87d7-c29013334138 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f434bb7b512646df85ba9aeaecc3762e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '927079ee4f8f49dfbb3809a990902f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:04.990482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:05.001364 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d93465c0-4972-425c-87d7-c29013334138 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 200 len: 1528 microversion: 2.1 time: 0.356348 Sep 08 13:02:05.010521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ee5b74f5-bf2a-441f-b587-9eef24788421 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:05.011642 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2001/3869] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:04 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 1528 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:05.016663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-15379be3-70d0-473c-97b9-36dd9b12d670 req-1d47e837-e98b-4b7a-82da-50dc82d159bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "tag": "1be64155-8dac-40c9-9439-05e67430247f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:05.041692 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ee5b74f5-bf2a-441f-b587-9eef24788421 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1666 microversion: 2.1 time: 0.555412 Sep 08 13:02:05.043923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-15379be3-70d0-473c-97b9-36dd9b12d670 req-1d47e837-e98b-4b7a-82da-50dc82d159bc service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:05.044217 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1869/3870] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:04 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1666 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:02:05.044395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-15379be3-70d0-473c-97b9-36dd9b12d670 req-1d47e837-e98b-4b7a-82da-50dc82d159bc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:05.044848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-15379be3-70d0-473c-97b9-36dd9b12d670 req-1d47e837-e98b-4b7a-82da-50dc82d159bc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:05.063104 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-15379be3-70d0-473c-97b9-36dd9b12d670 req-1d47e837-e98b-4b7a-82da-50dc82d159bc service nova] Creating event network-changed:1be64155-8dac-40c9-9439-05e67430247f for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:02:05.084059 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-15379be3-70d0-473c-97b9-36dd9b12d670 req-1d47e837-e98b-4b7a-82da-50dc82d159bc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070956 Sep 08 13:02:05.091305 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2002/3871] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:05.299264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8291d048-fff5-4e56-a63d-fb4864353d5f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:05.300158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8291d048-fff5-4e56-a63d-fb4864353d5f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:05.308513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8291d048-fff5-4e56-a63d-fb4864353d5f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:05.309512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8291d048-fff5-4e56-a63d-fb4864353d5f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:05.310065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8291d048-fff5-4e56-a63d-fb4864353d5f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:05.310824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8291d048-fff5-4e56-a63d-fb4864353d5f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:05.311326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8291d048-fff5-4e56-a63d-fb4864353d5f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:05.311765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8291d048-fff5-4e56-a63d-fb4864353d5f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:05.634467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-25a860e2-8126-44d3-b636-40cde56f0c23 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:05.635897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-25a860e2-8126-44d3-b636-40cde56f0c23 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:05.652222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25a860e2-8126-44d3-b636-40cde56f0c23 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:05.654350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25a860e2-8126-44d3-b636-40cde56f0c23 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:05.654835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25a860e2-8126-44d3-b636-40cde56f0c23 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:05.658865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25a860e2-8126-44d3-b636-40cde56f0c23 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:05.659640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25a860e2-8126-44d3-b636-40cde56f0c23 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:05.660560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25a860e2-8126-44d3-b636-40cde56f0c23 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:05.742191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-25a860e2-8126-44d3-b636-40cde56f0c23 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:02:05.976831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:06.026785 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-25a860e2-8126-44d3-b636-40cde56f0c23 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 204 len: 0 microversion: 2.42 time: 0.737774 Sep 08 13:02:06.027773 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1870/3872] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:02:05 2022] DELETE /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:02:06.038493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d2226576-e7e2-4ff7-b354-d5c2caba8e98 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:06.043613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d2226576-e7e2-4ff7-b354-d5c2caba8e98 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:06.061637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2226576-e7e2-4ff7-b354-d5c2caba8e98 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:06.062538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2226576-e7e2-4ff7-b354-d5c2caba8e98 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:06.063160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2226576-e7e2-4ff7-b354-d5c2caba8e98 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:06.066535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2226576-e7e2-4ff7-b354-d5c2caba8e98 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:06.067361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2226576-e7e2-4ff7-b354-d5c2caba8e98 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:06.069292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2226576-e7e2-4ff7-b354-d5c2caba8e98 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:06.502160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8291d048-fff5-4e56-a63d-fb4864353d5f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:06.537046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8291d048-fff5-4e56-a63d-fb4864353d5f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:06.550210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8291d048-fff5-4e56-a63d-fb4864353d5f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:06.554314 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8291d048-fff5-4e56-a63d-fb4864353d5f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.259104 Sep 08 13:02:06.556896 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2003/3873] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:05 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:02:06.581141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-586599c6-a719-4a72-9c50-1b13ac87ff01 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:06.582953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-586599c6-a719-4a72-9c50-1b13ac87ff01 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:06.591651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d2226576-e7e2-4ff7-b354-d5c2caba8e98 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:06.605090 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d2226576-e7e2-4ff7-b354-d5c2caba8e98 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1511 microversion: 2.1 time: 0.575770 Sep 08 13:02:06.607560 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1871/3874] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:06 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1511 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:06.613555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8b235aec-0d66-4f69-84c7-dddf40243ff4 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:06.614663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8b235aec-0d66-4f69-84c7-dddf40243ff4 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:06.621519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-586599c6-a719-4a72-9c50-1b13ac87ff01 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:06.622469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-586599c6-a719-4a72-9c50-1b13ac87ff01 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:06.638043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-586599c6-a719-4a72-9c50-1b13ac87ff01 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:06.643917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b235aec-0d66-4f69-84c7-dddf40243ff4 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:06.645348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b235aec-0d66-4f69-84c7-dddf40243ff4 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:06.646360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b235aec-0d66-4f69-84c7-dddf40243ff4 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:06.648305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b235aec-0d66-4f69-84c7-dddf40243ff4 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:06.648993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-586599c6-a719-4a72-9c50-1b13ac87ff01 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:06.649609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b235aec-0d66-4f69-84c7-dddf40243ff4 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:06.651657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b235aec-0d66-4f69-84c7-dddf40243ff4 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:06.651812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-586599c6-a719-4a72-9c50-1b13ac87ff01 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:06.654821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-586599c6-a719-4a72-9c50-1b13ac87ff01 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:07.511943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-586599c6-a719-4a72-9c50-1b13ac87ff01 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f434bb7b512646df85ba9aeaecc3762e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '927079ee4f8f49dfbb3809a990902f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:07.539965 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-586599c6-a719-4a72-9c50-1b13ac87ff01 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 200 len: 1528 microversion: 2.1 time: 0.980583 Sep 08 13:02:07.548335 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2004/3875] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:06 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 1528 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:07.567192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8dd25f56-820a-4015-ab35-21a1d632d41c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:07.568813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8dd25f56-820a-4015-ab35-21a1d632d41c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:07.589160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8dd25f56-820a-4015-ab35-21a1d632d41c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:07.590384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8dd25f56-820a-4015-ab35-21a1d632d41c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:07.591067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8dd25f56-820a-4015-ab35-21a1d632d41c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:07.592086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8dd25f56-820a-4015-ab35-21a1d632d41c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:07.592780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8dd25f56-820a-4015-ab35-21a1d632d41c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:07.593234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8dd25f56-820a-4015-ab35-21a1d632d41c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:07.611655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8b235aec-0d66-4f69-84c7-dddf40243ff4 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:07.643505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:07.659757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8b235aec-0d66-4f69-84c7-dddf40243ff4 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:07.679464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8b235aec-0d66-4f69-84c7-dddf40243ff4 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:07.683052 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8b235aec-0d66-4f69-84c7-dddf40243ff4 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 2963 microversion: 2.42 time: 1.073363 Sep 08 13:02:07.695775 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1872/3876] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:06 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 2963 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:07.747157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a21c2116-4d1b-4144-8f63-971ba2302c88 req-ed07f9f0-4502-4b67-a6cc-d94e3638e1b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "tag": "82d9067d-9ad7-41b2-8a73-eeae9e8ec555"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:07.766976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a21c2116-4d1b-4144-8f63-971ba2302c88 req-ed07f9f0-4502-4b67-a6cc-d94e3638e1b8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:07.768379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a21c2116-4d1b-4144-8f63-971ba2302c88 req-ed07f9f0-4502-4b67-a6cc-d94e3638e1b8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:07.769572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a21c2116-4d1b-4144-8f63-971ba2302c88 req-ed07f9f0-4502-4b67-a6cc-d94e3638e1b8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:07.795068 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a21c2116-4d1b-4144-8f63-971ba2302c88 req-ed07f9f0-4502-4b67-a6cc-d94e3638e1b8 service nova] Creating event network-changed:82d9067d-9ad7-41b2-8a73-eeae9e8ec555 for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:02:07.806507 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a21c2116-4d1b-4144-8f63-971ba2302c88 req-ed07f9f0-4502-4b67-a6cc-d94e3638e1b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107678 Sep 08 13:02:07.808654 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1873/3877] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:07.819938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f26aded9-cd5c-4417-a2f9-98d384a7cdec tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:07.821950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f26aded9-cd5c-4417-a2f9-98d384a7cdec tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:07.835810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f26aded9-cd5c-4417-a2f9-98d384a7cdec tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:07.837133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f26aded9-cd5c-4417-a2f9-98d384a7cdec tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:07.838695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f26aded9-cd5c-4417-a2f9-98d384a7cdec tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:07.840411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f26aded9-cd5c-4417-a2f9-98d384a7cdec tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:07.842137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f26aded9-cd5c-4417-a2f9-98d384a7cdec tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:07.843289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f26aded9-cd5c-4417-a2f9-98d384a7cdec tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:08.202593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8dd25f56-820a-4015-ab35-21a1d632d41c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:08.222352 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8dd25f56-820a-4015-ab35-21a1d632d41c tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.672101 Sep 08 13:02:08.224564 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2005/3878] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:07 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:08.253829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ff6b030d-ac76-4f07-9012-10446331ac5d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:08.261033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff6b030d-ac76-4f07-9012-10446331ac5d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:08.280464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff6b030d-ac76-4f07-9012-10446331ac5d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:08.281637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff6b030d-ac76-4f07-9012-10446331ac5d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:08.282364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff6b030d-ac76-4f07-9012-10446331ac5d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:08.283427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff6b030d-ac76-4f07-9012-10446331ac5d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:08.285170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff6b030d-ac76-4f07-9012-10446331ac5d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:08.290496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff6b030d-ac76-4f07-9012-10446331ac5d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:08.520308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f26aded9-cd5c-4417-a2f9-98d384a7cdec tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:08.538381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f26aded9-cd5c-4417-a2f9-98d384a7cdec tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:08.544715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f26aded9-cd5c-4417-a2f9-98d384a7cdec tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:08.551007 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f26aded9-cd5c-4417-a2f9-98d384a7cdec tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.740085 Sep 08 13:02:08.552177 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1874/3879] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:07 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:08.565826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b102a066-bca4-4e16-86c2-788c946a8e20 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:08.566897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b102a066-bca4-4e16-86c2-788c946a8e20 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:08.583869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b102a066-bca4-4e16-86c2-788c946a8e20 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:08.586776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b102a066-bca4-4e16-86c2-788c946a8e20 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:08.587924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b102a066-bca4-4e16-86c2-788c946a8e20 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:08.589460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b102a066-bca4-4e16-86c2-788c946a8e20 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:08.590446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b102a066-bca4-4e16-86c2-788c946a8e20 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:08.591465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b102a066-bca4-4e16-86c2-788c946a8e20 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:09.050623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ff6b030d-ac76-4f07-9012-10446331ac5d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:09.073355 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ff6b030d-ac76-4f07-9012-10446331ac5d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1511 microversion: 2.1 time: 0.837139 Sep 08 13:02:09.079439 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2006/3880] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:08 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1511 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:09.105081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-382a3c99-5eb7-44ee-a3c2-82c7e93a8af0 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:09.109954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-382a3c99-5eb7-44ee-a3c2-82c7e93a8af0 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:09.137228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-382a3c99-5eb7-44ee-a3c2-82c7e93a8af0 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:09.139694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-382a3c99-5eb7-44ee-a3c2-82c7e93a8af0 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:09.141593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-382a3c99-5eb7-44ee-a3c2-82c7e93a8af0 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:09.142827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-382a3c99-5eb7-44ee-a3c2-82c7e93a8af0 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:09.143578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-382a3c99-5eb7-44ee-a3c2-82c7e93a8af0 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:09.144054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b102a066-bca4-4e16-86c2-788c946a8e20 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:09.144924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-382a3c99-5eb7-44ee-a3c2-82c7e93a8af0 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:09.176509 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b102a066-bca4-4e16-86c2-788c946a8e20 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.616157 Sep 08 13:02:09.177589 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1875/3881] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:08 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:09.187730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-da54a580-9002-44c9-bd31-95905dd86cb8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:09.198577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-da54a580-9002-44c9-bd31-95905dd86cb8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:09.239572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da54a580-9002-44c9-bd31-95905dd86cb8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:09.240277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da54a580-9002-44c9-bd31-95905dd86cb8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:09.240845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da54a580-9002-44c9-bd31-95905dd86cb8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:09.241887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da54a580-9002-44c9-bd31-95905dd86cb8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:09.242436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da54a580-9002-44c9-bd31-95905dd86cb8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:09.242981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da54a580-9002-44c9-bd31-95905dd86cb8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:09.839294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-382a3c99-5eb7-44ee-a3c2-82c7e93a8af0 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f434bb7b512646df85ba9aeaecc3762e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '927079ee4f8f49dfbb3809a990902f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:09.855265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-da54a580-9002-44c9-bd31-95905dd86cb8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:09.861861 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-382a3c99-5eb7-44ee-a3c2-82c7e93a8af0 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 200 len: 1528 microversion: 2.1 time: 0.761984 Sep 08 13:02:09.875919 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2007/3882] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:09 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 1528 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:09.892436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-da54a580-9002-44c9-bd31-95905dd86cb8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:09.906446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1aef1fc6-fbbe-441f-9ee5-be46f2b64d8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:09.907600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-da54a580-9002-44c9-bd31-95905dd86cb8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:09.908163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1aef1fc6-fbbe-441f-9ee5-be46f2b64d8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:09.913473 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-da54a580-9002-44c9-bd31-95905dd86cb8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 2963 microversion: 2.42 time: 0.730119 Sep 08 13:02:09.918069 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1876/3883] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:09 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 2963 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:09.919625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:09.923338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1aef1fc6-fbbe-441f-9ee5-be46f2b64d8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:09.924667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1aef1fc6-fbbe-441f-9ee5-be46f2b64d8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:09.925811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1aef1fc6-fbbe-441f-9ee5-be46f2b64d8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:09.927482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1aef1fc6-fbbe-441f-9ee5-be46f2b64d8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:09.928595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1aef1fc6-fbbe-441f-9ee5-be46f2b64d8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:09.929664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1aef1fc6-fbbe-441f-9ee5-be46f2b64d8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:09.941435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d5bedea6-9cdd-47a0-8286-106091c37580 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:09.942587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d5bedea6-9cdd-47a0-8286-106091c37580 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:09.956607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5bedea6-9cdd-47a0-8286-106091c37580 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:09.988873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5bedea6-9cdd-47a0-8286-106091c37580 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:09.989711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5bedea6-9cdd-47a0-8286-106091c37580 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:09.991062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5bedea6-9cdd-47a0-8286-106091c37580 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:09.991949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5bedea6-9cdd-47a0-8286-106091c37580 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:09.993115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5bedea6-9cdd-47a0-8286-106091c37580 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:10.790361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d5bedea6-9cdd-47a0-8286-106091c37580 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:10.845934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1aef1fc6-fbbe-441f-9ee5-be46f2b64d8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:10.891924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d5bedea6-9cdd-47a0-8286-106091c37580 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:10.894898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d5bedea6-9cdd-47a0-8286-106091c37580 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:10.904232 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1aef1fc6-fbbe-441f-9ee5-be46f2b64d8e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.006173 Sep 08 13:02:10.907665 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d5bedea6-9cdd-47a0-8286-106091c37580 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.985075 Sep 08 13:02:10.931829 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2008/3884] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:09 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:10.944400 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1877/3885] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:09 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:10.958176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a328ccec-6139-4d79-81d2-8205330aabec req-0dde42c2-afbd-485d-9b95-b2a0d965c64f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e316df8-77a2-4365-9e83-ce0ce8eb4aa0", "name": "network-vif-unplugged", "status": "completed", "tag": "74a0642e-189b-4606-bf7e-42c94d73f877"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:10.964430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d7c0446a-7ef4-445d-8f7e-37412cd04d9a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:10.974702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d7c0446a-7ef4-445d-8f7e-37412cd04d9a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:10.998410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7c0446a-7ef4-445d-8f7e-37412cd04d9a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:11.000470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7c0446a-7ef4-445d-8f7e-37412cd04d9a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:11.001178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7c0446a-7ef4-445d-8f7e-37412cd04d9a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:11.003744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a328ccec-6139-4d79-81d2-8205330aabec req-0dde42c2-afbd-485d-9b95-b2a0d965c64f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:11.006438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7c0446a-7ef4-445d-8f7e-37412cd04d9a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:11.007158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7c0446a-7ef4-445d-8f7e-37412cd04d9a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:11.008837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7c0446a-7ef4-445d-8f7e-37412cd04d9a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:11.012160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a328ccec-6139-4d79-81d2-8205330aabec req-0dde42c2-afbd-485d-9b95-b2a0d965c64f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:11.013879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a328ccec-6139-4d79-81d2-8205330aabec req-0dde42c2-afbd-485d-9b95-b2a0d965c64f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:11.058885 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a328ccec-6139-4d79-81d2-8205330aabec req-0dde42c2-afbd-485d-9b95-b2a0d965c64f service nova] Creating event network-vif-unplugged:74a0642e-189b-4606-bf7e-42c94d73f877 for instance 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 on n-h1-852084-10 Sep 08 13:02:11.087477 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a328ccec-6139-4d79-81d2-8205330aabec req-0dde42c2-afbd-485d-9b95-b2a0d965c64f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.139153 Sep 08 13:02:11.089613 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1878/3886] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:11.111980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ea27bfc4-09a5-42b8-b9f6-32b209092a6e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:11.119244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ea27bfc4-09a5-42b8-b9f6-32b209092a6e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:11.164866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea27bfc4-09a5-42b8-b9f6-32b209092a6e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:11.168765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea27bfc4-09a5-42b8-b9f6-32b209092a6e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:11.169934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea27bfc4-09a5-42b8-b9f6-32b209092a6e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:11.174121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea27bfc4-09a5-42b8-b9f6-32b209092a6e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:11.177847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea27bfc4-09a5-42b8-b9f6-32b209092a6e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:11.178993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea27bfc4-09a5-42b8-b9f6-32b209092a6e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:11.861306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d7c0446a-7ef4-445d-8f7e-37412cd04d9a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:11.874593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ea27bfc4-09a5-42b8-b9f6-32b209092a6e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f434bb7b512646df85ba9aeaecc3762e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '927079ee4f8f49dfbb3809a990902f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:11.898041 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d7c0446a-7ef4-445d-8f7e-37412cd04d9a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1511 microversion: 2.1 time: 0.950212 Sep 08 13:02:11.904953 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2009/3887] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:10 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1511 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:11.916843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9c81a70-cee0-426f-87ad-b0fbba6898a6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:11.921412 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ea27bfc4-09a5-42b8-b9f6-32b209092a6e tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 200 len: 1528 microversion: 2.1 time: 0.826150 Sep 08 13:02:11.923878 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1879/3888] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:11 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 1528 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:11.926238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a9c81a70-cee0-426f-87ad-b0fbba6898a6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:11.944594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9fcc9345-0107-43dc-8f01-ad68dae8d107 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:11.948145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9fcc9345-0107-43dc-8f01-ad68dae8d107 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:11.954850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9c81a70-cee0-426f-87ad-b0fbba6898a6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:11.956192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9c81a70-cee0-426f-87ad-b0fbba6898a6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:11.957428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9c81a70-cee0-426f-87ad-b0fbba6898a6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:11.961929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9c81a70-cee0-426f-87ad-b0fbba6898a6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:11.965465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9c81a70-cee0-426f-87ad-b0fbba6898a6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:11.969009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9c81a70-cee0-426f-87ad-b0fbba6898a6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:11.987016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fcc9345-0107-43dc-8f01-ad68dae8d107 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:11.988529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fcc9345-0107-43dc-8f01-ad68dae8d107 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:11.991083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fcc9345-0107-43dc-8f01-ad68dae8d107 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:11.992889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fcc9345-0107-43dc-8f01-ad68dae8d107 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:11.994196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fcc9345-0107-43dc-8f01-ad68dae8d107 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:11.995504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fcc9345-0107-43dc-8f01-ad68dae8d107 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:13.413500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9c81a70-cee0-426f-87ad-b0fbba6898a6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:13.428585 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a9c81a70-cee0-426f-87ad-b0fbba6898a6 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.520420 Sep 08 13:02:13.430273 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2010/3889] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:11 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:13.444663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f8dac4e-79a0-4ae6-99eb-075f92c15804 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:13.445582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1f8dac4e-79a0-4ae6-99eb-075f92c15804 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:13.460893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f8dac4e-79a0-4ae6-99eb-075f92c15804 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:13.463314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f8dac4e-79a0-4ae6-99eb-075f92c15804 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:13.465198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f8dac4e-79a0-4ae6-99eb-075f92c15804 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:13.468400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f8dac4e-79a0-4ae6-99eb-075f92c15804 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:13.470195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f8dac4e-79a0-4ae6-99eb-075f92c15804 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:13.470715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f8dac4e-79a0-4ae6-99eb-075f92c15804 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:13.507204 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-1f8dac4e-79a0-4ae6-99eb-075f92c15804 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f8dac4e-79a0-4ae6-99eb-075f92c15804 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 HTTP/1.1 Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'e3368fcc-195b-45a7-92da-7bd0f4337247'} Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:13.512129 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f8dac4e-79a0-4ae6-99eb-075f92c15804 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1f8dac4e-79a0-4ae6-99eb-075f92c15804 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 404 len: 111 microversion: 2.1 time: 0.079395 Sep 08 13:02:13.522213 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2011/3890] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:13 2022] DELETE /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:13.530669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3a40aded-ec73-4158-8cc1-34ca090714c4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:13.533179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3a40aded-ec73-4158-8cc1-34ca090714c4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:13.551019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a40aded-ec73-4158-8cc1-34ca090714c4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:13.555488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a40aded-ec73-4158-8cc1-34ca090714c4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:13.556039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a40aded-ec73-4158-8cc1-34ca090714c4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:13.557029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a40aded-ec73-4158-8cc1-34ca090714c4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:13.557586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a40aded-ec73-4158-8cc1-34ca090714c4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:13.558047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a40aded-ec73-4158-8cc1-34ca090714c4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:14.093854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9fcc9345-0107-43dc-8f01-ad68dae8d107 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:14.109996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9fcc9345-0107-43dc-8f01-ad68dae8d107 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:14.111548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9fcc9345-0107-43dc-8f01-ad68dae8d107 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:14.113041 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9fcc9345-0107-43dc-8f01-ad68dae8d107 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 2942 microversion: 2.42 time: 2.185894 Sep 08 13:02:14.121079 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1880/3891] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:11 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 2942 bytes in 2194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:14.129839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-58fec7d0-9936-4ebe-a8b7-d86f8eb706f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:14.130477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-58fec7d0-9936-4ebe-a8b7-d86f8eb706f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:14.148833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58fec7d0-9936-4ebe-a8b7-d86f8eb706f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:14.149338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58fec7d0-9936-4ebe-a8b7-d86f8eb706f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:14.154768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58fec7d0-9936-4ebe-a8b7-d86f8eb706f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:14.156569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58fec7d0-9936-4ebe-a8b7-d86f8eb706f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:14.161086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58fec7d0-9936-4ebe-a8b7-d86f8eb706f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:14.162471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58fec7d0-9936-4ebe-a8b7-d86f8eb706f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:14.809759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3a40aded-ec73-4158-8cc1-34ca090714c4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:14.834406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3a40aded-ec73-4158-8cc1-34ca090714c4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:14.840436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3a40aded-ec73-4158-8cc1-34ca090714c4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:14.842940 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3a40aded-ec73-4158-8cc1-34ca090714c4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.323329 Sep 08 13:02:14.844950 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2012/3892] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:13 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:14.856176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be3eef65-9d81-4aa4-b681-5be5153a5a94 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:14.857711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-be3eef65-9d81-4aa4-b681-5be5153a5a94 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] [instance: 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:14.872422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be3eef65-9d81-4aa4-b681-5be5153a5a94 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:14.874022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be3eef65-9d81-4aa4-b681-5be5153a5a94 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:14.875211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be3eef65-9d81-4aa4-b681-5be5153a5a94 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:14.877103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be3eef65-9d81-4aa4-b681-5be5153a5a94 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:14.878367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be3eef65-9d81-4aa4-b681-5be5153a5a94 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:14.879568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be3eef65-9d81-4aa4-b681-5be5153a5a94 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:14.909459 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-be3eef65-9d81-4aa4-b681-5be5153a5a94 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] HTTP exception thrown: Instance 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 could not be found. Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be3eef65-9d81-4aa4-b681-5be5153a5a94 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Request method failure captured: Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 HTTP/1.1 Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGee3vfMpq8GdwOcQOjXCLnot1QcatEIWXgK-jyEXBDC2jbI6O1RRliwzyiDwNQePRlJwzFBOpnU-6Yj0WT8fYxYdBE-iP8-7Uf2DlzpysI4h0c5ahEFw82UbYSgbV4knK-R-Azes-rhNwnaPmF3nNy4J1-gljjc0SAovOTJy41FVZ9E Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 927079ee4f8f49dfbb3809a990902f5a Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1102622088 Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_927079ee4f8f49dfbb3809a990902f5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/927079ee4f8f49dfbb3809a990902f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/927079ee4f8f49dfbb3809a990902f5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/927079ee4f8f49dfbb3809a990902f5a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1102622088 Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 927079ee4f8f49dfbb3809a990902f5a Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1102622088 Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-InstanceActionsNegativeTestJSON-1102622088-project Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: f434bb7b512646df85ba9aeaecc3762e Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1102622088-project Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 could not be found. Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '3e316df8-77a2-4365-9e83-ce0ce8eb4aa0'} Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 could not be found. Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 could not be found. Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:14.911065 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:14.918588 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:14.918588 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:14.918588 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:14.918588 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:14.918588 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:14.918588 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:14.918588 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 could not be found. Sep 08 13:02:14.918588 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:14.918588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be3eef65-9d81-4aa4-b681-5be5153a5a94 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] Returning 404 to user: Instance 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:14.918588 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-be3eef65-9d81-4aa4-b681-5be5153a5a94 tempest-InstanceActionsNegativeTestJSON-1102622088 tempest-InstanceActionsNegativeTestJSON-1102622088-project] 10.222.0.78 "GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0" status: 404 len: 111 microversion: 2.1 time: 0.064911 Sep 08 13:02:14.918588 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2013/3893] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:14 2022] GET /compute/v2.1/servers/3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:14.923261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ee9aa110-4565-4da8-8cb9-6eb3bdbe4e9f req-8e295aeb-1e52-43f2-bc8d-3b1d7fc9c64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e316df8-77a2-4365-9e83-ce0ce8eb4aa0", "name": "network-vif-deleted", "tag": "74a0642e-189b-4606-bf7e-42c94d73f877"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:14.940833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ee9aa110-4565-4da8-8cb9-6eb3bdbe4e9f req-8e295aeb-1e52-43f2-bc8d-3b1d7fc9c64b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:14.941732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ee9aa110-4565-4da8-8cb9-6eb3bdbe4e9f req-8e295aeb-1e52-43f2-bc8d-3b1d7fc9c64b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:14.942513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ee9aa110-4565-4da8-8cb9-6eb3bdbe4e9f req-8e295aeb-1e52-43f2-bc8d-3b1d7fc9c64b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:14.973332 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ee9aa110-4565-4da8-8cb9-6eb3bdbe4e9f req-8e295aeb-1e52-43f2-bc8d-3b1d7fc9c64b service nova] Creating event network-vif-deleted:74a0642e-189b-4606-bf7e-42c94d73f877 for instance 3e316df8-77a2-4365-9e83-ce0ce8eb4aa0 on n-h1-852084-10 Sep 08 13:02:14.980394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-58fec7d0-9936-4ebe-a8b7-d86f8eb706f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:14.996953 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ee9aa110-4565-4da8-8cb9-6eb3bdbe4e9f req-8e295aeb-1e52-43f2-bc8d-3b1d7fc9c64b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078437 Sep 08 13:02:14.998490 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2014/3894] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:15.009103 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-58fec7d0-9936-4ebe-a8b7-d86f8eb706f9 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1511 microversion: 2.1 time: 0.884390 Sep 08 13:02:15.013385 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1881/3895] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:14 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1511 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:15.016941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-bff7ab57-e660-494e-96a3-a347bb7adbc6 req-f342197c-17f5-4e69-ba03-2496afb706b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-unplugged", "status": "completed", "tag": "4b26731c-bba7-426c-9edd-565f551fa508"}, {"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-unplugged", "status": "completed", "tag": "1a42ecce-f9f7-442b-a7d5-6607113087a7"}, {"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-unplugged", "status": "completed", "tag": "a69fd5b9-294a-4234-9531-c82133ce0190"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:15.032080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c757dfef-4d1d-49d8-a517-2dd9d392a6a1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:15.035553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c757dfef-4d1d-49d8-a517-2dd9d392a6a1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:15.066693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bff7ab57-e660-494e-96a3-a347bb7adbc6 req-f342197c-17f5-4e69-ba03-2496afb706b8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:15.071870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bff7ab57-e660-494e-96a3-a347bb7adbc6 req-f342197c-17f5-4e69-ba03-2496afb706b8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:15.075257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bff7ab57-e660-494e-96a3-a347bb7adbc6 req-f342197c-17f5-4e69-ba03-2496afb706b8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:15.083929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c757dfef-4d1d-49d8-a517-2dd9d392a6a1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:15.092412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c757dfef-4d1d-49d8-a517-2dd9d392a6a1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:15.093884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c757dfef-4d1d-49d8-a517-2dd9d392a6a1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:15.095115 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-bff7ab57-e660-494e-96a3-a347bb7adbc6 req-f342197c-17f5-4e69-ba03-2496afb706b8 service nova] Creating event network-vif-unplugged:4b26731c-bba7-426c-9edd-565f551fa508 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 13:02:15.095691 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-bff7ab57-e660-494e-96a3-a347bb7adbc6 req-f342197c-17f5-4e69-ba03-2496afb706b8 service nova] Creating event network-vif-unplugged:1a42ecce-f9f7-442b-a7d5-6607113087a7 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 13:02:15.096831 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-bff7ab57-e660-494e-96a3-a347bb7adbc6 req-f342197c-17f5-4e69-ba03-2496afb706b8 service nova] Creating event network-vif-unplugged:a69fd5b9-294a-4234-9531-c82133ce0190 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 13:02:15.099482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c757dfef-4d1d-49d8-a517-2dd9d392a6a1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:15.104755 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-bff7ab57-e660-494e-96a3-a347bb7adbc6 req-f342197c-17f5-4e69-ba03-2496afb706b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.104430 Sep 08 13:02:15.105217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c757dfef-4d1d-49d8-a517-2dd9d392a6a1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:15.105937 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2015/3896] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:15.107048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c757dfef-4d1d-49d8-a517-2dd9d392a6a1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:15.112420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f5b84357-e74e-4af3-aaf8-0b75af1e1ff5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:15.113161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f5b84357-e74e-4af3-aaf8-0b75af1e1ff5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: e3368fcc-195b-45a7-92da-7bd0f4337247] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:15.122708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5b84357-e74e-4af3-aaf8-0b75af1e1ff5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:15.123247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5b84357-e74e-4af3-aaf8-0b75af1e1ff5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:15.125616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5b84357-e74e-4af3-aaf8-0b75af1e1ff5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:15.125616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5b84357-e74e-4af3-aaf8-0b75af1e1ff5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:15.125972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5b84357-e74e-4af3-aaf8-0b75af1e1ff5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:15.126291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5b84357-e74e-4af3-aaf8-0b75af1e1ff5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:15.147884 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-f5b84357-e74e-4af3-aaf8-0b75af1e1ff5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f5b84357-e74e-4af3-aaf8-0b75af1e1ff5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 HTTP/1.1 Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'e3368fcc-195b-45a7-92da-7bd0f4337247'} Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:15.152767 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:15.159825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:15.159825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:15.159825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:15.159825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:15.159825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:15.159825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. Sep 08 13:02:15.159825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:15.159825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f5b84357-e74e-4af3-aaf8-0b75af1e1ff5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance e3368fcc-195b-45a7-92da-7bd0f4337247 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:15.159825 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f5b84357-e74e-4af3-aaf8-0b75af1e1ff5 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247" status: 404 len: 111 microversion: 2.1 time: 0.047144 Sep 08 13:02:15.159825 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2016/3897] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:15 2022] GET /compute/v2.1/servers/e3368fcc-195b-45a7-92da-7bd0f4337247 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:15.162192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1809f319-86b2-410f-844b-c73d6a357b0d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:15.167273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1809f319-86b2-410f-844b-c73d6a357b0d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:15.172165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1809f319-86b2-410f-844b-c73d6a357b0d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:15.174301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1809f319-86b2-410f-844b-c73d6a357b0d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:15.175019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1809f319-86b2-410f-844b-c73d6a357b0d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:15.176231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1809f319-86b2-410f-844b-c73d6a357b0d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:15.176738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1809f319-86b2-410f-844b-c73d6a357b0d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:15.177189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1809f319-86b2-410f-844b-c73d6a357b0d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:15.952725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c757dfef-4d1d-49d8-a517-2dd9d392a6a1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:15.972383 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c757dfef-4d1d-49d8-a517-2dd9d392a6a1 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.952332 Sep 08 13:02:15.974190 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1882/3898] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:15 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:15.986729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-53063954-4c0d-4cb6-a3e2-19b74bcf4ba8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:15.988487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-53063954-4c0d-4cb6-a3e2-19b74bcf4ba8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:15.990784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1809f319-86b2-410f-844b-c73d6a357b0d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:16.004709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-53063954-4c0d-4cb6-a3e2-19b74bcf4ba8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:16.006295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-53063954-4c0d-4cb6-a3e2-19b74bcf4ba8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:16.007448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-53063954-4c0d-4cb6-a3e2-19b74bcf4ba8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:16.008552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1809f319-86b2-410f-844b-c73d6a357b0d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:16.010674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-53063954-4c0d-4cb6-a3e2-19b74bcf4ba8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:16.015276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1809f319-86b2-410f-844b-c73d6a357b0d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:16.016005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-53063954-4c0d-4cb6-a3e2-19b74bcf4ba8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:16.016924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-53063954-4c0d-4cb6-a3e2-19b74bcf4ba8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:16.024363 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1809f319-86b2-410f-844b-c73d6a357b0d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 2921 microversion: 2.42 time: 0.859977 Sep 08 13:02:16.030168 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2017/3899] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:15 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 2921 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:16.047108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-803cc1f0-0008-453a-9a48-73701914ef23 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:16.047465 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-53063954-4c0d-4cb6-a3e2-19b74bcf4ba8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 13:02:16.050054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-803cc1f0-0008-453a-9a48-73701914ef23 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-53063954-4c0d-4cb6-a3e2-19b74bcf4ba8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 HTTP/1.1 Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '5d4fc907-3c1f-461d-9346-9efed53d8190'} Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:16.050560 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-53063954-4c0d-4cb6-a3e2-19b74bcf4ba8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-53063954-4c0d-4cb6-a3e2-19b74bcf4ba8 tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 404 len: 111 microversion: 2.1 time: 0.076132 Sep 08 13:02:16.066354 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1883/3900] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:15 2022] DELETE /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:16.073674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f9efaa79-3bb5-4de1-9993-c3ef0af585d3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:16.073674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f9efaa79-3bb5-4de1-9993-c3ef0af585d3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:16.083290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9efaa79-3bb5-4de1-9993-c3ef0af585d3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:16.084249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9efaa79-3bb5-4de1-9993-c3ef0af585d3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:16.085386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9efaa79-3bb5-4de1-9993-c3ef0af585d3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:16.086743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9efaa79-3bb5-4de1-9993-c3ef0af585d3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:16.087713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9efaa79-3bb5-4de1-9993-c3ef0af585d3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:16.088420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9efaa79-3bb5-4de1-9993-c3ef0af585d3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:16.096016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-803cc1f0-0008-453a-9a48-73701914ef23 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:16.096993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-803cc1f0-0008-453a-9a48-73701914ef23 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:16.097817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-803cc1f0-0008-453a-9a48-73701914ef23 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:16.108651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-803cc1f0-0008-453a-9a48-73701914ef23 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:16.111684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-803cc1f0-0008-453a-9a48-73701914ef23 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:16.113500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-803cc1f0-0008-453a-9a48-73701914ef23 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:16.164140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-f9efaa79-3bb5-4de1-9993-c3ef0af585d3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lazy-loading 'flavor' on Instance uuid abb01efa-03b9-40b6-901b-33e7d583b7c8 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:02:16.334924 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f9efaa79-3bb5-4de1-9993-c3ef0af585d3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.272562 Sep 08 13:02:16.340752 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1884/3901] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:02:16 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:02:16.352304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7d14139b-b30d-4fc9-bc61-721ec1309edb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:16.354820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7d14139b-b30d-4fc9-bc61-721ec1309edb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:16.369759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d14139b-b30d-4fc9-bc61-721ec1309edb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:16.371967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d14139b-b30d-4fc9-bc61-721ec1309edb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:16.373134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d14139b-b30d-4fc9-bc61-721ec1309edb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:16.375061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d14139b-b30d-4fc9-bc61-721ec1309edb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:16.376242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d14139b-b30d-4fc9-bc61-721ec1309edb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:16.376942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d14139b-b30d-4fc9-bc61-721ec1309edb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:17.145185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-803cc1f0-0008-453a-9a48-73701914ef23 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:17.156791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-803cc1f0-0008-453a-9a48-73701914ef23 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:17.158541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-803cc1f0-0008-453a-9a48-73701914ef23 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:17.159994 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-803cc1f0-0008-453a-9a48-73701914ef23 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.126804 Sep 08 13:02:17.160717 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2018/3902] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:16 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:17.175952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5581eab5-4827-4c43-98e7-23213c3acefb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:17.177504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5581eab5-4827-4c43-98e7-23213c3acefb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] [instance: 5d4fc907-3c1f-461d-9346-9efed53d8190] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:17.199332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5581eab5-4827-4c43-98e7-23213c3acefb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:17.200330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5581eab5-4827-4c43-98e7-23213c3acefb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:17.201098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5581eab5-4827-4c43-98e7-23213c3acefb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:17.202128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5581eab5-4827-4c43-98e7-23213c3acefb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:17.202985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5581eab5-4827-4c43-98e7-23213c3acefb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:17.203685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5581eab5-4827-4c43-98e7-23213c3acefb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:17.240785 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-5581eab5-4827-4c43-98e7-23213c3acefb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] HTTP exception thrown: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5581eab5-4827-4c43-98e7-23213c3acefb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Request method failure captured: Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 HTTP/1.1 Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeYctNqIe55jtV06sUo7E2FIsk78kNQLNU-qrvtig4sgXzqNg365CXA-xuz7Xy_IEYi7gdKk7fOztXC0nE6iOreqzqipNJpejC1TmLKefIpwhOeGnoPIbp-hUei0PBCq173xMhnRKYJ4X94wolzs-vOaaAgeqNvzM-c1ziEEfVxAh9Q Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ea5d4df4f22d4af3a40af8a9ab306bd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ea5d4df4f22d4af3a40af8a9ab306bd0 Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-348928280 Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9a995d2889c47738ad0b5255445c5f0 Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-348928280-project Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '5d4fc907-3c1f-461d-9346-9efed53d8190'} Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:17.247296 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:17.251598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:17.251598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:17.251598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:17.251598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:17.251598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:17.251598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. Sep 08 13:02:17.251598 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:17.251598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5581eab5-4827-4c43-98e7-23213c3acefb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] Returning 404 to user: Instance 5d4fc907-3c1f-461d-9346-9efed53d8190 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:17.251598 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5581eab5-4827-4c43-98e7-23213c3acefb tempest-DeleteServersTestJSON-348928280 tempest-DeleteServersTestJSON-348928280-project] 10.222.0.78 "GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190" status: 404 len: 111 microversion: 2.1 time: 0.087892 Sep 08 13:02:17.252209 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2019/3903] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:17 2022] GET /compute/v2.1/servers/5d4fc907-3c1f-461d-9346-9efed53d8190 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:17.260035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3fe2bb9c-4fb9-4dac-8511-903ec03eb9f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:17.261177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3fe2bb9c-4fb9-4dac-8511-903ec03eb9f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:17.274348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fe2bb9c-4fb9-4dac-8511-903ec03eb9f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:17.277175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fe2bb9c-4fb9-4dac-8511-903ec03eb9f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:17.279152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fe2bb9c-4fb9-4dac-8511-903ec03eb9f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:17.281817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fe2bb9c-4fb9-4dac-8511-903ec03eb9f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:17.283432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fe2bb9c-4fb9-4dac-8511-903ec03eb9f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:17.285692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fe2bb9c-4fb9-4dac-8511-903ec03eb9f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:17.386469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7d14139b-b30d-4fc9-bc61-721ec1309edb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:17.438784 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7d14139b-b30d-4fc9-bc61-721ec1309edb tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1511 microversion: 2.1 time: 1.095308 Sep 08 13:02:17.443315 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1885/3904] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:16 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1511 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:17.457998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2c201f49-7d08-4d2b-96aa-0d9380f5fea9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:17.459555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2c201f49-7d08-4d2b-96aa-0d9380f5fea9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:17.487324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c201f49-7d08-4d2b-96aa-0d9380f5fea9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:17.488685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c201f49-7d08-4d2b-96aa-0d9380f5fea9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:17.489669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c201f49-7d08-4d2b-96aa-0d9380f5fea9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:17.491145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c201f49-7d08-4d2b-96aa-0d9380f5fea9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:17.492408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c201f49-7d08-4d2b-96aa-0d9380f5fea9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:17.495176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c201f49-7d08-4d2b-96aa-0d9380f5fea9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:18.011703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3fe2bb9c-4fb9-4dac-8511-903ec03eb9f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:18.088053 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3fe2bb9c-4fb9-4dac-8511-903ec03eb9f9 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1661 microversion: 2.1 time: 0.807434 Sep 08 13:02:18.088053 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2020/3905] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:17 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1661 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:18.117686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-1ff511a7-fd73-4d85-ac82-f63ffdc7a497 req-17876da6-85e4-44ae-b8b8-33376a192d11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-unplugged", "status": "completed", "tag": "73bd7edb-2a02-4b55-9210-60c0c223d930"}, {"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-unplugged", "status": "completed", "tag": "a4326ea5-099a-4095-b74c-dfca6dbbcf45"}, {"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-unplugged", "status": "completed", "tag": "3466f05e-6efb-423f-9ac1-92190128aa45"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:18.167961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1ff511a7-fd73-4d85-ac82-f63ffdc7a497 req-17876da6-85e4-44ae-b8b8-33376a192d11 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:18.173079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1ff511a7-fd73-4d85-ac82-f63ffdc7a497 req-17876da6-85e4-44ae-b8b8-33376a192d11 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:18.174327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1ff511a7-fd73-4d85-ac82-f63ffdc7a497 req-17876da6-85e4-44ae-b8b8-33376a192d11 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:18.209677 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1ff511a7-fd73-4d85-ac82-f63ffdc7a497 req-17876da6-85e4-44ae-b8b8-33376a192d11 service nova] Creating event network-vif-unplugged:73bd7edb-2a02-4b55-9210-60c0c223d930 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 13:02:18.211905 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1ff511a7-fd73-4d85-ac82-f63ffdc7a497 req-17876da6-85e4-44ae-b8b8-33376a192d11 service nova] Creating event network-vif-unplugged:a4326ea5-099a-4095-b74c-dfca6dbbcf45 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 13:02:18.214437 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1ff511a7-fd73-4d85-ac82-f63ffdc7a497 req-17876da6-85e4-44ae-b8b8-33376a192d11 service nova] Creating event network-vif-unplugged:3466f05e-6efb-423f-9ac1-92190128aa45 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 13:02:18.228531 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-1ff511a7-fd73-4d85-ac82-f63ffdc7a497 req-17876da6-85e4-44ae-b8b8-33376a192d11 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.150111 Sep 08 13:02:18.230863 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2021/3906] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:18.243426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-3d1af9d3-39ec-4c8d-9c39-b6ddccd27f3b req-7e67a3bc-c1c7-48ad-bb77-3f16dedeba7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-deleted", "tag": "a4326ea5-099a-4095-b74c-dfca6dbbcf45"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:18.273902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3d1af9d3-39ec-4c8d-9c39-b6ddccd27f3b req-7e67a3bc-c1c7-48ad-bb77-3f16dedeba7d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:18.278215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3d1af9d3-39ec-4c8d-9c39-b6ddccd27f3b req-7e67a3bc-c1c7-48ad-bb77-3f16dedeba7d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:18.279539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3d1af9d3-39ec-4c8d-9c39-b6ddccd27f3b req-7e67a3bc-c1c7-48ad-bb77-3f16dedeba7d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:18.319430 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-3d1af9d3-39ec-4c8d-9c39-b6ddccd27f3b req-7e67a3bc-c1c7-48ad-bb77-3f16dedeba7d service nova] Creating event network-vif-deleted:a4326ea5-099a-4095-b74c-dfca6dbbcf45 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 13:02:18.333565 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-3d1af9d3-39ec-4c8d-9c39-b6ddccd27f3b req-7e67a3bc-c1c7-48ad-bb77-3f16dedeba7d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098070 Sep 08 13:02:18.336425 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2022/3907] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:18.348969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5f7a9910-6e38-4922-b55d-ca8aee6ffe9e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:18.350399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5f7a9910-6e38-4922-b55d-ca8aee6ffe9e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:18.372624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f7a9910-6e38-4922-b55d-ca8aee6ffe9e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:18.374588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f7a9910-6e38-4922-b55d-ca8aee6ffe9e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:18.375878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f7a9910-6e38-4922-b55d-ca8aee6ffe9e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:18.377451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f7a9910-6e38-4922-b55d-ca8aee6ffe9e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:18.379315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f7a9910-6e38-4922-b55d-ca8aee6ffe9e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:18.380451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f7a9910-6e38-4922-b55d-ca8aee6ffe9e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:18.563965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c201f49-7d08-4d2b-96aa-0d9380f5fea9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:18.596876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:18.608013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c201f49-7d08-4d2b-96aa-0d9380f5fea9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:18.610965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c201f49-7d08-4d2b-96aa-0d9380f5fea9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:18.617164 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2c201f49-7d08-4d2b-96aa-0d9380f5fea9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 2874 microversion: 2.42 time: 1.171785 Sep 08 13:02:18.618146 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1886/3908] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:17 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 2874 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:18.637437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44f426b4-f05d-49bc-8c64-f9bdfa1fb979 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:18.638559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-44f426b4-f05d-49bc-8c64-f9bdfa1fb979 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:18.666537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44f426b4-f05d-49bc-8c64-f9bdfa1fb979 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:18.671622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44f426b4-f05d-49bc-8c64-f9bdfa1fb979 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:18.672621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44f426b4-f05d-49bc-8c64-f9bdfa1fb979 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:18.673979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44f426b4-f05d-49bc-8c64-f9bdfa1fb979 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:18.674813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44f426b4-f05d-49bc-8c64-f9bdfa1fb979 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:18.680543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44f426b4-f05d-49bc-8c64-f9bdfa1fb979 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:18.733411 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5f7a9910-6e38-4922-b55d-ca8aee6ffe9e tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action" status: 202 len: 0 microversion: 2.1 time: 0.387999 Sep 08 13:02:18.739601 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2023/3909] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:02:18 2022] POST /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:02:18.766776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1a972cfa-3bc7-4cb5-a31f-4e5c1cfd036d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:18.783857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1a972cfa-3bc7-4cb5-a31f-4e5c1cfd036d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:18.809503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a972cfa-3bc7-4cb5-a31f-4e5c1cfd036d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:18.811029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a972cfa-3bc7-4cb5-a31f-4e5c1cfd036d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:18.814897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a972cfa-3bc7-4cb5-a31f-4e5c1cfd036d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:18.818696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a972cfa-3bc7-4cb5-a31f-4e5c1cfd036d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:18.820375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a972cfa-3bc7-4cb5-a31f-4e5c1cfd036d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:18.821549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a972cfa-3bc7-4cb5-a31f-4e5c1cfd036d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:19.311548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a972cfa-3bc7-4cb5-a31f-4e5c1cfd036d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:19.324444 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1a972cfa-3bc7-4cb5-a31f-4e5c1cfd036d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1511 microversion: 2.1 time: 0.582172 Sep 08 13:02:19.341103 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2024/3910] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:18 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1511 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:19.389598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-78d745a1-9d47-4de0-a2aa-8ce3759509c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:19.392590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-44f426b4-f05d-49bc-8c64-f9bdfa1fb979 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:19.394465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-78d745a1-9d47-4de0-a2aa-8ce3759509c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:19.416057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78d745a1-9d47-4de0-a2aa-8ce3759509c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:19.416580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78d745a1-9d47-4de0-a2aa-8ce3759509c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:19.417071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78d745a1-9d47-4de0-a2aa-8ce3759509c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:19.417827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78d745a1-9d47-4de0-a2aa-8ce3759509c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:19.418305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78d745a1-9d47-4de0-a2aa-8ce3759509c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:19.418743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78d745a1-9d47-4de0-a2aa-8ce3759509c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:19.441489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-44f426b4-f05d-49bc-8c64-f9bdfa1fb979 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:19.453089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-44f426b4-f05d-49bc-8c64-f9bdfa1fb979 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:19.455722 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-44f426b4-f05d-49bc-8c64-f9bdfa1fb979 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.833016 Sep 08 13:02:19.461619 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1887/3911] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:18 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:19.683866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9c191fb0-e84b-4806-ae74-afacad5ed263 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:19.686798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9c191fb0-e84b-4806-ae74-afacad5ed263 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:19.702432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c191fb0-e84b-4806-ae74-afacad5ed263 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:19.710020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c191fb0-e84b-4806-ae74-afacad5ed263 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:19.711324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c191fb0-e84b-4806-ae74-afacad5ed263 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:19.713773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c191fb0-e84b-4806-ae74-afacad5ed263 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:19.715041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c191fb0-e84b-4806-ae74-afacad5ed263 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:19.716669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c191fb0-e84b-4806-ae74-afacad5ed263 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:20.029525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-78d745a1-9d47-4de0-a2aa-8ce3759509c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:20.057973 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-78d745a1-9d47-4de0-a2aa-8ce3759509c3 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1667 microversion: 2.1 time: 0.714093 Sep 08 13:02:20.066132 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2025/3912] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:19 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1667 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:20.277918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9c191fb0-e84b-4806-ae74-afacad5ed263 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:20.295150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9c191fb0-e84b-4806-ae74-afacad5ed263 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:20.298321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9c191fb0-e84b-4806-ae74-afacad5ed263 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:20.301496 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9c191fb0-e84b-4806-ae74-afacad5ed263 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 2713 microversion: 2.42 time: 0.631445 Sep 08 13:02:20.302611 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1888/3913] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:19 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 2713 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:20.397481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0f81cb02-ac21-477e-8b8c-ac48326fbf55 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:20.399803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0f81cb02-ac21-477e-8b8c-ac48326fbf55 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:20.430736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f81cb02-ac21-477e-8b8c-ac48326fbf55 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:20.432935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f81cb02-ac21-477e-8b8c-ac48326fbf55 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:20.434374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f81cb02-ac21-477e-8b8c-ac48326fbf55 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:20.436598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f81cb02-ac21-477e-8b8c-ac48326fbf55 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:20.437879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f81cb02-ac21-477e-8b8c-ac48326fbf55 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:20.438771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f81cb02-ac21-477e-8b8c-ac48326fbf55 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:20.443087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-223f6d67-9e7f-4acb-8dde-2f978bbde5c4 req-40c0be33-7dec-4c76-b1da-043640dd0642 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-deleted", "tag": "73bd7edb-2a02-4b55-9210-60c0c223d930"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:20.492674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-223f6d67-9e7f-4acb-8dde-2f978bbde5c4 req-40c0be33-7dec-4c76-b1da-043640dd0642 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:20.500483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-223f6d67-9e7f-4acb-8dde-2f978bbde5c4 req-40c0be33-7dec-4c76-b1da-043640dd0642 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:20.501774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-223f6d67-9e7f-4acb-8dde-2f978bbde5c4 req-40c0be33-7dec-4c76-b1da-043640dd0642 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:20.530399 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-223f6d67-9e7f-4acb-8dde-2f978bbde5c4 req-40c0be33-7dec-4c76-b1da-043640dd0642 service nova] Creating event network-vif-deleted:73bd7edb-2a02-4b55-9210-60c0c223d930 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 13:02:20.541298 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-223f6d67-9e7f-4acb-8dde-2f978bbde5c4 req-40c0be33-7dec-4c76-b1da-043640dd0642 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143148 Sep 08 13:02:20.543617 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1889/3914] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:20.573576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-83b64eed-2f2a-429a-b545-562cbb558738 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:20.576353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-83b64eed-2f2a-429a-b545-562cbb558738 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:20.605224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83b64eed-2f2a-429a-b545-562cbb558738 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:20.606534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83b64eed-2f2a-429a-b545-562cbb558738 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:20.608202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83b64eed-2f2a-429a-b545-562cbb558738 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:20.612898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83b64eed-2f2a-429a-b545-562cbb558738 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:20.616817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83b64eed-2f2a-429a-b545-562cbb558738 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:20.619298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83b64eed-2f2a-429a-b545-562cbb558738 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:20.679338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:21.144385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0f81cb02-ac21-477e-8b8c-ac48326fbf55 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:21.168229 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0f81cb02-ac21-477e-8b8c-ac48326fbf55 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1511 microversion: 2.1 time: 0.780754 Sep 08 13:02:21.169243 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2026/3915] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:20 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1511 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:21.179063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-61402ed3-6498-4e3e-8722-c4ceff88d40d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:21.180926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-61402ed3-6498-4e3e-8722-c4ceff88d40d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:21.194416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61402ed3-6498-4e3e-8722-c4ceff88d40d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:21.195844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61402ed3-6498-4e3e-8722-c4ceff88d40d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:21.198196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61402ed3-6498-4e3e-8722-c4ceff88d40d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:21.200647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61402ed3-6498-4e3e-8722-c4ceff88d40d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:21.202215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61402ed3-6498-4e3e-8722-c4ceff88d40d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:21.203515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61402ed3-6498-4e3e-8722-c4ceff88d40d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:21.489125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-83b64eed-2f2a-429a-b545-562cbb558738 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:21.518161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-83b64eed-2f2a-429a-b545-562cbb558738 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:21.520970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-83b64eed-2f2a-429a-b545-562cbb558738 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:21.524441 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-83b64eed-2f2a-429a-b545-562cbb558738 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.978024 Sep 08 13:02:21.526233 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1890/3916] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:20 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:21.535255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-275070f0-1c0a-4322-8c15-0eff0fbdc2f1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:21.536696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-275070f0-1c0a-4322-8c15-0eff0fbdc2f1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:21.550918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-275070f0-1c0a-4322-8c15-0eff0fbdc2f1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:21.552194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-275070f0-1c0a-4322-8c15-0eff0fbdc2f1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:21.553844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-275070f0-1c0a-4322-8c15-0eff0fbdc2f1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:21.555616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-275070f0-1c0a-4322-8c15-0eff0fbdc2f1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:21.557219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-275070f0-1c0a-4322-8c15-0eff0fbdc2f1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:21.558331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-275070f0-1c0a-4322-8c15-0eff0fbdc2f1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:21.939971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-61402ed3-6498-4e3e-8722-c4ceff88d40d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:21.967269 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-61402ed3-6498-4e3e-8722-c4ceff88d40d tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1667 microversion: 2.1 time: 0.790098 Sep 08 13:02:21.969955 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2027/3917] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:21 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1667 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:22.012625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-275070f0-1c0a-4322-8c15-0eff0fbdc2f1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:22.032271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-275070f0-1c0a-4322-8c15-0eff0fbdc2f1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:22.036512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-275070f0-1c0a-4322-8c15-0eff0fbdc2f1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:22.039996 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-275070f0-1c0a-4322-8c15-0eff0fbdc2f1 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 2552 microversion: 2.42 time: 0.511140 Sep 08 13:02:22.047856 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1891/3918] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:21 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 2552 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:22.227538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-94f2f7a9-e1ef-48de-9c48-231469cd7eb1 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:22.229136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-94f2f7a9-e1ef-48de-9c48-231469cd7eb1 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:22.258590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94f2f7a9-e1ef-48de-9c48-231469cd7eb1 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:22.259381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94f2f7a9-e1ef-48de-9c48-231469cd7eb1 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:22.263501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94f2f7a9-e1ef-48de-9c48-231469cd7eb1 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:22.268828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94f2f7a9-e1ef-48de-9c48-231469cd7eb1 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:22.272820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94f2f7a9-e1ef-48de-9c48-231469cd7eb1 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:22.274009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94f2f7a9-e1ef-48de-9c48-231469cd7eb1 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:22.577171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-73b708ed-dd37-4ce3-a81e-814e2393a540 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:22.580607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-73b708ed-dd37-4ce3-a81e-814e2393a540 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:22.608857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73b708ed-dd37-4ce3-a81e-814e2393a540 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:22.616534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73b708ed-dd37-4ce3-a81e-814e2393a540 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:22.617912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73b708ed-dd37-4ce3-a81e-814e2393a540 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:22.619770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73b708ed-dd37-4ce3-a81e-814e2393a540 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:22.620938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73b708ed-dd37-4ce3-a81e-814e2393a540 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:22.622021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73b708ed-dd37-4ce3-a81e-814e2393a540 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:23.279579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-94f2f7a9-e1ef-48de-9c48-231469cd7eb1 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:23.288944 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-94f2f7a9-e1ef-48de-9c48-231469cd7eb1 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1511 microversion: 2.1 time: 1.078470 Sep 08 13:02:23.292680 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2028/3919] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:22 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1511 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:02:23.306741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-03bee6fc-2c3b-44f2-b066-b1a0bfea7272 req-b98dd14f-e12b-44e5-ba04-87df66e9fdec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-deleted", "tag": "4b26731c-bba7-426c-9edd-565f551fa508"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:23.330895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-03bee6fc-2c3b-44f2-b066-b1a0bfea7272 req-b98dd14f-e12b-44e5-ba04-87df66e9fdec service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:23.331708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-03bee6fc-2c3b-44f2-b066-b1a0bfea7272 req-b98dd14f-e12b-44e5-ba04-87df66e9fdec service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:23.332248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-03bee6fc-2c3b-44f2-b066-b1a0bfea7272 req-b98dd14f-e12b-44e5-ba04-87df66e9fdec service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:23.364882 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-03bee6fc-2c3b-44f2-b066-b1a0bfea7272 req-b98dd14f-e12b-44e5-ba04-87df66e9fdec service nova] Creating event network-vif-deleted:4b26731c-bba7-426c-9edd-565f551fa508 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 13:02:23.389650 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-03bee6fc-2c3b-44f2-b066-b1a0bfea7272 req-b98dd14f-e12b-44e5-ba04-87df66e9fdec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095108 Sep 08 13:02:23.391046 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2029/3920] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:23.420878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d8d367ef-e7e8-48c8-aa82-b45be6769849 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:23.422798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d8d367ef-e7e8-48c8-aa82-b45be6769849 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:23.450453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8d367ef-e7e8-48c8-aa82-b45be6769849 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:23.453433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8d367ef-e7e8-48c8-aa82-b45be6769849 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:23.454505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8d367ef-e7e8-48c8-aa82-b45be6769849 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:23.456265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8d367ef-e7e8-48c8-aa82-b45be6769849 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:23.459472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8d367ef-e7e8-48c8-aa82-b45be6769849 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:23.468988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8d367ef-e7e8-48c8-aa82-b45be6769849 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:23.820971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-73b708ed-dd37-4ce3-a81e-814e2393a540 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:23.860344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-73b708ed-dd37-4ce3-a81e-814e2393a540 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:23.871976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-73b708ed-dd37-4ce3-a81e-814e2393a540 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:23.882993 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-73b708ed-dd37-4ce3-a81e-814e2393a540 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.312772 Sep 08 13:02:23.884646 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1892/3921] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:22 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:23.921042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0e8057c1-d68e-4a13-9ec9-1c9a4c672a07 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:23.924794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0e8057c1-d68e-4a13-9ec9-1c9a4c672a07 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:23.936827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e8057c1-d68e-4a13-9ec9-1c9a4c672a07 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:23.937724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e8057c1-d68e-4a13-9ec9-1c9a4c672a07 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:23.938810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e8057c1-d68e-4a13-9ec9-1c9a4c672a07 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:23.940467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e8057c1-d68e-4a13-9ec9-1c9a4c672a07 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:23.943712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e8057c1-d68e-4a13-9ec9-1c9a4c672a07 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:23.944841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e8057c1-d68e-4a13-9ec9-1c9a4c672a07 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:24.070593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d8d367ef-e7e8-48c8-aa82-b45be6769849 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:24.103807 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d8d367ef-e7e8-48c8-aa82-b45be6769849 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 0.705664 Sep 08 13:02:24.106575 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2030/3922] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:23 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:24.137663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9c3851ba-0605-4870-9b7c-7355c36f7e10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:24.148821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9c3851ba-0605-4870-9b7c-7355c36f7e10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:24.174340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c3851ba-0605-4870-9b7c-7355c36f7e10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:24.175744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c3851ba-0605-4870-9b7c-7355c36f7e10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:24.176924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c3851ba-0605-4870-9b7c-7355c36f7e10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:24.178628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c3851ba-0605-4870-9b7c-7355c36f7e10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:24.180032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c3851ba-0605-4870-9b7c-7355c36f7e10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:24.181718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c3851ba-0605-4870-9b7c-7355c36f7e10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:24.442878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0e8057c1-d68e-4a13-9ec9-1c9a4c672a07 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:24.480276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0e8057c1-d68e-4a13-9ec9-1c9a4c672a07 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:24.489703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0e8057c1-d68e-4a13-9ec9-1c9a4c672a07 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:24.491440 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0e8057c1-d68e-4a13-9ec9-1c9a4c672a07 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 2394 microversion: 2.42 time: 0.591262 Sep 08 13:02:24.498083 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1893/3923] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:23 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 2394 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:24.528574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e58de8bc-7268-48b1-a09a-811384f9f535 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:24.530235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e58de8bc-7268-48b1-a09a-811384f9f535 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:24.550207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e58de8bc-7268-48b1-a09a-811384f9f535 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:24.552159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e58de8bc-7268-48b1-a09a-811384f9f535 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:24.552881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e58de8bc-7268-48b1-a09a-811384f9f535 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:24.555072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e58de8bc-7268-48b1-a09a-811384f9f535 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:24.557866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e58de8bc-7268-48b1-a09a-811384f9f535 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:24.559491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e58de8bc-7268-48b1-a09a-811384f9f535 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:25.915993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9c3851ba-0605-4870-9b7c-7355c36f7e10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:25.947724 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9c3851ba-0605-4870-9b7c-7355c36f7e10 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1670 microversion: 2.1 time: 1.816858 Sep 08 13:02:25.950665 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2031/3924] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:24 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1670 bytes in 1823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:02:25.975589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-331c9cdc-c2ba-44ce-8e03-48cd7720f140 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:25.977240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-331c9cdc-c2ba-44ce-8e03-48cd7720f140 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:25.990247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-331c9cdc-c2ba-44ce-8e03-48cd7720f140 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:25.992291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-331c9cdc-c2ba-44ce-8e03-48cd7720f140 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:25.994008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-331c9cdc-c2ba-44ce-8e03-48cd7720f140 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:25.996196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-331c9cdc-c2ba-44ce-8e03-48cd7720f140 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:25.997471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-331c9cdc-c2ba-44ce-8e03-48cd7720f140 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:25.998762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-331c9cdc-c2ba-44ce-8e03-48cd7720f140 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:26.369563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e58de8bc-7268-48b1-a09a-811384f9f535 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:26.406747 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e58de8bc-7268-48b1-a09a-811384f9f535 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1511 microversion: 2.1 time: 1.905631 Sep 08 13:02:26.412604 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1894/3925] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:24 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1511 bytes in 1913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:26.439007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c37e3273-7420-4d3f-b615-4b76c8534d6c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:26.445025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c37e3273-7420-4d3f-b615-4b76c8534d6c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:26.482426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c37e3273-7420-4d3f-b615-4b76c8534d6c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:26.483375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c37e3273-7420-4d3f-b615-4b76c8534d6c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:26.484170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c37e3273-7420-4d3f-b615-4b76c8534d6c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:26.492195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c37e3273-7420-4d3f-b615-4b76c8534d6c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:26.494169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c37e3273-7420-4d3f-b615-4b76c8534d6c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:26.506203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c37e3273-7420-4d3f-b615-4b76c8534d6c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:26.661109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-331c9cdc-c2ba-44ce-8e03-48cd7720f140 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:26.720991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-331c9cdc-c2ba-44ce-8e03-48cd7720f140 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:26.732531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-331c9cdc-c2ba-44ce-8e03-48cd7720f140 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:26.742386 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-331c9cdc-c2ba-44ce-8e03-48cd7720f140 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.789423 Sep 08 13:02:26.776096 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2032/3926] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:25 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:26.803101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-48faf926-9ff9-42c0-a31e-e83c97e8cfe7 req-8915a266-05c4-4824-bfcd-d65f24d77ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-deleted", "tag": "3466f05e-6efb-423f-9ac1-92190128aa45"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:26.848785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-48faf926-9ff9-42c0-a31e-e83c97e8cfe7 req-8915a266-05c4-4824-bfcd-d65f24d77ce2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:26.856740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-48faf926-9ff9-42c0-a31e-e83c97e8cfe7 req-8915a266-05c4-4824-bfcd-d65f24d77ce2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:26.861942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-48faf926-9ff9-42c0-a31e-e83c97e8cfe7 req-8915a266-05c4-4824-bfcd-d65f24d77ce2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:26.926697 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-48faf926-9ff9-42c0-a31e-e83c97e8cfe7 req-8915a266-05c4-4824-bfcd-d65f24d77ce2 service nova] Creating event network-vif-deleted:3466f05e-6efb-423f-9ac1-92190128aa45 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 13:02:26.954183 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-48faf926-9ff9-42c0-a31e-e83c97e8cfe7 req-8915a266-05c4-4824-bfcd-d65f24d77ce2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168295 Sep 08 13:02:26.957623 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2033/3927] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:26.988683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:26.991354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:27.024440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:27.025955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:27.028300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:27.032336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:27.038514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:27.040079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:27.181873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:02:27.200768 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.compute.api [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Working on deleting snapshot 87dfd9d7-f437-47d8-976a-54a9219efa10 from shelved instance... Sep 08 13:02:28.070375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c37e3273-7420-4d3f-b615-4b76c8534d6c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:28.142421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c37e3273-7420-4d3f-b615-4b76c8534d6c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:28.158480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c37e3273-7420-4d3f-b615-4b76c8534d6c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:28.179134 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c37e3273-7420-4d3f-b615-4b76c8534d6c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 2347 microversion: 2.42 time: 1.757738 Sep 08 13:02:28.210293 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1895/3928] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:26 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 2347 bytes in 1794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:28.228368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f3fe3df5-6a59-4b2b-a725-b43d85f66998 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:28.228368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f3fe3df5-6a59-4b2b-a725-b43d85f66998 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:28.261992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3fe3df5-6a59-4b2b-a725-b43d85f66998 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:28.263078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3fe3df5-6a59-4b2b-a725-b43d85f66998 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:28.263990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3fe3df5-6a59-4b2b-a725-b43d85f66998 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:28.265374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3fe3df5-6a59-4b2b-a725-b43d85f66998 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:28.267140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3fe3df5-6a59-4b2b-a725-b43d85f66998 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:28.267871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3fe3df5-6a59-4b2b-a725-b43d85f66998 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:29.385684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Doing local delete in cell eae6964b-faf8-466e-9843-5d6b1ae075c6(cell1) {{(pid=128970) _delete /opt/stack/nova/nova/compute/api.py:2546}} Sep 08 13:02:29.387067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:29.392962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:29.393312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:29.396874 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.compute.api [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Sep 08 13:02:29.419100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] deallocate_for_instance() {{(pid=128970) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Sep 08 13:02:30.782460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f3fe3df5-6a59-4b2b-a725-b43d85f66998 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:30.838661 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f3fe3df5-6a59-4b2b-a725-b43d85f66998 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1511 microversion: 2.1 time: 2.627201 Sep 08 13:02:30.846553 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1896/3929] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:28 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1511 bytes in 2638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:30.857801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ce9d3d04-57a7-4839-be56-eba606ed23a1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:30.858859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ce9d3d04-57a7-4839-be56-eba606ed23a1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:30.873632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce9d3d04-57a7-4839-be56-eba606ed23a1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:30.891288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce9d3d04-57a7-4839-be56-eba606ed23a1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:30.892552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce9d3d04-57a7-4839-be56-eba606ed23a1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:30.893896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce9d3d04-57a7-4839-be56-eba606ed23a1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:30.895181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce9d3d04-57a7-4839-be56-eba606ed23a1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:30.896296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce9d3d04-57a7-4839-be56-eba606ed23a1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:32.907320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Updating instance_info_cache with network_info: [] {{(pid=128970) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Sep 08 13:02:32.948235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ce9d3d04-57a7-4839-be56-eba606ed23a1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:32.965370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ce9d3d04-57a7-4839-be56-eba606ed23a1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:32.967341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ce9d3d04-57a7-4839-be56-eba606ed23a1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:32.982820 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ce9d3d04-57a7-4839-be56-eba606ed23a1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 2.134126 Sep 08 13:02:32.999946 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1897/3930] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:30 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:33.016634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6ef50a0e-b430-457e-8038-9d59c10d1db0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:33.018843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6ef50a0e-b430-457e-8038-9d59c10d1db0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:33.034819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ef50a0e-b430-457e-8038-9d59c10d1db0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:33.036666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ef50a0e-b430-457e-8038-9d59c10d1db0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:33.040788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ef50a0e-b430-457e-8038-9d59c10d1db0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:33.041873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ef50a0e-b430-457e-8038-9d59c10d1db0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:33.044117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ef50a0e-b430-457e-8038-9d59c10d1db0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:33.044803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ef50a0e-b430-457e-8038-9d59c10d1db0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:33.403838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6ef50a0e-b430-457e-8038-9d59c10d1db0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:33.425479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6ef50a0e-b430-457e-8038-9d59c10d1db0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:33.427211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6ef50a0e-b430-457e-8038-9d59c10d1db0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:33.439824 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6ef50a0e-b430-457e-8038-9d59c10d1db0 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.438684 Sep 08 13:02:33.443318 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1898/3931] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:32 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:33.461064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-679f7628-7954-447e-be56-9f75aabdc3de req-53990262-3f18-4b1e-b7fc-fc68f31fd878 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6", "name": "network-vif-deleted", "tag": "1a42ecce-f9f7-442b-a7d5-6607113087a7"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:33.477613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-679f7628-7954-447e-be56-9f75aabdc3de req-53990262-3f18-4b1e-b7fc-fc68f31fd878 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:33.479178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-679f7628-7954-447e-be56-9f75aabdc3de req-53990262-3f18-4b1e-b7fc-fc68f31fd878 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:33.479794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-679f7628-7954-447e-be56-9f75aabdc3de req-53990262-3f18-4b1e-b7fc-fc68f31fd878 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:33.502402 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-679f7628-7954-447e-be56-9f75aabdc3de req-53990262-3f18-4b1e-b7fc-fc68f31fd878 service nova] Creating event network-vif-deleted:1a42ecce-f9f7-442b-a7d5-6607113087a7 for instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 on n-h1-852084-10 Sep 08 13:02:33.514045 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-679f7628-7954-447e-be56-9f75aabdc3de req-53990262-3f18-4b1e-b7fc-fc68f31fd878 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069484 Sep 08 13:02:33.515525 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1899/3932] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:33.526283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-973aea91-7ef1-4075-8809-8676c28769e3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:33.529128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-973aea91-7ef1-4075-8809-8676c28769e3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:33.539961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-973aea91-7ef1-4075-8809-8676c28769e3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:33.546088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-973aea91-7ef1-4075-8809-8676c28769e3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:33.554461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-973aea91-7ef1-4075-8809-8676c28769e3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:33.555845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-973aea91-7ef1-4075-8809-8676c28769e3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:33.557472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-973aea91-7ef1-4075-8809-8676c28769e3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:33.560588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-973aea91-7ef1-4075-8809-8676c28769e3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:34.043887 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b625197d-c6a6-41c5-97db-d19a748e0591 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "DELETE /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 204 len: 0 microversion: 2.1 time: 7.083418 Sep 08 13:02:34.046030 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2034/3933] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:26 2022] DELETE /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 0 bytes in 7088 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:02:34.062770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d2eb3e04-a382-4115-98a5-3f70ba220c7a req-67e54165-3275-4d1a-8bbf-5b1b91f8ee88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50a71f0f-f2e1-45b0-9c8d-fee16d9b4840", "name": "network-vif-deleted", "tag": "9881bbfc-f0e8-43c0-a5c4-68f7e0961d4e"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:34.083897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d2eb3e04-a382-4115-98a5-3f70ba220c7a req-67e54165-3275-4d1a-8bbf-5b1b91f8ee88 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:34.085119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d2eb3e04-a382-4115-98a5-3f70ba220c7a req-67e54165-3275-4d1a-8bbf-5b1b91f8ee88 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:34.086378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d2eb3e04-a382-4115-98a5-3f70ba220c7a req-67e54165-3275-4d1a-8bbf-5b1b91f8ee88 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:34.097210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=79,nova_cell1:INSERT=1,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:34.116675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.compute.server_external_events [req-d2eb3e04-a382-4115-98a5-3f70ba220c7a req-67e54165-3275-4d1a-8bbf-5b1b91f8ee88 service nova] Unable to find a host for instance 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840. Dropping event network-vif-deleted {{(pid=128970) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 13:02:34.120961 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d2eb3e04-a382-4115-98a5-3f70ba220c7a req-67e54165-3275-4d1a-8bbf-5b1b91f8ee88 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.071866 Sep 08 13:02:34.122961 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2035/3934] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 76 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 13:02:34.132912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3ea9123c-12f2-41d5-8e53-19e8340ebc99 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:34.136991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3ea9123c-12f2-41d5-8e53-19e8340ebc99 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:34.160208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ea9123c-12f2-41d5-8e53-19e8340ebc99 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:34.161154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ea9123c-12f2-41d5-8e53-19e8340ebc99 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:34.162035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ea9123c-12f2-41d5-8e53-19e8340ebc99 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:34.163507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ea9123c-12f2-41d5-8e53-19e8340ebc99 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:34.164287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ea9123c-12f2-41d5-8e53-19e8340ebc99 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:34.165027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ea9123c-12f2-41d5-8e53-19e8340ebc99 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:34.852067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-973aea91-7ef1-4075-8809-8676c28769e3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:34.864139 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-973aea91-7ef1-4075-8809-8676c28769e3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1488 microversion: 2.1 time: 1.347079 Sep 08 13:02:34.864737 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1900/3935] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:33 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1488 bytes in 1348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:34.876769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d0cf0627-2e7c-47e4-b106-7a71086a7f90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:34.877429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d0cf0627-2e7c-47e4-b106-7a71086a7f90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:34.896833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0cf0627-2e7c-47e4-b106-7a71086a7f90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:34.897603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0cf0627-2e7c-47e4-b106-7a71086a7f90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:34.898210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0cf0627-2e7c-47e4-b106-7a71086a7f90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:34.899116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0cf0627-2e7c-47e4-b106-7a71086a7f90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:34.900306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0cf0627-2e7c-47e4-b106-7a71086a7f90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:34.900905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0cf0627-2e7c-47e4-b106-7a71086a7f90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:34.936575 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-d0cf0627-2e7c-47e4-b106-7a71086a7f90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] HTTP exception thrown: Instance 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 could not be found. Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d0cf0627-2e7c-47e4-b106-7a71086a7f90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Request method failure captured: Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 HTTP/1.1 Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVJlpIUu4I3etLbEARIZH8KBjvhrlSlsNaLxWsUVVjxg7DGa1gDBkjoWynkMnF04mkRKPOu0mP64ZnQqdnNZ67aOntgfBqoqUU7VATzwJXlIjY4wY2V0n8uOV_tKF-BjMvxYlC2i-O3RjgSypdvXI4jXqJB4nuGXejMn4MVXpX9mCw Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 59dc0decb175444491383c39918c5b2e Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerActionsTestJSON-204893554 Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_59dc0decb175444491383c39918c5b2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/59dc0decb175444491383c39918c5b2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59dc0decb175444491383c39918c5b2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59dc0decb175444491383c39918c5b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerActionsTestJSON-204893554 Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 59dc0decb175444491383c39918c5b2e Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerActionsTestJSON-204893554 Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerActionsTestJSON-204893554-project Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 4140a06bc6934d7780ef9ff3e30e6dd5 Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerActionsTestJSON-204893554-project Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 could not be found. Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '50a71f0f-f2e1-45b0-9c8d-fee16d9b4840'} Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 could not be found. Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 could not be found. Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:34.939407 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:34.943855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:34.943855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:34.943855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:34.943855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:34.943855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:34.943855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 could not be found. Sep 08 13:02:34.943855 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:34.946578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d0cf0627-2e7c-47e4-b106-7a71086a7f90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Returning 404 to user: Instance 50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:34.960610 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d0cf0627-2e7c-47e4-b106-7a71086a7f90 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840" status: 404 len: 111 microversion: 2.1 time: 0.091970 Sep 08 13:02:34.961923 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1901/3936] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:34 2022] GET /compute/v2.1/servers/50a71f0f-f2e1-45b0-9c8d-fee16d9b4840 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:34.981707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7f22629b-af16-431b-8284-610a87875914 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:34.984407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f22629b-af16-431b-8284-610a87875914 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:35.000608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f22629b-af16-431b-8284-610a87875914 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:35.001451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f22629b-af16-431b-8284-610a87875914 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:35.002096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f22629b-af16-431b-8284-610a87875914 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:35.006633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f22629b-af16-431b-8284-610a87875914 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:35.007937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f22629b-af16-431b-8284-610a87875914 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:35.008605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f22629b-af16-431b-8284-610a87875914 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:35.367639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7f22629b-af16-431b-8284-610a87875914 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:35.381855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7f22629b-af16-431b-8284-610a87875914 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:35.383697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7f22629b-af16-431b-8284-610a87875914 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:35.390529 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7f22629b-af16-431b-8284-610a87875914 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.426226 Sep 08 13:02:35.391136 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1902/3937] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:34 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:35.405359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bb8ca99b-026b-4974-8a9b-073191dbaee8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-52317602"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:35.410244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bb8ca99b-026b-4974-8a9b-073191dbaee8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:35.439644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb8ca99b-026b-4974-8a9b-073191dbaee8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:35.442601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb8ca99b-026b-4974-8a9b-073191dbaee8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:35.443359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb8ca99b-026b-4974-8a9b-073191dbaee8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:35.446130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb8ca99b-026b-4974-8a9b-073191dbaee8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:35.450313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb8ca99b-026b-4974-8a9b-073191dbaee8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:35.451017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bb8ca99b-026b-4974-8a9b-073191dbaee8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:35.567460 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bb8ca99b-026b-4974-8a9b-073191dbaee8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "PUT /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1060 microversion: 2.1 time: 0.173019 Sep 08 13:02:35.569136 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1903/3938] 10.222.0.78 () {60 vars in 1256 bytes} [Thu Sep 8 13:02:35 2022] PUT /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1060 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:35.577273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f28b6555-3c42-4516-a48f-2764edde6808 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:35.578462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f28b6555-3c42-4516-a48f-2764edde6808 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:35.586452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f28b6555-3c42-4516-a48f-2764edde6808 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:35.588046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f28b6555-3c42-4516-a48f-2764edde6808 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:35.589633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f28b6555-3c42-4516-a48f-2764edde6808 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:35.590697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f28b6555-3c42-4516-a48f-2764edde6808 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:35.591481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f28b6555-3c42-4516-a48f-2764edde6808 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:35.592141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f28b6555-3c42-4516-a48f-2764edde6808 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:35.663748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f28b6555-3c42-4516-a48f-2764edde6808 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:02:35.958243 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f28b6555-3c42-4516-a48f-2764edde6808 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "DELETE /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 204 len: 0 microversion: 2.1 time: 0.386443 Sep 08 13:02:35.964338 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1904/3939] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:35 2022] DELETE /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:02:35.976854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1e55f646-0c3f-4700-94a4-f38caccb0fa4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:35.980232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1e55f646-0c3f-4700-94a4-f38caccb0fa4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:35.989577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3ea9123c-12f2-41d5-8e53-19e8340ebc99 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:35.997213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e55f646-0c3f-4700-94a4-f38caccb0fa4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:36.003816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e55f646-0c3f-4700-94a4-f38caccb0fa4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:36.005582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e55f646-0c3f-4700-94a4-f38caccb0fa4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:36.007480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e55f646-0c3f-4700-94a4-f38caccb0fa4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:36.007677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3ea9123c-12f2-41d5-8e53-19e8340ebc99 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:36.008421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e55f646-0c3f-4700-94a4-f38caccb0fa4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:36.009061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3ea9123c-12f2-41d5-8e53-19e8340ebc99 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:36.009265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e55f646-0c3f-4700-94a4-f38caccb0fa4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:36.010327 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3ea9123c-12f2-41d5-8e53-19e8340ebc99 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.885678 Sep 08 13:02:36.011047 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2036/3940] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:34 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:36.034924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-78af4902-3f68-43a8-9b60-a76d41e49da7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:36.035718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-78af4902-3f68-43a8-9b60-a76d41e49da7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:36.044044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78af4902-3f68-43a8-9b60-a76d41e49da7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:36.044985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78af4902-3f68-43a8-9b60-a76d41e49da7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:36.045709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78af4902-3f68-43a8-9b60-a76d41e49da7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:36.046765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78af4902-3f68-43a8-9b60-a76d41e49da7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:36.047650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78af4902-3f68-43a8-9b60-a76d41e49da7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:36.048345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78af4902-3f68-43a8-9b60-a76d41e49da7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:36.308903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-78af4902-3f68-43a8-9b60-a76d41e49da7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:36.321190 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-78af4902-3f68-43a8-9b60-a76d41e49da7 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 200 len: 1467 microversion: 2.1 time: 0.296518 Sep 08 13:02:36.322704 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2037/3941] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:36 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 1467 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:36.423819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9d0e3dc6-cc82-463e-9015-f26dfe54b206 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:36.424825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9d0e3dc6-cc82-463e-9015-f26dfe54b206 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:36.432330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1e55f646-0c3f-4700-94a4-f38caccb0fa4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:36.437712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d0e3dc6-cc82-463e-9015-f26dfe54b206 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:36.438479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d0e3dc6-cc82-463e-9015-f26dfe54b206 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:36.439156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d0e3dc6-cc82-463e-9015-f26dfe54b206 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:36.440199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d0e3dc6-cc82-463e-9015-f26dfe54b206 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:36.441095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d0e3dc6-cc82-463e-9015-f26dfe54b206 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:36.442622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d0e3dc6-cc82-463e-9015-f26dfe54b206 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:36.451947 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1e55f646-0c3f-4700-94a4-f38caccb0fa4 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1487 microversion: 2.1 time: 0.488446 Sep 08 13:02:36.454480 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1905/3942] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:35 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1487 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:36.486827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f4d01d85-abca-4054-bcd2-c082714fbded tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:36.487495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f4d01d85-abca-4054-bcd2-c082714fbded tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:36.497475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:36.508785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4d01d85-abca-4054-bcd2-c082714fbded tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:36.510154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4d01d85-abca-4054-bcd2-c082714fbded tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:36.510678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4d01d85-abca-4054-bcd2-c082714fbded tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:36.515873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4d01d85-abca-4054-bcd2-c082714fbded tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:36.516438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4d01d85-abca-4054-bcd2-c082714fbded tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:36.517204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4d01d85-abca-4054-bcd2-c082714fbded tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:36.530817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:36.750536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d0e3dc6-cc82-463e-9015-f26dfe54b206 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:36.763138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d0e3dc6-cc82-463e-9015-f26dfe54b206 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:36.782616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d0e3dc6-cc82-463e-9015-f26dfe54b206 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:36.789947 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9d0e3dc6-cc82-463e-9015-f26dfe54b206 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.371226 Sep 08 13:02:36.791510 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2038/3943] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:36 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:02:36.969954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f4d01d85-abca-4054-bcd2-c082714fbded tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:37.010000 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f4d01d85-abca-4054-bcd2-c082714fbded tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1487 microversion: 2.1 time: 0.520446 Sep 08 13:02:37.022836 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1906/3944] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:36 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1487 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:02:37.042404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-25fbbfb8-2bba-49d0-b965-b893bdcda508 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:37.043840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-25fbbfb8-2bba-49d0-b965-b893bdcda508 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:37.061064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25fbbfb8-2bba-49d0-b965-b893bdcda508 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:37.061922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b88a9d0-dd62-4c1f-a849-b7a3abf3c146 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:37.062531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25fbbfb8-2bba-49d0-b965-b893bdcda508 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:37.062802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5b88a9d0-dd62-4c1f-a849-b7a3abf3c146 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:37.063484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25fbbfb8-2bba-49d0-b965-b893bdcda508 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:37.065164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25fbbfb8-2bba-49d0-b965-b893bdcda508 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:37.066316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25fbbfb8-2bba-49d0-b965-b893bdcda508 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:37.067861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25fbbfb8-2bba-49d0-b965-b893bdcda508 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:37.133241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b88a9d0-dd62-4c1f-a849-b7a3abf3c146 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:37.134352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b88a9d0-dd62-4c1f-a849-b7a3abf3c146 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:37.135147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b88a9d0-dd62-4c1f-a849-b7a3abf3c146 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:37.145622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b88a9d0-dd62-4c1f-a849-b7a3abf3c146 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:37.148902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b88a9d0-dd62-4c1f-a849-b7a3abf3c146 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:37.156104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b88a9d0-dd62-4c1f-a849-b7a3abf3c146 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:37.301886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5b88a9d0-dd62-4c1f-a849-b7a3abf3c146 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:02:37.692918 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5b88a9d0-dd62-4c1f-a849-b7a3abf3c146 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 204 len: 0 microversion: 2.1 time: 0.641518 Sep 08 13:02:37.694712 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1907/3945] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:37 2022] DELETE /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:02:37.709523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-179c701e-0b79-4988-9028-9e924a03c428 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:37.714044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-179c701e-0b79-4988-9028-9e924a03c428 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:37.729017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-179c701e-0b79-4988-9028-9e924a03c428 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:37.729839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-179c701e-0b79-4988-9028-9e924a03c428 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:37.735805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-179c701e-0b79-4988-9028-9e924a03c428 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:37.738947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-179c701e-0b79-4988-9028-9e924a03c428 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:37.740082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-179c701e-0b79-4988-9028-9e924a03c428 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:37.741504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-179c701e-0b79-4988-9028-9e924a03c428 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:37.967415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-25fbbfb8-2bba-49d0-b965-b893bdcda508 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:37.983035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-25fbbfb8-2bba-49d0-b965-b893bdcda508 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:37.985189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-25fbbfb8-2bba-49d0-b965-b893bdcda508 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:37.990740 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-25fbbfb8-2bba-49d0-b965-b893bdcda508 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.951178 Sep 08 13:02:38.013763 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2039/3946] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:37 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:38.027767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ed256e7c-5bd3-462f-b53e-dafb8f7b8373 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:38.031352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ed256e7c-5bd3-462f-b53e-dafb8f7b8373 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:38.047954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed256e7c-5bd3-462f-b53e-dafb8f7b8373 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:38.050153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed256e7c-5bd3-462f-b53e-dafb8f7b8373 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:38.050947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed256e7c-5bd3-462f-b53e-dafb8f7b8373 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:38.052025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed256e7c-5bd3-462f-b53e-dafb8f7b8373 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:38.054525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed256e7c-5bd3-462f-b53e-dafb8f7b8373 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:38.056664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed256e7c-5bd3-462f-b53e-dafb8f7b8373 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:38.253429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-179c701e-0b79-4988-9028-9e924a03c428 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:38.276367 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-179c701e-0b79-4988-9028-9e924a03c428 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 200 len: 1467 microversion: 2.1 time: 0.577185 Sep 08 13:02:38.279168 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1908/3947] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:37 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 1467 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:38.294060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d11ee6aa-6951-4335-84bd-8250372e9119 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:38.295193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d11ee6aa-6951-4335-84bd-8250372e9119 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:38.312405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d11ee6aa-6951-4335-84bd-8250372e9119 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:38.313303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d11ee6aa-6951-4335-84bd-8250372e9119 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:38.315368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d11ee6aa-6951-4335-84bd-8250372e9119 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:38.317359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d11ee6aa-6951-4335-84bd-8250372e9119 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:38.319036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d11ee6aa-6951-4335-84bd-8250372e9119 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:38.320596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d11ee6aa-6951-4335-84bd-8250372e9119 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:38.732279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ed256e7c-5bd3-462f-b53e-dafb8f7b8373 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:38.754886 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ed256e7c-5bd3-462f-b53e-dafb8f7b8373 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1493 microversion: 2.1 time: 0.732337 Sep 08 13:02:38.755878 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2040/3948] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:38 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1493 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:38.786913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d11ee6aa-6951-4335-84bd-8250372e9119 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:38.809963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d11ee6aa-6951-4335-84bd-8250372e9119 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:38.816666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d11ee6aa-6951-4335-84bd-8250372e9119 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:38.818226 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d11ee6aa-6951-4335-84bd-8250372e9119 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.536496 Sep 08 13:02:38.824535 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1909/3949] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:38 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:39.025570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0f059315-6c6b-41bf-bdbb-7585adb15287 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:39.026197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0f059315-6c6b-41bf-bdbb-7585adb15287 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:39.050126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f059315-6c6b-41bf-bdbb-7585adb15287 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:39.059254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f059315-6c6b-41bf-bdbb-7585adb15287 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:39.061414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f059315-6c6b-41bf-bdbb-7585adb15287 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:39.069017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f059315-6c6b-41bf-bdbb-7585adb15287 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:39.072051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f059315-6c6b-41bf-bdbb-7585adb15287 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:39.074946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f059315-6c6b-41bf-bdbb-7585adb15287 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:39.157918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-605531780", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": "none"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:39.325343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:02:39.326209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:02:39.326721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:02:39.328172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:02:39.328644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:02:39.356712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:39.357210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:39.357644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:39.361068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:39.361658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:39.364101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:39.423070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Getting quotas for project 88f2abf7107b42b6b73d50ec37014b2f. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:02:39.447432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Getting quotas for user 1e86019aa14544f8b874fb3c3d2037ed and project 88f2abf7107b42b6b73d50ec37014b2f. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:02:39.489996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:02:39.492925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] [instance: 227be722-d60b-4739-908b-4cf4f43a2a8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:02:39.630440 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-81bfbb17-75f2-4cf9-bb5e-069db0ddd748 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.866234 Sep 08 13:02:39.654863 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2041/3950] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 13:02:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 13:02:39.688443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-62bd579b-6900-4ffa-a2b0-e7d0f0c462ee tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:39.689621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-62bd579b-6900-4ffa-a2b0-e7d0f0c462ee tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:39.727534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62bd579b-6900-4ffa-a2b0-e7d0f0c462ee tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:39.730848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62bd579b-6900-4ffa-a2b0-e7d0f0c462ee tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:39.733760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62bd579b-6900-4ffa-a2b0-e7d0f0c462ee tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:39.735215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62bd579b-6900-4ffa-a2b0-e7d0f0c462ee tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:39.741608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62bd579b-6900-4ffa-a2b0-e7d0f0c462ee tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:39.742538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62bd579b-6900-4ffa-a2b0-e7d0f0c462ee tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:41.606572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-62bd579b-6900-4ffa-a2b0-e7d0f0c462ee tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:41.630026 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-62bd579b-6900-4ffa-a2b0-e7d0f0c462ee tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 200 len: 1467 microversion: 2.1 time: 1.972666 Sep 08 13:02:41.652180 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2042/3951] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:39 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 1467 bytes in 1996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:41.657421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52af97f1-48c5-4d79-a1db-70e9f0cb36e9 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:41.658054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-52af97f1-48c5-4d79-a1db-70e9f0cb36e9 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] [instance: 227be722-d60b-4739-908b-4cf4f43a2a8c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:41.664465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:41.666838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52af97f1-48c5-4d79-a1db-70e9f0cb36e9 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:41.667763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52af97f1-48c5-4d79-a1db-70e9f0cb36e9 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:41.668599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52af97f1-48c5-4d79-a1db-70e9f0cb36e9 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:41.669526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52af97f1-48c5-4d79-a1db-70e9f0cb36e9 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:41.670156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52af97f1-48c5-4d79-a1db-70e9f0cb36e9 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:41.670737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52af97f1-48c5-4d79-a1db-70e9f0cb36e9 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:41.997321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0f059315-6c6b-41bf-bdbb-7585adb15287 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:42.048326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0f059315-6c6b-41bf-bdbb-7585adb15287 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:42.059709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0f059315-6c6b-41bf-bdbb-7585adb15287 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:42.064959 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0f059315-6c6b-41bf-bdbb-7585adb15287 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 3.042749 Sep 08 13:02:42.066310 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1910/3952] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:39 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 3046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:42.077622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7572cce5-87d1-449b-a2db-52d645987086 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:42.089665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7572cce5-87d1-449b-a2db-52d645987086 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:42.113350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7572cce5-87d1-449b-a2db-52d645987086 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:42.121596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7572cce5-87d1-449b-a2db-52d645987086 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:42.122993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7572cce5-87d1-449b-a2db-52d645987086 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:42.125918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7572cce5-87d1-449b-a2db-52d645987086 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:42.127101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7572cce5-87d1-449b-a2db-52d645987086 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:42.130762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7572cce5-87d1-449b-a2db-52d645987086 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:42.286649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-52af97f1-48c5-4d79-a1db-70e9f0cb36e9 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:42.302138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-52af97f1-48c5-4d79-a1db-70e9f0cb36e9 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:42.309688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-52af97f1-48c5-4d79-a1db-70e9f0cb36e9 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:42.313762 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-52af97f1-48c5-4d79-a1db-70e9f0cb36e9 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] 10.222.0.78 "GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c" status: 200 len: 1276 microversion: 2.47 time: 0.658390 Sep 08 13:02:42.316037 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2043/3953] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:41 2022] GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c => generated 1276 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:42.328276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5e3c76f8-be09-4731-bc97-c269dae3e032 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:42.329503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5e3c76f8-be09-4731-bc97-c269dae3e032 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:42.350996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e3c76f8-be09-4731-bc97-c269dae3e032 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:42.357840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e3c76f8-be09-4731-bc97-c269dae3e032 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:42.358548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e3c76f8-be09-4731-bc97-c269dae3e032 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:42.359765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e3c76f8-be09-4731-bc97-c269dae3e032 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:42.360668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e3c76f8-be09-4731-bc97-c269dae3e032 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:42.361362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e3c76f8-be09-4731-bc97-c269dae3e032 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:42.799201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5e3c76f8-be09-4731-bc97-c269dae3e032 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:42.832561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5e3c76f8-be09-4731-bc97-c269dae3e032 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:42.834179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5e3c76f8-be09-4731-bc97-c269dae3e032 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:42.851604 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5e3c76f8-be09-4731-bc97-c269dae3e032 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.529101 Sep 08 13:02:42.853235 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2044/3954] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:42 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:42.869785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-67cb0e37-3db8-4bc6-ace9-2c5747ec76da tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:42.891530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-67cb0e37-3db8-4bc6-ace9-2c5747ec76da tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:42.917401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67cb0e37-3db8-4bc6-ace9-2c5747ec76da tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:42.933804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67cb0e37-3db8-4bc6-ace9-2c5747ec76da tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:42.939196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67cb0e37-3db8-4bc6-ace9-2c5747ec76da tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:42.942439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67cb0e37-3db8-4bc6-ace9-2c5747ec76da tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:42.943465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67cb0e37-3db8-4bc6-ace9-2c5747ec76da tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:42.948016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67cb0e37-3db8-4bc6-ace9-2c5747ec76da tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:44.334897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-67cb0e37-3db8-4bc6-ace9-2c5747ec76da tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:44.377821 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-67cb0e37-3db8-4bc6-ace9-2c5747ec76da tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 200 len: 1467 microversion: 2.1 time: 1.516921 Sep 08 13:02:44.382488 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2045/3955] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:42 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 1467 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:44.428315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fcc74c36-a743-487b-b74d-a72d8d43af43 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:44.439145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fcc74c36-a743-487b-b74d-a72d8d43af43 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:44.476421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcc74c36-a743-487b-b74d-a72d8d43af43 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:44.479955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcc74c36-a743-487b-b74d-a72d8d43af43 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:44.488688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcc74c36-a743-487b-b74d-a72d8d43af43 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:44.490613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcc74c36-a743-487b-b74d-a72d8d43af43 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:44.492382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcc74c36-a743-487b-b74d-a72d8d43af43 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:44.496496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcc74c36-a743-487b-b74d-a72d8d43af43 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:45.391219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7572cce5-87d1-449b-a2db-52d645987086 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:45.407109 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7572cce5-87d1-449b-a2db-52d645987086 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 200 len: 1493 microversion: 2.1 time: 3.335185 Sep 08 13:02:45.407815 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1911/3956] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:42 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 1493 bytes in 3337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:45.416797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3b4417a2-b242-4dcf-9061-730057f68629 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:45.417294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3b4417a2-b242-4dcf-9061-730057f68629 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] [instance: 227be722-d60b-4739-908b-4cf4f43a2a8c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:45.445609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b4417a2-b242-4dcf-9061-730057f68629 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:45.446902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b4417a2-b242-4dcf-9061-730057f68629 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:45.452278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b4417a2-b242-4dcf-9061-730057f68629 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:45.453347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b4417a2-b242-4dcf-9061-730057f68629 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:45.453997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b4417a2-b242-4dcf-9061-730057f68629 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:45.454649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b4417a2-b242-4dcf-9061-730057f68629 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:46.408926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fcc74c36-a743-487b-b74d-a72d8d43af43 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:46.447324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b4417a2-b242-4dcf-9061-730057f68629 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:46.468777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fcc74c36-a743-487b-b74d-a72d8d43af43 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:46.473311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fcc74c36-a743-487b-b74d-a72d8d43af43 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:46.489987 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fcc74c36-a743-487b-b74d-a72d8d43af43 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 2.105426 Sep 08 13:02:46.492008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b4417a2-b242-4dcf-9061-730057f68629 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:46.492373 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2046/3957] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:44 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 2109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:46.496577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b4417a2-b242-4dcf-9061-730057f68629 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:46.506242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3bcd3d35-bf4b-4644-8227-823e28399d5c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:46.514526 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3b4417a2-b242-4dcf-9061-730057f68629 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] 10.222.0.78 "GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c" status: 200 len: 1338 microversion: 2.47 time: 1.105168 Sep 08 13:02:46.529705 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1912/3958] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:45 2022] GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c => generated 1338 bytes in 1121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:46.552488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3bcd3d35-bf4b-4644-8227-823e28399d5c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:46.563346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-851c8458-85c9-4ef2-bd30-b079a0dc786a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:46.565114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-851c8458-85c9-4ef2-bd30-b079a0dc786a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:46.576940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-851c8458-85c9-4ef2-bd30-b079a0dc786a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:46.578178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-851c8458-85c9-4ef2-bd30-b079a0dc786a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:46.579253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-851c8458-85c9-4ef2-bd30-b079a0dc786a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:46.581022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-851c8458-85c9-4ef2-bd30-b079a0dc786a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:46.582149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-851c8458-85c9-4ef2-bd30-b079a0dc786a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:46.583167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-851c8458-85c9-4ef2-bd30-b079a0dc786a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:46.595050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d35-bf4b-4644-8227-823e28399d5c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:46.596014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d35-bf4b-4644-8227-823e28399d5c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:46.596806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d35-bf4b-4644-8227-823e28399d5c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:46.598096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d35-bf4b-4644-8227-823e28399d5c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:46.598902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d35-bf4b-4644-8227-823e28399d5c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:46.611972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bcd3d35-bf4b-4644-8227-823e28399d5c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:47.930205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3bcd3d35-bf4b-4644-8227-823e28399d5c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:47.935125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-851c8458-85c9-4ef2-bd30-b079a0dc786a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:47.947697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3bcd3d35-bf4b-4644-8227-823e28399d5c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:47.953904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3bcd3d35-bf4b-4644-8227-823e28399d5c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:47.956897 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3bcd3d35-bf4b-4644-8227-823e28399d5c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 1.458339 Sep 08 13:02:47.980238 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2047/3959] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:46 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 1482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:47.990323 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-851c8458-85c9-4ef2-bd30-b079a0dc786a tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 200 len: 1467 microversion: 2.1 time: 1.454185 Sep 08 13:02:47.995869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a1012030-da1c-47cb-8657-395d18a14e91 req-6b897fce-d3d5-4d80-a1a3-d8bd192f5f69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3433475a-6253-474c-9bdc-734b385ae282", "name": "network-vif-deleted", "tag": "790a60f6-25f6-497c-88dc-c28896334bc6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:48.016509 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1913/3960] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:46 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 1467 bytes in 1486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:48.018985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a1012030-da1c-47cb-8657-395d18a14e91 req-6b897fce-d3d5-4d80-a1a3-d8bd192f5f69 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:48.019872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a1012030-da1c-47cb-8657-395d18a14e91 req-6b897fce-d3d5-4d80-a1a3-d8bd192f5f69 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:48.020556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a1012030-da1c-47cb-8657-395d18a14e91 req-6b897fce-d3d5-4d80-a1a3-d8bd192f5f69 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:48.037949 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a1012030-da1c-47cb-8657-395d18a14e91 req-6b897fce-d3d5-4d80-a1a3-d8bd192f5f69 service nova] Creating event network-vif-deleted:790a60f6-25f6-497c-88dc-c28896334bc6 for instance 3433475a-6253-474c-9bdc-734b385ae282 on n-h2-852084-10 Sep 08 13:02:48.044536 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a1012030-da1c-47cb-8657-395d18a14e91 req-6b897fce-d3d5-4d80-a1a3-d8bd192f5f69 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062160 Sep 08 13:02:48.045947 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2048/3961] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:48.051082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7580edc3-c764-45c0-936d-2c8c53fdc00d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:48.052633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7580edc3-c764-45c0-936d-2c8c53fdc00d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:48.053689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc2b4c13-4588-4edd-9b29-94115ec2fd93 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:48.054923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc2b4c13-4588-4edd-9b29-94115ec2fd93 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:48.063442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc2b4c13-4588-4edd-9b29-94115ec2fd93 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:48.064363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc2b4c13-4588-4edd-9b29-94115ec2fd93 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:48.065051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc2b4c13-4588-4edd-9b29-94115ec2fd93 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:48.066058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc2b4c13-4588-4edd-9b29-94115ec2fd93 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:48.066816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc2b4c13-4588-4edd-9b29-94115ec2fd93 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:48.067532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc2b4c13-4588-4edd-9b29-94115ec2fd93 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:48.075635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7580edc3-c764-45c0-936d-2c8c53fdc00d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:48.076712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7580edc3-c764-45c0-936d-2c8c53fdc00d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:48.078335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7580edc3-c764-45c0-936d-2c8c53fdc00d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:48.080559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7580edc3-c764-45c0-936d-2c8c53fdc00d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:48.081444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7580edc3-c764-45c0-936d-2c8c53fdc00d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:48.082253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7580edc3-c764-45c0-936d-2c8c53fdc00d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:48.123161 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-7580edc3-c764-45c0-936d-2c8c53fdc00d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7580edc3-c764-45c0-936d-2c8c53fdc00d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 HTTP/1.1 Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '3433475a-6253-474c-9bdc-734b385ae282'} Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:48.128257 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:48.141731 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:48.141731 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:48.141731 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:48.141731 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:48.141731 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:48.141731 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:48.145735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7580edc3-c764-45c0-936d-2c8c53fdc00d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:48.148150 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7580edc3-c764-45c0-936d-2c8c53fdc00d tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 404 len: 111 microversion: 2.1 time: 0.129441 Sep 08 13:02:48.154549 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1914/3962] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:48 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:48.166234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3d99948e-0514-4138-b552-fa313ca828ff tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:48.168053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3d99948e-0514-4138-b552-fa313ca828ff tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] [instance: 227be722-d60b-4739-908b-4cf4f43a2a8c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:48.202471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d99948e-0514-4138-b552-fa313ca828ff tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:48.204013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d99948e-0514-4138-b552-fa313ca828ff tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:48.206800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d99948e-0514-4138-b552-fa313ca828ff tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:48.209714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d99948e-0514-4138-b552-fa313ca828ff tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:48.212007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d99948e-0514-4138-b552-fa313ca828ff tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:48.213301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d99948e-0514-4138-b552-fa313ca828ff tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:48.643574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3d99948e-0514-4138-b552-fa313ca828ff tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:48.666139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3d99948e-0514-4138-b552-fa313ca828ff tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:48.669435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3d99948e-0514-4138-b552-fa313ca828ff tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:48.674753 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3d99948e-0514-4138-b552-fa313ca828ff tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] 10.222.0.78 "GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c" status: 200 len: 1359 microversion: 2.47 time: 0.515800 Sep 08 13:02:48.675884 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1915/3963] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:48 2022] GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c => generated 1359 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:48.682369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44b09cb6-0b30-4e70-949a-dba17aa333dc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:48.683256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-44b09cb6-0b30-4e70-949a-dba17aa333dc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:48.691104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b09cb6-0b30-4e70-949a-dba17aa333dc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:48.691901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b09cb6-0b30-4e70-949a-dba17aa333dc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:48.695404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b09cb6-0b30-4e70-949a-dba17aa333dc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:48.696573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b09cb6-0b30-4e70-949a-dba17aa333dc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:48.697220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b09cb6-0b30-4e70-949a-dba17aa333dc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:48.697820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b09cb6-0b30-4e70-949a-dba17aa333dc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:48.724151 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-44b09cb6-0b30-4e70-949a-dba17aa333dc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44b09cb6-0b30-4e70-949a-dba17aa333dc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 HTTP/1.1 Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '3433475a-6253-474c-9bdc-734b385ae282'} Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:48.727076 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:48.731331 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:48.731331 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:48.731331 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:48.731331 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:48.731331 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:48.731331 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:48.731331 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:48.731331 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:48.731331 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:48.731331 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:48.734667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44b09cb6-0b30-4e70-949a-dba17aa333dc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:48.736818 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-44b09cb6-0b30-4e70-949a-dba17aa333dc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 404 len: 111 microversion: 2.1 time: 0.059694 Sep 08 13:02:48.739508 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1916/3964] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:48 2022] DELETE /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:48.758015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-12220470-65a1-4498-94de-df1ecb80fabe tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1812234386"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:48.763359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-12220470-65a1-4498-94de-df1ecb80fabe tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] [instance: 227be722-d60b-4739-908b-4cf4f43a2a8c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:48.797001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12220470-65a1-4498-94de-df1ecb80fabe tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:48.799552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12220470-65a1-4498-94de-df1ecb80fabe tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:48.802126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12220470-65a1-4498-94de-df1ecb80fabe tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:48.802830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12220470-65a1-4498-94de-df1ecb80fabe tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:48.803367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12220470-65a1-4498-94de-df1ecb80fabe tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:48.803800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12220470-65a1-4498-94de-df1ecb80fabe tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.044681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc2b4c13-4588-4edd-9b29-94115ec2fd93 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:49.065427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc2b4c13-4588-4edd-9b29-94115ec2fd93 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:49.079837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc2b4c13-4588-4edd-9b29-94115ec2fd93 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:49.081476 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc2b4c13-4588-4edd-9b29-94115ec2fd93 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.033186 Sep 08 13:02:49.084013 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2049/3965] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:48 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:49.092579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f5344bc-dafc-4135-a198-97f8f190ed91 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:49.099278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1f5344bc-dafc-4135-a198-97f8f190ed91 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3433475a-6253-474c-9bdc-734b385ae282] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:49.133097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f5344bc-dafc-4135-a198-97f8f190ed91 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:49.134558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f5344bc-dafc-4135-a198-97f8f190ed91 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:49.135262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f5344bc-dafc-4135-a198-97f8f190ed91 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.137199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f5344bc-dafc-4135-a198-97f8f190ed91 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:49.138073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f5344bc-dafc-4135-a198-97f8f190ed91 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:49.138677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f5344bc-dafc-4135-a198-97f8f190ed91 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.157287 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-1f5344bc-dafc-4135-a198-97f8f190ed91 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f5344bc-dafc-4135-a198-97f8f190ed91 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 HTTP/1.1 Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '3433475a-6253-474c-9bdc-734b385ae282'} Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.171701 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:49.176393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:49.176393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:49.176393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:49.176393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:49.176393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. Sep 08 13:02:49.176393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.180670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f5344bc-dafc-4135-a198-97f8f190ed91 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 3433475a-6253-474c-9bdc-734b385ae282 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:49.182043 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1f5344bc-dafc-4135-a198-97f8f190ed91 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282" status: 404 len: 111 microversion: 2.1 time: 0.096711 Sep 08 13:02:49.187572 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2050/3966] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:49 2022] GET /compute/v2.1/servers/3433475a-6253-474c-9bdc-734b385ae282 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:49.200568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8b882469-6966-4d02-a063-d065aebd8ce8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:49.201678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8b882469-6966-4d02-a063-d065aebd8ce8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:49.216657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b882469-6966-4d02-a063-d065aebd8ce8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:49.217568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b882469-6966-4d02-a063-d065aebd8ce8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:49.218256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b882469-6966-4d02-a063-d065aebd8ce8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.219270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b882469-6966-4d02-a063-d065aebd8ce8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:49.219979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b882469-6966-4d02-a063-d065aebd8ce8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:49.220640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b882469-6966-4d02-a063-d065aebd8ce8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.388121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:49.421968 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-12220470-65a1-4498-94de-df1ecb80fabe tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] 10.222.0.78 "POST /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c/action" status: 202 len: 52 microversion: 2.47 time: 0.679038 Sep 08 13:02:49.432795 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1917/3967] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 13:02:48 2022] POST /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c/action => generated 52 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Sep 08 13:02:49.438756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-420a1464-0c3b-408f-a22e-3e4694ba36ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:49.438756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-420a1464-0c3b-408f-a22e-3e4694ba36ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 307b0e06-8473-44e0-90d1-25e6bbf73210] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:49.463323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-420a1464-0c3b-408f-a22e-3e4694ba36ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:49.466588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-420a1464-0c3b-408f-a22e-3e4694ba36ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:49.470787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-420a1464-0c3b-408f-a22e-3e4694ba36ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.471102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8b882469-6966-4d02-a063-d065aebd8ce8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:49.471356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-420a1464-0c3b-408f-a22e-3e4694ba36ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:49.472362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-420a1464-0c3b-408f-a22e-3e4694ba36ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:49.473788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:49.475318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-420a1464-0c3b-408f-a22e-3e4694ba36ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.490869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8b882469-6966-4d02-a063-d065aebd8ce8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:49.495982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8b882469-6966-4d02-a063-d065aebd8ce8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:49.497279 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8b882469-6966-4d02-a063-d065aebd8ce8 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.308283 Sep 08 13:02:49.497871 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2051/3968] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:49 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:49.512768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-74a02c7a-78e1-494b-9c61-4a3270513fc3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:49.514183 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-420a1464-0c3b-408f-a22e-3e4694ba36ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] HTTP exception thrown: Instance 307b0e06-8473-44e0-90d1-25e6bbf73210 could not be found. Sep 08 13:02:49.517463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-74a02c7a-78e1-494b-9c61-4a3270513fc3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-420a1464-0c3b-408f-a22e-3e4694ba36ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Request method failure captured: Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 HTTP/1.1 Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVJlpIUu4I3etLbEARIZH8KBjvhrlSlsNaLxWsUVVjxg7DGa1gDBkjoWynkMnF04mkRKPOu0mP64ZnQqdnNZ67aOntgfBqoqUU7VATzwJXlIjY4wY2V0n8uOV_tKF-BjMvxYlC2i-O3RjgSypdvXI4jXqJB4nuGXejMn4MVXpX9mCw Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 59dc0decb175444491383c39918c5b2e Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerActionsTestJSON-204893554 Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_59dc0decb175444491383c39918c5b2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/59dc0decb175444491383c39918c5b2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59dc0decb175444491383c39918c5b2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59dc0decb175444491383c39918c5b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerActionsTestJSON-204893554 Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 59dc0decb175444491383c39918c5b2e Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerActionsTestJSON-204893554 Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerActionsTestJSON-204893554-project Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 4140a06bc6934d7780ef9ff3e30e6dd5 Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerActionsTestJSON-204893554-project Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 307b0e06-8473-44e0-90d1-25e6bbf73210 could not be found. Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '307b0e06-8473-44e0-90d1-25e6bbf73210'} Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 307b0e06-8473-44e0-90d1-25e6bbf73210 could not be found. Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 307b0e06-8473-44e0-90d1-25e6bbf73210 could not be found. Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:49.517647 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.522273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:49.522273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:49.522273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:49.522273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:49.522273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:49.522273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 307b0e06-8473-44e0-90d1-25e6bbf73210 could not be found. Sep 08 13:02:49.522273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.525272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-420a1464-0c3b-408f-a22e-3e4694ba36ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Returning 404 to user: Instance 307b0e06-8473-44e0-90d1-25e6bbf73210 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:49.527033 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-420a1464-0c3b-408f-a22e-3e4694ba36ad tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210" status: 404 len: 111 microversion: 2.1 time: 0.101941 Sep 08 13:02:49.532046 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1918/3969] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:49 2022] GET /compute/v2.1/servers/307b0e06-8473-44e0-90d1-25e6bbf73210 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:49.544600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e7095db3-499d-4444-ab1e-871cb35bef5d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:49.546178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e7095db3-499d-4444-ab1e-871cb35bef5d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] [instance: 227be722-d60b-4739-908b-4cf4f43a2a8c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:49.554561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74a02c7a-78e1-494b-9c61-4a3270513fc3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:49.556089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74a02c7a-78e1-494b-9c61-4a3270513fc3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:49.559477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74a02c7a-78e1-494b-9c61-4a3270513fc3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.565556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74a02c7a-78e1-494b-9c61-4a3270513fc3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:49.566300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74a02c7a-78e1-494b-9c61-4a3270513fc3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:49.567886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74a02c7a-78e1-494b-9c61-4a3270513fc3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.572844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7095db3-499d-4444-ab1e-871cb35bef5d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:49.574254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7095db3-499d-4444-ab1e-871cb35bef5d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:49.574830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7095db3-499d-4444-ab1e-871cb35bef5d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.575758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7095db3-499d-4444-ab1e-871cb35bef5d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:49.576359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7095db3-499d-4444-ab1e-871cb35bef5d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:49.576897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7095db3-499d-4444-ab1e-871cb35bef5d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.623778 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-74a02c7a-78e1-494b-9c61-4a3270513fc3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-74a02c7a-78e1-494b-9c61-4a3270513fc3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e HTTP/1.1 Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'acd6d509-a7c8-41ce-a825-5ce961e6c87e'} Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:49.638045 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:02:49.643455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.643455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:49.643455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.643455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:49.643455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:49.643455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:49.643455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:49.643455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:49.643455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:02:49.643455 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:49.643455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-74a02c7a-78e1-494b-9c61-4a3270513fc3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:49.644204 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-74a02c7a-78e1-494b-9c61-4a3270513fc3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 404 len: 111 microversion: 2.1 time: 0.138589 Sep 08 13:02:49.649365 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2052/3970] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:49 2022] DELETE /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:49.651605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e7095db3-499d-4444-ab1e-871cb35bef5d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] [instance: 227be722-d60b-4739-908b-4cf4f43a2a8c] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:02:49.658935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4dfb2fe0-9a09-43a8-bd05-407c8ff4b40f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:49.659961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4dfb2fe0-9a09-43a8-bd05-407c8ff4b40f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:49.670679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dfb2fe0-9a09-43a8-bd05-407c8ff4b40f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:49.671649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dfb2fe0-9a09-43a8-bd05-407c8ff4b40f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:49.673485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dfb2fe0-9a09-43a8-bd05-407c8ff4b40f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.674894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dfb2fe0-9a09-43a8-bd05-407c8ff4b40f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:49.675569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dfb2fe0-9a09-43a8-bd05-407c8ff4b40f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:49.676684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dfb2fe0-9a09-43a8-bd05-407c8ff4b40f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:49.721740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4dfb2fe0-9a09-43a8-bd05-407c8ff4b40f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:02:49.851127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:49.913909 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e7095db3-499d-4444-ab1e-871cb35bef5d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] 10.222.0.78 "DELETE /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c" status: 204 len: 0 microversion: 2.47 time: 0.371442 Sep 08 13:02:49.916554 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1919/3971] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:02:49 2022] DELETE /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:02:49.965226 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4dfb2fe0-9a09-43a8-bd05-407c8ff4b40f tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 204 len: 0 microversion: 2.1 time: 0.313707 Sep 08 13:02:49.969463 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2053/3972] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:49 2022] DELETE /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:02:49.978635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7c8d795f-cf60-4ab8-9a05-a3814486894a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:49.979385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7c8d795f-cf60-4ab8-9a05-a3814486894a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: acd6d509-a7c8-41ce-a825-5ce961e6c87e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:50.017663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c8d795f-cf60-4ab8-9a05-a3814486894a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:50.020038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c8d795f-cf60-4ab8-9a05-a3814486894a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:50.022426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c8d795f-cf60-4ab8-9a05-a3814486894a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:50.027766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c8d795f-cf60-4ab8-9a05-a3814486894a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:50.032061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c8d795f-cf60-4ab8-9a05-a3814486894a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:50.033231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c8d795f-cf60-4ab8-9a05-a3814486894a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:50.086102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-661240524", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "3a841670-5149-477f-b3e7-59684d50705d"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:50.118564 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-7c8d795f-cf60-4ab8-9a05-a3814486894a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7c8d795f-cf60-4ab8-9a05-a3814486894a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e HTTP/1.1 Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'acd6d509-a7c8-41ce-a825-5ce961e6c87e'} Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:50.124735 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:50.132816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:50.132816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:50.132816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:50.132816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:50.132816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. Sep 08 13:02:50.132816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:50.136280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7c8d795f-cf60-4ab8-9a05-a3814486894a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance acd6d509-a7c8-41ce-a825-5ce961e6c87e could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:50.142408 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7c8d795f-cf60-4ab8-9a05-a3814486894a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e" status: 404 len: 111 microversion: 2.1 time: 0.169766 Sep 08 13:02:50.146615 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2054/3973] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:49 2022] GET /compute/v2.1/servers/acd6d509-a7c8-41ce-a825-5ce961e6c87e => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:50.173304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26ee767c-f5a1-4ec1-82b6-372fc293d451 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:50.181302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-26ee767c-f5a1-4ec1-82b6-372fc293d451 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] [instance: 227be722-d60b-4739-908b-4cf4f43a2a8c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:50.198514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26ee767c-f5a1-4ec1-82b6-372fc293d451 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:50.199304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26ee767c-f5a1-4ec1-82b6-372fc293d451 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:50.200340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26ee767c-f5a1-4ec1-82b6-372fc293d451 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:50.201510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26ee767c-f5a1-4ec1-82b6-372fc293d451 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:50.202215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26ee767c-f5a1-4ec1-82b6-372fc293d451 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:50.203030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26ee767c-f5a1-4ec1-82b6-372fc293d451 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:50.318244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] validate_networks() for [('3a841670-5149-477f-b3e7-59684d50705d', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:02:50.374875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26ee767c-f5a1-4ec1-82b6-372fc293d451 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:50.396544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26ee767c-f5a1-4ec1-82b6-372fc293d451 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:50.403514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26ee767c-f5a1-4ec1-82b6-372fc293d451 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:50.413448 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-26ee767c-f5a1-4ec1-82b6-372fc293d451 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] 10.222.0.78 "GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c" status: 200 len: 1365 microversion: 2.47 time: 0.263422 Sep 08 13:02:50.416816 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2055/3974] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:50 2022] GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c => generated 1365 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:50.450671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7ef5a2f7-e0d2-4d1c-9c18-430358301025 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:50.454161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7ef5a2f7-e0d2-4d1c-9c18-430358301025 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:50.472253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ef5a2f7-e0d2-4d1c-9c18-430358301025 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:50.477218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ef5a2f7-e0d2-4d1c-9c18-430358301025 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:50.480564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ef5a2f7-e0d2-4d1c-9c18-430358301025 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:50.486898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ef5a2f7-e0d2-4d1c-9c18-430358301025 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:50.491597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ef5a2f7-e0d2-4d1c-9c18-430358301025 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:50.496574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ef5a2f7-e0d2-4d1c-9c18-430358301025 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:51.381376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ef5a2f7-e0d2-4d1c-9c18-430358301025 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:51.399819 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7ef5a2f7-e0d2-4d1c-9c18-430358301025 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1507 microversion: 2.1 time: 0.980352 Sep 08 13:02:51.400441 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2056/3975] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:50 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1507 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:51.406905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e347832d-f16b-45ea-bcd8-338ad95e5cb2 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:51.406905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e347832d-f16b-45ea-bcd8-338ad95e5cb2 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:51.433175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e347832d-f16b-45ea-bcd8-338ad95e5cb2 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:51.435407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e347832d-f16b-45ea-bcd8-338ad95e5cb2 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:51.436492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e347832d-f16b-45ea-bcd8-338ad95e5cb2 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:51.438448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e347832d-f16b-45ea-bcd8-338ad95e5cb2 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:51.439471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e347832d-f16b-45ea-bcd8-338ad95e5cb2 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:51.440506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e347832d-f16b-45ea-bcd8-338ad95e5cb2 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:51.552236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:02:51.554547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:02:51.555491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:02:51.556682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:02:51.557294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:02:51.580944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:51.586222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:51.590410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:51.595656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:51.597969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:51.601020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:51.650769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:51.697723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Getting quotas for project 6f815679701143e08a91b3ecc93325a1. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:02:51.712867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Getting quotas for user a9711561e1b044f4aa590eb9b30d9e44 and project 6f815679701143e08a91b3ecc93325a1. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:02:51.758445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:02:51.765544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:02:52.042627 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5abdb73c-f6fa-4c2d-8b04-bc38aeef603e tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.120721 Sep 08 13:02:52.049581 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1920/3976] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 13:02:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 13:02:52.063278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9101b4fe-590e-4650-b714-92874193b486 req-909d4d11-5606-41a1-856f-ceb1a476a873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "307b0e06-8473-44e0-90d1-25e6bbf73210", "name": "network-vif-deleted", "tag": "405b7b07-1d3d-4562-b0ae-fafd46ae290c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:52.114078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9101b4fe-590e-4650-b714-92874193b486 req-909d4d11-5606-41a1-856f-ceb1a476a873 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:52.121742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9101b4fe-590e-4650-b714-92874193b486 req-909d4d11-5606-41a1-856f-ceb1a476a873 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:52.125346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9101b4fe-590e-4650-b714-92874193b486 req-909d4d11-5606-41a1-856f-ceb1a476a873 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:52.192236 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9101b4fe-590e-4650-b714-92874193b486 req-909d4d11-5606-41a1-856f-ceb1a476a873 service nova] Creating event network-vif-deleted:405b7b07-1d3d-4562-b0ae-fafd46ae290c for instance 307b0e06-8473-44e0-90d1-25e6bbf73210 on n-h2-852084-10 Sep 08 13:02:52.232068 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9101b4fe-590e-4650-b714-92874193b486 req-909d4d11-5606-41a1-856f-ceb1a476a873 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.179499 Sep 08 13:02:52.247649 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1921/3977] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:52.281765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-662e1a2b-9225-4c93-8c48-f12351e7e6f3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:52.285545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-662e1a2b-9225-4c93-8c48-f12351e7e6f3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:52.327297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-662e1a2b-9225-4c93-8c48-f12351e7e6f3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:52.329834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-662e1a2b-9225-4c93-8c48-f12351e7e6f3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:52.349780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-662e1a2b-9225-4c93-8c48-f12351e7e6f3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:52.354089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-662e1a2b-9225-4c93-8c48-f12351e7e6f3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:52.356737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-662e1a2b-9225-4c93-8c48-f12351e7e6f3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:52.362061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-662e1a2b-9225-4c93-8c48-f12351e7e6f3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:52.458101 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-662e1a2b-9225-4c93-8c48-f12351e7e6f3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-662e1a2b-9225-4c93-8c48-f12351e7e6f3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 HTTP/1.1 Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '273397f3-2f7d-430f-845c-d365c2bc6412'} Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:52.463582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:02:52.468157 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:52.468157 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:52.468157 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:52.468157 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:52.468157 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:52.468157 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:52.468157 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:52.468157 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:52.468157 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:02:52.468157 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:52.468157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-662e1a2b-9225-4c93-8c48-f12351e7e6f3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:52.473961 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-662e1a2b-9225-4c93-8c48-f12351e7e6f3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 404 len: 111 microversion: 2.1 time: 0.221806 Sep 08 13:02:52.479874 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1922/3978] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:52 2022] DELETE /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 111 bytes in 231 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:52.515998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:52.526810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:52.567863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:52.569017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:52.572094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:52.577365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:52.578276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:52.584751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:53.223884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:53.240439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e347832d-f16b-45ea-bcd8-338ad95e5cb2 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:53.249547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:53.258584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e347832d-f16b-45ea-bcd8-338ad95e5cb2 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:53.264083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:53.265977 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.780714 Sep 08 13:02:53.266343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e347832d-f16b-45ea-bcd8-338ad95e5cb2 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:53.270391 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e347832d-f16b-45ea-bcd8-338ad95e5cb2 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.868805 Sep 08 13:02:53.271592 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1923/3979] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:52 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:53.288925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:53.298378 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2057/3980] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:51 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:53.301557 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-91a697cf-1cd7-42ba-939b-67e434fa3ddb tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.028335 Sep 08 13:02:53.301961 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1924/3981] 10.222.0.78 () {56 vars in 886 bytes} [Thu Sep 8 13:02:53 2022] GET /compute/ => generated 377 bytes in 29 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 13:02:53.323048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:53.324952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dec45a5e-3fe8-470e-bb1a-daeb9e73b5bc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:53.325584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dec45a5e-3fe8-470e-bb1a-daeb9e73b5bc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:53.327640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] [instance: 227be722-d60b-4739-908b-4cf4f43a2a8c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:53.369364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:53.370484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:53.371265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:53.372244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:53.375469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:53.376304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:53.628940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dec45a5e-3fe8-470e-bb1a-daeb9e73b5bc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:53.638223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dec45a5e-3fe8-470e-bb1a-daeb9e73b5bc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:53.641770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dec45a5e-3fe8-470e-bb1a-daeb9e73b5bc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:53.651191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:53.656550 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dec45a5e-3fe8-470e-bb1a-daeb9e73b5bc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1258 microversion: 2.21 time: 0.351190 Sep 08 13:02:53.658716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:53.667520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:53.668108 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1925/3982] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:53 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1258 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:53.668909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lazy-loading 'fault' on Instance uuid 227be722-d60b-4739-908b-4cf4f43a2a8c {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:02:53.676284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7c47d5b9-2a09-4127-b521-c9e7e577a191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:53.677223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7c47d5b9-2a09-4127-b521-c9e7e577a191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:53.717409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c47d5b9-2a09-4127-b521-c9e7e577a191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:53.725082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c47d5b9-2a09-4127-b521-c9e7e577a191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:53.725555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c47d5b9-2a09-4127-b521-c9e7e577a191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:53.726336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c47d5b9-2a09-4127-b521-c9e7e577a191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:53.726833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c47d5b9-2a09-4127-b521-c9e7e577a191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:53.727330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c47d5b9-2a09-4127-b521-c9e7e577a191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:53.927337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:53.951071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:53.962895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1e86019aa14544f8b874fb3c3d2037ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f2abf7107b42b6b73d50ec37014b2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:53.981524 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c6080637-a911-4019-93cd-c2a85ce8029d tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] 10.222.0.78 "GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c" status: 200 len: 1370 microversion: 2.47 time: 0.669934 Sep 08 13:02:53.987670 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2058/3983] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:53 2022] GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c => generated 1370 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:54.030323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8c7ee986-c537-445e-87e8-6c600b17de6f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:54.039674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8c7ee986-c537-445e-87e8-6c600b17de6f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 273397f3-2f7d-430f-845c-d365c2bc6412] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:54.041869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7c47d5b9-2a09-4127-b521-c9e7e577a191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:54.055939 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7c47d5b9-2a09-4127-b521-c9e7e577a191 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 200 len: 1299 microversion: 2.1 time: 0.383759 Sep 08 13:02:54.067932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c7ee986-c537-445e-87e8-6c600b17de6f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:54.072585 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1926/3984] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:53 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 1299 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:54.076347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c7ee986-c537-445e-87e8-6c600b17de6f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:54.080948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c7ee986-c537-445e-87e8-6c600b17de6f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:54.082885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c7ee986-c537-445e-87e8-6c600b17de6f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:54.105973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c7ee986-c537-445e-87e8-6c600b17de6f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:54.108054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8c7ee986-c537-445e-87e8-6c600b17de6f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:54.215106 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-8c7ee986-c537-445e-87e8-6c600b17de6f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8c7ee986-c537-445e-87e8-6c600b17de6f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 HTTP/1.1 Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '273397f3-2f7d-430f-845c-d365c2bc6412'} Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:54.225930 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:54.230611 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:54.230611 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:54.230611 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:54.230611 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:54.230611 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. Sep 08 13:02:54.230611 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:54.234313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8c7ee986-c537-445e-87e8-6c600b17de6f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 273397f3-2f7d-430f-845c-d365c2bc6412 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:54.241709 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8c7ee986-c537-445e-87e8-6c600b17de6f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412" status: 404 len: 111 microversion: 2.1 time: 0.247543 Sep 08 13:02:54.247324 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2059/3985] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:53 2022] GET /compute/v2.1/servers/273397f3-2f7d-430f-845c-d365c2bc6412 => generated 111 bytes in 256 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:54.254772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b7e68dc-0f1f-4c0c-8ff0-c04cbcb865d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:54.255456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5b7e68dc-0f1f-4c0c-8ff0-c04cbcb865d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:54.295902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b7e68dc-0f1f-4c0c-8ff0-c04cbcb865d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:54.296733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b7e68dc-0f1f-4c0c-8ff0-c04cbcb865d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:54.297390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b7e68dc-0f1f-4c0c-8ff0-c04cbcb865d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:54.298375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b7e68dc-0f1f-4c0c-8ff0-c04cbcb865d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:54.300397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b7e68dc-0f1f-4c0c-8ff0-c04cbcb865d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:54.301192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b7e68dc-0f1f-4c0c-8ff0-c04cbcb865d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:54.322145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-15e6d65d-90c1-4317-8e3b-b0224f776f5b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:54.322794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-15e6d65d-90c1-4317-8e3b-b0224f776f5b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:54.362428 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-5b7e68dc-0f1f-4c0c-8ff0-c04cbcb865d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:02:54.367584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15e6d65d-90c1-4317-8e3b-b0224f776f5b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:54.370933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15e6d65d-90c1-4317-8e3b-b0224f776f5b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b7e68dc-0f1f-4c0c-8ff0-c04cbcb865d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a HTTP/1.1 Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '4f5c17a5-8282-4299-b6c1-13159d0a3a7a'} Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:54.372229 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b7e68dc-0f1f-4c0c-8ff0-c04cbcb865d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5b7e68dc-0f1f-4c0c-8ff0-c04cbcb865d6 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 404 len: 111 microversion: 2.1 time: 0.123705 Sep 08 13:02:54.376459 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1927/3986] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:54 2022] DELETE /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:54.383814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15e6d65d-90c1-4317-8e3b-b0224f776f5b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:54.384664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15e6d65d-90c1-4317-8e3b-b0224f776f5b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:54.391996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15e6d65d-90c1-4317-8e3b-b0224f776f5b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:54.402536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a9775649-75eb-44b5-9395-e4d2a4a8c430 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:54.406051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-15e6d65d-90c1-4317-8e3b-b0224f776f5b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:54.408330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a9775649-75eb-44b5-9395-e4d2a4a8c430 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:54.442348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9775649-75eb-44b5-9395-e4d2a4a8c430 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:54.443558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9775649-75eb-44b5-9395-e4d2a4a8c430 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:54.445157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9775649-75eb-44b5-9395-e4d2a4a8c430 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:54.448210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9775649-75eb-44b5-9395-e4d2a4a8c430 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:54.451314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9775649-75eb-44b5-9395-e4d2a4a8c430 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:54.454792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9775649-75eb-44b5-9395-e4d2a4a8c430 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:54.860541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a9775649-75eb-44b5-9395-e4d2a4a8c430 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:54.875836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a9775649-75eb-44b5-9395-e4d2a4a8c430 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:54.890569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a9775649-75eb-44b5-9395-e4d2a4a8c430 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:54.915826 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a9775649-75eb-44b5-9395-e4d2a4a8c430 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.519197 Sep 08 13:02:54.923566 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1928/3987] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:54 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:54.959271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-465eb81c-940b-46e7-a2c1-b25c12a113f0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:54.969358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-465eb81c-940b-46e7-a2c1-b25c12a113f0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 4f5c17a5-8282-4299-b6c1-13159d0a3a7a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:55.000745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-465eb81c-940b-46e7-a2c1-b25c12a113f0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.003610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-465eb81c-940b-46e7-a2c1-b25c12a113f0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.007880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-465eb81c-940b-46e7-a2c1-b25c12a113f0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.011733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-465eb81c-940b-46e7-a2c1-b25c12a113f0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.014541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-465eb81c-940b-46e7-a2c1-b25c12a113f0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.018218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-465eb81c-940b-46e7-a2c1-b25c12a113f0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.036157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-15e6d65d-90c1-4317-8e3b-b0224f776f5b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:55.064117 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-465eb81c-940b-46e7-a2c1-b25c12a113f0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-465eb81c-940b-46e7-a2c1-b25c12a113f0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a HTTP/1.1 Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '4f5c17a5-8282-4299-b6c1-13159d0a3a7a'} Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.067421 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.073989 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:55.073989 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:55.073989 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:55.073989 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:55.073989 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. Sep 08 13:02:55.073989 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.074510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-15e6d65d-90c1-4317-8e3b-b0224f776f5b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:55.078596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-465eb81c-940b-46e7-a2c1-b25c12a113f0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 4f5c17a5-8282-4299-b6c1-13159d0a3a7a could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:55.080354 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-465eb81c-940b-46e7-a2c1-b25c12a113f0 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a" status: 404 len: 111 microversion: 2.1 time: 0.155349 Sep 08 13:02:55.081846 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1929/3988] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:54 2022] GET /compute/v2.1/servers/4f5c17a5-8282-4299-b6c1-13159d0a3a7a => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:55.082146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-15e6d65d-90c1-4317-8e3b-b0224f776f5b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:55.090650 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-15e6d65d-90c1-4317-8e3b-b0224f776f5b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.786329 Sep 08 13:02:55.091383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-43c4e70e-15cc-4133-a0c1-ab1fa6c73390 req-2b24622d-6392-4f88-af33-0cd824866096 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b685045a-400a-4641-a603-1d2fea9bbcf1", "name": "network-vif-deleted", "tag": "c78a1808-531d-4ec3-b753-f992ef457785"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:55.132940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-43c4e70e-15cc-4133-a0c1-ab1fa6c73390 req-2b24622d-6392-4f88-af33-0cd824866096 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.137047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-43c4e70e-15cc-4133-a0c1-ab1fa6c73390 req-2b24622d-6392-4f88-af33-0cd824866096 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.138340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-43c4e70e-15cc-4133-a0c1-ab1fa6c73390 req-2b24622d-6392-4f88-af33-0cd824866096 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.144114 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2060/3989] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:54 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:55.158788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6b030cd5-371c-427b-a0c5-30b8b7a98179 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:55.169944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6b030cd5-371c-427b-a0c5-30b8b7a98179 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:55.184117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b030cd5-371c-427b-a0c5-30b8b7a98179 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.190621 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-43c4e70e-15cc-4133-a0c1-ab1fa6c73390 req-2b24622d-6392-4f88-af33-0cd824866096 service nova] Creating event network-vif-deleted:c78a1808-531d-4ec3-b753-f992ef457785 for instance b685045a-400a-4641-a603-1d2fea9bbcf1 on n-h2-852084-10 Sep 08 13:02:55.195809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b030cd5-371c-427b-a0c5-30b8b7a98179 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.197490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b030cd5-371c-427b-a0c5-30b8b7a98179 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.198902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b030cd5-371c-427b-a0c5-30b8b7a98179 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.199762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b030cd5-371c-427b-a0c5-30b8b7a98179 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.200706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b030cd5-371c-427b-a0c5-30b8b7a98179 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.210405 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-43c4e70e-15cc-4133-a0c1-ab1fa6c73390 req-2b24622d-6392-4f88-af33-0cd824866096 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126133 Sep 08 13:02:55.212330 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1930/3990] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:55.233098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c88e3028-2d70-4a6b-be1d-2a2497581269 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:55.234075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c88e3028-2d70-4a6b-be1d-2a2497581269 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] [instance: 227be722-d60b-4739-908b-4cf4f43a2a8c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:55.250835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c88e3028-2d70-4a6b-be1d-2a2497581269 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.252794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c88e3028-2d70-4a6b-be1d-2a2497581269 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.253741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c88e3028-2d70-4a6b-be1d-2a2497581269 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.259032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c88e3028-2d70-4a6b-be1d-2a2497581269 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.260088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c88e3028-2d70-4a6b-be1d-2a2497581269 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.260986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c88e3028-2d70-4a6b-be1d-2a2497581269 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.331554 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-c88e3028-2d70-4a6b-be1d-2a2497581269 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] HTTP exception thrown: Instance 227be722-d60b-4739-908b-4cf4f43a2a8c could not be found. Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c88e3028-2d70-4a6b-be1d-2a2497581269 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Request method failure captured: Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c HTTP/1.1 Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGefuKUiTwLUJtCkytOXl9jy2pbABxCV4yh8p8gSgR7_Q4pGN7FkRqkLCLy775EuvbMnab8u-x26e3fuAC7QgS2dxaztxw_yqBB0lZxaPR3ZLVBFQmhi5-rpyyRnJ-Cm9izQeCj943P6_HTaOyqFsQOj71DYK8ntMPyUPwniIpQrnyrE Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.47 Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 88f2abf7107b42b6b73d50ec37014b2f Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersAaction247Test-1513216353 Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_88f2abf7107b42b6b73d50ec37014b2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/88f2abf7107b42b6b73d50ec37014b2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/88f2abf7107b42b6b73d50ec37014b2f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/88f2abf7107b42b6b73d50ec37014b2f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersAaction247Test-1513216353 Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 88f2abf7107b42b6b73d50ec37014b2f Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersAaction247Test-1513216353 Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersAaction247Test-1513216353-project Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1e86019aa14544f8b874fb3c3d2037ed Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersAaction247Test-1513216353-project Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 227be722-d60b-4739-908b-4cf4f43a2a8c could not be found. Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '227be722-d60b-4739-908b-4cf4f43a2a8c'} Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 227be722-d60b-4739-908b-4cf4f43a2a8c could not be found. Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 227be722-d60b-4739-908b-4cf4f43a2a8c could not be found. Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.334093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:55.345205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.345205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.345205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:55.345205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:55.345205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:55.345205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:55.345205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 227be722-d60b-4739-908b-4cf4f43a2a8c could not be found. Sep 08 13:02:55.345205 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.347364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c88e3028-2d70-4a6b-be1d-2a2497581269 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] Returning 404 to user: Instance 227be722-d60b-4739-908b-4cf4f43a2a8c could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:55.348348 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c88e3028-2d70-4a6b-be1d-2a2497581269 tempest-ServersAaction247Test-1513216353 tempest-ServersAaction247Test-1513216353-project] 10.222.0.78 "GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c" status: 404 len: 111 microversion: 2.47 time: 0.133310 Sep 08 13:02:55.366879 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1931/3991] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:55 2022] GET /compute/v2.1/servers/227be722-d60b-4739-908b-4cf4f43a2a8c => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:02:55.389453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-430d22fa-2926-42db-a4fc-34feb6b2e9bc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:55.390203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-430d22fa-2926-42db-a4fc-34feb6b2e9bc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:55.410502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-430d22fa-2926-42db-a4fc-34feb6b2e9bc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.411459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-430d22fa-2926-42db-a4fc-34feb6b2e9bc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.412283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-430d22fa-2926-42db-a4fc-34feb6b2e9bc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.413421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-430d22fa-2926-42db-a4fc-34feb6b2e9bc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.414177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-430d22fa-2926-42db-a4fc-34feb6b2e9bc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.469836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6b030cd5-371c-427b-a0c5-30b8b7a98179 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:55.476436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-430d22fa-2926-42db-a4fc-34feb6b2e9bc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.539391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6b030cd5-371c-427b-a0c5-30b8b7a98179 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:55.580707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6b030cd5-371c-427b-a0c5-30b8b7a98179 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:55.604146 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6b030cd5-371c-427b-a0c5-30b8b7a98179 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1254 microversion: 2.21 time: 0.457742 Sep 08 13:02:55.616481 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-430d22fa-2926-42db-a4fc-34feb6b2e9bc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 13:02:55.622809 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2061/3992] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:55 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1254 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-430d22fa-2926-42db-a4fc-34feb6b2e9bc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d HTTP/1.1 Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '302204af-5f35-498f-95f0-d0c03f99db4d'} Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:55.626698 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 13:02:55.640788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.640788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:55.640788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.640788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.640788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:55.640788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:55.640788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:55.640788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:55.640788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 13:02:55.640788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.647396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-430d22fa-2926-42db-a4fc-34feb6b2e9bc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:55.653306 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-430d22fa-2926-42db-a4fc-34feb6b2e9bc tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 404 len: 111 microversion: 2.1 time: 0.280553 Sep 08 13:02:55.655652 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1932/3993] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:55 2022] DELETE /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 111 bytes in 288 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:55.672723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-42bd54b3-02f4-44cd-8feb-f637f11f051e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:55.674911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3cb0d4d-e2cd-473d-85e5-70b2ef772183 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:55.675612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e3cb0d4d-e2cd-473d-85e5-70b2ef772183 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: b685045a-400a-4641-a603-1d2fea9bbcf1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:55.676307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-42bd54b3-02f4-44cd-8feb-f637f11f051e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 302204af-5f35-498f-95f0-d0c03f99db4d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:55.693236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42bd54b3-02f4-44cd-8feb-f637f11f051e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.695639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42bd54b3-02f4-44cd-8feb-f637f11f051e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.698528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42bd54b3-02f4-44cd-8feb-f637f11f051e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.699906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42bd54b3-02f4-44cd-8feb-f637f11f051e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.701163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42bd54b3-02f4-44cd-8feb-f637f11f051e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.701848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42bd54b3-02f4-44cd-8feb-f637f11f051e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.722827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3cb0d4d-e2cd-473d-85e5-70b2ef772183 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.723432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3cb0d4d-e2cd-473d-85e5-70b2ef772183 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.723882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3cb0d4d-e2cd-473d-85e5-70b2ef772183 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.724606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3cb0d4d-e2cd-473d-85e5-70b2ef772183 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.725069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3cb0d4d-e2cd-473d-85e5-70b2ef772183 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.732531 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-42bd54b3-02f4-44cd-8feb-f637f11f051e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-42bd54b3-02f4-44cd-8feb-f637f11f051e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d HTTP/1.1 Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '302204af-5f35-498f-95f0-d0c03f99db4d'} Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.739424 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.743628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:55.743628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:55.743628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:55.743628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:55.743628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. Sep 08 13:02:55.743628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.743628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-42bd54b3-02f4-44cd-8feb-f637f11f051e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 302204af-5f35-498f-95f0-d0c03f99db4d could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:55.743628 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-42bd54b3-02f4-44cd-8feb-f637f11f051e tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d" status: 404 len: 111 microversion: 2.1 time: 0.082654 Sep 08 13:02:55.744220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3cb0d4d-e2cd-473d-85e5-70b2ef772183 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.752122 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1933/3994] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:55 2022] GET /compute/v2.1/servers/302204af-5f35-498f-95f0-d0c03f99db4d => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:55.786482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01eca5f6-b9dc-473c-9b13-817a237d231c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:55.789257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-01eca5f6-b9dc-473c-9b13-817a237d231c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:55.825924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01eca5f6-b9dc-473c-9b13-817a237d231c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.828560 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e3cb0d4d-e2cd-473d-85e5-70b2ef772183 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] HTTP exception thrown: Instance b685045a-400a-4641-a603-1d2fea9bbcf1 could not be found. Sep 08 13:02:55.829491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01eca5f6-b9dc-473c-9b13-817a237d231c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.832722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01eca5f6-b9dc-473c-9b13-817a237d231c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3cb0d4d-e2cd-473d-85e5-70b2ef772183 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Request method failure captured: Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 HTTP/1.1 Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVJlpIUu4I3etLbEARIZH8KBjvhrlSlsNaLxWsUVVjxg7DGa1gDBkjoWynkMnF04mkRKPOu0mP64ZnQqdnNZ67aOntgfBqoqUU7VATzwJXlIjY4wY2V0n8uOV_tKF-BjMvxYlC2i-O3RjgSypdvXI4jXqJB4nuGXejMn4MVXpX9mCw Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 59dc0decb175444491383c39918c5b2e Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerActionsTestJSON-204893554 Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_59dc0decb175444491383c39918c5b2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/59dc0decb175444491383c39918c5b2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59dc0decb175444491383c39918c5b2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59dc0decb175444491383c39918c5b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerActionsTestJSON-204893554 Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 59dc0decb175444491383c39918c5b2e Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerActionsTestJSON-204893554 Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerActionsTestJSON-204893554-project Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 4140a06bc6934d7780ef9ff3e30e6dd5 Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerActionsTestJSON-204893554-project Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance b685045a-400a-4641-a603-1d2fea9bbcf1 could not be found. Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'b685045a-400a-4641-a603-1d2fea9bbcf1'} Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b685045a-400a-4641-a603-1d2fea9bbcf1 could not be found. Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b685045a-400a-4641-a603-1d2fea9bbcf1 could not be found. Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:55.833184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.843117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.843117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:55.843117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:55.843117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:55.843117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:55.843117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b685045a-400a-4641-a603-1d2fea9bbcf1 could not be found. Sep 08 13:02:55.843117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.843117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3cb0d4d-e2cd-473d-85e5-70b2ef772183 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Returning 404 to user: Instance b685045a-400a-4641-a603-1d2fea9bbcf1 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:55.843117 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e3cb0d4d-e2cd-473d-85e5-70b2ef772183 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1" status: 404 len: 111 microversion: 2.1 time: 0.215979 Sep 08 13:02:55.847744 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2062/3995] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:55 2022] GET /compute/v2.1/servers/b685045a-400a-4641-a603-1d2fea9bbcf1 => generated 111 bytes in 221 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:55.851502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01eca5f6-b9dc-473c-9b13-817a237d231c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.855898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01eca5f6-b9dc-473c-9b13-817a237d231c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.858552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01eca5f6-b9dc-473c-9b13-817a237d231c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.873723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-25b62a5a-707a-466b-ae7a-b0093457f2cc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:55.874439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-25b62a5a-707a-466b-ae7a-b0093457f2cc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:55.892542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25b62a5a-707a-466b-ae7a-b0093457f2cc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.896210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25b62a5a-707a-466b-ae7a-b0093457f2cc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.897238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25b62a5a-707a-466b-ae7a-b0093457f2cc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.898883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25b62a5a-707a-466b-ae7a-b0093457f2cc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.905551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25b62a5a-707a-466b-ae7a-b0093457f2cc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.907088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-25b62a5a-707a-466b-ae7a-b0093457f2cc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.912051 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-01eca5f6-b9dc-473c-9b13-817a237d231c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01eca5f6-b9dc-473c-9b13-817a237d231c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 HTTP/1.1 Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'cdf026f9-c479-4ace-bc9a-232c26f2e862'} Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:55.917123 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 13:02:55.921440 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.921440 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:55.921440 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.921440 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:55.921440 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:55.921440 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:55.921440 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:55.921440 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:55.921440 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 13:02:55.921440 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:55.921440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01eca5f6-b9dc-473c-9b13-817a237d231c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:55.921440 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-01eca5f6-b9dc-473c-9b13-817a237d231c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 404 len: 111 microversion: 2.1 time: 0.163175 Sep 08 13:02:55.923588 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1934/3996] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:55 2022] DELETE /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 111 bytes in 167 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:55.944050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c70eda91-2215-4e84-b136-36487e58dbde tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:55.945031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c70eda91-2215-4e84-b136-36487e58dbde tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: cdf026f9-c479-4ace-bc9a-232c26f2e862] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:55.969721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c70eda91-2215-4e84-b136-36487e58dbde tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.984749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c70eda91-2215-4e84-b136-36487e58dbde tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.986032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c70eda91-2215-4e84-b136-36487e58dbde tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:55.991674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c70eda91-2215-4e84-b136-36487e58dbde tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:55.992634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c70eda91-2215-4e84-b136-36487e58dbde tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:55.993292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c70eda91-2215-4e84-b136-36487e58dbde tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:56.012503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-25b62a5a-707a-466b-ae7a-b0093457f2cc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:02:56.083366 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-c70eda91-2215-4e84-b136-36487e58dbde tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c70eda91-2215-4e84-b136-36487e58dbde tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 HTTP/1.1 Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'cdf026f9-c479-4ace-bc9a-232c26f2e862'} Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:56.092582 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:56.100303 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:56.100303 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:56.100303 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:56.100303 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:56.100303 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. Sep 08 13:02:56.100303 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:02:56.102688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c70eda91-2215-4e84-b136-36487e58dbde tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance cdf026f9-c479-4ace-bc9a-232c26f2e862 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:56.105906 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c70eda91-2215-4e84-b136-36487e58dbde tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862" status: 404 len: 111 microversion: 2.1 time: 0.174488 Sep 08 13:02:56.108823 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1935/3997] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:55 2022] GET /compute/v2.1/servers/cdf026f9-c479-4ace-bc9a-232c26f2e862 => generated 111 bytes in 180 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:56.134899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-057e2ce4-6007-4392-81e6-fc89d8413287 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:56.136266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-057e2ce4-6007-4392-81e6-fc89d8413287 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:56.175760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-057e2ce4-6007-4392-81e6-fc89d8413287 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:56.178493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-057e2ce4-6007-4392-81e6-fc89d8413287 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:56.178493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-057e2ce4-6007-4392-81e6-fc89d8413287 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:56.179473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-057e2ce4-6007-4392-81e6-fc89d8413287 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:56.180043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-057e2ce4-6007-4392-81e6-fc89d8413287 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:56.182636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-057e2ce4-6007-4392-81e6-fc89d8413287 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:56.285245 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-25b62a5a-707a-466b-ae7a-b0093457f2cc tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "DELETE /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 204 len: 0 microversion: 2.1 time: 0.432297 Sep 08 13:02:56.286860 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2063/3998] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:55 2022] DELETE /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:02:56.298206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-782c1262-3f61-4e81-93fe-15a3a2bb016b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:56.300453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-782c1262-3f61-4e81-93fe-15a3a2bb016b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3bef90cd-775a-486e-afe2-8af6f9bbfbd0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:56.313898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-782c1262-3f61-4e81-93fe-15a3a2bb016b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:56.315349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-782c1262-3f61-4e81-93fe-15a3a2bb016b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:56.316563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-782c1262-3f61-4e81-93fe-15a3a2bb016b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:56.318272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-782c1262-3f61-4e81-93fe-15a3a2bb016b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:56.319393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-782c1262-3f61-4e81-93fe-15a3a2bb016b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:56.320708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-782c1262-3f61-4e81-93fe-15a3a2bb016b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:56.388262 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-782c1262-3f61-4e81-93fe-15a3a2bb016b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-782c1262-3f61-4e81-93fe-15a3a2bb016b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/3bef90cd-775a-486e-afe2-8af6f9bbfbd0 HTTP/1.1 Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '3bef90cd-775a-486e-afe2-8af6f9bbfbd0'} Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:56.390284 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 13:02:56.398928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:56.398928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:56.398928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:56.398928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:56.398928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:56.398928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:56.398928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:56.398928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:56.398928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 13:02:56.398928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:56.412970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-057e2ce4-6007-4392-81e6-fc89d8413287 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:56.424338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-782c1262-3f61-4e81-93fe-15a3a2bb016b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:56.425175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-057e2ce4-6007-4392-81e6-fc89d8413287 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:56.428490 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-782c1262-3f61-4e81-93fe-15a3a2bb016b tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3bef90cd-775a-486e-afe2-8af6f9bbfbd0" status: 404 len: 111 microversion: 2.1 time: 0.136454 Sep 08 13:02:56.433075 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2064/3999] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:56 2022] DELETE /compute/v2.1/servers/3bef90cd-775a-486e-afe2-8af6f9bbfbd0 => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:56.434109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-057e2ce4-6007-4392-81e6-fc89d8413287 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:56.435455 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-057e2ce4-6007-4392-81e6-fc89d8413287 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.324996 Sep 08 13:02:56.447640 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1936/4000] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:56 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:56.457322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e2b1ba7-676a-4d7f-a664-e7fddbce6963 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:56.460103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8e2b1ba7-676a-4d7f-a664-e7fddbce6963 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:56.469624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cfeae770-4cae-420a-b1c2-9b8953cc158c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:56.470391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cfeae770-4cae-420a-b1c2-9b8953cc158c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:56.481731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e2b1ba7-676a-4d7f-a664-e7fddbce6963 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:56.482245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e2b1ba7-676a-4d7f-a664-e7fddbce6963 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:56.482697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e2b1ba7-676a-4d7f-a664-e7fddbce6963 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:56.483487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e2b1ba7-676a-4d7f-a664-e7fddbce6963 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:56.483959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e2b1ba7-676a-4d7f-a664-e7fddbce6963 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:56.484920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e2b1ba7-676a-4d7f-a664-e7fddbce6963 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:56.500896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfeae770-4cae-420a-b1c2-9b8953cc158c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:56.515052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfeae770-4cae-420a-b1c2-9b8953cc158c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:56.515584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfeae770-4cae-420a-b1c2-9b8953cc158c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:56.516374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfeae770-4cae-420a-b1c2-9b8953cc158c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:56.516842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfeae770-4cae-420a-b1c2-9b8953cc158c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:56.517320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfeae770-4cae-420a-b1c2-9b8953cc158c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:57.800277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cfeae770-4cae-420a-b1c2-9b8953cc158c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:57.828227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cfeae770-4cae-420a-b1c2-9b8953cc158c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:57.833950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cfeae770-4cae-420a-b1c2-9b8953cc158c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:57.835703 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cfeae770-4cae-420a-b1c2-9b8953cc158c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.381907 Sep 08 13:02:57.852773 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2065/4001] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:56 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:57.863956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1bf33b25-6cc6-48db-acd3-5cc984e9c70a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:57.864848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1bf33b25-6cc6-48db-acd3-5cc984e9c70a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 3bef90cd-775a-486e-afe2-8af6f9bbfbd0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:57.873115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1bf33b25-6cc6-48db-acd3-5cc984e9c70a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:57.873875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1bf33b25-6cc6-48db-acd3-5cc984e9c70a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:57.874501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1bf33b25-6cc6-48db-acd3-5cc984e9c70a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:57.875432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1bf33b25-6cc6-48db-acd3-5cc984e9c70a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:57.876054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1bf33b25-6cc6-48db-acd3-5cc984e9c70a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:57.876656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1bf33b25-6cc6-48db-acd3-5cc984e9c70a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:57.878992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8e2b1ba7-676a-4d7f-a664-e7fddbce6963 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:57.889321 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8e2b1ba7-676a-4d7f-a664-e7fddbce6963 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1494 microversion: 2.1 time: 1.440215 Sep 08 13:02:57.904766 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1937/4002] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:56 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1494 bytes in 1451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:57.912739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54400bd5-a053-4201-8335-15a91e73c8c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:57.920157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54400bd5-a053-4201-8335-15a91e73c8c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:57.934888 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-1bf33b25-6cc6-48db-acd3-5cc984e9c70a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1bf33b25-6cc6-48db-acd3-5cc984e9c70a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/3bef90cd-775a-486e-afe2-8af6f9bbfbd0 HTTP/1.1 Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '3bef90cd-775a-486e-afe2-8af6f9bbfbd0'} Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:57.940184 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:02:57.944602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:02:57.944602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:02:57.944602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:02:57.944602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:02:57.944602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. Sep 08 13:02:57.944602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:02:57.945203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54400bd5-a053-4201-8335-15a91e73c8c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:57.945203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54400bd5-a053-4201-8335-15a91e73c8c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:57.945381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54400bd5-a053-4201-8335-15a91e73c8c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:57.947395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1bf33b25-6cc6-48db-acd3-5cc984e9c70a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 3bef90cd-775a-486e-afe2-8af6f9bbfbd0 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:02:57.948769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54400bd5-a053-4201-8335-15a91e73c8c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:57.952412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54400bd5-a053-4201-8335-15a91e73c8c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:57.954961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54400bd5-a053-4201-8335-15a91e73c8c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:57.955325 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1bf33b25-6cc6-48db-acd3-5cc984e9c70a tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/3bef90cd-775a-486e-afe2-8af6f9bbfbd0" status: 404 len: 111 microversion: 2.1 time: 0.100745 Sep 08 13:02:57.955760 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2066/4003] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:57 2022] GET /compute/v2.1/servers/3bef90cd-775a-486e-afe2-8af6f9bbfbd0 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:02:57.973645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-cdaf7801-4444-4486-9a72-2e381578de99 req-a6612b84-8011-4ea0-b989-07e58ff085c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-plugged", "status": "completed", "tag": "df47dbce-98af-457f-b820-6f3eed3fb9db"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:02:58.008360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cdaf7801-4444-4486-9a72-2e381578de99 req-a6612b84-8011-4ea0-b989-07e58ff085c3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:58.012964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cdaf7801-4444-4486-9a72-2e381578de99 req-a6612b84-8011-4ea0-b989-07e58ff085c3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:58.013687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cdaf7801-4444-4486-9a72-2e381578de99 req-a6612b84-8011-4ea0-b989-07e58ff085c3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:58.060516 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-cdaf7801-4444-4486-9a72-2e381578de99 req-a6612b84-8011-4ea0-b989-07e58ff085c3 service nova] Creating event network-vif-plugged:df47dbce-98af-457f-b820-6f3eed3fb9db for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:02:58.114609 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-cdaf7801-4444-4486-9a72-2e381578de99 req-a6612b84-8011-4ea0-b989-07e58ff085c3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133146 Sep 08 13:02:58.115729 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2067/4004] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:02:58.136705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a5d8a117-3d8b-488f-9475-215bbaae9bfc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:58.137449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a5d8a117-3d8b-488f-9475-215bbaae9bfc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:58.173729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5d8a117-3d8b-488f-9475-215bbaae9bfc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:58.174249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5d8a117-3d8b-488f-9475-215bbaae9bfc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:58.174689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5d8a117-3d8b-488f-9475-215bbaae9bfc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:58.175468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5d8a117-3d8b-488f-9475-215bbaae9bfc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:58.175940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5d8a117-3d8b-488f-9475-215bbaae9bfc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:58.176375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5d8a117-3d8b-488f-9475-215bbaae9bfc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:58.207418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54400bd5-a053-4201-8335-15a91e73c8c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:58.224128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54400bd5-a053-4201-8335-15a91e73c8c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:58.228529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54400bd5-a053-4201-8335-15a91e73c8c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:58.232006 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54400bd5-a053-4201-8335-15a91e73c8c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1316 microversion: 2.21 time: 0.330629 Sep 08 13:02:58.238617 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1938/4005] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:57 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:58.249414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-39c662f2-70ae-4529-ab96-5e19f6eada88 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:58.255064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-39c662f2-70ae-4529-ab96-5e19f6eada88 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:58.273770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-39c662f2-70ae-4529-ab96-5e19f6eada88 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:58.275509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-39c662f2-70ae-4529-ab96-5e19f6eada88 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:58.278609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-39c662f2-70ae-4529-ab96-5e19f6eada88 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:58.279921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-39c662f2-70ae-4529-ab96-5e19f6eada88 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:58.283382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-39c662f2-70ae-4529-ab96-5e19f6eada88 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:58.284088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-39c662f2-70ae-4529-ab96-5e19f6eada88 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:58.342569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-39c662f2-70ae-4529-ab96-5e19f6eada88 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:02:58.485816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a5d8a117-3d8b-488f-9475-215bbaae9bfc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:58.504100 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-39c662f2-70ae-4529-ab96-5e19f6eada88 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "DELETE /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 204 len: 0 microversion: 2.1 time: 0.263263 Sep 08 13:02:58.504816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a5d8a117-3d8b-488f-9475-215bbaae9bfc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:58.505303 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1939/4006] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:02:58 2022] DELETE /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:02:58.506408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a5d8a117-3d8b-488f-9475-215bbaae9bfc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:58.516639 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a5d8a117-3d8b-488f-9475-215bbaae9bfc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.399359 Sep 08 13:02:58.517286 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2068/4007] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:58 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:02:58.551538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e35e27b8-b4a8-41bf-9195-22a221b1f8a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:58.554738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e35e27b8-b4a8-41bf-9195-22a221b1f8a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:58.560346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:02:58.579702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e35e27b8-b4a8-41bf-9195-22a221b1f8a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:58.581235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e35e27b8-b4a8-41bf-9195-22a221b1f8a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:58.582588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e35e27b8-b4a8-41bf-9195-22a221b1f8a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:58.589982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e35e27b8-b4a8-41bf-9195-22a221b1f8a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:58.592229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e35e27b8-b4a8-41bf-9195-22a221b1f8a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:58.593130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e35e27b8-b4a8-41bf-9195-22a221b1f8a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:58.866524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee5fa9b6-047b-4512-8b37-1f09c0888394 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:58.867159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ee5fa9b6-047b-4512-8b37-1f09c0888394 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:58.882970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee5fa9b6-047b-4512-8b37-1f09c0888394 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:58.886066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee5fa9b6-047b-4512-8b37-1f09c0888394 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:58.888775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee5fa9b6-047b-4512-8b37-1f09c0888394 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:58.889838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee5fa9b6-047b-4512-8b37-1f09c0888394 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:58.890342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee5fa9b6-047b-4512-8b37-1f09c0888394 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:58.895015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee5fa9b6-047b-4512-8b37-1f09c0888394 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:59.494387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e35e27b8-b4a8-41bf-9195-22a221b1f8a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:59.535204 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e35e27b8-b4a8-41bf-9195-22a221b1f8a8 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 200 len: 1481 microversion: 2.1 time: 1.024368 Sep 08 13:02:59.536161 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1940/4008] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:58 2022] GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 1481 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:02:59.541741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b21586bd-fbec-43e4-9822-fa7aee7e6bfd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:59.542372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b21586bd-fbec-43e4-9822-fa7aee7e6bfd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:59.570315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b21586bd-fbec-43e4-9822-fa7aee7e6bfd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:59.571727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b21586bd-fbec-43e4-9822-fa7aee7e6bfd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:59.572423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b21586bd-fbec-43e4-9822-fa7aee7e6bfd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:59.574808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b21586bd-fbec-43e4-9822-fa7aee7e6bfd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:59.575498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b21586bd-fbec-43e4-9822-fa7aee7e6bfd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:59.576124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b21586bd-fbec-43e4-9822-fa7aee7e6bfd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:59.693080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ee5fa9b6-047b-4512-8b37-1f09c0888394 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:59.726993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ee5fa9b6-047b-4512-8b37-1f09c0888394 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:59.742228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ee5fa9b6-047b-4512-8b37-1f09c0888394 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:59.747787 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee5fa9b6-047b-4512-8b37-1f09c0888394 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 0.882311 Sep 08 13:02:59.749318 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2069/4009] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:58 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:02:59.760807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-85e305f9-0948-41a2-8d01-4484473b3fb3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:59.762118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-85e305f9-0948-41a2-8d01-4484473b3fb3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:59.782961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85e305f9-0948-41a2-8d01-4484473b3fb3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:59.784846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85e305f9-0948-41a2-8d01-4484473b3fb3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:59.789561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85e305f9-0948-41a2-8d01-4484473b3fb3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:59.792193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85e305f9-0948-41a2-8d01-4484473b3fb3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:59.793192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85e305f9-0948-41a2-8d01-4484473b3fb3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:59.795293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85e305f9-0948-41a2-8d01-4484473b3fb3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:59.880414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b21586bd-fbec-43e4-9822-fa7aee7e6bfd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:02:59.923103 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b21586bd-fbec-43e4-9822-fa7aee7e6bfd tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 200 len: 1452 microversion: 2.1 time: 0.385402 Sep 08 13:02:59.967333 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1941/4010] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:02:59 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 1452 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:02:59.973106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-96116430-2525-481e-9a14-287c829f248d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:02:59.974076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-96116430-2525-481e-9a14-287c829f248d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:02:59.985980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96116430-2525-481e-9a14-287c829f248d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:59.988454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96116430-2525-481e-9a14-287c829f248d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:59.989314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96116430-2525-481e-9a14-287c829f248d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:02:59.990267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96116430-2525-481e-9a14-287c829f248d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:02:59.993817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96116430-2525-481e-9a14-287c829f248d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:02:59.995931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96116430-2525-481e-9a14-287c829f248d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:00.617139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-96116430-2525-481e-9a14-287c829f248d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:00.643397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-96116430-2525-481e-9a14-287c829f248d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:00.645513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-96116430-2525-481e-9a14-287c829f248d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:00.652178 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-96116430-2525-481e-9a14-287c829f248d tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.683213 Sep 08 13:03:00.653059 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1942/4011] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:59 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:00.694661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-d7c01cf6-07d0-423a-9f04-3713ceeff4b4 req-c512a5ae-ef2a-48a0-be06-a7b6780468c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-plugged", "status": "completed", "tag": "b39d12c4-c98a-488f-9b41-a3704a8cd72f"}, {"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-plugged", "status": "completed", "tag": "400054e7-5c99-4a0d-a1c6-9d75e7b50cfa"}, {"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-plugged", "status": "completed", "tag": "d6b44d0c-7c17-4ee4-b680-3ecb83966756"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:00.724837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d7c01cf6-07d0-423a-9f04-3713ceeff4b4 req-c512a5ae-ef2a-48a0-be06-a7b6780468c9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:00.734737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d7c01cf6-07d0-423a-9f04-3713ceeff4b4 req-c512a5ae-ef2a-48a0-be06-a7b6780468c9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:00.735582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d7c01cf6-07d0-423a-9f04-3713ceeff4b4 req-c512a5ae-ef2a-48a0-be06-a7b6780468c9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:00.786606 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d7c01cf6-07d0-423a-9f04-3713ceeff4b4 req-c512a5ae-ef2a-48a0-be06-a7b6780468c9 service nova] Creating event network-vif-plugged:b39d12c4-c98a-488f-9b41-a3704a8cd72f for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:03:00.793078 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d7c01cf6-07d0-423a-9f04-3713ceeff4b4 req-c512a5ae-ef2a-48a0-be06-a7b6780468c9 service nova] Creating event network-vif-plugged:400054e7-5c99-4a0d-a1c6-9d75e7b50cfa for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:03:00.796326 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d7c01cf6-07d0-423a-9f04-3713ceeff4b4 req-c512a5ae-ef2a-48a0-be06-a7b6780468c9 service nova] Creating event network-vif-plugged:d6b44d0c-7c17-4ee4-b680-3ecb83966756 for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:03:00.859775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-85e305f9-0948-41a2-8d01-4484473b3fb3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:00.865580 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-d7c01cf6-07d0-423a-9f04-3713ceeff4b4 req-c512a5ae-ef2a-48a0-be06-a7b6780468c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.155753 Sep 08 13:03:00.882304 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1943/4012] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:03:00.923850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-bc8e1e14-ad1f-490f-9715-f876935846d9 req-53939bbb-82a0-49c3-9df5-5a16c4d4d08d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15036c65-9f70-4cce-bdc6-83a0ac87e853", "name": "network-vif-deleted", "tag": "014fff2f-2919-4ee9-b667-4043981336b9"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:00.935837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-85e305f9-0948-41a2-8d01-4484473b3fb3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:00.942495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-85e305f9-0948-41a2-8d01-4484473b3fb3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:00.951475 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-85e305f9-0948-41a2-8d01-4484473b3fb3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1358 microversion: 2.21 time: 1.198796 Sep 08 13:03:00.975270 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2070/4013] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:02:59 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1358 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:00.977537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f0c6e91e-4a24-4914-baeb-937edd4509dd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:00.978679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f0c6e91e-4a24-4914-baeb-937edd4509dd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:01.005989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bc8e1e14-ad1f-490f-9715-f876935846d9 req-53939bbb-82a0-49c3-9df5-5a16c4d4d08d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:01.007095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bc8e1e14-ad1f-490f-9715-f876935846d9 req-53939bbb-82a0-49c3-9df5-5a16c4d4d08d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:01.007984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bc8e1e14-ad1f-490f-9715-f876935846d9 req-53939bbb-82a0-49c3-9df5-5a16c4d4d08d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:01.019826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0c6e91e-4a24-4914-baeb-937edd4509dd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:01.020713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0c6e91e-4a24-4914-baeb-937edd4509dd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:01.024961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0c6e91e-4a24-4914-baeb-937edd4509dd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:01.026120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0c6e91e-4a24-4914-baeb-937edd4509dd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:01.032108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0c6e91e-4a24-4914-baeb-937edd4509dd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:01.032953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0c6e91e-4a24-4914-baeb-937edd4509dd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:01.091347 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-bc8e1e14-ad1f-490f-9715-f876935846d9 req-53939bbb-82a0-49c3-9df5-5a16c4d4d08d service nova] Creating event network-vif-deleted:014fff2f-2919-4ee9-b667-4043981336b9 for instance 15036c65-9f70-4cce-bdc6-83a0ac87e853 on n-h1-852084-10 Sep 08 13:03:01.145415 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-bc8e1e14-ad1f-490f-9715-f876935846d9 req-53939bbb-82a0-49c3-9df5-5a16c4d4d08d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.254097 Sep 08 13:03:01.154240 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1944/4014] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:03:01.166015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8997704d-dbce-4bd9-b1a4-0b86f6c5a730 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:01.167742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8997704d-dbce-4bd9-b1a4-0b86f6c5a730 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:01.189526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8997704d-dbce-4bd9-b1a4-0b86f6c5a730 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:01.192078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8997704d-dbce-4bd9-b1a4-0b86f6c5a730 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:01.201884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8997704d-dbce-4bd9-b1a4-0b86f6c5a730 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:01.203188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8997704d-dbce-4bd9-b1a4-0b86f6c5a730 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:01.203998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8997704d-dbce-4bd9-b1a4-0b86f6c5a730 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:01.207727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8997704d-dbce-4bd9-b1a4-0b86f6c5a730 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:01.632002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:02.277641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8997704d-dbce-4bd9-b1a4-0b86f6c5a730 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:02.287674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:02.355692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8997704d-dbce-4bd9-b1a4-0b86f6c5a730 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:02.358712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8997704d-dbce-4bd9-b1a4-0b86f6c5a730 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:02.380188 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8997704d-dbce-4bd9-b1a4-0b86f6c5a730 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.223249 Sep 08 13:03:02.381251 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1945/4015] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:01 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:02.400027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f0c6e91e-4a24-4914-baeb-937edd4509dd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:02.410161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b14d4aaf-1df4-44fe-8b5e-6a8d408b25fa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:02.426236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b14d4aaf-1df4-44fe-8b5e-6a8d408b25fa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: 15036c65-9f70-4cce-bdc6-83a0ac87e853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:02.440205 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f0c6e91e-4a24-4914-baeb-937edd4509dd tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 200 len: 1481 microversion: 2.1 time: 1.482300 Sep 08 13:03:02.451897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b14d4aaf-1df4-44fe-8b5e-6a8d408b25fa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:02.452765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b14d4aaf-1df4-44fe-8b5e-6a8d408b25fa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:02.453551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b14d4aaf-1df4-44fe-8b5e-6a8d408b25fa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:02.454832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b14d4aaf-1df4-44fe-8b5e-6a8d408b25fa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:02.459772 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2071/4016] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:00 2022] GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 1481 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:02.468050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b14d4aaf-1df4-44fe-8b5e-6a8d408b25fa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:02.476281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b14d4aaf-1df4-44fe-8b5e-6a8d408b25fa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:02.481936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-19ec3af8-7e07-4982-99e9-943a460ab549 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:02.483003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-19ec3af8-7e07-4982-99e9-943a460ab549 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:02.536023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19ec3af8-7e07-4982-99e9-943a460ab549 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:02.537336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19ec3af8-7e07-4982-99e9-943a460ab549 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:02.539467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19ec3af8-7e07-4982-99e9-943a460ab549 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:02.546512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19ec3af8-7e07-4982-99e9-943a460ab549 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:02.550608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19ec3af8-7e07-4982-99e9-943a460ab549 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:02.553793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19ec3af8-7e07-4982-99e9-943a460ab549 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:02.566992 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-b14d4aaf-1df4-44fe-8b5e-6a8d408b25fa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] HTTP exception thrown: Instance 15036c65-9f70-4cce-bdc6-83a0ac87e853 could not be found. Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b14d4aaf-1df4-44fe-8b5e-6a8d408b25fa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Request method failure captured: Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 HTTP/1.1 Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeVJlpIUu4I3etLbEARIZH8KBjvhrlSlsNaLxWsUVVjxg7DGa1gDBkjoWynkMnF04mkRKPOu0mP64ZnQqdnNZ67aOntgfBqoqUU7VATzwJXlIjY4wY2V0n8uOV_tKF-BjMvxYlC2i-O3RjgSypdvXI4jXqJB4nuGXejMn4MVXpX9mCw Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 59dc0decb175444491383c39918c5b2e Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerActionsTestJSON-204893554 Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_59dc0decb175444491383c39918c5b2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/59dc0decb175444491383c39918c5b2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59dc0decb175444491383c39918c5b2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59dc0decb175444491383c39918c5b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerActionsTestJSON-204893554 Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 59dc0decb175444491383c39918c5b2e Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerActionsTestJSON-204893554 Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerActionsTestJSON-204893554-project Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 4140a06bc6934d7780ef9ff3e30e6dd5 Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerActionsTestJSON-204893554-project Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 15036c65-9f70-4cce-bdc6-83a0ac87e853 could not be found. Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '15036c65-9f70-4cce-bdc6-83a0ac87e853'} Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15036c65-9f70-4cce-bdc6-83a0ac87e853 could not be found. Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15036c65-9f70-4cce-bdc6-83a0ac87e853 could not be found. Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:02.597488 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:02.606175 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:02.606175 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:02.606175 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:02.606175 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:03:02.606175 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:03:02.606175 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15036c65-9f70-4cce-bdc6-83a0ac87e853 could not be found. Sep 08 13:03:02.606175 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:02.608478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b14d4aaf-1df4-44fe-8b5e-6a8d408b25fa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Returning 404 to user: Instance 15036c65-9f70-4cce-bdc6-83a0ac87e853 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:03:02.610164 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b14d4aaf-1df4-44fe-8b5e-6a8d408b25fa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853" status: 404 len: 111 microversion: 2.1 time: 0.209064 Sep 08 13:03:02.627148 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1946/4017] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:02 2022] GET /compute/v2.1/servers/15036c65-9f70-4cce-bdc6-83a0ac87e853 => generated 111 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:03:02.687274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e0f494e6-89a4-4f7e-8ca0-c96d0b5a53fc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:02.690289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e0f494e6-89a4-4f7e-8ca0-c96d0b5a53fc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:02.696452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:02.724965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0f494e6-89a4-4f7e-8ca0-c96d0b5a53fc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:02.725463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0f494e6-89a4-4f7e-8ca0-c96d0b5a53fc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:02.731845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0f494e6-89a4-4f7e-8ca0-c96d0b5a53fc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:02.732667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0f494e6-89a4-4f7e-8ca0-c96d0b5a53fc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:02.733158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0f494e6-89a4-4f7e-8ca0-c96d0b5a53fc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:02.733608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0f494e6-89a4-4f7e-8ca0-c96d0b5a53fc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:02.935800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-19ec3af8-7e07-4982-99e9-943a460ab549 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:02.954217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-19ec3af8-7e07-4982-99e9-943a460ab549 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:02.967702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-19ec3af8-7e07-4982-99e9-943a460ab549 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:02.974198 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-19ec3af8-7e07-4982-99e9-943a460ab549 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.513012 Sep 08 13:03:02.979174 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2072/4018] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:02 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:03.000649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aa47cde7-016c-49b6-8627-0b49b8b0f794 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:03.001793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aa47cde7-016c-49b6-8627-0b49b8b0f794 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:03.025475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa47cde7-016c-49b6-8627-0b49b8b0f794 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:03.029481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa47cde7-016c-49b6-8627-0b49b8b0f794 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:03.030305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa47cde7-016c-49b6-8627-0b49b8b0f794 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:03.034123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa47cde7-016c-49b6-8627-0b49b8b0f794 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:03.039246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa47cde7-016c-49b6-8627-0b49b8b0f794 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:03.044793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa47cde7-016c-49b6-8627-0b49b8b0f794 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:03.120756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aa47cde7-016c-49b6-8627-0b49b8b0f794 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:03:03.481877 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aa47cde7-016c-49b6-8627-0b49b8b0f794 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "DELETE /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 204 len: 0 microversion: 2.1 time: 0.500870 Sep 08 13:03:03.494476 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2073/4019] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:03:02 2022] DELETE /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:03:03.506520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e42e717d-15c3-43fe-b33e-79587061553d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:03.510983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e42e717d-15c3-43fe-b33e-79587061553d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:03.529494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e42e717d-15c3-43fe-b33e-79587061553d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:03.530278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e42e717d-15c3-43fe-b33e-79587061553d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:03.530930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e42e717d-15c3-43fe-b33e-79587061553d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:03.531918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e42e717d-15c3-43fe-b33e-79587061553d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:03.532546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e42e717d-15c3-43fe-b33e-79587061553d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:03.533132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e42e717d-15c3-43fe-b33e-79587061553d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:03.533795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e0f494e6-89a4-4f7e-8ca0-c96d0b5a53fc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:03.555104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e0f494e6-89a4-4f7e-8ca0-c96d0b5a53fc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:03.564773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e0f494e6-89a4-4f7e-8ca0-c96d0b5a53fc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:03.570260 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e0f494e6-89a4-4f7e-8ca0-c96d0b5a53fc tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1358 microversion: 2.21 time: 0.936614 Sep 08 13:03:03.574117 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1947/4020] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:02 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1358 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:03.594025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2bfbcc02-095b-4bdd-8af3-f96a894d0d73 req-f9054340-23cb-479c-bc1f-da7199946a1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-plugged", "status": "completed", "tag": "1be64155-8dac-40c9-9439-05e67430247f"}, {"server_uuid": "90a767f4-2dcd-4dff-b8a0-ad87d0864ee4", "name": "network-vif-unplugged", "status": "completed", "tag": "8cb84f34-e16f-4afb-8a60-19a607783761"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:03.648061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:03.666993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2bfbcc02-095b-4bdd-8af3-f96a894d0d73 req-f9054340-23cb-479c-bc1f-da7199946a1b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:03.667830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2bfbcc02-095b-4bdd-8af3-f96a894d0d73 req-f9054340-23cb-479c-bc1f-da7199946a1b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:03.668277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2bfbcc02-095b-4bdd-8af3-f96a894d0d73 req-f9054340-23cb-479c-bc1f-da7199946a1b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:03.761822 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2bfbcc02-095b-4bdd-8af3-f96a894d0d73 req-f9054340-23cb-479c-bc1f-da7199946a1b service nova] Creating event network-vif-plugged:1be64155-8dac-40c9-9439-05e67430247f for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:03:03.776331 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2bfbcc02-095b-4bdd-8af3-f96a894d0d73 req-f9054340-23cb-479c-bc1f-da7199946a1b service nova] Creating event network-vif-unplugged:8cb84f34-e16f-4afb-8a60-19a607783761 for instance 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 on n-h1-852084-10 Sep 08 13:03:03.814111 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2bfbcc02-095b-4bdd-8af3-f96a894d0d73 req-f9054340-23cb-479c-bc1f-da7199946a1b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.235179 Sep 08 13:03:03.816216 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1948/4021] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:03:03.830498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5e9d02b4-b3ec-4c67-bc6b-8ad23a73537c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:03.832478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5e9d02b4-b3ec-4c67-bc6b-8ad23a73537c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:03.859994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e9d02b4-b3ec-4c67-bc6b-8ad23a73537c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:03.860846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e9d02b4-b3ec-4c67-bc6b-8ad23a73537c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:03.866274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e9d02b4-b3ec-4c67-bc6b-8ad23a73537c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:03.867604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e9d02b4-b3ec-4c67-bc6b-8ad23a73537c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:03.869802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e9d02b4-b3ec-4c67-bc6b-8ad23a73537c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:03.870798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e9d02b4-b3ec-4c67-bc6b-8ad23a73537c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:04.427438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5e9d02b4-b3ec-4c67-bc6b-8ad23a73537c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:04.459589 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5e9d02b4-b3ec-4c67-bc6b-8ad23a73537c tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 200 len: 1439 microversion: 2.1 time: 0.640149 Sep 08 13:03:04.461078 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1949/4022] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:03 2022] GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 1439 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:04.466714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eb25c2cd-283e-4a51-b5f9-110f855dfdaa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:04.494319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eb25c2cd-283e-4a51-b5f9-110f855dfdaa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:04.544493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb25c2cd-283e-4a51-b5f9-110f855dfdaa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:04.546040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb25c2cd-283e-4a51-b5f9-110f855dfdaa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:04.550328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb25c2cd-283e-4a51-b5f9-110f855dfdaa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:04.551584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb25c2cd-283e-4a51-b5f9-110f855dfdaa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:04.554259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb25c2cd-283e-4a51-b5f9-110f855dfdaa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:04.554720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb25c2cd-283e-4a51-b5f9-110f855dfdaa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:04.903624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e42e717d-15c3-43fe-b33e-79587061553d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:04.958398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e42e717d-15c3-43fe-b33e-79587061553d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:04.983519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e42e717d-15c3-43fe-b33e-79587061553d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:04.985814 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e42e717d-15c3-43fe-b33e-79587061553d tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.489435 Sep 08 13:03:04.998461 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2074/4023] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:03 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:05.040932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-dc20383a-3161-4901-bd82-dc30f87fd93e req-4cdbf3d3-e8fb-47ab-a944-522ba6af0a06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90a767f4-2dcd-4dff-b8a0-ad87d0864ee4", "name": "network-vif-deleted", "tag": "8cb84f34-e16f-4afb-8a60-19a607783761"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:05.086041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dc20383a-3161-4901-bd82-dc30f87fd93e req-4cdbf3d3-e8fb-47ab-a944-522ba6af0a06 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:05.093659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dc20383a-3161-4901-bd82-dc30f87fd93e req-4cdbf3d3-e8fb-47ab-a944-522ba6af0a06 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:05.094856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dc20383a-3161-4901-bd82-dc30f87fd93e req-4cdbf3d3-e8fb-47ab-a944-522ba6af0a06 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:05.155563 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-dc20383a-3161-4901-bd82-dc30f87fd93e req-4cdbf3d3-e8fb-47ab-a944-522ba6af0a06 service nova] Creating event network-vif-deleted:8cb84f34-e16f-4afb-8a60-19a607783761 for instance 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 on n-h1-852084-10 Sep 08 13:03:05.174941 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-dc20383a-3161-4901-bd82-dc30f87fd93e req-4cdbf3d3-e8fb-47ab-a944-522ba6af0a06 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173853 Sep 08 13:03:05.181618 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2075/4024] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:03:05.223579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9e3b6c2-fe0a-4743-adb3-99148b2c9cb9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:05.225564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a9e3b6c2-fe0a-4743-adb3-99148b2c9cb9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:05.245667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eb25c2cd-283e-4a51-b5f9-110f855dfdaa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:05.246539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9e3b6c2-fe0a-4743-adb3-99148b2c9cb9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:05.247717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9e3b6c2-fe0a-4743-adb3-99148b2c9cb9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:05.249124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9e3b6c2-fe0a-4743-adb3-99148b2c9cb9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:05.251715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9e3b6c2-fe0a-4743-adb3-99148b2c9cb9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:05.252908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9e3b6c2-fe0a-4743-adb3-99148b2c9cb9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:05.253979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9e3b6c2-fe0a-4743-adb3-99148b2c9cb9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:05.269207 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eb25c2cd-283e-4a51-b5f9-110f855dfdaa tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1676 microversion: 2.1 time: 0.806417 Sep 08 13:03:05.283280 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1950/4025] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:04 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1676 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:05.299289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b7252818-4257-4190-b30c-fc8229fe610a tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:05.299289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b7252818-4257-4190-b30c-fc8229fe610a tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:05.311186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7252818-4257-4190-b30c-fc8229fe610a tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:05.311718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7252818-4257-4190-b30c-fc8229fe610a tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:05.312161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7252818-4257-4190-b30c-fc8229fe610a tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:05.312884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7252818-4257-4190-b30c-fc8229fe610a tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:05.313403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7252818-4257-4190-b30c-fc8229fe610a tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:05.313774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7252818-4257-4190-b30c-fc8229fe610a tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:05.599349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9e3b6c2-fe0a-4743-adb3-99148b2c9cb9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:05.633802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9e3b6c2-fe0a-4743-adb3-99148b2c9cb9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:05.639581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9e3b6c2-fe0a-4743-adb3-99148b2c9cb9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:05.644675 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a9e3b6c2-fe0a-4743-adb3-99148b2c9cb9 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.459812 Sep 08 13:03:05.668668 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2076/4026] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:05 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:05.714243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:05.718479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:05.749812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:05.752654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:05.753845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:05.757413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:05.760498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:05.761771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:05.865875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:05.866995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:05.867964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:05.868759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lazy-loading 'fault' on Instance uuid 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:03:05.957751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '227ef616a0764f5eaff5988f8a470f0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '547655f80d6f4dabad7b7a2c659853b1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:05.969407 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-425e7eaa-268f-4ef8-905a-cf60e4da402f tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 200 len: 1283 microversion: 2.1 time: 0.271772 Sep 08 13:03:05.973541 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2077/4027] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:05 2022] GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 1283 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:06.005018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-dd46b6eb-7b21-44d7-9e84-fe1839d2c3ea req-59fc18ab-1d15-4ca5-b2ca-b7f848889ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-plugged", "status": "completed", "tag": "8a64c4ec-96a3-4c30-bb50-fded084669fd"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:06.034108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dd46b6eb-7b21-44d7-9e84-fe1839d2c3ea req-59fc18ab-1d15-4ca5-b2ca-b7f848889ac9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:06.034811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dd46b6eb-7b21-44d7-9e84-fe1839d2c3ea req-59fc18ab-1d15-4ca5-b2ca-b7f848889ac9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:06.035482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dd46b6eb-7b21-44d7-9e84-fe1839d2c3ea req-59fc18ab-1d15-4ca5-b2ca-b7f848889ac9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:06.075402 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-dd46b6eb-7b21-44d7-9e84-fe1839d2c3ea req-59fc18ab-1d15-4ca5-b2ca-b7f848889ac9 service nova] Creating event network-vif-plugged:8a64c4ec-96a3-4c30-bb50-fded084669fd for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:03:06.086954 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-dd46b6eb-7b21-44d7-9e84-fe1839d2c3ea req-59fc18ab-1d15-4ca5-b2ca-b7f848889ac9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091106 Sep 08 13:03:06.093173 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2078/4028] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:03:06.100014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0a1cff03-8363-47a7-885f-2b6daf0404ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:06.100732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0a1cff03-8363-47a7-885f-2b6daf0404ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:06.122354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a1cff03-8363-47a7-885f-2b6daf0404ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:06.122951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a1cff03-8363-47a7-885f-2b6daf0404ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:06.127191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a1cff03-8363-47a7-885f-2b6daf0404ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:06.128027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a1cff03-8363-47a7-885f-2b6daf0404ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:06.128525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a1cff03-8363-47a7-885f-2b6daf0404ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:06.128969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a1cff03-8363-47a7-885f-2b6daf0404ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:06.169383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b7252818-4257-4190-b30c-fc8229fe610a tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:06.205817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b7252818-4257-4190-b30c-fc8229fe610a tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:06.209226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b7252818-4257-4190-b30c-fc8229fe610a tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:06.216965 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b7252818-4257-4190-b30c-fc8229fe610a tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1358 microversion: 2.21 time: 0.942868 Sep 08 13:03:06.222202 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1951/4029] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:05 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1358 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:06.321629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-18bd7fdb-9da7-48f9-a5fe-300877053e33 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:06.329580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-18bd7fdb-9da7-48f9-a5fe-300877053e33 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:06.349431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18bd7fdb-9da7-48f9-a5fe-300877053e33 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:06.355075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18bd7fdb-9da7-48f9-a5fe-300877053e33 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:06.364731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18bd7fdb-9da7-48f9-a5fe-300877053e33 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:06.366639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18bd7fdb-9da7-48f9-a5fe-300877053e33 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:06.368131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18bd7fdb-9da7-48f9-a5fe-300877053e33 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:06.369258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18bd7fdb-9da7-48f9-a5fe-300877053e33 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:07.116918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0a1cff03-8363-47a7-885f-2b6daf0404ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:07.133152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0a1cff03-8363-47a7-885f-2b6daf0404ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:07.142718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0a1cff03-8363-47a7-885f-2b6daf0404ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:07.144809 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0a1cff03-8363-47a7-885f-2b6daf0404ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.049697 Sep 08 13:03:07.159784 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2079/4030] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:06 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:07.184595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-30023d34-c9ba-4db0-99d9-9f55ecd73998 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:07.188070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-30023d34-c9ba-4db0-99d9-9f55ecd73998 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:07.222137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-30023d34-c9ba-4db0-99d9-9f55ecd73998 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:07.223604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-30023d34-c9ba-4db0-99d9-9f55ecd73998 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:07.226702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-30023d34-c9ba-4db0-99d9-9f55ecd73998 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:07.230533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-30023d34-c9ba-4db0-99d9-9f55ecd73998 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:07.236443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-30023d34-c9ba-4db0-99d9-9f55ecd73998 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:07.238366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-30023d34-c9ba-4db0-99d9-9f55ecd73998 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:07.297070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-18bd7fdb-9da7-48f9-a5fe-300877053e33 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:07.308503 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-18bd7fdb-9da7-48f9-a5fe-300877053e33 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1676 microversion: 2.1 time: 0.995210 Sep 08 13:03:07.324028 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1952/4031] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:06 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1676 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:07.353725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b8cec45b-239f-4837-85c2-bb658c9a0fb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:07.354289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b8cec45b-239f-4837-85c2-bb658c9a0fb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] [instance: 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:07.381581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8cec45b-239f-4837-85c2-bb658c9a0fb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:07.382302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8cec45b-239f-4837-85c2-bb658c9a0fb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:07.382910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8cec45b-239f-4837-85c2-bb658c9a0fb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:07.392253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8cec45b-239f-4837-85c2-bb658c9a0fb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:07.392803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8cec45b-239f-4837-85c2-bb658c9a0fb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:07.394846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8cec45b-239f-4837-85c2-bb658c9a0fb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:07.445612 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-b8cec45b-239f-4837-85c2-bb658c9a0fb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] HTTP exception thrown: Instance 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 could not be found. Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b8cec45b-239f-4837-85c2-bb658c9a0fb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Request method failure captured: Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 HTTP/1.1 Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeaW6mbl2g-jUTiny9acNCU_ECTD8mDHHdmZA1v8mMOSiOf_INIwtxmbMkWUZ3eYTrkN8aC99ymvxiC6x6Afb41dpf2ocCfJwC9JtE1Y0fpFipsWKOY_-UvdC7IkLFX4CEuixskK-XAg3TwIa8NqETlNKQYL56WJp95r6IapKU1Jwtk Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersTestJSON-789653732 Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/547655f80d6f4dabad7b7a2c659853b1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersTestJSON-789653732 Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 547655f80d6f4dabad7b7a2c659853b1 Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersTestJSON-789653732 Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersTestJSON-789653732-project Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 227ef616a0764f5eaff5988f8a470f0c Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersTestJSON-789653732-project Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 could not be found. Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '90a767f4-2dcd-4dff-b8a0-ad87d0864ee4'} Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 could not be found. Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 could not be found. Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:07.454625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:07.466307 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:07.466307 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:07.466307 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:03:07.466307 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:03:07.466307 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 could not be found. Sep 08 13:03:07.466307 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:07.466307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b8cec45b-239f-4837-85c2-bb658c9a0fb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] Returning 404 to user: Instance 90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:03:07.466307 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b8cec45b-239f-4837-85c2-bb658c9a0fb3 tempest-ServersTestJSON-789653732 tempest-ServersTestJSON-789653732-project] 10.222.0.78 "GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4" status: 404 len: 111 microversion: 2.1 time: 0.131414 Sep 08 13:03:07.466307 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1953/4032] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:07 2022] GET /compute/v2.1/servers/90a767f4-2dcd-4dff-b8a0-ad87d0864ee4 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:03:07.475924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63029956-bc88-4b29-aa76-abf8f7dc0e4b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:07.475924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-63029956-bc88-4b29-aa76-abf8f7dc0e4b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:07.489301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63029956-bc88-4b29-aa76-abf8f7dc0e4b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:07.489823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63029956-bc88-4b29-aa76-abf8f7dc0e4b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:07.490278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63029956-bc88-4b29-aa76-abf8f7dc0e4b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:07.491026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63029956-bc88-4b29-aa76-abf8f7dc0e4b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:07.491559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63029956-bc88-4b29-aa76-abf8f7dc0e4b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:07.492003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63029956-bc88-4b29-aa76-abf8f7dc0e4b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:07.564760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-30023d34-c9ba-4db0-99d9-9f55ecd73998 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:07.603206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-30023d34-c9ba-4db0-99d9-9f55ecd73998 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:07.612704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-30023d34-c9ba-4db0-99d9-9f55ecd73998 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:07.616277 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-30023d34-c9ba-4db0-99d9-9f55ecd73998 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1605 microversion: 2.42 time: 0.440582 Sep 08 13:03:07.625315 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2080/4033] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:07 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1605 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:07.639728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-9209c6de-f38e-45a5-8285-a8de6b591a99 req-fa14ffac-604a-48b0-a1d2-5617c955da74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a68b5e05-8226-459a-9fa2-a6c34a6e6959", "tag": "4eb43058-1154-4fdc-854a-d71e9ed11299"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:07.661356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9209c6de-f38e-45a5-8285-a8de6b591a99 req-fa14ffac-604a-48b0-a1d2-5617c955da74 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:07.661997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9209c6de-f38e-45a5-8285-a8de6b591a99 req-fa14ffac-604a-48b0-a1d2-5617c955da74 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:07.662535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9209c6de-f38e-45a5-8285-a8de6b591a99 req-fa14ffac-604a-48b0-a1d2-5617c955da74 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:07.698654 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-9209c6de-f38e-45a5-8285-a8de6b591a99 req-fa14ffac-604a-48b0-a1d2-5617c955da74 service nova] Creating event network-changed:4eb43058-1154-4fdc-854a-d71e9ed11299 for instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 on n-h2-852084-10 Sep 08 13:03:07.705798 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-9209c6de-f38e-45a5-8285-a8de6b591a99 req-fa14ffac-604a-48b0-a1d2-5617c955da74 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078777 Sep 08 13:03:07.712575 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2081/4034] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:03:07.991205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-63029956-bc88-4b29-aa76-abf8f7dc0e4b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:08.059117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-63029956-bc88-4b29-aa76-abf8f7dc0e4b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:08.068984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-63029956-bc88-4b29-aa76-abf8f7dc0e4b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:08.072024 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-63029956-bc88-4b29-aa76-abf8f7dc0e4b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1358 microversion: 2.21 time: 0.605274 Sep 08 13:03:08.095778 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1954/4035] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:07 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1358 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:08.170013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d17b79b3-183c-465d-8ab3-f9af5c083cf1 req-d6ce09bf-6465-404c-8491-52fb35055b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-plugged", "status": "completed", "tag": "82d9067d-9ad7-41b2-8a73-eeae9e8ec555"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:08.186550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f4188f66-7dc8-4774-96c5-e738952502f1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:08.187655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f4188f66-7dc8-4774-96c5-e738952502f1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:08.209442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:08.214615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d17b79b3-183c-465d-8ab3-f9af5c083cf1 req-d6ce09bf-6465-404c-8491-52fb35055b8a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:08.215055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4188f66-7dc8-4774-96c5-e738952502f1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:08.215653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4188f66-7dc8-4774-96c5-e738952502f1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:08.216118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4188f66-7dc8-4774-96c5-e738952502f1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:08.216821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d17b79b3-183c-465d-8ab3-f9af5c083cf1 req-d6ce09bf-6465-404c-8491-52fb35055b8a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:08.217047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4188f66-7dc8-4774-96c5-e738952502f1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:08.217939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d17b79b3-183c-465d-8ab3-f9af5c083cf1 req-d6ce09bf-6465-404c-8491-52fb35055b8a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:08.237362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4188f66-7dc8-4774-96c5-e738952502f1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:08.241163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4188f66-7dc8-4774-96c5-e738952502f1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:08.278508 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d17b79b3-183c-465d-8ab3-f9af5c083cf1 req-d6ce09bf-6465-404c-8491-52fb35055b8a service nova] Creating event network-vif-plugged:82d9067d-9ad7-41b2-8a73-eeae9e8ec555 for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:03:08.302089 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d17b79b3-183c-465d-8ab3-f9af5c083cf1 req-d6ce09bf-6465-404c-8491-52fb35055b8a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141272 Sep 08 13:03:08.311732 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2082/4036] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:03:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:03:08.344116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2c1db3a8-2918-4274-9814-aaba5966faef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:08.345234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2c1db3a8-2918-4274-9814-aaba5966faef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:08.364234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1db3a8-2918-4274-9814-aaba5966faef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:08.365107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1db3a8-2918-4274-9814-aaba5966faef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:08.365767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1db3a8-2918-4274-9814-aaba5966faef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:08.366735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1db3a8-2918-4274-9814-aaba5966faef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:08.369016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1db3a8-2918-4274-9814-aaba5966faef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:08.372573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1db3a8-2918-4274-9814-aaba5966faef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:08.745233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2c1db3a8-2918-4274-9814-aaba5966faef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:08.760304 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2c1db3a8-2918-4274-9814-aaba5966faef tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1608 microversion: 2.1 time: 0.422647 Sep 08 13:03:08.764787 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2083/4037] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:08 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1608 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:03:08.777600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:08.784348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:08.817798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:08.819265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:08.820802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:08.824744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:08.825760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:08.826485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:08.942252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:08.943438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:08.944463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:08.945373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lazy-loading 'fault' on Instance uuid cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:03:09.271009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:09.350485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:09.361631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '39d5a18c9a8d462ca4e9fcdc74dfc8c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dde98df8ff64478e93fde5f75096c60a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:09.377507 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-26635fbf-b65d-4c65-9e7a-d3309c3ca1f6 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 200 len: 1610 microversion: 2.42 time: 0.600766 Sep 08 13:03:09.414472 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2084/4038] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:08 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 1610 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:09.441606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e808afeb-73c0-49a6-8ca2-bf31b8fd57c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:09.442858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e808afeb-73c0-49a6-8ca2-bf31b8fd57c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:09.484629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e808afeb-73c0-49a6-8ca2-bf31b8fd57c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:09.500549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e808afeb-73c0-49a6-8ca2-bf31b8fd57c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:09.501907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e808afeb-73c0-49a6-8ca2-bf31b8fd57c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:09.504771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e808afeb-73c0-49a6-8ca2-bf31b8fd57c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:09.507942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e808afeb-73c0-49a6-8ca2-bf31b8fd57c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:09.510409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e808afeb-73c0-49a6-8ca2-bf31b8fd57c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:09.518153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f4188f66-7dc8-4774-96c5-e738952502f1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:09.583623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f4188f66-7dc8-4774-96c5-e738952502f1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:09.592410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f4188f66-7dc8-4774-96c5-e738952502f1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:09.594091 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f4188f66-7dc8-4774-96c5-e738952502f1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.415040 Sep 08 13:03:09.605068 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1955/4039] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:08 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:09.814202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ed10b287-f1b3-4ff4-af91-8e9e5c727e43 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:09.815183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ed10b287-f1b3-4ff4-af91-8e9e5c727e43 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:09.833809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed10b287-f1b3-4ff4-af91-8e9e5c727e43 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:09.834912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed10b287-f1b3-4ff4-af91-8e9e5c727e43 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:09.837878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed10b287-f1b3-4ff4-af91-8e9e5c727e43 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:09.842531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed10b287-f1b3-4ff4-af91-8e9e5c727e43 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:09.844505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed10b287-f1b3-4ff4-af91-8e9e5c727e43 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:09.850212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed10b287-f1b3-4ff4-af91-8e9e5c727e43 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:09.894752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e808afeb-73c0-49a6-8ca2-bf31b8fd57c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:09.908574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e808afeb-73c0-49a6-8ca2-bf31b8fd57c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:09.912517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e808afeb-73c0-49a6-8ca2-bf31b8fd57c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:09.915957 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e808afeb-73c0-49a6-8ca2-bf31b8fd57c3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1358 microversion: 2.21 time: 0.498673 Sep 08 13:03:09.917566 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2085/4040] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:09 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1358 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:10.012489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ed10b287-f1b3-4ff4-af91-8e9e5c727e43 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:10.023264 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ed10b287-f1b3-4ff4-af91-8e9e5c727e43 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1608 microversion: 2.1 time: 0.214728 Sep 08 13:03:10.024936 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1956/4041] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:09 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1608 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:10.440963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-32a130d7-4d8d-44a5-87f8-30160c7c415b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:10.445525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-32a130d7-4d8d-44a5-87f8-30160c7c415b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:10.486361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32a130d7-4d8d-44a5-87f8-30160c7c415b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:10.487607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32a130d7-4d8d-44a5-87f8-30160c7c415b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:10.488574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32a130d7-4d8d-44a5-87f8-30160c7c415b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:10.490099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32a130d7-4d8d-44a5-87f8-30160c7c415b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:10.492042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32a130d7-4d8d-44a5-87f8-30160c7c415b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:10.495167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32a130d7-4d8d-44a5-87f8-30160c7c415b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:10.527435 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-32a130d7-4d8d-44a5-87f8-30160c7c415b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] HTTP exception thrown: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-32a130d7-4d8d-44a5-87f8-30160c7c415b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Request method failure captured: Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 HTTP/1.1 Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeY_ic7o_8Cz6pFf7NPWf_rlAIWwmt4a8EZuDKADM8i3AWQ7mw3TSKEjCytuuxWEvlwet6Hx8uD1x9sbFb-Knkza3JJq35V_6S9nzgEEHH1fuMNRSgsV5vET7afQOtPvreKVY8D1Xfj7LgOUaZ_F5TLvYHpRXilTK4u3bdEjy8W7eEg Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.42 Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: dde98df8ff64478e93fde5f75096c60a Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-174900958 Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dde98df8ff64478e93fde5f75096c60a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dde98df8ff64478e93fde5f75096c60a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dde98df8ff64478e93fde5f75096c60a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dde98df8ff64478e93fde5f75096c60a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TaggedBootDevicesTest_v242-174900958 Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: dde98df8ff64478e93fde5f75096c60a Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-174900958 Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TaggedBootDevicesTest_v242-174900958-project Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 39d5a18c9a8d462ca4e9fcdc74dfc8c2 Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TaggedBootDevicesTest_v242-174900958-project Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6'} Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:10.529686 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:10.533422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:10.533422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:10.533422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:10.533422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:10.533422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:03:10.533422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:03:10.533422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:10.533422 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:10.535863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-32a130d7-4d8d-44a5-87f8-30160c7c415b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Returning 404 to user: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:03:10.537451 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-32a130d7-4d8d-44a5-87f8-30160c7c415b tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 404 len: 111 microversion: 2.42 time: 0.109957 Sep 08 13:03:10.538452 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2086/4042] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:10 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:03:10.556371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8f2ab4b8-c530-4891-8d8f-64f1acc42e14 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '.version_select at 0x7fdb39e9a5e0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:10.647928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc184a87-f042-4f84-b46c-16473c8ae3c7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:10.652751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cc184a87-f042-4f84-b46c-16473c8ae3c7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:10.666744 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8f2ab4b8-c530-4891-8d8f-64f1acc42e14 tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857920673" status: 204 len: 0 microversion: 2.42 time: 0.116749 Sep 08 13:03:10.670751 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1957/4043] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 13:03:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1857920673 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:03:10.707469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc184a87-f042-4f84-b46c-16473c8ae3c7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:10.708922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc184a87-f042-4f84-b46c-16473c8ae3c7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:10.709870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc184a87-f042-4f84-b46c-16473c8ae3c7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:10.710907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc184a87-f042-4f84-b46c-16473c8ae3c7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:10.715091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc184a87-f042-4f84-b46c-16473c8ae3c7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:10.716297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc184a87-f042-4f84-b46c-16473c8ae3c7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:10.955276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f1164889-c404-4d62-932c-3903cae25f8b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:10.959639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f1164889-c404-4d62-932c-3903cae25f8b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:10.994810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1164889-c404-4d62-932c-3903cae25f8b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:11.001398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1164889-c404-4d62-932c-3903cae25f8b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:11.005857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1164889-c404-4d62-932c-3903cae25f8b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:11.008465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1164889-c404-4d62-932c-3903cae25f8b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:11.011362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1164889-c404-4d62-932c-3903cae25f8b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:11.014752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1164889-c404-4d62-932c-3903cae25f8b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:12.526831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cc184a87-f042-4f84-b46c-16473c8ae3c7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:12.550780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cc184a87-f042-4f84-b46c-16473c8ae3c7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:12.552714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cc184a87-f042-4f84-b46c-16473c8ae3c7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:12.559952 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc184a87-f042-4f84-b46c-16473c8ae3c7 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1875 microversion: 2.32 time: 1.922901 Sep 08 13:03:12.572989 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2087/4044] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:10 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1875 bytes in 1938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:12.597062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:12.598006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:12.607763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:12.612009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:12.614598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:12.617865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:12.618712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:12.619810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:12.629341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f1164889-c404-4d62-932c-3903cae25f8b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:12.665792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f1164889-c404-4d62-932c-3903cae25f8b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:12.674072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f1164889-c404-4d62-932c-3903cae25f8b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:12.680922 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f1164889-c404-4d62-932c-3903cae25f8b tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1358 microversion: 2.21 time: 1.732735 Sep 08 13:03:12.698667 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1958/4045] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:10 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1358 bytes in 1753 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:03:12.712621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:12.713676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:12.714421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:12.715042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lazy-loading 'fault' on Instance uuid abb01efa-03b9-40b6-901b-33e7d583b7c8 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:03:12.724762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a1b0764c-3348-48ea-861d-c3fd588e5abd req-e5267ca9-89dd-4761-96dd-7ccad9fce99d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abb01efa-03b9-40b6-901b-33e7d583b7c8", "name": "network-vif-deleted", "tag": "6d98b289-22e2-4a8e-ba25-0857a1412c6b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:12.784281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a1b0764c-3348-48ea-861d-c3fd588e5abd req-e5267ca9-89dd-4761-96dd-7ccad9fce99d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:12.787184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a1b0764c-3348-48ea-861d-c3fd588e5abd req-e5267ca9-89dd-4761-96dd-7ccad9fce99d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:12.788209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a1b0764c-3348-48ea-861d-c3fd588e5abd req-e5267ca9-89dd-4761-96dd-7ccad9fce99d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:12.810673 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a1b0764c-3348-48ea-861d-c3fd588e5abd req-e5267ca9-89dd-4761-96dd-7ccad9fce99d service nova] Creating event network-vif-deleted:6d98b289-22e2-4a8e-ba25-0857a1412c6b for instance abb01efa-03b9-40b6-901b-33e7d583b7c8 on n-h1-852084-10 Sep 08 13:03:12.827034 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a1b0764c-3348-48ea-861d-c3fd588e5abd req-e5267ca9-89dd-4761-96dd-7ccad9fce99d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125200 Sep 08 13:03:12.828038 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1959/4046] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:03:12.890309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4140a06bc6934d7780ef9ff3e30e6dd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dc0decb175444491383c39918c5b2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:12.905321 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0320252d-05b0-432b-9a07-e5e4af53ce7b tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 200 len: 1329 microversion: 2.1 time: 0.329597 Sep 08 13:03:12.908582 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2088/4047] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:12 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 1329 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:13.592076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f997fdb5-177b-40cc-b31e-ed19650767b5 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:13.596345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f997fdb5-177b-40cc-b31e-ed19650767b5 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:13.616768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f997fdb5-177b-40cc-b31e-ed19650767b5 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:13.618313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f997fdb5-177b-40cc-b31e-ed19650767b5 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:13.619038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f997fdb5-177b-40cc-b31e-ed19650767b5 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:13.620101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f997fdb5-177b-40cc-b31e-ed19650767b5 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:13.622548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f997fdb5-177b-40cc-b31e-ed19650767b5 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:13.623308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f997fdb5-177b-40cc-b31e-ed19650767b5 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:13.745273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5509d0a9-520b-411e-9971-6694a8019aad tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:13.748669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5509d0a9-520b-411e-9971-6694a8019aad tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:13.783444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5509d0a9-520b-411e-9971-6694a8019aad tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:13.783955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5509d0a9-520b-411e-9971-6694a8019aad tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:13.784408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5509d0a9-520b-411e-9971-6694a8019aad tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:13.785180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5509d0a9-520b-411e-9971-6694a8019aad tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:13.788482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5509d0a9-520b-411e-9971-6694a8019aad tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:13.788968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5509d0a9-520b-411e-9971-6694a8019aad tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:13.818520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:15.354102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5509d0a9-520b-411e-9971-6694a8019aad tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:15.377431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f997fdb5-177b-40cc-b31e-ed19650767b5 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:15.418800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5509d0a9-520b-411e-9971-6694a8019aad tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:15.424708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5509d0a9-520b-411e-9971-6694a8019aad tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:15.429622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f997fdb5-177b-40cc-b31e-ed19650767b5 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:15.443489 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5509d0a9-520b-411e-9971-6694a8019aad tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1358 microversion: 2.21 time: 1.705168 Sep 08 13:03:15.448319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f997fdb5-177b-40cc-b31e-ed19650767b5 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:15.450703 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2089/4048] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:13 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1358 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:03:15.467500 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f997fdb5-177b-40cc-b31e-ed19650767b5 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2830 microversion: 2.32 time: 1.877258 Sep 08 13:03:15.471866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d4cc5640-514b-422e-8f3d-708b1ddc2995 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:15.487462 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1960/4049] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:13 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2830 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:03:15.489304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d4cc5640-514b-422e-8f3d-708b1ddc2995 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] [instance: abb01efa-03b9-40b6-901b-33e7d583b7c8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:15.522579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4cc5640-514b-422e-8f3d-708b1ddc2995 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:15.529817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4cc5640-514b-422e-8f3d-708b1ddc2995 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:15.536588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9bf976fc-a591-4d78-b965-3f6e030c9552 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:15.536813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4cc5640-514b-422e-8f3d-708b1ddc2995 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:15.538097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9bf976fc-a591-4d78-b965-3f6e030c9552 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:15.538315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4cc5640-514b-422e-8f3d-708b1ddc2995 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:15.538958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4cc5640-514b-422e-8f3d-708b1ddc2995 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:15.551946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bf976fc-a591-4d78-b965-3f6e030c9552 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:15.553370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bf976fc-a591-4d78-b965-3f6e030c9552 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:15.553560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4cc5640-514b-422e-8f3d-708b1ddc2995 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:15.554716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bf976fc-a591-4d78-b965-3f6e030c9552 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:15.556933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bf976fc-a591-4d78-b965-3f6e030c9552 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:15.558196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bf976fc-a591-4d78-b965-3f6e030c9552 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:15.559416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bf976fc-a591-4d78-b965-3f6e030c9552 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:15.603825 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-d4cc5640-514b-422e-8f3d-708b1ddc2995 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] HTTP exception thrown: Instance abb01efa-03b9-40b6-901b-33e7d583b7c8 could not be found. Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d4cc5640-514b-422e-8f3d-708b1ddc2995 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Request method failure captured: Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 HTTP/1.1 Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeVJlpIUu4I3etLbEARIZH8KBjvhrlSlsNaLxWsUVVjxg7DGa1gDBkjoWynkMnF04mkRKPOu0mP64ZnQqdnNZ67aOntgfBqoqUU7VATzwJXlIjY4wY2V0n8uOV_tKF-BjMvxYlC2i-O3RjgSypdvXI4jXqJB4nuGXejMn4MVXpX9mCw Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 59dc0decb175444491383c39918c5b2e Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerActionsTestJSON-204893554 Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_59dc0decb175444491383c39918c5b2e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/59dc0decb175444491383c39918c5b2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59dc0decb175444491383c39918c5b2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/59dc0decb175444491383c39918c5b2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerActionsTestJSON-204893554 Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 59dc0decb175444491383c39918c5b2e Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerActionsTestJSON-204893554 Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerActionsTestJSON-204893554-project Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 4140a06bc6934d7780ef9ff3e30e6dd5 Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerActionsTestJSON-204893554-project Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance abb01efa-03b9-40b6-901b-33e7d583b7c8 could not be found. Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'abb01efa-03b9-40b6-901b-33e7d583b7c8'} Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abb01efa-03b9-40b6-901b-33e7d583b7c8 could not be found. Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abb01efa-03b9-40b6-901b-33e7d583b7c8 could not be found. Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:15.607846 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:15.615812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:15.615812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:15.615812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:15.615812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:03:15.615812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:03:15.615812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abb01efa-03b9-40b6-901b-33e7d583b7c8 could not be found. Sep 08 13:03:15.615812 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:15.619082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d4cc5640-514b-422e-8f3d-708b1ddc2995 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Returning 404 to user: Instance abb01efa-03b9-40b6-901b-33e7d583b7c8 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:03:15.621535 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d4cc5640-514b-422e-8f3d-708b1ddc2995 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8" status: 404 len: 111 microversion: 2.1 time: 0.167224 Sep 08 13:03:15.622866 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2090/4050] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:15 2022] GET /compute/v2.1/servers/abb01efa-03b9-40b6-901b-33e7d583b7c8 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:03:15.639655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e0e145ef-0d00-4ce8-b34e-7163b6807922 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] Calling method '.version_select at 0x7fdb363fa8b0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:15.693379 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e0e145ef-0d00-4ce8-b34e-7163b6807922 tempest-ServerActionsTestJSON-204893554 tempest-ServerActionsTestJSON-204893554-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1387000771" status: 202 len: 0 microversion: 2.1 time: 0.061268 Sep 08 13:03:15.700304 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2091/4051] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Sep 8 13:03:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1387000771 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:03:16.026264 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9bf976fc-a591-4d78-b965-3f6e030c9552 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.498832 Sep 08 13:03:16.028240 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1961/4052] 10.222.0.78 () {60 vars in 1316 bytes} [Thu Sep 8 13:03:15 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0/os-interface => generated 1832 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:16.505993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4bbb4c19-24c6-4743-b68f-e8a7e5d929a3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:16.507571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4bbb4c19-24c6-4743-b68f-e8a7e5d929a3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:16.529048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bbb4c19-24c6-4743-b68f-e8a7e5d929a3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:16.536207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bbb4c19-24c6-4743-b68f-e8a7e5d929a3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:16.541458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bbb4c19-24c6-4743-b68f-e8a7e5d929a3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:16.543031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bbb4c19-24c6-4743-b68f-e8a7e5d929a3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:16.544093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bbb4c19-24c6-4743-b68f-e8a7e5d929a3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:16.545023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bbb4c19-24c6-4743-b68f-e8a7e5d929a3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:18.070270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4bbb4c19-24c6-4743-b68f-e8a7e5d929a3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:18.094317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4bbb4c19-24c6-4743-b68f-e8a7e5d929a3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:18.105152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4bbb4c19-24c6-4743-b68f-e8a7e5d929a3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:18.107290 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4bbb4c19-24c6-4743-b68f-e8a7e5d929a3 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1358 microversion: 2.21 time: 1.608846 Sep 08 13:03:18.108275 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2092/4053] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:16 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1358 bytes in 1611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:18.618463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-396dcf41-26b2-4941-abdd-6a44ba293208 req-37a772b6-d564-4924-bdb0-550ecc230e70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68b5e05-8226-459a-9fa2-a6c34a6e6959", "name": "network-vif-plugged", "status": "completed", "tag": "4eb43058-1154-4fdc-854a-d71e9ed11299"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:18.663343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-396dcf41-26b2-4941-abdd-6a44ba293208 req-37a772b6-d564-4924-bdb0-550ecc230e70 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:18.665793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-396dcf41-26b2-4941-abdd-6a44ba293208 req-37a772b6-d564-4924-bdb0-550ecc230e70 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:18.669290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-396dcf41-26b2-4941-abdd-6a44ba293208 req-37a772b6-d564-4924-bdb0-550ecc230e70 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:18.782098 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-396dcf41-26b2-4941-abdd-6a44ba293208 req-37a772b6-d564-4924-bdb0-550ecc230e70 service nova] Creating event network-vif-plugged:4eb43058-1154-4fdc-854a-d71e9ed11299 for instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 on n-h2-852084-10 Sep 08 13:03:18.821797 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-396dcf41-26b2-4941-abdd-6a44ba293208 req-37a772b6-d564-4924-bdb0-550ecc230e70 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209073 Sep 08 13:03:18.828062 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1962/4054] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:03:19.163646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6bcca8aa-4cd4-4142-a702-ab8c0fe023a5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:19.164471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6bcca8aa-4cd4-4142-a702-ab8c0fe023a5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:19.182444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bcca8aa-4cd4-4142-a702-ab8c0fe023a5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:19.185418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bcca8aa-4cd4-4142-a702-ab8c0fe023a5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:19.187627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bcca8aa-4cd4-4142-a702-ab8c0fe023a5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:19.191585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bcca8aa-4cd4-4142-a702-ab8c0fe023a5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:19.201537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bcca8aa-4cd4-4142-a702-ab8c0fe023a5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:19.211032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bcca8aa-4cd4-4142-a702-ab8c0fe023a5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:20.464788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-396dcf41-26b2-4941-abdd-6a44ba293208 req-37a772b6-d564-4924-bdb0-550ecc230e70 service nova] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:20.467838 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-396dcf41-26b2-4941-abdd-6a44ba293208 req-37a772b6-d564-4924-bdb0-550ecc230e70 service nova] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.004897 Sep 08 13:03:20.470110 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1963/4055] 10.222.0.78 () {56 vars in 886 bytes} [Thu Sep 8 13:03:20 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 13:03:20.657959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6bcca8aa-4cd4-4142-a702-ab8c0fe023a5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:20.682738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6bcca8aa-4cd4-4142-a702-ab8c0fe023a5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:20.686223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6bcca8aa-4cd4-4142-a702-ab8c0fe023a5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:20.688866 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6bcca8aa-4cd4-4142-a702-ab8c0fe023a5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1358 microversion: 2.21 time: 1.529464 Sep 08 13:03:20.699944 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2093/4056] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:19 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1358 bytes in 1541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:21.766588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-48d5ab1b-b794-4ea2-81fd-474c7cf1ceb8 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:21.774853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-48d5ab1b-b794-4ea2-81fd-474c7cf1ceb8 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:21.815063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d5ab1b-b794-4ea2-81fd-474c7cf1ceb8 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:21.817546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d5ab1b-b794-4ea2-81fd-474c7cf1ceb8 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:21.821012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d5ab1b-b794-4ea2-81fd-474c7cf1ceb8 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:21.825715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d5ab1b-b794-4ea2-81fd-474c7cf1ceb8 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:21.828630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d5ab1b-b794-4ea2-81fd-474c7cf1ceb8 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:21.832604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48d5ab1b-b794-4ea2-81fd-474c7cf1ceb8 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:23.170223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-48d5ab1b-b794-4ea2-81fd-474c7cf1ceb8 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:23.231342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-48d5ab1b-b794-4ea2-81fd-474c7cf1ceb8 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:23.237317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-48d5ab1b-b794-4ea2-81fd-474c7cf1ceb8 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:23.243902 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-48d5ab1b-b794-4ea2-81fd-474c7cf1ceb8 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1358 microversion: 2.21 time: 1.508180 Sep 08 13:03:23.246953 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1964/4057] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:21 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1358 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:24.291394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-973ec4fb-fa1a-4ad1-b91f-c34f1e275cf5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:24.292727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-973ec4fb-fa1a-4ad1-b91f-c34f1e275cf5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:24.406039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-973ec4fb-fa1a-4ad1-b91f-c34f1e275cf5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:24.410010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-973ec4fb-fa1a-4ad1-b91f-c34f1e275cf5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:24.423455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-973ec4fb-fa1a-4ad1-b91f-c34f1e275cf5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:24.424583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-973ec4fb-fa1a-4ad1-b91f-c34f1e275cf5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:24.425377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-973ec4fb-fa1a-4ad1-b91f-c34f1e275cf5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:24.433437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-973ec4fb-fa1a-4ad1-b91f-c34f1e275cf5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:26.183133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-973ec4fb-fa1a-4ad1-b91f-c34f1e275cf5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:26.194065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-973ec4fb-fa1a-4ad1-b91f-c34f1e275cf5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:26.203498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-973ec4fb-fa1a-4ad1-b91f-c34f1e275cf5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:26.205314 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-973ec4fb-fa1a-4ad1-b91f-c34f1e275cf5 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1551 microversion: 2.21 time: 1.930362 Sep 08 13:03:26.229854 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2094/4058] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:24 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1551 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:26.253425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eb2afcb3-9d6b-4484-925e-1c0e3a376399 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:26.254916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eb2afcb3-9d6b-4484-925e-1c0e3a376399 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:26.304411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb2afcb3-9d6b-4484-925e-1c0e3a376399 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:26.309961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb2afcb3-9d6b-4484-925e-1c0e3a376399 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:26.311652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb2afcb3-9d6b-4484-925e-1c0e3a376399 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:26.316193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-8fbb5ed9-bd85-4492-a48e-a74c523d77a6 req-87d7a0a1-8d4e-44bb-989b-7f2f562f852c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "tag": "df47dbce-98af-457f-b820-6f3eed3fb9db"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:26.317045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb2afcb3-9d6b-4484-925e-1c0e3a376399 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:26.320629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb2afcb3-9d6b-4484-925e-1c0e3a376399 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:26.325069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb2afcb3-9d6b-4484-925e-1c0e3a376399 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:26.350281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8fbb5ed9-bd85-4492-a48e-a74c523d77a6 req-87d7a0a1-8d4e-44bb-989b-7f2f562f852c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:26.351179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8fbb5ed9-bd85-4492-a48e-a74c523d77a6 req-87d7a0a1-8d4e-44bb-989b-7f2f562f852c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:26.352537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8fbb5ed9-bd85-4492-a48e-a74c523d77a6 req-87d7a0a1-8d4e-44bb-989b-7f2f562f852c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:26.395013 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-8fbb5ed9-bd85-4492-a48e-a74c523d77a6 req-87d7a0a1-8d4e-44bb-989b-7f2f562f852c service nova] Creating event network-changed:df47dbce-98af-457f-b820-6f3eed3fb9db for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:03:26.402589 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-8fbb5ed9-bd85-4492-a48e-a74c523d77a6 req-87d7a0a1-8d4e-44bb-989b-7f2f562f852c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091027 Sep 08 13:03:26.404033 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2095/4059] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:03:26.452216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eb2afcb3-9d6b-4484-925e-1c0e3a376399 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:03:26.671066 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eb2afcb3-9d6b-4484-925e-1c0e3a376399 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 204 len: 0 microversion: 2.21 time: 0.427969 Sep 08 13:03:26.675537 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1965/4060] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:03:26 2022] DELETE /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:03:26.687259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bcc97a97-7bb6-40c7-bdb1-db66c58351df tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:26.689162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bcc97a97-7bb6-40c7-bdb1-db66c58351df tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:26.748615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcc97a97-7bb6-40c7-bdb1-db66c58351df tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:26.757694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcc97a97-7bb6-40c7-bdb1-db66c58351df tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:26.759329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcc97a97-7bb6-40c7-bdb1-db66c58351df tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:26.760325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcc97a97-7bb6-40c7-bdb1-db66c58351df tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:26.761615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcc97a97-7bb6-40c7-bdb1-db66c58351df tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:26.763168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcc97a97-7bb6-40c7-bdb1-db66c58351df tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:27.391354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bcc97a97-7bb6-40c7-bdb1-db66c58351df tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:27.541016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bcc97a97-7bb6-40c7-bdb1-db66c58351df tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:27.568409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bcc97a97-7bb6-40c7-bdb1-db66c58351df tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:27.572146 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bcc97a97-7bb6-40c7-bdb1-db66c58351df tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1557 microversion: 2.21 time: 0.894312 Sep 08 13:03:27.580090 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2096/4061] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:26 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1557 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:28.639044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e9349373-b4e5-48ba-8cff-6f786b1f62ce tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:28.664476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e9349373-b4e5-48ba-8cff-6f786b1f62ce tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:28.679377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:28.739387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9349373-b4e5-48ba-8cff-6f786b1f62ce tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:28.739387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9349373-b4e5-48ba-8cff-6f786b1f62ce tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:28.739387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9349373-b4e5-48ba-8cff-6f786b1f62ce tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:28.739387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9349373-b4e5-48ba-8cff-6f786b1f62ce tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:28.739387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9349373-b4e5-48ba-8cff-6f786b1f62ce tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:28.739387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9349373-b4e5-48ba-8cff-6f786b1f62ce tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:28.960221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:30.436467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e9349373-b4e5-48ba-8cff-6f786b1f62ce tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:30.452786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e9349373-b4e5-48ba-8cff-6f786b1f62ce tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:30.454365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e9349373-b4e5-48ba-8cff-6f786b1f62ce tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:30.455680 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e9349373-b4e5-48ba-8cff-6f786b1f62ce tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1557 microversion: 2.21 time: 1.835360 Sep 08 13:03:30.456287 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1966/4062] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:28 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1557 bytes in 1837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:31.516634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-16c2874c-fa2b-460c-a97f-6948d0add6fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:31.525935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-16c2874c-fa2b-460c-a97f-6948d0add6fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:31.560514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16c2874c-fa2b-460c-a97f-6948d0add6fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:31.561898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16c2874c-fa2b-460c-a97f-6948d0add6fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:31.566825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16c2874c-fa2b-460c-a97f-6948d0add6fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:31.577055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16c2874c-fa2b-460c-a97f-6948d0add6fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:31.578395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16c2874c-fa2b-460c-a97f-6948d0add6fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:31.579436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16c2874c-fa2b-460c-a97f-6948d0add6fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:32.222757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-89824c9f-e35c-4d30-8f71-70948986f607 req-cf7e1949-3919-4ad3-af8c-fb29c34bc745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68b5e05-8226-459a-9fa2-a6c34a6e6959", "name": "network-vif-unplugged", "status": "completed", "tag": "4eb43058-1154-4fdc-854a-d71e9ed11299"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:32.272718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-89824c9f-e35c-4d30-8f71-70948986f607 req-cf7e1949-3919-4ad3-af8c-fb29c34bc745 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:32.280118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-89824c9f-e35c-4d30-8f71-70948986f607 req-cf7e1949-3919-4ad3-af8c-fb29c34bc745 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:32.286757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-89824c9f-e35c-4d30-8f71-70948986f607 req-cf7e1949-3919-4ad3-af8c-fb29c34bc745 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:32.342329 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-89824c9f-e35c-4d30-8f71-70948986f607 req-cf7e1949-3919-4ad3-af8c-fb29c34bc745 service nova] Creating event network-vif-unplugged:4eb43058-1154-4fdc-854a-d71e9ed11299 for instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 on n-h2-852084-10 Sep 08 13:03:32.367426 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-89824c9f-e35c-4d30-8f71-70948986f607 req-cf7e1949-3919-4ad3-af8c-fb29c34bc745 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.151710 Sep 08 13:03:32.369300 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1967/4063] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:03:32.633968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-16c2874c-fa2b-460c-a97f-6948d0add6fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:32.654757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-16c2874c-fa2b-460c-a97f-6948d0add6fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:32.665159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-16c2874c-fa2b-460c-a97f-6948d0add6fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:32.667315 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-16c2874c-fa2b-460c-a97f-6948d0add6fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1557 microversion: 2.21 time: 1.162104 Sep 08 13:03:32.668552 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2097/4064] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:31 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1557 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:33.735956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d41d00a3-a71e-4eff-82bf-97e397275bed tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:33.737600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d41d00a3-a71e-4eff-82bf-97e397275bed tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:33.757046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41d00a3-a71e-4eff-82bf-97e397275bed tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:33.757999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41d00a3-a71e-4eff-82bf-97e397275bed tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:33.758682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41d00a3-a71e-4eff-82bf-97e397275bed tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:33.759859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41d00a3-a71e-4eff-82bf-97e397275bed tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:33.760596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41d00a3-a71e-4eff-82bf-97e397275bed tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:33.761323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d41d00a3-a71e-4eff-82bf-97e397275bed tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:34.099172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d41d00a3-a71e-4eff-82bf-97e397275bed tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:34.119719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d41d00a3-a71e-4eff-82bf-97e397275bed tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:34.121592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d41d00a3-a71e-4eff-82bf-97e397275bed tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:34.123529 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d41d00a3-a71e-4eff-82bf-97e397275bed tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1515 microversion: 2.21 time: 0.392915 Sep 08 13:03:34.133865 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1968/4065] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:33 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1515 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:34.301041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-5f3e5ea5-c7f6-4d31-819b-c34408a5de88 req-da143aa4-4d65-4bd3-916b-aae32bb5da0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a68b5e05-8226-459a-9fa2-a6c34a6e6959", "name": "network-vif-deleted", "tag": "4eb43058-1154-4fdc-854a-d71e9ed11299"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:34.331477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5f3e5ea5-c7f6-4d31-819b-c34408a5de88 req-da143aa4-4d65-4bd3-916b-aae32bb5da0f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:34.332859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5f3e5ea5-c7f6-4d31-819b-c34408a5de88 req-da143aa4-4d65-4bd3-916b-aae32bb5da0f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:34.333346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5f3e5ea5-c7f6-4d31-819b-c34408a5de88 req-da143aa4-4d65-4bd3-916b-aae32bb5da0f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:34.362189 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-5f3e5ea5-c7f6-4d31-819b-c34408a5de88 req-da143aa4-4d65-4bd3-916b-aae32bb5da0f service nova] Creating event network-vif-deleted:4eb43058-1154-4fdc-854a-d71e9ed11299 for instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 on n-h2-852084-10 Sep 08 13:03:34.369374 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-5f3e5ea5-c7f6-4d31-819b-c34408a5de88 req-da143aa4-4d65-4bd3-916b-aae32bb5da0f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072151 Sep 08 13:03:34.379031 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2098/4066] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:03:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:03:35.028405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4bf717a8-e64b-4104-b048-4e8cc581381c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:35.029522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4bf717a8-e64b-4104-b048-4e8cc581381c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:35.065273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bf717a8-e64b-4104-b048-4e8cc581381c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:35.069779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bf717a8-e64b-4104-b048-4e8cc581381c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:35.071590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bf717a8-e64b-4104-b048-4e8cc581381c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:35.077930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bf717a8-e64b-4104-b048-4e8cc581381c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:35.079383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bf717a8-e64b-4104-b048-4e8cc581381c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:35.083266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bf717a8-e64b-4104-b048-4e8cc581381c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:35.171556 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-4bf717a8-e64b-4104-b048-4e8cc581381c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] HTTP exception thrown: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4bf717a8-e64b-4104-b048-4e8cc581381c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Request method failure captured: Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 HTTP/1.1 Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeY_ic7o_8Cz6pFf7NPWf_rlAIWwmt4a8EZuDKADM8i3AWQ7mw3TSKEjCytuuxWEvlwet6Hx8uD1x9sbFb-Knkza3JJq35V_6S9nzgEEHH1fuMNRSgsV5vET7afQOtPvreKVY8D1Xfj7LgOUaZ_F5TLvYHpRXilTK4u3bdEjy8W7eEg Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.42 Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: dde98df8ff64478e93fde5f75096c60a Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-174900958 Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dde98df8ff64478e93fde5f75096c60a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dde98df8ff64478e93fde5f75096c60a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dde98df8ff64478e93fde5f75096c60a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dde98df8ff64478e93fde5f75096c60a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TaggedBootDevicesTest_v242-174900958 Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: dde98df8ff64478e93fde5f75096c60a Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-174900958 Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TaggedBootDevicesTest_v242-174900958-project Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 39d5a18c9a8d462ca4e9fcdc74dfc8c2 Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TaggedBootDevicesTest_v242-174900958-project Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6'} Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:03:35.180575 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:03:35.184533 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:35.184533 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:35.184533 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:35.184533 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:35.184533 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:35.184533 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:35.184533 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:35.184533 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:03:35.184533 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:03:35.184533 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:35.184533 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:35.189347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4bf717a8-e64b-4104-b048-4e8cc581381c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Returning 404 to user: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:03:35.190766 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4bf717a8-e64b-4104-b048-4e8cc581381c tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "DELETE /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 404 len: 111 microversion: 2.42 time: 0.172773 Sep 08 13:03:35.195834 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1969/4067] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:03:35 2022] DELETE /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:03:35.202647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:35.204010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:35.205349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d29a40dd-9732-4bfe-8917-073603971ecc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:35.207101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d29a40dd-9732-4bfe-8917-073603971ecc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] [instance: cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:35.228535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d29a40dd-9732-4bfe-8917-073603971ecc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:35.231089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d29a40dd-9732-4bfe-8917-073603971ecc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:35.235567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d29a40dd-9732-4bfe-8917-073603971ecc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:35.236531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d29a40dd-9732-4bfe-8917-073603971ecc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:35.237175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d29a40dd-9732-4bfe-8917-073603971ecc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:35.237850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d29a40dd-9732-4bfe-8917-073603971ecc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:35.242587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:35.250336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:35.252761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:35.255010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:35.256341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:35.260674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:35.312423 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-d29a40dd-9732-4bfe-8917-073603971ecc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] HTTP exception thrown: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d29a40dd-9732-4bfe-8917-073603971ecc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Request method failure captured: Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 HTTP/1.1 Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeY_ic7o_8Cz6pFf7NPWf_rlAIWwmt4a8EZuDKADM8i3AWQ7mw3TSKEjCytuuxWEvlwet6Hx8uD1x9sbFb-Knkza3JJq35V_6S9nzgEEHH1fuMNRSgsV5vET7afQOtPvreKVY8D1Xfj7LgOUaZ_F5TLvYHpRXilTK4u3bdEjy8W7eEg Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.42 Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: dde98df8ff64478e93fde5f75096c60a Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-174900958 Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dde98df8ff64478e93fde5f75096c60a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dde98df8ff64478e93fde5f75096c60a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dde98df8ff64478e93fde5f75096c60a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dde98df8ff64478e93fde5f75096c60a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TaggedBootDevicesTest_v242-174900958 Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: dde98df8ff64478e93fde5f75096c60a Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-174900958 Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TaggedBootDevicesTest_v242-174900958-project Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 39d5a18c9a8d462ca4e9fcdc74dfc8c2 Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TaggedBootDevicesTest_v242-174900958-project Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6'} Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:35.329588 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:35.334047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:35.334047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:35.334047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:35.334047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:35.334047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:03:35.334047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:03:35.334047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. Sep 08 13:03:35.334047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:35.351055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d29a40dd-9732-4bfe-8917-073603971ecc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] Returning 404 to user: Instance cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:03:35.353041 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d29a40dd-9732-4bfe-8917-073603971ecc tempest-TaggedBootDevicesTest_v242-174900958 tempest-TaggedBootDevicesTest_v242-174900958-project] 10.222.0.78 "GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6" status: 404 len: 111 microversion: 2.42 time: 0.154519 Sep 08 13:03:35.364163 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1970/4068] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:35 2022] GET /compute/v2.1/servers/cba8ff78-8bdb-4dc6-bdaa-a430380a0bc6 => generated 111 bytes in 166 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:03:35.493953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:35.498893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:35.504047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:35.511298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lazy-loading 'fault' on Instance uuid a68b5e05-8226-459a-9fa2-a6c34a6e6959 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:03:36.243598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:36.301712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:36.315278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a9711561e1b044f4aa590eb9b30d9e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f815679701143e08a91b3ecc93325a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:36.323111 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-720f0998-ee0e-4e6f-8015-b5310ea282fd tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 200 len: 1348 microversion: 2.21 time: 1.131636 Sep 08 13:03:36.329565 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2099/4069] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:35 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 1348 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:03:37.428674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d5b76dd-00d2-45b8-98ab-d492dc8d8557 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:37.429987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4d5b76dd-00d2-45b8-98ab-d492dc8d8557 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:37.462366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d5b76dd-00d2-45b8-98ab-d492dc8d8557 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:37.463488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d5b76dd-00d2-45b8-98ab-d492dc8d8557 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:37.464643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d5b76dd-00d2-45b8-98ab-d492dc8d8557 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:37.468196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d5b76dd-00d2-45b8-98ab-d492dc8d8557 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:37.470595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d5b76dd-00d2-45b8-98ab-d492dc8d8557 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:37.474097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d5b76dd-00d2-45b8-98ab-d492dc8d8557 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:37.504733 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-4d5b76dd-00d2-45b8-98ab-d492dc8d8557 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] HTTP exception thrown: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d5b76dd-00d2-45b8-98ab-d492dc8d8557 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Request method failure captured: Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 HTTP/1.1 Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGef5AsojvZyigOlIWdj42feE4jw01R1q2u4D8MEGsAeGqCmI5rOMdjLoRKx5jlNo1xAKcFscmirf6lMyoyXr-LFzyKp124lqHwFnkrWubQZANrRk7WpkVunEB4oC27TuFCS-9l9wMPLgRxSuFhUx5X-AjBGG5QRYghYmzDcnNi762s0 Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.21 Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 6f815679701143e08a91b3ecc93325a1 Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-InstanceActionsV221TestJSON-763335021 Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6f815679701143e08a91b3ecc93325a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6f815679701143e08a91b3ecc93325a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6f815679701143e08a91b3ecc93325a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6f815679701143e08a91b3ecc93325a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-InstanceActionsV221TestJSON-763335021 Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 6f815679701143e08a91b3ecc93325a1 Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-763335021 Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-InstanceActionsV221TestJSON-763335021-project Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: a9711561e1b044f4aa590eb9b30d9e44 Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-InstanceActionsV221TestJSON-763335021-project Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'a68b5e05-8226-459a-9fa2-a6c34a6e6959'} Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:37.509179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:37.517584 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:37.517584 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:37.517584 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:37.517584 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:37.517584 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:03:37.517584 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:03:37.517584 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:37.517584 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:03:37.520374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d5b76dd-00d2-45b8-98ab-d492dc8d8557 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Returning 404 to user: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:03:37.524073 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4d5b76dd-00d2-45b8-98ab-d492dc8d8557 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 404 len: 111 microversion: 2.21 time: 0.111296 Sep 08 13:03:37.525735 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1971/4070] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:37 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:03:37.545889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f0bd1d7a-b08b-408f-963a-dc77f14a3763 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '.version_select at 0x7fdb3f1e1ee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:37.549746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f0bd1d7a-b08b-408f-963a-dc77f14a3763 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:37.582481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0bd1d7a-b08b-408f-963a-dc77f14a3763 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:37.583596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0bd1d7a-b08b-408f-963a-dc77f14a3763 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:37.584551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0bd1d7a-b08b-408f-963a-dc77f14a3763 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:37.586528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0bd1d7a-b08b-408f-963a-dc77f14a3763 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:37.587570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0bd1d7a-b08b-408f-963a-dc77f14a3763 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:37.588508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0bd1d7a-b08b-408f-963a-dc77f14a3763 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:37.938700 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f0bd1d7a-b08b-408f-963a-dc77f14a3763 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.402618 Sep 08 13:03:37.948607 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2100/4071] 10.222.0.78 () {60 vars in 1337 bytes} [Thu Sep 8 13:03:37 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959/os-instance-actions => generated 611 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:03:37.990417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e9114d1-c0d4-4c70-9fea-8d9959a1e8b2 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:37.996236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2e9114d1-c0d4-4c70-9fea-8d9959a1e8b2 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:38.026114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e9114d1-c0d4-4c70-9fea-8d9959a1e8b2 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:38.027700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e9114d1-c0d4-4c70-9fea-8d9959a1e8b2 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:38.033525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e9114d1-c0d4-4c70-9fea-8d9959a1e8b2 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:38.035607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e9114d1-c0d4-4c70-9fea-8d9959a1e8b2 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:38.036932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e9114d1-c0d4-4c70-9fea-8d9959a1e8b2 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:38.041728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e9114d1-c0d4-4c70-9fea-8d9959a1e8b2 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:38.124306 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-2e9114d1-c0d4-4c70-9fea-8d9959a1e8b2 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] HTTP exception thrown: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e9114d1-c0d4-4c70-9fea-8d9959a1e8b2 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Request method failure captured: Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 HTTP/1.1 Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGef5AsojvZyigOlIWdj42feE4jw01R1q2u4D8MEGsAeGqCmI5rOMdjLoRKx5jlNo1xAKcFscmirf6lMyoyXr-LFzyKp124lqHwFnkrWubQZANrRk7WpkVunEB4oC27TuFCS-9l9wMPLgRxSuFhUx5X-AjBGG5QRYghYmzDcnNi762s0 Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.21 Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 6f815679701143e08a91b3ecc93325a1 Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-InstanceActionsV221TestJSON-763335021 Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6f815679701143e08a91b3ecc93325a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6f815679701143e08a91b3ecc93325a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6f815679701143e08a91b3ecc93325a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6f815679701143e08a91b3ecc93325a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-InstanceActionsV221TestJSON-763335021 Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 6f815679701143e08a91b3ecc93325a1 Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-763335021 Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-InstanceActionsV221TestJSON-763335021-project Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: a9711561e1b044f4aa590eb9b30d9e44 Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-InstanceActionsV221TestJSON-763335021-project Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'a68b5e05-8226-459a-9fa2-a6c34a6e6959'} Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:03:38.132531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:03:38.142684 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:38.142684 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:38.142684 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:38.142684 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:38.142684 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:38.142684 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:38.142684 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:38.142684 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:03:38.142684 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:03:38.142684 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:38.142684 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:38.142684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e9114d1-c0d4-4c70-9fea-8d9959a1e8b2 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Returning 404 to user: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:03:38.147908 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2e9114d1-c0d4-4c70-9fea-8d9959a1e8b2 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 404 len: 111 microversion: 2.21 time: 0.163485 Sep 08 13:03:38.157022 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2101/4072] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:03:37 2022] DELETE /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 111 bytes in 184 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 13:03:38.177078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be92409d-9b99-449d-8501-f6a51c5735f1 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:38.178238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-be92409d-9b99-449d-8501-f6a51c5735f1 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] [instance: a68b5e05-8226-459a-9fa2-a6c34a6e6959] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:38.206582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be92409d-9b99-449d-8501-f6a51c5735f1 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:38.207494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be92409d-9b99-449d-8501-f6a51c5735f1 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:38.209157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be92409d-9b99-449d-8501-f6a51c5735f1 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:38.215784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be92409d-9b99-449d-8501-f6a51c5735f1 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:38.216869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be92409d-9b99-449d-8501-f6a51c5735f1 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:38.217695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be92409d-9b99-449d-8501-f6a51c5735f1 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:38.319106 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-be92409d-9b99-449d-8501-f6a51c5735f1 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] HTTP exception thrown: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be92409d-9b99-449d-8501-f6a51c5735f1 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Request method failure captured: Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 HTTP/1.1 Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGef5AsojvZyigOlIWdj42feE4jw01R1q2u4D8MEGsAeGqCmI5rOMdjLoRKx5jlNo1xAKcFscmirf6lMyoyXr-LFzyKp124lqHwFnkrWubQZANrRk7WpkVunEB4oC27TuFCS-9l9wMPLgRxSuFhUx5X-AjBGG5QRYghYmzDcnNi762s0 Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.21 Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 6f815679701143e08a91b3ecc93325a1 Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-InstanceActionsV221TestJSON-763335021 Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6f815679701143e08a91b3ecc93325a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6f815679701143e08a91b3ecc93325a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6f815679701143e08a91b3ecc93325a1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6f815679701143e08a91b3ecc93325a1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-InstanceActionsV221TestJSON-763335021 Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 6f815679701143e08a91b3ecc93325a1 Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-763335021 Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-InstanceActionsV221TestJSON-763335021-project Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: a9711561e1b044f4aa590eb9b30d9e44 Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-InstanceActionsV221TestJSON-763335021-project Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'a68b5e05-8226-459a-9fa2-a6c34a6e6959'} Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:38.326893 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:03:38.335196 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:38.335196 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:03:38.335196 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:03:38.335196 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:03:38.335196 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:03:38.335196 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:03:38.335196 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. Sep 08 13:03:38.335196 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:03:38.338917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be92409d-9b99-449d-8501-f6a51c5735f1 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] Returning 404 to user: Instance a68b5e05-8226-459a-9fa2-a6c34a6e6959 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:03:38.345901 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-be92409d-9b99-449d-8501-f6a51c5735f1 tempest-InstanceActionsV221TestJSON-763335021 tempest-InstanceActionsV221TestJSON-763335021-project] 10.222.0.78 "GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959" status: 404 len: 111 microversion: 2.21 time: 0.184160 Sep 08 13:03:38.365187 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2102/4073] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:03:38 2022] GET /compute/v2.1/servers/a68b5e05-8226-459a-9fa2-a6c34a6e6959 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:03:38.782572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-170601704", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:39.028352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] validate_networks() for [('e1bd9f4c-1ea4-4b7b-92de-99c0075cba0d', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:03:40.839082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:03:40.840097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:03:40.840324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:03:40.840824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:03:40.841349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:03:40.878593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:40.889141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:40.895308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:40.896295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:40.901270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:40.901897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:40.990006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Getting quotas for project 4a806bce1ce8422790726f1f12f681ba. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:03:41.021237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Getting quotas for user 0d312121b259412dbf82c519a49285f4 and project 4a806bce1ce8422790726f1f12f681ba. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:03:41.077499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:03:41.080449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:03:41.322270 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f48c77d-30b8-4863-adc8-8a0800e9360b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.421546 Sep 08 13:03:41.333271 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1972/4074] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:03:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 3434 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:03:41.362150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9b6b7685-3c1a-48ab-954b-a126f27e0944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:41.365914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9b6b7685-3c1a-48ab-954b-a126f27e0944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:41.443988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:41.692215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9b6b7685-3c1a-48ab-954b-a126f27e0944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:41.741672 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9b6b7685-3c1a-48ab-954b-a126f27e0944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1221 microversion: 2.1 time: 0.401777 Sep 08 13:03:41.748072 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2103/4075] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:41 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1221 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:42.790993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1988889443", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:03:42.944906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] validate_networks() for [('e1bd9f4c-1ea4-4b7b-92de-99c0075cba0d', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:03:47.051692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:03:47.053981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:03:47.056632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:03:47.065397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:03:47.071701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:03:47.192746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:47.193433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:47.197648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:47.198995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:47.199771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:47.200398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:47.309442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Getting quotas for project 4a806bce1ce8422790726f1f12f681ba. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:03:47.330972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Getting quotas for user 0d312121b259412dbf82c519a49285f4 and project 4a806bce1ce8422790726f1f12f681ba. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:03:47.401002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:03:47.412814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:03:47.773064 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a9f60c77-ed55-4e7e-84bd-30167fa64c80 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.989511 Sep 08 13:03:47.782451 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1973/4076] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:03:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 5007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:03:47.786738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ed71498a-6a9f-4390-8d29-1ace0dafb627 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:47.787577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ed71498a-6a9f-4390-8d29-1ace0dafb627 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:48.123420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ed71498a-6a9f-4390-8d29-1ace0dafb627 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:48.178846 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ed71498a-6a9f-4390-8d29-1ace0dafb627 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1222 microversion: 2.1 time: 0.396307 Sep 08 13:03:48.186691 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2104/4077] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:47 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1222 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:49.221683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5f715a9-88c0-482d-ac9a-a1342958e103 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:49.222961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c5f715a9-88c0-482d-ac9a-a1342958e103 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:50.119761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c5f715a9-88c0-482d-ac9a-a1342958e103 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:50.138073 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c5f715a9-88c0-482d-ac9a-a1342958e103 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1222 microversion: 2.1 time: 0.921634 Sep 08 13:03:50.142694 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1974/4078] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:49 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1222 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:51.233409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e5d006cc-0781-48db-876c-8a40b5240e7e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:51.245263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e5d006cc-0781-48db-876c-8a40b5240e7e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:51.294164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=57 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:51.313188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5d006cc-0781-48db-876c-8a40b5240e7e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:51.315626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5d006cc-0781-48db-876c-8a40b5240e7e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:51.319354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5d006cc-0781-48db-876c-8a40b5240e7e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:51.329100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5d006cc-0781-48db-876c-8a40b5240e7e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:51.329774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5d006cc-0781-48db-876c-8a40b5240e7e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:51.331991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5d006cc-0781-48db-876c-8a40b5240e7e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:51.528421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e5d006cc-0781-48db-876c-8a40b5240e7e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:51.554300 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e5d006cc-0781-48db-876c-8a40b5240e7e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1282 microversion: 2.1 time: 0.369048 Sep 08 13:03:51.572374 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2105/4079] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:51 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1282 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:52.589814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff087c56-6089-4df8-9479-6316672fec0b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:52.591729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ff087c56-6089-4df8-9479-6316672fec0b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:52.613068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff087c56-6089-4df8-9479-6316672fec0b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:52.620539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff087c56-6089-4df8-9479-6316672fec0b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:52.626833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff087c56-6089-4df8-9479-6316672fec0b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:52.628713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff087c56-6089-4df8-9479-6316672fec0b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:52.629823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff087c56-6089-4df8-9479-6316672fec0b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:52.630743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff087c56-6089-4df8-9479-6316672fec0b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:52.988251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ff087c56-6089-4df8-9479-6316672fec0b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:53.016377 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ff087c56-6089-4df8-9479-6316672fec0b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1280 microversion: 2.1 time: 0.432901 Sep 08 13:03:53.021237 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1975/4080] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:52 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1280 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:54.050648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f226fc47-1b97-48dc-87d1-6563c079585f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:54.051985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f226fc47-1b97-48dc-87d1-6563c079585f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:54.064698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f226fc47-1b97-48dc-87d1-6563c079585f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:54.068700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f226fc47-1b97-48dc-87d1-6563c079585f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:54.069225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f226fc47-1b97-48dc-87d1-6563c079585f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:54.070210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f226fc47-1b97-48dc-87d1-6563c079585f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:54.106123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f226fc47-1b97-48dc-87d1-6563c079585f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:54.106681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f226fc47-1b97-48dc-87d1-6563c079585f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:54.515430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f226fc47-1b97-48dc-87d1-6563c079585f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:54.539855 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f226fc47-1b97-48dc-87d1-6563c079585f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1280 microversion: 2.1 time: 0.492927 Sep 08 13:03:54.544315 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2106/4081] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:54 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1280 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:55.576454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-af465d85-6585-4fc5-a633-097ba34f2d46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:55.577577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-af465d85-6585-4fc5-a633-097ba34f2d46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:55.647126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af465d85-6585-4fc5-a633-097ba34f2d46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:55.665782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af465d85-6585-4fc5-a633-097ba34f2d46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:55.666536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af465d85-6585-4fc5-a633-097ba34f2d46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:55.667891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af465d85-6585-4fc5-a633-097ba34f2d46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:55.668745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af465d85-6585-4fc5-a633-097ba34f2d46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:55.669545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af465d85-6585-4fc5-a633-097ba34f2d46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:56.305745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-af465d85-6585-4fc5-a633-097ba34f2d46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:56.391086 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-af465d85-6585-4fc5-a633-097ba34f2d46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1280 microversion: 2.1 time: 0.805120 Sep 08 13:03:56.392302 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1976/4082] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:55 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1280 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:03:57.437943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c36ed56-d45f-4033-8cdf-432810962f8c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:57.450341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6c36ed56-d45f-4033-8cdf-432810962f8c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:57.488295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c36ed56-d45f-4033-8cdf-432810962f8c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:57.490047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c36ed56-d45f-4033-8cdf-432810962f8c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:57.520129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c36ed56-d45f-4033-8cdf-432810962f8c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:57.528063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c36ed56-d45f-4033-8cdf-432810962f8c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:57.532857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c36ed56-d45f-4033-8cdf-432810962f8c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:57.534315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c36ed56-d45f-4033-8cdf-432810962f8c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:58.173508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:58.201965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6c36ed56-d45f-4033-8cdf-432810962f8c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:03:58.231743 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6c36ed56-d45f-4033-8cdf-432810962f8c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1322 microversion: 2.1 time: 0.796761 Sep 08 13:03:58.233891 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2107/4083] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:57 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1322 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:03:59.273515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-51cd657f-9dbc-4e9e-8b3e-27e5087e8525 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:03:59.275672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-51cd657f-9dbc-4e9e-8b3e-27e5087e8525 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:03:59.303145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:59.312318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:03:59.391080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51cd657f-9dbc-4e9e-8b3e-27e5087e8525 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:59.412934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51cd657f-9dbc-4e9e-8b3e-27e5087e8525 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:59.417557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51cd657f-9dbc-4e9e-8b3e-27e5087e8525 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:59.422866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51cd657f-9dbc-4e9e-8b3e-27e5087e8525 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:03:59.424706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51cd657f-9dbc-4e9e-8b3e-27e5087e8525 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:03:59.430302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51cd657f-9dbc-4e9e-8b3e-27e5087e8525 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:03:59.606078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=33 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:00.129722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=14 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:01.057271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-51cd657f-9dbc-4e9e-8b3e-27e5087e8525 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:01.072478 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-51cd657f-9dbc-4e9e-8b3e-27e5087e8525 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1322 microversion: 2.1 time: 1.805010 Sep 08 13:04:01.101443 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1977/4084] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:03:59 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1322 bytes in 1835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:02.143834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dce709df-65f4-494f-b59a-f990df9eae84 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:02.145806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dce709df-65f4-494f-b59a-f990df9eae84 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:02.165135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dce709df-65f4-494f-b59a-f990df9eae84 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:02.166932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dce709df-65f4-494f-b59a-f990df9eae84 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:02.170080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dce709df-65f4-494f-b59a-f990df9eae84 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:02.172074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dce709df-65f4-494f-b59a-f990df9eae84 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:02.172930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dce709df-65f4-494f-b59a-f990df9eae84 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:02.174237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dce709df-65f4-494f-b59a-f990df9eae84 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:02.693820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dce709df-65f4-494f-b59a-f990df9eae84 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:02.730956 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dce709df-65f4-494f-b59a-f990df9eae84 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1322 microversion: 2.1 time: 0.591864 Sep 08 13:04:02.737302 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1978/4085] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:02 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1322 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:02.914376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2f34e6f0-7584-419e-b8a0-24ef0ef6db10 req-1739ab69-1d24-45dd-aa98-b7a414127bd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fd2a7c5-18a2-4270-9e76-c5725415c55c", "tag": "fff5238d-9657-4691-bdeb-2cd0bcd1c3a8"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:02.985014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2f34e6f0-7584-419e-b8a0-24ef0ef6db10 req-1739ab69-1d24-45dd-aa98-b7a414127bd3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:02.985940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2f34e6f0-7584-419e-b8a0-24ef0ef6db10 req-1739ab69-1d24-45dd-aa98-b7a414127bd3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:02.986859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2f34e6f0-7584-419e-b8a0-24ef0ef6db10 req-1739ab69-1d24-45dd-aa98-b7a414127bd3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:03.043420 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2f34e6f0-7584-419e-b8a0-24ef0ef6db10 req-1739ab69-1d24-45dd-aa98-b7a414127bd3 service nova] Creating event network-changed:fff5238d-9657-4691-bdeb-2cd0bcd1c3a8 for instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c on n-h1-852084-10 Sep 08 13:04:03.064797 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2f34e6f0-7584-419e-b8a0-24ef0ef6db10 req-1739ab69-1d24-45dd-aa98-b7a414127bd3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.037945 Sep 08 13:04:03.073489 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2108/4086] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:04:03.384627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bacdf7cc-491e-404e-bea8-ae56d2382524 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:03.386609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bacdf7cc-491e-404e-bea8-ae56d2382524 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:03.417267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bacdf7cc-491e-404e-bea8-ae56d2382524 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:03.421124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bacdf7cc-491e-404e-bea8-ae56d2382524 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:03.422142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bacdf7cc-491e-404e-bea8-ae56d2382524 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:03.425415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bacdf7cc-491e-404e-bea8-ae56d2382524 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:03.427290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bacdf7cc-491e-404e-bea8-ae56d2382524 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:03.430202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bacdf7cc-491e-404e-bea8-ae56d2382524 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:03.765677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-16f74135-e25f-4d29-8be6-c1cb44802941 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:03.766408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-16f74135-e25f-4d29-8be6-c1cb44802941 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:03.799624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16f74135-e25f-4d29-8be6-c1cb44802941 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:03.805273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16f74135-e25f-4d29-8be6-c1cb44802941 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:03.807210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16f74135-e25f-4d29-8be6-c1cb44802941 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:03.808390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16f74135-e25f-4d29-8be6-c1cb44802941 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:03.812647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16f74135-e25f-4d29-8be6-c1cb44802941 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:03.817207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16f74135-e25f-4d29-8be6-c1cb44802941 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:04.457769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bacdf7cc-491e-404e-bea8-ae56d2382524 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:04.512976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bacdf7cc-491e-404e-bea8-ae56d2382524 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:04.530460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bacdf7cc-491e-404e-bea8-ae56d2382524 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:04.533747 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bacdf7cc-491e-404e-bea8-ae56d2382524 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2949 microversion: 2.32 time: 1.157080 Sep 08 13:04:04.542719 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1979/4087] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:03 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2949 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:04.596579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-58791d74-b49a-47f4-8756-22618ddd043e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:04.602959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-58791d74-b49a-47f4-8756-22618ddd043e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:04.624798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58791d74-b49a-47f4-8756-22618ddd043e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:04.627021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58791d74-b49a-47f4-8756-22618ddd043e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:04.628897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58791d74-b49a-47f4-8756-22618ddd043e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:04.630861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58791d74-b49a-47f4-8756-22618ddd043e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:04.632184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58791d74-b49a-47f4-8756-22618ddd043e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:04.634891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58791d74-b49a-47f4-8756-22618ddd043e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:04.674369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-16f74135-e25f-4d29-8be6-c1cb44802941 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:04.723452 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-16f74135-e25f-4d29-8be6-c1cb44802941 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1322 microversion: 2.1 time: 0.960526 Sep 08 13:04:04.731361 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2109/4088] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:03 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1322 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:04.966272 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-58791d74-b49a-47f4-8756-22618ddd043e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.385969 Sep 08 13:04:04.967885 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1980/4089] 10.222.0.78 () {60 vars in 1316 bytes} [Thu Sep 8 13:04:04 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0/os-interface => generated 1832 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:05.761925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3b1634b1-8370-4818-9666-d758f1917d5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:05.778564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3b1634b1-8370-4818-9666-d758f1917d5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:05.824342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b1634b1-8370-4818-9666-d758f1917d5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:05.825688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b1634b1-8370-4818-9666-d758f1917d5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:05.830436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b1634b1-8370-4818-9666-d758f1917d5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:05.832573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b1634b1-8370-4818-9666-d758f1917d5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:05.834030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b1634b1-8370-4818-9666-d758f1917d5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:05.844540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b1634b1-8370-4818-9666-d758f1917d5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:06.161382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b1634b1-8370-4818-9666-d758f1917d5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:06.229708 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3b1634b1-8370-4818-9666-d758f1917d5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1322 microversion: 2.1 time: 0.475622 Sep 08 13:04:06.240616 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1981/4090] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:05 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1322 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:06.600624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3c02f15b-a223-4929-b3cf-8de2762bb578 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1367638068", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:06.618711 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-3c02f15b-a223-4929-b3cf-8de2762bb578 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] HTTP exception thrown: min_count must be <= max_count Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3c02f15b-a223-4929-b3cf-8de2762bb578 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Request method failure captured: Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 184 Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGehFW0bCtYMTyQaEtGflT4UQZqy_YvKycNGl_UPUjYfOks3m694ynd9YasmIIdRZAUB2JLWs001Te3jp8Ed_AGSx9ewfhlXNcs2at2ou-XCFDNKn4U4V74jA54eTflFR-ZgGN9cnIduR5RVGLvXFyGAZnqBDOMBBrs-B4re2jEkDVgc Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ffd76762da4e49138eb44a225b9c4157 Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ffd76762da4e49138eb44a225b9c4157 Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-MultipleCreateNegativeTestJSON-1968095849-project Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 78d4f6cd49ff47c7af4332fa75f3efa0 Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1968095849-project Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1367638068", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "min_count": 3, "max_count": 2}} Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: exception: min_count must be <= max_count Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1367638068', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Sep 08 13:04:06.622007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:06.627956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3c02f15b-a223-4929-b3cf-8de2762bb578 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Returning 400 to user: min_count must be <= max_count {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:04:06.627956 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3c02f15b-a223-4929-b3cf-8de2762bb578 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.938052 Sep 08 13:04:06.632475 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2110/4091] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:04:05 2022] POST /compute/v2.1/servers => generated 74 bytes in 947 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:04:06.939067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b46bf07-796c-4b98-9f3e-d28aa6dd3906 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-902259860", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "max_count": 0}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b46bf07-796c-4b98-9f3e-d28aa6dd3906 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Request method failure captured: Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 167 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGehFW0bCtYMTyQaEtGflT4UQZqy_YvKycNGl_UPUjYfOks3m694ynd9YasmIIdRZAUB2JLWs001Te3jp8Ed_AGSx9ewfhlXNcs2at2ou-XCFDNKn4U4V74jA54eTflFR-ZgGN9cnIduR5RVGLvXFyGAZnqBDOMBBrs-B4re2jEkDVgc Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: ffd76762da4e49138eb44a225b9c4157 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: ffd76762da4e49138eb44a225b9c4157 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-MultipleCreateNegativeTestJSON-1968095849-project Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 78d4f6cd49ff47c7af4332fa75f3efa0 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1968095849-project Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-902259860", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "max_count": 0}} Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-902259860', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'max_count': 0}}} Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 0 Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:04:06.954549 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Sep 08 13:04:06.965015 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:06.975506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b46bf07-796c-4b98-9f3e-d28aa6dd3906 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:04:06.980414 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6b46bf07-796c-4b98-9f3e-d28aa6dd3906 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.047644 Sep 08 13:04:07.000964 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1982/4092] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:04:06 2022] POST /compute/v2.1/servers => generated 130 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:04:07.162447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8fb85e34-c9c7-46c0-9759-922a0121f02f tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-828540834", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "max_count": 2.5}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8fb85e34-c9c7-46c0-9759-922a0121f02f tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Request method failure captured: Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 169 Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGehFW0bCtYMTyQaEtGflT4UQZqy_YvKycNGl_UPUjYfOks3m694ynd9YasmIIdRZAUB2JLWs001Te3jp8Ed_AGSx9ewfhlXNcs2at2ou-XCFDNKn4U4V74jA54eTflFR-ZgGN9cnIduR5RVGLvXFyGAZnqBDOMBBrs-B4re2jEkDVgc Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ffd76762da4e49138eb44a225b9c4157 Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ffd76762da4e49138eb44a225b9c4157 Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-MultipleCreateNegativeTestJSON-1968095849-project Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 78d4f6cd49ff47c7af4332fa75f3efa0 Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1968095849-project Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-828540834", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "max_count": 2.5}} Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-828540834', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'max_count': 2.5}}} Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 2.5 Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:04:07.181363 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 13:04:07.185680 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.189965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8fb85e34-c9c7-46c0-9759-922a0121f02f tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:04:07.191264 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8fb85e34-c9c7-46c0-9759-922a0121f02f tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.087862 Sep 08 13:04:07.219714 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2111/4093] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:04:07 2022] POST /compute/v2.1/servers => generated 139 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:04:07.279725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5599d6f0-1dec-4bb8-88ba-8e975900a17d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:07.280932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5599d6f0-1dec-4bb8-88ba-8e975900a17d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:07.338533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5599d6f0-1dec-4bb8-88ba-8e975900a17d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:07.339495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5599d6f0-1dec-4bb8-88ba-8e975900a17d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:07.356334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5599d6f0-1dec-4bb8-88ba-8e975900a17d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:07.363850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5599d6f0-1dec-4bb8-88ba-8e975900a17d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:07.364892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5599d6f0-1dec-4bb8-88ba-8e975900a17d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:07.366151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5599d6f0-1dec-4bb8-88ba-8e975900a17d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:07.490226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7291f098-82ff-4eb5-a8d8-acecdc9efb47 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-78993328", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "min_count": 0}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7291f098-82ff-4eb5-a8d8-acecdc9efb47 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Request method failure captured: Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 166 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGehFW0bCtYMTyQaEtGflT4UQZqy_YvKycNGl_UPUjYfOks3m694ynd9YasmIIdRZAUB2JLWs001Te3jp8Ed_AGSx9ewfhlXNcs2at2ou-XCFDNKn4U4V74jA54eTflFR-ZgGN9cnIduR5RVGLvXFyGAZnqBDOMBBrs-B4re2jEkDVgc Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ffd76762da4e49138eb44a225b9c4157 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ffd76762da4e49138eb44a225b9c4157 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-MultipleCreateNegativeTestJSON-1968095849-project Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 78d4f6cd49ff47c7af4332fa75f3efa0 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1968095849-project Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-78993328", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "min_count": 0}} Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-78993328', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'min_count': 0}}} Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 0 Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:04:07.510429 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7291f098-82ff-4eb5-a8d8-acecdc9efb47 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7291f098-82ff-4eb5-a8d8-acecdc9efb47 tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.027518 Sep 08 13:04:07.526368 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2112/4094] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:04:07 2022] POST /compute/v2.1/servers => generated 130 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 13:04:07.907390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c57ee6b9-79c9-43cf-9834-419b289a30d5 req-29d27302-4e6d-42bd-b5ff-99b6c4f91264 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74916ce9-4e30-47ff-aa09-b1903b371bcd", "tag": "0bfb6ef6-3bb9-4667-8350-b67c18a3fac3"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:07.962805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c57ee6b9-79c9-43cf-9834-419b289a30d5 req-29d27302-4e6d-42bd-b5ff-99b6c4f91264 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:07.964314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c57ee6b9-79c9-43cf-9834-419b289a30d5 req-29d27302-4e6d-42bd-b5ff-99b6c4f91264 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:07.965174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c57ee6b9-79c9-43cf-9834-419b289a30d5 req-29d27302-4e6d-42bd-b5ff-99b6c4f91264 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:08.046284 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c57ee6b9-79c9-43cf-9834-419b289a30d5 req-29d27302-4e6d-42bd-b5ff-99b6c4f91264 service nova] Creating event network-changed:0bfb6ef6-3bb9-4667-8350-b67c18a3fac3 for instance 74916ce9-4e30-47ff-aa09-b1903b371bcd on n-h1-852084-10 Sep 08 13:04:08.074167 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c57ee6b9-79c9-43cf-9834-419b289a30d5 req-29d27302-4e6d-42bd-b5ff-99b6c4f91264 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171041 Sep 08 13:04:08.088934 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2113/4095] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:04:08.110181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cfacadae-c44f-4820-82a4-b6e0a9fffcac tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1802604806", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "min_count": 2.5}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cfacadae-c44f-4820-82a4-b6e0a9fffcac tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Request method failure captured: Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 170 Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGehFW0bCtYMTyQaEtGflT4UQZqy_YvKycNGl_UPUjYfOks3m694ynd9YasmIIdRZAUB2JLWs001Te3jp8Ed_AGSx9ewfhlXNcs2at2ou-XCFDNKn4U4V74jA54eTflFR-ZgGN9cnIduR5RVGLvXFyGAZnqBDOMBBrs-B4re2jEkDVgc Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ffd76762da4e49138eb44a225b9c4157 Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ffd76762da4e49138eb44a225b9c4157"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ffd76762da4e49138eb44a225b9c4157 Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1968095849 Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-MultipleCreateNegativeTestJSON-1968095849-project Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 78d4f6cd49ff47c7af4332fa75f3efa0 Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1968095849-project Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1802604806", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "min_count": 2.5}} Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1802604806', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'min_count': 2.5}}} Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'minLength': 1, Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'minimum': 1, Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 2.5 Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:04:08.134312 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Sep 08 13:04:08.144506 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:08.154795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cfacadae-c44f-4820-82a4-b6e0a9fffcac tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:04:08.157206 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cfacadae-c44f-4820-82a4-b6e0a9fffcac tempest-MultipleCreateNegativeTestJSON-1968095849 tempest-MultipleCreateNegativeTestJSON-1968095849-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.065436 Sep 08 13:04:08.158648 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2114/4096] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:04:08 2022] POST /compute/v2.1/servers => generated 139 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:04:08.364804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5599d6f0-1dec-4bb8-88ba-8e975900a17d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:08.411766 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5599d6f0-1dec-4bb8-88ba-8e975900a17d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1322 microversion: 2.1 time: 1.139206 Sep 08 13:04:08.412867 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1983/4097] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:07 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1322 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:09.478923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0f11da59-bea6-464e-99fc-bb96315634fa tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:09.480301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0f11da59-bea6-464e-99fc-bb96315634fa tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:09.551421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f11da59-bea6-464e-99fc-bb96315634fa tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:09.552080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f11da59-bea6-464e-99fc-bb96315634fa tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:09.552546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f11da59-bea6-464e-99fc-bb96315634fa tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:09.555855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f11da59-bea6-464e-99fc-bb96315634fa tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:09.556827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f11da59-bea6-464e-99fc-bb96315634fa tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:09.557615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f11da59-bea6-464e-99fc-bb96315634fa tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:10.584732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0f11da59-bea6-464e-99fc-bb96315634fa tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:10.686990 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0f11da59-bea6-464e-99fc-bb96315634fa tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1322 microversion: 2.1 time: 1.221075 Sep 08 13:04:10.696602 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2115/4098] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:09 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1322 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:11.746541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1088b7a0-d744-4248-bb92-03d4b3cf9422 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:11.747544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1088b7a0-d744-4248-bb92-03d4b3cf9422 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:11.778646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=22 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:11.795783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1088b7a0-d744-4248-bb92-03d4b3cf9422 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:11.805297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1088b7a0-d744-4248-bb92-03d4b3cf9422 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:11.808913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1088b7a0-d744-4248-bb92-03d4b3cf9422 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:11.814166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1088b7a0-d744-4248-bb92-03d4b3cf9422 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:11.817699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1088b7a0-d744-4248-bb92-03d4b3cf9422 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:11.823424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1088b7a0-d744-4248-bb92-03d4b3cf9422 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:12.616702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f609c423-58a5-4a2b-9f4d-8d51285410a7 req-77114c52-1cbb-45c0-9c13-59ef2658c136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd2a7c5-18a2-4270-9e76-c5725415c55c", "name": "network-vif-plugged", "status": "completed", "tag": "fff5238d-9657-4691-bdeb-2cd0bcd1c3a8"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:12.656995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f609c423-58a5-4a2b-9f4d-8d51285410a7 req-77114c52-1cbb-45c0-9c13-59ef2658c136 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:12.657479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f609c423-58a5-4a2b-9f4d-8d51285410a7 req-77114c52-1cbb-45c0-9c13-59ef2658c136 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:12.677018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f609c423-58a5-4a2b-9f4d-8d51285410a7 req-77114c52-1cbb-45c0-9c13-59ef2658c136 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:12.683446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1088b7a0-d744-4248-bb92-03d4b3cf9422 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:12.730876 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1088b7a0-d744-4248-bb92-03d4b3cf9422 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1322 microversion: 2.1 time: 0.974329 Sep 08 13:04:12.758927 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f609c423-58a5-4a2b-9f4d-8d51285410a7 req-77114c52-1cbb-45c0-9c13-59ef2658c136 service nova] Creating event network-vif-plugged:fff5238d-9657-4691-bdeb-2cd0bcd1c3a8 for instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c on n-h1-852084-10 Sep 08 13:04:12.763497 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2116/4099] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:11 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1322 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:12.807475 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f609c423-58a5-4a2b-9f4d-8d51285410a7 req-77114c52-1cbb-45c0-9c13-59ef2658c136 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.192430 Sep 08 13:04:12.812918 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1984/4100] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:04:13.778838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2c47646b-c1a6-4a6f-8563-28b839e7cf5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:13.780977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2c47646b-c1a6-4a6f-8563-28b839e7cf5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:13.844828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c47646b-c1a6-4a6f-8563-28b839e7cf5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:13.849175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c47646b-c1a6-4a6f-8563-28b839e7cf5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:13.856792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c47646b-c1a6-4a6f-8563-28b839e7cf5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:13.861059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c47646b-c1a6-4a6f-8563-28b839e7cf5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:13.869891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c47646b-c1a6-4a6f-8563-28b839e7cf5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:13.872053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c47646b-c1a6-4a6f-8563-28b839e7cf5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:15.117929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2c47646b-c1a6-4a6f-8563-28b839e7cf5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:15.153113 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2c47646b-c1a6-4a6f-8563-28b839e7cf5e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1322 microversion: 2.1 time: 1.379181 Sep 08 13:04:15.161771 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2117/4101] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:13 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1322 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:16.216481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-942fdb92-96b1-4348-b18f-a1a75e7d6fa9 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:16.217346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-942fdb92-96b1-4348-b18f-a1a75e7d6fa9 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:16.243359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-942fdb92-96b1-4348-b18f-a1a75e7d6fa9 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:16.243359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-942fdb92-96b1-4348-b18f-a1a75e7d6fa9 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:16.243359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-942fdb92-96b1-4348-b18f-a1a75e7d6fa9 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:16.243359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-942fdb92-96b1-4348-b18f-a1a75e7d6fa9 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:16.243359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-942fdb92-96b1-4348-b18f-a1a75e7d6fa9 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:16.243359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-942fdb92-96b1-4348-b18f-a1a75e7d6fa9 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:17.179900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-942fdb92-96b1-4348-b18f-a1a75e7d6fa9 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:17.216154 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-942fdb92-96b1-4348-b18f-a1a75e7d6fa9 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1322 microversion: 2.1 time: 1.007133 Sep 08 13:04:17.223473 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1985/4102] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:16 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1322 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:18.258237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ef6b0ca7-53c8-49a6-8ef1-0fa7964a2292 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:18.259741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ef6b0ca7-53c8-49a6-8ef1-0fa7964a2292 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:18.293968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef6b0ca7-53c8-49a6-8ef1-0fa7964a2292 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:18.296006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef6b0ca7-53c8-49a6-8ef1-0fa7964a2292 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:18.296699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef6b0ca7-53c8-49a6-8ef1-0fa7964a2292 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:18.297839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef6b0ca7-53c8-49a6-8ef1-0fa7964a2292 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:18.299009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef6b0ca7-53c8-49a6-8ef1-0fa7964a2292 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:18.299218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ef6b0ca7-53c8-49a6-8ef1-0fa7964a2292 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:19.487486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-57603124", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": "none"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:19.698656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:04:19.699302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:04:19.699927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:04:19.700489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:04:19.701023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:04:19.714837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:19.716028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:19.716955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:19.718450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:19.719876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:19.720575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:19.748084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Getting quotas for project dbcff02e6dbb4abab905684dbd0ab097. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:04:19.757166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Getting quotas for user 09e8b16ab90c47f6881bde461a1ee1b4 and project dbcff02e6dbb4abab905684dbd0ab097. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:04:19.785007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:04:19.791629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:04:19.895553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ef6b0ca7-53c8-49a6-8ef1-0fa7964a2292 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:19.946129 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ef6b0ca7-53c8-49a6-8ef1-0fa7964a2292 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1322 microversion: 2.1 time: 1.691973 Sep 08 13:04:19.950419 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2118/4103] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:18 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1322 bytes in 1698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:19.982574 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c5b7ebe6-33e5-430d-a019-6628d2c146d8 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 1.092941 Sep 08 13:04:19.995756 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1986/4104] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 13:04:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1107 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 13:04:20.011594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f5c438d-987c-4abc-a8ba-066a6ff5c9cd tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:20.015415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1f5c438d-987c-4abc-a8ba-066a6ff5c9cd tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:20.498656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1f5c438d-987c-4abc-a8ba-066a6ff5c9cd tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:20.507649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f21e513e-7684-4d4e-8752-acbe654c5d19 req-c1fe3d74-e8e8-48a9-a53d-c18c864e2925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74916ce9-4e30-47ff-aa09-b1903b371bcd", "name": "network-vif-plugged", "status": "completed", "tag": "0bfb6ef6-3bb9-4667-8350-b67c18a3fac3"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:20.518315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1f5c438d-987c-4abc-a8ba-066a6ff5c9cd tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:20.520182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1f5c438d-987c-4abc-a8ba-066a6ff5c9cd tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:20.521509 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1f5c438d-987c-4abc-a8ba-066a6ff5c9cd tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1276 microversion: 2.54 time: 0.525808 Sep 08 13:04:20.558083 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2119/4105] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:19 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1276 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:04:20.566176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f21e513e-7684-4d4e-8752-acbe654c5d19 req-c1fe3d74-e8e8-48a9-a53d-c18c864e2925 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:20.571458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f21e513e-7684-4d4e-8752-acbe654c5d19 req-c1fe3d74-e8e8-48a9-a53d-c18c864e2925 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:20.572251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f21e513e-7684-4d4e-8752-acbe654c5d19 req-c1fe3d74-e8e8-48a9-a53d-c18c864e2925 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:20.601330 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f21e513e-7684-4d4e-8752-acbe654c5d19 req-c1fe3d74-e8e8-48a9-a53d-c18c864e2925 service nova] Creating event network-vif-plugged:0bfb6ef6-3bb9-4667-8350-b67c18a3fac3 for instance 74916ce9-4e30-47ff-aa09-b1903b371bcd on n-h1-852084-10 Sep 08 13:04:20.614005 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f21e513e-7684-4d4e-8752-acbe654c5d19 req-c1fe3d74-e8e8-48a9-a53d-c18c864e2925 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136101 Sep 08 13:04:20.619624 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1987/4106] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:04:20.984214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e28fea1-7aab-4297-a057-f5dddeb1c793 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:20.985077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9e28fea1-7aab-4297-a057-f5dddeb1c793 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:21.045913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e28fea1-7aab-4297-a057-f5dddeb1c793 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:21.046788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e28fea1-7aab-4297-a057-f5dddeb1c793 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:21.056552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e28fea1-7aab-4297-a057-f5dddeb1c793 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:21.059074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e28fea1-7aab-4297-a057-f5dddeb1c793 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:21.060286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e28fea1-7aab-4297-a057-f5dddeb1c793 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:21.061319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e28fea1-7aab-4297-a057-f5dddeb1c793 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:21.978397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-2021517896", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "1c10bd3e-6782-4166-9f7c-0b247248b1de"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:22.225995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] validate_networks() for [('1c10bd3e-6782-4166-9f7c-0b247248b1de', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:04:22.247559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9e28fea1-7aab-4297-a057-f5dddeb1c793 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:22.275058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=57 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:22.277954 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e28fea1-7aab-4297-a057-f5dddeb1c793 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1322 microversion: 2.1 time: 1.298610 Sep 08 13:04:22.292792 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2120/4107] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:20 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1322 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:22.376377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b7fa645-6f6c-4250-86b3-db38d91c5add tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:22.381448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7b7fa645-6f6c-4250-86b3-db38d91c5add tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:22.440175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b7fa645-6f6c-4250-86b3-db38d91c5add tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:22.441548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b7fa645-6f6c-4250-86b3-db38d91c5add tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:22.442750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b7fa645-6f6c-4250-86b3-db38d91c5add tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:22.445284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b7fa645-6f6c-4250-86b3-db38d91c5add tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:22.446283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b7fa645-6f6c-4250-86b3-db38d91c5add tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:22.447242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b7fa645-6f6c-4250-86b3-db38d91c5add tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:22.912585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b7fa645-6f6c-4250-86b3-db38d91c5add tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:22.977517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b7fa645-6f6c-4250-86b3-db38d91c5add tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:22.984207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b7fa645-6f6c-4250-86b3-db38d91c5add tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:22.987175 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7b7fa645-6f6c-4250-86b3-db38d91c5add tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1280 microversion: 2.54 time: 0.685290 Sep 08 13:04:22.998065 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2121/4108] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:22 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1280 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:23.341099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bd1c816e-01de-456f-a8fb-593a0d21c4ca tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:23.342614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bd1c816e-01de-456f-a8fb-593a0d21c4ca tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:23.363344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd1c816e-01de-456f-a8fb-593a0d21c4ca tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:23.365022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd1c816e-01de-456f-a8fb-593a0d21c4ca tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:23.365687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd1c816e-01de-456f-a8fb-593a0d21c4ca tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:23.366813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd1c816e-01de-456f-a8fb-593a0d21c4ca tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:23.367591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd1c816e-01de-456f-a8fb-593a0d21c4ca tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:23.369001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bd1c816e-01de-456f-a8fb-593a0d21c4ca tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:24.269060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bd1c816e-01de-456f-a8fb-593a0d21c4ca tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:24.281389 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bd1c816e-01de-456f-a8fb-593a0d21c4ca tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1517 microversion: 2.1 time: 0.962079 Sep 08 13:04:24.295754 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2122/4109] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:23 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1517 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:24.308723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9bbb485f-a8f9-4b18-9bf1-1772268e1a49 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:24.311513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9bbb485f-a8f9-4b18-9bf1-1772268e1a49 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:24.362469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bbb485f-a8f9-4b18-9bf1-1772268e1a49 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:24.367766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bbb485f-a8f9-4b18-9bf1-1772268e1a49 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:24.369244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bbb485f-a8f9-4b18-9bf1-1772268e1a49 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:24.378797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bbb485f-a8f9-4b18-9bf1-1772268e1a49 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:24.382965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bbb485f-a8f9-4b18-9bf1-1772268e1a49 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:24.386866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9bbb485f-a8f9-4b18-9bf1-1772268e1a49 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:24.591562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:04:24.592899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:04:24.594108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:04:24.595042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:04:24.597184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:04:24.640195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9bbb485f-a8f9-4b18-9bf1-1772268e1a49 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:24.655999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9bbb485f-a8f9-4b18-9bf1-1772268e1a49 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:24.667137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:24.667458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9bbb485f-a8f9-4b18-9bf1-1772268e1a49 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:24.672430 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9bbb485f-a8f9-4b18-9bf1-1772268e1a49 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1334 microversion: 2.54 time: 0.381195 Sep 08 13:04:24.673057 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2123/4110] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:24 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1334 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:24.679739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:24.682773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:24.688953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:24.690229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:24.695618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-247f6752-a4d2-4678-883c-94ee0b440217 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:24.698136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-247f6752-a4d2-4678-883c-94ee0b440217 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:24.709482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-247f6752-a4d2-4678-883c-94ee0b440217 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:24.711102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:24.712487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-247f6752-a4d2-4678-883c-94ee0b440217 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:24.715123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-247f6752-a4d2-4678-883c-94ee0b440217 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:24.719653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-247f6752-a4d2-4678-883c-94ee0b440217 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:24.720819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-247f6752-a4d2-4678-883c-94ee0b440217 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:24.721896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-247f6752-a4d2-4678-883c-94ee0b440217 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:24.812012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-247f6752-a4d2-4678-883c-94ee0b440217 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lazy-loading 'flavor' on Instance uuid 74916ce9-4e30-47ff-aa09-b1903b371bcd {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:04:24.813661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Getting quotas for project 8f0e5bc4ae2e4015bd4ac57c3f9e97fc. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:04:24.853690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Getting quotas for user 17d2908ffdea41d6a47a7a9362a1b291 and project 8f0e5bc4ae2e4015bd4ac57c3f9e97fc. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:04:24.917068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:04:24.922625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:04:25.093760 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c47089ea-4909-4f84-84ea-693666704004 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.071226 Sep 08 13:04:25.097123 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1988/4111] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:04:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 4076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:04:25.112954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3f7d5f4e-2806-4ded-9434-3d4dd64f4358 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:25.119961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3f7d5f4e-2806-4ded-9434-3d4dd64f4358 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:25.165233 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-247f6752-a4d2-4678-883c-94ee0b440217 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd/action" status: 200 len: 32 microversion: 2.1 time: 0.488447 Sep 08 13:04:25.165994 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2124/4112] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:04:24 2022] POST /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd/action => generated 32 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:04:25.185716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d8398c7c-8ceb-4da3-85f4-de2a887bceb0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:25.187571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d8398c7c-8ceb-4da3-85f4-de2a887bceb0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:25.206363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8398c7c-8ceb-4da3-85f4-de2a887bceb0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:25.207494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8398c7c-8ceb-4da3-85f4-de2a887bceb0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:25.208253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8398c7c-8ceb-4da3-85f4-de2a887bceb0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:25.211695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8398c7c-8ceb-4da3-85f4-de2a887bceb0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:25.213348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8398c7c-8ceb-4da3-85f4-de2a887bceb0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:25.214075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8398c7c-8ceb-4da3-85f4-de2a887bceb0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:25.638256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3f7d5f4e-2806-4ded-9434-3d4dd64f4358 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:25.653662 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3f7d5f4e-2806-4ded-9434-3d4dd64f4358 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1217 microversion: 2.1 time: 0.545257 Sep 08 13:04:25.655007 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1989/4113] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:25 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1217 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:25.705992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-541a37a2-3b86-4990-878f-25cfa06dc71d tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:25.714235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-541a37a2-3b86-4990-878f-25cfa06dc71d tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:25.776364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-541a37a2-3b86-4990-878f-25cfa06dc71d tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:25.778226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-541a37a2-3b86-4990-878f-25cfa06dc71d tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:25.793351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-541a37a2-3b86-4990-878f-25cfa06dc71d tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:25.794444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-541a37a2-3b86-4990-878f-25cfa06dc71d tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:25.799791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-541a37a2-3b86-4990-878f-25cfa06dc71d tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:25.812462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-541a37a2-3b86-4990-878f-25cfa06dc71d tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:26.284359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-541a37a2-3b86-4990-878f-25cfa06dc71d tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:26.334505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-541a37a2-3b86-4990-878f-25cfa06dc71d tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:26.341648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-541a37a2-3b86-4990-878f-25cfa06dc71d tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:26.347514 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-541a37a2-3b86-4990-878f-25cfa06dc71d tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1334 microversion: 2.54 time: 0.647627 Sep 08 13:04:26.360759 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1990/4114] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:25 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1334 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:26.449995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d8398c7c-8ceb-4da3-85f4-de2a887bceb0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:26.485887 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d8398c7c-8ceb-4da3-85f4-de2a887bceb0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 1.312951 Sep 08 13:04:26.486503 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2125/4115] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:25 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:26.713623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5794033f-5f10-44ba-a634-5b2f1ea89b49 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:26.715396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5794033f-5f10-44ba-a634-5b2f1ea89b49 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:26.776032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5794033f-5f10-44ba-a634-5b2f1ea89b49 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:26.784843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5794033f-5f10-44ba-a634-5b2f1ea89b49 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:26.786604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5794033f-5f10-44ba-a634-5b2f1ea89b49 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:26.794487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5794033f-5f10-44ba-a634-5b2f1ea89b49 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:26.795349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5794033f-5f10-44ba-a634-5b2f1ea89b49 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:26.796869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5794033f-5f10-44ba-a634-5b2f1ea89b49 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:27.167545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5794033f-5f10-44ba-a634-5b2f1ea89b49 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:27.192051 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5794033f-5f10-44ba-a634-5b2f1ea89b49 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1221 microversion: 2.1 time: 0.500664 Sep 08 13:04:27.200096 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1991/4116] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:26 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1221 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:27.392300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fdd322f5-21e9-49e2-89fc-f4c1765ae42b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:27.393952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fdd322f5-21e9-49e2-89fc-f4c1765ae42b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:27.426827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdd322f5-21e9-49e2-89fc-f4c1765ae42b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:27.427681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdd322f5-21e9-49e2-89fc-f4c1765ae42b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:27.428307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdd322f5-21e9-49e2-89fc-f4c1765ae42b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:27.432312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdd322f5-21e9-49e2-89fc-f4c1765ae42b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:27.433084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdd322f5-21e9-49e2-89fc-f4c1765ae42b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:27.433687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdd322f5-21e9-49e2-89fc-f4c1765ae42b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:27.519575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c311f3f3-b016-4cee-8609-64ed1ee103f6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:27.520379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c311f3f3-b016-4cee-8609-64ed1ee103f6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:27.536736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c311f3f3-b016-4cee-8609-64ed1ee103f6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:27.538337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c311f3f3-b016-4cee-8609-64ed1ee103f6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:27.544806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c311f3f3-b016-4cee-8609-64ed1ee103f6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:27.546508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c311f3f3-b016-4cee-8609-64ed1ee103f6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:27.551319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c311f3f3-b016-4cee-8609-64ed1ee103f6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:27.558345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c311f3f3-b016-4cee-8609-64ed1ee103f6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:27.649366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fdd322f5-21e9-49e2-89fc-f4c1765ae42b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:27.670137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fdd322f5-21e9-49e2-89fc-f4c1765ae42b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:27.672058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fdd322f5-21e9-49e2-89fc-f4c1765ae42b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:27.673345 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fdd322f5-21e9-49e2-89fc-f4c1765ae42b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1355 microversion: 2.54 time: 0.287085 Sep 08 13:04:27.717938 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2126/4117] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:27 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1355 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:27.723770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9960c888-9633-40f6-a20b-7c4a9bd3eac2 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Action: 'create', calling method: .version_select at 0x7fdb35e4ff70>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-177875696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAnXsTZ4Z/l9iIWf6te7Jju5EClxgYkzFzF4KuxCJbaVtaG2+cmq9PwSCGbaaSz67tMXA2h1Xr2Al6Jw56AgXJX2Yq0Nc1ayfV/jLDyNBXVsJdFVSTepr2OUkm/7ymmz4g=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:27.840880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-9960c888-9633-40f6-a20b-7c4a9bd3eac2 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Getting quotas for project dbcff02e6dbb4abab905684dbd0ab097. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:04:27.889910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-9960c888-9633-40f6-a20b-7c4a9bd3eac2 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Getting quotas for user 09e8b16ab90c47f6881bde461a1ee1b4 and project dbcff02e6dbb4abab905684dbd0ab097. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:04:28.020173 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9960c888-9633-40f6-a20b-7c4a9bd3eac2 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.300739 Sep 08 13:04:28.024102 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2127/4118] 10.222.0.78 () {62 vars in 1200 bytes} [Thu Sep 8 13:04:27 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 305 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 13:04:28.068488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-177875696", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:28.092236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:28.134931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:28.136855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:28.141370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:28.144980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:28.153480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:28.154913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:28.158116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c311f3f3-b016-4cee-8609-64ed1ee103f6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:28.202135 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c311f3f3-b016-4cee-8609-64ed1ee103f6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 0.691754 Sep 08 13:04:28.202854 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1992/4119] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:27 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:28.226553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6c1f1b05-7db5-4438-98d3-e8b6de45e664 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:28.230501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6c1f1b05-7db5-4438-98d3-e8b6de45e664 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:28.269929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c1f1b05-7db5-4438-98d3-e8b6de45e664 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:28.271675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c1f1b05-7db5-4438-98d3-e8b6de45e664 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:28.276745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c1f1b05-7db5-4438-98d3-e8b6de45e664 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:28.281779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c1f1b05-7db5-4438-98d3-e8b6de45e664 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:28.283808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c1f1b05-7db5-4438-98d3-e8b6de45e664 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:28.284910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c1f1b05-7db5-4438-98d3-e8b6de45e664 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:28.595147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:04:28.596525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:04:28.597807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:04:28.599096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:04:28.600200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:04:28.868024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:28.885907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c1f1b05-7db5-4438-98d3-e8b6de45e664 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:28.913642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:28.914661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:28.926242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:28.927742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:28.929073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:28.929812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:28.985209 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6c1f1b05-7db5-4438-98d3-e8b6de45e664 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1277 microversion: 2.1 time: 0.763497 Sep 08 13:04:29.004139 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1993/4120] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:28 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1277 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:29.080231 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fce5c3a7-e78f-4bbb-a557-3a284a0e19e5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "POST /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc/action" status: 202 len: 1137 microversion: 2.54 time: 1.040672 Sep 08 13:04:29.081274 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2128/4121] 10.222.0.78 () {62 vars in 1320 bytes} [Thu Sep 8 13:04:28 2022] POST /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc/action => generated 1137 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 13:04:29.109587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ba95e98-33ac-4512-a30a-44a3d4b24699 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:29.110380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ba95e98-33ac-4512-a30a-44a3d4b24699 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:29.135098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ba95e98-33ac-4512-a30a-44a3d4b24699 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:29.135834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ba95e98-33ac-4512-a30a-44a3d4b24699 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:29.136484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ba95e98-33ac-4512-a30a-44a3d4b24699 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:29.146441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ba95e98-33ac-4512-a30a-44a3d4b24699 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:29.147199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ba95e98-33ac-4512-a30a-44a3d4b24699 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:29.147696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ba95e98-33ac-4512-a30a-44a3d4b24699 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:29.247256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fbf712a2-d9b3-4b05-b331-8fa5b391d62d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:29.253532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fbf712a2-d9b3-4b05-b331-8fa5b391d62d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:29.294834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbf712a2-d9b3-4b05-b331-8fa5b391d62d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:29.313419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbf712a2-d9b3-4b05-b331-8fa5b391d62d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:29.314714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbf712a2-d9b3-4b05-b331-8fa5b391d62d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:29.318231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbf712a2-d9b3-4b05-b331-8fa5b391d62d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:29.319722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbf712a2-d9b3-4b05-b331-8fa5b391d62d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:29.324053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbf712a2-d9b3-4b05-b331-8fa5b391d62d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:29.482074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ba95e98-33ac-4512-a30a-44a3d4b24699 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:29.519565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ba95e98-33ac-4512-a30a-44a3d4b24699 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:29.525700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ba95e98-33ac-4512-a30a-44a3d4b24699 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:29.531711 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ba95e98-33ac-4512-a30a-44a3d4b24699 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.426521 Sep 08 13:04:29.538848 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1994/4122] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:29 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:29.845317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fbf712a2-d9b3-4b05-b331-8fa5b391d62d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:29.862201 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fbf712a2-d9b3-4b05-b331-8fa5b391d62d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 0.622324 Sep 08 13:04:29.864525 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2129/4123] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:29 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:30.034141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d885a816-23e4-491c-acb5-3ee7aad8a4d3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:30.045539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d885a816-23e4-491c-acb5-3ee7aad8a4d3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:30.081136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:30.089857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d885a816-23e4-491c-acb5-3ee7aad8a4d3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:30.090729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d885a816-23e4-491c-acb5-3ee7aad8a4d3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:30.097348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d885a816-23e4-491c-acb5-3ee7aad8a4d3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:30.098720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d885a816-23e4-491c-acb5-3ee7aad8a4d3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:30.105535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d885a816-23e4-491c-acb5-3ee7aad8a4d3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:30.109999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d885a816-23e4-491c-acb5-3ee7aad8a4d3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:30.168196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=78 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:30.583409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-80d95522-cef6-43e8-a2e8-01301ca18f58 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:30.585254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-80d95522-cef6-43e8-a2e8-01301ca18f58 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:30.604354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80d95522-cef6-43e8-a2e8-01301ca18f58 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:30.605198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80d95522-cef6-43e8-a2e8-01301ca18f58 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:30.605944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80d95522-cef6-43e8-a2e8-01301ca18f58 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:30.607150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80d95522-cef6-43e8-a2e8-01301ca18f58 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:30.608045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80d95522-cef6-43e8-a2e8-01301ca18f58 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:30.608714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80d95522-cef6-43e8-a2e8-01301ca18f58 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:30.799477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d885a816-23e4-491c-acb5-3ee7aad8a4d3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:30.803129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-80d95522-cef6-43e8-a2e8-01301ca18f58 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:30.815814 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d885a816-23e4-491c-acb5-3ee7aad8a4d3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1275 microversion: 2.1 time: 0.790159 Sep 08 13:04:30.818827 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1995/4124] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:30 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1275 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:30.838871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-80d95522-cef6-43e8-a2e8-01301ca18f58 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:30.854158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-80d95522-cef6-43e8-a2e8-01301ca18f58 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:30.857899 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-80d95522-cef6-43e8-a2e8-01301ca18f58 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.280586 Sep 08 13:04:30.860119 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2130/4125] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:30 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:30.919048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f49edabb-6db1-489b-943c-0d4a51420587 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:30.920786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f49edabb-6db1-489b-943c-0d4a51420587 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:30.942172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f49edabb-6db1-489b-943c-0d4a51420587 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:30.943154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f49edabb-6db1-489b-943c-0d4a51420587 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:30.945609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f49edabb-6db1-489b-943c-0d4a51420587 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:30.948259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f49edabb-6db1-489b-943c-0d4a51420587 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:30.950664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f49edabb-6db1-489b-943c-0d4a51420587 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:30.951856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f49edabb-6db1-489b-943c-0d4a51420587 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:31.844133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f49edabb-6db1-489b-943c-0d4a51420587 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:31.871966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-70a79c7c-2275-48a7-a0ae-40be6777d520 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:31.873290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-70a79c7c-2275-48a7-a0ae-40be6777d520 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:31.903784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70a79c7c-2275-48a7-a0ae-40be6777d520 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:31.905912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70a79c7c-2275-48a7-a0ae-40be6777d520 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:31.906595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70a79c7c-2275-48a7-a0ae-40be6777d520 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:31.907948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70a79c7c-2275-48a7-a0ae-40be6777d520 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:31.911114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70a79c7c-2275-48a7-a0ae-40be6777d520 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:31.911877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70a79c7c-2275-48a7-a0ae-40be6777d520 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:31.913401 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f49edabb-6db1-489b-943c-0d4a51420587 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 0.999541 Sep 08 13:04:31.919970 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1996/4126] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:30 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:31.952382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c7c55db8-d789-4e4e-a4a2-e99b7b2f8177 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:31.954202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c7c55db8-d789-4e4e-a4a2-e99b7b2f8177 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:31.986487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7c55db8-d789-4e4e-a4a2-e99b7b2f8177 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:31.990027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7c55db8-d789-4e4e-a4a2-e99b7b2f8177 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:31.993759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7c55db8-d789-4e4e-a4a2-e99b7b2f8177 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:31.995564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7c55db8-d789-4e4e-a4a2-e99b7b2f8177 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:31.999164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7c55db8-d789-4e4e-a4a2-e99b7b2f8177 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:32.009614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7c55db8-d789-4e4e-a4a2-e99b7b2f8177 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:32.382740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c7c55db8-d789-4e4e-a4a2-e99b7b2f8177 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:32.410844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c7c55db8-d789-4e4e-a4a2-e99b7b2f8177 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:32.417232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c7c55db8-d789-4e4e-a4a2-e99b7b2f8177 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:32.422408 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c7c55db8-d789-4e4e-a4a2-e99b7b2f8177 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.497143 Sep 08 13:04:32.436457 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1997/4127] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:31 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:32.690502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-70a79c7c-2275-48a7-a0ae-40be6777d520 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:32.722044 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-70a79c7c-2275-48a7-a0ae-40be6777d520 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1317 microversion: 2.1 time: 0.855389 Sep 08 13:04:32.736048 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2131/4128] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:31 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1317 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:32.955408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ee708c3c-fcdd-4070-97e8-26b2d96f0ed0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:32.956085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ee708c3c-fcdd-4070-97e8-26b2d96f0ed0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:32.969531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee708c3c-fcdd-4070-97e8-26b2d96f0ed0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:32.970089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee708c3c-fcdd-4070-97e8-26b2d96f0ed0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:32.970825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee708c3c-fcdd-4070-97e8-26b2d96f0ed0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:32.976417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee708c3c-fcdd-4070-97e8-26b2d96f0ed0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:32.977589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee708c3c-fcdd-4070-97e8-26b2d96f0ed0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:32.979013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee708c3c-fcdd-4070-97e8-26b2d96f0ed0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:33.470589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-157cb9bc-803d-4e2c-ba2e-11cedc843e3b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:33.474439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-157cb9bc-803d-4e2c-ba2e-11cedc843e3b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:33.493745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-157cb9bc-803d-4e2c-ba2e-11cedc843e3b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:33.495380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-157cb9bc-803d-4e2c-ba2e-11cedc843e3b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:33.497259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-157cb9bc-803d-4e2c-ba2e-11cedc843e3b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:33.498767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-157cb9bc-803d-4e2c-ba2e-11cedc843e3b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:33.499505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-157cb9bc-803d-4e2c-ba2e-11cedc843e3b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:33.500470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-157cb9bc-803d-4e2c-ba2e-11cedc843e3b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:34.150476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-157cb9bc-803d-4e2c-ba2e-11cedc843e3b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:34.184297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-157cb9bc-803d-4e2c-ba2e-11cedc843e3b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:34.192123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-157cb9bc-803d-4e2c-ba2e-11cedc843e3b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:34.197955 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-157cb9bc-803d-4e2c-ba2e-11cedc843e3b tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.737566 Sep 08 13:04:34.207480 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2132/4129] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:33 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:34.217521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bfd6a9bc-0cea-4014-aabc-4b41fd9a8206 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:34.219161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bfd6a9bc-0cea-4014-aabc-4b41fd9a8206 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:34.235372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfd6a9bc-0cea-4014-aabc-4b41fd9a8206 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:34.236188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfd6a9bc-0cea-4014-aabc-4b41fd9a8206 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:34.237230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfd6a9bc-0cea-4014-aabc-4b41fd9a8206 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:34.242045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfd6a9bc-0cea-4014-aabc-4b41fd9a8206 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:34.242939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfd6a9bc-0cea-4014-aabc-4b41fd9a8206 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:34.244776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfd6a9bc-0cea-4014-aabc-4b41fd9a8206 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:34.766552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:34.878117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ee708c3c-fcdd-4070-97e8-26b2d96f0ed0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:34.903193 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ee708c3c-fcdd-4070-97e8-26b2d96f0ed0 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 1.952709 Sep 08 13:04:34.925144 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1998/4130] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:32 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 1975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:35.031926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bfd6a9bc-0cea-4014-aabc-4b41fd9a8206 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:35.055172 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bfd6a9bc-0cea-4014-aabc-4b41fd9a8206 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1317 microversion: 2.1 time: 0.845274 Sep 08 13:04:35.063279 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2133/4131] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:34 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1317 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:35.242807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1801156d-4de6-44f1-8377-e19eff9bc834 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:35.243937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1801156d-4de6-44f1-8377-e19eff9bc834 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:35.285778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1801156d-4de6-44f1-8377-e19eff9bc834 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:35.293763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1801156d-4de6-44f1-8377-e19eff9bc834 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:35.297033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1801156d-4de6-44f1-8377-e19eff9bc834 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:35.306508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1801156d-4de6-44f1-8377-e19eff9bc834 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:35.308010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1801156d-4de6-44f1-8377-e19eff9bc834 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:35.309848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1801156d-4de6-44f1-8377-e19eff9bc834 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:35.643162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=14 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:35.690337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1801156d-4de6-44f1-8377-e19eff9bc834 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:35.739177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1801156d-4de6-44f1-8377-e19eff9bc834 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:35.744543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1801156d-4de6-44f1-8377-e19eff9bc834 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:35.757030 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1801156d-4de6-44f1-8377-e19eff9bc834 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.518737 Sep 08 13:04:35.760734 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 1999/4132] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:35 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:35.939265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d68ab289-9ad1-4ea8-82a6-47627230ef55 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:35.946473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d68ab289-9ad1-4ea8-82a6-47627230ef55 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:35.982505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d68ab289-9ad1-4ea8-82a6-47627230ef55 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:35.989174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d68ab289-9ad1-4ea8-82a6-47627230ef55 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:35.992164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d68ab289-9ad1-4ea8-82a6-47627230ef55 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:35.996061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d68ab289-9ad1-4ea8-82a6-47627230ef55 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:35.998556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d68ab289-9ad1-4ea8-82a6-47627230ef55 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:36.004915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d68ab289-9ad1-4ea8-82a6-47627230ef55 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:36.043558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:36.115361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a28f259d-c828-408b-8829-13f3344a367e tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:36.116782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a28f259d-c828-408b-8829-13f3344a367e tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:36.140613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28f259d-c828-408b-8829-13f3344a367e tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:36.148585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28f259d-c828-408b-8829-13f3344a367e tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:36.149621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28f259d-c828-408b-8829-13f3344a367e tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:36.155147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28f259d-c828-408b-8829-13f3344a367e tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:36.156683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28f259d-c828-408b-8829-13f3344a367e tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:36.158557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28f259d-c828-408b-8829-13f3344a367e tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:36.954319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d68ab289-9ad1-4ea8-82a6-47627230ef55 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:36.969129 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d68ab289-9ad1-4ea8-82a6-47627230ef55 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 1.033783 Sep 08 13:04:36.976552 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2134/4133] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:35 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:36.992367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-51e416a3-b7b8-4725-9415-85241b43fa55 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:36.994447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a28f259d-c828-408b-8829-13f3344a367e tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:37.001871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-51e416a3-b7b8-4725-9415-85241b43fa55 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:37.015510 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a28f259d-c828-408b-8829-13f3344a367e tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1317 microversion: 2.1 time: 0.908042 Sep 08 13:04:37.016530 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2000/4134] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:36 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1317 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:37.022518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51e416a3-b7b8-4725-9415-85241b43fa55 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:37.023702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51e416a3-b7b8-4725-9415-85241b43fa55 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:37.027866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51e416a3-b7b8-4725-9415-85241b43fa55 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:37.035351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51e416a3-b7b8-4725-9415-85241b43fa55 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:37.038282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51e416a3-b7b8-4725-9415-85241b43fa55 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:37.041554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51e416a3-b7b8-4725-9415-85241b43fa55 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:37.421748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-51e416a3-b7b8-4725-9415-85241b43fa55 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:37.437459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-51e416a3-b7b8-4725-9415-85241b43fa55 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:37.450980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-51e416a3-b7b8-4725-9415-85241b43fa55 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:37.466254 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-51e416a3-b7b8-4725-9415-85241b43fa55 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.486092 Sep 08 13:04:37.469174 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2135/4135] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:36 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:38.036847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e37cfee-b65d-49ee-a520-8c2465a34473 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:38.038106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8e37cfee-b65d-49ee-a520-8c2465a34473 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:38.056844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:38.064814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e37cfee-b65d-49ee-a520-8c2465a34473 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:38.065334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e37cfee-b65d-49ee-a520-8c2465a34473 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:38.067038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e37cfee-b65d-49ee-a520-8c2465a34473 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:38.070639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e37cfee-b65d-49ee-a520-8c2465a34473 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:38.071534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e37cfee-b65d-49ee-a520-8c2465a34473 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:38.073839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e37cfee-b65d-49ee-a520-8c2465a34473 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:38.387030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7510a062-7993-45f8-8770-3a2ce2d5b7bd req-d2d61ff2-4401-4e3d-ad58-2fe458382694 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52456b8d-f384-4a58-b791-76e1d1823e60", "tag": "f0f71c6c-89fd-4c19-84a5-fc4a24d78094"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:38.439770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7510a062-7993-45f8-8770-3a2ce2d5b7bd req-d2d61ff2-4401-4e3d-ad58-2fe458382694 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:38.440274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7510a062-7993-45f8-8770-3a2ce2d5b7bd req-d2d61ff2-4401-4e3d-ad58-2fe458382694 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:38.440782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7510a062-7993-45f8-8770-3a2ce2d5b7bd req-d2d61ff2-4401-4e3d-ad58-2fe458382694 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:38.504200 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7510a062-7993-45f8-8770-3a2ce2d5b7bd req-d2d61ff2-4401-4e3d-ad58-2fe458382694 service nova] Creating event network-changed:f0f71c6c-89fd-4c19-84a5-fc4a24d78094 for instance 52456b8d-f384-4a58-b791-76e1d1823e60 on n-h2-852084-10 Sep 08 13:04:38.520433 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7510a062-7993-45f8-8770-3a2ce2d5b7bd req-d2d61ff2-4401-4e3d-ad58-2fe458382694 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.294351 Sep 08 13:04:38.521446 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2001/4136] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:04:38.538467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ea7020f1-e24a-42b2-a8eb-b3c5665456e7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:38.539186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ea7020f1-e24a-42b2-a8eb-b3c5665456e7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:38.559417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea7020f1-e24a-42b2-a8eb-b3c5665456e7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:38.562120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea7020f1-e24a-42b2-a8eb-b3c5665456e7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:38.567615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea7020f1-e24a-42b2-a8eb-b3c5665456e7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:38.568985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea7020f1-e24a-42b2-a8eb-b3c5665456e7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:38.569912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea7020f1-e24a-42b2-a8eb-b3c5665456e7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:38.570879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea7020f1-e24a-42b2-a8eb-b3c5665456e7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:39.671615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8e37cfee-b65d-49ee-a520-8c2465a34473 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:39.737027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ea7020f1-e24a-42b2-a8eb-b3c5665456e7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:39.746192 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8e37cfee-b65d-49ee-a520-8c2465a34473 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 1.730381 Sep 08 13:04:39.757224 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2136/4137] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:37 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 1761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:39.780374 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ea7020f1-e24a-42b2-a8eb-b3c5665456e7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1317 microversion: 2.1 time: 1.247955 Sep 08 13:04:39.789162 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2002/4138] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:38 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1317 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:39.790992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-40859c81-1488-4fa0-bb86-7f9019e529a6 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:39.796847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-40859c81-1488-4fa0-bb86-7f9019e529a6 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:39.844178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40859c81-1488-4fa0-bb86-7f9019e529a6 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:39.845788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40859c81-1488-4fa0-bb86-7f9019e529a6 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:39.846619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40859c81-1488-4fa0-bb86-7f9019e529a6 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:39.848340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40859c81-1488-4fa0-bb86-7f9019e529a6 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:39.858285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40859c81-1488-4fa0-bb86-7f9019e529a6 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:39.865610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40859c81-1488-4fa0-bb86-7f9019e529a6 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:40.159141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40859c81-1488-4fa0-bb86-7f9019e529a6 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:40.176491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40859c81-1488-4fa0-bb86-7f9019e529a6 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:40.181249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40859c81-1488-4fa0-bb86-7f9019e529a6 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:40.185513 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-40859c81-1488-4fa0-bb86-7f9019e529a6 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.422970 Sep 08 13:04:40.187329 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2137/4139] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:39 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:40.791793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ce7bf341-1740-4286-b9fe-85b715978277 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:40.793366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ce7bf341-1740-4286-b9fe-85b715978277 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:40.853666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2485c1af-3eb9-4248-9b40-cbd209e526a2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:40.854928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2485c1af-3eb9-4248-9b40-cbd209e526a2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:40.855596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce7bf341-1740-4286-b9fe-85b715978277 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:40.858566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce7bf341-1740-4286-b9fe-85b715978277 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:40.860139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce7bf341-1740-4286-b9fe-85b715978277 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:40.861518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce7bf341-1740-4286-b9fe-85b715978277 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:40.862447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce7bf341-1740-4286-b9fe-85b715978277 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:40.863186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce7bf341-1740-4286-b9fe-85b715978277 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:40.916038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2485c1af-3eb9-4248-9b40-cbd209e526a2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:40.919349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2485c1af-3eb9-4248-9b40-cbd209e526a2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:40.921808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2485c1af-3eb9-4248-9b40-cbd209e526a2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:40.926372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2485c1af-3eb9-4248-9b40-cbd209e526a2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:40.926915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2485c1af-3eb9-4248-9b40-cbd209e526a2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:40.927547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2485c1af-3eb9-4248-9b40-cbd209e526a2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:42.076283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ce7bf341-1740-4286-b9fe-85b715978277 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:42.095267 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ce7bf341-1740-4286-b9fe-85b715978277 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 1.311446 Sep 08 13:04:42.097254 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2003/4140] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:40 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:42.111134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7dc98e41-f299-49b9-9e73-96590001f9b5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:42.131041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7dc98e41-f299-49b9-9e73-96590001f9b5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:42.165094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dc98e41-f299-49b9-9e73-96590001f9b5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:42.168771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dc98e41-f299-49b9-9e73-96590001f9b5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:42.171189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dc98e41-f299-49b9-9e73-96590001f9b5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:42.174329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dc98e41-f299-49b9-9e73-96590001f9b5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:42.175639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dc98e41-f299-49b9-9e73-96590001f9b5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:42.177934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dc98e41-f299-49b9-9e73-96590001f9b5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:42.345292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2485c1af-3eb9-4248-9b40-cbd209e526a2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:42.358347 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2485c1af-3eb9-4248-9b40-cbd209e526a2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1317 microversion: 2.1 time: 1.514430 Sep 08 13:04:42.359027 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2138/4141] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:40 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1317 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:42.390951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7dc98e41-f299-49b9-9e73-96590001f9b5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:42.409332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7dc98e41-f299-49b9-9e73-96590001f9b5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:42.412058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7dc98e41-f299-49b9-9e73-96590001f9b5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:42.414849 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7dc98e41-f299-49b9-9e73-96590001f9b5 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.314804 Sep 08 13:04:42.416027 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2004/4142] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:42 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:43.147355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aa2c85f7-7b3e-41b9-a11f-daf7b4d59534 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:43.148300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aa2c85f7-7b3e-41b9-a11f-daf7b4d59534 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:43.174411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:43.190666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa2c85f7-7b3e-41b9-a11f-daf7b4d59534 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:43.191646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa2c85f7-7b3e-41b9-a11f-daf7b4d59534 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:43.199702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa2c85f7-7b3e-41b9-a11f-daf7b4d59534 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:43.201265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa2c85f7-7b3e-41b9-a11f-daf7b4d59534 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:43.206923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa2c85f7-7b3e-41b9-a11f-daf7b4d59534 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:43.209696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa2c85f7-7b3e-41b9-a11f-daf7b4d59534 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:43.396661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0698038-4ebf-4a48-bcbb-ce65da29d3e3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:43.399130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0698038-4ebf-4a48-bcbb-ce65da29d3e3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:43.424210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0698038-4ebf-4a48-bcbb-ce65da29d3e3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:43.425240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0698038-4ebf-4a48-bcbb-ce65da29d3e3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:43.426176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0698038-4ebf-4a48-bcbb-ce65da29d3e3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:43.430971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0698038-4ebf-4a48-bcbb-ce65da29d3e3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:43.432171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0698038-4ebf-4a48-bcbb-ce65da29d3e3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:43.434728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0698038-4ebf-4a48-bcbb-ce65da29d3e3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:44.668040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aa2c85f7-7b3e-41b9-a11f-daf7b4d59534 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:44.717416 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aa2c85f7-7b3e-41b9-a11f-daf7b4d59534 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 1.574841 Sep 08 13:04:44.727127 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2139/4143] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:43 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:44.772829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-07a38492-3800-4510-a919-33f2f6fc8f20 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:44.775312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-07a38492-3800-4510-a919-33f2f6fc8f20 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:44.788408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07a38492-3800-4510-a919-33f2f6fc8f20 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:44.789671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07a38492-3800-4510-a919-33f2f6fc8f20 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:44.790740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07a38492-3800-4510-a919-33f2f6fc8f20 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:44.792066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07a38492-3800-4510-a919-33f2f6fc8f20 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:44.793151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07a38492-3800-4510-a919-33f2f6fc8f20 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:44.794340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07a38492-3800-4510-a919-33f2f6fc8f20 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:45.383973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-07a38492-3800-4510-a919-33f2f6fc8f20 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:45.435667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-07a38492-3800-4510-a919-33f2f6fc8f20 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:45.439526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-07a38492-3800-4510-a919-33f2f6fc8f20 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:45.448459 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-07a38492-3800-4510-a919-33f2f6fc8f20 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.718900 Sep 08 13:04:45.457608 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2140/4144] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:44 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:45.645557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0698038-4ebf-4a48-bcbb-ce65da29d3e3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:45.675369 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0698038-4ebf-4a48-bcbb-ce65da29d3e3 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1317 microversion: 2.1 time: 2.289131 Sep 08 13:04:45.683889 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2005/4145] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:43 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1317 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:45.765116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c354bdf1-088c-4648-bc57-8db0466c28b7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:45.766045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c354bdf1-088c-4648-bc57-8db0466c28b7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:45.778780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c354bdf1-088c-4648-bc57-8db0466c28b7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:45.779620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c354bdf1-088c-4648-bc57-8db0466c28b7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:45.780317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c354bdf1-088c-4648-bc57-8db0466c28b7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:45.787477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c354bdf1-088c-4648-bc57-8db0466c28b7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:45.789553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c354bdf1-088c-4648-bc57-8db0466c28b7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:45.790027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c354bdf1-088c-4648-bc57-8db0466c28b7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:46.482342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c354bdf1-088c-4648-bc57-8db0466c28b7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:46.506926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a2904576-1aa5-4edd-9805-45d5385d93dc tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:46.508373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a2904576-1aa5-4edd-9805-45d5385d93dc tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:46.540518 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c354bdf1-088c-4648-bc57-8db0466c28b7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 0.780978 Sep 08 13:04:46.543715 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2141/4146] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:45 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:46.551278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2904576-1aa5-4edd-9805-45d5385d93dc tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:46.552063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2904576-1aa5-4edd-9805-45d5385d93dc tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:46.552879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2904576-1aa5-4edd-9805-45d5385d93dc tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:46.554758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2904576-1aa5-4edd-9805-45d5385d93dc tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:46.555678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2904576-1aa5-4edd-9805-45d5385d93dc tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:46.556496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2904576-1aa5-4edd-9805-45d5385d93dc tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:46.718712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2fedeb91-6ccd-4316-b1a2-7b8b1513f187 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:46.724527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2fedeb91-6ccd-4316-b1a2-7b8b1513f187 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:46.756137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2fedeb91-6ccd-4316-b1a2-7b8b1513f187 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:46.761084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2fedeb91-6ccd-4316-b1a2-7b8b1513f187 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:46.762231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2fedeb91-6ccd-4316-b1a2-7b8b1513f187 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:46.765936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2fedeb91-6ccd-4316-b1a2-7b8b1513f187 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:46.768370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2fedeb91-6ccd-4316-b1a2-7b8b1513f187 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:46.772912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2fedeb91-6ccd-4316-b1a2-7b8b1513f187 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:46.860879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a2904576-1aa5-4edd-9805-45d5385d93dc tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:46.899957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a2904576-1aa5-4edd-9805-45d5385d93dc tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:46.918180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a2904576-1aa5-4edd-9805-45d5385d93dc tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:46.920547 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a2904576-1aa5-4edd-9805-45d5385d93dc tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.420918 Sep 08 13:04:46.935866 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2006/4147] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:46 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:04:46.965123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a9e17039-0d21-4ec6-afa1-140a35a79a37 req-3972c8d3-b444-4914-9df9-ce5f151e403d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52456b8d-f384-4a58-b791-76e1d1823e60", "name": "network-vif-plugged", "status": "completed", "tag": "f0f71c6c-89fd-4c19-84a5-fc4a24d78094"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:46.992727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a9e17039-0d21-4ec6-afa1-140a35a79a37 req-3972c8d3-b444-4914-9df9-ce5f151e403d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:47.004453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a9e17039-0d21-4ec6-afa1-140a35a79a37 req-3972c8d3-b444-4914-9df9-ce5f151e403d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:47.005562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a9e17039-0d21-4ec6-afa1-140a35a79a37 req-3972c8d3-b444-4914-9df9-ce5f151e403d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:47.033956 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a9e17039-0d21-4ec6-afa1-140a35a79a37 req-3972c8d3-b444-4914-9df9-ce5f151e403d service nova] Creating event network-vif-plugged:f0f71c6c-89fd-4c19-84a5-fc4a24d78094 for instance 52456b8d-f384-4a58-b791-76e1d1823e60 on n-h2-852084-10 Sep 08 13:04:47.045663 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a9e17039-0d21-4ec6-afa1-140a35a79a37 req-3972c8d3-b444-4914-9df9-ce5f151e403d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107962 Sep 08 13:04:47.061370 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2007/4148] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:04:47.312688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2fedeb91-6ccd-4316-b1a2-7b8b1513f187 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:47.326965 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2fedeb91-6ccd-4316-b1a2-7b8b1513f187 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1317 microversion: 2.1 time: 0.615665 Sep 08 13:04:47.329207 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2142/4149] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:46 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:47.589556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4b06f12c-6560-4f69-b671-e6e234507bea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:47.590283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4b06f12c-6560-4f69-b671-e6e234507bea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:47.606155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b06f12c-6560-4f69-b671-e6e234507bea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:47.606790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b06f12c-6560-4f69-b671-e6e234507bea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:47.607177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b06f12c-6560-4f69-b671-e6e234507bea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:47.610691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b06f12c-6560-4f69-b671-e6e234507bea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:47.611656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b06f12c-6560-4f69-b671-e6e234507bea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:47.612427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b06f12c-6560-4f69-b671-e6e234507bea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:47.977912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b395b9dc-98ca-4e80-a542-6b7e160d27ca tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:47.980611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b395b9dc-98ca-4e80-a542-6b7e160d27ca tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:47.994188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b395b9dc-98ca-4e80-a542-6b7e160d27ca tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:47.995362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b395b9dc-98ca-4e80-a542-6b7e160d27ca tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:47.997862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b395b9dc-98ca-4e80-a542-6b7e160d27ca tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:47.999001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b395b9dc-98ca-4e80-a542-6b7e160d27ca tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:48.000072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b395b9dc-98ca-4e80-a542-6b7e160d27ca tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:48.003326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b395b9dc-98ca-4e80-a542-6b7e160d27ca tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:48.061150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4b06f12c-6560-4f69-b671-e6e234507bea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:48.081179 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4b06f12c-6560-4f69-b671-e6e234507bea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 0.498767 Sep 08 13:04:48.087363 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2008/4150] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:47 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:48.217284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b395b9dc-98ca-4e80-a542-6b7e160d27ca tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:48.230446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b395b9dc-98ca-4e80-a542-6b7e160d27ca tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:48.233461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b395b9dc-98ca-4e80-a542-6b7e160d27ca tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:48.234792 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b395b9dc-98ca-4e80-a542-6b7e160d27ca tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.261428 Sep 08 13:04:48.237704 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2143/4151] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:47 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:48.360813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bf1366b4-c4dd-4755-b14e-7c4c86824802 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:48.362568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bf1366b4-c4dd-4755-b14e-7c4c86824802 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:48.391649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf1366b4-c4dd-4755-b14e-7c4c86824802 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:48.393516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf1366b4-c4dd-4755-b14e-7c4c86824802 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:48.394322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf1366b4-c4dd-4755-b14e-7c4c86824802 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:48.395410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf1366b4-c4dd-4755-b14e-7c4c86824802 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:48.402905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf1366b4-c4dd-4755-b14e-7c4c86824802 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:48.404000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf1366b4-c4dd-4755-b14e-7c4c86824802 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:48.865193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bf1366b4-c4dd-4755-b14e-7c4c86824802 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:48.898184 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bf1366b4-c4dd-4755-b14e-7c4c86824802 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1317 microversion: 2.1 time: 0.544483 Sep 08 13:04:48.912514 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2009/4152] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:48 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:49.141983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b62799f0-418d-4363-9990-8e79f874b7db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:49.143003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b62799f0-418d-4363-9990-8e79f874b7db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:49.163498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b62799f0-418d-4363-9990-8e79f874b7db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:49.164014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b62799f0-418d-4363-9990-8e79f874b7db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:49.164465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b62799f0-418d-4363-9990-8e79f874b7db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:49.165200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b62799f0-418d-4363-9990-8e79f874b7db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:49.165666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b62799f0-418d-4363-9990-8e79f874b7db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:49.166098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b62799f0-418d-4363-9990-8e79f874b7db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:49.300391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7a3eb219-800d-438d-9bf5-e03423ddc42e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:49.301247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7a3eb219-800d-438d-9bf5-e03423ddc42e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:49.310469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a3eb219-800d-438d-9bf5-e03423ddc42e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:49.324095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a3eb219-800d-438d-9bf5-e03423ddc42e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:49.324594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a3eb219-800d-438d-9bf5-e03423ddc42e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:49.325395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a3eb219-800d-438d-9bf5-e03423ddc42e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:49.325864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a3eb219-800d-438d-9bf5-e03423ddc42e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:49.326350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a3eb219-800d-438d-9bf5-e03423ddc42e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:49.545242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7a3eb219-800d-438d-9bf5-e03423ddc42e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:49.556339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7a3eb219-800d-438d-9bf5-e03423ddc42e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:49.557695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7a3eb219-800d-438d-9bf5-e03423ddc42e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:49.559081 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7a3eb219-800d-438d-9bf5-e03423ddc42e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.263144 Sep 08 13:04:49.563456 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2010/4153] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:49 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:49.762244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b62799f0-418d-4363-9990-8e79f874b7db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:49.778403 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b62799f0-418d-4363-9990-8e79f874b7db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 0.641444 Sep 08 13:04:49.815266 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2144/4154] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:49 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:49.931635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9614decc-2c8f-4a1e-aa43-df68ccbfc495 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:49.932692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9614decc-2c8f-4a1e-aa43-df68ccbfc495 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:49.956121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9614decc-2c8f-4a1e-aa43-df68ccbfc495 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:49.956842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9614decc-2c8f-4a1e-aa43-df68ccbfc495 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:49.957390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9614decc-2c8f-4a1e-aa43-df68ccbfc495 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:49.968467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9614decc-2c8f-4a1e-aa43-df68ccbfc495 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:49.969533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9614decc-2c8f-4a1e-aa43-df68ccbfc495 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:49.970982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9614decc-2c8f-4a1e-aa43-df68ccbfc495 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:50.256789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9614decc-2c8f-4a1e-aa43-df68ccbfc495 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:50.270356 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9614decc-2c8f-4a1e-aa43-df68ccbfc495 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1505 microversion: 2.1 time: 0.347469 Sep 08 13:04:50.275428 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2011/4155] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:49 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:50.313167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-186a231f-4a21-4b37-a568-eeaf5242b21b tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:50.318655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-186a231f-4a21-4b37-a568-eeaf5242b21b tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:50.337573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-186a231f-4a21-4b37-a568-eeaf5242b21b tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:50.338295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-186a231f-4a21-4b37-a568-eeaf5242b21b tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:50.338885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-186a231f-4a21-4b37-a568-eeaf5242b21b tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:50.339949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-186a231f-4a21-4b37-a568-eeaf5242b21b tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:50.340729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-186a231f-4a21-4b37-a568-eeaf5242b21b tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:50.341456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-186a231f-4a21-4b37-a568-eeaf5242b21b tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:50.423999 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-186a231f-4a21-4b37-a568-eeaf5242b21b tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60/ips" status: 200 len: 108 microversion: 2.1 time: 0.115728 Sep 08 13:04:50.424935 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2145/4156] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 13:04:50 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60/ips => generated 108 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:04:50.445332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-556d8e24-d2b1-4f38-ab50-37833ba1a6a7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:50.446278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-556d8e24-d2b1-4f38-ab50-37833ba1a6a7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:50.461690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-556d8e24-d2b1-4f38-ab50-37833ba1a6a7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:50.463162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-556d8e24-d2b1-4f38-ab50-37833ba1a6a7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:50.478423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-556d8e24-d2b1-4f38-ab50-37833ba1a6a7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:50.480660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-556d8e24-d2b1-4f38-ab50-37833ba1a6a7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:50.481742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-556d8e24-d2b1-4f38-ab50-37833ba1a6a7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:50.482645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-556d8e24-d2b1-4f38-ab50-37833ba1a6a7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:50.540848 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-556d8e24-d2b1-4f38-ab50-37833ba1a6a7 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60/ips" status: 200 len: 108 microversion: 2.1 time: 0.103409 Sep 08 13:04:50.543688 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2012/4157] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 13:04:50 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60/ips => generated 108 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:04:50.561144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ab95fd77-0cde-45ab-b64f-da2e138ee342 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:50.562121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ab95fd77-0cde-45ab-b64f-da2e138ee342 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:50.590919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab95fd77-0cde-45ab-b64f-da2e138ee342 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:50.592036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab95fd77-0cde-45ab-b64f-da2e138ee342 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:50.594729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab95fd77-0cde-45ab-b64f-da2e138ee342 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:50.596331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab95fd77-0cde-45ab-b64f-da2e138ee342 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:50.598154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab95fd77-0cde-45ab-b64f-da2e138ee342 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:50.599269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab95fd77-0cde-45ab-b64f-da2e138ee342 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:50.620161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b530e94-2d75-49e7-b0c2-985997b71f63 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:50.624639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1b530e94-2d75-49e7-b0c2-985997b71f63 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:50.656381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b530e94-2d75-49e7-b0c2-985997b71f63 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:50.657867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b530e94-2d75-49e7-b0c2-985997b71f63 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:50.669672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b530e94-2d75-49e7-b0c2-985997b71f63 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:50.676011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b530e94-2d75-49e7-b0c2-985997b71f63 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:50.677748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b530e94-2d75-49e7-b0c2-985997b71f63 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:50.680982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b530e94-2d75-49e7-b0c2-985997b71f63 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:50.716164 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ab95fd77-0cde-45ab-b64f-da2e138ee342 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60/ips/tempest-ServerAddressesTestJSON-126178361-network" status: 200 len: 93 microversion: 2.1 time: 0.162726 Sep 08 13:04:50.732432 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2146/4158] 10.222.0.78 () {58 vars in 1398 bytes} [Thu Sep 8 13:04:50 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60/ips/tempest-ServerAddressesTestJSON-126178361-network => generated 93 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 13:04:50.758754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:50.758990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a0b40f65-f5d3-49d4-b359-59a21646d7c9 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:50.765780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a0b40f65-f5d3-49d4-b359-59a21646d7c9 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:50.797538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b40f65-f5d3-49d4-b359-59a21646d7c9 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:50.798664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b40f65-f5d3-49d4-b359-59a21646d7c9 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:50.800607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b40f65-f5d3-49d4-b359-59a21646d7c9 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:50.806184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b40f65-f5d3-49d4-b359-59a21646d7c9 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:50.810504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b40f65-f5d3-49d4-b359-59a21646d7c9 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:50.811613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0b40f65-f5d3-49d4-b359-59a21646d7c9 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:50.869266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a0b40f65-f5d3-49d4-b359-59a21646d7c9 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:04:51.029692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1b530e94-2d75-49e7-b0c2-985997b71f63 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:51.048999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1b530e94-2d75-49e7-b0c2-985997b71f63 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:51.059022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1b530e94-2d75-49e7-b0c2-985997b71f63 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:51.065086 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1b530e94-2d75-49e7-b0c2-985997b71f63 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.459047 Sep 08 13:04:51.067837 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2013/4159] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:50 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:51.078958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0aab2a52-d71f-45f0-9781-cec4c600af6c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:51.084762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0aab2a52-d71f-45f0-9781-cec4c600af6c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:51.104372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0aab2a52-d71f-45f0-9781-cec4c600af6c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:51.105041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0aab2a52-d71f-45f0-9781-cec4c600af6c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:51.105620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0aab2a52-d71f-45f0-9781-cec4c600af6c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:51.106981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0aab2a52-d71f-45f0-9781-cec4c600af6c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:51.111379 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a0b40f65-f5d3-49d4-b359-59a21646d7c9 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "DELETE /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 204 len: 0 microversion: 2.1 time: 0.375059 Sep 08 13:04:51.112989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0aab2a52-d71f-45f0-9781-cec4c600af6c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:51.117900 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2147/4160] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:04:50 2022] DELETE /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:04:51.120717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0aab2a52-d71f-45f0-9781-cec4c600af6c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:51.143454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5f763d7c-4798-4739-ae18-b64d334f9ace tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:51.146540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5f763d7c-4798-4739-ae18-b64d334f9ace tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:51.167210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f763d7c-4798-4739-ae18-b64d334f9ace tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:51.169061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f763d7c-4798-4739-ae18-b64d334f9ace tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:51.170366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f763d7c-4798-4739-ae18-b64d334f9ace tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:51.172382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f763d7c-4798-4739-ae18-b64d334f9ace tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:51.176070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f763d7c-4798-4739-ae18-b64d334f9ace tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:51.177089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f763d7c-4798-4739-ae18-b64d334f9ace tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:51.744060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0aab2a52-d71f-45f0-9781-cec4c600af6c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:51.773549 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0aab2a52-d71f-45f0-9781-cec4c600af6c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 0.703852 Sep 08 13:04:51.776331 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2014/4161] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:51 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:51.858084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5f763d7c-4798-4739-ae18-b64d334f9ace tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:51.872007 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5f763d7c-4798-4739-ae18-b64d334f9ace tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1511 microversion: 2.1 time: 0.749386 Sep 08 13:04:51.873729 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2148/4162] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:51 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1511 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:52.127818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63414dbe-2951-4c2a-8ec7-855d337b2310 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:52.129119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-63414dbe-2951-4c2a-8ec7-855d337b2310 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:52.179341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63414dbe-2951-4c2a-8ec7-855d337b2310 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:52.181475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63414dbe-2951-4c2a-8ec7-855d337b2310 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:52.182816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63414dbe-2951-4c2a-8ec7-855d337b2310 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:52.184046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63414dbe-2951-4c2a-8ec7-855d337b2310 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:52.186003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63414dbe-2951-4c2a-8ec7-855d337b2310 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:52.186870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63414dbe-2951-4c2a-8ec7-855d337b2310 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:52.299641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-63414dbe-2951-4c2a-8ec7-855d337b2310 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:52.312049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-63414dbe-2951-4c2a-8ec7-855d337b2310 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:52.313853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-63414dbe-2951-4c2a-8ec7-855d337b2310 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:52.315409 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-63414dbe-2951-4c2a-8ec7-855d337b2310 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.195212 Sep 08 13:04:52.317249 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2015/4163] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:52 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:52.820857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d975186b-e283-4e4c-a771-00a0ff5bd0a7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:52.821493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d975186b-e283-4e4c-a771-00a0ff5bd0a7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:52.839292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d975186b-e283-4e4c-a771-00a0ff5bd0a7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:52.839988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d975186b-e283-4e4c-a771-00a0ff5bd0a7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:52.840579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d975186b-e283-4e4c-a771-00a0ff5bd0a7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:52.852547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d975186b-e283-4e4c-a771-00a0ff5bd0a7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:52.854412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d975186b-e283-4e4c-a771-00a0ff5bd0a7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:52.855062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d975186b-e283-4e4c-a771-00a0ff5bd0a7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:52.916893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e35c89f2-fa76-459d-aaec-6e92d1af61dd tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:52.918406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e35c89f2-fa76-459d-aaec-6e92d1af61dd tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:52.946008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e35c89f2-fa76-459d-aaec-6e92d1af61dd tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:52.952617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e35c89f2-fa76-459d-aaec-6e92d1af61dd tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:52.961511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e35c89f2-fa76-459d-aaec-6e92d1af61dd tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:52.964886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e35c89f2-fa76-459d-aaec-6e92d1af61dd tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:52.969483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e35c89f2-fa76-459d-aaec-6e92d1af61dd tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:52.987498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e35c89f2-fa76-459d-aaec-6e92d1af61dd tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:53.796910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e35c89f2-fa76-459d-aaec-6e92d1af61dd tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:53.818133 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e35c89f2-fa76-459d-aaec-6e92d1af61dd tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1511 microversion: 2.1 time: 0.906163 Sep 08 13:04:53.827875 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2016/4164] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:52 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1511 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:53.836686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f32440d1-83b0-4cb0-aaa5-a71a1e6eaf27 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:53.837902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f32440d1-83b0-4cb0-aaa5-a71a1e6eaf27 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:53.861260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f32440d1-83b0-4cb0-aaa5-a71a1e6eaf27 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:53.862216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f32440d1-83b0-4cb0-aaa5-a71a1e6eaf27 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:53.863802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f32440d1-83b0-4cb0-aaa5-a71a1e6eaf27 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:53.865953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d975186b-e283-4e4c-a771-00a0ff5bd0a7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:53.869620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:04:53.870206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f32440d1-83b0-4cb0-aaa5-a71a1e6eaf27 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:53.875173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f32440d1-83b0-4cb0-aaa5-a71a1e6eaf27 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:53.879331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f32440d1-83b0-4cb0-aaa5-a71a1e6eaf27 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:53.894007 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d975186b-e283-4e4c-a771-00a0ff5bd0a7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1523 microversion: 2.1 time: 1.079719 Sep 08 13:04:53.912067 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2149/4165] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:52 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1523 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:54.078697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f32440d1-83b0-4cb0-aaa5-a71a1e6eaf27 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:54.100660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f32440d1-83b0-4cb0-aaa5-a71a1e6eaf27 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:54.103032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f32440d1-83b0-4cb0-aaa5-a71a1e6eaf27 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:54.110101 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f32440d1-83b0-4cb0-aaa5-a71a1e6eaf27 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.279475 Sep 08 13:04:54.110936 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2017/4166] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:53 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:54.457279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-67136ee2-cfaf-4110-8ab9-17fdacccdba1 req-cbcf8119-c017-414f-9b05-154252009171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52456b8d-f384-4a58-b791-76e1d1823e60", "name": "network-vif-deleted", "tag": "f0f71c6c-89fd-4c19-84a5-fc4a24d78094"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:54.510753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-67136ee2-cfaf-4110-8ab9-17fdacccdba1 req-cbcf8119-c017-414f-9b05-154252009171 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:54.516474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-67136ee2-cfaf-4110-8ab9-17fdacccdba1 req-cbcf8119-c017-414f-9b05-154252009171 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:54.517612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-67136ee2-cfaf-4110-8ab9-17fdacccdba1 req-cbcf8119-c017-414f-9b05-154252009171 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:54.556211 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-67136ee2-cfaf-4110-8ab9-17fdacccdba1 req-cbcf8119-c017-414f-9b05-154252009171 service nova] Creating event network-vif-deleted:f0f71c6c-89fd-4c19-84a5-fc4a24d78094 for instance 52456b8d-f384-4a58-b791-76e1d1823e60 on n-h2-852084-10 Sep 08 13:04:54.565643 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-67136ee2-cfaf-4110-8ab9-17fdacccdba1 req-cbcf8119-c017-414f-9b05-154252009171 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122481 Sep 08 13:04:54.577772 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2150/4167] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:04:54.856432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:54.857152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:54.878384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:54.879720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:54.880588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:54.881993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:54.883083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:54.887850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:54.955382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bbd3f26f-8573-47cd-903b-de56ab6c737e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:54.958542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bbd3f26f-8573-47cd-903b-de56ab6c737e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:54.977472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:54.977976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:54.978428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:54.978904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lazy-loading 'fault' on Instance uuid 52456b8d-f384-4a58-b791-76e1d1823e60 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:04:55.013376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd3f26f-8573-47cd-903b-de56ab6c737e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:55.014168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd3f26f-8573-47cd-903b-de56ab6c737e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:55.014618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd3f26f-8573-47cd-903b-de56ab6c737e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:55.015733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd3f26f-8573-47cd-903b-de56ab6c737e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:55.016579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd3f26f-8573-47cd-903b-de56ab6c737e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:55.028005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd3f26f-8573-47cd-903b-de56ab6c737e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:55.086378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17d2908ffdea41d6a47a7a9362a1b291', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f0e5bc4ae2e4015bd4ac57c3f9e97fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:55.105249 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c368e2de-9565-45c2-9317-bd25e657b6e2 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 200 len: 1307 microversion: 2.1 time: 0.251556 Sep 08 13:04:55.117871 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2018/4168] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:54 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 1307 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:55.177140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dc9f65d8-a3ac-4efd-91be-797f1277abcf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:55.178356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dc9f65d8-a3ac-4efd-91be-797f1277abcf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:55.191418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc9f65d8-a3ac-4efd-91be-797f1277abcf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:55.196846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc9f65d8-a3ac-4efd-91be-797f1277abcf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:55.198993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc9f65d8-a3ac-4efd-91be-797f1277abcf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:55.200381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc9f65d8-a3ac-4efd-91be-797f1277abcf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:55.200573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc9f65d8-a3ac-4efd-91be-797f1277abcf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:55.201011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc9f65d8-a3ac-4efd-91be-797f1277abcf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:55.270655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bbd3f26f-8573-47cd-903b-de56ab6c737e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:55.287067 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bbd3f26f-8573-47cd-903b-de56ab6c737e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1503 microversion: 2.1 time: 0.345754 Sep 08 13:04:55.289666 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2151/4169] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:54 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1503 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:55.333594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2ba8997d-67c1-46cf-80c7-c362b7adf2dc tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:55.337207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2ba8997d-67c1-46cf-80c7-c362b7adf2dc tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:55.348746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dc9f65d8-a3ac-4efd-91be-797f1277abcf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:55.362475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dc9f65d8-a3ac-4efd-91be-797f1277abcf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:55.364746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dc9f65d8-a3ac-4efd-91be-797f1277abcf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:55.367541 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dc9f65d8-a3ac-4efd-91be-797f1277abcf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.197313 Sep 08 13:04:55.379361 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2019/4170] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:55 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:55.379563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ba8997d-67c1-46cf-80c7-c362b7adf2dc tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:55.379563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ba8997d-67c1-46cf-80c7-c362b7adf2dc tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:55.383741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ba8997d-67c1-46cf-80c7-c362b7adf2dc tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:55.386643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ba8997d-67c1-46cf-80c7-c362b7adf2dc tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:55.390689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ba8997d-67c1-46cf-80c7-c362b7adf2dc tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:55.391979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ba8997d-67c1-46cf-80c7-c362b7adf2dc tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:55.795011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2ba8997d-67c1-46cf-80c7-c362b7adf2dc tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:55.814758 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2ba8997d-67c1-46cf-80c7-c362b7adf2dc tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1516 microversion: 2.1 time: 0.488475 Sep 08 13:04:55.823458 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2152/4171] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:55 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1516 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:04:55.875408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7d8ded7d-6c4b-4414-bef6-0b39f2a28ce4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:55.883444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7d8ded7d-6c4b-4414-bef6-0b39f2a28ce4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: c742a13a-31e5-41f6-87ab-325236709290] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:55.905697 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-7d8ded7d-6c4b-4414-bef6-0b39f2a28ce4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] HTTP exception thrown: Instance c742a13a-31e5-41f6-87ab-325236709290 could not be found. Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7d8ded7d-6c4b-4414-bef6-0b39f2a28ce4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Request method failure captured: Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/c742a13a-31e5-41f6-87ab-325236709290/action HTTP/1.1 Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 14 Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGegpHo3QYXwAmCN_OctsdmztHN8ts294yLUiw-Ms0Kk7EQY0XfuiDYH7wh8eQztYQYLofweMgdtwuLtrJuTvgGQNr7mGfBgIxtE0szoBUmvKc-BEHBhV8QiE_SJULNZI6czSRqo3YxgC4OeYllmJxk1yJEFxr_qKCUPtZ26YlP53grs Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 0d312121b259412dbf82c519a49285f4 Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: {"rescue": {}} Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance c742a13a-31e5-41f6-87ab-325236709290 could not be found. Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'c742a13a-31e5-41f6-87ab-325236709290', 'body': {'rescue': {}}} Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c742a13a-31e5-41f6-87ab-325236709290 could not be found. Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c742a13a-31e5-41f6-87ab-325236709290 could not be found. Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:55.926014 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:55.932847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:55.932847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:55.932847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:04:55.932847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:04:55.932847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c742a13a-31e5-41f6-87ab-325236709290 could not be found. Sep 08 13:04:55.932847 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:55.934186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7d8ded7d-6c4b-4414-bef6-0b39f2a28ce4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Returning 404 to user: Instance c742a13a-31e5-41f6-87ab-325236709290 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:04:55.942164 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7d8ded7d-6c4b-4414-bef6-0b39f2a28ce4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/c742a13a-31e5-41f6-87ab-325236709290/action" status: 404 len: 111 microversion: 2.1 time: 0.073737 Sep 08 13:04:55.943130 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2020/4172] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:04:55 2022] POST /compute/v2.1/servers/c742a13a-31e5-41f6-87ab-325236709290/action => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:04:55.965576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8134ad6e-11bf-4800-a916-fe2eacf00d3a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:55.967081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8134ad6e-11bf-4800-a916-fe2eacf00d3a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:56.001990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8134ad6e-11bf-4800-a916-fe2eacf00d3a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:56.003348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8134ad6e-11bf-4800-a916-fe2eacf00d3a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:56.008358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8134ad6e-11bf-4800-a916-fe2eacf00d3a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:56.011083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8134ad6e-11bf-4800-a916-fe2eacf00d3a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:56.012373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8134ad6e-11bf-4800-a916-fe2eacf00d3a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:56.024380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8134ad6e-11bf-4800-a916-fe2eacf00d3a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:56.142305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c1242ec9-ee6f-40b0-9ab8-d92f0bc29cf0 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:56.143132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c1242ec9-ee6f-40b0-9ab8-d92f0bc29cf0 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] [instance: 52456b8d-f384-4a58-b791-76e1d1823e60] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:56.164733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c1242ec9-ee6f-40b0-9ab8-d92f0bc29cf0 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:56.165257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c1242ec9-ee6f-40b0-9ab8-d92f0bc29cf0 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:56.165735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c1242ec9-ee6f-40b0-9ab8-d92f0bc29cf0 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:56.166507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c1242ec9-ee6f-40b0-9ab8-d92f0bc29cf0 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:56.170992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c1242ec9-ee6f-40b0-9ab8-d92f0bc29cf0 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:56.171504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c1242ec9-ee6f-40b0-9ab8-d92f0bc29cf0 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:56.213590 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-c1242ec9-ee6f-40b0-9ab8-d92f0bc29cf0 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] HTTP exception thrown: Instance 52456b8d-f384-4a58-b791-76e1d1823e60 could not be found. Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c1242ec9-ee6f-40b0-9ab8-d92f0bc29cf0 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Request method failure captured: Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 HTTP/1.1 Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGehUeQonBp0FW75QamFy0Q0gJ-Is8g_rkdAdz3wIY0STvJdzvkpQu68rgxX4wxfw5mKsjdACSglNjybrpAYeJLpFNby7aNd-AOSvBrzSnL6ofbA7g7YnSGpx-bYdDrb3QxBcR0sSOvJoFwvn1CLu60aDN0QLCFPqybdWtX-O-nnwyKM Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 8f0e5bc4ae2e4015bd4ac57c3f9e97fc Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerAddressesTestJSON-613470730 Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8f0e5bc4ae2e4015bd4ac57c3f9e97fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8f0e5bc4ae2e4015bd4ac57c3f9e97fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8f0e5bc4ae2e4015bd4ac57c3f9e97fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8f0e5bc4ae2e4015bd4ac57c3f9e97fc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerAddressesTestJSON-613470730 Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 8f0e5bc4ae2e4015bd4ac57c3f9e97fc Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerAddressesTestJSON-613470730 Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerAddressesTestJSON-613470730-project Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 17d2908ffdea41d6a47a7a9362a1b291 Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerAddressesTestJSON-613470730-project Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 52456b8d-f384-4a58-b791-76e1d1823e60 could not be found. Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '52456b8d-f384-4a58-b791-76e1d1823e60'} Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52456b8d-f384-4a58-b791-76e1d1823e60 could not be found. Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52456b8d-f384-4a58-b791-76e1d1823e60 could not be found. Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:56.222129 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:56.227073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:56.227073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:56.227073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:56.227073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:04:56.227073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:04:56.227073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52456b8d-f384-4a58-b791-76e1d1823e60 could not be found. Sep 08 13:04:56.227073 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:04:56.227073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c1242ec9-ee6f-40b0-9ab8-d92f0bc29cf0 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] Returning 404 to user: Instance 52456b8d-f384-4a58-b791-76e1d1823e60 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:04:56.227073 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c1242ec9-ee6f-40b0-9ab8-d92f0bc29cf0 tempest-ServerAddressesTestJSON-613470730 tempest-ServerAddressesTestJSON-613470730-project] 10.222.0.78 "GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60" status: 404 len: 111 microversion: 2.1 time: 0.088233 Sep 08 13:04:56.227762 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2021/4173] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:56 2022] GET /compute/v2.1/servers/52456b8d-f384-4a58-b791-76e1d1823e60 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:04:56.290709 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8134ad6e-11bf-4800-a916-fe2eacf00d3a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/action" status: 202 len: 0 microversion: 2.1 time: 0.334752 Sep 08 13:04:56.295201 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2153/4174] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:04:55 2022] POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:04:56.305320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-35ff44cb-5029-4236-9435-1c11e5cf9d08 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:56.306579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-35ff44cb-5029-4236-9435-1c11e5cf9d08 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:56.329136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35ff44cb-5029-4236-9435-1c11e5cf9d08 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:56.344852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35ff44cb-5029-4236-9435-1c11e5cf9d08 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:56.351686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35ff44cb-5029-4236-9435-1c11e5cf9d08 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:56.352602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35ff44cb-5029-4236-9435-1c11e5cf9d08 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:56.358481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35ff44cb-5029-4236-9435-1c11e5cf9d08 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:56.360258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-35ff44cb-5029-4236-9435-1c11e5cf9d08 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:56.425907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca71a270-64a7-41ab-a973-e7eb8f308717 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:56.452459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ca71a270-64a7-41ab-a973-e7eb8f308717 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:56.505654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca71a270-64a7-41ab-a973-e7eb8f308717 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:56.511327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca71a270-64a7-41ab-a973-e7eb8f308717 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:56.513679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca71a270-64a7-41ab-a973-e7eb8f308717 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:56.518015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca71a270-64a7-41ab-a973-e7eb8f308717 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:56.518908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca71a270-64a7-41ab-a973-e7eb8f308717 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:56.524569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca71a270-64a7-41ab-a973-e7eb8f308717 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:57.125995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ca71a270-64a7-41ab-a973-e7eb8f308717 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:57.152277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ca71a270-64a7-41ab-a973-e7eb8f308717 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:57.155999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ca71a270-64a7-41ab-a973-e7eb8f308717 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:57.162993 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca71a270-64a7-41ab-a973-e7eb8f308717 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1406 microversion: 2.54 time: 0.758634 Sep 08 13:04:57.180805 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2154/4175] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:56 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1406 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:57.264969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-35ff44cb-5029-4236-9435-1c11e5cf9d08 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:57.284788 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-35ff44cb-5029-4236-9435-1c11e5cf9d08 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1521 microversion: 2.1 time: 0.984074 Sep 08 13:04:57.298512 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2022/4176] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:56 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1521 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:58.226446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-90c5da5c-ca1a-42ce-b996-028ddde74141 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:58.239203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-90c5da5c-ca1a-42ce-b996-028ddde74141 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:58.258053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90c5da5c-ca1a-42ce-b996-028ddde74141 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:58.266474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90c5da5c-ca1a-42ce-b996-028ddde74141 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:58.267808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90c5da5c-ca1a-42ce-b996-028ddde74141 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:58.269451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90c5da5c-ca1a-42ce-b996-028ddde74141 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:58.270618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90c5da5c-ca1a-42ce-b996-028ddde74141 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:58.272013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90c5da5c-ca1a-42ce-b996-028ddde74141 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:58.324378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d45b65d-041e-429d-87e8-a7a202e2fcba tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:58.330406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1d45b65d-041e-429d-87e8-a7a202e2fcba tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:58.356221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d45b65d-041e-429d-87e8-a7a202e2fcba tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:58.361933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d45b65d-041e-429d-87e8-a7a202e2fcba tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:58.363150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d45b65d-041e-429d-87e8-a7a202e2fcba tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:58.364944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d45b65d-041e-429d-87e8-a7a202e2fcba tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:58.372055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d45b65d-041e-429d-87e8-a7a202e2fcba tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:58.373602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d45b65d-041e-429d-87e8-a7a202e2fcba tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:58.641450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-90c5da5c-ca1a-42ce-b996-028ddde74141 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:58.694948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-90c5da5c-ca1a-42ce-b996-028ddde74141 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:58.702245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-90c5da5c-ca1a-42ce-b996-028ddde74141 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:58.710888 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-90c5da5c-ca1a-42ce-b996-028ddde74141 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1412 microversion: 2.54 time: 0.494208 Sep 08 13:04:58.716958 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2155/4177] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:58 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1412 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:04:59.160980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1d45b65d-041e-429d-87e8-a7a202e2fcba tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:04:59.190117 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1d45b65d-041e-429d-87e8-a7a202e2fcba tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1501 microversion: 2.1 time: 0.873918 Sep 08 13:04:59.199743 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2023/4178] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:58 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1501 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:04:59.226431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:59.230589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:59.246418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:59.247775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:59.248850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:59.250446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:59.251694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:59.252645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:59.345039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lazy-loading 'flavor' on Instance uuid 4fd2a7c5-18a2-4270-9e76-c5725415c55c {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:04:59.368917 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] HTTP exception thrown: Cannot 'rescue' instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c while it is in vm_state paused Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Request method failure captured: Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/action HTTP/1.1 Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 14 Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGegpHo3QYXwAmCN_OctsdmztHN8ts294yLUiw-Ms0Kk7EQY0XfuiDYH7wh8eQztYQYLofweMgdtwuLtrJuTvgGQNr7mGfBgIxtE0szoBUmvKc-BEHBhV8QiE_SJULNZI6czSRqo3YxgC4OeYllmJxk1yJEFxr_qKCUPtZ26YlP53grs Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 0d312121b259412dbf82c519a49285f4 Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: {"rescue": {}} Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: exception: Cannot 'rescue' instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c while it is in vm_state paused Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '4fd2a7c5-18a2-4270-9e76-c5725415c55c', 'body': {'rescue': {}}} Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c in vm_state paused. Cannot rescue while the instance is in this state. Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c while it is in vm_state paused Sep 08 13:04:59.371811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:59.378444 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:04:59.378444 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:59.378444 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:04:59.378444 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:04:59.378444 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:04:59.378444 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:04:59.378444 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:04:59.378444 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c while it is in vm_state paused Sep 08 13:04:59.378444 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:04:59.383054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Returning 409 to user: Cannot 'rescue' instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c while it is in vm_state paused {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:04:59.385650 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f048c3a-2d0b-4aca-afa9-b96d76af9f46 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/action" status: 409 len: 144 microversion: 2.1 time: 0.165234 Sep 08 13:04:59.392200 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2156/4179] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:04:59 2022] POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/action => generated 144 bytes in 172 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:04:59.401235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bde159ad-d8d6-4d19-b848-ee613f36f777 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:04:59.411603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bde159ad-d8d6-4d19-b848-ee613f36f777 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:59.434311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bde159ad-d8d6-4d19-b848-ee613f36f777 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:59.438894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bde159ad-d8d6-4d19-b848-ee613f36f777 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:59.440269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bde159ad-d8d6-4d19-b848-ee613f36f777 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:59.442779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bde159ad-d8d6-4d19-b848-ee613f36f777 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:59.450733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bde159ad-d8d6-4d19-b848-ee613f36f777 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:59.452497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bde159ad-d8d6-4d19-b848-ee613f36f777 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:59.665573 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bde159ad-d8d6-4d19-b848-ee613f36f777 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/action" status: 202 len: 0 microversion: 2.1 time: 0.271585 Sep 08 13:04:59.667811 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2024/4180] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:04:59 2022] POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:04:59.679011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-166ac388-54b9-4ea3-b3bc-81260357d1a4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:59.680203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-166ac388-54b9-4ea3-b3bc-81260357d1a4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:59.707436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-166ac388-54b9-4ea3-b3bc-81260357d1a4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:59.719489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-166ac388-54b9-4ea3-b3bc-81260357d1a4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:59.720672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-166ac388-54b9-4ea3-b3bc-81260357d1a4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:59.727506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-166ac388-54b9-4ea3-b3bc-81260357d1a4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:59.732929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-166ac388-54b9-4ea3-b3bc-81260357d1a4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:59.733744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-166ac388-54b9-4ea3-b3bc-81260357d1a4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:59.784870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38c4fce1-465b-4dd5-9090-a922bbe25e66 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:04:59.789894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-38c4fce1-465b-4dd5-9090-a922bbe25e66 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:04:59.815112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38c4fce1-465b-4dd5-9090-a922bbe25e66 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:59.826092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38c4fce1-465b-4dd5-9090-a922bbe25e66 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:59.828100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38c4fce1-465b-4dd5-9090-a922bbe25e66 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:04:59.830580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38c4fce1-465b-4dd5-9090-a922bbe25e66 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:04:59.832450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38c4fce1-465b-4dd5-9090-a922bbe25e66 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:04:59.834931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38c4fce1-465b-4dd5-9090-a922bbe25e66 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:00.656730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38c4fce1-465b-4dd5-9090-a922bbe25e66 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:00.703630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38c4fce1-465b-4dd5-9090-a922bbe25e66 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:00.707061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38c4fce1-465b-4dd5-9090-a922bbe25e66 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:00.710047 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38c4fce1-465b-4dd5-9090-a922bbe25e66 tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1397 microversion: 2.54 time: 0.946866 Sep 08 13:05:00.711682 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2025/4181] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:04:59 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1397 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:00.763762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5fb304b2-e9eb-4c7d-b3de-438cecc467da tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '.version_select at 0x7fdb3f0bf040>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:00.786549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=64 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:00.808622 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5fb304b2-e9eb-4c7d-b3de-438cecc467da tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-177875696" status: 204 len: 0 microversion: 2.54 time: 0.053753 Sep 08 13:05:00.811544 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2026/4182] 10.222.0.78 () {60 vars in 1316 bytes} [Thu Sep 8 13:05:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-177875696 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:05:00.846880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3acd2503-fc7c-48e2-a904-b957e0a24e3a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:00.848406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3acd2503-fc7c-48e2-a904-b957e0a24e3a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:00.863962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3acd2503-fc7c-48e2-a904-b957e0a24e3a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:00.865110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3acd2503-fc7c-48e2-a904-b957e0a24e3a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:00.865110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3acd2503-fc7c-48e2-a904-b957e0a24e3a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:00.873372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3acd2503-fc7c-48e2-a904-b957e0a24e3a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:00.874116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3acd2503-fc7c-48e2-a904-b957e0a24e3a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:00.874785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3acd2503-fc7c-48e2-a904-b957e0a24e3a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:00.959761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3acd2503-fc7c-48e2-a904-b957e0a24e3a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:05:01.269849 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3acd2503-fc7c-48e2-a904-b957e0a24e3a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "DELETE /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 204 len: 0 microversion: 2.54 time: 0.437010 Sep 08 13:05:01.275490 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2027/4183] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:05:00 2022] DELETE /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:05:01.310336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-543e3f41-ff4d-48f8-be19-c8a73d9578bf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:01.311424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-543e3f41-ff4d-48f8-be19-c8a73d9578bf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:01.324728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-166ac388-54b9-4ea3-b3bc-81260357d1a4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:01.328199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-543e3f41-ff4d-48f8-be19-c8a73d9578bf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:01.328921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-543e3f41-ff4d-48f8-be19-c8a73d9578bf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:01.332497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-543e3f41-ff4d-48f8-be19-c8a73d9578bf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:01.333656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-543e3f41-ff4d-48f8-be19-c8a73d9578bf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:01.340442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-543e3f41-ff4d-48f8-be19-c8a73d9578bf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:01.341185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-543e3f41-ff4d-48f8-be19-c8a73d9578bf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:01.405804 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-166ac388-54b9-4ea3-b3bc-81260357d1a4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1508 microversion: 2.1 time: 1.723606 Sep 08 13:05:01.406669 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2157/4184] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:04:59 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1508 bytes in 1735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:05:01.661963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-543e3f41-ff4d-48f8-be19-c8a73d9578bf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:01.711941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-543e3f41-ff4d-48f8-be19-c8a73d9578bf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:01.716384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-543e3f41-ff4d-48f8-be19-c8a73d9578bf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:01.719136 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-543e3f41-ff4d-48f8-be19-c8a73d9578bf tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1403 microversion: 2.54 time: 0.429373 Sep 08 13:05:01.721113 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2028/4185] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:01 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1403 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:02.455716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-93ccbceb-515d-4251-b527-75b7655b5fcb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:02.459742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-93ccbceb-515d-4251-b527-75b7655b5fcb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:02.531067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ccbceb-515d-4251-b527-75b7655b5fcb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:02.532236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ccbceb-515d-4251-b527-75b7655b5fcb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:02.533147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ccbceb-515d-4251-b527-75b7655b5fcb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:02.536229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ccbceb-515d-4251-b527-75b7655b5fcb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:02.542387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ccbceb-515d-4251-b527-75b7655b5fcb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:02.543756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ccbceb-515d-4251-b527-75b7655b5fcb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:02.781004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a3dd18f0-a2c6-47f1-ad17-fb9ce6004c5a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:02.788155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a3dd18f0-a2c6-47f1-ad17-fb9ce6004c5a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:02.820164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3dd18f0-a2c6-47f1-ad17-fb9ce6004c5a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:02.821099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3dd18f0-a2c6-47f1-ad17-fb9ce6004c5a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:02.821934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3dd18f0-a2c6-47f1-ad17-fb9ce6004c5a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:02.823425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3dd18f0-a2c6-47f1-ad17-fb9ce6004c5a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:02.828314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3dd18f0-a2c6-47f1-ad17-fb9ce6004c5a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:02.836674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3dd18f0-a2c6-47f1-ad17-fb9ce6004c5a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:03.150143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a3dd18f0-a2c6-47f1-ad17-fb9ce6004c5a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:03.184273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:03.197313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a3dd18f0-a2c6-47f1-ad17-fb9ce6004c5a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:03.202251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a3dd18f0-a2c6-47f1-ad17-fb9ce6004c5a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:03.203317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-93ccbceb-515d-4251-b527-75b7655b5fcb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:03.207258 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a3dd18f0-a2c6-47f1-ad17-fb9ce6004c5a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1403 microversion: 2.54 time: 0.436063 Sep 08 13:05:03.209582 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2029/4186] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:02 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1403 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:03.228583 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-93ccbceb-515d-4251-b527-75b7655b5fcb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1516 microversion: 2.1 time: 0.793343 Sep 08 13:05:03.246850 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2158/4187] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:02 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1516 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:04.262790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:04.267042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:04.324005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:04.324978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:04.325887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:04.327289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:04.328151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:04.328931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:04.512241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:04.512995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:04.515296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:04.516904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lazy-loading 'fault' on Instance uuid 846e6149-d671-4e2d-acfa-f512e1ac28cc {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:05:04.584499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-322390196", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "0fb492f5-9ba9-40dd-a160-14170b8ef23d"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:04.697408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:04.726801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:04.737128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '09e8b16ab90c47f6881bde461a1ee1b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbcff02e6dbb4abab905684dbd0ab097', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:04.774421 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-335a5187-6012-4081-99c3-99045dc9ba2a tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 200 len: 1408 microversion: 2.54 time: 0.493798 Sep 08 13:05:04.776959 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2159/4188] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:04 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 1408 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:05:04.874428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] validate_networks() for [('0fb492f5-9ba9-40dd-a160-14170b8ef23d', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:05:05.840890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-42044577-4874-4477-8e36-cde26d85616e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:05.842140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-42044577-4874-4477-8e36-cde26d85616e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] [instance: 846e6149-d671-4e2d-acfa-f512e1ac28cc] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:05.892397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42044577-4874-4477-8e36-cde26d85616e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:05.894558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42044577-4874-4477-8e36-cde26d85616e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:05.894558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42044577-4874-4477-8e36-cde26d85616e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:05.899218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42044577-4874-4477-8e36-cde26d85616e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:05.899218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42044577-4874-4477-8e36-cde26d85616e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:05.899218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42044577-4874-4477-8e36-cde26d85616e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:05.964441 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-42044577-4874-4477-8e36-cde26d85616e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] HTTP exception thrown: Instance 846e6149-d671-4e2d-acfa-f512e1ac28cc could not be found. Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-42044577-4874-4477-8e36-cde26d85616e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Request method failure captured: Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc HTTP/1.1 Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGehSz2xSJKwAybfJZvds3g0I4Zh6jj7OWK4yh7GYhy9T6LscbgwTFrNGiS4-w96cVbR_5WV0oBd1DVt0xA_TNsRIUnLJLwA0qJLSlo7OTEvBlGZp1xndOB0Wy29vOt3hKcRj1Q28xdycCN0XDE4wfdFN5HaijRqN8USKty2VTIFbz-w Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.54 Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: dbcff02e6dbb4abab905684dbd0ab097 Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerShowV254Test-130220786 Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dbcff02e6dbb4abab905684dbd0ab097"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dbcff02e6dbb4abab905684dbd0ab097"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dbcff02e6dbb4abab905684dbd0ab097"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dbcff02e6dbb4abab905684dbd0ab097"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerShowV254Test-130220786 Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: dbcff02e6dbb4abab905684dbd0ab097 Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerShowV254Test-130220786 Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerShowV254Test-130220786-project Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 09e8b16ab90c47f6881bde461a1ee1b4 Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerShowV254Test-130220786-project Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 846e6149-d671-4e2d-acfa-f512e1ac28cc could not be found. Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '846e6149-d671-4e2d-acfa-f512e1ac28cc'} Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 846e6149-d671-4e2d-acfa-f512e1ac28cc could not be found. Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 846e6149-d671-4e2d-acfa-f512e1ac28cc could not be found. Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:05:05.967615 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:05:05.979550 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:05:05.979550 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:05:05.979550 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:05:05.979550 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:05:05.979550 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:05:05.979550 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 846e6149-d671-4e2d-acfa-f512e1ac28cc could not be found. Sep 08 13:05:05.979550 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:05:05.979550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-42044577-4874-4477-8e36-cde26d85616e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] Returning 404 to user: Instance 846e6149-d671-4e2d-acfa-f512e1ac28cc could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:05:05.979550 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-42044577-4874-4477-8e36-cde26d85616e tempest-ServerShowV254Test-130220786 tempest-ServerShowV254Test-130220786-project] 10.222.0.78 "GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc" status: 404 len: 111 microversion: 2.54 time: 0.144029 Sep 08 13:05:05.981937 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2160/4189] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:05 2022] GET /compute/v2.1/servers/846e6149-d671-4e2d-acfa-f512e1ac28cc => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:05:07.793576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1e5a30ff-3156-48cd-874c-2d53475340dd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:07.798951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1e5a30ff-3156-48cd-874c-2d53475340dd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:07.830529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e5a30ff-3156-48cd-874c-2d53475340dd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:07.836258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e5a30ff-3156-48cd-874c-2d53475340dd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:07.840696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e5a30ff-3156-48cd-874c-2d53475340dd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:07.844248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e5a30ff-3156-48cd-874c-2d53475340dd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:07.847729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e5a30ff-3156-48cd-874c-2d53475340dd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:07.848845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e5a30ff-3156-48cd-874c-2d53475340dd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:07.942446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-1e5a30ff-3156-48cd-874c-2d53475340dd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lazy-loading 'flavor' on Instance uuid 4fd2a7c5-18a2-4270-9e76-c5725415c55c {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:05:08.191165 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1e5a30ff-3156-48cd-874c-2d53475340dd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/action" status: 200 len: 32 microversion: 2.1 time: 0.405375 Sep 08 13:05:08.196099 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2161/4190] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:05:07 2022] POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/action => generated 32 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 13:05:08.220911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-377f2dc4-2839-4138-ba50-d45193e9a42a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:08.224395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-377f2dc4-2839-4138-ba50-d45193e9a42a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:08.235896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:05:08.237422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:05:08.238679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:05:08.239511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:05:08.241016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:05:08.294936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-377f2dc4-2839-4138-ba50-d45193e9a42a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:08.297229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:08.298298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:08.299413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:08.300277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-377f2dc4-2839-4138-ba50-d45193e9a42a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:08.301055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:08.301271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-377f2dc4-2839-4138-ba50-d45193e9a42a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:08.311788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:08.311788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:08.318293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-377f2dc4-2839-4138-ba50-d45193e9a42a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:08.319121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-377f2dc4-2839-4138-ba50-d45193e9a42a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:08.319776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-377f2dc4-2839-4138-ba50-d45193e9a42a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:08.335850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Getting quotas for project 511145520efa4e9080fcda708326930c. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:05:08.347625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Getting quotas for user 2621e43bb2074ef7b04e10e82c0c2de0 and project 511145520efa4e9080fcda708326930c. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:05:08.394939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:05:08.410991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:05:08.666801 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-70b45595-ba19-4f9d-9d6b-85ac15e5a907 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.452895 Sep 08 13:05:08.672596 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2030/4191] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:05:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 5462 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:05:08.706121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-de8a30b7-ca5e-413e-ae9b-5bc1d087aaea tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:08.711597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-de8a30b7-ca5e-413e-ae9b-5bc1d087aaea tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:08.852938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-377f2dc4-2839-4138-ba50-d45193e9a42a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:08.881853 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-377f2dc4-2839-4138-ba50-d45193e9a42a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 0.681532 Sep 08 13:05:08.885525 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2162/4192] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:08 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:05:08.949669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-de8a30b7-ca5e-413e-ae9b-5bc1d087aaea tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:08.977662 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-de8a30b7-ca5e-413e-ae9b-5bc1d087aaea tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1215 microversion: 2.1 time: 0.288889 Sep 08 13:05:08.983662 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2031/4193] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:08 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1215 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:05:09.921479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6c4f24c1-0e19-4b1f-ac37-19872996cb04 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:09.922517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6c4f24c1-0e19-4b1f-ac37-19872996cb04 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:09.945823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c4f24c1-0e19-4b1f-ac37-19872996cb04 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:09.946425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c4f24c1-0e19-4b1f-ac37-19872996cb04 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:09.949041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c4f24c1-0e19-4b1f-ac37-19872996cb04 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:09.951258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c4f24c1-0e19-4b1f-ac37-19872996cb04 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:09.953664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c4f24c1-0e19-4b1f-ac37-19872996cb04 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:09.957305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c4f24c1-0e19-4b1f-ac37-19872996cb04 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:10.342062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c4f24c1-0e19-4b1f-ac37-19872996cb04 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:10.357184 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6c4f24c1-0e19-4b1f-ac37-19872996cb04 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 0.439716 Sep 08 13:05:10.359658 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2032/4194] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:09 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:10.374240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5209d336-47be-46f6-9273-47d8aa3b11b2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:10.388076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5209d336-47be-46f6-9273-47d8aa3b11b2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:10.404031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5209d336-47be-46f6-9273-47d8aa3b11b2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:10.404822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5209d336-47be-46f6-9273-47d8aa3b11b2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:10.405469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5209d336-47be-46f6-9273-47d8aa3b11b2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:10.406416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5209d336-47be-46f6-9273-47d8aa3b11b2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:10.407048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5209d336-47be-46f6-9273-47d8aa3b11b2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:10.407869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5209d336-47be-46f6-9273-47d8aa3b11b2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:10.722439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1347505226", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "91bbb611-1ebe-4e72-b7d5-4439307007df"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:10.776681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5209d336-47be-46f6-9273-47d8aa3b11b2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:10.790017 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5209d336-47be-46f6-9273-47d8aa3b11b2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1219 microversion: 2.1 time: 0.428257 Sep 08 13:05:10.790642 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2033/4195] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:10 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1219 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:10.963407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] validate_networks() for [('91bbb611-1ebe-4e72-b7d5-4439307007df', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:05:11.386981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ee6e1434-1167-4414-b132-d1bc3bf4b05d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:11.388804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ee6e1434-1167-4414-b132-d1bc3bf4b05d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:11.409356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6e1434-1167-4414-b132-d1bc3bf4b05d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:11.416140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6e1434-1167-4414-b132-d1bc3bf4b05d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:11.417019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6e1434-1167-4414-b132-d1bc3bf4b05d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:11.418788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6e1434-1167-4414-b132-d1bc3bf4b05d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:11.419656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6e1434-1167-4414-b132-d1bc3bf4b05d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:11.421057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee6e1434-1167-4414-b132-d1bc3bf4b05d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:12.593916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ee6e1434-1167-4414-b132-d1bc3bf4b05d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:12.632680 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ee6e1434-1167-4414-b132-d1bc3bf4b05d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 1.246543 Sep 08 13:05:12.640659 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2034/4196] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:11 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 1259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:05:12.652128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2bb49823-da87-40ec-a999-e714cf53a74f tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:12.656080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2bb49823-da87-40ec-a999-e714cf53a74f tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:12.674717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bb49823-da87-40ec-a999-e714cf53a74f tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:12.675628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bb49823-da87-40ec-a999-e714cf53a74f tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:12.676535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bb49823-da87-40ec-a999-e714cf53a74f tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:12.677841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bb49823-da87-40ec-a999-e714cf53a74f tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:12.678378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bb49823-da87-40ec-a999-e714cf53a74f tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:12.678820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bb49823-da87-40ec-a999-e714cf53a74f tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:12.802652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2bb49823-da87-40ec-a999-e714cf53a74f tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:12.828912 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2bb49823-da87-40ec-a999-e714cf53a74f tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1273 microversion: 2.1 time: 0.184485 Sep 08 13:05:12.830098 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2035/4197] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:12 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1273 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:13.683633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-57877549-1d6b-40db-99cf-027ce2255b73 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:13.683633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-57877549-1d6b-40db-99cf-027ce2255b73 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:13.716641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57877549-1d6b-40db-99cf-027ce2255b73 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:13.722705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57877549-1d6b-40db-99cf-027ce2255b73 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:13.726413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57877549-1d6b-40db-99cf-027ce2255b73 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:13.730563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57877549-1d6b-40db-99cf-027ce2255b73 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:13.731652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57877549-1d6b-40db-99cf-027ce2255b73 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:13.748693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57877549-1d6b-40db-99cf-027ce2255b73 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:14.028641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:05:14.031987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:05:14.033370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:05:14.034474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:05:14.035498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:05:14.048388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:14.073303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:14.073303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:14.074392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:14.076506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:14.077435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:14.079453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:14.136636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Getting quotas for project 3288eb64816f42a7a6445af1ab88d9c9. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:05:14.145994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Getting quotas for user 10f2fad7f8034c709202ea9ad00336e1 and project 3288eb64816f42a7a6445af1ab88d9c9. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:05:14.172495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:05:14.176673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:05:14.214353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-57877549-1d6b-40db-99cf-027ce2255b73 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:14.246773 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-57877549-1d6b-40db-99cf-027ce2255b73 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 0.571589 Sep 08 13:05:14.267155 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2036/4198] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:13 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:14.293336 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7d857b7d-49d0-44a9-a0e4-6fed7e17b603 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.743881 Sep 08 13:05:14.293514 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2163/4199] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:05:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 4747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:05:14.326411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7424822a-fbe2-4b0c-bf0f-680058634114 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:14.327771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7424822a-fbe2-4b0c-bf0f-680058634114 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:14.343004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7424822a-fbe2-4b0c-bf0f-680058634114 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:14.344037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7424822a-fbe2-4b0c-bf0f-680058634114 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:14.345031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7424822a-fbe2-4b0c-bf0f-680058634114 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:14.351524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7424822a-fbe2-4b0c-bf0f-680058634114 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:14.357531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7424822a-fbe2-4b0c-bf0f-680058634114 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:14.359023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7424822a-fbe2-4b0c-bf0f-680058634114 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:15.102594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7424822a-fbe2-4b0c-bf0f-680058634114 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:15.138233 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7424822a-fbe2-4b0c-bf0f-680058634114 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1315 microversion: 2.1 time: 0.842217 Sep 08 13:05:15.140761 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2164/4200] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:14 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1315 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:15.172390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f182b22d-40a4-426a-876c-783e3b4fa0bb tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:15.175114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f182b22d-40a4-426a-876c-783e3b4fa0bb tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:15.320994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-216729489", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": "none"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:15.356581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f182b22d-40a4-426a-876c-783e3b4fa0bb tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:15.389897 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f182b22d-40a4-426a-876c-783e3b4fa0bb tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1215 microversion: 2.1 time: 0.235520 Sep 08 13:05:15.402416 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2165/4201] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:15 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1215 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:15.403030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-70f70107-4999-482f-82d9-9904f9ef1f60 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:15.404215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-70f70107-4999-482f-82d9-9904f9ef1f60 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:15.439170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f70107-4999-482f-82d9-9904f9ef1f60 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:15.441364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f70107-4999-482f-82d9-9904f9ef1f60 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:15.442479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f70107-4999-482f-82d9-9904f9ef1f60 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:15.448087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f70107-4999-482f-82d9-9904f9ef1f60 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:15.450824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f70107-4999-482f-82d9-9904f9ef1f60 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:15.457225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f70107-4999-482f-82d9-9904f9ef1f60 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:15.517547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:05:15.518308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:05:15.519164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:05:15.521619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:05:15.522709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:05:15.544855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:15.546443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:15.547789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:15.549531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:15.550608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:15.551877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:15.577176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:15.596382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Getting quotas for project b0f4f8248bd049099d67cbc774089c27. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:05:15.611886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Getting quotas for user 337b15570f544280a503eac0e5b1f76c and project b0f4f8248bd049099d67cbc774089c27. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:05:15.655753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:05:15.663464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:05:15.807450 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-84340f78-3640-48c7-90dd-baebe912592d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 1.538314 Sep 08 13:05:15.814525 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2037/4202] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 13:05:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1546 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 13:05:15.829680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f913eb0a-e0f8-47cb-8f8f-586ac53b2f3e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:15.830331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f913eb0a-e0f8-47cb-8f8f-586ac53b2f3e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:16.577918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f913eb0a-e0f8-47cb-8f8f-586ac53b2f3e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:16.614471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f913eb0a-e0f8-47cb-8f8f-586ac53b2f3e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:16.619279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f913eb0a-e0f8-47cb-8f8f-586ac53b2f3e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:16.621758 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f913eb0a-e0f8-47cb-8f8f-586ac53b2f3e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1277 microversion: 2.57 time: 0.796592 Sep 08 13:05:16.637070 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2038/4203] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:15 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1277 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:16.673538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-70f70107-4999-482f-82d9-9904f9ef1f60 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:16.676103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d8abf3d3-1292-4833-8958-2ff6eacb922d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:16.677282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d8abf3d3-1292-4833-8958-2ff6eacb922d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:16.727460 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-70f70107-4999-482f-82d9-9904f9ef1f60 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 1.334981 Sep 08 13:05:16.730605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8abf3d3-1292-4833-8958-2ff6eacb922d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:16.735795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8abf3d3-1292-4833-8958-2ff6eacb922d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:16.736673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8abf3d3-1292-4833-8958-2ff6eacb922d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:16.739006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8abf3d3-1292-4833-8958-2ff6eacb922d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:16.739763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8abf3d3-1292-4833-8958-2ff6eacb922d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:16.740623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8abf3d3-1292-4833-8958-2ff6eacb922d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:16.740851 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2166/4204] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:15 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 1350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:16.770456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b364093a-d0c2-469d-b9fa-2c81bf573345 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:16.771777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b364093a-d0c2-469d-b9fa-2c81bf573345 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:16.819029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b364093a-d0c2-469d-b9fa-2c81bf573345 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:16.824772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b364093a-d0c2-469d-b9fa-2c81bf573345 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:16.825652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b364093a-d0c2-469d-b9fa-2c81bf573345 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:16.831885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b364093a-d0c2-469d-b9fa-2c81bf573345 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:16.838356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b364093a-d0c2-469d-b9fa-2c81bf573345 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:16.839675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b364093a-d0c2-469d-b9fa-2c81bf573345 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:17.149323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b364093a-d0c2-469d-b9fa-2c81bf573345 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:17.164318 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b364093a-d0c2-469d-b9fa-2c81bf573345 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1267 microversion: 2.1 time: 0.419441 Sep 08 13:05:17.180105 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2167/4205] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:16 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1267 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:17.274978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d8abf3d3-1292-4833-8958-2ff6eacb922d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:17.308210 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d8abf3d3-1292-4833-8958-2ff6eacb922d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1315 microversion: 2.1 time: 0.660817 Sep 08 13:05:17.309359 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2039/4206] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:16 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1315 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:17.693875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a531ffff-8b65-482d-91b4-8d47da1aa661 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:17.696086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a531ffff-8b65-482d-91b4-8d47da1aa661 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:17.777091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a531ffff-8b65-482d-91b4-8d47da1aa661 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:17.778769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a531ffff-8b65-482d-91b4-8d47da1aa661 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:17.781522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dd5ebfd2-28a9-4282-82fd-3b9d4bbd1089 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:17.782411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dd5ebfd2-28a9-4282-82fd-3b9d4bbd1089 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:17.788984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a531ffff-8b65-482d-91b4-8d47da1aa661 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:17.797983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a531ffff-8b65-482d-91b4-8d47da1aa661 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:17.803162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dd5ebfd2-28a9-4282-82fd-3b9d4bbd1089 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:17.804134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dd5ebfd2-28a9-4282-82fd-3b9d4bbd1089 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:17.805943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a531ffff-8b65-482d-91b4-8d47da1aa661 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:17.806799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dd5ebfd2-28a9-4282-82fd-3b9d4bbd1089 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:17.806932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a531ffff-8b65-482d-91b4-8d47da1aa661 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:17.807998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dd5ebfd2-28a9-4282-82fd-3b9d4bbd1089 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:17.810860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dd5ebfd2-28a9-4282-82fd-3b9d4bbd1089 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:17.811582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dd5ebfd2-28a9-4282-82fd-3b9d4bbd1089 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:18.179502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a531ffff-8b65-482d-91b4-8d47da1aa661 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:18.213191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a531ffff-8b65-482d-91b4-8d47da1aa661 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:18.216246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a531ffff-8b65-482d-91b4-8d47da1aa661 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:18.221614 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a531ffff-8b65-482d-91b4-8d47da1aa661 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1273 microversion: 2.57 time: 0.545837 Sep 08 13:05:18.227361 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2168/4207] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:17 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1273 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:18.250497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae013be6-979d-4ef0-869b-cfe4730e778f tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:18.251836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ae013be6-979d-4ef0-869b-cfe4730e778f tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:18.268501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae013be6-979d-4ef0-869b-cfe4730e778f tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:18.272726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae013be6-979d-4ef0-869b-cfe4730e778f tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:18.275883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae013be6-979d-4ef0-869b-cfe4730e778f tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:18.278429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae013be6-979d-4ef0-869b-cfe4730e778f tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:18.281582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae013be6-979d-4ef0-869b-cfe4730e778f tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:18.285926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae013be6-979d-4ef0-869b-cfe4730e778f tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:18.554664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ae013be6-979d-4ef0-869b-cfe4730e778f tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:18.563817 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ae013be6-979d-4ef0-869b-cfe4730e778f tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1273 microversion: 2.1 time: 0.334780 Sep 08 13:05:18.568118 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2169/4208] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:18 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1273 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:18.578073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84b312d6-9d28-4bb5-a83b-d53eacc78ed2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:18.583306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-84b312d6-9d28-4bb5-a83b-d53eacc78ed2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:18.601364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84b312d6-9d28-4bb5-a83b-d53eacc78ed2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:18.603014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84b312d6-9d28-4bb5-a83b-d53eacc78ed2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:18.605427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84b312d6-9d28-4bb5-a83b-d53eacc78ed2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:18.611560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84b312d6-9d28-4bb5-a83b-d53eacc78ed2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:18.616538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84b312d6-9d28-4bb5-a83b-d53eacc78ed2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:18.618423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84b312d6-9d28-4bb5-a83b-d53eacc78ed2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:18.642596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dd5ebfd2-28a9-4282-82fd-3b9d4bbd1089 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:18.705506 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dd5ebfd2-28a9-4282-82fd-3b9d4bbd1089 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 0.926368 Sep 08 13:05:18.710098 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2040/4209] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:17 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:18.733458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b409a573-62ba-429f-a089-43df267a9d2a req-5405db07-a48b-42a5-af24-10140546b56a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09056cb0-d150-40fa-8001-acdf52066ba8", "tag": "0ddeedae-3f13-4191-bc0d-be0f45345674"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:18.780882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b409a573-62ba-429f-a089-43df267a9d2a req-5405db07-a48b-42a5-af24-10140546b56a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:18.781782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b409a573-62ba-429f-a089-43df267a9d2a req-5405db07-a48b-42a5-af24-10140546b56a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:18.788278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b409a573-62ba-429f-a089-43df267a9d2a req-5405db07-a48b-42a5-af24-10140546b56a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:18.854261 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b409a573-62ba-429f-a089-43df267a9d2a req-5405db07-a48b-42a5-af24-10140546b56a service nova] Creating event network-changed:0ddeedae-3f13-4191-bc0d-be0f45345674 for instance 09056cb0-d150-40fa-8001-acdf52066ba8 on n-h2-852084-10 Sep 08 13:05:18.870069 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b409a573-62ba-429f-a089-43df267a9d2a req-5405db07-a48b-42a5-af24-10140546b56a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154672 Sep 08 13:05:18.872654 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2041/4210] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:05:19.306209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff18ca16-940d-4aa3-8a39-449360724456 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:19.309669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ff18ca16-940d-4aa3-8a39-449360724456 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:19.363619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff18ca16-940d-4aa3-8a39-449360724456 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:19.364693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff18ca16-940d-4aa3-8a39-449360724456 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:19.365705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff18ca16-940d-4aa3-8a39-449360724456 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:19.367195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff18ca16-940d-4aa3-8a39-449360724456 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:19.368498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff18ca16-940d-4aa3-8a39-449360724456 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:19.369306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff18ca16-940d-4aa3-8a39-449360724456 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:19.405324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-84b312d6-9d28-4bb5-a83b-d53eacc78ed2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:19.432576 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-84b312d6-9d28-4bb5-a83b-d53eacc78ed2 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1315 microversion: 2.1 time: 0.858040 Sep 08 13:05:19.434152 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2170/4211] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:18 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:19.624745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0d44740a-233c-4466-b4ad-4f77744cf321 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:19.630874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0d44740a-233c-4466-b4ad-4f77744cf321 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:19.655264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d44740a-233c-4466-b4ad-4f77744cf321 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:19.657748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d44740a-233c-4466-b4ad-4f77744cf321 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:19.658475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d44740a-233c-4466-b4ad-4f77744cf321 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:19.664062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d44740a-233c-4466-b4ad-4f77744cf321 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:19.664937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d44740a-233c-4466-b4ad-4f77744cf321 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:19.665892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d44740a-233c-4466-b4ad-4f77744cf321 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:19.843380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ff18ca16-940d-4aa3-8a39-449360724456 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:19.866817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ff18ca16-940d-4aa3-8a39-449360724456 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:19.870194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ff18ca16-940d-4aa3-8a39-449360724456 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:19.873529 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ff18ca16-940d-4aa3-8a39-449360724456 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1347 microversion: 2.57 time: 0.586813 Sep 08 13:05:19.895970 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2042/4212] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:19 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1347 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:19.908382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7419f15f-e1ba-4487-a9b3-591c1a4ffeb7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:19.909302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7419f15f-e1ba-4487-a9b3-591c1a4ffeb7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:19.930787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7419f15f-e1ba-4487-a9b3-591c1a4ffeb7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:19.931412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7419f15f-e1ba-4487-a9b3-591c1a4ffeb7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:19.931939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7419f15f-e1ba-4487-a9b3-591c1a4ffeb7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:19.933316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7419f15f-e1ba-4487-a9b3-591c1a4ffeb7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:19.933890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7419f15f-e1ba-4487-a9b3-591c1a4ffeb7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:19.934334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7419f15f-e1ba-4487-a9b3-591c1a4ffeb7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:20.312677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0d44740a-233c-4466-b4ad-4f77744cf321 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:20.331411 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0d44740a-233c-4466-b4ad-4f77744cf321 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1315 microversion: 2.1 time: 0.716900 Sep 08 13:05:20.332802 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2171/4213] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:19 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1315 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:20.345267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7419f15f-e1ba-4487-a9b3-591c1a4ffeb7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:20.367033 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7419f15f-e1ba-4487-a9b3-591c1a4ffeb7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 0.468994 Sep 08 13:05:20.368088 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2043/4214] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:19 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:20.480504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-471229e0-9131-45c1-8d40-1dba90c04440 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:20.482478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-471229e0-9131-45c1-8d40-1dba90c04440 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:20.490109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-471229e0-9131-45c1-8d40-1dba90c04440 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:20.490888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-471229e0-9131-45c1-8d40-1dba90c04440 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:20.491822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-471229e0-9131-45c1-8d40-1dba90c04440 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:20.492776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-471229e0-9131-45c1-8d40-1dba90c04440 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:20.493401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-471229e0-9131-45c1-8d40-1dba90c04440 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:20.494074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-471229e0-9131-45c1-8d40-1dba90c04440 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:20.741401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-471229e0-9131-45c1-8d40-1dba90c04440 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:20.758604 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-471229e0-9131-45c1-8d40-1dba90c04440 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1315 microversion: 2.1 time: 0.281993 Sep 08 13:05:20.759966 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2172/4215] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:20 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:20.940035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3f03e37e-a971-4727-80e8-ba54314ab41d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:20.941195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3f03e37e-a971-4727-80e8-ba54314ab41d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:20.955350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f03e37e-a971-4727-80e8-ba54314ab41d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:20.956720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f03e37e-a971-4727-80e8-ba54314ab41d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:20.957626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f03e37e-a971-4727-80e8-ba54314ab41d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:20.959648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f03e37e-a971-4727-80e8-ba54314ab41d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:20.960581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f03e37e-a971-4727-80e8-ba54314ab41d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:20.961716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f03e37e-a971-4727-80e8-ba54314ab41d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:21.202223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3f03e37e-a971-4727-80e8-ba54314ab41d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:21.234790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3f03e37e-a971-4727-80e8-ba54314ab41d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:21.241048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3f03e37e-a971-4727-80e8-ba54314ab41d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:21.244874 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3f03e37e-a971-4727-80e8-ba54314ab41d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1335 microversion: 2.57 time: 0.311234 Sep 08 13:05:21.246321 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2044/4216] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:20 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1335 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:05:21.372637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a3b809c9-446e-46a2-8083-0735530f21e7 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:21.373384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a3b809c9-446e-46a2-8083-0735530f21e7 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:21.409813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fd912eb4-f3d3-4d8a-b03b-5b9b05d16e62 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:21.417144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b809c9-446e-46a2-8083-0735530f21e7 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:21.417444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b809c9-446e-46a2-8083-0735530f21e7 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:21.418049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b809c9-446e-46a2-8083-0735530f21e7 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:21.419806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b809c9-446e-46a2-8083-0735530f21e7 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:21.420513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fd912eb4-f3d3-4d8a-b03b-5b9b05d16e62 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:21.428299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b809c9-446e-46a2-8083-0735530f21e7 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:21.429057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3b809c9-446e-46a2-8083-0735530f21e7 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:21.446073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd912eb4-f3d3-4d8a-b03b-5b9b05d16e62 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:21.454503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd912eb4-f3d3-4d8a-b03b-5b9b05d16e62 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:21.455765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd912eb4-f3d3-4d8a-b03b-5b9b05d16e62 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:21.459351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd912eb4-f3d3-4d8a-b03b-5b9b05d16e62 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:21.460802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd912eb4-f3d3-4d8a-b03b-5b9b05d16e62 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:21.462306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd912eb4-f3d3-4d8a-b03b-5b9b05d16e62 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:22.025861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a3b809c9-446e-46a2-8083-0735530f21e7 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:22.039968 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a3b809c9-446e-46a2-8083-0735530f21e7 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1315 microversion: 2.1 time: 0.672724 Sep 08 13:05:22.060980 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2173/4217] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:21 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:22.070455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d2c07e55-5ee0-4f8b-8580-5ab46e4d9661 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:22.072901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d2c07e55-5ee0-4f8b-8580-5ab46e4d9661 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:22.088523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2c07e55-5ee0-4f8b-8580-5ab46e4d9661 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:22.092416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2c07e55-5ee0-4f8b-8580-5ab46e4d9661 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:22.093979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2c07e55-5ee0-4f8b-8580-5ab46e4d9661 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:22.097594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2c07e55-5ee0-4f8b-8580-5ab46e4d9661 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:22.098462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2c07e55-5ee0-4f8b-8580-5ab46e4d9661 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:22.099084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2c07e55-5ee0-4f8b-8580-5ab46e4d9661 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:22.253674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fd912eb4-f3d3-4d8a-b03b-5b9b05d16e62 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:22.275180 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fd912eb4-f3d3-4d8a-b03b-5b9b05d16e62 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 0.874223 Sep 08 13:05:22.298045 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2045/4218] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:21 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:22.330156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-741e1016-8083-4c5e-98db-7ed53057dbcc tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:22.331867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-741e1016-8083-4c5e-98db-7ed53057dbcc tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:22.371851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-741e1016-8083-4c5e-98db-7ed53057dbcc tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:22.377365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-741e1016-8083-4c5e-98db-7ed53057dbcc tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:22.385399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-741e1016-8083-4c5e-98db-7ed53057dbcc tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:22.389132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-741e1016-8083-4c5e-98db-7ed53057dbcc tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:22.392115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-741e1016-8083-4c5e-98db-7ed53057dbcc tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:22.393601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-741e1016-8083-4c5e-98db-7ed53057dbcc tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:22.662017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-741e1016-8083-4c5e-98db-7ed53057dbcc tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:22.701009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-741e1016-8083-4c5e-98db-7ed53057dbcc tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:22.709160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-741e1016-8083-4c5e-98db-7ed53057dbcc tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:22.715510 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-741e1016-8083-4c5e-98db-7ed53057dbcc tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1356 microversion: 2.57 time: 0.414119 Sep 08 13:05:22.721347 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2046/4219] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:22 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1356 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:22.769984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:22.776430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:22.794682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:22.795308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:22.795764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:22.796720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:22.797199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:22.797626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:22.960869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d2c07e55-5ee0-4f8b-8580-5ab46e4d9661 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:23.004535 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d2c07e55-5ee0-4f8b-8580-5ab46e4d9661 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1315 microversion: 2.1 time: 0.941175 Sep 08 13:05:23.004860 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2174/4220] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:22 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:23.050085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7ff6737a-8bd8-4ae8-a9d6-55d788aa7b2c req-a05c760b-c154-4bf3-b8e4-5a7e149a6907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f993e7b7-677b-4ffc-a4f9-5eddaf3d3105", "tag": "dd76a2dd-f067-46e8-a492-15eec7a149c3"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:23.076993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:05:23.079439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:05:23.083910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:05:23.085214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:05:23.085697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:05:23.099558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7ff6737a-8bd8-4ae8-a9d6-55d788aa7b2c req-a05c760b-c154-4bf3-b8e4-5a7e149a6907 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:23.100275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7ff6737a-8bd8-4ae8-a9d6-55d788aa7b2c req-a05c760b-c154-4bf3-b8e4-5a7e149a6907 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:23.101760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7ff6737a-8bd8-4ae8-a9d6-55d788aa7b2c req-a05c760b-c154-4bf3-b8e4-5a7e149a6907 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:23.138233 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7ff6737a-8bd8-4ae8-a9d6-55d788aa7b2c req-a05c760b-c154-4bf3-b8e4-5a7e149a6907 service nova] Creating event network-changed:dd76a2dd-f067-46e8-a492-15eec7a149c3 for instance f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 on n-h1-852084-10 Sep 08 13:05:23.165164 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7ff6737a-8bd8-4ae8-a9d6-55d788aa7b2c req-a05c760b-c154-4bf3-b8e4-5a7e149a6907 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138525 Sep 08 13:05:23.170939 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2175/4221] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:05:23.186070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-330772bc-18dc-456f-bb01-ac4cd55a675c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:23.186793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-330772bc-18dc-456f-bb01-ac4cd55a675c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:23.217399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-330772bc-18dc-456f-bb01-ac4cd55a675c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:23.217753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-330772bc-18dc-456f-bb01-ac4cd55a675c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:23.231107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-330772bc-18dc-456f-bb01-ac4cd55a675c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:23.232285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-330772bc-18dc-456f-bb01-ac4cd55a675c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:23.234490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-330772bc-18dc-456f-bb01-ac4cd55a675c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:23.235663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-330772bc-18dc-456f-bb01-ac4cd55a675c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:23.304871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:23.335469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:23.335983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:23.336670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:23.337884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:23.339747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:23.340228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:23.490030 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bbe87059-b54c-46d0-a77a-2d6f4157a292 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "POST /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c/action" status: 202 len: 1137 microversion: 2.57 time: 0.725528 Sep 08 13:05:23.492510 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2047/4222] 10.222.0.78 () {62 vars in 1320 bytes} [Thu Sep 8 13:05:22 2022] POST /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c/action => generated 1137 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Sep 08 13:05:23.528336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-61ef2299-2a77-43a7-8039-e81af01ee944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:23.529578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-61ef2299-2a77-43a7-8039-e81af01ee944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:23.551080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61ef2299-2a77-43a7-8039-e81af01ee944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:23.552001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61ef2299-2a77-43a7-8039-e81af01ee944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:23.561685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61ef2299-2a77-43a7-8039-e81af01ee944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:23.566408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61ef2299-2a77-43a7-8039-e81af01ee944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:23.571016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61ef2299-2a77-43a7-8039-e81af01ee944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:23.577811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61ef2299-2a77-43a7-8039-e81af01ee944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:23.646391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:23.842140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-330772bc-18dc-456f-bb01-ac4cd55a675c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:23.861951 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-330772bc-18dc-456f-bb01-ac4cd55a675c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1315 microversion: 2.1 time: 0.685749 Sep 08 13:05:23.866415 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2176/4223] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:23 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1315 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:23.901706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d4698ff4-6601-4e90-a716-562969c70895 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:23.902697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d4698ff4-6601-4e90-a716-562969c70895 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:23.912231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4698ff4-6601-4e90-a716-562969c70895 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:23.913526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4698ff4-6601-4e90-a716-562969c70895 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:23.914401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4698ff4-6601-4e90-a716-562969c70895 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:23.915578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4698ff4-6601-4e90-a716-562969c70895 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:23.918174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4698ff4-6601-4e90-a716-562969c70895 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:23.919271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4698ff4-6601-4e90-a716-562969c70895 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:24.075560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d4698ff4-6601-4e90-a716-562969c70895 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:24.093253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d4698ff4-6601-4e90-a716-562969c70895 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:24.096846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d4698ff4-6601-4e90-a716-562969c70895 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:24.102803 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d4698ff4-6601-4e90-a716-562969c70895 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.210997 Sep 08 13:05:24.104251 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2177/4224] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:23 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:24.111066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-11d49dbc-171a-4bca-b8c5-7a816b497e1a tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:24.112738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-11d49dbc-171a-4bca-b8c5-7a816b497e1a tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:24.126504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:24.132334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11d49dbc-171a-4bca-b8c5-7a816b497e1a tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:24.133470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11d49dbc-171a-4bca-b8c5-7a816b497e1a tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:24.134124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11d49dbc-171a-4bca-b8c5-7a816b497e1a tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:24.135129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11d49dbc-171a-4bca-b8c5-7a816b497e1a tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:24.135964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11d49dbc-171a-4bca-b8c5-7a816b497e1a tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:24.136606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11d49dbc-171a-4bca-b8c5-7a816b497e1a tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:24.170200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-61ef2299-2a77-43a7-8039-e81af01ee944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:24.183869 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-61ef2299-2a77-43a7-8039-e81af01ee944 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 0.689357 Sep 08 13:05:24.204835 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2048/4225] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:23 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:24.483834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-11d49dbc-171a-4bca-b8c5-7a816b497e1a tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:24.544906 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-11d49dbc-171a-4bca-b8c5-7a816b497e1a tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1315 microversion: 2.1 time: 0.438048 Sep 08 13:05:24.546453 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2178/4226] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:24 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1315 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:24.898616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-65977b11-a164-40ec-9486-9feded79b4bc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:24.910412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-65977b11-a164-40ec-9486-9feded79b4bc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:24.929797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65977b11-a164-40ec-9486-9feded79b4bc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:24.935936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65977b11-a164-40ec-9486-9feded79b4bc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:24.937675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65977b11-a164-40ec-9486-9feded79b4bc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:24.940086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65977b11-a164-40ec-9486-9feded79b4bc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:24.952470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65977b11-a164-40ec-9486-9feded79b4bc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:24.953389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65977b11-a164-40ec-9486-9feded79b4bc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:25.146026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e0cdbea2-1d42-4071-a0de-ce39eee4b3ac tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:25.147614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e0cdbea2-1d42-4071-a0de-ce39eee4b3ac tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:25.162018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e0cdbea2-1d42-4071-a0de-ce39eee4b3ac tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:25.163798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e0cdbea2-1d42-4071-a0de-ce39eee4b3ac tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:25.164896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e0cdbea2-1d42-4071-a0de-ce39eee4b3ac tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:25.167535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e0cdbea2-1d42-4071-a0de-ce39eee4b3ac tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:25.168298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e0cdbea2-1d42-4071-a0de-ce39eee4b3ac tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:25.168964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e0cdbea2-1d42-4071-a0de-ce39eee4b3ac tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:25.346485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e0cdbea2-1d42-4071-a0de-ce39eee4b3ac tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:25.376726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e0cdbea2-1d42-4071-a0de-ce39eee4b3ac tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:25.386102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e0cdbea2-1d42-4071-a0de-ce39eee4b3ac tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:25.390004 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e0cdbea2-1d42-4071-a0de-ce39eee4b3ac tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.255044 Sep 08 13:05:25.393077 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2179/4227] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:25 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:25.400651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5b53e942-25d8-452f-91fb-f885fded8d74 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:25.401725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5b53e942-25d8-452f-91fb-f885fded8d74 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:25.410196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:25.415117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b53e942-25d8-452f-91fb-f885fded8d74 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:25.416077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b53e942-25d8-452f-91fb-f885fded8d74 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:25.417026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b53e942-25d8-452f-91fb-f885fded8d74 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:25.418114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b53e942-25d8-452f-91fb-f885fded8d74 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:25.418931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b53e942-25d8-452f-91fb-f885fded8d74 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:25.419651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b53e942-25d8-452f-91fb-f885fded8d74 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:25.436465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-65977b11-a164-40ec-9486-9feded79b4bc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:25.452623 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-65977b11-a164-40ec-9486-9feded79b4bc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1315 microversion: 2.1 time: 0.563220 Sep 08 13:05:25.467788 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2049/4228] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:24 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1315 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:25.590972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-47e0b186-848a-4fc0-ae46-f10ed057cc7c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:25.592375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-47e0b186-848a-4fc0-ae46-f10ed057cc7c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:25.595794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:25.608341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47e0b186-848a-4fc0-ae46-f10ed057cc7c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:25.609548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47e0b186-848a-4fc0-ae46-f10ed057cc7c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:25.612084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47e0b186-848a-4fc0-ae46-f10ed057cc7c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:25.613619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47e0b186-848a-4fc0-ae46-f10ed057cc7c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:25.616960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47e0b186-848a-4fc0-ae46-f10ed057cc7c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:25.617895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47e0b186-848a-4fc0-ae46-f10ed057cc7c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:25.843181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5b53e942-25d8-452f-91fb-f885fded8d74 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:25.881299 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5b53e942-25d8-452f-91fb-f885fded8d74 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 0.485686 Sep 08 13:05:25.882432 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2180/4229] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:25 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:26.088001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-47e0b186-848a-4fc0-ae46-f10ed057cc7c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:26.107522 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-47e0b186-848a-4fc0-ae46-f10ed057cc7c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1315 microversion: 2.1 time: 0.521434 Sep 08 13:05:26.116962 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2050/4230] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:25 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1315 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:26.470505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5dbe8d07-368e-4cd2-a9a4-5e3f89f596f3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:26.475616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5dbe8d07-368e-4cd2-a9a4-5e3f89f596f3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:26.490325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ddeb6604-c62a-4b58-b889-500f4b4370e3 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:26.491500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ddeb6604-c62a-4b58-b889-500f4b4370e3 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:26.514296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddeb6604-c62a-4b58-b889-500f4b4370e3 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:26.520610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddeb6604-c62a-4b58-b889-500f4b4370e3 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:26.522198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddeb6604-c62a-4b58-b889-500f4b4370e3 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:26.523584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddeb6604-c62a-4b58-b889-500f4b4370e3 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:26.524720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddeb6604-c62a-4b58-b889-500f4b4370e3 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:26.525526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddeb6604-c62a-4b58-b889-500f4b4370e3 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:26.532588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5dbe8d07-368e-4cd2-a9a4-5e3f89f596f3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:26.533425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5dbe8d07-368e-4cd2-a9a4-5e3f89f596f3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:26.534203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5dbe8d07-368e-4cd2-a9a4-5e3f89f596f3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:26.538792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5dbe8d07-368e-4cd2-a9a4-5e3f89f596f3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:26.540131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5dbe8d07-368e-4cd2-a9a4-5e3f89f596f3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:26.541221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5dbe8d07-368e-4cd2-a9a4-5e3f89f596f3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:26.601876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=16 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:26.688271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5dbe8d07-368e-4cd2-a9a4-5e3f89f596f3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:26.715559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5dbe8d07-368e-4cd2-a9a4-5e3f89f596f3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:26.727356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5dbe8d07-368e-4cd2-a9a4-5e3f89f596f3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:26.730056 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5dbe8d07-368e-4cd2-a9a4-5e3f89f596f3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.267207 Sep 08 13:05:26.736241 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2181/4231] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:26 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:26.934513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b1e395df-e22b-48f7-b5d4-97ced4da721b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:26.935626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b1e395df-e22b-48f7-b5d4-97ced4da721b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:26.956886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1e395df-e22b-48f7-b5d4-97ced4da721b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:26.959901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1e395df-e22b-48f7-b5d4-97ced4da721b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:26.961013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1e395df-e22b-48f7-b5d4-97ced4da721b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:26.962672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1e395df-e22b-48f7-b5d4-97ced4da721b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:26.963603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1e395df-e22b-48f7-b5d4-97ced4da721b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:26.964794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1e395df-e22b-48f7-b5d4-97ced4da721b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:26.990965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ddeb6604-c62a-4b58-b889-500f4b4370e3 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:27.016080 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ddeb6604-c62a-4b58-b889-500f4b4370e3 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1315 microversion: 2.1 time: 0.535455 Sep 08 13:05:27.029568 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2051/4232] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:26 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:27.168836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7cbdcf33-5898-4947-8794-b49cc8bc1e1d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:27.180429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7cbdcf33-5898-4947-8794-b49cc8bc1e1d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:27.198011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cbdcf33-5898-4947-8794-b49cc8bc1e1d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:27.215073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cbdcf33-5898-4947-8794-b49cc8bc1e1d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:27.220732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cbdcf33-5898-4947-8794-b49cc8bc1e1d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:27.227793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cbdcf33-5898-4947-8794-b49cc8bc1e1d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:27.229032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cbdcf33-5898-4947-8794-b49cc8bc1e1d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:27.230252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cbdcf33-5898-4947-8794-b49cc8bc1e1d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:27.329222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b1e395df-e22b-48f7-b5d4-97ced4da721b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:27.350477 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b1e395df-e22b-48f7-b5d4-97ced4da721b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 0.420747 Sep 08 13:05:27.353626 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2182/4233] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:26 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:05:27.665250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7cbdcf33-5898-4947-8794-b49cc8bc1e1d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:27.691885 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7cbdcf33-5898-4947-8794-b49cc8bc1e1d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1315 microversion: 2.1 time: 0.526809 Sep 08 13:05:27.726747 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2052/4234] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:27 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:27.790250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4898ddf8-0c4d-4ca0-9cf3-652cbe444283 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:27.793188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4898ddf8-0c4d-4ca0-9cf3-652cbe444283 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:27.854270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4898ddf8-0c4d-4ca0-9cf3-652cbe444283 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:27.859385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4898ddf8-0c4d-4ca0-9cf3-652cbe444283 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:27.872103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4898ddf8-0c4d-4ca0-9cf3-652cbe444283 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:27.881774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4898ddf8-0c4d-4ca0-9cf3-652cbe444283 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:27.886388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4898ddf8-0c4d-4ca0-9cf3-652cbe444283 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:27.888969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4898ddf8-0c4d-4ca0-9cf3-652cbe444283 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:27.985636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:28.061693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b0813b25-04aa-4ed3-aa58-ef305782952a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:28.072249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b0813b25-04aa-4ed3-aa58-ef305782952a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:28.104475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0813b25-04aa-4ed3-aa58-ef305782952a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:28.105790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0813b25-04aa-4ed3-aa58-ef305782952a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:28.108234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0813b25-04aa-4ed3-aa58-ef305782952a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:28.110063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0813b25-04aa-4ed3-aa58-ef305782952a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:28.111303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0813b25-04aa-4ed3-aa58-ef305782952a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:28.112515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0813b25-04aa-4ed3-aa58-ef305782952a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:28.216548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4898ddf8-0c4d-4ca0-9cf3-652cbe444283 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:28.234067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4898ddf8-0c4d-4ca0-9cf3-652cbe444283 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:28.235973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4898ddf8-0c4d-4ca0-9cf3-652cbe444283 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:28.237248 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4898ddf8-0c4d-4ca0-9cf3-652cbe444283 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.458421 Sep 08 13:05:28.238181 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2183/4235] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:27 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:28.394327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b49c900f-6044-4697-9c4b-6b77c87ec1de tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:28.395499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b49c900f-6044-4697-9c4b-6b77c87ec1de tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:28.434907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b49c900f-6044-4697-9c4b-6b77c87ec1de tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:28.435966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b49c900f-6044-4697-9c4b-6b77c87ec1de tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:28.436789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b49c900f-6044-4697-9c4b-6b77c87ec1de tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:28.441830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b49c900f-6044-4697-9c4b-6b77c87ec1de tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:28.446035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b49c900f-6044-4697-9c4b-6b77c87ec1de tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:28.446829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b49c900f-6044-4697-9c4b-6b77c87ec1de tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:28.790661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b0813b25-04aa-4ed3-aa58-ef305782952a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:28.821573 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b0813b25-04aa-4ed3-aa58-ef305782952a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1315 microversion: 2.1 time: 0.774529 Sep 08 13:05:28.827168 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2053/4236] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:28 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1315 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:28.836301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-21ddb59e-9e7c-494b-9b19-ebceee3d6ea3 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:28.838266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-21ddb59e-9e7c-494b-9b19-ebceee3d6ea3 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:28.848850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:28.854410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21ddb59e-9e7c-494b-9b19-ebceee3d6ea3 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:28.855947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21ddb59e-9e7c-494b-9b19-ebceee3d6ea3 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:28.856979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21ddb59e-9e7c-494b-9b19-ebceee3d6ea3 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:28.858867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21ddb59e-9e7c-494b-9b19-ebceee3d6ea3 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:28.860007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21ddb59e-9e7c-494b-9b19-ebceee3d6ea3 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:28.860989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21ddb59e-9e7c-494b-9b19-ebceee3d6ea3 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:29.257006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b49c900f-6044-4697-9c4b-6b77c87ec1de tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:29.275414 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b49c900f-6044-4697-9c4b-6b77c87ec1de tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 0.884869 Sep 08 13:05:29.294031 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2184/4237] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:28 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:29.309191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-364a3536-9895-4c80-bb9e-f3506336372d req-a219f863-18af-44da-b928-8406504a1cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09056cb0-d150-40fa-8001-acdf52066ba8", "name": "network-vif-plugged", "status": "completed", "tag": "0ddeedae-3f13-4191-bc0d-be0f45345674"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:29.343356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-364a3536-9895-4c80-bb9e-f3506336372d req-a219f863-18af-44da-b928-8406504a1cf6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:29.345327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-364a3536-9895-4c80-bb9e-f3506336372d req-a219f863-18af-44da-b928-8406504a1cf6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:29.346089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-364a3536-9895-4c80-bb9e-f3506336372d req-a219f863-18af-44da-b928-8406504a1cf6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:29.377350 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-364a3536-9895-4c80-bb9e-f3506336372d req-a219f863-18af-44da-b928-8406504a1cf6 service nova] Creating event network-vif-plugged:0ddeedae-3f13-4191-bc0d-be0f45345674 for instance 09056cb0-d150-40fa-8001-acdf52066ba8 on n-h2-852084-10 Sep 08 13:05:29.398828 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-364a3536-9895-4c80-bb9e-f3506336372d req-a219f863-18af-44da-b928-8406504a1cf6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093680 Sep 08 13:05:29.407605 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2185/4238] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:05:29.446277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-443249ee-e04f-4597-9855-737452746430 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:29.451376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-443249ee-e04f-4597-9855-737452746430 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:29.484196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-443249ee-e04f-4597-9855-737452746430 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:29.486138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-443249ee-e04f-4597-9855-737452746430 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:29.487347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-443249ee-e04f-4597-9855-737452746430 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:29.489248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-443249ee-e04f-4597-9855-737452746430 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:29.490572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-443249ee-e04f-4597-9855-737452746430 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:29.491573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-443249ee-e04f-4597-9855-737452746430 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:29.549777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-21ddb59e-9e7c-494b-9b19-ebceee3d6ea3 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:29.597717 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-21ddb59e-9e7c-494b-9b19-ebceee3d6ea3 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1315 microversion: 2.1 time: 0.768111 Sep 08 13:05:29.599673 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2054/4239] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:28 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1315 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:29.725341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-443249ee-e04f-4597-9855-737452746430 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:29.749318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-443249ee-e04f-4597-9855-737452746430 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:29.753442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-443249ee-e04f-4597-9855-737452746430 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:29.755898 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-443249ee-e04f-4597-9855-737452746430 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.342395 Sep 08 13:05:29.756951 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2186/4240] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:29 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:29.866073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1616723a-b604-4847-b31b-f1279d5edd7c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:29.870225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1616723a-b604-4847-b31b-f1279d5edd7c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:29.904838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1616723a-b604-4847-b31b-f1279d5edd7c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:29.908245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1616723a-b604-4847-b31b-f1279d5edd7c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:29.909091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1616723a-b604-4847-b31b-f1279d5edd7c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:29.910608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1616723a-b604-4847-b31b-f1279d5edd7c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:29.914903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1616723a-b604-4847-b31b-f1279d5edd7c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:29.915641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1616723a-b604-4847-b31b-f1279d5edd7c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:30.313151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-feb41aeb-0b35-4205-942e-344e639dcdda tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:30.314314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-feb41aeb-0b35-4205-942e-344e639dcdda tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:30.353569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-feb41aeb-0b35-4205-942e-344e639dcdda tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:30.354735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-feb41aeb-0b35-4205-942e-344e639dcdda tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:30.356064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-feb41aeb-0b35-4205-942e-344e639dcdda tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:30.357588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-feb41aeb-0b35-4205-942e-344e639dcdda tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:30.358809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-feb41aeb-0b35-4205-942e-344e639dcdda tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:30.360034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-feb41aeb-0b35-4205-942e-344e639dcdda tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:30.793672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1616723a-b604-4847-b31b-f1279d5edd7c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:30.812754 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1616723a-b604-4847-b31b-f1279d5edd7c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1315 microversion: 2.1 time: 0.956533 Sep 08 13:05:30.816161 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2055/4241] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:29 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1315 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:30.847500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4a76690f-1f8d-43cd-b8b1-17e5e92a9488 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:30.850134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4a76690f-1f8d-43cd-b8b1-17e5e92a9488 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:30.875695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a76690f-1f8d-43cd-b8b1-17e5e92a9488 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:30.878904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a76690f-1f8d-43cd-b8b1-17e5e92a9488 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:30.887420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a76690f-1f8d-43cd-b8b1-17e5e92a9488 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:30.890312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a76690f-1f8d-43cd-b8b1-17e5e92a9488 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:30.891800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a76690f-1f8d-43cd-b8b1-17e5e92a9488 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:30.893076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a76690f-1f8d-43cd-b8b1-17e5e92a9488 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:31.080787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-feb41aeb-0b35-4205-942e-344e639dcdda tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:31.113062 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-feb41aeb-0b35-4205-942e-344e639dcdda tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1502 microversion: 2.1 time: 0.807637 Sep 08 13:05:31.140681 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2187/4242] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:30 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1502 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:05:31.182156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84aed65a-e32d-474b-90bc-80a494a2ec8f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:31.183467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-84aed65a-e32d-474b-90bc-80a494a2ec8f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:31.212411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84aed65a-e32d-474b-90bc-80a494a2ec8f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:31.213751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84aed65a-e32d-474b-90bc-80a494a2ec8f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:31.215397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84aed65a-e32d-474b-90bc-80a494a2ec8f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:31.217901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84aed65a-e32d-474b-90bc-80a494a2ec8f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:31.219370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84aed65a-e32d-474b-90bc-80a494a2ec8f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:31.221854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84aed65a-e32d-474b-90bc-80a494a2ec8f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:31.500347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-84aed65a-e32d-474b-90bc-80a494a2ec8f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:31.542418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-84aed65a-e32d-474b-90bc-80a494a2ec8f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:31.553442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-84aed65a-e32d-474b-90bc-80a494a2ec8f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:31.558571 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-84aed65a-e32d-474b-90bc-80a494a2ec8f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.410240 Sep 08 13:05:31.560500 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2188/4243] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:31 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:31.571431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-51c1b001-8938-4314-868e-eee03820dd48 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fdc33c0d-f940-483a-b7e9-e7ce1e414dc0"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:31.578239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-51c1b001-8938-4314-868e-eee03820dd48 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:31.593503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51c1b001-8938-4314-868e-eee03820dd48 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:31.595312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51c1b001-8938-4314-868e-eee03820dd48 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:31.597420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51c1b001-8938-4314-868e-eee03820dd48 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:31.601186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51c1b001-8938-4314-868e-eee03820dd48 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:31.602730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51c1b001-8938-4314-868e-eee03820dd48 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:31.604893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51c1b001-8938-4314-868e-eee03820dd48 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:31.687932 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-51c1b001-8938-4314-868e-eee03820dd48 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] HTTP exception thrown: Cannot 'attach_volume' instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c while it is in vm_state rescued Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-51c1b001-8938-4314-868e-eee03820dd48 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Request method failure captured: Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/os-volume_attachments HTTP/1.1 Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 74 Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGegpHo3QYXwAmCN_OctsdmztHN8ts294yLUiw-Ms0Kk7EQY0XfuiDYH7wh8eQztYQYLofweMgdtwuLtrJuTvgGQNr7mGfBgIxtE0szoBUmvKc-BEHBhV8QiE_SJULNZI6czSRqo3YxgC4OeYllmJxk1yJEFxr_qKCUPtZ26YlP53grs Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 0d312121b259412dbf82c519a49285f4 Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: {"volumeAttachment": {"volumeId": "fdc33c0d-f940-483a-b7e9-e7ce1e414dc0"}} Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: exception: Cannot 'attach_volume' instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c while it is in vm_state rescued Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'server_id': '4fd2a7c5-18a2-4270-9e76-c5725415c55c', 'body': {'volumeAttachment': {'volumeId': 'fdc33c0d-f940-483a-b7e9-e7ce1e414dc0'}}} Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 08 13:05:31.693982 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c while it is in vm_state rescued Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c while it is in vm_state rescued Sep 08 13:05:31.702135 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:05:31.704355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4a76690f-1f8d-43cd-b8b1-17e5e92a9488 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:31.704528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-51c1b001-8938-4314-868e-eee03820dd48 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Returning 409 to user: Cannot 'attach_volume' instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c while it is in vm_state rescued {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:05:31.704528 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-51c1b001-8938-4314-868e-eee03820dd48 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.138748 Sep 08 13:05:31.707409 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2189/4244] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:05:31 2022] POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/os-volume_attachments => generated 152 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:05:31.716100 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4a76690f-1f8d-43cd-b8b1-17e5e92a9488 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1315 microversion: 2.1 time: 0.869808 Sep 08 13:05:31.717091 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2056/4245] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:30 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1315 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:31.737876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3baae5e6-5c59-4856-902e-9375590593b5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:31.740439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3baae5e6-5c59-4856-902e-9375590593b5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:31.743211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-fc68cc56-dcb9-4a72-8c30-bb535b49b12a req-7238701e-a57d-4dcf-8437-4bb6f9c91a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f993e7b7-677b-4ffc-a4f9-5eddaf3d3105", "name": "network-vif-plugged", "status": "completed", "tag": "dd76a2dd-f067-46e8-a492-15eec7a149c3"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:31.767727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3baae5e6-5c59-4856-902e-9375590593b5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:31.768350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3baae5e6-5c59-4856-902e-9375590593b5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:31.775183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-fc68cc56-dcb9-4a72-8c30-bb535b49b12a req-7238701e-a57d-4dcf-8437-4bb6f9c91a5c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:31.775692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3baae5e6-5c59-4856-902e-9375590593b5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:31.776940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3baae5e6-5c59-4856-902e-9375590593b5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:31.778408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-fc68cc56-dcb9-4a72-8c30-bb535b49b12a req-7238701e-a57d-4dcf-8437-4bb6f9c91a5c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:31.779167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3baae5e6-5c59-4856-902e-9375590593b5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:31.780153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3baae5e6-5c59-4856-902e-9375590593b5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:31.781468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-fc68cc56-dcb9-4a72-8c30-bb535b49b12a req-7238701e-a57d-4dcf-8437-4bb6f9c91a5c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:31.822121 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-fc68cc56-dcb9-4a72-8c30-bb535b49b12a req-7238701e-a57d-4dcf-8437-4bb6f9c91a5c service nova] Creating event network-vif-plugged:dd76a2dd-f067-46e8-a492-15eec7a149c3 for instance f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 on n-h1-852084-10 Sep 08 13:05:31.847117 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-fc68cc56-dcb9-4a72-8c30-bb535b49b12a req-7238701e-a57d-4dcf-8437-4bb6f9c91a5c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135920 Sep 08 13:05:31.848343 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2190/4246] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:05:31.859156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d698babb-abb7-4ddf-9462-8a2bbaff97f1 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:31.867826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d698babb-abb7-4ddf-9462-8a2bbaff97f1 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:31.897348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d698babb-abb7-4ddf-9462-8a2bbaff97f1 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:31.898779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d698babb-abb7-4ddf-9462-8a2bbaff97f1 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:31.900271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d698babb-abb7-4ddf-9462-8a2bbaff97f1 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:31.906347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d698babb-abb7-4ddf-9462-8a2bbaff97f1 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:31.907452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d698babb-abb7-4ddf-9462-8a2bbaff97f1 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:31.908302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d698babb-abb7-4ddf-9462-8a2bbaff97f1 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:32.024784 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3baae5e6-5c59-4856-902e-9375590593b5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/action" status: 202 len: 0 microversion: 2.1 time: 0.300843 Sep 08 13:05:32.028843 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2057/4247] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:05:31 2022] POST /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:05:32.050965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b9a7fb61-dba1-4081-aedb-ce381e5808d2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:32.062145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b9a7fb61-dba1-4081-aedb-ce381e5808d2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:32.075071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9a7fb61-dba1-4081-aedb-ce381e5808d2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:32.076104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9a7fb61-dba1-4081-aedb-ce381e5808d2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:32.077403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9a7fb61-dba1-4081-aedb-ce381e5808d2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:32.078426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9a7fb61-dba1-4081-aedb-ce381e5808d2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:32.079188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9a7fb61-dba1-4081-aedb-ce381e5808d2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:32.080878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9a7fb61-dba1-4081-aedb-ce381e5808d2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:33.395673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b9a7fb61-dba1-4081-aedb-ce381e5808d2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:33.409005 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b9a7fb61-dba1-4081-aedb-ce381e5808d2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1510 microversion: 2.1 time: 1.368760 Sep 08 13:05:33.422311 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2058/4248] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:32 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1510 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:33.433705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3931d460-e698-4499-957b-a77642d5e977 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:33.434836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3931d460-e698-4499-957b-a77642d5e977 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:33.436123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d698babb-abb7-4ddf-9462-8a2bbaff97f1 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:33.475094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3931d460-e698-4499-957b-a77642d5e977 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:33.478008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3931d460-e698-4499-957b-a77642d5e977 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:33.478709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3931d460-e698-4499-957b-a77642d5e977 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:33.479759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3931d460-e698-4499-957b-a77642d5e977 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:33.480417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3931d460-e698-4499-957b-a77642d5e977 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:33.483954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3931d460-e698-4499-957b-a77642d5e977 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:33.486376 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d698babb-abb7-4ddf-9462-8a2bbaff97f1 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1315 microversion: 2.1 time: 1.633294 Sep 08 13:05:33.493607 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2191/4249] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:31 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1315 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:33.514907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75aa2ef4-729d-4d9b-a035-f78db595c2bd tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:33.515914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-75aa2ef4-729d-4d9b-a035-f78db595c2bd tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:33.561564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75aa2ef4-729d-4d9b-a035-f78db595c2bd tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:33.565686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75aa2ef4-729d-4d9b-a035-f78db595c2bd tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:33.573779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75aa2ef4-729d-4d9b-a035-f78db595c2bd tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:33.580070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75aa2ef4-729d-4d9b-a035-f78db595c2bd tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:33.594644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75aa2ef4-729d-4d9b-a035-f78db595c2bd tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:33.595481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75aa2ef4-729d-4d9b-a035-f78db595c2bd tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:33.639986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3931d460-e698-4499-957b-a77642d5e977 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:33.662897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3931d460-e698-4499-957b-a77642d5e977 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:33.669542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3931d460-e698-4499-957b-a77642d5e977 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:33.675164 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3931d460-e698-4499-957b-a77642d5e977 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.248340 Sep 08 13:05:33.675923 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2059/4250] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:33 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:34.411142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-75aa2ef4-729d-4d9b-a035-f78db595c2bd tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:34.450682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a8aed24f-db87-4b03-ba15-284d35a917bb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:34.451556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a8aed24f-db87-4b03-ba15-284d35a917bb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:34.459244 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-75aa2ef4-729d-4d9b-a035-f78db595c2bd tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1502 microversion: 2.1 time: 0.963070 Sep 08 13:05:34.461990 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2192/4251] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:33 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1502 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:34.467872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8aed24f-db87-4b03-ba15-284d35a917bb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:34.469525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8aed24f-db87-4b03-ba15-284d35a917bb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:34.470061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8aed24f-db87-4b03-ba15-284d35a917bb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:34.474381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8aed24f-db87-4b03-ba15-284d35a917bb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:34.474911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8aed24f-db87-4b03-ba15-284d35a917bb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:34.475400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a8aed24f-db87-4b03-ba15-284d35a917bb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:34.499933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d31e305c-c587-449d-a5cc-cb1c3c37e66c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:34.500324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d31e305c-c587-449d-a5cc-cb1c3c37e66c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:34.527862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d31e305c-c587-449d-a5cc-cb1c3c37e66c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:34.528737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d31e305c-c587-449d-a5cc-cb1c3c37e66c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:34.529240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d31e305c-c587-449d-a5cc-cb1c3c37e66c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:34.529980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d31e305c-c587-449d-a5cc-cb1c3c37e66c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:34.533782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d31e305c-c587-449d-a5cc-cb1c3c37e66c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:34.534544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d31e305c-c587-449d-a5cc-cb1c3c37e66c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:34.788895 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d31e305c-c587-449d-a5cc-cb1c3c37e66c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "DELETE /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.293419 Sep 08 13:05:34.790155 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2193/4252] 10.222.0.78 () {58 vars in 1296 bytes} [Thu Sep 8 13:05:34 2022] DELETE /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8/os-server-password => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:05:34.804923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-859668a5-104e-42f0-8e1d-d8d9c4507e6b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:34.805953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-859668a5-104e-42f0-8e1d-d8d9c4507e6b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:34.813563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-859668a5-104e-42f0-8e1d-d8d9c4507e6b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:34.814528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-859668a5-104e-42f0-8e1d-d8d9c4507e6b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:34.815811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-859668a5-104e-42f0-8e1d-d8d9c4507e6b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:34.817276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-859668a5-104e-42f0-8e1d-d8d9c4507e6b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:34.818319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-859668a5-104e-42f0-8e1d-d8d9c4507e6b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:34.820825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-859668a5-104e-42f0-8e1d-d8d9c4507e6b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:35.236363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a8aed24f-db87-4b03-ba15-284d35a917bb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:35.260949 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a8aed24f-db87-4b03-ba15-284d35a917bb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1510 microversion: 2.1 time: 0.815752 Sep 08 13:05:35.265389 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2060/4253] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:34 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1510 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:35.282589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ded06271-666f-4ebd-a2c6-d1d883bf923f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:35.284374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ded06271-666f-4ebd-a2c6-d1d883bf923f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:35.305141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ded06271-666f-4ebd-a2c6-d1d883bf923f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:35.308424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ded06271-666f-4ebd-a2c6-d1d883bf923f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:35.309602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ded06271-666f-4ebd-a2c6-d1d883bf923f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:35.311039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ded06271-666f-4ebd-a2c6-d1d883bf923f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:35.312198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ded06271-666f-4ebd-a2c6-d1d883bf923f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:35.313491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ded06271-666f-4ebd-a2c6-d1d883bf923f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:35.345471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-859668a5-104e-42f0-8e1d-d8d9c4507e6b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:35.371742 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-859668a5-104e-42f0-8e1d-d8d9c4507e6b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1502 microversion: 2.1 time: 0.578835 Sep 08 13:05:35.381985 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2194/4254] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:34 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1502 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:35.391861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b98c0cf4-267f-4423-aaec-aaec984eba6c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:35.392686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b98c0cf4-267f-4423-aaec-aaec984eba6c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:35.423134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b98c0cf4-267f-4423-aaec-aaec984eba6c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:35.424047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b98c0cf4-267f-4423-aaec-aaec984eba6c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:35.424837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b98c0cf4-267f-4423-aaec-aaec984eba6c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:35.426071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b98c0cf4-267f-4423-aaec-aaec984eba6c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:35.426846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b98c0cf4-267f-4423-aaec-aaec984eba6c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:35.429681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b98c0cf4-267f-4423-aaec-aaec984eba6c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:35.508471 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b98c0cf4-267f-4423-aaec-aaec984eba6c tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.124195 Sep 08 13:05:35.511786 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2195/4255] 10.222.0.78 () {58 vars in 1293 bytes} [Thu Sep 8 13:05:35 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8/os-server-password => generated 16 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:05:35.531671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d5d009e6-989d-4a44-9c2d-f08c27eebdb5 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:35.532881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d5d009e6-989d-4a44-9c2d-f08c27eebdb5 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:35.557674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5d009e6-989d-4a44-9c2d-f08c27eebdb5 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:35.558562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5d009e6-989d-4a44-9c2d-f08c27eebdb5 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:35.559199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5d009e6-989d-4a44-9c2d-f08c27eebdb5 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:35.560197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5d009e6-989d-4a44-9c2d-f08c27eebdb5 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:35.560841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5d009e6-989d-4a44-9c2d-f08c27eebdb5 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:35.561432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5d009e6-989d-4a44-9c2d-f08c27eebdb5 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:35.607667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ded06271-666f-4ebd-a2c6-d1d883bf923f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:35.644845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ded06271-666f-4ebd-a2c6-d1d883bf923f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:35.652617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ded06271-666f-4ebd-a2c6-d1d883bf923f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:35.665634 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ded06271-666f-4ebd-a2c6-d1d883bf923f tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.396749 Sep 08 13:05:35.667554 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2061/4256] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:35 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:35.678222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-479347ae-4c86-4a83-b5fa-9c1b20afd03d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:35.679986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-479347ae-4c86-4a83-b5fa-9c1b20afd03d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:35.691848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479347ae-4c86-4a83-b5fa-9c1b20afd03d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:35.693177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479347ae-4c86-4a83-b5fa-9c1b20afd03d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:35.694283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479347ae-4c86-4a83-b5fa-9c1b20afd03d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:35.696334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479347ae-4c86-4a83-b5fa-9c1b20afd03d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:35.697502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479347ae-4c86-4a83-b5fa-9c1b20afd03d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:35.698580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479347ae-4c86-4a83-b5fa-9c1b20afd03d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:35.758228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-479347ae-4c86-4a83-b5fa-9c1b20afd03d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:05:35.911570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:35.987990 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-479347ae-4c86-4a83-b5fa-9c1b20afd03d tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "DELETE /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 204 len: 0 microversion: 2.1 time: 0.317327 Sep 08 13:05:35.998017 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2062/4257] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:05:35 2022] DELETE /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:05:36.012745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f562570-52c1-4033-bac9-47da96b3fb03 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:36.015446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f562570-52c1-4033-bac9-47da96b3fb03 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:36.027957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f562570-52c1-4033-bac9-47da96b3fb03 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:36.028450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f562570-52c1-4033-bac9-47da96b3fb03 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:36.031382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f562570-52c1-4033-bac9-47da96b3fb03 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:36.033757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f562570-52c1-4033-bac9-47da96b3fb03 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:36.038016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f562570-52c1-4033-bac9-47da96b3fb03 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:36.041166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f562570-52c1-4033-bac9-47da96b3fb03 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:36.206595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d5d009e6-989d-4a44-9c2d-f08c27eebdb5 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:36.237740 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d5d009e6-989d-4a44-9c2d-f08c27eebdb5 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1502 microversion: 2.1 time: 0.723745 Sep 08 13:05:36.241188 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2196/4258] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:35 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1502 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:36.287347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-032a5433-e2dc-4a51-8239-28dca89ddaf0 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:36.288009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-032a5433-e2dc-4a51-8239-28dca89ddaf0 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:36.310095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-032a5433-e2dc-4a51-8239-28dca89ddaf0 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:36.311579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-032a5433-e2dc-4a51-8239-28dca89ddaf0 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:36.312515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-032a5433-e2dc-4a51-8239-28dca89ddaf0 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:36.313907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-032a5433-e2dc-4a51-8239-28dca89ddaf0 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:36.315735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-032a5433-e2dc-4a51-8239-28dca89ddaf0 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:36.316677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-032a5433-e2dc-4a51-8239-28dca89ddaf0 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:36.408865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-032a5433-e2dc-4a51-8239-28dca89ddaf0 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lazy-loading 'flavor' on Instance uuid f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:05:36.581056 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-032a5433-e2dc-4a51-8239-28dca89ddaf0 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "POST /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105/action" status: 202 len: 0 microversion: 2.1 time: 0.299322 Sep 08 13:05:36.586392 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2197/4259] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:05:36 2022] POST /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:05:36.605717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-48813f01-bc89-4c09-a2a5-6bed51f8f235 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:36.606724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-48813f01-bc89-4c09-a2a5-6bed51f8f235 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:36.627191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48813f01-bc89-4c09-a2a5-6bed51f8f235 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:36.628370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48813f01-bc89-4c09-a2a5-6bed51f8f235 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:36.629551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48813f01-bc89-4c09-a2a5-6bed51f8f235 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:36.630776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48813f01-bc89-4c09-a2a5-6bed51f8f235 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:36.631453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48813f01-bc89-4c09-a2a5-6bed51f8f235 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:36.632159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48813f01-bc89-4c09-a2a5-6bed51f8f235 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:36.788569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f562570-52c1-4033-bac9-47da96b3fb03 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:36.825496 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f562570-52c1-4033-bac9-47da96b3fb03 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1508 microversion: 2.1 time: 0.823302 Sep 08 13:05:36.827911 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2063/4260] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:35 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1508 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:36.841377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63ff7bcc-5d24-4659-91b1-7b5e1eb3e92c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:36.844913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-63ff7bcc-5d24-4659-91b1-7b5e1eb3e92c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:36.884538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63ff7bcc-5d24-4659-91b1-7b5e1eb3e92c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:36.892336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63ff7bcc-5d24-4659-91b1-7b5e1eb3e92c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:36.893207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63ff7bcc-5d24-4659-91b1-7b5e1eb3e92c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:36.898912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63ff7bcc-5d24-4659-91b1-7b5e1eb3e92c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:36.902240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63ff7bcc-5d24-4659-91b1-7b5e1eb3e92c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:36.903853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63ff7bcc-5d24-4659-91b1-7b5e1eb3e92c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:37.213051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-48813f01-bc89-4c09-a2a5-6bed51f8f235 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:37.230725 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-48813f01-bc89-4c09-a2a5-6bed51f8f235 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1516 microversion: 2.1 time: 0.640004 Sep 08 13:05:37.231505 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2198/4261] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:36 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1516 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:37.241305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b240a9b7-5589-4365-85a7-56ef5374edd1 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:37.253297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b240a9b7-5589-4365-85a7-56ef5374edd1 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:37.273198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b240a9b7-5589-4365-85a7-56ef5374edd1 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:37.274093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b240a9b7-5589-4365-85a7-56ef5374edd1 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:37.275009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b240a9b7-5589-4365-85a7-56ef5374edd1 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:37.276335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b240a9b7-5589-4365-85a7-56ef5374edd1 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:37.277161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b240a9b7-5589-4365-85a7-56ef5374edd1 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:37.283494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b240a9b7-5589-4365-85a7-56ef5374edd1 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:37.296206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=5 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:37.658826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b240a9b7-5589-4365-85a7-56ef5374edd1 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:37.698851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b240a9b7-5589-4365-85a7-56ef5374edd1 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:37.702500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b240a9b7-5589-4365-85a7-56ef5374edd1 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:37.706644 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b240a9b7-5589-4365-85a7-56ef5374edd1 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.473714 Sep 08 13:05:37.708655 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2199/4262] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:37 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:37.804661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-63ff7bcc-5d24-4659-91b1-7b5e1eb3e92c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:37.825974 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-63ff7bcc-5d24-4659-91b1-7b5e1eb3e92c tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1510 microversion: 2.1 time: 0.994517 Sep 08 13:05:37.828349 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2064/4263] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:36 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1510 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:37.875924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3dddb989-f1bc-47a5-81e2-21eb1556012e tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:37.883290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3dddb989-f1bc-47a5-81e2-21eb1556012e tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:37.909588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dddb989-f1bc-47a5-81e2-21eb1556012e tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:37.914152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dddb989-f1bc-47a5-81e2-21eb1556012e tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:37.916137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dddb989-f1bc-47a5-81e2-21eb1556012e tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:37.919685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dddb989-f1bc-47a5-81e2-21eb1556012e tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:37.923189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dddb989-f1bc-47a5-81e2-21eb1556012e tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:37.928007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dddb989-f1bc-47a5-81e2-21eb1556012e tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:38.571001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-789798033", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "c24d9e68-6af7-4b43-9b8a-f0188f08d888"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:38.684966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3dddb989-f1bc-47a5-81e2-21eb1556012e tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:38.702876 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3dddb989-f1bc-47a5-81e2-21eb1556012e tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1508 microversion: 2.1 time: 0.836339 Sep 08 13:05:38.710593 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2065/4264] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:37 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1508 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:38.762821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9595a94d-7910-485f-8048-befe29d487d3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:38.763592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9595a94d-7910-485f-8048-befe29d487d3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:38.775580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9595a94d-7910-485f-8048-befe29d487d3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:38.780411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9595a94d-7910-485f-8048-befe29d487d3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:38.786650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9595a94d-7910-485f-8048-befe29d487d3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:38.787670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9595a94d-7910-485f-8048-befe29d487d3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:38.791842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9595a94d-7910-485f-8048-befe29d487d3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:38.792448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9595a94d-7910-485f-8048-befe29d487d3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:38.923830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] validate_networks() for [('c24d9e68-6af7-4b43-9b8a-f0188f08d888', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:05:39.529368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9595a94d-7910-485f-8048-befe29d487d3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:39.545150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9595a94d-7910-485f-8048-befe29d487d3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:39.546724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9595a94d-7910-485f-8048-befe29d487d3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:39.549235 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9595a94d-7910-485f-8048-befe29d487d3 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.790203 Sep 08 13:05:39.560697 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2066/4265] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:38 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:05:39.601109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2abd7eb2-5824-4369-9458-a6450bfeca95 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:39.601738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2abd7eb2-5824-4369-9458-a6450bfeca95 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:39.631720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2abd7eb2-5824-4369-9458-a6450bfeca95 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:39.632237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2abd7eb2-5824-4369-9458-a6450bfeca95 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:39.632689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2abd7eb2-5824-4369-9458-a6450bfeca95 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:39.633436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2abd7eb2-5824-4369-9458-a6450bfeca95 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:39.634056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2abd7eb2-5824-4369-9458-a6450bfeca95 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:39.634503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2abd7eb2-5824-4369-9458-a6450bfeca95 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:40.759582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2abd7eb2-5824-4369-9458-a6450bfeca95 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:40.789945 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2abd7eb2-5824-4369-9458-a6450bfeca95 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1493 microversion: 2.1 time: 1.213787 Sep 08 13:05:40.835703 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2067/4266] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:39 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1493 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:40.874648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:40.886619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:40.910521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:40.912201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:40.912875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:40.913818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:40.915377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:40.916135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:40.976396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:40.977244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:40.977879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:40.978583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lazy-loading 'fault' on Instance uuid 09056cb0-d150-40fa-8001-acdf52066ba8 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:05:41.128304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2621e43bb2074ef7b04e10e82c0c2de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '511145520efa4e9080fcda708326930c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:41.202481 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7c82bebf-4296-47a6-8835-214e83889793 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 200 len: 1305 microversion: 2.1 time: 0.344097 Sep 08 13:05:41.207743 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2068/4267] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:40 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 1305 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:41.222938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-81d22df0-43a6-4b3c-ad55-c3e9977c68c7 req-31108175-f5a7-4bd3-b60a-a6aa7d9c4d0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09056cb0-d150-40fa-8001-acdf52066ba8", "name": "network-vif-deleted", "tag": "0ddeedae-3f13-4191-bc0d-be0f45345674"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:41.250500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-81d22df0-43a6-4b3c-ad55-c3e9977c68c7 req-31108175-f5a7-4bd3-b60a-a6aa7d9c4d0a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:41.251631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-81d22df0-43a6-4b3c-ad55-c3e9977c68c7 req-31108175-f5a7-4bd3-b60a-a6aa7d9c4d0a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:41.252756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-81d22df0-43a6-4b3c-ad55-c3e9977c68c7 req-31108175-f5a7-4bd3-b60a-a6aa7d9c4d0a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:41.285925 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-81d22df0-43a6-4b3c-ad55-c3e9977c68c7 req-31108175-f5a7-4bd3-b60a-a6aa7d9c4d0a service nova] Creating event network-vif-deleted:0ddeedae-3f13-4191-bc0d-be0f45345674 for instance 09056cb0-d150-40fa-8001-acdf52066ba8 on n-h2-852084-10 Sep 08 13:05:41.319427 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-81d22df0-43a6-4b3c-ad55-c3e9977c68c7 req-31108175-f5a7-4bd3-b60a-a6aa7d9c4d0a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107806 Sep 08 13:05:41.330174 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2069/4268] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:05:41.348648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6161c38e-68e1-47da-bd70-fa1cd5f46c89 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:41.351648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6161c38e-68e1-47da-bd70-fa1cd5f46c89 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:41.376179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6161c38e-68e1-47da-bd70-fa1cd5f46c89 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:41.377078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6161c38e-68e1-47da-bd70-fa1cd5f46c89 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:41.390366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6161c38e-68e1-47da-bd70-fa1cd5f46c89 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:41.396485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6161c38e-68e1-47da-bd70-fa1cd5f46c89 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:41.397031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6161c38e-68e1-47da-bd70-fa1cd5f46c89 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:41.404059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6161c38e-68e1-47da-bd70-fa1cd5f46c89 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:41.647184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:05:41.648619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:05:41.650021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:05:41.650788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:05:41.651752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:05:41.689023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:41.689929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:41.690754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:41.714010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:41.715329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:41.716234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:41.725183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6161c38e-68e1-47da-bd70-fa1cd5f46c89 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:41.762985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6161c38e-68e1-47da-bd70-fa1cd5f46c89 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:41.771147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6161c38e-68e1-47da-bd70-fa1cd5f46c89 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:41.776911 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6161c38e-68e1-47da-bd70-fa1cd5f46c89 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.444083 Sep 08 13:05:41.782494 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2070/4269] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:41 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:41.809627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1701c772-9f69-4879-b050-0682b20e95ee tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:41.819995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1701c772-9f69-4879-b050-0682b20e95ee tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:41.824676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Getting quotas for project 8f2476e462d24206bfc7db3934d482a8. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:05:41.868915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1701c772-9f69-4879-b050-0682b20e95ee tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:41.869583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1701c772-9f69-4879-b050-0682b20e95ee tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:41.870333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1701c772-9f69-4879-b050-0682b20e95ee tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:41.871672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1701c772-9f69-4879-b050-0682b20e95ee tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:41.872546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1701c772-9f69-4879-b050-0682b20e95ee tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:41.873355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1701c772-9f69-4879-b050-0682b20e95ee tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:41.883009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Getting quotas for user 3492d45795b54d66996d692562d02ed5 and project 8f2476e462d24206bfc7db3934d482a8. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:05:41.964369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:05:41.969419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:05:42.044399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:42.085612 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-11338483-b784-4524-949f-0b95274feb1f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.374115 Sep 08 13:05:42.098177 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2200/4270] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:05:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 4387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:05:42.102073 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1701c772-9f69-4879-b050-0682b20e95ee tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "POST /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105/action" status: 202 len: 0 microversion: 2.1 time: 0.310893 Sep 08 13:05:42.107082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c28aae08-f4f8-4653-b214-a1d6293eb1e1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'create', calling method: .version_select at 0x7fdb35b0e160>, body: {"keypair": {"name": "tempest-keypair-742012241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPHx8Dizmfzsd6vALxmTf+FKtXICu2V6vo3kpt4WMmcsXO3sCOFJUkIoI0KHme4OVxo9UvJCxIa/M3QN2rsfT0ZfA5DPrue6PJ/hjYWbQEWx29r+4o5pRU9KrgO3d7m/Uw=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:42.108510 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2071/4271] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:05:41 2022] POST /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:05:42.117753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d29f099b-5aea-429b-bc4e-be172f299506 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:42.136633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d29f099b-5aea-429b-bc4e-be172f299506 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:42.180576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-c28aae08-f4f8-4653-b214-a1d6293eb1e1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Getting quotas for project 4a806bce1ce8422790726f1f12f681ba. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:05:42.194212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-c28aae08-f4f8-4653-b214-a1d6293eb1e1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Getting quotas for user 0d312121b259412dbf82c519a49285f4 and project 4a806bce1ce8422790726f1f12f681ba. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:05:42.299003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d29f099b-5aea-429b-bc4e-be172f299506 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:42.334075 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d29f099b-5aea-429b-bc4e-be172f299506 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1224 microversion: 2.1 time: 0.221004 Sep 08 13:05:42.342548 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c28aae08-f4f8-4653-b214-a1d6293eb1e1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.242593 Sep 08 13:05:42.344656 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2201/4272] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:05:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:05:42.348009 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2072/4273] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:42 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1224 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:42.354179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e8103c3b-4462-400d-b58c-30a50af8081b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:42.367987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e8103c3b-4462-400d-b58c-30a50af8081b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:42.382360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e0877552-9af7-4bfd-b6c9-541f117bf555 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:42.383592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e0877552-9af7-4bfd-b6c9-541f117bf555 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] [instance: 09056cb0-d150-40fa-8001-acdf52066ba8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:42.397042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8103c3b-4462-400d-b58c-30a50af8081b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:42.398772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8103c3b-4462-400d-b58c-30a50af8081b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:42.400797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8103c3b-4462-400d-b58c-30a50af8081b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:42.402772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8103c3b-4462-400d-b58c-30a50af8081b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:42.407487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8103c3b-4462-400d-b58c-30a50af8081b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:42.407809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0877552-9af7-4bfd-b6c9-541f117bf555 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:42.408462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0877552-9af7-4bfd-b6c9-541f117bf555 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:42.410056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0877552-9af7-4bfd-b6c9-541f117bf555 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:42.410906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e8103c3b-4462-400d-b58c-30a50af8081b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:42.412439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0877552-9af7-4bfd-b6c9-541f117bf555 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:42.413555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0877552-9af7-4bfd-b6c9-541f117bf555 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:42.433318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0877552-9af7-4bfd-b6c9-541f117bf555 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:42.464914 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e0877552-9af7-4bfd-b6c9-541f117bf555 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] HTTP exception thrown: Instance 09056cb0-d150-40fa-8001-acdf52066ba8 could not be found. Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e0877552-9af7-4bfd-b6c9-541f117bf555 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Request method failure captured: Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 HTTP/1.1 Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeh9gjd8D7B9dv9gtSi9EcsZtRVY2dS0LGPC6Gymy6fn5-SDperZF3wAvuzTvV9_ekfZK1VJW8-oZ4xk9DO9wh5GmDZXHcNxWe4Qp2TLJ00S-qu5cZ5lsVzWJrFNXbUWaOFCNbCXXWlTBHLSRRoEdqtmRaMTZblaOOOx5nI4_7R1TwE Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 511145520efa4e9080fcda708326930c Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerPasswordTestJSON-1226441597 Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_511145520efa4e9080fcda708326930c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/511145520efa4e9080fcda708326930c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/511145520efa4e9080fcda708326930c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/511145520efa4e9080fcda708326930c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerPasswordTestJSON-1226441597 Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 511145520efa4e9080fcda708326930c Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1226441597 Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerPasswordTestJSON-1226441597-project Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2621e43bb2074ef7b04e10e82c0c2de0 Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerPasswordTestJSON-1226441597-project Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 09056cb0-d150-40fa-8001-acdf52066ba8 could not be found. Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '09056cb0-d150-40fa-8001-acdf52066ba8'} Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09056cb0-d150-40fa-8001-acdf52066ba8 could not be found. Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09056cb0-d150-40fa-8001-acdf52066ba8 could not be found. Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:05:42.468745 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:05:42.478338 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:05:42.478338 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:05:42.478338 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:05:42.478338 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:05:42.478338 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:05:42.478338 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09056cb0-d150-40fa-8001-acdf52066ba8 could not be found. Sep 08 13:05:42.478338 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:05:42.483464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e0877552-9af7-4bfd-b6c9-541f117bf555 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] Returning 404 to user: Instance 09056cb0-d150-40fa-8001-acdf52066ba8 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:05:42.483464 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e0877552-9af7-4bfd-b6c9-541f117bf555 tempest-ServerPasswordTestJSON-1226441597 tempest-ServerPasswordTestJSON-1226441597-project] 10.222.0.78 "GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8" status: 404 len: 111 microversion: 2.1 time: 0.132012 Sep 08 13:05:42.485731 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2073/4274] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:42 2022] GET /compute/v2.1/servers/09056cb0-d150-40fa-8001-acdf52066ba8 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:05:42.842460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4691bbcf-ae36-4c4d-8186-7db3d2478e0e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:42.843524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4691bbcf-ae36-4c4d-8186-7db3d2478e0e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:42.863624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4691bbcf-ae36-4c4d-8186-7db3d2478e0e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:42.864158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4691bbcf-ae36-4c4d-8186-7db3d2478e0e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:42.865187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4691bbcf-ae36-4c4d-8186-7db3d2478e0e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:42.866024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4691bbcf-ae36-4c4d-8186-7db3d2478e0e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:42.881869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4691bbcf-ae36-4c4d-8186-7db3d2478e0e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:42.882458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4691bbcf-ae36-4c4d-8186-7db3d2478e0e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:43.123814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4691bbcf-ae36-4c4d-8186-7db3d2478e0e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:43.142618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4691bbcf-ae36-4c4d-8186-7db3d2478e0e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:43.159983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4691bbcf-ae36-4c4d-8186-7db3d2478e0e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:43.162421 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4691bbcf-ae36-4c4d-8186-7db3d2478e0e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.323505 Sep 08 13:05:43.163409 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2074/4275] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:42 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:05:43.386016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-68073290-9384-40b7-b7e0-b6b55c138363 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:43.397344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-68073290-9384-40b7-b7e0-b6b55c138363 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:43.419810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e8103c3b-4462-400d-b58c-30a50af8081b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:43.447802 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e8103c3b-4462-400d-b58c-30a50af8081b tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1499 microversion: 2.1 time: 1.101198 Sep 08 13:05:43.477007 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2202/4276] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:42 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1499 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:43.678555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-68073290-9384-40b7-b7e0-b6b55c138363 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:43.794032 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-68073290-9384-40b7-b7e0-b6b55c138363 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1224 microversion: 2.1 time: 0.414576 Sep 08 13:05:43.798297 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2075/4277] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:43 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1224 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:44.222434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-008fdce6-3ed0-4bfb-a452-c832813945b4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:44.228805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-008fdce6-3ed0-4bfb-a452-c832813945b4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:44.276775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-008fdce6-3ed0-4bfb-a452-c832813945b4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:44.284379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-008fdce6-3ed0-4bfb-a452-c832813945b4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:44.285797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-008fdce6-3ed0-4bfb-a452-c832813945b4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:44.293101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-008fdce6-3ed0-4bfb-a452-c832813945b4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:44.310592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-008fdce6-3ed0-4bfb-a452-c832813945b4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:44.316245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-008fdce6-3ed0-4bfb-a452-c832813945b4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:44.506945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9f51a762-27e7-494c-bc3e-add8fc0e7028 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:44.509167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9f51a762-27e7-494c-bc3e-add8fc0e7028 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:44.526629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f51a762-27e7-494c-bc3e-add8fc0e7028 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:44.528184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f51a762-27e7-494c-bc3e-add8fc0e7028 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:44.529341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f51a762-27e7-494c-bc3e-add8fc0e7028 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:44.531059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f51a762-27e7-494c-bc3e-add8fc0e7028 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:44.535963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f51a762-27e7-494c-bc3e-add8fc0e7028 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:44.543649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f51a762-27e7-494c-bc3e-add8fc0e7028 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:45.378151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-008fdce6-3ed0-4bfb-a452-c832813945b4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:45.430601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-008fdce6-3ed0-4bfb-a452-c832813945b4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:45.441349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-008fdce6-3ed0-4bfb-a452-c832813945b4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:45.452530 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-008fdce6-3ed0-4bfb-a452-c832813945b4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 1.235336 Sep 08 13:05:45.457489 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2203/4278] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:44 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:45.481899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8b81070c-af04-4117-9966-aed869e0fb18 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:45.484555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8b81070c-af04-4117-9966-aed869e0fb18 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:45.518834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b81070c-af04-4117-9966-aed869e0fb18 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:45.520418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b81070c-af04-4117-9966-aed869e0fb18 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:45.521717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b81070c-af04-4117-9966-aed869e0fb18 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:45.523592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b81070c-af04-4117-9966-aed869e0fb18 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:45.530995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b81070c-af04-4117-9966-aed869e0fb18 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:45.534075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b81070c-af04-4117-9966-aed869e0fb18 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:46.114470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8b81070c-af04-4117-9966-aed869e0fb18 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:46.139936 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8b81070c-af04-4117-9966-aed869e0fb18 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1294 microversion: 2.1 time: 0.679857 Sep 08 13:05:46.145198 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2204/4279] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:45 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1294 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:46.437619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9f51a762-27e7-494c-bc3e-add8fc0e7028 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:46.461310 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9f51a762-27e7-494c-bc3e-add8fc0e7028 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1499 microversion: 2.1 time: 1.965919 Sep 08 13:05:46.462395 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2076/4280] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:44 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1499 bytes in 1969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:46.507867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-02c819f1-16f1-400d-b981-f8d90b0a2479 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:46.508511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-02c819f1-16f1-400d-b981-f8d90b0a2479 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:46.530326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02c819f1-16f1-400d-b981-f8d90b0a2479 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:46.538598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02c819f1-16f1-400d-b981-f8d90b0a2479 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:46.539648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02c819f1-16f1-400d-b981-f8d90b0a2479 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:46.541193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02c819f1-16f1-400d-b981-f8d90b0a2479 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:46.542035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02c819f1-16f1-400d-b981-f8d90b0a2479 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:46.548299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02c819f1-16f1-400d-b981-f8d90b0a2479 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:46.842814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-02c819f1-16f1-400d-b981-f8d90b0a2479 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:46.875531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-02c819f1-16f1-400d-b981-f8d90b0a2479 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:46.884066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-02c819f1-16f1-400d-b981-f8d90b0a2479 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:46.889393 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-02c819f1-16f1-400d-b981-f8d90b0a2479 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.386998 Sep 08 13:05:46.897400 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2205/4281] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:46 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:47.183358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0a06b1b0-2398-4dff-a0a9-79fa54411574 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:47.185465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0a06b1b0-2398-4dff-a0a9-79fa54411574 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:47.213571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a06b1b0-2398-4dff-a0a9-79fa54411574 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:47.215392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a06b1b0-2398-4dff-a0a9-79fa54411574 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:47.221326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a06b1b0-2398-4dff-a0a9-79fa54411574 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:47.224863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a06b1b0-2398-4dff-a0a9-79fa54411574 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:47.225679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a06b1b0-2398-4dff-a0a9-79fa54411574 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:47.226404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a06b1b0-2398-4dff-a0a9-79fa54411574 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:47.498353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0a06b1b0-2398-4dff-a0a9-79fa54411574 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:47.510730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-774bec75-2e6e-4c1b-b2cf-129e0a71d76a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:47.512184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-774bec75-2e6e-4c1b-b2cf-129e0a71d76a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:47.519712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-774bec75-2e6e-4c1b-b2cf-129e0a71d76a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:47.520649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-774bec75-2e6e-4c1b-b2cf-129e0a71d76a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:47.521760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-774bec75-2e6e-4c1b-b2cf-129e0a71d76a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:47.522725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-774bec75-2e6e-4c1b-b2cf-129e0a71d76a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:47.523466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-774bec75-2e6e-4c1b-b2cf-129e0a71d76a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:47.524071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-774bec75-2e6e-4c1b-b2cf-129e0a71d76a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:47.547217 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0a06b1b0-2398-4dff-a0a9-79fa54411574 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1282 microversion: 2.1 time: 0.365790 Sep 08 13:05:47.556610 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2077/4282] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:47 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1282 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:47.936160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-69d35813-2888-4248-88a2-a766651f3284 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:47.940612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-69d35813-2888-4248-88a2-a766651f3284 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:47.977200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d35813-2888-4248-88a2-a766651f3284 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:47.980684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d35813-2888-4248-88a2-a766651f3284 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:47.981910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d35813-2888-4248-88a2-a766651f3284 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:47.984199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d35813-2888-4248-88a2-a766651f3284 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:47.985498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d35813-2888-4248-88a2-a766651f3284 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:47.987122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d35813-2888-4248-88a2-a766651f3284 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:48.697738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-69d35813-2888-4248-88a2-a766651f3284 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:48.722076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-69d35813-2888-4248-88a2-a766651f3284 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:48.724973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-774bec75-2e6e-4c1b-b2cf-129e0a71d76a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:48.728562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-69d35813-2888-4248-88a2-a766651f3284 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:48.731807 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-69d35813-2888-4248-88a2-a766651f3284 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.804867 Sep 08 13:05:48.734080 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2078/4283] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:47 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:48.756748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2fd9d5e9-b57f-4c16-be7d-6fff195297e4 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:48.758760 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-774bec75-2e6e-4c1b-b2cf-129e0a71d76a tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1502 microversion: 2.1 time: 1.255689 Sep 08 13:05:48.759878 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2206/4284] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:47 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1502 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:05:48.780781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2fd9d5e9-b57f-4c16-be7d-6fff195297e4 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:48.808255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a2e2356c-4db6-4e46-b124-b5a87c1e60d8 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:48.809121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a2e2356c-4db6-4e46-b124-b5a87c1e60d8 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:48.815889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fd9d5e9-b57f-4c16-be7d-6fff195297e4 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:48.816892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fd9d5e9-b57f-4c16-be7d-6fff195297e4 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:48.817609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fd9d5e9-b57f-4c16-be7d-6fff195297e4 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:48.819308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2e2356c-4db6-4e46-b124-b5a87c1e60d8 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:48.820039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2e2356c-4db6-4e46-b124-b5a87c1e60d8 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:48.820655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2e2356c-4db6-4e46-b124-b5a87c1e60d8 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:48.822264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2e2356c-4db6-4e46-b124-b5a87c1e60d8 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:48.823150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2e2356c-4db6-4e46-b124-b5a87c1e60d8 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:48.823953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a2e2356c-4db6-4e46-b124-b5a87c1e60d8 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:48.825147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fd9d5e9-b57f-4c16-be7d-6fff195297e4 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:48.826864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fd9d5e9-b57f-4c16-be7d-6fff195297e4 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:48.827908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fd9d5e9-b57f-4c16-be7d-6fff195297e4 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:48.918915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-a2e2356c-4db6-4e46-b124-b5a87c1e60d8 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lazy-loading 'flavor' on Instance uuid f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:05:49.158161 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a2e2356c-4db6-4e46-b124-b5a87c1e60d8 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "POST /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105/action" status: 202 len: 0 microversion: 2.1 time: 0.331702 Sep 08 13:05:49.175074 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2207/4285] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:05:48 2022] POST /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:05:49.203193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9d164364-85bb-4f9d-93b3-4e4f77b9ab24 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:49.206678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9d164364-85bb-4f9d-93b3-4e4f77b9ab24 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:49.216313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d164364-85bb-4f9d-93b3-4e4f77b9ab24 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:49.217464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d164364-85bb-4f9d-93b3-4e4f77b9ab24 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:49.217736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d164364-85bb-4f9d-93b3-4e4f77b9ab24 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:49.218631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d164364-85bb-4f9d-93b3-4e4f77b9ab24 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:49.219584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d164364-85bb-4f9d-93b3-4e4f77b9ab24 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:49.220137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d164364-85bb-4f9d-93b3-4e4f77b9ab24 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:49.270081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2fd9d5e9-b57f-4c16-be7d-6fff195297e4 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:49.303925 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2fd9d5e9-b57f-4c16-be7d-6fff195297e4 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1282 microversion: 2.1 time: 0.566187 Sep 08 13:05:49.305725 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2079/4286] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:48 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1282 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:49.791164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f6f6e4cd-5c87-4862-9520-a4c141fce3f2 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:49.794216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f6f6e4cd-5c87-4862-9520-a4c141fce3f2 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:49.809552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6f6e4cd-5c87-4862-9520-a4c141fce3f2 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:49.811148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6f6e4cd-5c87-4862-9520-a4c141fce3f2 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:49.812677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6f6e4cd-5c87-4862-9520-a4c141fce3f2 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:49.814713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6f6e4cd-5c87-4862-9520-a4c141fce3f2 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:49.816096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6f6e4cd-5c87-4862-9520-a4c141fce3f2 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:49.817246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6f6e4cd-5c87-4862-9520-a4c141fce3f2 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:49.995087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f6f6e4cd-5c87-4862-9520-a4c141fce3f2 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:50.016563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f6f6e4cd-5c87-4862-9520-a4c141fce3f2 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:50.042370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f6f6e4cd-5c87-4862-9520-a4c141fce3f2 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:50.049294 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f6f6e4cd-5c87-4862-9520-a4c141fce3f2 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.269070 Sep 08 13:05:50.080683 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2080/4287] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:49 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:05:50.086754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d164364-85bb-4f9d-93b3-4e4f77b9ab24 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:50.111655 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9d164364-85bb-4f9d-93b3-4e4f77b9ab24 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1510 microversion: 2.1 time: 0.930022 Sep 08 13:05:50.117070 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2208/4288] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:49 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1510 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:50.128398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-524954009", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e1bd9f4c-1ea4-4b7b-92de-99c0075cba0d"}], "security_groups": [{"name": "tempest-securitygroup--67807240"}], "key_name": "tempest-keypair-742012241", "user_data": "}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:50.358669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d9c24e5c-d59d-4607-901c-a0bb923b8d30 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:50.358669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d9c24e5c-d59d-4607-901c-a0bb923b8d30 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:50.384921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9c24e5c-d59d-4607-901c-a0bb923b8d30 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:50.386271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9c24e5c-d59d-4607-901c-a0bb923b8d30 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:50.387264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9c24e5c-d59d-4607-901c-a0bb923b8d30 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:50.388935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9c24e5c-d59d-4607-901c-a0bb923b8d30 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:50.391350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9c24e5c-d59d-4607-901c-a0bb923b8d30 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:50.392632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9c24e5c-d59d-4607-901c-a0bb923b8d30 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:50.668670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] validate_networks() for [('e1bd9f4c-1ea4-4b7b-92de-99c0075cba0d', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:05:51.166721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d9c24e5c-d59d-4607-901c-a0bb923b8d30 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:51.184135 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d9c24e5c-d59d-4607-901c-a0bb923b8d30 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1324 microversion: 2.1 time: 0.831838 Sep 08 13:05:51.187145 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2209/4289] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:50 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1324 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:51.210806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-01c047ef-8d1b-4791-868f-4a6d533043a7 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:51.213113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-01c047ef-8d1b-4791-868f-4a6d533043a7 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:51.237265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01c047ef-8d1b-4791-868f-4a6d533043a7 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:51.238892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01c047ef-8d1b-4791-868f-4a6d533043a7 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:51.240157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01c047ef-8d1b-4791-868f-4a6d533043a7 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:51.246362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01c047ef-8d1b-4791-868f-4a6d533043a7 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:51.247397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01c047ef-8d1b-4791-868f-4a6d533043a7 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:51.248597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01c047ef-8d1b-4791-868f-4a6d533043a7 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:51.451624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-01c047ef-8d1b-4791-868f-4a6d533043a7 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:51.472746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-01c047ef-8d1b-4791-868f-4a6d533043a7 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:51.476692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-01c047ef-8d1b-4791-868f-4a6d533043a7 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:51.479929 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-01c047ef-8d1b-4791-868f-4a6d533043a7 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.290162 Sep 08 13:05:51.481689 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2210/4290] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:51 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:51.493074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e07f75e-c9ae-4e0d-abe6-3f7e7402c5fc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:51.495340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9e07f75e-c9ae-4e0d-abe6-3f7e7402c5fc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:51.526218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e07f75e-c9ae-4e0d-abe6-3f7e7402c5fc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:51.528317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e07f75e-c9ae-4e0d-abe6-3f7e7402c5fc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:51.530198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e07f75e-c9ae-4e0d-abe6-3f7e7402c5fc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:51.537004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e07f75e-c9ae-4e0d-abe6-3f7e7402c5fc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:51.537004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e07f75e-c9ae-4e0d-abe6-3f7e7402c5fc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:51.537004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e07f75e-c9ae-4e0d-abe6-3f7e7402c5fc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:51.775725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:52.256098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=10 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:53.083285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9e07f75e-c9ae-4e0d-abe6-3f7e7402c5fc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:53.158310 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e07f75e-c9ae-4e0d-abe6-3f7e7402c5fc tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1493 microversion: 2.1 time: 1.674072 Sep 08 13:05:53.168423 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2211/4291] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:51 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1493 bytes in 1684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:53.196057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-41e09207-4e56-4c39-ba7b-b3c4c16e4894 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:53.203162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-41e09207-4e56-4c39-ba7b-b3c4c16e4894 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:53.218657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41e09207-4e56-4c39-ba7b-b3c4c16e4894 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:53.220194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41e09207-4e56-4c39-ba7b-b3c4c16e4894 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:53.221409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41e09207-4e56-4c39-ba7b-b3c4c16e4894 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:53.223353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41e09207-4e56-4c39-ba7b-b3c4c16e4894 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:53.224656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41e09207-4e56-4c39-ba7b-b3c4c16e4894 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:53.225727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41e09207-4e56-4c39-ba7b-b3c4c16e4894 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:53.780861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:53.823164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:05:53.824548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:05:53.826239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:05:53.827857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:05:53.833506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:05:53.876423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:53.877618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:53.878693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:53.881430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:53.882805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:53.883963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:53.900244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:53.934558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Getting quotas for project 4a806bce1ce8422790726f1f12f681ba. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:05:53.966978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Getting quotas for user 0d312121b259412dbf82c519a49285f4 and project 4a806bce1ce8422790726f1f12f681ba. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:05:54.059962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:05:54.073098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:05:54.238365 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6f269f41-6bbe-4bea-8ae5-fef93ce48255 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 4.155147 Sep 08 13:05:54.240110 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2081/4292] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:05:50 2022] POST /compute/v2.1/servers => generated 407 bytes in 4158 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:05:54.269490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8be0fb9d-bd73-438c-9b94-c95276010d01 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:54.276573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8be0fb9d-bd73-438c-9b94-c95276010d01 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:54.324687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8be0fb9d-bd73-438c-9b94-c95276010d01 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:54.325420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8be0fb9d-bd73-438c-9b94-c95276010d01 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:54.326016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8be0fb9d-bd73-438c-9b94-c95276010d01 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:54.327155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8be0fb9d-bd73-438c-9b94-c95276010d01 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:54.327791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8be0fb9d-bd73-438c-9b94-c95276010d01 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:54.328901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8be0fb9d-bd73-438c-9b94-c95276010d01 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:54.610068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8be0fb9d-bd73-438c-9b94-c95276010d01 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:54.635415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8be0fb9d-bd73-438c-9b94-c95276010d01 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:54.641131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8be0fb9d-bd73-438c-9b94-c95276010d01 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:54.643893 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8be0fb9d-bd73-438c-9b94-c95276010d01 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1365 microversion: 2.57 time: 0.397006 Sep 08 13:05:54.645271 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2082/4293] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:54 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1365 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:54.664567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9134f5c8-3396-4be1-8f6a-516dc361d126 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:54.665990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9134f5c8-3396-4be1-8f6a-516dc361d126 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:54.711166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-41e09207-4e56-4c39-ba7b-b3c4c16e4894 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:54.720709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9134f5c8-3396-4be1-8f6a-516dc361d126 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:54.724552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9134f5c8-3396-4be1-8f6a-516dc361d126 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:54.725752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9134f5c8-3396-4be1-8f6a-516dc361d126 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:54.729533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9134f5c8-3396-4be1-8f6a-516dc361d126 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:54.730332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9134f5c8-3396-4be1-8f6a-516dc361d126 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:54.731210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9134f5c8-3396-4be1-8f6a-516dc361d126 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:54.745436 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-41e09207-4e56-4c39-ba7b-b3c4c16e4894 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1324 microversion: 2.1 time: 1.573842 Sep 08 13:05:54.762229 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2212/4294] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:53 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1324 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:54.788822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4665a2e0-0a1c-409e-aaeb-e3fd7d9f716e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:54.793781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4665a2e0-0a1c-409e-aaeb-e3fd7d9f716e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:55.001141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4665a2e0-0a1c-409e-aaeb-e3fd7d9f716e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:55.033057 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4665a2e0-0a1c-409e-aaeb-e3fd7d9f716e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1244 microversion: 2.1 time: 0.256943 Sep 08 13:05:55.036506 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2213/4295] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:54 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1244 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:55.081714 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9134f5c8-3396-4be1-8f6a-516dc361d126 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "POST /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105/action" status: 202 len: 0 microversion: 2.1 time: 0.432287 Sep 08 13:05:55.082626 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2083/4296] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:05:54 2022] POST /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105/action => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:05:55.098282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ba67d17-f7f5-40c6-93a6-87d080950743 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:55.110404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1ba67d17-f7f5-40c6-93a6-87d080950743 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:55.124186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ba67d17-f7f5-40c6-93a6-87d080950743 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:55.125432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ba67d17-f7f5-40c6-93a6-87d080950743 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:55.126549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ba67d17-f7f5-40c6-93a6-87d080950743 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:55.128203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ba67d17-f7f5-40c6-93a6-87d080950743 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:55.129511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ba67d17-f7f5-40c6-93a6-87d080950743 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:55.130596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ba67d17-f7f5-40c6-93a6-87d080950743 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:55.713743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b9bc896c-d017-4dd5-b9cf-89e92ff353ba tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:55.715713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b9bc896c-d017-4dd5-b9cf-89e92ff353ba tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:55.742375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9bc896c-d017-4dd5-b9cf-89e92ff353ba tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:55.743348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9bc896c-d017-4dd5-b9cf-89e92ff353ba tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:55.744171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9bc896c-d017-4dd5-b9cf-89e92ff353ba tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:55.756174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9bc896c-d017-4dd5-b9cf-89e92ff353ba tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:55.757184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9bc896c-d017-4dd5-b9cf-89e92ff353ba tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:55.757962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9bc896c-d017-4dd5-b9cf-89e92ff353ba tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:56.011056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1ba67d17-f7f5-40c6-93a6-87d080950743 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:56.034965 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1ba67d17-f7f5-40c6-93a6-87d080950743 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1499 microversion: 2.1 time: 0.945724 Sep 08 13:05:56.037588 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2214/4297] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:55 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1499 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:56.061386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7ee302c8-b1e6-443e-a73f-2667e48c10f1 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:56.064085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7ee302c8-b1e6-443e-a73f-2667e48c10f1 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:56.077020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b9bc896c-d017-4dd5-b9cf-89e92ff353ba tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:56.109596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ee302c8-b1e6-443e-a73f-2667e48c10f1 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:56.110404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ee302c8-b1e6-443e-a73f-2667e48c10f1 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:56.111125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ee302c8-b1e6-443e-a73f-2667e48c10f1 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:56.112372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ee302c8-b1e6-443e-a73f-2667e48c10f1 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:56.117139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b9bc896c-d017-4dd5-b9cf-89e92ff353ba tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:56.119180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b9bc896c-d017-4dd5-b9cf-89e92ff353ba tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:56.121347 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b9bc896c-d017-4dd5-b9cf-89e92ff353ba tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1371 microversion: 2.57 time: 0.418016 Sep 08 13:05:56.122467 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2084/4298] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:55 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1371 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:56.124542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ee302c8-b1e6-443e-a73f-2667e48c10f1 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:56.125603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ee302c8-b1e6-443e-a73f-2667e48c10f1 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:56.146195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-16bf0f44-bf9c-4099-8c1e-6c4bbd82d8c4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:56.146832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-16bf0f44-bf9c-4099-8c1e-6c4bbd82d8c4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:56.190985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16bf0f44-bf9c-4099-8c1e-6c4bbd82d8c4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:56.191986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16bf0f44-bf9c-4099-8c1e-6c4bbd82d8c4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:56.192913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16bf0f44-bf9c-4099-8c1e-6c4bbd82d8c4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:56.194313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16bf0f44-bf9c-4099-8c1e-6c4bbd82d8c4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:56.195106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16bf0f44-bf9c-4099-8c1e-6c4bbd82d8c4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:56.195951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16bf0f44-bf9c-4099-8c1e-6c4bbd82d8c4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:56.444754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-16bf0f44-bf9c-4099-8c1e-6c4bbd82d8c4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:56.472072 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-16bf0f44-bf9c-4099-8c1e-6c4bbd82d8c4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1296 microversion: 2.1 time: 0.336826 Sep 08 13:05:56.473841 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2085/4299] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:56 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1296 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:56.519077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e7c0a71f-43de-42b9-b16c-71fb34ad628a req-c0490ee7-1b8d-4225-9933-601f94f0fc56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3895a953-5d11-423d-9e5a-bc4ef928d9e6", "tag": "1d8701c0-17f7-4be9-9d46-b94892ef328c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:05:56.570323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e7c0a71f-43de-42b9-b16c-71fb34ad628a req-c0490ee7-1b8d-4225-9933-601f94f0fc56 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:56.571784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e7c0a71f-43de-42b9-b16c-71fb34ad628a req-c0490ee7-1b8d-4225-9933-601f94f0fc56 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:56.575287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e7c0a71f-43de-42b9-b16c-71fb34ad628a req-c0490ee7-1b8d-4225-9933-601f94f0fc56 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:56.599030 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e7c0a71f-43de-42b9-b16c-71fb34ad628a req-c0490ee7-1b8d-4225-9933-601f94f0fc56 service nova] Creating event network-changed:1d8701c0-17f7-4be9-9d46-b94892ef328c for instance 3895a953-5d11-423d-9e5a-bc4ef928d9e6 on n-h2-852084-10 Sep 08 13:05:56.609611 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e7c0a71f-43de-42b9-b16c-71fb34ad628a req-c0490ee7-1b8d-4225-9933-601f94f0fc56 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130870 Sep 08 13:05:56.612370 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2086/4300] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:05:56.764560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ee302c8-b1e6-443e-a73f-2667e48c10f1 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:56.789399 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7ee302c8-b1e6-443e-a73f-2667e48c10f1 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1324 microversion: 2.1 time: 0.748039 Sep 08 13:05:56.791310 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2215/4301] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:56 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1324 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:57.084165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2105b6ab-f568-4331-afae-33e98e3f0079 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:57.085924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2105b6ab-f568-4331-afae-33e98e3f0079 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:57.116076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2105b6ab-f568-4331-afae-33e98e3f0079 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:57.118990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2105b6ab-f568-4331-afae-33e98e3f0079 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:57.121145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2105b6ab-f568-4331-afae-33e98e3f0079 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:57.124850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2105b6ab-f568-4331-afae-33e98e3f0079 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:57.129089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2105b6ab-f568-4331-afae-33e98e3f0079 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:57.133400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2105b6ab-f568-4331-afae-33e98e3f0079 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:57.179819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2869ceb6-17aa-40c5-b583-450e3e037049 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:57.181836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2869ceb6-17aa-40c5-b583-450e3e037049 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:57.198492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2869ceb6-17aa-40c5-b583-450e3e037049 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:57.200327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2869ceb6-17aa-40c5-b583-450e3e037049 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:57.201397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2869ceb6-17aa-40c5-b583-450e3e037049 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:57.202923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2869ceb6-17aa-40c5-b583-450e3e037049 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:57.204070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2869ceb6-17aa-40c5-b583-450e3e037049 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:57.205052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2869ceb6-17aa-40c5-b583-450e3e037049 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:57.677834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2869ceb6-17aa-40c5-b583-450e3e037049 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:57.695367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:57.706623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2869ceb6-17aa-40c5-b583-450e3e037049 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:57.712869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2869ceb6-17aa-40c5-b583-450e3e037049 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:57.720674 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2869ceb6-17aa-40c5-b583-450e3e037049 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1371 microversion: 2.57 time: 0.550100 Sep 08 13:05:57.722841 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2216/4302] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:57 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1371 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:57.739466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e322bdb-faa5-49ef-b645-1a7ee1cf1dc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:57.742451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6e322bdb-faa5-49ef-b645-1a7ee1cf1dc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:57.760461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e322bdb-faa5-49ef-b645-1a7ee1cf1dc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:57.764103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e322bdb-faa5-49ef-b645-1a7ee1cf1dc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:57.791865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e322bdb-faa5-49ef-b645-1a7ee1cf1dc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:57.794950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e322bdb-faa5-49ef-b645-1a7ee1cf1dc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:57.797183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e322bdb-faa5-49ef-b645-1a7ee1cf1dc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:57.798818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e322bdb-faa5-49ef-b645-1a7ee1cf1dc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:58.136320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6e322bdb-faa5-49ef-b645-1a7ee1cf1dc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:58.153327 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6e322bdb-faa5-49ef-b645-1a7ee1cf1dc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1302 microversion: 2.1 time: 0.426806 Sep 08 13:05:58.154320 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2217/4303] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:57 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1302 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:58.164340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ad9e73ce-61d8-4272-bc48-ee3f6391f1d5 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:58.165257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ad9e73ce-61d8-4272-bc48-ee3f6391f1d5 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:58.178445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad9e73ce-61d8-4272-bc48-ee3f6391f1d5 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:58.179378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad9e73ce-61d8-4272-bc48-ee3f6391f1d5 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:58.180087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad9e73ce-61d8-4272-bc48-ee3f6391f1d5 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:58.181749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad9e73ce-61d8-4272-bc48-ee3f6391f1d5 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:58.182506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad9e73ce-61d8-4272-bc48-ee3f6391f1d5 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:58.183370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad9e73ce-61d8-4272-bc48-ee3f6391f1d5 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:58.296595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2105b6ab-f568-4331-afae-33e98e3f0079 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:58.314252 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2105b6ab-f568-4331-afae-33e98e3f0079 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1499 microversion: 2.1 time: 1.245213 Sep 08 13:05:58.329252 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2087/4304] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:57 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1499 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:58.800622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3f43d758-b42b-4ad7-81d5-16d7e717895d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:58.802964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3f43d758-b42b-4ad7-81d5-16d7e717895d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:58.815408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f43d758-b42b-4ad7-81d5-16d7e717895d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:58.817043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f43d758-b42b-4ad7-81d5-16d7e717895d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:58.818268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f43d758-b42b-4ad7-81d5-16d7e717895d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:58.820201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f43d758-b42b-4ad7-81d5-16d7e717895d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:58.821402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f43d758-b42b-4ad7-81d5-16d7e717895d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:58.822550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3f43d758-b42b-4ad7-81d5-16d7e717895d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:59.064065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ad9e73ce-61d8-4272-bc48-ee3f6391f1d5 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:59.107372 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ad9e73ce-61d8-4272-bc48-ee3f6391f1d5 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1324 microversion: 2.1 time: 0.950718 Sep 08 13:05:59.116571 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2218/4305] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:58 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1324 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:05:59.211265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0f2bd079-2fae-4b9d-9110-487306a2bb4e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:59.219654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0f2bd079-2fae-4b9d-9110-487306a2bb4e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:59.241243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f2bd079-2fae-4b9d-9110-487306a2bb4e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:59.244579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f2bd079-2fae-4b9d-9110-487306a2bb4e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:59.248536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f2bd079-2fae-4b9d-9110-487306a2bb4e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:59.254550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f2bd079-2fae-4b9d-9110-487306a2bb4e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:59.255186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f2bd079-2fae-4b9d-9110-487306a2bb4e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:59.256830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f2bd079-2fae-4b9d-9110-487306a2bb4e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:59.814605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3f43d758-b42b-4ad7-81d5-16d7e717895d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:59.842498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3f43d758-b42b-4ad7-81d5-16d7e717895d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:59.857532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3f43d758-b42b-4ad7-81d5-16d7e717895d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:05:59.860020 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3f43d758-b42b-4ad7-81d5-16d7e717895d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1356 microversion: 2.57 time: 1.066978 Sep 08 13:05:59.861161 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2088/4306] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:05:58 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1356 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:05:59.894128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-98d9fed6-d152-42d3-b7ec-d1ed668da3a9 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:05:59.897012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-98d9fed6-d152-42d3-b7ec-d1ed668da3a9 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:05:59.901040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:05:59.930872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98d9fed6-d152-42d3-b7ec-d1ed668da3a9 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:59.931817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98d9fed6-d152-42d3-b7ec-d1ed668da3a9 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:59.932640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98d9fed6-d152-42d3-b7ec-d1ed668da3a9 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:05:59.933977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98d9fed6-d152-42d3-b7ec-d1ed668da3a9 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:05:59.934856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98d9fed6-d152-42d3-b7ec-d1ed668da3a9 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:05:59.935724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98d9fed6-d152-42d3-b7ec-d1ed668da3a9 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:00.003776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0f2bd079-2fae-4b9d-9110-487306a2bb4e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:00.080846 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0f2bd079-2fae-4b9d-9110-487306a2bb4e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1302 microversion: 2.1 time: 0.866961 Sep 08 13:06:00.112378 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2219/4307] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:59 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1302 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:06:00.150530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6425459-9ac1-43ec-b880-5263c029ebb4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:00.151495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f6425459-9ac1-43ec-b880-5263c029ebb4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:00.177206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6425459-9ac1-43ec-b880-5263c029ebb4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:00.182151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6425459-9ac1-43ec-b880-5263c029ebb4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:00.186066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6425459-9ac1-43ec-b880-5263c029ebb4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:00.191131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6425459-9ac1-43ec-b880-5263c029ebb4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:00.193980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6425459-9ac1-43ec-b880-5263c029ebb4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:00.196291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6425459-9ac1-43ec-b880-5263c029ebb4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:00.349843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f6425459-9ac1-43ec-b880-5263c029ebb4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:06:00.628054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-98d9fed6-d152-42d3-b7ec-d1ed668da3a9 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:00.653391 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-98d9fed6-d152-42d3-b7ec-d1ed668da3a9 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1502 microversion: 2.1 time: 0.790047 Sep 08 13:06:00.658002 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2089/4308] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:05:59 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1502 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:00.679337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7a9b47c6-69f7-4a73-93ee-a27aa7d13d4a tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:00.693783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7a9b47c6-69f7-4a73-93ee-a27aa7d13d4a tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:00.698327 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f6425459-9ac1-43ec-b880-5263c029ebb4 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 204 len: 0 microversion: 2.57 time: 0.576093 Sep 08 13:06:00.698957 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2220/4309] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:06:00 2022] DELETE /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:06:00.725626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a9b47c6-69f7-4a73-93ee-a27aa7d13d4a tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:00.728384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a9b47c6-69f7-4a73-93ee-a27aa7d13d4a tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:00.732534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ec849716-a5aa-4591-8e8c-dd21b0718313 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:00.732817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a9b47c6-69f7-4a73-93ee-a27aa7d13d4a tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:00.736525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ec849716-a5aa-4591-8e8c-dd21b0718313 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:00.743127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a9b47c6-69f7-4a73-93ee-a27aa7d13d4a tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:00.747051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a9b47c6-69f7-4a73-93ee-a27aa7d13d4a tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:00.748691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a9b47c6-69f7-4a73-93ee-a27aa7d13d4a tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:00.771683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec849716-a5aa-4591-8e8c-dd21b0718313 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:00.773139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec849716-a5aa-4591-8e8c-dd21b0718313 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:00.773823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec849716-a5aa-4591-8e8c-dd21b0718313 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:00.775438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec849716-a5aa-4591-8e8c-dd21b0718313 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:00.776578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec849716-a5aa-4591-8e8c-dd21b0718313 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:00.777653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec849716-a5aa-4591-8e8c-dd21b0718313 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:00.884800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ec849716-a5aa-4591-8e8c-dd21b0718313 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:06:01.168241 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ec849716-a5aa-4591-8e8c-dd21b0718313 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 204 len: 0 microversion: 2.1 time: 0.461790 Sep 08 13:06:01.169824 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2221/4310] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:06:00 2022] DELETE /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:06:01.195084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-92031156-77af-4efa-9070-77e2d41bf879 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:01.196658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-92031156-77af-4efa-9070-77e2d41bf879 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:01.213094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92031156-77af-4efa-9070-77e2d41bf879 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:01.213626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92031156-77af-4efa-9070-77e2d41bf879 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:01.214257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92031156-77af-4efa-9070-77e2d41bf879 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:01.215208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92031156-77af-4efa-9070-77e2d41bf879 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:01.224434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92031156-77af-4efa-9070-77e2d41bf879 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:01.225532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92031156-77af-4efa-9070-77e2d41bf879 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:01.539698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-92031156-77af-4efa-9070-77e2d41bf879 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:01.580833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-92031156-77af-4efa-9070-77e2d41bf879 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:01.586489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-92031156-77af-4efa-9070-77e2d41bf879 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:01.592212 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-92031156-77af-4efa-9070-77e2d41bf879 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1362 microversion: 2.57 time: 0.416900 Sep 08 13:06:01.634823 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2222/4311] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:01 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1362 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:01.667276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8760ab2-033a-42cb-a3d4-73d4dcb2222b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:01.670644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b8760ab2-033a-42cb-a3d4-73d4dcb2222b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:01.705003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8760ab2-033a-42cb-a3d4-73d4dcb2222b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:01.708843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8760ab2-033a-42cb-a3d4-73d4dcb2222b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:01.709700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8760ab2-033a-42cb-a3d4-73d4dcb2222b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:01.712017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8760ab2-033a-42cb-a3d4-73d4dcb2222b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:01.716369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8760ab2-033a-42cb-a3d4-73d4dcb2222b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:01.717270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8760ab2-033a-42cb-a3d4-73d4dcb2222b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:01.849073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7a9b47c6-69f7-4a73-93ee-a27aa7d13d4a tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:01.868424 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7a9b47c6-69f7-4a73-93ee-a27aa7d13d4a tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1324 microversion: 2.1 time: 1.208664 Sep 08 13:06:01.869421 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2090/4312] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:00 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1324 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:01.928392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1ef323fc-157a-4482-88ed-2ed7347a2776 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:01.929722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1ef323fc-157a-4482-88ed-2ed7347a2776 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:01.959932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ef323fc-157a-4482-88ed-2ed7347a2776 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:01.960849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ef323fc-157a-4482-88ed-2ed7347a2776 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:01.961658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ef323fc-157a-4482-88ed-2ed7347a2776 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:01.962981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ef323fc-157a-4482-88ed-2ed7347a2776 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:01.963932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ef323fc-157a-4482-88ed-2ed7347a2776 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:01.964677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ef323fc-157a-4482-88ed-2ed7347a2776 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:02.796114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b8760ab2-033a-42cb-a3d4-73d4dcb2222b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:02.815804 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8760ab2-033a-42cb-a3d4-73d4dcb2222b tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1368 microversion: 2.1 time: 1.178791 Sep 08 13:06:02.835555 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2223/4313] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:01 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1368 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:02.861060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6bd794e5-07aa-4679-94dd-06f73397720d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:02.863294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6bd794e5-07aa-4679-94dd-06f73397720d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:02.884327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bd794e5-07aa-4679-94dd-06f73397720d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:02.886833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bd794e5-07aa-4679-94dd-06f73397720d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:02.887630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bd794e5-07aa-4679-94dd-06f73397720d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:02.888681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bd794e5-07aa-4679-94dd-06f73397720d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:02.891327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bd794e5-07aa-4679-94dd-06f73397720d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:02.893401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bd794e5-07aa-4679-94dd-06f73397720d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:03.116291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6bd794e5-07aa-4679-94dd-06f73397720d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:03.145978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1ef323fc-157a-4482-88ed-2ed7347a2776 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:03.155016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6bd794e5-07aa-4679-94dd-06f73397720d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:03.161211 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1ef323fc-157a-4482-88ed-2ed7347a2776 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1508 microversion: 2.1 time: 1.254564 Sep 08 13:06:03.164236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6bd794e5-07aa-4679-94dd-06f73397720d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:03.165553 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2091/4314] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:01 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1508 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:03.171436 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6bd794e5-07aa-4679-94dd-06f73397720d tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1362 microversion: 2.57 time: 0.332345 Sep 08 13:06:03.177344 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2224/4315] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:02 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1362 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:03.181494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-68973b00-9817-48f2-97f1-3e3b9b74317f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:03.185591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-68973b00-9817-48f2-97f1-3e3b9b74317f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:03.211807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68973b00-9817-48f2-97f1-3e3b9b74317f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:03.213268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68973b00-9817-48f2-97f1-3e3b9b74317f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:03.214634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68973b00-9817-48f2-97f1-3e3b9b74317f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:03.219200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68973b00-9817-48f2-97f1-3e3b9b74317f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:03.220128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68973b00-9817-48f2-97f1-3e3b9b74317f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:03.240039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68973b00-9817-48f2-97f1-3e3b9b74317f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:03.861392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-032df2fa-7782-4854-9e65-52dfa8c53d27 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:03.862528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-032df2fa-7782-4854-9e65-52dfa8c53d27 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:03.900979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:06:03.901833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-032df2fa-7782-4854-9e65-52dfa8c53d27 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:03.903008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-032df2fa-7782-4854-9e65-52dfa8c53d27 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:03.904724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-032df2fa-7782-4854-9e65-52dfa8c53d27 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:03.909088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-032df2fa-7782-4854-9e65-52dfa8c53d27 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:03.914651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-032df2fa-7782-4854-9e65-52dfa8c53d27 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:03.918276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-032df2fa-7782-4854-9e65-52dfa8c53d27 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:04.007434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:06:04.121704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-68973b00-9817-48f2-97f1-3e3b9b74317f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:04.137056 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-68973b00-9817-48f2-97f1-3e3b9b74317f tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1324 microversion: 2.1 time: 0.967593 Sep 08 13:06:04.139659 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2092/4316] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:03 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1324 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:04.246716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4619e6cb-e08c-4f79-ac74-86dd23dd1f93 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:04.247820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4619e6cb-e08c-4f79-ac74-86dd23dd1f93 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:04.321214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4619e6cb-e08c-4f79-ac74-86dd23dd1f93 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:04.328904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4619e6cb-e08c-4f79-ac74-86dd23dd1f93 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:04.334656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4619e6cb-e08c-4f79-ac74-86dd23dd1f93 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:04.338515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4619e6cb-e08c-4f79-ac74-86dd23dd1f93 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:04.343643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4619e6cb-e08c-4f79-ac74-86dd23dd1f93 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:04.349220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4619e6cb-e08c-4f79-ac74-86dd23dd1f93 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:04.419082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-032df2fa-7782-4854-9e65-52dfa8c53d27 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:04.434379 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-032df2fa-7782-4854-9e65-52dfa8c53d27 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1368 microversion: 2.1 time: 0.580943 Sep 08 13:06:04.463768 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2225/4317] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:03 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1368 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:04.475509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-06f167bb-06b3-4454-9a79-e12d318bec8e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:04.480623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-06f167bb-06b3-4454-9a79-e12d318bec8e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:04.503428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06f167bb-06b3-4454-9a79-e12d318bec8e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:04.504380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06f167bb-06b3-4454-9a79-e12d318bec8e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:04.505282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06f167bb-06b3-4454-9a79-e12d318bec8e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:04.506376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06f167bb-06b3-4454-9a79-e12d318bec8e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:04.507042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06f167bb-06b3-4454-9a79-e12d318bec8e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:04.507686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06f167bb-06b3-4454-9a79-e12d318bec8e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:04.731961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-06f167bb-06b3-4454-9a79-e12d318bec8e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:04.769200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-06f167bb-06b3-4454-9a79-e12d318bec8e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:04.771657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-06f167bb-06b3-4454-9a79-e12d318bec8e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '337b15570f544280a503eac0e5b1f76c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0f4f8248bd049099d67cbc774089c27', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:04.773891 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-06f167bb-06b3-4454-9a79-e12d318bec8e tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 200 len: 1362 microversion: 2.57 time: 0.308318 Sep 08 13:06:04.775212 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2226/4318] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:04 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:05.087159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d6982dc9-4004-4ff2-bd61-fc1ca28d16c0 req-5a189ff7-312b-45d4-882a-498292c4383c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3895a953-5d11-423d-9e5a-bc4ef928d9e6", "name": "network-vif-plugged", "status": "completed", "tag": "1d8701c0-17f7-4be9-9d46-b94892ef328c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:05.139886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:06:05.147880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4619e6cb-e08c-4f79-ac74-86dd23dd1f93 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:05.179132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d6982dc9-4004-4ff2-bd61-fc1ca28d16c0 req-5a189ff7-312b-45d4-882a-498292c4383c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:05.184343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d6982dc9-4004-4ff2-bd61-fc1ca28d16c0 req-5a189ff7-312b-45d4-882a-498292c4383c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:05.185821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d6982dc9-4004-4ff2-bd61-fc1ca28d16c0 req-5a189ff7-312b-45d4-882a-498292c4383c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:05.193613 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4619e6cb-e08c-4f79-ac74-86dd23dd1f93 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1508 microversion: 2.1 time: 0.951586 Sep 08 13:06:05.221714 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2093/4319] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:04 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1508 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:05.233953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-09497e84-ad83-4a79-8f43-cedba68368db tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:05.236220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-09497e84-ad83-4a79-8f43-cedba68368db tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:05.262389 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d6982dc9-4004-4ff2-bd61-fc1ca28d16c0 req-5a189ff7-312b-45d4-882a-498292c4383c service nova] Creating event network-vif-plugged:1d8701c0-17f7-4be9-9d46-b94892ef328c for instance 3895a953-5d11-423d-9e5a-bc4ef928d9e6 on n-h2-852084-10 Sep 08 13:06:05.267754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09497e84-ad83-4a79-8f43-cedba68368db tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:05.269319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09497e84-ad83-4a79-8f43-cedba68368db tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:05.270107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09497e84-ad83-4a79-8f43-cedba68368db tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:05.273475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09497e84-ad83-4a79-8f43-cedba68368db tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:05.274450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09497e84-ad83-4a79-8f43-cedba68368db tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:05.280562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09497e84-ad83-4a79-8f43-cedba68368db tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:05.305059 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d6982dc9-4004-4ff2-bd61-fc1ca28d16c0 req-5a189ff7-312b-45d4-882a-498292c4383c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.230204 Sep 08 13:06:05.311486 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2227/4320] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:06:05.489005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7de41861-e25a-49f3-96b8-0dfe49f9e299 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:05.490774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7de41861-e25a-49f3-96b8-0dfe49f9e299 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:05.538924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7de41861-e25a-49f3-96b8-0dfe49f9e299 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:05.547010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7de41861-e25a-49f3-96b8-0dfe49f9e299 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:05.550889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7de41861-e25a-49f3-96b8-0dfe49f9e299 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:05.562637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7de41861-e25a-49f3-96b8-0dfe49f9e299 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:05.563992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7de41861-e25a-49f3-96b8-0dfe49f9e299 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:05.568210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7de41861-e25a-49f3-96b8-0dfe49f9e299 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:06.272231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7de41861-e25a-49f3-96b8-0dfe49f9e299 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:06.301117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-09497e84-ad83-4a79-8f43-cedba68368db tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:06.305266 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7de41861-e25a-49f3-96b8-0dfe49f9e299 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1368 microversion: 2.1 time: 0.825567 Sep 08 13:06:06.323751 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-09497e84-ad83-4a79-8f43-cedba68368db tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1324 microversion: 2.1 time: 1.097820 Sep 08 13:06:06.326137 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2094/4321] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:05 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1324 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:06.339153 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2228/4322] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:05 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1368 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:06.344773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-973ecbed-c024-4f9f-82df-50ebafe58385 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:06.346235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-973ecbed-c024-4f9f-82df-50ebafe58385 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] [instance: f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:06.354163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-3cc61f5f-8ea3-4662-bc17-0361372e3823 req-39af38b0-550d-4d52-817e-26312f2171ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f993e7b7-677b-4ffc-a4f9-5eddaf3d3105", "name": "network-vif-deleted", "tag": "dd76a2dd-f067-46e8-a492-15eec7a149c3"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:06.370668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-973ecbed-c024-4f9f-82df-50ebafe58385 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:06.372518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-973ecbed-c024-4f9f-82df-50ebafe58385 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:06.373707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-973ecbed-c024-4f9f-82df-50ebafe58385 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:06.374974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-973ecbed-c024-4f9f-82df-50ebafe58385 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:06.375943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-973ecbed-c024-4f9f-82df-50ebafe58385 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:06.376765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-973ecbed-c024-4f9f-82df-50ebafe58385 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:06.410082 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-973ecbed-c024-4f9f-82df-50ebafe58385 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] HTTP exception thrown: Instance f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c could not be found. Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-973ecbed-c024-4f9f-82df-50ebafe58385 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Request method failure captured: Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c HTTP/1.1 Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeiJpwjtwQ8_i6-WYOdocuIIy3rzNNiiGIuox30QoSUC45xqCxYhOXXumIdc5UVn5yl-mGrpL8TLT69RTr8gTSU_3ZhB2b_3JhcZFZM2rUwy4h_V0_BHfIuHj9ElUSiUKRR205wJXvEdfCZoDqMdkyCBbdBu0N_FhKwZN0t0nAx17bA Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.57 Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b0f4f8248bd049099d67cbc774089c27 Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerShowV257Test-707721305 Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b0f4f8248bd049099d67cbc774089c27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b0f4f8248bd049099d67cbc774089c27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0f4f8248bd049099d67cbc774089c27"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b0f4f8248bd049099d67cbc774089c27"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerShowV257Test-707721305 Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b0f4f8248bd049099d67cbc774089c27 Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerShowV257Test-707721305 Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerShowV257Test-707721305-project Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 337b15570f544280a503eac0e5b1f76c Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerShowV257Test-707721305-project Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c could not be found. Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c'} Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c could not be found. Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c could not be found. Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:06:06.415445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:06:06.428372 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:06.428372 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:06:06.428372 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:06:06.428372 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:06:06.428372 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:06:06.428372 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c could not be found. Sep 08 13:06:06.428372 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:06:06.428372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-973ecbed-c024-4f9f-82df-50ebafe58385 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] Returning 404 to user: Instance f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:06:06.430800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3cc61f5f-8ea3-4662-bc17-0361372e3823 req-39af38b0-550d-4d52-817e-26312f2171ba service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:06.431857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3cc61f5f-8ea3-4662-bc17-0361372e3823 req-39af38b0-550d-4d52-817e-26312f2171ba service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:06.432553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3cc61f5f-8ea3-4662-bc17-0361372e3823 req-39af38b0-550d-4d52-817e-26312f2171ba service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:06.433704 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-973ecbed-c024-4f9f-82df-50ebafe58385 tempest-ServerShowV257Test-707721305 tempest-ServerShowV257Test-707721305-project] 10.222.0.78 "GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c" status: 404 len: 111 microversion: 2.57 time: 0.099122 Sep 08 13:06:06.434916 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2095/4323] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:06 2022] GET /compute/v2.1/servers/f8d66ec5-0fd5-4c2f-ac24-07b6e14e225c => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:06:06.443443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:06.455985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:06.478370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:06.483538 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-3cc61f5f-8ea3-4662-bc17-0361372e3823 req-39af38b0-550d-4d52-817e-26312f2171ba service nova] Creating event network-vif-deleted:dd76a2dd-f067-46e8-a492-15eec7a149c3 for instance f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 on n-h1-852084-10 Sep 08 13:06:06.485200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:06.486286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:06.494330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:06.496178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:06.497321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:06.506135 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-3cc61f5f-8ea3-4662-bc17-0361372e3823 req-39af38b0-550d-4d52-817e-26312f2171ba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164464 Sep 08 13:06:06.510644 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2229/4324] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:06:06.624867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-290b09ec-ac7c-455d-963c-96f809f5b3fe req-1e0d34c9-4dfd-4543-8633-c24b6be9dfe8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfec9e61-54e7-4949-a6f6-d18640db5191", "tag": "ba217dba-14ca-486d-8bc1-9f1f6fae3f90"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:06.653297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:06.654927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:06.656141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:06.657705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lazy-loading 'fault' on Instance uuid f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:06:06.662630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-290b09ec-ac7c-455d-963c-96f809f5b3fe req-1e0d34c9-4dfd-4543-8633-c24b6be9dfe8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:06.666329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-290b09ec-ac7c-455d-963c-96f809f5b3fe req-1e0d34c9-4dfd-4543-8633-c24b6be9dfe8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:06.667033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-290b09ec-ac7c-455d-963c-96f809f5b3fe req-1e0d34c9-4dfd-4543-8633-c24b6be9dfe8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:06.703303 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-290b09ec-ac7c-455d-963c-96f809f5b3fe req-1e0d34c9-4dfd-4543-8633-c24b6be9dfe8 service nova] Creating event network-changed:ba217dba-14ca-486d-8bc1-9f1f6fae3f90 for instance bfec9e61-54e7-4949-a6f6-d18640db5191 on n-h2-852084-10 Sep 08 13:06:06.717374 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-290b09ec-ac7c-455d-963c-96f809f5b3fe req-1e0d34c9-4dfd-4543-8633-c24b6be9dfe8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099691 Sep 08 13:06:06.718374 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2230/4325] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:06:06.781920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10f2fad7f8034c709202ea9ad00336e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3288eb64816f42a7a6445af1ab88d9c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:06.811124 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d167f057-d7ba-46c4-bf5d-a169bf540646 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 200 len: 1305 microversion: 2.1 time: 0.373101 Sep 08 13:06:06.813195 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2096/4326] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:06 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 1305 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:07.349564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-27a7f00c-617f-404c-9bef-8046748a4263 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:07.353141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-27a7f00c-617f-404c-9bef-8046748a4263 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:07.379277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-27a7f00c-617f-404c-9bef-8046748a4263 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:07.382411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bd386350-85c7-456f-be0c-3acc79a21d85 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:07.384034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-27a7f00c-617f-404c-9bef-8046748a4263 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:07.385157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-27a7f00c-617f-404c-9bef-8046748a4263 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:07.386672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-27a7f00c-617f-404c-9bef-8046748a4263 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:07.391256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bd386350-85c7-456f-be0c-3acc79a21d85 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:07.392634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-27a7f00c-617f-404c-9bef-8046748a4263 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:07.393656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-27a7f00c-617f-404c-9bef-8046748a4263 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:07.439778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd386350-85c7-456f-be0c-3acc79a21d85 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:07.445150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd386350-85c7-456f-be0c-3acc79a21d85 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:07.450219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd386350-85c7-456f-be0c-3acc79a21d85 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:07.451845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd386350-85c7-456f-be0c-3acc79a21d85 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:07.456235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd386350-85c7-456f-be0c-3acc79a21d85 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:07.459548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd386350-85c7-456f-be0c-3acc79a21d85 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:08.110653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-27a7f00c-617f-404c-9bef-8046748a4263 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:08.132085 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-27a7f00c-617f-404c-9bef-8046748a4263 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1368 microversion: 2.1 time: 0.788186 Sep 08 13:06:08.165834 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2231/4327] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:07 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1368 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:08.180741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e2249e5-b4e4-4b72-bbc8-6e3833a258c6 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:08.182396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3e2249e5-b4e4-4b72-bbc8-6e3833a258c6 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] [instance: f993e7b7-677b-4ffc-a4f9-5eddaf3d3105] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:08.193374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bd386350-85c7-456f-be0c-3acc79a21d85 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:08.196082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e2249e5-b4e4-4b72-bbc8-6e3833a258c6 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:08.197610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e2249e5-b4e4-4b72-bbc8-6e3833a258c6 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:08.198687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e2249e5-b4e4-4b72-bbc8-6e3833a258c6 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:08.200418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e2249e5-b4e4-4b72-bbc8-6e3833a258c6 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:08.201746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e2249e5-b4e4-4b72-bbc8-6e3833a258c6 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:08.202893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e2249e5-b4e4-4b72-bbc8-6e3833a258c6 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:08.210054 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bd386350-85c7-456f-be0c-3acc79a21d85 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1324 microversion: 2.1 time: 0.837395 Sep 08 13:06:08.210737 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2097/4328] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:07 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1324 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:08.214957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:06:08.241249 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-3e2249e5-b4e4-4b72-bbc8-6e3833a258c6 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] HTTP exception thrown: Instance f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 could not be found. Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e2249e5-b4e4-4b72-bbc8-6e3833a258c6 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Request method failure captured: Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 HTTP/1.1 Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeh9XenKsRkVNKAFsdQ0XiTpQDda1iE_4qCB247E-26hi5KAlC8e-yOXb6b_cs8y-3e3S3C18Th7ltlrpFieVu6bzkvzOiCgE52fWQn2AJqR2p5kbWapxDshpISGmSUCK17bmP2iYkgmhqYODzZ5wrSeIsRsD07AcNIhFZ03aeCJsD0 Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 3288eb64816f42a7a6445af1ab88d9c9 Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestServerAdvancedOps-690090164 Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3288eb64816f42a7a6445af1ab88d9c9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3288eb64816f42a7a6445af1ab88d9c9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3288eb64816f42a7a6445af1ab88d9c9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3288eb64816f42a7a6445af1ab88d9c9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestServerAdvancedOps-690090164 Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 3288eb64816f42a7a6445af1ab88d9c9 Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestServerAdvancedOps-690090164 Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestServerAdvancedOps-690090164-project Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 10f2fad7f8034c709202ea9ad00336e1 Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestServerAdvancedOps-690090164-project Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 could not be found. Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'f993e7b7-677b-4ffc-a4f9-5eddaf3d3105'} Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 could not be found. Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 could not be found. Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:06:08.243727 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:08.250228 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:08.250228 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:06:08.250228 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:06:08.250228 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:06:08.250228 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:06:08.250228 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 could not be found. Sep 08 13:06:08.250228 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:08.252166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e2249e5-b4e4-4b72-bbc8-6e3833a258c6 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] Returning 404 to user: Instance f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:06:08.253763 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3e2249e5-b4e4-4b72-bbc8-6e3833a258c6 tempest-TestServerAdvancedOps-690090164 tempest-TestServerAdvancedOps-690090164-project] 10.222.0.78 "GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105" status: 404 len: 111 microversion: 2.1 time: 0.086186 Sep 08 13:06:08.254632 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2232/4329] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:08 2022] GET /compute/v2.1/servers/f993e7b7-677b-4ffc-a4f9-5eddaf3d3105 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:06:09.195364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0655b3ba-f6bb-4fda-89f5-d99f90240142 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:09.196246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0655b3ba-f6bb-4fda-89f5-d99f90240142 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:09.229367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0655b3ba-f6bb-4fda-89f5-d99f90240142 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:09.230241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0655b3ba-f6bb-4fda-89f5-d99f90240142 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:09.230986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0655b3ba-f6bb-4fda-89f5-d99f90240142 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:09.234818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0655b3ba-f6bb-4fda-89f5-d99f90240142 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:09.244318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-02578a0c-6e16-4e62-acc0-9f7d43aa44b6 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:09.245336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-02578a0c-6e16-4e62-acc0-9f7d43aa44b6 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:09.251746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0655b3ba-f6bb-4fda-89f5-d99f90240142 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:09.258518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0655b3ba-f6bb-4fda-89f5-d99f90240142 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:09.266748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02578a0c-6e16-4e62-acc0-9f7d43aa44b6 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:09.282176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02578a0c-6e16-4e62-acc0-9f7d43aa44b6 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:09.282995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02578a0c-6e16-4e62-acc0-9f7d43aa44b6 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:09.293302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02578a0c-6e16-4e62-acc0-9f7d43aa44b6 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:09.294208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02578a0c-6e16-4e62-acc0-9f7d43aa44b6 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:09.295103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02578a0c-6e16-4e62-acc0-9f7d43aa44b6 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:09.411311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:06:10.606393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-02578a0c-6e16-4e62-acc0-9f7d43aa44b6 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:10.622857 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-02578a0c-6e16-4e62-acc0-9f7d43aa44b6 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1521 microversion: 2.1 time: 1.384346 Sep 08 13:06:10.633710 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2233/4330] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:09 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1521 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:06:10.686952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7f9102d2-bf96-4826-b197-8544c67c2c86 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:10.693162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7f9102d2-bf96-4826-b197-8544c67c2c86 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:10.712416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f9102d2-bf96-4826-b197-8544c67c2c86 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:10.719903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f9102d2-bf96-4826-b197-8544c67c2c86 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:10.721281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f9102d2-bf96-4826-b197-8544c67c2c86 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:10.728013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f9102d2-bf96-4826-b197-8544c67c2c86 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:10.731726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f9102d2-bf96-4826-b197-8544c67c2c86 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:10.733158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f9102d2-bf96-4826-b197-8544c67c2c86 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:10.824335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0655b3ba-f6bb-4fda-89f5-d99f90240142 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:10.830082 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-7f9102d2-bf96-4826-b197-8544c67c2c86 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] HTTP exception thrown: Instance is not a member of specified network Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7f9102d2-bf96-4826-b197-8544c67c2c86 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Request method failure captured: Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6/ips/invalid HTTP/1.1 Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeigHaMqOuzqy8OFA_BtMRYkZp481m6UWFoTxRdmtcavBcED09hftokDdQi6X2BIkthmoYOGEjV5FcVe4sv_OYaq8IxSoJe4QhU1iovxjsqiWVVoL2S_NSDIgawp6hqe6thOlgVtUvYxFZ-ZUQymBzBETHS1mKV0rhrt_NO1wsxDQbI Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 8f2476e462d24206bfc7db3934d482a8 Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1408438895 Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8f2476e462d24206bfc7db3934d482a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8f2476e462d24206bfc7db3934d482a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8f2476e462d24206bfc7db3934d482a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8f2476e462d24206bfc7db3934d482a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1408438895 Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 8f2476e462d24206bfc7db3934d482a8 Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1408438895 Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerAddressesNegativeTestJSON-1408438895-project Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 3492d45795b54d66996d692562d02ed5 Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1408438895-project Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance is not a member of specified network Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'server_id': '3895a953-5d11-423d-9e5a-bc4ef928d9e6', 'id': 'invalid'} Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Sep 08 13:06:10.838582 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:10.848823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7f9102d2-bf96-4826-b197-8544c67c2c86 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:06:10.852600 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7f9102d2-bf96-4826-b197-8544c67c2c86 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.173789 Sep 08 13:06:10.854242 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0655b3ba-f6bb-4fda-89f5-d99f90240142 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1368 microversion: 2.1 time: 1.671932 Sep 08 13:06:10.855013 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2234/4331] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 13:06:10 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6/ips/invalid => generated 91 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 08 13:06:10.856237 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2098/4332] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:09 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1368 bytes in 1678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:10.894151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8a366dbb-c7a6-4bdd-8355-2d57e301f714 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:10.898616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8a366dbb-c7a6-4bdd-8355-2d57e301f714 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Failed to fetch instance by id 999 {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 13:06:10.904283 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-8a366dbb-c7a6-4bdd-8355-2d57e301f714 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] HTTP exception thrown: Instance 999 could not be found. Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8a366dbb-c7a6-4bdd-8355-2d57e301f714 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Request method failure captured: Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeigHaMqOuzqy8OFA_BtMRYkZp481m6UWFoTxRdmtcavBcED09hftokDdQi6X2BIkthmoYOGEjV5FcVe4sv_OYaq8IxSoJe4QhU1iovxjsqiWVVoL2S_NSDIgawp6hqe6thOlgVtUvYxFZ-ZUQymBzBETHS1mKV0rhrt_NO1wsxDQbI Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 8f2476e462d24206bfc7db3934d482a8 Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1408438895 Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8f2476e462d24206bfc7db3934d482a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8f2476e462d24206bfc7db3934d482a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8f2476e462d24206bfc7db3934d482a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8f2476e462d24206bfc7db3934d482a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1408438895 Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 8f2476e462d24206bfc7db3934d482a8 Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1408438895 Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerAddressesNegativeTestJSON-1408438895-project Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 3492d45795b54d66996d692562d02ed5 Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1408438895-project Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 999 could not be found. Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'server_id': '999'} Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Sep 08 13:06:10.908509 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:10.930866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8a366dbb-c7a6-4bdd-8355-2d57e301f714 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:06:10.931620 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8a366dbb-c7a6-4bdd-8355-2d57e301f714 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.058196 Sep 08 13:06:10.941707 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2235/4333] 10.222.0.78 () {58 vars in 1149 bytes} [Thu Sep 8 13:06:10 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:06:10.965190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bd294c98-742f-42fe-bea9-4d8899525418 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:10.969089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bd294c98-742f-42fe-bea9-4d8899525418 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:10.987291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd294c98-742f-42fe-bea9-4d8899525418 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:10.994887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd294c98-742f-42fe-bea9-4d8899525418 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:10.996223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd294c98-742f-42fe-bea9-4d8899525418 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:10.998385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd294c98-742f-42fe-bea9-4d8899525418 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:10.999556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd294c98-742f-42fe-bea9-4d8899525418 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:11.000673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd294c98-742f-42fe-bea9-4d8899525418 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:11.070867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bd294c98-742f-42fe-bea9-4d8899525418 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:06:11.376670 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bd294c98-742f-42fe-bea9-4d8899525418 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 204 len: 0 microversion: 2.1 time: 0.421662 Sep 08 13:06:11.379949 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2099/4334] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:06:10 2022] DELETE /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:06:11.397138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6a76ac80-dcb7-405e-b622-f14be558b49c tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:11.404579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6a76ac80-dcb7-405e-b622-f14be558b49c tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:11.435705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a76ac80-dcb7-405e-b622-f14be558b49c tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:11.436822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a76ac80-dcb7-405e-b622-f14be558b49c tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:11.440736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a76ac80-dcb7-405e-b622-f14be558b49c tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:11.443137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a76ac80-dcb7-405e-b622-f14be558b49c tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:11.447540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a76ac80-dcb7-405e-b622-f14be558b49c tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:11.450320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a76ac80-dcb7-405e-b622-f14be558b49c tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:11.913768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36af3d3d-98f3-4982-b62d-a6421fc63e9a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:11.917744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-36af3d3d-98f3-4982-b62d-a6421fc63e9a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:11.937960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36af3d3d-98f3-4982-b62d-a6421fc63e9a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:11.943309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36af3d3d-98f3-4982-b62d-a6421fc63e9a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:11.947143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36af3d3d-98f3-4982-b62d-a6421fc63e9a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:11.950266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36af3d3d-98f3-4982-b62d-a6421fc63e9a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:11.952174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36af3d3d-98f3-4982-b62d-a6421fc63e9a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:11.954471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36af3d3d-98f3-4982-b62d-a6421fc63e9a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:12.129243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6a76ac80-dcb7-405e-b622-f14be558b49c tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:12.164958 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6a76ac80-dcb7-405e-b622-f14be558b49c tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1527 microversion: 2.1 time: 0.779003 Sep 08 13:06:12.166899 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2236/4335] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:11 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1527 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:12.349921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-36af3d3d-98f3-4982-b62d-a6421fc63e9a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:12.371049 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36af3d3d-98f3-4982-b62d-a6421fc63e9a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1368 microversion: 2.1 time: 0.472318 Sep 08 13:06:12.383268 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2100/4336] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:11 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1368 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:12.968135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a0e943c0-6c3b-42af-a5c5-17297045d22c req-16959144-004f-4c3f-a78c-f367f70f6c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfec9e61-54e7-4949-a6f6-d18640db5191", "name": "network-vif-plugged", "status": "completed", "tag": "ba217dba-14ca-486d-8bc1-9f1f6fae3f90"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:12.995040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a0e943c0-6c3b-42af-a5c5-17297045d22c req-16959144-004f-4c3f-a78c-f367f70f6c15 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:12.995628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a0e943c0-6c3b-42af-a5c5-17297045d22c req-16959144-004f-4c3f-a78c-f367f70f6c15 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:12.995913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a0e943c0-6c3b-42af-a5c5-17297045d22c req-16959144-004f-4c3f-a78c-f367f70f6c15 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:13.023887 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a0e943c0-6c3b-42af-a5c5-17297045d22c req-16959144-004f-4c3f-a78c-f367f70f6c15 service nova] Creating event network-vif-plugged:ba217dba-14ca-486d-8bc1-9f1f6fae3f90 for instance bfec9e61-54e7-4949-a6f6-d18640db5191 on n-h2-852084-10 Sep 08 13:06:13.032935 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a0e943c0-6c3b-42af-a5c5-17297045d22c req-16959144-004f-4c3f-a78c-f367f70f6c15 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070216 Sep 08 13:06:13.034426 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2101/4337] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:06:13.195257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2002a6a6-2d12-4404-b51e-6068cf9adadb tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:13.195972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2002a6a6-2d12-4404-b51e-6068cf9adadb tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:13.211256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2002a6a6-2d12-4404-b51e-6068cf9adadb tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:13.212373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2002a6a6-2d12-4404-b51e-6068cf9adadb tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:13.213128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2002a6a6-2d12-4404-b51e-6068cf9adadb tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:13.214239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2002a6a6-2d12-4404-b51e-6068cf9adadb tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:13.215027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2002a6a6-2d12-4404-b51e-6068cf9adadb tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:13.215747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2002a6a6-2d12-4404-b51e-6068cf9adadb tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:13.538918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ea6c89c4-1fa3-4ce5-80cc-05957e50804b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:13.545388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ea6c89c4-1fa3-4ce5-80cc-05957e50804b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:13.552170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=92,nova_api:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:06:13.585442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea6c89c4-1fa3-4ce5-80cc-05957e50804b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:13.587949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea6c89c4-1fa3-4ce5-80cc-05957e50804b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:13.593646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea6c89c4-1fa3-4ce5-80cc-05957e50804b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:13.596681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea6c89c4-1fa3-4ce5-80cc-05957e50804b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:13.598138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea6c89c4-1fa3-4ce5-80cc-05957e50804b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:13.604158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea6c89c4-1fa3-4ce5-80cc-05957e50804b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:13.670106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ea6c89c4-1fa3-4ce5-80cc-05957e50804b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:06:13.757881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2002a6a6-2d12-4404-b51e-6068cf9adadb tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:13.786302 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2002a6a6-2d12-4404-b51e-6068cf9adadb tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1527 microversion: 2.1 time: 0.595812 Sep 08 13:06:13.793664 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2102/4338] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:13 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1527 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:06:13.810937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:13.813631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:13.846967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:13.847967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:13.851771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:13.856431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:13.859918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:13.861071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:13.960200 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ea6c89c4-1fa3-4ce5-80cc-05957e50804b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 204 len: 0 microversion: 2.32 time: 1.498435 Sep 08 13:06:13.966090 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2237/4339] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:06:12 2022] DELETE /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 0 bytes in 1505 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:06:13.968416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ea6c89c4-1fa3-4ce5-80cc-05957e50804b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:13.970130 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ea6c89c4-1fa3-4ce5-80cc-05957e50804b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002804 Sep 08 13:06:13.977628 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2238/4340] 10.222.0.78 () {56 vars in 886 bytes} [Thu Sep 8 13:06:13 2022] GET /compute/ => generated 377 bytes in 9 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 13:06:13.994661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1a4d31c8-6905-464b-8365-8e17291459ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:13.997014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1a4d31c8-6905-464b-8365-8e17291459ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:14.014712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a4d31c8-6905-464b-8365-8e17291459ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:14.015990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a4d31c8-6905-464b-8365-8e17291459ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:14.017063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a4d31c8-6905-464b-8365-8e17291459ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:14.018655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a4d31c8-6905-464b-8365-8e17291459ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:14.021395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a4d31c8-6905-464b-8365-8e17291459ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:14.022693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a4d31c8-6905-464b-8365-8e17291459ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:14.509614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:14.542454 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1368 microversion: 2.1 time: 0.744371 Sep 08 13:06:14.563333 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2103/4341] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:13 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1368 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:14.563333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:14.563333 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002971 Sep 08 13:06:14.563333 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2104/4342] 10.222.0.78 () {54 vars in 1035 bytes} [Thu Sep 8 13:06:14 2022] GET /compute/v2/ => generated 379 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Sep 08 13:06:14.571671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:14.573621 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002629 Sep 08 13:06:14.574807 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2105/4343] 10.222.0.78 () {54 vars in 1041 bytes} [Thu Sep 8 13:06:14 2022] GET /compute/v2.1/ => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:06:14.592675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:14.594388 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5ac10351-c033-44a7-8282-f73873097ed2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002419 Sep 08 13:06:14.595625 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2106/4344] 10.222.0.78 () {56 vars in 886 bytes} [Thu Sep 8 13:06:14 2022] GET /compute/ => generated 377 bytes in 4 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Sep 08 13:06:14.658541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7ed0be88-41e3-4470-b885-d18a35eea76f req-81d8ea2f-cc5c-421d-8a73-28890b3434d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3895a953-5d11-423d-9e5a-bc4ef928d9e6", "name": "network-vif-deleted", "tag": "1d8701c0-17f7-4be9-9d46-b94892ef328c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:14.713005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7ed0be88-41e3-4470-b885-d18a35eea76f req-81d8ea2f-cc5c-421d-8a73-28890b3434d4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:14.713962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7ed0be88-41e3-4470-b885-d18a35eea76f req-81d8ea2f-cc5c-421d-8a73-28890b3434d4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:14.714772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7ed0be88-41e3-4470-b885-d18a35eea76f req-81d8ea2f-cc5c-421d-8a73-28890b3434d4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:14.737210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a4d31c8-6905-464b-8365-8e17291459ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:14.740579 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7ed0be88-41e3-4470-b885-d18a35eea76f req-81d8ea2f-cc5c-421d-8a73-28890b3434d4 service nova] Creating event network-vif-deleted:1d8701c0-17f7-4be9-9d46-b94892ef328c for instance 3895a953-5d11-423d-9e5a-bc4ef928d9e6 on n-h2-852084-10 Sep 08 13:06:14.759125 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7ed0be88-41e3-4470-b885-d18a35eea76f req-81d8ea2f-cc5c-421d-8a73-28890b3434d4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107583 Sep 08 13:06:14.760813 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2107/4345] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:06:14.772140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a4d31c8-6905-464b-8365-8e17291459ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:14.777334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a4d31c8-6905-464b-8365-8e17291459ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:14.780186 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1a4d31c8-6905-464b-8365-8e17291459ff tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2955 microversion: 2.32 time: 0.800043 Sep 08 13:06:14.796681 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2239/4346] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:13 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2955 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:14.839362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1424d8f2-98f4-4f1c-9de2-9d55e3fe5831 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:14.840990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1424d8f2-98f4-4f1c-9de2-9d55e3fe5831 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:14.854535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1424d8f2-98f4-4f1c-9de2-9d55e3fe5831 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:14.855920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1424d8f2-98f4-4f1c-9de2-9d55e3fe5831 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:14.857441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1424d8f2-98f4-4f1c-9de2-9d55e3fe5831 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:14.859540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1424d8f2-98f4-4f1c-9de2-9d55e3fe5831 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:14.861120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1424d8f2-98f4-4f1c-9de2-9d55e3fe5831 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:14.863199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1424d8f2-98f4-4f1c-9de2-9d55e3fe5831 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:15.053434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1424d8f2-98f4-4f1c-9de2-9d55e3fe5831 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:15.067558 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1424d8f2-98f4-4f1c-9de2-9d55e3fe5831 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1485 microversion: 2.1 time: 0.237459 Sep 08 13:06:15.083658 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2108/4347] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:14 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1485 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:15.577424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9c2da7fa-f8f0-4572-ad57-f7e86c3e122f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:15.578299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9c2da7fa-f8f0-4572-ad57-f7e86c3e122f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:15.590172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c2da7fa-f8f0-4572-ad57-f7e86c3e122f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:15.591031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c2da7fa-f8f0-4572-ad57-f7e86c3e122f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:15.591856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c2da7fa-f8f0-4572-ad57-f7e86c3e122f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:15.593329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c2da7fa-f8f0-4572-ad57-f7e86c3e122f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:15.594215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c2da7fa-f8f0-4572-ad57-f7e86c3e122f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:15.595137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c2da7fa-f8f0-4572-ad57-f7e86c3e122f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:15.823165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6851b60d-13d2-46c8-871c-f0d7385775f8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:15.825517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6851b60d-13d2-46c8-871c-f0d7385775f8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:15.839288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6851b60d-13d2-46c8-871c-f0d7385775f8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:15.841469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6851b60d-13d2-46c8-871c-f0d7385775f8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:15.842411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6851b60d-13d2-46c8-871c-f0d7385775f8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:15.844286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6851b60d-13d2-46c8-871c-f0d7385775f8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:15.845470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6851b60d-13d2-46c8-871c-f0d7385775f8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:15.846496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6851b60d-13d2-46c8-871c-f0d7385775f8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:15.921780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9c2da7fa-f8f0-4572-ad57-f7e86c3e122f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:15.963613 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9c2da7fa-f8f0-4572-ad57-f7e86c3e122f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1368 microversion: 2.1 time: 0.381328 Sep 08 13:06:15.968449 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2240/4348] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:15 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1368 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:16.107142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6616fc97-ec6a-42f6-989f-9abb3ce66e76 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:16.108629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6616fc97-ec6a-42f6-989f-9abb3ce66e76 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:16.132107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6616fc97-ec6a-42f6-989f-9abb3ce66e76 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:16.132900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6616fc97-ec6a-42f6-989f-9abb3ce66e76 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:16.133609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6616fc97-ec6a-42f6-989f-9abb3ce66e76 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:16.139108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6616fc97-ec6a-42f6-989f-9abb3ce66e76 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:16.145800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6616fc97-ec6a-42f6-989f-9abb3ce66e76 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:16.149278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6616fc97-ec6a-42f6-989f-9abb3ce66e76 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:16.339508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6616fc97-ec6a-42f6-989f-9abb3ce66e76 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:16.381183 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6616fc97-ec6a-42f6-989f-9abb3ce66e76 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1309 microversion: 2.1 time: 0.284484 Sep 08 13:06:16.383605 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2241/4349] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:16 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1309 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:06:16.508483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6851b60d-13d2-46c8-871c-f0d7385775f8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:16.536367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6851b60d-13d2-46c8-871c-f0d7385775f8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:16.539478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6851b60d-13d2-46c8-871c-f0d7385775f8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:16.541189 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6851b60d-13d2-46c8-871c-f0d7385775f8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2955 microversion: 2.32 time: 0.726745 Sep 08 13:06:16.542761 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2109/4350] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:15 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2955 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:17.028088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bcccd7a3-4f75-4df7-94bc-e89b12319fc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:17.031915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bcccd7a3-4f75-4df7-94bc-e89b12319fc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:17.064349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcccd7a3-4f75-4df7-94bc-e89b12319fc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:17.066386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcccd7a3-4f75-4df7-94bc-e89b12319fc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:17.071703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcccd7a3-4f75-4df7-94bc-e89b12319fc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:17.076731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcccd7a3-4f75-4df7-94bc-e89b12319fc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:17.080631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcccd7a3-4f75-4df7-94bc-e89b12319fc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:17.083438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcccd7a3-4f75-4df7-94bc-e89b12319fc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:17.441233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:17.443177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:17.470503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:17.477450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:17.478794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:17.486198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:17.487359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:17.489666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:17.655484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:17.656327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:17.657141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:17.663519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lazy-loading 'fault' on Instance uuid 3895a953-5d11-423d-9e5a-bc4ef928d9e6 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:06:17.782262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3492d45795b54d66996d692562d02ed5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f2476e462d24206bfc7db3934d482a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:17.810223 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3a4f9c1a-b7a2-4365-9331-2d76dc016d25 tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 200 len: 1314 microversion: 2.1 time: 0.374634 Sep 08 13:06:17.814009 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2110/4351] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:17 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:17.823631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8501ac85-ad34-423f-9336-9aee7f9a5dad tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:17.825565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8501ac85-ad34-423f-9336-9aee7f9a5dad tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:17.844662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8501ac85-ad34-423f-9336-9aee7f9a5dad tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:17.851180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8501ac85-ad34-423f-9336-9aee7f9a5dad tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:17.852229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8501ac85-ad34-423f-9336-9aee7f9a5dad tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:17.853379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8501ac85-ad34-423f-9336-9aee7f9a5dad tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:17.854146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8501ac85-ad34-423f-9336-9aee7f9a5dad tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:17.855731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8501ac85-ad34-423f-9336-9aee7f9a5dad tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:17.931469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bcccd7a3-4f75-4df7-94bc-e89b12319fc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:17.951157 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bcccd7a3-4f75-4df7-94bc-e89b12319fc1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1562 microversion: 2.1 time: 0.932603 Sep 08 13:06:17.963098 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2242/4352] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:17 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1562 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:06:18.002963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9751b853-052d-4ea9-aef7-dfcf5af86870 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:18.003893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9751b853-052d-4ea9-aef7-dfcf5af86870 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:18.027608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9751b853-052d-4ea9-aef7-dfcf5af86870 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:18.028752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9751b853-052d-4ea9-aef7-dfcf5af86870 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:18.029660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9751b853-052d-4ea9-aef7-dfcf5af86870 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:18.030848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9751b853-052d-4ea9-aef7-dfcf5af86870 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:18.031937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9751b853-052d-4ea9-aef7-dfcf5af86870 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:18.032746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9751b853-052d-4ea9-aef7-dfcf5af86870 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:18.496393 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9751b853-052d-4ea9-aef7-dfcf5af86870 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.501408 Sep 08 13:06:18.498387 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2243/4353] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:06:17 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-interface => generated 284 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:06:18.733256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8501ac85-ad34-423f-9336-9aee7f9a5dad tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:18.753184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8501ac85-ad34-423f-9336-9aee7f9a5dad tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:18.757217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8501ac85-ad34-423f-9336-9aee7f9a5dad tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:18.759656 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8501ac85-ad34-423f-9336-9aee7f9a5dad tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2955 microversion: 2.32 time: 0.942986 Sep 08 13:06:18.762205 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2111/4354] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:17 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2955 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:18.853372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2c29f00e-0e74-4c90-bd33-e659af47fbaf tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:18.854236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2c29f00e-0e74-4c90-bd33-e659af47fbaf tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] [instance: 3895a953-5d11-423d-9e5a-bc4ef928d9e6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:18.877636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c29f00e-0e74-4c90-bd33-e659af47fbaf tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:18.887455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c29f00e-0e74-4c90-bd33-e659af47fbaf tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:18.891482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c29f00e-0e74-4c90-bd33-e659af47fbaf tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:18.891482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c29f00e-0e74-4c90-bd33-e659af47fbaf tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:18.896004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c29f00e-0e74-4c90-bd33-e659af47fbaf tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:18.896841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c29f00e-0e74-4c90-bd33-e659af47fbaf tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:18.962076 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-2c29f00e-0e74-4c90-bd33-e659af47fbaf tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] HTTP exception thrown: Instance 3895a953-5d11-423d-9e5a-bc4ef928d9e6 could not be found. Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2c29f00e-0e74-4c90-bd33-e659af47fbaf tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Request method failure captured: Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 HTTP/1.1 Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeigHaMqOuzqy8OFA_BtMRYkZp481m6UWFoTxRdmtcavBcED09hftokDdQi6X2BIkthmoYOGEjV5FcVe4sv_OYaq8IxSoJe4QhU1iovxjsqiWVVoL2S_NSDIgawp6hqe6thOlgVtUvYxFZ-ZUQymBzBETHS1mKV0rhrt_NO1wsxDQbI Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 8f2476e462d24206bfc7db3934d482a8 Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1408438895 Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8f2476e462d24206bfc7db3934d482a8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8f2476e462d24206bfc7db3934d482a8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8f2476e462d24206bfc7db3934d482a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8f2476e462d24206bfc7db3934d482a8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1408438895 Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 8f2476e462d24206bfc7db3934d482a8 Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1408438895 Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerAddressesNegativeTestJSON-1408438895-project Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 3492d45795b54d66996d692562d02ed5 Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1408438895-project Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 3895a953-5d11-423d-9e5a-bc4ef928d9e6 could not be found. Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '3895a953-5d11-423d-9e5a-bc4ef928d9e6'} Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3895a953-5d11-423d-9e5a-bc4ef928d9e6 could not be found. Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3895a953-5d11-423d-9e5a-bc4ef928d9e6 could not be found. Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:18.972574 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:06:18.983798 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:18.983798 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:06:18.983798 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:06:18.983798 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:06:18.983798 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:06:18.983798 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:06:18.983798 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3895a953-5d11-423d-9e5a-bc4ef928d9e6 could not be found. Sep 08 13:06:18.983798 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:06:18.983798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2c29f00e-0e74-4c90-bd33-e659af47fbaf tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] Returning 404 to user: Instance 3895a953-5d11-423d-9e5a-bc4ef928d9e6 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:06:18.983798 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2c29f00e-0e74-4c90-bd33-e659af47fbaf tempest-ServerAddressesNegativeTestJSON-1408438895 tempest-ServerAddressesNegativeTestJSON-1408438895-project] 10.222.0.78 "GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6" status: 404 len: 111 microversion: 2.1 time: 0.132033 Sep 08 13:06:18.987883 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2244/4355] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:06:18 2022] GET /compute/v2.1/servers/3895a953-5d11-423d-9e5a-bc4ef928d9e6 => generated 111 bytes in 140 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:06:19.816300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c74fcf8f-421f-4bf0-aa4f-3fdfd67b1dab tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:19.818223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c74fcf8f-421f-4bf0-aa4f-3fdfd67b1dab tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:19.833368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c74fcf8f-421f-4bf0-aa4f-3fdfd67b1dab tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:19.833899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c74fcf8f-421f-4bf0-aa4f-3fdfd67b1dab tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:19.840444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c74fcf8f-421f-4bf0-aa4f-3fdfd67b1dab tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:19.841994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c74fcf8f-421f-4bf0-aa4f-3fdfd67b1dab tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:19.844133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c74fcf8f-421f-4bf0-aa4f-3fdfd67b1dab tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:19.844939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c74fcf8f-421f-4bf0-aa4f-3fdfd67b1dab tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:21.050133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-385390b4-26ba-4469-b7de-3934d9aa78d7 req-d27e0000-0b53-4091-aa67-a0a4f7a34f95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-unplugged", "status": "completed", "tag": "df47dbce-98af-457f-b820-6f3eed3fb9db"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:21.089213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-385390b4-26ba-4469-b7de-3934d9aa78d7 req-d27e0000-0b53-4091-aa67-a0a4f7a34f95 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:21.090478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-385390b4-26ba-4469-b7de-3934d9aa78d7 req-d27e0000-0b53-4091-aa67-a0a4f7a34f95 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:21.091621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-385390b4-26ba-4469-b7de-3934d9aa78d7 req-d27e0000-0b53-4091-aa67-a0a4f7a34f95 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:21.128245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c74fcf8f-421f-4bf0-aa4f-3fdfd67b1dab tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:21.160899 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-385390b4-26ba-4469-b7de-3934d9aa78d7 req-d27e0000-0b53-4091-aa67-a0a4f7a34f95 service nova] Creating event network-vif-unplugged:df47dbce-98af-457f-b820-6f3eed3fb9db for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:06:21.173532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c74fcf8f-421f-4bf0-aa4f-3fdfd67b1dab tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:21.186295 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-385390b4-26ba-4469-b7de-3934d9aa78d7 req-d27e0000-0b53-4091-aa67-a0a4f7a34f95 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.144724 Sep 08 13:06:21.187209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c74fcf8f-421f-4bf0-aa4f-3fdfd67b1dab tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:21.194106 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c74fcf8f-421f-4bf0-aa4f-3fdfd67b1dab tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2934 microversion: 2.32 time: 1.380311 Sep 08 13:06:21.197007 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2245/4356] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:06:21.199910 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2112/4357] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:19 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2934 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:21.267467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d70629d8-c1f8-4631-8cab-0cca818d6c5c req-0167b7fd-62ca-4d42-a148-333728b97987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfec9e61-54e7-4949-a6f6-d18640db5191", "tag": "ba217dba-14ca-486d-8bc1-9f1f6fae3f90"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:21.293323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d70629d8-c1f8-4631-8cab-0cca818d6c5c req-0167b7fd-62ca-4d42-a148-333728b97987 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:21.295102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d70629d8-c1f8-4631-8cab-0cca818d6c5c req-0167b7fd-62ca-4d42-a148-333728b97987 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:21.296882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d70629d8-c1f8-4631-8cab-0cca818d6c5c req-0167b7fd-62ca-4d42-a148-333728b97987 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:21.353917 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d70629d8-c1f8-4631-8cab-0cca818d6c5c req-0167b7fd-62ca-4d42-a148-333728b97987 service nova] Creating event network-changed:ba217dba-14ca-486d-8bc1-9f1f6fae3f90 for instance bfec9e61-54e7-4949-a6f6-d18640db5191 on n-h2-852084-10 Sep 08 13:06:21.365187 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d70629d8-c1f8-4631-8cab-0cca818d6c5c req-0167b7fd-62ca-4d42-a148-333728b97987 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148959 Sep 08 13:06:21.368160 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2246/4358] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:06:22.258964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc2d906f-1e27-40ca-ac14-491392b241d1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:22.292212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fc2d906f-1e27-40ca-ac14-491392b241d1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:22.336079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc2d906f-1e27-40ca-ac14-491392b241d1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:22.339314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc2d906f-1e27-40ca-ac14-491392b241d1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:22.341027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc2d906f-1e27-40ca-ac14-491392b241d1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:22.342703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc2d906f-1e27-40ca-ac14-491392b241d1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:22.347536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc2d906f-1e27-40ca-ac14-491392b241d1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:22.349734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc2d906f-1e27-40ca-ac14-491392b241d1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:23.251868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-1a417ee8-2dc2-4b5d-9465-2c047eb1dfc5 req-4977a4ba-574e-4be7-90ed-ea209f81de4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-unplugged", "status": "completed", "tag": "b39d12c4-c98a-488f-9b41-a3704a8cd72f"}, {"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-unplugged", "status": "completed", "tag": "400054e7-5c99-4a0d-a1c6-9d75e7b50cfa"}, {"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-unplugged", "status": "completed", "tag": "1be64155-8dac-40c9-9439-05e67430247f"}, {"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-unplugged", "status": "completed", "tag": "8a64c4ec-96a3-4c30-bb50-fded084669fd"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:23.301940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1a417ee8-2dc2-4b5d-9465-2c047eb1dfc5 req-4977a4ba-574e-4be7-90ed-ea209f81de4a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:23.302800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1a417ee8-2dc2-4b5d-9465-2c047eb1dfc5 req-4977a4ba-574e-4be7-90ed-ea209f81de4a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:23.303626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1a417ee8-2dc2-4b5d-9465-2c047eb1dfc5 req-4977a4ba-574e-4be7-90ed-ea209f81de4a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:23.358500 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1a417ee8-2dc2-4b5d-9465-2c047eb1dfc5 req-4977a4ba-574e-4be7-90ed-ea209f81de4a service nova] Creating event network-vif-unplugged:b39d12c4-c98a-488f-9b41-a3704a8cd72f for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:06:23.359443 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1a417ee8-2dc2-4b5d-9465-2c047eb1dfc5 req-4977a4ba-574e-4be7-90ed-ea209f81de4a service nova] Creating event network-vif-unplugged:400054e7-5c99-4a0d-a1c6-9d75e7b50cfa for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:06:23.361257 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1a417ee8-2dc2-4b5d-9465-2c047eb1dfc5 req-4977a4ba-574e-4be7-90ed-ea209f81de4a service nova] Creating event network-vif-unplugged:1be64155-8dac-40c9-9439-05e67430247f for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:06:23.364668 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1a417ee8-2dc2-4b5d-9465-2c047eb1dfc5 req-4977a4ba-574e-4be7-90ed-ea209f81de4a service nova] Creating event network-vif-unplugged:8a64c4ec-96a3-4c30-bb50-fded084669fd for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:06:23.389675 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-1a417ee8-2dc2-4b5d-9465-2c047eb1dfc5 req-4977a4ba-574e-4be7-90ed-ea209f81de4a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.152325 Sep 08 13:06:23.390638 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2247/4359] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:06:24.266074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fc2d906f-1e27-40ca-ac14-491392b241d1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:24.303582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fc2d906f-1e27-40ca-ac14-491392b241d1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:24.306563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fc2d906f-1e27-40ca-ac14-491392b241d1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:24.313562 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fc2d906f-1e27-40ca-ac14-491392b241d1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2934 microversion: 2.32 time: 2.066524 Sep 08 13:06:24.336499 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2113/4360] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:22 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2934 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:06:25.382028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a3a3ad7e-1551-4d85-bcb2-56c2609f87ee tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:25.384834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a3a3ad7e-1551-4d85-bcb2-56c2609f87ee tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:25.421969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3a3ad7e-1551-4d85-bcb2-56c2609f87ee tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:25.422685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3a3ad7e-1551-4d85-bcb2-56c2609f87ee tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:25.427587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3a3ad7e-1551-4d85-bcb2-56c2609f87ee tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:25.430068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3a3ad7e-1551-4d85-bcb2-56c2609f87ee tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:25.432246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3a3ad7e-1551-4d85-bcb2-56c2609f87ee tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:25.433002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3a3ad7e-1551-4d85-bcb2-56c2609f87ee tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:25.447394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-ff127eff-150e-4c64-a902-d390fbbbe271 req-923cfdbc-6355-43d8-8c03-a39619374a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-unplugged", "status": "completed", "tag": "82d9067d-9ad7-41b2-8a73-eeae9e8ec555"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:25.501986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ff127eff-150e-4c64-a902-d390fbbbe271 req-923cfdbc-6355-43d8-8c03-a39619374a02 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:25.502880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ff127eff-150e-4c64-a902-d390fbbbe271 req-923cfdbc-6355-43d8-8c03-a39619374a02 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:25.503585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ff127eff-150e-4c64-a902-d390fbbbe271 req-923cfdbc-6355-43d8-8c03-a39619374a02 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:25.555647 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-ff127eff-150e-4c64-a902-d390fbbbe271 req-923cfdbc-6355-43d8-8c03-a39619374a02 service nova] Creating event network-vif-unplugged:82d9067d-9ad7-41b2-8a73-eeae9e8ec555 for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:06:25.568098 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-ff127eff-150e-4c64-a902-d390fbbbe271 req-923cfdbc-6355-43d8-8c03-a39619374a02 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138355 Sep 08 13:06:25.570699 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2114/4361] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:06:26.823801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a3a3ad7e-1551-4d85-bcb2-56c2609f87ee tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:26.858091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a3a3ad7e-1551-4d85-bcb2-56c2609f87ee tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:26.861259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a3a3ad7e-1551-4d85-bcb2-56c2609f87ee tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:26.864197 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a3a3ad7e-1551-4d85-bcb2-56c2609f87ee tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2913 microversion: 2.32 time: 1.493622 Sep 08 13:06:26.868321 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2248/4362] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:25 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2913 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:27.926767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b3b4164d-9e3c-4e16-bc9e-f0c8c8f84706 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:27.928211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b3b4164d-9e3c-4e16-bc9e-f0c8c8f84706 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:27.958741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3b4164d-9e3c-4e16-bc9e-f0c8c8f84706 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:27.959733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3b4164d-9e3c-4e16-bc9e-f0c8c8f84706 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:27.960553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3b4164d-9e3c-4e16-bc9e-f0c8c8f84706 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:27.966945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3b4164d-9e3c-4e16-bc9e-f0c8c8f84706 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:27.968254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3b4164d-9e3c-4e16-bc9e-f0c8c8f84706 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:27.969168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3b4164d-9e3c-4e16-bc9e-f0c8c8f84706 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:29.841872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b3b4164d-9e3c-4e16-bc9e-f0c8c8f84706 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:29.882198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b3b4164d-9e3c-4e16-bc9e-f0c8c8f84706 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:29.887656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b3b4164d-9e3c-4e16-bc9e-f0c8c8f84706 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:29.888514 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b3b4164d-9e3c-4e16-bc9e-f0c8c8f84706 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2913 microversion: 2.32 time: 1.980790 Sep 08 13:06:29.903846 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2115/4363] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:27 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2913 bytes in 1998 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:29.986714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-3a03b5f8-6779-444f-a8c4-c552c7390467 req-4ef20932-1327-471e-b17d-28441fe7b25b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-deleted", "tag": "1be64155-8dac-40c9-9439-05e67430247f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:30.028627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3a03b5f8-6779-444f-a8c4-c552c7390467 req-4ef20932-1327-471e-b17d-28441fe7b25b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:30.029476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3a03b5f8-6779-444f-a8c4-c552c7390467 req-4ef20932-1327-471e-b17d-28441fe7b25b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:30.030259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3a03b5f8-6779-444f-a8c4-c552c7390467 req-4ef20932-1327-471e-b17d-28441fe7b25b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:30.076421 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-3a03b5f8-6779-444f-a8c4-c552c7390467 req-4ef20932-1327-471e-b17d-28441fe7b25b service nova] Creating event network-vif-deleted:1be64155-8dac-40c9-9439-05e67430247f for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:06:30.103978 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-3a03b5f8-6779-444f-a8c4-c552c7390467 req-4ef20932-1327-471e-b17d-28441fe7b25b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120113 Sep 08 13:06:30.106060 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2249/4364] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:06:30.963531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-17f703dc-0848-45fb-9ad9-c99e06494161 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:30.964467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-17f703dc-0848-45fb-9ad9-c99e06494161 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:30.977992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:06:31.001842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-17f703dc-0848-45fb-9ad9-c99e06494161 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:31.005831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-17f703dc-0848-45fb-9ad9-c99e06494161 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:31.008502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-17f703dc-0848-45fb-9ad9-c99e06494161 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:31.009750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-17f703dc-0848-45fb-9ad9-c99e06494161 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:31.010679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-17f703dc-0848-45fb-9ad9-c99e06494161 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:31.011453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-17f703dc-0848-45fb-9ad9-c99e06494161 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:32.330171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-17f703dc-0848-45fb-9ad9-c99e06494161 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:32.347198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-17f703dc-0848-45fb-9ad9-c99e06494161 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:32.349564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-17f703dc-0848-45fb-9ad9-c99e06494161 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:32.351619 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-17f703dc-0848-45fb-9ad9-c99e06494161 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2753 microversion: 2.32 time: 1.398594 Sep 08 13:06:32.353068 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2116/4365] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:30 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2753 bytes in 1402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:33.425681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1db43c48-f79a-45ee-b08b-06621c1e1c9c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:33.433818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1db43c48-f79a-45ee-b08b-06621c1e1c9c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:33.477084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1db43c48-f79a-45ee-b08b-06621c1e1c9c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:33.480467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1db43c48-f79a-45ee-b08b-06621c1e1c9c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:33.480791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1db43c48-f79a-45ee-b08b-06621c1e1c9c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:33.482145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1db43c48-f79a-45ee-b08b-06621c1e1c9c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:33.482982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1db43c48-f79a-45ee-b08b-06621c1e1c9c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:33.484507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1db43c48-f79a-45ee-b08b-06621c1e1c9c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:35.038240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-cb8f0501-5874-4138-8b5b-134a69108afd req-5b6e0ed3-f8fa-4d20-89f0-23f768b8d9ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-deleted", "tag": "df47dbce-98af-457f-b820-6f3eed3fb9db"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:35.077916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cb8f0501-5874-4138-8b5b-134a69108afd req-5b6e0ed3-f8fa-4d20-89f0-23f768b8d9ac service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:35.078433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cb8f0501-5874-4138-8b5b-134a69108afd req-5b6e0ed3-f8fa-4d20-89f0-23f768b8d9ac service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:35.079179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cb8f0501-5874-4138-8b5b-134a69108afd req-5b6e0ed3-f8fa-4d20-89f0-23f768b8d9ac service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:35.118625 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-cb8f0501-5874-4138-8b5b-134a69108afd req-5b6e0ed3-f8fa-4d20-89f0-23f768b8d9ac service nova] Creating event network-vif-deleted:df47dbce-98af-457f-b820-6f3eed3fb9db for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:06:35.133520 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-cb8f0501-5874-4138-8b5b-134a69108afd req-5b6e0ed3-f8fa-4d20-89f0-23f768b8d9ac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099199 Sep 08 13:06:35.137391 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2117/4366] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:06:35.181898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1db43c48-f79a-45ee-b08b-06621c1e1c9c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:35.212959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1db43c48-f79a-45ee-b08b-06621c1e1c9c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:35.218366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1db43c48-f79a-45ee-b08b-06621c1e1c9c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:35.223732 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1db43c48-f79a-45ee-b08b-06621c1e1c9c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2707 microversion: 2.32 time: 1.810252 Sep 08 13:06:35.225992 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2250/4367] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:33 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2707 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:36.294227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-83a5876c-e7cf-488b-b1db-ba49702b2565 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:36.312105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-83a5876c-e7cf-488b-b1db-ba49702b2565 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:36.345976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83a5876c-e7cf-488b-b1db-ba49702b2565 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:36.356582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83a5876c-e7cf-488b-b1db-ba49702b2565 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:36.357446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83a5876c-e7cf-488b-b1db-ba49702b2565 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:36.360094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83a5876c-e7cf-488b-b1db-ba49702b2565 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:36.360992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83a5876c-e7cf-488b-b1db-ba49702b2565 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:36.366062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83a5876c-e7cf-488b-b1db-ba49702b2565 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:37.419616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-83a5876c-e7cf-488b-b1db-ba49702b2565 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:37.423718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:06:37.437859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-83a5876c-e7cf-488b-b1db-ba49702b2565 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:37.439903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-83a5876c-e7cf-488b-b1db-ba49702b2565 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:37.441807 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-83a5876c-e7cf-488b-b1db-ba49702b2565 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2419 microversion: 2.32 time: 1.160091 Sep 08 13:06:37.443884 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2118/4368] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:36 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2419 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:38.067847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-abb22397-6c71-4fc6-82ab-055a5005dfd0 req-900b91e0-c9f2-4f73-b66d-03784cabafb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-deleted", "tag": "82d9067d-9ad7-41b2-8a73-eeae9e8ec555"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:38.139205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-abb22397-6c71-4fc6-82ab-055a5005dfd0 req-900b91e0-c9f2-4f73-b66d-03784cabafb3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:38.140076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-abb22397-6c71-4fc6-82ab-055a5005dfd0 req-900b91e0-c9f2-4f73-b66d-03784cabafb3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:38.140794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-abb22397-6c71-4fc6-82ab-055a5005dfd0 req-900b91e0-c9f2-4f73-b66d-03784cabafb3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:38.212618 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-abb22397-6c71-4fc6-82ab-055a5005dfd0 req-900b91e0-c9f2-4f73-b66d-03784cabafb3 service nova] Creating event network-vif-deleted:82d9067d-9ad7-41b2-8a73-eeae9e8ec555 for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:06:38.248235 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-abb22397-6c71-4fc6-82ab-055a5005dfd0 req-900b91e0-c9f2-4f73-b66d-03784cabafb3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206717 Sep 08 13:06:38.249338 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2251/4369] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:06:38.524729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6a6d9a69-8d51-4414-b4f7-5e9595c2a523 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:38.536435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6a6d9a69-8d51-4414-b4f7-5e9595c2a523 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:38.553676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a6d9a69-8d51-4414-b4f7-5e9595c2a523 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:38.555014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a6d9a69-8d51-4414-b4f7-5e9595c2a523 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:38.556137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a6d9a69-8d51-4414-b4f7-5e9595c2a523 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:38.557671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a6d9a69-8d51-4414-b4f7-5e9595c2a523 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:38.559285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a6d9a69-8d51-4414-b4f7-5e9595c2a523 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:38.561221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a6d9a69-8d51-4414-b4f7-5e9595c2a523 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:39.319036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6a6d9a69-8d51-4414-b4f7-5e9595c2a523 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:39.344151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6a6d9a69-8d51-4414-b4f7-5e9595c2a523 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:39.347091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6a6d9a69-8d51-4414-b4f7-5e9595c2a523 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:39.351069 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6a6d9a69-8d51-4414-b4f7-5e9595c2a523 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2215 microversion: 2.32 time: 0.847525 Sep 08 13:06:39.353159 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2119/4370] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:38 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2215 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:39.559141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c4b370d9-a4ef-4493-8a69-8213fb9b0d89 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Action: 'create', calling method: .version_select at 0x7fdb3f1e18b0>, body: {"keypair": {"name": "tempest-keypair-191342414", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHzEcJbdHp1CZ8CJCDK3bv2jF5hjE58DfSX9w80jw82Wt4b24Y8Iko3YxsJhdxJUH+QKPFOWQmwxLKiHf2iAhlsrtPB2ozzqWeGjD5Hrx2npucTwpkPKKQBMsNULB849yA=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:39.613709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-c4b370d9-a4ef-4493-8a69-8213fb9b0d89 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Getting quotas for project 4b0e146de89146b9b1d07a8b07b1b77b. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:06:39.631448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-c4b370d9-a4ef-4493-8a69-8213fb9b0d89 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Getting quotas for user d9ccc775b0764dbf860508db1d2096bf and project 4b0e146de89146b9b1d07a8b07b1b77b. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:06:39.727741 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c4b370d9-a4ef-4493-8a69-8213fb9b0d89 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.224663 Sep 08 13:06:39.735817 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2252/4371] 10.222.0.78 () {62 vars in 1200 bytes} [Thu Sep 8 13:06:38 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1233 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 13:06:40.400831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-45bfdadc-7357-4c86-b6c7-0599bb08f5ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:40.402823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-45bfdadc-7357-4c86-b6c7-0599bb08f5ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:40.434138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45bfdadc-7357-4c86-b6c7-0599bb08f5ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:40.438137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45bfdadc-7357-4c86-b6c7-0599bb08f5ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:40.439096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45bfdadc-7357-4c86-b6c7-0599bb08f5ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:40.440330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45bfdadc-7357-4c86-b6c7-0599bb08f5ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:40.441039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45bfdadc-7357-4c86-b6c7-0599bb08f5ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:40.442291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45bfdadc-7357-4c86-b6c7-0599bb08f5ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:40.515852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ff326f93-debe-4769-bcdd-120584f05e75 req-c75c0ee7-4e14-4221-ad28-6eebe928417b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-deleted", "tag": "b39d12c4-c98a-488f-9b41-a3704a8cd72f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:40.565054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ff326f93-debe-4769-bcdd-120584f05e75 req-c75c0ee7-4e14-4221-ad28-6eebe928417b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:40.570066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ff326f93-debe-4769-bcdd-120584f05e75 req-c75c0ee7-4e14-4221-ad28-6eebe928417b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:40.571212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ff326f93-debe-4769-bcdd-120584f05e75 req-c75c0ee7-4e14-4221-ad28-6eebe928417b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:40.642743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:06:40.651032 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ff326f93-debe-4769-bcdd-120584f05e75 req-c75c0ee7-4e14-4221-ad28-6eebe928417b service nova] Creating event network-vif-deleted:b39d12c4-c98a-488f-9b41-a3704a8cd72f for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:06:40.693612 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ff326f93-debe-4769-bcdd-120584f05e75 req-c75c0ee7-4e14-4221-ad28-6eebe928417b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.166307 Sep 08 13:06:40.699828 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2253/4372] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:06:40.944932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-45bfdadc-7357-4c86-b6c7-0599bb08f5ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:40.968106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-45bfdadc-7357-4c86-b6c7-0599bb08f5ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:40.975106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-45bfdadc-7357-4c86-b6c7-0599bb08f5ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:40.980423 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-45bfdadc-7357-4c86-b6c7-0599bb08f5ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 2169 microversion: 2.32 time: 0.585648 Sep 08 13:06:40.981869 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2120/4373] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:40 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 2169 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:06:42.049356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bafc731a-c9b2-4301-928e-a58d1e146384 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:42.051206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bafc731a-c9b2-4301-928e-a58d1e146384 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:42.090603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bafc731a-c9b2-4301-928e-a58d1e146384 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:42.098708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bafc731a-c9b2-4301-928e-a58d1e146384 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:42.100985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bafc731a-c9b2-4301-928e-a58d1e146384 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:42.102350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bafc731a-c9b2-4301-928e-a58d1e146384 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:42.103213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bafc731a-c9b2-4301-928e-a58d1e146384 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:42.113000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bafc731a-c9b2-4301-928e-a58d1e146384 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:42.600753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bafc731a-c9b2-4301-928e-a58d1e146384 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:42.637153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bafc731a-c9b2-4301-928e-a58d1e146384 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:42.647535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bafc731a-c9b2-4301-928e-a58d1e146384 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:42.649413 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bafc731a-c9b2-4301-928e-a58d1e146384 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.609725 Sep 08 13:06:42.659673 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2254/4374] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:42 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:42.782089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0cf7f7eb-fccd-4ea1-a2b9-1eaa6d2da0a5 req-0939a5e3-5c14-4624-b958-a8f055fb76f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d230b17f-eb54-4a20-b3fd-72e60ed7f0c0", "name": "network-vif-deleted", "tag": "8a64c4ec-96a3-4c30-bb50-fded084669fd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:42.836855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0cf7f7eb-fccd-4ea1-a2b9-1eaa6d2da0a5 req-0939a5e3-5c14-4624-b958-a8f055fb76f3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:42.842486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0cf7f7eb-fccd-4ea1-a2b9-1eaa6d2da0a5 req-0939a5e3-5c14-4624-b958-a8f055fb76f3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:42.843943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0cf7f7eb-fccd-4ea1-a2b9-1eaa6d2da0a5 req-0939a5e3-5c14-4624-b958-a8f055fb76f3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:42.926552 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0cf7f7eb-fccd-4ea1-a2b9-1eaa6d2da0a5 req-0939a5e3-5c14-4624-b958-a8f055fb76f3 service nova] Creating event network-vif-deleted:8a64c4ec-96a3-4c30-bb50-fded084669fd for instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 on n-h2-852084-10 Sep 08 13:06:42.955711 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0cf7f7eb-fccd-4ea1-a2b9-1eaa6d2da0a5 req-0939a5e3-5c14-4624-b958-a8f055fb76f3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183289 Sep 08 13:06:42.956449 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2121/4375] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:06:43.720611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0ca42ca4-cd5d-48fe-a1e4-cf8d8402fd02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:43.722637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0ca42ca4-cd5d-48fe-a1e4-cf8d8402fd02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:43.778625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:06:43.788226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ca42ca4-cd5d-48fe-a1e4-cf8d8402fd02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:43.796397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ca42ca4-cd5d-48fe-a1e4-cf8d8402fd02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:43.799201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ca42ca4-cd5d-48fe-a1e4-cf8d8402fd02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:43.806098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ca42ca4-cd5d-48fe-a1e4-cf8d8402fd02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:43.810411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ca42ca4-cd5d-48fe-a1e4-cf8d8402fd02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:43.814462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ca42ca4-cd5d-48fe-a1e4-cf8d8402fd02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:44.098282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0ca42ca4-cd5d-48fe-a1e4-cf8d8402fd02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:44.145226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0ca42ca4-cd5d-48fe-a1e4-cf8d8402fd02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:44.152230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0ca42ca4-cd5d-48fe-a1e4-cf8d8402fd02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:44.158237 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0ca42ca4-cd5d-48fe-a1e4-cf8d8402fd02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.443938 Sep 08 13:06:44.161276 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2255/4376] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:43 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:45.231268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-217781dd-b801-43b2-b4fd-ac91c7177f75 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:45.235204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-217781dd-b801-43b2-b4fd-ac91c7177f75 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:45.270996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-217781dd-b801-43b2-b4fd-ac91c7177f75 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:45.272735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-217781dd-b801-43b2-b4fd-ac91c7177f75 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:45.273540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-217781dd-b801-43b2-b4fd-ac91c7177f75 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:45.274808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-217781dd-b801-43b2-b4fd-ac91c7177f75 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:45.275907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-217781dd-b801-43b2-b4fd-ac91c7177f75 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:45.294207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-217781dd-b801-43b2-b4fd-ac91c7177f75 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:45.766134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-217781dd-b801-43b2-b4fd-ac91c7177f75 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:45.806836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-217781dd-b801-43b2-b4fd-ac91c7177f75 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:45.809260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-217781dd-b801-43b2-b4fd-ac91c7177f75 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:45.813341 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-217781dd-b801-43b2-b4fd-ac91c7177f75 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.596546 Sep 08 13:06:45.816197 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2122/4377] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:45 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:46.872304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d0cec4a3-6bf9-4da8-92a7-10c72cf6a54b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:46.875726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d0cec4a3-6bf9-4da8-92a7-10c72cf6a54b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:46.896073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d0cec4a3-6bf9-4da8-92a7-10c72cf6a54b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:46.899676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d0cec4a3-6bf9-4da8-92a7-10c72cf6a54b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:46.901636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d0cec4a3-6bf9-4da8-92a7-10c72cf6a54b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:46.908084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d0cec4a3-6bf9-4da8-92a7-10c72cf6a54b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:46.911576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d0cec4a3-6bf9-4da8-92a7-10c72cf6a54b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:46.916294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d0cec4a3-6bf9-4da8-92a7-10c72cf6a54b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:47.202719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d0cec4a3-6bf9-4da8-92a7-10c72cf6a54b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:47.263893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d0cec4a3-6bf9-4da8-92a7-10c72cf6a54b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:47.278972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d0cec4a3-6bf9-4da8-92a7-10c72cf6a54b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:47.317016 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d0cec4a3-6bf9-4da8-92a7-10c72cf6a54b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.453148 Sep 08 13:06:47.321550 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2256/4378] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:46 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:48.384698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e048d501-93a0-43ab-ae3b-fa60769f844c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:48.386499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e048d501-93a0-43ab-ae3b-fa60769f844c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:48.408821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e048d501-93a0-43ab-ae3b-fa60769f844c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:48.409767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e048d501-93a0-43ab-ae3b-fa60769f844c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:48.411771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e048d501-93a0-43ab-ae3b-fa60769f844c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:48.415151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e048d501-93a0-43ab-ae3b-fa60769f844c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:48.415822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e048d501-93a0-43ab-ae3b-fa60769f844c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:48.416269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e048d501-93a0-43ab-ae3b-fa60769f844c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:48.673541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e048d501-93a0-43ab-ae3b-fa60769f844c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:48.710306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e048d501-93a0-43ab-ae3b-fa60769f844c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:48.724582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e048d501-93a0-43ab-ae3b-fa60769f844c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:48.727463 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e048d501-93a0-43ab-ae3b-fa60769f844c tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.349294 Sep 08 13:06:48.728929 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2123/4379] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:48 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:48.837665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2093162306", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8de9e067-a10d-41da-93b7-a0cd2d878a61"}], "security_groups": [{"name": "tempest-securitygroup--2055220983"}], "key_name": "tempest-keypair-191342414", "user_data": "}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:49.256685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] validate_networks() for [('8de9e067-a10d-41da-93b7-a0cd2d878a61', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:06:49.658786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:06:49.732182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-582e8827-edeb-432f-bc84-a7d82df14b4d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7c5bf79f-51f7-4438-9301-1713ac9a755e"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:06:49.735647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-582e8827-edeb-432f-bc84-a7d82df14b4d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:49.759174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-582e8827-edeb-432f-bc84-a7d82df14b4d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:49.760838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-582e8827-edeb-432f-bc84-a7d82df14b4d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:49.761808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-582e8827-edeb-432f-bc84-a7d82df14b4d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:49.762764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-582e8827-edeb-432f-bc84-a7d82df14b4d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:49.763581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-582e8827-edeb-432f-bc84-a7d82df14b4d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:49.764324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-582e8827-edeb-432f-bc84-a7d82df14b4d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:50.485574 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-582e8827-edeb-432f-bc84-a7d82df14b4d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756650 Sep 08 13:06:50.487889 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2124/4380] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:06:49 2022] POST /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments => generated 194 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:06:50.500223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-892f9035-a5b6-441f-85dd-359d7a2f01ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:50.502870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-892f9035-a5b6-441f-85dd-359d7a2f01ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:50.525401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-892f9035-a5b6-441f-85dd-359d7a2f01ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:50.526864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-892f9035-a5b6-441f-85dd-359d7a2f01ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:50.528879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-892f9035-a5b6-441f-85dd-359d7a2f01ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:50.534563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-892f9035-a5b6-441f-85dd-359d7a2f01ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:50.541311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-892f9035-a5b6-441f-85dd-359d7a2f01ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:50.545885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-892f9035-a5b6-441f-85dd-359d7a2f01ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:51.173464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-892f9035-a5b6-441f-85dd-359d7a2f01ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:51.220664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-892f9035-a5b6-441f-85dd-359d7a2f01ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:51.236901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-892f9035-a5b6-441f-85dd-359d7a2f01ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:51.241799 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-892f9035-a5b6-441f-85dd-359d7a2f01ca tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.749628 Sep 08 13:06:51.244723 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2125/4381] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:50 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:51.510265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:06:51.512352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:06:51.513702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:06:51.514986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:06:51.516219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:06:51.546737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:51.550198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:51.552194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:51.555128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:51.557345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:51.559091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:51.677536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Getting quotas for project 4b0e146de89146b9b1d07a8b07b1b77b. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:06:51.744859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Getting quotas for user d9ccc775b0764dbf860508db1d2096bf and project 4b0e146de89146b9b1d07a8b07b1b77b. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:06:51.829106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:06:51.848318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:06:52.011595 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6ea0f304-919c-49b2-8af4-ec0548969e30 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.188084 Sep 08 13:06:52.013294 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2257/4382] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 13:06:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 3191 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 13:06:52.039768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-88b09f99-7f9f-4b17-a8b8-fb6c13388aba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:52.045399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-88b09f99-7f9f-4b17-a8b8-fb6c13388aba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:52.331443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3424f2ad-cefc-41b0-a6f3-28943cfbb141 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:52.342095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3424f2ad-cefc-41b0-a6f3-28943cfbb141 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:52.412984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3424f2ad-cefc-41b0-a6f3-28943cfbb141 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:52.414305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3424f2ad-cefc-41b0-a6f3-28943cfbb141 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:52.415421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3424f2ad-cefc-41b0-a6f3-28943cfbb141 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:52.417360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3424f2ad-cefc-41b0-a6f3-28943cfbb141 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:52.418597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3424f2ad-cefc-41b0-a6f3-28943cfbb141 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:52.421276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3424f2ad-cefc-41b0-a6f3-28943cfbb141 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:52.469735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-88b09f99-7f9f-4b17-a8b8-fb6c13388aba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:52.524569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-88b09f99-7f9f-4b17-a8b8-fb6c13388aba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:52.562217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-88b09f99-7f9f-4b17-a8b8-fb6c13388aba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:52.567299 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-88b09f99-7f9f-4b17-a8b8-fb6c13388aba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1281 microversion: 2.20 time: 0.537922 Sep 08 13:06:52.569509 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2126/4383] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:52 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1281 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:52.723657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3424f2ad-cefc-41b0-a6f3-28943cfbb141 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:52.752397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3424f2ad-cefc-41b0-a6f3-28943cfbb141 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:52.757470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3424f2ad-cefc-41b0-a6f3-28943cfbb141 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:52.761238 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3424f2ad-cefc-41b0-a6f3-28943cfbb141 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.459334 Sep 08 13:06:52.768422 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2258/4384] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:52 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:06:53.605420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54c277e8-c7d8-4838-b5df-402bf3b2c1d5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:53.619986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54c277e8-c7d8-4838-b5df-402bf3b2c1d5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:53.803266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-99924092-d027-4917-8797-151c128e41bb tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:53.804275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-99924092-d027-4917-8797-151c128e41bb tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:53.834863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-99924092-d027-4917-8797-151c128e41bb tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:53.839734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-99924092-d027-4917-8797-151c128e41bb tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:53.840262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-99924092-d027-4917-8797-151c128e41bb tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:53.853638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-99924092-d027-4917-8797-151c128e41bb tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:53.854142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-99924092-d027-4917-8797-151c128e41bb tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:53.855924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-99924092-d027-4917-8797-151c128e41bb tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:53.889066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54c277e8-c7d8-4838-b5df-402bf3b2c1d5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:53.949121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54c277e8-c7d8-4838-b5df-402bf3b2c1d5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:53.966735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54c277e8-c7d8-4838-b5df-402bf3b2c1d5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:53.986909 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54c277e8-c7d8-4838-b5df-402bf3b2c1d5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1281 microversion: 2.20 time: 0.382989 Sep 08 13:06:53.989868 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2127/4385] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:53 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1281 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:54.044521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-99924092-d027-4917-8797-151c128e41bb tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:54.078934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-99924092-d027-4917-8797-151c128e41bb tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:54.086270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-99924092-d027-4917-8797-151c128e41bb tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:54.100406 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-99924092-d027-4917-8797-151c128e41bb tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.295788 Sep 08 13:06:54.102324 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2259/4386] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:53 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:55.040213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ef8d5347-7f89-4233-ad6e-34231a59f7d3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:55.041342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ef8d5347-7f89-4233-ad6e-34231a59f7d3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:55.093655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef8d5347-7f89-4233-ad6e-34231a59f7d3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:55.094603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef8d5347-7f89-4233-ad6e-34231a59f7d3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:55.095529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef8d5347-7f89-4233-ad6e-34231a59f7d3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:55.097057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef8d5347-7f89-4233-ad6e-34231a59f7d3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:55.098438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef8d5347-7f89-4233-ad6e-34231a59f7d3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:55.112526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef8d5347-7f89-4233-ad6e-34231a59f7d3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:55.153164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-31144040-ccb5-46a8-ade1-f26006386b84 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:55.154295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-31144040-ccb5-46a8-ade1-f26006386b84 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:55.192354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31144040-ccb5-46a8-ade1-f26006386b84 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:55.197939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31144040-ccb5-46a8-ade1-f26006386b84 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:55.198798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31144040-ccb5-46a8-ade1-f26006386b84 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:55.200162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31144040-ccb5-46a8-ade1-f26006386b84 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:55.208251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31144040-ccb5-46a8-ade1-f26006386b84 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:55.209276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31144040-ccb5-46a8-ade1-f26006386b84 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:55.355064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ef8d5347-7f89-4233-ad6e-34231a59f7d3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:55.394744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ef8d5347-7f89-4233-ad6e-34231a59f7d3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:55.398166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ef8d5347-7f89-4233-ad6e-34231a59f7d3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:55.414422 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ef8d5347-7f89-4233-ad6e-34231a59f7d3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1333 microversion: 2.20 time: 0.371004 Sep 08 13:06:55.418174 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2128/4387] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:55 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1333 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:06:55.464865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-31144040-ccb5-46a8-ade1-f26006386b84 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:55.483555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-31144040-ccb5-46a8-ade1-f26006386b84 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:55.487476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-31144040-ccb5-46a8-ade1-f26006386b84 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:55.501825 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-31144040-ccb5-46a8-ade1-f26006386b84 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.357551 Sep 08 13:06:55.517352 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2260/4388] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:55 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:06:56.470214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5725e3eb-bea8-413b-8e17-544600d5e386 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:56.471059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5725e3eb-bea8-413b-8e17-544600d5e386 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:56.494647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5725e3eb-bea8-413b-8e17-544600d5e386 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:56.495471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5725e3eb-bea8-413b-8e17-544600d5e386 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:56.496838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5725e3eb-bea8-413b-8e17-544600d5e386 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:56.501504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5725e3eb-bea8-413b-8e17-544600d5e386 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:56.504479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5725e3eb-bea8-413b-8e17-544600d5e386 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:56.511848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5725e3eb-bea8-413b-8e17-544600d5e386 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:56.544573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-45e91932-a159-4d93-943c-42795fef723f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:56.546291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-45e91932-a159-4d93-943c-42795fef723f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:56.564037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45e91932-a159-4d93-943c-42795fef723f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:56.565228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45e91932-a159-4d93-943c-42795fef723f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:56.565783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45e91932-a159-4d93-943c-42795fef723f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:56.566920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45e91932-a159-4d93-943c-42795fef723f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:56.572964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45e91932-a159-4d93-943c-42795fef723f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:56.573530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45e91932-a159-4d93-943c-42795fef723f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:56.784394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-45e91932-a159-4d93-943c-42795fef723f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:56.834595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-45e91932-a159-4d93-943c-42795fef723f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:56.838561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-45e91932-a159-4d93-943c-42795fef723f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:56.850315 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-45e91932-a159-4d93-943c-42795fef723f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.311075 Sep 08 13:06:56.855428 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2261/4389] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:56 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:56.867829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5725e3eb-bea8-413b-8e17-544600d5e386 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:56.922990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5725e3eb-bea8-413b-8e17-544600d5e386 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:56.935164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5725e3eb-bea8-413b-8e17-544600d5e386 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:56.941406 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5725e3eb-bea8-413b-8e17-544600d5e386 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1339 microversion: 2.20 time: 0.473394 Sep 08 13:06:56.948488 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2129/4390] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:56 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1339 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:06:57.895434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b419226-d69e-4081-aac4-206eebd15ddf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:57.896188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7b419226-d69e-4081-aac4-206eebd15ddf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:57.919460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b419226-d69e-4081-aac4-206eebd15ddf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:57.919915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b419226-d69e-4081-aac4-206eebd15ddf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:57.924078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b419226-d69e-4081-aac4-206eebd15ddf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:57.925799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b419226-d69e-4081-aac4-206eebd15ddf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:57.929617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b419226-d69e-4081-aac4-206eebd15ddf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:57.930898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b419226-d69e-4081-aac4-206eebd15ddf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:57.999850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dcf8921e-11a8-49a2-ae50-efc2fec3d7eb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:58.001412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dcf8921e-11a8-49a2-ae50-efc2fec3d7eb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:58.023533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcf8921e-11a8-49a2-ae50-efc2fec3d7eb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:58.032080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcf8921e-11a8-49a2-ae50-efc2fec3d7eb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:58.033080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcf8921e-11a8-49a2-ae50-efc2fec3d7eb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:58.034512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcf8921e-11a8-49a2-ae50-efc2fec3d7eb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:58.035878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcf8921e-11a8-49a2-ae50-efc2fec3d7eb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:58.037333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcf8921e-11a8-49a2-ae50-efc2fec3d7eb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:58.332852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b419226-d69e-4081-aac4-206eebd15ddf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:58.357202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b419226-d69e-4081-aac4-206eebd15ddf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:58.360164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b419226-d69e-4081-aac4-206eebd15ddf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:58.364848 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7b419226-d69e-4081-aac4-206eebd15ddf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.474118 Sep 08 13:06:58.372598 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2262/4391] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:57 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:59.185419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dcf8921e-11a8-49a2-ae50-efc2fec3d7eb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:59.205268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dcf8921e-11a8-49a2-ae50-efc2fec3d7eb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:59.223215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dcf8921e-11a8-49a2-ae50-efc2fec3d7eb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:06:59.226523 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dcf8921e-11a8-49a2-ae50-efc2fec3d7eb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1407 microversion: 2.20 time: 1.233512 Sep 08 13:06:59.227926 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2130/4392] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:57 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1407 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:06:59.414656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a94d8eef-2a7c-4526-a683-adc087b2e75b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:06:59.415442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a94d8eef-2a7c-4526-a683-adc087b2e75b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:06:59.440147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a94d8eef-2a7c-4526-a683-adc087b2e75b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:59.441197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a94d8eef-2a7c-4526-a683-adc087b2e75b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:59.441915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a94d8eef-2a7c-4526-a683-adc087b2e75b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:06:59.442911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a94d8eef-2a7c-4526-a683-adc087b2e75b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:06:59.444242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a94d8eef-2a7c-4526-a683-adc087b2e75b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:06:59.444945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a94d8eef-2a7c-4526-a683-adc087b2e75b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:00.113872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a94d8eef-2a7c-4526-a683-adc087b2e75b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:00.129134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a94d8eef-2a7c-4526-a683-adc087b2e75b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:00.131413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a94d8eef-2a7c-4526-a683-adc087b2e75b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:00.134066 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a94d8eef-2a7c-4526-a683-adc087b2e75b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.724504 Sep 08 13:07:00.136268 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2263/4393] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:06:59 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:00.271766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-caebeaf1-2bc5-4d5e-99d7-be765d54c7de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:00.292296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-caebeaf1-2bc5-4d5e-99d7-be765d54c7de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:00.347647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-caebeaf1-2bc5-4d5e-99d7-be765d54c7de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:00.355073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-caebeaf1-2bc5-4d5e-99d7-be765d54c7de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:00.359216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-caebeaf1-2bc5-4d5e-99d7-be765d54c7de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:00.361119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-caebeaf1-2bc5-4d5e-99d7-be765d54c7de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:00.361525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-caebeaf1-2bc5-4d5e-99d7-be765d54c7de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:00.362349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-caebeaf1-2bc5-4d5e-99d7-be765d54c7de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:01.078166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-caebeaf1-2bc5-4d5e-99d7-be765d54c7de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:01.149704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-caebeaf1-2bc5-4d5e-99d7-be765d54c7de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:01.171084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-caebeaf1-2bc5-4d5e-99d7-be765d54c7de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:01.176718 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-caebeaf1-2bc5-4d5e-99d7-be765d54c7de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1407 microversion: 2.20 time: 0.912446 Sep 08 13:07:01.180712 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2131/4394] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:00 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1407 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:07:01.198369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-799b06aa-5f01-45c2-a4db-feb4b4abb6b8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:01.200169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-799b06aa-5f01-45c2-a4db-feb4b4abb6b8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:01.201665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-795659b8-cb95-4268-a5fc-79eb23aa8bf5 req-0770ed23-57bb-4e57-83f1-ec0402866dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68", "tag": "bab66cd4-e2d1-4c9a-803e-24552207b4f0"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:07:01.238692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=36 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:01.250570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-795659b8-cb95-4268-a5fc-79eb23aa8bf5 req-0770ed23-57bb-4e57-83f1-ec0402866dc8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:01.252113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-795659b8-cb95-4268-a5fc-79eb23aa8bf5 req-0770ed23-57bb-4e57-83f1-ec0402866dc8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:01.257838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-799b06aa-5f01-45c2-a4db-feb4b4abb6b8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:01.259088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-795659b8-cb95-4268-a5fc-79eb23aa8bf5 req-0770ed23-57bb-4e57-83f1-ec0402866dc8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:01.265117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-799b06aa-5f01-45c2-a4db-feb4b4abb6b8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:01.275290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-799b06aa-5f01-45c2-a4db-feb4b4abb6b8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:01.277581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-799b06aa-5f01-45c2-a4db-feb4b4abb6b8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:01.292570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-799b06aa-5f01-45c2-a4db-feb4b4abb6b8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:01.293979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-799b06aa-5f01-45c2-a4db-feb4b4abb6b8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:01.315002 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-795659b8-cb95-4268-a5fc-79eb23aa8bf5 req-0770ed23-57bb-4e57-83f1-ec0402866dc8 service nova] Creating event network-changed:bab66cd4-e2d1-4c9a-803e-24552207b4f0 for instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 on n-h2-852084-10 Sep 08 13:07:01.338968 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-795659b8-cb95-4268-a5fc-79eb23aa8bf5 req-0770ed23-57bb-4e57-83f1-ec0402866dc8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139474 Sep 08 13:07:01.341785 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2132/4395] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:07:01.616494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:01.653728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-799b06aa-5f01-45c2-a4db-feb4b4abb6b8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:01.732436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-799b06aa-5f01-45c2-a4db-feb4b4abb6b8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:01.735925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-799b06aa-5f01-45c2-a4db-feb4b4abb6b8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:01.743305 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-799b06aa-5f01-45c2-a4db-feb4b4abb6b8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.573908 Sep 08 13:07:01.768386 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2264/4396] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:01 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:07:02.245819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-84a5fb34-49c3-4965-a4f2-600ab30bc5f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:02.249971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-84a5fb34-49c3-4965-a4f2-600ab30bc5f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:02.272241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84a5fb34-49c3-4965-a4f2-600ab30bc5f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:02.273425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84a5fb34-49c3-4965-a4f2-600ab30bc5f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:02.274802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84a5fb34-49c3-4965-a4f2-600ab30bc5f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:02.276649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84a5fb34-49c3-4965-a4f2-600ab30bc5f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:02.278312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84a5fb34-49c3-4965-a4f2-600ab30bc5f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:02.279835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84a5fb34-49c3-4965-a4f2-600ab30bc5f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:02.807669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7187910b-3e15-4835-8dc5-63b27dfd677a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:02.811578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7187910b-3e15-4835-8dc5-63b27dfd677a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:02.841315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:02.875950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7187910b-3e15-4835-8dc5-63b27dfd677a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:02.878264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7187910b-3e15-4835-8dc5-63b27dfd677a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:02.883934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7187910b-3e15-4835-8dc5-63b27dfd677a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:02.886775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7187910b-3e15-4835-8dc5-63b27dfd677a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:02.894775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7187910b-3e15-4835-8dc5-63b27dfd677a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:02.899657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7187910b-3e15-4835-8dc5-63b27dfd677a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:03.180803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-84a5fb34-49c3-4965-a4f2-600ab30bc5f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:03.213241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7187910b-3e15-4835-8dc5-63b27dfd677a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:03.217876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-84a5fb34-49c3-4965-a4f2-600ab30bc5f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:03.237666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7187910b-3e15-4835-8dc5-63b27dfd677a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:03.239696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7187910b-3e15-4835-8dc5-63b27dfd677a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:03.241669 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7187910b-3e15-4835-8dc5-63b27dfd677a tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.445030 Sep 08 13:07:03.242557 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2265/4397] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:02 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:03.250531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-84a5fb34-49c3-4965-a4f2-600ab30bc5f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:03.253306 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-84a5fb34-49c3-4965-a4f2-600ab30bc5f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1407 microversion: 2.20 time: 1.028222 Sep 08 13:07:03.257495 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2133/4398] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:02 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1407 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:04.294957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-423f7457-6353-46b1-8edd-673fac90636d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:04.297385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8a1fbd8c-351d-4e16-93ae-fba321bb9e1e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:04.298976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-423f7457-6353-46b1-8edd-673fac90636d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:04.300630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8a1fbd8c-351d-4e16-93ae-fba321bb9e1e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:04.324173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:04.332799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a1fbd8c-351d-4e16-93ae-fba321bb9e1e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:04.334250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-423f7457-6353-46b1-8edd-673fac90636d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:04.341078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-423f7457-6353-46b1-8edd-673fac90636d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:04.342073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a1fbd8c-351d-4e16-93ae-fba321bb9e1e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:04.342780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-423f7457-6353-46b1-8edd-673fac90636d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:04.343505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a1fbd8c-351d-4e16-93ae-fba321bb9e1e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:04.345239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a1fbd8c-351d-4e16-93ae-fba321bb9e1e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:04.347090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-423f7457-6353-46b1-8edd-673fac90636d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:04.347934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-423f7457-6353-46b1-8edd-673fac90636d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:04.348729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a1fbd8c-351d-4e16-93ae-fba321bb9e1e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:04.349375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-423f7457-6353-46b1-8edd-673fac90636d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:04.352753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a1fbd8c-351d-4e16-93ae-fba321bb9e1e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:04.994342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8a1fbd8c-351d-4e16-93ae-fba321bb9e1e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:05.042063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8a1fbd8c-351d-4e16-93ae-fba321bb9e1e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:05.054396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8a1fbd8c-351d-4e16-93ae-fba321bb9e1e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:05.060675 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8a1fbd8c-351d-4e16-93ae-fba321bb9e1e tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.773660 Sep 08 13:07:05.065599 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2266/4399] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:04 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:05.162024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-423f7457-6353-46b1-8edd-673fac90636d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:05.189899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-423f7457-6353-46b1-8edd-673fac90636d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:05.203771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-423f7457-6353-46b1-8edd-673fac90636d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:05.205039 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-423f7457-6353-46b1-8edd-673fac90636d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1407 microversion: 2.20 time: 0.914588 Sep 08 13:07:05.222232 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2134/4400] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:04 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1407 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:07:06.097753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4b0b33f-edb8-40c8-b775-a09814e17f8b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:06.098713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a4b0b33f-edb8-40c8-b775-a09814e17f8b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:06.112226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4b0b33f-edb8-40c8-b775-a09814e17f8b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:06.114186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4b0b33f-edb8-40c8-b775-a09814e17f8b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:06.114647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4b0b33f-edb8-40c8-b775-a09814e17f8b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:06.121373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4b0b33f-edb8-40c8-b775-a09814e17f8b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:06.122198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4b0b33f-edb8-40c8-b775-a09814e17f8b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:06.122768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4b0b33f-edb8-40c8-b775-a09814e17f8b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:06.271051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-64fe0146-ca13-4cb9-abb4-16bf4fc4d2e3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:06.277605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4b0b33f-edb8-40c8-b775-a09814e17f8b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:06.284951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-64fe0146-ca13-4cb9-abb4-16bf4fc4d2e3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:06.324622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4b0b33f-edb8-40c8-b775-a09814e17f8b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:06.334541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64fe0146-ca13-4cb9-abb4-16bf4fc4d2e3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:06.335550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64fe0146-ca13-4cb9-abb4-16bf4fc4d2e3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:06.338957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64fe0146-ca13-4cb9-abb4-16bf4fc4d2e3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:06.343667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4b0b33f-edb8-40c8-b775-a09814e17f8b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:06.345423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64fe0146-ca13-4cb9-abb4-16bf4fc4d2e3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:06.346342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64fe0146-ca13-4cb9-abb4-16bf4fc4d2e3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:06.347171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64fe0146-ca13-4cb9-abb4-16bf4fc4d2e3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:06.353394 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a4b0b33f-edb8-40c8-b775-a09814e17f8b tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.255620 Sep 08 13:07:06.356227 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2267/4401] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:06 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:06.871886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-64fe0146-ca13-4cb9-abb4-16bf4fc4d2e3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:06.894875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-64fe0146-ca13-4cb9-abb4-16bf4fc4d2e3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:06.905882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-64fe0146-ca13-4cb9-abb4-16bf4fc4d2e3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:06.907714 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-64fe0146-ca13-4cb9-abb4-16bf4fc4d2e3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1407 microversion: 2.20 time: 0.650141 Sep 08 13:07:06.908539 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2135/4402] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:06 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1407 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:07:07.409034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7011ca39-842f-4782-b567-d37c18b6eb6f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:07.410201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7011ca39-842f-4782-b567-d37c18b6eb6f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:07.427118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7011ca39-842f-4782-b567-d37c18b6eb6f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:07.428151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7011ca39-842f-4782-b567-d37c18b6eb6f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:07.428603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7011ca39-842f-4782-b567-d37c18b6eb6f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:07.429871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7011ca39-842f-4782-b567-d37c18b6eb6f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:07.430650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7011ca39-842f-4782-b567-d37c18b6eb6f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:07.431592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7011ca39-842f-4782-b567-d37c18b6eb6f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:07.648046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7011ca39-842f-4782-b567-d37c18b6eb6f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:07.669164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7011ca39-842f-4782-b567-d37c18b6eb6f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:07.673319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7011ca39-842f-4782-b567-d37c18b6eb6f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:07.677791 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7011ca39-842f-4782-b567-d37c18b6eb6f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.274706 Sep 08 13:07:07.679986 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2136/4403] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:07 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:07.967366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a1db32e-24ea-4a6d-bf60-a70cfe3fc949 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:07.971307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2a1db32e-24ea-4a6d-bf60-a70cfe3fc949 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:08.007365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a1db32e-24ea-4a6d-bf60-a70cfe3fc949 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:08.008558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a1db32e-24ea-4a6d-bf60-a70cfe3fc949 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:08.010910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a1db32e-24ea-4a6d-bf60-a70cfe3fc949 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:08.016402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a1db32e-24ea-4a6d-bf60-a70cfe3fc949 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:08.019596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a1db32e-24ea-4a6d-bf60-a70cfe3fc949 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:08.022538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a1db32e-24ea-4a6d-bf60-a70cfe3fc949 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:08.103150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:08.163191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-685532996", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:07:08.356454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] validate_networks() for [('6cf9ac04-bf1b-4fd3-befb-5346c4907700', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:07:08.578929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2a1db32e-24ea-4a6d-bf60-a70cfe3fc949 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:08.614744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2a1db32e-24ea-4a6d-bf60-a70cfe3fc949 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:08.623449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2a1db32e-24ea-4a6d-bf60-a70cfe3fc949 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:08.636500 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a1db32e-24ea-4a6d-bf60-a70cfe3fc949 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1407 microversion: 2.20 time: 0.671296 Sep 08 13:07:08.640449 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2137/4404] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:07 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1407 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:07:08.740681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-459d7d4d-3c3a-4491-a7fe-05c3d2b50502 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:08.748778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-459d7d4d-3c3a-4491-a7fe-05c3d2b50502 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:08.781977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-459d7d4d-3c3a-4491-a7fe-05c3d2b50502 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:08.790301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-459d7d4d-3c3a-4491-a7fe-05c3d2b50502 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:08.795816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-459d7d4d-3c3a-4491-a7fe-05c3d2b50502 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:08.799550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-459d7d4d-3c3a-4491-a7fe-05c3d2b50502 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:08.801588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-459d7d4d-3c3a-4491-a7fe-05c3d2b50502 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:08.809643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-459d7d4d-3c3a-4491-a7fe-05c3d2b50502 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:09.272394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-459d7d4d-3c3a-4491-a7fe-05c3d2b50502 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:09.319027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-459d7d4d-3c3a-4491-a7fe-05c3d2b50502 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:09.334477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-459d7d4d-3c3a-4491-a7fe-05c3d2b50502 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:09.339764 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-459d7d4d-3c3a-4491-a7fe-05c3d2b50502 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.610263 Sep 08 13:07:09.343205 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2138/4405] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:08 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:07:09.728880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-152f876e-308e-48a6-be06-99eebae115d6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:09.731392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-152f876e-308e-48a6-be06-99eebae115d6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:09.764576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-152f876e-308e-48a6-be06-99eebae115d6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:09.766617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-152f876e-308e-48a6-be06-99eebae115d6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:09.768230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-152f876e-308e-48a6-be06-99eebae115d6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:09.770532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-152f876e-308e-48a6-be06-99eebae115d6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:09.772046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-152f876e-308e-48a6-be06-99eebae115d6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:09.775485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-152f876e-308e-48a6-be06-99eebae115d6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:09.966248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:07:09.967543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:07:09.968155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:07:09.968946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:07:09.969768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:07:10.021250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:10.023931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:10.026357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:10.031684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:10.035271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:10.036632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:10.091790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Getting quotas for project 0d6967bf506a413c92acc93b58778334. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:07:10.106926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Getting quotas for user 2d3977def69d4b5e8c91be7b122f4764 and project 0d6967bf506a413c92acc93b58778334. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:07:10.169156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:07:10.184026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:07:10.360347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-152f876e-308e-48a6-be06-99eebae115d6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:10.373172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-152f876e-308e-48a6-be06-99eebae115d6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:10.374943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-152f876e-308e-48a6-be06-99eebae115d6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:10.376271 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-152f876e-308e-48a6-be06-99eebae115d6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1407 microversion: 2.20 time: 0.677506 Sep 08 13:07:10.389292 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2139/4406] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:09 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1407 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:10.404783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8f25df97-7a32-44dc-9a49-b56a6e9ce759 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:10.412708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8f25df97-7a32-44dc-9a49-b56a6e9ce759 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:10.432110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f25df97-7a32-44dc-9a49-b56a6e9ce759 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:10.432714 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-777bf55b-e4ec-45d5-8d33-9cb3a7c8cc74 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.124090 Sep 08 13:07:10.434846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f25df97-7a32-44dc-9a49-b56a6e9ce759 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:10.439494 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2268/4407] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:07:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 3149 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:07:10.446340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f25df97-7a32-44dc-9a49-b56a6e9ce759 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:10.448009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f25df97-7a32-44dc-9a49-b56a6e9ce759 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:10.449724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f25df97-7a32-44dc-9a49-b56a6e9ce759 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:10.452942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f25df97-7a32-44dc-9a49-b56a6e9ce759 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:10.461094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-53480cae-488d-4a6f-9115-f1906aed5503 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:10.466313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-53480cae-488d-4a6f-9115-f1906aed5503 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:10.667951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-53480cae-488d-4a6f-9115-f1906aed5503 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:10.690634 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-53480cae-488d-4a6f-9115-f1906aed5503 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1216 microversion: 2.1 time: 0.243491 Sep 08 13:07:10.704908 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2269/4408] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:10 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1216 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:10.804949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8f25df97-7a32-44dc-9a49-b56a6e9ce759 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:10.855155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8f25df97-7a32-44dc-9a49-b56a6e9ce759 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:10.861791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8f25df97-7a32-44dc-9a49-b56a6e9ce759 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:10.883576 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8f25df97-7a32-44dc-9a49-b56a6e9ce759 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.483219 Sep 08 13:07:10.908537 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2140/4409] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:10 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:11.448340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da7d3eef-50c6-42f2-9174-fffcce2084c9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:11.449110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-da7d3eef-50c6-42f2-9174-fffcce2084c9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:11.490932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da7d3eef-50c6-42f2-9174-fffcce2084c9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:11.493654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da7d3eef-50c6-42f2-9174-fffcce2084c9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:11.497175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da7d3eef-50c6-42f2-9174-fffcce2084c9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:11.502107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da7d3eef-50c6-42f2-9174-fffcce2084c9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:11.506395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da7d3eef-50c6-42f2-9174-fffcce2084c9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:11.509481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da7d3eef-50c6-42f2-9174-fffcce2084c9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:11.733690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3971b247-a746-4340-8462-76fba6c42491 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:11.733690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3971b247-a746-4340-8462-76fba6c42491 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:11.937908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3971b247-a746-4340-8462-76fba6c42491 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:11.947915 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3971b247-a746-4340-8462-76fba6c42491 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1216 microversion: 2.1 time: 0.223831 Sep 08 13:07:11.953516 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2141/4410] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:11 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1216 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:07:11.984652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a43a990a-e980-4dba-913f-eaa2f8f60d02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:11.986882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a43a990a-e980-4dba-913f-eaa2f8f60d02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:12.010372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a43a990a-e980-4dba-913f-eaa2f8f60d02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:12.013070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a43a990a-e980-4dba-913f-eaa2f8f60d02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:12.016166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a43a990a-e980-4dba-913f-eaa2f8f60d02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:12.018516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a43a990a-e980-4dba-913f-eaa2f8f60d02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:12.026880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a43a990a-e980-4dba-913f-eaa2f8f60d02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:12.027596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a43a990a-e980-4dba-913f-eaa2f8f60d02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:12.072738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-da7d3eef-50c6-42f2-9174-fffcce2084c9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:12.138456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-da7d3eef-50c6-42f2-9174-fffcce2084c9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:12.149261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-da7d3eef-50c6-42f2-9174-fffcce2084c9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:12.156703 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-da7d3eef-50c6-42f2-9174-fffcce2084c9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1407 microversion: 2.20 time: 0.712681 Sep 08 13:07:12.169264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a43a990a-e980-4dba-913f-eaa2f8f60d02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:12.176062 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2270/4411] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:11 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1407 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:12.188849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a43a990a-e980-4dba-913f-eaa2f8f60d02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:12.193329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a43a990a-e980-4dba-913f-eaa2f8f60d02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:12.202240 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a43a990a-e980-4dba-913f-eaa2f8f60d02 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.233133 Sep 08 13:07:12.203483 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2142/4412] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:11 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:12.942669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e9b1127e-daea-43c2-866d-c3dbe9ab7697 req-d4a518c9-a1c7-4c31-9efa-d118ef3b1afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68", "name": "network-vif-plugged", "status": "completed", "tag": "bab66cd4-e2d1-4c9a-803e-24552207b4f0"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:07:12.983869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-19633a38-1302-4439-8e81-af8bad31d641 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:12.984994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-19633a38-1302-4439-8e81-af8bad31d641 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:13.001211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19633a38-1302-4439-8e81-af8bad31d641 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:13.005295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19633a38-1302-4439-8e81-af8bad31d641 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:13.007552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19633a38-1302-4439-8e81-af8bad31d641 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:13.009522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19633a38-1302-4439-8e81-af8bad31d641 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:13.010709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19633a38-1302-4439-8e81-af8bad31d641 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:13.012897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e9b1127e-daea-43c2-866d-c3dbe9ab7697 req-d4a518c9-a1c7-4c31-9efa-d118ef3b1afb service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:13.013416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e9b1127e-daea-43c2-866d-c3dbe9ab7697 req-d4a518c9-a1c7-4c31-9efa-d118ef3b1afb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:13.013874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e9b1127e-daea-43c2-866d-c3dbe9ab7697 req-d4a518c9-a1c7-4c31-9efa-d118ef3b1afb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:13.015277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19633a38-1302-4439-8e81-af8bad31d641 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:13.022193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=90 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:13.048163 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e9b1127e-daea-43c2-866d-c3dbe9ab7697 req-d4a518c9-a1c7-4c31-9efa-d118ef3b1afb service nova] Creating event network-vif-plugged:bab66cd4-e2d1-4c9a-803e-24552207b4f0 for instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 on n-h2-852084-10 Sep 08 13:07:13.056698 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e9b1127e-daea-43c2-866d-c3dbe9ab7697 req-d4a518c9-a1c7-4c31-9efa-d118ef3b1afb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123087 Sep 08 13:07:13.058221 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2271/4413] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:07:13.211583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-19633a38-1302-4439-8e81-af8bad31d641 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:13.215354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4fc48c57-144f-45a5-9b2b-3fb6554226ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:13.216928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4fc48c57-144f-45a5-9b2b-3fb6554226ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:13.244543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fc48c57-144f-45a5-9b2b-3fb6554226ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:13.246076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fc48c57-144f-45a5-9b2b-3fb6554226ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:13.248805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fc48c57-144f-45a5-9b2b-3fb6554226ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:13.249807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fc48c57-144f-45a5-9b2b-3fb6554226ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:13.251498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fc48c57-144f-45a5-9b2b-3fb6554226ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:13.253156 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-19633a38-1302-4439-8e81-af8bad31d641 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1268 microversion: 2.1 time: 0.275041 Sep 08 13:07:13.254299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fc48c57-144f-45a5-9b2b-3fb6554226ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:13.259971 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2143/4414] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:12 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1268 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:07:13.292018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-23e71c8d-df7d-4907-a922-31ce02d9ccd1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:13.301759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-23e71c8d-df7d-4907-a922-31ce02d9ccd1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:13.326257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e71c8d-df7d-4907-a922-31ce02d9ccd1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:13.330402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e71c8d-df7d-4907-a922-31ce02d9ccd1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:13.333315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e71c8d-df7d-4907-a922-31ce02d9ccd1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:13.344239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e71c8d-df7d-4907-a922-31ce02d9ccd1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:13.350591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e71c8d-df7d-4907-a922-31ce02d9ccd1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:13.359121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e71c8d-df7d-4907-a922-31ce02d9ccd1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:14.057248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-23e71c8d-df7d-4907-a922-31ce02d9ccd1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:14.111622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-23e71c8d-df7d-4907-a922-31ce02d9ccd1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:14.127425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-23e71c8d-df7d-4907-a922-31ce02d9ccd1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:14.130838 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-23e71c8d-df7d-4907-a922-31ce02d9ccd1 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.868587 Sep 08 13:07:14.132712 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2144/4415] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:13 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:14.235869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4fc48c57-144f-45a5-9b2b-3fb6554226ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:14.247391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4fc48c57-144f-45a5-9b2b-3fb6554226ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:14.249526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4fc48c57-144f-45a5-9b2b-3fb6554226ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:14.252507 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4fc48c57-144f-45a5-9b2b-3fb6554226ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1407 microversion: 2.20 time: 1.043864 Sep 08 13:07:14.267286 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2272/4416] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:13 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1407 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:07:14.301909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4ba69cd1-f269-4622-9f8c-89dea2c2dcb9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:14.302949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ba69cd1-f269-4622-9f8c-89dea2c2dcb9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:14.363710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ba69cd1-f269-4622-9f8c-89dea2c2dcb9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:14.364689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ba69cd1-f269-4622-9f8c-89dea2c2dcb9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:14.365438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ba69cd1-f269-4622-9f8c-89dea2c2dcb9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:14.371308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ba69cd1-f269-4622-9f8c-89dea2c2dcb9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:14.372183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ba69cd1-f269-4622-9f8c-89dea2c2dcb9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:14.372951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ba69cd1-f269-4622-9f8c-89dea2c2dcb9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:14.810792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4ba69cd1-f269-4622-9f8c-89dea2c2dcb9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:14.850142 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4ba69cd1-f269-4622-9f8c-89dea2c2dcb9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1274 microversion: 2.1 time: 0.556953 Sep 08 13:07:14.867286 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2145/4417] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:14 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1274 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:15.195369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e923715e-42e3-44a9-9a96-7124cc2508b4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:15.198993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e923715e-42e3-44a9-9a96-7124cc2508b4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:15.226114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:15.234065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e923715e-42e3-44a9-9a96-7124cc2508b4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:15.235512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e923715e-42e3-44a9-9a96-7124cc2508b4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:15.236210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e923715e-42e3-44a9-9a96-7124cc2508b4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:15.244981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e923715e-42e3-44a9-9a96-7124cc2508b4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:15.250760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e923715e-42e3-44a9-9a96-7124cc2508b4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:15.251985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e923715e-42e3-44a9-9a96-7124cc2508b4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:15.286840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-efd62765-1a5b-4bec-adb9-9b42d864a10f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:15.290552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-efd62765-1a5b-4bec-adb9-9b42d864a10f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:15.329061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efd62765-1a5b-4bec-adb9-9b42d864a10f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:15.333270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efd62765-1a5b-4bec-adb9-9b42d864a10f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:15.336240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efd62765-1a5b-4bec-adb9-9b42d864a10f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:15.338441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efd62765-1a5b-4bec-adb9-9b42d864a10f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:15.340203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efd62765-1a5b-4bec-adb9-9b42d864a10f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:15.341694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efd62765-1a5b-4bec-adb9-9b42d864a10f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:15.523575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e923715e-42e3-44a9-9a96-7124cc2508b4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:15.570326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e923715e-42e3-44a9-9a96-7124cc2508b4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:15.574830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e923715e-42e3-44a9-9a96-7124cc2508b4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:15.578460 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e923715e-42e3-44a9-9a96-7124cc2508b4 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.394080 Sep 08 13:07:15.582280 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2273/4418] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:15 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:15.840129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-efd62765-1a5b-4bec-adb9-9b42d864a10f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:15.860484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-efd62765-1a5b-4bec-adb9-9b42d864a10f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:15.865933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-efd62765-1a5b-4bec-adb9-9b42d864a10f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:15.869916 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-efd62765-1a5b-4bec-adb9-9b42d864a10f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1407 microversion: 2.20 time: 0.592222 Sep 08 13:07:15.870993 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2146/4419] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:15 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1407 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:15.906361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ebc8dd94-d2a2-4d22-bd7e-0b57eb249948 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:15.909364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ebc8dd94-d2a2-4d22-bd7e-0b57eb249948 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:15.935809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc8dd94-d2a2-4d22-bd7e-0b57eb249948 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:15.936695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc8dd94-d2a2-4d22-bd7e-0b57eb249948 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:15.937324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc8dd94-d2a2-4d22-bd7e-0b57eb249948 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:15.938734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc8dd94-d2a2-4d22-bd7e-0b57eb249948 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:15.939999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc8dd94-d2a2-4d22-bd7e-0b57eb249948 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:15.941348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc8dd94-d2a2-4d22-bd7e-0b57eb249948 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:16.109432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ebc8dd94-d2a2-4d22-bd7e-0b57eb249948 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:16.128117 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ebc8dd94-d2a2-4d22-bd7e-0b57eb249948 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1274 microversion: 2.1 time: 0.231098 Sep 08 13:07:16.131146 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2274/4420] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:15 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:16.638779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-626007a8-da10-442a-9ffa-410063292313 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:16.642115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-626007a8-da10-442a-9ffa-410063292313 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:16.666885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-626007a8-da10-442a-9ffa-410063292313 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:16.667440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-626007a8-da10-442a-9ffa-410063292313 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:16.668040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-626007a8-da10-442a-9ffa-410063292313 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:16.668798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-626007a8-da10-442a-9ffa-410063292313 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:16.670184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-626007a8-da10-442a-9ffa-410063292313 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:16.670633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-626007a8-da10-442a-9ffa-410063292313 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:16.828004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-626007a8-da10-442a-9ffa-410063292313 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:16.862177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-626007a8-da10-442a-9ffa-410063292313 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:16.867596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-626007a8-da10-442a-9ffa-410063292313 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:16.879390 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-626007a8-da10-442a-9ffa-410063292313 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.247994 Sep 08 13:07:16.881449 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2147/4421] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:16 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:16.927911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-67d3f05a-4f06-46a4-b838-5c158592d06e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:16.928740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-67d3f05a-4f06-46a4-b838-5c158592d06e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:16.946738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67d3f05a-4f06-46a4-b838-5c158592d06e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:16.947534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67d3f05a-4f06-46a4-b838-5c158592d06e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:16.948183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67d3f05a-4f06-46a4-b838-5c158592d06e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:16.949097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67d3f05a-4f06-46a4-b838-5c158592d06e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:16.951020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67d3f05a-4f06-46a4-b838-5c158592d06e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:16.951897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67d3f05a-4f06-46a4-b838-5c158592d06e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:17.156507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-66ec4c44-0015-4e33-8e72-0d83d86f8edb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:17.157442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-66ec4c44-0015-4e33-8e72-0d83d86f8edb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:17.177755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66ec4c44-0015-4e33-8e72-0d83d86f8edb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:17.179041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66ec4c44-0015-4e33-8e72-0d83d86f8edb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:17.180192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66ec4c44-0015-4e33-8e72-0d83d86f8edb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:17.183005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66ec4c44-0015-4e33-8e72-0d83d86f8edb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:17.184584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66ec4c44-0015-4e33-8e72-0d83d86f8edb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:17.185888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66ec4c44-0015-4e33-8e72-0d83d86f8edb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:17.456125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-66ec4c44-0015-4e33-8e72-0d83d86f8edb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:17.485085 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-66ec4c44-0015-4e33-8e72-0d83d86f8edb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1274 microversion: 2.1 time: 0.333976 Sep 08 13:07:17.488616 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2148/4422] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:17 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1274 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:17.512192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-67d3f05a-4f06-46a4-b838-5c158592d06e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:17.539864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-67d3f05a-4f06-46a4-b838-5c158592d06e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:17.544283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-67d3f05a-4f06-46a4-b838-5c158592d06e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:17.547050 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-67d3f05a-4f06-46a4-b838-5c158592d06e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1599 microversion: 2.20 time: 0.630719 Sep 08 13:07:17.549410 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2275/4423] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:16 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1599 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:07:17.602696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-593a5b52-d8da-4ab2-bf48-b44d96cdcff1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:17.602696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-593a5b52-d8da-4ab2-bf48-b44d96cdcff1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:17.620572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-593a5b52-d8da-4ab2-bf48-b44d96cdcff1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:17.621418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-593a5b52-d8da-4ab2-bf48-b44d96cdcff1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:17.622233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-593a5b52-d8da-4ab2-bf48-b44d96cdcff1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:17.623551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-593a5b52-d8da-4ab2-bf48-b44d96cdcff1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:17.624389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-593a5b52-d8da-4ab2-bf48-b44d96cdcff1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:17.625206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-593a5b52-d8da-4ab2-bf48-b44d96cdcff1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:17.793104 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-593a5b52-d8da-4ab2-bf48-b44d96cdcff1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.202328 Sep 08 13:07:17.795431 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2149/4424] 10.222.0.78 () {60 vars in 1316 bytes} [Thu Sep 8 13:07:17 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-interface => generated 284 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:07:17.915270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-63a035dd-55a0-46dc-86d5-a1069de6b9de tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:17.916303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-63a035dd-55a0-46dc-86d5-a1069de6b9de tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:17.961009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63a035dd-55a0-46dc-86d5-a1069de6b9de tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:17.962975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63a035dd-55a0-46dc-86d5-a1069de6b9de tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:17.965444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63a035dd-55a0-46dc-86d5-a1069de6b9de tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:17.968666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63a035dd-55a0-46dc-86d5-a1069de6b9de tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:17.972829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63a035dd-55a0-46dc-86d5-a1069de6b9de tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:17.973992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-63a035dd-55a0-46dc-86d5-a1069de6b9de tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:18.317690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-63a035dd-55a0-46dc-86d5-a1069de6b9de tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:18.339017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-63a035dd-55a0-46dc-86d5-a1069de6b9de tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:18.351321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-63a035dd-55a0-46dc-86d5-a1069de6b9de tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:18.359047 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-63a035dd-55a0-46dc-86d5-a1069de6b9de tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.451269 Sep 08 13:07:18.363891 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2276/4425] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:17 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:07:18.528687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4c37778e-21d3-4fc5-84dc-43cd8b54c6fc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:18.532714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4c37778e-21d3-4fc5-84dc-43cd8b54c6fc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:18.561992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c37778e-21d3-4fc5-84dc-43cd8b54c6fc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:18.564957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c37778e-21d3-4fc5-84dc-43cd8b54c6fc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:18.569708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c37778e-21d3-4fc5-84dc-43cd8b54c6fc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:18.573662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c37778e-21d3-4fc5-84dc-43cd8b54c6fc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:18.578610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c37778e-21d3-4fc5-84dc-43cd8b54c6fc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:18.581200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c37778e-21d3-4fc5-84dc-43cd8b54c6fc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:19.314584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4c37778e-21d3-4fc5-84dc-43cd8b54c6fc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:19.332801 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4c37778e-21d3-4fc5-84dc-43cd8b54c6fc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1316 microversion: 2.1 time: 0.812432 Sep 08 13:07:19.335907 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2150/4426] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:18 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1316 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:19.396253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5d5d8704-d5d8-41ff-9e4e-a75cd0af3a10 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:19.398963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5d5d8704-d5d8-41ff-9e4e-a75cd0af3a10 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:19.415280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d5d8704-d5d8-41ff-9e4e-a75cd0af3a10 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:19.416569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d5d8704-d5d8-41ff-9e4e-a75cd0af3a10 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:19.417679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d5d8704-d5d8-41ff-9e4e-a75cd0af3a10 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:19.420181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d5d8704-d5d8-41ff-9e4e-a75cd0af3a10 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:19.421429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d5d8704-d5d8-41ff-9e4e-a75cd0af3a10 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:19.422464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d5d8704-d5d8-41ff-9e4e-a75cd0af3a10 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:19.616465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5d5d8704-d5d8-41ff-9e4e-a75cd0af3a10 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:19.653508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5d5d8704-d5d8-41ff-9e4e-a75cd0af3a10 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:19.671500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5d5d8704-d5d8-41ff-9e4e-a75cd0af3a10 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:19.675989 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5d5d8704-d5d8-41ff-9e4e-a75cd0af3a10 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.289301 Sep 08 13:07:19.679757 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2277/4427] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:19 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:07:20.375808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d4ad9d2c-de07-4c62-9bf9-cb55388100be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:20.376565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d4ad9d2c-de07-4c62-9bf9-cb55388100be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:20.388278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4ad9d2c-de07-4c62-9bf9-cb55388100be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:20.396142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4ad9d2c-de07-4c62-9bf9-cb55388100be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:20.396946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4ad9d2c-de07-4c62-9bf9-cb55388100be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:20.398137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4ad9d2c-de07-4c62-9bf9-cb55388100be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:20.399282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4ad9d2c-de07-4c62-9bf9-cb55388100be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:20.403426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4ad9d2c-de07-4c62-9bf9-cb55388100be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:20.739860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a15f8327-2c6c-4546-9a23-e21bb0f05de8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:20.745969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a15f8327-2c6c-4546-9a23-e21bb0f05de8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:20.749092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:20.752471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:20.760765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a15f8327-2c6c-4546-9a23-e21bb0f05de8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:20.761532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a15f8327-2c6c-4546-9a23-e21bb0f05de8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:20.763445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a15f8327-2c6c-4546-9a23-e21bb0f05de8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:20.766151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a15f8327-2c6c-4546-9a23-e21bb0f05de8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:20.767320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a15f8327-2c6c-4546-9a23-e21bb0f05de8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:20.768307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a15f8327-2c6c-4546-9a23-e21bb0f05de8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:21.088332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a15f8327-2c6c-4546-9a23-e21bb0f05de8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:21.131488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a15f8327-2c6c-4546-9a23-e21bb0f05de8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:21.141924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d4ad9d2c-de07-4c62-9bf9-cb55388100be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:21.145271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a15f8327-2c6c-4546-9a23-e21bb0f05de8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:21.148281 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a15f8327-2c6c-4546-9a23-e21bb0f05de8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.414603 Sep 08 13:07:21.153901 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2278/4428] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:20 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:21.200547 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d4ad9d2c-de07-4c62-9bf9-cb55388100be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1316 microversion: 2.1 time: 0.830113 Sep 08 13:07:21.217662 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2151/4429] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:20 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1316 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:21.486603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-9f8c8ce6-307c-4e6d-b4fe-2d6c84c4ee94 req-7f81c8aa-4484-46b9-8dc8-fbe750557d5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68", "tag": "bab66cd4-e2d1-4c9a-803e-24552207b4f0"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:07:21.508684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9f8c8ce6-307c-4e6d-b4fe-2d6c84c4ee94 req-7f81c8aa-4484-46b9-8dc8-fbe750557d5b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:21.510119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9f8c8ce6-307c-4e6d-b4fe-2d6c84c4ee94 req-7f81c8aa-4484-46b9-8dc8-fbe750557d5b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:21.512010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9f8c8ce6-307c-4e6d-b4fe-2d6c84c4ee94 req-7f81c8aa-4484-46b9-8dc8-fbe750557d5b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:21.541653 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-9f8c8ce6-307c-4e6d-b4fe-2d6c84c4ee94 req-7f81c8aa-4484-46b9-8dc8-fbe750557d5b service nova] Creating event network-changed:bab66cd4-e2d1-4c9a-803e-24552207b4f0 for instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 on n-h2-852084-10 Sep 08 13:07:21.569421 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-9f8c8ce6-307c-4e6d-b4fe-2d6c84c4ee94 req-7f81c8aa-4484-46b9-8dc8-fbe750557d5b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089380 Sep 08 13:07:21.572407 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2279/4430] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:07:22.204311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aff220a3-121a-4250-80a2-5814084f0417 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:22.206393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-aff220a3-121a-4250-80a2-5814084f0417 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:22.218942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:22.223834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aff220a3-121a-4250-80a2-5814084f0417 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:22.225294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aff220a3-121a-4250-80a2-5814084f0417 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:22.226385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aff220a3-121a-4250-80a2-5814084f0417 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:22.228850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aff220a3-121a-4250-80a2-5814084f0417 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:22.230019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aff220a3-121a-4250-80a2-5814084f0417 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:22.231754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aff220a3-121a-4250-80a2-5814084f0417 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:22.246625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-506804e7-efd4-4b61-acb2-d1d08924526c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:22.247530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-506804e7-efd4-4b61-acb2-d1d08924526c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:22.283768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-506804e7-efd4-4b61-acb2-d1d08924526c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:22.300831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-506804e7-efd4-4b61-acb2-d1d08924526c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:22.301717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-506804e7-efd4-4b61-acb2-d1d08924526c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:22.303083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-506804e7-efd4-4b61-acb2-d1d08924526c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:22.304029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-506804e7-efd4-4b61-acb2-d1d08924526c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:22.304853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-506804e7-efd4-4b61-acb2-d1d08924526c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:23.677150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-aff220a3-121a-4250-80a2-5814084f0417 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:23.722337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-aff220a3-121a-4250-80a2-5814084f0417 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:23.752629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-aff220a3-121a-4250-80a2-5814084f0417 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:23.776814 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-aff220a3-121a-4250-80a2-5814084f0417 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 1.573660 Sep 08 13:07:23.778511 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2152/4431] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:22 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:23.801321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-48f55925-4471-4d35-aad2-ad2c162a3583 req-dd39bbb6-e5e4-400f-9d81-c148d2e60ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eb421d7-2415-43d2-a6bb-3fdbca098091", "tag": "633f3920-4732-4687-b8a2-8db04d18d889"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:07:23.850266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-48f55925-4471-4d35-aad2-ad2c162a3583 req-dd39bbb6-e5e4-400f-9d81-c148d2e60ad2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:23.851285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-48f55925-4471-4d35-aad2-ad2c162a3583 req-dd39bbb6-e5e4-400f-9d81-c148d2e60ad2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:23.858850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-48f55925-4471-4d35-aad2-ad2c162a3583 req-dd39bbb6-e5e4-400f-9d81-c148d2e60ad2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:23.924503 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-48f55925-4471-4d35-aad2-ad2c162a3583 req-dd39bbb6-e5e4-400f-9d81-c148d2e60ad2 service nova] Creating event network-changed:633f3920-4732-4687-b8a2-8db04d18d889 for instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 on n-h1-852084-10 Sep 08 13:07:23.963870 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-48f55925-4471-4d35-aad2-ad2c162a3583 req-dd39bbb6-e5e4-400f-9d81-c148d2e60ad2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182423 Sep 08 13:07:23.970004 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2153/4432] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:07:23.996630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ba803dbf-d6d5-432f-8370-e1f3f0e42f29 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:07:24.007326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ba803dbf-d6d5-432f-8370-e1f3f0e42f29 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:24.038338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba803dbf-d6d5-432f-8370-e1f3f0e42f29 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:24.039647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba803dbf-d6d5-432f-8370-e1f3f0e42f29 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:24.041183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba803dbf-d6d5-432f-8370-e1f3f0e42f29 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:24.042985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba803dbf-d6d5-432f-8370-e1f3f0e42f29 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:24.044163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba803dbf-d6d5-432f-8370-e1f3f0e42f29 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:24.045293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba803dbf-d6d5-432f-8370-e1f3f0e42f29 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:24.131664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-ba803dbf-d6d5-432f-8370-e1f3f0e42f29 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lazy-loading 'flavor' on Instance uuid bfec9e61-54e7-4949-a6f6-d18640db5191 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:07:24.592234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-506804e7-efd4-4b61-acb2-d1d08924526c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:24.621690 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-506804e7-efd4-4b61-acb2-d1d08924526c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1316 microversion: 2.1 time: 2.377236 Sep 08 13:07:24.627324 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2280/4433] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:22 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1316 bytes in 2387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:24.658152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:24.743851 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ba803dbf-d6d5-432f-8370-e1f3f0e42f29 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/action" status: 200 len: 32 microversion: 2.1 time: 0.768875 Sep 08 13:07:24.748199 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2154/4434] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:07:23 2022] POST /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/action => generated 32 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:07:24.766041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d836d306-0e8c-4c41-9b8a-01abe6823a9c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:24.767112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d836d306-0e8c-4c41-9b8a-01abe6823a9c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:24.788803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d836d306-0e8c-4c41-9b8a-01abe6823a9c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:24.793016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d836d306-0e8c-4c41-9b8a-01abe6823a9c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:24.795256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d836d306-0e8c-4c41-9b8a-01abe6823a9c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:24.803193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d836d306-0e8c-4c41-9b8a-01abe6823a9c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:24.804258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d836d306-0e8c-4c41-9b8a-01abe6823a9c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:24.806393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d836d306-0e8c-4c41-9b8a-01abe6823a9c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:24.850717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a4cf3ff0-533e-42d6-9ef3-80c4a8545829 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:24.851902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a4cf3ff0-533e-42d6-9ef3-80c4a8545829 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:24.908457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4cf3ff0-533e-42d6-9ef3-80c4a8545829 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:24.913919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4cf3ff0-533e-42d6-9ef3-80c4a8545829 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:24.916567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4cf3ff0-533e-42d6-9ef3-80c4a8545829 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:24.924116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4cf3ff0-533e-42d6-9ef3-80c4a8545829 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:24.926044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4cf3ff0-533e-42d6-9ef3-80c4a8545829 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:24.927489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a4cf3ff0-533e-42d6-9ef3-80c4a8545829 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:25.627476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a4cf3ff0-533e-42d6-9ef3-80c4a8545829 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:25.657204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a4cf3ff0-533e-42d6-9ef3-80c4a8545829 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:25.657847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a4cf3ff0-533e-42d6-9ef3-80c4a8545829 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:25.660065 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a4cf3ff0-533e-42d6-9ef3-80c4a8545829 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.828227 Sep 08 13:07:25.671488 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2155/4435] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:24 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:25.671488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a0865b4c-497c-434e-8d63-9db2de228cb3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:25.671488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a0865b4c-497c-434e-8d63-9db2de228cb3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:25.695831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0865b4c-497c-434e-8d63-9db2de228cb3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:25.696782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0865b4c-497c-434e-8d63-9db2de228cb3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:25.700115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0865b4c-497c-434e-8d63-9db2de228cb3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:25.707437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0865b4c-497c-434e-8d63-9db2de228cb3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:25.708064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0865b4c-497c-434e-8d63-9db2de228cb3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:25.708624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0865b4c-497c-434e-8d63-9db2de228cb3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:25.889448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d836d306-0e8c-4c41-9b8a-01abe6823a9c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:25.930505 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d836d306-0e8c-4c41-9b8a-01abe6823a9c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1733 microversion: 2.1 time: 1.173524 Sep 08 13:07:25.943280 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2281/4436] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:24 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1733 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:26.424724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a0865b4c-497c-434e-8d63-9db2de228cb3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:26.455927 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a0865b4c-497c-434e-8d63-9db2de228cb3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1316 microversion: 2.1 time: 0.793209 Sep 08 13:07:26.458473 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2156/4437] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:25 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1316 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:26.715606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-658bd807-15b2-4b1a-9f22-68888da786bf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:26.724486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-658bd807-15b2-4b1a-9f22-68888da786bf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:26.764254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-658bd807-15b2-4b1a-9f22-68888da786bf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:26.767768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-658bd807-15b2-4b1a-9f22-68888da786bf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:26.768688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-658bd807-15b2-4b1a-9f22-68888da786bf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:26.770675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-658bd807-15b2-4b1a-9f22-68888da786bf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:26.771646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-658bd807-15b2-4b1a-9f22-68888da786bf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:26.777312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-658bd807-15b2-4b1a-9f22-68888da786bf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:26.978450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-536fd92b-0d50-4577-b506-44a6b9a1eb22 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:26.980987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-536fd92b-0d50-4577-b506-44a6b9a1eb22 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:27.015115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-536fd92b-0d50-4577-b506-44a6b9a1eb22 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:27.018158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-536fd92b-0d50-4577-b506-44a6b9a1eb22 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:27.026203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-536fd92b-0d50-4577-b506-44a6b9a1eb22 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:27.028471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-536fd92b-0d50-4577-b506-44a6b9a1eb22 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:27.030038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-536fd92b-0d50-4577-b506-44a6b9a1eb22 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:27.031597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-536fd92b-0d50-4577-b506-44a6b9a1eb22 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:27.130929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-658bd807-15b2-4b1a-9f22-68888da786bf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:27.158035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-658bd807-15b2-4b1a-9f22-68888da786bf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:27.164020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-658bd807-15b2-4b1a-9f22-68888da786bf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:27.167396 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-658bd807-15b2-4b1a-9f22-68888da786bf tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1605 microversion: 2.32 time: 0.462054 Sep 08 13:07:27.169521 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2282/4438] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:26 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1605 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:07:27.526105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1401bb26-dd2b-4b75-af7d-e67e127357d8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:27.543735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1401bb26-dd2b-4b75-af7d-e67e127357d8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:27.595517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1401bb26-dd2b-4b75-af7d-e67e127357d8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:27.602069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1401bb26-dd2b-4b75-af7d-e67e127357d8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:27.611695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1401bb26-dd2b-4b75-af7d-e67e127357d8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:27.629273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1401bb26-dd2b-4b75-af7d-e67e127357d8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:27.631678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1401bb26-dd2b-4b75-af7d-e67e127357d8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:27.635049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1401bb26-dd2b-4b75-af7d-e67e127357d8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:27.750837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-536fd92b-0d50-4577-b506-44a6b9a1eb22 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:27.774818 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-536fd92b-0d50-4577-b506-44a6b9a1eb22 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1733 microversion: 2.1 time: 0.808123 Sep 08 13:07:27.777099 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2157/4439] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:26 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1733 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:07:28.146586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1401bb26-dd2b-4b75-af7d-e67e127357d8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:28.196721 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1401bb26-dd2b-4b75-af7d-e67e127357d8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1316 microversion: 2.1 time: 0.699998 Sep 08 13:07:28.198094 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2283/4440] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:27 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1316 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:28.203667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:28.204389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:28.215729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:28.219072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:28.219834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:28.220722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:28.223552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:28.224162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:28.293999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:28.294888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:28.296000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:28.297917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lazy-loading 'fault' on Instance uuid d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:07:28.823350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-808d7e22-2739-46b2-aa89-a3445d9f5a35 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:28.825242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-808d7e22-2739-46b2-aa89-a3445d9f5a35 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:28.889492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-808d7e22-2739-46b2-aa89-a3445d9f5a35 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:28.890707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-808d7e22-2739-46b2-aa89-a3445d9f5a35 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:28.891692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-808d7e22-2739-46b2-aa89-a3445d9f5a35 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:28.893065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-808d7e22-2739-46b2-aa89-a3445d9f5a35 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:28.895452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-808d7e22-2739-46b2-aa89-a3445d9f5a35 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:28.897017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-808d7e22-2739-46b2-aa89-a3445d9f5a35 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:29.246678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:29.277540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:29.282854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9c69cb225dfb433b9f2f026d2b0122af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af85d8df0c104c1b901eac2599721972', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:29.285986 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7d9b9c4d-19fd-4536-87f8-7b3b322c6002 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 200 len: 1372 microversion: 2.32 time: 1.086476 Sep 08 13:07:29.306355 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2158/4441] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:28 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 1372 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:29.322445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b86b84d-45d5-44be-b333-9855c008a4f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:29.326070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5b86b84d-45d5-44be-b333-9855c008a4f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:29.345210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b86b84d-45d5-44be-b333-9855c008a4f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:29.346601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b86b84d-45d5-44be-b333-9855c008a4f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:29.349101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b86b84d-45d5-44be-b333-9855c008a4f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:29.352545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b86b84d-45d5-44be-b333-9855c008a4f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:29.353840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b86b84d-45d5-44be-b333-9855c008a4f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:29.355017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b86b84d-45d5-44be-b333-9855c008a4f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:29.516130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-808d7e22-2739-46b2-aa89-a3445d9f5a35 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:29.542204 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-808d7e22-2739-46b2-aa89-a3445d9f5a35 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1733 microversion: 2.1 time: 0.729545 Sep 08 13:07:29.548835 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2284/4442] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:28 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1733 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:29.861810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5b86b84d-45d5-44be-b333-9855c008a4f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:29.885169 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5b86b84d-45d5-44be-b333-9855c008a4f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1316 microversion: 2.1 time: 0.574553 Sep 08 13:07:29.888691 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2159/4443] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:29 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1316 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:30.367674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-258c7226-cd77-4dbf-8f07-023c46546e52 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:30.369657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-258c7226-cd77-4dbf-8f07-023c46546e52 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:30.408834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-258c7226-cd77-4dbf-8f07-023c46546e52 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:30.410728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-258c7226-cd77-4dbf-8f07-023c46546e52 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:30.411997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-258c7226-cd77-4dbf-8f07-023c46546e52 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:30.418690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-258c7226-cd77-4dbf-8f07-023c46546e52 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:30.421319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-258c7226-cd77-4dbf-8f07-023c46546e52 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:30.422538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-258c7226-cd77-4dbf-8f07-023c46546e52 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:30.548330 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-258c7226-cd77-4dbf-8f07-023c46546e52 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] HTTP exception thrown: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-258c7226-cd77-4dbf-8f07-023c46546e52 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Request method failure captured: Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 HTTP/1.1 Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGecwWxvhUcBHvdvtIiMCA-j9E5Z7d6c4Hho31H92ln3cXvZ_kkCdJxhq24rZ53VrVKQn_6cVJ4V4C-fnbOTDw_G41W0nHIRd2Jfmcp2-8G8NrPk23sSKSuVz9cSMb3hAKZGCmqFdqlnf41ddiEQZi-ItTIpzmsWw7BlgfhS5MiT87FI Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.32 Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: af85d8df0c104c1b901eac2599721972 Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TaggedBootDevicesTest-989847742 Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_af85d8df0c104c1b901eac2599721972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/af85d8df0c104c1b901eac2599721972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "tempest-type-1972079076", "name": "tempest-service-1206977435", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af85d8df0c104c1b901eac2599721972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af85d8df0c104c1b901eac2599721972"}]}, {"type": "tempest-type-659314335", "name": "tempest-service-875643165", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TaggedBootDevicesTest-989847742 Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: af85d8df0c104c1b901eac2599721972 Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TaggedBootDevicesTest-989847742 Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TaggedBootDevicesTest-989847742-project Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 9c69cb225dfb433b9f2f026d2b0122af Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TaggedBootDevicesTest-989847742-project Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'd230b17f-eb54-4a20-b3fd-72e60ed7f0c0'} Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:07:30.553270 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:30.560843 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:30.560843 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:07:30.560843 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:30.560843 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:07:30.560843 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:07:30.560843 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:07:30.560843 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:07:30.560843 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:07:30.560843 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:30.560843 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:30.572091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-258c7226-cd77-4dbf-8f07-023c46546e52 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Returning 404 to user: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:07:30.574972 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-258c7226-cd77-4dbf-8f07-023c46546e52 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 404 len: 111 microversion: 2.32 time: 0.218745 Sep 08 13:07:30.585060 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2285/4444] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:30 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 111 bytes in 225 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:07:30.593909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c3bfce26-1e02-4cf0-bfee-6d648c054b7c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:30.598501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ba2100e-30ee-4dba-a4ea-a062dc80e71f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '.version_select at 0x7fdb3f132820>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:30.600127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c3bfce26-1e02-4cf0-bfee-6d648c054b7c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:30.619775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3bfce26-1e02-4cf0-bfee-6d648c054b7c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:30.620326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3bfce26-1e02-4cf0-bfee-6d648c054b7c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:30.620778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3bfce26-1e02-4cf0-bfee-6d648c054b7c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:30.621536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3bfce26-1e02-4cf0-bfee-6d648c054b7c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:30.622008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3bfce26-1e02-4cf0-bfee-6d648c054b7c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:30.622438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3bfce26-1e02-4cf0-bfee-6d648c054b7c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:30.710589 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ba2100e-30ee-4dba-a4ea-a062dc80e71f tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1235785080" status: 204 len: 0 microversion: 2.32 time: 0.126500 Sep 08 13:07:30.731247 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2160/4445] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 13:07:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1235785080 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:07:30.925995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7f315da7-9aab-45c7-a474-97c7073e666c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:30.932375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f315da7-9aab-45c7-a474-97c7073e666c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:30.961932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f315da7-9aab-45c7-a474-97c7073e666c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:30.963389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f315da7-9aab-45c7-a474-97c7073e666c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:30.964687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f315da7-9aab-45c7-a474-97c7073e666c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:30.966472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f315da7-9aab-45c7-a474-97c7073e666c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:30.968173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f315da7-9aab-45c7-a474-97c7073e666c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:30.969233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f315da7-9aab-45c7-a474-97c7073e666c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:31.392557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c3bfce26-1e02-4cf0-bfee-6d648c054b7c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:31.429895 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c3bfce26-1e02-4cf0-bfee-6d648c054b7c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1733 microversion: 2.1 time: 0.838137 Sep 08 13:07:31.434784 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2286/4446] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:30 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1733 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:32.498097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6ed8c01-fb23-41e7-964f-fbce71644685 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:32.499294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f6ed8c01-fb23-41e7-964f-fbce71644685 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:32.529199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6ed8c01-fb23-41e7-964f-fbce71644685 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:32.530550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6ed8c01-fb23-41e7-964f-fbce71644685 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:32.533625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6ed8c01-fb23-41e7-964f-fbce71644685 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:32.536923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6ed8c01-fb23-41e7-964f-fbce71644685 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:32.538260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6ed8c01-fb23-41e7-964f-fbce71644685 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:32.539413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6ed8c01-fb23-41e7-964f-fbce71644685 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:32.567280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7f315da7-9aab-45c7-a474-97c7073e666c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:32.629447 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7f315da7-9aab-45c7-a474-97c7073e666c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1316 microversion: 2.1 time: 1.710764 Sep 08 13:07:32.650102 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2161/4447] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:30 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1316 bytes in 1733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:32.857097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2ab337d2-e2fc-44ed-929e-6b9c18f87f9b req-538c498c-abb7-4344-92dc-f277d861bc53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb421d7-2415-43d2-a6bb-3fdbca098091", "name": "network-vif-plugged", "status": "completed", "tag": "633f3920-4732-4687-b8a2-8db04d18d889"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:07:32.876485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=65,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:32.917872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2ab337d2-e2fc-44ed-929e-6b9c18f87f9b req-538c498c-abb7-4344-92dc-f277d861bc53 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:32.924416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2ab337d2-e2fc-44ed-929e-6b9c18f87f9b req-538c498c-abb7-4344-92dc-f277d861bc53 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:32.931137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2ab337d2-e2fc-44ed-929e-6b9c18f87f9b req-538c498c-abb7-4344-92dc-f277d861bc53 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:32.977497 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2ab337d2-e2fc-44ed-929e-6b9c18f87f9b req-538c498c-abb7-4344-92dc-f277d861bc53 service nova] Creating event network-vif-plugged:633f3920-4732-4687-b8a2-8db04d18d889 for instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 on n-h1-852084-10 Sep 08 13:07:33.001398 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2ab337d2-e2fc-44ed-929e-6b9c18f87f9b req-538c498c-abb7-4344-92dc-f277d861bc53 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150465 Sep 08 13:07:33.005436 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2162/4448] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:07:33.390302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f6ed8c01-fb23-41e7-964f-fbce71644685 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:33.408026 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f6ed8c01-fb23-41e7-964f-fbce71644685 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1733 microversion: 2.1 time: 0.939493 Sep 08 13:07:33.412166 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2287/4449] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:32 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1733 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:33.714732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9d9b7b56-92d8-40f7-8d01-195f33f1d3da tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:33.719249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9d9b7b56-92d8-40f7-8d01-195f33f1d3da tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:33.741639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d9b7b56-92d8-40f7-8d01-195f33f1d3da tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:33.742294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d9b7b56-92d8-40f7-8d01-195f33f1d3da tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:33.742990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d9b7b56-92d8-40f7-8d01-195f33f1d3da tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:33.744071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d9b7b56-92d8-40f7-8d01-195f33f1d3da tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:33.745229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d9b7b56-92d8-40f7-8d01-195f33f1d3da tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:33.746032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d9b7b56-92d8-40f7-8d01-195f33f1d3da tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:34.465377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-06b6f4fa-f9bb-4bf5-a5ae-0f4ae8f373fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:34.466687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-06b6f4fa-f9bb-4bf5-a5ae-0f4ae8f373fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:34.479628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06b6f4fa-f9bb-4bf5-a5ae-0f4ae8f373fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:34.480539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06b6f4fa-f9bb-4bf5-a5ae-0f4ae8f373fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:34.481380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06b6f4fa-f9bb-4bf5-a5ae-0f4ae8f373fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:34.482700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06b6f4fa-f9bb-4bf5-a5ae-0f4ae8f373fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:34.483701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06b6f4fa-f9bb-4bf5-a5ae-0f4ae8f373fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:34.484752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06b6f4fa-f9bb-4bf5-a5ae-0f4ae8f373fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:35.030940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9d9b7b56-92d8-40f7-8d01-195f33f1d3da tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:35.051920 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9d9b7b56-92d8-40f7-8d01-195f33f1d3da tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1316 microversion: 2.1 time: 1.361177 Sep 08 13:07:35.053852 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2163/4450] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:33 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1316 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:35.733743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-06b6f4fa-f9bb-4bf5-a5ae-0f4ae8f373fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:35.764969 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-06b6f4fa-f9bb-4bf5-a5ae-0f4ae8f373fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1733 microversion: 2.1 time: 1.306368 Sep 08 13:07:35.794593 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2288/4451] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:34 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1733 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:36.113133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2e1b4b8a-d96f-4bf5-be71-25db9bfe9378 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:36.116150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2e1b4b8a-d96f-4bf5-be71-25db9bfe9378 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:36.153923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e1b4b8a-d96f-4bf5-be71-25db9bfe9378 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:36.154937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e1b4b8a-d96f-4bf5-be71-25db9bfe9378 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:36.160390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e1b4b8a-d96f-4bf5-be71-25db9bfe9378 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:36.161403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e1b4b8a-d96f-4bf5-be71-25db9bfe9378 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:36.162798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e1b4b8a-d96f-4bf5-be71-25db9bfe9378 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:36.163802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e1b4b8a-d96f-4bf5-be71-25db9bfe9378 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:36.793662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2e1b4b8a-d96f-4bf5-be71-25db9bfe9378 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:36.807323 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2e1b4b8a-d96f-4bf5-be71-25db9bfe9378 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.720317 Sep 08 13:07:36.808135 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2164/4452] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:36 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:36.847355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d53bf3f4-d9d1-44cd-9acc-d139a8f2aa58 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:36.857382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d53bf3f4-d9d1-44cd-9acc-d139a8f2aa58 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:36.883624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d53bf3f4-d9d1-44cd-9acc-d139a8f2aa58 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:36.884671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d53bf3f4-d9d1-44cd-9acc-d139a8f2aa58 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:36.890149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d53bf3f4-d9d1-44cd-9acc-d139a8f2aa58 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:36.891266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d53bf3f4-d9d1-44cd-9acc-d139a8f2aa58 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:36.891784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d53bf3f4-d9d1-44cd-9acc-d139a8f2aa58 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:36.892240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d53bf3f4-d9d1-44cd-9acc-d139a8f2aa58 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:37.185296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-497840172", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:07:37.347961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] validate_networks() for [('6cf9ac04-bf1b-4fd3-befb-5346c4907700', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:07:37.914261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d53bf3f4-d9d1-44cd-9acc-d139a8f2aa58 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:37.917060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:37.934874 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d53bf3f4-d9d1-44cd-9acc-d139a8f2aa58 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1733 microversion: 2.1 time: 1.107591 Sep 08 13:07:37.936979 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2289/4453] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:36 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1733 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:38.978145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dfa0dffc-3a3a-4e07-a1b6-eb23de1a6a2f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:38.979405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dfa0dffc-3a3a-4e07-a1b6-eb23de1a6a2f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:39.005457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfa0dffc-3a3a-4e07-a1b6-eb23de1a6a2f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:39.005957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfa0dffc-3a3a-4e07-a1b6-eb23de1a6a2f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:39.006627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfa0dffc-3a3a-4e07-a1b6-eb23de1a6a2f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:39.007600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfa0dffc-3a3a-4e07-a1b6-eb23de1a6a2f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:39.008418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfa0dffc-3a3a-4e07-a1b6-eb23de1a6a2f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:39.008768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfa0dffc-3a3a-4e07-a1b6-eb23de1a6a2f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:40.084354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:07:40.086213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:07:40.087523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:07:40.088778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:07:40.089877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:07:40.170064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:40.177253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:40.178270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:40.183631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:40.184672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:40.187425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:40.205883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dfa0dffc-3a3a-4e07-a1b6-eb23de1a6a2f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:40.240188 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dfa0dffc-3a3a-4e07-a1b6-eb23de1a6a2f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1733 microversion: 2.1 time: 1.268511 Sep 08 13:07:40.258114 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2290/4454] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:38 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1733 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:07:40.289396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Getting quotas for project 0d6967bf506a413c92acc93b58778334. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:07:40.312262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Getting quotas for user 2d3977def69d4b5e8c91be7b122f4764 and project 0d6967bf506a413c92acc93b58778334. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:07:40.404762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:07:40.431865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:07:40.577269 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-42901cda-493c-41a5-85b0-85f970f0312a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.398637 Sep 08 13:07:40.580850 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2165/4455] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:07:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 3403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:07:40.609001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-13a240e2-3964-4f37-a3b4-fe2c11c9a5ea tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:40.614634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-13a240e2-3964-4f37-a3b4-fe2c11c9a5ea tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:40.833244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-13a240e2-3964-4f37-a3b4-fe2c11c9a5ea tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:40.869609 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-13a240e2-3964-4f37-a3b4-fe2c11c9a5ea tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1216 microversion: 2.1 time: 0.267990 Sep 08 13:07:40.871938 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2291/4456] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:40 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1216 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:41.307926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eb6c4370-53c4-4dd9-ad6d-0ea544e0fb30 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:41.317385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eb6c4370-53c4-4dd9-ad6d-0ea544e0fb30 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:41.413276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb6c4370-53c4-4dd9-ad6d-0ea544e0fb30 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:41.415718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb6c4370-53c4-4dd9-ad6d-0ea544e0fb30 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:41.430645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb6c4370-53c4-4dd9-ad6d-0ea544e0fb30 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:41.434364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb6c4370-53c4-4dd9-ad6d-0ea544e0fb30 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:41.439641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb6c4370-53c4-4dd9-ad6d-0ea544e0fb30 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:41.441573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eb6c4370-53c4-4dd9-ad6d-0ea544e0fb30 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:41.942179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-daeb09c6-e16a-4e9d-92a1-3f174d77f77d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:41.944643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-daeb09c6-e16a-4e9d-92a1-3f174d77f77d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:42.122528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-daeb09c6-e16a-4e9d-92a1-3f174d77f77d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:42.138648 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-daeb09c6-e16a-4e9d-92a1-3f174d77f77d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1216 microversion: 2.1 time: 0.229690 Sep 08 13:07:42.140635 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2292/4457] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:41 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1216 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:07:42.230711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eb6c4370-53c4-4dd9-ad6d-0ea544e0fb30 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:42.252142 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eb6c4370-53c4-4dd9-ad6d-0ea544e0fb30 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1733 microversion: 2.1 time: 0.969184 Sep 08 13:07:42.253242 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2166/4458] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:41 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1733 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:43.175728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-16086aca-7b0f-40c7-9484-698deaacbdad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:43.178193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-16086aca-7b0f-40c7-9484-698deaacbdad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:43.194777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16086aca-7b0f-40c7-9484-698deaacbdad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:43.195811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16086aca-7b0f-40c7-9484-698deaacbdad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:43.197014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16086aca-7b0f-40c7-9484-698deaacbdad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:43.198868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16086aca-7b0f-40c7-9484-698deaacbdad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:43.200157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16086aca-7b0f-40c7-9484-698deaacbdad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:43.201286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16086aca-7b0f-40c7-9484-698deaacbdad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:43.294872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d3b0211-6f8f-4b70-a822-5a6fc24d9a5f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:43.295732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1d3b0211-6f8f-4b70-a822-5a6fc24d9a5f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:43.334426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d3b0211-6f8f-4b70-a822-5a6fc24d9a5f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:43.335967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d3b0211-6f8f-4b70-a822-5a6fc24d9a5f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:43.338716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d3b0211-6f8f-4b70-a822-5a6fc24d9a5f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:43.346544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d3b0211-6f8f-4b70-a822-5a6fc24d9a5f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:43.347800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d3b0211-6f8f-4b70-a822-5a6fc24d9a5f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:43.348830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d3b0211-6f8f-4b70-a822-5a6fc24d9a5f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:43.678056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-16086aca-7b0f-40c7-9484-698deaacbdad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:43.723001 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-16086aca-7b0f-40c7-9484-698deaacbdad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1268 microversion: 2.1 time: 0.557581 Sep 08 13:07:43.736323 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2293/4459] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:43 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1268 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:07:43.848238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5440a90a-57be-4e61-a093-4935ec9b7fc8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:43.849142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5440a90a-57be-4e61-a093-4935ec9b7fc8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:43.857242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5440a90a-57be-4e61-a093-4935ec9b7fc8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:43.858332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5440a90a-57be-4e61-a093-4935ec9b7fc8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:43.859200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5440a90a-57be-4e61-a093-4935ec9b7fc8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:43.860420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5440a90a-57be-4e61-a093-4935ec9b7fc8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:43.861234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5440a90a-57be-4e61-a093-4935ec9b7fc8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:43.861922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5440a90a-57be-4e61-a093-4935ec9b7fc8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:43.891414 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-5440a90a-57be-4e61-a093-4935ec9b7fc8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] HTTP exception thrown: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5440a90a-57be-4e61-a093-4935ec9b7fc8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Request method failure captured: Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 HTTP/1.1 Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGecwWxvhUcBHvdvtIiMCA-j9E5Z7d6c4Hho31H92ln3cXvZ_kkCdJxhq24rZ53VrVKQn_6cVJ4V4C-fnbOTDw_G41W0nHIRd2Jfmcp2-8G8NrPk23sSKSuVz9cSMb3hAKZGCmqFdqlnf41ddiEQZi-ItTIpzmsWw7BlgfhS5MiT87FI Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.32 Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: af85d8df0c104c1b901eac2599721972 Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TaggedBootDevicesTest-989847742 Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_af85d8df0c104c1b901eac2599721972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/af85d8df0c104c1b901eac2599721972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "tempest-type-1972079076", "name": "tempest-service-1206977435", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af85d8df0c104c1b901eac2599721972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af85d8df0c104c1b901eac2599721972"}]}, {"type": "tempest-type-659314335", "name": "tempest-service-875643165", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TaggedBootDevicesTest-989847742 Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: af85d8df0c104c1b901eac2599721972 Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TaggedBootDevicesTest-989847742 Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TaggedBootDevicesTest-989847742-project Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 9c69cb225dfb433b9f2f026d2b0122af Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TaggedBootDevicesTest-989847742-project Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'd230b17f-eb54-4a20-b3fd-72e60ed7f0c0'} Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:07:43.895139 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:43.899743 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:43.904007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5440a90a-57be-4e61-a093-4935ec9b7fc8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Returning 404 to user: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:07:43.906266 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5440a90a-57be-4e61-a093-4935ec9b7fc8 tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 404 len: 111 microversion: 2.32 time: 0.082999 Sep 08 13:07:43.907929 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2294/4460] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:07:43 2022] DELETE /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:07:43.922723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b4a29130-46f1-4b3b-9936-2907c8cef8bd tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:43.924383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b4a29130-46f1-4b3b-9936-2907c8cef8bd tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] [instance: d230b17f-eb54-4a20-b3fd-72e60ed7f0c0] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:43.937122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4a29130-46f1-4b3b-9936-2907c8cef8bd tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:43.938809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4a29130-46f1-4b3b-9936-2907c8cef8bd tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:43.940034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4a29130-46f1-4b3b-9936-2907c8cef8bd tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:43.941762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4a29130-46f1-4b3b-9936-2907c8cef8bd tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:43.943419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4a29130-46f1-4b3b-9936-2907c8cef8bd tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:43.944476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4a29130-46f1-4b3b-9936-2907c8cef8bd tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:43.983404 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-b4a29130-46f1-4b3b-9936-2907c8cef8bd tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] HTTP exception thrown: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b4a29130-46f1-4b3b-9936-2907c8cef8bd tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Request method failure captured: Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 HTTP/1.1 Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGecwWxvhUcBHvdvtIiMCA-j9E5Z7d6c4Hho31H92ln3cXvZ_kkCdJxhq24rZ53VrVKQn_6cVJ4V4C-fnbOTDw_G41W0nHIRd2Jfmcp2-8G8NrPk23sSKSuVz9cSMb3hAKZGCmqFdqlnf41ddiEQZi-ItTIpzmsWw7BlgfhS5MiT87FI Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.32 Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: af85d8df0c104c1b901eac2599721972 Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TaggedBootDevicesTest-989847742 Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_af85d8df0c104c1b901eac2599721972"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/af85d8df0c104c1b901eac2599721972"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "tempest-type-1972079076", "name": "tempest-service-1206977435", "endpoints": []}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af85d8df0c104c1b901eac2599721972"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af85d8df0c104c1b901eac2599721972"}]}, {"type": "tempest-type-659314335", "name": "tempest-service-875643165", "endpoints": []}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TaggedBootDevicesTest-989847742 Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: af85d8df0c104c1b901eac2599721972 Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TaggedBootDevicesTest-989847742 Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TaggedBootDevicesTest-989847742-project Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 9c69cb225dfb433b9f2f026d2b0122af Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TaggedBootDevicesTest-989847742-project Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'd230b17f-eb54-4a20-b3fd-72e60ed7f0c0'} Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:07:43.986956 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:43.994207 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:43.994207 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:07:43.994207 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:43.994207 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:07:43.994207 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:07:43.994207 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:07:43.994207 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:07:43.994207 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:07:43.994207 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. Sep 08 13:07:43.994207 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:07:43.998823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b4a29130-46f1-4b3b-9936-2907c8cef8bd tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] Returning 404 to user: Instance d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:07:44.001840 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b4a29130-46f1-4b3b-9936-2907c8cef8bd tempest-TaggedBootDevicesTest-989847742 tempest-TaggedBootDevicesTest-989847742-project] 10.222.0.78 "GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0" status: 404 len: 111 microversion: 2.32 time: 0.086332 Sep 08 13:07:44.003673 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2295/4461] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:43 2022] GET /compute/v2.1/servers/d230b17f-eb54-4a20-b3fd-72e60ed7f0c0 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:07:44.316106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1d3b0211-6f8f-4b70-a822-5a6fc24d9a5f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:44.354195 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1d3b0211-6f8f-4b70-a822-5a6fc24d9a5f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1733 microversion: 2.1 time: 1.063787 Sep 08 13:07:44.354888 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2167/4462] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:43 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1733 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:44.768402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1d7dcce4-973b-419b-9495-3bcc398735f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:44.769564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1d7dcce4-973b-419b-9495-3bcc398735f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:44.798950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d7dcce4-973b-419b-9495-3bcc398735f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:44.801090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d7dcce4-973b-419b-9495-3bcc398735f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:44.809439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d7dcce4-973b-419b-9495-3bcc398735f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:44.811260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d7dcce4-973b-419b-9495-3bcc398735f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:44.812132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d7dcce4-973b-419b-9495-3bcc398735f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:44.812780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d7dcce4-973b-419b-9495-3bcc398735f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:45.300201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1d7dcce4-973b-419b-9495-3bcc398735f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:45.322601 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1d7dcce4-973b-419b-9495-3bcc398735f1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1274 microversion: 2.1 time: 0.560309 Sep 08 13:07:45.323755 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2296/4463] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:44 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1274 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:07:45.400311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-86df4aee-d815-4093-be24-909e1c558e53 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:45.402461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-86df4aee-d815-4093-be24-909e1c558e53 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:45.415092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86df4aee-d815-4093-be24-909e1c558e53 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:45.416283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86df4aee-d815-4093-be24-909e1c558e53 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:45.417237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86df4aee-d815-4093-be24-909e1c558e53 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:45.418733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86df4aee-d815-4093-be24-909e1c558e53 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:45.419873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86df4aee-d815-4093-be24-909e1c558e53 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:45.420790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-86df4aee-d815-4093-be24-909e1c558e53 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:46.389291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-922935ef-519a-4027-99aa-26aa2817babc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:46.390524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-922935ef-519a-4027-99aa-26aa2817babc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:46.415207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=52 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:46.443694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-86df4aee-d815-4093-be24-909e1c558e53 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:46.448789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-922935ef-519a-4027-99aa-26aa2817babc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:46.449849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-922935ef-519a-4027-99aa-26aa2817babc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:46.450634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-922935ef-519a-4027-99aa-26aa2817babc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:46.451918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-922935ef-519a-4027-99aa-26aa2817babc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:46.452737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-922935ef-519a-4027-99aa-26aa2817babc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:46.453519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-922935ef-519a-4027-99aa-26aa2817babc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:46.484978 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-86df4aee-d815-4093-be24-909e1c558e53 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1733 microversion: 2.1 time: 1.082837 Sep 08 13:07:46.500107 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2168/4464] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:45 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1733 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:46.935783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-922935ef-519a-4027-99aa-26aa2817babc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:46.968779 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-922935ef-519a-4027-99aa-26aa2817babc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1274 microversion: 2.1 time: 0.601009 Sep 08 13:07:46.970390 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2297/4465] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:46 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1274 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:47.525349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dc9f378b-4acf-48e6-aef5-2772e3611f9d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:47.529854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dc9f378b-4acf-48e6-aef5-2772e3611f9d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:47.555323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc9f378b-4acf-48e6-aef5-2772e3611f9d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:47.565008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc9f378b-4acf-48e6-aef5-2772e3611f9d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:47.566397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc9f378b-4acf-48e6-aef5-2772e3611f9d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:47.572824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc9f378b-4acf-48e6-aef5-2772e3611f9d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:47.580268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc9f378b-4acf-48e6-aef5-2772e3611f9d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:47.582852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc9f378b-4acf-48e6-aef5-2772e3611f9d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:48.036130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-47709cc0-59be-4049-a334-278334f3e5bb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:48.036883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-47709cc0-59be-4049-a334-278334f3e5bb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:48.053311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47709cc0-59be-4049-a334-278334f3e5bb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:48.054208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47709cc0-59be-4049-a334-278334f3e5bb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:48.055005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47709cc0-59be-4049-a334-278334f3e5bb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:48.056793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47709cc0-59be-4049-a334-278334f3e5bb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:48.058784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47709cc0-59be-4049-a334-278334f3e5bb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:48.060327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47709cc0-59be-4049-a334-278334f3e5bb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:48.170762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dc9f378b-4acf-48e6-aef5-2772e3611f9d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:48.236115 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dc9f378b-4acf-48e6-aef5-2772e3611f9d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1713 microversion: 2.1 time: 0.725181 Sep 08 13:07:48.240017 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2169/4466] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:47 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1713 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:07:48.637074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d44eeaf-09ae-4cae-b055-59780830ae49 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:48.638076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1d44eeaf-09ae-4cae-b055-59780830ae49 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:48.661389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d44eeaf-09ae-4cae-b055-59780830ae49 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:48.661905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d44eeaf-09ae-4cae-b055-59780830ae49 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:48.662433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d44eeaf-09ae-4cae-b055-59780830ae49 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:48.665841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d44eeaf-09ae-4cae-b055-59780830ae49 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:48.666775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d44eeaf-09ae-4cae-b055-59780830ae49 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:48.668031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d44eeaf-09ae-4cae-b055-59780830ae49 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:48.899175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-47709cc0-59be-4049-a334-278334f3e5bb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:48.917282 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1d44eeaf-09ae-4cae-b055-59780830ae49 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] HTTP exception thrown: Cannot 'detach_volume' instance bfec9e61-54e7-4949-a6f6-d18640db5191 while it is in vm_state rescued Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d44eeaf-09ae-4cae-b055-59780830ae49 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Request method failure captured: Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments/7c5bf79f-51f7-4438-9301-1713ac9a755e HTTP/1.1 Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGegpHo3QYXwAmCN_OctsdmztHN8ts294yLUiw-Ms0Kk7EQY0XfuiDYH7wh8eQztYQYLofweMgdtwuLtrJuTvgGQNr7mGfBgIxtE0szoBUmvKc-BEHBhV8QiE_SJULNZI6czSRqo3YxgC4OeYllmJxk1yJEFxr_qKCUPtZ26YlP53grs Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 0d312121b259412dbf82c519a49285f4 Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: exception: Cannot 'detach_volume' instance bfec9e61-54e7-4949-a6f6-d18640db5191 while it is in vm_state rescued Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'server_id': 'bfec9e61-54e7-4949-a6f6-d18640db5191', 'id': '7c5bf79f-51f7-4438-9301-1713ac9a755e'} Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bfec9e61-54e7-4949-a6f6-d18640db5191 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance bfec9e61-54e7-4949-a6f6-d18640db5191 while it is in vm_state rescued Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:07:48.922033 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:07:48.938894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:07:48.938894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:07:48.938894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:07:48.938894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:07:48.938894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance bfec9e61-54e7-4949-a6f6-d18640db5191 while it is in vm_state rescued Sep 08 13:07:48.938894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:07:48.942904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d44eeaf-09ae-4cae-b055-59780830ae49 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Returning 409 to user: Cannot 'detach_volume' instance bfec9e61-54e7-4949-a6f6-d18640db5191 while it is in vm_state rescued {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:07:48.945673 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1d44eeaf-09ae-4cae-b055-59780830ae49 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments/7c5bf79f-51f7-4438-9301-1713ac9a755e" status: 409 len: 152 microversion: 2.1 time: 0.319216 Sep 08 13:07:48.947459 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2170/4467] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:07:48 2022] DELETE /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments/7c5bf79f-51f7-4438-9301-1713ac9a755e => generated 152 bytes in 324 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:07:48.973515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b4f7206-063d-462a-be8e-d018a5c7598f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:07:48.977629 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-47709cc0-59be-4049-a334-278334f3e5bb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1316 microversion: 2.1 time: 0.947030 Sep 08 13:07:48.980743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6b4f7206-063d-462a-be8e-d018a5c7598f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:48.981693 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2298/4468] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:48 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1316 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:49.008270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b4f7206-063d-462a-be8e-d018a5c7598f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:49.009760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b4f7206-063d-462a-be8e-d018a5c7598f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:49.016371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b4f7206-063d-462a-be8e-d018a5c7598f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:49.018882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b4f7206-063d-462a-be8e-d018a5c7598f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:49.020351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b4f7206-063d-462a-be8e-d018a5c7598f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:49.021941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b4f7206-063d-462a-be8e-d018a5c7598f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:49.173011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:49.201263 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6b4f7206-063d-462a-be8e-d018a5c7598f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/action" status: 202 len: 0 microversion: 2.1 time: 0.243655 Sep 08 13:07:49.205267 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2171/4469] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:07:48 2022] POST /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:07:49.227842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b9273adc-7d80-4cde-9023-74ac22e1f276 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:49.235694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b9273adc-7d80-4cde-9023-74ac22e1f276 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:49.273281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9273adc-7d80-4cde-9023-74ac22e1f276 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:49.273842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9273adc-7d80-4cde-9023-74ac22e1f276 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:49.280630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9273adc-7d80-4cde-9023-74ac22e1f276 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:49.286262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9273adc-7d80-4cde-9023-74ac22e1f276 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:49.287813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9273adc-7d80-4cde-9023-74ac22e1f276 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:49.292666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9273adc-7d80-4cde-9023-74ac22e1f276 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:50.018893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36ba4977-6c1b-4320-aa95-c507f74e5e55 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:50.020575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-36ba4977-6c1b-4320-aa95-c507f74e5e55 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:50.035546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36ba4977-6c1b-4320-aa95-c507f74e5e55 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:50.039048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36ba4977-6c1b-4320-aa95-c507f74e5e55 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:50.045384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36ba4977-6c1b-4320-aa95-c507f74e5e55 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:50.047870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36ba4977-6c1b-4320-aa95-c507f74e5e55 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:50.049170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36ba4977-6c1b-4320-aa95-c507f74e5e55 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:50.053285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36ba4977-6c1b-4320-aa95-c507f74e5e55 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:50.251852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:50.349073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:50.430107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b9273adc-7d80-4cde-9023-74ac22e1f276 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:50.448598 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b9273adc-7d80-4cde-9023-74ac22e1f276 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1721 microversion: 2.1 time: 1.233152 Sep 08 13:07:50.460537 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2299/4470] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:49 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1721 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:50.721888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-36ba4977-6c1b-4320-aa95-c507f74e5e55 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:50.750504 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36ba4977-6c1b-4320-aa95-c507f74e5e55 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1316 microversion: 2.1 time: 0.737224 Sep 08 13:07:50.751659 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2172/4471] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:50 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1316 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:07:51.036436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-cd968e1a-7513-4604-a73d-1b6d3197b778 req-4f5edaa3-830c-409b-a282-a893f1fe94ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47e92e06-d041-47a8-8715-1f8dae99b9dd", "tag": "6a9acdd1-d077-4fa5-a164-c7480855933c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:07:51.075089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cd968e1a-7513-4604-a73d-1b6d3197b778 req-4f5edaa3-830c-409b-a282-a893f1fe94ff service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:51.075089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cd968e1a-7513-4604-a73d-1b6d3197b778 req-4f5edaa3-830c-409b-a282-a893f1fe94ff service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:51.075089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cd968e1a-7513-4604-a73d-1b6d3197b778 req-4f5edaa3-830c-409b-a282-a893f1fe94ff service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:51.114929 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-cd968e1a-7513-4604-a73d-1b6d3197b778 req-4f5edaa3-830c-409b-a282-a893f1fe94ff service nova] Creating event network-changed:6a9acdd1-d077-4fa5-a164-c7480855933c for instance 47e92e06-d041-47a8-8715-1f8dae99b9dd on n-h2-852084-10 Sep 08 13:07:51.143677 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-cd968e1a-7513-4604-a73d-1b6d3197b778 req-4f5edaa3-830c-409b-a282-a893f1fe94ff service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108428 Sep 08 13:07:51.146849 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2300/4472] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:07:51.517026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4bd91545-c7c0-44ec-86d7-a2adb1de5ab8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:51.517822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4bd91545-c7c0-44ec-86d7-a2adb1de5ab8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:51.533369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bd91545-c7c0-44ec-86d7-a2adb1de5ab8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:51.536742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bd91545-c7c0-44ec-86d7-a2adb1de5ab8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:51.539442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bd91545-c7c0-44ec-86d7-a2adb1de5ab8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:51.542362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bd91545-c7c0-44ec-86d7-a2adb1de5ab8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:51.543780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bd91545-c7c0-44ec-86d7-a2adb1de5ab8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:51.546419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4bd91545-c7c0-44ec-86d7-a2adb1de5ab8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:51.796681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-54f446a2-5b8d-40cd-9a81-c582520efe58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:51.799190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-54f446a2-5b8d-40cd-9a81-c582520efe58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:51.831717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54f446a2-5b8d-40cd-9a81-c582520efe58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:51.833004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54f446a2-5b8d-40cd-9a81-c582520efe58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:51.834068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54f446a2-5b8d-40cd-9a81-c582520efe58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:51.836827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54f446a2-5b8d-40cd-9a81-c582520efe58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:51.838185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54f446a2-5b8d-40cd-9a81-c582520efe58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:51.839550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54f446a2-5b8d-40cd-9a81-c582520efe58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:52.137563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:07:52.138738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4bd91545-c7c0-44ec-86d7-a2adb1de5ab8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:52.169471 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4bd91545-c7c0-44ec-86d7-a2adb1de5ab8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1721 microversion: 2.1 time: 0.658579 Sep 08 13:07:52.170447 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2173/4473] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:51 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1721 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:52.192557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-496d7698-42f4-43f3-9728-0645628d88d0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:52.193444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-496d7698-42f4-43f3-9728-0645628d88d0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:52.205545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-496d7698-42f4-43f3-9728-0645628d88d0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:52.206545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-496d7698-42f4-43f3-9728-0645628d88d0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:52.212923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-496d7698-42f4-43f3-9728-0645628d88d0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:52.227876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-496d7698-42f4-43f3-9728-0645628d88d0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:52.229121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-496d7698-42f4-43f3-9728-0645628d88d0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:52.230111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-496d7698-42f4-43f3-9728-0645628d88d0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:52.333313 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-496d7698-42f4-43f3-9728-0645628d88d0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/ips" status: 200 len: 152 microversion: 2.20 time: 0.154368 Sep 08 13:07:52.334940 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2174/4474] 10.222.0.78 () {60 vars in 1289 bytes} [Thu Sep 8 13:07:52 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/ips => generated 152 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:07:52.383385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-54f446a2-5b8d-40cd-9a81-c582520efe58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:52.408918 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-54f446a2-5b8d-40cd-9a81-c582520efe58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1316 microversion: 2.1 time: 0.630069 Sep 08 13:07:52.416023 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2301/4475] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:51 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1316 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:07:53.231409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-207e3ebd-cd99-45d0-8065-cffc9a3281d4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:53.232327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-207e3ebd-cd99-45d0-8065-cffc9a3281d4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:53.254880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-207e3ebd-cd99-45d0-8065-cffc9a3281d4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:53.255711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-207e3ebd-cd99-45d0-8065-cffc9a3281d4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:53.256529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-207e3ebd-cd99-45d0-8065-cffc9a3281d4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:53.258679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-207e3ebd-cd99-45d0-8065-cffc9a3281d4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:53.260638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-207e3ebd-cd99-45d0-8065-cffc9a3281d4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:53.263602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-207e3ebd-cd99-45d0-8065-cffc9a3281d4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:53.474223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ead1f698-a721-4236-81f0-5478d4846679 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:53.488068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ead1f698-a721-4236-81f0-5478d4846679 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:53.525758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ead1f698-a721-4236-81f0-5478d4846679 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:53.532587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ead1f698-a721-4236-81f0-5478d4846679 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:53.534168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ead1f698-a721-4236-81f0-5478d4846679 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:53.535807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ead1f698-a721-4236-81f0-5478d4846679 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:53.537000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ead1f698-a721-4236-81f0-5478d4846679 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:53.539495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ead1f698-a721-4236-81f0-5478d4846679 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:55.267827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-207e3ebd-cd99-45d0-8065-cffc9a3281d4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:55.293393 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-207e3ebd-cd99-45d0-8065-cffc9a3281d4 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1721 microversion: 2.1 time: 2.068357 Sep 08 13:07:55.308217 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2175/4476] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:53 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1721 bytes in 2085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:55.331528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ead1f698-a721-4236-81f0-5478d4846679 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:55.345487 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ead1f698-a721-4236-81f0-5478d4846679 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1316 microversion: 2.1 time: 1.890243 Sep 08 13:07:55.346827 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2302/4477] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:53 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1316 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:07:56.342469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c0fc58bd-0d51-4a81-acdf-39ab2330eda6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:56.347011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c0fc58bd-0d51-4a81-acdf-39ab2330eda6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:56.376579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0fc58bd-0d51-4a81-acdf-39ab2330eda6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:56.381024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0fc58bd-0d51-4a81-acdf-39ab2330eda6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:56.385193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0fc58bd-0d51-4a81-acdf-39ab2330eda6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:56.387595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0fc58bd-0d51-4a81-acdf-39ab2330eda6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:56.387976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0fc58bd-0d51-4a81-acdf-39ab2330eda6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:56.391059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0fc58bd-0d51-4a81-acdf-39ab2330eda6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:56.398718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7345432c-c2a9-4199-948a-0c02f08b899e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:56.399367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7345432c-c2a9-4199-948a-0c02f08b899e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:56.421647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7345432c-c2a9-4199-948a-0c02f08b899e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:56.422546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7345432c-c2a9-4199-948a-0c02f08b899e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:56.423161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7345432c-c2a9-4199-948a-0c02f08b899e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:56.425512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7345432c-c2a9-4199-948a-0c02f08b899e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:56.428758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7345432c-c2a9-4199-948a-0c02f08b899e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:56.431551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7345432c-c2a9-4199-948a-0c02f08b899e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:57.019099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7345432c-c2a9-4199-948a-0c02f08b899e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:57.045999 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7345432c-c2a9-4199-948a-0c02f08b899e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1316 microversion: 2.1 time: 0.656876 Sep 08 13:07:57.047036 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2303/4478] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:56 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1316 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:07:57.339679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c0fc58bd-0d51-4a81-acdf-39ab2330eda6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:57.362704 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c0fc58bd-0d51-4a81-acdf-39ab2330eda6 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1727 microversion: 2.1 time: 1.023928 Sep 08 13:07:57.365667 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2176/4479] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:56 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1727 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:57.411145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-67cebaed-332b-4413-8e3b-07fb6293d2ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:07:57.412209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-67cebaed-332b-4413-8e3b-07fb6293d2ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:57.427988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-19079c7b-8b78-4686-a419-29e525515ca1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:57.435905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-19079c7b-8b78-4686-a419-29e525515ca1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:57.456886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67cebaed-332b-4413-8e3b-07fb6293d2ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:57.458197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67cebaed-332b-4413-8e3b-07fb6293d2ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:57.459015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67cebaed-332b-4413-8e3b-07fb6293d2ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:57.464208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67cebaed-332b-4413-8e3b-07fb6293d2ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:57.465467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67cebaed-332b-4413-8e3b-07fb6293d2ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:57.466414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67cebaed-332b-4413-8e3b-07fb6293d2ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:57.479874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19079c7b-8b78-4686-a419-29e525515ca1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:57.482297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19079c7b-8b78-4686-a419-29e525515ca1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:57.485868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19079c7b-8b78-4686-a419-29e525515ca1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:57.490303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19079c7b-8b78-4686-a419-29e525515ca1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:57.497212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19079c7b-8b78-4686-a419-29e525515ca1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:57.499534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19079c7b-8b78-4686-a419-29e525515ca1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:57.572332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-67cebaed-332b-4413-8e3b-07fb6293d2ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lazy-loading 'flavor' on Instance uuid a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:07:58.061042 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-19079c7b-8b78-4686-a419-29e525515ca1 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.663612 Sep 08 13:07:58.061852 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2177/4480] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:07:57 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-interface => generated 284 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:07:58.108926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b5a4a427-fa31-40ae-a62e-10bea9396864 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:58.111586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b5a4a427-fa31-40ae-a62e-10bea9396864 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:58.150680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5a4a427-fa31-40ae-a62e-10bea9396864 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:58.156152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5a4a427-fa31-40ae-a62e-10bea9396864 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:58.157108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5a4a427-fa31-40ae-a62e-10bea9396864 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:58.158157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5a4a427-fa31-40ae-a62e-10bea9396864 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:58.161746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5a4a427-fa31-40ae-a62e-10bea9396864 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:58.167002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5a4a427-fa31-40ae-a62e-10bea9396864 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:58.237530 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-67cebaed-332b-4413-8e3b-07fb6293d2ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "POST /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/action" status: 202 len: 0 microversion: 2.20 time: 0.847252 Sep 08 13:07:58.238498 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2304/4481] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 13:07:57 2022] POST /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/action => generated 0 bytes in 850 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:07:58.275823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f1d4c0c-ba36-4cb3-a580-e61fc2099c5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:07:58.281196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8f1d4c0c-ba36-4cb3-a580-e61fc2099c5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:07:58.307662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f1d4c0c-ba36-4cb3-a580-e61fc2099c5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:58.308184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f1d4c0c-ba36-4cb3-a580-e61fc2099c5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:58.308632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f1d4c0c-ba36-4cb3-a580-e61fc2099c5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:58.312729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f1d4c0c-ba36-4cb3-a580-e61fc2099c5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:58.313998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f1d4c0c-ba36-4cb3-a580-e61fc2099c5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:58.316384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f1d4c0c-ba36-4cb3-a580-e61fc2099c5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:59.042761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b5a4a427-fa31-40ae-a62e-10bea9396864 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:59.070281 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b5a4a427-fa31-40ae-a62e-10bea9396864 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1316 microversion: 2.1 time: 0.984673 Sep 08 13:07:59.079431 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2178/4482] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:07:58 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1316 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:07:59.189322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8f1d4c0c-ba36-4cb3-a580-e61fc2099c5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:59.255633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8f1d4c0c-ba36-4cb3-a580-e61fc2099c5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:59.293487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8f1d4c0c-ba36-4cb3-a580-e61fc2099c5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:07:59.312673 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f1d4c0c-ba36-4cb3-a580-e61fc2099c5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1724 microversion: 2.20 time: 1.060328 Sep 08 13:07:59.319818 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2305/4483] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:07:58 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1724 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:07:59.918448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-485a0fe5-ffd7-4d3e-91f6-85e193c4bb7e req-14bdce6b-f113-4890-95e3-574b5750d013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e92e06-d041-47a8-8715-1f8dae99b9dd", "name": "network-vif-plugged", "status": "completed", "tag": "6a9acdd1-d077-4fa5-a164-c7480855933c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:07:59.948112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-485a0fe5-ffd7-4d3e-91f6-85e193c4bb7e req-14bdce6b-f113-4890-95e3-574b5750d013 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:07:59.952233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-485a0fe5-ffd7-4d3e-91f6-85e193c4bb7e req-14bdce6b-f113-4890-95e3-574b5750d013 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:07:59.953172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-485a0fe5-ffd7-4d3e-91f6-85e193c4bb7e req-14bdce6b-f113-4890-95e3-574b5750d013 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:07:59.994056 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-485a0fe5-ffd7-4d3e-91f6-85e193c4bb7e req-14bdce6b-f113-4890-95e3-574b5750d013 service nova] Creating event network-vif-plugged:6a9acdd1-d077-4fa5-a164-c7480855933c for instance 47e92e06-d041-47a8-8715-1f8dae99b9dd on n-h2-852084-10 Sep 08 13:08:00.012499 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-485a0fe5-ffd7-4d3e-91f6-85e193c4bb7e req-14bdce6b-f113-4890-95e3-574b5750d013 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099969 Sep 08 13:08:00.018312 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2179/4484] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:08:00.133993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-57e09757-316c-40e3-b759-4163941c134c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:00.135128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-57e09757-316c-40e3-b759-4163941c134c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:00.202076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e09757-316c-40e3-b759-4163941c134c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:00.206157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e09757-316c-40e3-b759-4163941c134c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:00.209227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e09757-316c-40e3-b759-4163941c134c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:00.217651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e09757-316c-40e3-b759-4163941c134c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:00.220350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e09757-316c-40e3-b759-4163941c134c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:00.223173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57e09757-316c-40e3-b759-4163941c134c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:00.372634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ab14524a-eb98-4013-a853-f4662e883b67 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:00.380397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ab14524a-eb98-4013-a853-f4662e883b67 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:00.442499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab14524a-eb98-4013-a853-f4662e883b67 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:00.447524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab14524a-eb98-4013-a853-f4662e883b67 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:00.451394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab14524a-eb98-4013-a853-f4662e883b67 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:00.460003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab14524a-eb98-4013-a853-f4662e883b67 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:00.461453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab14524a-eb98-4013-a853-f4662e883b67 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:00.462360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab14524a-eb98-4013-a853-f4662e883b67 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:01.093006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-57e09757-316c-40e3-b759-4163941c134c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:01.130929 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-57e09757-316c-40e3-b759-4163941c134c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1316 microversion: 2.1 time: 1.009152 Sep 08 13:08:01.140609 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2306/4485] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:00 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1316 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:08:01.159021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ab14524a-eb98-4013-a853-f4662e883b67 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:01.195737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ab14524a-eb98-4013-a853-f4662e883b67 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:01.199109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ab14524a-eb98-4013-a853-f4662e883b67 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:01.201423 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ab14524a-eb98-4013-a853-f4662e883b67 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1724 microversion: 2.20 time: 0.838003 Sep 08 13:08:01.215921 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2180/4486] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:00 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1724 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:08:02.197136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e6115b2-09ad-4267-9dee-7414a9b6d5cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:02.198509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e6115b2-09ad-4267-9dee-7414a9b6d5cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:02.223874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e6115b2-09ad-4267-9dee-7414a9b6d5cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:02.228108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e6115b2-09ad-4267-9dee-7414a9b6d5cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:02.230689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e6115b2-09ad-4267-9dee-7414a9b6d5cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:02.232580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e6115b2-09ad-4267-9dee-7414a9b6d5cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:02.236941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e6115b2-09ad-4267-9dee-7414a9b6d5cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:02.237816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e6115b2-09ad-4267-9dee-7414a9b6d5cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:02.248665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f0e8888-b131-480b-a5ed-c3ab2b0bd1b8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:02.252993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f0e8888-b131-480b-a5ed-c3ab2b0bd1b8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:02.279691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f0e8888-b131-480b-a5ed-c3ab2b0bd1b8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:02.279691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f0e8888-b131-480b-a5ed-c3ab2b0bd1b8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:02.279691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f0e8888-b131-480b-a5ed-c3ab2b0bd1b8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:02.279691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f0e8888-b131-480b-a5ed-c3ab2b0bd1b8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:02.279691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f0e8888-b131-480b-a5ed-c3ab2b0bd1b8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:02.280535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f0e8888-b131-480b-a5ed-c3ab2b0bd1b8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:02.868387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e6115b2-09ad-4267-9dee-7414a9b6d5cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:02.908806 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e6115b2-09ad-4267-9dee-7414a9b6d5cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1506 microversion: 2.1 time: 0.718390 Sep 08 13:08:02.939171 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2307/4487] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:02 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1506 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:02.970188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a688ad91-e704-4f40-8a10-a41ad44a3c75 req-26d8050d-f41c-42f9-a508-1f2f8bf47181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfec9e61-54e7-4949-a6f6-d18640db5191", "tag": "ba217dba-14ca-486d-8bc1-9f1f6fae3f90"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:03.013572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a688ad91-e704-4f40-8a10-a41ad44a3c75 req-26d8050d-f41c-42f9-a508-1f2f8bf47181 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:03.016223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a688ad91-e704-4f40-8a10-a41ad44a3c75 req-26d8050d-f41c-42f9-a508-1f2f8bf47181 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:03.020200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a688ad91-e704-4f40-8a10-a41ad44a3c75 req-26d8050d-f41c-42f9-a508-1f2f8bf47181 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:03.045544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f0e8888-b131-480b-a5ed-c3ab2b0bd1b8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:03.119031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f0e8888-b131-480b-a5ed-c3ab2b0bd1b8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:03.134054 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a688ad91-e704-4f40-8a10-a41ad44a3c75 req-26d8050d-f41c-42f9-a508-1f2f8bf47181 service nova] Creating event network-changed:ba217dba-14ca-486d-8bc1-9f1f6fae3f90 for instance bfec9e61-54e7-4949-a6f6-d18640db5191 on n-h2-852084-10 Sep 08 13:08:03.148541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f0e8888-b131-480b-a5ed-c3ab2b0bd1b8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:03.152680 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a688ad91-e704-4f40-8a10-a41ad44a3c75 req-26d8050d-f41c-42f9-a508-1f2f8bf47181 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.211027 Sep 08 13:08:03.153657 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2308/4488] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:03.156282 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f0e8888-b131-480b-a5ed-c3ab2b0bd1b8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1724 microversion: 2.20 time: 0.917578 Sep 08 13:08:03.165292 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2181/4489] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:02 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1724 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:03.204177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9940d64c-0589-4d9b-80f6-cd5f04a16a7d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:03.209584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9940d64c-0589-4d9b-80f6-cd5f04a16a7d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:03.239265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9940d64c-0589-4d9b-80f6-cd5f04a16a7d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:03.240695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9940d64c-0589-4d9b-80f6-cd5f04a16a7d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:03.242614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9940d64c-0589-4d9b-80f6-cd5f04a16a7d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:03.244443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9940d64c-0589-4d9b-80f6-cd5f04a16a7d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:03.246366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9940d64c-0589-4d9b-80f6-cd5f04a16a7d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:03.247673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9940d64c-0589-4d9b-80f6-cd5f04a16a7d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:03.256154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:08:03.327640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9940d64c-0589-4d9b-80f6-cd5f04a16a7d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:08:03.536774 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9940d64c-0589-4d9b-80f6-cd5f04a16a7d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "DELETE /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 204 len: 0 microversion: 2.1 time: 0.376905 Sep 08 13:08:03.559172 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2309/4490] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:08:03 2022] DELETE /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:08:03.560119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c6b7926f-13b9-4113-8a10-f199f90d70d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:03.562408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c6b7926f-13b9-4113-8a10-f199f90d70d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:03.582644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6b7926f-13b9-4113-8a10-f199f90d70d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:03.584159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6b7926f-13b9-4113-8a10-f199f90d70d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:03.586246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6b7926f-13b9-4113-8a10-f199f90d70d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:03.588013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6b7926f-13b9-4113-8a10-f199f90d70d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:03.589734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6b7926f-13b9-4113-8a10-f199f90d70d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:03.591392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6b7926f-13b9-4113-8a10-f199f90d70d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:04.222660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-90809757-eba6-4360-b64d-4606654c6d1a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:04.227349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-90809757-eba6-4360-b64d-4606654c6d1a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:04.264686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90809757-eba6-4360-b64d-4606654c6d1a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:04.265820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90809757-eba6-4360-b64d-4606654c6d1a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:04.266940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90809757-eba6-4360-b64d-4606654c6d1a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:04.269006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90809757-eba6-4360-b64d-4606654c6d1a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:04.273677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90809757-eba6-4360-b64d-4606654c6d1a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:04.274950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-90809757-eba6-4360-b64d-4606654c6d1a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:04.304644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c6b7926f-13b9-4113-8a10-f199f90d70d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:04.319818 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c6b7926f-13b9-4113-8a10-f199f90d70d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1512 microversion: 2.1 time: 0.773110 Sep 08 13:08:04.351964 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2182/4491] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:03 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1512 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:05.225483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-684b0afd-7668-4945-82fa-dc41473e8a8e req-e84d2a5e-c61b-414d-8ea6-668f2015e214 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfec9e61-54e7-4949-a6f6-d18640db5191", "tag": "ba217dba-14ca-486d-8bc1-9f1f6fae3f90"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:05.237620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-90809757-eba6-4360-b64d-4606654c6d1a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:05.265035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:08:05.269446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-684b0afd-7668-4945-82fa-dc41473e8a8e req-e84d2a5e-c61b-414d-8ea6-668f2015e214 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:05.269813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-90809757-eba6-4360-b64d-4606654c6d1a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:05.270442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-684b0afd-7668-4945-82fa-dc41473e8a8e req-e84d2a5e-c61b-414d-8ea6-668f2015e214 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:05.271640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-684b0afd-7668-4945-82fa-dc41473e8a8e req-e84d2a5e-c61b-414d-8ea6-668f2015e214 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:05.272787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-90809757-eba6-4360-b64d-4606654c6d1a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:05.280708 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-90809757-eba6-4360-b64d-4606654c6d1a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1724 microversion: 2.20 time: 1.061290 Sep 08 13:08:05.284829 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2310/4492] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:04 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1724 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:08:05.322807 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-684b0afd-7668-4945-82fa-dc41473e8a8e req-e84d2a5e-c61b-414d-8ea6-668f2015e214 service nova] Creating event network-changed:ba217dba-14ca-486d-8bc1-9f1f6fae3f90 for instance bfec9e61-54e7-4949-a6f6-d18640db5191 on n-h2-852084-10 Sep 08 13:08:05.341100 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-684b0afd-7668-4945-82fa-dc41473e8a8e req-e84d2a5e-c61b-414d-8ea6-668f2015e214 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141513 Sep 08 13:08:05.343345 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2183/4493] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:05.369013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b1cbfcf7-4cbc-41d3-8271-3084831477d9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:05.372914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b1cbfcf7-4cbc-41d3-8271-3084831477d9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:05.397386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1cbfcf7-4cbc-41d3-8271-3084831477d9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:05.399070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1cbfcf7-4cbc-41d3-8271-3084831477d9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:05.400032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1cbfcf7-4cbc-41d3-8271-3084831477d9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:05.401458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1cbfcf7-4cbc-41d3-8271-3084831477d9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:05.402916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1cbfcf7-4cbc-41d3-8271-3084831477d9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:05.403935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1cbfcf7-4cbc-41d3-8271-3084831477d9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:06.053579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b1cbfcf7-4cbc-41d3-8271-3084831477d9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:06.072782 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b1cbfcf7-4cbc-41d3-8271-3084831477d9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1512 microversion: 2.1 time: 0.714354 Sep 08 13:08:06.083540 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2311/4494] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:05 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1512 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:06.348471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0db861c-6560-46a3-99bb-d61166ddc50f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:06.355019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0db861c-6560-46a3-99bb-d61166ddc50f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:06.396626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0db861c-6560-46a3-99bb-d61166ddc50f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:06.399540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0db861c-6560-46a3-99bb-d61166ddc50f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:06.401176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0db861c-6560-46a3-99bb-d61166ddc50f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:06.403595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0db861c-6560-46a3-99bb-d61166ddc50f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:06.405259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0db861c-6560-46a3-99bb-d61166ddc50f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:06.407951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0db861c-6560-46a3-99bb-d61166ddc50f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:07.125132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-249bbf53-e644-4379-9f3e-eed03ed6b2fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:07.126128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-249bbf53-e644-4379-9f3e-eed03ed6b2fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:07.144999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-249bbf53-e644-4379-9f3e-eed03ed6b2fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:07.145879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-249bbf53-e644-4379-9f3e-eed03ed6b2fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:07.148666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-249bbf53-e644-4379-9f3e-eed03ed6b2fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:07.150410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-249bbf53-e644-4379-9f3e-eed03ed6b2fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:07.153411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-249bbf53-e644-4379-9f3e-eed03ed6b2fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:07.154634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-249bbf53-e644-4379-9f3e-eed03ed6b2fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:07.742674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0db861c-6560-46a3-99bb-d61166ddc50f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:07.797944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0db861c-6560-46a3-99bb-d61166ddc50f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:07.814003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0db861c-6560-46a3-99bb-d61166ddc50f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:07.817779 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0db861c-6560-46a3-99bb-d61166ddc50f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1724 microversion: 2.20 time: 1.494676 Sep 08 13:08:07.819537 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2184/4495] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:06 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1724 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:08:08.442099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-249bbf53-e644-4379-9f3e-eed03ed6b2fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:08.474989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-93d410bb-0164-4042-a6ed-5fb9f64c9f80 req-0df95553-d417-4e15-b58c-f6ba4f0078a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47e92e06-d041-47a8-8715-1f8dae99b9dd", "name": "network-vif-deleted", "tag": "6a9acdd1-d077-4fa5-a164-c7480855933c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:08.476503 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-249bbf53-e644-4379-9f3e-eed03ed6b2fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1470 microversion: 2.1 time: 1.359320 Sep 08 13:08:08.478172 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2312/4496] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:07 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1470 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:08.583082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-93d410bb-0164-4042-a6ed-5fb9f64c9f80 req-0df95553-d417-4e15-b58c-f6ba4f0078a7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:08.584439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-93d410bb-0164-4042-a6ed-5fb9f64c9f80 req-0df95553-d417-4e15-b58c-f6ba4f0078a7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:08.585452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-93d410bb-0164-4042-a6ed-5fb9f64c9f80 req-0df95553-d417-4e15-b58c-f6ba4f0078a7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:08.652568 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-93d410bb-0164-4042-a6ed-5fb9f64c9f80 req-0df95553-d417-4e15-b58c-f6ba4f0078a7 service nova] Creating event network-vif-deleted:6a9acdd1-d077-4fa5-a164-c7480855933c for instance 47e92e06-d041-47a8-8715-1f8dae99b9dd on n-h2-852084-10 Sep 08 13:08:08.736410 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-93d410bb-0164-4042-a6ed-5fb9f64c9f80 req-0df95553-d417-4e15-b58c-f6ba4f0078a7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275055 Sep 08 13:08:08.749270 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2185/4497] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:08.884776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1bba3c8a-e75b-433b-9c51-35d2d39a0873 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:08.887290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1bba3c8a-e75b-433b-9c51-35d2d39a0873 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:08.931777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1bba3c8a-e75b-433b-9c51-35d2d39a0873 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:08.936696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1bba3c8a-e75b-433b-9c51-35d2d39a0873 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:08.939602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1bba3c8a-e75b-433b-9c51-35d2d39a0873 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:08.943469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1bba3c8a-e75b-433b-9c51-35d2d39a0873 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:08.951447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1bba3c8a-e75b-433b-9c51-35d2d39a0873 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:08.952722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1bba3c8a-e75b-433b-9c51-35d2d39a0873 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:09.420547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1bba3c8a-e75b-433b-9c51-35d2d39a0873 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:09.450090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1bba3c8a-e75b-433b-9c51-35d2d39a0873 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:09.455419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1bba3c8a-e75b-433b-9c51-35d2d39a0873 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:09.464718 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1bba3c8a-e75b-433b-9c51-35d2d39a0873 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1745 microversion: 2.20 time: 0.593041 Sep 08 13:08:09.465996 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2313/4498] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:08 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1745 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:08:09.540738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:09.541463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:09.554544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:09.555077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:09.555573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:09.560957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:09.567564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:09.568434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:09.682325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:09.683012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:09.683915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:09.685128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lazy-loading 'fault' on Instance uuid 47e92e06-d041-47a8-8715-1f8dae99b9dd {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:08:10.379441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:10.393633 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8378d51c-d1e5-40a2-9314-f731ddcebbcd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 200 len: 1306 microversion: 2.1 time: 0.857313 Sep 08 13:08:10.395414 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2186/4499] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:09 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 1306 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:10.545796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-191e55e4-256e-482b-a6cd-08456bc9eb78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:10.548434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-191e55e4-256e-482b-a6cd-08456bc9eb78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:10.567883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-191e55e4-256e-482b-a6cd-08456bc9eb78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:10.569413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-191e55e4-256e-482b-a6cd-08456bc9eb78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:10.572164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-191e55e4-256e-482b-a6cd-08456bc9eb78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:10.574741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-191e55e4-256e-482b-a6cd-08456bc9eb78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:10.576074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-191e55e4-256e-482b-a6cd-08456bc9eb78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:10.577056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-191e55e4-256e-482b-a6cd-08456bc9eb78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:10.982707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-191e55e4-256e-482b-a6cd-08456bc9eb78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:11.012411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-191e55e4-256e-482b-a6cd-08456bc9eb78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:11.021847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-191e55e4-256e-482b-a6cd-08456bc9eb78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:11.026078 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-191e55e4-256e-482b-a6cd-08456bc9eb78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1745 microversion: 2.20 time: 0.512940 Sep 08 13:08:11.027890 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2314/4500] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:10 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1745 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:11.440350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9b2abf31-c9d6-44f2-b3e6-a117d3d080c8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:11.444224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9b2abf31-c9d6-44f2-b3e6-a117d3d080c8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:11.465699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b2abf31-c9d6-44f2-b3e6-a117d3d080c8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:11.467150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b2abf31-c9d6-44f2-b3e6-a117d3d080c8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:11.468340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b2abf31-c9d6-44f2-b3e6-a117d3d080c8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:11.470149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b2abf31-c9d6-44f2-b3e6-a117d3d080c8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:11.474697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b2abf31-c9d6-44f2-b3e6-a117d3d080c8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:11.477523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9b2abf31-c9d6-44f2-b3e6-a117d3d080c8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:11.513927 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-9b2abf31-c9d6-44f2-b3e6-a117d3d080c8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9b2abf31-c9d6-44f2-b3e6-a117d3d080c8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd HTTP/1.1 Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '47e92e06-d041-47a8-8715-1f8dae99b9dd'} Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:11.518771 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:11.529183 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:11.529183 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:11.529183 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:11.529183 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:11.529183 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:11.529183 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:08:11.529183 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:11.535586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9b2abf31-c9d6-44f2-b3e6-a117d3d080c8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:11.535586 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9b2abf31-c9d6-44f2-b3e6-a117d3d080c8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 404 len: 111 microversion: 2.1 time: 0.102178 Sep 08 13:08:11.535586 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2187/4501] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:11 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:08:11.553410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-69910464-f684-4f5a-976c-403a6280f09e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:11.555750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-69910464-f684-4f5a-976c-403a6280f09e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:11.574109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69910464-f684-4f5a-976c-403a6280f09e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:11.575668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69910464-f684-4f5a-976c-403a6280f09e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:11.576923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69910464-f684-4f5a-976c-403a6280f09e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:11.578639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69910464-f684-4f5a-976c-403a6280f09e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:11.580078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69910464-f684-4f5a-976c-403a6280f09e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:11.581550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69910464-f684-4f5a-976c-403a6280f09e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:11.956932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-69910464-f684-4f5a-976c-403a6280f09e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:11.974503 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-69910464-f684-4f5a-976c-403a6280f09e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.430892 Sep 08 13:08:11.977902 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2315/4502] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:11 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:12.087198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d211ad79-e69b-4127-9620-81aa3995f5ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:12.090550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d211ad79-e69b-4127-9620-81aa3995f5ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:12.109167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d211ad79-e69b-4127-9620-81aa3995f5ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:12.110727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d211ad79-e69b-4127-9620-81aa3995f5ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:12.113533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d211ad79-e69b-4127-9620-81aa3995f5ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:12.115212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d211ad79-e69b-4127-9620-81aa3995f5ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:12.118833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d211ad79-e69b-4127-9620-81aa3995f5ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:12.120524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d211ad79-e69b-4127-9620-81aa3995f5ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:12.331953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cbd8bc18-e131-4bc7-8004-a50f675d9661 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cbd8bc18-e131-4bc7-8004-a50f675d9661 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 163 Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": 12345, "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'networks': [{'uuid': '6cf9ac04-bf1b-4fd3-befb-5346c4907700'}]}}} Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 12345 Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:08:12.376966 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cbd8bc18-e131-4bc7-8004-a50f675d9661 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:12.388502 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cbd8bc18-e131-4bc7-8004-a50f675d9661 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.062937 Sep 08 13:08:12.397283 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2316/4503] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:08:12 2022] POST /compute/v2.1/servers => generated 127 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:08:12.406721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b31b4c5b-b9bb-42e7-a8a7-09343ac749a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:12.415802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b31b4c5b-b9bb-42e7-a8a7-09343ac749a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:12.467923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b31b4c5b-b9bb-42e7-a8a7-09343ac749a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:12.469420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b31b4c5b-b9bb-42e7-a8a7-09343ac749a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:12.470406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b31b4c5b-b9bb-42e7-a8a7-09343ac749a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:12.472116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b31b4c5b-b9bb-42e7-a8a7-09343ac749a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:12.473798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b31b4c5b-b9bb-42e7-a8a7-09343ac749a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:12.474658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b31b4c5b-b9bb-42e7-a8a7-09343ac749a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:12.696217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d211ad79-e69b-4127-9620-81aa3995f5ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:12.717714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d211ad79-e69b-4127-9620-81aa3995f5ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:12.720436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d211ad79-e69b-4127-9620-81aa3995f5ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:12.724756 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d211ad79-e69b-4127-9620-81aa3995f5ee tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 0.654287 Sep 08 13:08:12.726237 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2188/4504] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:12 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:12.786523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b31b4c5b-b9bb-42e7-a8a7-09343ac749a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:12.821359 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b31b4c5b-b9bb-42e7-a8a7-09343ac749a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.419700 Sep 08 13:08:12.821980 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2317/4505] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:12 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:12.873646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dde588e2-4b20-4cd0-83d9-5f8256a3331c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:12.877955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dde588e2-4b20-4cd0-83d9-5f8256a3331c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:12.892050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dde588e2-4b20-4cd0-83d9-5f8256a3331c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:12.893867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dde588e2-4b20-4cd0-83d9-5f8256a3331c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:12.894972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dde588e2-4b20-4cd0-83d9-5f8256a3331c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:12.896732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dde588e2-4b20-4cd0-83d9-5f8256a3331c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:12.897756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dde588e2-4b20-4cd0-83d9-5f8256a3331c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:12.898692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dde588e2-4b20-4cd0-83d9-5f8256a3331c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:13.233038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dde588e2-4b20-4cd0-83d9-5f8256a3331c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:13.261127 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dde588e2-4b20-4cd0-83d9-5f8256a3331c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.394048 Sep 08 13:08:13.263123 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2189/4506] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:12 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:13.786541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0f5d1d57-89e3-41ed-82f3-a93556e90852 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:13.789290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-88314a66-c103-4800-a964-5290c704f457 req-bbd0c7eb-b036-44f0-8ab7-2feebfb5e9d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68", "name": "network-vif-plugged", "status": "completed", "tag": "bab66cd4-e2d1-4c9a-803e-24552207b4f0"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:13.791731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0f5d1d57-89e3-41ed-82f3-a93556e90852 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:13.817439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-88314a66-c103-4800-a964-5290c704f457 req-bbd0c7eb-b036-44f0-8ab7-2feebfb5e9d8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:13.819024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-88314a66-c103-4800-a964-5290c704f457 req-bbd0c7eb-b036-44f0-8ab7-2feebfb5e9d8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:13.820308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-88314a66-c103-4800-a964-5290c704f457 req-bbd0c7eb-b036-44f0-8ab7-2feebfb5e9d8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:13.820508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f5d1d57-89e3-41ed-82f3-a93556e90852 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:13.821122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f5d1d57-89e3-41ed-82f3-a93556e90852 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:13.828453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f5d1d57-89e3-41ed-82f3-a93556e90852 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:13.829944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f5d1d57-89e3-41ed-82f3-a93556e90852 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:13.831696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f5d1d57-89e3-41ed-82f3-a93556e90852 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:13.833314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f5d1d57-89e3-41ed-82f3-a93556e90852 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:13.884658 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-88314a66-c103-4800-a964-5290c704f457 req-bbd0c7eb-b036-44f0-8ab7-2feebfb5e9d8 service nova] Creating event network-vif-plugged:bab66cd4-e2d1-4c9a-803e-24552207b4f0 for instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 on n-h2-852084-10 Sep 08 13:08:13.913726 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-88314a66-c103-4800-a964-5290c704f457 req-bbd0c7eb-b036-44f0-8ab7-2feebfb5e9d8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136828 Sep 08 13:08:13.918010 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2318/4507] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:14.290676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0f5d1d57-89e3-41ed-82f3-a93556e90852 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:14.317847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0f5d1d57-89e3-41ed-82f3-a93556e90852 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:14.326844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0f5d1d57-89e3-41ed-82f3-a93556e90852 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:14.333962 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0f5d1d57-89e3-41ed-82f3-a93556e90852 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 0.553065 Sep 08 13:08:14.336346 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2190/4508] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:13 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:15.417156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8d4fc259-ecdb-4980-89ae-ef056747ed69 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:15.421292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8d4fc259-ecdb-4980-89ae-ef056747ed69 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:15.460458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d4fc259-ecdb-4980-89ae-ef056747ed69 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:15.466435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d4fc259-ecdb-4980-89ae-ef056747ed69 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:15.467939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d4fc259-ecdb-4980-89ae-ef056747ed69 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:15.478161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d4fc259-ecdb-4980-89ae-ef056747ed69 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:15.482587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d4fc259-ecdb-4980-89ae-ef056747ed69 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:15.486711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d4fc259-ecdb-4980-89ae-ef056747ed69 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:16.218921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8d4fc259-ecdb-4980-89ae-ef056747ed69 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:16.258056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8d4fc259-ecdb-4980-89ae-ef056747ed69 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:16.262443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8d4fc259-ecdb-4980-89ae-ef056747ed69 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:16.267416 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8d4fc259-ecdb-4980-89ae-ef056747ed69 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 0.869254 Sep 08 13:08:16.276949 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2319/4509] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:15 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:17.359892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bc4b4034-5436-4f66-9fc9-674aab97bb5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:17.361122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bc4b4034-5436-4f66-9fc9-674aab97bb5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:17.410648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc4b4034-5436-4f66-9fc9-674aab97bb5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:17.414106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc4b4034-5436-4f66-9fc9-674aab97bb5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:17.415203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc4b4034-5436-4f66-9fc9-674aab97bb5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:17.423349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc4b4034-5436-4f66-9fc9-674aab97bb5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:17.430605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc4b4034-5436-4f66-9fc9-674aab97bb5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:17.434397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc4b4034-5436-4f66-9fc9-674aab97bb5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:17.525787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:08:18.570880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bc4b4034-5436-4f66-9fc9-674aab97bb5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:18.620050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bc4b4034-5436-4f66-9fc9-674aab97bb5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:18.637420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bc4b4034-5436-4f66-9fc9-674aab97bb5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:18.648441 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bc4b4034-5436-4f66-9fc9-674aab97bb5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 1.320271 Sep 08 13:08:18.651205 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2191/4510] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:17 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:18.769972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d2367dd6-93a8-432f-b743-40766af00e81 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-313569554", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "9649e775-71d7-4341-89ed-3f3d41424c28", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:18.827336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:08:19.037768 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-d2367dd6-93a8-432f-b743-40766af00e81 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Block Device 9649e775-71d7-4341-89ed-3f3d41424c28 is not bootable. Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d2367dd6-93a8-432f-b743-40766af00e81 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 357 Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-313569554", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "9649e775-71d7-4341-89ed-3f3d41424c28", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: exception: Block Device 9649e775-71d7-4341-89ed-3f3d41424c28 is not bootable. Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-313569554', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '9649e775-71d7-4341-89ed-3f3d41424c28'}], 'networks': [{'uuid': '6cf9ac04-bf1b-4fd3-befb-5346c4907700'}]}}} Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 9649e775-71d7-4341-89ed-3f3d41424c28 is not bootable. Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:19.053153 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 9649e775-71d7-4341-89ed-3f3d41424c28 is not bootable. Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 9649e775-71d7-4341-89ed-3f3d41424c28 is not bootable. Sep 08 13:08:19.063111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:19.074336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d2367dd6-93a8-432f-b743-40766af00e81 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Block Device 9649e775-71d7-4341-89ed-3f3d41424c28 is not bootable. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:19.076611 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d2367dd6-93a8-432f-b743-40766af00e81 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.311457 Sep 08 13:08:19.078255 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2320/4511] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:08:18 2022] POST /compute/v2.1/servers => generated 110 bytes in 315 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:08:19.095842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-57eccb59-3c62-4f45-a467-e6227ace61bf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:19.096834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-57eccb59-3c62-4f45-a467-e6227ace61bf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:19.123340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57eccb59-3c62-4f45-a467-e6227ace61bf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:19.124625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57eccb59-3c62-4f45-a467-e6227ace61bf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:19.130477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57eccb59-3c62-4f45-a467-e6227ace61bf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:19.132083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57eccb59-3c62-4f45-a467-e6227ace61bf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:19.133114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57eccb59-3c62-4f45-a467-e6227ace61bf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:19.134099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57eccb59-3c62-4f45-a467-e6227ace61bf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:19.703742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-92886d7f-f310-48ce-be2f-8a6f04f336ba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:19.707064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-92886d7f-f310-48ce-be2f-8a6f04f336ba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:19.743977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92886d7f-f310-48ce-be2f-8a6f04f336ba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:19.749010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92886d7f-f310-48ce-be2f-8a6f04f336ba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:19.750303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92886d7f-f310-48ce-be2f-8a6f04f336ba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:19.760674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92886d7f-f310-48ce-be2f-8a6f04f336ba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:19.761778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92886d7f-f310-48ce-be2f-8a6f04f336ba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:19.762316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92886d7f-f310-48ce-be2f-8a6f04f336ba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:20.393133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-57eccb59-3c62-4f45-a467-e6227ace61bf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:20.483540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-92886d7f-f310-48ce-be2f-8a6f04f336ba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:20.501599 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-57eccb59-3c62-4f45-a467-e6227ace61bf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.411485 Sep 08 13:08:20.505798 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2192/4512] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:19 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:08:20.537007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-92886d7f-f310-48ce-be2f-8a6f04f336ba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:20.544203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-92886d7f-f310-48ce-be2f-8a6f04f336ba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:20.547157 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-92886d7f-f310-48ce-be2f-8a6f04f336ba tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 0.850451 Sep 08 13:08:20.548557 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2321/4513] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:19 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:08:20.552177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5140da15-39fd-4f73-91f1-4d143497b6dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:20.553353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5140da15-39fd-4f73-91f1-4d143497b6dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:20.591788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5140da15-39fd-4f73-91f1-4d143497b6dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:20.592812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5140da15-39fd-4f73-91f1-4d143497b6dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:20.596936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5140da15-39fd-4f73-91f1-4d143497b6dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:20.604104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5140da15-39fd-4f73-91f1-4d143497b6dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:20.604685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5140da15-39fd-4f73-91f1-4d143497b6dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:20.607840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5140da15-39fd-4f73-91f1-4d143497b6dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:21.387174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5140da15-39fd-4f73-91f1-4d143497b6dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:21.417353 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5140da15-39fd-4f73-91f1-4d143497b6dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.874281 Sep 08 13:08:21.423125 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2193/4514] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:20 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:08:21.625275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e50fc38-0b7a-4761-9655-59bed0d63b5f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:21.626643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3e50fc38-0b7a-4761-9655-59bed0d63b5f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:21.680440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e50fc38-0b7a-4761-9655-59bed0d63b5f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:21.695520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e50fc38-0b7a-4761-9655-59bed0d63b5f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:21.700520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e50fc38-0b7a-4761-9655-59bed0d63b5f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:21.720763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e50fc38-0b7a-4761-9655-59bed0d63b5f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:21.726347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e50fc38-0b7a-4761-9655-59bed0d63b5f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:21.734700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e50fc38-0b7a-4761-9655-59bed0d63b5f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:22.799723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3e50fc38-0b7a-4761-9655-59bed0d63b5f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:22.832825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3e50fc38-0b7a-4761-9655-59bed0d63b5f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:22.839672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3e50fc38-0b7a-4761-9655-59bed0d63b5f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:22.854598 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3e50fc38-0b7a-4761-9655-59bed0d63b5f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 1.252826 Sep 08 13:08:22.868306 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2322/4515] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:21 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:23.910502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-382fe625-874f-4900-9c64-7d4caaa20913 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:23.916857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-382fe625-874f-4900-9c64-7d4caaa20913 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:23.951773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-382fe625-874f-4900-9c64-7d4caaa20913 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:23.954677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-382fe625-874f-4900-9c64-7d4caaa20913 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:23.959865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-382fe625-874f-4900-9c64-7d4caaa20913 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:23.963124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-382fe625-874f-4900-9c64-7d4caaa20913 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:23.964582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-382fe625-874f-4900-9c64-7d4caaa20913 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:23.968047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-382fe625-874f-4900-9c64-7d4caaa20913 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:24.788841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-382fe625-874f-4900-9c64-7d4caaa20913 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:24.804067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-382fe625-874f-4900-9c64-7d4caaa20913 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:24.817711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-382fe625-874f-4900-9c64-7d4caaa20913 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:24.820762 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-382fe625-874f-4900-9c64-7d4caaa20913 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 0.921100 Sep 08 13:08:24.831700 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2194/4516] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:23 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:25.887940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d5c2dcc-5246-4ec0-a6a6-fd26c1921ebc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:25.890503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6d5c2dcc-5246-4ec0-a6a6-fd26c1921ebc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:25.906130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d5c2dcc-5246-4ec0-a6a6-fd26c1921ebc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:25.907563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d5c2dcc-5246-4ec0-a6a6-fd26c1921ebc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:25.909162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d5c2dcc-5246-4ec0-a6a6-fd26c1921ebc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:25.911881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d5c2dcc-5246-4ec0-a6a6-fd26c1921ebc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:25.913052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d5c2dcc-5246-4ec0-a6a6-fd26c1921ebc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:25.914121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d5c2dcc-5246-4ec0-a6a6-fd26c1921ebc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:26.306983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f649db74-4528-4801-9453-d6018d2823a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-738387529", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "destination_type": "local"}, {"source_type": "volume", "uuid": "56a36eaa-1929-4440-b97b-a1345972248c", "destination_type": "invalid"}], "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f649db74-4528-4801-9453-d6018d2823a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 494 Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-738387529", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "destination_type": "local"}, {"source_type": "volume", "uuid": "56a36eaa-1929-4440-b97b-a1345972248c", "destination_type": "invalid"}], "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-738387529', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '56a36eaa-1929-4440-b97b-a1345972248c', 'destination_type': 'invalid'}], 'networks': [{'uuid': '6cf9ac04-bf1b-4fd3-befb-5346c4907700'}]}}} Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'invalid' Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:26.379710 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f649db74-4528-4801-9453-d6018d2823a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:26.384779 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f649db74-4528-4801-9453-d6018d2823a2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.086334 Sep 08 13:08:26.400713 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2195/4517] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:08:26 2022] POST /compute/v2.1/servers => generated 155 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:08:26.430148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-266e7fb2-49e4-40c5-996f-3e9f2da5fcf6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:26.431800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-266e7fb2-49e4-40c5-996f-3e9f2da5fcf6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:26.465085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-266e7fb2-49e4-40c5-996f-3e9f2da5fcf6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:26.467477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-266e7fb2-49e4-40c5-996f-3e9f2da5fcf6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:26.468657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-266e7fb2-49e4-40c5-996f-3e9f2da5fcf6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:26.471104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-266e7fb2-49e4-40c5-996f-3e9f2da5fcf6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:26.472474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-266e7fb2-49e4-40c5-996f-3e9f2da5fcf6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:26.473610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-266e7fb2-49e4-40c5-996f-3e9f2da5fcf6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:26.583754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d5c2dcc-5246-4ec0-a6a6-fd26c1921ebc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:26.612312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d5c2dcc-5246-4ec0-a6a6-fd26c1921ebc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:26.616488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d5c2dcc-5246-4ec0-a6a6-fd26c1921ebc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:26.619826 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6d5c2dcc-5246-4ec0-a6a6-fd26c1921ebc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 0.742205 Sep 08 13:08:26.621811 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2323/4518] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:25 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:27.712894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1902c3f1-ec64-4c54-b042-5a2d08c193b9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:27.723845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1902c3f1-ec64-4c54-b042-5a2d08c193b9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:27.765455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1902c3f1-ec64-4c54-b042-5a2d08c193b9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:27.772817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1902c3f1-ec64-4c54-b042-5a2d08c193b9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:27.776286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1902c3f1-ec64-4c54-b042-5a2d08c193b9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:27.782858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1902c3f1-ec64-4c54-b042-5a2d08c193b9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:27.791987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1902c3f1-ec64-4c54-b042-5a2d08c193b9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:27.792795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1902c3f1-ec64-4c54-b042-5a2d08c193b9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:28.348850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-266e7fb2-49e4-40c5-996f-3e9f2da5fcf6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:28.387497 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-266e7fb2-49e4-40c5-996f-3e9f2da5fcf6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.975672 Sep 08 13:08:28.389126 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2196/4519] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:26 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:28.454180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-33fd589a-d095-470f-9cb1-6c73fdf04ddd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:28.456142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33fd589a-d095-470f-9cb1-6c73fdf04ddd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:28.479357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33fd589a-d095-470f-9cb1-6c73fdf04ddd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:28.483117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33fd589a-d095-470f-9cb1-6c73fdf04ddd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:28.485065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33fd589a-d095-470f-9cb1-6c73fdf04ddd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:28.489837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33fd589a-d095-470f-9cb1-6c73fdf04ddd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:28.492245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33fd589a-d095-470f-9cb1-6c73fdf04ddd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:28.493134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33fd589a-d095-470f-9cb1-6c73fdf04ddd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:28.906879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1902c3f1-ec64-4c54-b042-5a2d08c193b9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:28.950910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1902c3f1-ec64-4c54-b042-5a2d08c193b9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:28.958650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1902c3f1-ec64-4c54-b042-5a2d08c193b9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:28.966957 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1902c3f1-ec64-4c54-b042-5a2d08c193b9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 1.296384 Sep 08 13:08:28.973420 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2324/4520] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:27 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:08:29.101370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-33fd589a-d095-470f-9cb1-6c73fdf04ddd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:29.140709 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-33fd589a-d095-470f-9cb1-6c73fdf04ddd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.697248 Sep 08 13:08:29.143030 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2197/4521] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:28 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:29.269561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-63abd0d7-a213-48b2-9d89-ae5384aa1901 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-294244185", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-63abd0d7-a213-48b2-9d89-ae5384aa1901 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 491 Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-294244185", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-294244185', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '6cf9ac04-bf1b-4fd3-befb-5346c4907700'}]}}} Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:29.293082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-63abd0d7-a213-48b2-9d89-ae5384aa1901 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-63abd0d7-a213-48b2-9d89-ae5384aa1901 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.031938 Sep 08 13:08:29.299999 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2325/4522] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:08:29 2022] POST /compute/v2.1/servers => generated 624 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:08:29.310900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9f7467bf-8863-4c60-a0a1-350bd58f8b66 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:29.311773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9f7467bf-8863-4c60-a0a1-350bd58f8b66 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:29.336240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f7467bf-8863-4c60-a0a1-350bd58f8b66 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:29.336985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f7467bf-8863-4c60-a0a1-350bd58f8b66 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:29.337950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f7467bf-8863-4c60-a0a1-350bd58f8b66 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:29.347583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f7467bf-8863-4c60-a0a1-350bd58f8b66 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:29.353636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f7467bf-8863-4c60-a0a1-350bd58f8b66 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:29.355689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f7467bf-8863-4c60-a0a1-350bd58f8b66 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:29.988348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9f7467bf-8863-4c60-a0a1-350bd58f8b66 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:30.011609 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9f7467bf-8863-4c60-a0a1-350bd58f8b66 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.705106 Sep 08 13:08:30.014949 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2198/4523] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:29 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:08:30.019250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ceb00db4-94c7-4054-8ff0-b501185ccb6b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:30.021509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ceb00db4-94c7-4054-8ff0-b501185ccb6b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:30.045274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ceb00db4-94c7-4054-8ff0-b501185ccb6b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:30.045823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ceb00db4-94c7-4054-8ff0-b501185ccb6b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:30.046300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ceb00db4-94c7-4054-8ff0-b501185ccb6b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:30.047107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ceb00db4-94c7-4054-8ff0-b501185ccb6b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:30.047636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ceb00db4-94c7-4054-8ff0-b501185ccb6b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:30.048092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ceb00db4-94c7-4054-8ff0-b501185ccb6b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:30.054592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9ad560f8-6346-421f-b051-30cea660df99 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:30.067822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9ad560f8-6346-421f-b051-30cea660df99 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:30.090426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ad560f8-6346-421f-b051-30cea660df99 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:30.091257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ad560f8-6346-421f-b051-30cea660df99 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:30.097017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ad560f8-6346-421f-b051-30cea660df99 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:30.098598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ad560f8-6346-421f-b051-30cea660df99 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:30.100147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ad560f8-6346-421f-b051-30cea660df99 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:30.101108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ad560f8-6346-421f-b051-30cea660df99 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:30.852825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ceb00db4-94c7-4054-8ff0-b501185ccb6b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:30.895566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ceb00db4-94c7-4054-8ff0-b501185ccb6b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:30.902306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ceb00db4-94c7-4054-8ff0-b501185ccb6b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:30.910103 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ceb00db4-94c7-4054-8ff0-b501185ccb6b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 0.896969 Sep 08 13:08:30.939425 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2326/4524] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:30 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:31.150398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9ad560f8-6346-421f-b051-30cea660df99 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:31.167979 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9ad560f8-6346-421f-b051-30cea660df99 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.124748 Sep 08 13:08:31.178340 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2199/4525] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:30 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:08:31.315532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-38902743-21a9-42c8-a9f6-b00d9b4df21c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-38902743-21a9-42c8-a9f6-b00d9b4df21c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 416 Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'networks': [{'uuid': '6cf9ac04-bf1b-4fd3-befb-5346c4907700'}]}}} Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:31.320007 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 13:08:31.327730 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:31.335343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-38902743-21a9-42c8-a9f6-b00d9b4df21c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:31.337406 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-38902743-21a9-42c8-a9f6-b00d9b4df21c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.024316 Sep 08 13:08:31.345551 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2327/4526] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:08:31 2022] POST /compute/v2.1/servers => generated 619 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:08:31.356194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-55c6ac35-2fc6-43d8-9927-9c13516f00a9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:31.357186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-55c6ac35-2fc6-43d8-9927-9c13516f00a9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:31.405844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55c6ac35-2fc6-43d8-9927-9c13516f00a9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:31.416576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55c6ac35-2fc6-43d8-9927-9c13516f00a9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:31.428493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55c6ac35-2fc6-43d8-9927-9c13516f00a9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:31.432878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55c6ac35-2fc6-43d8-9927-9c13516f00a9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:31.436032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55c6ac35-2fc6-43d8-9927-9c13516f00a9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:31.438983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55c6ac35-2fc6-43d8-9927-9c13516f00a9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:31.981136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cb2b06dd-46ef-4302-9fa4-eb0ddf9aea6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:31.982086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cb2b06dd-46ef-4302-9fa4-eb0ddf9aea6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:32.008231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb2b06dd-46ef-4302-9fa4-eb0ddf9aea6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:32.010781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb2b06dd-46ef-4302-9fa4-eb0ddf9aea6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:32.019956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb2b06dd-46ef-4302-9fa4-eb0ddf9aea6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:32.021660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb2b06dd-46ef-4302-9fa4-eb0ddf9aea6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:32.022818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb2b06dd-46ef-4302-9fa4-eb0ddf9aea6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:32.023869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb2b06dd-46ef-4302-9fa4-eb0ddf9aea6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:32.065020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-55c6ac35-2fc6-43d8-9927-9c13516f00a9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:32.092237 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-55c6ac35-2fc6-43d8-9927-9c13516f00a9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.744530 Sep 08 13:08:32.093367 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2200/4527] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:31 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:32.140978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a51e3aa4-7c6b-4ae2-b6b7-9444659b4f67 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:32.144670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a51e3aa4-7c6b-4ae2-b6b7-9444659b4f67 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:32.176203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a51e3aa4-7c6b-4ae2-b6b7-9444659b4f67 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:32.186032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a51e3aa4-7c6b-4ae2-b6b7-9444659b4f67 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:32.199809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a51e3aa4-7c6b-4ae2-b6b7-9444659b4f67 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:32.200879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a51e3aa4-7c6b-4ae2-b6b7-9444659b4f67 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:32.202196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a51e3aa4-7c6b-4ae2-b6b7-9444659b4f67 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:32.206510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a51e3aa4-7c6b-4ae2-b6b7-9444659b4f67 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:32.655205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cb2b06dd-46ef-4302-9fa4-eb0ddf9aea6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:32.683699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:08:32.726573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cb2b06dd-46ef-4302-9fa4-eb0ddf9aea6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:32.739697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cb2b06dd-46ef-4302-9fa4-eb0ddf9aea6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:32.749428 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cb2b06dd-46ef-4302-9fa4-eb0ddf9aea6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 0.783744 Sep 08 13:08:32.784101 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2328/4528] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:31 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:08:32.791755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a51e3aa4-7c6b-4ae2-b6b7-9444659b4f67 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:32.808624 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a51e3aa4-7c6b-4ae2-b6b7-9444659b4f67 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.671517 Sep 08 13:08:32.810127 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2201/4529] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:32 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:32.919593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc68cf9d-4819-4e9b-ad08-88c61aec9ba9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1565434602", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": -1, "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:32.977548 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-fc68cf9d-4819-4e9b-ad08-88c61aec9ba9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Flavor -1 could not be found. Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc68cf9d-4819-4e9b-ad08-88c61aec9ba9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 206 Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1565434602", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": -1, "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: exception: Flavor -1 could not be found. Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1565434602', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': -1, 'networks': [{'uuid': '6cf9ac04-bf1b-4fd3-befb-5346c4907700'}]}}} Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:32.981945 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Sep 08 13:08:32.990939 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:32.996864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc68cf9d-4819-4e9b-ad08-88c61aec9ba9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:32.998648 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc68cf9d-4819-4e9b-ad08-88c61aec9ba9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.094127 Sep 08 13:08:33.000390 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2329/4530] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:08:32 2022] POST /compute/v2.1/servers => generated 73 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Sep 08 13:08:33.025263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-78e86eb2-c49d-4863-8132-93a636c1c6ad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:33.026533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-78e86eb2-c49d-4863-8132-93a636c1c6ad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:33.038664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78e86eb2-c49d-4863-8132-93a636c1c6ad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:33.040153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78e86eb2-c49d-4863-8132-93a636c1c6ad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:33.040979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78e86eb2-c49d-4863-8132-93a636c1c6ad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:33.042336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78e86eb2-c49d-4863-8132-93a636c1c6ad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:33.043188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78e86eb2-c49d-4863-8132-93a636c1c6ad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:33.044015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78e86eb2-c49d-4863-8132-93a636c1c6ad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:33.379690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-78e86eb2-c49d-4863-8132-93a636c1c6ad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:33.391753 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-78e86eb2-c49d-4863-8132-93a636c1c6ad tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.383675 Sep 08 13:08:33.393778 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2202/4531] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:33 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:33.434258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-68823986-803c-4539-8de7-6a720b5a887b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:33.442776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-68823986-803c-4539-8de7-6a720b5a887b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:33.454120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68823986-803c-4539-8de7-6a720b5a887b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:33.455631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68823986-803c-4539-8de7-6a720b5a887b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:33.456972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68823986-803c-4539-8de7-6a720b5a887b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:33.458523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68823986-803c-4539-8de7-6a720b5a887b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:33.459639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68823986-803c-4539-8de7-6a720b5a887b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:33.460866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68823986-803c-4539-8de7-6a720b5a887b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:33.808474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5209c81d-6aa2-46f6-8c37-4e75b82899c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:33.808474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5209c81d-6aa2-46f6-8c37-4e75b82899c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:33.838516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-68823986-803c-4539-8de7-6a720b5a887b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:33.848998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5209c81d-6aa2-46f6-8c37-4e75b82899c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:33.850485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5209c81d-6aa2-46f6-8c37-4e75b82899c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:33.851834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5209c81d-6aa2-46f6-8c37-4e75b82899c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:33.854143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5209c81d-6aa2-46f6-8c37-4e75b82899c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:33.855620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5209c81d-6aa2-46f6-8c37-4e75b82899c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:33.856697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5209c81d-6aa2-46f6-8c37-4e75b82899c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:33.858636 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-68823986-803c-4539-8de7-6a720b5a887b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.430637 Sep 08 13:08:33.868309 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2330/4532] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:33 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:34.013784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52ac0ae4-e5c6-4ca4-8826-e75f62466168 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1426309717", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52ac0ae4-e5c6-4ca4-8826-e75f62466168 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 173 Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1426309717", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1426309717', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '6cf9ac04-bf1b-4fd3-befb-5346c4907700'}]}}} Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi -1 Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:08:34.032532 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52ac0ae4-e5c6-4ca4-8826-e75f62466168 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:34.042362 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-52ac0ae4-e5c6-4ca4-8826-e75f62466168 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.033428 Sep 08 13:08:34.049681 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2331/4533] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:08:34 2022] POST /compute/v2.1/servers => generated 145 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:08:34.059786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8d69ddee-ea79-4e02-96ff-6bd527ea3fe1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:34.060669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8d69ddee-ea79-4e02-96ff-6bd527ea3fe1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:34.075786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d69ddee-ea79-4e02-96ff-6bd527ea3fe1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:34.076695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d69ddee-ea79-4e02-96ff-6bd527ea3fe1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:34.077579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d69ddee-ea79-4e02-96ff-6bd527ea3fe1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:34.080280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d69ddee-ea79-4e02-96ff-6bd527ea3fe1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:34.081151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d69ddee-ea79-4e02-96ff-6bd527ea3fe1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:34.081946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d69ddee-ea79-4e02-96ff-6bd527ea3fe1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:34.986827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5209c81d-6aa2-46f6-8c37-4e75b82899c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:35.020528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5209c81d-6aa2-46f6-8c37-4e75b82899c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:35.022949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5209c81d-6aa2-46f6-8c37-4e75b82899c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:35.029464 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5209c81d-6aa2-46f6-8c37-4e75b82899c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 1.233663 Sep 08 13:08:35.031579 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2203/4534] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:33 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:08:35.043942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-70882ef4-a954-4bad-a55b-d0b3c5ac0565 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:35.045861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-70882ef4-a954-4bad-a55b-d0b3c5ac0565 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:35.063200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70882ef4-a954-4bad-a55b-d0b3c5ac0565 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:35.065956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70882ef4-a954-4bad-a55b-d0b3c5ac0565 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:35.067518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70882ef4-a954-4bad-a55b-d0b3c5ac0565 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:35.069994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70882ef4-a954-4bad-a55b-d0b3c5ac0565 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:35.072912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70882ef4-a954-4bad-a55b-d0b3c5ac0565 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:35.074609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70882ef4-a954-4bad-a55b-d0b3c5ac0565 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:35.178503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8d69ddee-ea79-4e02-96ff-6bd527ea3fe1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:35.202933 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8d69ddee-ea79-4e02-96ff-6bd527ea3fe1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.152538 Sep 08 13:08:35.219712 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2332/4535] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:34 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:35.254334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5a1a9409-f89c-4027-a342-4c03378b9a17 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:35.255307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5a1a9409-f89c-4027-a342-4c03378b9a17 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:35.280655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a1a9409-f89c-4027-a342-4c03378b9a17 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:35.281894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a1a9409-f89c-4027-a342-4c03378b9a17 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:35.292412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a1a9409-f89c-4027-a342-4c03378b9a17 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:35.294444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a1a9409-f89c-4027-a342-4c03378b9a17 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:35.295620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a1a9409-f89c-4027-a342-4c03378b9a17 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:35.296701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a1a9409-f89c-4027-a342-4c03378b9a17 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:35.323086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-70882ef4-a954-4bad-a55b-d0b3c5ac0565 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lazy-loading 'services' on Instance uuid bfec9e61-54e7-4949-a6f6-d18640db5191 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:08:35.559531 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-70882ef4-a954-4bad-a55b-d0b3c5ac0565 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments/7c5bf79f-51f7-4438-9301-1713ac9a755e" status: 202 len: 0 microversion: 2.1 time: 0.524983 Sep 08 13:08:35.570709 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2204/4536] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:08:35 2022] DELETE /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments/7c5bf79f-51f7-4438-9301-1713ac9a755e => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:08:35.590798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4ec7f945-189f-4ac9-a5be-ee514559faa2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:35.598011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ec7f945-189f-4ac9-a5be-ee514559faa2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:35.614439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ec7f945-189f-4ac9-a5be-ee514559faa2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:35.615711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ec7f945-189f-4ac9-a5be-ee514559faa2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:35.616776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ec7f945-189f-4ac9-a5be-ee514559faa2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:35.618366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ec7f945-189f-4ac9-a5be-ee514559faa2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:35.619973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ec7f945-189f-4ac9-a5be-ee514559faa2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:35.621003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ec7f945-189f-4ac9-a5be-ee514559faa2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:35.740846 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4ec7f945-189f-4ac9-a5be-ee514559faa2 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167095 Sep 08 13:08:35.742165 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2205/4537] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:08:35 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments => generated 197 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:36.081186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8ad7ff87-a3ad-42a6-8f10-680a74516ee5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:36.082216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8ad7ff87-a3ad-42a6-8f10-680a74516ee5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:36.092216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5a1a9409-f89c-4027-a342-4c03378b9a17 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:36.122835 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5a1a9409-f89c-4027-a342-4c03378b9a17 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.875121 Sep 08 13:08:36.125390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ad7ff87-a3ad-42a6-8f10-680a74516ee5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:36.131193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ad7ff87-a3ad-42a6-8f10-680a74516ee5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:36.134866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ad7ff87-a3ad-42a6-8f10-680a74516ee5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:36.148734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ad7ff87-a3ad-42a6-8f10-680a74516ee5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:36.152488 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2333/4538] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:35 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:08:36.171266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ad7ff87-a3ad-42a6-8f10-680a74516ee5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:36.171266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ad7ff87-a3ad-42a6-8f10-680a74516ee5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:36.445627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7c5ee3da-948b-41e0-98dc-cb040646919c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-309106057", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:36.471978 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-7c5ee3da-948b-41e0-98dc-cb040646919c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7c5ee3da-948b-41e0-98dc-cb040646919c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 215 Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-309106057", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-309106057', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._validate_network_id( Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:36.478433 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:36.488280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:36.488280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:36.488280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:36.488280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:36.488280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:36.488280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Sep 08 13:08:36.488280 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:36.488280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7c5ee3da-948b-41e0-98dc-cb040646919c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:36.490152 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7c5ee3da-948b-41e0-98dc-cb040646919c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.051855 Sep 08 13:08:36.491715 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2334/4539] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:08:36 2022] POST /compute/v2.1/servers => generated 123 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 13:08:36.512433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f5082e1c-bd80-44f0-a1d4-eeb8b85eca25 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:36.514200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f5082e1c-bd80-44f0-a1d4-eeb8b85eca25 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:36.544837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5082e1c-bd80-44f0-a1d4-eeb8b85eca25 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:36.554316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5082e1c-bd80-44f0-a1d4-eeb8b85eca25 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:36.555707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5082e1c-bd80-44f0-a1d4-eeb8b85eca25 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:36.557813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5082e1c-bd80-44f0-a1d4-eeb8b85eca25 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:36.559035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5082e1c-bd80-44f0-a1d4-eeb8b85eca25 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:36.560255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f5082e1c-bd80-44f0-a1d4-eeb8b85eca25 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:37.430413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f5082e1c-bd80-44f0-a1d4-eeb8b85eca25 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:37.449886 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f5082e1c-bd80-44f0-a1d4-eeb8b85eca25 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.951363 Sep 08 13:08:37.468782 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2335/4540] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:36 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:37.496244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2c980fd6-bfea-4360-bee2-1f8efaa55ad3 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:37.500489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2c980fd6-bfea-4360-bee2-1f8efaa55ad3 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:37.512161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c980fd6-bfea-4360-bee2-1f8efaa55ad3 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:37.514184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c980fd6-bfea-4360-bee2-1f8efaa55ad3 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:37.515370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c980fd6-bfea-4360-bee2-1f8efaa55ad3 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:37.517054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c980fd6-bfea-4360-bee2-1f8efaa55ad3 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:37.518789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c980fd6-bfea-4360-bee2-1f8efaa55ad3 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:37.519865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c980fd6-bfea-4360-bee2-1f8efaa55ad3 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:37.587906 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2c980fd6-bfea-4360-bee2-1f8efaa55ad3 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116784 Sep 08 13:08:37.589493 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2336/4541] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:08:37 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:37.601641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8ad7ff87-a3ad-42a6-8f10-680a74516ee5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:37.606844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f8bb554b-6726-480a-8928-38ca690558df tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:37.609252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f8bb554b-6726-480a-8928-38ca690558df tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:37.622939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8bb554b-6726-480a-8928-38ca690558df tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:37.624289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8bb554b-6726-480a-8928-38ca690558df tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:37.625401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8bb554b-6726-480a-8928-38ca690558df tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:37.627503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8bb554b-6726-480a-8928-38ca690558df tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:37.629385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8bb554b-6726-480a-8928-38ca690558df tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:37.630512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8bb554b-6726-480a-8928-38ca690558df tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:37.649582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8ad7ff87-a3ad-42a6-8f10-680a74516ee5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:37.653194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8ad7ff87-a3ad-42a6-8f10-680a74516ee5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:37.667786 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8ad7ff87-a3ad-42a6-8f10-680a74516ee5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 1.581160 Sep 08 13:08:37.677638 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2206/4542] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:36 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:08:39.424853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e7679af-5e81-4a6c-9256-5ded09e7555d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:39.440221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8e7679af-5e81-4a6c-9256-5ded09e7555d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:39.462377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f8bb554b-6726-480a-8928-38ca690558df tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:39.482174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=48 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:08:39.488200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e7679af-5e81-4a6c-9256-5ded09e7555d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:39.496208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e7679af-5e81-4a6c-9256-5ded09e7555d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:39.502594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e7679af-5e81-4a6c-9256-5ded09e7555d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:39.506793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e7679af-5e81-4a6c-9256-5ded09e7555d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:39.508181 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f8bb554b-6726-480a-8928-38ca690558df tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.906101 Sep 08 13:08:39.535353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e7679af-5e81-4a6c-9256-5ded09e7555d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:39.536497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e7679af-5e81-4a6c-9256-5ded09e7555d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:39.559630 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2337/4543] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:37 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:39.585864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7ad443b7-8d5d-4bc2-9471-b8751e2f8ad6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:39.587869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7ad443b7-8d5d-4bc2-9471-b8751e2f8ad6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:39.604599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ad443b7-8d5d-4bc2-9471-b8751e2f8ad6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:39.606864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ad443b7-8d5d-4bc2-9471-b8751e2f8ad6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:39.611616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ad443b7-8d5d-4bc2-9471-b8751e2f8ad6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:39.613674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ad443b7-8d5d-4bc2-9471-b8751e2f8ad6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:39.617767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ad443b7-8d5d-4bc2-9471-b8751e2f8ad6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:39.619460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ad443b7-8d5d-4bc2-9471-b8751e2f8ad6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:39.738542 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8e7679af-5e81-4a6c-9256-5ded09e7555d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 1.136233 Sep 08 13:08:39.752675 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2207/4544] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:08:38 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments => generated 197 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:39.795263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-48bb4705-42d5-44f0-990f-b6a311cbd5d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-335459740", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "key_name": "tempest-key-1472314049", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:40.003245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-48bb4705-42d5-44f0-990f-b6a311cbd5d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] validate_networks() for [('6cf9ac04-bf1b-4fd3-befb-5346c4907700', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:08:40.743628 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-48bb4705-42d5-44f0-990f-b6a311cbd5d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Invalid key_name provided. Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-48bb4705-42d5-44f0-990f-b6a311cbd5d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 246 Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-335459740", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "key_name": "tempest-key-1472314049", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid key_name provided. Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-335459740', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'key_name': 'tempest-key-1472314049', 'networks': [{'uuid': '6cf9ac04-bf1b-4fd3-befb-5346c4907700'}]}}} Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1472314049 not found for user 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:40.747356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:40.757193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-48bb4705-42d5-44f0-990f-b6a311cbd5d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Invalid key_name provided. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:40.769326 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-48bb4705-42d5-44f0-990f-b6a311cbd5d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.971766 Sep 08 13:08:40.777013 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2208/4545] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:08:39 2022] POST /compute/v2.1/servers => generated 70 bytes in 1000 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Sep 08 13:08:40.794063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ed047026-6be6-4063-8f69-42bbf0b41ccd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:40.798050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ed047026-6be6-4063-8f69-42bbf0b41ccd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:40.837866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed047026-6be6-4063-8f69-42bbf0b41ccd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:40.842697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed047026-6be6-4063-8f69-42bbf0b41ccd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:40.843653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed047026-6be6-4063-8f69-42bbf0b41ccd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:40.845016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed047026-6be6-4063-8f69-42bbf0b41ccd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:40.847873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed047026-6be6-4063-8f69-42bbf0b41ccd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:40.849197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed047026-6be6-4063-8f69-42bbf0b41ccd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:40.909558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:08:40.928946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ad443b7-8d5d-4bc2-9471-b8751e2f8ad6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:40.933567 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ed047026-6be6-4063-8f69-42bbf0b41ccd tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.154293 Sep 08 13:08:40.935098 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2209/4546] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:08:40 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:40.950908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d5b0a581-eb7b-4ed8-bf2e-1150ee0067ba tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:40.952228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d5b0a581-eb7b-4ed8-bf2e-1150ee0067ba tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:40.966825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5b0a581-eb7b-4ed8-bf2e-1150ee0067ba tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:40.968744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5b0a581-eb7b-4ed8-bf2e-1150ee0067ba tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:40.969681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5b0a581-eb7b-4ed8-bf2e-1150ee0067ba tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:40.971653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5b0a581-eb7b-4ed8-bf2e-1150ee0067ba tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:40.973791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5b0a581-eb7b-4ed8-bf2e-1150ee0067ba tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:40.974652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5b0a581-eb7b-4ed8-bf2e-1150ee0067ba tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:40.975695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ad443b7-8d5d-4bc2-9471-b8751e2f8ad6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:40.984264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ad443b7-8d5d-4bc2-9471-b8751e2f8ad6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:40.991082 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7ad443b7-8d5d-4bc2-9471-b8751e2f8ad6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 1.428871 Sep 08 13:08:40.996470 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2338/4547] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:39 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 1436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:41.378626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d5b0a581-eb7b-4ed8-bf2e-1150ee0067ba tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:41.411850 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d5b0a581-eb7b-4ed8-bf2e-1150ee0067ba tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.469284 Sep 08 13:08:41.413203 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2210/4548] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:40 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:41.473626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-56bfdbe8-7a4a-46bd-97cd-f6b550c0ba85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:41.478874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-56bfdbe8-7a4a-46bd-97cd-f6b550c0ba85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:41.519245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56bfdbe8-7a4a-46bd-97cd-f6b550c0ba85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:41.520306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56bfdbe8-7a4a-46bd-97cd-f6b550c0ba85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:41.521478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56bfdbe8-7a4a-46bd-97cd-f6b550c0ba85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:41.523492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56bfdbe8-7a4a-46bd-97cd-f6b550c0ba85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:41.524756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56bfdbe8-7a4a-46bd-97cd-f6b550c0ba85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:41.525844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56bfdbe8-7a4a-46bd-97cd-f6b550c0ba85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:41.962095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cae3c41b-f4f9-40b0-9291-6f411c451d06 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:41.972983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cae3c41b-f4f9-40b0-9291-6f411c451d06 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:41.998207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cae3c41b-f4f9-40b0-9291-6f411c451d06 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:42.003348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cae3c41b-f4f9-40b0-9291-6f411c451d06 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:42.005084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cae3c41b-f4f9-40b0-9291-6f411c451d06 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:42.010220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cae3c41b-f4f9-40b0-9291-6f411c451d06 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:42.011643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cae3c41b-f4f9-40b0-9291-6f411c451d06 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:42.012774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cae3c41b-f4f9-40b0-9291-6f411c451d06 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:42.063246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-56bfdbe8-7a4a-46bd-97cd-f6b550c0ba85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:42.116079 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-56bfdbe8-7a4a-46bd-97cd-f6b550c0ba85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.652869 Sep 08 13:08:42.121600 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2339/4549] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:41 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:42.141108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-df3230be-0772-4846-bd6c-9d621b027ad1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:42.148467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-df3230be-0772-4846-bd6c-9d621b027ad1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:42.164535 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cae3c41b-f4f9-40b0-9291-6f411c451d06 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.214537 Sep 08 13:08:42.168078 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2211/4550] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:08:41 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments => generated 197 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:42.175553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df3230be-0772-4846-bd6c-9d621b027ad1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:42.180987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df3230be-0772-4846-bd6c-9d621b027ad1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:42.196679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df3230be-0772-4846-bd6c-9d621b027ad1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:42.204504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df3230be-0772-4846-bd6c-9d621b027ad1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:42.209810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df3230be-0772-4846-bd6c-9d621b027ad1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:42.215770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df3230be-0772-4846-bd6c-9d621b027ad1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:42.432086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db693869-6605-4c78-93ac-f5eb83d05955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1681497261", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:43.472993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.security_group_api [None req-db693869-6605-4c78-93ac-f5eb83d05955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Neutron security group does_not_exist not found {{(pid=128971) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Sep 08 13:08:43.474751 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-db693869-6605-4c78-93ac-f5eb83d05955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db693869-6605-4c78-93ac-f5eb83d05955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 258 Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1681497261", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: exception: Unable to find security_group with name or id 'does_not_exist' Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1681497261', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '6cf9ac04-bf1b-4fd3-befb-5346c4907700'}]}}} Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Sep 08 13:08:43.491885 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._create_instance( Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:43.500780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db693869-6605-4c78-93ac-f5eb83d05955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:43.516527 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-db693869-6605-4c78-93ac-f5eb83d05955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 1.080948 Sep 08 13:08:43.516527 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2212/4551] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:08:42 2022] POST /compute/v2.1/servers => generated 106 bytes in 1092 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:08:43.522713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e27ca76e-de9e-4926-ab6a-20d6c3a39b1e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:43.546827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e27ca76e-de9e-4926-ab6a-20d6c3a39b1e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:43.614949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e27ca76e-de9e-4926-ab6a-20d6c3a39b1e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:43.624446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e27ca76e-de9e-4926-ab6a-20d6c3a39b1e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:43.636356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e27ca76e-de9e-4926-ab6a-20d6c3a39b1e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:43.638443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e27ca76e-de9e-4926-ab6a-20d6c3a39b1e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:43.639790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e27ca76e-de9e-4926-ab6a-20d6c3a39b1e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:43.642056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e27ca76e-de9e-4926-ab6a-20d6c3a39b1e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:43.936064 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e27ca76e-de9e-4926-ab6a-20d6c3a39b1e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.426707 Sep 08 13:08:43.937387 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2213/4552] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:08:43 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments => generated 197 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:43.964547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d2d22fb7-6435-4ce2-8b3a-16adf1830470 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:43.966971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d2d22fb7-6435-4ce2-8b3a-16adf1830470 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:44.000134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2d22fb7-6435-4ce2-8b3a-16adf1830470 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:44.009079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2d22fb7-6435-4ce2-8b3a-16adf1830470 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:44.010249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2d22fb7-6435-4ce2-8b3a-16adf1830470 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:44.011845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2d22fb7-6435-4ce2-8b3a-16adf1830470 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:44.013126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2d22fb7-6435-4ce2-8b3a-16adf1830470 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:44.014103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2d22fb7-6435-4ce2-8b3a-16adf1830470 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:44.017965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-df3230be-0772-4846-bd6c-9d621b027ad1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:44.067884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-df3230be-0772-4846-bd6c-9d621b027ad1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:44.071188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-df3230be-0772-4846-bd6c-9d621b027ad1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:44.084371 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-df3230be-0772-4846-bd6c-9d621b027ad1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 1.960289 Sep 08 13:08:44.092359 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2340/4553] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:42 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 1970 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:44.958000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d2d22fb7-6435-4ce2-8b3a-16adf1830470 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:44.964107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-35c3c7f9-2a70-47d1-b632-e4e1845ab8c8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:44.981105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-35c3c7f9-2a70-47d1-b632-e4e1845ab8c8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:44.989727 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d2d22fb7-6435-4ce2-8b3a-16adf1830470 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.046258 Sep 08 13:08:44.991446 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2214/4554] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:43 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:45.014206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35c3c7f9-2a70-47d1-b632-e4e1845ab8c8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:45.017225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35c3c7f9-2a70-47d1-b632-e4e1845ab8c8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:45.018355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35c3c7f9-2a70-47d1-b632-e4e1845ab8c8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:45.022603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35c3c7f9-2a70-47d1-b632-e4e1845ab8c8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:45.026376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35c3c7f9-2a70-47d1-b632-e4e1845ab8c8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:45.029936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35c3c7f9-2a70-47d1-b632-e4e1845ab8c8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:45.093492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b2478731-00bc-43d5-b03c-0108341ccbe9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:45.100297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b2478731-00bc-43d5-b03c-0108341ccbe9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:45.143380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2478731-00bc-43d5-b03c-0108341ccbe9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:45.145924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2478731-00bc-43d5-b03c-0108341ccbe9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:45.146433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2478731-00bc-43d5-b03c-0108341ccbe9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:45.153448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2478731-00bc-43d5-b03c-0108341ccbe9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:45.154114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2478731-00bc-43d5-b03c-0108341ccbe9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:45.157981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b2478731-00bc-43d5-b03c-0108341ccbe9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:45.208189 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-35c3c7f9-2a70-47d1-b632-e4e1845ab8c8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.258939 Sep 08 13:08:45.222741 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2341/4555] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:08:44 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments => generated 197 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:08:45.237542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a427384f-7f86-4ed5-b29c-f271b94e17ef tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:45.240310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a427384f-7f86-4ed5-b29c-f271b94e17ef tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:45.271809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a427384f-7f86-4ed5-b29c-f271b94e17ef tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:45.276166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a427384f-7f86-4ed5-b29c-f271b94e17ef tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:45.277171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a427384f-7f86-4ed5-b29c-f271b94e17ef tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:45.278914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a427384f-7f86-4ed5-b29c-f271b94e17ef tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:45.287457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a427384f-7f86-4ed5-b29c-f271b94e17ef tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:45.288614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a427384f-7f86-4ed5-b29c-f271b94e17ef tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:45.789665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b2478731-00bc-43d5-b03c-0108341ccbe9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:45.837841 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b2478731-00bc-43d5-b03c-0108341ccbe9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.758572 Sep 08 13:08:45.843453 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2215/4556] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:45 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:45.872279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a427384f-7f86-4ed5-b29c-f271b94e17ef tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:45.892793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5fcaca39-46a8-4c6e-825a-6bea6adcba08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:45.894151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5fcaca39-46a8-4c6e-825a-6bea6adcba08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 0767c13b-4eb8-488f-b385-ec63940e2ed0] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:45.902107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a427384f-7f86-4ed5-b29c-f271b94e17ef tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:45.913044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a427384f-7f86-4ed5-b29c-f271b94e17ef tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:45.917289 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a427384f-7f86-4ed5-b29c-f271b94e17ef tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1740 microversion: 2.20 time: 0.699502 Sep 08 13:08:45.920122 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2342/4557] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:45 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1740 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:45.933699 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-5fcaca39-46a8-4c6e-825a-6bea6adcba08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 0767c13b-4eb8-488f-b385-ec63940e2ed0 could not be found. Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5fcaca39-46a8-4c6e-825a-6bea6adcba08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/0767c13b-4eb8-488f-b385-ec63940e2ed0 HTTP/1.1 Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 0767c13b-4eb8-488f-b385-ec63940e2ed0 could not be found. Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '0767c13b-4eb8-488f-b385-ec63940e2ed0'} Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0767c13b-4eb8-488f-b385-ec63940e2ed0 could not be found. Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0767c13b-4eb8-488f-b385-ec63940e2ed0 could not be found. Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:45.937975 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:45.946625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:45.946625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:45.946625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:45.946625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:45.946625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:45.946625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:45.946625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0767c13b-4eb8-488f-b385-ec63940e2ed0 could not be found. Sep 08 13:08:45.946625 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:45.956909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5fcaca39-46a8-4c6e-825a-6bea6adcba08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 0767c13b-4eb8-488f-b385-ec63940e2ed0 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:45.959271 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5fcaca39-46a8-4c6e-825a-6bea6adcba08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0767c13b-4eb8-488f-b385-ec63940e2ed0" status: 404 len: 111 microversion: 2.1 time: 0.079993 Sep 08 13:08:45.966858 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2216/4558] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:08:45 2022] DELETE /compute/v2.1/servers/0767c13b-4eb8-488f-b385-ec63940e2ed0 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:08:45.982913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7ab71f13-d465-438b-b627-c65787ba827f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:45.984001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7ab71f13-d465-438b-b627-c65787ba827f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:46.013419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ab71f13-d465-438b-b627-c65787ba827f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:46.015529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ab71f13-d465-438b-b627-c65787ba827f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:46.016006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ab71f13-d465-438b-b627-c65787ba827f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:46.016904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ab71f13-d465-438b-b627-c65787ba827f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:46.018153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ab71f13-d465-438b-b627-c65787ba827f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:46.020924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ab71f13-d465-438b-b627-c65787ba827f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:46.239638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63f03b41-7774-471f-851a-17020efc62fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:46.247473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-63f03b41-7774-471f-851a-17020efc62fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:46.265312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63f03b41-7774-471f-851a-17020efc62fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:46.268322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63f03b41-7774-471f-851a-17020efc62fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:46.268867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63f03b41-7774-471f-851a-17020efc62fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:46.272358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63f03b41-7774-471f-851a-17020efc62fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:46.273174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63f03b41-7774-471f-851a-17020efc62fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:46.276077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63f03b41-7774-471f-851a-17020efc62fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:46.399690 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-63f03b41-7774-471f-851a-17020efc62fb tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171095 Sep 08 13:08:46.413637 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2217/4559] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:08:46 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:46.978183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-305b0275-5a6e-4329-a920-235355e5dc3c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:46.980565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-305b0275-5a6e-4329-a920-235355e5dc3c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:46.984496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ab71f13-d465-438b-b627-c65787ba827f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:47.010218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-305b0275-5a6e-4329-a920-235355e5dc3c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:47.011019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-305b0275-5a6e-4329-a920-235355e5dc3c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:47.011767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-305b0275-5a6e-4329-a920-235355e5dc3c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:47.012998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-305b0275-5a6e-4329-a920-235355e5dc3c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:47.013772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-305b0275-5a6e-4329-a920-235355e5dc3c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:47.014506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-305b0275-5a6e-4329-a920-235355e5dc3c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:47.068720 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7ab71f13-d465-438b-b627-c65787ba827f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.090956 Sep 08 13:08:47.086492 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2343/4560] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:45 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:08:47.118122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4c7c6c2d-29e4-4db3-b638-c692fda62b60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:47.120171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4c7c6c2d-29e4-4db3-b638-c692fda62b60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:47.149229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c7c6c2d-29e4-4db3-b638-c692fda62b60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:47.150241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c7c6c2d-29e4-4db3-b638-c692fda62b60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:47.156368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c7c6c2d-29e4-4db3-b638-c692fda62b60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:47.158978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c7c6c2d-29e4-4db3-b638-c692fda62b60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:47.160241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c7c6c2d-29e4-4db3-b638-c692fda62b60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:47.161366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c7c6c2d-29e4-4db3-b638-c692fda62b60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:47.937024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4c7c6c2d-29e4-4db3-b638-c692fda62b60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:47.968690 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4c7c6c2d-29e4-4db3-b638-c692fda62b60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.862777 Sep 08 13:08:47.974719 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2344/4561] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:47 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:08:47.990767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e68aef53-a892-4fc5-a986-1f5649992264 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:48.000212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e68aef53-a892-4fc5-a986-1f5649992264 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:48.028665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-305b0275-5a6e-4329-a920-235355e5dc3c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:48.054976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e68aef53-a892-4fc5-a986-1f5649992264 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:48.056411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e68aef53-a892-4fc5-a986-1f5649992264 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:48.060659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e68aef53-a892-4fc5-a986-1f5649992264 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:48.061998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e68aef53-a892-4fc5-a986-1f5649992264 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:48.063178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e68aef53-a892-4fc5-a986-1f5649992264 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:48.064802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e68aef53-a892-4fc5-a986-1f5649992264 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:48.071596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-305b0275-5a6e-4329-a920-235355e5dc3c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:48.094082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-305b0275-5a6e-4329-a920-235355e5dc3c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:48.106897 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-305b0275-5a6e-4329-a920-235355e5dc3c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1722 microversion: 2.20 time: 1.137575 Sep 08 13:08:48.112740 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2218/4562] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:46 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1722 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:48.137692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63622e7c-0d69-45a6-a884-11471e26df45 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:48.154396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-63622e7c-0d69-45a6-a884-11471e26df45 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 13:08:48.156513 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-63622e7c-0d69-45a6-a884-11471e26df45 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63622e7c-0d69-45a6-a884-11471e26df45 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 9223372036854775808 could not be found. Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '9223372036854775808'} Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:48.160357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:48.168366 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:48.168366 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:48.168366 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:48.168366 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Sep 08 13:08:48.168366 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:08:48.173749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63622e7c-0d69-45a6-a884-11471e26df45 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:48.178533 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-63622e7c-0d69-45a6-a884-11471e26df45 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.060508 Sep 08 13:08:48.184099 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2219/4563] 10.222.0.78 () {58 vars in 1188 bytes} [Thu Sep 8 13:08:48 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:08:48.217747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f4f4ccf0-f159-4ebf-9d69-f7a4628f8a5f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:48.219142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f4f4ccf0-f159-4ebf-9d69-f7a4628f8a5f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:48.220267 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e68aef53-a892-4fc5-a986-1f5649992264 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.243529 Sep 08 13:08:48.233011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4f4ccf0-f159-4ebf-9d69-f7a4628f8a5f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:48.233940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4f4ccf0-f159-4ebf-9d69-f7a4628f8a5f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:48.234777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4f4ccf0-f159-4ebf-9d69-f7a4628f8a5f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:48.236173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4f4ccf0-f159-4ebf-9d69-f7a4628f8a5f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:48.237647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4f4ccf0-f159-4ebf-9d69-f7a4628f8a5f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:48.238451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4f4ccf0-f159-4ebf-9d69-f7a4628f8a5f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:48.238959 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2345/4564] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:08:47 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments => generated 197 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:49.174696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4946d2d3-fdbd-417a-ae62-dd88d6ab44f6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:49.176721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4946d2d3-fdbd-417a-ae62-dd88d6ab44f6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:49.190302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=44 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:08:49.193833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4946d2d3-fdbd-417a-ae62-dd88d6ab44f6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:49.195436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4946d2d3-fdbd-417a-ae62-dd88d6ab44f6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:49.196729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4946d2d3-fdbd-417a-ae62-dd88d6ab44f6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:49.198764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4946d2d3-fdbd-417a-ae62-dd88d6ab44f6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:49.200087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4946d2d3-fdbd-417a-ae62-dd88d6ab44f6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:49.201467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4946d2d3-fdbd-417a-ae62-dd88d6ab44f6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:50.073423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f4f4ccf0-f159-4ebf-9d69-f7a4628f8a5f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:50.104764 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f4f4ccf0-f159-4ebf-9d69-f7a4628f8a5f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.911198 Sep 08 13:08:50.120128 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2220/4565] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:48 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:50.153427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-967255e4-6218-4e28-a808-1fde1fa7cd6a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:50.159670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-967255e4-6218-4e28-a808-1fde1fa7cd6a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:50.163124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4946d2d3-fdbd-417a-ae62-dd88d6ab44f6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:50.176953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-967255e4-6218-4e28-a808-1fde1fa7cd6a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:50.180196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-967255e4-6218-4e28-a808-1fde1fa7cd6a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:50.181603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-967255e4-6218-4e28-a808-1fde1fa7cd6a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:50.185818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-967255e4-6218-4e28-a808-1fde1fa7cd6a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:50.187369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-967255e4-6218-4e28-a808-1fde1fa7cd6a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:50.188938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-967255e4-6218-4e28-a808-1fde1fa7cd6a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:50.217764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4946d2d3-fdbd-417a-ae62-dd88d6ab44f6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:50.223332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4946d2d3-fdbd-417a-ae62-dd88d6ab44f6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:50.227505 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4946d2d3-fdbd-417a-ae62-dd88d6ab44f6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1722 microversion: 2.20 time: 1.062498 Sep 08 13:08:50.232987 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2346/4566] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:49 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1722 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:50.271113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-739b624a-e922-4af1-b5ce-2ad378f1f04e req-a578bacd-c404-40c6-ad62-7cb732993ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68", "name": "network-vif-unplugged", "status": "completed", "tag": "bab66cd4-e2d1-4c9a-803e-24552207b4f0"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:50.310065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-739b624a-e922-4af1-b5ce-2ad378f1f04e req-a578bacd-c404-40c6-ad62-7cb732993ed2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:50.311930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-739b624a-e922-4af1-b5ce-2ad378f1f04e req-a578bacd-c404-40c6-ad62-7cb732993ed2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:50.313528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-739b624a-e922-4af1-b5ce-2ad378f1f04e req-a578bacd-c404-40c6-ad62-7cb732993ed2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:50.325354 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-967255e4-6218-4e28-a808-1fde1fa7cd6a tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.202474 Sep 08 13:08:50.326467 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2221/4567] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:08:50 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191/os-volume_attachments => generated 25 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:08:50.336661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-32e1c82a-f985-4a89-ada9-4323bd7f4302 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:50.338093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-32e1c82a-f985-4a89-ada9-4323bd7f4302 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:50.351876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32e1c82a-f985-4a89-ada9-4323bd7f4302 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:50.352849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32e1c82a-f985-4a89-ada9-4323bd7f4302 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:50.353779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32e1c82a-f985-4a89-ada9-4323bd7f4302 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:50.355920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32e1c82a-f985-4a89-ada9-4323bd7f4302 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:50.357354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32e1c82a-f985-4a89-ada9-4323bd7f4302 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:50.358050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32e1c82a-f985-4a89-ada9-4323bd7f4302 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:50.366002 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-739b624a-e922-4af1-b5ce-2ad378f1f04e req-a578bacd-c404-40c6-ad62-7cb732993ed2 service nova] Creating event network-vif-unplugged:bab66cd4-e2d1-4c9a-803e-24552207b4f0 for instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 on n-h2-852084-10 Sep 08 13:08:50.408747 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-739b624a-e922-4af1-b5ce-2ad378f1f04e req-a578bacd-c404-40c6-ad62-7cb732993ed2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.170190 Sep 08 13:08:50.413297 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2347/4568] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:08:50.565728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b42700bb-2c22-42a5-8d97-4c3f813cceea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:50.569696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b42700bb-2c22-42a5-8d97-4c3f813cceea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:50.600318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b42700bb-2c22-42a5-8d97-4c3f813cceea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:50.605473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b42700bb-2c22-42a5-8d97-4c3f813cceea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:50.605473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b42700bb-2c22-42a5-8d97-4c3f813cceea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:50.607667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b42700bb-2c22-42a5-8d97-4c3f813cceea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:50.608987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b42700bb-2c22-42a5-8d97-4c3f813cceea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:50.609807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b42700bb-2c22-42a5-8d97-4c3f813cceea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:50.705034 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-b42700bb-2c22-42a5-8d97-4c3f813cceea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] HTTP exception thrown: Cannot 'reboot' instance 74916ce9-4e30-47ff-aa09-b1903b371bcd while it is in vm_state rescued Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b42700bb-2c22-42a5-8d97-4c3f813cceea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Request method failure captured: Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd/action HTTP/1.1 Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 28 Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGegpHo3QYXwAmCN_OctsdmztHN8ts294yLUiw-Ms0Kk7EQY0XfuiDYH7wh8eQztYQYLofweMgdtwuLtrJuTvgGQNr7mGfBgIxtE0szoBUmvKc-BEHBhV8QiE_SJULNZI6czSRqo3YxgC4OeYllmJxk1yJEFxr_qKCUPtZ26YlP53grs Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 0d312121b259412dbf82c519a49285f4 Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: {"reboot": {"type": "HARD"}} Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: exception: Cannot 'reboot' instance 74916ce9-4e30-47ff-aa09-b1903b371bcd while it is in vm_state rescued Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '74916ce9-4e30-47ff-aa09-b1903b371bcd', 'body': {'reboot': {'type': 'HARD'}}} Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74916ce9-4e30-47ff-aa09-b1903b371bcd in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:08:50.716722 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 74916ce9-4e30-47ff-aa09-b1903b371bcd while it is in vm_state rescued Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 74916ce9-4e30-47ff-aa09-b1903b371bcd while it is in vm_state rescued Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b42700bb-2c22-42a5-8d97-4c3f813cceea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Returning 409 to user: Cannot 'reboot' instance 74916ce9-4e30-47ff-aa09-b1903b371bcd while it is in vm_state rescued {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b42700bb-2c22-42a5-8d97-4c3f813cceea tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd/action" status: 409 len: 145 microversion: 2.1 time: 0.177172 Sep 08 13:08:50.733921 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2348/4569] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:08:50 2022] POST /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd/action => generated 145 bytes in 181 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 13:08:50.745217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-de663f24-8fa3-4b87-b3a2-51a87a3db998 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:50.754068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-de663f24-8fa3-4b87-b3a2-51a87a3db998 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:50.780985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de663f24-8fa3-4b87-b3a2-51a87a3db998 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:50.781908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de663f24-8fa3-4b87-b3a2-51a87a3db998 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:50.783568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de663f24-8fa3-4b87-b3a2-51a87a3db998 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:50.784993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de663f24-8fa3-4b87-b3a2-51a87a3db998 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:50.785891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de663f24-8fa3-4b87-b3a2-51a87a3db998 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:50.786710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de663f24-8fa3-4b87-b3a2-51a87a3db998 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:50.857556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:08:50.910091 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-de663f24-8fa3-4b87-b3a2-51a87a3db998 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] HTTP exception thrown: Cannot 'rebuild' instance 74916ce9-4e30-47ff-aa09-b1903b371bcd while it is in vm_state rescued Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-de663f24-8fa3-4b87-b3a2-51a87a3db998 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Request method failure captured: Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd/action HTTP/1.1 Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 65 Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGegpHo3QYXwAmCN_OctsdmztHN8ts294yLUiw-Ms0Kk7EQY0XfuiDYH7wh8eQztYQYLofweMgdtwuLtrJuTvgGQNr7mGfBgIxtE0szoBUmvKc-BEHBhV8QiE_SJULNZI6czSRqo3YxgC4OeYllmJxk1yJEFxr_qKCUPtZ26YlP53grs Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 0d312121b259412dbf82c519a49285f4 Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: exception: Cannot 'rebuild' instance 74916ce9-4e30-47ff-aa09-b1903b371bcd while it is in vm_state rescued Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '74916ce9-4e30-47ff-aa09-b1903b371bcd', 'body': {'rebuild': {'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d'}}} Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74916ce9-4e30-47ff-aa09-b1903b371bcd in vm_state rescued. Cannot rebuild while the instance is in this state. Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:50.913804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 74916ce9-4e30-47ff-aa09-b1903b371bcd while it is in vm_state rescued Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 74916ce9-4e30-47ff-aa09-b1903b371bcd while it is in vm_state rescued Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:50.922775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-de663f24-8fa3-4b87-b3a2-51a87a3db998 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Returning 409 to user: Cannot 'rebuild' instance 74916ce9-4e30-47ff-aa09-b1903b371bcd while it is in vm_state rescued {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:50.925983 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-de663f24-8fa3-4b87-b3a2-51a87a3db998 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "POST /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd/action" status: 409 len: 146 microversion: 2.1 time: 0.194322 Sep 08 13:08:50.927157 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2349/4570] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:08:50 2022] POST /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd/action => generated 146 bytes in 197 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:08:50.948205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b84daba0-fd73-400c-af8a-389cc5fb00a5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:50.952471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b84daba0-fd73-400c-af8a-389cc5fb00a5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:50.976819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b84daba0-fd73-400c-af8a-389cc5fb00a5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:50.981317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b84daba0-fd73-400c-af8a-389cc5fb00a5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:50.992343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b84daba0-fd73-400c-af8a-389cc5fb00a5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:50.993969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b84daba0-fd73-400c-af8a-389cc5fb00a5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:50.994744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b84daba0-fd73-400c-af8a-389cc5fb00a5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:50.995602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b84daba0-fd73-400c-af8a-389cc5fb00a5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:51.099955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b84daba0-fd73-400c-af8a-389cc5fb00a5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:08:51.406913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-32e1c82a-f985-4a89-ada9-4323bd7f4302 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:51.413082 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b84daba0-fd73-400c-af8a-389cc5fb00a5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 204 len: 0 microversion: 2.1 time: 0.476513 Sep 08 13:08:51.418482 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2350/4571] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:08:50 2022] DELETE /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:08:51.450487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1d00aaba-ee50-47a0-aa29-8d6dae82ec7c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:51.456199 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-32e1c82a-f985-4a89-ada9-4323bd7f4302 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.127318 Sep 08 13:08:51.461785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1d00aaba-ee50-47a0-aa29-8d6dae82ec7c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:51.469363 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2222/4572] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:50 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:51.490213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4b98d426-d360-4fba-9725-3323c5e4c56f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:51.502393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d00aaba-ee50-47a0-aa29-8d6dae82ec7c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:51.504338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4b98d426-d360-4fba-9725-3323c5e4c56f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:51.505991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d00aaba-ee50-47a0-aa29-8d6dae82ec7c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:51.513968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d00aaba-ee50-47a0-aa29-8d6dae82ec7c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:51.516075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d00aaba-ee50-47a0-aa29-8d6dae82ec7c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:51.518202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d00aaba-ee50-47a0-aa29-8d6dae82ec7c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:51.523278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d00aaba-ee50-47a0-aa29-8d6dae82ec7c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:51.533478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b98d426-d360-4fba-9725-3323c5e4c56f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:51.536411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b98d426-d360-4fba-9725-3323c5e4c56f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:51.543970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b98d426-d360-4fba-9725-3323c5e4c56f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:51.546266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b98d426-d360-4fba-9725-3323c5e4c56f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:51.547922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b98d426-d360-4fba-9725-3323c5e4c56f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:51.549871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b98d426-d360-4fba-9725-3323c5e4c56f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:52.118117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1d00aaba-ee50-47a0-aa29-8d6dae82ec7c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:52.145527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1d00aaba-ee50-47a0-aa29-8d6dae82ec7c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:52.148454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1d00aaba-ee50-47a0-aa29-8d6dae82ec7c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:52.150275 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1d00aaba-ee50-47a0-aa29-8d6dae82ec7c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1722 microversion: 2.20 time: 0.723422 Sep 08 13:08:52.167786 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2351/4573] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:51 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1722 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:52.169430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8808b757-d31b-49cd-bd57-7993f0c54ac8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:52.170260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8808b757-d31b-49cd-bd57-7993f0c54ac8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Failed to fetch instance by id -1 {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2981}} Sep 08 13:08:52.171184 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-8808b757-d31b-49cd-bd57-7993f0c54ac8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance -1 could not be found. Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8808b757-d31b-49cd-bd57-7993f0c54ac8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance -1 could not be found. Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '-1'} Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:52.173778 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:52.193082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:52.193082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:52.193082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Sep 08 13:08:52.193082 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:52.193082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8808b757-d31b-49cd-bd57-7993f0c54ac8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:52.193082 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8808b757-d31b-49cd-bd57-7993f0c54ac8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.018201 Sep 08 13:08:52.197852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4b98d426-d360-4fba-9725-3323c5e4c56f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:52.200809 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2352/4574] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Sep 8 13:08:52 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:08:52.206321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-748813cd-83ce-4d92-983c-d244f9446f59 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:52.206637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-748813cd-83ce-4d92-983c-d244f9446f59 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:52.219529 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4b98d426-d360-4fba-9725-3323c5e4c56f tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1687 microversion: 2.1 time: 0.746884 Sep 08 13:08:52.220913 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2223/4575] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:51 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1687 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:52.228859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-748813cd-83ce-4d92-983c-d244f9446f59 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:52.230683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-748813cd-83ce-4d92-983c-d244f9446f59 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:52.231806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-748813cd-83ce-4d92-983c-d244f9446f59 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:52.236313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-748813cd-83ce-4d92-983c-d244f9446f59 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:52.239530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-748813cd-83ce-4d92-983c-d244f9446f59 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:52.243081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-748813cd-83ce-4d92-983c-d244f9446f59 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:52.880196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-748813cd-83ce-4d92-983c-d244f9446f59 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:52.901049 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-748813cd-83ce-4d92-983c-d244f9446f59 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.699793 Sep 08 13:08:52.903873 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2353/4576] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:52 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:52.949329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0f0f47aa-9f33-4c36-a141-cec23ee25570 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:52.951963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0f0f47aa-9f33-4c36-a141-cec23ee25570 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:52.966583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f0f47aa-9f33-4c36-a141-cec23ee25570 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:52.967767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f0f47aa-9f33-4c36-a141-cec23ee25570 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:52.969570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f0f47aa-9f33-4c36-a141-cec23ee25570 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:52.971204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f0f47aa-9f33-4c36-a141-cec23ee25570 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:52.972550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f0f47aa-9f33-4c36-a141-cec23ee25570 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:52.973591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f0f47aa-9f33-4c36-a141-cec23ee25570 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:53.230997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d47a100d-91e5-4f79-9073-cbb2791b1d1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:53.234710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d47a100d-91e5-4f79-9073-cbb2791b1d1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:53.265907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47a100d-91e5-4f79-9073-cbb2791b1d1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:53.271831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47a100d-91e5-4f79-9073-cbb2791b1d1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:53.276362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47a100d-91e5-4f79-9073-cbb2791b1d1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:53.278479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47a100d-91e5-4f79-9073-cbb2791b1d1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:53.279903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47a100d-91e5-4f79-9073-cbb2791b1d1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:53.280458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47a100d-91e5-4f79-9073-cbb2791b1d1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:53.654381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0f0f47aa-9f33-4c36-a141-cec23ee25570 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:53.712638 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0f0f47aa-9f33-4c36-a141-cec23ee25570 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.769770 Sep 08 13:08:53.727096 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2224/4577] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:52 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:53.775366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-76e98481-628d-47ec-a8a1-e7a3921eb1d8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:53.781569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-76e98481-628d-47ec-a8a1-e7a3921eb1d8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:53.806198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76e98481-628d-47ec-a8a1-e7a3921eb1d8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:53.810549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76e98481-628d-47ec-a8a1-e7a3921eb1d8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:53.811399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76e98481-628d-47ec-a8a1-e7a3921eb1d8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:53.812787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76e98481-628d-47ec-a8a1-e7a3921eb1d8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:53.813664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76e98481-628d-47ec-a8a1-e7a3921eb1d8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:53.814537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76e98481-628d-47ec-a8a1-e7a3921eb1d8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:54.123003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d47a100d-91e5-4f79-9073-cbb2791b1d1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:54.146092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d47a100d-91e5-4f79-9073-cbb2791b1d1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:54.149657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d47a100d-91e5-4f79-9073-cbb2791b1d1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:54.153917 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d47a100d-91e5-4f79-9073-cbb2791b1d1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1722 microversion: 2.20 time: 0.945701 Sep 08 13:08:54.162393 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2354/4578] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:53 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1722 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:54.175257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-99e0d070-067b-4b88-953b-372f3507f78a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:54.176331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-99e0d070-067b-4b88-953b-372f3507f78a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: bfc8235b-12d0-4c20-9474-18229d598846] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:54.187760 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-99e0d070-067b-4b88-953b-372f3507f78a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance bfc8235b-12d0-4c20-9474-18229d598846 could not be found. Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-99e0d070-067b-4b88-953b-372f3507f78a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/bfc8235b-12d0-4c20-9474-18229d598846/action HTTP/1.1 Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 19 Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: {"forceDelete": {}} Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance bfc8235b-12d0-4c20-9474-18229d598846 could not be found. Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'bfc8235b-12d0-4c20-9474-18229d598846', 'body': {'forceDelete': {}}} Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfc8235b-12d0-4c20-9474-18229d598846 could not be found. Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfc8235b-12d0-4c20-9474-18229d598846 could not be found. Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:54.199034 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:54.206421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:54.206421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:54.206421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfc8235b-12d0-4c20-9474-18229d598846 could not be found. Sep 08 13:08:54.206421 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:54.206421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-99e0d070-067b-4b88-953b-372f3507f78a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance bfc8235b-12d0-4c20-9474-18229d598846 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:54.206421 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-99e0d070-067b-4b88-953b-372f3507f78a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/bfc8235b-12d0-4c20-9474-18229d598846/action" status: 404 len: 111 microversion: 2.1 time: 0.037532 Sep 08 13:08:54.206421 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2355/4579] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:08:54 2022] POST /compute/v2.1/servers/bfc8235b-12d0-4c20-9474-18229d598846/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:08:54.221595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-31318c8c-7157-4803-baa3-a04fca02f829 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:54.222775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-31318c8c-7157-4803-baa3-a04fca02f829 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:54.245958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31318c8c-7157-4803-baa3-a04fca02f829 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:54.246846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31318c8c-7157-4803-baa3-a04fca02f829 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:54.247713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31318c8c-7157-4803-baa3-a04fca02f829 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:54.249079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31318c8c-7157-4803-baa3-a04fca02f829 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:54.250293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31318c8c-7157-4803-baa3-a04fca02f829 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:54.251098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-31318c8c-7157-4803-baa3-a04fca02f829 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:54.256700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-76e98481-628d-47ec-a8a1-e7a3921eb1d8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:54.276010 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-76e98481-628d-47ec-a8a1-e7a3921eb1d8 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1687 microversion: 2.1 time: 0.546125 Sep 08 13:08:54.277229 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2225/4580] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:53 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1687 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:54.495071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-31318c8c-7157-4803-baa3-a04fca02f829 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:54.511492 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-31318c8c-7157-4803-baa3-a04fca02f829 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.300043 Sep 08 13:08:54.512721 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2356/4581] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:54 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:08:54.560306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0d7a9647-f126-4cda-b40c-a3be2428b64d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:54.561459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0d7a9647-f126-4cda-b40c-a3be2428b64d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:54.577648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d7a9647-f126-4cda-b40c-a3be2428b64d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:54.578547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d7a9647-f126-4cda-b40c-a3be2428b64d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:54.579938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d7a9647-f126-4cda-b40c-a3be2428b64d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:54.580740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d7a9647-f126-4cda-b40c-a3be2428b64d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:54.583195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d7a9647-f126-4cda-b40c-a3be2428b64d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:54.584045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d7a9647-f126-4cda-b40c-a3be2428b64d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:54.856968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0d7a9647-f126-4cda-b40c-a3be2428b64d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:54.908965 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0d7a9647-f126-4cda-b40c-a3be2428b64d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.352471 Sep 08 13:08:54.913241 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2226/4582] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:54 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:08:54.965399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cd228a37-20e2-45a3-8080-5ccd3f0e7b9d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:54.970697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cd228a37-20e2-45a3-8080-5ccd3f0e7b9d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: b0b4d627-c849-4f8c-ae04-aae104bcfda4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:54.994803 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-cd228a37-20e2-45a3-8080-5ccd3f0e7b9d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance b0b4d627-c849-4f8c-ae04-aae104bcfda4 could not be found. Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cd228a37-20e2-45a3-8080-5ccd3f0e7b9d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/b0b4d627-c849-4f8c-ae04-aae104bcfda4/action HTTP/1.1 Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 39 Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: {"os-getConsoleOutput": {"length": 10}} Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance b0b4d627-c849-4f8c-ae04-aae104bcfda4 could not be found. Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'b0b4d627-c849-4f8c-ae04-aae104bcfda4', 'body': {'os-getConsoleOutput': {'length': 10}}} Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b4d627-c849-4f8c-ae04-aae104bcfda4 could not be found. Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b4d627-c849-4f8c-ae04-aae104bcfda4 could not be found. Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:55.005471 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:55.014176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:55.014176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:55.014176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:55.014176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:55.014176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b4d627-c849-4f8c-ae04-aae104bcfda4 could not be found. Sep 08 13:08:55.014176 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:55.014176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cd228a37-20e2-45a3-8080-5ccd3f0e7b9d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance b0b4d627-c849-4f8c-ae04-aae104bcfda4 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:55.015301 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cd228a37-20e2-45a3-8080-5ccd3f0e7b9d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/b0b4d627-c849-4f8c-ae04-aae104bcfda4/action" status: 404 len: 111 microversion: 2.1 time: 0.057506 Sep 08 13:08:55.023325 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2357/4583] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:08:54 2022] POST /compute/v2.1/servers/b0b4d627-c849-4f8c-ae04-aae104bcfda4/action => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:08:55.049376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a0dbbeea-4c60-4135-b1d7-5e64a0a55745 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:55.051021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a0dbbeea-4c60-4135-b1d7-5e64a0a55745 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:55.072328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0dbbeea-4c60-4135-b1d7-5e64a0a55745 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:55.073350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0dbbeea-4c60-4135-b1d7-5e64a0a55745 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:55.074423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0dbbeea-4c60-4135-b1d7-5e64a0a55745 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:55.076179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0dbbeea-4c60-4135-b1d7-5e64a0a55745 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:55.077099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0dbbeea-4c60-4135-b1d7-5e64a0a55745 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:55.079749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0dbbeea-4c60-4135-b1d7-5e64a0a55745 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:55.251503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-71fc45b2-efdb-4db2-9f53-d4d05bf063ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:55.254682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-71fc45b2-efdb-4db2-9f53-d4d05bf063ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:55.310545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71fc45b2-efdb-4db2-9f53-d4d05bf063ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:55.312116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71fc45b2-efdb-4db2-9f53-d4d05bf063ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:55.314112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71fc45b2-efdb-4db2-9f53-d4d05bf063ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:55.315500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71fc45b2-efdb-4db2-9f53-d4d05bf063ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:55.316360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71fc45b2-efdb-4db2-9f53-d4d05bf063ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:55.317312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71fc45b2-efdb-4db2-9f53-d4d05bf063ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:56.481390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a0dbbeea-4c60-4135-b1d7-5e64a0a55745 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:56.522219 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a0dbbeea-4c60-4135-b1d7-5e64a0a55745 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.493076 Sep 08 13:08:56.542825 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2227/4584] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:55 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:56.549494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a24b1dcf-91f8-41a8-97ba-56f47c65de3d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:56.550638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a24b1dcf-91f8-41a8-97ba-56f47c65de3d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:56.573789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a24b1dcf-91f8-41a8-97ba-56f47c65de3d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:56.575214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a24b1dcf-91f8-41a8-97ba-56f47c65de3d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:56.576703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a24b1dcf-91f8-41a8-97ba-56f47c65de3d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:56.582035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a24b1dcf-91f8-41a8-97ba-56f47c65de3d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:56.584532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a24b1dcf-91f8-41a8-97ba-56f47c65de3d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:56.585263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a24b1dcf-91f8-41a8-97ba-56f47c65de3d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:57.273398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-71fc45b2-efdb-4db2-9f53-d4d05bf063ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:57.306413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-71fc45b2-efdb-4db2-9f53-d4d05bf063ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:57.309577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-71fc45b2-efdb-4db2-9f53-d4d05bf063ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:57.311821 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-71fc45b2-efdb-4db2-9f53-d4d05bf063ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1725 microversion: 2.20 time: 2.102672 Sep 08 13:08:57.315289 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2358/4585] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:08:55 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1725 bytes in 2108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:08:57.329536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3dc0f4e4-cf0c-4274-b9a6-ebb4ab2181e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:57.331319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3dc0f4e4-cf0c-4274-b9a6-ebb4ab2181e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:57.364869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dc0f4e4-cf0c-4274-b9a6-ebb4ab2181e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:57.368163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dc0f4e4-cf0c-4274-b9a6-ebb4ab2181e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:57.369450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dc0f4e4-cf0c-4274-b9a6-ebb4ab2181e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:57.370567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dc0f4e4-cf0c-4274-b9a6-ebb4ab2181e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:57.372738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dc0f4e4-cf0c-4274-b9a6-ebb4ab2181e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:57.379311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3dc0f4e4-cf0c-4274-b9a6-ebb4ab2181e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:58.050327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a24b1dcf-91f8-41a8-97ba-56f47c65de3d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:58.079179 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a24b1dcf-91f8-41a8-97ba-56f47c65de3d tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1687 microversion: 2.1 time: 1.546290 Sep 08 13:08:58.079878 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2228/4586] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:56 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1687 bytes in 1548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:58.100798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1e44089f-6c3f-4646-afb3-287cf19ba392 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd96fe58-e4ea-4dc7-a1b8-2fe44057dad3"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:58.116484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1e44089f-6c3f-4646-afb3-287cf19ba392 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:58.142719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e44089f-6c3f-4646-afb3-287cf19ba392 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:58.143694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e44089f-6c3f-4646-afb3-287cf19ba392 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:58.144705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e44089f-6c3f-4646-afb3-287cf19ba392 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:58.146260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e44089f-6c3f-4646-afb3-287cf19ba392 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:58.163170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e44089f-6c3f-4646-afb3-287cf19ba392 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:58.164491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e44089f-6c3f-4646-afb3-287cf19ba392 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:58.178880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:08:58.625109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3dc0f4e4-cf0c-4274-b9a6-ebb4ab2181e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:58.640555 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3dc0f4e4-cf0c-4274-b9a6-ebb4ab2181e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.323600 Sep 08 13:08:58.641162 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2359/4587] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:57 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:58.672183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75f76f67-8daf-4a4d-8709-86d45b7d5ba6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:58.672920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-75f76f67-8daf-4a4d-8709-86d45b7d5ba6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 7638bcd4-e3b6-4115-83e0-632ef287f8b8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:58.694488 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-75f76f67-8daf-4a4d-8709-86d45b7d5ba6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 7638bcd4-e3b6-4115-83e0-632ef287f8b8 could not be found. Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75f76f67-8daf-4a4d-8709-86d45b7d5ba6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/7638bcd4-e3b6-4115-83e0-632ef287f8b8 HTTP/1.1 Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 7638bcd4-e3b6-4115-83e0-632ef287f8b8 could not be found. Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '7638bcd4-e3b6-4115-83e0-632ef287f8b8'} Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7638bcd4-e3b6-4115-83e0-632ef287f8b8 could not be found. Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7638bcd4-e3b6-4115-83e0-632ef287f8b8 could not be found. Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:08:58.713873 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:08:58.728908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:08:58.728908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:08:58.728908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:08:58.728908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7638bcd4-e3b6-4115-83e0-632ef287f8b8 could not be found. Sep 08 13:08:58.728908 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:08:58.728908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75f76f67-8daf-4a4d-8709-86d45b7d5ba6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 7638bcd4-e3b6-4115-83e0-632ef287f8b8 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:08:58.728908 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-75f76f67-8daf-4a4d-8709-86d45b7d5ba6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/7638bcd4-e3b6-4115-83e0-632ef287f8b8" status: 404 len: 111 microversion: 2.1 time: 0.049599 Sep 08 13:08:58.728908 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2360/4588] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:58 2022] GET /compute/v2.1/servers/7638bcd4-e3b6-4115-83e0-632ef287f8b8 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:08:58.756927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a245c45f-31a1-440a-96d4-8ddba77e489c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:58.758863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a245c45f-31a1-440a-96d4-8ddba77e489c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:58.827658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a245c45f-31a1-440a-96d4-8ddba77e489c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:58.829278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a245c45f-31a1-440a-96d4-8ddba77e489c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:58.831951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a245c45f-31a1-440a-96d4-8ddba77e489c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:58.834827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a245c45f-31a1-440a-96d4-8ddba77e489c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:58.837192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a245c45f-31a1-440a-96d4-8ddba77e489c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:58.839641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a245c45f-31a1-440a-96d4-8ddba77e489c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:59.066011 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1e44089f-6c3f-4646-afb3-287cf19ba392 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "POST /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.982547 Sep 08 13:08:59.085047 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2229/4589] 10.222.0.78 () {62 vars in 1364 bytes} [Thu Sep 8 13:08:58 2022] POST /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 188 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:08:59.135612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1cb5ff7f-4fa0-46f6-b753-1a339eca997c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:59.135612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1cb5ff7f-4fa0-46f6-b753-1a339eca997c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:59.156199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cb5ff7f-4fa0-46f6-b753-1a339eca997c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:59.157303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cb5ff7f-4fa0-46f6-b753-1a339eca997c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:59.159317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cb5ff7f-4fa0-46f6-b753-1a339eca997c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:59.160640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cb5ff7f-4fa0-46f6-b753-1a339eca997c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:59.161468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cb5ff7f-4fa0-46f6-b753-1a339eca997c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:59.162228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cb5ff7f-4fa0-46f6-b753-1a339eca997c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:59.500395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1cb5ff7f-4fa0-46f6-b753-1a339eca997c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:59.523066 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1cb5ff7f-4fa0-46f6-b753-1a339eca997c tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1621 microversion: 2.1 time: 0.396205 Sep 08 13:08:59.545707 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2230/4590] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:59 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1621 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:59.566624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-02316134-7277-483a-8d97-8d8e3acd8239 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:08:59.568459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-02316134-7277-483a-8d97-8d8e3acd8239 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:59.580555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02316134-7277-483a-8d97-8d8e3acd8239 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:59.581939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02316134-7277-483a-8d97-8d8e3acd8239 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:59.583081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02316134-7277-483a-8d97-8d8e3acd8239 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:59.584803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02316134-7277-483a-8d97-8d8e3acd8239 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:59.586021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02316134-7277-483a-8d97-8d8e3acd8239 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:59.587145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02316134-7277-483a-8d97-8d8e3acd8239 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:59.757942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-02316134-7277-483a-8d97-8d8e3acd8239 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128971) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 13:08:59.813334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a245c45f-31a1-440a-96d4-8ddba77e489c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:08:59.841417 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a245c45f-31a1-440a-96d4-8ddba77e489c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.102986 Sep 08 13:08:59.852115 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2361/4591] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:58 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:08:59.910162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee1e778f-36fb-4d6f-9e9e-1919e628b111 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:08:59.911841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ee1e778f-36fb-4d6f-9e9e-1919e628b111 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:08:59.941072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee1e778f-36fb-4d6f-9e9e-1919e628b111 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:59.956817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee1e778f-36fb-4d6f-9e9e-1919e628b111 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:59.959205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee1e778f-36fb-4d6f-9e9e-1919e628b111 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:08:59.981768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee1e778f-36fb-4d6f-9e9e-1919e628b111 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:08:59.984518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee1e778f-36fb-4d6f-9e9e-1919e628b111 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:08:59.985242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee1e778f-36fb-4d6f-9e9e-1919e628b111 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:00.083149 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-02316134-7277-483a-8d97-8d8e3acd8239 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "POST /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/action" status: 202 len: 0 microversion: 2.20 time: 0.535034 Sep 08 13:09:00.086226 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2231/4592] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 13:08:59 2022] POST /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:09:00.112667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-acd043a2-1a73-4397-afe9-c7b23649e8f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:00.113991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-acd043a2-1a73-4397-afe9-c7b23649e8f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:00.149242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acd043a2-1a73-4397-afe9-c7b23649e8f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:00.159634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acd043a2-1a73-4397-afe9-c7b23649e8f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:00.160624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acd043a2-1a73-4397-afe9-c7b23649e8f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:00.161978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acd043a2-1a73-4397-afe9-c7b23649e8f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:00.168784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acd043a2-1a73-4397-afe9-c7b23649e8f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:00.169568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acd043a2-1a73-4397-afe9-c7b23649e8f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:01.246448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ee1e778f-36fb-4d6f-9e9e-1919e628b111 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:01.281221 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee1e778f-36fb-4d6f-9e9e-1919e628b111 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.389605 Sep 08 13:09:01.287030 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2362/4593] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:08:59 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:01.358225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:01.359608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:01.416649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:01.424362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:01.425402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:01.443652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-acd043a2-1a73-4397-afe9-c7b23649e8f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:01.445966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:01.451822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:01.456409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:01.474310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-acd043a2-1a73-4397-afe9-c7b23649e8f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:01.477770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-acd043a2-1a73-4397-afe9-c7b23649e8f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:01.484272 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-acd043a2-1a73-4397-afe9-c7b23649e8f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1751 microversion: 2.20 time: 1.390969 Sep 08 13:09:01.490793 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2232/4594] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:00 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1751 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:09:01.510042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-20553bb0-fdd7-4638-9580-292a742f70d5 req-b85a5605-3971-4221-9f56-dfe26a17ecdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfec9e61-54e7-4949-a6f6-d18640db5191", "name": "network-vif-deleted", "tag": "ba217dba-14ca-486d-8bc1-9f1f6fae3f90"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:01.566097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-20553bb0-fdd7-4638-9580-292a742f70d5 req-b85a5605-3971-4221-9f56-dfe26a17ecdb service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:01.570332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-20553bb0-fdd7-4638-9580-292a742f70d5 req-b85a5605-3971-4221-9f56-dfe26a17ecdb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:01.577287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-20553bb0-fdd7-4638-9580-292a742f70d5 req-b85a5605-3971-4221-9f56-dfe26a17ecdb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:01.658762 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-20553bb0-fdd7-4638-9580-292a742f70d5 req-b85a5605-3971-4221-9f56-dfe26a17ecdb service nova] Creating event network-vif-deleted:ba217dba-14ca-486d-8bc1-9f1f6fae3f90 for instance bfec9e61-54e7-4949-a6f6-d18640db5191 on n-h2-852084-10 Sep 08 13:09:01.711710 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-20553bb0-fdd7-4638-9580-292a742f70d5 req-b85a5605-3971-4221-9f56-dfe26a17ecdb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.213966 Sep 08 13:09:01.721536 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2233/4595] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:09:01.731117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:01.732049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:01.733746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:01.738814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lazy-loading 'fault' on Instance uuid bfec9e61-54e7-4949-a6f6-d18640db5191 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:09:01.920477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:01.963002 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-52e14ab4-20b9-42ce-806b-434a0003c823 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 200 len: 1334 microversion: 2.1 time: 0.673867 Sep 08 13:09:01.966761 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2363/4596] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:01 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 1334 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:02.215617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-79cfbbf9-842a-4418-8738-31103298a932 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-788491316", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-79cfbbf9-842a-4418-8738-31103298a932 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 237 Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-788491316", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-788491316', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '6cf9ac04-bf1b-4fd3-befb-5346c4907700'}]}}} Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:02.251992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Sep 08 13:09:02.264277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:02.274646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-79cfbbf9-842a-4418-8738-31103298a932 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:02.274646 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-79cfbbf9-842a-4418-8738-31103298a932 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.070535 Sep 08 13:09:02.282540 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2234/4597] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:09:02 2022] POST /compute/v2.1/servers => generated 139 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:09:02.306540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-17fb51a2-6e2a-494d-8a9f-c74ced460a43 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:02.312363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-17fb51a2-6e2a-494d-8a9f-c74ced460a43 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:02.332548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fb51a2-6e2a-494d-8a9f-c74ced460a43 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:02.344578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fb51a2-6e2a-494d-8a9f-c74ced460a43 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:02.345856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fb51a2-6e2a-494d-8a9f-c74ced460a43 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:02.349105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fb51a2-6e2a-494d-8a9f-c74ced460a43 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:02.350654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fb51a2-6e2a-494d-8a9f-c74ced460a43 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:02.352089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fb51a2-6e2a-494d-8a9f-c74ced460a43 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:02.547089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-77d2da0c-b67c-4d0b-ad08-ffb861f3f619 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:02.552407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-77d2da0c-b67c-4d0b-ad08-ffb861f3f619 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:02.583640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77d2da0c-b67c-4d0b-ad08-ffb861f3f619 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:02.584826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77d2da0c-b67c-4d0b-ad08-ffb861f3f619 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:02.585522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77d2da0c-b67c-4d0b-ad08-ffb861f3f619 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:02.588932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77d2da0c-b67c-4d0b-ad08-ffb861f3f619 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:02.592392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77d2da0c-b67c-4d0b-ad08-ffb861f3f619 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:02.597857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77d2da0c-b67c-4d0b-ad08-ffb861f3f619 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:03.085952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-17fb51a2-6e2a-494d-8a9f-c74ced460a43 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:03.110932 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-17fb51a2-6e2a-494d-8a9f-c74ced460a43 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.826342 Sep 08 13:09:03.127768 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2364/4598] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:02 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:03.137640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1954a3a0-c1ef-403a-98ae-8a2475b8b8d5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:03.139472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1954a3a0-c1ef-403a-98ae-8a2475b8b8d5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: bfec9e61-54e7-4949-a6f6-d18640db5191] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:03.166207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1954a3a0-c1ef-403a-98ae-8a2475b8b8d5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:03.180539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1954a3a0-c1ef-403a-98ae-8a2475b8b8d5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:03.182401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1954a3a0-c1ef-403a-98ae-8a2475b8b8d5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:03.184198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1954a3a0-c1ef-403a-98ae-8a2475b8b8d5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:03.185415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1954a3a0-c1ef-403a-98ae-8a2475b8b8d5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:03.186486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1954a3a0-c1ef-403a-98ae-8a2475b8b8d5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:03.252094 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-1954a3a0-c1ef-403a-98ae-8a2475b8b8d5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] HTTP exception thrown: Instance bfec9e61-54e7-4949-a6f6-d18640db5191 could not be found. Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1954a3a0-c1ef-403a-98ae-8a2475b8b8d5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Request method failure captured: Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 HTTP/1.1 Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGegpHo3QYXwAmCN_OctsdmztHN8ts294yLUiw-Ms0Kk7EQY0XfuiDYH7wh8eQztYQYLofweMgdtwuLtrJuTvgGQNr7mGfBgIxtE0szoBUmvKc-BEHBhV8QiE_SJULNZI6czSRqo3YxgC4OeYllmJxk1yJEFxr_qKCUPtZ26YlP53grs Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 0d312121b259412dbf82c519a49285f4 Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance bfec9e61-54e7-4949-a6f6-d18640db5191 could not be found. Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'bfec9e61-54e7-4949-a6f6-d18640db5191'} Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfec9e61-54e7-4949-a6f6-d18640db5191 could not be found. Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfec9e61-54e7-4949-a6f6-d18640db5191 could not be found. Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:03.272255 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:03.281569 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:03.281569 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:03.281569 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:03.281569 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:03.281569 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:03.281569 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:03.281569 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfec9e61-54e7-4949-a6f6-d18640db5191 could not be found. Sep 08 13:09:03.281569 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:03.287260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1954a3a0-c1ef-403a-98ae-8a2475b8b8d5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Returning 404 to user: Instance bfec9e61-54e7-4949-a6f6-d18640db5191 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:03.287260 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1954a3a0-c1ef-403a-98ae-8a2475b8b8d5 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191" status: 404 len: 111 microversion: 2.1 time: 0.156928 Sep 08 13:09:03.288828 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2365/4599] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:03 2022] GET /compute/v2.1/servers/bfec9e61-54e7-4949-a6f6-d18640db5191 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:09:03.298392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4c8ad733-4c3b-4b62-b98f-4d0873f25eb0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:03.312801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4c8ad733-4c3b-4b62-b98f-4d0873f25eb0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:03.334167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c8ad733-4c3b-4b62-b98f-4d0873f25eb0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:03.335494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c8ad733-4c3b-4b62-b98f-4d0873f25eb0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:03.336575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c8ad733-4c3b-4b62-b98f-4d0873f25eb0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:03.338261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c8ad733-4c3b-4b62-b98f-4d0873f25eb0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:03.339459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c8ad733-4c3b-4b62-b98f-4d0873f25eb0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:03.340570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c8ad733-4c3b-4b62-b98f-4d0873f25eb0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:03.771516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-77d2da0c-b67c-4d0b-ad08-ffb861f3f619 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:03.833204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-77d2da0c-b67c-4d0b-ad08-ffb861f3f619 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:03.836874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-77d2da0c-b67c-4d0b-ad08-ffb861f3f619 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:03.848497 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-77d2da0c-b67c-4d0b-ad08-ffb861f3f619 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1751 microversion: 2.20 time: 1.307826 Sep 08 13:09:03.852852 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2235/4600] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:02 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1751 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:09:03.887169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-76a066e2-3efb-46ee-b48b-a2c96218526e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '.version_select at 0x7fdb39f7b430>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:03.953407 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-76a066e2-3efb-46ee-b48b-a2c96218526e tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-742012241" status: 202 len: 0 microversion: 2.1 time: 0.097079 Sep 08 13:09:03.958223 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2236/4601] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 13:09:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-742012241 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:09:04.200474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4c8ad733-4c3b-4b62-b98f-4d0873f25eb0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:04.255438 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4c8ad733-4c3b-4b62-b98f-4d0873f25eb0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.964071 Sep 08 13:09:04.261425 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2366/4602] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:03 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:04.907917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-91fafde8-16b3-4a44-93ea-3e58cd74460b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:04.920936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-91fafde8-16b3-4a44-93ea-3e58cd74460b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:04.967786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91fafde8-16b3-4a44-93ea-3e58cd74460b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:04.969248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91fafde8-16b3-4a44-93ea-3e58cd74460b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:04.973086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91fafde8-16b3-4a44-93ea-3e58cd74460b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:04.987872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91fafde8-16b3-4a44-93ea-3e58cd74460b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:04.989445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91fafde8-16b3-4a44-93ea-3e58cd74460b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:04.995390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-91fafde8-16b3-4a44-93ea-3e58cd74460b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:05.413915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-303a294d-351c-46c8-9dfa-28b7bc086168 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-449896562", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-303a294d-351c-46c8-9dfa-28b7bc086168 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 234 Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-449896562", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-449896562', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '6cf9ac04-bf1b-4fd3-befb-5346c4907700'}]}}} Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = func(instance) Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi 'notvalid' Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:05.468690 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:05.480063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-303a294d-351c-46c8-9dfa-28b7bc086168 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:05.486719 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-303a294d-351c-46c8-9dfa-28b7bc086168 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.074117 Sep 08 13:09:05.499300 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2367/4603] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:09:05 2022] POST /compute/v2.1/servers => generated 133 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:09:05.522594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a8646270-2958-4bf2-9d3d-4723fe7d66ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:05.536017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a8646270-2958-4bf2-9d3d-4723fe7d66ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:05.616520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8646270-2958-4bf2-9d3d-4723fe7d66ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:05.620130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8646270-2958-4bf2-9d3d-4723fe7d66ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:05.623777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8646270-2958-4bf2-9d3d-4723fe7d66ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:05.625701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8646270-2958-4bf2-9d3d-4723fe7d66ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:05.632267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8646270-2958-4bf2-9d3d-4723fe7d66ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:05.637100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8646270-2958-4bf2-9d3d-4723fe7d66ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:06.241425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-91fafde8-16b3-4a44-93ea-3e58cd74460b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:06.264676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-91fafde8-16b3-4a44-93ea-3e58cd74460b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:06.266642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-91fafde8-16b3-4a44-93ea-3e58cd74460b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:06.268866 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-91fafde8-16b3-4a44-93ea-3e58cd74460b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1751 microversion: 2.20 time: 1.370669 Sep 08 13:09:06.275610 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2237/4604] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:04 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1751 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:06.734752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a8646270-2958-4bf2-9d3d-4723fe7d66ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:06.773494 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a8646270-2958-4bf2-9d3d-4723fe7d66ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.264204 Sep 08 13:09:06.776297 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2368/4605] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:05 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:06.821923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3c802ef8-8d2f-43bd-aec3-9e7ddb55dde5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:06.823120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3c802ef8-8d2f-43bd-aec3-9e7ddb55dde5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:06.865129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c802ef8-8d2f-43bd-aec3-9e7ddb55dde5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:06.865990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c802ef8-8d2f-43bd-aec3-9e7ddb55dde5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:06.866767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c802ef8-8d2f-43bd-aec3-9e7ddb55dde5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:06.887004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c802ef8-8d2f-43bd-aec3-9e7ddb55dde5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:06.887935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c802ef8-8d2f-43bd-aec3-9e7ddb55dde5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:06.888710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c802ef8-8d2f-43bd-aec3-9e7ddb55dde5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:07.425742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-441c447b-c7bb-424c-991c-148b7c0da828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:07.443413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-441c447b-c7bb-424c-991c-148b7c0da828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:07.512579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c447b-c7bb-424c-991c-148b7c0da828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:07.524935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c447b-c7bb-424c-991c-148b7c0da828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:07.526017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c447b-c7bb-424c-991c-148b7c0da828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:07.536023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c447b-c7bb-424c-991c-148b7c0da828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:07.536898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c447b-c7bb-424c-991c-148b7c0da828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:07.537682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c447b-c7bb-424c-991c-148b7c0da828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:07.566289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3c802ef8-8d2f-43bd-aec3-9e7ddb55dde5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:07.584648 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3c802ef8-8d2f-43bd-aec3-9e7ddb55dde5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.769626 Sep 08 13:09:07.588540 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2238/4606] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:06 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:07.644094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b08eab32-0b3a-4367-8740-297d8f194251 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:07.649974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b08eab32-0b3a-4367-8740-297d8f194251 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 38798b4a-2c55-4bba-9fce-ee879305d88f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:07.689313 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-b08eab32-0b3a-4367-8740-297d8f194251 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 38798b4a-2c55-4bba-9fce-ee879305d88f could not be found. Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b08eab32-0b3a-4367-8740-297d8f194251 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/38798b4a-2c55-4bba-9fce-ee879305d88f/action HTTP/1.1 Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 13 Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: {"pause": {}} Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 38798b4a-2c55-4bba-9fce-ee879305d88f could not be found. Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '38798b4a-2c55-4bba-9fce-ee879305d88f', 'body': {'pause': {}}} Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38798b4a-2c55-4bba-9fce-ee879305d88f could not be found. Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38798b4a-2c55-4bba-9fce-ee879305d88f could not be found. Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:07.730749 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:07.743663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:07.743663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:07.743663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38798b4a-2c55-4bba-9fce-ee879305d88f could not be found. Sep 08 13:09:07.743663 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:07.748051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b08eab32-0b3a-4367-8740-297d8f194251 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 38798b4a-2c55-4bba-9fce-ee879305d88f could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:07.762384 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b08eab32-0b3a-4367-8740-297d8f194251 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/38798b4a-2c55-4bba-9fce-ee879305d88f/action" status: 404 len: 111 microversion: 2.1 time: 0.129653 Sep 08 13:09:07.766395 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2239/4607] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:07 2022] POST /compute/v2.1/servers/38798b4a-2c55-4bba-9fce-ee879305d88f/action => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:09:07.809104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-70ba97d8-af77-48a1-b488-3de18ae09ac5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:07.819065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-70ba97d8-af77-48a1-b488-3de18ae09ac5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:07.852335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70ba97d8-af77-48a1-b488-3de18ae09ac5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:07.854081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70ba97d8-af77-48a1-b488-3de18ae09ac5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:07.855656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70ba97d8-af77-48a1-b488-3de18ae09ac5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:07.858378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70ba97d8-af77-48a1-b488-3de18ae09ac5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:07.859914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70ba97d8-af77-48a1-b488-3de18ae09ac5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:07.861111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70ba97d8-af77-48a1-b488-3de18ae09ac5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:09.356542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-70ba97d8-af77-48a1-b488-3de18ae09ac5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:09.395110 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-70ba97d8-af77-48a1-b488-3de18ae09ac5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.618694 Sep 08 13:09:09.399722 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2240/4608] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:07 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:09.453076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4a1e416e-dac8-4881-8e9d-6a0469966655 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:09.454399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4a1e416e-dac8-4881-8e9d-6a0469966655 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:09.484551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a1e416e-dac8-4881-8e9d-6a0469966655 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:09.487778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a1e416e-dac8-4881-8e9d-6a0469966655 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:09.492355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a1e416e-dac8-4881-8e9d-6a0469966655 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:09.495043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a1e416e-dac8-4881-8e9d-6a0469966655 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:09.497715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a1e416e-dac8-4881-8e9d-6a0469966655 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:09.498931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a1e416e-dac8-4881-8e9d-6a0469966655 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:09.623267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-441c447b-c7bb-424c-991c-148b7c0da828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:09.658517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-441c447b-c7bb-424c-991c-148b7c0da828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:09.666686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-441c447b-c7bb-424c-991c-148b7c0da828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:09.673634 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-441c447b-c7bb-424c-991c-148b7c0da828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1753 microversion: 2.20 time: 2.348898 Sep 08 13:09:09.674988 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2369/4609] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:07 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1753 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:09:10.621250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4a1e416e-dac8-4881-8e9d-6a0469966655 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:10.659437 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4a1e416e-dac8-4881-8e9d-6a0469966655 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.213819 Sep 08 13:09:10.663410 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2241/4610] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:09 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:09:10.733158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28a6c2ac-6fec-4957-a7f8-0792b6f9b61f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:10.734064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-28a6c2ac-6fec-4957-a7f8-0792b6f9b61f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:10.752656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-159a7203-54f9-4124-a093-4043b9e4129d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:10.760231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-159a7203-54f9-4124-a093-4043b9e4129d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:10.770697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:09:10.838112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28a6c2ac-6fec-4957-a7f8-0792b6f9b61f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:10.843486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-159a7203-54f9-4124-a093-4043b9e4129d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:10.844035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28a6c2ac-6fec-4957-a7f8-0792b6f9b61f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:10.846506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28a6c2ac-6fec-4957-a7f8-0792b6f9b61f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:10.854784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-159a7203-54f9-4124-a093-4043b9e4129d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:10.856722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28a6c2ac-6fec-4957-a7f8-0792b6f9b61f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:10.861622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-159a7203-54f9-4124-a093-4043b9e4129d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:10.862773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28a6c2ac-6fec-4957-a7f8-0792b6f9b61f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:10.865315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-159a7203-54f9-4124-a093-4043b9e4129d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:10.866311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28a6c2ac-6fec-4957-a7f8-0792b6f9b61f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:10.867415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-159a7203-54f9-4124-a093-4043b9e4129d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:10.875219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-159a7203-54f9-4124-a093-4043b9e4129d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:10.892522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:09:11.451973 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-28a6c2ac-6fec-4957-a7f8-0792b6f9b61f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 202 len: 0 microversion: 2.1 time: 0.724887 Sep 08 13:09:11.478067 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2370/4611] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:10 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 0 bytes in 754 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:09:11.509458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3e4ba2f-0b61-424a-84c9-453f35499a0f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:11.537534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e3e4ba2f-0b61-424a-84c9-453f35499a0f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:11.579808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3e4ba2f-0b61-424a-84c9-453f35499a0f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:11.580852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3e4ba2f-0b61-424a-84c9-453f35499a0f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:11.584639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3e4ba2f-0b61-424a-84c9-453f35499a0f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:11.586035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3e4ba2f-0b61-424a-84c9-453f35499a0f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:11.586837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3e4ba2f-0b61-424a-84c9-453f35499a0f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:11.587928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3e4ba2f-0b61-424a-84c9-453f35499a0f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:12.379184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-159a7203-54f9-4124-a093-4043b9e4129d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:12.431189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-159a7203-54f9-4124-a093-4043b9e4129d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:12.445831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-159a7203-54f9-4124-a093-4043b9e4129d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:12.466332 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-159a7203-54f9-4124-a093-4043b9e4129d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1753 microversion: 2.20 time: 1.728675 Sep 08 13:09:12.479102 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2242/4612] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:10 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1753 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:12.537026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e3e4ba2f-0b61-424a-84c9-453f35499a0f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:12.588734 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e3e4ba2f-0b61-424a-84c9-453f35499a0f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1511 microversion: 2.1 time: 1.084111 Sep 08 13:09:12.599570 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2371/4613] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:11 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1511 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:09:13.517999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ed3458b5-4612-46d3-ada3-5d9d43eac6a5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:13.519026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ed3458b5-4612-46d3-ada3-5d9d43eac6a5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:13.541977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed3458b5-4612-46d3-ada3-5d9d43eac6a5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:13.542552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed3458b5-4612-46d3-ada3-5d9d43eac6a5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:13.543008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed3458b5-4612-46d3-ada3-5d9d43eac6a5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:13.543790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed3458b5-4612-46d3-ada3-5d9d43eac6a5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:13.544270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed3458b5-4612-46d3-ada3-5d9d43eac6a5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:13.544712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed3458b5-4612-46d3-ada3-5d9d43eac6a5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:13.650180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8479c40e-8035-417a-9848-c10aee20ebe8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:13.651276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8479c40e-8035-417a-9848-c10aee20ebe8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:13.702014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8479c40e-8035-417a-9848-c10aee20ebe8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:13.702605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8479c40e-8035-417a-9848-c10aee20ebe8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:13.703192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8479c40e-8035-417a-9848-c10aee20ebe8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:13.712342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8479c40e-8035-417a-9848-c10aee20ebe8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:13.712853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8479c40e-8035-417a-9848-c10aee20ebe8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:13.713372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8479c40e-8035-417a-9848-c10aee20ebe8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:14.619088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ed3458b5-4612-46d3-ada3-5d9d43eac6a5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:14.679342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ed3458b5-4612-46d3-ada3-5d9d43eac6a5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:14.690508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ed3458b5-4612-46d3-ada3-5d9d43eac6a5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:14.707361 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ed3458b5-4612-46d3-ada3-5d9d43eac6a5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1753 microversion: 2.20 time: 1.183122 Sep 08 13:09:14.709312 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2243/4614] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:13 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1753 bytes in 1199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:09:15.207525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8479c40e-8035-417a-9848-c10aee20ebe8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:15.253603 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8479c40e-8035-417a-9848-c10aee20ebe8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1491 microversion: 2.1 time: 1.604004 Sep 08 13:09:15.259588 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2372/4615] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:13 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1491 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:09:15.308477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2211e0b3-33f9-4ba1-98ae-7bc95712ad49 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:15.309291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2211e0b3-33f9-4ba1-98ae-7bc95712ad49 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:15.331043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2211e0b3-33f9-4ba1-98ae-7bc95712ad49 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:15.335218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2211e0b3-33f9-4ba1-98ae-7bc95712ad49 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:15.338078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2211e0b3-33f9-4ba1-98ae-7bc95712ad49 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:15.344386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2211e0b3-33f9-4ba1-98ae-7bc95712ad49 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:15.347822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2211e0b3-33f9-4ba1-98ae-7bc95712ad49 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:15.348411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2211e0b3-33f9-4ba1-98ae-7bc95712ad49 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:15.462364 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-2211e0b3-33f9-4ba1-98ae-7bc95712ad49 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Cannot 'pause' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state paused Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2211e0b3-33f9-4ba1-98ae-7bc95712ad49 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action HTTP/1.1 Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 13 Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: {"pause": {}} Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: exception: Cannot 'pause' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state paused Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '4eb421d7-2415-43d2-a6bb-3fdbca098091', 'body': {'pause': {}}} Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 in vm_state paused. Cannot pause while the instance is in this state. Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state paused Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:15.472166 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:15.480724 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:15.480724 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:15.480724 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:15.480724 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state paused Sep 08 13:09:15.480724 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:15.483747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2211e0b3-33f9-4ba1-98ae-7bc95712ad49 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 409 to user: Cannot 'pause' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state paused {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:15.500294 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2211e0b3-33f9-4ba1-98ae-7bc95712ad49 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 409 len: 143 microversion: 2.1 time: 0.204804 Sep 08 13:09:15.504153 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2244/4616] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:15 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 143 bytes in 210 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 13:09:15.519137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8d7a9f05-fcbc-416d-a0c4-fe1577b03c70 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:15.520661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8d7a9f05-fcbc-416d-a0c4-fe1577b03c70 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:15.559944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d7a9f05-fcbc-416d-a0c4-fe1577b03c70 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:15.569673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d7a9f05-fcbc-416d-a0c4-fe1577b03c70 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:15.572043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d7a9f05-fcbc-416d-a0c4-fe1577b03c70 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:15.576377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d7a9f05-fcbc-416d-a0c4-fe1577b03c70 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:15.581848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d7a9f05-fcbc-416d-a0c4-fe1577b03c70 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:15.583426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d7a9f05-fcbc-416d-a0c4-fe1577b03c70 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:15.767932 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8d7a9f05-fcbc-416d-a0c4-fe1577b03c70 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 202 len: 0 microversion: 2.1 time: 0.256381 Sep 08 13:09:15.773199 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2373/4617] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:15 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:09:15.775485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2c2d1110-1e12-4a44-889b-d5dc1679b29b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:15.783475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2c2d1110-1e12-4a44-889b-d5dc1679b29b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:15.790045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-654eee0b-df6d-4848-8077-dfe27a4087e4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:15.794575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-654eee0b-df6d-4848-8077-dfe27a4087e4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:15.821605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-654eee0b-df6d-4848-8077-dfe27a4087e4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:15.822816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c2d1110-1e12-4a44-889b-d5dc1679b29b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:15.823743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-654eee0b-df6d-4848-8077-dfe27a4087e4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:15.825684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c2d1110-1e12-4a44-889b-d5dc1679b29b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:15.830463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c2d1110-1e12-4a44-889b-d5dc1679b29b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:15.831496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-654eee0b-df6d-4848-8077-dfe27a4087e4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:15.835508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c2d1110-1e12-4a44-889b-d5dc1679b29b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:15.838024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-654eee0b-df6d-4848-8077-dfe27a4087e4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:15.840144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c2d1110-1e12-4a44-889b-d5dc1679b29b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:15.840996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-654eee0b-df6d-4848-8077-dfe27a4087e4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:15.845394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c2d1110-1e12-4a44-889b-d5dc1679b29b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:15.854901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-654eee0b-df6d-4848-8077-dfe27a4087e4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:18.031561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c2d1110-1e12-4a44-889b-d5dc1679b29b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:18.081224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c2d1110-1e12-4a44-889b-d5dc1679b29b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:18.086884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-654eee0b-df6d-4848-8077-dfe27a4087e4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:18.107065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c2d1110-1e12-4a44-889b-d5dc1679b29b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:18.109711 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2c2d1110-1e12-4a44-889b-d5dc1679b29b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1753 microversion: 2.20 time: 2.352821 Sep 08 13:09:18.110759 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2245/4618] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:15 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1753 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:18.135669 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-654eee0b-df6d-4848-8077-dfe27a4087e4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1498 microversion: 2.1 time: 2.360257 Sep 08 13:09:18.136739 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2374/4619] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:15 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1498 bytes in 2363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:19.181512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4ddfe3d-77c3-4af0-a0c6-8596d3ac3cff tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:19.187823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b4ddfe3d-77c3-4af0-a0c6-8596d3ac3cff tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:19.216744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a37beb06-f3f3-441c-8bf9-76203953557b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:19.218110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4ddfe3d-77c3-4af0-a0c6-8596d3ac3cff tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:19.219504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4ddfe3d-77c3-4af0-a0c6-8596d3ac3cff tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:19.220503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a37beb06-f3f3-441c-8bf9-76203953557b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:19.221301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4ddfe3d-77c3-4af0-a0c6-8596d3ac3cff tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:19.223045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4ddfe3d-77c3-4af0-a0c6-8596d3ac3cff tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:19.225413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4ddfe3d-77c3-4af0-a0c6-8596d3ac3cff tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:19.231471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4ddfe3d-77c3-4af0-a0c6-8596d3ac3cff tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:19.237527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:09:19.266243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a37beb06-f3f3-441c-8bf9-76203953557b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:19.271876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a37beb06-f3f3-441c-8bf9-76203953557b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:19.272828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a37beb06-f3f3-441c-8bf9-76203953557b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:19.275561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a37beb06-f3f3-441c-8bf9-76203953557b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:19.276806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a37beb06-f3f3-441c-8bf9-76203953557b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:19.279324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a37beb06-f3f3-441c-8bf9-76203953557b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:19.320482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:09:20.306139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b4ddfe3d-77c3-4af0-a0c6-8596d3ac3cff tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:20.361387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b4ddfe3d-77c3-4af0-a0c6-8596d3ac3cff tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:20.377301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b4ddfe3d-77c3-4af0-a0c6-8596d3ac3cff tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:20.384350 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b4ddfe3d-77c3-4af0-a0c6-8596d3ac3cff tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1753 microversion: 2.20 time: 1.212522 Sep 08 13:09:20.396644 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2246/4620] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:19 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1753 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:09:20.942090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a37beb06-f3f3-441c-8bf9-76203953557b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:21.006339 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a37beb06-f3f3-441c-8bf9-76203953557b tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.804020 Sep 08 13:09:21.017951 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2375/4621] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:19 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:09:21.091212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1263f758-6576-4928-9313-71a923b098b2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:21.092545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1263f758-6576-4928-9313-71a923b098b2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:21.132268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1263f758-6576-4928-9313-71a923b098b2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:21.137566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1263f758-6576-4928-9313-71a923b098b2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:21.144153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1263f758-6576-4928-9313-71a923b098b2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:21.147192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1263f758-6576-4928-9313-71a923b098b2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:21.149845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1263f758-6576-4928-9313-71a923b098b2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:21.155094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1263f758-6576-4928-9313-71a923b098b2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:21.324071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1343183700", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "d70c1a9a-5af4-46a8-a93d-89615f8219c5"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:21.541491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] validate_networks() for [('d70c1a9a-5af4-46a8-a93d-89615f8219c5', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:09:24.343045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1263f758-6576-4928-9313-71a923b098b2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:24.400526 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1263f758-6576-4928-9313-71a923b098b2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 3.295523 Sep 08 13:09:24.419012 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2376/4622] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:21 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 3331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:24.448807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9be65a13-df5e-4550-8353-8be1bd5097dc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:24.454516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9be65a13-df5e-4550-8353-8be1bd5097dc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:24.497850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9be65a13-df5e-4550-8353-8be1bd5097dc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:24.501954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9be65a13-df5e-4550-8353-8be1bd5097dc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:24.507746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9be65a13-df5e-4550-8353-8be1bd5097dc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:24.516300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9be65a13-df5e-4550-8353-8be1bd5097dc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:24.518426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9be65a13-df5e-4550-8353-8be1bd5097dc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:24.519830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9be65a13-df5e-4550-8353-8be1bd5097dc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:25.193426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9be65a13-df5e-4550-8353-8be1bd5097dc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:25.250238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9be65a13-df5e-4550-8353-8be1bd5097dc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:25.257255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9be65a13-df5e-4550-8353-8be1bd5097dc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:25.272604 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9be65a13-df5e-4550-8353-8be1bd5097dc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1753 microversion: 2.20 time: 0.846905 Sep 08 13:09:25.279440 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2377/4623] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:24 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1753 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:25.322548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5ff45707-a333-4695-939a-ad44a88dac10 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:25.354047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5ff45707-a333-4695-939a-ad44a88dac10 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:25.474260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ff45707-a333-4695-939a-ad44a88dac10 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:25.475200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ff45707-a333-4695-939a-ad44a88dac10 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:25.476985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ff45707-a333-4695-939a-ad44a88dac10 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:25.478445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ff45707-a333-4695-939a-ad44a88dac10 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:25.480971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ff45707-a333-4695-939a-ad44a88dac10 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:25.482424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ff45707-a333-4695-939a-ad44a88dac10 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:25.518954 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-5ff45707-a333-4695-939a-ad44a88dac10 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5ff45707-a333-4695-939a-ad44a88dac10 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd/action HTTP/1.1 Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 28 Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: {"reboot": {"type": "SOFT"}} Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '47e92e06-d041-47a8-8715-1f8dae99b9dd', 'body': {'reboot': {'type': 'SOFT'}}} Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:09:25.523818 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5ff45707-a333-4695-939a-ad44a88dac10 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:25.529765 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5ff45707-a333-4695-939a-ad44a88dac10 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd/action" status: 404 len: 111 microversion: 2.1 time: 0.243788 Sep 08 13:09:25.538078 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2378/4624] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:25 2022] POST /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd/action => generated 111 bytes in 253 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:09:25.569380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-475b970d-c0ba-4caa-9737-f7a3edf99775 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:25.569380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-475b970d-c0ba-4caa-9737-f7a3edf99775 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:25.595781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-475b970d-c0ba-4caa-9737-f7a3edf99775 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:25.596916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-475b970d-c0ba-4caa-9737-f7a3edf99775 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:25.599150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-475b970d-c0ba-4caa-9737-f7a3edf99775 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:25.604189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-475b970d-c0ba-4caa-9737-f7a3edf99775 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:25.607355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-475b970d-c0ba-4caa-9737-f7a3edf99775 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:25.608332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-475b970d-c0ba-4caa-9737-f7a3edf99775 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:26.338255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:09:26.340243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:09:26.341566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:09:26.342644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:09:26.343768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:09:26.363962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:26.364789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:26.365455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:26.366737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:26.367539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:26.368288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:26.392063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Getting quotas for project f4fbcd2605e24a6d9186a9422e43bc07. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:09:26.407481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Getting quotas for user 68846e7305b7461f89cd6bd00003ad63 and project f4fbcd2605e24a6d9186a9422e43bc07. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:09:26.452389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:09:26.455825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:09:26.529028 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad00fb73-f094-45ed-968e-49f171e2ff0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.942453 Sep 08 13:09:26.530687 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2247/4625] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:09:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 5946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:09:26.559674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-313d7d63-cf9f-4c28-b994-ad6ba4e306cf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:26.561452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-313d7d63-cf9f-4c28-b994-ad6ba4e306cf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:26.585774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-313d7d63-cf9f-4c28-b994-ad6ba4e306cf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:26.587629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-313d7d63-cf9f-4c28-b994-ad6ba4e306cf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:26.588314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-313d7d63-cf9f-4c28-b994-ad6ba4e306cf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:26.589311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-313d7d63-cf9f-4c28-b994-ad6ba4e306cf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:26.612830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-313d7d63-cf9f-4c28-b994-ad6ba4e306cf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:26.621149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-313d7d63-cf9f-4c28-b994-ad6ba4e306cf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:26.651018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-475b970d-c0ba-4caa-9737-f7a3edf99775 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:26.671382 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-475b970d-c0ba-4caa-9737-f7a3edf99775 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.130440 Sep 08 13:09:26.674499 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2379/4626] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:25 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:26.720334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f139e750-085f-4bf3-a7f2-a5a0d8d0404d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:26.721448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f139e750-085f-4bf3-a7f2-a5a0d8d0404d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:26.889508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f139e750-085f-4bf3-a7f2-a5a0d8d0404d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:26.912679 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f139e750-085f-4bf3-a7f2-a5a0d8d0404d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1217 microversion: 2.1 time: 0.231943 Sep 08 13:09:26.913860 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2380/4627] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:26 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1217 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:26.947429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a5e14dea-0840-4c8b-9063-7861fa96a1f4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:26.948850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a5e14dea-0840-4c8b-9063-7861fa96a1f4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:26.988968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5e14dea-0840-4c8b-9063-7861fa96a1f4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:26.997317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5e14dea-0840-4c8b-9063-7861fa96a1f4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:27.001606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5e14dea-0840-4c8b-9063-7861fa96a1f4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:27.003114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5e14dea-0840-4c8b-9063-7861fa96a1f4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:27.018318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5e14dea-0840-4c8b-9063-7861fa96a1f4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:27.028395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5e14dea-0840-4c8b-9063-7861fa96a1f4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:27.998361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a5e14dea-0840-4c8b-9063-7861fa96a1f4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:28.014922 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a5e14dea-0840-4c8b-9063-7861fa96a1f4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.093998 Sep 08 13:09:28.015606 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2381/4628] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:26 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:28.052865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6b89b43e-fd02-4598-a0f7-b41eb6b0ea05 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:28.070590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6b89b43e-fd02-4598-a0f7-b41eb6b0ea05 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:28.219127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-313d7d63-cf9f-4c28-b994-ad6ba4e306cf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:28.283922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-313d7d63-cf9f-4c28-b994-ad6ba4e306cf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:28.294379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-313d7d63-cf9f-4c28-b994-ad6ba4e306cf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:28.309285 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-313d7d63-cf9f-4c28-b994-ad6ba4e306cf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1753 microversion: 2.20 time: 1.773133 Sep 08 13:09:28.317226 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2248/4629] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:26 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1753 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:28.368360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2aedaf28-a118-40b9-ab6a-a39318c66dfb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:28.388686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2aedaf28-a118-40b9-ab6a-a39318c66dfb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 31d081d9-cb74-4e74-a6ae-9751d9bf872c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:28.431593 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-2aedaf28-a118-40b9-ab6a-a39318c66dfb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 31d081d9-cb74-4e74-a6ae-9751d9bf872c could not be found. Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2aedaf28-a118-40b9-ab6a-a39318c66dfb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/31d081d9-cb74-4e74-a6ae-9751d9bf872c/action HTTP/1.1 Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 28 Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: {"reboot": {"type": "SOFT"}} Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 31d081d9-cb74-4e74-a6ae-9751d9bf872c could not be found. Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '31d081d9-cb74-4e74-a6ae-9751d9bf872c', 'body': {'reboot': {'type': 'SOFT'}}} Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31d081d9-cb74-4e74-a6ae-9751d9bf872c could not be found. Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31d081d9-cb74-4e74-a6ae-9751d9bf872c could not be found. Sep 08 13:09:28.441031 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:28.450429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:28.450429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:28.450429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:28.450429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:28.450429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:28.450429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:28.450429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:28.450429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31d081d9-cb74-4e74-a6ae-9751d9bf872c could not be found. Sep 08 13:09:28.450429 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:28.458898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2aedaf28-a118-40b9-ab6a-a39318c66dfb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 31d081d9-cb74-4e74-a6ae-9751d9bf872c could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:28.468352 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2aedaf28-a118-40b9-ab6a-a39318c66dfb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/31d081d9-cb74-4e74-a6ae-9751d9bf872c/action" status: 404 len: 111 microversion: 2.1 time: 0.140425 Sep 08 13:09:28.471069 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2249/4630] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:28 2022] POST /compute/v2.1/servers/31d081d9-cb74-4e74-a6ae-9751d9bf872c/action => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:09:28.474152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6b89b43e-fd02-4598-a0f7-b41eb6b0ea05 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:28.488297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f20c093-b8e9-4374-a577-a243227ebbee tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:28.489484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f20c093-b8e9-4374-a577-a243227ebbee tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:28.503792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f20c093-b8e9-4374-a577-a243227ebbee tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:28.504944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f20c093-b8e9-4374-a577-a243227ebbee tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:28.505805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f20c093-b8e9-4374-a577-a243227ebbee tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:28.507260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f20c093-b8e9-4374-a577-a243227ebbee tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:28.508187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f20c093-b8e9-4374-a577-a243227ebbee tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:28.508997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f20c093-b8e9-4374-a577-a243227ebbee tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:28.512701 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6b89b43e-fd02-4598-a0f7-b41eb6b0ea05 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1217 microversion: 2.1 time: 0.487327 Sep 08 13:09:28.524823 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2382/4631] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:28 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1217 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:29.111216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f20c093-b8e9-4374-a577-a243227ebbee tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:29.143678 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f20c093-b8e9-4374-a577-a243227ebbee tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.660754 Sep 08 13:09:29.145771 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2250/4632] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:28 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:29.213771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-738376cb-6099-4263-ab58-bde9f39a5803 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:29.215182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-738376cb-6099-4263-ab58-bde9f39a5803 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:29.258350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-738376cb-6099-4263-ab58-bde9f39a5803 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:29.259603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-738376cb-6099-4263-ab58-bde9f39a5803 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:29.260248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-738376cb-6099-4263-ab58-bde9f39a5803 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:29.261596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-738376cb-6099-4263-ab58-bde9f39a5803 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:29.262476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-738376cb-6099-4263-ab58-bde9f39a5803 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:29.268557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-738376cb-6099-4263-ab58-bde9f39a5803 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:29.406750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e311031c-6d33-4197-8bc8-d88d75bcdf78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:29.410915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e311031c-6d33-4197-8bc8-d88d75bcdf78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:29.462543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e311031c-6d33-4197-8bc8-d88d75bcdf78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:29.471474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e311031c-6d33-4197-8bc8-d88d75bcdf78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:29.473229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e311031c-6d33-4197-8bc8-d88d75bcdf78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:29.475111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e311031c-6d33-4197-8bc8-d88d75bcdf78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:29.480338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e311031c-6d33-4197-8bc8-d88d75bcdf78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:29.482417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e311031c-6d33-4197-8bc8-d88d75bcdf78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:30.541561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-738376cb-6099-4263-ab58-bde9f39a5803 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:30.579868 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-738376cb-6099-4263-ab58-bde9f39a5803 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.400867 Sep 08 13:09:30.583970 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2383/4633] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:29 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:30.593186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d6833477-1bef-47ab-958b-584bc79ac1db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:30.594545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d6833477-1bef-47ab-958b-584bc79ac1db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:30.632276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6833477-1bef-47ab-958b-584bc79ac1db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:30.633796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6833477-1bef-47ab-958b-584bc79ac1db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:30.636096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6833477-1bef-47ab-958b-584bc79ac1db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:30.638065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6833477-1bef-47ab-958b-584bc79ac1db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:30.639192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6833477-1bef-47ab-958b-584bc79ac1db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:30.640286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6833477-1bef-47ab-958b-584bc79ac1db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:30.717389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d6833477-1bef-47ab-958b-584bc79ac1db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:09:30.745226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e311031c-6d33-4197-8bc8-d88d75bcdf78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:30.776881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e311031c-6d33-4197-8bc8-d88d75bcdf78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:30.782943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e311031c-6d33-4197-8bc8-d88d75bcdf78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:30.788265 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e311031c-6d33-4197-8bc8-d88d75bcdf78 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1753 microversion: 2.20 time: 1.401770 Sep 08 13:09:30.809887 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2251/4634] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:29 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1753 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:30.831753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b65da28b-cf8c-4a2c-ad59-7dd3c8a169a3 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:30.833131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b65da28b-cf8c-4a2c-ad59-7dd3c8a169a3 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:30.854102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b65da28b-cf8c-4a2c-ad59-7dd3c8a169a3 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:30.857293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b65da28b-cf8c-4a2c-ad59-7dd3c8a169a3 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:30.858723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b65da28b-cf8c-4a2c-ad59-7dd3c8a169a3 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:30.863897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b65da28b-cf8c-4a2c-ad59-7dd3c8a169a3 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:30.865813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b65da28b-cf8c-4a2c-ad59-7dd3c8a169a3 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:30.867953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b65da28b-cf8c-4a2c-ad59-7dd3c8a169a3 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:31.071099 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d6833477-1bef-47ab-958b-584bc79ac1db tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "DELETE /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 204 len: 0 microversion: 2.1 time: 0.482947 Sep 08 13:09:31.077510 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2384/4635] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:09:30 2022] DELETE /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:09:31.121173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4fbc148e-7fae-41e6-b4dc-dc64e23738c5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:31.140604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4fbc148e-7fae-41e6-b4dc-dc64e23738c5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:31.193376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fbc148e-7fae-41e6-b4dc-dc64e23738c5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:31.194241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fbc148e-7fae-41e6-b4dc-dc64e23738c5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:31.194985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fbc148e-7fae-41e6-b4dc-dc64e23738c5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:31.201514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fbc148e-7fae-41e6-b4dc-dc64e23738c5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:31.203342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fbc148e-7fae-41e6-b4dc-dc64e23738c5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:31.210778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fbc148e-7fae-41e6-b4dc-dc64e23738c5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:31.322315 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-4fbc148e-7fae-41e6-b4dc-dc64e23738c5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4fbc148e-7fae-41e6-b4dc-dc64e23738c5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd/action HTTP/1.1 Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 65 Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '47e92e06-d041-47a8-8715-1f8dae99b9dd', 'body': {'rebuild': {'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d'}}} Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 08 13:09:31.332299 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:31.348403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4fbc148e-7fae-41e6-b4dc-dc64e23738c5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:31.353334 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4fbc148e-7fae-41e6-b4dc-dc64e23738c5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd/action" status: 404 len: 111 microversion: 2.1 time: 0.261340 Sep 08 13:09:31.356425 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2385/4636] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:31 2022] POST /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd/action => generated 111 bytes in 281 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:09:31.385028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b65da28b-cf8c-4a2c-ad59-7dd3c8a169a3 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:31.445834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9885bfed-19a0-4998-a0f2-cb9d850b86ae tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:31.467408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9885bfed-19a0-4998-a0f2-cb9d850b86ae tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:31.491829 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b65da28b-cf8c-4a2c-ad59-7dd3c8a169a3 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1275 microversion: 2.1 time: 0.668312 Sep 08 13:09:31.494983 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2252/4637] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:30 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1275 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:31.515901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9885bfed-19a0-4998-a0f2-cb9d850b86ae tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:31.519870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9885bfed-19a0-4998-a0f2-cb9d850b86ae tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:31.522654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3c55914e-2016-4191-a120-84658e1e437c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:31.523877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9885bfed-19a0-4998-a0f2-cb9d850b86ae tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:31.526836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3c55914e-2016-4191-a120-84658e1e437c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:31.528204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9885bfed-19a0-4998-a0f2-cb9d850b86ae tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:31.531082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9885bfed-19a0-4998-a0f2-cb9d850b86ae tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:31.532609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9885bfed-19a0-4998-a0f2-cb9d850b86ae tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:31.546512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c55914e-2016-4191-a120-84658e1e437c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:31.548168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c55914e-2016-4191-a120-84658e1e437c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:31.549098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c55914e-2016-4191-a120-84658e1e437c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:31.552625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c55914e-2016-4191-a120-84658e1e437c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:31.553662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c55914e-2016-4191-a120-84658e1e437c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:31.554451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c55914e-2016-4191-a120-84658e1e437c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:31.621366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:09:33.712432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3c55914e-2016-4191-a120-84658e1e437c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:33.753139 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3c55914e-2016-4191-a120-84658e1e437c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 2.246528 Sep 08 13:09:33.775738 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2253/4638] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:31 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:33.801254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-14496ddd-288e-4108-9d7a-1398d24f0c9c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:33.805261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-14496ddd-288e-4108-9d7a-1398d24f0c9c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:33.827087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14496ddd-288e-4108-9d7a-1398d24f0c9c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:33.829474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14496ddd-288e-4108-9d7a-1398d24f0c9c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:33.830865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14496ddd-288e-4108-9d7a-1398d24f0c9c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:33.833215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14496ddd-288e-4108-9d7a-1398d24f0c9c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:33.838138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14496ddd-288e-4108-9d7a-1398d24f0c9c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:33.839695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-14496ddd-288e-4108-9d7a-1398d24f0c9c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:34.609196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9885bfed-19a0-4998-a0f2-cb9d850b86ae tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:34.638960 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9885bfed-19a0-4998-a0f2-cb9d850b86ae tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 200 len: 1509 microversion: 2.1 time: 3.278232 Sep 08 13:09:34.640954 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2386/4639] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:31 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 1509 bytes in 3284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:34.654509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-342cd6d0-27dc-46c1-a9eb-71c5ff1324c8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:34.656428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-342cd6d0-27dc-46c1-a9eb-71c5ff1324c8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:34.691808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-342cd6d0-27dc-46c1-a9eb-71c5ff1324c8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:34.691808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-342cd6d0-27dc-46c1-a9eb-71c5ff1324c8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:34.691808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-342cd6d0-27dc-46c1-a9eb-71c5ff1324c8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:34.691808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-342cd6d0-27dc-46c1-a9eb-71c5ff1324c8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:34.691808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-342cd6d0-27dc-46c1-a9eb-71c5ff1324c8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:34.692926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-342cd6d0-27dc-46c1-a9eb-71c5ff1324c8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:36.180984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-342cd6d0-27dc-46c1-a9eb-71c5ff1324c8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:36.206928 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-342cd6d0-27dc-46c1-a9eb-71c5ff1324c8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1317 microversion: 2.1 time: 1.561562 Sep 08 13:09:36.210232 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2387/4640] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:34 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1317 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:36.224590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-841b97cf-60db-4088-ab94-781da7096f6e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:36.231395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-841b97cf-60db-4088-ab94-781da7096f6e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:36.247930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-841b97cf-60db-4088-ab94-781da7096f6e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:36.249348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-841b97cf-60db-4088-ab94-781da7096f6e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:36.250133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-841b97cf-60db-4088-ab94-781da7096f6e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:36.252593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-841b97cf-60db-4088-ab94-781da7096f6e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:36.253816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-841b97cf-60db-4088-ab94-781da7096f6e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:36.254636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-841b97cf-60db-4088-ab94-781da7096f6e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:36.288374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-14496ddd-288e-4108-9d7a-1398d24f0c9c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:36.321464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-14496ddd-288e-4108-9d7a-1398d24f0c9c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:36.339517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-14496ddd-288e-4108-9d7a-1398d24f0c9c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:36.342771 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-14496ddd-288e-4108-9d7a-1398d24f0c9c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 2.564287 Sep 08 13:09:36.361981 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2254/4641] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:33 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 2585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:36.438527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:09:36.450796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:09:36.629617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-71b46a07-3005-443c-9f38-2f08cead91cf req-1a99db77-617b-4b9c-9a71-26b37849066d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74916ce9-4e30-47ff-aa09-b1903b371bcd", "name": "network-vif-deleted", "tag": "0bfb6ef6-3bb9-4667-8350-b67c18a3fac3"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:36.656705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-71b46a07-3005-443c-9f38-2f08cead91cf req-1a99db77-617b-4b9c-9a71-26b37849066d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:36.657627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-71b46a07-3005-443c-9f38-2f08cead91cf req-1a99db77-617b-4b9c-9a71-26b37849066d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:36.658679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-71b46a07-3005-443c-9f38-2f08cead91cf req-1a99db77-617b-4b9c-9a71-26b37849066d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:36.704232 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-71b46a07-3005-443c-9f38-2f08cead91cf req-1a99db77-617b-4b9c-9a71-26b37849066d service nova] Creating event network-vif-deleted:0bfb6ef6-3bb9-4667-8350-b67c18a3fac3 for instance 74916ce9-4e30-47ff-aa09-b1903b371bcd on n-h1-852084-10 Sep 08 13:09:36.725468 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-71b46a07-3005-443c-9f38-2f08cead91cf req-1a99db77-617b-4b9c-9a71-26b37849066d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359245 Sep 08 13:09:36.727790 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2255/4642] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:09:36.744733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e097ce95-2af7-4009-8001-0c5315cd7cec tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:36.748951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e097ce95-2af7-4009-8001-0c5315cd7cec tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 74916ce9-4e30-47ff-aa09-b1903b371bcd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:36.767120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e097ce95-2af7-4009-8001-0c5315cd7cec tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:36.768565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e097ce95-2af7-4009-8001-0c5315cd7cec tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:36.769646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e097ce95-2af7-4009-8001-0c5315cd7cec tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:36.771608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e097ce95-2af7-4009-8001-0c5315cd7cec tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:36.772753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e097ce95-2af7-4009-8001-0c5315cd7cec tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:36.773812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e097ce95-2af7-4009-8001-0c5315cd7cec tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:36.807322 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e097ce95-2af7-4009-8001-0c5315cd7cec tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] HTTP exception thrown: Instance 74916ce9-4e30-47ff-aa09-b1903b371bcd could not be found. Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e097ce95-2af7-4009-8001-0c5315cd7cec tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Request method failure captured: Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd HTTP/1.1 Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGegpHo3QYXwAmCN_OctsdmztHN8ts294yLUiw-Ms0Kk7EQY0XfuiDYH7wh8eQztYQYLofweMgdtwuLtrJuTvgGQNr7mGfBgIxtE0szoBUmvKc-BEHBhV8QiE_SJULNZI6czSRqo3YxgC4OeYllmJxk1yJEFxr_qKCUPtZ26YlP53grs Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 0d312121b259412dbf82c519a49285f4 Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 74916ce9-4e30-47ff-aa09-b1903b371bcd could not be found. Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '74916ce9-4e30-47ff-aa09-b1903b371bcd'} Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74916ce9-4e30-47ff-aa09-b1903b371bcd could not be found. Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74916ce9-4e30-47ff-aa09-b1903b371bcd could not be found. Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:36.811500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:36.823932 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:36.823932 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:36.823932 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:36.823932 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:36.823932 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:36.823932 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:36.823932 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74916ce9-4e30-47ff-aa09-b1903b371bcd could not be found. Sep 08 13:09:36.823932 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:36.823932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e097ce95-2af7-4009-8001-0c5315cd7cec tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Returning 404 to user: Instance 74916ce9-4e30-47ff-aa09-b1903b371bcd could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:36.823932 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e097ce95-2af7-4009-8001-0c5315cd7cec tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd" status: 404 len: 111 microversion: 2.1 time: 0.089566 Sep 08 13:09:36.823932 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2256/4643] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:36 2022] GET /compute/v2.1/servers/74916ce9-4e30-47ff-aa09-b1903b371bcd => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:09:36.840797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-26f6b7b3-2862-400e-a65d-012d01063af7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:36.841481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-26f6b7b3-2862-400e-a65d-012d01063af7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:36.862632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26f6b7b3-2862-400e-a65d-012d01063af7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:36.862632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26f6b7b3-2862-400e-a65d-012d01063af7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:36.862632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26f6b7b3-2862-400e-a65d-012d01063af7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:36.862632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26f6b7b3-2862-400e-a65d-012d01063af7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:36.862632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26f6b7b3-2862-400e-a65d-012d01063af7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:36.862632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26f6b7b3-2862-400e-a65d-012d01063af7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:36.932581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-26f6b7b3-2862-400e-a65d-012d01063af7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:09:37.070752 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-26f6b7b3-2862-400e-a65d-012d01063af7 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 204 len: 0 microversion: 2.1 time: 0.240115 Sep 08 13:09:37.072590 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2257/4644] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:09:36 2022] DELETE /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:09:37.085555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-66a3952d-7bb2-4522-9713-1db73ab6eafe tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:37.088096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-66a3952d-7bb2-4522-9713-1db73ab6eafe tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:37.099323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66a3952d-7bb2-4522-9713-1db73ab6eafe tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:37.101292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66a3952d-7bb2-4522-9713-1db73ab6eafe tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:37.102572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66a3952d-7bb2-4522-9713-1db73ab6eafe tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:37.104208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66a3952d-7bb2-4522-9713-1db73ab6eafe tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:37.105714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66a3952d-7bb2-4522-9713-1db73ab6eafe tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:37.106527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-66a3952d-7bb2-4522-9713-1db73ab6eafe tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:37.667940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-841b97cf-60db-4088-ab94-781da7096f6e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:37.719868 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-841b97cf-60db-4088-ab94-781da7096f6e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.505307 Sep 08 13:09:37.721319 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2388/4645] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:36 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:37.733050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-18358cc1-720a-45df-af44-808ba15e9319 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:37.734305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-18358cc1-720a-45df-af44-808ba15e9319 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:37.752623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18358cc1-720a-45df-af44-808ba15e9319 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:37.753738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18358cc1-720a-45df-af44-808ba15e9319 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:37.754409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18358cc1-720a-45df-af44-808ba15e9319 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:37.756439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18358cc1-720a-45df-af44-808ba15e9319 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:37.760740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18358cc1-720a-45df-af44-808ba15e9319 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:37.762023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18358cc1-720a-45df-af44-808ba15e9319 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:38.507528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:09:38.632284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-66a3952d-7bb2-4522-9713-1db73ab6eafe tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:38.659848 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-66a3952d-7bb2-4522-9713-1db73ab6eafe tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 1.580853 Sep 08 13:09:38.692391 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2258/4646] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:37 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 1615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:09:38.704476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38eda906-5b75-4c26-abb8-9ec8ccf82f07 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:38.706482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-38eda906-5b75-4c26-abb8-9ec8ccf82f07 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:38.724604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38eda906-5b75-4c26-abb8-9ec8ccf82f07 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:38.725489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38eda906-5b75-4c26-abb8-9ec8ccf82f07 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:38.731099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38eda906-5b75-4c26-abb8-9ec8ccf82f07 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:38.731099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38eda906-5b75-4c26-abb8-9ec8ccf82f07 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:38.731099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38eda906-5b75-4c26-abb8-9ec8ccf82f07 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:38.731099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38eda906-5b75-4c26-abb8-9ec8ccf82f07 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:39.038909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-18358cc1-720a-45df-af44-808ba15e9319 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:39.062734 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-18358cc1-720a-45df-af44-808ba15e9319 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1317 microversion: 2.1 time: 1.339345 Sep 08 13:09:39.079469 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2389/4647] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:37 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1317 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:39.093902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b41ddc3f-32a4-4f2d-87c2-58f646615689 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:39.100653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b41ddc3f-32a4-4f2d-87c2-58f646615689 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 1e05d69e-5552-447c-9bdb-de12b7730359] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:39.131015 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-b41ddc3f-32a4-4f2d-87c2-58f646615689 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 1e05d69e-5552-447c-9bdb-de12b7730359 could not be found. Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b41ddc3f-32a4-4f2d-87c2-58f646615689 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/1e05d69e-5552-447c-9bdb-de12b7730359/action HTTP/1.1 Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 65 Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 1e05d69e-5552-447c-9bdb-de12b7730359 could not be found. Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '1e05d69e-5552-447c-9bdb-de12b7730359', 'body': {'rebuild': {'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d'}}} Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e05d69e-5552-447c-9bdb-de12b7730359 could not be found. Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Sep 08 13:09:39.139977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e05d69e-5552-447c-9bdb-de12b7730359 could not be found. Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e05d69e-5552-447c-9bdb-de12b7730359 could not be found. Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b41ddc3f-32a4-4f2d-87c2-58f646615689 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 1e05d69e-5552-447c-9bdb-de12b7730359 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:39.146335 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b41ddc3f-32a4-4f2d-87c2-58f646615689 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/1e05d69e-5552-447c-9bdb-de12b7730359/action" status: 404 len: 111 microversion: 2.1 time: 0.061214 Sep 08 13:09:39.150088 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2390/4648] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:39 2022] POST /compute/v2.1/servers/1e05d69e-5552-447c-9bdb-de12b7730359/action => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:09:39.165165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2a8d536c-7d13-4730-884b-ce27a252877f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:39.166248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2a8d536c-7d13-4730-884b-ce27a252877f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:39.179352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a8d536c-7d13-4730-884b-ce27a252877f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:39.181634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a8d536c-7d13-4730-884b-ce27a252877f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:39.181995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a8d536c-7d13-4730-884b-ce27a252877f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:39.188601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a8d536c-7d13-4730-884b-ce27a252877f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:39.188601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a8d536c-7d13-4730-884b-ce27a252877f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:39.188601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a8d536c-7d13-4730-884b-ce27a252877f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:39.809450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38eda906-5b75-4c26-abb8-9ec8ccf82f07 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:39.821601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38eda906-5b75-4c26-abb8-9ec8ccf82f07 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:39.823107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38eda906-5b75-4c26-abb8-9ec8ccf82f07 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:39.824576 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38eda906-5b75-4c26-abb8-9ec8ccf82f07 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 1.130524 Sep 08 13:09:39.825174 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2259/4649] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:38 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:39.853400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-276b1903-4a57-41c9-854b-b00374d6b496 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:39.854130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-276b1903-4a57-41c9-854b-b00374d6b496 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:39.865719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-276b1903-4a57-41c9-854b-b00374d6b496 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:39.866224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-276b1903-4a57-41c9-854b-b00374d6b496 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:39.873290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-276b1903-4a57-41c9-854b-b00374d6b496 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:39.887905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-276b1903-4a57-41c9-854b-b00374d6b496 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:39.888532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-276b1903-4a57-41c9-854b-b00374d6b496 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:39.889007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-276b1903-4a57-41c9-854b-b00374d6b496 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:40.361274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2a8d536c-7d13-4730-884b-ce27a252877f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:40.404197 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2a8d536c-7d13-4730-884b-ce27a252877f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.247613 Sep 08 13:09:40.405270 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2391/4650] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:39 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:09:40.456597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3ed9441e-bdf3-45a0-827a-cb31b51bd29c tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:40.470622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3ed9441e-bdf3-45a0-827a-cb31b51bd29c tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:40.521141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ed9441e-bdf3-45a0-827a-cb31b51bd29c tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:40.522046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ed9441e-bdf3-45a0-827a-cb31b51bd29c tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:40.536683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ed9441e-bdf3-45a0-827a-cb31b51bd29c tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:40.537530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ed9441e-bdf3-45a0-827a-cb31b51bd29c tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:40.538616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ed9441e-bdf3-45a0-827a-cb31b51bd29c tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:40.542087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ed9441e-bdf3-45a0-827a-cb31b51bd29c tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:42.780814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-276b1903-4a57-41c9-854b-b00374d6b496 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d312121b259412dbf82c519a49285f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a806bce1ce8422790726f1f12f681ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:42.837475 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-276b1903-4a57-41c9-854b-b00374d6b496 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 200 len: 1522 microversion: 2.1 time: 3.003281 Sep 08 13:09:42.851997 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2260/4651] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:39 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 1522 bytes in 3019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:42.887104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3ed9441e-bdf3-45a0-827a-cb31b51bd29c tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:42.907417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8b1c4b89-4c0f-4368-a507-f6b8a73cc65a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:42.917879 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3ed9441e-bdf3-45a0-827a-cb31b51bd29c tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1317 microversion: 2.1 time: 2.494707 Sep 08 13:09:42.919566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8b1c4b89-4c0f-4368-a507-f6b8a73cc65a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:42.929054 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2392/4652] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:40 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1317 bytes in 2523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:42.946947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-54158532-555c-4a9b-bc76-33ea0b92b9ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:42.948694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-54158532-555c-4a9b-bc76-33ea0b92b9ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:42.953872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:09:42.964259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b1c4b89-4c0f-4368-a507-f6b8a73cc65a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:42.979905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b1c4b89-4c0f-4368-a507-f6b8a73cc65a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:42.981435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b1c4b89-4c0f-4368-a507-f6b8a73cc65a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:42.990155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b1c4b89-4c0f-4368-a507-f6b8a73cc65a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:42.990610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54158532-555c-4a9b-bc76-33ea0b92b9ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:42.992930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b1c4b89-4c0f-4368-a507-f6b8a73cc65a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:42.996526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b1c4b89-4c0f-4368-a507-f6b8a73cc65a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:43.001043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54158532-555c-4a9b-bc76-33ea0b92b9ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:43.001918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54158532-555c-4a9b-bc76-33ea0b92b9ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:43.009971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54158532-555c-4a9b-bc76-33ea0b92b9ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:43.011208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54158532-555c-4a9b-bc76-33ea0b92b9ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:43.013214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54158532-555c-4a9b-bc76-33ea0b92b9ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:45.454997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8b1c4b89-4c0f-4368-a507-f6b8a73cc65a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:45.497630 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8b1c4b89-4c0f-4368-a507-f6b8a73cc65a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 2.635068 Sep 08 13:09:45.544701 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2261/4653] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:42 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 2690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:45.580024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-54158532-555c-4a9b-bc76-33ea0b92b9ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:45.594390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b31b7a7b-ba9e-4c3a-8d13-07463becd605 req-8af6841b-b1ac-406b-8063-dd7cbcc2bcdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fd2a7c5-18a2-4270-9e76-c5725415c55c", "name": "network-vif-deleted", "tag": "fff5238d-9657-4691-bdeb-2cd0bcd1c3a8"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:45.627337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b31b7a7b-ba9e-4c3a-8d13-07463becd605 req-8af6841b-b1ac-406b-8063-dd7cbcc2bcdb service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:45.629273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-54158532-555c-4a9b-bc76-33ea0b92b9ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:45.632281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b31b7a7b-ba9e-4c3a-8d13-07463becd605 req-8af6841b-b1ac-406b-8063-dd7cbcc2bcdb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:45.636221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b31b7a7b-ba9e-4c3a-8d13-07463becd605 req-8af6841b-b1ac-406b-8063-dd7cbcc2bcdb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:45.648213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-54158532-555c-4a9b-bc76-33ea0b92b9ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:45.650824 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-54158532-555c-4a9b-bc76-33ea0b92b9ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 2.719519 Sep 08 13:09:45.668550 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2393/4654] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:42 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 2738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:45.671511 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b31b7a7b-ba9e-4c3a-8d13-07463becd605 req-8af6841b-b1ac-406b-8063-dd7cbcc2bcdb service nova] Creating event network-vif-deleted:fff5238d-9657-4691-bdeb-2cd0bcd1c3a8 for instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c on n-h1-852084-10 Sep 08 13:09:45.701489 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b31b7a7b-ba9e-4c3a-8d13-07463becd605 req-8af6841b-b1ac-406b-8063-dd7cbcc2bcdb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154705 Sep 08 13:09:45.707196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-59a1263f-812d-4b8b-a122-b27fd806d638 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:45.710556 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2262/4655] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:09:45.711824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-59a1263f-812d-4b8b-a122-b27fd806d638 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] [instance: 4fd2a7c5-18a2-4270-9e76-c5725415c55c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:45.741667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4044b628-30ec-452c-86e4-16c150928ddb tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:45.744754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4044b628-30ec-452c-86e4-16c150928ddb tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:45.759210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59a1263f-812d-4b8b-a122-b27fd806d638 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:45.765073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59a1263f-812d-4b8b-a122-b27fd806d638 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:45.765903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59a1263f-812d-4b8b-a122-b27fd806d638 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:45.777110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59a1263f-812d-4b8b-a122-b27fd806d638 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:45.778168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59a1263f-812d-4b8b-a122-b27fd806d638 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:45.779213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59a1263f-812d-4b8b-a122-b27fd806d638 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:45.786795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4044b628-30ec-452c-86e4-16c150928ddb tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:45.789922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4044b628-30ec-452c-86e4-16c150928ddb tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:45.792070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4044b628-30ec-452c-86e4-16c150928ddb tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:45.794496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4044b628-30ec-452c-86e4-16c150928ddb tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:45.798089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4044b628-30ec-452c-86e4-16c150928ddb tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:45.800424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4044b628-30ec-452c-86e4-16c150928ddb tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:45.896497 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-59a1263f-812d-4b8b-a122-b27fd806d638 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] HTTP exception thrown: Instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c could not be found. Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-59a1263f-812d-4b8b-a122-b27fd806d638 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Request method failure captured: Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c HTTP/1.1 Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGegpHo3QYXwAmCN_OctsdmztHN8ts294yLUiw-Ms0Kk7EQY0XfuiDYH7wh8eQztYQYLofweMgdtwuLtrJuTvgGQNr7mGfBgIxtE0szoBUmvKc-BEHBhV8QiE_SJULNZI6czSRqo3YxgC4OeYllmJxk1yJEFxr_qKCUPtZ26YlP53grs Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4a806bce1ce8422790726f1f12f681ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 4a806bce1ce8422790726f1f12f681ba Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2122781122 Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 0d312121b259412dbf82c519a49285f4 Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2122781122-project Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c could not be found. Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '4fd2a7c5-18a2-4270-9e76-c5725415c55c'} Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c could not be found. Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c could not be found. Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:45.914376 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:45.925918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:45.925918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:45.925918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:45.925918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:45.925918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:45.925918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:45.925918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c could not be found. Sep 08 13:09:45.925918 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:45.925918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-59a1263f-812d-4b8b-a122-b27fd806d638 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] Returning 404 to user: Instance 4fd2a7c5-18a2-4270-9e76-c5725415c55c could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:45.925918 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-59a1263f-812d-4b8b-a122-b27fd806d638 tempest-ServerRescueNegativeTestJSON-2122781122 tempest-ServerRescueNegativeTestJSON-2122781122-project] 10.222.0.78 "GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c" status: 404 len: 111 microversion: 2.1 time: 0.246945 Sep 08 13:09:45.925918 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2394/4656] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:45 2022] GET /compute/v2.1/servers/4fd2a7c5-18a2-4270-9e76-c5725415c55c => generated 111 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:09:46.387511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-da3f75d6-4e1a-4c50-9cdc-8c482e151552 req-e070da83-fa12-4182-b7fd-f6639366cf69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5981dfd-0a38-4e7a-a91b-91e9b1bd203c", "tag": "4bf82251-4137-45b9-8734-db89f1052418"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:46.413302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-da3f75d6-4e1a-4c50-9cdc-8c482e151552 req-e070da83-fa12-4182-b7fd-f6639366cf69 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:46.414557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-da3f75d6-4e1a-4c50-9cdc-8c482e151552 req-e070da83-fa12-4182-b7fd-f6639366cf69 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:46.416028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-da3f75d6-4e1a-4c50-9cdc-8c482e151552 req-e070da83-fa12-4182-b7fd-f6639366cf69 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:46.448079 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-da3f75d6-4e1a-4c50-9cdc-8c482e151552 req-e070da83-fa12-4182-b7fd-f6639366cf69 service nova] Creating event network-changed:4bf82251-4137-45b9-8734-db89f1052418 for instance a5981dfd-0a38-4e7a-a91b-91e9b1bd203c on n-h2-852084-10 Sep 08 13:09:46.479603 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-da3f75d6-4e1a-4c50-9cdc-8c482e151552 req-e070da83-fa12-4182-b7fd-f6639366cf69 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.539441 Sep 08 13:09:46.484281 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2395/4657] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:09:46.512884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52b662a4-c35e-4976-bf55-466a5f950482 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:46.517906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-52b662a4-c35e-4976-bf55-466a5f950482 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 5f7eab64-b653-44a1-ae04-8f611725b569] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:46.542904 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-52b662a4-c35e-4976-bf55-466a5f950482 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 5f7eab64-b653-44a1-ae04-8f611725b569 could not be found. Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52b662a4-c35e-4976-bf55-466a5f950482 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/5f7eab64-b653-44a1-ae04-8f611725b569/action HTTP/1.1 Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 15 Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: {"restore": {}} Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 5f7eab64-b653-44a1-ae04-8f611725b569 could not be found. Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '5f7eab64-b653-44a1-ae04-8f611725b569', 'body': {'restore': {}}} Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f7eab64-b653-44a1-ae04-8f611725b569 could not be found. Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f7eab64-b653-44a1-ae04-8f611725b569 could not be found. Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:46.561648 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:46.571685 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:46.571685 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:46.571685 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f7eab64-b653-44a1-ae04-8f611725b569 could not be found. Sep 08 13:09:46.571685 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:46.573391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52b662a4-c35e-4976-bf55-466a5f950482 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 5f7eab64-b653-44a1-ae04-8f611725b569 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:46.576396 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-52b662a4-c35e-4976-bf55-466a5f950482 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/5f7eab64-b653-44a1-ae04-8f611725b569/action" status: 404 len: 111 microversion: 2.1 time: 0.087399 Sep 08 13:09:46.582272 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2396/4658] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:46 2022] POST /compute/v2.1/servers/5f7eab64-b653-44a1-ae04-8f611725b569/action => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:09:46.597456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9599930-e0ad-42db-ac89-cc788df2e10e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:46.605692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a9599930-e0ad-42db-ac89-cc788df2e10e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:46.623501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9599930-e0ad-42db-ac89-cc788df2e10e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:46.624310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9599930-e0ad-42db-ac89-cc788df2e10e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:46.625041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9599930-e0ad-42db-ac89-cc788df2e10e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:46.626340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9599930-e0ad-42db-ac89-cc788df2e10e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:46.627119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9599930-e0ad-42db-ac89-cc788df2e10e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:46.627852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9599930-e0ad-42db-ac89-cc788df2e10e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:47.734538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4044b628-30ec-452c-86e4-16c150928ddb tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:47.761053 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4044b628-30ec-452c-86e4-16c150928ddb tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1317 microversion: 2.1 time: 2.045609 Sep 08 13:09:47.775748 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2263/4659] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:45 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1317 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:47.801767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8f2d1d75-2bf7-4eb2-83eb-d53b226bf923 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:47.803412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8f2d1d75-2bf7-4eb2-83eb-d53b226bf923 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:47.815982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f2d1d75-2bf7-4eb2-83eb-d53b226bf923 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:47.817245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f2d1d75-2bf7-4eb2-83eb-d53b226bf923 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:47.818298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f2d1d75-2bf7-4eb2-83eb-d53b226bf923 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:47.820501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f2d1d75-2bf7-4eb2-83eb-d53b226bf923 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:47.821703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f2d1d75-2bf7-4eb2-83eb-d53b226bf923 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:47.822818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f2d1d75-2bf7-4eb2-83eb-d53b226bf923 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:47.966378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9599930-e0ad-42db-ac89-cc788df2e10e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:47.981635 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a9599930-e0ad-42db-ac89-cc788df2e10e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.390273 Sep 08 13:09:47.983797 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2397/4660] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:46 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:09:48.040419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e9a9855-0e61-4564-a194-560c6f4e91c3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:48.042119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8e9a9855-0e61-4564-a194-560c6f4e91c3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:48.055285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e9a9855-0e61-4564-a194-560c6f4e91c3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:48.056715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e9a9855-0e61-4564-a194-560c6f4e91c3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:48.059377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e9a9855-0e61-4564-a194-560c6f4e91c3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:48.063064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e9a9855-0e61-4564-a194-560c6f4e91c3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:48.064619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e9a9855-0e61-4564-a194-560c6f4e91c3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:48.065742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e9a9855-0e61-4564-a194-560c6f4e91c3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:48.430013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8e9a9855-0e61-4564-a194-560c6f4e91c3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:48.457527 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8e9a9855-0e61-4564-a194-560c6f4e91c3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.424277 Sep 08 13:09:48.460139 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2398/4661] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:48 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:48.485826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bcce4962-7bb0-419b-96a8-a83a857ccdd6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:48.488862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bcce4962-7bb0-419b-96a8-a83a857ccdd6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:48.529167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcce4962-7bb0-419b-96a8-a83a857ccdd6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:48.536453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcce4962-7bb0-419b-96a8-a83a857ccdd6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:48.537357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcce4962-7bb0-419b-96a8-a83a857ccdd6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:48.540750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcce4962-7bb0-419b-96a8-a83a857ccdd6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:48.543574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcce4962-7bb0-419b-96a8-a83a857ccdd6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:48.548119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcce4962-7bb0-419b-96a8-a83a857ccdd6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:48.615771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8f2d1d75-2bf7-4eb2-83eb-d53b226bf923 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:48.634200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:09:48.649036 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-bcce4962-7bb0-419b-96a8-a83a857ccdd6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Cannot 'restore' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bcce4962-7bb0-419b-96a8-a83a857ccdd6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action HTTP/1.1 Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 15 Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: {"restore": {}} Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: exception: Cannot 'restore' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '4eb421d7-2415-43d2-a6bb-3fdbca098091', 'body': {'restore': {}}} Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 in vm_state active. Cannot restore while the instance is in this state. Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:48.652395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:48.661732 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:48.661732 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:48.661732 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:48.661732 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:09:48.661732 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:09:48.666870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bcce4962-7bb0-419b-96a8-a83a857ccdd6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 409 to user: Cannot 'restore' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:48.666870 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bcce4962-7bb0-419b-96a8-a83a857ccdd6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 409 len: 145 microversion: 2.1 time: 0.184249 Sep 08 13:09:48.666870 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2399/4662] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:48 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 145 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:09:48.696607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7bc4e0db-b2b9-4923-a5fa-241e11fc96e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:48.697827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8f2d1d75-2bf7-4eb2-83eb-d53b226bf923 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:48.701245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8f2d1d75-2bf7-4eb2-83eb-d53b226bf923 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:48.702975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7bc4e0db-b2b9-4923-a5fa-241e11fc96e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:48.710088 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8f2d1d75-2bf7-4eb2-83eb-d53b226bf923 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.931971 Sep 08 13:09:48.718012 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2264/4663] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:47 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:48.731908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bc4e0db-b2b9-4923-a5fa-241e11fc96e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:48.733299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bc4e0db-b2b9-4923-a5fa-241e11fc96e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:48.739935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bc4e0db-b2b9-4923-a5fa-241e11fc96e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:48.741817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bc4e0db-b2b9-4923-a5fa-241e11fc96e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:48.743023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bc4e0db-b2b9-4923-a5fa-241e11fc96e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:48.744199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bc4e0db-b2b9-4923-a5fa-241e11fc96e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:48.807709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-641105c6-5cf0-496e-87e1-3d95e88cd0ec tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:48.810683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-641105c6-5cf0-496e-87e1-3d95e88cd0ec tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:48.844597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-641105c6-5cf0-496e-87e1-3d95e88cd0ec tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:48.845637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-641105c6-5cf0-496e-87e1-3d95e88cd0ec tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:48.846637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-641105c6-5cf0-496e-87e1-3d95e88cd0ec tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:48.861846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-641105c6-5cf0-496e-87e1-3d95e88cd0ec tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:48.865025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-641105c6-5cf0-496e-87e1-3d95e88cd0ec tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:48.866401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-641105c6-5cf0-496e-87e1-3d95e88cd0ec tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:49.567642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-641105c6-5cf0-496e-87e1-3d95e88cd0ec tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:49.605949 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-641105c6-5cf0-496e-87e1-3d95e88cd0ec tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1317 microversion: 2.1 time: 0.804127 Sep 08 13:09:49.608993 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2265/4664] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:48 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1317 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:09:49.614707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7bc4e0db-b2b9-4923-a5fa-241e11fc96e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:49.632032 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7bc4e0db-b2b9-4923-a5fa-241e11fc96e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.959088 Sep 08 13:09:49.633913 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2400/4665] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:48 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:49.679709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f50f0c70-0ddd-4099-83dd-91a17610363a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:49.680832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f50f0c70-0ddd-4099-83dd-91a17610363a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:49.697691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f50f0c70-0ddd-4099-83dd-91a17610363a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:49.698763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f50f0c70-0ddd-4099-83dd-91a17610363a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:49.699642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f50f0c70-0ddd-4099-83dd-91a17610363a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:49.700671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f50f0c70-0ddd-4099-83dd-91a17610363a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:49.701365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f50f0c70-0ddd-4099-83dd-91a17610363a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:49.702108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f50f0c70-0ddd-4099-83dd-91a17610363a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:49.782893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a7a577ce-64a1-4c97-9aa4-851b77979241 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:49.784714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a7a577ce-64a1-4c97-9aa4-851b77979241 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:49.810395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:09:49.828818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a7a577ce-64a1-4c97-9aa4-851b77979241 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:49.829832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a7a577ce-64a1-4c97-9aa4-851b77979241 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:49.830711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a7a577ce-64a1-4c97-9aa4-851b77979241 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:49.832193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a7a577ce-64a1-4c97-9aa4-851b77979241 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:49.833449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a7a577ce-64a1-4c97-9aa4-851b77979241 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:49.834566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a7a577ce-64a1-4c97-9aa4-851b77979241 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:50.266397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f50f0c70-0ddd-4099-83dd-91a17610363a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:50.293317 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f50f0c70-0ddd-4099-83dd-91a17610363a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.620521 Sep 08 13:09:50.335944 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2266/4666] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:49 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:09:50.350607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cd91d18b-2f9c-43e9-b79d-9de7bb2f6597 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:50.352053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cd91d18b-2f9c-43e9-b79d-9de7bb2f6597 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 384e845b-709d-49b0-85a2-3f5ad8d32c78] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:50.359156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a7a577ce-64a1-4c97-9aa4-851b77979241 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:50.365430 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-cd91d18b-2f9c-43e9-b79d-9de7bb2f6597 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 384e845b-709d-49b0-85a2-3f5ad8d32c78 could not be found. Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cd91d18b-2f9c-43e9-b79d-9de7bb2f6597 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/384e845b-709d-49b0-85a2-3f5ad8d32c78/action HTTP/1.1 Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 14 Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: {"resume": {}} Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 384e845b-709d-49b0-85a2-3f5ad8d32c78 could not be found. Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '384e845b-709d-49b0-85a2-3f5ad8d32c78', 'body': {'resume': {}}} Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384e845b-709d-49b0-85a2-3f5ad8d32c78 could not be found. Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384e845b-709d-49b0-85a2-3f5ad8d32c78 could not be found. Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:50.375436 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:50.392500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:50.392500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:50.392500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384e845b-709d-49b0-85a2-3f5ad8d32c78 could not be found. Sep 08 13:09:50.392500 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:50.395363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cd91d18b-2f9c-43e9-b79d-9de7bb2f6597 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 384e845b-709d-49b0-85a2-3f5ad8d32c78 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:50.398355 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cd91d18b-2f9c-43e9-b79d-9de7bb2f6597 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/384e845b-709d-49b0-85a2-3f5ad8d32c78/action" status: 404 len: 111 microversion: 2.1 time: 0.054972 Sep 08 13:09:50.398645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a7a577ce-64a1-4c97-9aa4-851b77979241 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:50.400289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a7a577ce-64a1-4c97-9aa4-851b77979241 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:50.401623 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a7a577ce-64a1-4c97-9aa4-851b77979241 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.629642 Sep 08 13:09:50.404843 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2267/4667] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:50 2022] POST /compute/v2.1/servers/384e845b-709d-49b0-85a2-3f5ad8d32c78/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:09:50.424374 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2401/4668] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:49 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:50.455965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aec14465-f736-4679-a186-76cd37981458 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:50.459623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-aec14465-f736-4679-a186-76cd37981458 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:50.521895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aec14465-f736-4679-a186-76cd37981458 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:50.526098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aec14465-f736-4679-a186-76cd37981458 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:50.527023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aec14465-f736-4679-a186-76cd37981458 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:50.528783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aec14465-f736-4679-a186-76cd37981458 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:50.539306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aec14465-f736-4679-a186-76cd37981458 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:50.541854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aec14465-f736-4679-a186-76cd37981458 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:50.658728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-339cac44-8b43-4536-bf31-2315b6b68ad8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:50.668297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-339cac44-8b43-4536-bf31-2315b6b68ad8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:50.685489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-339cac44-8b43-4536-bf31-2315b6b68ad8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:50.688853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-339cac44-8b43-4536-bf31-2315b6b68ad8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:50.695343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-339cac44-8b43-4536-bf31-2315b6b68ad8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:50.696976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-339cac44-8b43-4536-bf31-2315b6b68ad8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:50.697893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-339cac44-8b43-4536-bf31-2315b6b68ad8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:50.698816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-339cac44-8b43-4536-bf31-2315b6b68ad8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:51.661004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-339cac44-8b43-4536-bf31-2315b6b68ad8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:51.709185 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-339cac44-8b43-4536-bf31-2315b6b68ad8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1317 microversion: 2.1 time: 1.059465 Sep 08 13:09:51.716303 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2402/4669] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:50 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1317 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:51.730249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d7405420-6615-404f-86cd-52a106412c0a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:51.732944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d7405420-6615-404f-86cd-52a106412c0a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:51.742820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-aec14465-f736-4679-a186-76cd37981458 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:51.754452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7405420-6615-404f-86cd-52a106412c0a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:51.756030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7405420-6615-404f-86cd-52a106412c0a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:51.757270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7405420-6615-404f-86cd-52a106412c0a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:51.759813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7405420-6615-404f-86cd-52a106412c0a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:51.761625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7405420-6615-404f-86cd-52a106412c0a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:51.762062 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-aec14465-f736-4679-a186-76cd37981458 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.352238 Sep 08 13:09:51.763117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d7405420-6615-404f-86cd-52a106412c0a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:51.768094 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2268/4670] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:50 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:51.815927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a6a3a4c2-31aa-401d-805a-70e0b57a09cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:51.827401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a6a3a4c2-31aa-401d-805a-70e0b57a09cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:51.879243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a6a3a4c2-31aa-401d-805a-70e0b57a09cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:51.882139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a6a3a4c2-31aa-401d-805a-70e0b57a09cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:51.884883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a6a3a4c2-31aa-401d-805a-70e0b57a09cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:51.892577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a6a3a4c2-31aa-401d-805a-70e0b57a09cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:51.895397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a6a3a4c2-31aa-401d-805a-70e0b57a09cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:51.899406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a6a3a4c2-31aa-401d-805a-70e0b57a09cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:52.966560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d7405420-6615-404f-86cd-52a106412c0a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:52.979118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a6a3a4c2-31aa-401d-805a-70e0b57a09cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:53.005288 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a6a3a4c2-31aa-401d-805a-70e0b57a09cb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.196378 Sep 08 13:09:53.013379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d7405420-6615-404f-86cd-52a106412c0a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:53.020871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d7405420-6615-404f-86cd-52a106412c0a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:53.029781 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d7405420-6615-404f-86cd-52a106412c0a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 1.309699 Sep 08 13:09:53.035928 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2403/4671] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:51 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:53.047286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a0a5542d-f68c-4807-856e-81d79b46bc9a tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:53.051366 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2269/4672] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:51 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:09:53.052809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a0a5542d-f68c-4807-856e-81d79b46bc9a tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:53.073399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0a5542d-f68c-4807-856e-81d79b46bc9a tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:53.074538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-59cd9269-7db8-443e-b48e-47e7d1f71955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:53.075796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-59cd9269-7db8-443e-b48e-47e7d1f71955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:53.076859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0a5542d-f68c-4807-856e-81d79b46bc9a tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:53.083292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0a5542d-f68c-4807-856e-81d79b46bc9a tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:53.087109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0a5542d-f68c-4807-856e-81d79b46bc9a tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:53.088329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0a5542d-f68c-4807-856e-81d79b46bc9a tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:53.091574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0a5542d-f68c-4807-856e-81d79b46bc9a tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:53.098817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59cd9269-7db8-443e-b48e-47e7d1f71955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:53.099362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59cd9269-7db8-443e-b48e-47e7d1f71955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:53.100041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59cd9269-7db8-443e-b48e-47e7d1f71955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:53.101003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59cd9269-7db8-443e-b48e-47e7d1f71955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:53.101689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59cd9269-7db8-443e-b48e-47e7d1f71955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:53.102987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-59cd9269-7db8-443e-b48e-47e7d1f71955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:53.166979 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-59cd9269-7db8-443e-b48e-47e7d1f71955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Cannot 'resume' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-59cd9269-7db8-443e-b48e-47e7d1f71955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action HTTP/1.1 Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 14 Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: {"resume": {}} Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: exception: Cannot 'resume' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '4eb421d7-2415-43d2-a6bb-3fdbca098091', 'body': {'resume': {}}} Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 in vm_state active. Cannot resume while the instance is in this state. Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:53.169249 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:53.176803 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:53.176803 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:53.176803 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:53.176803 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:53.176803 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:53.176803 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:09:53.176803 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:53.182568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-59cd9269-7db8-443e-b48e-47e7d1f71955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 409 to user: Cannot 'resume' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:53.183961 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-59cd9269-7db8-443e-b48e-47e7d1f71955 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 409 len: 144 microversion: 2.1 time: 0.122546 Sep 08 13:09:53.191685 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2270/4673] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:53 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 144 bytes in 131 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 08 13:09:53.203070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-64a72948-01b6-485e-b8a1-e73b93aec795 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:53.211383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-64a72948-01b6-485e-b8a1-e73b93aec795 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:53.224189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64a72948-01b6-485e-b8a1-e73b93aec795 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:53.224869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64a72948-01b6-485e-b8a1-e73b93aec795 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:53.226328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64a72948-01b6-485e-b8a1-e73b93aec795 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:53.231958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64a72948-01b6-485e-b8a1-e73b93aec795 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:53.232684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64a72948-01b6-485e-b8a1-e73b93aec795 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:53.233285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64a72948-01b6-485e-b8a1-e73b93aec795 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:53.676988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a0a5542d-f68c-4807-856e-81d79b46bc9a tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:53.743919 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a0a5542d-f68c-4807-856e-81d79b46bc9a tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1317 microversion: 2.1 time: 0.698936 Sep 08 13:09:53.747313 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2404/4674] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:53 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1317 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:53.764418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-64a72948-01b6-485e-b8a1-e73b93aec795 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:53.821633 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-64a72948-01b6-485e-b8a1-e73b93aec795 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.628130 Sep 08 13:09:53.839258 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2271/4675] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:53 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:53.856220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0b9a4876-e035-40ed-b26d-e65f4947c193 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:53.857633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0b9a4876-e035-40ed-b26d-e65f4947c193 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:53.869668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b9a4876-e035-40ed-b26d-e65f4947c193 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:53.871341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b9a4876-e035-40ed-b26d-e65f4947c193 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:53.872861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b9a4876-e035-40ed-b26d-e65f4947c193 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:53.874475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b9a4876-e035-40ed-b26d-e65f4947c193 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:53.875534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b9a4876-e035-40ed-b26d-e65f4947c193 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:53.876867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b9a4876-e035-40ed-b26d-e65f4947c193 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:54.089318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6577346b-1243-48dc-8914-0c5b3be6d16d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:54.090828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6577346b-1243-48dc-8914-0c5b3be6d16d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:54.142221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6577346b-1243-48dc-8914-0c5b3be6d16d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:54.143349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6577346b-1243-48dc-8914-0c5b3be6d16d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:54.144208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6577346b-1243-48dc-8914-0c5b3be6d16d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:54.158339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6577346b-1243-48dc-8914-0c5b3be6d16d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:54.159358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6577346b-1243-48dc-8914-0c5b3be6d16d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:54.160220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6577346b-1243-48dc-8914-0c5b3be6d16d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:54.292737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0b9a4876-e035-40ed-b26d-e65f4947c193 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:54.307212 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0b9a4876-e035-40ed-b26d-e65f4947c193 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.456489 Sep 08 13:09:54.320466 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2405/4676] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:53 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:54.892113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6577346b-1243-48dc-8914-0c5b3be6d16d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:54.935799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6577346b-1243-48dc-8914-0c5b3be6d16d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:54.944580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6577346b-1243-48dc-8914-0c5b3be6d16d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:54.973894 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6577346b-1243-48dc-8914-0c5b3be6d16d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.873908 Sep 08 13:09:54.975509 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2272/4677] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:54 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:09:54.985736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-88a1b231-7c40-42b2-a150-b6fb94001dbd tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:55.000995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-88a1b231-7c40-42b2-a150-b6fb94001dbd tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:55.035194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88a1b231-7c40-42b2-a150-b6fb94001dbd tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:55.036591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88a1b231-7c40-42b2-a150-b6fb94001dbd tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:55.046684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88a1b231-7c40-42b2-a150-b6fb94001dbd tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:55.048210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88a1b231-7c40-42b2-a150-b6fb94001dbd tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:55.049077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88a1b231-7c40-42b2-a150-b6fb94001dbd tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:55.049855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88a1b231-7c40-42b2-a150-b6fb94001dbd tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:55.556434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-88a1b231-7c40-42b2-a150-b6fb94001dbd tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:55.593343 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-88a1b231-7c40-42b2-a150-b6fb94001dbd tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1317 microversion: 2.1 time: 0.614295 Sep 08 13:09:55.595976 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2273/4678] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:54 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1317 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:55.623039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-83723b4e-6f5d-4b37-b13f-ccc9c7329ab7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-83723b4e-6f5d-4b37-b13f-ccc9c7329ab7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers HTTP/1.1 Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 160 Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: {"server": {"name": "", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "6cf9ac04-bf1b-4fd3-befb-5346c4907700"}]}} Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'body': {'server': {'name': '', 'imageRef': 'f54d39f0-e02f-4735-8a67-b5b40688d75d', 'flavorRef': '452', 'networks': [{'uuid': '6cf9ac04-bf1b-4fd3-befb-5346c4907700'}]}}} Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi '' Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:09:55.637273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:09:55.647816 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:09:55.647816 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 08 13:09:55.647816 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:55.647816 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:55.647816 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:55.647816 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:55.647816 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:55.647816 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:55.647816 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:09:55.647816 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:09:55.647816 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 08 13:09:55.647816 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:55.657984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-83723b4e-6f5d-4b37-b13f-ccc9c7329ab7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:55.666826 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-83723b4e-6f5d-4b37-b13f-ccc9c7329ab7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.059016 Sep 08 13:09:55.675178 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2274/4679] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:09:55 2022] POST /compute/v2.1/servers => generated 108 bytes in 76 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:09:55.709221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-70db534b-2efc-4814-b20e-618555f8a6c6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:55.713446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-70db534b-2efc-4814-b20e-618555f8a6c6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:55.726091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-873ec6d6-0ccb-494c-8caa-3f5a744570df req-8b488beb-2a35-4089-bb68-30e6811f75c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5981dfd-0a38-4e7a-a91b-91e9b1bd203c", "name": "network-vif-plugged", "status": "completed", "tag": "4bf82251-4137-45b9-8734-db89f1052418"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:55.752100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-873ec6d6-0ccb-494c-8caa-3f5a744570df req-8b488beb-2a35-4089-bb68-30e6811f75c5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:55.754071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-873ec6d6-0ccb-494c-8caa-3f5a744570df req-8b488beb-2a35-4089-bb68-30e6811f75c5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:55.755383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-873ec6d6-0ccb-494c-8caa-3f5a744570df req-8b488beb-2a35-4089-bb68-30e6811f75c5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:55.766415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70db534b-2efc-4814-b20e-618555f8a6c6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:55.767566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70db534b-2efc-4814-b20e-618555f8a6c6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:55.768398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70db534b-2efc-4814-b20e-618555f8a6c6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:55.769955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70db534b-2efc-4814-b20e-618555f8a6c6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:55.773358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70db534b-2efc-4814-b20e-618555f8a6c6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:55.783338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70db534b-2efc-4814-b20e-618555f8a6c6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:55.796144 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-873ec6d6-0ccb-494c-8caa-3f5a744570df req-8b488beb-2a35-4089-bb68-30e6811f75c5 service nova] Creating event network-vif-plugged:4bf82251-4137-45b9-8734-db89f1052418 for instance a5981dfd-0a38-4e7a-a91b-91e9b1bd203c on n-h2-852084-10 Sep 08 13:09:55.809530 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-873ec6d6-0ccb-494c-8caa-3f5a744570df req-8b488beb-2a35-4089-bb68-30e6811f75c5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.174573 Sep 08 13:09:55.811622 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2406/4680] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:09:56.041039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-40501da9-b807-4ad3-b2c2-5d36da9967ec tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:56.048058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-40501da9-b807-4ad3-b2c2-5d36da9967ec tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:56.101924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40501da9-b807-4ad3-b2c2-5d36da9967ec tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:56.104203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40501da9-b807-4ad3-b2c2-5d36da9967ec tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:56.108478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40501da9-b807-4ad3-b2c2-5d36da9967ec tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:56.110672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40501da9-b807-4ad3-b2c2-5d36da9967ec tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:56.116310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40501da9-b807-4ad3-b2c2-5d36da9967ec tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:56.117389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40501da9-b807-4ad3-b2c2-5d36da9967ec tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:56.158876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:09:56.461319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-70db534b-2efc-4814-b20e-618555f8a6c6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:56.486281 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-70db534b-2efc-4814-b20e-618555f8a6c6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.805993 Sep 08 13:09:56.487965 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2275/4681] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:55 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:56.550864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6d2d34e1-2af2-4542-b467-19172c0049fd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:56.559150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6d2d34e1-2af2-4542-b467-19172c0049fd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:56.572450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d2d34e1-2af2-4542-b467-19172c0049fd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:56.574291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d2d34e1-2af2-4542-b467-19172c0049fd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:56.575789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d2d34e1-2af2-4542-b467-19172c0049fd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:56.582360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d2d34e1-2af2-4542-b467-19172c0049fd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:56.584764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d2d34e1-2af2-4542-b467-19172c0049fd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:56.586015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40501da9-b807-4ad3-b2c2-5d36da9967ec tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:56.586235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d2d34e1-2af2-4542-b467-19172c0049fd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:56.600262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40501da9-b807-4ad3-b2c2-5d36da9967ec tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:56.604793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40501da9-b807-4ad3-b2c2-5d36da9967ec tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:56.610118 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-40501da9-b807-4ad3-b2c2-5d36da9967ec tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.586739 Sep 08 13:09:56.617330 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2407/4682] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:56 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:56.648182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d8e84353-012b-4d44-9fe5-bf5ef2e90a4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:56.651187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d8e84353-012b-4d44-9fe5-bf5ef2e90a4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:56.676506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8e84353-012b-4d44-9fe5-bf5ef2e90a4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:56.677520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8e84353-012b-4d44-9fe5-bf5ef2e90a4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:56.680565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8e84353-012b-4d44-9fe5-bf5ef2e90a4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:56.681772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8e84353-012b-4d44-9fe5-bf5ef2e90a4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:56.683918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8e84353-012b-4d44-9fe5-bf5ef2e90a4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:56.684914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8e84353-012b-4d44-9fe5-bf5ef2e90a4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:57.603725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d8e84353-012b-4d44-9fe5-bf5ef2e90a4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:57.646191 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d8e84353-012b-4d44-9fe5-bf5ef2e90a4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1317 microversion: 2.1 time: 1.006150 Sep 08 13:09:57.647669 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2408/4683] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:56 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1317 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:09:57.694783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f541011c-552b-42c9-bf95-8b795646e670 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:57.695861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f541011c-552b-42c9-bf95-8b795646e670 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:57.714013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f541011c-552b-42c9-bf95-8b795646e670 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:57.718936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f541011c-552b-42c9-bf95-8b795646e670 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:57.719509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f541011c-552b-42c9-bf95-8b795646e670 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:57.720354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f541011c-552b-42c9-bf95-8b795646e670 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:57.722180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f541011c-552b-42c9-bf95-8b795646e670 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:57.724010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f541011c-552b-42c9-bf95-8b795646e670 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:57.726759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6d2d34e1-2af2-4542-b467-19172c0049fd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:57.764370 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6d2d34e1-2af2-4542-b467-19172c0049fd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.218740 Sep 08 13:09:57.767104 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2276/4684] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:56 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:57.807402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-acfff86c-140e-4ce8-bf18-55ce6d1d268c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:57.818899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-acfff86c-140e-4ce8-bf18-55ce6d1d268c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: bae2799f-b909-406f-8b04-9235c39a1c1d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:57.830628 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-acfff86c-140e-4ce8-bf18-55ce6d1d268c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance bae2799f-b909-406f-8b04-9235c39a1c1d could not be found. Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-acfff86c-140e-4ce8-bf18-55ce6d1d268c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/bae2799f-b909-406f-8b04-9235c39a1c1d/action HTTP/1.1 Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 14 Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: {"shelve": {}} Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance bae2799f-b909-406f-8b04-9235c39a1c1d could not be found. Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'bae2799f-b909-406f-8b04-9235c39a1c1d', 'body': {'shelve': {}}} Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bae2799f-b909-406f-8b04-9235c39a1c1d could not be found. Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bae2799f-b909-406f-8b04-9235c39a1c1d could not be found. Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:09:57.854812 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:09:57.865514 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:09:57.865514 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:09:57.865514 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bae2799f-b909-406f-8b04-9235c39a1c1d could not be found. Sep 08 13:09:57.865514 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:09:57.870409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-acfff86c-140e-4ce8-bf18-55ce6d1d268c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance bae2799f-b909-406f-8b04-9235c39a1c1d could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:09:57.870409 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-acfff86c-140e-4ce8-bf18-55ce6d1d268c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/bae2799f-b909-406f-8b04-9235c39a1c1d/action" status: 404 len: 111 microversion: 2.1 time: 0.069722 Sep 08 13:09:57.870409 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2277/4685] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:57 2022] POST /compute/v2.1/servers/bae2799f-b909-406f-8b04-9235c39a1c1d/action => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:09:57.885218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1e1cb8fc-0cc4-473a-aa87-b54557f888eb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:57.886892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1e1cb8fc-0cc4-473a-aa87-b54557f888eb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:57.906602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e1cb8fc-0cc4-473a-aa87-b54557f888eb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:57.914695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e1cb8fc-0cc4-473a-aa87-b54557f888eb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:57.915928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e1cb8fc-0cc4-473a-aa87-b54557f888eb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:57.918433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e1cb8fc-0cc4-473a-aa87-b54557f888eb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:57.921808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e1cb8fc-0cc4-473a-aa87-b54557f888eb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:57.923414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e1cb8fc-0cc4-473a-aa87-b54557f888eb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:58.064222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f541011c-552b-42c9-bf95-8b795646e670 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:58.076830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f541011c-552b-42c9-bf95-8b795646e670 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:58.081783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f541011c-552b-42c9-bf95-8b795646e670 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:58.083850 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f541011c-552b-42c9-bf95-8b795646e670 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.411994 Sep 08 13:09:58.085692 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2409/4686] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:57 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:09:58.397643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1e1cb8fc-0cc4-473a-aa87-b54557f888eb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:58.421774 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1e1cb8fc-0cc4-473a-aa87-b54557f888eb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.543521 Sep 08 13:09:58.452114 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2278/4687] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:57 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:58.480783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-afba87db-2e63-4792-83bc-48f35443d3f3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:58.482127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-afba87db-2e63-4792-83bc-48f35443d3f3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:58.496729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afba87db-2e63-4792-83bc-48f35443d3f3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:58.498832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afba87db-2e63-4792-83bc-48f35443d3f3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:58.500021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afba87db-2e63-4792-83bc-48f35443d3f3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:58.501980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afba87db-2e63-4792-83bc-48f35443d3f3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:58.503363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afba87db-2e63-4792-83bc-48f35443d3f3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:58.504535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afba87db-2e63-4792-83bc-48f35443d3f3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:58.692094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f6cea868-d67a-4a20-9480-2082cb1423cc tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:58.714285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f6cea868-d67a-4a20-9480-2082cb1423cc tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:58.763390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6cea868-d67a-4a20-9480-2082cb1423cc tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:58.767044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6cea868-d67a-4a20-9480-2082cb1423cc tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:58.767939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6cea868-d67a-4a20-9480-2082cb1423cc tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:58.776535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6cea868-d67a-4a20-9480-2082cb1423cc tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:58.777585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6cea868-d67a-4a20-9480-2082cb1423cc tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:58.783871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6cea868-d67a-4a20-9480-2082cb1423cc tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:59.101250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-afba87db-2e63-4792-83bc-48f35443d3f3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:59.151795 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-afba87db-2e63-4792-83bc-48f35443d3f3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.678554 Sep 08 13:09:59.153222 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2410/4688] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:58 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:59.168452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-12fafae6-30fe-43f0-a8c5-4080193d26e2 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:59.175814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-12fafae6-30fe-43f0-a8c5-4080193d26e2 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:59.202749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12fafae6-30fe-43f0-a8c5-4080193d26e2 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:59.204604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12fafae6-30fe-43f0-a8c5-4080193d26e2 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:59.208142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12fafae6-30fe-43f0-a8c5-4080193d26e2 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:59.213029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12fafae6-30fe-43f0-a8c5-4080193d26e2 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:59.214197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12fafae6-30fe-43f0-a8c5-4080193d26e2 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:59.218419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12fafae6-30fe-43f0-a8c5-4080193d26e2 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:59.755811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-12fafae6-30fe-43f0-a8c5-4080193d26e2 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:59.761971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f6cea868-d67a-4a20-9480-2082cb1423cc tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:59.789052 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f6cea868-d67a-4a20-9480-2082cb1423cc tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1504 microversion: 2.1 time: 1.104520 Sep 08 13:09:59.794953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-12fafae6-30fe-43f0-a8c5-4080193d26e2 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:59.795392 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2279/4689] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:09:58 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1504 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:09:59.805113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-12fafae6-30fe-43f0-a8c5-4080193d26e2 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:59.810186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad454897-e0d1-4583-bd84-7a239836c1fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:09:59.811321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad454897-e0d1-4583-bd84-7a239836c1fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:59.811813 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-12fafae6-30fe-43f0-a8c5-4080193d26e2 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.654846 Sep 08 13:09:59.829046 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2411/4690] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:09:59 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:09:59.840092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad454897-e0d1-4583-bd84-7a239836c1fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:59.841545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad454897-e0d1-4583-bd84-7a239836c1fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:59.842192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad454897-e0d1-4583-bd84-7a239836c1fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:59.844979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad454897-e0d1-4583-bd84-7a239836c1fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:59.845649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad454897-e0d1-4583-bd84-7a239836c1fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:59.848542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad454897-e0d1-4583-bd84-7a239836c1fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:59.860504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b49b0ce9-6b82-4a8d-8a1f-eb4f2357fda5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:09:59.861590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b49b0ce9-6b82-4a8d-8a1f-eb4f2357fda5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:09:59.873390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b49b0ce9-6b82-4a8d-8a1f-eb4f2357fda5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:59.874295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b49b0ce9-6b82-4a8d-8a1f-eb4f2357fda5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:59.875141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b49b0ce9-6b82-4a8d-8a1f-eb4f2357fda5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:59.876763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b49b0ce9-6b82-4a8d-8a1f-eb4f2357fda5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:09:59.877612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b49b0ce9-6b82-4a8d-8a1f-eb4f2357fda5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:09:59.878383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b49b0ce9-6b82-4a8d-8a1f-eb4f2357fda5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:09:59.927481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-ad454897-e0d1-4583-bd84-7a239836c1fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lazy-loading 'flavor' on Instance uuid 4eb421d7-2415-43d2-a6bb-3fdbca098091 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:09:59.988134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b49b0ce9-6b82-4a8d-8a1f-eb4f2357fda5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:09:59.995258 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b49b0ce9-6b82-4a8d-8a1f-eb4f2357fda5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c/os-instance-actions/req-ad00fb73-f094-45ed-968e-49f171e2ff0d" status: 200 len: 313 microversion: 2.1 time: 0.155770 Sep 08 13:10:00.012456 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2412/4691] 10.222.0.78 () {58 vars in 1419 bytes} [Thu Sep 8 13:09:59 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c/os-instance-actions/req-ad00fb73-f094-45ed-968e-49f171e2ff0d => generated 313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:10:00.038971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-223b193d-0b58-4318-90b4-981b8afc244d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:10:00.051142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-223b193d-0b58-4318-90b4-981b8afc244d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:00.071496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-223b193d-0b58-4318-90b4-981b8afc244d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:00.073237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-223b193d-0b58-4318-90b4-981b8afc244d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:00.074338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-223b193d-0b58-4318-90b4-981b8afc244d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:00.077003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-223b193d-0b58-4318-90b4-981b8afc244d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:00.080903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-223b193d-0b58-4318-90b4-981b8afc244d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:00.084803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-223b193d-0b58-4318-90b4-981b8afc244d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:00.398198 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-223b193d-0b58-4318-90b4-981b8afc244d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "POST /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c/action" status: 202 len: 0 microversion: 2.1 time: 0.372048 Sep 08 13:10:00.421636 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2413/4692] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:10:00 2022] POST /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c/action => generated 0 bytes in 396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:10:00.448853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-39db4012-200e-41ac-9c1a-68404bc5d77b tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:00.451929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-39db4012-200e-41ac-9c1a-68404bc5d77b tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:00.480758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39db4012-200e-41ac-9c1a-68404bc5d77b tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:00.481254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39db4012-200e-41ac-9c1a-68404bc5d77b tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:00.501694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39db4012-200e-41ac-9c1a-68404bc5d77b tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:00.504459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39db4012-200e-41ac-9c1a-68404bc5d77b tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:00.507622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39db4012-200e-41ac-9c1a-68404bc5d77b tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:00.508111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39db4012-200e-41ac-9c1a-68404bc5d77b tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:00.539394 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad454897-e0d1-4583-bd84-7a239836c1fb tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 202 len: 0 microversion: 2.1 time: 0.742239 Sep 08 13:10:00.549864 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2280/4693] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:09:59 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:10:00.559036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0365a1ed-a3ad-4749-bf6d-c439faf52a92 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:00.559676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0365a1ed-a3ad-4749-bf6d-c439faf52a92 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:00.589665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0365a1ed-a3ad-4749-bf6d-c439faf52a92 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:00.590329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0365a1ed-a3ad-4749-bf6d-c439faf52a92 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:00.591985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0365a1ed-a3ad-4749-bf6d-c439faf52a92 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:00.622425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0365a1ed-a3ad-4749-bf6d-c439faf52a92 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:00.623156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0365a1ed-a3ad-4749-bf6d-c439faf52a92 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:00.623635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0365a1ed-a3ad-4749-bf6d-c439faf52a92 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:01.387541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-39db4012-200e-41ac-9c1a-68404bc5d77b tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:01.410430 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-39db4012-200e-41ac-9c1a-68404bc5d77b tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1506 microversion: 2.1 time: 0.986197 Sep 08 13:10:01.411974 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2414/4694] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:00 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1506 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:01.420709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2ad267df-c01c-4ec3-bbbb-70d6263b1414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:01.421734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2ad267df-c01c-4ec3-bbbb-70d6263b1414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:01.453109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ad267df-c01c-4ec3-bbbb-70d6263b1414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:01.454242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ad267df-c01c-4ec3-bbbb-70d6263b1414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:01.456092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ad267df-c01c-4ec3-bbbb-70d6263b1414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:01.457527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ad267df-c01c-4ec3-bbbb-70d6263b1414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:01.458407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ad267df-c01c-4ec3-bbbb-70d6263b1414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:01.459126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ad267df-c01c-4ec3-bbbb-70d6263b1414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:01.520659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0365a1ed-a3ad-4749-bf6d-c439faf52a92 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:01.549346 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0365a1ed-a3ad-4749-bf6d-c439faf52a92 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1512 microversion: 2.1 time: 0.999943 Sep 08 13:10:01.550317 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2281/4695] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:00 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1512 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:01.989203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2ad267df-c01c-4ec3-bbbb-70d6263b1414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:02.029657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2ad267df-c01c-4ec3-bbbb-70d6263b1414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:02.035782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2ad267df-c01c-4ec3-bbbb-70d6263b1414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:02.040612 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2ad267df-c01c-4ec3-bbbb-70d6263b1414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.624452 Sep 08 13:10:02.051340 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2415/4696] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:10:01 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:10:02.470615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b0e1d41b-c444-4db3-bd80-0f85fddffaa7 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:02.472301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b0e1d41b-c444-4db3-bd80-0f85fddffaa7 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:02.500731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0e1d41b-c444-4db3-bd80-0f85fddffaa7 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:02.502105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0e1d41b-c444-4db3-bd80-0f85fddffaa7 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:02.503183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0e1d41b-c444-4db3-bd80-0f85fddffaa7 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:02.504882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0e1d41b-c444-4db3-bd80-0f85fddffaa7 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:02.506518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0e1d41b-c444-4db3-bd80-0f85fddffaa7 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:02.514006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0e1d41b-c444-4db3-bd80-0f85fddffaa7 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:02.594453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e6e4b41-d1ea-4ba4-82a9-fcd2a98107e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:02.608680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2e6e4b41-d1ea-4ba4-82a9-fcd2a98107e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:02.620075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e6e4b41-d1ea-4ba4-82a9-fcd2a98107e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:02.620877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e6e4b41-d1ea-4ba4-82a9-fcd2a98107e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:02.621571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e6e4b41-d1ea-4ba4-82a9-fcd2a98107e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:02.622716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e6e4b41-d1ea-4ba4-82a9-fcd2a98107e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:02.631657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e6e4b41-d1ea-4ba4-82a9-fcd2a98107e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:02.632578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e6e4b41-d1ea-4ba4-82a9-fcd2a98107e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:02.994274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b0e1d41b-c444-4db3-bd80-0f85fddffaa7 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:03.019912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:10:03.033693 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b0e1d41b-c444-4db3-bd80-0f85fddffaa7 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1506 microversion: 2.1 time: 0.574646 Sep 08 13:10:03.047919 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2282/4697] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:02 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1506 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:03.081659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2e6e4b41-d1ea-4ba4-82a9-fcd2a98107e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:03.103593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-68ca62ce-148c-435b-8f7f-861c0fb5658a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:03.105042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-68ca62ce-148c-435b-8f7f-861c0fb5658a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:03.120210 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2e6e4b41-d1ea-4ba4-82a9-fcd2a98107e9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1512 microversion: 2.1 time: 0.532679 Sep 08 13:10:03.121341 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2416/4698] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:02 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1512 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:10:03.129262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68ca62ce-148c-435b-8f7f-861c0fb5658a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:03.130800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68ca62ce-148c-435b-8f7f-861c0fb5658a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:03.131959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68ca62ce-148c-435b-8f7f-861c0fb5658a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:03.133936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68ca62ce-148c-435b-8f7f-861c0fb5658a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:03.135066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68ca62ce-148c-435b-8f7f-861c0fb5658a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:03.150583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-68ca62ce-148c-435b-8f7f-861c0fb5658a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:03.765921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-68ca62ce-148c-435b-8f7f-861c0fb5658a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:03.797486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-68ca62ce-148c-435b-8f7f-861c0fb5658a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:03.801383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-68ca62ce-148c-435b-8f7f-861c0fb5658a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:03.803858 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-68ca62ce-148c-435b-8f7f-861c0fb5658a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.711911 Sep 08 13:10:03.805824 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2283/4699] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:10:03 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:10:04.082803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89582e40-1a31-49e0-b21d-bc7b3f3440e9 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:04.083708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-89582e40-1a31-49e0-b21d-bc7b3f3440e9 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:04.098698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89582e40-1a31-49e0-b21d-bc7b3f3440e9 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:04.099477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89582e40-1a31-49e0-b21d-bc7b3f3440e9 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:04.101225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89582e40-1a31-49e0-b21d-bc7b3f3440e9 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:04.102392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89582e40-1a31-49e0-b21d-bc7b3f3440e9 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:04.103060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89582e40-1a31-49e0-b21d-bc7b3f3440e9 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:04.103940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89582e40-1a31-49e0-b21d-bc7b3f3440e9 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:04.155720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b5bf9608-71cb-4638-a20d-aa7f18c0f705 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:04.161500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b5bf9608-71cb-4638-a20d-aa7f18c0f705 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:04.197355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5bf9608-71cb-4638-a20d-aa7f18c0f705 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:04.200384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5bf9608-71cb-4638-a20d-aa7f18c0f705 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:04.204556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5bf9608-71cb-4638-a20d-aa7f18c0f705 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:04.207626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5bf9608-71cb-4638-a20d-aa7f18c0f705 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:04.210939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5bf9608-71cb-4638-a20d-aa7f18c0f705 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:04.213471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5bf9608-71cb-4638-a20d-aa7f18c0f705 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:04.926846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-89582e40-1a31-49e0-b21d-bc7b3f3440e9 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:04.930895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b5bf9608-71cb-4638-a20d-aa7f18c0f705 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:04.955828 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-89582e40-1a31-49e0-b21d-bc7b3f3440e9 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1504 microversion: 2.1 time: 0.886198 Sep 08 13:10:04.958987 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2417/4700] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:04 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1504 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:04.960544 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b5bf9608-71cb-4638-a20d-aa7f18c0f705 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1512 microversion: 2.1 time: 0.801688 Sep 08 13:10:04.963650 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2284/4701] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:04 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1512 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:10:04.990151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f8bae2a-ab0b-4602-98cc-cbffdb1e4a46 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:05.000315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f8bae2a-ab0b-4602-98cc-cbffdb1e4a46 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:05.007624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a1afaa2f-dc71-4bdb-ab73-b441f8d960d5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '.version_select at 0x7fdb39c96940>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:05.008945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a1afaa2f-dc71-4bdb-ab73-b441f8d960d5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:05.023375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1afaa2f-dc71-4bdb-ab73-b441f8d960d5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:05.024393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1afaa2f-dc71-4bdb-ab73-b441f8d960d5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:05.025214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1afaa2f-dc71-4bdb-ab73-b441f8d960d5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:05.026616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1afaa2f-dc71-4bdb-ab73-b441f8d960d5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:05.027548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1afaa2f-dc71-4bdb-ab73-b441f8d960d5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:05.029960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1afaa2f-dc71-4bdb-ab73-b441f8d960d5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:05.035177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8bae2a-ab0b-4602-98cc-cbffdb1e4a46 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:05.036537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8bae2a-ab0b-4602-98cc-cbffdb1e4a46 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:05.037587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8bae2a-ab0b-4602-98cc-cbffdb1e4a46 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:05.041702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8bae2a-ab0b-4602-98cc-cbffdb1e4a46 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:05.043389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8bae2a-ab0b-4602-98cc-cbffdb1e4a46 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:05.046326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8bae2a-ab0b-4602-98cc-cbffdb1e4a46 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:05.162655 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a1afaa2f-dc71-4bdb-ab73-b441f8d960d5 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.162809 Sep 08 13:10:05.166245 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2285/4702] 10.222.0.78 () {58 vars in 1296 bytes} [Thu Sep 8 13:10:04 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c/os-instance-actions => generated 611 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:10:05.191202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0562ca97-ddb8-4159-97bf-7280b63613a4 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:05.192863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0562ca97-ddb8-4159-97bf-7280b63613a4 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:05.203827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0562ca97-ddb8-4159-97bf-7280b63613a4 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:05.205570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0562ca97-ddb8-4159-97bf-7280b63613a4 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:05.207181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0562ca97-ddb8-4159-97bf-7280b63613a4 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:05.208763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0562ca97-ddb8-4159-97bf-7280b63613a4 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:05.209879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0562ca97-ddb8-4159-97bf-7280b63613a4 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:05.210944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0562ca97-ddb8-4159-97bf-7280b63613a4 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:05.289257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0562ca97-ddb8-4159-97bf-7280b63613a4 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:10:05.581264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f8bae2a-ab0b-4602-98cc-cbffdb1e4a46 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:05.637749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f8bae2a-ab0b-4602-98cc-cbffdb1e4a46 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:05.643737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f8bae2a-ab0b-4602-98cc-cbffdb1e4a46 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:05.656617 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f8bae2a-ab0b-4602-98cc-cbffdb1e4a46 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.691751 Sep 08 13:10:05.659386 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2418/4703] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:10:04 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:10:05.729319 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0562ca97-ddb8-4159-97bf-7280b63613a4 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 204 len: 0 microversion: 2.1 time: 0.548636 Sep 08 13:10:05.735110 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2286/4704] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:10:05 2022] DELETE /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:10:05.761870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d0e6416-1520-40b8-b41a-bdb4eb6686bf tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:05.761870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6d0e6416-1520-40b8-b41a-bdb4eb6686bf tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:05.785461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d0e6416-1520-40b8-b41a-bdb4eb6686bf tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:05.785973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d0e6416-1520-40b8-b41a-bdb4eb6686bf tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:05.786894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d0e6416-1520-40b8-b41a-bdb4eb6686bf tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:05.788322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d0e6416-1520-40b8-b41a-bdb4eb6686bf tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:05.790010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d0e6416-1520-40b8-b41a-bdb4eb6686bf tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:05.791178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d0e6416-1520-40b8-b41a-bdb4eb6686bf tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:05.997302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f7c3ec0e-47b3-4fa6-9c67-bbca3a88d3bd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:06.002818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f7c3ec0e-47b3-4fa6-9c67-bbca3a88d3bd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:06.030615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7c3ec0e-47b3-4fa6-9c67-bbca3a88d3bd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:06.031015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7c3ec0e-47b3-4fa6-9c67-bbca3a88d3bd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:06.036464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7c3ec0e-47b3-4fa6-9c67-bbca3a88d3bd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:06.040835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7c3ec0e-47b3-4fa6-9c67-bbca3a88d3bd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:06.041960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7c3ec0e-47b3-4fa6-9c67-bbca3a88d3bd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:06.049592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7c3ec0e-47b3-4fa6-9c67-bbca3a88d3bd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:06.355548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d0e6416-1520-40b8-b41a-bdb4eb6686bf tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:06.383278 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6d0e6416-1520-40b8-b41a-bdb4eb6686bf tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1510 microversion: 2.1 time: 0.639276 Sep 08 13:10:06.403839 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2419/4705] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:05 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1510 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:06.560867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f7c3ec0e-47b3-4fa6-9c67-bbca3a88d3bd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:06.584447 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f7c3ec0e-47b3-4fa6-9c67-bbca3a88d3bd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1512 microversion: 2.1 time: 0.595075 Sep 08 13:10:06.589942 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2287/4706] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:05 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1512 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:06.713285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b5a9d75a-a464-473f-8357-1517b98ce28b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:06.714393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b5a9d75a-a464-473f-8357-1517b98ce28b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:06.742064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5a9d75a-a464-473f-8357-1517b98ce28b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:06.742969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5a9d75a-a464-473f-8357-1517b98ce28b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:06.743834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5a9d75a-a464-473f-8357-1517b98ce28b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:06.745193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5a9d75a-a464-473f-8357-1517b98ce28b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:06.746057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5a9d75a-a464-473f-8357-1517b98ce28b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:06.756426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5a9d75a-a464-473f-8357-1517b98ce28b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:07.384316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b5a9d75a-a464-473f-8357-1517b98ce28b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:07.400182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b5a9d75a-a464-473f-8357-1517b98ce28b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:07.403364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b5a9d75a-a464-473f-8357-1517b98ce28b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:07.412559 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b5a9d75a-a464-473f-8357-1517b98ce28b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.706708 Sep 08 13:10:07.414355 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2420/4707] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:10:06 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:10:07.445929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-55cc55f1-219e-454f-a963-017b0f0a9c0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:07.446911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-55cc55f1-219e-454f-a963-017b0f0a9c0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:07.464198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55cc55f1-219e-454f-a963-017b0f0a9c0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:07.464864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55cc55f1-219e-454f-a963-017b0f0a9c0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:07.465535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55cc55f1-219e-454f-a963-017b0f0a9c0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:07.466518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55cc55f1-219e-454f-a963-017b0f0a9c0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:07.467196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55cc55f1-219e-454f-a963-017b0f0a9c0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:07.472679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55cc55f1-219e-454f-a963-017b0f0a9c0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:07.637512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-028d2e42-9140-4f03-979d-5eae81ec2cc7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:07.638697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-028d2e42-9140-4f03-979d-5eae81ec2cc7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:07.648077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-028d2e42-9140-4f03-979d-5eae81ec2cc7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:07.650496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-028d2e42-9140-4f03-979d-5eae81ec2cc7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:07.651190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-028d2e42-9140-4f03-979d-5eae81ec2cc7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:07.652379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-028d2e42-9140-4f03-979d-5eae81ec2cc7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:07.653142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-028d2e42-9140-4f03-979d-5eae81ec2cc7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:07.653855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-028d2e42-9140-4f03-979d-5eae81ec2cc7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:08.058450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-028d2e42-9140-4f03-979d-5eae81ec2cc7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:08.072758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-55cc55f1-219e-454f-a963-017b0f0a9c0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:08.082859 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-55cc55f1-219e-454f-a963-017b0f0a9c0d tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1510 microversion: 2.1 time: 0.657022 Sep 08 13:10:08.085759 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-028d2e42-9140-4f03-979d-5eae81ec2cc7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1512 microversion: 2.1 time: 0.456662 Sep 08 13:10:08.087937 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2421/4708] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:07 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1512 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:10:08.088161 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2288/4709] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:07 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1510 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:08.405250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-04a46f56-919a-4207-b8fd-85e05bbed4d7 req-fc3580c3-1c17-4ffe-8aad-a01f1fef6e9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68", "name": "network-vif-plugged", "status": "completed", "tag": "bab66cd4-e2d1-4c9a-803e-24552207b4f0"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:10:08.441859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-04a46f56-919a-4207-b8fd-85e05bbed4d7 req-fc3580c3-1c17-4ffe-8aad-a01f1fef6e9f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:08.442698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-04a46f56-919a-4207-b8fd-85e05bbed4d7 req-fc3580c3-1c17-4ffe-8aad-a01f1fef6e9f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:08.457767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7e1c02d5-4341-4d66-9aa5-523267d0ad02 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:08.458911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7e1c02d5-4341-4d66-9aa5-523267d0ad02 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:08.471656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-04a46f56-919a-4207-b8fd-85e05bbed4d7 req-fc3580c3-1c17-4ffe-8aad-a01f1fef6e9f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:08.496009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e1c02d5-4341-4d66-9aa5-523267d0ad02 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:08.497047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e1c02d5-4341-4d66-9aa5-523267d0ad02 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:08.499547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e1c02d5-4341-4d66-9aa5-523267d0ad02 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:08.506413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e1c02d5-4341-4d66-9aa5-523267d0ad02 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:08.512881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e1c02d5-4341-4d66-9aa5-523267d0ad02 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:08.514325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e1c02d5-4341-4d66-9aa5-523267d0ad02 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:08.540891 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-04a46f56-919a-4207-b8fd-85e05bbed4d7 req-fc3580c3-1c17-4ffe-8aad-a01f1fef6e9f service nova] Creating event network-vif-plugged:bab66cd4-e2d1-4c9a-803e-24552207b4f0 for instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 on n-h2-852084-10 Sep 08 13:10:08.583114 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-04a46f56-919a-4207-b8fd-85e05bbed4d7 req-fc3580c3-1c17-4ffe-8aad-a01f1fef6e9f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.185709 Sep 08 13:10:08.596132 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2422/4710] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:10:09.108916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bf162d33-f581-44f0-98b9-211799de30f8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:09.110399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bf162d33-f581-44f0-98b9-211799de30f8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:09.130144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf162d33-f581-44f0-98b9-211799de30f8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:09.130707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf162d33-f581-44f0-98b9-211799de30f8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:09.131453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf162d33-f581-44f0-98b9-211799de30f8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:09.135769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf162d33-f581-44f0-98b9-211799de30f8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:09.137545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf162d33-f581-44f0-98b9-211799de30f8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:09.138326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf162d33-f581-44f0-98b9-211799de30f8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:09.389943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7e1c02d5-4341-4d66-9aa5-523267d0ad02 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:09.400641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7e1c02d5-4341-4d66-9aa5-523267d0ad02 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:09.404951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7e1c02d5-4341-4d66-9aa5-523267d0ad02 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:09.411001 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7e1c02d5-4341-4d66-9aa5-523267d0ad02 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.962498 Sep 08 13:10:09.415037 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2289/4711] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:10:08 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:10:09.427377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-1eaea6cd-8406-4c6b-a641-32c8b886da79 req-a817a1ea-2a8c-407f-be76-8b624c8be2b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5981dfd-0a38-4e7a-a91b-91e9b1bd203c", "name": "network-vif-deleted", "tag": "4bf82251-4137-45b9-8734-db89f1052418"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:10:09.465161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bf162d33-f581-44f0-98b9-211799de30f8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68846e7305b7461f89cd6bd00003ad63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4fbcd2605e24a6d9186a9422e43bc07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:09.465618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1eaea6cd-8406-4c6b-a641-32c8b886da79 req-a817a1ea-2a8c-407f-be76-8b624c8be2b5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:09.467902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:10:09.468269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1eaea6cd-8406-4c6b-a641-32c8b886da79 req-a817a1ea-2a8c-407f-be76-8b624c8be2b5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:09.470336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1eaea6cd-8406-4c6b-a641-32c8b886da79 req-a817a1ea-2a8c-407f-be76-8b624c8be2b5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:09.499305 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bf162d33-f581-44f0-98b9-211799de30f8 tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 200 len: 1468 microversion: 2.1 time: 0.376925 Sep 08 13:10:09.500754 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2423/4712] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:09 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 1468 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:10:09.514504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5d71c797-82c9-421f-8568-7795b7d3c588 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:09.516941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5d71c797-82c9-421f-8568-7795b7d3c588 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:09.525171 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-1eaea6cd-8406-4c6b-a641-32c8b886da79 req-a817a1ea-2a8c-407f-be76-8b624c8be2b5 service nova] Creating event network-vif-deleted:4bf82251-4137-45b9-8734-db89f1052418 for instance a5981dfd-0a38-4e7a-a91b-91e9b1bd203c on n-h2-852084-10 Sep 08 13:10:09.553854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d71c797-82c9-421f-8568-7795b7d3c588 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:09.555032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d71c797-82c9-421f-8568-7795b7d3c588 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:09.555537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d71c797-82c9-421f-8568-7795b7d3c588 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:09.556332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d71c797-82c9-421f-8568-7795b7d3c588 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:09.560553 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-1eaea6cd-8406-4c6b-a641-32c8b886da79 req-a817a1ea-2a8c-407f-be76-8b624c8be2b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140168 Sep 08 13:10:09.561692 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2290/4713] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:10:09.562318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d71c797-82c9-421f-8568-7795b7d3c588 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:09.563085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d71c797-82c9-421f-8568-7795b7d3c588 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:09.905475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5d71c797-82c9-421f-8568-7795b7d3c588 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:09.929917 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5d71c797-82c9-421f-8568-7795b7d3c588 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1512 microversion: 2.1 time: 0.427136 Sep 08 13:10:09.933198 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2424/4714] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:09 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1512 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:10.462196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54b0ec8f-240e-4297-8329-aa41d967de50 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:10.465441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54b0ec8f-240e-4297-8329-aa41d967de50 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:10.480823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54b0ec8f-240e-4297-8329-aa41d967de50 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:10.482164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54b0ec8f-240e-4297-8329-aa41d967de50 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:10.483278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54b0ec8f-240e-4297-8329-aa41d967de50 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:10.484560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54b0ec8f-240e-4297-8329-aa41d967de50 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:10.485325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54b0ec8f-240e-4297-8329-aa41d967de50 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:10.487287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54b0ec8f-240e-4297-8329-aa41d967de50 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:10.551461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-542c24f6-721b-447e-bf73-1064c1243d4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:10.558757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-542c24f6-721b-447e-bf73-1064c1243d4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] [instance: a5981dfd-0a38-4e7a-a91b-91e9b1bd203c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:10.586753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-542c24f6-721b-447e-bf73-1064c1243d4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:10.588213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-542c24f6-721b-447e-bf73-1064c1243d4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:10.589198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-542c24f6-721b-447e-bf73-1064c1243d4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:10.590742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-542c24f6-721b-447e-bf73-1064c1243d4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:10.592249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-542c24f6-721b-447e-bf73-1064c1243d4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:10.593260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-542c24f6-721b-447e-bf73-1064c1243d4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:10.630091 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-542c24f6-721b-447e-bf73-1064c1243d4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] HTTP exception thrown: Instance a5981dfd-0a38-4e7a-a91b-91e9b1bd203c could not be found. Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-542c24f6-721b-447e-bf73-1064c1243d4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Request method failure captured: Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c HTTP/1.1 Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGel_R4LPGYkRVgPo05-AyybZEG7N-lFubFBZvx71BvrBLGyPnKcEilSwqjaQ6kZDdTEJ3tq1YkEccfylDAPklX9YiqZjgCzhIs6mOhL5qBUlztWg1totuHha4fd7LCzJEqgNjrERp_epYB2FIjQcNGgRkmRM5FTpcAj7ueaXXnjX_i0 Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: f4fbcd2605e24a6d9186a9422e43bc07 Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-InstanceActionsTestJSON-146420544 Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_f4fbcd2605e24a6d9186a9422e43bc07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/f4fbcd2605e24a6d9186a9422e43bc07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4fbcd2605e24a6d9186a9422e43bc07"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/f4fbcd2605e24a6d9186a9422e43bc07"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-InstanceActionsTestJSON-146420544 Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: f4fbcd2605e24a6d9186a9422e43bc07 Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-InstanceActionsTestJSON-146420544 Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-InstanceActionsTestJSON-146420544-project Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 68846e7305b7461f89cd6bd00003ad63 Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-InstanceActionsTestJSON-146420544-project Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance a5981dfd-0a38-4e7a-a91b-91e9b1bd203c could not be found. Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'a5981dfd-0a38-4e7a-a91b-91e9b1bd203c'} Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5981dfd-0a38-4e7a-a91b-91e9b1bd203c could not be found. Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5981dfd-0a38-4e7a-a91b-91e9b1bd203c could not be found. Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:10:10.636692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:10:10.650513 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:10:10.650513 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:10:10.650513 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:10:10.650513 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:10:10.650513 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:10:10.650513 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5981dfd-0a38-4e7a-a91b-91e9b1bd203c could not be found. Sep 08 13:10:10.650513 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:10:10.650513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-542c24f6-721b-447e-bf73-1064c1243d4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] Returning 404 to user: Instance a5981dfd-0a38-4e7a-a91b-91e9b1bd203c could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:10:10.650513 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-542c24f6-721b-447e-bf73-1064c1243d4f tempest-InstanceActionsTestJSON-146420544 tempest-InstanceActionsTestJSON-146420544-project] 10.222.0.78 "GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c" status: 404 len: 111 microversion: 2.1 time: 0.106467 Sep 08 13:10:10.653685 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2425/4715] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:10 2022] GET /compute/v2.1/servers/a5981dfd-0a38-4e7a-a91b-91e9b1bd203c => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:10:10.998661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd285ea9-4d66-45a1-9b98-932a26c50f8c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:10.999798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dd285ea9-4d66-45a1-9b98-932a26c50f8c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:11.039682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd285ea9-4d66-45a1-9b98-932a26c50f8c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:11.040561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd285ea9-4d66-45a1-9b98-932a26c50f8c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:11.041288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd285ea9-4d66-45a1-9b98-932a26c50f8c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:11.042559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd285ea9-4d66-45a1-9b98-932a26c50f8c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:11.043464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd285ea9-4d66-45a1-9b98-932a26c50f8c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:11.054185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd285ea9-4d66-45a1-9b98-932a26c50f8c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:11.240294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54b0ec8f-240e-4297-8329-aa41d967de50 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:11.285197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54b0ec8f-240e-4297-8329-aa41d967de50 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:11.293033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54b0ec8f-240e-4297-8329-aa41d967de50 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:11.302054 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54b0ec8f-240e-4297-8329-aa41d967de50 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.844862 Sep 08 13:10:11.304120 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2291/4716] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:10:10 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:10:11.923208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-50beb7c0-579d-4e88-843f-a3cd7f3b4801 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Action: 'create', calling method: .version_select at 0x7fdb39cf2d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1714854776", "metadata": {"Type": "work"}}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:10:12.208977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dd285ea9-4d66-45a1-9b98-932a26c50f8c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:12.227408 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dd285ea9-4d66-45a1-9b98-932a26c50f8c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1533 microversion: 2.1 time: 1.253625 Sep 08 13:10:12.229666 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2426/4717] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:10 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1533 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:12.363397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9cdc61c1-027f-4717-934e-83a269db88ad tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:12.363397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9cdc61c1-027f-4717-934e-83a269db88ad tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:12.386544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9cdc61c1-027f-4717-934e-83a269db88ad tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:12.387508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9cdc61c1-027f-4717-934e-83a269db88ad tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:12.388328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9cdc61c1-027f-4717-934e-83a269db88ad tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:12.389652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9cdc61c1-027f-4717-934e-83a269db88ad tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:12.390524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9cdc61c1-027f-4717-934e-83a269db88ad tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:12.391343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9cdc61c1-027f-4717-934e-83a269db88ad tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:12.778220 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-50beb7c0-579d-4e88-843f-a3cd7f3b4801 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.382392 Sep 08 13:10:12.780122 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2292/4718] 10.222.0.78 () {60 vars in 1156 bytes} [Thu Sep 8 13:10:11 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1386 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 08 13:10:12.798564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-85d32810-46c3-4eb2-9ac7-bade7955484d tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb39dae040>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:12.971753 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-85d32810-46c3-4eb2-9ac7-bade7955484d tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 200 len: 353 microversion: 2.1 time: 0.177085 Sep 08 13:10:12.973368 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2293/4719] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 13:10:12 2022] GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 353 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:10:12.985930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9cdc61c1-027f-4717-934e-83a269db88ad tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:13.023419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9cdc61c1-027f-4717-934e-83a269db88ad tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:13.028660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9cdc61c1-027f-4717-934e-83a269db88ad tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:13.033531 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9cdc61c1-027f-4717-934e-83a269db88ad tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1809 microversion: 2.20 time: 0.677419 Sep 08 13:10:13.034748 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2427/4720] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:10:12 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1809 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:10:13.276193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3e8b0cb7-12d4-45a4-8d13-2b1645f62bc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:13.280303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3e8b0cb7-12d4-45a4-8d13-2b1645f62bc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:13.287406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:10:13.317998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e8b0cb7-12d4-45a4-8d13-2b1645f62bc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:13.322133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e8b0cb7-12d4-45a4-8d13-2b1645f62bc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:13.322906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e8b0cb7-12d4-45a4-8d13-2b1645f62bc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:13.329170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e8b0cb7-12d4-45a4-8d13-2b1645f62bc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:13.330107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e8b0cb7-12d4-45a4-8d13-2b1645f62bc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:13.330961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e8b0cb7-12d4-45a4-8d13-2b1645f62bc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:13.990195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3a4a2dc5-78a6-4f8e-b3ea-8f56c34992a6 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb3f2ec040>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:14.211214 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3a4a2dc5-78a6-4f8e-b3ea-8f56c34992a6 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 200 len: 353 microversion: 2.1 time: 0.226985 Sep 08 13:10:14.212499 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2428/4721] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 13:10:13 2022] GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 353 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:10:14.226348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-94fd0232-0756-411f-85d0-365b311e4e5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:14.233364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-94fd0232-0756-411f-85d0-365b311e4e5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:14.260529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94fd0232-0756-411f-85d0-365b311e4e5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:14.261339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94fd0232-0756-411f-85d0-365b311e4e5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:14.261952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94fd0232-0756-411f-85d0-365b311e4e5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:14.263613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94fd0232-0756-411f-85d0-365b311e4e5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:14.264551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94fd0232-0756-411f-85d0-365b311e4e5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:14.265312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94fd0232-0756-411f-85d0-365b311e4e5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:14.625657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3e8b0cb7-12d4-45a4-8d13-2b1645f62bc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:14.756876 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3e8b0cb7-12d4-45a4-8d13-2b1645f62bc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1533 microversion: 2.1 time: 1.477936 Sep 08 13:10:14.773678 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2294/4722] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:13 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1533 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:15.240401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-73041f09-5c64-4b48-9a3e-1e4e42d773b8 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb3af88dc0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:15.486697 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-73041f09-5c64-4b48-9a3e-1e4e42d773b8 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 200 len: 354 microversion: 2.1 time: 0.258283 Sep 08 13:10:15.488373 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2295/4723] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 13:10:15 2022] GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 354 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:10:15.513507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8b3781c8-932f-4943-8d9c-7c15ddd379b1 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb39dbf1f0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:15.836893 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8b3781c8-932f-4943-8d9c-7c15ddd379b1 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 200 len: 354 microversion: 2.1 time: 0.330794 Sep 08 13:10:15.838443 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2296/4724] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 13:10:15 2022] GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 354 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:10:15.863519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c47ef579-3bb3-49e0-a927-32ac0376d7d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:15.865187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c47ef579-3bb3-49e0-a927-32ac0376d7d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:15.893344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c47ef579-3bb3-49e0-a927-32ac0376d7d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:15.904824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c47ef579-3bb3-49e0-a927-32ac0376d7d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:15.905651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c47ef579-3bb3-49e0-a927-32ac0376d7d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:15.913090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c47ef579-3bb3-49e0-a927-32ac0376d7d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:15.917676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c47ef579-3bb3-49e0-a927-32ac0376d7d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:15.923927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c47ef579-3bb3-49e0-a927-32ac0376d7d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:16.329367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-94fd0232-0756-411f-85d0-365b311e4e5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:16.363056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-94fd0232-0756-411f-85d0-365b311e4e5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:16.366895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-94fd0232-0756-411f-85d0-365b311e4e5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:16.383469 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-94fd0232-0756-411f-85d0-365b311e4e5a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1796 microversion: 2.20 time: 2.160664 Sep 08 13:10:16.387693 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2429/4725] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:10:14 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1796 bytes in 2174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:10:16.406826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-954c1452-980a-44d9-9b2a-66c17efefc9a tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb36bf3280>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:16.643803 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-954c1452-980a-44d9-9b2a-66c17efefc9a tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 202 len: 0 microversion: 2.1 time: 0.252148 Sep 08 13:10:16.644975 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2430/4726] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 13:10:16 2022] DELETE /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:10:16.660766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d73202b0-9060-4134-baeb-5726867f7bf6 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb36cffb80>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:16.895948 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d73202b0-9060-4134-baeb-5726867f7bf6 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 200 len: 353 microversion: 2.1 time: 0.244415 Sep 08 13:10:16.896728 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2431/4727] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 13:10:16 2022] GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 353 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:10:17.248810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c47ef579-3bb3-49e0-a927-32ac0376d7d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:17.286329 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c47ef579-3bb3-49e0-a927-32ac0376d7d4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 1.445719 Sep 08 13:10:17.287506 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2297/4728] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:15 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:17.923939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0b10a0c1-b141-44d1-abb7-84f4bdcb5764 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb3f0ea4c0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:18.099170 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0b10a0c1-b141-44d1-abb7-84f4bdcb5764 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 200 len: 353 microversion: 2.1 time: 0.190236 Sep 08 13:10:18.106245 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2432/4729] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 13:10:17 2022] GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 353 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:10:18.326772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d1ab6907-dc9e-4b9e-a227-8ef2753e77c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:18.356074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d1ab6907-dc9e-4b9e-a227-8ef2753e77c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:18.410232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1ab6907-dc9e-4b9e-a227-8ef2753e77c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:18.436264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1ab6907-dc9e-4b9e-a227-8ef2753e77c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:18.437856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1ab6907-dc9e-4b9e-a227-8ef2753e77c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:18.442161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1ab6907-dc9e-4b9e-a227-8ef2753e77c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:18.443810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1ab6907-dc9e-4b9e-a227-8ef2753e77c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:18.445241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1ab6907-dc9e-4b9e-a227-8ef2753e77c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:19.119461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5d1dc627-910d-4d70-bf21-5182be73cb15 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb3f2ecb80>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:19.307709 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5d1dc627-910d-4d70-bf21-5182be73cb15 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 200 len: 353 microversion: 2.1 time: 0.195658 Sep 08 13:10:19.309327 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2433/4730] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 13:10:19 2022] GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:10:19.321819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d520dc3e-6260-4afb-96b0-4c5bde0f9989 req-3803b38f-53c6-42fb-932c-c9f81b59620f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb421d7-2415-43d2-a6bb-3fdbca098091", "name": "network-vif-plugged", "status": "completed", "tag": "633f3920-4732-4687-b8a2-8db04d18d889"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:10:19.364708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d520dc3e-6260-4afb-96b0-4c5bde0f9989 req-3803b38f-53c6-42fb-932c-c9f81b59620f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:19.371442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d520dc3e-6260-4afb-96b0-4c5bde0f9989 req-3803b38f-53c6-42fb-932c-c9f81b59620f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:19.372037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d520dc3e-6260-4afb-96b0-4c5bde0f9989 req-3803b38f-53c6-42fb-932c-c9f81b59620f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:19.485277 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d520dc3e-6260-4afb-96b0-4c5bde0f9989 req-3803b38f-53c6-42fb-932c-c9f81b59620f service nova] Creating event network-vif-plugged:633f3920-4732-4687-b8a2-8db04d18d889 for instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 on n-h1-852084-10 Sep 08 13:10:19.510550 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d520dc3e-6260-4afb-96b0-4c5bde0f9989 req-3803b38f-53c6-42fb-932c-c9f81b59620f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198725 Sep 08 13:10:19.518443 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2434/4731] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:10:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:10:20.187921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d1ab6907-dc9e-4b9e-a227-8ef2753e77c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:20.236382 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d1ab6907-dc9e-4b9e-a227-8ef2753e77c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 1.917235 Sep 08 13:10:20.238747 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2298/4732] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:18 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 1924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:20.343764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6cd9c9f6-718b-46e1-9f09-edf2a3b21a39 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb375c7af0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:20.659187 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6cd9c9f6-718b-46e1-9f09-edf2a3b21a39 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 200 len: 353 microversion: 2.1 time: 0.326103 Sep 08 13:10:20.660530 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2435/4733] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 13:10:20 2022] GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 353 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:10:21.289975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-82105118-2fa8-4192-a658-c1004ca880be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:21.293599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-82105118-2fa8-4192-a658-c1004ca880be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:21.349823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82105118-2fa8-4192-a658-c1004ca880be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:21.351098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82105118-2fa8-4192-a658-c1004ca880be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:21.353791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82105118-2fa8-4192-a658-c1004ca880be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:21.362617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82105118-2fa8-4192-a658-c1004ca880be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:21.370072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82105118-2fa8-4192-a658-c1004ca880be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:21.379651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82105118-2fa8-4192-a658-c1004ca880be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:21.686169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-807d7368-9c90-4d54-a573-73042fbdd846 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb3f0ea790>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:21.946450 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-807d7368-9c90-4d54-a573-73042fbdd846 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 200 len: 353 microversion: 2.1 time: 0.270252 Sep 08 13:10:21.948046 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2436/4734] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 13:10:21 2022] GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 353 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:10:22.976931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-602ea802-7808-4596-8386-28453d4d5f26 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb3f29b820>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:23.072621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-82105118-2fa8-4192-a658-c1004ca880be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:23.087646 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-82105118-2fa8-4192-a658-c1004ca880be tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 1.804859 Sep 08 13:10:23.110501 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2299/4735] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:21 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 1829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:10:23.268119 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-602ea802-7808-4596-8386-28453d4d5f26 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 200 len: 353 microversion: 2.1 time: 0.301708 Sep 08 13:10:23.285099 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2437/4736] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 13:10:22 2022] GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 353 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:10:24.168890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d25abf0c-ac9d-4971-8ab4-4c53c2842728 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:24.170198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d25abf0c-ac9d-4971-8ab4-4c53c2842728 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:24.256699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d25abf0c-ac9d-4971-8ab4-4c53c2842728 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:24.259913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d25abf0c-ac9d-4971-8ab4-4c53c2842728 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:24.265452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d25abf0c-ac9d-4971-8ab4-4c53c2842728 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:24.266992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d25abf0c-ac9d-4971-8ab4-4c53c2842728 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:24.267873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d25abf0c-ac9d-4971-8ab4-4c53c2842728 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:24.268665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d25abf0c-ac9d-4971-8ab4-4c53c2842728 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:24.295615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cd855f97-601d-4075-b7f6-e173b8d8fc41 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb3666e940>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:24.526052 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cd855f97-601d-4075-b7f6-e173b8d8fc41 tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 200 len: 353 microversion: 2.1 time: 0.238685 Sep 08 13:10:24.527003 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2438/4737] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 13:10:24 2022] GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 353 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:10:24.978212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d25abf0c-ac9d-4971-8ab4-4c53c2842728 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:25.006426 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d25abf0c-ac9d-4971-8ab4-4c53c2842728 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 0.879816 Sep 08 13:10:25.010190 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2300/4738] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:24 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:25.597125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f13c16b1-1ac9-43f1-af4e-15e13d758f4a tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Calling method '.version_select at 0x7fdb3f0ea430>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:25.677531 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-f13c16b1-1ac9-43f1-af4e-15e13d758f4a tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] HTTP exception thrown: Volume b31e0a8d-d87e-4bfe-b89b-12341914d11b could not be found. Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f13c16b1-1ac9-43f1-af4e-15e13d758f4a tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Request method failure captured: Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b HTTP/1.1 Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGemzuMc5cg9iyUPWXrZxtx6281ydEOBuGjPiHvqMvKwMbbhEtz-Av_fFpydKpElxa5BQ1FK0du7GmQpXBQMx3Obdk2Ord2knoPyEyeFNNHe18QNdzNy_bdD-C2jyI1V-jyU0YyiafV9clW9H-ENcRAYN9vCm1lApi1h3qKs5wp9PMjo Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: dd30fe3064d647ebb3db635259f157df Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesGetTestJSON-1779130242 Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_dd30fe3064d647ebb3db635259f157df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/dd30fe3064d647ebb3db635259f157df"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd30fe3064d647ebb3db635259f157df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/dd30fe3064d647ebb3db635259f157df"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesGetTestJSON-1779130242 Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: dd30fe3064d647ebb3db635259f157df Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesGetTestJSON-1779130242 Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesGetTestJSON-1779130242-project Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: e9c8448d75fb4f8ea4c21d8802a6fbaf Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesGetTestJSON-1779130242-project Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: method: Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: exception: Volume b31e0a8d-d87e-4bfe-b89b-12341914d11b could not be found. Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'b31e0a8d-d87e-4bfe-b89b-12341914d11b'} Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b31e0a8d-d87e-4bfe-b89b-12341914d11b could not be found. (HTTP 404) (Request-ID: req-78a07cee-ec78-4806-bd70-4f719893f9a8) Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 08 13:10:25.680603 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b31e0a8d-d87e-4bfe-b89b-12341914d11b could not be found. Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b31e0a8d-d87e-4bfe-b89b-12341914d11b could not be found. Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b31e0a8d-d87e-4bfe-b89b-12341914d11b could not be found. Sep 08 13:10:25.686186 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:10:25.694679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f13c16b1-1ac9-43f1-af4e-15e13d758f4a tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] Returning 404 to user: Volume b31e0a8d-d87e-4bfe-b89b-12341914d11b could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:10:25.713171 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f13c16b1-1ac9-43f1-af4e-15e13d758f4a tempest-VolumesGetTestJSON-1779130242 tempest-VolumesGetTestJSON-1779130242-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b" status: 404 len: 109 microversion: 2.1 time: 0.166652 Sep 08 13:10:25.714771 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2439/4739] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Sep 8 13:10:25 2022] GET /compute/v2.1/os-volumes/b31e0a8d-d87e-4bfe-b89b-12341914d11b => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:10:26.061898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f79e5160-c4ff-49f6-a1a4-0c69a0e798e1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:26.064315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f79e5160-c4ff-49f6-a1a4-0c69a0e798e1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:26.096658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f79e5160-c4ff-49f6-a1a4-0c69a0e798e1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:26.100684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f79e5160-c4ff-49f6-a1a4-0c69a0e798e1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:26.101792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f79e5160-c4ff-49f6-a1a4-0c69a0e798e1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:26.104643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f79e5160-c4ff-49f6-a1a4-0c69a0e798e1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:26.110899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f79e5160-c4ff-49f6-a1a4-0c69a0e798e1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:26.112267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f79e5160-c4ff-49f6-a1a4-0c69a0e798e1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:26.728564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f79e5160-c4ff-49f6-a1a4-0c69a0e798e1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:26.754739 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f79e5160-c4ff-49f6-a1a4-0c69a0e798e1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 0.698001 Sep 08 13:10:26.756610 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2301/4740] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:26 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:10:27.784693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bdd2ddb0-eca6-4e29-80a1-6891c16830e8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:27.788986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bdd2ddb0-eca6-4e29-80a1-6891c16830e8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:27.802793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=58 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:10:27.832083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bdd2ddb0-eca6-4e29-80a1-6891c16830e8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:27.832604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bdd2ddb0-eca6-4e29-80a1-6891c16830e8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:27.833076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bdd2ddb0-eca6-4e29-80a1-6891c16830e8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:27.833858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bdd2ddb0-eca6-4e29-80a1-6891c16830e8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:27.834335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bdd2ddb0-eca6-4e29-80a1-6891c16830e8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:27.834781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bdd2ddb0-eca6-4e29-80a1-6891c16830e8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:28.469367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bdd2ddb0-eca6-4e29-80a1-6891c16830e8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:28.528719 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bdd2ddb0-eca6-4e29-80a1-6891c16830e8 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 0.748677 Sep 08 13:10:28.548212 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2440/4741] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:27 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:10:29.578988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0966439f-875b-49e5-a8bb-5da9112ad5a3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:29.579973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0966439f-875b-49e5-a8bb-5da9112ad5a3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:29.617044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0966439f-875b-49e5-a8bb-5da9112ad5a3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:29.617841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0966439f-875b-49e5-a8bb-5da9112ad5a3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:29.618380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0966439f-875b-49e5-a8bb-5da9112ad5a3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:29.621028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0966439f-875b-49e5-a8bb-5da9112ad5a3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:29.626241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0966439f-875b-49e5-a8bb-5da9112ad5a3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:29.629445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0966439f-875b-49e5-a8bb-5da9112ad5a3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:29.802774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:10:31.113209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0966439f-875b-49e5-a8bb-5da9112ad5a3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:31.157056 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0966439f-875b-49e5-a8bb-5da9112ad5a3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 1.584176 Sep 08 13:10:31.158116 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2302/4742] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:29 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:32.198395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-723424b8-44f0-4914-9a44-a316595330c1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:32.199366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-723424b8-44f0-4914-9a44-a316595330c1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:32.229648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-723424b8-44f0-4914-9a44-a316595330c1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:32.239993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-723424b8-44f0-4914-9a44-a316595330c1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:32.243676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-723424b8-44f0-4914-9a44-a316595330c1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:32.248806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-723424b8-44f0-4914-9a44-a316595330c1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:32.252136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-723424b8-44f0-4914-9a44-a316595330c1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:32.252593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-723424b8-44f0-4914-9a44-a316595330c1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:33.103138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-723424b8-44f0-4914-9a44-a316595330c1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:33.168152 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-723424b8-44f0-4914-9a44-a316595330c1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 0.973802 Sep 08 13:10:33.173384 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2441/4743] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:32 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:34.219406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-93c392a4-6dcc-4ee5-9d32-d31b8f869db4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:34.220938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-93c392a4-6dcc-4ee5-9d32-d31b8f869db4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:34.285305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93c392a4-6dcc-4ee5-9d32-d31b8f869db4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:34.286984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93c392a4-6dcc-4ee5-9d32-d31b8f869db4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:34.288507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93c392a4-6dcc-4ee5-9d32-d31b8f869db4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:34.297473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93c392a4-6dcc-4ee5-9d32-d31b8f869db4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:34.299045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93c392a4-6dcc-4ee5-9d32-d31b8f869db4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:34.304740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93c392a4-6dcc-4ee5-9d32-d31b8f869db4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:35.549921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-93c392a4-6dcc-4ee5-9d32-d31b8f869db4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:35.597406 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-93c392a4-6dcc-4ee5-9d32-d31b8f869db4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 1.381990 Sep 08 13:10:35.630569 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2303/4744] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:34 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:36.653843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3be2d2a3-80d5-4470-a77b-7849b5df0c00 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:36.656568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3be2d2a3-80d5-4470-a77b-7849b5df0c00 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:36.701125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3be2d2a3-80d5-4470-a77b-7849b5df0c00 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:36.707725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3be2d2a3-80d5-4470-a77b-7849b5df0c00 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:36.720215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3be2d2a3-80d5-4470-a77b-7849b5df0c00 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:36.721396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3be2d2a3-80d5-4470-a77b-7849b5df0c00 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:36.721897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3be2d2a3-80d5-4470-a77b-7849b5df0c00 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:36.722345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3be2d2a3-80d5-4470-a77b-7849b5df0c00 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:38.169669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3be2d2a3-80d5-4470-a77b-7849b5df0c00 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:38.244065 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3be2d2a3-80d5-4470-a77b-7849b5df0c00 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 1.594327 Sep 08 13:10:38.250238 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2442/4745] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:36 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 1603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:39.283341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1cb01a29-954c-476b-839c-4bb93c2b7d14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:39.284162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1cb01a29-954c-476b-839c-4bb93c2b7d14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:39.317317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cb01a29-954c-476b-839c-4bb93c2b7d14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:39.317950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cb01a29-954c-476b-839c-4bb93c2b7d14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:39.318931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cb01a29-954c-476b-839c-4bb93c2b7d14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:39.337379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cb01a29-954c-476b-839c-4bb93c2b7d14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:39.349391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cb01a29-954c-476b-839c-4bb93c2b7d14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:39.350235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cb01a29-954c-476b-839c-4bb93c2b7d14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:41.375330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1cb01a29-954c-476b-839c-4bb93c2b7d14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:41.398803 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1cb01a29-954c-476b-839c-4bb93c2b7d14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 2.122814 Sep 08 13:10:41.407307 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2304/4746] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:39 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 2133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:42.438153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-77c1dbd7-8018-4bc0-a34c-4d3a1e045e8f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:42.439001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-77c1dbd7-8018-4bc0-a34c-4d3a1e045e8f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:42.458653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77c1dbd7-8018-4bc0-a34c-4d3a1e045e8f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:42.463196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77c1dbd7-8018-4bc0-a34c-4d3a1e045e8f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:42.464455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77c1dbd7-8018-4bc0-a34c-4d3a1e045e8f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:42.465486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77c1dbd7-8018-4bc0-a34c-4d3a1e045e8f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:42.467647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77c1dbd7-8018-4bc0-a34c-4d3a1e045e8f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:42.470359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77c1dbd7-8018-4bc0-a34c-4d3a1e045e8f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:42.565863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=48 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:10:43.896325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-77c1dbd7-8018-4bc0-a34c-4d3a1e045e8f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:43.913399 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-77c1dbd7-8018-4bc0-a34c-4d3a1e045e8f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 1.479566 Sep 08 13:10:43.930855 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2443/4747] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:42 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 1501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:44.943989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cdfd4153-5031-4c15-8645-92be682cb42e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:44.944716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cdfd4153-5031-4c15-8645-92be682cb42e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:44.976133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=18 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:10:44.982869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdfd4153-5031-4c15-8645-92be682cb42e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:44.982869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdfd4153-5031-4c15-8645-92be682cb42e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:44.991867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdfd4153-5031-4c15-8645-92be682cb42e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:44.993438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdfd4153-5031-4c15-8645-92be682cb42e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:45.002616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdfd4153-5031-4c15-8645-92be682cb42e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:45.005245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cdfd4153-5031-4c15-8645-92be682cb42e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:46.129585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cdfd4153-5031-4c15-8645-92be682cb42e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:46.169939 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cdfd4153-5031-4c15-8645-92be682cb42e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 1.231611 Sep 08 13:10:46.171595 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2305/4748] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:44 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:46.399055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-921aba03-eb53-4eee-9e5d-454ad0367bb3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:46.400177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-921aba03-eb53-4eee-9e5d-454ad0367bb3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:46.451015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-921aba03-eb53-4eee-9e5d-454ad0367bb3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:46.470501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-921aba03-eb53-4eee-9e5d-454ad0367bb3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:46.478748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-921aba03-eb53-4eee-9e5d-454ad0367bb3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:46.485881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-921aba03-eb53-4eee-9e5d-454ad0367bb3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:46.488361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-921aba03-eb53-4eee-9e5d-454ad0367bb3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:46.491174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-921aba03-eb53-4eee-9e5d-454ad0367bb3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:46.582963 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-921aba03-eb53-4eee-9e5d-454ad0367bb3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments/fd96fe58-e4ea-4dc7-a1b8-2fe44057dad3" status: 200 len: 194 microversion: 2.20 time: 0.189059 Sep 08 13:10:46.598701 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2444/4749] 10.222.0.78 () {60 vars in 1454 bytes} [Thu Sep 8 13:10:46 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments/fd96fe58-e4ea-4dc7-a1b8-2fe44057dad3 => generated 194 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:10:46.782626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a021c42c-3cf0-4bad-93e4-8d5bc1af39de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:46.783531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a021c42c-3cf0-4bad-93e4-8d5bc1af39de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:46.804725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a021c42c-3cf0-4bad-93e4-8d5bc1af39de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:46.805226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a021c42c-3cf0-4bad-93e4-8d5bc1af39de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:46.808122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a021c42c-3cf0-4bad-93e4-8d5bc1af39de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:46.821243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a021c42c-3cf0-4bad-93e4-8d5bc1af39de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:46.822998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a021c42c-3cf0-4bad-93e4-8d5bc1af39de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:46.827842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a021c42c-3cf0-4bad-93e4-8d5bc1af39de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:47.200157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-a021c42c-3cf0-4bad-93e4-8d5bc1af39de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lazy-loading 'services' on Instance uuid a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:10:47.222591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d9b1488-0879-4723-afdf-aa998bf2014d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:47.227165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6d9b1488-0879-4723-afdf-aa998bf2014d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:47.253726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d9b1488-0879-4723-afdf-aa998bf2014d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:47.258007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d9b1488-0879-4723-afdf-aa998bf2014d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:47.259719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d9b1488-0879-4723-afdf-aa998bf2014d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:47.264438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d9b1488-0879-4723-afdf-aa998bf2014d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:47.268466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d9b1488-0879-4723-afdf-aa998bf2014d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:47.272487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d9b1488-0879-4723-afdf-aa998bf2014d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:47.480995 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a021c42c-3cf0-4bad-93e4-8d5bc1af39de tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments/fd96fe58-e4ea-4dc7-a1b8-2fe44057dad3" status: 202 len: 0 microversion: 2.20 time: 0.704091 Sep 08 13:10:47.482282 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2306/4750] 10.222.0.78 () {60 vars in 1457 bytes} [Thu Sep 8 13:10:46 2022] DELETE /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments/fd96fe58-e4ea-4dc7-a1b8-2fe44057dad3 => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:10:47.513240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3e963bf2-62dd-4cb3-ba67-c703559f6e2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:47.532312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3e963bf2-62dd-4cb3-ba67-c703559f6e2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:47.577998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e963bf2-62dd-4cb3-ba67-c703559f6e2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:47.582787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e963bf2-62dd-4cb3-ba67-c703559f6e2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:47.583379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e963bf2-62dd-4cb3-ba67-c703559f6e2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:47.585495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e963bf2-62dd-4cb3-ba67-c703559f6e2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:47.588789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e963bf2-62dd-4cb3-ba67-c703559f6e2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:47.589594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e963bf2-62dd-4cb3-ba67-c703559f6e2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:47.809607 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3e963bf2-62dd-4cb3-ba67-c703559f6e2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.290781 Sep 08 13:10:47.815076 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2307/4751] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:10:47 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:10:48.842138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-541f27e3-9788-4e60-8a3d-3f8ec9820eda tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:48.846495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-541f27e3-9788-4e60-8a3d-3f8ec9820eda tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:48.921706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-541f27e3-9788-4e60-8a3d-3f8ec9820eda tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:48.923033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-541f27e3-9788-4e60-8a3d-3f8ec9820eda tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:48.924175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-541f27e3-9788-4e60-8a3d-3f8ec9820eda tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:48.929132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-541f27e3-9788-4e60-8a3d-3f8ec9820eda tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:48.930639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-541f27e3-9788-4e60-8a3d-3f8ec9820eda tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:48.932205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-541f27e3-9788-4e60-8a3d-3f8ec9820eda tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:49.097280 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-541f27e3-9788-4e60-8a3d-3f8ec9820eda tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.265141 Sep 08 13:10:49.108161 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2308/4752] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:10:48 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:10:49.325508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d9b1488-0879-4723-afdf-aa998bf2014d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:49.364600 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6d9b1488-0879-4723-afdf-aa998bf2014d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 2.167429 Sep 08 13:10:49.399840 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2445/4753] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:47 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 2205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:10:50.123057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8bebcb08-ff31-4976-b100-a483cf559f4d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:50.126016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8bebcb08-ff31-4976-b100-a483cf559f4d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:50.164429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bebcb08-ff31-4976-b100-a483cf559f4d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:50.168288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bebcb08-ff31-4976-b100-a483cf559f4d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:50.169715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bebcb08-ff31-4976-b100-a483cf559f4d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:50.172824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bebcb08-ff31-4976-b100-a483cf559f4d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:50.195544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bebcb08-ff31-4976-b100-a483cf559f4d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:50.201092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8bebcb08-ff31-4976-b100-a483cf559f4d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:50.362579 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8bebcb08-ff31-4976-b100-a483cf559f4d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.248695 Sep 08 13:10:50.364409 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2309/4754] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:10:50 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:10:50.424303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c3a6e65e-924a-4894-a6b9-d876e69f116e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:50.431551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c3a6e65e-924a-4894-a6b9-d876e69f116e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:50.479172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3a6e65e-924a-4894-a6b9-d876e69f116e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:50.485488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3a6e65e-924a-4894-a6b9-d876e69f116e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:50.486564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3a6e65e-924a-4894-a6b9-d876e69f116e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:50.489481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3a6e65e-924a-4894-a6b9-d876e69f116e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:50.498821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3a6e65e-924a-4894-a6b9-d876e69f116e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:50.500000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3a6e65e-924a-4894-a6b9-d876e69f116e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:51.396736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4a7dce9e-bc87-4b7e-b3a2-58ede37cc938 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:51.408284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4a7dce9e-bc87-4b7e-b3a2-58ede37cc938 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:51.434660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a7dce9e-bc87-4b7e-b3a2-58ede37cc938 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:51.436051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a7dce9e-bc87-4b7e-b3a2-58ede37cc938 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:51.437708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a7dce9e-bc87-4b7e-b3a2-58ede37cc938 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:51.439398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a7dce9e-bc87-4b7e-b3a2-58ede37cc938 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:51.440533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a7dce9e-bc87-4b7e-b3a2-58ede37cc938 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:51.441590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a7dce9e-bc87-4b7e-b3a2-58ede37cc938 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:51.540652 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4a7dce9e-bc87-4b7e-b3a2-58ede37cc938 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.160713 Sep 08 13:10:51.543482 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2310/4755] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:10:51 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:10:52.116719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c3a6e65e-924a-4894-a6b9-d876e69f116e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:52.216172 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c3a6e65e-924a-4894-a6b9-d876e69f116e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 1.798832 Sep 08 13:10:52.240759 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2446/4756] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:50 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 1826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:52.575514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-28dcaab3-d16a-4b1d-9e90-2dc13c46c78b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:52.592640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-28dcaab3-d16a-4b1d-9e90-2dc13c46c78b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:52.652761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28dcaab3-d16a-4b1d-9e90-2dc13c46c78b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:52.654683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28dcaab3-d16a-4b1d-9e90-2dc13c46c78b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:52.661578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28dcaab3-d16a-4b1d-9e90-2dc13c46c78b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:52.665791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28dcaab3-d16a-4b1d-9e90-2dc13c46c78b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:52.671611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28dcaab3-d16a-4b1d-9e90-2dc13c46c78b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:52.672922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28dcaab3-d16a-4b1d-9e90-2dc13c46c78b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:52.919883 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-28dcaab3-d16a-4b1d-9e90-2dc13c46c78b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.354252 Sep 08 13:10:52.922829 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2311/4757] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:10:52 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:10:53.262489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ecac9ead-f92b-4951-812a-f5e932554dc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:53.266806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ecac9ead-f92b-4951-812a-f5e932554dc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:53.322280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecac9ead-f92b-4951-812a-f5e932554dc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:53.327125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecac9ead-f92b-4951-812a-f5e932554dc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:53.333945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecac9ead-f92b-4951-812a-f5e932554dc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:53.334933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecac9ead-f92b-4951-812a-f5e932554dc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:53.346434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecac9ead-f92b-4951-812a-f5e932554dc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:53.347525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ecac9ead-f92b-4951-812a-f5e932554dc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:53.953200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7156ff7c-ffa1-4999-a392-deb1cdd04ce6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:53.957228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7156ff7c-ffa1-4999-a392-deb1cdd04ce6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:54.026599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7156ff7c-ffa1-4999-a392-deb1cdd04ce6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:54.029088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7156ff7c-ffa1-4999-a392-deb1cdd04ce6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:54.032700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7156ff7c-ffa1-4999-a392-deb1cdd04ce6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:54.036272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7156ff7c-ffa1-4999-a392-deb1cdd04ce6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:54.037015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7156ff7c-ffa1-4999-a392-deb1cdd04ce6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:54.044162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7156ff7c-ffa1-4999-a392-deb1cdd04ce6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:54.129153 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7156ff7c-ffa1-4999-a392-deb1cdd04ce6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.193709 Sep 08 13:10:54.134987 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2312/4758] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:10:53 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:10:54.377560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ecac9ead-f92b-4951-812a-f5e932554dc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:54.452589 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ecac9ead-f92b-4951-812a-f5e932554dc1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 1.191735 Sep 08 13:10:54.454112 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2447/4759] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:53 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:55.156662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bd77f743-57bb-408c-b819-e02c642e4830 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:55.186074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bd77f743-57bb-408c-b819-e02c642e4830 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:55.222461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd77f743-57bb-408c-b819-e02c642e4830 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:55.223203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd77f743-57bb-408c-b819-e02c642e4830 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:55.223987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd77f743-57bb-408c-b819-e02c642e4830 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:55.225378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd77f743-57bb-408c-b819-e02c642e4830 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:55.226183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd77f743-57bb-408c-b819-e02c642e4830 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:55.226873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd77f743-57bb-408c-b819-e02c642e4830 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:55.340955 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bd77f743-57bb-408c-b819-e02c642e4830 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.193837 Sep 08 13:10:55.346947 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2313/4760] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:10:55 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:10:55.492279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ad4a1bf0-df29-498e-9304-5117e16419a1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:55.503326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ad4a1bf0-df29-498e-9304-5117e16419a1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:55.560084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad4a1bf0-df29-498e-9304-5117e16419a1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:55.572334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad4a1bf0-df29-498e-9304-5117e16419a1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:55.579155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad4a1bf0-df29-498e-9304-5117e16419a1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:55.586418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad4a1bf0-df29-498e-9304-5117e16419a1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:55.594262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad4a1bf0-df29-498e-9304-5117e16419a1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:55.595531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad4a1bf0-df29-498e-9304-5117e16419a1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:56.376870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bbdfec05-1ce2-4445-be25-471d15431ee0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:56.383710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bbdfec05-1ce2-4445-be25-471d15431ee0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:56.418051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbdfec05-1ce2-4445-be25-471d15431ee0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:56.418690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbdfec05-1ce2-4445-be25-471d15431ee0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:56.419159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbdfec05-1ce2-4445-be25-471d15431ee0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:56.425720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbdfec05-1ce2-4445-be25-471d15431ee0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:56.429660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbdfec05-1ce2-4445-be25-471d15431ee0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:56.431532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbdfec05-1ce2-4445-be25-471d15431ee0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:56.533386 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bbdfec05-1ce2-4445-be25-471d15431ee0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.174948 Sep 08 13:10:56.549672 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2314/4761] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:10:56 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:10:56.818333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ad4a1bf0-df29-498e-9304-5117e16419a1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:56.878839 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ad4a1bf0-df29-498e-9304-5117e16419a1 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1528 microversion: 2.1 time: 1.388168 Sep 08 13:10:56.881736 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2448/4762] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:55 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1528 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:57.554603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7f148683-9ca4-400e-839d-d3c6399de061 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:57.558384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f148683-9ca4-400e-839d-d3c6399de061 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:57.624839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f148683-9ca4-400e-839d-d3c6399de061 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:57.629539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f148683-9ca4-400e-839d-d3c6399de061 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:57.635079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f148683-9ca4-400e-839d-d3c6399de061 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:57.637076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f148683-9ca4-400e-839d-d3c6399de061 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:57.647075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f148683-9ca4-400e-839d-d3c6399de061 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:57.650037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f148683-9ca4-400e-839d-d3c6399de061 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:57.808965 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7f148683-9ca4-400e-839d-d3c6399de061 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.260537 Sep 08 13:10:57.810342 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2315/4763] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:10:57 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:10:57.932221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a597cf8b-9982-4439-95f9-4950bbbc978c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:57.934595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a597cf8b-9982-4439-95f9-4950bbbc978c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:57.940709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=18 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:10:57.965046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a597cf8b-9982-4439-95f9-4950bbbc978c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:57.967138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a597cf8b-9982-4439-95f9-4950bbbc978c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:57.972056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a597cf8b-9982-4439-95f9-4950bbbc978c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:57.980267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a597cf8b-9982-4439-95f9-4950bbbc978c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:57.981540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a597cf8b-9982-4439-95f9-4950bbbc978c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:57.982642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a597cf8b-9982-4439-95f9-4950bbbc978c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:58.741834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a597cf8b-9982-4439-95f9-4950bbbc978c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:10:58.779545 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a597cf8b-9982-4439-95f9-4950bbbc978c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1510 microversion: 2.1 time: 0.871585 Sep 08 13:10:58.787806 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2449/4764] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:57 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1510 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:10:58.831626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3c8e423-f71b-4c23-a0b4-56b3443dadcd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:58.840943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d3c8e423-f71b-4c23-a0b4-56b3443dadcd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:58.857729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3c8e423-f71b-4c23-a0b4-56b3443dadcd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:58.859660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3c8e423-f71b-4c23-a0b4-56b3443dadcd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:58.860879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3c8e423-f71b-4c23-a0b4-56b3443dadcd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:58.862507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3c8e423-f71b-4c23-a0b4-56b3443dadcd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:58.863749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3c8e423-f71b-4c23-a0b4-56b3443dadcd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:58.864879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3c8e423-f71b-4c23-a0b4-56b3443dadcd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:58.987340 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3c8e423-f71b-4c23-a0b4-56b3443dadcd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.150578 Sep 08 13:10:58.989503 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2316/4765] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:10:58 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:10:59.846579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-72ab49ea-9f4f-43a0-8f23-d0a35056e9ec tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:10:59.847810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-72ab49ea-9f4f-43a0-8f23-d0a35056e9ec tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:10:59.892653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72ab49ea-9f4f-43a0-8f23-d0a35056e9ec tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:59.893584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72ab49ea-9f4f-43a0-8f23-d0a35056e9ec tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:59.894441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72ab49ea-9f4f-43a0-8f23-d0a35056e9ec tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:10:59.895865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72ab49ea-9f4f-43a0-8f23-d0a35056e9ec tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:10:59.896705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72ab49ea-9f4f-43a0-8f23-d0a35056e9ec tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:10:59.908177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72ab49ea-9f4f-43a0-8f23-d0a35056e9ec tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:00.017154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-97d59c4d-5e34-43f9-8920-01e7ff57f4c1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:00.028179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-97d59c4d-5e34-43f9-8920-01e7ff57f4c1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:00.045135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97d59c4d-5e34-43f9-8920-01e7ff57f4c1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:00.047938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97d59c4d-5e34-43f9-8920-01e7ff57f4c1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:00.051389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97d59c4d-5e34-43f9-8920-01e7ff57f4c1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:00.056446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97d59c4d-5e34-43f9-8920-01e7ff57f4c1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:00.057152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97d59c4d-5e34-43f9-8920-01e7ff57f4c1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:00.059868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97d59c4d-5e34-43f9-8920-01e7ff57f4c1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:00.063582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:00.191196 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-97d59c4d-5e34-43f9-8920-01e7ff57f4c1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.175535 Sep 08 13:11:00.193465 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2317/4766] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:11:00 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:11:00.488190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-72ab49ea-9f4f-43a0-8f23-d0a35056e9ec tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:00.507750 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-72ab49ea-9f4f-43a0-8f23-d0a35056e9ec tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1510 microversion: 2.1 time: 0.685666 Sep 08 13:11:00.514327 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2450/4767] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:10:59 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1510 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:01.215557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a64f967-38ef-4c60-aa7c-5b530ef72c10 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:01.218568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2a64f967-38ef-4c60-aa7c-5b530ef72c10 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:01.258110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a64f967-38ef-4c60-aa7c-5b530ef72c10 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:01.260643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a64f967-38ef-4c60-aa7c-5b530ef72c10 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:01.262845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a64f967-38ef-4c60-aa7c-5b530ef72c10 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:01.265415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a64f967-38ef-4c60-aa7c-5b530ef72c10 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:01.268405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a64f967-38ef-4c60-aa7c-5b530ef72c10 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:01.277244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a64f967-38ef-4c60-aa7c-5b530ef72c10 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:01.397519 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a64f967-38ef-4c60-aa7c-5b530ef72c10 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.187822 Sep 08 13:11:01.400765 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2318/4768] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:11:01 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:11:01.555582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee218821-bb25-441b-add0-ec8f8fde74dd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:01.556471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ee218821-bb25-441b-add0-ec8f8fde74dd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:01.602023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee218821-bb25-441b-add0-ec8f8fde74dd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:01.611897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee218821-bb25-441b-add0-ec8f8fde74dd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:01.613419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee218821-bb25-441b-add0-ec8f8fde74dd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:01.619481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee218821-bb25-441b-add0-ec8f8fde74dd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:01.629549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0590ec99-54f0-4d4a-9143-560599c50cc7 req-4bece041-5ecd-47c5-86ec-2bbe5a488711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb421d7-2415-43d2-a6bb-3fdbca098091", "name": "network-vif-unplugged", "status": "completed", "tag": "633f3920-4732-4687-b8a2-8db04d18d889"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:01.636845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee218821-bb25-441b-add0-ec8f8fde74dd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:01.637686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee218821-bb25-441b-add0-ec8f8fde74dd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:01.708282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0590ec99-54f0-4d4a-9143-560599c50cc7 req-4bece041-5ecd-47c5-86ec-2bbe5a488711 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:01.709382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0590ec99-54f0-4d4a-9143-560599c50cc7 req-4bece041-5ecd-47c5-86ec-2bbe5a488711 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:01.718404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0590ec99-54f0-4d4a-9143-560599c50cc7 req-4bece041-5ecd-47c5-86ec-2bbe5a488711 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:01.841981 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0590ec99-54f0-4d4a-9143-560599c50cc7 req-4bece041-5ecd-47c5-86ec-2bbe5a488711 service nova] Creating event network-vif-unplugged:633f3920-4732-4687-b8a2-8db04d18d889 for instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 on n-h1-852084-10 Sep 08 13:11:01.862563 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0590ec99-54f0-4d4a-9143-560599c50cc7 req-4bece041-5ecd-47c5-86ec-2bbe5a488711 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.240916 Sep 08 13:11:01.870577 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2319/4769] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:11:02.421456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-10345735-b506-4ee6-bc3e-71ba468cb614 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:02.424056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-10345735-b506-4ee6-bc3e-71ba468cb614 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:02.456253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10345735-b506-4ee6-bc3e-71ba468cb614 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:02.461449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10345735-b506-4ee6-bc3e-71ba468cb614 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:02.462193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10345735-b506-4ee6-bc3e-71ba468cb614 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:02.463145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10345735-b506-4ee6-bc3e-71ba468cb614 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:02.468662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10345735-b506-4ee6-bc3e-71ba468cb614 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:02.469271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10345735-b506-4ee6-bc3e-71ba468cb614 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:02.476166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ee218821-bb25-441b-add0-ec8f8fde74dd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:02.528975 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee218821-bb25-441b-add0-ec8f8fde74dd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1510 microversion: 2.1 time: 0.978896 Sep 08 13:11:02.611540 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2451/4770] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:01 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1510 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:02.635882 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-10345735-b506-4ee6-bc3e-71ba468cb614 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.223112 Sep 08 13:11:02.644423 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2320/4771] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:11:02 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:11:03.589219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-22614fde-e218-4537-a144-04a423a06e1c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:03.592595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-22614fde-e218-4537-a144-04a423a06e1c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:03.616379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22614fde-e218-4537-a144-04a423a06e1c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:03.622767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22614fde-e218-4537-a144-04a423a06e1c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:03.624567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22614fde-e218-4537-a144-04a423a06e1c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:03.627029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22614fde-e218-4537-a144-04a423a06e1c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:03.634397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22614fde-e218-4537-a144-04a423a06e1c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:03.635345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22614fde-e218-4537-a144-04a423a06e1c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:03.660721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-703ed4bd-bb4b-4ec8-8b15-6b9730683bca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:03.664752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-703ed4bd-bb4b-4ec8-8b15-6b9730683bca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:03.710539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-703ed4bd-bb4b-4ec8-8b15-6b9730683bca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:03.723823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-703ed4bd-bb4b-4ec8-8b15-6b9730683bca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:03.724620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-703ed4bd-bb4b-4ec8-8b15-6b9730683bca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:03.730635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-703ed4bd-bb4b-4ec8-8b15-6b9730683bca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:03.731505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-703ed4bd-bb4b-4ec8-8b15-6b9730683bca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:03.736483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-703ed4bd-bb4b-4ec8-8b15-6b9730683bca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:03.881506 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-703ed4bd-bb4b-4ec8-8b15-6b9730683bca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.224590 Sep 08 13:11:03.891973 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2321/4772] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:11:03 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68/os-volume_attachments => generated 25 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:11:04.034246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4ef8ad7f-9992-4940-8fcd-94d23c748cf7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:04.035113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ef8ad7f-9992-4940-8fcd-94d23c748cf7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:04.054676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ef8ad7f-9992-4940-8fcd-94d23c748cf7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:04.059245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ef8ad7f-9992-4940-8fcd-94d23c748cf7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:04.060408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ef8ad7f-9992-4940-8fcd-94d23c748cf7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:04.064754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ef8ad7f-9992-4940-8fcd-94d23c748cf7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:04.068139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ef8ad7f-9992-4940-8fcd-94d23c748cf7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:04.069882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ef8ad7f-9992-4940-8fcd-94d23c748cf7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:04.181001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ef8ad7f-9992-4940-8fcd-94d23c748cf7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:11:04.463824 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4ef8ad7f-9992-4940-8fcd-94d23c748cf7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 204 len: 0 microversion: 2.20 time: 0.437178 Sep 08 13:11:04.465738 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2322/4773] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:11:04 2022] DELETE /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:11:04.495797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-50f0e0eb-f932-4a8d-9d48-00b153399a3d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:04.496778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-50f0e0eb-f932-4a8d-9d48-00b153399a3d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:04.514570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50f0e0eb-f932-4a8d-9d48-00b153399a3d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:04.515933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50f0e0eb-f932-4a8d-9d48-00b153399a3d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:04.516579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50f0e0eb-f932-4a8d-9d48-00b153399a3d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:04.524092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50f0e0eb-f932-4a8d-9d48-00b153399a3d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:04.528437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50f0e0eb-f932-4a8d-9d48-00b153399a3d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:04.535263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50f0e0eb-f932-4a8d-9d48-00b153399a3d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:05.427854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-22614fde-e218-4537-a144-04a423a06e1c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:05.471717 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-22614fde-e218-4537-a144-04a423a06e1c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1453 microversion: 2.1 time: 1.883075 Sep 08 13:11:05.474016 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2452/4774] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:03 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1453 bytes in 1894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:05.515639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d0daccb6-8b13-423a-8f1e-ab868c5bb7e6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:05.524356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d0daccb6-8b13-423a-8f1e-ab868c5bb7e6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:05.542431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d0daccb6-8b13-423a-8f1e-ab868c5bb7e6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:05.543560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d0daccb6-8b13-423a-8f1e-ab868c5bb7e6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:05.544869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d0daccb6-8b13-423a-8f1e-ab868c5bb7e6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:05.547566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d0daccb6-8b13-423a-8f1e-ab868c5bb7e6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:05.548434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d0daccb6-8b13-423a-8f1e-ab868c5bb7e6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:05.549156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d0daccb6-8b13-423a-8f1e-ab868c5bb7e6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:06.689884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-50f0e0eb-f932-4a8d-9d48-00b153399a3d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:06.724067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-50f0e0eb-f932-4a8d-9d48-00b153399a3d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:06.727762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-50f0e0eb-f932-4a8d-9d48-00b153399a3d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:06.732348 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-50f0e0eb-f932-4a8d-9d48-00b153399a3d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1724 microversion: 2.20 time: 2.258070 Sep 08 13:11:06.737444 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2323/4775] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:04 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1724 bytes in 2265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:07.194940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d0daccb6-8b13-423a-8f1e-ab868c5bb7e6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:07.228809 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d0daccb6-8b13-423a-8f1e-ab868c5bb7e6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1453 microversion: 2.1 time: 1.721739 Sep 08 13:11:07.234547 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2453/4776] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:05 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1453 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:11:07.324432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:07.327897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:07.354856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:07.358393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:07.359574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:07.364209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:07.365004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:07.365462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:07.477288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lazy-loading 'flavor' on Instance uuid 4eb421d7-2415-43d2-a6bb-3fdbca098091 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:11:07.511657 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Cannot 'shelve' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state shelved_offloaded Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action HTTP/1.1 Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 14 Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: {"shelve": {}} Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: exception: Cannot 'shelve' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state shelved_offloaded Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '4eb421d7-2415-43d2-a6bb-3fdbca098091', 'body': {'shelve': {}}} Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:11:07.519216 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state shelved_offloaded Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state shelved_offloaded Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 409 to user: Cannot 'shelve' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state shelved_offloaded {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6d451bde-9398-4bbb-9b78-766c56020640 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 409 len: 155 microversion: 2.1 time: 0.204410 Sep 08 13:11:07.526445 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2324/4777] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:11:07 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 155 bytes in 208 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:11:07.534678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-040159fd-62f6-4e0b-b976-3882dd1d24db tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:07.535442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-040159fd-62f6-4e0b-b976-3882dd1d24db tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:07.553539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-040159fd-62f6-4e0b-b976-3882dd1d24db tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:07.554954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-040159fd-62f6-4e0b-b976-3882dd1d24db tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:07.557388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-040159fd-62f6-4e0b-b976-3882dd1d24db tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:07.559580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-040159fd-62f6-4e0b-b976-3882dd1d24db tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:07.560371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-040159fd-62f6-4e0b-b976-3882dd1d24db tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:07.561124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-040159fd-62f6-4e0b-b976-3882dd1d24db tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:07.921851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-479658ad-7a08-42e1-bf41-3049f8ae5d18 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] Action: 'create', calling method: .version_select at 0x7fdb39cc6ee0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:07.978725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-479658ad-7a08-42e1-bf41-3049f8ae5d18 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] Getting quotas for project 8e84252a02c84993a704215b1bf4e3cc. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:11:08.013039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-479658ad-7a08-42e1-bf41-3049f8ae5d18 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] Getting quotas for user a2f8fe4eedce46ec818499860e5ae4e6 and project 8e84252a02c84993a704215b1bf4e3cc. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:11:08.125436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-479658ad-7a08-42e1-bf41-3049f8ae5d18 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] Getting quotas for project 8e84252a02c84993a704215b1bf4e3cc. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:11:08.144026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-479658ad-7a08-42e1-bf41-3049f8ae5d18 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] Getting quotas for user a2f8fe4eedce46ec818499860e5ae4e6 and project 8e84252a02c84993a704215b1bf4e3cc. Resources: {'server_groups'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:11:08.173531 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-479658ad-7a08-42e1-bf41-3049f8ae5d18 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] 10.222.0.78 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.546515 Sep 08 13:11:08.174618 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2325/4778] 10.222.0.78 () {62 vars in 1214 bytes} [Thu Sep 8 13:11:07 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:11:08.190599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5fb8edfc-a8fc-4b8c-8dc0-0e995ed20b42 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:08.192133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5fb8edfc-a8fc-4b8c-8dc0-0e995ed20b42 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:08.205776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fb8edfc-a8fc-4b8c-8dc0-0e995ed20b42 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:08.207852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fb8edfc-a8fc-4b8c-8dc0-0e995ed20b42 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:08.208834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fb8edfc-a8fc-4b8c-8dc0-0e995ed20b42 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:08.210335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fb8edfc-a8fc-4b8c-8dc0-0e995ed20b42 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:08.211435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fb8edfc-a8fc-4b8c-8dc0-0e995ed20b42 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:08.212443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fb8edfc-a8fc-4b8c-8dc0-0e995ed20b42 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:08.298401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-040159fd-62f6-4e0b-b976-3882dd1d24db tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128970) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 13:11:08.476303 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-040159fd-62f6-4e0b-b976-3882dd1d24db tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 202 len: 0 microversion: 2.1 time: 0.947111 Sep 08 13:11:08.485247 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2454/4779] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:11:07 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 0 bytes in 955 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:11:08.495765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a1b393a4-94ed-491b-bdce-81cc30cfa889 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:08.517136 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a1b393a4-94ed-491b-bdce-81cc30cfa889 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.029642 Sep 08 13:11:08.518447 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2455/4780] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Sep 8 13:11:08 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:11:08.527279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2431c2aa-bb2b-4f73-a37f-407dd455575f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:08.528418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2431c2aa-bb2b-4f73-a37f-407dd455575f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:08.537850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2431c2aa-bb2b-4f73-a37f-407dd455575f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:08.538794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2431c2aa-bb2b-4f73-a37f-407dd455575f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:08.539888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2431c2aa-bb2b-4f73-a37f-407dd455575f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:08.543332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2431c2aa-bb2b-4f73-a37f-407dd455575f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:08.545264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2431c2aa-bb2b-4f73-a37f-407dd455575f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:08.546732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2431c2aa-bb2b-4f73-a37f-407dd455575f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:10.638562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2431c2aa-bb2b-4f73-a37f-407dd455575f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:10.694269 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2431c2aa-bb2b-4f73-a37f-407dd455575f tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1461 microversion: 2.1 time: 2.171776 Sep 08 13:11:10.694984 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2456/4781] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:08 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1461 bytes in 2176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:10.710850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-43b23914-6484-4231-a963-222c75031512 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:10.736948 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-43b23914-6484-4231-a963-222c75031512 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] 10.222.0.78 "GET /compute/v2.1/os-server-groups/80141ee0-ad67-4cd6-b332-ec4fa226cb4d" status: 200 len: 235 microversion: 2.64 time: 0.040289 Sep 08 13:11:10.747665 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2457/4782] 10.222.0.78 () {60 vars in 1304 bytes} [Thu Sep 8 13:11:10 2022] GET /compute/v2.1/os-server-groups/80141ee0-ad67-4cd6-b332-ec4fa226cb4d => generated 235 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:11:10.761319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5fb8edfc-a8fc-4b8c-8dc0-0e995ed20b42 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:10.767615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eea5f99c-0ae6-4a59-9e9a-5aa52eceda6d tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:10.794925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5fb8edfc-a8fc-4b8c-8dc0-0e995ed20b42 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:10.804454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5fb8edfc-a8fc-4b8c-8dc0-0e995ed20b42 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:10.811774 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5fb8edfc-a8fc-4b8c-8dc0-0e995ed20b42 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1724 microversion: 2.20 time: 2.629586 Sep 08 13:11:10.827023 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2326/4783] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:08 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1724 bytes in 2651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:10.840374 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eea5f99c-0ae6-4a59-9e9a-5aa52eceda6d tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/80141ee0-ad67-4cd6-b332-ec4fa226cb4d" status: 204 len: 0 microversion: 2.64 time: 0.073011 Sep 08 13:11:10.841411 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2458/4784] 10.222.0.78 () {60 vars in 1307 bytes} [Thu Sep 8 13:11:10 2022] DELETE /compute/v2.1/os-server-groups/80141ee0-ad67-4cd6-b332-ec4fa226cb4d => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 08 13:11:10.869529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8079ce42-fdf3-4b7b-9797-ba5117944290 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:10.901854 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-8079ce42-fdf3-4b7b-9797-ba5117944290 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] HTTP exception thrown: Instance group 80141ee0-ad67-4cd6-b332-ec4fa226cb4d could not be found. Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8079ce42-fdf3-4b7b-9797-ba5117944290 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] Request method failure captured: Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/os-server-groups/80141ee0-ad67-4cd6-b332-ec4fa226cb4d HTTP/1.1 Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGenrHJ4ooCvRuzN_ZTd4-G5Q_RDmnOSnU9s9OALwAZLowuekJa0OF6pK5v-b0k2SVcFkw5BtmNT7IBYSdlcGsEMIWn6r7RphG-BCrgH0FUVHY49FOW7yH59kDFrBkRiTvKSdMfVbEelEXkUxMS-RWGVf2jktWzIxbbmMlUEUK3NhfNQ Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.64 Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 8e84252a02c84993a704215b1bf4e3cc Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerGroup264TestJSON-103943147 Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8e84252a02c84993a704215b1bf4e3cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8e84252a02c84993a704215b1bf4e3cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e84252a02c84993a704215b1bf4e3cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8e84252a02c84993a704215b1bf4e3cc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerGroup264TestJSON-103943147 Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 8e84252a02c84993a704215b1bf4e3cc Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerGroup264TestJSON-103943147 Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerGroup264TestJSON-103943147-project Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: a2f8fe4eedce46ec818499860e5ae4e6 Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerGroup264TestJSON-103943147-project Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance group 80141ee0-ad67-4cd6-b332-ec4fa226cb4d could not be found. Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '80141ee0-ad67-4cd6-b332-ec4fa226cb4d'} Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 80141ee0-ad67-4cd6-b332-ec4fa226cb4d could not be found. Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 80141ee0-ad67-4cd6-b332-ec4fa226cb4d could not be found. Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:10.915194 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:11:10.924411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:11:10.924411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:11:10.924411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:11:10.924411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:11:10.924411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 80141ee0-ad67-4cd6-b332-ec4fa226cb4d could not be found. Sep 08 13:11:10.924411 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:10.925318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8079ce42-fdf3-4b7b-9797-ba5117944290 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] Returning 404 to user: Instance group 80141ee0-ad67-4cd6-b332-ec4fa226cb4d could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:11:10.928677 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8079ce42-fdf3-4b7b-9797-ba5117944290 tempest-ServerGroup264TestJSON-103943147 tempest-ServerGroup264TestJSON-103943147-project] 10.222.0.78 "DELETE /compute/v2.1/os-server-groups/80141ee0-ad67-4cd6-b332-ec4fa226cb4d" status: 404 len: 117 microversion: 2.64 time: 0.076647 Sep 08 13:11:10.931979 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2327/4785] 10.222.0.78 () {60 vars in 1307 bytes} [Thu Sep 8 13:11:10 2022] DELETE /compute/v2.1/os-server-groups/80141ee0-ad67-4cd6-b332-ec4fa226cb4d => generated 117 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:11:11.739628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-18376f41-e707-4bf5-9c8e-fd4fba6612fa tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:11.740631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-18376f41-e707-4bf5-9c8e-fd4fba6612fa tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:11.765141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18376f41-e707-4bf5-9c8e-fd4fba6612fa tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:11.767341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18376f41-e707-4bf5-9c8e-fd4fba6612fa tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:11.768318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18376f41-e707-4bf5-9c8e-fd4fba6612fa tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:11.769758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18376f41-e707-4bf5-9c8e-fd4fba6612fa tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:11.771310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18376f41-e707-4bf5-9c8e-fd4fba6612fa tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:11.772440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18376f41-e707-4bf5-9c8e-fd4fba6612fa tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:11.872370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-73011271-df5a-44b1-b911-9f06d273d890 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:11.873173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-73011271-df5a-44b1-b911-9f06d273d890 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:11.901245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73011271-df5a-44b1-b911-9f06d273d890 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:11.904673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73011271-df5a-44b1-b911-9f06d273d890 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:11.908020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73011271-df5a-44b1-b911-9f06d273d890 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:11.909860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73011271-df5a-44b1-b911-9f06d273d890 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:11.910981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73011271-df5a-44b1-b911-9f06d273d890 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:11.913799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73011271-df5a-44b1-b911-9f06d273d890 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:12.250140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-73011271-df5a-44b1-b911-9f06d273d890 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:12.277727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-73011271-df5a-44b1-b911-9f06d273d890 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:12.283066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-73011271-df5a-44b1-b911-9f06d273d890 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:12.285761 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-73011271-df5a-44b1-b911-9f06d273d890 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1656 microversion: 2.20 time: 0.419677 Sep 08 13:11:12.292481 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2328/4786] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:11 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1656 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:12.946784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-18376f41-e707-4bf5-9c8e-fd4fba6612fa tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:12.958214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:12.969069 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-18376f41-e707-4bf5-9c8e-fd4fba6612fa tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1461 microversion: 2.1 time: 1.233111 Sep 08 13:11:12.970144 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2459/4787] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:11 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1461 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:13.265222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-16db7a2a-7186-4684-be0d-736c7c7545e9 req-5fc0d1ed-8fb9-465b-8b8f-b309141626ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68", "name": "network-vif-deleted", "tag": "bab66cd4-e2d1-4c9a-803e-24552207b4f0"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:13.313925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-16db7a2a-7186-4684-be0d-736c7c7545e9 req-5fc0d1ed-8fb9-465b-8b8f-b309141626ac service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:13.318195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-16db7a2a-7186-4684-be0d-736c7c7545e9 req-5fc0d1ed-8fb9-465b-8b8f-b309141626ac service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:13.318779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-16db7a2a-7186-4684-be0d-736c7c7545e9 req-5fc0d1ed-8fb9-465b-8b8f-b309141626ac service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:13.340316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3faf8e3d-66c9-402c-8a94-39acf6deb6b3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:13.341817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3faf8e3d-66c9-402c-8a94-39acf6deb6b3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:13.364498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3faf8e3d-66c9-402c-8a94-39acf6deb6b3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:13.365395 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-16db7a2a-7186-4684-be0d-736c7c7545e9 req-5fc0d1ed-8fb9-465b-8b8f-b309141626ac service nova] Creating event network-vif-deleted:bab66cd4-e2d1-4c9a-803e-24552207b4f0 for instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 on n-h2-852084-10 Sep 08 13:11:13.366833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3faf8e3d-66c9-402c-8a94-39acf6deb6b3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:13.370507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3faf8e3d-66c9-402c-8a94-39acf6deb6b3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:13.375065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3faf8e3d-66c9-402c-8a94-39acf6deb6b3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:13.377639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3faf8e3d-66c9-402c-8a94-39acf6deb6b3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:13.382355 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-16db7a2a-7186-4684-be0d-736c7c7545e9 req-5fc0d1ed-8fb9-465b-8b8f-b309141626ac service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124225 Sep 08 13:11:13.382998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3faf8e3d-66c9-402c-8a94-39acf6deb6b3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:13.399063 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2329/4788] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:11:13.686278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3faf8e3d-66c9-402c-8a94-39acf6deb6b3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:13.723141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3faf8e3d-66c9-402c-8a94-39acf6deb6b3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:13.742813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3faf8e3d-66c9-402c-8a94-39acf6deb6b3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:13.745278 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3faf8e3d-66c9-402c-8a94-39acf6deb6b3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 200 len: 1366 microversion: 2.20 time: 0.412574 Sep 08 13:11:13.746423 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2460/4789] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:13 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:14.025157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-50b2ac4d-fc69-4272-979c-c814f2fb0358 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:14.032399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-50b2ac4d-fc69-4272-979c-c814f2fb0358 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:14.057696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50b2ac4d-fc69-4272-979c-c814f2fb0358 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:14.060870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50b2ac4d-fc69-4272-979c-c814f2fb0358 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:14.062180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50b2ac4d-fc69-4272-979c-c814f2fb0358 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:14.069503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50b2ac4d-fc69-4272-979c-c814f2fb0358 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:14.070316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50b2ac4d-fc69-4272-979c-c814f2fb0358 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:14.075146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50b2ac4d-fc69-4272-979c-c814f2fb0358 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:14.800692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e18fb200-3174-4b54-ab5a-0bf201c1372c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:14.803414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e18fb200-3174-4b54-ab5a-0bf201c1372c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:14.858611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e18fb200-3174-4b54-ab5a-0bf201c1372c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:14.868427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e18fb200-3174-4b54-ab5a-0bf201c1372c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:14.872245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e18fb200-3174-4b54-ab5a-0bf201c1372c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:14.873628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e18fb200-3174-4b54-ab5a-0bf201c1372c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:14.880885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e18fb200-3174-4b54-ab5a-0bf201c1372c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:14.881741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e18fb200-3174-4b54-ab5a-0bf201c1372c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:14.961616 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e18fb200-3174-4b54-ab5a-0bf201c1372c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] HTTP exception thrown: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e18fb200-3174-4b54-ab5a-0bf201c1372c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Request method failure captured: Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 HTTP/1.1 Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGejeY0G7Pzyo12zPbsJqxZazCm5XfFy5FeKTeuh2Cdz68kKa0hH5jVX-3GV2irJwRgmKI9ZKR9NXuG0gYi5tJIiri4zZkWklfHVzADvV5rMZsKtNYjvYuOWjj0gXceyBIowOvBzkOk2lsIp6cVXn0cZFXdU6ulV1gf9CrxhR2a60OVg Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 4b0e146de89146b9b1d07a8b07b1b77b Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 4b0e146de89146b9b1d07a8b07b1b77b Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachVolumeShelveTestJSON-1053339716-project Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9ccc775b0764dbf860508db1d2096bf Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1053339716-project Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68'} Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:11:14.973813 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:11:14.979004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:11:14.979004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:11:14.979004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:11:14.979004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:11:14.979004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:11:14.979004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:11:14.979004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:11:14.979004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:11:14.986717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e18fb200-3174-4b54-ab5a-0bf201c1372c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Returning 404 to user: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:11:14.991199 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e18fb200-3174-4b54-ab5a-0bf201c1372c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 404 len: 111 microversion: 2.20 time: 0.197702 Sep 08 13:11:14.995498 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2461/4790] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:14 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 111 bytes in 203 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:11:15.026596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2b93d3f2-d66c-4426-b73c-9da6fa5905f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '.version_select at 0x7fdb36db2e50>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:15.123393 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2b93d3f2-d66c-4426-b73c-9da6fa5905f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-191342414" status: 204 len: 0 microversion: 2.20 time: 0.124384 Sep 08 13:11:15.126101 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2462/4791] 10.222.0.78 () {60 vars in 1259 bytes} [Thu Sep 8 13:11:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-191342414 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:11:15.598564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-50b2ac4d-fc69-4272-979c-c814f2fb0358 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:15.626058 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-50b2ac4d-fc69-4272-979c-c814f2fb0358 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 1.609278 Sep 08 13:11:15.630329 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2330/4792] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:14 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:11:16.710884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-04f62d49-3382-4b92-bde5-d85f3eafc402 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:16.726004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-04f62d49-3382-4b92-bde5-d85f3eafc402 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:16.788085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-04f62d49-3382-4b92-bde5-d85f3eafc402 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:16.789874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-04f62d49-3382-4b92-bde5-d85f3eafc402 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:16.790846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-04f62d49-3382-4b92-bde5-d85f3eafc402 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:16.804630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-04f62d49-3382-4b92-bde5-d85f3eafc402 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:16.813357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-04f62d49-3382-4b92-bde5-d85f3eafc402 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:16.814204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-04f62d49-3382-4b92-bde5-d85f3eafc402 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:17.311801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-04f62d49-3382-4b92-bde5-d85f3eafc402 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:17.332320 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-04f62d49-3382-4b92-bde5-d85f3eafc402 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 0.650897 Sep 08 13:11:17.334307 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2463/4793] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:16 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:18.382628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d1ccd36c-9310-46b2-85fe-901faf12981d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:18.384082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d1ccd36c-9310-46b2-85fe-901faf12981d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:18.393515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:18.406566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:18.432538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1ccd36c-9310-46b2-85fe-901faf12981d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:18.433773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1ccd36c-9310-46b2-85fe-901faf12981d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:18.434606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1ccd36c-9310-46b2-85fe-901faf12981d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:18.436542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1ccd36c-9310-46b2-85fe-901faf12981d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:18.437845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1ccd36c-9310-46b2-85fe-901faf12981d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:18.439208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1ccd36c-9310-46b2-85fe-901faf12981d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:19.060282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d1ccd36c-9310-46b2-85fe-901faf12981d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:19.092078 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d1ccd36c-9310-46b2-85fe-901faf12981d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 0.713876 Sep 08 13:11:19.107276 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2331/4794] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:18 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:11:19.817990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5da1e823-07f6-4e65-a770-72b1ebb06874 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Action: 'create', calling method: .version_select at 0x7fdb3f271ee0>, body: {"keypair": {"name": "tempest-keypair-1486601619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKv+/Sofl3HJd5ET0sZFMjCtGofbOa+35VJ7aUArDty9s1q1irR+5ChA5pt8SqecfUYhWU1powJLJb6nKJUr28TBqOGpkOHzSAhihA2zmWbTJvqFbIi8iUc/SJB5klalxQ=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:19.908949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-5da1e823-07f6-4e65-a770-72b1ebb06874 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Getting quotas for project 4b0e146de89146b9b1d07a8b07b1b77b. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:11:19.951308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-5da1e823-07f6-4e65-a770-72b1ebb06874 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Getting quotas for user d9ccc775b0764dbf860508db1d2096bf and project 4b0e146de89146b9b1d07a8b07b1b77b. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:11:20.034099 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5da1e823-07f6-4e65-a770-72b1ebb06874 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.225790 Sep 08 13:11:20.048099 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2464/4795] 10.222.0.78 () {62 vars in 1200 bytes} [Thu Sep 8 13:11:19 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 240 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 08 13:11:20.159951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38cd5af9-d392-4390-bcc1-6ef91aaab059 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:20.160805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-38cd5af9-d392-4390-bcc1-6ef91aaab059 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:20.189013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38cd5af9-d392-4390-bcc1-6ef91aaab059 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:20.190276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38cd5af9-d392-4390-bcc1-6ef91aaab059 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:20.190926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38cd5af9-d392-4390-bcc1-6ef91aaab059 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:20.197714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38cd5af9-d392-4390-bcc1-6ef91aaab059 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:20.198962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38cd5af9-d392-4390-bcc1-6ef91aaab059 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:20.200375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38cd5af9-d392-4390-bcc1-6ef91aaab059 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:20.685651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38cd5af9-d392-4390-bcc1-6ef91aaab059 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:20.717869 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38cd5af9-d392-4390-bcc1-6ef91aaab059 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 0.556805 Sep 08 13:11:20.720596 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2332/4796] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:20 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:21.769197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00bdd051-b524-465d-99a6-fd2a48423794 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:21.770656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00bdd051-b524-465d-99a6-fd2a48423794 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:21.785724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00bdd051-b524-465d-99a6-fd2a48423794 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:21.791053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00bdd051-b524-465d-99a6-fd2a48423794 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:21.792582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00bdd051-b524-465d-99a6-fd2a48423794 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:21.795365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00bdd051-b524-465d-99a6-fd2a48423794 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:21.799439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00bdd051-b524-465d-99a6-fd2a48423794 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:21.801125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00bdd051-b524-465d-99a6-fd2a48423794 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:23.017382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00bdd051-b524-465d-99a6-fd2a48423794 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:23.040338 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00bdd051-b524-465d-99a6-fd2a48423794 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 1.279116 Sep 08 13:11:23.056404 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2465/4797] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:21 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:24.082490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-32c33936-8f1a-4aa6-8981-633ab45b248e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:24.083779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-32c33936-8f1a-4aa6-8981-633ab45b248e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:24.136568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32c33936-8f1a-4aa6-8981-633ab45b248e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:24.137322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32c33936-8f1a-4aa6-8981-633ab45b248e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:24.148361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32c33936-8f1a-4aa6-8981-633ab45b248e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:24.154791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32c33936-8f1a-4aa6-8981-633ab45b248e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:24.165145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32c33936-8f1a-4aa6-8981-633ab45b248e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:24.169351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32c33936-8f1a-4aa6-8981-633ab45b248e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:27.166374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-32c33936-8f1a-4aa6-8981-633ab45b248e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:27.189602 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-32c33936-8f1a-4aa6-8981-633ab45b248e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 3.116733 Sep 08 13:11:27.204149 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2333/4798] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:24 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 3133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:28.242846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-38ccfb15-1ab6-43e6-b025-d9dd233a676a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:28.256917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-38ccfb15-1ab6-43e6-b025-d9dd233a676a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:28.289935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=4,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:28.296227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38ccfb15-1ab6-43e6-b025-d9dd233a676a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:28.296841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38ccfb15-1ab6-43e6-b025-d9dd233a676a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:28.297302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38ccfb15-1ab6-43e6-b025-d9dd233a676a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:28.306189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38ccfb15-1ab6-43e6-b025-d9dd233a676a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:28.306736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38ccfb15-1ab6-43e6-b025-d9dd233a676a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:28.307314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38ccfb15-1ab6-43e6-b025-d9dd233a676a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:29.590311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-38ccfb15-1ab6-43e6-b025-d9dd233a676a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:29.639512 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-38ccfb15-1ab6-43e6-b025-d9dd233a676a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 1.411051 Sep 08 13:11:29.647751 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2466/4799] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:28 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:30.684860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-251ad1ff-77b2-4ea3-9168-d4a549584aca tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:30.690972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-251ad1ff-77b2-4ea3-9168-d4a549584aca tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:30.724758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-251ad1ff-77b2-4ea3-9168-d4a549584aca tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:30.736302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-251ad1ff-77b2-4ea3-9168-d4a549584aca tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:30.744957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-251ad1ff-77b2-4ea3-9168-d4a549584aca tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:30.747037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-251ad1ff-77b2-4ea3-9168-d4a549584aca tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:30.753484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-251ad1ff-77b2-4ea3-9168-d4a549584aca tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:30.763580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-251ad1ff-77b2-4ea3-9168-d4a549584aca tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:30.810006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:32.187653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-251ad1ff-77b2-4ea3-9168-d4a549584aca tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:32.237206 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-251ad1ff-77b2-4ea3-9168-d4a549584aca tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 1.556022 Sep 08 13:11:32.254816 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2334/4800] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:30 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 1569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:33.296302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be3f26c8-8e39-4575-8b04-fa9e9f61f131 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:33.297648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-be3f26c8-8e39-4575-8b04-fa9e9f61f131 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:33.328716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:33.332937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be3f26c8-8e39-4575-8b04-fa9e9f61f131 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:33.333447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be3f26c8-8e39-4575-8b04-fa9e9f61f131 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:33.333907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be3f26c8-8e39-4575-8b04-fa9e9f61f131 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:33.334657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be3f26c8-8e39-4575-8b04-fa9e9f61f131 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:33.345313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be3f26c8-8e39-4575-8b04-fa9e9f61f131 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:33.346084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be3f26c8-8e39-4575-8b04-fa9e9f61f131 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:34.697783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-be3f26c8-8e39-4575-8b04-fa9e9f61f131 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:34.710948 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-be3f26c8-8e39-4575-8b04-fa9e9f61f131 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 1.427016 Sep 08 13:11:34.725323 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2467/4801] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:33 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:35.147755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-803458326", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8de9e067-a10d-41da-93b7-a0cd2d878a61"}], "security_groups": [{"name": "tempest-securitygroup--850211480"}], "key_name": "tempest-keypair-1486601619", "user_data": "}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:35.763999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c3730d85-53b9-40cc-a477-6aa50f254b5a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:35.765118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c3730d85-53b9-40cc-a477-6aa50f254b5a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:35.794429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3730d85-53b9-40cc-a477-6aa50f254b5a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:35.795428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3730d85-53b9-40cc-a477-6aa50f254b5a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:35.798197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3730d85-53b9-40cc-a477-6aa50f254b5a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:35.798197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3730d85-53b9-40cc-a477-6aa50f254b5a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:35.798675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3730d85-53b9-40cc-a477-6aa50f254b5a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:35.816228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3730d85-53b9-40cc-a477-6aa50f254b5a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:36.570109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] validate_networks() for [('8de9e067-a10d-41da-93b7-a0cd2d878a61', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:11:37.434738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c3730d85-53b9-40cc-a477-6aa50f254b5a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:37.462462 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c3730d85-53b9-40cc-a477-6aa50f254b5a tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 1.706183 Sep 08 13:11:37.464380 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2468/4802] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:35 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 1710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:11:38.419074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-634467187", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": "none"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:38.575629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:11:38.577475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:11:38.578051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:11:38.578661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:11:38.579181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:11:38.615928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:38.617484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:38.619787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:38.622170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:38.626526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:38.628387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:38.752541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Getting quotas for project a14cd14eb3034d3699c49f8b0f4488bb. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:11:38.783180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Getting quotas for user 2eba3f63d4734cd6ac5e60138d7bcdc3 and project a14cd14eb3034d3699c49f8b0f4488bb. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:11:38.888315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:11:38.902410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: c66d0923-df7f-44f7-bafe-42bd0f9aeffb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:11:39.128667 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9d89e008-6aff-4b48-92c5-0b2f2e0cfd4f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 1.655009 Sep 08 13:11:39.152929 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2469/4803] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 13:11:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1685 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 08 13:11:39.187392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ee43a58-3657-4e1b-afde-5561038d3836 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:39.188554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6ee43a58-3657-4e1b-afde-5561038d3836 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:39.229879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ee43a58-3657-4e1b-afde-5561038d3836 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:39.230736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ee43a58-3657-4e1b-afde-5561038d3836 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:39.231564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ee43a58-3657-4e1b-afde-5561038d3836 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:39.233444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ee43a58-3657-4e1b-afde-5561038d3836 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:39.234281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ee43a58-3657-4e1b-afde-5561038d3836 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:39.235059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ee43a58-3657-4e1b-afde-5561038d3836 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:40.562406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6ee43a58-3657-4e1b-afde-5561038d3836 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:40.596913 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6ee43a58-3657-4e1b-afde-5561038d3836 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 1.429483 Sep 08 13:11:40.598090 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2470/4804] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:39 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 1444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:40.607658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bf618038-d89d-4d21-8860-2038883eaebc tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:40.613631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bf618038-d89d-4d21-8860-2038883eaebc tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: c66d0923-df7f-44f7-bafe-42bd0f9aeffb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:40.640900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf618038-d89d-4d21-8860-2038883eaebc tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:40.641809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf618038-d89d-4d21-8860-2038883eaebc tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:40.642596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf618038-d89d-4d21-8860-2038883eaebc tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:40.643954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf618038-d89d-4d21-8860-2038883eaebc tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:40.644804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf618038-d89d-4d21-8860-2038883eaebc tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:40.645592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bf618038-d89d-4d21-8860-2038883eaebc tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:40.663101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:11:40.663946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:11:40.664721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:11:40.665473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:11:40.666224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:11:40.721200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:40.721936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:40.722575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:40.723958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:40.724780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:40.725524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:40.800360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Getting quotas for project 4b0e146de89146b9b1d07a8b07b1b77b. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:11:40.813848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Getting quotas for user d9ccc775b0764dbf860508db1d2096bf and project 4b0e146de89146b9b1d07a8b07b1b77b. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:11:40.845765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:11:40.850101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:11:41.002223 n-d-852084-10 devstack@n-api.service[128971]: ERROR oslo.messaging._drivers.impl_rabbit [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [0cff7a8f-28d3-48a0-85b5-d0b15fdc4db0] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 13:11:41.088761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bf618038-d89d-4d21-8860-2038883eaebc tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:41.102180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bf618038-d89d-4d21-8860-2038883eaebc tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:41.103854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bf618038-d89d-4d21-8860-2038883eaebc tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:41.105223 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bf618038-d89d-4d21-8860-2038883eaebc tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb" status: 200 len: 1281 microversion: 2.47 time: 0.505373 Sep 08 13:11:41.105880 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2471/4805] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:40 2022] GET /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb => generated 1281 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:41.418766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-708997296", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": "none"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:41.505659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:11:41.506563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:11:41.507427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:11:41.507826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:11:41.508362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:11:41.525927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:41.527368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:41.528552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:41.531813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:41.533710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:41.535014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:41.613647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Getting quotas for project a14cd14eb3034d3699c49f8b0f4488bb. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:11:41.641604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Getting quotas for user 2eba3f63d4734cd6ac5e60138d7bcdc3 and project a14cd14eb3034d3699c49f8b0f4488bb. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:11:41.732199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:11:41.745396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:11:41.971159 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c0f3c3cc-f9c1-4d26-93e0-1abb5195203e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.559132 Sep 08 13:11:41.973337 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2472/4806] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 13:11:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 563 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 08 13:11:42.001320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d64c3a80-9621-4039-847b-41302c942e42 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:42.002973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d64c3a80-9621-4039-847b-41302c942e42 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:42.024540 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [0cff7a8f-28d3-48a0-85b5-d0b15fdc4db0] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 43978. Sep 08 13:11:42.027709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d64c3a80-9621-4039-847b-41302c942e42 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:42.036314 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-98ad2682-87f9-4745-a31b-cafa6251301f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 6.891410 Sep 08 13:11:42.040284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d64c3a80-9621-4039-847b-41302c942e42 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:42.042253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d64c3a80-9621-4039-847b-41302c942e42 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:42.045020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d64c3a80-9621-4039-847b-41302c942e42 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:42.045588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d64c3a80-9621-4039-847b-41302c942e42 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:42.046860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d64c3a80-9621-4039-847b-41302c942e42 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:42.052681 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2335/4807] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Sep 8 13:11:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 6911 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 08 13:11:42.071995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-47059f70-d5d3-4693-b3ab-36bbfc4a8f39 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:42.089330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-47059f70-d5d3-4693-b3ab-36bbfc4a8f39 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:42.290944 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-47059f70-d5d3-4693-b3ab-36bbfc4a8f39 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "PUT /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 991 microversion: 2.47 time: 0.228103 Sep 08 13:11:42.292846 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2336/4808] 10.222.0.78 () {62 vars in 1297 bytes} [Thu Sep 8 13:11:42 2022] PUT /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 991 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:11:43.236262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1530ae1c-e608-41a2-a92f-b84de29a7c93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:43.237014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1530ae1c-e608-41a2-a92f-b84de29a7c93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:43.309842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d64c3a80-9621-4039-847b-41302c942e42 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:43.354969 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d64c3a80-9621-4039-847b-41302c942e42 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 1.374603 Sep 08 13:11:43.355970 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2473/4809] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:41 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:43.389525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-539cdc63-5416-4d34-9de7-7c18060544f0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:43.394972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-539cdc63-5416-4d34-9de7-7c18060544f0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:43.804628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1530ae1c-e608-41a2-a92f-b84de29a7c93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:43.825758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1530ae1c-e608-41a2-a92f-b84de29a7c93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:43.831069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1530ae1c-e608-41a2-a92f-b84de29a7c93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:43.851527 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1530ae1c-e608-41a2-a92f-b84de29a7c93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1281 microversion: 2.20 time: 1.556775 Sep 08 13:11:43.859724 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2337/4810] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:42 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1281 bytes in 1566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:43.911836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-539cdc63-5416-4d34-9de7-7c18060544f0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:43.928056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-539cdc63-5416-4d34-9de7-7c18060544f0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:43.931014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-539cdc63-5416-4d34-9de7-7c18060544f0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:43.934068 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-539cdc63-5416-4d34-9de7-7c18060544f0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1277 microversion: 2.47 time: 0.567668 Sep 08 13:11:43.935427 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2474/4811] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:43 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1277 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:44.397030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a9f3d941-dabe-4fbb-aeac-11252e050c60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:44.398812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a9f3d941-dabe-4fbb-aeac-11252e050c60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:44.433957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9f3d941-dabe-4fbb-aeac-11252e050c60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:44.434857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9f3d941-dabe-4fbb-aeac-11252e050c60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:44.436462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9f3d941-dabe-4fbb-aeac-11252e050c60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:44.439031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9f3d941-dabe-4fbb-aeac-11252e050c60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:44.440143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9f3d941-dabe-4fbb-aeac-11252e050c60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:44.441139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a9f3d941-dabe-4fbb-aeac-11252e050c60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:44.898477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8931cb6e-df4a-45e2-9d84-1a7b7f0d42ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:44.901072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8931cb6e-df4a-45e2-9d84-1a7b7f0d42ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:44.936008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8931cb6e-df4a-45e2-9d84-1a7b7f0d42ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:44.937044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8931cb6e-df4a-45e2-9d84-1a7b7f0d42ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:44.938143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8931cb6e-df4a-45e2-9d84-1a7b7f0d42ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:44.942710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a9f3d941-dabe-4fbb-aeac-11252e050c60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:44.946037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8931cb6e-df4a-45e2-9d84-1a7b7f0d42ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:44.950415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8931cb6e-df4a-45e2-9d84-1a7b7f0d42ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:44.953671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8931cb6e-df4a-45e2-9d84-1a7b7f0d42ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:44.991474 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a9f3d941-dabe-4fbb-aeac-11252e050c60 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 0.598090 Sep 08 13:11:45.051543 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2338/4812] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:44 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:45.087840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-56b77131-70ee-48d4-9c7c-fcac10a75c5f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:45.089291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-56b77131-70ee-48d4-9c7c-fcac10a75c5f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:45.107845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=62 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:45.111700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56b77131-70ee-48d4-9c7c-fcac10a75c5f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:45.112584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56b77131-70ee-48d4-9c7c-fcac10a75c5f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:45.122069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56b77131-70ee-48d4-9c7c-fcac10a75c5f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:45.124130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56b77131-70ee-48d4-9c7c-fcac10a75c5f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:45.125637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56b77131-70ee-48d4-9c7c-fcac10a75c5f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:45.126779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56b77131-70ee-48d4-9c7c-fcac10a75c5f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:46.105703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8931cb6e-df4a-45e2-9d84-1a7b7f0d42ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:46.140345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8931cb6e-df4a-45e2-9d84-1a7b7f0d42ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:46.157013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8931cb6e-df4a-45e2-9d84-1a7b7f0d42ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:46.158424 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8931cb6e-df4a-45e2-9d84-1a7b7f0d42ce tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1333 microversion: 2.20 time: 1.274084 Sep 08 13:11:46.194568 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2475/4813] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:44 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1333 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:46.218498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-56b77131-70ee-48d4-9c7c-fcac10a75c5f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:46.235995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44f2ebaa-264c-40b0-8a11-f63d98d10628 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:46.245380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-44f2ebaa-264c-40b0-8a11-f63d98d10628 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:46.273630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44f2ebaa-264c-40b0-8a11-f63d98d10628 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:46.277791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-56b77131-70ee-48d4-9c7c-fcac10a75c5f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:46.280757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44f2ebaa-264c-40b0-8a11-f63d98d10628 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:46.283760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44f2ebaa-264c-40b0-8a11-f63d98d10628 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:46.286633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44f2ebaa-264c-40b0-8a11-f63d98d10628 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:46.288737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-56b77131-70ee-48d4-9c7c-fcac10a75c5f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:46.290197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44f2ebaa-264c-40b0-8a11-f63d98d10628 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:46.293569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44f2ebaa-264c-40b0-8a11-f63d98d10628 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:46.297712 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-56b77131-70ee-48d4-9c7c-fcac10a75c5f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1273 microversion: 2.47 time: 1.243944 Sep 08 13:11:46.304693 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2339/4814] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:45 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1273 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:46.359764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f076352e-302c-4d8d-9890-8ac258c9b2ea req-37697994-6edf-4484-950a-56034c4ab198 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb421d7-2415-43d2-a6bb-3fdbca098091", "name": "network-vif-plugged", "status": "completed", "tag": "633f3920-4732-4687-b8a2-8db04d18d889"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:46.396716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f076352e-302c-4d8d-9890-8ac258c9b2ea req-37697994-6edf-4484-950a-56034c4ab198 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:46.397995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f076352e-302c-4d8d-9890-8ac258c9b2ea req-37697994-6edf-4484-950a-56034c4ab198 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:46.399581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f076352e-302c-4d8d-9890-8ac258c9b2ea req-37697994-6edf-4484-950a-56034c4ab198 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:46.429347 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f076352e-302c-4d8d-9890-8ac258c9b2ea req-37697994-6edf-4484-950a-56034c4ab198 service nova] Creating event network-vif-plugged:633f3920-4732-4687-b8a2-8db04d18d889 for instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 on n-h1-852084-10 Sep 08 13:11:46.444166 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f076352e-302c-4d8d-9890-8ac258c9b2ea req-37697994-6edf-4484-950a-56034c4ab198 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132418 Sep 08 13:11:46.446040 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2340/4815] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:11:47.076090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-44f2ebaa-264c-40b0-8a11-f63d98d10628 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:47.133048 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44f2ebaa-264c-40b0-8a11-f63d98d10628 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 0.930191 Sep 08 13:11:47.152262 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2476/4816] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:46 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:47.198983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e87a5e48-79aa-45af-84de-5c47b7235e03 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:47.203048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e87a5e48-79aa-45af-84de-5c47b7235e03 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:47.229710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e87a5e48-79aa-45af-84de-5c47b7235e03 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:47.237033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e87a5e48-79aa-45af-84de-5c47b7235e03 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:47.237676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e87a5e48-79aa-45af-84de-5c47b7235e03 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:47.238493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e87a5e48-79aa-45af-84de-5c47b7235e03 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:47.239327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e87a5e48-79aa-45af-84de-5c47b7235e03 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:47.239788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e87a5e48-79aa-45af-84de-5c47b7235e03 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:47.355023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-53f1b98d-ee93-421a-ae4c-6658c556a280 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:47.356819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-53f1b98d-ee93-421a-ae4c-6658c556a280 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:47.374058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53f1b98d-ee93-421a-ae4c-6658c556a280 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:47.376956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53f1b98d-ee93-421a-ae4c-6658c556a280 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:47.382152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53f1b98d-ee93-421a-ae4c-6658c556a280 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:47.382152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53f1b98d-ee93-421a-ae4c-6658c556a280 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:47.383010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53f1b98d-ee93-421a-ae4c-6658c556a280 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:47.385423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53f1b98d-ee93-421a-ae4c-6658c556a280 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:47.740638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e87a5e48-79aa-45af-84de-5c47b7235e03 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:47.756210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e87a5e48-79aa-45af-84de-5c47b7235e03 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:47.759315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e87a5e48-79aa-45af-84de-5c47b7235e03 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:47.762576 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e87a5e48-79aa-45af-84de-5c47b7235e03 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1339 microversion: 2.20 time: 0.568727 Sep 08 13:11:47.763836 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2341/4817] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:47 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1339 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:11:47.837277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-53f1b98d-ee93-421a-ae4c-6658c556a280 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:47.857048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-53f1b98d-ee93-421a-ae4c-6658c556a280 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:47.866435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-53f1b98d-ee93-421a-ae4c-6658c556a280 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:47.870013 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-53f1b98d-ee93-421a-ae4c-6658c556a280 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1337 microversion: 2.47 time: 0.519022 Sep 08 13:11:47.872649 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2477/4818] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:47 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1337 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:11:48.193724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71d402de-682c-4942-ba11-5217071c4236 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:48.194859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-71d402de-682c-4942-ba11-5217071c4236 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:48.203977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71d402de-682c-4942-ba11-5217071c4236 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:48.205190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71d402de-682c-4942-ba11-5217071c4236 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:48.206296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71d402de-682c-4942-ba11-5217071c4236 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:48.207849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71d402de-682c-4942-ba11-5217071c4236 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:48.211347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71d402de-682c-4942-ba11-5217071c4236 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:48.212485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71d402de-682c-4942-ba11-5217071c4236 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:48.810592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-613fe224-b075-4b58-8f20-28d93b8d8abb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:48.814327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-613fe224-b075-4b58-8f20-28d93b8d8abb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:48.872609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-613fe224-b075-4b58-8f20-28d93b8d8abb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:48.878483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-613fe224-b075-4b58-8f20-28d93b8d8abb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:48.893064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-613fe224-b075-4b58-8f20-28d93b8d8abb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:48.900090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-613fe224-b075-4b58-8f20-28d93b8d8abb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:48.903749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-613fe224-b075-4b58-8f20-28d93b8d8abb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:48.909194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-613fe224-b075-4b58-8f20-28d93b8d8abb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:49.290849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-71d402de-682c-4942-ba11-5217071c4236 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:49.291884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-613fe224-b075-4b58-8f20-28d93b8d8abb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:49.306893 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-71d402de-682c-4942-ba11-5217071c4236 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 1.121782 Sep 08 13:11:49.308851 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2342/4819] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:48 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:49.321518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-613fe224-b075-4b58-8f20-28d93b8d8abb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:49.326512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c28be3a8-d6f5-4bee-8e9f-0202490d393e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:49.328911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-613fe224-b075-4b58-8f20-28d93b8d8abb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:49.331172 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-613fe224-b075-4b58-8f20-28d93b8d8abb tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1339 microversion: 2.20 time: 0.533248 Sep 08 13:11:49.343772 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2478/4820] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:48 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1339 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:49.353822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c28be3a8-d6f5-4bee-8e9f-0202490d393e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:49.357315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:49.426026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c28be3a8-d6f5-4bee-8e9f-0202490d393e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:49.427041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c28be3a8-d6f5-4bee-8e9f-0202490d393e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:49.427691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c28be3a8-d6f5-4bee-8e9f-0202490d393e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:49.428634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c28be3a8-d6f5-4bee-8e9f-0202490d393e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:49.429262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c28be3a8-d6f5-4bee-8e9f-0202490d393e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:49.429856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c28be3a8-d6f5-4bee-8e9f-0202490d393e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:49.723305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c28be3a8-d6f5-4bee-8e9f-0202490d393e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:49.740967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c28be3a8-d6f5-4bee-8e9f-0202490d393e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:49.742845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c28be3a8-d6f5-4bee-8e9f-0202490d393e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:49.744791 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c28be3a8-d6f5-4bee-8e9f-0202490d393e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1335 microversion: 2.47 time: 0.434281 Sep 08 13:11:49.756670 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2343/4821] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:49 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1335 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:50.349630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f6d6455-8308-4525-9ca7-353f812d7e14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:50.350448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1f6d6455-8308-4525-9ca7-353f812d7e14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:50.367836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f6d6455-8308-4525-9ca7-353f812d7e14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:50.369375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f6d6455-8308-4525-9ca7-353f812d7e14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:50.372244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f6d6455-8308-4525-9ca7-353f812d7e14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:50.374994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f6d6455-8308-4525-9ca7-353f812d7e14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:50.378698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f6d6455-8308-4525-9ca7-353f812d7e14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:50.381640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f6d6455-8308-4525-9ca7-353f812d7e14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:50.384577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6dcb7e28-0f0f-425b-a025-4ed7e0837bcf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:50.393661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6dcb7e28-0f0f-425b-a025-4ed7e0837bcf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:50.448775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6dcb7e28-0f0f-425b-a025-4ed7e0837bcf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:50.450741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6dcb7e28-0f0f-425b-a025-4ed7e0837bcf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:50.452446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6dcb7e28-0f0f-425b-a025-4ed7e0837bcf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:50.454398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6dcb7e28-0f0f-425b-a025-4ed7e0837bcf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:50.455631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6dcb7e28-0f0f-425b-a025-4ed7e0837bcf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:50.456749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6dcb7e28-0f0f-425b-a025-4ed7e0837bcf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:50.786038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:51.042695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6dcb7e28-0f0f-425b-a025-4ed7e0837bcf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:51.098483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6dcb7e28-0f0f-425b-a025-4ed7e0837bcf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:51.102223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6dcb7e28-0f0f-425b-a025-4ed7e0837bcf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:51.104334 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6dcb7e28-0f0f-425b-a025-4ed7e0837bcf tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1339 microversion: 2.20 time: 0.739239 Sep 08 13:11:51.105969 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2344/4822] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:50 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1339 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:11:51.123883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-445f711e-dd84-490e-b00e-55e6662cb1ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:51.130667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-445f711e-dd84-490e-b00e-55e6662cb1ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:51.159425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-445f711e-dd84-490e-b00e-55e6662cb1ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:51.164710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-445f711e-dd84-490e-b00e-55e6662cb1ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:51.166905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-445f711e-dd84-490e-b00e-55e6662cb1ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:51.169765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-445f711e-dd84-490e-b00e-55e6662cb1ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:51.209161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-445f711e-dd84-490e-b00e-55e6662cb1ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:51.214164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-445f711e-dd84-490e-b00e-55e6662cb1ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:51.280873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1f6d6455-8308-4525-9ca7-353f812d7e14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:51.300308 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1f6d6455-8308-4525-9ca7-353f812d7e14 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 0.955220 Sep 08 13:11:51.307149 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2479/4823] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:50 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:51.586717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-445f711e-dd84-490e-b00e-55e6662cb1ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:51.627415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-445f711e-dd84-490e-b00e-55e6662cb1ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:51.635134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-445f711e-dd84-490e-b00e-55e6662cb1ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:51.637834 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-445f711e-dd84-490e-b00e-55e6662cb1ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1356 microversion: 2.47 time: 0.529958 Sep 08 13:11:51.638982 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2345/4824] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:51 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1356 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:51.694719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:51.710839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:51.718863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:51.759597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:51.765564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:51.769288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:51.771997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:51.781957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:51.785902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:52.158313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-268bf352-df5a-41f9-8e2c-9aeafdc07613 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:52.162020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-268bf352-df5a-41f9-8e2c-9aeafdc07613 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:52.177370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:11:52.184200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:11:52.185688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:11:52.186785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:11:52.187657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:11:52.236663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-268bf352-df5a-41f9-8e2c-9aeafdc07613 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:52.237587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-268bf352-df5a-41f9-8e2c-9aeafdc07613 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:52.238340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-268bf352-df5a-41f9-8e2c-9aeafdc07613 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:52.244252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-268bf352-df5a-41f9-8e2c-9aeafdc07613 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:52.252326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-268bf352-df5a-41f9-8e2c-9aeafdc07613 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:52.255464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-268bf352-df5a-41f9-8e2c-9aeafdc07613 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:52.398407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:52.428237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:52.429195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:52.430170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:52.439529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:52.440401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:52.441193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:52.561338 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-61b4e64c-3a82-4e8b-abff-42a9dced2be8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "POST /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398/action" status: 202 len: 1078 microversion: 2.47 time: 0.880249 Sep 08 13:11:52.563197 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2480/4825] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 13:11:51 2022] POST /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398/action => generated 1078 bytes in 884 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Sep 08 13:11:52.577979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-56ca5c3e-fed1-44b4-80b9-1ea9eda8d1c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:52.583983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-56ca5c3e-fed1-44b4-80b9-1ea9eda8d1c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:52.602865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56ca5c3e-fed1-44b4-80b9-1ea9eda8d1c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:52.626938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56ca5c3e-fed1-44b4-80b9-1ea9eda8d1c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:52.628373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56ca5c3e-fed1-44b4-80b9-1ea9eda8d1c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:52.630070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56ca5c3e-fed1-44b4-80b9-1ea9eda8d1c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:52.631309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56ca5c3e-fed1-44b4-80b9-1ea9eda8d1c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:52.632396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56ca5c3e-fed1-44b4-80b9-1ea9eda8d1c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:53.234182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-268bf352-df5a-41f9-8e2c-9aeafdc07613 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:53.268789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-268bf352-df5a-41f9-8e2c-9aeafdc07613 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:53.272040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-268bf352-df5a-41f9-8e2c-9aeafdc07613 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:53.274271 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-268bf352-df5a-41f9-8e2c-9aeafdc07613 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1406 microversion: 2.20 time: 1.127949 Sep 08 13:11:53.275219 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2346/4826] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:52 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1406 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:11:53.327747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-935300fe-5283-43f8-ac2d-309160695867 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:53.330888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-935300fe-5283-43f8-ac2d-309160695867 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:53.364830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-935300fe-5283-43f8-ac2d-309160695867 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:53.366671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-935300fe-5283-43f8-ac2d-309160695867 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:53.367835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-935300fe-5283-43f8-ac2d-309160695867 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:53.372592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-935300fe-5283-43f8-ac2d-309160695867 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:53.374087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-935300fe-5283-43f8-ac2d-309160695867 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:53.383621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-935300fe-5283-43f8-ac2d-309160695867 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:53.524501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-56ca5c3e-fed1-44b4-80b9-1ea9eda8d1c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:53.544821 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-56ca5c3e-fed1-44b4-80b9-1ea9eda8d1c9 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1519 microversion: 2.1 time: 0.979557 Sep 08 13:11:53.546563 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2481/4827] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:52 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1519 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:53.635242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-935300fe-5283-43f8-ac2d-309160695867 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:53.650608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-935300fe-5283-43f8-ac2d-309160695867 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:53.652565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-935300fe-5283-43f8-ac2d-309160695867 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:53.653855 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-935300fe-5283-43f8-ac2d-309160695867 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.376949 Sep 08 13:11:53.655809 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2347/4828] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:53 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:54.321436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-510f5088-b1a1-4fb2-968a-0a35c54ae16e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:54.323532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-510f5088-b1a1-4fb2-968a-0a35c54ae16e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:54.327982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=14 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:54.352693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-510f5088-b1a1-4fb2-968a-0a35c54ae16e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:54.353690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-510f5088-b1a1-4fb2-968a-0a35c54ae16e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:54.354402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-510f5088-b1a1-4fb2-968a-0a35c54ae16e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:54.357942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-510f5088-b1a1-4fb2-968a-0a35c54ae16e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:54.358748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-510f5088-b1a1-4fb2-968a-0a35c54ae16e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:54.359493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-510f5088-b1a1-4fb2-968a-0a35c54ae16e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:54.577902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0fe03ca2-eaf6-4e1a-9b71-ec0938c47012 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:54.579013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0fe03ca2-eaf6-4e1a-9b71-ec0938c47012 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:54.609946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:54.609946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0fe03ca2-eaf6-4e1a-9b71-ec0938c47012 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:54.609946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0fe03ca2-eaf6-4e1a-9b71-ec0938c47012 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:54.609946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0fe03ca2-eaf6-4e1a-9b71-ec0938c47012 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:54.609946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0fe03ca2-eaf6-4e1a-9b71-ec0938c47012 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:54.609946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0fe03ca2-eaf6-4e1a-9b71-ec0938c47012 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:54.609946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0fe03ca2-eaf6-4e1a-9b71-ec0938c47012 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:55.641421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-510f5088-b1a1-4fb2-968a-0a35c54ae16e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:55.663420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-510f5088-b1a1-4fb2-968a-0a35c54ae16e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:55.672314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-510f5088-b1a1-4fb2-968a-0a35c54ae16e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:55.678200 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-510f5088-b1a1-4fb2-968a-0a35c54ae16e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1406 microversion: 2.20 time: 1.360375 Sep 08 13:11:55.682796 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2482/4829] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:54 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1406 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:11:55.724469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b0730677-ac62-40ab-b9ec-541fa85fa3a0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:55.727126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b0730677-ac62-40ab-b9ec-541fa85fa3a0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:55.773118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0730677-ac62-40ab-b9ec-541fa85fa3a0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:55.773702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0730677-ac62-40ab-b9ec-541fa85fa3a0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:55.774225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0730677-ac62-40ab-b9ec-541fa85fa3a0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:55.786107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0730677-ac62-40ab-b9ec-541fa85fa3a0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:55.787592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0730677-ac62-40ab-b9ec-541fa85fa3a0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:55.788116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0730677-ac62-40ab-b9ec-541fa85fa3a0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:56.146164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0730677-ac62-40ab-b9ec-541fa85fa3a0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:56.174008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0730677-ac62-40ab-b9ec-541fa85fa3a0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:56.177283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0730677-ac62-40ab-b9ec-541fa85fa3a0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:56.179901 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b0730677-ac62-40ab-b9ec-541fa85fa3a0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.493063 Sep 08 13:11:56.182814 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2483/4830] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:55 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:56.202723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-6d5bd4b6-0f81-4c32-a264-7ac65d9d86c1 req-cea8baa4-612d-4cfc-a50e-48fc44596c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad0f9bb-3303-4bdc-a35e-102f0002fe77", "tag": "1ea3ab52-16b6-4072-bb78-7320e9ba5e25"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:56.249721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6d5bd4b6-0f81-4c32-a264-7ac65d9d86c1 req-cea8baa4-612d-4cfc-a50e-48fc44596c4a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:56.253036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6d5bd4b6-0f81-4c32-a264-7ac65d9d86c1 req-cea8baa4-612d-4cfc-a50e-48fc44596c4a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:56.254705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6d5bd4b6-0f81-4c32-a264-7ac65d9d86c1 req-cea8baa4-612d-4cfc-a50e-48fc44596c4a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:56.334655 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-6d5bd4b6-0f81-4c32-a264-7ac65d9d86c1 req-cea8baa4-612d-4cfc-a50e-48fc44596c4a service nova] Creating event network-changed:1ea3ab52-16b6-4072-bb78-7320e9ba5e25 for instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 on n-h1-852084-10 Sep 08 13:11:56.362833 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-6d5bd4b6-0f81-4c32-a264-7ac65d9d86c1 req-cea8baa4-612d-4cfc-a50e-48fc44596c4a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164149 Sep 08 13:11:56.362833 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2484/4831] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:11:56.477282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0fe03ca2-eaf6-4e1a-9b71-ec0938c47012 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:56.523917 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0fe03ca2-eaf6-4e1a-9b71-ec0938c47012 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.945399 Sep 08 13:11:56.524805 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2348/4832] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:54 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:56.573255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75a79b83-4918-46ed-9f32-45684a33983e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:56.575440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-75a79b83-4918-46ed-9f32-45684a33983e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:56.600817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75a79b83-4918-46ed-9f32-45684a33983e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:56.602091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75a79b83-4918-46ed-9f32-45684a33983e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:56.602912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75a79b83-4918-46ed-9f32-45684a33983e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:56.604261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75a79b83-4918-46ed-9f32-45684a33983e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:56.605123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75a79b83-4918-46ed-9f32-45684a33983e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:56.605914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75a79b83-4918-46ed-9f32-45684a33983e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:56.736927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aaa305c5-7335-48fd-84d8-20356dee5fe1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:56.737940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-aaa305c5-7335-48fd-84d8-20356dee5fe1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:56.777093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aaa305c5-7335-48fd-84d8-20356dee5fe1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:56.778377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aaa305c5-7335-48fd-84d8-20356dee5fe1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:56.779194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aaa305c5-7335-48fd-84d8-20356dee5fe1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:56.780737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aaa305c5-7335-48fd-84d8-20356dee5fe1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:56.782050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aaa305c5-7335-48fd-84d8-20356dee5fe1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:56.807113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aaa305c5-7335-48fd-84d8-20356dee5fe1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:57.666744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-75a79b83-4918-46ed-9f32-45684a33983e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:57.682576 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-75a79b83-4918-46ed-9f32-45684a33983e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.130036 Sep 08 13:11:57.705839 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2485/4833] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:56 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:57.754244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-aaa305c5-7335-48fd-84d8-20356dee5fe1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:57.766030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e305a976-dcff-4cea-90a7-07cbb77c8877 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:57.767445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e305a976-dcff-4cea-90a7-07cbb77c8877 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:57.786595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-aaa305c5-7335-48fd-84d8-20356dee5fe1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:57.793082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-aaa305c5-7335-48fd-84d8-20356dee5fe1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:57.796268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e305a976-dcff-4cea-90a7-07cbb77c8877 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:57.802343 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-aaa305c5-7335-48fd-84d8-20356dee5fe1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1406 microversion: 2.20 time: 1.071236 Sep 08 13:11:57.802967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e305a976-dcff-4cea-90a7-07cbb77c8877 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:57.803165 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2349/4834] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:56 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1406 bytes in 1075 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:11:57.803852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e305a976-dcff-4cea-90a7-07cbb77c8877 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:57.804763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e305a976-dcff-4cea-90a7-07cbb77c8877 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:57.805350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e305a976-dcff-4cea-90a7-07cbb77c8877 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:57.805871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e305a976-dcff-4cea-90a7-07cbb77c8877 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:57.815165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-995d661d-4a18-4ee3-8f8e-b8d9f8f98029 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:57.822304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-995d661d-4a18-4ee3-8f8e-b8d9f8f98029 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:57.864247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-995d661d-4a18-4ee3-8f8e-b8d9f8f98029 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:57.866147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-995d661d-4a18-4ee3-8f8e-b8d9f8f98029 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:57.880773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-995d661d-4a18-4ee3-8f8e-b8d9f8f98029 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:57.885389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-995d661d-4a18-4ee3-8f8e-b8d9f8f98029 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:57.887714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-995d661d-4a18-4ee3-8f8e-b8d9f8f98029 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:57.889463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-995d661d-4a18-4ee3-8f8e-b8d9f8f98029 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:58.091011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e305a976-dcff-4cea-90a7-07cbb77c8877 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:58.124937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e305a976-dcff-4cea-90a7-07cbb77c8877 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:58.132814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e305a976-dcff-4cea-90a7-07cbb77c8877 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:58.140469 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e305a976-dcff-4cea-90a7-07cbb77c8877 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.391112 Sep 08 13:11:58.141986 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2486/4835] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:57 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:11:58.794928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-995d661d-4a18-4ee3-8f8e-b8d9f8f98029 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:58.833989 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-995d661d-4a18-4ee3-8f8e-b8d9f8f98029 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.027190 Sep 08 13:11:58.836996 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2350/4836] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:57 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:58.872786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7fc37ec8-ba05-42cc-bf20-a647418e69c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:58.877330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7fc37ec8-ba05-42cc-bf20-a647418e69c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:58.878189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e5414433-6348-4224-8d29-8b808166124c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:11:58.892812 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e5414433-6348-4224-8d29-8b808166124c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 6c459eb9-15b2-4b75-945e-239495d8fd98 has no mapping to a cell. Sep 08 13:11:58.911162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e5414433-6348-4224-8d29-8b808166124c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/6c459eb9-15b2-4b75-945e-239495d8fd98/action HTTP/1.1 Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 15 Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: {"os-stop": {}} Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 6c459eb9-15b2-4b75-945e-239495d8fd98 has no mapping to a cell. Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '6c459eb9-15b2-4b75-945e-239495d8fd98', 'body': {'os-stop': {}}} Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 6c459eb9-15b2-4b75-945e-239495d8fd98 has no mapping to a cell. Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:11:58.912141 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c459eb9-15b2-4b75-945e-239495d8fd98 has no mapping to a cell. Sep 08 13:11:58.925047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:58.925047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:11:58.925047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:58.925047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:11:58.925047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:11:58.925047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:11:58.925047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:11:58.925047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:11:58.925047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c459eb9-15b2-4b75-945e-239495d8fd98 has no mapping to a cell. Sep 08 13:11:58.925047 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:11:58.925047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e5414433-6348-4224-8d29-8b808166124c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 6c459eb9-15b2-4b75-945e-239495d8fd98 has no mapping to a cell. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:11:58.925047 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e5414433-6348-4224-8d29-8b808166124c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/6c459eb9-15b2-4b75-945e-239495d8fd98/action" status: 404 len: 117 microversion: 2.1 time: 0.048033 Sep 08 13:11:58.931339 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2351/4837] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:11:58 2022] POST /compute/v2.1/servers/6c459eb9-15b2-4b75-945e-239495d8fd98/action => generated 117 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:11:58.936535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fc37ec8-ba05-42cc-bf20-a647418e69c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:58.941188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fc37ec8-ba05-42cc-bf20-a647418e69c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:58.942366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fc37ec8-ba05-42cc-bf20-a647418e69c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:58.947630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fc37ec8-ba05-42cc-bf20-a647418e69c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:58.947922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2492dd98-16ed-49b1-9c91-a9e4a142f338 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:58.949145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fc37ec8-ba05-42cc-bf20-a647418e69c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:58.952233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fc37ec8-ba05-42cc-bf20-a647418e69c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:58.953854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2492dd98-16ed-49b1-9c91-a9e4a142f338 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:11:58.982073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2492dd98-16ed-49b1-9c91-a9e4a142f338 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:58.989527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2492dd98-16ed-49b1-9c91-a9e4a142f338 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:58.991403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2492dd98-16ed-49b1-9c91-a9e4a142f338 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:58.993160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2492dd98-16ed-49b1-9c91-a9e4a142f338 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:11:58.994345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2492dd98-16ed-49b1-9c91-a9e4a142f338 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:11:59.001821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2492dd98-16ed-49b1-9c91-a9e4a142f338 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:11:59.927202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2492dd98-16ed-49b1-9c91-a9e4a142f338 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:59.934879 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2492dd98-16ed-49b1-9c91-a9e4a142f338 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.999469 Sep 08 13:11:59.957302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7fc37ec8-ba05-42cc-bf20-a647418e69c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:59.976728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7fc37ec8-ba05-42cc-bf20-a647418e69c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:59.981613 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2352/4838] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:11:58 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:11:59.990963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3769ba44-9472-4fe7-9917-82493d98c4ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:11:59.991903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7fc37ec8-ba05-42cc-bf20-a647418e69c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:11:59.993781 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7fc37ec8-ba05-42cc-bf20-a647418e69c7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1406 microversion: 2.20 time: 1.131145 Sep 08 13:12:00.004047 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2487/4839] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:58 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1406 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:00.010525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6b189e02-63e7-4e80-8784-c126c7dcd3c4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:00.011164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6b189e02-63e7-4e80-8784-c126c7dcd3c4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:00.024163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3769ba44-9472-4fe7-9917-82493d98c4ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:00.034938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3769ba44-9472-4fe7-9917-82493d98c4ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:00.035482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3769ba44-9472-4fe7-9917-82493d98c4ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:00.035929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3769ba44-9472-4fe7-9917-82493d98c4ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:00.039577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3769ba44-9472-4fe7-9917-82493d98c4ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:00.040335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3769ba44-9472-4fe7-9917-82493d98c4ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:00.041037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3769ba44-9472-4fe7-9917-82493d98c4ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:00.045075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b189e02-63e7-4e80-8784-c126c7dcd3c4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:00.045574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b189e02-63e7-4e80-8784-c126c7dcd3c4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:00.046015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b189e02-63e7-4e80-8784-c126c7dcd3c4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:00.047308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b189e02-63e7-4e80-8784-c126c7dcd3c4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:00.055642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b189e02-63e7-4e80-8784-c126c7dcd3c4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:00.055959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b189e02-63e7-4e80-8784-c126c7dcd3c4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:00.507063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3769ba44-9472-4fe7-9917-82493d98c4ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:00.528790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3769ba44-9472-4fe7-9917-82493d98c4ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:00.534004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3769ba44-9472-4fe7-9917-82493d98c4ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:00.538289 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3769ba44-9472-4fe7-9917-82493d98c4ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.549835 Sep 08 13:12:00.540553 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2353/4840] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:11:59 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:00.663165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6b189e02-63e7-4e80-8784-c126c7dcd3c4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:00.680721 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6b189e02-63e7-4e80-8784-c126c7dcd3c4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.675088 Sep 08 13:12:00.698906 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2488/4841] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:00 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:00.727407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-048bc6fb-0710-49e3-9591-92abe31e3559 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:00.735667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-048bc6fb-0710-49e3-9591-92abe31e3559 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: e3e95db2-4f06-41c4-a24c-7e7d8130fcd7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:00.778817 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-048bc6fb-0710-49e3-9591-92abe31e3559 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance e3e95db2-4f06-41c4-a24c-7e7d8130fcd7 could not be found. Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-048bc6fb-0710-49e3-9591-92abe31e3559 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/e3e95db2-4f06-41c4-a24c-7e7d8130fcd7/action HTTP/1.1 Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 15 Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: {"suspend": {}} Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance e3e95db2-4f06-41c4-a24c-7e7d8130fcd7 could not be found. Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'e3e95db2-4f06-41c4-a24c-7e7d8130fcd7', 'body': {'suspend': {}}} Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3e95db2-4f06-41c4-a24c-7e7d8130fcd7 could not be found. Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3e95db2-4f06-41c4-a24c-7e7d8130fcd7 could not be found. Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:00.783247 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:00.792293 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:12:00.792293 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:12:00.792293 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3e95db2-4f06-41c4-a24c-7e7d8130fcd7 could not be found. Sep 08 13:12:00.792293 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:00.808762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-048bc6fb-0710-49e3-9591-92abe31e3559 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance e3e95db2-4f06-41c4-a24c-7e7d8130fcd7 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:00.812246 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-048bc6fb-0710-49e3-9591-92abe31e3559 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/e3e95db2-4f06-41c4-a24c-7e7d8130fcd7/action" status: 404 len: 111 microversion: 2.1 time: 0.088363 Sep 08 13:12:00.828974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a24d6ef0-5945-4fe8-92db-49297edf6119 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:00.836205 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2354/4842] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:12:00 2022] POST /compute/v2.1/servers/e3e95db2-4f06-41c4-a24c-7e7d8130fcd7/action => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:12:00.838205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a24d6ef0-5945-4fe8-92db-49297edf6119 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:00.857993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a24d6ef0-5945-4fe8-92db-49297edf6119 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:00.859508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a24d6ef0-5945-4fe8-92db-49297edf6119 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:00.861302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a24d6ef0-5945-4fe8-92db-49297edf6119 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:00.863832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a24d6ef0-5945-4fe8-92db-49297edf6119 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:00.865187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a24d6ef0-5945-4fe8-92db-49297edf6119 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:00.866430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a24d6ef0-5945-4fe8-92db-49297edf6119 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:01.037463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-add1bd68-7003-4bde-b0c8-b2b9c428385c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:01.038884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-add1bd68-7003-4bde-b0c8-b2b9c428385c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:01.090872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-add1bd68-7003-4bde-b0c8-b2b9c428385c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:01.094413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-add1bd68-7003-4bde-b0c8-b2b9c428385c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:01.097833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-add1bd68-7003-4bde-b0c8-b2b9c428385c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:01.103597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-add1bd68-7003-4bde-b0c8-b2b9c428385c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:01.104961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-add1bd68-7003-4bde-b0c8-b2b9c428385c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:01.106137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-add1bd68-7003-4bde-b0c8-b2b9c428385c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:01.128473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=94 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:12:02.131923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-add1bd68-7003-4bde-b0c8-b2b9c428385c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:02.170109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-add1bd68-7003-4bde-b0c8-b2b9c428385c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:02.178375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-add1bd68-7003-4bde-b0c8-b2b9c428385c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:02.180788 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-add1bd68-7003-4bde-b0c8-b2b9c428385c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1406 microversion: 2.20 time: 1.151342 Sep 08 13:12:02.187152 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2355/4843] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:01 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1406 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:02.200151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad2dcdf8-d9a5-4dfc-970d-10901b46cdf9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:02.206738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad2dcdf8-d9a5-4dfc-970d-10901b46cdf9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:02.231742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad2dcdf8-d9a5-4dfc-970d-10901b46cdf9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:02.233180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad2dcdf8-d9a5-4dfc-970d-10901b46cdf9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:02.234215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad2dcdf8-d9a5-4dfc-970d-10901b46cdf9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:02.235904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad2dcdf8-d9a5-4dfc-970d-10901b46cdf9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:02.238155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad2dcdf8-d9a5-4dfc-970d-10901b46cdf9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:02.239604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad2dcdf8-d9a5-4dfc-970d-10901b46cdf9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:02.559930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ad2dcdf8-d9a5-4dfc-970d-10901b46cdf9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:02.597246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ad2dcdf8-d9a5-4dfc-970d-10901b46cdf9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:02.598530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a24d6ef0-5945-4fe8-92db-49297edf6119 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:02.609595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ad2dcdf8-d9a5-4dfc-970d-10901b46cdf9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:02.612610 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad2dcdf8-d9a5-4dfc-970d-10901b46cdf9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.423478 Sep 08 13:12:02.624021 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a24d6ef0-5945-4fe8-92db-49297edf6119 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.803120 Sep 08 13:12:02.625769 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2356/4844] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:02 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:02.633146 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2489/4845] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:00 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:12:02.684438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-231738db-22cb-4eac-8437-a87805b4fa05 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:02.689861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-231738db-22cb-4eac-8437-a87805b4fa05 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:02.755429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-231738db-22cb-4eac-8437-a87805b4fa05 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:02.756869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-231738db-22cb-4eac-8437-a87805b4fa05 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:02.762464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-231738db-22cb-4eac-8437-a87805b4fa05 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:02.766875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-231738db-22cb-4eac-8437-a87805b4fa05 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:02.772697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-231738db-22cb-4eac-8437-a87805b4fa05 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:02.774007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-231738db-22cb-4eac-8437-a87805b4fa05 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:03.620152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e1ad51ac-c4e9-44aa-9fc6-994e6fbe90a2 tempest-PortsAdminExtendedAttrsTestJSON-428926520 tempest-PortsAdminExtendedAttrsTestJSON-428926520-project-admin] Calling method '.version_select at 0x7fdb35a991f0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:03.623021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ad51ac-c4e9-44aa-9fc6-994e6fbe90a2 tempest-PortsAdminExtendedAttrsTestJSON-428926520 tempest-PortsAdminExtendedAttrsTestJSON-428926520-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:03.631448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ad51ac-c4e9-44aa-9fc6-994e6fbe90a2 tempest-PortsAdminExtendedAttrsTestJSON-428926520 tempest-PortsAdminExtendedAttrsTestJSON-428926520-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:03.632204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ad51ac-c4e9-44aa-9fc6-994e6fbe90a2 tempest-PortsAdminExtendedAttrsTestJSON-428926520 tempest-PortsAdminExtendedAttrsTestJSON-428926520-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:03.672920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ad51ac-c4e9-44aa-9fc6-994e6fbe90a2 tempest-PortsAdminExtendedAttrsTestJSON-428926520 tempest-PortsAdminExtendedAttrsTestJSON-428926520-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:03.675808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ad51ac-c4e9-44aa-9fc6-994e6fbe90a2 tempest-PortsAdminExtendedAttrsTestJSON-428926520 tempest-PortsAdminExtendedAttrsTestJSON-428926520-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:03.676406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ad51ac-c4e9-44aa-9fc6-994e6fbe90a2 tempest-PortsAdminExtendedAttrsTestJSON-428926520 tempest-PortsAdminExtendedAttrsTestJSON-428926520-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:03.680715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-231738db-22cb-4eac-8437-a87805b4fa05 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:03.694330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:12:03.697531 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-231738db-22cb-4eac-8437-a87805b4fa05 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.021122 Sep 08 13:12:03.711898 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2357/4846] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:02 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:03.712412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ad51ac-c4e9-44aa-9fc6-994e6fbe90a2 tempest-PortsAdminExtendedAttrsTestJSON-428926520 tempest-PortsAdminExtendedAttrsTestJSON-428926520-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:03.719904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ad51ac-c4e9-44aa-9fc6-994e6fbe90a2 tempest-PortsAdminExtendedAttrsTestJSON-428926520 tempest-PortsAdminExtendedAttrsTestJSON-428926520-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:03.720761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ad51ac-c4e9-44aa-9fc6-994e6fbe90a2 tempest-PortsAdminExtendedAttrsTestJSON-428926520 tempest-PortsAdminExtendedAttrsTestJSON-428926520-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:03.737925 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e1ad51ac-c4e9-44aa-9fc6-994e6fbe90a2 tempest-PortsAdminExtendedAttrsTestJSON-428926520 tempest-PortsAdminExtendedAttrsTestJSON-428926520-project-admin] 10.222.0.78 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.602646 Sep 08 13:12:03.740121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d122df9-d431-4eae-9cb3-74f204eed2fd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:03.741113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d122df9-d431-4eae-9cb3-74f204eed2fd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:03.741449 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2490/4847] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 13:12:03 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:12:03.754023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-db43200f-fee1-4be3-a146-1f23b851a577 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:03.755180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-db43200f-fee1-4be3-a146-1f23b851a577 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:03.762967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d122df9-d431-4eae-9cb3-74f204eed2fd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:03.763932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d122df9-d431-4eae-9cb3-74f204eed2fd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:03.764594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d122df9-d431-4eae-9cb3-74f204eed2fd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:03.765552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d122df9-d431-4eae-9cb3-74f204eed2fd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:03.768097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d122df9-d431-4eae-9cb3-74f204eed2fd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:03.768889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d122df9-d431-4eae-9cb3-74f204eed2fd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:03.785785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db43200f-fee1-4be3-a146-1f23b851a577 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:03.789235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db43200f-fee1-4be3-a146-1f23b851a577 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:03.791106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db43200f-fee1-4be3-a146-1f23b851a577 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:03.793566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db43200f-fee1-4be3-a146-1f23b851a577 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:03.794103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db43200f-fee1-4be3-a146-1f23b851a577 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:03.795788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db43200f-fee1-4be3-a146-1f23b851a577 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:04.458179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-db43200f-fee1-4be3-a146-1f23b851a577 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:04.485235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-db43200f-fee1-4be3-a146-1f23b851a577 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:04.496170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-db43200f-fee1-4be3-a146-1f23b851a577 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:04.504876 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-db43200f-fee1-4be3-a146-1f23b851a577 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.760371 Sep 08 13:12:04.508498 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2491/4848] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:03 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:04.534651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fe656a4a-f627-4dc4-901a-c106113c6a85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:04.535677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fe656a4a-f627-4dc4-901a-c106113c6a85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:04.570190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe656a4a-f627-4dc4-901a-c106113c6a85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:04.571049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe656a4a-f627-4dc4-901a-c106113c6a85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:04.571870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe656a4a-f627-4dc4-901a-c106113c6a85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:04.577644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe656a4a-f627-4dc4-901a-c106113c6a85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:04.581897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe656a4a-f627-4dc4-901a-c106113c6a85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:04.585084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe656a4a-f627-4dc4-901a-c106113c6a85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:04.667325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-fe656a4a-f627-4dc4-901a-c106113c6a85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lazy-loading 'flavor' on Instance uuid 4eb421d7-2415-43d2-a6bb-3fdbca098091 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:12:04.851872 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fe656a4a-f627-4dc4-901a-c106113c6a85 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 202 len: 0 microversion: 2.1 time: 0.340340 Sep 08 13:12:04.855909 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2492/4849] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:12:04 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:12:04.893885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ddcf23af-7829-4fe8-af0e-4227e4d0a7bc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:04.896542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ddcf23af-7829-4fe8-af0e-4227e4d0a7bc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:04.909962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddcf23af-7829-4fe8-af0e-4227e4d0a7bc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:04.909962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddcf23af-7829-4fe8-af0e-4227e4d0a7bc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:04.909962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddcf23af-7829-4fe8-af0e-4227e4d0a7bc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:04.909962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddcf23af-7829-4fe8-af0e-4227e4d0a7bc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:04.909962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddcf23af-7829-4fe8-af0e-4227e4d0a7bc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:04.909962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ddcf23af-7829-4fe8-af0e-4227e4d0a7bc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:05.536880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8d122df9-d431-4eae-9cb3-74f204eed2fd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:05.579668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8d122df9-d431-4eae-9cb3-74f204eed2fd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:05.585087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8d122df9-d431-4eae-9cb3-74f204eed2fd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:05.593793 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d122df9-d431-4eae-9cb3-74f204eed2fd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1406 microversion: 2.20 time: 1.879720 Sep 08 13:12:05.594845 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2358/4850] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:03 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1406 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:05.627200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4ac6e498-9b45-44ad-8d74-0fff51d2f4d4 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:05.638255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ac6e498-9b45-44ad-8d74-0fff51d2f4d4 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:05.695835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ac6e498-9b45-44ad-8d74-0fff51d2f4d4 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:05.699765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ac6e498-9b45-44ad-8d74-0fff51d2f4d4 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:05.701461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ac6e498-9b45-44ad-8d74-0fff51d2f4d4 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:05.707013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ac6e498-9b45-44ad-8d74-0fff51d2f4d4 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:05.711636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ac6e498-9b45-44ad-8d74-0fff51d2f4d4 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:05.716978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ac6e498-9b45-44ad-8d74-0fff51d2f4d4 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:06.018491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4ac6e498-9b45-44ad-8d74-0fff51d2f4d4 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:06.052413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4ac6e498-9b45-44ad-8d74-0fff51d2f4d4 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:06.056142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4ac6e498-9b45-44ad-8d74-0fff51d2f4d4 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:06.058634 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4ac6e498-9b45-44ad-8d74-0fff51d2f4d4 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.457036 Sep 08 13:12:06.060610 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2359/4851] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:05 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:06.301588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ddcf23af-7829-4fe8-af0e-4227e4d0a7bc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:06.328176 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ddcf23af-7829-4fe8-af0e-4227e4d0a7bc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1514 microversion: 2.1 time: 1.468262 Sep 08 13:12:06.329330 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2493/4852] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:04 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1514 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:06.646629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-368edd77-492f-478e-8490-7036ecd909fa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:06.647603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-368edd77-492f-478e-8490-7036ecd909fa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:06.670598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-368edd77-492f-478e-8490-7036ecd909fa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:06.676494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-368edd77-492f-478e-8490-7036ecd909fa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:06.679490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-368edd77-492f-478e-8490-7036ecd909fa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:06.714749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-368edd77-492f-478e-8490-7036ecd909fa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:06.715631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-368edd77-492f-478e-8490-7036ecd909fa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:06.720446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-368edd77-492f-478e-8490-7036ecd909fa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:07.117754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b94f07aa-d0bb-41c3-b0fe-f5ab231ab774 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:07.118935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b94f07aa-d0bb-41c3-b0fe-f5ab231ab774 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:07.141179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b94f07aa-d0bb-41c3-b0fe-f5ab231ab774 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:07.141922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b94f07aa-d0bb-41c3-b0fe-f5ab231ab774 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:07.142744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b94f07aa-d0bb-41c3-b0fe-f5ab231ab774 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:07.144155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b94f07aa-d0bb-41c3-b0fe-f5ab231ab774 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:07.145031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b94f07aa-d0bb-41c3-b0fe-f5ab231ab774 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:07.145841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b94f07aa-d0bb-41c3-b0fe-f5ab231ab774 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:07.364825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-368edd77-492f-478e-8490-7036ecd909fa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:07.389803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-368edd77-492f-478e-8490-7036ecd909fa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:07.410088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-368edd77-492f-478e-8490-7036ecd909fa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:07.412549 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-368edd77-492f-478e-8490-7036ecd909fa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1406 microversion: 2.20 time: 0.775210 Sep 08 13:12:07.413649 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2360/4853] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:06 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1406 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:07.420717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b94f07aa-d0bb-41c3-b0fe-f5ab231ab774 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:07.459056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b94f07aa-d0bb-41c3-b0fe-f5ab231ab774 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:07.462349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b94f07aa-d0bb-41c3-b0fe-f5ab231ab774 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:07.463818 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b94f07aa-d0bb-41c3-b0fe-f5ab231ab774 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.353987 Sep 08 13:12:07.464429 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2494/4854] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:07 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:12:07.785150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6aeb6790-fb33-43b2-8be4-78cfae06a436 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:07.788826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6aeb6790-fb33-43b2-8be4-78cfae06a436 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:07.809199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6aeb6790-fb33-43b2-8be4-78cfae06a436 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:07.810121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6aeb6790-fb33-43b2-8be4-78cfae06a436 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:07.810955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6aeb6790-fb33-43b2-8be4-78cfae06a436 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:07.812752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6aeb6790-fb33-43b2-8be4-78cfae06a436 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:07.813944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6aeb6790-fb33-43b2-8be4-78cfae06a436 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:07.814989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6aeb6790-fb33-43b2-8be4-78cfae06a436 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:08.302149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6aeb6790-fb33-43b2-8be4-78cfae06a436 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:08.321107 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6aeb6790-fb33-43b2-8be4-78cfae06a436 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1497 microversion: 2.1 time: 0.895020 Sep 08 13:12:08.322814 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2361/4855] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:07 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1497 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:08.371908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:08.380216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:08.408327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:08.409249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:08.410076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:08.411643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:08.415763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:08.416982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:08.464244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ed32a929-4e00-4c92-8126-b229848abdf5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:08.469260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ed32a929-4e00-4c92-8126-b229848abdf5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:08.513701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed32a929-4e00-4c92-8126-b229848abdf5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:08.514693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed32a929-4e00-4c92-8126-b229848abdf5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:08.524076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed32a929-4e00-4c92-8126-b229848abdf5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:08.525595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed32a929-4e00-4c92-8126-b229848abdf5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:08.526507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed32a929-4e00-4c92-8126-b229848abdf5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:08.527350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed32a929-4e00-4c92-8126-b229848abdf5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:08.582329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lazy-loading 'flavor' on Instance uuid 4eb421d7-2415-43d2-a6bb-3fdbca098091 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:12:08.621119 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Cannot 'suspend' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state suspended Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action HTTP/1.1 Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 15 Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: {"suspend": {}} Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: exception: Cannot 'suspend' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state suspended Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '4eb421d7-2415-43d2-a6bb-3fdbca098091', 'body': {'suspend': {}}} Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 in vm_state suspended. Cannot suspend while the instance is in this state. Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Sep 08 13:12:08.625761 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state suspended Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state suspended Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 409 to user: Cannot 'suspend' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state suspended {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a950d6b8-6467-4d0e-8ef6-f3bb203685e3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 409 len: 148 microversion: 2.1 time: 0.263674 Sep 08 13:12:08.643866 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2495/4856] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:12:08 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 148 bytes in 272 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:12:08.650010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d6e0aeb-ddc4-47be-adb5-bb58ad508700 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:08.650010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6d6e0aeb-ddc4-47be-adb5-bb58ad508700 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:08.669323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d6e0aeb-ddc4-47be-adb5-bb58ad508700 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:08.670712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d6e0aeb-ddc4-47be-adb5-bb58ad508700 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:08.671318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d6e0aeb-ddc4-47be-adb5-bb58ad508700 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:08.672265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d6e0aeb-ddc4-47be-adb5-bb58ad508700 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:08.672952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d6e0aeb-ddc4-47be-adb5-bb58ad508700 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:08.673780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d6e0aeb-ddc4-47be-adb5-bb58ad508700 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:08.896758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d6e0aeb-ddc4-47be-adb5-bb58ad508700 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:08.930716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d6e0aeb-ddc4-47be-adb5-bb58ad508700 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:08.940211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d6e0aeb-ddc4-47be-adb5-bb58ad508700 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:08.947088 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6d6e0aeb-ddc4-47be-adb5-bb58ad508700 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.306971 Sep 08 13:12:08.970195 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2496/4857] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:08 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:08.993617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3afd3ac4-6dc4-4f16-b2e7-7d4d8d4b0a08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:08.995125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3afd3ac4-6dc4-4f16-b2e7-7d4d8d4b0a08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:09.008850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3afd3ac4-6dc4-4f16-b2e7-7d4d8d4b0a08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:09.010331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3afd3ac4-6dc4-4f16-b2e7-7d4d8d4b0a08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:09.011910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3afd3ac4-6dc4-4f16-b2e7-7d4d8d4b0a08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:09.013696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3afd3ac4-6dc4-4f16-b2e7-7d4d8d4b0a08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:09.015300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3afd3ac4-6dc4-4f16-b2e7-7d4d8d4b0a08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:09.016799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3afd3ac4-6dc4-4f16-b2e7-7d4d8d4b0a08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:09.076197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ed32a929-4e00-4c92-8126-b229848abdf5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:09.115749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ed32a929-4e00-4c92-8126-b229848abdf5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:09.127305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ed32a929-4e00-4c92-8126-b229848abdf5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:09.138041 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ed32a929-4e00-4c92-8126-b229848abdf5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1406 microversion: 2.20 time: 0.681656 Sep 08 13:12:09.139209 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2362/4858] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:08 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1406 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:09.177254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-76934666-a3e9-4008-abd1-c2b0f02fa4f6 req-f9561175-79fd-4ec5-adfa-a9b054bb13ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad0f9bb-3303-4bdc-a35e-102f0002fe77", "name": "network-vif-plugged", "status": "completed", "tag": "1ea3ab52-16b6-4072-bb78-7320e9ba5e25"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:09.240256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-76934666-a3e9-4008-abd1-c2b0f02fa4f6 req-f9561175-79fd-4ec5-adfa-a9b054bb13ad service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:09.246105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-76934666-a3e9-4008-abd1-c2b0f02fa4f6 req-f9561175-79fd-4ec5-adfa-a9b054bb13ad service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:09.252456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-76934666-a3e9-4008-abd1-c2b0f02fa4f6 req-f9561175-79fd-4ec5-adfa-a9b054bb13ad service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:09.344584 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-76934666-a3e9-4008-abd1-c2b0f02fa4f6 req-f9561175-79fd-4ec5-adfa-a9b054bb13ad service nova] Creating event network-vif-plugged:1ea3ab52-16b6-4072-bb78-7320e9ba5e25 for instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 on n-h1-852084-10 Sep 08 13:12:09.363249 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3afd3ac4-6dc4-4f16-b2e7-7d4d8d4b0a08 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 202 len: 0 microversion: 2.1 time: 0.383818 Sep 08 13:12:09.375739 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2497/4859] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:12:08 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:12:09.410304 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-76934666-a3e9-4008-abd1-c2b0f02fa4f6 req-f9561175-79fd-4ec5-adfa-a9b054bb13ad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.265404 Sep 08 13:12:09.411078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84699063-3a44-4de8-9674-2922fd4ee2e2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:09.412531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-84699063-3a44-4de8-9674-2922fd4ee2e2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:09.413940 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2363/4860] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:12:09.473518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84699063-3a44-4de8-9674-2922fd4ee2e2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:09.478330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84699063-3a44-4de8-9674-2922fd4ee2e2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:09.479717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84699063-3a44-4de8-9674-2922fd4ee2e2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:09.490025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84699063-3a44-4de8-9674-2922fd4ee2e2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:09.492204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84699063-3a44-4de8-9674-2922fd4ee2e2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:09.499055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84699063-3a44-4de8-9674-2922fd4ee2e2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:10.001096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-773307fc-68c2-4697-aa04-5bbd890772bb tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:10.002617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-773307fc-68c2-4697-aa04-5bbd890772bb tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:10.020216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-773307fc-68c2-4697-aa04-5bbd890772bb tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:10.021146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-773307fc-68c2-4697-aa04-5bbd890772bb tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:10.021836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-773307fc-68c2-4697-aa04-5bbd890772bb tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:10.023167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-773307fc-68c2-4697-aa04-5bbd890772bb tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:10.023867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-773307fc-68c2-4697-aa04-5bbd890772bb tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:10.024499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-773307fc-68c2-4697-aa04-5bbd890772bb tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:10.224570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-773307fc-68c2-4697-aa04-5bbd890772bb tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:10.249300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-773307fc-68c2-4697-aa04-5bbd890772bb tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:10.262759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-773307fc-68c2-4697-aa04-5bbd890772bb tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:10.265238 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-773307fc-68c2-4697-aa04-5bbd890772bb tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.269535 Sep 08 13:12:10.269234 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2364/4861] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:09 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:12:10.283536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9fa09336-22af-45a5-81c7-e488bae8d9e0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:10.284597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9fa09336-22af-45a5-81c7-e488bae8d9e0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:10.305660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fa09336-22af-45a5-81c7-e488bae8d9e0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:10.306650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fa09336-22af-45a5-81c7-e488bae8d9e0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:10.307451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fa09336-22af-45a5-81c7-e488bae8d9e0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:10.308452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fa09336-22af-45a5-81c7-e488bae8d9e0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:10.309167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fa09336-22af-45a5-81c7-e488bae8d9e0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:10.309852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fa09336-22af-45a5-81c7-e488bae8d9e0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:10.450904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-84699063-3a44-4de8-9674-2922fd4ee2e2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:10.467588 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-84699063-3a44-4de8-9674-2922fd4ee2e2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1503 microversion: 2.1 time: 1.086187 Sep 08 13:12:10.474919 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2498/4862] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:09 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1503 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:11.324626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fb3d0372-54e0-4d4d-9e9d-4860c576087f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:11.328091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fb3d0372-54e0-4d4d-9e9d-4860c576087f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:11.356911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9fa09336-22af-45a5-81c7-e488bae8d9e0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:11.390172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb3d0372-54e0-4d4d-9e9d-4860c576087f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:11.397492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb3d0372-54e0-4d4d-9e9d-4860c576087f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:11.407081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb3d0372-54e0-4d4d-9e9d-4860c576087f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:11.412958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb3d0372-54e0-4d4d-9e9d-4860c576087f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:11.422890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9fa09336-22af-45a5-81c7-e488bae8d9e0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:11.428546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb3d0372-54e0-4d4d-9e9d-4860c576087f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:11.445739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb3d0372-54e0-4d4d-9e9d-4860c576087f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:11.464753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9fa09336-22af-45a5-81c7-e488bae8d9e0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:11.482217 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9fa09336-22af-45a5-81c7-e488bae8d9e0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1406 microversion: 2.20 time: 1.202243 Sep 08 13:12:11.519397 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2365/4863] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:10 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1406 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:11.576900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-77cdf5cf-5a43-47c9-8144-9945898ac108 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:11.587293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-77cdf5cf-5a43-47c9-8144-9945898ac108 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:11.620702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77cdf5cf-5a43-47c9-8144-9945898ac108 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:11.623063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77cdf5cf-5a43-47c9-8144-9945898ac108 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:11.625790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77cdf5cf-5a43-47c9-8144-9945898ac108 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:11.626791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77cdf5cf-5a43-47c9-8144-9945898ac108 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:11.628422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77cdf5cf-5a43-47c9-8144-9945898ac108 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:11.631163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77cdf5cf-5a43-47c9-8144-9945898ac108 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:12.106475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fb3d0372-54e0-4d4d-9e9d-4860c576087f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:12.129498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fb3d0372-54e0-4d4d-9e9d-4860c576087f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:12.133459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fb3d0372-54e0-4d4d-9e9d-4860c576087f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:12.139967 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fb3d0372-54e0-4d4d-9e9d-4860c576087f tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.826703 Sep 08 13:12:12.140959 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2499/4864] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:11 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:12:12.342370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-77cdf5cf-5a43-47c9-8144-9945898ac108 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:12.397559 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-77cdf5cf-5a43-47c9-8144-9945898ac108 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1503 microversion: 2.1 time: 0.860361 Sep 08 13:12:12.402258 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2366/4865] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:11 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1503 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:12.553370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eef142b9-6c09-4fc8-b5c4-152f8f2267e6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:12.553906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eef142b9-6c09-4fc8-b5c4-152f8f2267e6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:12.584122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef142b9-6c09-4fc8-b5c4-152f8f2267e6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:12.584546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef142b9-6c09-4fc8-b5c4-152f8f2267e6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:12.585213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef142b9-6c09-4fc8-b5c4-152f8f2267e6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:12.586208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef142b9-6c09-4fc8-b5c4-152f8f2267e6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:12.587003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef142b9-6c09-4fc8-b5c4-152f8f2267e6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:12.587682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef142b9-6c09-4fc8-b5c4-152f8f2267e6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:13.125176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eef142b9-6c09-4fc8-b5c4-152f8f2267e6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:13.155321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eef142b9-6c09-4fc8-b5c4-152f8f2267e6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:13.157562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eef142b9-6c09-4fc8-b5c4-152f8f2267e6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:13.165872 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eef142b9-6c09-4fc8-b5c4-152f8f2267e6 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1599 microversion: 2.20 time: 0.617676 Sep 08 13:12:13.170506 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2500/4866] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:12 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1599 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:13.196469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2452a47-9c9c-4cc5-a045-795886f997ce tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:13.197096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2452a47-9c9c-4cc5-a045-795886f997ce tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:13.197463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-120fdedd-c55d-4fa9-af0e-736c0cd1c828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:13.198187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-120fdedd-c55d-4fa9-af0e-736c0cd1c828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:13.210043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-120fdedd-c55d-4fa9-af0e-736c0cd1c828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:13.213243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-120fdedd-c55d-4fa9-af0e-736c0cd1c828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:13.214056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-120fdedd-c55d-4fa9-af0e-736c0cd1c828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:13.216205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-120fdedd-c55d-4fa9-af0e-736c0cd1c828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:13.216449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2452a47-9c9c-4cc5-a045-795886f997ce tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:13.218524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-120fdedd-c55d-4fa9-af0e-736c0cd1c828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:13.219259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-120fdedd-c55d-4fa9-af0e-736c0cd1c828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:13.238375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2452a47-9c9c-4cc5-a045-795886f997ce tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:13.238982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2452a47-9c9c-4cc5-a045-795886f997ce tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:13.239807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2452a47-9c9c-4cc5-a045-795886f997ce tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:13.240343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2452a47-9c9c-4cc5-a045-795886f997ce tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:13.240977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2452a47-9c9c-4cc5-a045-795886f997ce tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:13.544450 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-120fdedd-c55d-4fa9-af0e-736c0cd1c828 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.351617 Sep 08 13:12:13.546468 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2501/4867] 10.222.0.78 () {60 vars in 1316 bytes} [Thu Sep 8 13:12:13 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/os-interface => generated 285 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:12:13.554841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e090cfc0-78e9-46ba-850a-5c508a10fffd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:13.556379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e090cfc0-78e9-46ba-850a-5c508a10fffd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:13.561006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f2452a47-9c9c-4cc5-a045-795886f997ce tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:13.595272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e090cfc0-78e9-46ba-850a-5c508a10fffd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:13.595781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e090cfc0-78e9-46ba-850a-5c508a10fffd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:13.596242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e090cfc0-78e9-46ba-850a-5c508a10fffd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:13.597023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e090cfc0-78e9-46ba-850a-5c508a10fffd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:13.597475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e090cfc0-78e9-46ba-850a-5c508a10fffd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:13.601352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f2452a47-9c9c-4cc5-a045-795886f997ce tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:13.605113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f2452a47-9c9c-4cc5-a045-795886f997ce tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:13.606181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e090cfc0-78e9-46ba-850a-5c508a10fffd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:13.623852 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2452a47-9c9c-4cc5-a045-795886f997ce tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.425275 Sep 08 13:12:13.625455 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2367/4868] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:13 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:12:14.199359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e090cfc0-78e9-46ba-850a-5c508a10fffd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:14.227567 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e090cfc0-78e9-46ba-850a-5c508a10fffd tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.678039 Sep 08 13:12:14.229549 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2502/4869] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:13 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:14.261003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e859c8f2-9903-447c-b845-0be54d2da904 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:14.267002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e859c8f2-9903-447c-b845-0be54d2da904 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:14.295270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e859c8f2-9903-447c-b845-0be54d2da904 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:14.302706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e859c8f2-9903-447c-b845-0be54d2da904 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:14.313247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e859c8f2-9903-447c-b845-0be54d2da904 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:14.315526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e859c8f2-9903-447c-b845-0be54d2da904 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:14.319409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e859c8f2-9903-447c-b845-0be54d2da904 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:14.321936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e859c8f2-9903-447c-b845-0be54d2da904 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:14.679731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28bf7480-cc38-4e18-8ccc-72972f664afd tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:14.680968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-28bf7480-cc38-4e18-8ccc-72972f664afd tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:14.733759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28bf7480-cc38-4e18-8ccc-72972f664afd tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:14.735046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28bf7480-cc38-4e18-8ccc-72972f664afd tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:14.736942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28bf7480-cc38-4e18-8ccc-72972f664afd tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:14.738711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28bf7480-cc38-4e18-8ccc-72972f664afd tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:14.741145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28bf7480-cc38-4e18-8ccc-72972f664afd tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:14.742377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28bf7480-cc38-4e18-8ccc-72972f664afd tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:15.176422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-28bf7480-cc38-4e18-8ccc-72972f664afd tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:15.208143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-28bf7480-cc38-4e18-8ccc-72972f664afd tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:15.216658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-28bf7480-cc38-4e18-8ccc-72972f664afd tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:15.225595 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-28bf7480-cc38-4e18-8ccc-72972f664afd tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.549842 Sep 08 13:12:15.227795 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2503/4870] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:14 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:12:15.299842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e859c8f2-9903-447c-b845-0be54d2da904 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:15.340905 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e859c8f2-9903-447c-b845-0be54d2da904 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.084509 Sep 08 13:12:15.342374 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2368/4871] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:14 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:15.378596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b5e34b6-e6cc-409c-87f3-bb6cc11d7db3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:15.379601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7b5e34b6-e6cc-409c-87f3-bb6cc11d7db3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 91e4486e-b4a5-45ce-9c06-ac931566c868] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:15.410391 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-7b5e34b6-e6cc-409c-87f3-bb6cc11d7db3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 91e4486e-b4a5-45ce-9c06-ac931566c868 could not be found. Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b5e34b6-e6cc-409c-87f3-bb6cc11d7db3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/91e4486e-b4a5-45ce-9c06-ac931566c868/action HTTP/1.1 Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 15 Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: {"unpause": {}} Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 91e4486e-b4a5-45ce-9c06-ac931566c868 could not be found. Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '91e4486e-b4a5-45ce-9c06-ac931566c868', 'body': {'unpause': {}}} Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91e4486e-b4a5-45ce-9c06-ac931566c868 could not be found. Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91e4486e-b4a5-45ce-9c06-ac931566c868 could not be found. Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:15.418346 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:15.429933 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:12:15.429933 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:12:15.429933 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91e4486e-b4a5-45ce-9c06-ac931566c868 could not be found. Sep 08 13:12:15.429933 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:15.434484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b5e34b6-e6cc-409c-87f3-bb6cc11d7db3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 91e4486e-b4a5-45ce-9c06-ac931566c868 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:15.434484 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7b5e34b6-e6cc-409c-87f3-bb6cc11d7db3 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/91e4486e-b4a5-45ce-9c06-ac931566c868/action" status: 404 len: 111 microversion: 2.1 time: 0.069492 Sep 08 13:12:15.436709 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2504/4872] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:12:15 2022] POST /compute/v2.1/servers/91e4486e-b4a5-45ce-9c06-ac931566c868/action => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:12:15.450317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0f0319f0-e7b7-41b5-9ce6-797e1aada02e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:15.452168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0f0319f0-e7b7-41b5-9ce6-797e1aada02e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:15.465811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f0319f0-e7b7-41b5-9ce6-797e1aada02e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:15.467742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f0319f0-e7b7-41b5-9ce6-797e1aada02e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:15.469008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f0319f0-e7b7-41b5-9ce6-797e1aada02e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:15.470799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f0319f0-e7b7-41b5-9ce6-797e1aada02e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:15.472170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f0319f0-e7b7-41b5-9ce6-797e1aada02e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:15.473406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f0319f0-e7b7-41b5-9ce6-797e1aada02e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:16.284365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-622581ac-2e1c-4cca-ae1f-eaa4262386a9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:16.287915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-622581ac-2e1c-4cca-ae1f-eaa4262386a9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:16.319092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-622581ac-2e1c-4cca-ae1f-eaa4262386a9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:16.320593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-622581ac-2e1c-4cca-ae1f-eaa4262386a9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:16.321773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-622581ac-2e1c-4cca-ae1f-eaa4262386a9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:16.323577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-622581ac-2e1c-4cca-ae1f-eaa4262386a9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:16.327947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-622581ac-2e1c-4cca-ae1f-eaa4262386a9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:16.329398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-622581ac-2e1c-4cca-ae1f-eaa4262386a9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:16.593833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-622581ac-2e1c-4cca-ae1f-eaa4262386a9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:16.597851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:12:16.632779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-622581ac-2e1c-4cca-ae1f-eaa4262386a9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:16.635777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-622581ac-2e1c-4cca-ae1f-eaa4262386a9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:16.638397 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-622581ac-2e1c-4cca-ae1f-eaa4262386a9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.371833 Sep 08 13:12:16.640060 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2505/4873] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:16 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:16.685394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0f0319f0-e7b7-41b5-9ce6-797e1aada02e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:16.709693 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0f0319f0-e7b7-41b5-9ce6-797e1aada02e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.267897 Sep 08 13:12:16.710978 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2369/4874] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:15 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:16.750086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9f83e0c-7473-4022-8e90-a77e17396710 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:16.751926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a9f83e0c-7473-4022-8e90-a77e17396710 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:16.768207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9f83e0c-7473-4022-8e90-a77e17396710 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:16.769234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9f83e0c-7473-4022-8e90-a77e17396710 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:16.770479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9f83e0c-7473-4022-8e90-a77e17396710 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:16.774138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9f83e0c-7473-4022-8e90-a77e17396710 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:16.774822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9f83e0c-7473-4022-8e90-a77e17396710 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:16.775758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9f83e0c-7473-4022-8e90-a77e17396710 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:17.691640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-537d9355-1657-4fe8-8492-b7c9266513f3 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:17.694363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-537d9355-1657-4fe8-8492-b7c9266513f3 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:17.709311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-537d9355-1657-4fe8-8492-b7c9266513f3 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:17.710434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-537d9355-1657-4fe8-8492-b7c9266513f3 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:17.710434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-537d9355-1657-4fe8-8492-b7c9266513f3 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:17.712066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-537d9355-1657-4fe8-8492-b7c9266513f3 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:17.712605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-537d9355-1657-4fe8-8492-b7c9266513f3 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:17.714907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-537d9355-1657-4fe8-8492-b7c9266513f3 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:18.057815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-537d9355-1657-4fe8-8492-b7c9266513f3 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:18.140551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-537d9355-1657-4fe8-8492-b7c9266513f3 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:18.142335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-537d9355-1657-4fe8-8492-b7c9266513f3 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:18.148940 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-537d9355-1657-4fe8-8492-b7c9266513f3 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.466058 Sep 08 13:12:18.156516 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2370/4875] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:17 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:18.270816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9f83e0c-7473-4022-8e90-a77e17396710 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:18.281287 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a9f83e0c-7473-4022-8e90-a77e17396710 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.549275 Sep 08 13:12:18.283278 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2506/4876] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:16 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:18.313384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b078f9c3-338a-46dd-bcc0-b97143cce651 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:18.313995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b078f9c3-338a-46dd-bcc0-b97143cce651 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:18.327606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b078f9c3-338a-46dd-bcc0-b97143cce651 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:18.328286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b078f9c3-338a-46dd-bcc0-b97143cce651 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:18.328770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b078f9c3-338a-46dd-bcc0-b97143cce651 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:18.329507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b078f9c3-338a-46dd-bcc0-b97143cce651 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:18.329994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b078f9c3-338a-46dd-bcc0-b97143cce651 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:18.330439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b078f9c3-338a-46dd-bcc0-b97143cce651 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:18.376659 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-b078f9c3-338a-46dd-bcc0-b97143cce651 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Cannot 'unpause' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b078f9c3-338a-46dd-bcc0-b97143cce651 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action HTTP/1.1 Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 15 Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: {"unpause": {}} Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: exception: Cannot 'unpause' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '4eb421d7-2415-43d2-a6bb-3fdbca098091', 'body': {'unpause': {}}} Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 in vm_state active. Cannot unpause while the instance is in this state. Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:18.383986 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:18.392156 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:18.392156 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:12:18.392156 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:12:18.392156 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:12:18.392156 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:18.394855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b078f9c3-338a-46dd-bcc0-b97143cce651 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 409 to user: Cannot 'unpause' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:18.396431 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b078f9c3-338a-46dd-bcc0-b97143cce651 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 409 len: 145 microversion: 2.1 time: 0.092903 Sep 08 13:12:18.403835 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2371/4877] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:12:18 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 145 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:12:18.410252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b7fc3580-064b-4cfe-b274-84450914b202 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:18.411945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b7fc3580-064b-4cfe-b274-84450914b202 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:18.425583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b7fc3580-064b-4cfe-b274-84450914b202 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:18.426493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b7fc3580-064b-4cfe-b274-84450914b202 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:18.427355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b7fc3580-064b-4cfe-b274-84450914b202 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:18.429043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b7fc3580-064b-4cfe-b274-84450914b202 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:18.430204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b7fc3580-064b-4cfe-b274-84450914b202 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:18.431212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b7fc3580-064b-4cfe-b274-84450914b202 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:19.214656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-102456fc-0ac5-425e-bfbb-2359325583e6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:19.216187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b7fc3580-064b-4cfe-b274-84450914b202 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:19.220186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-102456fc-0ac5-425e-bfbb-2359325583e6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:19.258912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-102456fc-0ac5-425e-bfbb-2359325583e6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:19.265308 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b7fc3580-064b-4cfe-b274-84450914b202 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.862387 Sep 08 13:12:19.281275 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2507/4878] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:18 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:12:19.282577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-102456fc-0ac5-425e-bfbb-2359325583e6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:19.282577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-102456fc-0ac5-425e-bfbb-2359325583e6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:19.283302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-102456fc-0ac5-425e-bfbb-2359325583e6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:19.284910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-102456fc-0ac5-425e-bfbb-2359325583e6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:19.288058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-102456fc-0ac5-425e-bfbb-2359325583e6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:19.303362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc9743e1-ef27-4e7a-b41c-68e27980a7dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:19.303998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc9743e1-ef27-4e7a-b41c-68e27980a7dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:19.315411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc9743e1-ef27-4e7a-b41c-68e27980a7dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:19.315952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc9743e1-ef27-4e7a-b41c-68e27980a7dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:19.316452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc9743e1-ef27-4e7a-b41c-68e27980a7dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:19.317808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc9743e1-ef27-4e7a-b41c-68e27980a7dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:19.318526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc9743e1-ef27-4e7a-b41c-68e27980a7dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:19.319006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc9743e1-ef27-4e7a-b41c-68e27980a7dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:19.496442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-102456fc-0ac5-425e-bfbb-2359325583e6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:19.509458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:12:19.516378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-102456fc-0ac5-425e-bfbb-2359325583e6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:19.519262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-102456fc-0ac5-425e-bfbb-2359325583e6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:19.521722 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-102456fc-0ac5-425e-bfbb-2359325583e6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.314143 Sep 08 13:12:19.522972 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2372/4879] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:19 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:20.055621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc9743e1-ef27-4e7a-b41c-68e27980a7dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:20.115818 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc9743e1-ef27-4e7a-b41c-68e27980a7dc tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.822524 Sep 08 13:12:20.123036 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2508/4880] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:19 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:20.153043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-30f5975c-945c-49dd-8d70-bd08c244cc56 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:20.156160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-30f5975c-945c-49dd-8d70-bd08c244cc56 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: fd3c78af-5a62-46ae-965e-1a8e2c241dc8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:20.176493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=60 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:12:20.182073 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-30f5975c-945c-49dd-8d70-bd08c244cc56 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance fd3c78af-5a62-46ae-965e-1a8e2c241dc8 could not be found. Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-30f5975c-945c-49dd-8d70-bd08c244cc56 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/fd3c78af-5a62-46ae-965e-1a8e2c241dc8/action HTTP/1.1 Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 18 Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: {"unshelve": null} Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance fd3c78af-5a62-46ae-965e-1a8e2c241dc8 could not be found. Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'fd3c78af-5a62-46ae-965e-1a8e2c241dc8', 'body': {'unshelve': None}} Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd3c78af-5a62-46ae-965e-1a8e2c241dc8 could not be found. Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd3c78af-5a62-46ae-965e-1a8e2c241dc8 could not be found. Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:20.187611 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:20.193391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:20.193391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:20.193391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:20.193391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:20.193391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:12:20.193391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:12:20.193391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd3c78af-5a62-46ae-965e-1a8e2c241dc8 could not be found. Sep 08 13:12:20.193391 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:20.196442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-30f5975c-945c-49dd-8d70-bd08c244cc56 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance fd3c78af-5a62-46ae-965e-1a8e2c241dc8 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:20.201897 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-30f5975c-945c-49dd-8d70-bd08c244cc56 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/fd3c78af-5a62-46ae-965e-1a8e2c241dc8/action" status: 404 len: 111 microversion: 2.1 time: 0.060860 Sep 08 13:12:20.206073 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2373/4881] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:12:20 2022] POST /compute/v2.1/servers/fd3c78af-5a62-46ae-965e-1a8e2c241dc8/action => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:12:20.213008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e693554-f8de-47b1-9302-b6c38db58db2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:20.214019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e693554-f8de-47b1-9302-b6c38db58db2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:20.223910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e693554-f8de-47b1-9302-b6c38db58db2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:20.230494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e693554-f8de-47b1-9302-b6c38db58db2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:20.234093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e693554-f8de-47b1-9302-b6c38db58db2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:20.235207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e693554-f8de-47b1-9302-b6c38db58db2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:20.237074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e693554-f8de-47b1-9302-b6c38db58db2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:20.241435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e693554-f8de-47b1-9302-b6c38db58db2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:20.332434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-fc1d7452-c1ba-43f3-a3ce-2b457c6f9464 req-a3d495f8-e893-49ec-b384-04bb8f72c087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad0f9bb-3303-4bdc-a35e-102f0002fe77", "tag": "1ea3ab52-16b6-4072-bb78-7320e9ba5e25"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:20.357026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fc1d7452-c1ba-43f3-a3ce-2b457c6f9464 req-a3d495f8-e893-49ec-b384-04bb8f72c087 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:20.360925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fc1d7452-c1ba-43f3-a3ce-2b457c6f9464 req-a3d495f8-e893-49ec-b384-04bb8f72c087 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:20.364526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fc1d7452-c1ba-43f3-a3ce-2b457c6f9464 req-a3d495f8-e893-49ec-b384-04bb8f72c087 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:20.422706 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-fc1d7452-c1ba-43f3-a3ce-2b457c6f9464 req-a3d495f8-e893-49ec-b384-04bb8f72c087 service nova] Creating event network-changed:1ea3ab52-16b6-4072-bb78-7320e9ba5e25 for instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 on n-h1-852084-10 Sep 08 13:12:20.442163 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-fc1d7452-c1ba-43f3-a3ce-2b457c6f9464 req-a3d495f8-e893-49ec-b384-04bb8f72c087 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114670 Sep 08 13:12:20.455870 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2374/4882] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:12:20.556840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62f4482b-0f7e-46ef-bc6b-18e61fef9c25 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:20.565948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-62f4482b-0f7e-46ef-bc6b-18e61fef9c25 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:20.577691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e693554-f8de-47b1-9302-b6c38db58db2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:20.594633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62f4482b-0f7e-46ef-bc6b-18e61fef9c25 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:20.598364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62f4482b-0f7e-46ef-bc6b-18e61fef9c25 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:20.600166 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e693554-f8de-47b1-9302-b6c38db58db2 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.385873 Sep 08 13:12:20.601256 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2509/4883] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:20 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:12:20.629432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62f4482b-0f7e-46ef-bc6b-18e61fef9c25 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:20.631875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62f4482b-0f7e-46ef-bc6b-18e61fef9c25 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:20.634979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62f4482b-0f7e-46ef-bc6b-18e61fef9c25 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:20.635728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62f4482b-0f7e-46ef-bc6b-18e61fef9c25 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:20.649608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f1554769-c97f-4c9d-a252-f6adca425dce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:20.650635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f1554769-c97f-4c9d-a252-f6adca425dce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:20.668319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1554769-c97f-4c9d-a252-f6adca425dce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:20.669167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1554769-c97f-4c9d-a252-f6adca425dce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:20.670486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1554769-c97f-4c9d-a252-f6adca425dce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:20.671622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1554769-c97f-4c9d-a252-f6adca425dce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:20.673003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1554769-c97f-4c9d-a252-f6adca425dce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:20.673678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1554769-c97f-4c9d-a252-f6adca425dce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:21.137309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-62f4482b-0f7e-46ef-bc6b-18e61fef9c25 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:21.173123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-62f4482b-0f7e-46ef-bc6b-18e61fef9c25 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:21.176555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-62f4482b-0f7e-46ef-bc6b-18e61fef9c25 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:21.179069 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62f4482b-0f7e-46ef-bc6b-18e61fef9c25 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.632330 Sep 08 13:12:21.203795 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2375/4884] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:20 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:12:21.217841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f1554769-c97f-4c9d-a252-f6adca425dce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:21.236031 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f1554769-c97f-4c9d-a252-f6adca425dce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.588048 Sep 08 13:12:21.241279 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2510/4885] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:20 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:12:21.285059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e54b47d9-1153-44c7-b2c7-c312d7750986 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:21.286692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e54b47d9-1153-44c7-b2c7-c312d7750986 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:21.299860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e54b47d9-1153-44c7-b2c7-c312d7750986 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:21.300914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e54b47d9-1153-44c7-b2c7-c312d7750986 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:21.301719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e54b47d9-1153-44c7-b2c7-c312d7750986 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:21.302990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e54b47d9-1153-44c7-b2c7-c312d7750986 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:21.303859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e54b47d9-1153-44c7-b2c7-c312d7750986 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:21.304836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e54b47d9-1153-44c7-b2c7-c312d7750986 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:21.360087 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e54b47d9-1153-44c7-b2c7-c312d7750986 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Cannot 'unshelve' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e54b47d9-1153-44c7-b2c7-c312d7750986 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action HTTP/1.1 Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 18 Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: {"unshelve": null} Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: exception: Cannot 'unshelve' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '4eb421d7-2415-43d2-a6bb-3fdbca098091', 'body': {'unshelve': None}} Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 in vm_state active. Cannot unshelve while the instance is in this state. Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 08 13:12:21.363506 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 08 13:12:21.369178 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:12:21.369178 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:21.369178 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:21.369178 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:21.369178 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:21.369178 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:21.369178 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:21.369178 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:12:21.369178 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:12:21.369178 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active Sep 08 13:12:21.369178 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:21.373833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e54b47d9-1153-44c7-b2c7-c312d7750986 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 409 to user: Cannot 'unshelve' instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 while it is in vm_state active {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:21.376017 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e54b47d9-1153-44c7-b2c7-c312d7750986 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action" status: 409 len: 146 microversion: 2.1 time: 0.098706 Sep 08 13:12:21.379110 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2376/4886] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:12:21 2022] POST /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091/action => generated 146 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 08 13:12:21.390504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cb876aa1-97aa-4ae9-b861-866601b4e16e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:21.391711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cb876aa1-97aa-4ae9-b861-866601b4e16e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:21.398847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb876aa1-97aa-4ae9-b861-866601b4e16e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:21.399718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb876aa1-97aa-4ae9-b861-866601b4e16e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:21.400475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb876aa1-97aa-4ae9-b861-866601b4e16e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:21.401470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb876aa1-97aa-4ae9-b861-866601b4e16e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:21.401955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb876aa1-97aa-4ae9-b861-866601b4e16e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:21.402395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb876aa1-97aa-4ae9-b861-866601b4e16e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:21.798289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cb876aa1-97aa-4ae9-b861-866601b4e16e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:21.813788 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cb876aa1-97aa-4ae9-b861-866601b4e16e tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.428916 Sep 08 13:12:21.836304 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2511/4887] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:21 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:21.853417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad4464f0-ac17-4632-877e-f929cdedb1e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:21.859126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad4464f0-ac17-4632-877e-f929cdedb1e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:21.882215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad4464f0-ac17-4632-877e-f929cdedb1e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:21.889003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad4464f0-ac17-4632-877e-f929cdedb1e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:21.892492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad4464f0-ac17-4632-877e-f929cdedb1e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:21.894215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad4464f0-ac17-4632-877e-f929cdedb1e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:21.898993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad4464f0-ac17-4632-877e-f929cdedb1e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:21.900187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad4464f0-ac17-4632-877e-f929cdedb1e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:22.246146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6109d444-0d2a-44b7-ab7c-3a94e04727ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:22.247139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6109d444-0d2a-44b7-ab7c-3a94e04727ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:22.260042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6109d444-0d2a-44b7-ab7c-3a94e04727ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:22.260551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6109d444-0d2a-44b7-ab7c-3a94e04727ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:22.261006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6109d444-0d2a-44b7-ab7c-3a94e04727ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:22.261742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6109d444-0d2a-44b7-ab7c-3a94e04727ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:22.268714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6109d444-0d2a-44b7-ab7c-3a94e04727ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:22.270311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6109d444-0d2a-44b7-ab7c-3a94e04727ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:22.522975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6109d444-0d2a-44b7-ab7c-3a94e04727ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:22.548258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6109d444-0d2a-44b7-ab7c-3a94e04727ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:22.553037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6109d444-0d2a-44b7-ab7c-3a94e04727ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:22.554328 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6109d444-0d2a-44b7-ab7c-3a94e04727ae tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.313958 Sep 08 13:12:22.580468 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2512/4888] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:22 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:22.679603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ad4464f0-ac17-4632-877e-f929cdedb1e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:22.720987 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad4464f0-ac17-4632-877e-f929cdedb1e0 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.870799 Sep 08 13:12:22.722171 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2377/4889] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:21 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:22.765126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4736bf4-de44-4879-9df5-2ad6747d5e7c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2002158539_updated"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:22.770135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e4736bf4-de44-4879-9df5-2ad6747d5e7c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 321ee71c-e676-454f-be1d-48342dc12888] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:22.779081 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e4736bf4-de44-4879-9df5-2ad6747d5e7c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 321ee71c-e676-454f-be1d-48342dc12888 could not be found. Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4736bf4-de44-4879-9df5-2ad6747d5e7c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/servers/321ee71c-e676-454f-be1d-48342dc12888 HTTP/1.1 Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 81 Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2002158539_updated"}} Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 321ee71c-e676-454f-be1d-48342dc12888 could not be found. Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '321ee71c-e676-454f-be1d-48342dc12888', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2002158539_updated'}}} Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 321ee71c-e676-454f-be1d-48342dc12888 could not be found. Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Sep 08 13:12:22.781389 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 321ee71c-e676-454f-be1d-48342dc12888 could not be found. Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 321ee71c-e676-454f-be1d-48342dc12888 could not be found. Sep 08 13:12:22.787617 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:22.790996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4736bf4-de44-4879-9df5-2ad6747d5e7c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 321ee71c-e676-454f-be1d-48342dc12888 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:22.792549 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e4736bf4-de44-4879-9df5-2ad6747d5e7c tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "PUT /compute/v2.1/servers/321ee71c-e676-454f-be1d-48342dc12888" status: 404 len: 111 microversion: 2.1 time: 0.037700 Sep 08 13:12:22.803662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-851a9bf7-31ea-4608-beed-970dacfdaeb5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:22.805277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-851a9bf7-31ea-4608-beed-970dacfdaeb5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:22.809924 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2513/4890] 10.222.0.78 () {60 vars in 1256 bytes} [Thu Sep 8 13:12:22 2022] PUT /compute/v2.1/servers/321ee71c-e676-454f-be1d-48342dc12888 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:12:22.817701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-851a9bf7-31ea-4608-beed-970dacfdaeb5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:22.818720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-851a9bf7-31ea-4608-beed-970dacfdaeb5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:22.819848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-851a9bf7-31ea-4608-beed-970dacfdaeb5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:22.821277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-851a9bf7-31ea-4608-beed-970dacfdaeb5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:22.822111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-851a9bf7-31ea-4608-beed-970dacfdaeb5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:22.822952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-851a9bf7-31ea-4608-beed-970dacfdaeb5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:23.524094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-851a9bf7-31ea-4608-beed-970dacfdaeb5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:23.536977 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-851a9bf7-31ea-4608-beed-970dacfdaeb5 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.737473 Sep 08 13:12:23.538043 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2378/4891] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:22 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:23.563120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8cefd8b5-5507-4c8b-afe2-531670e1c676 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:23.564395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8cefd8b5-5507-4c8b-afe2-531670e1c676 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:23.578410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cefd8b5-5507-4c8b-afe2-531670e1c676 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:23.579469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cefd8b5-5507-4c8b-afe2-531670e1c676 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:23.580425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cefd8b5-5507-4c8b-afe2-531670e1c676 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:23.581840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cefd8b5-5507-4c8b-afe2-531670e1c676 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:23.582973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cefd8b5-5507-4c8b-afe2-531670e1c676 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:23.583820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cefd8b5-5507-4c8b-afe2-531670e1c676 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:23.594410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b25b6545-5414-44db-a6c9-972aef7d636a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:23.595582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b25b6545-5414-44db-a6c9-972aef7d636a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:23.629807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25b6545-5414-44db-a6c9-972aef7d636a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:23.643815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25b6545-5414-44db-a6c9-972aef7d636a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:23.644501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25b6545-5414-44db-a6c9-972aef7d636a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:23.645621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25b6545-5414-44db-a6c9-972aef7d636a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:23.658139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25b6545-5414-44db-a6c9-972aef7d636a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:23.658711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25b6545-5414-44db-a6c9-972aef7d636a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:23.909931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b25b6545-5414-44db-a6c9-972aef7d636a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:23.935833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b25b6545-5414-44db-a6c9-972aef7d636a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:23.941163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b25b6545-5414-44db-a6c9-972aef7d636a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:23.945225 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b25b6545-5414-44db-a6c9-972aef7d636a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1365 microversion: 2.47 time: 0.361811 Sep 08 13:12:23.946676 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2379/4892] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:23 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1365 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:24.026377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8cefd8b5-5507-4c8b-afe2-531670e1c676 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:24.048289 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8cefd8b5-5507-4c8b-afe2-531670e1c676 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.490012 Sep 08 13:12:24.065694 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2514/4893] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:23 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:24.098690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b81b186b-aafc-40c5-b7b3-e9c20b8c94b6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b81b186b-aafc-40c5-b7b3-e9c20b8c94b6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: request: PUT /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 HTTP/1.1 Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 280 Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '4eb421d7-2415-43d2-a6bb-3fdbca098091', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:24.106138 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Sep 08 13:12:24.113851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:24.120141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b81b186b-aafc-40c5-b7b3-e9c20b8c94b6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:24.121158 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b81b186b-aafc-40c5-b7b3-e9c20b8c94b6 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "PUT /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 400 len: 619 microversion: 2.1 time: 0.033830 Sep 08 13:12:24.128012 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2380/4894] 10.222.0.78 () {60 vars in 1257 bytes} [Thu Sep 8 13:12:24 2022] PUT /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 619 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 08 13:12:24.139105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd9b61a8-3ba3-4ca7-a729-adf4be8e7dcf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:24.141598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dd9b61a8-3ba3-4ca7-a729-adf4be8e7dcf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:24.156103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd9b61a8-3ba3-4ca7-a729-adf4be8e7dcf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:24.157384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd9b61a8-3ba3-4ca7-a729-adf4be8e7dcf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:24.158368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd9b61a8-3ba3-4ca7-a729-adf4be8e7dcf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:24.160246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd9b61a8-3ba3-4ca7-a729-adf4be8e7dcf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:24.161483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd9b61a8-3ba3-4ca7-a729-adf4be8e7dcf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:24.162571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd9b61a8-3ba3-4ca7-a729-adf4be8e7dcf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:24.489189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dd9b61a8-3ba3-4ca7-a729-adf4be8e7dcf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:24.497700 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dd9b61a8-3ba3-4ca7-a729-adf4be8e7dcf tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.368650 Sep 08 13:12:24.503820 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2515/4895] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:24 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:12:24.546761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-28ad7ad5-2b1f-4970-bd41-9b35adea1031 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:24.548138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-28ad7ad5-2b1f-4970-bd41-9b35adea1031 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:24.564253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28ad7ad5-2b1f-4970-bd41-9b35adea1031 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:24.564683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28ad7ad5-2b1f-4970-bd41-9b35adea1031 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:24.577494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28ad7ad5-2b1f-4970-bd41-9b35adea1031 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:24.587766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28ad7ad5-2b1f-4970-bd41-9b35adea1031 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:24.589533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28ad7ad5-2b1f-4970-bd41-9b35adea1031 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:24.590352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28ad7ad5-2b1f-4970-bd41-9b35adea1031 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:24.989410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5e1a33f3-acba-4dca-ac03-4c8d03317df6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:24.992260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5e1a33f3-acba-4dca-ac03-4c8d03317df6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:25.030819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e1a33f3-acba-4dca-ac03-4c8d03317df6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:25.037659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e1a33f3-acba-4dca-ac03-4c8d03317df6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:25.039852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e1a33f3-acba-4dca-ac03-4c8d03317df6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:25.042207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e1a33f3-acba-4dca-ac03-4c8d03317df6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:25.043169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e1a33f3-acba-4dca-ac03-4c8d03317df6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:25.044035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e1a33f3-acba-4dca-ac03-4c8d03317df6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:25.692303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5e1a33f3-acba-4dca-ac03-4c8d03317df6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:25.719273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5e1a33f3-acba-4dca-ac03-4c8d03317df6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:25.722833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5e1a33f3-acba-4dca-ac03-4c8d03317df6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:25.725297 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5e1a33f3-acba-4dca-ac03-4c8d03317df6 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1383 microversion: 2.47 time: 0.750403 Sep 08 13:12:25.727758 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2516/4896] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:24 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1383 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:25.978645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-28ad7ad5-2b1f-4970-bd41-9b35adea1031 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:25.993744 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-28ad7ad5-2b1f-4970-bd41-9b35adea1031 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 1.456048 Sep 08 13:12:25.994700 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2381/4897] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:24 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:26.034765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1b5a1d24-8e88-4516-aa6b-5c692e259a30 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1b5a1d24-8e88-4516-aa6b-5c692e259a30 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: request: PUT /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 HTTP/1.1 Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 24 Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: {"server": {"name": ""}} Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: exception: Invalid input for field/attribute name. Value: . '' is too short Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '4eb421d7-2415-43d2-a6bb-3fdbca098091', 'body': {'server': {'name': ''}}} Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi On instance['server']: Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi '' Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:12:26.043839 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Sep 08 13:12:26.053566 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:26.053566 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:26.053566 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:26.053566 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:26.053566 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:26.053566 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:26.053566 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:12:26.053566 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:12:26.053566 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Sep 08 13:12:26.053566 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:26.058654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1b5a1d24-8e88-4516-aa6b-5c692e259a30 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:26.063208 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1b5a1d24-8e88-4516-aa6b-5c692e259a30 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "PUT /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 400 len: 108 microversion: 2.1 time: 0.035979 Sep 08 13:12:26.064451 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2517/4898] 10.222.0.78 () {60 vars in 1256 bytes} [Thu Sep 8 13:12:26 2022] PUT /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 108 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:12:26.078570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-48069a9a-a01c-43e2-b831-61c0832bfb58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:26.081704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-48069a9a-a01c-43e2-b831-61c0832bfb58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:26.118428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48069a9a-a01c-43e2-b831-61c0832bfb58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:26.119990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48069a9a-a01c-43e2-b831-61c0832bfb58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:26.120654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48069a9a-a01c-43e2-b831-61c0832bfb58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:26.122118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48069a9a-a01c-43e2-b831-61c0832bfb58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:26.123188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48069a9a-a01c-43e2-b831-61c0832bfb58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:26.124142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-48069a9a-a01c-43e2-b831-61c0832bfb58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:26.652322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-48069a9a-a01c-43e2-b831-61c0832bfb58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:26.679432 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-48069a9a-a01c-43e2-b831-61c0832bfb58 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1506 microversion: 2.1 time: 0.606922 Sep 08 13:12:26.680660 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2382/4899] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:26 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1506 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:26.758427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ed1c7187-fe74-40cd-943e-50644f089246 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:26.759623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ed1c7187-fe74-40cd-943e-50644f089246 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:26.791668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed1c7187-fe74-40cd-943e-50644f089246 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:26.792659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed1c7187-fe74-40cd-943e-50644f089246 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:26.793494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed1c7187-fe74-40cd-943e-50644f089246 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:26.798591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed1c7187-fe74-40cd-943e-50644f089246 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:26.802902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed1c7187-fe74-40cd-943e-50644f089246 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:26.803653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed1c7187-fe74-40cd-943e-50644f089246 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:27.408377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ed1c7187-fe74-40cd-943e-50644f089246 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:27.449662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ed1c7187-fe74-40cd-943e-50644f089246 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:27.457449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ed1c7187-fe74-40cd-943e-50644f089246 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:27.465189 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ed1c7187-fe74-40cd-943e-50644f089246 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1371 microversion: 2.47 time: 0.713306 Sep 08 13:12:27.492286 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2518/4900] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:26 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1371 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:28.547147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-20f420d1-61d9-48ec-a8ad-337c6eb4d295 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:28.553205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-20f420d1-61d9-48ec-a8ad-337c6eb4d295 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:28.614865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20f420d1-61d9-48ec-a8ad-337c6eb4d295 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:28.626048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20f420d1-61d9-48ec-a8ad-337c6eb4d295 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:28.627708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20f420d1-61d9-48ec-a8ad-337c6eb4d295 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:28.633195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20f420d1-61d9-48ec-a8ad-337c6eb4d295 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:28.640984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20f420d1-61d9-48ec-a8ad-337c6eb4d295 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:28.642343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20f420d1-61d9-48ec-a8ad-337c6eb4d295 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:29.094395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-20f420d1-61d9-48ec-a8ad-337c6eb4d295 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:29.132217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-20f420d1-61d9-48ec-a8ad-337c6eb4d295 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:29.144669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-20f420d1-61d9-48ec-a8ad-337c6eb4d295 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:29.151282 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-20f420d1-61d9-48ec-a8ad-337c6eb4d295 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1356 microversion: 2.47 time: 0.638649 Sep 08 13:12:29.183270 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2383/4901] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:28 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1356 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:29.195542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:29.203277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:29.221401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Searching by: {'deleted': False, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 13:12:29.246783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=64 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:12:29.277589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:29.278420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:29.300341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:29.302614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:29.306148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:29.312079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:29.840265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 13:12:30.216699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:30.234994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:30.236261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:30.237756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:30.260405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:30.262167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:30.402595 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e891fc3-f468-4c23-815b-5d707b0ebbee tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/detail" status: 200 len: 2705 microversion: 2.47 time: 1.213385 Sep 08 13:12:30.404286 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2519/4902] 10.222.0.78 () {60 vars in 1187 bytes} [Thu Sep 8 13:12:29 2022] GET /compute/v2.1/servers/detail => generated 2705 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:30.458177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-31c46568-7981-4fca-985a-3e7193273967 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:30.459453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-31c46568-7981-4fca-985a-3e7193273967 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:30.479809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31c46568-7981-4fca-985a-3e7193273967 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:30.480564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31c46568-7981-4fca-985a-3e7193273967 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:30.482651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31c46568-7981-4fca-985a-3e7193273967 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:30.484756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31c46568-7981-4fca-985a-3e7193273967 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:30.485463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31c46568-7981-4fca-985a-3e7193273967 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:30.487435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-31c46568-7981-4fca-985a-3e7193273967 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:30.531920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-31c46568-7981-4fca-985a-3e7193273967 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:12:30.801137 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-31c46568-7981-4fca-985a-3e7193273967 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "DELETE /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 204 len: 0 microversion: 2.47 time: 0.351701 Sep 08 13:12:30.803516 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2384/4903] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:12:30 2022] DELETE /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:12:30.819697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aa168c26-9c7d-4638-90c8-00c814b95e8b tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:30.820813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aa168c26-9c7d-4638-90c8-00c814b95e8b tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:30.853066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa168c26-9c7d-4638-90c8-00c814b95e8b tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:30.853660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa168c26-9c7d-4638-90c8-00c814b95e8b tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:30.856417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa168c26-9c7d-4638-90c8-00c814b95e8b tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:30.858865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa168c26-9c7d-4638-90c8-00c814b95e8b tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:30.860274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa168c26-9c7d-4638-90c8-00c814b95e8b tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:30.875039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa168c26-9c7d-4638-90c8-00c814b95e8b tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:31.240247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aa168c26-9c7d-4638-90c8-00c814b95e8b tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:31.290032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aa168c26-9c7d-4638-90c8-00c814b95e8b tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:31.295538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aa168c26-9c7d-4638-90c8-00c814b95e8b tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:31.331646 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aa168c26-9c7d-4638-90c8-00c814b95e8b tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1362 microversion: 2.47 time: 0.513660 Sep 08 13:12:31.337849 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2520/4904] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:30 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1362 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:32.404924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f296c646-5938-41e8-9b51-829ac3eedd94 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:32.410590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f296c646-5938-41e8-9b51-829ac3eedd94 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:32.452964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f296c646-5938-41e8-9b51-829ac3eedd94 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:32.453709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f296c646-5938-41e8-9b51-829ac3eedd94 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:32.454303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f296c646-5938-41e8-9b51-829ac3eedd94 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:32.455086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f296c646-5938-41e8-9b51-829ac3eedd94 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:32.455641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f296c646-5938-41e8-9b51-829ac3eedd94 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:32.456089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f296c646-5938-41e8-9b51-829ac3eedd94 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:33.217603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f296c646-5938-41e8-9b51-829ac3eedd94 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:33.228554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f296c646-5938-41e8-9b51-829ac3eedd94 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:33.230432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f296c646-5938-41e8-9b51-829ac3eedd94 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:33.232928 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f296c646-5938-41e8-9b51-829ac3eedd94 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1362 microversion: 2.47 time: 0.840019 Sep 08 13:12:33.234538 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2385/4905] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:32 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1362 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:34.288135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a971d066-422c-4802-8f8c-958bbdeb5986 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:34.288993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a971d066-422c-4802-8f8c-958bbdeb5986 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:34.323205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a971d066-422c-4802-8f8c-958bbdeb5986 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:34.324491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a971d066-422c-4802-8f8c-958bbdeb5986 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:34.325179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a971d066-422c-4802-8f8c-958bbdeb5986 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:34.330488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a971d066-422c-4802-8f8c-958bbdeb5986 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:34.332103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a971d066-422c-4802-8f8c-958bbdeb5986 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:34.334461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a971d066-422c-4802-8f8c-958bbdeb5986 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:34.718091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a971d066-422c-4802-8f8c-958bbdeb5986 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:34.762879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a971d066-422c-4802-8f8c-958bbdeb5986 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:34.768688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a971d066-422c-4802-8f8c-958bbdeb5986 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:34.775333 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a971d066-422c-4802-8f8c-958bbdeb5986 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 200 len: 1362 microversion: 2.47 time: 0.486578 Sep 08 13:12:34.776031 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2521/4906] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:34 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 1362 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:35.848195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a215274-5c6a-48d0-bdaa-7c5494ab208e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:35.849934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2a215274-5c6a-48d0-bdaa-7c5494ab208e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: 82dbb4ca-df1e-44c3-8b14-7964b0f49398] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:35.896767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a215274-5c6a-48d0-bdaa-7c5494ab208e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:35.900929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a215274-5c6a-48d0-bdaa-7c5494ab208e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:35.908841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a215274-5c6a-48d0-bdaa-7c5494ab208e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:35.916516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a215274-5c6a-48d0-bdaa-7c5494ab208e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:35.922259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a215274-5c6a-48d0-bdaa-7c5494ab208e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:35.926742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a215274-5c6a-48d0-bdaa-7c5494ab208e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:36.069623 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-2a215274-5c6a-48d0-bdaa-7c5494ab208e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] HTTP exception thrown: Instance 82dbb4ca-df1e-44c3-8b14-7964b0f49398 could not be found. Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a215274-5c6a-48d0-bdaa-7c5494ab208e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Request method failure captured: Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 HTTP/1.1 Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGeoILD3U4vChTrZjkYI4Mb1kQqju4iwwUAYzlRXKVryjoclEfp1UhmOMHe778O5Z4ARhhTFWmkUbknFAv5rpY_CXinYH_td3aTmUIcUS1D1BuQ5KjeFh9JIa2zMHAABGSpZQFjKVKfFJFS90ugU-HBFkBjlvLtvBkr5Y6Kc1SeIzgsY Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.47 Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: a14cd14eb3034d3699c49f8b0f4488bb Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerShowV247Test-1079756871 Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a14cd14eb3034d3699c49f8b0f4488bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a14cd14eb3034d3699c49f8b0f4488bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a14cd14eb3034d3699c49f8b0f4488bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a14cd14eb3034d3699c49f8b0f4488bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerShowV247Test-1079756871 Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: a14cd14eb3034d3699c49f8b0f4488bb Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerShowV247Test-1079756871 Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerShowV247Test-1079756871-project Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2eba3f63d4734cd6ac5e60138d7bcdc3 Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerShowV247Test-1079756871-project Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 82dbb4ca-df1e-44c3-8b14-7964b0f49398 could not be found. Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '82dbb4ca-df1e-44c3-8b14-7964b0f49398'} Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82dbb4ca-df1e-44c3-8b14-7964b0f49398 could not be found. Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82dbb4ca-df1e-44c3-8b14-7964b0f49398 could not be found. Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:36.080021 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:36.088667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:36.088667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:36.088667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:36.088667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:12:36.088667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:12:36.088667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82dbb4ca-df1e-44c3-8b14-7964b0f49398 could not be found. Sep 08 13:12:36.088667 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:12:36.088667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a215274-5c6a-48d0-bdaa-7c5494ab208e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Returning 404 to user: Instance 82dbb4ca-df1e-44c3-8b14-7964b0f49398 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:36.090379 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a215274-5c6a-48d0-bdaa-7c5494ab208e tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398" status: 404 len: 111 microversion: 2.47 time: 0.251871 Sep 08 13:12:36.090379 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2386/4907] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:35 2022] GET /compute/v2.1/servers/82dbb4ca-df1e-44c3-8b14-7964b0f49398 => generated 111 bytes in 261 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:12:36.111728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fdfd0a0c-a43c-4477-983e-166c3f26733a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:36.113027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fdfd0a0c-a43c-4477-983e-166c3f26733a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: c66d0923-df7f-44f7-bafe-42bd0f9aeffb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:36.134496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdfd0a0c-a43c-4477-983e-166c3f26733a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:36.135629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdfd0a0c-a43c-4477-983e-166c3f26733a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:36.144997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdfd0a0c-a43c-4477-983e-166c3f26733a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:36.146944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdfd0a0c-a43c-4477-983e-166c3f26733a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:36.148743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdfd0a0c-a43c-4477-983e-166c3f26733a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:36.150175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdfd0a0c-a43c-4477-983e-166c3f26733a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:36.226493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fdfd0a0c-a43c-4477-983e-166c3f26733a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: c66d0923-df7f-44f7-bafe-42bd0f9aeffb] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:12:36.437352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:12:36.687732 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fdfd0a0c-a43c-4477-983e-166c3f26733a tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb" status: 204 len: 0 microversion: 2.47 time: 0.582031 Sep 08 13:12:36.690292 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2522/4908] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:12:36 2022] DELETE /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:12:36.710160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d6bdfd5-13aa-492e-bb21-38e333819ce9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:36.712953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d6bdfd5-13aa-492e-bb21-38e333819ce9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: c66d0923-df7f-44f7-bafe-42bd0f9aeffb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:36.741670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d6bdfd5-13aa-492e-bb21-38e333819ce9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:36.743016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d6bdfd5-13aa-492e-bb21-38e333819ce9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:36.744148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d6bdfd5-13aa-492e-bb21-38e333819ce9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:36.749545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d6bdfd5-13aa-492e-bb21-38e333819ce9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:36.757441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d6bdfd5-13aa-492e-bb21-38e333819ce9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:36.759690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d6bdfd5-13aa-492e-bb21-38e333819ce9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:37.318787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8d6bdfd5-13aa-492e-bb21-38e333819ce9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:37.342774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8d6bdfd5-13aa-492e-bb21-38e333819ce9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:37.358284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8d6bdfd5-13aa-492e-bb21-38e333819ce9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:37.360945 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d6bdfd5-13aa-492e-bb21-38e333819ce9 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb" status: 200 len: 1362 microversion: 2.47 time: 0.661884 Sep 08 13:12:37.362677 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2387/4909] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:36 2022] GET /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb => generated 1362 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:38.425003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33d27168-0042-4ae6-8c01-6015b1f8cba8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:38.426712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-33d27168-0042-4ae6-8c01-6015b1f8cba8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: c66d0923-df7f-44f7-bafe-42bd0f9aeffb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:38.443328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33d27168-0042-4ae6-8c01-6015b1f8cba8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:38.450085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33d27168-0042-4ae6-8c01-6015b1f8cba8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:38.451731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33d27168-0042-4ae6-8c01-6015b1f8cba8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:38.452946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33d27168-0042-4ae6-8c01-6015b1f8cba8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:38.453880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33d27168-0042-4ae6-8c01-6015b1f8cba8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:38.454694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33d27168-0042-4ae6-8c01-6015b1f8cba8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:39.340949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-33d27168-0042-4ae6-8c01-6015b1f8cba8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:39.362667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-33d27168-0042-4ae6-8c01-6015b1f8cba8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:39.367439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-33d27168-0042-4ae6-8c01-6015b1f8cba8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:39.371366 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-33d27168-0042-4ae6-8c01-6015b1f8cba8 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb" status: 200 len: 1362 microversion: 2.47 time: 0.953044 Sep 08 13:12:39.379471 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2523/4910] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:38 2022] GET /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb => generated 1362 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:40.445988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:40.447089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: c66d0923-df7f-44f7-bafe-42bd0f9aeffb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:40.464987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:40.469998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:40.476466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:40.479114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:40.479820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:40.483380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:40.510340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-301fe9ee-cb09-4840-99c1-4d1e60bbcdd7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:40.511876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-301fe9ee-cb09-4840-99c1-4d1e60bbcdd7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:40.530016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:12:40.533176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:12:40.540243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-301fe9ee-cb09-4840-99c1-4d1e60bbcdd7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:40.542114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-301fe9ee-cb09-4840-99c1-4d1e60bbcdd7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:40.546309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-301fe9ee-cb09-4840-99c1-4d1e60bbcdd7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:40.548719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-301fe9ee-cb09-4840-99c1-4d1e60bbcdd7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:40.550936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-301fe9ee-cb09-4840-99c1-4d1e60bbcdd7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:40.555864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-301fe9ee-cb09-4840-99c1-4d1e60bbcdd7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:40.609643 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-301fe9ee-cb09-4840-99c1-4d1e60bbcdd7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-301fe9ee-cb09-4840-99c1-4d1e60bbcdd7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd HTTP/1.1 Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '47e92e06-d041-47a8-8715-1f8dae99b9dd'} Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:12:40.613277 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:12:40.618909 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:12:40.618909 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:40.618909 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:40.618909 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:40.618909 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:40.618909 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:40.618909 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:40.618909 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:12:40.618909 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:12:40.618909 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:12:40.618909 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:40.625573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-301fe9ee-cb09-4840-99c1-4d1e60bbcdd7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:40.628395 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-301fe9ee-cb09-4840-99c1-4d1e60bbcdd7 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "DELETE /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 404 len: 111 microversion: 2.1 time: 0.121967 Sep 08 13:12:40.630850 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2524/4911] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:12:40 2022] DELETE /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:12:40.648431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8b02312c-9ee9-450f-8e36-fd4fd85f124d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:40.651477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8b02312c-9ee9-450f-8e36-fd4fd85f124d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 47e92e06-d041-47a8-8715-1f8dae99b9dd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:40.672900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:40.674934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:40.676142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:40.678982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lazy-loading 'fault' on Instance uuid c66d0923-df7f-44f7-bafe-42bd0f9aeffb {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:12:40.683847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b02312c-9ee9-450f-8e36-fd4fd85f124d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:40.685629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b02312c-9ee9-450f-8e36-fd4fd85f124d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:40.687723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b02312c-9ee9-450f-8e36-fd4fd85f124d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:40.688825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b02312c-9ee9-450f-8e36-fd4fd85f124d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:40.689493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b02312c-9ee9-450f-8e36-fd4fd85f124d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:40.690100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b02312c-9ee9-450f-8e36-fd4fd85f124d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:40.751905 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-8b02312c-9ee9-450f-8e36-fd4fd85f124d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8b02312c-9ee9-450f-8e36-fd4fd85f124d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd HTTP/1.1 Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '47e92e06-d041-47a8-8715-1f8dae99b9dd'} Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:40.757212 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:40.764531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:40.764531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:40.764531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:40.764531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:12:40.764531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:12:40.764531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. Sep 08 13:12:40.764531 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:40.764531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8b02312c-9ee9-450f-8e36-fd4fd85f124d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 47e92e06-d041-47a8-8715-1f8dae99b9dd could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:40.764531 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8b02312c-9ee9-450f-8e36-fd4fd85f124d tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd" status: 404 len: 111 microversion: 2.1 time: 0.123549 Sep 08 13:12:40.766358 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2525/4912] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:40 2022] GET /compute/v2.1/servers/47e92e06-d041-47a8-8715-1f8dae99b9dd => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:12:40.777119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bcbeee07-8bb2-45b5-9f2f-be89d29c48b4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:40.777640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bcbeee07-8bb2-45b5-9f2f-be89d29c48b4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:40.822218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcbeee07-8bb2-45b5-9f2f-be89d29c48b4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:40.823117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcbeee07-8bb2-45b5-9f2f-be89d29c48b4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:40.824130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcbeee07-8bb2-45b5-9f2f-be89d29c48b4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:40.838605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcbeee07-8bb2-45b5-9f2f-be89d29c48b4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:40.839660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcbeee07-8bb2-45b5-9f2f-be89d29c48b4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:40.840570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bcbeee07-8bb2-45b5-9f2f-be89d29c48b4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:40.931565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bcbeee07-8bb2-45b5-9f2f-be89d29c48b4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:12:41.044164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:41.073328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:41.077420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2eba3f63d4734cd6ac5e60138d7bcdc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14cd14eb3034d3699c49f8b0f4488bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:41.093822 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8fa9a406-0a53-4fed-8155-11b42f3c8012 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb" status: 200 len: 1367 microversion: 2.47 time: 0.661625 Sep 08 13:12:41.096484 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2388/4913] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:40 2022] GET /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb => generated 1367 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:12:41.330394 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bcbeee07-8bb2-45b5-9f2f-be89d29c48b4 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "DELETE /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 204 len: 0 microversion: 2.1 time: 0.558355 Sep 08 13:12:41.339370 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2526/4914] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:12:40 2022] DELETE /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:12:41.343335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3388c20c-976b-4023-a19f-d7c438018599 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:41.343973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3388c20c-976b-4023-a19f-d7c438018599 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:41.358511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3388c20c-976b-4023-a19f-d7c438018599 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:41.361794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3388c20c-976b-4023-a19f-d7c438018599 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:41.362580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3388c20c-976b-4023-a19f-d7c438018599 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:41.368551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3388c20c-976b-4023-a19f-d7c438018599 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:41.370276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3388c20c-976b-4023-a19f-d7c438018599 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:41.375318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3388c20c-976b-4023-a19f-d7c438018599 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:41.976473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3388c20c-976b-4023-a19f-d7c438018599 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:41.992312 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3388c20c-976b-4023-a19f-d7c438018599 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1512 microversion: 2.1 time: 0.653506 Sep 08 13:12:41.998840 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2389/4915] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:41 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1512 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:42.166916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-508faceb-24ae-4617-b834-4f7670dd56c0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:42.174440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-508faceb-24ae-4617-b834-4f7670dd56c0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] [instance: c66d0923-df7f-44f7-bafe-42bd0f9aeffb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:42.211126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-508faceb-24ae-4617-b834-4f7670dd56c0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:42.211646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-508faceb-24ae-4617-b834-4f7670dd56c0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:42.212097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-508faceb-24ae-4617-b834-4f7670dd56c0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:42.212840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-508faceb-24ae-4617-b834-4f7670dd56c0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:42.213304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-508faceb-24ae-4617-b834-4f7670dd56c0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:42.213730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-508faceb-24ae-4617-b834-4f7670dd56c0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:42.295055 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-508faceb-24ae-4617-b834-4f7670dd56c0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] HTTP exception thrown: Instance c66d0923-df7f-44f7-bafe-42bd0f9aeffb could not be found. Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-508faceb-24ae-4617-b834-4f7670dd56c0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Request method failure captured: Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb HTTP/1.1 Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGeoILD3U4vChTrZjkYI4Mb1kQqju4iwwUAYzlRXKVryjoclEfp1UhmOMHe778O5Z4ARhhTFWmkUbknFAv5rpY_CXinYH_td3aTmUIcUS1D1BuQ5KjeFh9JIa2zMHAABGSpZQFjKVKfFJFS90ugU-HBFkBjlvLtvBkr5Y6Kc1SeIzgsY Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.47 Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a14cd14eb3034d3699c49f8b0f4488bb Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerShowV247Test-1079756871 Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a14cd14eb3034d3699c49f8b0f4488bb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a14cd14eb3034d3699c49f8b0f4488bb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a14cd14eb3034d3699c49f8b0f4488bb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a14cd14eb3034d3699c49f8b0f4488bb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerShowV247Test-1079756871 Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a14cd14eb3034d3699c49f8b0f4488bb Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerShowV247Test-1079756871 Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerShowV247Test-1079756871-project Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2eba3f63d4734cd6ac5e60138d7bcdc3 Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerShowV247Test-1079756871-project Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance c66d0923-df7f-44f7-bafe-42bd0f9aeffb could not be found. Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c66d0923-df7f-44f7-bafe-42bd0f9aeffb'} Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c66d0923-df7f-44f7-bafe-42bd0f9aeffb could not be found. Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c66d0923-df7f-44f7-bafe-42bd0f9aeffb could not be found. Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:42.305358 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:42.317842 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:42.317842 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:42.317842 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:42.317842 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:12:42.317842 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:12:42.317842 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c66d0923-df7f-44f7-bafe-42bd0f9aeffb could not be found. Sep 08 13:12:42.317842 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:42.317842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-508faceb-24ae-4617-b834-4f7670dd56c0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] Returning 404 to user: Instance c66d0923-df7f-44f7-bafe-42bd0f9aeffb could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:42.319951 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-508faceb-24ae-4617-b834-4f7670dd56c0 tempest-ServerShowV247Test-1079756871 tempest-ServerShowV247Test-1079756871-project] 10.222.0.78 "GET /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb" status: 404 len: 111 microversion: 2.47 time: 0.162885 Sep 08 13:12:42.332866 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2527/4916] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:12:42 2022] GET /compute/v2.1/servers/c66d0923-df7f-44f7-bafe-42bd0f9aeffb => generated 111 bytes in 195 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:12:43.049475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-244d5bb0-e782-4cd0-a7d9-c20705c89384 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:43.050237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-244d5bb0-e782-4cd0-a7d9-c20705c89384 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:43.073646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-244d5bb0-e782-4cd0-a7d9-c20705c89384 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:43.074498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-244d5bb0-e782-4cd0-a7d9-c20705c89384 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:43.076648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-244d5bb0-e782-4cd0-a7d9-c20705c89384 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:43.077922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-244d5bb0-e782-4cd0-a7d9-c20705c89384 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:43.098175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-244d5bb0-e782-4cd0-a7d9-c20705c89384 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:43.099560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-244d5bb0-e782-4cd0-a7d9-c20705c89384 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:43.610703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-244d5bb0-e782-4cd0-a7d9-c20705c89384 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:43.648962 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-244d5bb0-e782-4cd0-a7d9-c20705c89384 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1512 microversion: 2.1 time: 0.607331 Sep 08 13:12:43.654286 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2390/4917] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:43 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1512 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:44.698492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1a964acf-8662-43cd-82ea-2ddb57cd98ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:44.699609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1a964acf-8662-43cd-82ea-2ddb57cd98ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:44.725896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a964acf-8662-43cd-82ea-2ddb57cd98ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:44.726658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a964acf-8662-43cd-82ea-2ddb57cd98ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:44.727373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a964acf-8662-43cd-82ea-2ddb57cd98ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:44.728549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a964acf-8662-43cd-82ea-2ddb57cd98ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:44.729313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a964acf-8662-43cd-82ea-2ddb57cd98ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:44.730015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a964acf-8662-43cd-82ea-2ddb57cd98ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:45.318551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a964acf-8662-43cd-82ea-2ddb57cd98ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:45.361284 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1a964acf-8662-43cd-82ea-2ddb57cd98ce tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1512 microversion: 2.1 time: 0.668108 Sep 08 13:12:45.365056 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2528/4918] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:44 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1512 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:46.414822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1cd3d15d-9fe5-42fd-9fba-40f6173cfe77 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:46.417863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1cd3d15d-9fe5-42fd-9fba-40f6173cfe77 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:46.442134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cd3d15d-9fe5-42fd-9fba-40f6173cfe77 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:46.444856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cd3d15d-9fe5-42fd-9fba-40f6173cfe77 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:46.446944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cd3d15d-9fe5-42fd-9fba-40f6173cfe77 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:46.449333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cd3d15d-9fe5-42fd-9fba-40f6173cfe77 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:46.457823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cd3d15d-9fe5-42fd-9fba-40f6173cfe77 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:46.466600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1cd3d15d-9fe5-42fd-9fba-40f6173cfe77 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:46.476996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:12:46.720601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1cd3d15d-9fe5-42fd-9fba-40f6173cfe77 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:46.754977 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1cd3d15d-9fe5-42fd-9fba-40f6173cfe77 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1470 microversion: 2.1 time: 0.345244 Sep 08 13:12:46.773128 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2391/4919] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:46 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1470 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:47.816612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44b8fe19-f4d4-4c70-ad59-70cdca049916 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:47.820320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-44b8fe19-f4d4-4c70-ad59-70cdca049916 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:47.846305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44b8fe19-f4d4-4c70-ad59-70cdca049916 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:47.849194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44b8fe19-f4d4-4c70-ad59-70cdca049916 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:47.850540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44b8fe19-f4d4-4c70-ad59-70cdca049916 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:47.854979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44b8fe19-f4d4-4c70-ad59-70cdca049916 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:47.858154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44b8fe19-f4d4-4c70-ad59-70cdca049916 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:47.869712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44b8fe19-f4d4-4c70-ad59-70cdca049916 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:48.144915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-44b8fe19-f4d4-4c70-ad59-70cdca049916 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3977def69d4b5e8c91be7b122f4764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6967bf506a413c92acc93b58778334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:12:48.193003 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44b8fe19-f4d4-4c70-ad59-70cdca049916 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 200 len: 1470 microversion: 2.1 time: 0.379771 Sep 08 13:12:48.193778 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2529/4920] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:47 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 1470 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:12:48.279654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-bffd76ba-ef31-4ef6-8fcb-28cd0c840486 req-fb49e8b5-ba2d-44c9-8821-1d799fb3ba61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eb421d7-2415-43d2-a6bb-3fdbca098091", "name": "network-vif-deleted", "tag": "633f3920-4732-4687-b8a2-8db04d18d889"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:12:48.347027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bffd76ba-ef31-4ef6-8fcb-28cd0c840486 req-fb49e8b5-ba2d-44c9-8821-1d799fb3ba61 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:48.348944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bffd76ba-ef31-4ef6-8fcb-28cd0c840486 req-fb49e8b5-ba2d-44c9-8821-1d799fb3ba61 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:48.350133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bffd76ba-ef31-4ef6-8fcb-28cd0c840486 req-fb49e8b5-ba2d-44c9-8821-1d799fb3ba61 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:48.399677 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-bffd76ba-ef31-4ef6-8fcb-28cd0c840486 req-fb49e8b5-ba2d-44c9-8821-1d799fb3ba61 service nova] Creating event network-vif-deleted:633f3920-4732-4687-b8a2-8db04d18d889 for instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 on n-h1-852084-10 Sep 08 13:12:48.421061 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-bffd76ba-ef31-4ef6-8fcb-28cd0c840486 req-fb49e8b5-ba2d-44c9-8821-1d799fb3ba61 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161008 Sep 08 13:12:48.424069 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2392/4921] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:12:49.242813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4b029b95-1b8a-4cf3-ab6a-0ba35d5bc611 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:49.245404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4b029b95-1b8a-4cf3-ab6a-0ba35d5bc611 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] [instance: 4eb421d7-2415-43d2-a6bb-3fdbca098091] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:49.295632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b029b95-1b8a-4cf3-ab6a-0ba35d5bc611 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:49.304539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b029b95-1b8a-4cf3-ab6a-0ba35d5bc611 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:49.306015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b029b95-1b8a-4cf3-ab6a-0ba35d5bc611 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:49.313764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b029b95-1b8a-4cf3-ab6a-0ba35d5bc611 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:49.320962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b029b95-1b8a-4cf3-ab6a-0ba35d5bc611 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:49.322277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b029b95-1b8a-4cf3-ab6a-0ba35d5bc611 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:49.396632 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-4b029b95-1b8a-4cf3-ab6a-0ba35d5bc611 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] HTTP exception thrown: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 could not be found. Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4b029b95-1b8a-4cf3-ab6a-0ba35d5bc611 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Request method failure captured: Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 HTTP/1.1 Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGej6IQl1fZr_NaMvCoL5tDMFl0QTKvwLAfduxUKdIjzymrdss6hwMnNTE2mshpeHAiOGUuUDTqD-gwM5VCqa_gx3iAEK_wqzuufUYX2espSkU39Ip8I1Hg4hC5jODm6UBGQclZIPgsZDptFqLohQK-5UlgGCLFf6ROCer4A-5A3sohA Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0d6967bf506a413c92acc93b58778334"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0d6967bf506a413c92acc93b58778334"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0d6967bf506a413c92acc93b58778334"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0d6967bf506a413c92acc93b58778334 Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-670417623 Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 2d3977def69d4b5e8c91be7b122f4764 Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-670417623-project Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 could not be found. Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '4eb421d7-2415-43d2-a6bb-3fdbca098091'} Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 could not be found. Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 could not be found. Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:12:49.397328 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:49.413238 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:12:49.413238 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:12:49.413238 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:12:49.413238 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:12:49.413238 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:12:49.413238 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 could not be found. Sep 08 13:12:49.413238 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:12:49.413238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4b029b95-1b8a-4cf3-ab6a-0ba35d5bc611 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] Returning 404 to user: Instance 4eb421d7-2415-43d2-a6bb-3fdbca098091 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:12:49.413238 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4b029b95-1b8a-4cf3-ab6a-0ba35d5bc611 tempest-ServersNegativeTestJSON-670417623 tempest-ServersNegativeTestJSON-670417623-project] 10.222.0.78 "GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091" status: 404 len: 111 microversion: 2.1 time: 0.180363 Sep 08 13:12:49.413238 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2530/4922] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:12:49 2022] GET /compute/v2.1/servers/4eb421d7-2415-43d2-a6bb-3fdbca098091 => generated 111 bytes in 190 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:12:51.439178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2435bb59-05e1-4d53-a729-09b39607157c tempest-QuotasTestJSON-1667027328 tempest-QuotasTestJSON-1667027328-project] Calling method '.version_select at 0x7fdb39fc4670>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:51.591946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:12:51.611489 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2435bb59-05e1-4d53-a729-09b39607157c tempest-QuotasTestJSON-1667027328 tempest-QuotasTestJSON-1667027328-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/7044e32864b4483cb653e7d908279944/defaults" status: 200 len: 371 microversion: 2.1 time: 0.724024 Sep 08 13:12:51.624116 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2393/4923] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 13:12:50 2022] GET /compute/v2.1/os-quota-sets/7044e32864b4483cb653e7d908279944/defaults => generated 371 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:12:51.626939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-16223be1-da7d-4e74-936a-0f3b40eaa026 tempest-QuotasTestJSON-1667027328 tempest-QuotasTestJSON-1667027328-project] Calling method '.version_select at 0x7fdb36ff5820>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:51.928283 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-16223be1-da7d-4e74-936a-0f3b40eaa026 tempest-QuotasTestJSON-1667027328 tempest-QuotasTestJSON-1667027328-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/7044e32864b4483cb653e7d908279944" status: 200 len: 371 microversion: 2.1 time: 0.306755 Sep 08 13:12:51.959431 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2531/4924] 10.222.0.78 () {58 vars in 1242 bytes} [Thu Sep 8 13:12:51 2022] GET /compute/v2.1/os-quota-sets/7044e32864b4483cb653e7d908279944 => generated 371 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:12:51.969959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5ada3419-6c8b-4142-a3a8-ac46bb240f3c tempest-QuotasTestJSON-1667027328 tempest-QuotasTestJSON-1667027328-project] Calling method '.version_select at 0x7fdb39c9d280>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:52.154945 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5ada3419-6c8b-4142-a3a8-ac46bb240f3c tempest-QuotasTestJSON-1667027328 tempest-QuotasTestJSON-1667027328-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/7044e32864b4483cb653e7d908279944/defaults" status: 200 len: 371 microversion: 2.1 time: 0.196136 Sep 08 13:12:52.155870 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2394/4925] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 13:12:51 2022] GET /compute/v2.1/os-quota-sets/7044e32864b4483cb653e7d908279944/defaults => generated 371 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:12:52.174306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8562467b-a5b1-4ecd-83ee-f94f6c81c912 tempest-QuotasTestJSON-1667027328 tempest-QuotasTestJSON-1667027328-project] Calling method '.version_select at 0x7fdb3f1e1c10>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:52.377593 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8562467b-a5b1-4ecd-83ee-f94f6c81c912 tempest-QuotasTestJSON-1667027328 tempest-QuotasTestJSON-1667027328-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/7044e32864b4483cb653e7d908279944" status: 200 len: 371 microversion: 2.1 time: 0.209033 Sep 08 13:12:52.394780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2d94317-612c-46ec-9543-1747b0310ee3 tempest-QuotasTestJSON-1667027328 tempest-QuotasTestJSON-1667027328-project] Calling method '.version_select at 0x7fdb3f095c10>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:52.401537 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2532/4926] 10.222.0.78 () {58 vars in 1242 bytes} [Thu Sep 8 13:12:52 2022] GET /compute/v2.1/os-quota-sets/7044e32864b4483cb653e7d908279944 => generated 371 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:12:52.572896 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2d94317-612c-46ec-9543-1747b0310ee3 tempest-QuotasTestJSON-1667027328 tempest-QuotasTestJSON-1667027328-project] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/7044e32864b4483cb653e7d908279944?user_id=d2b80aa28c044e0889614208ad106dbe" status: 200 len: 371 microversion: 2.1 time: 0.184783 Sep 08 13:12:52.574787 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2395/4927] 10.222.0.78 () {58 vars in 1323 bytes} [Thu Sep 8 13:12:52 2022] GET /compute/v2.1/os-quota-sets/7044e32864b4483cb653e7d908279944?user_id=d2b80aa28c044e0889614208ad106dbe => generated 371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:12:55.452340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-01f20534-6dd5-40d7-a8e1-506accfa5081 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:12:55.453625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-01f20534-6dd5-40d7-a8e1-506accfa5081 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:12:55.485834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01f20534-6dd5-40d7-a8e1-506accfa5081 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:55.486997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01f20534-6dd5-40d7-a8e1-506accfa5081 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:55.487878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01f20534-6dd5-40d7-a8e1-506accfa5081 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:55.493928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01f20534-6dd5-40d7-a8e1-506accfa5081 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:12:55.495947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01f20534-6dd5-40d7-a8e1-506accfa5081 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:12:55.497739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01f20534-6dd5-40d7-a8e1-506accfa5081 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:12:55.575931 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-01f20534-6dd5-40d7-a8e1-506accfa5081 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/ips" status: 200 len: 153 microversion: 2.20 time: 0.151114 Sep 08 13:12:55.581793 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2533/4928] 10.222.0.78 () {60 vars in 1289 bytes} [Thu Sep 8 13:12:55 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/ips => generated 153 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:13:00.940036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fbf0be8f-ef0d-4c9c-889b-4499f32075a8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:13:00.941944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fbf0be8f-ef0d-4c9c-889b-4499f32075a8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:00.962702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=7 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:13:00.996993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf0be8f-ef0d-4c9c-889b-4499f32075a8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:01.006346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf0be8f-ef0d-4c9c-889b-4499f32075a8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:01.008878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf0be8f-ef0d-4c9c-889b-4499f32075a8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:01.015935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf0be8f-ef0d-4c9c-889b-4499f32075a8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:01.025156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf0be8f-ef0d-4c9c-889b-4499f32075a8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:01.028380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbf0be8f-ef0d-4c9c-889b-4499f32075a8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:01.151341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-fbf0be8f-ef0d-4c9c-889b-4499f32075a8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lazy-loading 'flavor' on Instance uuid bad0f9bb-3303-4bdc-a35e-102f0002fe77 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:13:01.852541 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fbf0be8f-ef0d-4c9c-889b-4499f32075a8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "POST /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/action" status: 202 len: 0 microversion: 2.20 time: 0.915558 Sep 08 13:13:01.858024 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2396/4929] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 13:13:00 2022] POST /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/action => generated 0 bytes in 924 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:13:01.883348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1a177c70-af74-4d52-aa0a-ff5b582428f0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:01.884277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1a177c70-af74-4d52-aa0a-ff5b582428f0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:01.886938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:13:01.933601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a177c70-af74-4d52-aa0a-ff5b582428f0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:01.935171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a177c70-af74-4d52-aa0a-ff5b582428f0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:01.943952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a177c70-af74-4d52-aa0a-ff5b582428f0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:01.947772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a177c70-af74-4d52-aa0a-ff5b582428f0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:01.949279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a177c70-af74-4d52-aa0a-ff5b582428f0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:01.953551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1a177c70-af74-4d52-aa0a-ff5b582428f0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:02.358428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:13:04.256162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a177c70-af74-4d52-aa0a-ff5b582428f0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:04.291670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a177c70-af74-4d52-aa0a-ff5b582428f0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:04.308354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1a177c70-af74-4d52-aa0a-ff5b582428f0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:04.321713 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1a177c70-af74-4d52-aa0a-ff5b582428f0 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1724 microversion: 2.20 time: 2.456187 Sep 08 13:13:04.348329 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2534/4930] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:01 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1724 bytes in 2487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:05.365849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:13:05.375904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8b4c0603-2bdd-4880-affc-082f9cba0ede tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:05.379921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8b4c0603-2bdd-4880-affc-082f9cba0ede tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:05.422749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b4c0603-2bdd-4880-affc-082f9cba0ede tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:05.424036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b4c0603-2bdd-4880-affc-082f9cba0ede tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:05.428373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b4c0603-2bdd-4880-affc-082f9cba0ede tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:05.437284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b4c0603-2bdd-4880-affc-082f9cba0ede tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:05.441976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b4c0603-2bdd-4880-affc-082f9cba0ede tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:05.447907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b4c0603-2bdd-4880-affc-082f9cba0ede tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:06.808848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8b4c0603-2bdd-4880-affc-082f9cba0ede tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:06.889330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8b4c0603-2bdd-4880-affc-082f9cba0ede tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:06.893204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8b4c0603-2bdd-4880-affc-082f9cba0ede tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:06.897331 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8b4c0603-2bdd-4880-affc-082f9cba0ede tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1724 microversion: 2.20 time: 1.532543 Sep 08 13:13:06.899679 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2397/4931] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:05 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1724 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:07.939781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eab15883-0046-4f69-9516-bbef30b3e414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:07.945474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eab15883-0046-4f69-9516-bbef30b3e414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:07.998074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eab15883-0046-4f69-9516-bbef30b3e414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:08.000925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eab15883-0046-4f69-9516-bbef30b3e414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:08.004849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eab15883-0046-4f69-9516-bbef30b3e414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:08.010492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eab15883-0046-4f69-9516-bbef30b3e414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:08.011729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eab15883-0046-4f69-9516-bbef30b3e414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:08.015757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eab15883-0046-4f69-9516-bbef30b3e414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:08.116962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:13:09.413283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eab15883-0046-4f69-9516-bbef30b3e414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:09.440426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eab15883-0046-4f69-9516-bbef30b3e414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:09.456084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eab15883-0046-4f69-9516-bbef30b3e414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:09.457788 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eab15883-0046-4f69-9516-bbef30b3e414 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1724 microversion: 2.20 time: 1.527110 Sep 08 13:13:09.459104 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2535/4932] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:07 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1724 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:10.509225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-abef6b25-4c67-4455-b833-9303c1d5f06f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:10.511987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-abef6b25-4c67-4455-b833-9303c1d5f06f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:10.539051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-abef6b25-4c67-4455-b833-9303c1d5f06f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:10.551547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-abef6b25-4c67-4455-b833-9303c1d5f06f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:10.552406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-abef6b25-4c67-4455-b833-9303c1d5f06f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:10.554068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-abef6b25-4c67-4455-b833-9303c1d5f06f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:10.555701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-abef6b25-4c67-4455-b833-9303c1d5f06f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:10.556759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-abef6b25-4c67-4455-b833-9303c1d5f06f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:12.491812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-abef6b25-4c67-4455-b833-9303c1d5f06f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:12.523280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-abef6b25-4c67-4455-b833-9303c1d5f06f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:12.527995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-abef6b25-4c67-4455-b833-9303c1d5f06f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:12.530622 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-abef6b25-4c67-4455-b833-9303c1d5f06f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1724 microversion: 2.20 time: 2.028933 Sep 08 13:13:12.547793 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2398/4933] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:10 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1724 bytes in 2047 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:13.570700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a1aa4ae0-8fd5-4f1f-94bd-8a0855efbc2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:13.573167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a1aa4ae0-8fd5-4f1f-94bd-8a0855efbc2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:13.598300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1aa4ae0-8fd5-4f1f-94bd-8a0855efbc2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:13.598912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1aa4ae0-8fd5-4f1f-94bd-8a0855efbc2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:13.599395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1aa4ae0-8fd5-4f1f-94bd-8a0855efbc2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:13.600159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1aa4ae0-8fd5-4f1f-94bd-8a0855efbc2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:13.600652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1aa4ae0-8fd5-4f1f-94bd-8a0855efbc2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:13.601084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a1aa4ae0-8fd5-4f1f-94bd-8a0855efbc2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:14.524156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a1aa4ae0-8fd5-4f1f-94bd-8a0855efbc2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:14.591662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a1aa4ae0-8fd5-4f1f-94bd-8a0855efbc2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:14.602129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a1aa4ae0-8fd5-4f1f-94bd-8a0855efbc2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:14.605686 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a1aa4ae0-8fd5-4f1f-94bd-8a0855efbc2c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1745 microversion: 2.20 time: 1.039594 Sep 08 13:13:14.612898 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2536/4934] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:13 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1745 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:15.679017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-20004ba4-e82a-422f-800f-9ff4de8e7ad4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:15.693650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-20004ba4-e82a-422f-800f-9ff4de8e7ad4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:15.738577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-20004ba4-e82a-422f-800f-9ff4de8e7ad4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:15.739503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-20004ba4-e82a-422f-800f-9ff4de8e7ad4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:15.740390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-20004ba4-e82a-422f-800f-9ff4de8e7ad4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:15.750299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-20004ba4-e82a-422f-800f-9ff4de8e7ad4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:15.754621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-20004ba4-e82a-422f-800f-9ff4de8e7ad4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:15.758039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-20004ba4-e82a-422f-800f-9ff4de8e7ad4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:16.311537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9c1f0517-2525-48ca-848a-7f142fe88eca tempest-ExtensionsTest-1771780732 tempest-ExtensionsTest-1771780732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:16.315537 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9c1f0517-2525-48ca-848a-7f142fe88eca tempest-ExtensionsTest-1771780732 tempest-ExtensionsTest-1771780732-project] 10.222.0.78 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 1.296334 Sep 08 13:13:16.324318 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2399/4935] 10.222.0.78 () {58 vars in 1170 bytes} [Thu Sep 8 13:13:15 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:13:16.345196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-75ff03ee-435d-45e2-b028-364200aaf680 tempest-ExtensionsTest-1771780732 tempest-ExtensionsTest-1771780732-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:16.356069 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-75ff03ee-435d-45e2-b028-364200aaf680 tempest-ExtensionsTest-1771780732 tempest-ExtensionsTest-1771780732-project] 10.222.0.78 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.018990 Sep 08 13:13:16.363304 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2400/4936] 10.222.0.78 () {58 vars in 1134 bytes} [Thu Sep 8 13:13:16 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:13:16.751727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-20004ba4-e82a-422f-800f-9ff4de8e7ad4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:16.803424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-20004ba4-e82a-422f-800f-9ff4de8e7ad4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:16.806655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-20004ba4-e82a-422f-800f-9ff4de8e7ad4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:16.816599 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-20004ba4-e82a-422f-800f-9ff4de8e7ad4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 1.153881 Sep 08 13:13:16.828964 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2537/4937] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:15 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:17.865452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9d2c3f97-61b8-4bd7-9cca-9f6581f47169 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:17.866406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9d2c3f97-61b8-4bd7-9cca-9f6581f47169 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:17.898744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d2c3f97-61b8-4bd7-9cca-9f6581f47169 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:17.903289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d2c3f97-61b8-4bd7-9cca-9f6581f47169 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:17.905506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d2c3f97-61b8-4bd7-9cca-9f6581f47169 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:17.909044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d2c3f97-61b8-4bd7-9cca-9f6581f47169 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:17.909563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d2c3f97-61b8-4bd7-9cca-9f6581f47169 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:17.910019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d2c3f97-61b8-4bd7-9cca-9f6581f47169 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:20.073351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9d2c3f97-61b8-4bd7-9cca-9f6581f47169 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:20.142222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9d2c3f97-61b8-4bd7-9cca-9f6581f47169 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:20.144791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9d2c3f97-61b8-4bd7-9cca-9f6581f47169 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:20.162976 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9d2c3f97-61b8-4bd7-9cca-9f6581f47169 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 2.303843 Sep 08 13:13:20.171251 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2401/4938] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:17 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:21.223202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0d719d08-f484-4567-9ee9-a8398f552344 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:21.236919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0d719d08-f484-4567-9ee9-a8398f552344 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:21.316781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d719d08-f484-4567-9ee9-a8398f552344 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:21.319493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d719d08-f484-4567-9ee9-a8398f552344 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:21.322367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d719d08-f484-4567-9ee9-a8398f552344 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:21.333138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d719d08-f484-4567-9ee9-a8398f552344 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:21.340526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d719d08-f484-4567-9ee9-a8398f552344 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:21.344203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d719d08-f484-4567-9ee9-a8398f552344 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:22.786803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0d719d08-f484-4567-9ee9-a8398f552344 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:22.851773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0d719d08-f484-4567-9ee9-a8398f552344 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:22.862126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0d719d08-f484-4567-9ee9-a8398f552344 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:22.864575 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0d719d08-f484-4567-9ee9-a8398f552344 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 1.656226 Sep 08 13:13:22.874331 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2538/4939] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:21 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:23.919099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ab908ac-4ee2-40f7-a09e-8c1a8f20ae7a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:23.924456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ab908ac-4ee2-40f7-a09e-8c1a8f20ae7a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:23.929356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=18 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:13:23.995065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ab908ac-4ee2-40f7-a09e-8c1a8f20ae7a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:23.995971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ab908ac-4ee2-40f7-a09e-8c1a8f20ae7a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:23.997329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ab908ac-4ee2-40f7-a09e-8c1a8f20ae7a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:24.006212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ab908ac-4ee2-40f7-a09e-8c1a8f20ae7a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:24.015544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ab908ac-4ee2-40f7-a09e-8c1a8f20ae7a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:24.016233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ab908ac-4ee2-40f7-a09e-8c1a8f20ae7a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:24.374133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ab908ac-4ee2-40f7-a09e-8c1a8f20ae7a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:24.391398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ab908ac-4ee2-40f7-a09e-8c1a8f20ae7a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:24.394282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ab908ac-4ee2-40f7-a09e-8c1a8f20ae7a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:24.400358 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ab908ac-4ee2-40f7-a09e-8c1a8f20ae7a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 0.487069 Sep 08 13:13:24.416859 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2402/4940] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:23 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:25.435057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0bc6f833-b7e4-455e-9f54-2347a1fc1459 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:25.435969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0bc6f833-b7e4-455e-9f54-2347a1fc1459 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:25.456771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0bc6f833-b7e4-455e-9f54-2347a1fc1459 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:25.460282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0bc6f833-b7e4-455e-9f54-2347a1fc1459 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:25.460814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0bc6f833-b7e4-455e-9f54-2347a1fc1459 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:25.463103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0bc6f833-b7e4-455e-9f54-2347a1fc1459 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:25.463564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0bc6f833-b7e4-455e-9f54-2347a1fc1459 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:25.466407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0bc6f833-b7e4-455e-9f54-2347a1fc1459 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:25.784514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0bc6f833-b7e4-455e-9f54-2347a1fc1459 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:25.808649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0bc6f833-b7e4-455e-9f54-2347a1fc1459 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:25.810258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0bc6f833-b7e4-455e-9f54-2347a1fc1459 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:25.816575 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0bc6f833-b7e4-455e-9f54-2347a1fc1459 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 0.386719 Sep 08 13:13:25.817886 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2539/4941] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:25 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:13:26.165539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-5a9be819-d8cf-40c0-bbdf-86a1c5de8078 req-4da545e0-fa04-4797-b3d9-9c1c5d948d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad0f9bb-3303-4bdc-a35e-102f0002fe77", "name": "network-vif-plugged", "status": "completed", "tag": "1ea3ab52-16b6-4072-bb78-7320e9ba5e25"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:13:26.212784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5a9be819-d8cf-40c0-bbdf-86a1c5de8078 req-4da545e0-fa04-4797-b3d9-9c1c5d948d1b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:26.213678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5a9be819-d8cf-40c0-bbdf-86a1c5de8078 req-4da545e0-fa04-4797-b3d9-9c1c5d948d1b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:26.218793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5a9be819-d8cf-40c0-bbdf-86a1c5de8078 req-4da545e0-fa04-4797-b3d9-9c1c5d948d1b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:26.280422 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-5a9be819-d8cf-40c0-bbdf-86a1c5de8078 req-4da545e0-fa04-4797-b3d9-9c1c5d948d1b service nova] Creating event network-vif-plugged:1ea3ab52-16b6-4072-bb78-7320e9ba5e25 for instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 on n-h1-852084-10 Sep 08 13:13:26.303590 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-5a9be819-d8cf-40c0-bbdf-86a1c5de8078 req-4da545e0-fa04-4797-b3d9-9c1c5d948d1b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148196 Sep 08 13:13:26.308281 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2403/4942] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:13:26.852754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-312ac88b-7e61-4508-af78-847072368a13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:26.862358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-312ac88b-7e61-4508-af78-847072368a13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:26.912646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-312ac88b-7e61-4508-af78-847072368a13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:26.913427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-312ac88b-7e61-4508-af78-847072368a13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:26.914073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-312ac88b-7e61-4508-af78-847072368a13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:26.914999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-312ac88b-7e61-4508-af78-847072368a13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:26.919411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-312ac88b-7e61-4508-af78-847072368a13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:26.929778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-312ac88b-7e61-4508-af78-847072368a13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:27.792187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-312ac88b-7e61-4508-af78-847072368a13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:27.819446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-312ac88b-7e61-4508-af78-847072368a13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:27.835131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-312ac88b-7e61-4508-af78-847072368a13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:27.838192 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-312ac88b-7e61-4508-af78-847072368a13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 0.994636 Sep 08 13:13:27.841272 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2540/4943] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:26 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:28.898361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d381c39-6847-4993-a074-487322a490ea tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:28.900128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4d381c39-6847-4993-a074-487322a490ea tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:28.958240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d381c39-6847-4993-a074-487322a490ea tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:28.958692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d381c39-6847-4993-a074-487322a490ea tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:28.962524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d381c39-6847-4993-a074-487322a490ea tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:28.964023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d381c39-6847-4993-a074-487322a490ea tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:28.964768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d381c39-6847-4993-a074-487322a490ea tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:28.970326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d381c39-6847-4993-a074-487322a490ea tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:30.333710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4d381c39-6847-4993-a074-487322a490ea tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:30.373735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4d381c39-6847-4993-a074-487322a490ea tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:30.375685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4d381c39-6847-4993-a074-487322a490ea tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:30.386390 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4d381c39-6847-4993-a074-487322a490ea tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 1.496736 Sep 08 13:13:30.390326 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2404/4944] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:28 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 1511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:31.432085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ad9c3a4-c227-4c61-8b55-9b5bbd334ef8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:31.438221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8ad9c3a4-c227-4c61-8b55-9b5bbd334ef8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:31.474852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ad9c3a4-c227-4c61-8b55-9b5bbd334ef8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:31.478915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ad9c3a4-c227-4c61-8b55-9b5bbd334ef8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:31.486073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ad9c3a4-c227-4c61-8b55-9b5bbd334ef8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:31.488122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ad9c3a4-c227-4c61-8b55-9b5bbd334ef8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:31.489962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ad9c3a4-c227-4c61-8b55-9b5bbd334ef8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:31.491160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ad9c3a4-c227-4c61-8b55-9b5bbd334ef8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:31.846960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8ad9c3a4-c227-4c61-8b55-9b5bbd334ef8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:31.947622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8ad9c3a4-c227-4c61-8b55-9b5bbd334ef8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:31.947622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8ad9c3a4-c227-4c61-8b55-9b5bbd334ef8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:31.947622 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8ad9c3a4-c227-4c61-8b55-9b5bbd334ef8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 0.466079 Sep 08 13:13:31.947622 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2541/4945] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:31 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:32.997666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d0305a6f-f11b-4caf-ba3b-6eac3bee1a1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:32.998770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d0305a6f-f11b-4caf-ba3b-6eac3bee1a1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:33.044495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0305a6f-f11b-4caf-ba3b-6eac3bee1a1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:33.045661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0305a6f-f11b-4caf-ba3b-6eac3bee1a1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:33.048060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0305a6f-f11b-4caf-ba3b-6eac3bee1a1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:33.051272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0305a6f-f11b-4caf-ba3b-6eac3bee1a1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:33.052172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0305a6f-f11b-4caf-ba3b-6eac3bee1a1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:33.052958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0305a6f-f11b-4caf-ba3b-6eac3bee1a1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:33.105489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:13:34.953469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d0305a6f-f11b-4caf-ba3b-6eac3bee1a1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:34.969454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d0305a6f-f11b-4caf-ba3b-6eac3bee1a1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:34.971406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d0305a6f-f11b-4caf-ba3b-6eac3bee1a1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:34.972788 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d0305a6f-f11b-4caf-ba3b-6eac3bee1a1b tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 1.983540 Sep 08 13:13:35.007271 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2405/4946] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:32 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 2008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:36.058195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eadcf48a-d58d-40d0-baca-85a91e18d3a4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:36.072107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eadcf48a-d58d-40d0-baca-85a91e18d3a4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:36.092255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=16 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:13:36.147878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eadcf48a-d58d-40d0-baca-85a91e18d3a4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:36.161512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eadcf48a-d58d-40d0-baca-85a91e18d3a4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:36.162315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eadcf48a-d58d-40d0-baca-85a91e18d3a4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:36.168089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eadcf48a-d58d-40d0-baca-85a91e18d3a4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:36.170348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eadcf48a-d58d-40d0-baca-85a91e18d3a4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:36.179942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eadcf48a-d58d-40d0-baca-85a91e18d3a4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:37.089156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eadcf48a-d58d-40d0-baca-85a91e18d3a4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:37.133331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eadcf48a-d58d-40d0-baca-85a91e18d3a4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:37.144549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eadcf48a-d58d-40d0-baca-85a91e18d3a4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:37.149484 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eadcf48a-d58d-40d0-baca-85a91e18d3a4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 1.097824 Sep 08 13:13:37.163290 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2542/4947] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:36 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:38.204688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2b5c50a2-c336-4341-8442-e411e7a0d0cc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:38.206041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2b5c50a2-c336-4341-8442-e411e7a0d0cc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:38.222436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b5c50a2-c336-4341-8442-e411e7a0d0cc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:38.232905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b5c50a2-c336-4341-8442-e411e7a0d0cc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:38.233957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b5c50a2-c336-4341-8442-e411e7a0d0cc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:38.235115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b5c50a2-c336-4341-8442-e411e7a0d0cc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:38.236156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b5c50a2-c336-4341-8442-e411e7a0d0cc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:38.236833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b5c50a2-c336-4341-8442-e411e7a0d0cc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:39.366991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2b5c50a2-c336-4341-8442-e411e7a0d0cc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:39.391098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2b5c50a2-c336-4341-8442-e411e7a0d0cc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:39.453907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2b5c50a2-c336-4341-8442-e411e7a0d0cc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:39.480949 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2b5c50a2-c336-4341-8442-e411e7a0d0cc tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 1.278846 Sep 08 13:13:39.483352 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2406/4948] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:38 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:40.519391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79d5efab-0473-4381-9111-5a4990443220 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:40.521624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-79d5efab-0473-4381-9111-5a4990443220 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:40.549164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79d5efab-0473-4381-9111-5a4990443220 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:40.552670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79d5efab-0473-4381-9111-5a4990443220 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:40.556744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79d5efab-0473-4381-9111-5a4990443220 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:40.557960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79d5efab-0473-4381-9111-5a4990443220 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:40.559004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79d5efab-0473-4381-9111-5a4990443220 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:40.559686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79d5efab-0473-4381-9111-5a4990443220 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:40.564739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=48 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:13:41.368444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-79d5efab-0473-4381-9111-5a4990443220 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:41.398100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-79d5efab-0473-4381-9111-5a4990443220 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:41.407686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-79d5efab-0473-4381-9111-5a4990443220 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:41.412296 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-79d5efab-0473-4381-9111-5a4990443220 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 0.902135 Sep 08 13:13:41.415420 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2543/4949] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:40 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:42.463517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4ec50873-c122-4d28-9357-335f0d452e5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:42.465787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ec50873-c122-4d28-9357-335f0d452e5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:42.494750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ec50873-c122-4d28-9357-335f0d452e5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:42.496268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ec50873-c122-4d28-9357-335f0d452e5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:42.497252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ec50873-c122-4d28-9357-335f0d452e5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:42.498586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ec50873-c122-4d28-9357-335f0d452e5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:42.499729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ec50873-c122-4d28-9357-335f0d452e5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:42.500503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ec50873-c122-4d28-9357-335f0d452e5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:43.211202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4ec50873-c122-4d28-9357-335f0d452e5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:43.290428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4ec50873-c122-4d28-9357-335f0d452e5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:43.307080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4ec50873-c122-4d28-9357-335f0d452e5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:43.321222 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4ec50873-c122-4d28-9357-335f0d452e5d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 0.876173 Sep 08 13:13:43.366953 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2407/4950] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:42 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:44.410532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-781114e1-7f90-46c7-a5b3-423106390d8d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:44.419255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-781114e1-7f90-46c7-a5b3-423106390d8d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:44.542336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-781114e1-7f90-46c7-a5b3-423106390d8d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:44.542336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-781114e1-7f90-46c7-a5b3-423106390d8d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:44.542336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-781114e1-7f90-46c7-a5b3-423106390d8d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:44.542336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-781114e1-7f90-46c7-a5b3-423106390d8d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:44.542336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-781114e1-7f90-46c7-a5b3-423106390d8d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:44.542336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-781114e1-7f90-46c7-a5b3-423106390d8d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:45.746986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-781114e1-7f90-46c7-a5b3-423106390d8d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:45.758535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-781114e1-7f90-46c7-a5b3-423106390d8d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:45.782945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-781114e1-7f90-46c7-a5b3-423106390d8d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:45.790290 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-781114e1-7f90-46c7-a5b3-423106390d8d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 1.390366 Sep 08 13:13:45.802482 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2544/4951] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:44 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:46.826055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9e42c1d5-b833-4363-a4b3-af12f85c95ca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:46.826757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9e42c1d5-b833-4363-a4b3-af12f85c95ca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:46.841956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e42c1d5-b833-4363-a4b3-af12f85c95ca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:46.842466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e42c1d5-b833-4363-a4b3-af12f85c95ca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:46.842922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e42c1d5-b833-4363-a4b3-af12f85c95ca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:46.843697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e42c1d5-b833-4363-a4b3-af12f85c95ca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:46.844165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e42c1d5-b833-4363-a4b3-af12f85c95ca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:46.844685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e42c1d5-b833-4363-a4b3-af12f85c95ca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:49.745193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9e42c1d5-b833-4363-a4b3-af12f85c95ca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:49.762027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9e42c1d5-b833-4363-a4b3-af12f85c95ca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:49.767181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9e42c1d5-b833-4363-a4b3-af12f85c95ca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:49.773163 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9e42c1d5-b833-4363-a4b3-af12f85c95ca tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 2.952003 Sep 08 13:13:49.779604 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2408/4952] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:46 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 2959 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:50.817778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae356213-04dc-42ba-a68e-c9bc2e7fad93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:50.818859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ae356213-04dc-42ba-a68e-c9bc2e7fad93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:50.892385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae356213-04dc-42ba-a68e-c9bc2e7fad93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:50.894377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae356213-04dc-42ba-a68e-c9bc2e7fad93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:50.896798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae356213-04dc-42ba-a68e-c9bc2e7fad93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:50.899712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae356213-04dc-42ba-a68e-c9bc2e7fad93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:50.901768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae356213-04dc-42ba-a68e-c9bc2e7fad93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:50.904200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae356213-04dc-42ba-a68e-c9bc2e7fad93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:51.417186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ae356213-04dc-42ba-a68e-c9bc2e7fad93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:51.465542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ae356213-04dc-42ba-a68e-c9bc2e7fad93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:51.469464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ae356213-04dc-42ba-a68e-c9bc2e7fad93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:51.478687 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ae356213-04dc-42ba-a68e-c9bc2e7fad93 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 0.665701 Sep 08 13:13:51.495509 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2545/4953] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:50 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:13:52.540081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ae650377-18ee-49e6-8c63-be850a674888 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:52.543010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ae650377-18ee-49e6-8c63-be850a674888 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:52.580836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae650377-18ee-49e6-8c63-be850a674888 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:52.582408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae650377-18ee-49e6-8c63-be850a674888 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:52.588706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae650377-18ee-49e6-8c63-be850a674888 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:52.592039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae650377-18ee-49e6-8c63-be850a674888 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:52.593648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae650377-18ee-49e6-8c63-be850a674888 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:52.594688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae650377-18ee-49e6-8c63-be850a674888 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:53.713036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ae650377-18ee-49e6-8c63-be850a674888 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:53.740846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ae650377-18ee-49e6-8c63-be850a674888 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:53.744087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ae650377-18ee-49e6-8c63-be850a674888 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:53.747117 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ae650377-18ee-49e6-8c63-be850a674888 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 1.217471 Sep 08 13:13:53.760818 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2409/4954] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:52 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:54.814548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-055789d2-e8d7-424c-9284-496d1174ebde tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:54.815289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-055789d2-e8d7-424c-9284-496d1174ebde tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:54.851940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-055789d2-e8d7-424c-9284-496d1174ebde tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:54.852568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-055789d2-e8d7-424c-9284-496d1174ebde tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:54.853023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-055789d2-e8d7-424c-9284-496d1174ebde tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:54.853769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-055789d2-e8d7-424c-9284-496d1174ebde tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:54.854240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-055789d2-e8d7-424c-9284-496d1174ebde tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:54.854684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-055789d2-e8d7-424c-9284-496d1174ebde tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:55.255484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-055789d2-e8d7-424c-9284-496d1174ebde tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:55.279710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-055789d2-e8d7-424c-9284-496d1174ebde tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:55.282497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-055789d2-e8d7-424c-9284-496d1174ebde tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:55.286693 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-055789d2-e8d7-424c-9284-496d1174ebde tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 0.475832 Sep 08 13:13:55.288617 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2546/4955] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:54 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:56.349595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b6d5362e-9d5b-4bfa-8d8a-57d28b7f9570 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:56.352760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b6d5362e-9d5b-4bfa-8d8a-57d28b7f9570 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:56.396620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=16 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:13:56.419161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b6d5362e-9d5b-4bfa-8d8a-57d28b7f9570 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:56.420566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b6d5362e-9d5b-4bfa-8d8a-57d28b7f9570 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:56.424569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b6d5362e-9d5b-4bfa-8d8a-57d28b7f9570 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:56.447924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b6d5362e-9d5b-4bfa-8d8a-57d28b7f9570 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:56.451983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b6d5362e-9d5b-4bfa-8d8a-57d28b7f9570 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:56.453362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b6d5362e-9d5b-4bfa-8d8a-57d28b7f9570 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:57.319797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b6d5362e-9d5b-4bfa-8d8a-57d28b7f9570 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:57.330795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b6d5362e-9d5b-4bfa-8d8a-57d28b7f9570 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:57.332380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b6d5362e-9d5b-4bfa-8d8a-57d28b7f9570 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:57.345916 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b6d5362e-9d5b-4bfa-8d8a-57d28b7f9570 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 1.003383 Sep 08 13:13:57.395302 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2410/4956] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:56 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:13:58.414476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-992c6968-24f1-4b25-9f37-79d99111cb6f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:13:58.415683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-992c6968-24f1-4b25-9f37-79d99111cb6f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:13:58.469431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-992c6968-24f1-4b25-9f37-79d99111cb6f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:58.483187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-992c6968-24f1-4b25-9f37-79d99111cb6f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:58.486948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-992c6968-24f1-4b25-9f37-79d99111cb6f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:58.492705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-992c6968-24f1-4b25-9f37-79d99111cb6f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:13:58.496064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-992c6968-24f1-4b25-9f37-79d99111cb6f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:13:58.497511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-992c6968-24f1-4b25-9f37-79d99111cb6f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:13:59.458764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-992c6968-24f1-4b25-9f37-79d99111cb6f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:59.512439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-992c6968-24f1-4b25-9f37-79d99111cb6f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:59.517746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-992c6968-24f1-4b25-9f37-79d99111cb6f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:13:59.524348 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-992c6968-24f1-4b25-9f37-79d99111cb6f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1740 microversion: 2.20 time: 1.123150 Sep 08 13:13:59.532428 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2547/4957] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:13:58 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1740 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:00.573350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a25e7996-7c4b-4b51-aa57-c3979c28cd19 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:00.578937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a25e7996-7c4b-4b51-aa57-c3979c28cd19 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:00.639408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a25e7996-7c4b-4b51-aa57-c3979c28cd19 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:00.640790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a25e7996-7c4b-4b51-aa57-c3979c28cd19 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:00.648278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a25e7996-7c4b-4b51-aa57-c3979c28cd19 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:00.650615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a25e7996-7c4b-4b51-aa57-c3979c28cd19 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:00.652718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a25e7996-7c4b-4b51-aa57-c3979c28cd19 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:00.654135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a25e7996-7c4b-4b51-aa57-c3979c28cd19 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:01.817716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a25e7996-7c4b-4b51-aa57-c3979c28cd19 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:01.860713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a25e7996-7c4b-4b51-aa57-c3979c28cd19 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:01.878447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a25e7996-7c4b-4b51-aa57-c3979c28cd19 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:01.884519 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a25e7996-7c4b-4b51-aa57-c3979c28cd19 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1722 microversion: 2.20 time: 1.322619 Sep 08 13:14:01.887858 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2411/4958] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:00 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1722 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:02.954900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3aba1590-cf3f-482b-bbd2-7f93c3e77a22 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:02.959360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3aba1590-cf3f-482b-bbd2-7f93c3e77a22 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:03.042177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3aba1590-cf3f-482b-bbd2-7f93c3e77a22 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:03.044531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3aba1590-cf3f-482b-bbd2-7f93c3e77a22 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:03.048432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3aba1590-cf3f-482b-bbd2-7f93c3e77a22 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:03.052860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3aba1590-cf3f-482b-bbd2-7f93c3e77a22 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:03.054181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3aba1590-cf3f-482b-bbd2-7f93c3e77a22 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:03.055322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3aba1590-cf3f-482b-bbd2-7f93c3e77a22 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:03.823859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-fb4ba063-d368-4e86-94ba-5409312e5f2b req-480ba28d-cab0-4e49-a0af-0dd69394abe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad0f9bb-3303-4bdc-a35e-102f0002fe77", "name": "network-vif-unplugged", "status": "completed", "tag": "1ea3ab52-16b6-4072-bb78-7320e9ba5e25"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:14:03.910169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fb4ba063-d368-4e86-94ba-5409312e5f2b req-480ba28d-cab0-4e49-a0af-0dd69394abe8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:03.915513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fb4ba063-d368-4e86-94ba-5409312e5f2b req-480ba28d-cab0-4e49-a0af-0dd69394abe8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:03.923691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fb4ba063-d368-4e86-94ba-5409312e5f2b req-480ba28d-cab0-4e49-a0af-0dd69394abe8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:03.932178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=42 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:14:03.956428 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-fb4ba063-d368-4e86-94ba-5409312e5f2b req-480ba28d-cab0-4e49-a0af-0dd69394abe8 service nova] Creating event network-vif-unplugged:1ea3ab52-16b6-4072-bb78-7320e9ba5e25 for instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 on n-h1-852084-10 Sep 08 13:14:03.980358 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-fb4ba063-d368-4e86-94ba-5409312e5f2b req-480ba28d-cab0-4e49-a0af-0dd69394abe8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.157487 Sep 08 13:14:03.985455 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2412/4959] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:14:04.027965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3aba1590-cf3f-482b-bbd2-7f93c3e77a22 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:04.094334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3aba1590-cf3f-482b-bbd2-7f93c3e77a22 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:04.103468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3aba1590-cf3f-482b-bbd2-7f93c3e77a22 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:04.108433 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3aba1590-cf3f-482b-bbd2-7f93c3e77a22 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1722 microversion: 2.20 time: 1.175287 Sep 08 13:14:04.139661 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2548/4960] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:02 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1722 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:05.155700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f5f2e58e-7fa5-4871-b824-5ca325f1a9b4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:05.157155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f5f2e58e-7fa5-4871-b824-5ca325f1a9b4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:05.213506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5f2e58e-7fa5-4871-b824-5ca325f1a9b4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:05.215019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5f2e58e-7fa5-4871-b824-5ca325f1a9b4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:05.215931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5f2e58e-7fa5-4871-b824-5ca325f1a9b4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:05.217293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5f2e58e-7fa5-4871-b824-5ca325f1a9b4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:05.218163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5f2e58e-7fa5-4871-b824-5ca325f1a9b4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:05.239294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5f2e58e-7fa5-4871-b824-5ca325f1a9b4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:06.295982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f5f2e58e-7fa5-4871-b824-5ca325f1a9b4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:06.336978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f5f2e58e-7fa5-4871-b824-5ca325f1a9b4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:06.351205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f5f2e58e-7fa5-4871-b824-5ca325f1a9b4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:06.365691 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f5f2e58e-7fa5-4871-b824-5ca325f1a9b4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1665 microversion: 2.20 time: 1.220525 Sep 08 13:14:06.375529 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2413/4961] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:05 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1665 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:06.425157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9c638137-3d83-4615-b83b-8ab43a477920 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e34ed2f-4229-4a99-9ad5-f56bb84e2f38"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:14:06.445550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9c638137-3d83-4615-b83b-8ab43a477920 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:06.489223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=14 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:14:06.498898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c638137-3d83-4615-b83b-8ab43a477920 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:06.504682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c638137-3d83-4615-b83b-8ab43a477920 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:06.508925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c638137-3d83-4615-b83b-8ab43a477920 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:06.516803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c638137-3d83-4615-b83b-8ab43a477920 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:06.522419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c638137-3d83-4615-b83b-8ab43a477920 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:06.524980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9c638137-3d83-4615-b83b-8ab43a477920 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:06.814875 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:14:06.819725 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 13:14:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/os-volume_attachments (ip 10.222.0.78) !!! Sep 08 13:14:07.700897 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9c638137-3d83-4615-b83b-8ab43a477920 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "POST /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.292706 Sep 08 13:14:07.704215 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2549/4962] 10.222.0.78 () {62 vars in 1364 bytes} [Thu Sep 8 13:14:06 2022] POST /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/os-volume_attachments => generated 188 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:14:08.168194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc559fd8-eb28-48a9-b843-a52e39d45754 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:08.172822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fc559fd8-eb28-48a9-b843-a52e39d45754 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:08.201034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc559fd8-eb28-48a9-b843-a52e39d45754 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:08.201861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc559fd8-eb28-48a9-b843-a52e39d45754 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:08.209264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc559fd8-eb28-48a9-b843-a52e39d45754 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:08.210883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc559fd8-eb28-48a9-b843-a52e39d45754 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:08.212736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc559fd8-eb28-48a9-b843-a52e39d45754 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:08.213835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc559fd8-eb28-48a9-b843-a52e39d45754 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:09.172884 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fc559fd8-eb28-48a9-b843-a52e39d45754 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/os-volume_attachments/1e34ed2f-4229-4a99-9ad5-f56bb84e2f38" status: 202 len: 0 microversion: 2.20 time: 1.012728 Sep 08 13:14:09.175654 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2414/4963] 10.222.0.78 () {60 vars in 1457 bytes} [Thu Sep 8 13:14:08 2022] DELETE /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/os-volume_attachments/1e34ed2f-4229-4a99-9ad5-f56bb84e2f38 => generated 0 bytes in 1017 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:14:09.348052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b36b52c-2b53-40b6-b9aa-daf2e58ed40c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:14:09.358220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7b36b52c-2b53-40b6-b9aa-daf2e58ed40c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:09.413184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b36b52c-2b53-40b6-b9aa-daf2e58ed40c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:09.416700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b36b52c-2b53-40b6-b9aa-daf2e58ed40c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:09.428393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b36b52c-2b53-40b6-b9aa-daf2e58ed40c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:09.430729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b36b52c-2b53-40b6-b9aa-daf2e58ed40c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:09.431546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b36b52c-2b53-40b6-b9aa-daf2e58ed40c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:09.432354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b36b52c-2b53-40b6-b9aa-daf2e58ed40c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:09.583912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7b36b52c-2b53-40b6-b9aa-daf2e58ed40c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128970) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 13:14:09.957523 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7b36b52c-2b53-40b6-b9aa-daf2e58ed40c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "POST /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/action" status: 202 len: 0 microversion: 2.20 time: 0.623816 Sep 08 13:14:09.958052 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2550/4964] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Sep 8 13:14:09 2022] POST /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:14:09.971290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d1a5b41d-bf85-4a1e-8fa3-2df689d54ec9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:09.979317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d1a5b41d-bf85-4a1e-8fa3-2df689d54ec9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:10.050880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1a5b41d-bf85-4a1e-8fa3-2df689d54ec9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:10.054635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1a5b41d-bf85-4a1e-8fa3-2df689d54ec9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:10.062000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1a5b41d-bf85-4a1e-8fa3-2df689d54ec9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:10.068588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1a5b41d-bf85-4a1e-8fa3-2df689d54ec9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:10.084694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1a5b41d-bf85-4a1e-8fa3-2df689d54ec9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:10.085893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1a5b41d-bf85-4a1e-8fa3-2df689d54ec9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:11.507085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d1a5b41d-bf85-4a1e-8fa3-2df689d54ec9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:11.680324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d1a5b41d-bf85-4a1e-8fa3-2df689d54ec9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:11.691947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d1a5b41d-bf85-4a1e-8fa3-2df689d54ec9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:11.713218 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d1a5b41d-bf85-4a1e-8fa3-2df689d54ec9 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1673 microversion: 2.20 time: 1.747644 Sep 08 13:14:11.713931 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2415/4965] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:09 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1673 bytes in 1752 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:12.751739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-add54612-16f6-478e-9b42-d7b73df8428c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:12.752505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-add54612-16f6-478e-9b42-d7b73df8428c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:12.769912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-add54612-16f6-478e-9b42-d7b73df8428c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:12.771773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-add54612-16f6-478e-9b42-d7b73df8428c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:12.778887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-add54612-16f6-478e-9b42-d7b73df8428c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:12.780491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-add54612-16f6-478e-9b42-d7b73df8428c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:12.781581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-add54612-16f6-478e-9b42-d7b73df8428c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:12.782498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-add54612-16f6-478e-9b42-d7b73df8428c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:12.801451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:14:13.501339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-add54612-16f6-478e-9b42-d7b73df8428c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:13.535057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-add54612-16f6-478e-9b42-d7b73df8428c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:13.538333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-add54612-16f6-478e-9b42-d7b73df8428c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:13.551664 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-add54612-16f6-478e-9b42-d7b73df8428c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1673 microversion: 2.20 time: 0.793828 Sep 08 13:14:13.553047 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2551/4966] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:12 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1673 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:14.619950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c3ce4a32-e085-46e2-9465-1f78f8d3d249 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:14.625759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c3ce4a32-e085-46e2-9465-1f78f8d3d249 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:14.655263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3ce4a32-e085-46e2-9465-1f78f8d3d249 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:14.656432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3ce4a32-e085-46e2-9465-1f78f8d3d249 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:14.657485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3ce4a32-e085-46e2-9465-1f78f8d3d249 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:14.659994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3ce4a32-e085-46e2-9465-1f78f8d3d249 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:14.661304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3ce4a32-e085-46e2-9465-1f78f8d3d249 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:14.662386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3ce4a32-e085-46e2-9465-1f78f8d3d249 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:15.978278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c3ce4a32-e085-46e2-9465-1f78f8d3d249 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:15.999924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c3ce4a32-e085-46e2-9465-1f78f8d3d249 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:16.009482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c3ce4a32-e085-46e2-9465-1f78f8d3d249 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:16.025170 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c3ce4a32-e085-46e2-9465-1f78f8d3d249 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1673 microversion: 2.20 time: 1.417213 Sep 08 13:14:16.030529 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2416/4967] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:14 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1673 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:17.078522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b864cd8b-a463-441c-82d3-7317b4e08ec5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:17.080350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b864cd8b-a463-441c-82d3-7317b4e08ec5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:17.111796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b864cd8b-a463-441c-82d3-7317b4e08ec5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:17.112824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b864cd8b-a463-441c-82d3-7317b4e08ec5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:17.113919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b864cd8b-a463-441c-82d3-7317b4e08ec5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:17.119720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b864cd8b-a463-441c-82d3-7317b4e08ec5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:17.122020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b864cd8b-a463-441c-82d3-7317b4e08ec5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:17.124316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b864cd8b-a463-441c-82d3-7317b4e08ec5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:17.821029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b864cd8b-a463-441c-82d3-7317b4e08ec5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:17.838048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b864cd8b-a463-441c-82d3-7317b4e08ec5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:17.842286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b864cd8b-a463-441c-82d3-7317b4e08ec5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:17.848938 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b864cd8b-a463-441c-82d3-7317b4e08ec5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1673 microversion: 2.20 time: 0.782629 Sep 08 13:14:17.849855 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2552/4968] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:17 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1673 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:18.890203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4b4d7ea9-a4d5-4e2b-a5a4-52c9bcbc73a3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:18.892701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4b4d7ea9-a4d5-4e2b-a5a4-52c9bcbc73a3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:18.906334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b4d7ea9-a4d5-4e2b-a5a4-52c9bcbc73a3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:18.907043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b4d7ea9-a4d5-4e2b-a5a4-52c9bcbc73a3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:18.907807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b4d7ea9-a4d5-4e2b-a5a4-52c9bcbc73a3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:18.908770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b4d7ea9-a4d5-4e2b-a5a4-52c9bcbc73a3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:18.920788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b4d7ea9-a4d5-4e2b-a5a4-52c9bcbc73a3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:18.922187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b4d7ea9-a4d5-4e2b-a5a4-52c9bcbc73a3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:19.647777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4b4d7ea9-a4d5-4e2b-a5a4-52c9bcbc73a3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:19.693099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4b4d7ea9-a4d5-4e2b-a5a4-52c9bcbc73a3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:19.696410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4b4d7ea9-a4d5-4e2b-a5a4-52c9bcbc73a3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:19.705468 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4b4d7ea9-a4d5-4e2b-a5a4-52c9bcbc73a3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 0.820367 Sep 08 13:14:19.706621 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2417/4969] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:18 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:14:20.760562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eb487d1d-d17e-48db-8a9a-f8c2190be7bd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:20.762036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eb487d1d-d17e-48db-8a9a-f8c2190be7bd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:20.799746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb487d1d-d17e-48db-8a9a-f8c2190be7bd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:20.801956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb487d1d-d17e-48db-8a9a-f8c2190be7bd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:20.803884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb487d1d-d17e-48db-8a9a-f8c2190be7bd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:20.808626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb487d1d-d17e-48db-8a9a-f8c2190be7bd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:20.813328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb487d1d-d17e-48db-8a9a-f8c2190be7bd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:20.823262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb487d1d-d17e-48db-8a9a-f8c2190be7bd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:21.801280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eb487d1d-d17e-48db-8a9a-f8c2190be7bd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:21.836845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eb487d1d-d17e-48db-8a9a-f8c2190be7bd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:21.840016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eb487d1d-d17e-48db-8a9a-f8c2190be7bd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:21.844016 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eb487d1d-d17e-48db-8a9a-f8c2190be7bd tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.086114 Sep 08 13:14:21.845235 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2553/4970] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:20 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:22.897499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d89309d0-741d-4dff-87fb-1fba7ed6b93f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:22.898556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d89309d0-741d-4dff-87fb-1fba7ed6b93f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:22.945308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d89309d0-741d-4dff-87fb-1fba7ed6b93f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:22.945830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d89309d0-741d-4dff-87fb-1fba7ed6b93f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:22.946288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d89309d0-741d-4dff-87fb-1fba7ed6b93f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:22.947045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d89309d0-741d-4dff-87fb-1fba7ed6b93f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:22.968046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d89309d0-741d-4dff-87fb-1fba7ed6b93f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:22.968840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d89309d0-741d-4dff-87fb-1fba7ed6b93f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:24.557249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d89309d0-741d-4dff-87fb-1fba7ed6b93f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:24.577646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d89309d0-741d-4dff-87fb-1fba7ed6b93f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:24.584182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d89309d0-741d-4dff-87fb-1fba7ed6b93f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:24.593376 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d89309d0-741d-4dff-87fb-1fba7ed6b93f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.703107 Sep 08 13:14:24.596913 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2418/4971] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:22 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:24.882432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-42771566-9d33-49db-9a03-deb271880228 req-4af95bbe-3418-4d2f-b239-26f148b93c1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bad0f9bb-3303-4bdc-a35e-102f0002fe77", "tag": "1ea3ab52-16b6-4072-bb78-7320e9ba5e25"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:14:24.932368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-42771566-9d33-49db-9a03-deb271880228 req-4af95bbe-3418-4d2f-b239-26f148b93c1b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:24.933425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-42771566-9d33-49db-9a03-deb271880228 req-4af95bbe-3418-4d2f-b239-26f148b93c1b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:24.934027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-42771566-9d33-49db-9a03-deb271880228 req-4af95bbe-3418-4d2f-b239-26f148b93c1b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:24.966065 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-42771566-9d33-49db-9a03-deb271880228 req-4af95bbe-3418-4d2f-b239-26f148b93c1b service nova] Creating event network-changed:1ea3ab52-16b6-4072-bb78-7320e9ba5e25 for instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 on n-h2-852084-10 Sep 08 13:14:24.994305 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-42771566-9d33-49db-9a03-deb271880228 req-4af95bbe-3418-4d2f-b239-26f148b93c1b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111508 Sep 08 13:14:24.994305 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2554/4972] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:14:25.646086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-11b7d793-7ca6-4022-83a3-75b5663810af tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:25.647721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-11b7d793-7ca6-4022-83a3-75b5663810af tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:25.667643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-11b7d793-7ca6-4022-83a3-75b5663810af tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:25.668518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-11b7d793-7ca6-4022-83a3-75b5663810af tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:25.670131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-11b7d793-7ca6-4022-83a3-75b5663810af tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:25.672276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-11b7d793-7ca6-4022-83a3-75b5663810af tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:25.673193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-11b7d793-7ca6-4022-83a3-75b5663810af tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:25.676083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-11b7d793-7ca6-4022-83a3-75b5663810af tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:26.877112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-11b7d793-7ca6-4022-83a3-75b5663810af tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:26.918299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-11b7d793-7ca6-4022-83a3-75b5663810af tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:26.927997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-11b7d793-7ca6-4022-83a3-75b5663810af tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:26.932440 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-11b7d793-7ca6-4022-83a3-75b5663810af tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.290788 Sep 08 13:14:26.937746 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2419/4973] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:25 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:14:27.993640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e91cf74f-7878-45f1-9b2d-2c1a23e51faa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:27.994965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e91cf74f-7878-45f1-9b2d-2c1a23e51faa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:28.039005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e91cf74f-7878-45f1-9b2d-2c1a23e51faa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:28.040039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e91cf74f-7878-45f1-9b2d-2c1a23e51faa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:28.040874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e91cf74f-7878-45f1-9b2d-2c1a23e51faa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:28.056491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e91cf74f-7878-45f1-9b2d-2c1a23e51faa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:28.057327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e91cf74f-7878-45f1-9b2d-2c1a23e51faa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:28.067127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e91cf74f-7878-45f1-9b2d-2c1a23e51faa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:29.162479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e91cf74f-7878-45f1-9b2d-2c1a23e51faa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:29.190060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e91cf74f-7878-45f1-9b2d-2c1a23e51faa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:29.207960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e91cf74f-7878-45f1-9b2d-2c1a23e51faa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:29.216811 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e91cf74f-7878-45f1-9b2d-2c1a23e51faa tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.240529 Sep 08 13:14:29.218425 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2555/4974] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:27 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:14:30.271996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9aadfb86-9755-4c63-9bc2-d20fb41e706e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:30.273187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9aadfb86-9755-4c63-9bc2-d20fb41e706e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:30.291911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=20 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:14:30.315662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aadfb86-9755-4c63-9bc2-d20fb41e706e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:30.319436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aadfb86-9755-4c63-9bc2-d20fb41e706e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:30.327406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aadfb86-9755-4c63-9bc2-d20fb41e706e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:30.329543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aadfb86-9755-4c63-9bc2-d20fb41e706e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:30.330650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aadfb86-9755-4c63-9bc2-d20fb41e706e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:30.331744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aadfb86-9755-4c63-9bc2-d20fb41e706e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:31.099127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9aadfb86-9755-4c63-9bc2-d20fb41e706e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:31.147475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9aadfb86-9755-4c63-9bc2-d20fb41e706e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:31.155827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9aadfb86-9755-4c63-9bc2-d20fb41e706e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:31.163165 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9aadfb86-9755-4c63-9bc2-d20fb41e706e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 0.896816 Sep 08 13:14:31.168116 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2420/4975] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:30 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:32.210220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f8454f1-44f0-46be-a071-a984b926082c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:32.217716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f8454f1-44f0-46be-a071-a984b926082c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:32.233030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8454f1-44f0-46be-a071-a984b926082c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:32.233525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8454f1-44f0-46be-a071-a984b926082c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:32.233972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8454f1-44f0-46be-a071-a984b926082c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:32.234707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8454f1-44f0-46be-a071-a984b926082c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:32.237194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8454f1-44f0-46be-a071-a984b926082c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:32.240559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8454f1-44f0-46be-a071-a984b926082c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:34.177643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f8454f1-44f0-46be-a071-a984b926082c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:34.224253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f8454f1-44f0-46be-a071-a984b926082c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:34.231832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f8454f1-44f0-46be-a071-a984b926082c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:34.234186 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f8454f1-44f0-46be-a071-a984b926082c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 2.033937 Sep 08 13:14:34.238317 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2556/4976] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:32 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 2040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:35.269628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a97320ef-93a7-4df0-8a72-8d1af9a3afe5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:35.270458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a97320ef-93a7-4df0-8a72-8d1af9a3afe5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:35.309279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a97320ef-93a7-4df0-8a72-8d1af9a3afe5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:35.309836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a97320ef-93a7-4df0-8a72-8d1af9a3afe5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:35.323689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a97320ef-93a7-4df0-8a72-8d1af9a3afe5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:35.328942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a97320ef-93a7-4df0-8a72-8d1af9a3afe5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:35.332183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a97320ef-93a7-4df0-8a72-8d1af9a3afe5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:35.344561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a97320ef-93a7-4df0-8a72-8d1af9a3afe5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:35.477733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:14:36.438186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a97320ef-93a7-4df0-8a72-8d1af9a3afe5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:36.460078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a97320ef-93a7-4df0-8a72-8d1af9a3afe5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:36.469533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a97320ef-93a7-4df0-8a72-8d1af9a3afe5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:36.476478 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a97320ef-93a7-4df0-8a72-8d1af9a3afe5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.211790 Sep 08 13:14:36.511955 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2421/4977] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:35 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:37.524177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cd1635ca-8bca-4e72-a5a5-1cdd6600b15f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:37.527963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cd1635ca-8bca-4e72-a5a5-1cdd6600b15f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:37.579772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:14:37.583495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd1635ca-8bca-4e72-a5a5-1cdd6600b15f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:37.592618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd1635ca-8bca-4e72-a5a5-1cdd6600b15f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:37.593268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd1635ca-8bca-4e72-a5a5-1cdd6600b15f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:37.594315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd1635ca-8bca-4e72-a5a5-1cdd6600b15f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:37.599388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd1635ca-8bca-4e72-a5a5-1cdd6600b15f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:37.602981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd1635ca-8bca-4e72-a5a5-1cdd6600b15f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:38.725508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cd1635ca-8bca-4e72-a5a5-1cdd6600b15f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:38.786336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cd1635ca-8bca-4e72-a5a5-1cdd6600b15f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:38.794331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cd1635ca-8bca-4e72-a5a5-1cdd6600b15f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:38.801809 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cd1635ca-8bca-4e72-a5a5-1cdd6600b15f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.281755 Sep 08 13:14:38.804392 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2557/4978] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:37 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:39.843000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2c06e564-5c46-408f-8b24-0840467182f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:39.845086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2c06e564-5c46-408f-8b24-0840467182f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:39.891401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c06e564-5c46-408f-8b24-0840467182f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:39.892151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c06e564-5c46-408f-8b24-0840467182f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:39.892947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c06e564-5c46-408f-8b24-0840467182f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:39.894199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c06e564-5c46-408f-8b24-0840467182f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:39.895026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c06e564-5c46-408f-8b24-0840467182f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:39.911987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c06e564-5c46-408f-8b24-0840467182f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:41.439003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c06e564-5c46-408f-8b24-0840467182f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:41.516289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c06e564-5c46-408f-8b24-0840467182f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:41.527569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c06e564-5c46-408f-8b24-0840467182f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:41.552970 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2c06e564-5c46-408f-8b24-0840467182f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.716916 Sep 08 13:14:41.556314 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2422/4979] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:39 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:14:42.610339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be6103a7-6508-45c4-951a-bad127c415f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:42.616692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-be6103a7-6508-45c4-951a-bad127c415f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:42.644954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be6103a7-6508-45c4-951a-bad127c415f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:42.645835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be6103a7-6508-45c4-951a-bad127c415f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:42.651642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be6103a7-6508-45c4-951a-bad127c415f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:42.653172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be6103a7-6508-45c4-951a-bad127c415f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:42.657301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be6103a7-6508-45c4-951a-bad127c415f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:42.659855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be6103a7-6508-45c4-951a-bad127c415f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:43.225002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-be6103a7-6508-45c4-951a-bad127c415f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:43.236676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=42 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:14:43.251997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-be6103a7-6508-45c4-951a-bad127c415f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:43.276044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-be6103a7-6508-45c4-951a-bad127c415f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:43.290509 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-be6103a7-6508-45c4-951a-bad127c415f1 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 0.687440 Sep 08 13:14:43.294131 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2558/4980] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:42 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:44.344918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5ddf20c6-bf4b-460a-ba99-a6681acf537d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:44.345545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5ddf20c6-bf4b-460a-ba99-a6681acf537d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:44.374838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ddf20c6-bf4b-460a-ba99-a6681acf537d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:44.375809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ddf20c6-bf4b-460a-ba99-a6681acf537d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:44.376472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ddf20c6-bf4b-460a-ba99-a6681acf537d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:44.381437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ddf20c6-bf4b-460a-ba99-a6681acf537d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:44.386840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ddf20c6-bf4b-460a-ba99-a6681acf537d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:44.392258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ddf20c6-bf4b-460a-ba99-a6681acf537d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:45.459683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5ddf20c6-bf4b-460a-ba99-a6681acf537d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:45.544822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5ddf20c6-bf4b-460a-ba99-a6681acf537d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:45.565333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5ddf20c6-bf4b-460a-ba99-a6681acf537d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:45.575330 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5ddf20c6-bf4b-460a-ba99-a6681acf537d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.236628 Sep 08 13:14:45.603374 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2423/4981] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:44 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:46.663974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d939422e-57e5-4844-a135-6046470c65f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:46.685079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d939422e-57e5-4844-a135-6046470c65f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:46.739393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d939422e-57e5-4844-a135-6046470c65f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:46.746410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d939422e-57e5-4844-a135-6046470c65f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:46.756424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d939422e-57e5-4844-a135-6046470c65f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:46.764252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d939422e-57e5-4844-a135-6046470c65f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:46.765685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d939422e-57e5-4844-a135-6046470c65f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:46.772823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d939422e-57e5-4844-a135-6046470c65f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:47.763659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d939422e-57e5-4844-a135-6046470c65f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:47.831778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d939422e-57e5-4844-a135-6046470c65f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:47.842077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d939422e-57e5-4844-a135-6046470c65f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:47.844900 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d939422e-57e5-4844-a135-6046470c65f7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.189731 Sep 08 13:14:47.864618 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2559/4982] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:46 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:48.902626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c434120a-8390-45cf-b203-0a4fddd10868 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:48.904493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c434120a-8390-45cf-b203-0a4fddd10868 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:48.934283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c434120a-8390-45cf-b203-0a4fddd10868 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:48.934805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c434120a-8390-45cf-b203-0a4fddd10868 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:48.939737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c434120a-8390-45cf-b203-0a4fddd10868 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:48.944366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c434120a-8390-45cf-b203-0a4fddd10868 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:48.945117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c434120a-8390-45cf-b203-0a4fddd10868 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:48.945682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c434120a-8390-45cf-b203-0a4fddd10868 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:49.690711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-986332387", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "616144fc-8efe-40a3-9bb6-db51f979797f"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:14:49.889502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] validate_networks() for [('616144fc-8efe-40a3-9bb6-db51f979797f', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:14:50.347144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c434120a-8390-45cf-b203-0a4fddd10868 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:50.453241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c434120a-8390-45cf-b203-0a4fddd10868 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:50.474409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c434120a-8390-45cf-b203-0a4fddd10868 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:50.490723 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c434120a-8390-45cf-b203-0a4fddd10868 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.593197 Sep 08 13:14:50.506302 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2424/4983] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:48 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:14:51.249024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:14:51.249748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:14:51.250721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:14:51.264160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:14:51.265049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:14:51.316724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:51.317607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:51.318409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:51.328933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:51.330636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:51.334763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:51.386697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Getting quotas for project 07d9ade398aa4cf396bb58268cf3e25e. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:14:51.399148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Getting quotas for user cf24e2de28614ec3b3367c15208c333d and project 07d9ade398aa4cf396bb58268cf3e25e. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:14:51.425733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:14:51.430226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:14:51.535390 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a6802d5c-c835-4012-a3a4-97365cf675e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.858677 Sep 08 13:14:51.539491 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2560/4984] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:14:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:14:51.543076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-561f2775-ab16-4104-8284-deef05f33f6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:51.543905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-561f2775-ab16-4104-8284-deef05f33f6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:51.553320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-58bae838-208e-4090-98bf-2e79e3d666c5 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:51.554408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58bae838-208e-4090-98bf-2e79e3d666c5 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:51.558900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-561f2775-ab16-4104-8284-deef05f33f6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:51.559436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-561f2775-ab16-4104-8284-deef05f33f6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:51.562148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-561f2775-ab16-4104-8284-deef05f33f6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:51.569967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-561f2775-ab16-4104-8284-deef05f33f6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:51.574573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-561f2775-ab16-4104-8284-deef05f33f6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:51.575302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-561f2775-ab16-4104-8284-deef05f33f6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:51.839700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-58bae838-208e-4090-98bf-2e79e3d666c5 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:51.867472 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-58bae838-208e-4090-98bf-2e79e3d666c5 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1213 microversion: 2.1 time: 0.321490 Sep 08 13:14:51.904993 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2561/4985] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:14:51 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1213 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:14:51.982255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-561f2775-ab16-4104-8284-deef05f33f6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:52.040088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-561f2775-ab16-4104-8284-deef05f33f6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:52.043897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-561f2775-ab16-4104-8284-deef05f33f6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:52.058295 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-561f2775-ab16-4104-8284-deef05f33f6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 0.507204 Sep 08 13:14:52.069681 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2425/4986] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:51 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:52.920688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7224b7d8-59ae-4461-8f5d-4937913e72f0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:52.923857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7224b7d8-59ae-4461-8f5d-4937913e72f0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:52.938668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7224b7d8-59ae-4461-8f5d-4937913e72f0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:52.940607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7224b7d8-59ae-4461-8f5d-4937913e72f0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:52.941772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7224b7d8-59ae-4461-8f5d-4937913e72f0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:52.943977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7224b7d8-59ae-4461-8f5d-4937913e72f0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:52.945299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7224b7d8-59ae-4461-8f5d-4937913e72f0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:52.946449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7224b7d8-59ae-4461-8f5d-4937913e72f0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:53.120450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5466b8ec-a81d-4ccb-92f1-b211f30261e5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:53.125434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5466b8ec-a81d-4ccb-92f1-b211f30261e5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:53.165684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5466b8ec-a81d-4ccb-92f1-b211f30261e5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:53.167039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5466b8ec-a81d-4ccb-92f1-b211f30261e5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:53.170271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5466b8ec-a81d-4ccb-92f1-b211f30261e5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:53.174217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5466b8ec-a81d-4ccb-92f1-b211f30261e5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:53.179372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5466b8ec-a81d-4ccb-92f1-b211f30261e5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:53.185677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5466b8ec-a81d-4ccb-92f1-b211f30261e5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:53.298441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7224b7d8-59ae-4461-8f5d-4937913e72f0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:53.334145 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7224b7d8-59ae-4461-8f5d-4937913e72f0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1209 microversion: 2.1 time: 0.421401 Sep 08 13:14:53.335200 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2562/4987] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:14:52 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1209 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:14:54.221583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5466b8ec-a81d-4ccb-92f1-b211f30261e5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:54.277814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5466b8ec-a81d-4ccb-92f1-b211f30261e5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:54.290044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5466b8ec-a81d-4ccb-92f1-b211f30261e5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:54.291639 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5466b8ec-a81d-4ccb-92f1-b211f30261e5 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.184573 Sep 08 13:14:54.293777 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2426/4988] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:53 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:54.364585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-78826d3c-4dc3-4222-8d8b-ee74da68dc3e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:54.366446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-78826d3c-4dc3-4222-8d8b-ee74da68dc3e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:54.381216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78826d3c-4dc3-4222-8d8b-ee74da68dc3e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:54.382294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78826d3c-4dc3-4222-8d8b-ee74da68dc3e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:54.382956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78826d3c-4dc3-4222-8d8b-ee74da68dc3e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:54.389187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78826d3c-4dc3-4222-8d8b-ee74da68dc3e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:54.389943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78826d3c-4dc3-4222-8d8b-ee74da68dc3e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:54.390546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78826d3c-4dc3-4222-8d8b-ee74da68dc3e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:54.632727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-78826d3c-4dc3-4222-8d8b-ee74da68dc3e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:54.647403 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-78826d3c-4dc3-4222-8d8b-ee74da68dc3e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1271 microversion: 2.1 time: 0.286335 Sep 08 13:14:54.650520 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2563/4989] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:14:54 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1271 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:14:55.333453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c343d4a4-cbd4-47c6-9bbc-569595d2a563 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:55.334292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c343d4a4-cbd4-47c6-9bbc-569595d2a563 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:55.352660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c343d4a4-cbd4-47c6-9bbc-569595d2a563 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:55.353570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c343d4a4-cbd4-47c6-9bbc-569595d2a563 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:55.354229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c343d4a4-cbd4-47c6-9bbc-569595d2a563 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:55.355187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c343d4a4-cbd4-47c6-9bbc-569595d2a563 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:55.365390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c343d4a4-cbd4-47c6-9bbc-569595d2a563 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:55.366253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c343d4a4-cbd4-47c6-9bbc-569595d2a563 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:55.694513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd78f5aa-5fd9-42ff-919f-5692543fa895 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:55.695933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dd78f5aa-5fd9-42ff-919f-5692543fa895 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:55.716725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd78f5aa-5fd9-42ff-919f-5692543fa895 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:55.721224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd78f5aa-5fd9-42ff-919f-5692543fa895 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:55.725208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd78f5aa-5fd9-42ff-919f-5692543fa895 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:55.728738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd78f5aa-5fd9-42ff-919f-5692543fa895 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:55.734200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd78f5aa-5fd9-42ff-919f-5692543fa895 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:55.738304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd78f5aa-5fd9-42ff-919f-5692543fa895 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:56.243962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dd78f5aa-5fd9-42ff-919f-5692543fa895 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:56.275130 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dd78f5aa-5fd9-42ff-919f-5692543fa895 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1271 microversion: 2.1 time: 0.588320 Sep 08 13:14:56.279346 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2564/4990] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:14:55 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1271 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:14:56.383033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c343d4a4-cbd4-47c6-9bbc-569595d2a563 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:56.402970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c343d4a4-cbd4-47c6-9bbc-569595d2a563 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:56.407016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c343d4a4-cbd4-47c6-9bbc-569595d2a563 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:56.410689 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c343d4a4-cbd4-47c6-9bbc-569595d2a563 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.081765 Sep 08 13:14:56.413790 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2427/4991] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:55 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:14:57.327442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44e98908-9b88-4956-8bd6-7546af4c62f4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:57.332373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-44e98908-9b88-4956-8bd6-7546af4c62f4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:57.379293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44e98908-9b88-4956-8bd6-7546af4c62f4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:57.385764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44e98908-9b88-4956-8bd6-7546af4c62f4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:57.388383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44e98908-9b88-4956-8bd6-7546af4c62f4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:57.389996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44e98908-9b88-4956-8bd6-7546af4c62f4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:57.396447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44e98908-9b88-4956-8bd6-7546af4c62f4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:57.397949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44e98908-9b88-4956-8bd6-7546af4c62f4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:57.476926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-88b401dc-cd23-4506-9b50-8d4c31f70b2b req-28a0518d-04c1-431c-bec3-1bf70110b789 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad0f9bb-3303-4bdc-a35e-102f0002fe77", "name": "network-vif-plugged", "status": "completed", "tag": "1ea3ab52-16b6-4072-bb78-7320e9ba5e25"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:14:57.534466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-88b401dc-cd23-4506-9b50-8d4c31f70b2b req-28a0518d-04c1-431c-bec3-1bf70110b789 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:57.542998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-88b401dc-cd23-4506-9b50-8d4c31f70b2b req-28a0518d-04c1-431c-bec3-1bf70110b789 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:57.544549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-88b401dc-cd23-4506-9b50-8d4c31f70b2b req-28a0518d-04c1-431c-bec3-1bf70110b789 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:57.611602 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-88b401dc-cd23-4506-9b50-8d4c31f70b2b req-28a0518d-04c1-431c-bec3-1bf70110b789 service nova] Creating event network-vif-plugged:1ea3ab52-16b6-4072-bb78-7320e9ba5e25 for instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 on n-h2-852084-10 Sep 08 13:14:57.640786 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-88b401dc-cd23-4506-9b50-8d4c31f70b2b req-28a0518d-04c1-431c-bec3-1bf70110b789 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.639051 Sep 08 13:14:57.648540 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2565/4992] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:14:57.729939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cd1ec542-3277-4d5a-a86d-9c8474761f13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:57.742918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cd1ec542-3277-4d5a-a86d-9c8474761f13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:57.792798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd1ec542-3277-4d5a-a86d-9c8474761f13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:57.795290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd1ec542-3277-4d5a-a86d-9c8474761f13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:57.796373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd1ec542-3277-4d5a-a86d-9c8474761f13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:57.806003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd1ec542-3277-4d5a-a86d-9c8474761f13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:57.810994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd1ec542-3277-4d5a-a86d-9c8474761f13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:57.811722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-44e98908-9b88-4956-8bd6-7546af4c62f4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:57.811911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cd1ec542-3277-4d5a-a86d-9c8474761f13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:57.875278 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-44e98908-9b88-4956-8bd6-7546af4c62f4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1271 microversion: 2.1 time: 0.556859 Sep 08 13:14:57.875928 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2428/4993] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:14:57 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1271 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:14:58.932507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ac02feaf-d76d-4c08-81c3-a1ed4dbcddd8 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:14:58.933990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cd1ec542-3277-4d5a-a86d-9c8474761f13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:58.941292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ac02feaf-d76d-4c08-81c3-a1ed4dbcddd8 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:14:58.984732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac02feaf-d76d-4c08-81c3-a1ed4dbcddd8 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:58.988145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cd1ec542-3277-4d5a-a86d-9c8474761f13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:58.989709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac02feaf-d76d-4c08-81c3-a1ed4dbcddd8 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:58.991171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cd1ec542-3277-4d5a-a86d-9c8474761f13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:14:58.993317 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cd1ec542-3277-4d5a-a86d-9c8474761f13 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 1.337844 Sep 08 13:14:58.994147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac02feaf-d76d-4c08-81c3-a1ed4dbcddd8 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:59.000332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac02feaf-d76d-4c08-81c3-a1ed4dbcddd8 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:14:59.001985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac02feaf-d76d-4c08-81c3-a1ed4dbcddd8 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:14:59.006704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac02feaf-d76d-4c08-81c3-a1ed4dbcddd8 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:14:59.019577 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2566/4994] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:14:57 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:14:59.970473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ac02feaf-d76d-4c08-81c3-a1ed4dbcddd8 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:00.004977 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ac02feaf-d76d-4c08-81c3-a1ed4dbcddd8 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1313 microversion: 2.1 time: 1.081093 Sep 08 13:15:00.008057 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2429/4995] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:14:58 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1313 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:00.048374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-edce76a9-e1cc-460f-9bc4-fc007d280a5c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:00.049503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-edce76a9-e1cc-460f-9bc4-fc007d280a5c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:00.086900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edce76a9-e1cc-460f-9bc4-fc007d280a5c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:00.092541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edce76a9-e1cc-460f-9bc4-fc007d280a5c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:00.096131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edce76a9-e1cc-460f-9bc4-fc007d280a5c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:00.101160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edce76a9-e1cc-460f-9bc4-fc007d280a5c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:00.105094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edce76a9-e1cc-460f-9bc4-fc007d280a5c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:00.108529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edce76a9-e1cc-460f-9bc4-fc007d280a5c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:00.993033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-edce76a9-e1cc-460f-9bc4-fc007d280a5c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:01.029275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-edce76a9-e1cc-460f-9bc4-fc007d280a5c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:01.032014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-edce76a9-e1cc-460f-9bc4-fc007d280a5c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:01.033784 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-edce76a9-e1cc-460f-9bc4-fc007d280a5c tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 0.992954 Sep 08 13:15:01.036411 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2567/4996] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:15:00 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:15:01.042650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b444a5d7-9ea7-4b34-8396-78363def6ebb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:01.046296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b444a5d7-9ea7-4b34-8396-78363def6ebb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:01.066309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=20 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:01.074749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b444a5d7-9ea7-4b34-8396-78363def6ebb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:01.075924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b444a5d7-9ea7-4b34-8396-78363def6ebb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:01.077721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b444a5d7-9ea7-4b34-8396-78363def6ebb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:01.080562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b444a5d7-9ea7-4b34-8396-78363def6ebb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:01.081325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b444a5d7-9ea7-4b34-8396-78363def6ebb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:01.082954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b444a5d7-9ea7-4b34-8396-78363def6ebb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:02.087273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4d7654ec-9e87-4d74-90c7-ad5b05ada80a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:02.089396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4d7654ec-9e87-4d74-90c7-ad5b05ada80a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:02.113769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:02.115707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:02.123511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d7654ec-9e87-4d74-90c7-ad5b05ada80a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:02.124300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d7654ec-9e87-4d74-90c7-ad5b05ada80a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:02.125091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d7654ec-9e87-4d74-90c7-ad5b05ada80a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:02.126138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d7654ec-9e87-4d74-90c7-ad5b05ada80a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:02.127909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d7654ec-9e87-4d74-90c7-ad5b05ada80a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:02.129575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d7654ec-9e87-4d74-90c7-ad5b05ada80a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:02.399197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b444a5d7-9ea7-4b34-8396-78363def6ebb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:02.450237 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b444a5d7-9ea7-4b34-8396-78363def6ebb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1313 microversion: 2.1 time: 1.416492 Sep 08 13:15:02.455288 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2430/4997] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:01 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1313 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:03.015137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4d7654ec-9e87-4d74-90c7-ad5b05ada80a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:03.043301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4d7654ec-9e87-4d74-90c7-ad5b05ada80a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:03.055372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4d7654ec-9e87-4d74-90c7-ad5b05ada80a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:03.070634 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4d7654ec-9e87-4d74-90c7-ad5b05ada80a tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1731 microversion: 2.20 time: 0.991052 Sep 08 13:15:03.083277 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2568/4998] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:15:02 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1731 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:15:03.497835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d288903-e681-48cd-8130-0ebfb1f380da tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:03.498639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1d288903-e681-48cd-8130-0ebfb1f380da tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:03.509734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d288903-e681-48cd-8130-0ebfb1f380da tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:03.511207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d288903-e681-48cd-8130-0ebfb1f380da tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:03.511767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d288903-e681-48cd-8130-0ebfb1f380da tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:03.512615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d288903-e681-48cd-8130-0ebfb1f380da tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:03.513175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d288903-e681-48cd-8130-0ebfb1f380da tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:03.513733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d288903-e681-48cd-8130-0ebfb1f380da tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:04.114987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60fe8052-f67f-4c4f-b1a4-aab71876b532 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:04.119291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-60fe8052-f67f-4c4f-b1a4-aab71876b532 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:04.123989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1d288903-e681-48cd-8130-0ebfb1f380da tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:04.140855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60fe8052-f67f-4c4f-b1a4-aab71876b532 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:04.143926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60fe8052-f67f-4c4f-b1a4-aab71876b532 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:04.145974 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1d288903-e681-48cd-8130-0ebfb1f380da tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1313 microversion: 2.1 time: 0.654488 Sep 08 13:15:04.148884 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2431/4999] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:03 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1313 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:15:04.150192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60fe8052-f67f-4c4f-b1a4-aab71876b532 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:04.152630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60fe8052-f67f-4c4f-b1a4-aab71876b532 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:04.156945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60fe8052-f67f-4c4f-b1a4-aab71876b532 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:04.158350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60fe8052-f67f-4c4f-b1a4-aab71876b532 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:04.927050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-315c9ba9-50f4-4f4b-a4fa-c7a823475503 req-2285a4d1-5f4c-4a14-aac5-ca7e54350e17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba0fb1c-26ca-46ea-aeca-e89070379463", "tag": "d5776e1e-148d-42d6-9a15-dfcee6086a34"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:15:04.977130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-315c9ba9-50f4-4f4b-a4fa-c7a823475503 req-2285a4d1-5f4c-4a14-aac5-ca7e54350e17 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:04.977733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-315c9ba9-50f4-4f4b-a4fa-c7a823475503 req-2285a4d1-5f4c-4a14-aac5-ca7e54350e17 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:04.977948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-60fe8052-f67f-4c4f-b1a4-aab71876b532 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:04.978278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-315c9ba9-50f4-4f4b-a4fa-c7a823475503 req-2285a4d1-5f4c-4a14-aac5-ca7e54350e17 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:05.006743 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-315c9ba9-50f4-4f4b-a4fa-c7a823475503 req-2285a4d1-5f4c-4a14-aac5-ca7e54350e17 service nova] Creating event network-changed:d5776e1e-148d-42d6-9a15-dfcee6086a34 for instance 5ba0fb1c-26ca-46ea-aeca-e89070379463 on n-h2-852084-10 Sep 08 13:15:05.011720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-60fe8052-f67f-4c4f-b1a4-aab71876b532 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:05.015009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-60fe8052-f67f-4c4f-b1a4-aab71876b532 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:05.021275 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-315c9ba9-50f4-4f4b-a4fa-c7a823475503 req-2285a4d1-5f4c-4a14-aac5-ca7e54350e17 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.667515 Sep 08 13:15:05.022337 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2432/5000] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:15:05.028721 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-60fe8052-f67f-4c4f-b1a4-aab71876b532 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1718 microversion: 2.20 time: 0.933263 Sep 08 13:15:05.035883 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2569/5001] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:15:04 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1718 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:15:05.179859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36caf424-9600-4c5f-9b49-31a46fde8d02 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:05.181303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-36caf424-9600-4c5f-9b49-31a46fde8d02 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:05.190799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36caf424-9600-4c5f-9b49-31a46fde8d02 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:05.192217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36caf424-9600-4c5f-9b49-31a46fde8d02 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:05.192895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36caf424-9600-4c5f-9b49-31a46fde8d02 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:05.194406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36caf424-9600-4c5f-9b49-31a46fde8d02 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:05.195536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36caf424-9600-4c5f-9b49-31a46fde8d02 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:05.196387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36caf424-9600-4c5f-9b49-31a46fde8d02 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:05.922717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-36caf424-9600-4c5f-9b49-31a46fde8d02 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:05.927912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=72 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:05.956942 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36caf424-9600-4c5f-9b49-31a46fde8d02 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1313 microversion: 2.1 time: 0.780907 Sep 08 13:15:06.026873 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2433/5002] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:05 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1313 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:07.060937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-056e05dd-ed25-4300-855b-60e18a0cb5b1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:07.065092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-056e05dd-ed25-4300-855b-60e18a0cb5b1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:07.140120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-056e05dd-ed25-4300-855b-60e18a0cb5b1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:07.145141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-056e05dd-ed25-4300-855b-60e18a0cb5b1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:07.154752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-056e05dd-ed25-4300-855b-60e18a0cb5b1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:07.159448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-056e05dd-ed25-4300-855b-60e18a0cb5b1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:07.168983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-056e05dd-ed25-4300-855b-60e18a0cb5b1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:07.177914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-056e05dd-ed25-4300-855b-60e18a0cb5b1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:08.107111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-056e05dd-ed25-4300-855b-60e18a0cb5b1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:08.132426 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-056e05dd-ed25-4300-855b-60e18a0cb5b1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1313 microversion: 2.1 time: 1.099046 Sep 08 13:15:08.141266 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2570/5003] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:07 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1313 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:09.166819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-97c43d02-da5f-4c36-8b99-21839b1f2b39 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:09.168150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-97c43d02-da5f-4c36-8b99-21839b1f2b39 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:09.203525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97c43d02-da5f-4c36-8b99-21839b1f2b39 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:09.212019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97c43d02-da5f-4c36-8b99-21839b1f2b39 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:09.215200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97c43d02-da5f-4c36-8b99-21839b1f2b39 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:09.220026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97c43d02-da5f-4c36-8b99-21839b1f2b39 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:09.221356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97c43d02-da5f-4c36-8b99-21839b1f2b39 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:09.226775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97c43d02-da5f-4c36-8b99-21839b1f2b39 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:09.709797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-97c43d02-da5f-4c36-8b99-21839b1f2b39 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:09.726965 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-97c43d02-da5f-4c36-8b99-21839b1f2b39 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1313 microversion: 2.1 time: 0.564794 Sep 08 13:15:09.751428 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2434/5004] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:09 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:10.762049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6fdaae37-48e7-4990-9975-383f2b023375 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:10.763491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6fdaae37-48e7-4990-9975-383f2b023375 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:10.783321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:10.819256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6fdaae37-48e7-4990-9975-383f2b023375 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:10.820059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6fdaae37-48e7-4990-9975-383f2b023375 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:10.823462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6fdaae37-48e7-4990-9975-383f2b023375 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:10.829305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6fdaae37-48e7-4990-9975-383f2b023375 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:10.840138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6fdaae37-48e7-4990-9975-383f2b023375 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:10.841710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6fdaae37-48e7-4990-9975-383f2b023375 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:11.702974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6fdaae37-48e7-4990-9975-383f2b023375 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:11.720517 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6fdaae37-48e7-4990-9975-383f2b023375 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1313 microversion: 2.1 time: 0.965503 Sep 08 13:15:11.722389 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2571/5005] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:10 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1313 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:12.752469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ccb77832-e9f5-42fd-bd28-d9a3f7ce2463 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:12.753590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ccb77832-e9f5-42fd-bd28-d9a3f7ce2463 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:12.793295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccb77832-e9f5-42fd-bd28-d9a3f7ce2463 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:12.794359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccb77832-e9f5-42fd-bd28-d9a3f7ce2463 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:12.804139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccb77832-e9f5-42fd-bd28-d9a3f7ce2463 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:12.805407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccb77832-e9f5-42fd-bd28-d9a3f7ce2463 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:12.806236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccb77832-e9f5-42fd-bd28-d9a3f7ce2463 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:12.814295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccb77832-e9f5-42fd-bd28-d9a3f7ce2463 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:14.219815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ccb77832-e9f5-42fd-bd28-d9a3f7ce2463 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:14.255145 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ccb77832-e9f5-42fd-bd28-d9a3f7ce2463 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1313 microversion: 2.1 time: 1.510965 Sep 08 13:15:14.265741 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2435/5006] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:12 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1313 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:15.303813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a8c023e7-5f0b-40ac-8184-4d4e5d237d6e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:15.305071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a8c023e7-5f0b-40ac-8184-4d4e5d237d6e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:15.342600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c023e7-5f0b-40ac-8184-4d4e5d237d6e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:15.353830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c023e7-5f0b-40ac-8184-4d4e5d237d6e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:15.354994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c023e7-5f0b-40ac-8184-4d4e5d237d6e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:15.356520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c023e7-5f0b-40ac-8184-4d4e5d237d6e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:15.357604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c023e7-5f0b-40ac-8184-4d4e5d237d6e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:15.358635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8c023e7-5f0b-40ac-8184-4d4e5d237d6e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:15.490736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=66 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:15.964959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-efd43093-a86b-44be-84dd-60b620848931 req-d2a73f77-bc9c-45d2-a702-d44df9acf75e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba0fb1c-26ca-46ea-aeca-e89070379463", "name": "network-vif-plugged", "status": "completed", "tag": "d5776e1e-148d-42d6-9a15-dfcee6086a34"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:15:16.032164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-efd43093-a86b-44be-84dd-60b620848931 req-d2a73f77-bc9c-45d2-a702-d44df9acf75e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:16.032805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-efd43093-a86b-44be-84dd-60b620848931 req-d2a73f77-bc9c-45d2-a702-d44df9acf75e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:16.033086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-efd43093-a86b-44be-84dd-60b620848931 req-d2a73f77-bc9c-45d2-a702-d44df9acf75e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:16.092757 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-efd43093-a86b-44be-84dd-60b620848931 req-d2a73f77-bc9c-45d2-a702-d44df9acf75e service nova] Creating event network-vif-plugged:d5776e1e-148d-42d6-9a15-dfcee6086a34 for instance 5ba0fb1c-26ca-46ea-aeca-e89070379463 on n-h2-852084-10 Sep 08 13:15:16.162870 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-efd43093-a86b-44be-84dd-60b620848931 req-d2a73f77-bc9c-45d2-a702-d44df9acf75e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205304 Sep 08 13:15:16.164832 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2436/5007] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:15:16.419109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a8c023e7-5f0b-40ac-8184-4d4e5d237d6e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:16.493547 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a8c023e7-5f0b-40ac-8184-4d4e5d237d6e tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1313 microversion: 2.1 time: 1.194415 Sep 08 13:15:16.500675 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2572/5008] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:15 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1313 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:17.557826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-90446a10-40e8-46b4-8f9d-400f0b413ac1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:17.559104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-90446a10-40e8-46b4-8f9d-400f0b413ac1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:17.616098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90446a10-40e8-46b4-8f9d-400f0b413ac1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:17.624583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90446a10-40e8-46b4-8f9d-400f0b413ac1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:17.630324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90446a10-40e8-46b4-8f9d-400f0b413ac1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:17.635345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90446a10-40e8-46b4-8f9d-400f0b413ac1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:17.636607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90446a10-40e8-46b4-8f9d-400f0b413ac1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:17.638904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90446a10-40e8-46b4-8f9d-400f0b413ac1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:18.911194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-90446a10-40e8-46b4-8f9d-400f0b413ac1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:18.958697 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-90446a10-40e8-46b4-8f9d-400f0b413ac1 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1313 microversion: 2.1 time: 1.418877 Sep 08 13:15:18.960348 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2437/5009] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:17 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1313 bytes in 1423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:20.004087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3f29c79e-f003-4f38-a6a4-7f062d28f3e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:20.004980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3f29c79e-f003-4f38-a6a4-7f062d28f3e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:20.022900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f29c79e-f003-4f38-a6a4-7f062d28f3e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:20.023441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f29c79e-f003-4f38-a6a4-7f062d28f3e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:20.023900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f29c79e-f003-4f38-a6a4-7f062d28f3e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:20.024752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f29c79e-f003-4f38-a6a4-7f062d28f3e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:20.025226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f29c79e-f003-4f38-a6a4-7f062d28f3e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:20.025705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f29c79e-f003-4f38-a6a4-7f062d28f3e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:20.463705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3f29c79e-f003-4f38-a6a4-7f062d28f3e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:20.507177 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3f29c79e-f003-4f38-a6a4-7f062d28f3e4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1497 microversion: 2.1 time: 0.506842 Sep 08 13:15:20.538081 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2573/5010] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:19 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1497 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:21.365667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9d9e5d04-a832-47fa-8187-c045231f37f2 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:21.367758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9d9e5d04-a832-47fa-8187-c045231f37f2 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:21.393200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d9e5d04-a832-47fa-8187-c045231f37f2 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:21.394486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d9e5d04-a832-47fa-8187-c045231f37f2 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:21.397284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d9e5d04-a832-47fa-8187-c045231f37f2 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:21.398998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d9e5d04-a832-47fa-8187-c045231f37f2 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:21.403205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d9e5d04-a832-47fa-8187-c045231f37f2 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:21.404343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d9e5d04-a832-47fa-8187-c045231f37f2 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:21.526243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9d9e5d04-a832-47fa-8187-c045231f37f2 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:15:21.821316 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9d9e5d04-a832-47fa-8187-c045231f37f2 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 204 len: 0 microversion: 2.1 time: 0.474327 Sep 08 13:15:21.827001 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2438/5011] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:15:21 2022] DELETE /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:15:21.835088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a6f5b87f-e7ea-4942-a330-d9e9cffa4ccf tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:21.837681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a6f5b87f-e7ea-4942-a330-d9e9cffa4ccf tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:21.872663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6f5b87f-e7ea-4942-a330-d9e9cffa4ccf tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:21.873465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6f5b87f-e7ea-4942-a330-d9e9cffa4ccf tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:21.874474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6f5b87f-e7ea-4942-a330-d9e9cffa4ccf tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:21.885356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6f5b87f-e7ea-4942-a330-d9e9cffa4ccf tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:21.886954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6f5b87f-e7ea-4942-a330-d9e9cffa4ccf tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:21.887808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6f5b87f-e7ea-4942-a330-d9e9cffa4ccf tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:22.373121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a6f5b87f-e7ea-4942-a330-d9e9cffa4ccf tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:22.399763 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a6f5b87f-e7ea-4942-a330-d9e9cffa4ccf tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1503 microversion: 2.1 time: 0.569526 Sep 08 13:15:22.400938 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2574/5012] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:21 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1503 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:15:23.460202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-93d60d0a-b083-4f7f-a56a-f4f8da5afd87 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:23.465772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-93d60d0a-b083-4f7f-a56a-f4f8da5afd87 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:23.513630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93d60d0a-b083-4f7f-a56a-f4f8da5afd87 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:23.518854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93d60d0a-b083-4f7f-a56a-f4f8da5afd87 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:23.518854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93d60d0a-b083-4f7f-a56a-f4f8da5afd87 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:23.518854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93d60d0a-b083-4f7f-a56a-f4f8da5afd87 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:23.518854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93d60d0a-b083-4f7f-a56a-f4f8da5afd87 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:23.523302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93d60d0a-b083-4f7f-a56a-f4f8da5afd87 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:24.929522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-93d60d0a-b083-4f7f-a56a-f4f8da5afd87 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:24.961756 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-93d60d0a-b083-4f7f-a56a-f4f8da5afd87 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1503 microversion: 2.1 time: 1.514374 Sep 08 13:15:24.969518 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2439/5013] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:23 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1503 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:15:26.029527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc6ce0ec-7e44-4c52-817b-55fc171f82dc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:26.043059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cc6ce0ec-7e44-4c52-817b-55fc171f82dc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:26.069433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc6ce0ec-7e44-4c52-817b-55fc171f82dc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:26.070360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc6ce0ec-7e44-4c52-817b-55fc171f82dc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:26.071120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc6ce0ec-7e44-4c52-817b-55fc171f82dc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:26.072954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc6ce0ec-7e44-4c52-817b-55fc171f82dc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:26.077370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc6ce0ec-7e44-4c52-817b-55fc171f82dc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:26.078699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc6ce0ec-7e44-4c52-817b-55fc171f82dc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:26.227302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-91072a69-5452-4045-a55e-4329f1e27d51 req-0f071b58-6f83-40ee-8344-9ac245a4a353 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba0fb1c-26ca-46ea-aeca-e89070379463", "name": "network-vif-deleted", "tag": "d5776e1e-148d-42d6-9a15-dfcee6086a34"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:15:26.294362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-91072a69-5452-4045-a55e-4329f1e27d51 req-0f071b58-6f83-40ee-8344-9ac245a4a353 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:26.298909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-91072a69-5452-4045-a55e-4329f1e27d51 req-0f071b58-6f83-40ee-8344-9ac245a4a353 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:26.304902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-91072a69-5452-4045-a55e-4329f1e27d51 req-0f071b58-6f83-40ee-8344-9ac245a4a353 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:26.319879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cc6ce0ec-7e44-4c52-817b-55fc171f82dc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:26.346075 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc6ce0ec-7e44-4c52-817b-55fc171f82dc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 200 len: 1461 microversion: 2.1 time: 0.332447 Sep 08 13:15:26.356947 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2575/5014] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:26 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 1461 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:26.413463 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-91072a69-5452-4045-a55e-4329f1e27d51 req-0f071b58-6f83-40ee-8344-9ac245a4a353 service nova] Creating event network-vif-deleted:d5776e1e-148d-42d6-9a15-dfcee6086a34 for instance 5ba0fb1c-26ca-46ea-aeca-e89070379463 on n-h2-852084-10 Sep 08 13:15:26.444418 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-91072a69-5452-4045-a55e-4329f1e27d51 req-0f071b58-6f83-40ee-8344-9ac245a4a353 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.221835 Sep 08 13:15:26.451780 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2440/5015] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:15:27.372670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-812c8934-643c-440b-9997-c35a27ea22ae tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:27.377609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-812c8934-643c-440b-9997-c35a27ea22ae tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 5ba0fb1c-26ca-46ea-aeca-e89070379463] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:27.391464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-812c8934-643c-440b-9997-c35a27ea22ae tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:27.393882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-812c8934-643c-440b-9997-c35a27ea22ae tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:27.394717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-812c8934-643c-440b-9997-c35a27ea22ae tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:27.396570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-812c8934-643c-440b-9997-c35a27ea22ae tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:27.397281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-812c8934-643c-440b-9997-c35a27ea22ae tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:27.397877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-812c8934-643c-440b-9997-c35a27ea22ae tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:27.418261 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-812c8934-643c-440b-9997-c35a27ea22ae tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] HTTP exception thrown: Instance 5ba0fb1c-26ca-46ea-aeca-e89070379463 could not be found. Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-812c8934-643c-440b-9997-c35a27ea22ae tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Request method failure captured: Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 HTTP/1.1 Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGerAB2oR4D1eatHUiyXntBvatl-mPfiQh7Yv3foH8YPBRFaCi_zRKo5II8Dt8tZuAUzTbbw_shfZ4TzdSiNsfO9unthlXfzB9QEpqXpa6BzFhTI0hMQsHobRBM6yzjf_0zDq_zzAVupl_NE6eQeIPHEOn84qiAW_NQ3Gbn_thFguIiw Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 07d9ade398aa4cf396bb58268cf3e25e Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesActionsTest-636549243 Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_07d9ade398aa4cf396bb58268cf3e25e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/07d9ade398aa4cf396bb58268cf3e25e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/07d9ade398aa4cf396bb58268cf3e25e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/07d9ade398aa4cf396bb58268cf3e25e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesActionsTest-636549243 Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 07d9ade398aa4cf396bb58268cf3e25e Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesActionsTest-636549243 Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesActionsTest-636549243-project Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: cf24e2de28614ec3b3367c15208c333d Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesActionsTest-636549243-project Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 5ba0fb1c-26ca-46ea-aeca-e89070379463 could not be found. Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '5ba0fb1c-26ca-46ea-aeca-e89070379463'} Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba0fb1c-26ca-46ea-aeca-e89070379463 could not be found. Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba0fb1c-26ca-46ea-aeca-e89070379463 could not be found. Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:15:27.420335 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:15:27.424625 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:15:27.424625 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:15:27.424625 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:15:27.424625 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:15:27.424625 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:15:27.424625 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba0fb1c-26ca-46ea-aeca-e89070379463 could not be found. Sep 08 13:15:27.424625 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:15:27.427017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-812c8934-643c-440b-9997-c35a27ea22ae tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Returning 404 to user: Instance 5ba0fb1c-26ca-46ea-aeca-e89070379463 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:15:27.428569 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-812c8934-643c-440b-9997-c35a27ea22ae tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463" status: 404 len: 111 microversion: 2.1 time: 0.061334 Sep 08 13:15:27.429583 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2576/5016] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:27 2022] GET /compute/v2.1/servers/5ba0fb1c-26ca-46ea-aeca-e89070379463 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:15:27.757902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-681660393", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "616144fc-8efe-40a3-9bb6-db51f979797f"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:15:27.873846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] validate_networks() for [('616144fc-8efe-40a3-9bb6-db51f979797f', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:15:28.928410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:15:28.929574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:15:28.930602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:15:28.931212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:15:28.931973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:15:28.947190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:28.948310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:28.948844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:28.949695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:28.950187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:28.950875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:29.007149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Getting quotas for project 07d9ade398aa4cf396bb58268cf3e25e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:15:29.042165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Getting quotas for user cf24e2de28614ec3b3367c15208c333d and project 07d9ade398aa4cf396bb58268cf3e25e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:15:29.098509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:15:29.103733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:15:29.237116 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54830028-5d5e-48be-989c-39b0468e7a47 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.484280 Sep 08 13:15:29.249550 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2441/5017] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:15:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:15:29.276529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28a640d9-58a1-4b8b-94e1-13403bda98be tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:29.279102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-28a640d9-58a1-4b8b-94e1-13403bda98be tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:29.457121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-28a640d9-58a1-4b8b-94e1-13403bda98be tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:29.478560 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-28a640d9-58a1-4b8b-94e1-13403bda98be tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1213 microversion: 2.1 time: 0.226278 Sep 08 13:15:29.496727 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2577/5018] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:29 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1213 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:30.558026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f52f1c9-bc3c-4e04-8c54-b7e1a6a55f9d tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:30.560351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f52f1c9-bc3c-4e04-8c54-b7e1a6a55f9d tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:30.586902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f52f1c9-bc3c-4e04-8c54-b7e1a6a55f9d tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:30.588955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f52f1c9-bc3c-4e04-8c54-b7e1a6a55f9d tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:30.589865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f52f1c9-bc3c-4e04-8c54-b7e1a6a55f9d tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:30.591827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f52f1c9-bc3c-4e04-8c54-b7e1a6a55f9d tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:30.592600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f52f1c9-bc3c-4e04-8c54-b7e1a6a55f9d tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:30.593352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f52f1c9-bc3c-4e04-8c54-b7e1a6a55f9d tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:30.780900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f52f1c9-bc3c-4e04-8c54-b7e1a6a55f9d tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:30.809745 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f52f1c9-bc3c-4e04-8c54-b7e1a6a55f9d tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1209 microversion: 2.1 time: 0.288423 Sep 08 13:15:30.811792 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2442/5019] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:30 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1209 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:15:31.844937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-577e0421-64f9-43ad-bbf1-23feb9b12ef6 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:31.846341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-577e0421-64f9-43ad-bbf1-23feb9b12ef6 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:31.888771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-577e0421-64f9-43ad-bbf1-23feb9b12ef6 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:31.892441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-577e0421-64f9-43ad-bbf1-23feb9b12ef6 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:31.893022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-577e0421-64f9-43ad-bbf1-23feb9b12ef6 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:31.893855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-577e0421-64f9-43ad-bbf1-23feb9b12ef6 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:31.894339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-577e0421-64f9-43ad-bbf1-23feb9b12ef6 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:31.894807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-577e0421-64f9-43ad-bbf1-23feb9b12ef6 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:32.253797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-577e0421-64f9-43ad-bbf1-23feb9b12ef6 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:32.268348 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-577e0421-64f9-43ad-bbf1-23feb9b12ef6 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1283 microversion: 2.1 time: 0.429211 Sep 08 13:15:32.271189 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2578/5020] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:31 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1283 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:33.312921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-251a1916-e8c5-4fb4-a803-bd097e4d6160 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:33.325729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-251a1916-e8c5-4fb4-a803-bd097e4d6160 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:33.337585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:33.341984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-251a1916-e8c5-4fb4-a803-bd097e4d6160 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:33.343208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-251a1916-e8c5-4fb4-a803-bd097e4d6160 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:33.344709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-251a1916-e8c5-4fb4-a803-bd097e4d6160 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:33.347061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-251a1916-e8c5-4fb4-a803-bd097e4d6160 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:33.350958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-251a1916-e8c5-4fb4-a803-bd097e4d6160 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:33.350958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-251a1916-e8c5-4fb4-a803-bd097e4d6160 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:33.595086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-251a1916-e8c5-4fb4-a803-bd097e4d6160 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:33.629192 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-251a1916-e8c5-4fb4-a803-bd097e4d6160 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1271 microversion: 2.1 time: 0.329657 Sep 08 13:15:33.630676 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2443/5021] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:33 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1271 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:34.671376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4b836265-725d-4de9-aa2d-e2483f5eddeb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:34.672526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4b836265-725d-4de9-aa2d-e2483f5eddeb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:34.687650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b836265-725d-4de9-aa2d-e2483f5eddeb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:34.688962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b836265-725d-4de9-aa2d-e2483f5eddeb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:34.690035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b836265-725d-4de9-aa2d-e2483f5eddeb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:34.691853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b836265-725d-4de9-aa2d-e2483f5eddeb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:34.698393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b836265-725d-4de9-aa2d-e2483f5eddeb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:34.699964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b836265-725d-4de9-aa2d-e2483f5eddeb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:35.240856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4b836265-725d-4de9-aa2d-e2483f5eddeb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:35.277107 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4b836265-725d-4de9-aa2d-e2483f5eddeb tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1271 microversion: 2.1 time: 0.613065 Sep 08 13:15:35.278830 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2579/5022] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:34 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1271 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:35.580474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c2e687c4-44c9-4d06-b68a-ab9d2ac9111e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:35.587782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c2e687c4-44c9-4d06-b68a-ab9d2ac9111e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:35.606936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2e687c4-44c9-4d06-b68a-ab9d2ac9111e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:35.608781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2e687c4-44c9-4d06-b68a-ab9d2ac9111e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:35.610001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2e687c4-44c9-4d06-b68a-ab9d2ac9111e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:35.612054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2e687c4-44c9-4d06-b68a-ab9d2ac9111e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:35.613212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2e687c4-44c9-4d06-b68a-ab9d2ac9111e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:35.614284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2e687c4-44c9-4d06-b68a-ab9d2ac9111e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:35.697152 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c2e687c4-44c9-4d06-b68a-ab9d2ac9111e tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.124932 Sep 08 13:15:35.711999 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2444/5023] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Sep 8 13:15:35 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:35.828494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a88fd762-f682-47a8-991f-b7c847aee485 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:35.829636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a88fd762-f682-47a8-991f-b7c847aee485 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:35.841923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a88fd762-f682-47a8-991f-b7c847aee485 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:35.843116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a88fd762-f682-47a8-991f-b7c847aee485 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:35.844127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a88fd762-f682-47a8-991f-b7c847aee485 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:35.845328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a88fd762-f682-47a8-991f-b7c847aee485 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:35.846004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a88fd762-f682-47a8-991f-b7c847aee485 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:35.847037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a88fd762-f682-47a8-991f-b7c847aee485 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:35.919349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a88fd762-f682-47a8-991f-b7c847aee485 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:15:36.149511 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a88fd762-f682-47a8-991f-b7c847aee485 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 204 len: 0 microversion: 2.20 time: 0.323141 Sep 08 13:15:36.154294 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2580/5024] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:15:35 2022] DELETE /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:15:36.167164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ba0c1300-1ee1-476a-9822-ba515e36dc12 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:36.172223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ba0c1300-1ee1-476a-9822-ba515e36dc12 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:36.192251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba0c1300-1ee1-476a-9822-ba515e36dc12 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:36.193112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba0c1300-1ee1-476a-9822-ba515e36dc12 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:36.208363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba0c1300-1ee1-476a-9822-ba515e36dc12 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:36.216058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba0c1300-1ee1-476a-9822-ba515e36dc12 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:36.217336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba0c1300-1ee1-476a-9822-ba515e36dc12 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:36.218367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba0c1300-1ee1-476a-9822-ba515e36dc12 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:36.231357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:36.313169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-48a6ee3e-aa40-4036-b87f-76081f456acd tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:36.314185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-48a6ee3e-aa40-4036-b87f-76081f456acd tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:36.332903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a6ee3e-aa40-4036-b87f-76081f456acd tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:36.335293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a6ee3e-aa40-4036-b87f-76081f456acd tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:36.336922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a6ee3e-aa40-4036-b87f-76081f456acd tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:36.339529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a6ee3e-aa40-4036-b87f-76081f456acd tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:36.342150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a6ee3e-aa40-4036-b87f-76081f456acd tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:36.343874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a6ee3e-aa40-4036-b87f-76081f456acd tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:37.679310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ba0c1300-1ee1-476a-9822-ba515e36dc12 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:37.714353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ba0c1300-1ee1-476a-9822-ba515e36dc12 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:37.727485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ba0c1300-1ee1-476a-9822-ba515e36dc12 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:37.740435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-48a6ee3e-aa40-4036-b87f-76081f456acd tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:37.744873 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ba0c1300-1ee1-476a-9822-ba515e36dc12 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1724 microversion: 2.20 time: 1.588495 Sep 08 13:15:37.745505 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2445/5025] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:15:36 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1724 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:15:37.772535 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-48a6ee3e-aa40-4036-b87f-76081f456acd tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1313 microversion: 2.1 time: 1.462939 Sep 08 13:15:37.773703 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2581/5026] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:36 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1313 bytes in 1471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:38.798511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-487513c6-2fb1-4b49-a0e6-64ff2d7d4bed tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:38.800387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-487513c6-2fb1-4b49-a0e6-64ff2d7d4bed tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:38.809292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0b2a504a-7aef-4dc7-821d-b3442727931b tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:38.816413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0b2a504a-7aef-4dc7-821d-b3442727931b tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:38.825172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-487513c6-2fb1-4b49-a0e6-64ff2d7d4bed tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:38.826056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-487513c6-2fb1-4b49-a0e6-64ff2d7d4bed tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:38.828737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-487513c6-2fb1-4b49-a0e6-64ff2d7d4bed tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:38.833671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-487513c6-2fb1-4b49-a0e6-64ff2d7d4bed tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:38.835980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-487513c6-2fb1-4b49-a0e6-64ff2d7d4bed tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:38.836681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-487513c6-2fb1-4b49-a0e6-64ff2d7d4bed tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:38.846147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b2a504a-7aef-4dc7-821d-b3442727931b tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:38.848253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b2a504a-7aef-4dc7-821d-b3442727931b tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:38.849910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b2a504a-7aef-4dc7-821d-b3442727931b tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:38.851975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b2a504a-7aef-4dc7-821d-b3442727931b tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:38.853177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b2a504a-7aef-4dc7-821d-b3442727931b tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:38.854522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b2a504a-7aef-4dc7-821d-b3442727931b tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:38.976145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:39.064463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:39.479348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:39.884669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-487513c6-2fb1-4b49-a0e6-64ff2d7d4bed tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:39.902178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-487513c6-2fb1-4b49-a0e6-64ff2d7d4bed tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:39.903770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-487513c6-2fb1-4b49-a0e6-64ff2d7d4bed tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:39.905191 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-487513c6-2fb1-4b49-a0e6-64ff2d7d4bed tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1724 microversion: 2.20 time: 1.111063 Sep 08 13:15:39.915348 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2446/5027] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:15:38 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1724 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:15:39.989682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0b2a504a-7aef-4dc7-821d-b3442727931b tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:40.010671 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0b2a504a-7aef-4dc7-821d-b3442727931b tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1313 microversion: 2.1 time: 1.210757 Sep 08 13:15:40.011447 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2582/5028] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:38 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1313 bytes in 1217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:40.943828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4fde871c-f147-4929-8ab6-a1bc0c2d8783 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:40.955206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4fde871c-f147-4929-8ab6-a1bc0c2d8783 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:41.008124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fde871c-f147-4929-8ab6-a1bc0c2d8783 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:41.008659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fde871c-f147-4929-8ab6-a1bc0c2d8783 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:41.009121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fde871c-f147-4929-8ab6-a1bc0c2d8783 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:41.009952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fde871c-f147-4929-8ab6-a1bc0c2d8783 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:41.010432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fde871c-f147-4929-8ab6-a1bc0c2d8783 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:41.010877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fde871c-f147-4929-8ab6-a1bc0c2d8783 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:41.061552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e471eb0-e7c5-425e-a5d2-430df56d6131 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:41.062438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8e471eb0-e7c5-425e-a5d2-430df56d6131 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:41.090611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:41.094572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e471eb0-e7c5-425e-a5d2-430df56d6131 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:41.095574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e471eb0-e7c5-425e-a5d2-430df56d6131 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:41.096641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e471eb0-e7c5-425e-a5d2-430df56d6131 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:41.099593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e471eb0-e7c5-425e-a5d2-430df56d6131 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:41.100663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e471eb0-e7c5-425e-a5d2-430df56d6131 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:41.101598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e471eb0-e7c5-425e-a5d2-430df56d6131 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:41.912679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4fde871c-f147-4929-8ab6-a1bc0c2d8783 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:41.928446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4fde871c-f147-4929-8ab6-a1bc0c2d8783 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:41.929782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4fde871c-f147-4929-8ab6-a1bc0c2d8783 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:41.931369 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4fde871c-f147-4929-8ab6-a1bc0c2d8783 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1724 microversion: 2.20 time: 0.995214 Sep 08 13:15:41.948573 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2447/5029] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:15:40 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1724 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:15:42.027727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8e471eb0-e7c5-425e-a5d2-430df56d6131 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:42.045124 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8e471eb0-e7c5-425e-a5d2-430df56d6131 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1313 microversion: 2.1 time: 0.990518 Sep 08 13:15:42.046199 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2583/5030] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:41 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1313 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:42.973524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-79497bed-ee76-4863-85d6-982309682e6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:42.979464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-79497bed-ee76-4863-85d6-982309682e6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:43.013077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79497bed-ee76-4863-85d6-982309682e6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:43.019332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79497bed-ee76-4863-85d6-982309682e6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:43.021996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79497bed-ee76-4863-85d6-982309682e6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:43.024426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79497bed-ee76-4863-85d6-982309682e6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:43.026387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79497bed-ee76-4863-85d6-982309682e6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:43.027475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79497bed-ee76-4863-85d6-982309682e6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:43.100815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3f452dfa-61d9-424f-a23a-e4c7c9af8b49 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:43.102873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3f452dfa-61d9-424f-a23a-e4c7c9af8b49 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:43.164198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f452dfa-61d9-424f-a23a-e4c7c9af8b49 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:43.165332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f452dfa-61d9-424f-a23a-e4c7c9af8b49 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:43.166896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f452dfa-61d9-424f-a23a-e4c7c9af8b49 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:43.169819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f452dfa-61d9-424f-a23a-e4c7c9af8b49 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:43.171090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f452dfa-61d9-424f-a23a-e4c7c9af8b49 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:43.178155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f452dfa-61d9-424f-a23a-e4c7c9af8b49 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:43.603898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-79497bed-ee76-4863-85d6-982309682e6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:43.666599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-79497bed-ee76-4863-85d6-982309682e6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:43.669984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-79497bed-ee76-4863-85d6-982309682e6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:43.672362 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-79497bed-ee76-4863-85d6-982309682e6d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1657 microversion: 2.20 time: 0.707381 Sep 08 13:15:43.705123 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2448/5031] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:15:42 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1657 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:15:43.740172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e4626c70-5da1-4cb4-85d2-789f4fc0612c req-41e50e35-efde-49cd-851f-0213ec3bd323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6715fcfe-59a2-4237-945d-e9ca6ca304fd", "tag": "45a17e01-f261-41f7-b5eb-8c997a8d91e5"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:15:43.763939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e4626c70-5da1-4cb4-85d2-789f4fc0612c req-41e50e35-efde-49cd-851f-0213ec3bd323 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:43.768158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e4626c70-5da1-4cb4-85d2-789f4fc0612c req-41e50e35-efde-49cd-851f-0213ec3bd323 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:43.774913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e4626c70-5da1-4cb4-85d2-789f4fc0612c req-41e50e35-efde-49cd-851f-0213ec3bd323 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:43.821025 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e4626c70-5da1-4cb4-85d2-789f4fc0612c req-41e50e35-efde-49cd-851f-0213ec3bd323 service nova] Creating event network-changed:45a17e01-f261-41f7-b5eb-8c997a8d91e5 for instance 6715fcfe-59a2-4237-945d-e9ca6ca304fd on n-h2-852084-10 Sep 08 13:15:43.846256 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e4626c70-5da1-4cb4-85d2-789f4fc0612c req-41e50e35-efde-49cd-851f-0213ec3bd323 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117129 Sep 08 13:15:43.850786 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2449/5032] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:15:44.762571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ba86a83f-d6e3-4dd6-98ed-26c0468fa801 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:44.766497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ba86a83f-d6e3-4dd6-98ed-26c0468fa801 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:44.786769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba86a83f-d6e3-4dd6-98ed-26c0468fa801 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:44.799018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba86a83f-d6e3-4dd6-98ed-26c0468fa801 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:44.800129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba86a83f-d6e3-4dd6-98ed-26c0468fa801 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:44.801622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba86a83f-d6e3-4dd6-98ed-26c0468fa801 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:44.802666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba86a83f-d6e3-4dd6-98ed-26c0468fa801 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:44.811029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba86a83f-d6e3-4dd6-98ed-26c0468fa801 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:45.332454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ba86a83f-d6e3-4dd6-98ed-26c0468fa801 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:45.357343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3f452dfa-61d9-424f-a23a-e4c7c9af8b49 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:45.377421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ba86a83f-d6e3-4dd6-98ed-26c0468fa801 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:45.386448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ba86a83f-d6e3-4dd6-98ed-26c0468fa801 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:45.392160 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3f452dfa-61d9-424f-a23a-e4c7c9af8b49 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1313 microversion: 2.1 time: 2.298395 Sep 08 13:15:45.393248 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2584/5033] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:43 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1313 bytes in 2301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:45.398512 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ba86a83f-d6e3-4dd6-98ed-26c0468fa801 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1657 microversion: 2.20 time: 0.655448 Sep 08 13:15:45.402377 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2450/5034] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:15:44 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1657 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:15:45.999730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-1d3fbe26-7f1a-4a06-a7fe-f32b32bdebd9 req-32302882-e8aa-41e7-95e1-4c33cd99c2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bad0f9bb-3303-4bdc-a35e-102f0002fe77", "name": "network-vif-deleted", "tag": "1ea3ab52-16b6-4072-bb78-7320e9ba5e25"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:15:46.052317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1d3fbe26-7f1a-4a06-a7fe-f32b32bdebd9 req-32302882-e8aa-41e7-95e1-4c33cd99c2e8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:46.053180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1d3fbe26-7f1a-4a06-a7fe-f32b32bdebd9 req-32302882-e8aa-41e7-95e1-4c33cd99c2e8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:46.053964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1d3fbe26-7f1a-4a06-a7fe-f32b32bdebd9 req-32302882-e8aa-41e7-95e1-4c33cd99c2e8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:46.100522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:15:46.179181 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1d3fbe26-7f1a-4a06-a7fe-f32b32bdebd9 req-32302882-e8aa-41e7-95e1-4c33cd99c2e8 service nova] Creating event network-vif-deleted:1ea3ab52-16b6-4072-bb78-7320e9ba5e25 for instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 on n-h2-852084-10 Sep 08 13:15:46.203995 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-1d3fbe26-7f1a-4a06-a7fe-f32b32bdebd9 req-32302882-e8aa-41e7-95e1-4c33cd99c2e8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210736 Sep 08 13:15:46.209766 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2585/5035] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:15:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:15:46.451518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36791fbe-50c9-4b38-92f3-c81c39c87ea4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:46.464345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-36791fbe-50c9-4b38-92f3-c81c39c87ea4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:46.466798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:46.474160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:46.504699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36791fbe-50c9-4b38-92f3-c81c39c87ea4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:46.505505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36791fbe-50c9-4b38-92f3-c81c39c87ea4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:46.515075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:46.517260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36791fbe-50c9-4b38-92f3-c81c39c87ea4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:46.518547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36791fbe-50c9-4b38-92f3-c81c39c87ea4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:46.526600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36791fbe-50c9-4b38-92f3-c81c39c87ea4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:46.526874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:46.527870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:46.529085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:46.530576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36791fbe-50c9-4b38-92f3-c81c39c87ea4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:46.537063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:46.537890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:46.831755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:46.832599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:46.833365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:46.834151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lazy-loading 'fault' on Instance uuid bad0f9bb-3303-4bdc-a35e-102f0002fe77 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:15:47.057196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:47.086393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:47.098339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:47.109179 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b0347047-83d5-437e-bb8e-398bfd17b7db tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1371 microversion: 2.20 time: 0.647943 Sep 08 13:15:47.143650 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2586/5036] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:15:46 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1371 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 08 13:15:47.377505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-36791fbe-50c9-4b38-92f3-c81c39c87ea4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:47.396672 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36791fbe-50c9-4b38-92f3-c81c39c87ea4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1313 microversion: 2.1 time: 0.960415 Sep 08 13:15:47.397637 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2451/5037] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:46 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1313 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:48.179622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:48.182884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:48.204665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:48.211142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:48.213248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:48.221904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:48.227749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:48.237499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:48.340314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:48.342730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:48.344295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:48.345774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lazy-loading 'fault' on Instance uuid bad0f9bb-3303-4bdc-a35e-102f0002fe77 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:15:48.448901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-144b253a-96ba-458b-acf7-f7511837dbc9 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:48.452625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-144b253a-96ba-458b-acf7-f7511837dbc9 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:48.467385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-144b253a-96ba-458b-acf7-f7511837dbc9 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:48.468625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-144b253a-96ba-458b-acf7-f7511837dbc9 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:48.469496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-144b253a-96ba-458b-acf7-f7511837dbc9 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:48.473619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-144b253a-96ba-458b-acf7-f7511837dbc9 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:48.475960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-144b253a-96ba-458b-acf7-f7511837dbc9 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:48.477907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-144b253a-96ba-458b-acf7-f7511837dbc9 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:48.536252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:48.563175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:48.565947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'd9ccc775b0764dbf860508db1d2096bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b0e146de89146b9b1d07a8b07b1b77b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:48.567832 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b022c975-44f9-4c10-a45b-465daaa6fea4 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 200 len: 1371 microversion: 2.20 time: 0.400088 Sep 08 13:15:48.568817 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2587/5038] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:15:48 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 1371 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 08 13:15:49.397042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-144b253a-96ba-458b-acf7-f7511837dbc9 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:49.422242 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-144b253a-96ba-458b-acf7-f7511837dbc9 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1313 microversion: 2.1 time: 0.983176 Sep 08 13:15:49.423080 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2452/5039] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:48 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1313 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:15:49.622661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f43b8826-07c8-4316-8be0-622917b5f61f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:49.624086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f43b8826-07c8-4316-8be0-622917b5f61f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:49.643820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43b8826-07c8-4316-8be0-622917b5f61f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:49.645173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43b8826-07c8-4316-8be0-622917b5f61f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:49.646722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43b8826-07c8-4316-8be0-622917b5f61f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:49.648852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43b8826-07c8-4316-8be0-622917b5f61f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:49.653183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43b8826-07c8-4316-8be0-622917b5f61f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:49.654024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43b8826-07c8-4316-8be0-622917b5f61f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:49.694706 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-f43b8826-07c8-4316-8be0-622917b5f61f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] HTTP exception thrown: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f43b8826-07c8-4316-8be0-622917b5f61f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Request method failure captured: Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 HTTP/1.1 Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGejeY0G7Pzyo12zPbsJqxZazCm5XfFy5FeKTeuh2Cdz68kKa0hH5jVX-3GV2irJwRgmKI9ZKR9NXuG0gYi5tJIiri4zZkWklfHVzADvV5rMZsKtNYjvYuOWjj0gXceyBIowOvBzkOk2lsIp6cVXn0cZFXdU6ulV1gf9CrxhR2a60OVg Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 4b0e146de89146b9b1d07a8b07b1b77b Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 4b0e146de89146b9b1d07a8b07b1b77b Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachVolumeShelveTestJSON-1053339716-project Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9ccc775b0764dbf860508db1d2096bf Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1053339716-project Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'bad0f9bb-3303-4bdc-a35e-102f0002fe77'} Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:15:49.700447 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:15:49.705311 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:15:49.705311 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:15:49.705311 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:15:49.705311 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:15:49.705311 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:15:49.705311 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:15:49.705311 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:15:49.705311 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:15:49.708874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f43b8826-07c8-4316-8be0-622917b5f61f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Returning 404 to user: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:15:49.710495 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f43b8826-07c8-4316-8be0-622917b5f61f tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 404 len: 111 microversion: 2.20 time: 0.095392 Sep 08 13:15:49.714508 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2588/5040] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:15:49 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:15:49.725922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7429e187-b902-46b7-8b03-9583aff8cdb3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '.version_select at 0x7fdb3a035af0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:49.773126 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7429e187-b902-46b7-8b03-9583aff8cdb3 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486601619" status: 204 len: 0 microversion: 2.20 time: 0.051532 Sep 08 13:15:49.776525 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2453/5041] 10.222.0.78 () {60 vars in 1262 bytes} [Thu Sep 8 13:15:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1486601619 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 08 13:15:50.462918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fed49d01-2b34-4c39-8657-0564ba18cb5f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:50.463998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fed49d01-2b34-4c39-8657-0564ba18cb5f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:50.483292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fed49d01-2b34-4c39-8657-0564ba18cb5f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:50.484847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fed49d01-2b34-4c39-8657-0564ba18cb5f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:50.485567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fed49d01-2b34-4c39-8657-0564ba18cb5f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:50.487448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fed49d01-2b34-4c39-8657-0564ba18cb5f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:50.488678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fed49d01-2b34-4c39-8657-0564ba18cb5f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:50.489492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fed49d01-2b34-4c39-8657-0564ba18cb5f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:51.765845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fed49d01-2b34-4c39-8657-0564ba18cb5f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:51.797243 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fed49d01-2b34-4c39-8657-0564ba18cb5f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1313 microversion: 2.1 time: 1.338107 Sep 08 13:15:51.798942 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2589/5042] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:50 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1313 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:15:52.861201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a56fc175-4eaa-47d9-a756-54ed50d5722f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:52.864451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a56fc175-4eaa-47d9-a756-54ed50d5722f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:52.892039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a56fc175-4eaa-47d9-a756-54ed50d5722f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:52.893045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a56fc175-4eaa-47d9-a756-54ed50d5722f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:52.901486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a56fc175-4eaa-47d9-a756-54ed50d5722f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:52.902916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a56fc175-4eaa-47d9-a756-54ed50d5722f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:52.904005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a56fc175-4eaa-47d9-a756-54ed50d5722f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:52.927930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a56fc175-4eaa-47d9-a756-54ed50d5722f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:53.408250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a56fc175-4eaa-47d9-a756-54ed50d5722f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:53.425988 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a56fc175-4eaa-47d9-a756-54ed50d5722f tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1313 microversion: 2.1 time: 0.594929 Sep 08 13:15:53.444032 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2454/5043] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:52 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1313 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:54.467608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fe6b78d8-5af8-43a8-9ae4-b365db2af9cc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:54.469163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fe6b78d8-5af8-43a8-9ae4-b365db2af9cc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:54.505272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe6b78d8-5af8-43a8-9ae4-b365db2af9cc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:54.506496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe6b78d8-5af8-43a8-9ae4-b365db2af9cc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:54.509366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe6b78d8-5af8-43a8-9ae4-b365db2af9cc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:54.512339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe6b78d8-5af8-43a8-9ae4-b365db2af9cc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:54.516672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe6b78d8-5af8-43a8-9ae4-b365db2af9cc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:54.517625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe6b78d8-5af8-43a8-9ae4-b365db2af9cc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:54.556842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-d4c43164-614d-4224-8667-bae4ad8180ca req-c0f83d59-2b96-48e4-bf2f-ef9c730dfc09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6715fcfe-59a2-4237-945d-e9ca6ca304fd", "name": "network-vif-plugged", "status": "completed", "tag": "45a17e01-f261-41f7-b5eb-8c997a8d91e5"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:15:54.621642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d4c43164-614d-4224-8667-bae4ad8180ca req-c0f83d59-2b96-48e4-bf2f-ef9c730dfc09 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:54.630097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d4c43164-614d-4224-8667-bae4ad8180ca req-c0f83d59-2b96-48e4-bf2f-ef9c730dfc09 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:54.634289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d4c43164-614d-4224-8667-bae4ad8180ca req-c0f83d59-2b96-48e4-bf2f-ef9c730dfc09 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:54.700822 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d4c43164-614d-4224-8667-bae4ad8180ca req-c0f83d59-2b96-48e4-bf2f-ef9c730dfc09 service nova] Creating event network-vif-plugged:45a17e01-f261-41f7-b5eb-8c997a8d91e5 for instance 6715fcfe-59a2-4237-945d-e9ca6ca304fd on n-h2-852084-10 Sep 08 13:15:54.745669 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-d4c43164-614d-4224-8667-bae4ad8180ca req-c0f83d59-2b96-48e4-bf2f-ef9c730dfc09 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.171095 Sep 08 13:15:54.754769 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2455/5044] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:15:55.152054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fe6b78d8-5af8-43a8-9ae4-b365db2af9cc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:55.176707 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fe6b78d8-5af8-43a8-9ae4-b365db2af9cc tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1313 microversion: 2.1 time: 0.719501 Sep 08 13:15:55.190712 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2590/5045] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:54 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1313 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:56.237131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-474d9887-e5df-4244-aa56-aa2d7d22d3e0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:56.238067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-474d9887-e5df-4244-aa56-aa2d7d22d3e0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:56.266866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-474d9887-e5df-4244-aa56-aa2d7d22d3e0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:56.267738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-474d9887-e5df-4244-aa56-aa2d7d22d3e0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:56.268456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-474d9887-e5df-4244-aa56-aa2d7d22d3e0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:56.270082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-474d9887-e5df-4244-aa56-aa2d7d22d3e0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:56.271070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-474d9887-e5df-4244-aa56-aa2d7d22d3e0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:56.271728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-474d9887-e5df-4244-aa56-aa2d7d22d3e0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:57.697266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-474d9887-e5df-4244-aa56-aa2d7d22d3e0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:57.768978 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-474d9887-e5df-4244-aa56-aa2d7d22d3e0 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1313 microversion: 2.1 time: 1.530812 Sep 08 13:15:57.771356 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2456/5046] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:56 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1313 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:15:58.814960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4b918d96-113e-4a9f-aef0-850eda33bfb4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:15:58.816318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4b918d96-113e-4a9f-aef0-850eda33bfb4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:15:58.847211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b918d96-113e-4a9f-aef0-850eda33bfb4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:58.854440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b918d96-113e-4a9f-aef0-850eda33bfb4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:58.861230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b918d96-113e-4a9f-aef0-850eda33bfb4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:58.862180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b918d96-113e-4a9f-aef0-850eda33bfb4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:15:58.864590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b918d96-113e-4a9f-aef0-850eda33bfb4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:15:58.865430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b918d96-113e-4a9f-aef0-850eda33bfb4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:15:59.443652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4b918d96-113e-4a9f-aef0-850eda33bfb4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:15:59.475680 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4b918d96-113e-4a9f-aef0-850eda33bfb4 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1496 microversion: 2.1 time: 0.665609 Sep 08 13:15:59.477527 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2591/5047] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:15:58 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1496 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:16:01.169231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-05dbcd7b-bdff-4f3d-a7cc-d9431cf01f51 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:16:01.170305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-05dbcd7b-bdff-4f3d-a7cc-d9431cf01f51 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:16:01.199630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-05dbcd7b-bdff-4f3d-a7cc-d9431cf01f51 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:01.200543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-05dbcd7b-bdff-4f3d-a7cc-d9431cf01f51 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:01.201337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-05dbcd7b-bdff-4f3d-a7cc-d9431cf01f51 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:01.202742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-05dbcd7b-bdff-4f3d-a7cc-d9431cf01f51 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:01.203687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-05dbcd7b-bdff-4f3d-a7cc-d9431cf01f51 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:01.204438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-05dbcd7b-bdff-4f3d-a7cc-d9431cf01f51 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:01.315642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-05dbcd7b-bdff-4f3d-a7cc-d9431cf01f51 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:16:01.638752 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-05dbcd7b-bdff-4f3d-a7cc-d9431cf01f51 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 204 len: 0 microversion: 2.1 time: 0.477347 Sep 08 13:16:01.645691 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2457/5048] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:16:01 2022] DELETE /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:16:01.660009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-47734852-b846-40a1-8ad3-90f5623c5471 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:16:01.660962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-47734852-b846-40a1-8ad3-90f5623c5471 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:16:01.713505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47734852-b846-40a1-8ad3-90f5623c5471 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:01.714417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47734852-b846-40a1-8ad3-90f5623c5471 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:01.715254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47734852-b846-40a1-8ad3-90f5623c5471 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:01.716591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47734852-b846-40a1-8ad3-90f5623c5471 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:01.733429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47734852-b846-40a1-8ad3-90f5623c5471 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:01.734708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-47734852-b846-40a1-8ad3-90f5623c5471 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:01.901150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6f61092c-8b96-4294-b86f-b29ade4760d7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:16:01.905345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6f61092c-8b96-4294-b86f-b29ade4760d7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:16:01.960795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f61092c-8b96-4294-b86f-b29ade4760d7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:01.961814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f61092c-8b96-4294-b86f-b29ade4760d7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:01.964135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f61092c-8b96-4294-b86f-b29ade4760d7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:01.967308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f61092c-8b96-4294-b86f-b29ade4760d7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:01.972631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f61092c-8b96-4294-b86f-b29ade4760d7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:01.979081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f61092c-8b96-4294-b86f-b29ade4760d7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:02.063414 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-6f61092c-8b96-4294-b86f-b29ade4760d7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] HTTP exception thrown: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6f61092c-8b96-4294-b86f-b29ade4760d7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Request method failure captured: Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 HTTP/1.1 Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGejeY0G7Pzyo12zPbsJqxZazCm5XfFy5FeKTeuh2Cdz68kKa0hH5jVX-3GV2irJwRgmKI9ZKR9NXuG0gYi5tJIiri4zZkWklfHVzADvV5rMZsKtNYjvYuOWjj0gXceyBIowOvBzkOk2lsIp6cVXn0cZFXdU6ulV1gf9CrxhR2a60OVg Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4b0e146de89146b9b1d07a8b07b1b77b Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4b0e146de89146b9b1d07a8b07b1b77b Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeShelveTestJSON-1053339716-project Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9ccc775b0764dbf860508db1d2096bf Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1053339716-project Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'bad0f9bb-3303-4bdc-a35e-102f0002fe77'} Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:16:02.067356 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6f61092c-8b96-4294-b86f-b29ade4760d7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Returning 404 to user: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6f61092c-8b96-4294-b86f-b29ade4760d7 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 404 len: 111 microversion: 2.20 time: 0.204394 Sep 08 13:16:02.075596 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2458/5049] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:16:01 2022] DELETE /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 111 bytes in 207 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:16:02.086630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9c2a7ab5-c853-47c2-873b-62d38e415c2d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:16:02.088467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9c2a7ab5-c853-47c2-873b-62d38e415c2d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: bad0f9bb-3303-4bdc-a35e-102f0002fe77] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:16:02.102154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c2a7ab5-c853-47c2-873b-62d38e415c2d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:02.104690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c2a7ab5-c853-47c2-873b-62d38e415c2d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:02.105562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c2a7ab5-c853-47c2-873b-62d38e415c2d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:02.106888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c2a7ab5-c853-47c2-873b-62d38e415c2d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:02.107731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c2a7ab5-c853-47c2-873b-62d38e415c2d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:02.108763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c2a7ab5-c853-47c2-873b-62d38e415c2d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:02.142534 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-9c2a7ab5-c853-47c2-873b-62d38e415c2d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] HTTP exception thrown: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9c2a7ab5-c853-47c2-873b-62d38e415c2d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Request method failure captured: Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 HTTP/1.1 Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGejeY0G7Pzyo12zPbsJqxZazCm5XfFy5FeKTeuh2Cdz68kKa0hH5jVX-3GV2irJwRgmKI9ZKR9NXuG0gYi5tJIiri4zZkWklfHVzADvV5rMZsKtNYjvYuOWjj0gXceyBIowOvBzkOk2lsIp6cVXn0cZFXdU6ulV1gf9CrxhR2a60OVg Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4b0e146de89146b9b1d07a8b07b1b77b Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4b0e146de89146b9b1d07a8b07b1b77b Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeShelveTestJSON-1053339716-project Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9ccc775b0764dbf860508db1d2096bf Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1053339716-project Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'bad0f9bb-3303-4bdc-a35e-102f0002fe77'} Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:02.146177 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:16:02.154690 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:02.154690 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:02.154690 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:16:02.154690 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:16:02.154690 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:16:02.154690 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:16:02.154690 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. Sep 08 13:16:02.154690 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:02.158570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9c2a7ab5-c853-47c2-873b-62d38e415c2d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Returning 404 to user: Instance bad0f9bb-3303-4bdc-a35e-102f0002fe77 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:16:02.160590 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9c2a7ab5-c853-47c2-873b-62d38e415c2d tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77" status: 404 len: 111 microversion: 2.20 time: 0.082347 Sep 08 13:16:02.162525 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2459/5050] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:16:02 2022] GET /compute/v2.1/servers/bad0f9bb-3303-4bdc-a35e-102f0002fe77 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 08 13:16:03.040117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-47734852-b846-40a1-8ad3-90f5623c5471 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:16:03.067071 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-47734852-b846-40a1-8ad3-90f5623c5471 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1502 microversion: 2.1 time: 1.414422 Sep 08 13:16:03.098381 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2592/5051] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:16:01 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1502 bytes in 1443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:16:04.109937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9fba8e30-7679-4148-a4be-00cc6e476f22 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:16:04.111166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9fba8e30-7679-4148-a4be-00cc6e476f22 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:16:04.132084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:16:04.167665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fba8e30-7679-4148-a4be-00cc6e476f22 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:04.168853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fba8e30-7679-4148-a4be-00cc6e476f22 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:04.169691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fba8e30-7679-4148-a4be-00cc6e476f22 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:04.171121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fba8e30-7679-4148-a4be-00cc6e476f22 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:04.172053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fba8e30-7679-4148-a4be-00cc6e476f22 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:04.172957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fba8e30-7679-4148-a4be-00cc6e476f22 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:05.617427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9fba8e30-7679-4148-a4be-00cc6e476f22 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:16:05.654742 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9fba8e30-7679-4148-a4be-00cc6e476f22 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1502 microversion: 2.1 time: 1.550341 Sep 08 13:16:05.655923 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2460/5052] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:16:04 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1502 bytes in 1558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:16:06.530963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-366c78b5-1418-40e1-8614-bc4ebea56dec req-6e0ce564-6747-4db1-8314-79f716c6d971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6715fcfe-59a2-4237-945d-e9ca6ca304fd", "name": "network-vif-deleted", "tag": "45a17e01-f261-41f7-b5eb-8c997a8d91e5"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:16:06.579104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-366c78b5-1418-40e1-8614-bc4ebea56dec req-6e0ce564-6747-4db1-8314-79f716c6d971 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:06.580654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-366c78b5-1418-40e1-8614-bc4ebea56dec req-6e0ce564-6747-4db1-8314-79f716c6d971 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:06.594056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-366c78b5-1418-40e1-8614-bc4ebea56dec req-6e0ce564-6747-4db1-8314-79f716c6d971 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:06.665734 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-366c78b5-1418-40e1-8614-bc4ebea56dec req-6e0ce564-6747-4db1-8314-79f716c6d971 service nova] Creating event network-vif-deleted:45a17e01-f261-41f7-b5eb-8c997a8d91e5 for instance 6715fcfe-59a2-4237-945d-e9ca6ca304fd on n-h2-852084-10 Sep 08 13:16:06.696754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:16:06.708452 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-366c78b5-1418-40e1-8614-bc4ebea56dec req-6e0ce564-6747-4db1-8314-79f716c6d971 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180817 Sep 08 13:16:06.719019 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2593/5053] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:16:06.721892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:16:06.783371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:06.785705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:06.786788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:06.788425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:06.789307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:06.801073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:06.842459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:16:06.950624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:06.952808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:06.953247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:06.953709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lazy-loading 'fault' on Instance uuid 6715fcfe-59a2-4237-945d-e9ca6ca304fd {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:16:07.079992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf24e2de28614ec3b3367c15208c333d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07d9ade398aa4cf396bb58268cf3e25e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:16:07.100294 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3a35023-b28b-45a8-94f1-81947ecec373 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 200 len: 1303 microversion: 2.1 time: 0.418652 Sep 08 13:16:07.101478 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2461/5054] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:16:06 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 1303 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:16:08.144918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e6016cb-ca06-42ca-b71d-0fd4e5ecce52 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:16:08.148896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8e6016cb-ca06-42ca-b71d-0fd4e5ecce52 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] [instance: 6715fcfe-59a2-4237-945d-e9ca6ca304fd] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:16:08.180021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e6016cb-ca06-42ca-b71d-0fd4e5ecce52 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:08.182741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e6016cb-ca06-42ca-b71d-0fd4e5ecce52 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:08.184550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e6016cb-ca06-42ca-b71d-0fd4e5ecce52 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:08.186608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e6016cb-ca06-42ca-b71d-0fd4e5ecce52 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:08.188909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e6016cb-ca06-42ca-b71d-0fd4e5ecce52 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:08.190814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e6016cb-ca06-42ca-b71d-0fd4e5ecce52 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:08.240233 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-8e6016cb-ca06-42ca-b71d-0fd4e5ecce52 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] HTTP exception thrown: Instance 6715fcfe-59a2-4237-945d-e9ca6ca304fd could not be found. Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e6016cb-ca06-42ca-b71d-0fd4e5ecce52 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Request method failure captured: Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd HTTP/1.1 Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGerAB2oR4D1eatHUiyXntBvatl-mPfiQh7Yv3foH8YPBRFaCi_zRKo5II8Dt8tZuAUzTbbw_shfZ4TzdSiNsfO9unthlXfzB9QEpqXpa6BzFhTI0hMQsHobRBM6yzjf_0zDq_zzAVupl_NE6eQeIPHEOn84qiAW_NQ3Gbn_thFguIiw Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 07d9ade398aa4cf396bb58268cf3e25e Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesActionsTest-636549243 Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_07d9ade398aa4cf396bb58268cf3e25e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/07d9ade398aa4cf396bb58268cf3e25e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/07d9ade398aa4cf396bb58268cf3e25e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/07d9ade398aa4cf396bb58268cf3e25e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesActionsTest-636549243 Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 07d9ade398aa4cf396bb58268cf3e25e Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesActionsTest-636549243 Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesActionsTest-636549243-project Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: cf24e2de28614ec3b3367c15208c333d Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesActionsTest-636549243-project Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 6715fcfe-59a2-4237-945d-e9ca6ca304fd could not be found. Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '6715fcfe-59a2-4237-945d-e9ca6ca304fd'} Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6715fcfe-59a2-4237-945d-e9ca6ca304fd could not be found. Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6715fcfe-59a2-4237-945d-e9ca6ca304fd could not be found. Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:16:08.248560 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:16:08.257371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:08.257371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:16:08.257371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:16:08.257371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:16:08.257371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:16:08.257371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6715fcfe-59a2-4237-945d-e9ca6ca304fd could not be found. Sep 08 13:16:08.257371 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:16:08.260356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e6016cb-ca06-42ca-b71d-0fd4e5ecce52 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] Returning 404 to user: Instance 6715fcfe-59a2-4237-945d-e9ca6ca304fd could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:16:08.263968 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8e6016cb-ca06-42ca-b71d-0fd4e5ecce52 tempest-VolumesActionsTest-636549243 tempest-VolumesActionsTest-636549243-project] 10.222.0.78 "GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd" status: 404 len: 111 microversion: 2.1 time: 0.128241 Sep 08 13:16:08.265881 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2594/5055] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:16:08 2022] GET /compute/v2.1/servers/6715fcfe-59a2-4237-945d-e9ca6ca304fd => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:16:12.092414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8f090891-39c2-437c-899e-7a1c567a4101 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:16:12.093183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8f090891-39c2-437c-899e-7a1c567a4101 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:16:12.122200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f090891-39c2-437c-899e-7a1c567a4101 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:12.124244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f090891-39c2-437c-899e-7a1c567a4101 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:12.127402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f090891-39c2-437c-899e-7a1c567a4101 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:12.128731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f090891-39c2-437c-899e-7a1c567a4101 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:12.134243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f090891-39c2-437c-899e-7a1c567a4101 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:12.135771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8f090891-39c2-437c-899e-7a1c567a4101 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:12.188123 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-8f090891-39c2-437c-899e-7a1c567a4101 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] HTTP exception thrown: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8f090891-39c2-437c-899e-7a1c567a4101 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Request method failure captured: Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 HTTP/1.1 Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGejeY0G7Pzyo12zPbsJqxZazCm5XfFy5FeKTeuh2Cdz68kKa0hH5jVX-3GV2irJwRgmKI9ZKR9NXuG0gYi5tJIiri4zZkWklfHVzADvV5rMZsKtNYjvYuOWjj0gXceyBIowOvBzkOk2lsIp6cVXn0cZFXdU6ulV1gf9CrxhR2a60OVg Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4b0e146de89146b9b1d07a8b07b1b77b Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4b0e146de89146b9b1d07a8b07b1b77b Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeShelveTestJSON-1053339716-project Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: d9ccc775b0764dbf860508db1d2096bf Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1053339716-project Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68'} Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:16:12.193324 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:16:12.200219 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:16:12.200219 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:12.200219 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:16:12.200219 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:12.200219 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:12.200219 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:16:12.200219 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:16:12.200219 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:16:12.200219 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:16:12.200219 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:16:12.200219 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:16:12.203156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8f090891-39c2-437c-899e-7a1c567a4101 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Returning 404 to user: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:16:12.207483 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8f090891-39c2-437c-899e-7a1c567a4101 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 404 len: 111 microversion: 2.20 time: 0.119810 Sep 08 13:16:12.211895 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2462/5056] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Sep 8 13:16:12 2022] DELETE /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:16:12.221996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d8902c0-5b53-4f0e-be9f-ff758f6bf2f8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:16:12.223872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6d8902c0-5b53-4f0e-be9f-ff758f6bf2f8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] [instance: a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:16:12.232247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=28 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:16:12.242657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d8902c0-5b53-4f0e-be9f-ff758f6bf2f8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:12.244063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d8902c0-5b53-4f0e-be9f-ff758f6bf2f8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:12.244859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d8902c0-5b53-4f0e-be9f-ff758f6bf2f8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:12.245948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d8902c0-5b53-4f0e-be9f-ff758f6bf2f8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:16:12.246691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d8902c0-5b53-4f0e-be9f-ff758f6bf2f8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:16:12.247404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d8902c0-5b53-4f0e-be9f-ff758f6bf2f8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:16:12.270396 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6d8902c0-5b53-4f0e-be9f-ff758f6bf2f8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] HTTP exception thrown: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d8902c0-5b53-4f0e-be9f-ff758f6bf2f8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Request method failure captured: Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 HTTP/1.1 Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGejeY0G7Pzyo12zPbsJqxZazCm5XfFy5FeKTeuh2Cdz68kKa0hH5jVX-3GV2irJwRgmKI9ZKR9NXuG0gYi5tJIiri4zZkWklfHVzADvV5rMZsKtNYjvYuOWjj0gXceyBIowOvBzkOk2lsIp6cVXn0cZFXdU6ulV1gf9CrxhR2a60OVg Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Openstack-Nova-Api-Version: 2.20 Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 4b0e146de89146b9b1d07a8b07b1b77b Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4b0e146de89146b9b1d07a8b07b1b77b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 4b0e146de89146b9b1d07a8b07b1b77b Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1053339716 Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachVolumeShelveTestJSON-1053339716-project Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: d9ccc775b0764dbf860508db1d2096bf Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1053339716-project Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68'} Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:16:12.273408 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:16:12.278626 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:16:12.278626 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:16:12.278626 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:16:12.278626 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:16:12.278626 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:16:12.278626 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:16:12.278626 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. Sep 08 13:16:12.278626 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:16:12.282800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d8902c0-5b53-4f0e-be9f-ff758f6bf2f8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] Returning 404 to user: Instance a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:16:12.284123 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6d8902c0-5b53-4f0e-be9f-ff758f6bf2f8 tempest-AttachVolumeShelveTestJSON-1053339716 tempest-AttachVolumeShelveTestJSON-1053339716-project] 10.222.0.78 "GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68" status: 404 len: 111 microversion: 2.20 time: 0.067636 Sep 08 13:16:12.285375 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2595/5057] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Sep 8 13:16:12 2022] GET /compute/v2.1/servers/a7948b57-fc0d-4ae5-80b5-6b59cfe6fd68 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:17:20.328611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=7 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:17:20.329845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=9 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:17:21.032631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1a972e75-1d46-44bb-aeb5-dd55c8b9f2a5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Action: 'create', calling method: .version_select at 0x7fdb3f116e50>, body: {"keypair": {"name": "tempest-keypair-1405915329", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrngEKt26pkUVHMl2fQlxT5tp58vuMm0YHTlkX5g9idj+EqO8e50XpPcSeblsDDF3a4CBiF4wuyuWYt0fGC8IG9JWLqIcdeaqgn6k51II3mNYGda4+nQA1aldzFeUARTQ=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:17:21.122089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-1a972e75-1d46-44bb-aeb5-dd55c8b9f2a5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Getting quotas for project 8ba356cf57224bcdb710a75c346f386d. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:17:21.149645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-1a972e75-1d46-44bb-aeb5-dd55c8b9f2a5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Getting quotas for user 334fc689cca7450f82f3603de32a5a19 and project 8ba356cf57224bcdb710a75c346f386d. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:17:21.251150 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1a972e75-1d46-44bb-aeb5-dd55c8b9f2a5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.926692 Sep 08 13:17:21.252276 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2463/5058] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:17:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:17:27.651360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1388677184", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c41ee687-af4b-4aa3-88c2-b6f8e5d2a2fa"}], "security_groups": [{"name": "tempest-securitygroup--1503066984"}], "key_name": "tempest-keypair-1405915329", "user_data": "}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:17:27.725054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:17:27.729528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=49 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:17:27.732641 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:17:27.733387 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 13:17:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Sep 08 13:17:27.740834 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:17:27.741085 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 13:17:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Sep 08 13:17:28.081213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] validate_networks() for [('c41ee687-af4b-4aa3-88c2-b6f8e5d2a2fa', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:17:29.603103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:17:29.605232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:17:29.606526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:17:29.607687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:17:29.609091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:17:29.635214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:29.636669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:29.637783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:29.639864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:29.641128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:29.642251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:29.690439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Getting quotas for project 8ba356cf57224bcdb710a75c346f386d. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:17:29.704364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Getting quotas for user 334fc689cca7450f82f3603de32a5a19 and project 8ba356cf57224bcdb710a75c346f386d. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:17:29.755343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:17:29.760991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:17:29.971606 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-69f51602-fa06-442c-b9f5-c43efa2da8e6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.334823 Sep 08 13:17:29.990369 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2596/5059] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:17:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 2345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:17:30.002267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cb51b964-11af-4d1a-8322-e3b8b8352291 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:30.008730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cb51b964-11af-4d1a-8322-e3b8b8352291 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:30.178291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cb51b964-11af-4d1a-8322-e3b8b8352291 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:30.198106 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cb51b964-11af-4d1a-8322-e3b8b8352291 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1238 microversion: 2.1 time: 0.202985 Sep 08 13:17:30.199153 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2464/5060] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:29 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1238 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:17:31.250915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-afedff6d-b1c8-4e69-86bf-dd6a388cc0d8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:31.260519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-afedff6d-b1c8-4e69-86bf-dd6a388cc0d8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:31.311967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afedff6d-b1c8-4e69-86bf-dd6a388cc0d8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:31.312599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afedff6d-b1c8-4e69-86bf-dd6a388cc0d8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:31.313242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afedff6d-b1c8-4e69-86bf-dd6a388cc0d8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:31.314306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afedff6d-b1c8-4e69-86bf-dd6a388cc0d8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:31.315171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afedff6d-b1c8-4e69-86bf-dd6a388cc0d8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:31.315860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afedff6d-b1c8-4e69-86bf-dd6a388cc0d8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:31.737165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-afedff6d-b1c8-4e69-86bf-dd6a388cc0d8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:31.750716 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-afedff6d-b1c8-4e69-86bf-dd6a388cc0d8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1242 microversion: 2.1 time: 0.513606 Sep 08 13:17:31.759180 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2597/5061] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:31 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1242 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:17:32.808732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a29ec087-7591-400d-949e-0c09d4c46b36 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:32.809669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a29ec087-7591-400d-949e-0c09d4c46b36 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:32.858131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a29ec087-7591-400d-949e-0c09d4c46b36 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:32.859182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a29ec087-7591-400d-949e-0c09d4c46b36 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:32.860161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a29ec087-7591-400d-949e-0c09d4c46b36 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:32.861329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a29ec087-7591-400d-949e-0c09d4c46b36 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:32.862175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a29ec087-7591-400d-949e-0c09d4c46b36 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:32.868278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a29ec087-7591-400d-949e-0c09d4c46b36 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:33.741578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a29ec087-7591-400d-949e-0c09d4c46b36 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:33.750853 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a29ec087-7591-400d-949e-0c09d4c46b36 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1308 microversion: 2.1 time: 0.951176 Sep 08 13:17:33.755751 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2465/5062] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:32 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1308 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:17:34.799089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-85aaf311-18b0-4f89-a989-59847c16dddb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:34.801460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-85aaf311-18b0-4f89-a989-59847c16dddb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:34.812981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85aaf311-18b0-4f89-a989-59847c16dddb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:34.813712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85aaf311-18b0-4f89-a989-59847c16dddb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:34.814447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85aaf311-18b0-4f89-a989-59847c16dddb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:34.815441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85aaf311-18b0-4f89-a989-59847c16dddb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:34.816150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85aaf311-18b0-4f89-a989-59847c16dddb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:34.816802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85aaf311-18b0-4f89-a989-59847c16dddb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:35.120068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-85aaf311-18b0-4f89-a989-59847c16dddb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:35.169310 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-85aaf311-18b0-4f89-a989-59847c16dddb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1296 microversion: 2.1 time: 0.370413 Sep 08 13:17:35.173966 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2598/5063] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:34 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1296 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:17:36.200003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e366e4c2-6058-4f63-8ede-cce42e652da1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:36.201388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e366e4c2-6058-4f63-8ede-cce42e652da1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:36.250758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e366e4c2-6058-4f63-8ede-cce42e652da1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:36.258931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e366e4c2-6058-4f63-8ede-cce42e652da1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:36.264920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e366e4c2-6058-4f63-8ede-cce42e652da1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:36.265721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e366e4c2-6058-4f63-8ede-cce42e652da1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:36.266257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e366e4c2-6058-4f63-8ede-cce42e652da1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:36.266678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e366e4c2-6058-4f63-8ede-cce42e652da1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:36.534158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e366e4c2-6058-4f63-8ede-cce42e652da1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:36.556961 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e366e4c2-6058-4f63-8ede-cce42e652da1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1296 microversion: 2.1 time: 0.359155 Sep 08 13:17:36.560942 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2466/5064] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:36 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1296 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:17:37.606394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-68cfece6-94cb-4389-8b8c-374f00835486 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:37.610743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-68cfece6-94cb-4389-8b8c-374f00835486 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:37.659608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68cfece6-94cb-4389-8b8c-374f00835486 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:37.660867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68cfece6-94cb-4389-8b8c-374f00835486 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:37.661476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68cfece6-94cb-4389-8b8c-374f00835486 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:37.666458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68cfece6-94cb-4389-8b8c-374f00835486 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:37.671854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68cfece6-94cb-4389-8b8c-374f00835486 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:37.672556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68cfece6-94cb-4389-8b8c-374f00835486 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:39.228249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-68cfece6-94cb-4389-8b8c-374f00835486 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:39.272664 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-68cfece6-94cb-4389-8b8c-374f00835486 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1364 microversion: 2.1 time: 1.671183 Sep 08 13:17:39.276874 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2599/5065] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:37 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1364 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:17:40.319470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:17:40.335768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b32a662a-d7d7-44c9-bf38-8ff17cf17118 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:40.338629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b32a662a-d7d7-44c9-bf38-8ff17cf17118 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:40.350839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b32a662a-d7d7-44c9-bf38-8ff17cf17118 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:40.353948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b32a662a-d7d7-44c9-bf38-8ff17cf17118 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:40.364025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b32a662a-d7d7-44c9-bf38-8ff17cf17118 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:40.365595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b32a662a-d7d7-44c9-bf38-8ff17cf17118 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:40.366258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b32a662a-d7d7-44c9-bf38-8ff17cf17118 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:40.366794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b32a662a-d7d7-44c9-bf38-8ff17cf17118 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:41.908677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b32a662a-d7d7-44c9-bf38-8ff17cf17118 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:41.942738 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b32a662a-d7d7-44c9-bf38-8ff17cf17118 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1364 microversion: 2.1 time: 1.614708 Sep 08 13:17:41.961406 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2467/5066] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:40 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1364 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:17:42.988871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5398b7e9-c54d-491b-93e5-ca0b348e65c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:42.989681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5398b7e9-c54d-491b-93e5-ca0b348e65c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:42.994145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:17:43.005630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:17:43.032697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5398b7e9-c54d-491b-93e5-ca0b348e65c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:43.033219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5398b7e9-c54d-491b-93e5-ca0b348e65c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:43.033685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5398b7e9-c54d-491b-93e5-ca0b348e65c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:43.034440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5398b7e9-c54d-491b-93e5-ca0b348e65c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:43.034917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5398b7e9-c54d-491b-93e5-ca0b348e65c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:43.035463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5398b7e9-c54d-491b-93e5-ca0b348e65c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:45.405860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5398b7e9-c54d-491b-93e5-ca0b348e65c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:45.415433 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5398b7e9-c54d-491b-93e5-ca0b348e65c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1364 microversion: 2.1 time: 2.430897 Sep 08 13:17:45.435989 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2600/5067] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:42 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1364 bytes in 2452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:17:46.030610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c1ddd763-2ad0-4405-a025-52e4f75ac506 req-12c14f4d-5393-4dbd-806a-e5f06f1ed5ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96514589-9deb-48df-95d3-5b3c56d620ac", "tag": "073c7e49-1f65-49ba-bf02-05582aa538af"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:17:46.056563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c1ddd763-2ad0-4405-a025-52e4f75ac506 req-12c14f4d-5393-4dbd-806a-e5f06f1ed5ab service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:46.057863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c1ddd763-2ad0-4405-a025-52e4f75ac506 req-12c14f4d-5393-4dbd-806a-e5f06f1ed5ab service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:46.059619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c1ddd763-2ad0-4405-a025-52e4f75ac506 req-12c14f4d-5393-4dbd-806a-e5f06f1ed5ab service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:46.080907 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c1ddd763-2ad0-4405-a025-52e4f75ac506 req-12c14f4d-5393-4dbd-806a-e5f06f1ed5ab service nova] Creating event network-changed:073c7e49-1f65-49ba-bf02-05582aa538af for instance 96514589-9deb-48df-95d3-5b3c56d620ac on n-h2-852084-10 Sep 08 13:17:46.089574 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c1ddd763-2ad0-4405-a025-52e4f75ac506 req-12c14f4d-5393-4dbd-806a-e5f06f1ed5ab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068263 Sep 08 13:17:46.090928 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2468/5068] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:17:46.458299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-01a5deae-218f-4e20-90f4-083bdfd58c9e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:46.459387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-01a5deae-218f-4e20-90f4-083bdfd58c9e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:46.483040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01a5deae-218f-4e20-90f4-083bdfd58c9e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:46.483853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01a5deae-218f-4e20-90f4-083bdfd58c9e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:46.493139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01a5deae-218f-4e20-90f4-083bdfd58c9e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:46.496330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01a5deae-218f-4e20-90f4-083bdfd58c9e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:46.497125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01a5deae-218f-4e20-90f4-083bdfd58c9e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:46.497720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01a5deae-218f-4e20-90f4-083bdfd58c9e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:47.726771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-01a5deae-218f-4e20-90f4-083bdfd58c9e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:47.751784 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-01a5deae-218f-4e20-90f4-083bdfd58c9e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1364 microversion: 2.1 time: 1.304703 Sep 08 13:17:47.756425 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2601/5069] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:46 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1364 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:17:48.796600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b8871514-c556-46e6-9f16-7707a427dc0a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:48.797910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b8871514-c556-46e6-9f16-7707a427dc0a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:48.850264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8871514-c556-46e6-9f16-7707a427dc0a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:48.851141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8871514-c556-46e6-9f16-7707a427dc0a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:48.870323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8871514-c556-46e6-9f16-7707a427dc0a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:48.875276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8871514-c556-46e6-9f16-7707a427dc0a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:48.875276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8871514-c556-46e6-9f16-7707a427dc0a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:48.875276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b8871514-c556-46e6-9f16-7707a427dc0a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:50.066522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b8871514-c556-46e6-9f16-7707a427dc0a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:50.086840 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b8871514-c556-46e6-9f16-7707a427dc0a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1364 microversion: 2.1 time: 1.299407 Sep 08 13:17:50.089295 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2469/5070] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:48 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1364 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:17:51.144617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca8374dd-a929-4026-8b04-1c99dfa3a5fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:51.148663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ca8374dd-a929-4026-8b04-1c99dfa3a5fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:51.188448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca8374dd-a929-4026-8b04-1c99dfa3a5fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:51.192816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca8374dd-a929-4026-8b04-1c99dfa3a5fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:51.196638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca8374dd-a929-4026-8b04-1c99dfa3a5fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:51.199964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca8374dd-a929-4026-8b04-1c99dfa3a5fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:51.203772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca8374dd-a929-4026-8b04-1c99dfa3a5fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:51.206232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca8374dd-a929-4026-8b04-1c99dfa3a5fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:53.406997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ca8374dd-a929-4026-8b04-1c99dfa3a5fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:53.455946 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca8374dd-a929-4026-8b04-1c99dfa3a5fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1364 microversion: 2.1 time: 2.314916 Sep 08 13:17:53.461982 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2602/5071] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:51 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1364 bytes in 2325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:17:54.511833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-29aa7be9-b0f6-4f49-bf89-0c36feb99b85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:54.513165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-29aa7be9-b0f6-4f49-bf89-0c36feb99b85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:54.517277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:17:54.545414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29aa7be9-b0f6-4f49-bf89-0c36feb99b85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:54.546013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29aa7be9-b0f6-4f49-bf89-0c36feb99b85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:54.546629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29aa7be9-b0f6-4f49-bf89-0c36feb99b85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:54.547640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29aa7be9-b0f6-4f49-bf89-0c36feb99b85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:54.548353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29aa7be9-b0f6-4f49-bf89-0c36feb99b85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:54.548876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-29aa7be9-b0f6-4f49-bf89-0c36feb99b85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:55.609530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-29aa7be9-b0f6-4f49-bf89-0c36feb99b85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:55.631465 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-29aa7be9-b0f6-4f49-bf89-0c36feb99b85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1364 microversion: 2.1 time: 1.124444 Sep 08 13:17:55.639686 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2470/5072] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:54 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1364 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:17:56.396296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-1ed68507-be57-48c4-9614-a069cd074d07 req-a0d16de7-9bdc-438f-8607-dd6e60c18b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96514589-9deb-48df-95d3-5b3c56d620ac", "name": "network-vif-plugged", "status": "completed", "tag": "073c7e49-1f65-49ba-bf02-05582aa538af"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:17:56.444673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1ed68507-be57-48c4-9614-a069cd074d07 req-a0d16de7-9bdc-438f-8607-dd6e60c18b8c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:56.446379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1ed68507-be57-48c4-9614-a069cd074d07 req-a0d16de7-9bdc-438f-8607-dd6e60c18b8c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:56.447721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1ed68507-be57-48c4-9614-a069cd074d07 req-a0d16de7-9bdc-438f-8607-dd6e60c18b8c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:56.485049 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1ed68507-be57-48c4-9614-a069cd074d07 req-a0d16de7-9bdc-438f-8607-dd6e60c18b8c service nova] Creating event network-vif-plugged:073c7e49-1f65-49ba-bf02-05582aa538af for instance 96514589-9deb-48df-95d3-5b3c56d620ac on n-h2-852084-10 Sep 08 13:17:56.513551 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-1ed68507-be57-48c4-9614-a069cd074d07 req-a0d16de7-9bdc-438f-8607-dd6e60c18b8c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158331 Sep 08 13:17:56.518910 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2603/5073] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:17:56.671261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-65840a3f-eb5c-42d4-b851-0d1c40c6e101 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:56.678134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-65840a3f-eb5c-42d4-b851-0d1c40c6e101 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:56.701106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65840a3f-eb5c-42d4-b851-0d1c40c6e101 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:56.701498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65840a3f-eb5c-42d4-b851-0d1c40c6e101 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:56.715797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65840a3f-eb5c-42d4-b851-0d1c40c6e101 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:56.717317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65840a3f-eb5c-42d4-b851-0d1c40c6e101 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:56.718125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65840a3f-eb5c-42d4-b851-0d1c40c6e101 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:56.718950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65840a3f-eb5c-42d4-b851-0d1c40c6e101 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:57.911894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-65840a3f-eb5c-42d4-b851-0d1c40c6e101 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:57.956256 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-65840a3f-eb5c-42d4-b851-0d1c40c6e101 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1364 microversion: 2.1 time: 1.290498 Sep 08 13:17:57.958732 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2471/5074] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:56 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1364 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:17:59.008336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8589c5d1-5841-4540-9c21-4c8e38a3676e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:59.010469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8589c5d1-5841-4540-9c21-4c8e38a3676e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:59.027461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:17:59.030459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8589c5d1-5841-4540-9c21-4c8e38a3676e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:59.033846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8589c5d1-5841-4540-9c21-4c8e38a3676e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:59.035477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8589c5d1-5841-4540-9c21-4c8e38a3676e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:59.036767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8589c5d1-5841-4540-9c21-4c8e38a3676e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:59.037553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8589c5d1-5841-4540-9c21-4c8e38a3676e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:59.038446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8589c5d1-5841-4540-9c21-4c8e38a3676e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:59.049894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=41 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:17:59.468859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8589c5d1-5841-4540-9c21-4c8e38a3676e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:17:59.519725 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8589c5d1-5841-4540-9c21-4c8e38a3676e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1550 microversion: 2.1 time: 0.517050 Sep 08 13:17:59.527034 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2604/5075] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:17:58 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1550 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:17:59.568445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7543edde-0b21-4932-a18a-aa61330ef4ba tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:17:59.571864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7543edde-0b21-4932-a18a-aa61330ef4ba tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:17:59.586364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7543edde-0b21-4932-a18a-aa61330ef4ba tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:59.587643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7543edde-0b21-4932-a18a-aa61330ef4ba tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:59.588610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7543edde-0b21-4932-a18a-aa61330ef4ba tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:59.591093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7543edde-0b21-4932-a18a-aa61330ef4ba tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:17:59.592409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7543edde-0b21-4932-a18a-aa61330ef4ba tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:17:59.593380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7543edde-0b21-4932-a18a-aa61330ef4ba tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:17:59.893088 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7543edde-0b21-4932-a18a-aa61330ef4ba tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.333052 Sep 08 13:17:59.897238 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2472/5076] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:17:59 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/os-interface => generated 285 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:18:09.050499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:18:09.355616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-8b7c8137-eaad-4b80-a2c0-c85a2f2327a5 req-7d4b69ee-ca5a-4e5b-a521-cdff34eacba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96514589-9deb-48df-95d3-5b3c56d620ac", "tag": "073c7e49-1f65-49ba-bf02-05582aa538af"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:18:09.395528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8b7c8137-eaad-4b80-a2c0-c85a2f2327a5 req-7d4b69ee-ca5a-4e5b-a521-cdff34eacba8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:18:09.400267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8b7c8137-eaad-4b80-a2c0-c85a2f2327a5 req-7d4b69ee-ca5a-4e5b-a521-cdff34eacba8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:18:09.401600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8b7c8137-eaad-4b80-a2c0-c85a2f2327a5 req-7d4b69ee-ca5a-4e5b-a521-cdff34eacba8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:18:09.461331 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-8b7c8137-eaad-4b80-a2c0-c85a2f2327a5 req-7d4b69ee-ca5a-4e5b-a521-cdff34eacba8 service nova] Creating event network-changed:073c7e49-1f65-49ba-bf02-05582aa538af for instance 96514589-9deb-48df-95d3-5b3c56d620ac on n-h2-852084-10 Sep 08 13:18:09.483081 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-8b7c8137-eaad-4b80-a2c0-c85a2f2327a5 req-7d4b69ee-ca5a-4e5b-a521-cdff34eacba8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.166032 Sep 08 13:18:09.491889 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2605/5077] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:18:34.086395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fe5589f0-46e5-4dee-8d99-2cc3448c23fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:18:34.087275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fe5589f0-46e5-4dee-8d99-2cc3448c23fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:18:34.096541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=5 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:18:34.098005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=42 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:18:34.139277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe5589f0-46e5-4dee-8d99-2cc3448c23fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:18:34.139823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe5589f0-46e5-4dee-8d99-2cc3448c23fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:18:34.140354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe5589f0-46e5-4dee-8d99-2cc3448c23fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:18:34.141137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe5589f0-46e5-4dee-8d99-2cc3448c23fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:18:34.141678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe5589f0-46e5-4dee-8d99-2cc3448c23fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:18:34.142127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe5589f0-46e5-4dee-8d99-2cc3448c23fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:18:34.233121 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fe5589f0-46e5-4dee-8d99-2cc3448c23fc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/ips" status: 200 len: 145 microversion: 2.1 time: 0.152542 Sep 08 13:18:34.251268 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2473/5078] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 13:18:34 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/ips => generated 145 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:18:40.090164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:18:40.092217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=7 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:18:40.131491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c53d4d5c-4f92-4ea8-b975-757993473ea3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aaa5433c-8658-42ad-9696-4a47c02701f9"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:18:40.159937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c53d4d5c-4f92-4ea8-b975-757993473ea3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:18:40.199683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c53d4d5c-4f92-4ea8-b975-757993473ea3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:18:40.201487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c53d4d5c-4f92-4ea8-b975-757993473ea3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:18:40.204628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c53d4d5c-4f92-4ea8-b975-757993473ea3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:18:40.211907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c53d4d5c-4f92-4ea8-b975-757993473ea3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:18:40.215889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c53d4d5c-4f92-4ea8-b975-757993473ea3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:18:40.216576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c53d4d5c-4f92-4ea8-b975-757993473ea3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:18:41.154211 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c53d4d5c-4f92-4ea8-b975-757993473ea3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "POST /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.059221 Sep 08 13:18:41.160446 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2606/5079] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:18:40 2022] POST /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/os-volume_attachments => generated 194 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:19:16.483517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1db517fa-9aa8-485a-b952-e4b01ceacb27 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:19:16.501100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:19:16.502862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:19:16.506991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1db517fa-9aa8-485a-b952-e4b01ceacb27 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:16.508329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1db517fa-9aa8-485a-b952-e4b01ceacb27 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:16.509171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1db517fa-9aa8-485a-b952-e4b01ceacb27 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:16.595713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1db517fa-9aa8-485a-b952-e4b01ceacb27 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Going to try to stop instance {{(pid=128971) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 13:19:16.749507 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1db517fa-9aa8-485a-b952-e4b01ceacb27 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "POST /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/action" status: 202 len: 0 microversion: 2.1 time: 0.270227 Sep 08 13:19:16.767580 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2474/5080] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:19:16 2022] POST /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:19:16.768877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b29b2be6-e49d-4af0-b3ce-0d7b84f866d5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:16.771511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b29b2be6-e49d-4af0-b3ce-0d7b84f866d5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:16.791130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:19:16.797065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:19:16.832498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b29b2be6-e49d-4af0-b3ce-0d7b84f866d5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:16.847657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b29b2be6-e49d-4af0-b3ce-0d7b84f866d5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:16.849148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b29b2be6-e49d-4af0-b3ce-0d7b84f866d5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:16.851171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b29b2be6-e49d-4af0-b3ce-0d7b84f866d5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:16.852421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b29b2be6-e49d-4af0-b3ce-0d7b84f866d5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:16.853312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b29b2be6-e49d-4af0-b3ce-0d7b84f866d5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:18.144786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b29b2be6-e49d-4af0-b3ce-0d7b84f866d5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:18.184112 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b29b2be6-e49d-4af0-b3ce-0d7b84f866d5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 1.420296 Sep 08 13:19:18.216964 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2607/5081] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:16 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:19.235489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c570ccc3-8fb6-428f-be1c-c7277b615714 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:19.236646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c570ccc3-8fb6-428f-be1c-c7277b615714 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:19.254579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c570ccc3-8fb6-428f-be1c-c7277b615714 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:19.258625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c570ccc3-8fb6-428f-be1c-c7277b615714 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:19.259465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c570ccc3-8fb6-428f-be1c-c7277b615714 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:19.260427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c570ccc3-8fb6-428f-be1c-c7277b615714 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:19.264517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c570ccc3-8fb6-428f-be1c-c7277b615714 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:19.265365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c570ccc3-8fb6-428f-be1c-c7277b615714 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:20.277697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c570ccc3-8fb6-428f-be1c-c7277b615714 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:20.326004 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c570ccc3-8fb6-428f-be1c-c7277b615714 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 1.095248 Sep 08 13:19:20.327351 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2475/5082] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:19 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:19:21.374615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eeaddebd-5016-427b-a02c-ed9978a182cc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:21.376789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eeaddebd-5016-427b-a02c-ed9978a182cc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:21.423809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eeaddebd-5016-427b-a02c-ed9978a182cc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:21.425176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eeaddebd-5016-427b-a02c-ed9978a182cc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:21.426302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eeaddebd-5016-427b-a02c-ed9978a182cc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:21.428504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eeaddebd-5016-427b-a02c-ed9978a182cc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:21.429760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eeaddebd-5016-427b-a02c-ed9978a182cc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:21.430935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eeaddebd-5016-427b-a02c-ed9978a182cc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:21.984276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eeaddebd-5016-427b-a02c-ed9978a182cc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:22.012711 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eeaddebd-5016-427b-a02c-ed9978a182cc tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 0.644369 Sep 08 13:19:22.033143 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2608/5083] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:21 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:23.062920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a3a17a62-dc0f-4a8d-abd5-d3a06bef060a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:23.065419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a3a17a62-dc0f-4a8d-abd5-d3a06bef060a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:23.099590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3a17a62-dc0f-4a8d-abd5-d3a06bef060a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:23.102019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3a17a62-dc0f-4a8d-abd5-d3a06bef060a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:23.112436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3a17a62-dc0f-4a8d-abd5-d3a06bef060a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:23.117940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3a17a62-dc0f-4a8d-abd5-d3a06bef060a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:23.119527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3a17a62-dc0f-4a8d-abd5-d3a06bef060a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:23.122531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3a17a62-dc0f-4a8d-abd5-d3a06bef060a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:23.619653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a3a17a62-dc0f-4a8d-abd5-d3a06bef060a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:23.655577 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a3a17a62-dc0f-4a8d-abd5-d3a06bef060a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 0.600509 Sep 08 13:19:23.664125 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2476/5084] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:23 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:24.711744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33a04017-3d29-4e8c-8ea3-95a269d2f712 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:24.722330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-33a04017-3d29-4e8c-8ea3-95a269d2f712 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:24.763723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33a04017-3d29-4e8c-8ea3-95a269d2f712 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:24.768843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33a04017-3d29-4e8c-8ea3-95a269d2f712 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:24.770551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33a04017-3d29-4e8c-8ea3-95a269d2f712 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:24.781666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33a04017-3d29-4e8c-8ea3-95a269d2f712 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:24.785475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33a04017-3d29-4e8c-8ea3-95a269d2f712 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:24.786764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33a04017-3d29-4e8c-8ea3-95a269d2f712 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:25.811358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-33a04017-3d29-4e8c-8ea3-95a269d2f712 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:25.848750 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-33a04017-3d29-4e8c-8ea3-95a269d2f712 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 1.145355 Sep 08 13:19:25.849383 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2609/5085] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:24 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:26.906797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e193159e-2f51-4062-9b89-62e14bf15fe2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:26.908278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e193159e-2f51-4062-9b89-62e14bf15fe2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:26.944833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e193159e-2f51-4062-9b89-62e14bf15fe2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:26.946476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e193159e-2f51-4062-9b89-62e14bf15fe2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:26.947764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e193159e-2f51-4062-9b89-62e14bf15fe2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:26.957910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e193159e-2f51-4062-9b89-62e14bf15fe2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:26.962831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e193159e-2f51-4062-9b89-62e14bf15fe2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:26.964682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e193159e-2f51-4062-9b89-62e14bf15fe2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:27.405446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e193159e-2f51-4062-9b89-62e14bf15fe2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:27.419181 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e193159e-2f51-4062-9b89-62e14bf15fe2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 0.520934 Sep 08 13:19:27.425850 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2477/5086] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:26 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:28.460583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-38ced0ce-11a6-42c3-88e1-cfd8cdeb12c6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:28.461213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-38ced0ce-11a6-42c3-88e1-cfd8cdeb12c6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:28.479732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38ced0ce-11a6-42c3-88e1-cfd8cdeb12c6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:28.480246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38ced0ce-11a6-42c3-88e1-cfd8cdeb12c6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:28.480698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38ced0ce-11a6-42c3-88e1-cfd8cdeb12c6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:28.481449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38ced0ce-11a6-42c3-88e1-cfd8cdeb12c6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:28.481918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38ced0ce-11a6-42c3-88e1-cfd8cdeb12c6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:28.482354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-38ced0ce-11a6-42c3-88e1-cfd8cdeb12c6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:29.427436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-38ced0ce-11a6-42c3-88e1-cfd8cdeb12c6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:29.461596 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-38ced0ce-11a6-42c3-88e1-cfd8cdeb12c6 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 1.003383 Sep 08 13:19:29.463487 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2610/5087] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:28 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:30.491068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ddd0f889-2535-4c48-87c9-b736b7a60551 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:30.492245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ddd0f889-2535-4c48-87c9-b736b7a60551 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:30.544464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddd0f889-2535-4c48-87c9-b736b7a60551 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:30.553471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddd0f889-2535-4c48-87c9-b736b7a60551 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:30.572032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddd0f889-2535-4c48-87c9-b736b7a60551 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:30.574189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddd0f889-2535-4c48-87c9-b736b7a60551 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:30.575753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddd0f889-2535-4c48-87c9-b736b7a60551 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:30.580419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddd0f889-2535-4c48-87c9-b736b7a60551 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:31.239117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ddd0f889-2535-4c48-87c9-b736b7a60551 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:31.257513 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ddd0f889-2535-4c48-87c9-b736b7a60551 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 0.773917 Sep 08 13:19:31.258117 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2478/5088] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:30 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:32.291707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3bf29b56-767c-4928-b939-cea167cc929d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:32.292843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3bf29b56-767c-4928-b939-cea167cc929d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:32.306473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bf29b56-767c-4928-b939-cea167cc929d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:32.307270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bf29b56-767c-4928-b939-cea167cc929d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:32.309126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bf29b56-767c-4928-b939-cea167cc929d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:32.316020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bf29b56-767c-4928-b939-cea167cc929d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:32.317256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bf29b56-767c-4928-b939-cea167cc929d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:32.323187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bf29b56-767c-4928-b939-cea167cc929d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:33.206632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3bf29b56-767c-4928-b939-cea167cc929d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:33.249189 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3bf29b56-767c-4928-b939-cea167cc929d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 0.960621 Sep 08 13:19:33.250737 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2611/5089] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:32 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:34.275893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4ef78b73-9ba7-4780-8e92-29baa5e1d0e0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:34.276788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ef78b73-9ba7-4780-8e92-29baa5e1d0e0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:34.292466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ef78b73-9ba7-4780-8e92-29baa5e1d0e0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:34.293565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ef78b73-9ba7-4780-8e92-29baa5e1d0e0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:34.294223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ef78b73-9ba7-4780-8e92-29baa5e1d0e0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:34.295850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ef78b73-9ba7-4780-8e92-29baa5e1d0e0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:34.296677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ef78b73-9ba7-4780-8e92-29baa5e1d0e0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:34.297737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ef78b73-9ba7-4780-8e92-29baa5e1d0e0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:35.763450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4ef78b73-9ba7-4780-8e92-29baa5e1d0e0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:35.797925 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4ef78b73-9ba7-4780-8e92-29baa5e1d0e0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 1.526156 Sep 08 13:19:35.833608 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2479/5090] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:34 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 1563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:36.880778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-54d80702-438c-4f68-b0e8-b7fa963ef40b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:36.892319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-54d80702-438c-4f68-b0e8-b7fa963ef40b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:36.929424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d80702-438c-4f68-b0e8-b7fa963ef40b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:36.936714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d80702-438c-4f68-b0e8-b7fa963ef40b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:36.938163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d80702-438c-4f68-b0e8-b7fa963ef40b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:36.940447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d80702-438c-4f68-b0e8-b7fa963ef40b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:36.941747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d80702-438c-4f68-b0e8-b7fa963ef40b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:36.943211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d80702-438c-4f68-b0e8-b7fa963ef40b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:37.557815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-54d80702-438c-4f68-b0e8-b7fa963ef40b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:37.578663 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-54d80702-438c-4f68-b0e8-b7fa963ef40b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 0.715484 Sep 08 13:19:37.592031 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2612/5091] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:36 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:38.623870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6ad886ee-50bb-4161-b450-a01073b29849 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:38.628587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6ad886ee-50bb-4161-b450-a01073b29849 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:38.675782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ad886ee-50bb-4161-b450-a01073b29849 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:38.676751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ad886ee-50bb-4161-b450-a01073b29849 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:38.680425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ad886ee-50bb-4161-b450-a01073b29849 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:38.719834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ad886ee-50bb-4161-b450-a01073b29849 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:38.720793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ad886ee-50bb-4161-b450-a01073b29849 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:38.721822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ad886ee-50bb-4161-b450-a01073b29849 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:39.654338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6ad886ee-50bb-4161-b450-a01073b29849 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:39.675976 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6ad886ee-50bb-4161-b450-a01073b29849 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 1.066649 Sep 08 13:19:39.679320 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2480/5092] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:38 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:40.742435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e05ee0f-ea64-4175-8c20-16e7d06d45fe tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:40.750257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2e05ee0f-ea64-4175-8c20-16e7d06d45fe tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:40.781272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e05ee0f-ea64-4175-8c20-16e7d06d45fe tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:40.784353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e05ee0f-ea64-4175-8c20-16e7d06d45fe tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:40.789579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e05ee0f-ea64-4175-8c20-16e7d06d45fe tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:40.803657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e05ee0f-ea64-4175-8c20-16e7d06d45fe tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:40.806963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e05ee0f-ea64-4175-8c20-16e7d06d45fe tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:40.813420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e05ee0f-ea64-4175-8c20-16e7d06d45fe tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:42.210614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2e05ee0f-ea64-4175-8c20-16e7d06d45fe tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:42.225903 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2e05ee0f-ea64-4175-8c20-16e7d06d45fe tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1724 microversion: 2.1 time: 1.517707 Sep 08 13:19:42.259784 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2613/5093] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:40 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1724 bytes in 1553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:43.308900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-28a4e334-a9d5-44dc-9f70-2289b2dda903 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:43.310883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-28a4e334-a9d5-44dc-9f70-2289b2dda903 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:43.331711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28a4e334-a9d5-44dc-9f70-2289b2dda903 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:43.332683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28a4e334-a9d5-44dc-9f70-2289b2dda903 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:43.336075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28a4e334-a9d5-44dc-9f70-2289b2dda903 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:43.360219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28a4e334-a9d5-44dc-9f70-2289b2dda903 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:43.361268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28a4e334-a9d5-44dc-9f70-2289b2dda903 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:43.365059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28a4e334-a9d5-44dc-9f70-2289b2dda903 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:44.046065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-28a4e334-a9d5-44dc-9f70-2289b2dda903 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:44.063607 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-28a4e334-a9d5-44dc-9f70-2289b2dda903 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1701 microversion: 2.1 time: 0.778940 Sep 08 13:19:44.067032 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2481/5094] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:43 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1701 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:19:44.111088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f956f90b-fa4f-4f9e-916a-048542c85b75 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:19:44.127806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f956f90b-fa4f-4f9e-916a-048542c85b75 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:44.134508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f956f90b-fa4f-4f9e-916a-048542c85b75 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:44.135421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f956f90b-fa4f-4f9e-916a-048542c85b75 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:44.199885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f956f90b-fa4f-4f9e-916a-048542c85b75 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Going to try to start instance {{(pid=128970) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 13:19:44.324338 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f956f90b-fa4f-4f9e-916a-048542c85b75 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "POST /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/action" status: 202 len: 0 microversion: 2.1 time: 0.218490 Sep 08 13:19:44.325523 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2614/5095] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:19:44 2022] POST /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:19:44.338642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d8adc750-ec47-4bf1-9512-b8b46871b135 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:44.340591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d8adc750-ec47-4bf1-9512-b8b46871b135 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:44.357387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8adc750-ec47-4bf1-9512-b8b46871b135 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:44.357983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8adc750-ec47-4bf1-9512-b8b46871b135 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:44.358519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8adc750-ec47-4bf1-9512-b8b46871b135 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:44.359697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8adc750-ec47-4bf1-9512-b8b46871b135 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:44.360414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8adc750-ec47-4bf1-9512-b8b46871b135 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:44.361257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8adc750-ec47-4bf1-9512-b8b46871b135 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:44.901439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d8adc750-ec47-4bf1-9512-b8b46871b135 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:44.920179 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d8adc750-ec47-4bf1-9512-b8b46871b135 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1710 microversion: 2.1 time: 0.588907 Sep 08 13:19:44.922137 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2482/5096] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:44 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1710 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:45.973224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9712c612-b315-4a89-b52e-9db5b187678d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:45.974076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9712c612-b315-4a89-b52e-9db5b187678d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:46.004209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9712c612-b315-4a89-b52e-9db5b187678d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:46.008623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9712c612-b315-4a89-b52e-9db5b187678d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:46.009227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9712c612-b315-4a89-b52e-9db5b187678d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:46.010009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9712c612-b315-4a89-b52e-9db5b187678d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:46.010526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9712c612-b315-4a89-b52e-9db5b187678d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:46.010914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9712c612-b315-4a89-b52e-9db5b187678d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:48.042054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9712c612-b315-4a89-b52e-9db5b187678d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:48.047871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:19:48.087787 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9712c612-b315-4a89-b52e-9db5b187678d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1710 microversion: 2.1 time: 2.118716 Sep 08 13:19:48.089824 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2615/5097] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:45 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1710 bytes in 2122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:49.137340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0955896b-8bc6-4671-bb64-0822aa706a7c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:49.140078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0955896b-8bc6-4671-bb64-0822aa706a7c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:49.162077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=19 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:19:49.165209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0955896b-8bc6-4671-bb64-0822aa706a7c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:49.165811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0955896b-8bc6-4671-bb64-0822aa706a7c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:49.167834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0955896b-8bc6-4671-bb64-0822aa706a7c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:49.168863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0955896b-8bc6-4671-bb64-0822aa706a7c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:49.171039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0955896b-8bc6-4671-bb64-0822aa706a7c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:49.171890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0955896b-8bc6-4671-bb64-0822aa706a7c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:49.264052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:19:50.082893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0955896b-8bc6-4671-bb64-0822aa706a7c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:50.100878 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0955896b-8bc6-4671-bb64-0822aa706a7c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1710 microversion: 2.1 time: 0.984438 Sep 08 13:19:50.116498 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2483/5098] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:49 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1710 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:19:51.132112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0b1bf4fe-e972-4768-a3e7-9086a103eb29 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:19:51.136586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0b1bf4fe-e972-4768-a3e7-9086a103eb29 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:19:51.152041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=19 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:19:51.182917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b1bf4fe-e972-4768-a3e7-9086a103eb29 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:51.183905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b1bf4fe-e972-4768-a3e7-9086a103eb29 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:51.184988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b1bf4fe-e972-4768-a3e7-9086a103eb29 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:51.190791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b1bf4fe-e972-4768-a3e7-9086a103eb29 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:19:51.192178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b1bf4fe-e972-4768-a3e7-9086a103eb29 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:19:51.193929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b1bf4fe-e972-4768-a3e7-9086a103eb29 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:19:51.876597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0b1bf4fe-e972-4768-a3e7-9086a103eb29 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:19:51.930359 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0b1bf4fe-e972-4768-a3e7-9086a103eb29 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1714 microversion: 2.1 time: 0.804560 Sep 08 13:19:51.931752 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2616/5099] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:19:51 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1714 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:20:24.141324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3061235-1046-4145-9795-b2fc3f1f8c85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:20:24.146876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d3061235-1046-4145-9795-b2fc3f1f8c85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:20:24.163857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:20:24.164507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=5 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:20:24.169568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3061235-1046-4145-9795-b2fc3f1f8c85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:24.170276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3061235-1046-4145-9795-b2fc3f1f8c85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:24.170779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3061235-1046-4145-9795-b2fc3f1f8c85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:24.173398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3061235-1046-4145-9795-b2fc3f1f8c85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:24.175692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3061235-1046-4145-9795-b2fc3f1f8c85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:24.182069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3061235-1046-4145-9795-b2fc3f1f8c85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:24.397530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-d3061235-1046-4145-9795-b2fc3f1f8c85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lazy-loading 'services' on Instance uuid 96514589-9deb-48df-95d3-5b3c56d620ac {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:20:24.657235 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3061235-1046-4145-9795-b2fc3f1f8c85 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/os-volume_attachments/aaa5433c-8658-42ad-9696-4a47c02701f9" status: 202 len: 0 microversion: 2.1 time: 0.537773 Sep 08 13:20:24.658075 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2484/5100] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:20:24 2022] DELETE /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/os-volume_attachments/aaa5433c-8658-42ad-9696-4a47c02701f9 => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:20:43.838180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0b23aad9-a40d-4244-8024-14981e0b0388 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:20:43.847816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:20:43.850122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=7 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:20:43.852433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b23aad9-a40d-4244-8024-14981e0b0388 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:43.853339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b23aad9-a40d-4244-8024-14981e0b0388 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:43.853962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b23aad9-a40d-4244-8024-14981e0b0388 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:43.936790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0b23aad9-a40d-4244-8024-14981e0b0388 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Going to try to stop instance {{(pid=128970) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 13:20:44.099580 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0b23aad9-a40d-4244-8024-14981e0b0388 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "POST /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/action" status: 202 len: 0 microversion: 2.1 time: 0.266583 Sep 08 13:20:44.106272 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2617/5101] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:20:43 2022] POST /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:20:44.109901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:20:44.111292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:20:44.117760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-257f6b86-a371-4944-a4b6-ae061a45928c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:20:44.118524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-257f6b86-a371-4944-a4b6-ae061a45928c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:20:44.154673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-257f6b86-a371-4944-a4b6-ae061a45928c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:44.155460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-257f6b86-a371-4944-a4b6-ae061a45928c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:44.160918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-257f6b86-a371-4944-a4b6-ae061a45928c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:44.178400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-257f6b86-a371-4944-a4b6-ae061a45928c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:44.178400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-257f6b86-a371-4944-a4b6-ae061a45928c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:44.178400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-257f6b86-a371-4944-a4b6-ae061a45928c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:44.773304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-257f6b86-a371-4944-a4b6-ae061a45928c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:20:44.785101 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-257f6b86-a371-4944-a4b6-ae061a45928c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1678 microversion: 2.1 time: 0.677481 Sep 08 13:20:44.811888 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2485/5102] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:20:44 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1678 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:20:45.842005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-35e3d644-d359-4df9-a89a-2d62bf720b41 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:20:45.869602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-35e3d644-d359-4df9-a89a-2d62bf720b41 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:20:45.893666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35e3d644-d359-4df9-a89a-2d62bf720b41 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:45.895882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35e3d644-d359-4df9-a89a-2d62bf720b41 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:45.897186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35e3d644-d359-4df9-a89a-2d62bf720b41 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:45.899686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35e3d644-d359-4df9-a89a-2d62bf720b41 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:45.900946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35e3d644-d359-4df9-a89a-2d62bf720b41 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:45.902950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35e3d644-d359-4df9-a89a-2d62bf720b41 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:46.789726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-35e3d644-d359-4df9-a89a-2d62bf720b41 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:20:46.839152 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-35e3d644-d359-4df9-a89a-2d62bf720b41 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1678 microversion: 2.1 time: 1.023967 Sep 08 13:20:46.860942 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2618/5103] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:20:45 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1678 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:20:47.876020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-98628fea-29bf-472f-a97b-a6bed82b322a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:20:47.877575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-98628fea-29bf-472f-a97b-a6bed82b322a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:20:47.896927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98628fea-29bf-472f-a97b-a6bed82b322a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:47.903714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98628fea-29bf-472f-a97b-a6bed82b322a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:47.905576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98628fea-29bf-472f-a97b-a6bed82b322a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:47.906789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98628fea-29bf-472f-a97b-a6bed82b322a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:47.908875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98628fea-29bf-472f-a97b-a6bed82b322a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:47.912529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98628fea-29bf-472f-a97b-a6bed82b322a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:48.444644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-98628fea-29bf-472f-a97b-a6bed82b322a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:20:48.516364 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-98628fea-29bf-472f-a97b-a6bed82b322a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1678 microversion: 2.1 time: 0.648088 Sep 08 13:20:48.531682 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2486/5104] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:20:47 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1678 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:20:49.558622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eef5f2bb-a738-4984-ab86-4cfe5c290514 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:20:49.562983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eef5f2bb-a738-4984-ab86-4cfe5c290514 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:20:49.620815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef5f2bb-a738-4984-ab86-4cfe5c290514 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:49.622739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef5f2bb-a738-4984-ab86-4cfe5c290514 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:49.626805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef5f2bb-a738-4984-ab86-4cfe5c290514 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:49.636583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef5f2bb-a738-4984-ab86-4cfe5c290514 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:49.640727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef5f2bb-a738-4984-ab86-4cfe5c290514 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:49.642957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef5f2bb-a738-4984-ab86-4cfe5c290514 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:50.547567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eef5f2bb-a738-4984-ab86-4cfe5c290514 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:20:50.561249 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eef5f2bb-a738-4984-ab86-4cfe5c290514 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1678 microversion: 2.1 time: 1.015167 Sep 08 13:20:50.571535 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2619/5105] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:20:49 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1678 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:20:51.618458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-16f88136-7639-44a9-be22-8701c9171ad9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:20:51.627867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-16f88136-7639-44a9-be22-8701c9171ad9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:20:51.716057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16f88136-7639-44a9-be22-8701c9171ad9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:51.716586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16f88136-7639-44a9-be22-8701c9171ad9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:51.717222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16f88136-7639-44a9-be22-8701c9171ad9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:51.718346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16f88136-7639-44a9-be22-8701c9171ad9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:51.719636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16f88136-7639-44a9-be22-8701c9171ad9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:51.720261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16f88136-7639-44a9-be22-8701c9171ad9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:53.092103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-16f88136-7639-44a9-be22-8701c9171ad9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:20:53.102851 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-16f88136-7639-44a9-be22-8701c9171ad9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1678 microversion: 2.1 time: 1.491863 Sep 08 13:20:53.113506 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2487/5106] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:20:51 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1678 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:20:54.142337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d1e494c2-26de-47e0-9155-00cc69d83f8c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:20:54.144586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d1e494c2-26de-47e0-9155-00cc69d83f8c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:20:54.159613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1e494c2-26de-47e0-9155-00cc69d83f8c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:54.162349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1e494c2-26de-47e0-9155-00cc69d83f8c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:54.164517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1e494c2-26de-47e0-9155-00cc69d83f8c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:54.168429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1e494c2-26de-47e0-9155-00cc69d83f8c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:54.169245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1e494c2-26de-47e0-9155-00cc69d83f8c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:54.172579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1e494c2-26de-47e0-9155-00cc69d83f8c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:55.275627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d1e494c2-26de-47e0-9155-00cc69d83f8c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:20:55.306409 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d1e494c2-26de-47e0-9155-00cc69d83f8c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1678 microversion: 2.1 time: 1.169433 Sep 08 13:20:55.321439 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2620/5107] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:20:54 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1678 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:20:56.365782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-94a8582b-8f7c-4c52-95ba-e2988dbc6f4a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:20:56.367208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-94a8582b-8f7c-4c52-95ba-e2988dbc6f4a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:20:56.390267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94a8582b-8f7c-4c52-95ba-e2988dbc6f4a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:56.400862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94a8582b-8f7c-4c52-95ba-e2988dbc6f4a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:56.401861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94a8582b-8f7c-4c52-95ba-e2988dbc6f4a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:56.408757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94a8582b-8f7c-4c52-95ba-e2988dbc6f4a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:56.415655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94a8582b-8f7c-4c52-95ba-e2988dbc6f4a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:56.418724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94a8582b-8f7c-4c52-95ba-e2988dbc6f4a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:56.593474 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:20:56.593932 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 13:20:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac (ip 10.222.0.78) !!! Sep 08 13:20:56.595522 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:20:56.595935 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 13:20:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac (ip 10.222.0.78) !!! Sep 08 13:20:57.375680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-94a8582b-8f7c-4c52-95ba-e2988dbc6f4a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:20:57.393482 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-94a8582b-8f7c-4c52-95ba-e2988dbc6f4a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1655 microversion: 2.1 time: 1.034416 Sep 08 13:20:57.396742 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2488/5108] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:20:56 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1655 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:20:57.459072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2db7d770-fcfd-4738-81d3-9b9cb059b00c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:20:57.469548 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:20:57.469770 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 13:20:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/action (ip 10.222.0.78) !!! Sep 08 13:20:57.470889 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:20:57.474692 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 13:20:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/action (ip 10.222.0.78) !!! Sep 08 13:20:57.484785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2db7d770-fcfd-4738-81d3-9b9cb059b00c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:57.490003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2db7d770-fcfd-4738-81d3-9b9cb059b00c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:57.490552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2db7d770-fcfd-4738-81d3-9b9cb059b00c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:57.593760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2db7d770-fcfd-4738-81d3-9b9cb059b00c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Going to try to start instance {{(pid=128970) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 13:20:58.096418 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2db7d770-fcfd-4738-81d3-9b9cb059b00c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "POST /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/action" status: 202 len: 0 microversion: 2.1 time: 0.641124 Sep 08 13:20:58.121674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f391133-2816-47a4-a47a-4037518f73a4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:20:58.127168 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2621/5109] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:20:57 2022] POST /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:20:58.129267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f391133-2816-47a4-a47a-4037518f73a4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:20:58.208795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f391133-2816-47a4-a47a-4037518f73a4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:58.236053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f391133-2816-47a4-a47a-4037518f73a4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:58.238995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f391133-2816-47a4-a47a-4037518f73a4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:58.240329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f391133-2816-47a4-a47a-4037518f73a4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:20:58.253275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f391133-2816-47a4-a47a-4037518f73a4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:20:58.254088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f391133-2816-47a4-a47a-4037518f73a4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:20:59.915334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f391133-2816-47a4-a47a-4037518f73a4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:20:59.983859 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f391133-2816-47a4-a47a-4037518f73a4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1664 microversion: 2.1 time: 1.868850 Sep 08 13:20:59.992390 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2489/5110] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:20:58 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1664 bytes in 1878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:01.033952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f7f7582a-647a-4ff3-b5ee-3bdd91e2f618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:01.034697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f7f7582a-647a-4ff3-b5ee-3bdd91e2f618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:01.081054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f7582a-647a-4ff3-b5ee-3bdd91e2f618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:01.081664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f7582a-647a-4ff3-b5ee-3bdd91e2f618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:01.086019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f7582a-647a-4ff3-b5ee-3bdd91e2f618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:01.087021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f7582a-647a-4ff3-b5ee-3bdd91e2f618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:01.087772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f7582a-647a-4ff3-b5ee-3bdd91e2f618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:01.088256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f7582a-647a-4ff3-b5ee-3bdd91e2f618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:03.028792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f7f7582a-647a-4ff3-b5ee-3bdd91e2f618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:03.043412 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f7f7582a-647a-4ff3-b5ee-3bdd91e2f618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1664 microversion: 2.1 time: 2.018535 Sep 08 13:21:03.044394 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2622/5111] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:01 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1664 bytes in 2021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:04.071598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-231a2b41-0026-423c-b8dc-737465a0c732 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:04.072476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-231a2b41-0026-423c-b8dc-737465a0c732 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:04.089024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-231a2b41-0026-423c-b8dc-737465a0c732 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:04.089632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-231a2b41-0026-423c-b8dc-737465a0c732 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:04.090165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-231a2b41-0026-423c-b8dc-737465a0c732 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:04.092435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-231a2b41-0026-423c-b8dc-737465a0c732 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:04.093101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-231a2b41-0026-423c-b8dc-737465a0c732 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:04.093554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-231a2b41-0026-423c-b8dc-737465a0c732 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:04.747600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-231a2b41-0026-423c-b8dc-737465a0c732 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:04.759626 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-231a2b41-0026-423c-b8dc-737465a0c732 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1664 microversion: 2.1 time: 0.693179 Sep 08 13:21:04.775274 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2490/5112] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:04 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1664 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:21:05.811541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-35bfb69a-3c4b-4cec-b60d-b81a8f89e28c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:05.812999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-35bfb69a-3c4b-4cec-b60d-b81a8f89e28c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:05.826339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35bfb69a-3c4b-4cec-b60d-b81a8f89e28c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:05.826857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35bfb69a-3c4b-4cec-b60d-b81a8f89e28c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:05.839522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35bfb69a-3c4b-4cec-b60d-b81a8f89e28c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:05.839815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35bfb69a-3c4b-4cec-b60d-b81a8f89e28c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:05.840479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35bfb69a-3c4b-4cec-b60d-b81a8f89e28c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:05.841484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35bfb69a-3c4b-4cec-b60d-b81a8f89e28c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:06.613985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-35bfb69a-3c4b-4cec-b60d-b81a8f89e28c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:06.632526 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-35bfb69a-3c4b-4cec-b60d-b81a8f89e28c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1668 microversion: 2.1 time: 0.826011 Sep 08 13:21:06.641868 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2623/5113] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:05 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1668 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:21:13.701889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-963baf40-2da8-4798-a791-41adbb39d441 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Action: 'create', calling method: .version_select at 0x7fdb3ac01160>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-179052639", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+wtHWIkW5Q6wpJOS8EVeKNq66Kyu/bBcYRKk/aPLEjrADXhF5S81ZYlhORkMgbVHXKmzRFFwD+zMH2LAzBLEGQ5Uj1t16JTh1+Hd9gdlR0i5YDrllMaWBjucoWdWzIig=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:21:13.761265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-963baf40-2da8-4798-a791-41adbb39d441 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Getting quotas for project 8de9ce7e5cda42afa55b08b9158cb72f. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:21:13.792856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-963baf40-2da8-4798-a791-41adbb39d441 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Getting quotas for user e8b4c622b66243558ea7c2395101382b and project 8de9ce7e5cda42afa55b08b9158cb72f. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:21:13.863807 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-963baf40-2da8-4798-a791-41adbb39d441 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.162802 Sep 08 13:21:13.866059 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2491/5114] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:21:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:21:19.680151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1022061636", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "45b601a0-3ffd-460f-9e21-89440342b184"}], "key_name": "tempest-TestNetworkBasicOps-179052639", "security_groups": [{"name": "tempest-secgroup-smoke-1436523781"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:21:19.713134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=14 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:21:19.716852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:21:20.066511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] validate_networks() for [('45b601a0-3ffd-460f-9e21-89440342b184', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:21:21.904899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:21:21.905628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:21:21.906487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:21:21.907253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:21:21.907750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:21:21.941324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:21.943835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:21.944325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:21.947547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:21.948053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:21.948505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:22.002879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Getting quotas for project 8de9ce7e5cda42afa55b08b9158cb72f. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:21:22.024141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Getting quotas for user e8b4c622b66243558ea7c2395101382b and project 8de9ce7e5cda42afa55b08b9158cb72f. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:21:22.076010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:21:22.085272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:21:22.249835 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bab0737a-6579-4bbe-950a-32766145cd97 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.573067 Sep 08 13:21:22.250836 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2624/5115] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:21:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 2580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:21:22.270999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5f0abb64-c740-4dec-a326-35c5a8d4be9d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:22.273581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5f0abb64-c740-4dec-a326-35c5a8d4be9d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:22.345316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=36 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:21:22.364596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:21:22.579708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5f0abb64-c740-4dec-a326-35c5a8d4be9d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:22.592042 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5f0abb64-c740-4dec-a326-35c5a8d4be9d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1248 microversion: 2.1 time: 0.331799 Sep 08 13:21:22.602324 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2492/5116] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:22 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1248 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:23.634347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b60c8389-f455-4e3a-b162-8a3a85c4c13d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:23.635936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b60c8389-f455-4e3a-b162-8a3a85c4c13d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:23.892035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b60c8389-f455-4e3a-b162-8a3a85c4c13d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:23.939743 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b60c8389-f455-4e3a-b162-8a3a85c4c13d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1248 microversion: 2.1 time: 0.312799 Sep 08 13:21:23.942943 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2625/5117] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:23 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1248 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:21:24.978254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a90f9274-b763-4e13-bff5-1d85392272ae tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:24.984333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a90f9274-b763-4e13-bff5-1d85392272ae tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:25.034232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a90f9274-b763-4e13-bff5-1d85392272ae tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:25.046735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a90f9274-b763-4e13-bff5-1d85392272ae tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:25.048738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a90f9274-b763-4e13-bff5-1d85392272ae tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:25.062549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a90f9274-b763-4e13-bff5-1d85392272ae tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:25.067402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a90f9274-b763-4e13-bff5-1d85392272ae tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:25.071475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a90f9274-b763-4e13-bff5-1d85392272ae tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:25.743282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a90f9274-b763-4e13-bff5-1d85392272ae tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:25.817382 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a90f9274-b763-4e13-bff5-1d85392272ae tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1244 microversion: 2.1 time: 0.847382 Sep 08 13:21:25.827479 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2493/5118] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:24 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1244 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:26.853122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4ecd7eac-ac5d-41d4-b53a-278dcaa6a7ec tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:26.855100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4ecd7eac-ac5d-41d4-b53a-278dcaa6a7ec tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:26.877080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ecd7eac-ac5d-41d4-b53a-278dcaa6a7ec tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:26.878164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ecd7eac-ac5d-41d4-b53a-278dcaa6a7ec tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:26.881849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ecd7eac-ac5d-41d4-b53a-278dcaa6a7ec tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:26.883265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ecd7eac-ac5d-41d4-b53a-278dcaa6a7ec tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:26.885162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ecd7eac-ac5d-41d4-b53a-278dcaa6a7ec tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:26.888241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ecd7eac-ac5d-41d4-b53a-278dcaa6a7ec tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:27.227839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4ecd7eac-ac5d-41d4-b53a-278dcaa6a7ec tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:27.276394 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4ecd7eac-ac5d-41d4-b53a-278dcaa6a7ec tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1306 microversion: 2.1 time: 0.413629 Sep 08 13:21:27.277583 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2626/5119] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:26 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1306 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:21:28.321501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ae41055e-5ccf-48db-bafe-2daf0a62695a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:28.323427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ae41055e-5ccf-48db-bafe-2daf0a62695a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:28.363386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae41055e-5ccf-48db-bafe-2daf0a62695a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:28.364123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae41055e-5ccf-48db-bafe-2daf0a62695a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:28.364785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae41055e-5ccf-48db-bafe-2daf0a62695a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:28.372768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae41055e-5ccf-48db-bafe-2daf0a62695a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:28.373479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae41055e-5ccf-48db-bafe-2daf0a62695a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:28.382022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae41055e-5ccf-48db-bafe-2daf0a62695a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:28.557831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ae41055e-5ccf-48db-bafe-2daf0a62695a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:28.575125 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ae41055e-5ccf-48db-bafe-2daf0a62695a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1306 microversion: 2.1 time: 0.261891 Sep 08 13:21:28.583121 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2494/5120] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:28 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1306 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:29.616813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e5668e99-5801-4329-8374-1e5be58d2449 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:29.625535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e5668e99-5801-4329-8374-1e5be58d2449 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:29.683199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5668e99-5801-4329-8374-1e5be58d2449 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:29.684474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5668e99-5801-4329-8374-1e5be58d2449 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:29.698145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5668e99-5801-4329-8374-1e5be58d2449 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:29.705580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5668e99-5801-4329-8374-1e5be58d2449 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:29.706968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5668e99-5801-4329-8374-1e5be58d2449 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:29.708237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5668e99-5801-4329-8374-1e5be58d2449 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:29.946962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e5668e99-5801-4329-8374-1e5be58d2449 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:29.957925 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e5668e99-5801-4329-8374-1e5be58d2449 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1306 microversion: 2.1 time: 0.349945 Sep 08 13:21:29.963836 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2627/5121] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:29 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1306 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:31.002765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fdb31091-a885-4b48-874f-4c934ff6c9ff tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:31.003633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fdb31091-a885-4b48-874f-4c934ff6c9ff tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:31.017574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdb31091-a885-4b48-874f-4c934ff6c9ff tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:31.019996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdb31091-a885-4b48-874f-4c934ff6c9ff tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:31.021617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdb31091-a885-4b48-874f-4c934ff6c9ff tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:31.024622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdb31091-a885-4b48-874f-4c934ff6c9ff tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:31.026248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdb31091-a885-4b48-874f-4c934ff6c9ff tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:31.029143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdb31091-a885-4b48-874f-4c934ff6c9ff tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:31.286104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fdb31091-a885-4b48-874f-4c934ff6c9ff tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:31.323530 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fdb31091-a885-4b48-874f-4c934ff6c9ff tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1306 microversion: 2.1 time: 0.325913 Sep 08 13:21:31.337187 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2495/5122] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:30 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1306 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:21:32.354270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f0324a03-d233-4b81-bd1b-5d8bff796b85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:32.355304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f0324a03-d233-4b81-bd1b-5d8bff796b85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:32.361824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:21:32.387342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0324a03-d233-4b81-bd1b-5d8bff796b85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:32.387963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0324a03-d233-4b81-bd1b-5d8bff796b85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:32.388417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0324a03-d233-4b81-bd1b-5d8bff796b85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:32.389190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0324a03-d233-4b81-bd1b-5d8bff796b85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:32.397426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0324a03-d233-4b81-bd1b-5d8bff796b85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:32.398203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0324a03-d233-4b81-bd1b-5d8bff796b85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:32.736880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f0324a03-d233-4b81-bd1b-5d8bff796b85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:32.764111 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f0324a03-d233-4b81-bd1b-5d8bff796b85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1306 microversion: 2.1 time: 0.416010 Sep 08 13:21:32.765768 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2628/5123] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:32 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1306 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:21:33.799356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f880a984-9411-4211-96e9-bb23cf96f842 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:33.801246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f880a984-9411-4211-96e9-bb23cf96f842 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:33.827194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:21:33.854641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f880a984-9411-4211-96e9-bb23cf96f842 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:33.856626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f880a984-9411-4211-96e9-bb23cf96f842 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:33.862855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f880a984-9411-4211-96e9-bb23cf96f842 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:33.867245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f880a984-9411-4211-96e9-bb23cf96f842 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:33.875929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f880a984-9411-4211-96e9-bb23cf96f842 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:33.876498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f880a984-9411-4211-96e9-bb23cf96f842 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:34.874969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f880a984-9411-4211-96e9-bb23cf96f842 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:34.888801 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f880a984-9411-4211-96e9-bb23cf96f842 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1374 microversion: 2.1 time: 1.098261 Sep 08 13:21:34.889433 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2496/5124] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:33 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1374 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:35.922062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-81f3cda5-2043-41d7-a8d5-a8f79e9ba243 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:35.935068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-81f3cda5-2043-41d7-a8d5-a8f79e9ba243 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:35.955025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:21:35.995134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81f3cda5-2043-41d7-a8d5-a8f79e9ba243 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:35.996235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81f3cda5-2043-41d7-a8d5-a8f79e9ba243 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:35.997041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81f3cda5-2043-41d7-a8d5-a8f79e9ba243 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:35.998423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81f3cda5-2043-41d7-a8d5-a8f79e9ba243 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:35.999411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81f3cda5-2043-41d7-a8d5-a8f79e9ba243 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:36.000447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81f3cda5-2043-41d7-a8d5-a8f79e9ba243 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:36.779810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-81f3cda5-2043-41d7-a8d5-a8f79e9ba243 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:36.815563 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-81f3cda5-2043-41d7-a8d5-a8f79e9ba243 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1374 microversion: 2.1 time: 0.897752 Sep 08 13:21:36.824817 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2629/5125] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:35 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1374 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:37.382857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-95bb45c2-7966-4d93-bed8-6886ef5418e3 req-2a6bb057-e97b-467f-9a26-9e5f32c9ff68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca964cbe-e495-4b9c-ad2f-44ff068729ff", "tag": "0c4a644f-842a-423d-ab02-ce5aa6a156f2"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:21:37.425073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-95bb45c2-7966-4d93-bed8-6886ef5418e3 req-2a6bb057-e97b-467f-9a26-9e5f32c9ff68 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:37.426000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-95bb45c2-7966-4d93-bed8-6886ef5418e3 req-2a6bb057-e97b-467f-9a26-9e5f32c9ff68 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:37.426833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-95bb45c2-7966-4d93-bed8-6886ef5418e3 req-2a6bb057-e97b-467f-9a26-9e5f32c9ff68 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:37.449428 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-95bb45c2-7966-4d93-bed8-6886ef5418e3 req-2a6bb057-e97b-467f-9a26-9e5f32c9ff68 service nova] Creating event network-changed:0c4a644f-842a-423d-ab02-ce5aa6a156f2 for instance ca964cbe-e495-4b9c-ad2f-44ff068729ff on n-h1-852084-10 Sep 08 13:21:37.462808 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-95bb45c2-7966-4d93-bed8-6886ef5418e3 req-2a6bb057-e97b-467f-9a26-9e5f32c9ff68 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089029 Sep 08 13:21:37.464545 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2497/5126] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:21:37.849681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-72385f88-b8e7-4c35-a858-37c79bbfb735 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:37.853096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-72385f88-b8e7-4c35-a858-37c79bbfb735 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:37.868243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72385f88-b8e7-4c35-a858-37c79bbfb735 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:37.870308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72385f88-b8e7-4c35-a858-37c79bbfb735 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:37.873032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72385f88-b8e7-4c35-a858-37c79bbfb735 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:37.874052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72385f88-b8e7-4c35-a858-37c79bbfb735 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:37.875146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72385f88-b8e7-4c35-a858-37c79bbfb735 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:37.877391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-72385f88-b8e7-4c35-a858-37c79bbfb735 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:38.191849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e374932-b835-4261-9b9e-b0a09f838955 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-493554337", "availability_zone": "foo_zone"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:21:38.197546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.aggregate [None req-7e374932-b835-4261-9b9e-b0a09f838955 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Generated uuid 17b55050-4979-404b-b684-72b2863f6d6f for aggregate {{(pid=128970) create /opt/stack/nova/nova/objects/aggregate.py:298}} Sep 08 13:21:38.280988 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e374932-b835-4261-9b9e-b0a09f838955 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.779721 Sep 08 13:21:38.283393 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2630/5127] 10.222.0.78 () {60 vars in 1164 bytes} [Thu Sep 8 13:21:37 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:21:38.313571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-842bf644-a0e8-4bf2-a22a-b80aeee6bcf7 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:21:38.426488 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-842bf644-a0e8-4bf2-a22a-b80aeee6bcf7 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.129632 Sep 08 13:21:38.433252 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2631/5128] 10.222.0.78 () {60 vars in 1194 bytes} [Thu Sep 8 13:21:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:21:38.458336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cfa8ab13-3e31-43b1-91e9-92994817e190 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:38.477135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfa8ab13-3e31-43b1-91e9-92994817e190 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:38.498225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfa8ab13-3e31-43b1-91e9-92994817e190 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:38.506729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfa8ab13-3e31-43b1-91e9-92994817e190 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:38.512420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfa8ab13-3e31-43b1-91e9-92994817e190 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:38.516502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfa8ab13-3e31-43b1-91e9-92994817e190 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:38.518874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cfa8ab13-3e31-43b1-91e9-92994817e190 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:38.641715 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cfa8ab13-3e31-43b1-91e9-92994817e190 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] 10.222.0.78 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.201001 Sep 08 13:21:38.643441 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2632/5129] 10.222.0.78 () {58 vars in 1176 bytes} [Thu Sep 8 13:21:38 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:21:38.668798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4d6350d5-0c7f-407e-9def-6b48a65ac2cb tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:38.704612 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4d6350d5-0c7f-407e-9def-6b48a65ac2cb tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.047422 Sep 08 13:21:38.710705 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2633/5130] 10.222.0.78 () {58 vars in 1143 bytes} [Thu Sep 8 13:21:38 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:21:38.732189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aa584370-7075-4d93-8ec2-322677f453ba tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-852084-10"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:21:38.759023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa584370-7075-4d93-8ec2-322677f453ba tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:38.760278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa584370-7075-4d93-8ec2-322677f453ba tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:38.761563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa584370-7075-4d93-8ec2-322677f453ba tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:39.456271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-72385f88-b8e7-4c35-a858-37c79bbfb735 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:39.480402 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-72385f88-b8e7-4c35-a858-37c79bbfb735 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1374 microversion: 2.1 time: 1.637040 Sep 08 13:21:39.487640 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2498/5131] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:37 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1374 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:21:39.514747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a988442b-ab53-47eb-89e1-e4306a69532d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:39.518888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a988442b-ab53-47eb-89e1-e4306a69532d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:39.534421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a988442b-ab53-47eb-89e1-e4306a69532d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:39.536881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a988442b-ab53-47eb-89e1-e4306a69532d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:39.538517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a988442b-ab53-47eb-89e1-e4306a69532d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:39.540818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a988442b-ab53-47eb-89e1-e4306a69532d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:39.542251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a988442b-ab53-47eb-89e1-e4306a69532d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:39.544490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a988442b-ab53-47eb-89e1-e4306a69532d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:39.632533 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a988442b-ab53-47eb-89e1-e4306a69532d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.141795 Sep 08 13:21:39.635190 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2499/5132] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:21:39 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac/os-volume_attachments => generated 25 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:21:39.650867 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aa584370-7075-4d93-8ec2-322677f453ba tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.930835 Sep 08 13:21:39.652426 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2634/5133] 10.222.0.78 () {60 vars in 1194 bytes} [Thu Sep 8 13:21:38 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:21:39.670774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-06c58957-8ae5-45db-8966-943e913bee8b tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:39.705595 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-06c58957-8ae5-45db-8966-943e913bee8b tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.044457 Sep 08 13:21:39.716020 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2500/5134] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 13:21:39 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:21:39.745642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1e37b4e8-8c35-4ed3-8a4e-1f7cdaf2ca53 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-463330650", "availability_zone": "foo_zone"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:21:39.834518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63d84dc1-a73f-461c-9db2-bc56f02bf7d2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:39.836347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-63d84dc1-a73f-461c-9db2-bc56f02bf7d2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:39.872485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63d84dc1-a73f-461c-9db2-bc56f02bf7d2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:39.875422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63d84dc1-a73f-461c-9db2-bc56f02bf7d2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:39.878678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63d84dc1-a73f-461c-9db2-bc56f02bf7d2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:39.883523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63d84dc1-a73f-461c-9db2-bc56f02bf7d2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:39.884751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63d84dc1-a73f-461c-9db2-bc56f02bf7d2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:39.887421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63d84dc1-a73f-461c-9db2-bc56f02bf7d2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:39.961118 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1e37b4e8-8c35-4ed3-8a4e-1f7cdaf2ca53 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] 10.222.0.78 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.225116 Sep 08 13:21:39.970905 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2635/5135] 10.222.0.78 () {60 vars in 1173 bytes} [Thu Sep 8 13:21:39 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:21:39.977411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1777f6de-4ce9-47c3-a1ea-fb15e08ddfa3 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:21:39.994813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-63d84dc1-a73f-461c-9db2-bc56f02bf7d2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:21:40.031125 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1777f6de-4ce9-47c3-a1ea-fb15e08ddfa3 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.058058 Sep 08 13:21:40.033178 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2636/5136] 10.222.0.78 () {60 vars in 1194 bytes} [Thu Sep 8 13:21:39 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:21:40.054282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2b778909-4d10-4d64-8326-788ff4526b39 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:40.068053 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2b778909-4d10-4d64-8326-788ff4526b39 tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] 10.222.0.78 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.022323 Sep 08 13:21:40.079139 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2637/5137] 10.222.0.78 () {58 vars in 1152 bytes} [Thu Sep 8 13:21:40 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:21:40.087970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e74f2ba-01b8-4ced-aae0-f8870c7b299b tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-852084-10"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:21:40.106358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e74f2ba-01b8-4ced-aae0-f8870c7b299b tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:40.107813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e74f2ba-01b8-4ced-aae0-f8870c7b299b tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:40.109101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e74f2ba-01b8-4ced-aae0-f8870c7b299b tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:40.299691 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-63d84dc1-a73f-461c-9db2-bc56f02bf7d2 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 204 len: 0 microversion: 2.1 time: 0.472749 Sep 08 13:21:40.306402 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2501/5138] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:21:39 2022] DELETE /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:21:40.320842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dce40a44-96d3-4beb-ab54-e9fc17d58604 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:40.322243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dce40a44-96d3-4beb-ab54-e9fc17d58604 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:40.335791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dce40a44-96d3-4beb-ab54-e9fc17d58604 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:40.337147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dce40a44-96d3-4beb-ab54-e9fc17d58604 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:40.338471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dce40a44-96d3-4beb-ab54-e9fc17d58604 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:40.339971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dce40a44-96d3-4beb-ab54-e9fc17d58604 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:40.340834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dce40a44-96d3-4beb-ab54-e9fc17d58604 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:40.341669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dce40a44-96d3-4beb-ab54-e9fc17d58604 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:40.424318 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e74f2ba-01b8-4ced-aae0-f8870c7b299b tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] 10.222.0.78 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.342915 Sep 08 13:21:40.425760 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2638/5139] 10.222.0.78 () {60 vars in 1194 bytes} [Thu Sep 8 13:21:40 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:21:40.445804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-151c3169-ec8d-4e49-ac18-c83cb643f86c tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:40.494914 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-151c3169-ec8d-4e49-ac18-c83cb643f86c tempest-TestAggregatesBasicOps-673296012 tempest-TestAggregatesBasicOps-673296012-project-admin] 10.222.0.78 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.055323 Sep 08 13:21:40.496462 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2639/5140] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Sep 8 13:21:40 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Sep 08 13:21:40.520296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-781509a6-d088-4dde-bd2b-ad1e3aff93e7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:40.522383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-781509a6-d088-4dde-bd2b-ad1e3aff93e7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:40.537997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-781509a6-d088-4dde-bd2b-ad1e3aff93e7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:40.538765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-781509a6-d088-4dde-bd2b-ad1e3aff93e7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:40.539504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-781509a6-d088-4dde-bd2b-ad1e3aff93e7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:40.540932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-781509a6-d088-4dde-bd2b-ad1e3aff93e7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:40.541931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-781509a6-d088-4dde-bd2b-ad1e3aff93e7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:40.542814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-781509a6-d088-4dde-bd2b-ad1e3aff93e7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:41.549705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-781509a6-d088-4dde-bd2b-ad1e3aff93e7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:41.574326 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-781509a6-d088-4dde-bd2b-ad1e3aff93e7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1374 microversion: 2.1 time: 1.062831 Sep 08 13:21:41.576843 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2640/5141] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:40 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1374 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:41.582120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dce40a44-96d3-4beb-ab54-e9fc17d58604 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:41.598043 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dce40a44-96d3-4beb-ab54-e9fc17d58604 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1674 microversion: 2.1 time: 1.284570 Sep 08 13:21:41.599217 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2502/5142] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:40 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1674 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:42.642532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-837222bd-e691-4d42-88bb-66b2a7bb6269 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:42.648459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-837222bd-e691-4d42-88bb-66b2a7bb6269 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:42.661655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-447bfa8e-1fb0-497b-b4ef-8f6e712160b5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:42.670116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-447bfa8e-1fb0-497b-b4ef-8f6e712160b5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:42.707942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-837222bd-e691-4d42-88bb-66b2a7bb6269 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:42.718612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-447bfa8e-1fb0-497b-b4ef-8f6e712160b5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:42.720933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-837222bd-e691-4d42-88bb-66b2a7bb6269 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:42.728328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-837222bd-e691-4d42-88bb-66b2a7bb6269 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:42.729509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-837222bd-e691-4d42-88bb-66b2a7bb6269 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:42.730565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-447bfa8e-1fb0-497b-b4ef-8f6e712160b5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:42.734498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-447bfa8e-1fb0-497b-b4ef-8f6e712160b5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:42.735417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-837222bd-e691-4d42-88bb-66b2a7bb6269 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:42.737551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-447bfa8e-1fb0-497b-b4ef-8f6e712160b5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:42.737976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-837222bd-e691-4d42-88bb-66b2a7bb6269 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:42.745136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-447bfa8e-1fb0-497b-b4ef-8f6e712160b5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:42.749118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-447bfa8e-1fb0-497b-b4ef-8f6e712160b5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:45.639883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-447bfa8e-1fb0-497b-b4ef-8f6e712160b5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:45.661426 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-447bfa8e-1fb0-497b-b4ef-8f6e712160b5 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1674 microversion: 2.1 time: 3.009223 Sep 08 13:21:45.664981 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2503/5143] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:42 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1674 bytes in 3015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:45.921571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-837222bd-e691-4d42-88bb-66b2a7bb6269 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:45.969154 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-837222bd-e691-4d42-88bb-66b2a7bb6269 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1374 microversion: 2.1 time: 3.332595 Sep 08 13:21:45.976123 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2641/5144] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:42 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1374 bytes in 3345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:46.730970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-97dd0287-d233-40d7-a8e0-aea6f4c9dbee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:46.741941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-97dd0287-d233-40d7-a8e0-aea6f4c9dbee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:46.796065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97dd0287-d233-40d7-a8e0-aea6f4c9dbee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:46.803909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97dd0287-d233-40d7-a8e0-aea6f4c9dbee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:46.809639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97dd0287-d233-40d7-a8e0-aea6f4c9dbee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:46.812958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97dd0287-d233-40d7-a8e0-aea6f4c9dbee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:46.818169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97dd0287-d233-40d7-a8e0-aea6f4c9dbee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:46.827999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-97dd0287-d233-40d7-a8e0-aea6f4c9dbee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:46.854200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-101ed2f1-eaa0-472c-a76f-55fff7fdbcba req-365943b2-43dc-4e17-acc1-4adca8ada9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca964cbe-e495-4b9c-ad2f-44ff068729ff", "name": "network-vif-plugged", "status": "completed", "tag": "0c4a644f-842a-423d-ab02-ce5aa6a156f2"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:21:46.934580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-101ed2f1-eaa0-472c-a76f-55fff7fdbcba req-365943b2-43dc-4e17-acc1-4adca8ada9f7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:46.940839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-101ed2f1-eaa0-472c-a76f-55fff7fdbcba req-365943b2-43dc-4e17-acc1-4adca8ada9f7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:46.945629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-101ed2f1-eaa0-472c-a76f-55fff7fdbcba req-365943b2-43dc-4e17-acc1-4adca8ada9f7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:47.017973 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-101ed2f1-eaa0-472c-a76f-55fff7fdbcba req-365943b2-43dc-4e17-acc1-4adca8ada9f7 service nova] Creating event network-vif-plugged:0c4a644f-842a-423d-ab02-ce5aa6a156f2 for instance ca964cbe-e495-4b9c-ad2f-44ff068729ff on n-h1-852084-10 Sep 08 13:21:47.034450 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-101ed2f1-eaa0-472c-a76f-55fff7fdbcba req-365943b2-43dc-4e17-acc1-4adca8ada9f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.903503 Sep 08 13:21:47.039959 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2504/5145] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:21:47.065349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dcb331be-8e6c-4165-aa9b-571cfe7d57c0 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:47.066824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dcb331be-8e6c-4165-aa9b-571cfe7d57c0 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:47.094813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcb331be-8e6c-4165-aa9b-571cfe7d57c0 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:47.095850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcb331be-8e6c-4165-aa9b-571cfe7d57c0 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:47.099268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcb331be-8e6c-4165-aa9b-571cfe7d57c0 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:47.102796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcb331be-8e6c-4165-aa9b-571cfe7d57c0 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:47.103862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcb331be-8e6c-4165-aa9b-571cfe7d57c0 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:47.107386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcb331be-8e6c-4165-aa9b-571cfe7d57c0 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:47.468541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-97dd0287-d233-40d7-a8e0-aea6f4c9dbee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:47.507103 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-97dd0287-d233-40d7-a8e0-aea6f4c9dbee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1606 microversion: 2.1 time: 0.797062 Sep 08 13:21:47.511755 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2642/5146] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:46 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1606 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:48.319575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dcb331be-8e6c-4165-aa9b-571cfe7d57c0 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:48.336923 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dcb331be-8e6c-4165-aa9b-571cfe7d57c0 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1374 microversion: 2.1 time: 1.294822 Sep 08 13:21:48.342237 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2505/5147] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:47 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1374 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:48.473235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-aabf8642-568e-47cf-aea6-d072be07c242 req-89566991-6224-46e6-999b-33887545ed09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96514589-9deb-48df-95d3-5b3c56d620ac", "name": "network-vif-deleted", "tag": "073c7e49-1f65-49ba-bf02-05582aa538af"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:21:48.537025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:48.538669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:48.545086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-aabf8642-568e-47cf-aea6-d072be07c242 req-89566991-6224-46e6-999b-33887545ed09 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:48.546785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-aabf8642-568e-47cf-aea6-d072be07c242 req-89566991-6224-46e6-999b-33887545ed09 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:48.551008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-aabf8642-568e-47cf-aea6-d072be07c242 req-89566991-6224-46e6-999b-33887545ed09 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:48.569483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:48.572372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:48.586730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:48.594188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:48.594867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:48.606271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:48.646163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:21:48.666057 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-aabf8642-568e-47cf-aea6-d072be07c242 req-89566991-6224-46e6-999b-33887545ed09 service nova] Creating event network-vif-deleted:073c7e49-1f65-49ba-bf02-05582aa538af for instance 96514589-9deb-48df-95d3-5b3c56d620ac on n-h2-852084-10 Sep 08 13:21:48.709127 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-aabf8642-568e-47cf-aea6-d072be07c242 req-89566991-6224-46e6-999b-33887545ed09 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.847806 Sep 08 13:21:48.713946 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2643/5148] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:21:48.817576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:48.818431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:48.819387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:48.820475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lazy-loading 'fault' on Instance uuid 96514589-9deb-48df-95d3-5b3c56d620ac {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:21:49.036714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:49.096214 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0290729f-cf2b-4ab6-92a9-e4e03a8e395c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 200 len: 1328 microversion: 2.1 time: 0.564782 Sep 08 13:21:49.116258 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2506/5149] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:48 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 1328 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:21:49.398892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f4cf9996-0a90-4633-8f06-63786a2b2525 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:49.403322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f4cf9996-0a90-4633-8f06-63786a2b2525 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:49.420201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=8,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:21:49.445087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4cf9996-0a90-4633-8f06-63786a2b2525 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:49.449521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4cf9996-0a90-4633-8f06-63786a2b2525 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:49.452518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4cf9996-0a90-4633-8f06-63786a2b2525 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:49.458737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4cf9996-0a90-4633-8f06-63786a2b2525 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:49.460013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4cf9996-0a90-4633-8f06-63786a2b2525 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:49.461110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4cf9996-0a90-4633-8f06-63786a2b2525 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:50.195375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dcd29792-6a5c-431c-b243-9ea5ce49e55e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:50.196522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dcd29792-6a5c-431c-b243-9ea5ce49e55e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:50.229737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcd29792-6a5c-431c-b243-9ea5ce49e55e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:50.230408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcd29792-6a5c-431c-b243-9ea5ce49e55e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:50.231121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcd29792-6a5c-431c-b243-9ea5ce49e55e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:50.232334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcd29792-6a5c-431c-b243-9ea5ce49e55e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:50.233046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcd29792-6a5c-431c-b243-9ea5ce49e55e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:50.233739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dcd29792-6a5c-431c-b243-9ea5ce49e55e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:50.292399 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-dcd29792-6a5c-431c-b243-9ea5ce49e55e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] HTTP exception thrown: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dcd29792-6a5c-431c-b243-9ea5ce49e55e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Request method failure captured: Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac HTTP/1.1 Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGetgmztsiusn_P8f3XaXHyjRUrqNydbOYz3uBNxdYE_MYgT23N-5-QPgjltkJy0nGSbeedHTWwNUUit3mmNK4PQgt-YdZ5ktEtKb3y-56wwljeK9nY-ijij0bGAJwJDpEcVL-b_QZNGywutXZieMY8gzaKzqHIYv0HnZg56HrosdV_w Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 8ba356cf57224bcdb710a75c346f386d Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 8ba356cf57224bcdb710a75c346f386d Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeTestJSON-363111724-project Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 334fc689cca7450f82f3603de32a5a19 Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeTestJSON-363111724-project Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '96514589-9deb-48df-95d3-5b3c56d620ac'} Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:21:50.300479 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:21:50.308234 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:21:50.308234 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:21:50.308234 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:21:50.308234 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:21:50.308234 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:21:50.308234 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:21:50.308234 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:21:50.310380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dcd29792-6a5c-431c-b243-9ea5ce49e55e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Returning 404 to user: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:21:50.312273 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dcd29792-6a5c-431c-b243-9ea5ce49e55e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 404 len: 111 microversion: 2.1 time: 0.159262 Sep 08 13:21:50.314584 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2507/5150] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:50 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:21:50.343253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3156c9eb-27da-4f38-9209-c150c9561193 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '.version_select at 0x7fdb3ab5f9d0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:50.475354 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3156c9eb-27da-4f38-9209-c150c9561193 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405915329" status: 202 len: 0 microversion: 2.1 time: 0.150304 Sep 08 13:21:50.491504 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2508/5151] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Sep 8 13:21:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1405915329 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:21:51.223349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f4cf9996-0a90-4633-8f06-63786a2b2525 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:51.299452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=61 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:21:51.321300 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f4cf9996-0a90-4633-8f06-63786a2b2525 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1374 microversion: 2.1 time: 1.936415 Sep 08 13:21:51.322315 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2644/5152] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:49 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1374 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:21:52.388950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-55946028-8bcb-4879-b341-439904b21ab7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:52.396860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-55946028-8bcb-4879-b341-439904b21ab7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:52.423299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55946028-8bcb-4879-b341-439904b21ab7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:52.424516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55946028-8bcb-4879-b341-439904b21ab7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:52.426561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55946028-8bcb-4879-b341-439904b21ab7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:52.428439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55946028-8bcb-4879-b341-439904b21ab7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:52.441121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55946028-8bcb-4879-b341-439904b21ab7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:52.444204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55946028-8bcb-4879-b341-439904b21ab7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:52.499788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:21:53.788414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-55946028-8bcb-4879-b341-439904b21ab7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:53.832589 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-55946028-8bcb-4879-b341-439904b21ab7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1547 microversion: 2.1 time: 1.454454 Sep 08 13:21:53.842394 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2509/5153] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:52 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1547 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:21:53.892893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-249ea21b-e216-4849-9019-8427555937c4 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:21:53.895496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-249ea21b-e216-4849-9019-8427555937c4 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:21:53.920771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-249ea21b-e216-4849-9019-8427555937c4 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:53.924600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-249ea21b-e216-4849-9019-8427555937c4 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:53.926603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-249ea21b-e216-4849-9019-8427555937c4 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:53.928309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-249ea21b-e216-4849-9019-8427555937c4 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:21:53.929753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-249ea21b-e216-4849-9019-8427555937c4 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:21:53.933348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-249ea21b-e216-4849-9019-8427555937c4 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:21:54.099420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3f320884-af96-49a8-b9ed-8806812ca42c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Action: 'create', calling method: .version_select at 0x7fdb3ad30160>, body: {"keypair": {"name": "tempest-keypair-2092730327", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgso9pOyYRR5eZZwFtw2lIUEsAmXWCq1XtbaS2VSY/AAGG9nu2b7Egq4O+Mb9gPw+i5ezpKLETo88BKbfSQWlXmBxa8yZYzpway/R5ygf34Xa96XlvAUpgr3OtE5aDtOw=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:21:54.117641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:21:54.179166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-3f320884-af96-49a8-b9ed-8806812ca42c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Getting quotas for project 8ba356cf57224bcdb710a75c346f386d. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:21:54.211719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-3f320884-af96-49a8-b9ed-8806812ca42c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Getting quotas for user 334fc689cca7450f82f3603de32a5a19 and project 8ba356cf57224bcdb710a75c346f386d. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:21:54.302445 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3f320884-af96-49a8-b9ed-8806812ca42c tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.209454 Sep 08 13:21:54.316055 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2510/5154] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:21:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:21:55.078303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-249ea21b-e216-4849-9019-8427555937c4 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:21:55.112567 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-249ea21b-e216-4849-9019-8427555937c4 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1547 microversion: 2.1 time: 1.221981 Sep 08 13:21:55.126383 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2645/5155] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:21:53 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1547 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:05.465175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-925398399", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c41ee687-af4b-4aa3-88c2-b6f8e5d2a2fa"}], "security_groups": [{"name": "tempest-securitygroup--1028588515"}], "key_name": "tempest-keypair-2092730327", "user_data": "}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:22:05.515424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:05.517062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:05.522521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:05.889404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] validate_networks() for [('c41ee687-af4b-4aa3-88c2-b6f8e5d2a2fa', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:22:08.082102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-9e5de6c6-3d53-494f-acdc-42d3def0d49e req-41261900-948e-4ce5-90f0-13517c3a5575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca964cbe-e495-4b9c-ad2f-44ff068729ff", "tag": "0c4a644f-842a-423d-ab02-ce5aa6a156f2"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:22:08.114102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:08.129991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=7 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:08.182225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9e5de6c6-3d53-494f-acdc-42d3def0d49e req-41261900-948e-4ce5-90f0-13517c3a5575 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:08.184057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9e5de6c6-3d53-494f-acdc-42d3def0d49e req-41261900-948e-4ce5-90f0-13517c3a5575 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:08.185083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9e5de6c6-3d53-494f-acdc-42d3def0d49e req-41261900-948e-4ce5-90f0-13517c3a5575 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:08.251051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:22:08.252023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:22:08.253269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:22:08.254345 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-9e5de6c6-3d53-494f-acdc-42d3def0d49e req-41261900-948e-4ce5-90f0-13517c3a5575 service nova] Creating event network-changed:0c4a644f-842a-423d-ab02-ce5aa6a156f2 for instance ca964cbe-e495-4b9c-ad2f-44ff068729ff on n-h1-852084-10 Sep 08 13:22:08.255055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:22:08.256123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:22:08.268675 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-9e5de6c6-3d53-494f-acdc-42d3def0d49e req-41261900-948e-4ce5-90f0-13517c3a5575 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195366 Sep 08 13:22:08.269723 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2646/5156] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:22:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:22:08.301778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:08.320717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:08.321528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:08.326781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:08.327757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:08.328551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:08.430443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Getting quotas for project 8ba356cf57224bcdb710a75c346f386d. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:22:08.458370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Getting quotas for user 334fc689cca7450f82f3603de32a5a19 and project 8ba356cf57224bcdb710a75c346f386d. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:22:08.527598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:22:08.539176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:22:08.853216 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f9ca4cfd-0975-4e17-99b6-64de65e75cf3 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.396129 Sep 08 13:22:08.856830 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2511/5157] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:22:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 3404 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:22:08.880098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-21b8661b-502a-45d2-872d-a7dc9e01e595 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:08.885569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-21b8661b-502a-45d2-872d-a7dc9e01e595 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:09.158781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-21b8661b-502a-45d2-872d-a7dc9e01e595 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:09.171714 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-21b8661b-502a-45d2-872d-a7dc9e01e595 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1237 microversion: 2.1 time: 0.303029 Sep 08 13:22:09.172329 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2647/5158] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:08 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1237 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:22:10.219110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b949d4e5-c2cc-480a-97e2-abba7212c48a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:10.220133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b949d4e5-c2cc-480a-97e2-abba7212c48a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:10.574490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b949d4e5-c2cc-480a-97e2-abba7212c48a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:10.594358 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b949d4e5-c2cc-480a-97e2-abba7212c48a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1237 microversion: 2.1 time: 0.380705 Sep 08 13:22:10.608962 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2512/5159] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:10 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1237 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:11.635774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a50fc46a-e676-492d-992c-9f8ba30b6d2e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:11.638074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a50fc46a-e676-492d-992c-9f8ba30b6d2e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:11.677259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a50fc46a-e676-492d-992c-9f8ba30b6d2e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:11.679882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a50fc46a-e676-492d-992c-9f8ba30b6d2e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:11.712385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a50fc46a-e676-492d-992c-9f8ba30b6d2e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:11.719102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a50fc46a-e676-492d-992c-9f8ba30b6d2e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:11.720322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a50fc46a-e676-492d-992c-9f8ba30b6d2e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:11.728288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a50fc46a-e676-492d-992c-9f8ba30b6d2e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:12.536923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a50fc46a-e676-492d-992c-9f8ba30b6d2e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:12.564523 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a50fc46a-e676-492d-992c-9f8ba30b6d2e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1289 microversion: 2.1 time: 0.938635 Sep 08 13:22:12.573197 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2648/5160] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:11 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1289 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:13.625803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-40958410-53e1-408e-984f-c90bed76a1d9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:13.628378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-40958410-53e1-408e-984f-c90bed76a1d9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:13.679925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40958410-53e1-408e-984f-c90bed76a1d9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:13.682677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40958410-53e1-408e-984f-c90bed76a1d9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:13.685021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40958410-53e1-408e-984f-c90bed76a1d9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:13.688796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40958410-53e1-408e-984f-c90bed76a1d9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:13.693111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40958410-53e1-408e-984f-c90bed76a1d9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:13.694109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40958410-53e1-408e-984f-c90bed76a1d9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:14.213079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-40958410-53e1-408e-984f-c90bed76a1d9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:14.269262 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-40958410-53e1-408e-984f-c90bed76a1d9 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1295 microversion: 2.1 time: 0.655445 Sep 08 13:22:14.270568 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2513/5161] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:13 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1295 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:15.329279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f613f9f-4b6c-4e5c-9c24-03229b0df79e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:15.329974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f613f9f-4b6c-4e5c-9c24-03229b0df79e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:15.361202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f613f9f-4b6c-4e5c-9c24-03229b0df79e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:15.364708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f613f9f-4b6c-4e5c-9c24-03229b0df79e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:15.365289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f613f9f-4b6c-4e5c-9c24-03229b0df79e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:15.366085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f613f9f-4b6c-4e5c-9c24-03229b0df79e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:15.366578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f613f9f-4b6c-4e5c-9c24-03229b0df79e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:15.367020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f613f9f-4b6c-4e5c-9c24-03229b0df79e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:16.359468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f613f9f-4b6c-4e5c-9c24-03229b0df79e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:16.387670 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f613f9f-4b6c-4e5c-9c24-03229b0df79e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1295 microversion: 2.1 time: 1.067453 Sep 08 13:22:16.389075 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2649/5162] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:15 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1295 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:22:17.428683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6f590251-acd0-42d1-8c85-ef2a4f00565b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:17.430670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6f590251-acd0-42d1-8c85-ef2a4f00565b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:17.450872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f590251-acd0-42d1-8c85-ef2a4f00565b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:17.451638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f590251-acd0-42d1-8c85-ef2a4f00565b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:17.452564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f590251-acd0-42d1-8c85-ef2a4f00565b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:17.453961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f590251-acd0-42d1-8c85-ef2a4f00565b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:17.454963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f590251-acd0-42d1-8c85-ef2a4f00565b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:17.456234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f590251-acd0-42d1-8c85-ef2a4f00565b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:17.763325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8522c78b-d981-44fe-b4ad-e72623f2815e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:22:17.772328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8522c78b-d981-44fe-b4ad-e72623f2815e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:17.789826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8522c78b-d981-44fe-b4ad-e72623f2815e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:17.791406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8522c78b-d981-44fe-b4ad-e72623f2815e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:17.792389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8522c78b-d981-44fe-b4ad-e72623f2815e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:17.794227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8522c78b-d981-44fe-b4ad-e72623f2815e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:17.795851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8522c78b-d981-44fe-b4ad-e72623f2815e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:17.796728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8522c78b-d981-44fe-b4ad-e72623f2815e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:17.914599 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8522c78b-d981-44fe-b4ad-e72623f2815e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "POST /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff/action" status: 200 len: 24564 microversion: 2.1 time: 0.157040 Sep 08 13:22:17.920090 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2650/5163] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:22:17 2022] POST /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff/action => generated 24564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:22:18.398275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:19.395935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6f590251-acd0-42d1-8c85-ef2a4f00565b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:19.472401 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6f590251-acd0-42d1-8c85-ef2a4f00565b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1363 microversion: 2.1 time: 2.051680 Sep 08 13:22:19.491911 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2514/5164] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:17 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1363 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:20.528897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e14893ba-c2b3-473a-885a-ad046e1d6fd4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:20.535337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e14893ba-c2b3-473a-885a-ad046e1d6fd4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:20.560482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:20.572164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e14893ba-c2b3-473a-885a-ad046e1d6fd4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:20.608140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e14893ba-c2b3-473a-885a-ad046e1d6fd4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:20.610650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e14893ba-c2b3-473a-885a-ad046e1d6fd4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:20.615804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e14893ba-c2b3-473a-885a-ad046e1d6fd4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:20.617240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e14893ba-c2b3-473a-885a-ad046e1d6fd4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:20.618475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e14893ba-c2b3-473a-885a-ad046e1d6fd4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:21.951061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e14893ba-c2b3-473a-885a-ad046e1d6fd4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:21.992959 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e14893ba-c2b3-473a-885a-ad046e1d6fd4 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1363 microversion: 2.1 time: 1.478224 Sep 08 13:22:22.012490 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2651/5165] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:20 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1363 bytes in 1500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:23.072167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-33190bbb-9fcd-4f37-b17d-df6d8315002a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:23.074644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33190bbb-9fcd-4f37-b17d-df6d8315002a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:23.105967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:23.180694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33190bbb-9fcd-4f37-b17d-df6d8315002a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:23.183298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33190bbb-9fcd-4f37-b17d-df6d8315002a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:23.187990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33190bbb-9fcd-4f37-b17d-df6d8315002a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:23.190851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33190bbb-9fcd-4f37-b17d-df6d8315002a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:23.195840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33190bbb-9fcd-4f37-b17d-df6d8315002a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:23.202452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33190bbb-9fcd-4f37-b17d-df6d8315002a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:23.736842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-33190bbb-9fcd-4f37-b17d-df6d8315002a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:23.761662 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-33190bbb-9fcd-4f37-b17d-df6d8315002a tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1363 microversion: 2.1 time: 0.708295 Sep 08 13:22:23.777161 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2515/5166] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:23 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1363 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:23.840468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-049ee5b9-7284-4b6f-b7d8-4ea46b0bda54 req-b7752df6-a621-438d-8797-4f755efbdfee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3abfe3b5-55c0-40e6-906f-a7770dd8e5c7", "tag": "4f346bb7-ca7c-4060-b2f8-4bc559534eae"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:22:23.889826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-049ee5b9-7284-4b6f-b7d8-4ea46b0bda54 req-b7752df6-a621-438d-8797-4f755efbdfee service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:23.891127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-049ee5b9-7284-4b6f-b7d8-4ea46b0bda54 req-b7752df6-a621-438d-8797-4f755efbdfee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:23.892285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-049ee5b9-7284-4b6f-b7d8-4ea46b0bda54 req-b7752df6-a621-438d-8797-4f755efbdfee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:23.942704 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-049ee5b9-7284-4b6f-b7d8-4ea46b0bda54 req-b7752df6-a621-438d-8797-4f755efbdfee service nova] Creating event network-changed:4f346bb7-ca7c-4060-b2f8-4bc559534eae for instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 on n-h2-852084-10 Sep 08 13:22:23.951930 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-049ee5b9-7284-4b6f-b7d8-4ea46b0bda54 req-b7752df6-a621-438d-8797-4f755efbdfee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.134501 Sep 08 13:22:23.952880 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2652/5167] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:22:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:22:24.804332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3b0eec81-a5bc-4100-8278-aa332dda7095 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:24.805295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3b0eec81-a5bc-4100-8278-aa332dda7095 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:24.853831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b0eec81-a5bc-4100-8278-aa332dda7095 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:24.866667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b0eec81-a5bc-4100-8278-aa332dda7095 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:24.868182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b0eec81-a5bc-4100-8278-aa332dda7095 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:24.875697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b0eec81-a5bc-4100-8278-aa332dda7095 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:24.880744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b0eec81-a5bc-4100-8278-aa332dda7095 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:24.888833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b0eec81-a5bc-4100-8278-aa332dda7095 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:25.830118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b0eec81-a5bc-4100-8278-aa332dda7095 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:25.850738 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3b0eec81-a5bc-4100-8278-aa332dda7095 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1363 microversion: 2.1 time: 1.053104 Sep 08 13:22:25.858269 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2516/5168] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:24 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1363 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:26.917165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ec9b9a58-d477-4b94-90dc-2ee1834f998f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:26.938410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ec9b9a58-d477-4b94-90dc-2ee1834f998f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:27.018108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec9b9a58-d477-4b94-90dc-2ee1834f998f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:27.025438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec9b9a58-d477-4b94-90dc-2ee1834f998f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:27.032366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec9b9a58-d477-4b94-90dc-2ee1834f998f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:27.042244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec9b9a58-d477-4b94-90dc-2ee1834f998f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:27.043895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec9b9a58-d477-4b94-90dc-2ee1834f998f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:27.052167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec9b9a58-d477-4b94-90dc-2ee1834f998f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:28.074210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ec9b9a58-d477-4b94-90dc-2ee1834f998f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:28.105247 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ec9b9a58-d477-4b94-90dc-2ee1834f998f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1363 microversion: 2.1 time: 1.202594 Sep 08 13:22:28.106383 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2653/5169] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:26 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1363 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:29.160100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4780978d-ade8-4f07-814e-fd2e5fa20e84 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:29.161157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4780978d-ade8-4f07-814e-fd2e5fa20e84 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:29.207302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4780978d-ade8-4f07-814e-fd2e5fa20e84 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:29.209041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4780978d-ade8-4f07-814e-fd2e5fa20e84 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:29.210225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4780978d-ade8-4f07-814e-fd2e5fa20e84 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:29.216691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4780978d-ade8-4f07-814e-fd2e5fa20e84 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:29.217790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4780978d-ade8-4f07-814e-fd2e5fa20e84 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:29.222205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4780978d-ade8-4f07-814e-fd2e5fa20e84 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:30.060503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4780978d-ade8-4f07-814e-fd2e5fa20e84 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:30.088342 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4780978d-ade8-4f07-814e-fd2e5fa20e84 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1363 microversion: 2.1 time: 0.934317 Sep 08 13:22:30.100157 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2517/5170] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:29 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1363 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:31.164982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-68c2c2a2-7e27-4f47-b408-05f1c923cdac tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:31.177226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-68c2c2a2-7e27-4f47-b408-05f1c923cdac tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:31.235608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68c2c2a2-7e27-4f47-b408-05f1c923cdac tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:31.242645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68c2c2a2-7e27-4f47-b408-05f1c923cdac tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:31.243742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68c2c2a2-7e27-4f47-b408-05f1c923cdac tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:31.245301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68c2c2a2-7e27-4f47-b408-05f1c923cdac tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:31.249167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68c2c2a2-7e27-4f47-b408-05f1c923cdac tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:31.250284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68c2c2a2-7e27-4f47-b408-05f1c923cdac tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:32.000930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c78bbeba-ab1d-4690-b17a-c4d51d5f67f8 req-e7e10975-4436-4106-ae89-38db2e0607c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3abfe3b5-55c0-40e6-906f-a7770dd8e5c7", "name": "network-vif-plugged", "status": "completed", "tag": "4f346bb7-ca7c-4060-b2f8-4bc559534eae"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:22:32.085690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c78bbeba-ab1d-4690-b17a-c4d51d5f67f8 req-e7e10975-4436-4106-ae89-38db2e0607c2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:32.086526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c78bbeba-ab1d-4690-b17a-c4d51d5f67f8 req-e7e10975-4436-4106-ae89-38db2e0607c2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:32.086526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c78bbeba-ab1d-4690-b17a-c4d51d5f67f8 req-e7e10975-4436-4106-ae89-38db2e0607c2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:32.125469 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c78bbeba-ab1d-4690-b17a-c4d51d5f67f8 req-e7e10975-4436-4106-ae89-38db2e0607c2 service nova] Creating event network-vif-plugged:4f346bb7-ca7c-4060-b2f8-4bc559534eae for instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 on n-h2-852084-10 Sep 08 13:22:32.150342 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c78bbeba-ab1d-4690-b17a-c4d51d5f67f8 req-e7e10975-4436-4106-ae89-38db2e0607c2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168753 Sep 08 13:22:32.175242 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2518/5171] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:22:32.316239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-68c2c2a2-7e27-4f47-b408-05f1c923cdac tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:32.384449 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-68c2c2a2-7e27-4f47-b408-05f1c923cdac tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1363 microversion: 2.1 time: 1.223061 Sep 08 13:22:32.390810 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2654/5172] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:31 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1363 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:33.428598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f35387a-c343-4efe-9b07-feee12f762fb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:33.429869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f35387a-c343-4efe-9b07-feee12f762fb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:33.465053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f35387a-c343-4efe-9b07-feee12f762fb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:33.465879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f35387a-c343-4efe-9b07-feee12f762fb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:33.471365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f35387a-c343-4efe-9b07-feee12f762fb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:33.474104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f35387a-c343-4efe-9b07-feee12f762fb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:33.479292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f35387a-c343-4efe-9b07-feee12f762fb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:33.483890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f35387a-c343-4efe-9b07-feee12f762fb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:35.460375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f35387a-c343-4efe-9b07-feee12f762fb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:35.478347 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f35387a-c343-4efe-9b07-feee12f762fb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1363 microversion: 2.1 time: 2.058429 Sep 08 13:22:35.499294 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2519/5173] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:33 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1363 bytes in 2073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:36.535499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7ee213db-e608-4c66-bfe0-c36193199324 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:36.538360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7ee213db-e608-4c66-bfe0-c36193199324 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:36.598310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ee213db-e608-4c66-bfe0-c36193199324 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:36.599134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ee213db-e608-4c66-bfe0-c36193199324 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:36.599946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ee213db-e608-4c66-bfe0-c36193199324 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:36.606289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ee213db-e608-4c66-bfe0-c36193199324 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:36.607198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ee213db-e608-4c66-bfe0-c36193199324 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:36.608056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ee213db-e608-4c66-bfe0-c36193199324 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:37.100453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ee213db-e608-4c66-bfe0-c36193199324 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:22:37.134664 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7ee213db-e608-4c66-bfe0-c36193199324 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1549 microversion: 2.1 time: 0.608967 Sep 08 13:22:37.141489 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2655/5174] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:22:36 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1549 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:22:37.176475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-602f7383-1aff-4b3e-b9f6-881b9db54bee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:22:37.178666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-602f7383-1aff-4b3e-b9f6-881b9db54bee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:22:37.230391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:37.268811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-602f7383-1aff-4b3e-b9f6-881b9db54bee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:37.270168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-602f7383-1aff-4b3e-b9f6-881b9db54bee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:37.277535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-602f7383-1aff-4b3e-b9f6-881b9db54bee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:37.281914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-602f7383-1aff-4b3e-b9f6-881b9db54bee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:37.287209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-602f7383-1aff-4b3e-b9f6-881b9db54bee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:37.288169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-602f7383-1aff-4b3e-b9f6-881b9db54bee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:37.324115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=41 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:38.070320 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-602f7383-1aff-4b3e-b9f6-881b9db54bee tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.912996 Sep 08 13:22:38.071411 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2520/5175] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:22:37 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-interface => generated 285 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:22:40.474892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-15fead17-8a5c-4eb4-9a0e-b2407b69b14a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Action: 'create', calling method: .version_select at 0x7fdb36c23dc0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1176312275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtpu2NWWDQ/ZneqiA4WrKOtMLvHvQZABMu19gwS550J+tarrOyPhnaM1L0d5C7nHSGyuuapu3GbWXNjc/4EIRxn1yivOodf3b8985qP+ci81Dt4H87hq4R2Vx3jjN4QYA=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:22:40.517641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=23 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:40.658301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-15fead17-8a5c-4eb4-9a0e-b2407b69b14a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Getting quotas for project 8de9ce7e5cda42afa55b08b9158cb72f. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:22:40.689536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-15fead17-8a5c-4eb4-9a0e-b2407b69b14a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Getting quotas for user e8b4c622b66243558ea7c2395101382b and project 8de9ce7e5cda42afa55b08b9158cb72f. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:22:40.854845 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-15fead17-8a5c-4eb4-9a0e-b2407b69b14a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.396543 Sep 08 13:22:40.861293 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2656/5176] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:22:40 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:22:48.393890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:48.395009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:48.407412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7a4d239e-8fb6-494e-a43f-ab669d9c8acf req-b2fa2fd1-3a32-4a71-a173-355c6f05aba1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3abfe3b5-55c0-40e6-906f-a7770dd8e5c7", "tag": "4f346bb7-ca7c-4060-b2f8-4bc559534eae"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:22:48.436003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7a4d239e-8fb6-494e-a43f-ab669d9c8acf req-b2fa2fd1-3a32-4a71-a173-355c6f05aba1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:22:48.438830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7a4d239e-8fb6-494e-a43f-ab669d9c8acf req-b2fa2fd1-3a32-4a71-a173-355c6f05aba1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:22:48.442784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7a4d239e-8fb6-494e-a43f-ab669d9c8acf req-b2fa2fd1-3a32-4a71-a173-355c6f05aba1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:22:48.503606 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7a4d239e-8fb6-494e-a43f-ab669d9c8acf req-b2fa2fd1-3a32-4a71-a173-355c6f05aba1 service nova] Creating event network-changed:4f346bb7-ca7c-4060-b2f8-4bc559534eae for instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 on n-h2-852084-10 Sep 08 13:22:48.543364 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7a4d239e-8fb6-494e-a43f-ab669d9c8acf req-b2fa2fd1-3a32-4a71-a173-355c6f05aba1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139802 Sep 08 13:22:48.563093 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2521/5177] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:22:58.448043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1598495099", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "5aac71d4-3a29-4164-b78a-723ee3a66234"}], "key_name": "tempest-TestNetworkBasicOps-1176312275", "security_groups": [{"name": "tempest-secgroup-smoke-40223545"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:22:58.482566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=44 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:58.488113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:22:58.489873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:00.170933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] validate_networks() for [('5aac71d4-3a29-4164-b78a-723ee3a66234', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:23:01.879703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:23:01.883991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:23:01.884896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:23:01.885567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:23:01.886499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:23:01.927306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:01.928323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:01.929248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:01.930542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:01.931389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:01.932070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:01.988801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Getting quotas for project 8de9ce7e5cda42afa55b08b9158cb72f. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:23:02.000039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Getting quotas for user e8b4c622b66243558ea7c2395101382b and project 8de9ce7e5cda42afa55b08b9158cb72f. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:23:02.039853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:23:02.047856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:23:02.226353 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-55c8d9c3-1311-450f-86c5-e67bc6425e60 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 3.776579 Sep 08 13:23:02.236513 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2657/5178] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:22:58 2022] POST /compute/v2.1/servers => generated 404 bytes in 3796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:23:02.242172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:02.244267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:02.272449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e1d02a1e-4155-4039-9dc0-9896e2000ddf tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:02.279393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e1d02a1e-4155-4039-9dc0-9896e2000ddf tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:02.495176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e1d02a1e-4155-4039-9dc0-9896e2000ddf tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:02.523330 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e1d02a1e-4155-4039-9dc0-9896e2000ddf tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1249 microversion: 2.1 time: 0.286845 Sep 08 13:23:02.527379 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2522/5179] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:02 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1249 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:03.558389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0ce0299d-5c7f-42d1-894d-87fd3607714b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:03.559213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0ce0299d-5c7f-42d1-894d-87fd3607714b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:03.571285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ce0299d-5c7f-42d1-894d-87fd3607714b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:03.579172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ce0299d-5c7f-42d1-894d-87fd3607714b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:03.584503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ce0299d-5c7f-42d1-894d-87fd3607714b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:03.585824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ce0299d-5c7f-42d1-894d-87fd3607714b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:03.587557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ce0299d-5c7f-42d1-894d-87fd3607714b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:03.592204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ce0299d-5c7f-42d1-894d-87fd3607714b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:03.749465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0ce0299d-5c7f-42d1-894d-87fd3607714b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:03.792014 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0ce0299d-5c7f-42d1-894d-87fd3607714b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1253 microversion: 2.1 time: 0.235224 Sep 08 13:23:03.793345 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2658/5180] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:03 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1253 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:04.825331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b4752bd-d4c3-48c9-b9e3-53cd50b40b36 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:04.826565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5b4752bd-d4c3-48c9-b9e3-53cd50b40b36 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:04.865058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b4752bd-d4c3-48c9-b9e3-53cd50b40b36 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:04.866731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b4752bd-d4c3-48c9-b9e3-53cd50b40b36 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:04.868939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b4752bd-d4c3-48c9-b9e3-53cd50b40b36 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:04.870761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b4752bd-d4c3-48c9-b9e3-53cd50b40b36 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:04.872005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b4752bd-d4c3-48c9-b9e3-53cd50b40b36 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:04.874031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b4752bd-d4c3-48c9-b9e3-53cd50b40b36 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:05.512190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5b4752bd-d4c3-48c9-b9e3-53cd50b40b36 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:05.549909 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5b4752bd-d4c3-48c9-b9e3-53cd50b40b36 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1309 microversion: 2.1 time: 0.733716 Sep 08 13:23:05.568670 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2523/5181] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:04 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1309 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:06.585968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dc699235-9221-46d8-9b71-730231c894cb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:06.587558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dc699235-9221-46d8-9b71-730231c894cb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:06.606100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc699235-9221-46d8-9b71-730231c894cb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:06.607156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc699235-9221-46d8-9b71-730231c894cb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:06.607915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc699235-9221-46d8-9b71-730231c894cb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:06.608976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc699235-9221-46d8-9b71-730231c894cb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:06.609778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc699235-9221-46d8-9b71-730231c894cb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:06.610482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc699235-9221-46d8-9b71-730231c894cb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:07.436232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dc699235-9221-46d8-9b71-730231c894cb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:07.462415 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dc699235-9221-46d8-9b71-730231c894cb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1307 microversion: 2.1 time: 0.878684 Sep 08 13:23:07.464997 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2659/5182] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:06 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1307 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:08.433799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-954721964", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:23:08.512223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cb8a39dd-9e39-49df-a1a8-145ce6bdf4a9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:08.513016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cb8a39dd-9e39-49df-a1a8-145ce6bdf4a9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:08.529987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb8a39dd-9e39-49df-a1a8-145ce6bdf4a9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:08.531950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb8a39dd-9e39-49df-a1a8-145ce6bdf4a9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:08.536644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb8a39dd-9e39-49df-a1a8-145ce6bdf4a9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:08.538195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb8a39dd-9e39-49df-a1a8-145ce6bdf4a9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:08.539420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb8a39dd-9e39-49df-a1a8-145ce6bdf4a9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:08.541544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb8a39dd-9e39-49df-a1a8-145ce6bdf4a9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:08.619034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:23:08.873511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cb8a39dd-9e39-49df-a1a8-145ce6bdf4a9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:08.894105 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cb8a39dd-9e39-49df-a1a8-145ce6bdf4a9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1307 microversion: 2.1 time: 0.385337 Sep 08 13:23:08.896960 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2660/5183] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:08 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1307 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:09.909639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:23:09.910223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:23:09.910536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:23:09.912090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:23:09.912774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:23:09.927382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f7a4e567-79b7-4c22-8a70-cb52eaa58c41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:09.928797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f7a4e567-79b7-4c22-8a70-cb52eaa58c41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:09.952865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7a4e567-79b7-4c22-8a70-cb52eaa58c41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:09.954955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7a4e567-79b7-4c22-8a70-cb52eaa58c41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:09.957895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:09.958899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7a4e567-79b7-4c22-8a70-cb52eaa58c41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:09.960065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7a4e567-79b7-4c22-8a70-cb52eaa58c41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:09.961907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7a4e567-79b7-4c22-8a70-cb52eaa58c41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:09.962187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:09.963049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:09.963778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7a4e567-79b7-4c22-8a70-cb52eaa58c41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:09.969409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:09.969927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:09.970381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:10.023941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Getting quotas for project 9116b26920f34a6697bde76eec67d525. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:23:10.047492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Getting quotas for user 2e996bf8a26649fca6da3aa5ff9c5858 and project 9116b26920f34a6697bde76eec67d525. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:23:10.066366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:23:10.069576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:23:10.220738 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cebc4127-86f4-4dd0-b55f-7fcf8e1c581e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.806169 Sep 08 13:23:10.224264 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2524/5184] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:23:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:23:10.236187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d65ba9bf-68a7-4e1b-89f1-a30440710f31 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:10.237398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d65ba9bf-68a7-4e1b-89f1-a30440710f31 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:10.626140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d65ba9bf-68a7-4e1b-89f1-a30440710f31 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:10.640893 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d65ba9bf-68a7-4e1b-89f1-a30440710f31 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1214 microversion: 2.1 time: 0.409730 Sep 08 13:23:10.642404 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2525/5185] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:10 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1214 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:10.887584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f7a4e567-79b7-4c22-8a70-cb52eaa58c41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:10.898876 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f7a4e567-79b7-4c22-8a70-cb52eaa58c41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1373 microversion: 2.1 time: 0.981992 Sep 08 13:23:10.900477 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2661/5186] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:09 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1373 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:11.679547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-740b6149-7a61-428c-9383-39625e12efc8 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:11.682570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-740b6149-7a61-428c-9383-39625e12efc8 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:11.698442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-740b6149-7a61-428c-9383-39625e12efc8 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:11.699326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-740b6149-7a61-428c-9383-39625e12efc8 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:11.700012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-740b6149-7a61-428c-9383-39625e12efc8 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:11.701215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-740b6149-7a61-428c-9383-39625e12efc8 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:11.710208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-740b6149-7a61-428c-9383-39625e12efc8 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:11.710870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-740b6149-7a61-428c-9383-39625e12efc8 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:11.927289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e551fa43-6958-4663-8930-74fc367f9784 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:11.928581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e551fa43-6958-4663-8930-74fc367f9784 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:11.949349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e551fa43-6958-4663-8930-74fc367f9784 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:11.951901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e551fa43-6958-4663-8930-74fc367f9784 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:11.952713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e551fa43-6958-4663-8930-74fc367f9784 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:11.955855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e551fa43-6958-4663-8930-74fc367f9784 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:11.956557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e551fa43-6958-4663-8930-74fc367f9784 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:11.960130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e551fa43-6958-4663-8930-74fc367f9784 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:11.966108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:12.024900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:12.074446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-740b6149-7a61-428c-9383-39625e12efc8 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:12.097789 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-740b6149-7a61-428c-9383-39625e12efc8 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1210 microversion: 2.1 time: 0.422469 Sep 08 13:23:12.099678 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2526/5187] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:11 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1210 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:12.113295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-196777f4-995e-4eb4-a68f-3125bcc975c1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:12.115810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-196777f4-995e-4eb4-a68f-3125bcc975c1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:12.136703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-196777f4-995e-4eb4-a68f-3125bcc975c1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:12.139000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-196777f4-995e-4eb4-a68f-3125bcc975c1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:12.141044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-196777f4-995e-4eb4-a68f-3125bcc975c1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:12.144863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-196777f4-995e-4eb4-a68f-3125bcc975c1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:12.149005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-196777f4-995e-4eb4-a68f-3125bcc975c1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:12.149791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-196777f4-995e-4eb4-a68f-3125bcc975c1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:12.197539 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-196777f4-995e-4eb4-a68f-3125bcc975c1 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/ips" status: 200 len: 145 microversion: 2.1 time: 0.094699 Sep 08 13:23:12.198510 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2527/5188] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 13:23:12 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/ips => generated 145 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:13.154418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0c6ce88c-01b6-4cc3-8bd4-cb05afef3d1d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:13.156322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0c6ce88c-01b6-4cc3-8bd4-cb05afef3d1d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:13.186305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c6ce88c-01b6-4cc3-8bd4-cb05afef3d1d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:13.193366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c6ce88c-01b6-4cc3-8bd4-cb05afef3d1d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:13.195600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c6ce88c-01b6-4cc3-8bd4-cb05afef3d1d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:13.196604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c6ce88c-01b6-4cc3-8bd4-cb05afef3d1d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:13.198753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c6ce88c-01b6-4cc3-8bd4-cb05afef3d1d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:13.205333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c6ce88c-01b6-4cc3-8bd4-cb05afef3d1d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:13.464853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e551fa43-6958-4663-8930-74fc367f9784 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:13.482217 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e551fa43-6958-4663-8930-74fc367f9784 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1373 microversion: 2.1 time: 1.557198 Sep 08 13:23:13.483332 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2662/5189] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:11 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1373 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:13.857951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0c6ce88c-01b6-4cc3-8bd4-cb05afef3d1d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:13.877917 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0c6ce88c-01b6-4cc3-8bd4-cb05afef3d1d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1272 microversion: 2.1 time: 0.729129 Sep 08 13:23:13.897295 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2528/5190] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:13 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1272 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:14.515257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-62c3dd34-9703-4ecf-866b-7ae73ed85ca9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:14.520833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-62c3dd34-9703-4ecf-866b-7ae73ed85ca9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:14.560406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62c3dd34-9703-4ecf-866b-7ae73ed85ca9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:14.561267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62c3dd34-9703-4ecf-866b-7ae73ed85ca9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:14.561943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62c3dd34-9703-4ecf-866b-7ae73ed85ca9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:14.562927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62c3dd34-9703-4ecf-866b-7ae73ed85ca9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:14.566643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62c3dd34-9703-4ecf-866b-7ae73ed85ca9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:14.569500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62c3dd34-9703-4ecf-866b-7ae73ed85ca9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:14.923729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cbed3cda-fffd-4319-8dfe-c1ca9df48c2e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:14.927073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cbed3cda-fffd-4319-8dfe-c1ca9df48c2e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:14.938868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbed3cda-fffd-4319-8dfe-c1ca9df48c2e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:14.945007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbed3cda-fffd-4319-8dfe-c1ca9df48c2e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:14.945916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbed3cda-fffd-4319-8dfe-c1ca9df48c2e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:14.947086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbed3cda-fffd-4319-8dfe-c1ca9df48c2e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:14.953003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbed3cda-fffd-4319-8dfe-c1ca9df48c2e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:14.953773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbed3cda-fffd-4319-8dfe-c1ca9df48c2e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:15.414828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cbed3cda-fffd-4319-8dfe-c1ca9df48c2e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:15.463372 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cbed3cda-fffd-4319-8dfe-c1ca9df48c2e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1272 microversion: 2.1 time: 0.538522 Sep 08 13:23:15.493087 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2529/5191] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:14 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1272 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:15.572522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cea995b5-b5a3-48b7-bca9-033e4da995bf tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98e28928-c40d-49be-9132-dcab293e0a04"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:23:15.587731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cea995b5-b5a3-48b7-bca9-033e4da995bf tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:15.619914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cea995b5-b5a3-48b7-bca9-033e4da995bf tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:15.620843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cea995b5-b5a3-48b7-bca9-033e4da995bf tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:15.621661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cea995b5-b5a3-48b7-bca9-033e4da995bf tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:15.631504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cea995b5-b5a3-48b7-bca9-033e4da995bf tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:15.632291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cea995b5-b5a3-48b7-bca9-033e4da995bf tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:15.633014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cea995b5-b5a3-48b7-bca9-033e4da995bf tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:15.794211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-62c3dd34-9703-4ecf-866b-7ae73ed85ca9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:15.816744 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-62c3dd34-9703-4ecf-866b-7ae73ed85ca9 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1373 microversion: 2.1 time: 1.311372 Sep 08 13:23:15.820705 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2663/5192] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:14 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1373 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:16.250043 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cea995b5-b5a3-48b7-bca9-033e4da995bf tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "POST /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.688083 Sep 08 13:23:16.251511 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2530/5193] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:23:15 2022] POST /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments => generated 194 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:16.517330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f8228899-c884-4de5-bc32-9303a843185e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:16.519003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f8228899-c884-4de5-bc32-9303a843185e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:16.540483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8228899-c884-4de5-bc32-9303a843185e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:16.544056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8228899-c884-4de5-bc32-9303a843185e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:16.547772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8228899-c884-4de5-bc32-9303a843185e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:16.548720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8228899-c884-4de5-bc32-9303a843185e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:16.550372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8228899-c884-4de5-bc32-9303a843185e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:16.555054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8228899-c884-4de5-bc32-9303a843185e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:16.847623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e853db4-fe30-49ca-b1dc-36f7cdaaf520 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:16.848374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6e853db4-fe30-49ca-b1dc-36f7cdaaf520 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:16.861100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e853db4-fe30-49ca-b1dc-36f7cdaaf520 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:16.862141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e853db4-fe30-49ca-b1dc-36f7cdaaf520 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:16.866245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e853db4-fe30-49ca-b1dc-36f7cdaaf520 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:16.872251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e853db4-fe30-49ca-b1dc-36f7cdaaf520 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:16.873250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e853db4-fe30-49ca-b1dc-36f7cdaaf520 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:16.873898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e853db4-fe30-49ca-b1dc-36f7cdaaf520 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:17.787993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f8228899-c884-4de5-bc32-9303a843185e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:17.811588 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f8228899-c884-4de5-bc32-9303a843185e tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 1.295061 Sep 08 13:23:17.815462 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2664/5194] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:16 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 1304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:17.826171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-14b735c2-7751-419c-ae1c-64971d610dd3 req-7d6796f5-8770-4940-9da2-a156a88e16c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c63671b3-14c6-4956-9131-8324104a48eb", "tag": "7f1728cc-3a88-4e36-98ef-185c9951e7aa"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:23:17.881854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-14b735c2-7751-419c-ae1c-64971d610dd3 req-7d6796f5-8770-4940-9da2-a156a88e16c5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:17.884860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-14b735c2-7751-419c-ae1c-64971d610dd3 req-7d6796f5-8770-4940-9da2-a156a88e16c5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:17.885398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-14b735c2-7751-419c-ae1c-64971d610dd3 req-7d6796f5-8770-4940-9da2-a156a88e16c5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:17.951503 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-14b735c2-7751-419c-ae1c-64971d610dd3 req-7d6796f5-8770-4940-9da2-a156a88e16c5 service nova] Creating event network-changed:7f1728cc-3a88-4e36-98ef-185c9951e7aa for instance c63671b3-14c6-4956-9131-8324104a48eb on n-h2-852084-10 Sep 08 13:23:17.971211 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-14b735c2-7751-419c-ae1c-64971d610dd3 req-7d6796f5-8770-4940-9da2-a156a88e16c5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150174 Sep 08 13:23:17.977206 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2665/5195] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:18.100887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6e853db4-fe30-49ca-b1dc-36f7cdaaf520 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:18.121577 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e853db4-fe30-49ca-b1dc-36f7cdaaf520 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1373 microversion: 2.1 time: 1.280486 Sep 08 13:23:18.141014 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2531/5196] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:16 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1373 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:18.838176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fda8ad17-8c46-4639-80c7-b429ecb08000 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:18.839543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fda8ad17-8c46-4639-80c7-b429ecb08000 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:18.862746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fda8ad17-8c46-4639-80c7-b429ecb08000 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:18.863574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fda8ad17-8c46-4639-80c7-b429ecb08000 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:18.864203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fda8ad17-8c46-4639-80c7-b429ecb08000 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:18.868309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fda8ad17-8c46-4639-80c7-b429ecb08000 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:18.869226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fda8ad17-8c46-4639-80c7-b429ecb08000 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:18.869851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fda8ad17-8c46-4639-80c7-b429ecb08000 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:19.152483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3c0dcc2e-e78c-412c-a94b-cb937a9eb1aa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:19.155672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3c0dcc2e-e78c-412c-a94b-cb937a9eb1aa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:19.190535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c0dcc2e-e78c-412c-a94b-cb937a9eb1aa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:19.199920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c0dcc2e-e78c-412c-a94b-cb937a9eb1aa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:19.200421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c0dcc2e-e78c-412c-a94b-cb937a9eb1aa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:19.201471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c0dcc2e-e78c-412c-a94b-cb937a9eb1aa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:19.201946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c0dcc2e-e78c-412c-a94b-cb937a9eb1aa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:19.202381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c0dcc2e-e78c-412c-a94b-cb937a9eb1aa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:19.476051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fda8ad17-8c46-4639-80c7-b429ecb08000 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:19.493919 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fda8ad17-8c46-4639-80c7-b429ecb08000 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 0.659842 Sep 08 13:23:19.498408 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2666/5197] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:18 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:19.994300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:20.201317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3c0dcc2e-e78c-412c-a94b-cb937a9eb1aa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:20.226479 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3c0dcc2e-e78c-412c-a94b-cb937a9eb1aa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1373 microversion: 2.1 time: 1.074309 Sep 08 13:23:20.246633 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2532/5198] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:19 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1373 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:20.528338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00de0a1b-7085-4a35-8ea1-aa163877ef6a tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:20.532283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00de0a1b-7085-4a35-8ea1-aa163877ef6a tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:20.553297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00de0a1b-7085-4a35-8ea1-aa163877ef6a tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:20.561760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00de0a1b-7085-4a35-8ea1-aa163877ef6a tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:20.565055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00de0a1b-7085-4a35-8ea1-aa163877ef6a tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:20.570086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00de0a1b-7085-4a35-8ea1-aa163877ef6a tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:20.572260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00de0a1b-7085-4a35-8ea1-aa163877ef6a tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:20.572880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00de0a1b-7085-4a35-8ea1-aa163877ef6a tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:21.258609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c83307b8-086a-4ea3-b198-ca319d9f436d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:21.259858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c83307b8-086a-4ea3-b198-ca319d9f436d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:21.278511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=10 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:21.297701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c83307b8-086a-4ea3-b198-ca319d9f436d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:21.298624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c83307b8-086a-4ea3-b198-ca319d9f436d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:21.302866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c83307b8-086a-4ea3-b198-ca319d9f436d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:21.304664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c83307b8-086a-4ea3-b198-ca319d9f436d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:21.308616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c83307b8-086a-4ea3-b198-ca319d9f436d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:21.309841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c83307b8-086a-4ea3-b198-ca319d9f436d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:22.025450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00de0a1b-7085-4a35-8ea1-aa163877ef6a tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:22.040235 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00de0a1b-7085-4a35-8ea1-aa163877ef6a tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 1.519245 Sep 08 13:23:22.048249 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2667/5199] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:20 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:22.117246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c83307b8-086a-4ea3-b198-ca319d9f436d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:22.132502 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c83307b8-086a-4ea3-b198-ca319d9f436d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1373 microversion: 2.1 time: 0.881479 Sep 08 13:23:22.133405 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2533/5200] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:21 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1373 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:23.078924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6a9d28c-dae5-4639-b705-989916cf86fe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:23.079734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f6a9d28c-dae5-4639-b705-989916cf86fe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:23.088904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6a9d28c-dae5-4639-b705-989916cf86fe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:23.089263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6a9d28c-dae5-4639-b705-989916cf86fe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:23.089705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6a9d28c-dae5-4639-b705-989916cf86fe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:23.090509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6a9d28c-dae5-4639-b705-989916cf86fe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:23.091024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6a9d28c-dae5-4639-b705-989916cf86fe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:23.091586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6a9d28c-dae5-4639-b705-989916cf86fe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:23.178310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-be155998-1c9e-408f-b6b1-ee670653983a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:23.179119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-be155998-1c9e-408f-b6b1-ee670653983a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:23.195971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be155998-1c9e-408f-b6b1-ee670653983a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:23.196493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be155998-1c9e-408f-b6b1-ee670653983a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:23.196905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be155998-1c9e-408f-b6b1-ee670653983a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:23.202509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be155998-1c9e-408f-b6b1-ee670653983a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:23.203521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be155998-1c9e-408f-b6b1-ee670653983a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:23.208568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be155998-1c9e-408f-b6b1-ee670653983a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:23.628515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f6a9d28c-dae5-4639-b705-989916cf86fe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:23.633529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-be155998-1c9e-408f-b6b1-ee670653983a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:23.662782 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-be155998-1c9e-408f-b6b1-ee670653983a tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1373 microversion: 2.1 time: 0.486969 Sep 08 13:23:23.663506 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2534/5201] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:23 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1373 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:23.667591 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f6a9d28c-dae5-4639-b705-989916cf86fe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 0.598207 Sep 08 13:23:23.672275 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2668/5202] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:23 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:24.691434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-75aa69e1-9cc7-45d8-ab5b-a772283d0871 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:24.692074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-75aa69e1-9cc7-45d8-ab5b-a772283d0871 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:24.708461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75aa69e1-9cc7-45d8-ab5b-a772283d0871 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:24.708974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75aa69e1-9cc7-45d8-ab5b-a772283d0871 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:24.717648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75aa69e1-9cc7-45d8-ab5b-a772283d0871 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:24.718550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75aa69e1-9cc7-45d8-ab5b-a772283d0871 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:24.719056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75aa69e1-9cc7-45d8-ab5b-a772283d0871 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:24.723671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75aa69e1-9cc7-45d8-ab5b-a772283d0871 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:24.727316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-429e78c9-fec6-4cec-8e81-1f4abb328b81 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:24.731787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-429e78c9-fec6-4cec-8e81-1f4abb328b81 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:24.784591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-429e78c9-fec6-4cec-8e81-1f4abb328b81 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:24.797745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-429e78c9-fec6-4cec-8e81-1f4abb328b81 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:24.802940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-429e78c9-fec6-4cec-8e81-1f4abb328b81 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:24.804524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-429e78c9-fec6-4cec-8e81-1f4abb328b81 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:24.806576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-429e78c9-fec6-4cec-8e81-1f4abb328b81 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:24.815046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-429e78c9-fec6-4cec-8e81-1f4abb328b81 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:25.228673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-75aa69e1-9cc7-45d8-ab5b-a772283d0871 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:25.235573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-429e78c9-fec6-4cec-8e81-1f4abb328b81 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:25.242198 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-75aa69e1-9cc7-45d8-ab5b-a772283d0871 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1373 microversion: 2.1 time: 0.555773 Sep 08 13:23:25.245034 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-429e78c9-fec6-4cec-8e81-1f4abb328b81 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 0.536623 Sep 08 13:23:25.245651 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2669/5203] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:24 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:25.259461 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2535/5204] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:24 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1373 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:25.995160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-ab7d4d5e-fbae-4d2c-9db2-92fa30e939ac req-295107bc-b75c-4483-bdc8-b9059c3ff86e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63671b3-14c6-4956-9131-8324104a48eb", "name": "network-vif-plugged", "status": "completed", "tag": "7f1728cc-3a88-4e36-98ef-185c9951e7aa"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:23:26.037366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ab7d4d5e-fbae-4d2c-9db2-92fa30e939ac req-295107bc-b75c-4483-bdc8-b9059c3ff86e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:26.040892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ab7d4d5e-fbae-4d2c-9db2-92fa30e939ac req-295107bc-b75c-4483-bdc8-b9059c3ff86e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:26.041860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ab7d4d5e-fbae-4d2c-9db2-92fa30e939ac req-295107bc-b75c-4483-bdc8-b9059c3ff86e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:26.072042 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-ab7d4d5e-fbae-4d2c-9db2-92fa30e939ac req-295107bc-b75c-4483-bdc8-b9059c3ff86e service nova] Creating event network-vif-plugged:7f1728cc-3a88-4e36-98ef-185c9951e7aa for instance c63671b3-14c6-4956-9131-8324104a48eb on n-h2-852084-10 Sep 08 13:23:26.079310 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-ab7d4d5e-fbae-4d2c-9db2-92fa30e939ac req-295107bc-b75c-4483-bdc8-b9059c3ff86e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094051 Sep 08 13:23:26.080896 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2536/5205] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:26.277909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ff36372f-131b-4bd8-ad6f-a9bd7a7dcffa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:26.278947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff36372f-131b-4bd8-ad6f-a9bd7a7dcffa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:26.280913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-83db58e6-f8d0-4adf-a780-a663865f722b tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:26.281939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-83db58e6-f8d0-4adf-a780-a663865f722b tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:26.290765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff36372f-131b-4bd8-ad6f-a9bd7a7dcffa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:26.291296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff36372f-131b-4bd8-ad6f-a9bd7a7dcffa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:26.291743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff36372f-131b-4bd8-ad6f-a9bd7a7dcffa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:26.292798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff36372f-131b-4bd8-ad6f-a9bd7a7dcffa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:26.293441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff36372f-131b-4bd8-ad6f-a9bd7a7dcffa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:26.293892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff36372f-131b-4bd8-ad6f-a9bd7a7dcffa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:26.296489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83db58e6-f8d0-4adf-a780-a663865f722b tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:26.300520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83db58e6-f8d0-4adf-a780-a663865f722b tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:26.305457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83db58e6-f8d0-4adf-a780-a663865f722b tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:26.316457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83db58e6-f8d0-4adf-a780-a663865f722b tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:26.317210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83db58e6-f8d0-4adf-a780-a663865f722b tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:26.317841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-83db58e6-f8d0-4adf-a780-a663865f722b tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:26.881583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-83db58e6-f8d0-4adf-a780-a663865f722b tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:26.890480 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-83db58e6-f8d0-4adf-a780-a663865f722b tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 0.616885 Sep 08 13:23:26.891102 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2537/5206] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:26 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:26.963288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ff36372f-131b-4bd8-ad6f-a9bd7a7dcffa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:26.976169 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ff36372f-131b-4bd8-ad6f-a9bd7a7dcffa tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1373 microversion: 2.1 time: 0.704079 Sep 08 13:23:26.976787 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2670/5207] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:26 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1373 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:27.375768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7e6adb49-cd6d-4bc0-abf8-51fa37e47a32 req-a92c1002-1557-402a-b4ee-86574b6c33a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46bf8338-c378-4fd3-87e7-63c5993f3b73", "tag": "bc0857bf-d3a0-4699-8de2-ff0bd08a733e"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:23:27.407205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7e6adb49-cd6d-4bc0-abf8-51fa37e47a32 req-a92c1002-1557-402a-b4ee-86574b6c33a1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:27.410436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7e6adb49-cd6d-4bc0-abf8-51fa37e47a32 req-a92c1002-1557-402a-b4ee-86574b6c33a1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:27.412377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7e6adb49-cd6d-4bc0-abf8-51fa37e47a32 req-a92c1002-1557-402a-b4ee-86574b6c33a1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:27.458104 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7e6adb49-cd6d-4bc0-abf8-51fa37e47a32 req-a92c1002-1557-402a-b4ee-86574b6c33a1 service nova] Creating event network-changed:bc0857bf-d3a0-4699-8de2-ff0bd08a733e for instance 46bf8338-c378-4fd3-87e7-63c5993f3b73 on n-h1-852084-10 Sep 08 13:23:27.466418 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7e6adb49-cd6d-4bc0-abf8-51fa37e47a32 req-a92c1002-1557-402a-b4ee-86574b6c33a1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.573987 Sep 08 13:23:27.470158 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2538/5208] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:27.925971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ea54bcde-2f11-4926-9048-4417dfb688d0 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:27.928449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ea54bcde-2f11-4926-9048-4417dfb688d0 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:27.960005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea54bcde-2f11-4926-9048-4417dfb688d0 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:27.962606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea54bcde-2f11-4926-9048-4417dfb688d0 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:27.963719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea54bcde-2f11-4926-9048-4417dfb688d0 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:27.966819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea54bcde-2f11-4926-9048-4417dfb688d0 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:27.968986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea54bcde-2f11-4926-9048-4417dfb688d0 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:27.984594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ea54bcde-2f11-4926-9048-4417dfb688d0 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:28.009688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6237cb4f-7bad-4f17-a2f9-642d45049455 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:28.010433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6237cb4f-7bad-4f17-a2f9-642d45049455 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:28.029171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6237cb4f-7bad-4f17-a2f9-642d45049455 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:28.030515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6237cb4f-7bad-4f17-a2f9-642d45049455 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:28.033867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6237cb4f-7bad-4f17-a2f9-642d45049455 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:28.037902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6237cb4f-7bad-4f17-a2f9-642d45049455 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:28.038960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6237cb4f-7bad-4f17-a2f9-642d45049455 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:28.039634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6237cb4f-7bad-4f17-a2f9-642d45049455 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:28.680542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6237cb4f-7bad-4f17-a2f9-642d45049455 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:28.714145 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6237cb4f-7bad-4f17-a2f9-642d45049455 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1546 microversion: 2.1 time: 0.709989 Sep 08 13:23:28.724787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ea54bcde-2f11-4926-9048-4417dfb688d0 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:28.724787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=81 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:28.741227 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2539/5209] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:28 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1546 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:28.761930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e9f8d9e9-1014-4c15-84a8-ed2f1728bf3f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:28.762679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e9f8d9e9-1014-4c15-84a8-ed2f1728bf3f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:28.770294 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ea54bcde-2f11-4926-9048-4417dfb688d0 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 0.850093 Sep 08 13:23:28.772250 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2671/5210] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:27 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:28.788997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9f8d9e9-1014-4c15-84a8-ed2f1728bf3f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:28.789506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9f8d9e9-1014-4c15-84a8-ed2f1728bf3f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:28.790127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9f8d9e9-1014-4c15-84a8-ed2f1728bf3f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:28.791342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9f8d9e9-1014-4c15-84a8-ed2f1728bf3f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:28.791826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9f8d9e9-1014-4c15-84a8-ed2f1728bf3f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:28.792315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e9f8d9e9-1014-4c15-84a8-ed2f1728bf3f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:29.355687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e9f8d9e9-1014-4c15-84a8-ed2f1728bf3f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:29.390726 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e9f8d9e9-1014-4c15-84a8-ed2f1728bf3f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1546 microversion: 2.1 time: 0.629950 Sep 08 13:23:29.400303 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2540/5211] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:28 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1546 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:29.825433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d3bd96d2-7c9c-4ab5-b884-1836fba6b38d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:29.828600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d3bd96d2-7c9c-4ab5-b884-1836fba6b38d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:29.832849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:29.841182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3bd96d2-7c9c-4ab5-b884-1836fba6b38d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:29.848781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3bd96d2-7c9c-4ab5-b884-1836fba6b38d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:29.852586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3bd96d2-7c9c-4ab5-b884-1836fba6b38d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:29.853893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3bd96d2-7c9c-4ab5-b884-1836fba6b38d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:29.854866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3bd96d2-7c9c-4ab5-b884-1836fba6b38d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:29.857628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3bd96d2-7c9c-4ab5-b884-1836fba6b38d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:30.308527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d3bd96d2-7c9c-4ab5-b884-1836fba6b38d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:30.323295 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d3bd96d2-7c9c-4ab5-b884-1836fba6b38d tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 0.502159 Sep 08 13:23:30.324770 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2672/5212] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:29 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:31.380466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4010d3d1-b3d8-4939-b164-7dc0a5d154e5 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:31.387034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4010d3d1-b3d8-4939-b164-7dc0a5d154e5 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:31.421165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4010d3d1-b3d8-4939-b164-7dc0a5d154e5 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:31.421964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4010d3d1-b3d8-4939-b164-7dc0a5d154e5 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:31.422700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4010d3d1-b3d8-4939-b164-7dc0a5d154e5 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:31.424483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4010d3d1-b3d8-4939-b164-7dc0a5d154e5 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:31.427969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4010d3d1-b3d8-4939-b164-7dc0a5d154e5 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:31.436618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4010d3d1-b3d8-4939-b164-7dc0a5d154e5 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:31.600624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c48a34d5-43fe-4d06-af34-a2c447db9146 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:31.609969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c48a34d5-43fe-4d06-af34-a2c447db9146 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:31.610843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c48a34d5-43fe-4d06-af34-a2c447db9146 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:31.612185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c48a34d5-43fe-4d06-af34-a2c447db9146 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:31.613604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c48a34d5-43fe-4d06-af34-a2c447db9146 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:31.614478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c48a34d5-43fe-4d06-af34-a2c447db9146 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:31.615310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c48a34d5-43fe-4d06-af34-a2c447db9146 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:31.718072 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c48a34d5-43fe-4d06-af34-a2c447db9146 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.512340 Sep 08 13:23:31.740285 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2541/5213] 10.222.0.78 () {58 vars in 1185 bytes} [Thu Sep 8 13:23:31 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:32.120522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-35483519", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "availability_zone": "nova:n-h1-852084-10", "networks": [{"uuid": "1accf130-38d5-4381-aef9-0a34f895737e"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:23:32.342488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] validate_networks() for [('1accf130-38d5-4381-aef9-0a34f895737e', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:23:32.763730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4010d3d1-b3d8-4939-b164-7dc0a5d154e5 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:32.788273 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4010d3d1-b3d8-4939-b164-7dc0a5d154e5 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 1.423796 Sep 08 13:23:32.792230 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2673/5214] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:31 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 1429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:33.854167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d9348403-3c2a-4671-9770-41e6a8b67823 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:33.860191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d9348403-3c2a-4671-9770-41e6a8b67823 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:33.900545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9348403-3c2a-4671-9770-41e6a8b67823 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:33.902128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9348403-3c2a-4671-9770-41e6a8b67823 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:33.906193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9348403-3c2a-4671-9770-41e6a8b67823 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:33.926693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9348403-3c2a-4671-9770-41e6a8b67823 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:33.928888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9348403-3c2a-4671-9770-41e6a8b67823 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:33.933525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9348403-3c2a-4671-9770-41e6a8b67823 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:34.643167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d9348403-3c2a-4671-9770-41e6a8b67823 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:34.669760 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d9348403-3c2a-4671-9770-41e6a8b67823 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 0.843469 Sep 08 13:23:34.679719 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2674/5215] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:33 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:35.257048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:23:35.258276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:23:35.262816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:23:35.265364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:23:35.273001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:23:35.297841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:35.350720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:35.358680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:35.360250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:35.364823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:35.368232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:35.372815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:35.432873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:35.478991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Getting quotas for project a8689932c83541b59d0ce26909d9d959. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:23:35.508214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Getting quotas for user 3b7d980f46db446ca11f6cc1e76fbff6 and project a8689932c83541b59d0ce26909d9d959. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:23:35.555776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:23:35.558965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:23:35.584469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fa86f4c8-481e-4782-8b87-542aa090540e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:35.600715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fa86f4c8-481e-4782-8b87-542aa090540e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:35.664568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa86f4c8-481e-4782-8b87-542aa090540e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:35.671219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa86f4c8-481e-4782-8b87-542aa090540e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:35.675793 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-21c4f1a7-fa1f-4514-8bc3-ebb4a7fc98d9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.557770 Sep 08 13:23:35.684002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa86f4c8-481e-4782-8b87-542aa090540e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:35.686191 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2542/5216] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:23:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 3572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:23:35.688065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa86f4c8-481e-4782-8b87-542aa090540e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:35.694302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa86f4c8-481e-4782-8b87-542aa090540e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:35.695762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa86f4c8-481e-4782-8b87-542aa090540e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:35.710389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-497a81be-2750-4424-b53b-cdca04e67a69 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:35.711980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-497a81be-2750-4424-b53b-cdca04e67a69 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:35.786590 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fa86f4c8-481e-4782-8b87-542aa090540e tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231065 Sep 08 13:23:35.788000 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2675/5217] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:23:35 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments => generated 197 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:35.793788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e2926541-fe09-4f76-bd82-73ee96665cfe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:35.794942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e2926541-fe09-4f76-bd82-73ee96665cfe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:35.803294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2926541-fe09-4f76-bd82-73ee96665cfe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:35.804244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2926541-fe09-4f76-bd82-73ee96665cfe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:35.805313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2926541-fe09-4f76-bd82-73ee96665cfe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:35.806317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2926541-fe09-4f76-bd82-73ee96665cfe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:35.807092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2926541-fe09-4f76-bd82-73ee96665cfe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:35.807839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2926541-fe09-4f76-bd82-73ee96665cfe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:36.149752 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-497a81be-2750-4424-b53b-cdca04e67a69 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1327 microversion: 2.1 time: 0.456335 Sep 08 13:23:36.153838 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2543/5218] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:35 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1327 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:36.181440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1adcb7f1-2701-4fb6-88f0-a954ba9304bb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:36.182965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1adcb7f1-2701-4fb6-88f0-a954ba9304bb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:36.204263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1adcb7f1-2701-4fb6-88f0-a954ba9304bb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:36.207387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1adcb7f1-2701-4fb6-88f0-a954ba9304bb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:36.210489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1adcb7f1-2701-4fb6-88f0-a954ba9304bb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:36.214171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1adcb7f1-2701-4fb6-88f0-a954ba9304bb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:36.220407 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1adcb7f1-2701-4fb6-88f0-a954ba9304bb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:36.223107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1adcb7f1-2701-4fb6-88f0-a954ba9304bb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:36.407265 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1adcb7f1-2701-4fb6-88f0-a954ba9304bb tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments/98e28928-c40d-49be-9132-dcab293e0a04" status: 200 len: 194 microversion: 2.1 time: 0.242793 Sep 08 13:23:36.428954 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2544/5219] 10.222.0.78 () {58 vars in 1413 bytes} [Thu Sep 8 13:23:36 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments/98e28928-c40d-49be-9132-dcab293e0a04 => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:37.107937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e2926541-fe09-4f76-bd82-73ee96665cfe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:37.119876 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e2926541-fe09-4f76-bd82-73ee96665cfe tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 1.330476 Sep 08 13:23:37.130842 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2676/5220] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:35 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 1342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:37.194024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d60dd4be-c438-49b6-a3a8-920b35c89b48 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:37.194852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d60dd4be-c438-49b6-a3a8-920b35c89b48 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:37.481220 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d60dd4be-c438-49b6-a3a8-920b35c89b48 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1327 microversion: 2.1 time: 0.288186 Sep 08 13:23:37.499621 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2545/5221] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:37 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1327 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:38.159026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4c89efc7-9461-40c1-8671-5a0f352f0abb tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:38.161055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4c89efc7-9461-40c1-8671-5a0f352f0abb tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:38.183703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c89efc7-9461-40c1-8671-5a0f352f0abb tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:38.184411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c89efc7-9461-40c1-8671-5a0f352f0abb tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:38.187423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c89efc7-9461-40c1-8671-5a0f352f0abb tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:38.188649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c89efc7-9461-40c1-8671-5a0f352f0abb tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:38.189421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c89efc7-9461-40c1-8671-5a0f352f0abb tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:38.192516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4c89efc7-9461-40c1-8671-5a0f352f0abb tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:38.520404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8712aa18-d34b-48cf-b552-7c5edba6de45 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:38.544746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8712aa18-d34b-48cf-b552-7c5edba6de45 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:38.578811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8712aa18-d34b-48cf-b552-7c5edba6de45 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:38.581469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8712aa18-d34b-48cf-b552-7c5edba6de45 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:38.583388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8712aa18-d34b-48cf-b552-7c5edba6de45 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:38.585622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8712aa18-d34b-48cf-b552-7c5edba6de45 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:38.589208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8712aa18-d34b-48cf-b552-7c5edba6de45 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:38.590056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8712aa18-d34b-48cf-b552-7c5edba6de45 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:39.096425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4c89efc7-9461-40c1-8671-5a0f352f0abb tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:39.125488 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4c89efc7-9461-40c1-8671-5a0f352f0abb tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 0.973408 Sep 08 13:23:39.151708 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2677/5222] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:38 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:39.385717 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8712aa18-d34b-48cf-b552-7c5edba6de45 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1416 microversion: 2.1 time: 0.874781 Sep 08 13:23:39.395971 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2546/5223] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:38 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1416 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:40.157751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b9ae2324-f95a-4ae8-bd1b-5e1a61da7b8c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:40.163365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b9ae2324-f95a-4ae8-bd1b-5e1a61da7b8c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:40.195321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9ae2324-f95a-4ae8-bd1b-5e1a61da7b8c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:40.196186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9ae2324-f95a-4ae8-bd1b-5e1a61da7b8c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:40.196958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9ae2324-f95a-4ae8-bd1b-5e1a61da7b8c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:40.198246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9ae2324-f95a-4ae8-bd1b-5e1a61da7b8c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:40.199085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9ae2324-f95a-4ae8-bd1b-5e1a61da7b8c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:40.199814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b9ae2324-f95a-4ae8-bd1b-5e1a61da7b8c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:40.438468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a35e687-0466-4f73-9085-45f274030628 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:40.439745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2a35e687-0466-4f73-9085-45f274030628 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:40.487557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a35e687-0466-4f73-9085-45f274030628 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:40.490365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a35e687-0466-4f73-9085-45f274030628 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:40.491792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a35e687-0466-4f73-9085-45f274030628 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:40.494877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a35e687-0466-4f73-9085-45f274030628 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:40.497223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a35e687-0466-4f73-9085-45f274030628 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:40.498816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a35e687-0466-4f73-9085-45f274030628 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:41.050984 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a35e687-0466-4f73-9085-45f274030628 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1422 microversion: 2.1 time: 0.620644 Sep 08 13:23:41.055615 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2547/5224] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:40 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1422 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:41.106226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-62dda56d-db27-4297-b1bb-326a321e3f65 req-0998424f-ee24-410c-ac2c-9afab96bafc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46bf8338-c378-4fd3-87e7-63c5993f3b73", "name": "network-vif-plugged", "status": "completed", "tag": "bc0857bf-d3a0-4699-8de2-ff0bd08a733e"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:23:41.176274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-62dda56d-db27-4297-b1bb-326a321e3f65 req-0998424f-ee24-410c-ac2c-9afab96bafc1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:41.176274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-62dda56d-db27-4297-b1bb-326a321e3f65 req-0998424f-ee24-410c-ac2c-9afab96bafc1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:41.176274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-62dda56d-db27-4297-b1bb-326a321e3f65 req-0998424f-ee24-410c-ac2c-9afab96bafc1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:41.216237 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-62dda56d-db27-4297-b1bb-326a321e3f65 req-0998424f-ee24-410c-ac2c-9afab96bafc1 service nova] Creating event network-vif-plugged:bc0857bf-d3a0-4699-8de2-ff0bd08a733e for instance 46bf8338-c378-4fd3-87e7-63c5993f3b73 on n-h1-852084-10 Sep 08 13:23:41.232272 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-62dda56d-db27-4297-b1bb-326a321e3f65 req-0998424f-ee24-410c-ac2c-9afab96bafc1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159119 Sep 08 13:23:41.233316 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2548/5225] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:41.754008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b9ae2324-f95a-4ae8-bd1b-5e1a61da7b8c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:41.794065 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b9ae2324-f95a-4ae8-bd1b-5e1a61da7b8c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 1.642577 Sep 08 13:23:41.818763 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2678/5226] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:40 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 1669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:41.934216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9a25f5ff-43fb-436a-8bd1-c3f19bc14b48 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad804490-d617-4b28-9060-ea6d2e4aa67e"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:23:41.947263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9a25f5ff-43fb-436a-8bd1-c3f19bc14b48 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:41.968853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a25f5ff-43fb-436a-8bd1-c3f19bc14b48 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:41.969581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a25f5ff-43fb-436a-8bd1-c3f19bc14b48 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:41.970266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a25f5ff-43fb-436a-8bd1-c3f19bc14b48 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:41.972631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a25f5ff-43fb-436a-8bd1-c3f19bc14b48 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:41.973313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a25f5ff-43fb-436a-8bd1-c3f19bc14b48 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:41.973698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a25f5ff-43fb-436a-8bd1-c3f19bc14b48 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:42.092854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9f1f821e-8c7a-42da-8118-2b1269b97a30 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:42.094081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9f1f821e-8c7a-42da-8118-2b1269b97a30 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:42.119294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f1f821e-8c7a-42da-8118-2b1269b97a30 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:42.120763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f1f821e-8c7a-42da-8118-2b1269b97a30 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:42.123123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f1f821e-8c7a-42da-8118-2b1269b97a30 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:42.130180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f1f821e-8c7a-42da-8118-2b1269b97a30 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:42.131598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f1f821e-8c7a-42da-8118-2b1269b97a30 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:42.132464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f1f821e-8c7a-42da-8118-2b1269b97a30 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:42.757432 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9a25f5ff-43fb-436a-8bd1-c3f19bc14b48 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "POST /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.834533 Sep 08 13:23:42.758557 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2549/5227] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:23:41 2022] POST /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments => generated 194 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:42.854413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5d29928-6611-4813-9aa5-498d958c28f2 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:42.855705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c5d29928-6611-4813-9aa5-498d958c28f2 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:42.891713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5d29928-6611-4813-9aa5-498d958c28f2 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:42.893105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5d29928-6611-4813-9aa5-498d958c28f2 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:42.910284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5d29928-6611-4813-9aa5-498d958c28f2 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:42.913637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5d29928-6611-4813-9aa5-498d958c28f2 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:42.914592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5d29928-6611-4813-9aa5-498d958c28f2 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:42.918270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5d29928-6611-4813-9aa5-498d958c28f2 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:45.432183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:45.790642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c5d29928-6611-4813-9aa5-498d958c28f2 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:45.830175 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c5d29928-6611-4813-9aa5-498d958c28f2 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1314 microversion: 2.1 time: 2.992187 Sep 08 13:23:45.835931 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2550/5228] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:42 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1314 bytes in 3000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:45.856811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c2a9e826-d72c-44e8-9010-51a296b21804 req-ea610e07-45d4-42ed-bc16-dee0bbda8a62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "349f4f33-226a-4bc7-a45f-91a7c5316ecb", "tag": "ac739bdf-3e78-4273-8710-21e1be72b831"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:23:45.918629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c2a9e826-d72c-44e8-9010-51a296b21804 req-ea610e07-45d4-42ed-bc16-dee0bbda8a62 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:45.919989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c2a9e826-d72c-44e8-9010-51a296b21804 req-ea610e07-45d4-42ed-bc16-dee0bbda8a62 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:45.920414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c2a9e826-d72c-44e8-9010-51a296b21804 req-ea610e07-45d4-42ed-bc16-dee0bbda8a62 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:46.027753 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c2a9e826-d72c-44e8-9010-51a296b21804 req-ea610e07-45d4-42ed-bc16-dee0bbda8a62 service nova] Creating event network-changed:ac739bdf-3e78-4273-8710-21e1be72b831 for instance 349f4f33-226a-4bc7-a45f-91a7c5316ecb on n-h1-852084-10 Sep 08 13:23:46.054598 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9f1f821e-8c7a-42da-8118-2b1269b97a30 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1464 microversion: 2.1 time: 3.966877 Sep 08 13:23:46.058079 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2679/5229] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:42 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1464 bytes in 3973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:46.060117 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c2a9e826-d72c-44e8-9010-51a296b21804 req-ea610e07-45d4-42ed-bc16-dee0bbda8a62 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.220810 Sep 08 13:23:46.061206 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2551/5230] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:46.744066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-103990999", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:23:46.848511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] validate_networks() for None {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:23:46.891092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4b30f48b-770f-4001-9f06-1eb2c5610d5f tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:46.893056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4b30f48b-770f-4001-9f06-1eb2c5610d5f tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:46.941741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b30f48b-770f-4001-9f06-1eb2c5610d5f tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:46.942658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b30f48b-770f-4001-9f06-1eb2c5610d5f tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:46.943526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b30f48b-770f-4001-9f06-1eb2c5610d5f tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:46.944836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b30f48b-770f-4001-9f06-1eb2c5610d5f tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:46.952674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b30f48b-770f-4001-9f06-1eb2c5610d5f tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:46.953136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b30f48b-770f-4001-9f06-1eb2c5610d5f tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:47.473843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=10 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:47.906178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:23:47.910885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:23:47.912134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:23:47.915651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:23:47.920751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:23:47.949375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:47.951475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:47.952413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:47.954176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:47.961023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4b30f48b-770f-4001-9f06-1eb2c5610d5f tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:47.964331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:47.971434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:48.015558 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4b30f48b-770f-4001-9f06-1eb2c5610d5f tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1464 microversion: 2.1 time: 1.139512 Sep 08 13:23:48.027508 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2552/5231] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:46 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1464 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:48.051930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Getting quotas for project fe0c9479f36046769da581ad6c240e5f. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:23:48.061229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6a6d7347-22ac-4fac-99db-0d3aa269c535 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:48.065699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6a6d7347-22ac-4fac-99db-0d3aa269c535 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:48.077318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Getting quotas for user 5a057989f7d646038f4bef908406ed9f and project fe0c9479f36046769da581ad6c240e5f. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:23:48.090080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a6d7347-22ac-4fac-99db-0d3aa269c535 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:48.090900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a6d7347-22ac-4fac-99db-0d3aa269c535 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:48.091392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a6d7347-22ac-4fac-99db-0d3aa269c535 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:48.096153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a6d7347-22ac-4fac-99db-0d3aa269c535 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:48.096657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a6d7347-22ac-4fac-99db-0d3aa269c535 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:48.097100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a6d7347-22ac-4fac-99db-0d3aa269c535 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:48.115431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:23:48.124616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:23:48.250614 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c8b17743-87eb-496e-afc3-22f0eab710d4 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.509862 Sep 08 13:23:48.253161 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2680/5232] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:23:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:23:48.265346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2d3ec637-4340-4d6a-a7f4-00e0fc76b776 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:48.269553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2d3ec637-4340-4d6a-a7f4-00e0fc76b776 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:48.282564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d3ec637-4340-4d6a-a7f4-00e0fc76b776 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:48.283444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d3ec637-4340-4d6a-a7f4-00e0fc76b776 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:48.284070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d3ec637-4340-4d6a-a7f4-00e0fc76b776 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:48.286667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d3ec637-4340-4d6a-a7f4-00e0fc76b776 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:48.287616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d3ec637-4340-4d6a-a7f4-00e0fc76b776 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:48.288483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d3ec637-4340-4d6a-a7f4-00e0fc76b776 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:48.338494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2d3ec637-4340-4d6a-a7f4-00e0fc76b776 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:23:48.511809 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2d3ec637-4340-4d6a-a7f4-00e0fc76b776 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "DELETE /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 204 len: 0 microversion: 2.1 time: 0.255303 Sep 08 13:23:48.515956 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2681/5233] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:23:48 2022] DELETE /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:23:48.534956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-18313aac-3e32-46e1-bc46-99f2bd491e55 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:48.536016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-18313aac-3e32-46e1-bc46-99f2bd491e55 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:48.624362 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6a6d7347-22ac-4fac-99db-0d3aa269c535 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1464 microversion: 2.1 time: 0.593161 Sep 08 13:23:48.625873 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2553/5234] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:48 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1464 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:48.639083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d8ad8adb-9263-4b55-beb2-fc27ed73fc53 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:48.641594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d8ad8adb-9263-4b55-beb2-fc27ed73fc53 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:48.652785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8ad8adb-9263-4b55-beb2-fc27ed73fc53 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:48.654528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8ad8adb-9263-4b55-beb2-fc27ed73fc53 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:48.655264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8ad8adb-9263-4b55-beb2-fc27ed73fc53 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:48.656559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8ad8adb-9263-4b55-beb2-fc27ed73fc53 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:48.657289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8ad8adb-9263-4b55-beb2-fc27ed73fc53 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:48.659258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d8ad8adb-9263-4b55-beb2-fc27ed73fc53 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:48.713428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-18313aac-3e32-46e1-bc46-99f2bd491e55 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:48.746245 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-18313aac-3e32-46e1-bc46-99f2bd491e55 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1213 microversion: 2.1 time: 0.230343 Sep 08 13:23:48.750795 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2682/5235] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:48 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1213 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:49.665383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-71984401-eb70-44d6-9811-82dd8b5f671e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:49.673516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-71984401-eb70-44d6-9811-82dd8b5f671e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:49.713572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71984401-eb70-44d6-9811-82dd8b5f671e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:49.717276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71984401-eb70-44d6-9811-82dd8b5f671e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:49.718419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71984401-eb70-44d6-9811-82dd8b5f671e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:49.719128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71984401-eb70-44d6-9811-82dd8b5f671e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:49.719930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71984401-eb70-44d6-9811-82dd8b5f671e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:49.726712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71984401-eb70-44d6-9811-82dd8b5f671e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:49.825478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d8ad8adb-9263-4b55-beb2-fc27ed73fc53 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:49.857457 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d8ad8adb-9263-4b55-beb2-fc27ed73fc53 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1470 microversion: 2.1 time: 1.229011 Sep 08 13:23:49.872910 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2554/5236] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:48 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1470 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:49.904182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f021840c-6168-4156-9c5d-e5b3d8a7050f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:49.910803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f021840c-6168-4156-9c5d-e5b3d8a7050f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:49.941389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f021840c-6168-4156-9c5d-e5b3d8a7050f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:49.942912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f021840c-6168-4156-9c5d-e5b3d8a7050f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:49.944068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f021840c-6168-4156-9c5d-e5b3d8a7050f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:49.949003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f021840c-6168-4156-9c5d-e5b3d8a7050f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:49.951971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f021840c-6168-4156-9c5d-e5b3d8a7050f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:49.953101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f021840c-6168-4156-9c5d-e5b3d8a7050f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:50.346559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f021840c-6168-4156-9c5d-e5b3d8a7050f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:50.387824 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f021840c-6168-4156-9c5d-e5b3d8a7050f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1209 microversion: 2.1 time: 0.508006 Sep 08 13:23:50.404911 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2555/5237] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:49 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1209 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:50.514948 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-71984401-eb70-44d6-9811-82dd8b5f671e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1464 microversion: 2.1 time: 0.862343 Sep 08 13:23:50.515590 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2683/5238] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:49 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1464 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:50.902789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4b3ee46f-e995-4d30-881b-2e52555b7083 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:50.904423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4b3ee46f-e995-4d30-881b-2e52555b7083 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:50.918231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b3ee46f-e995-4d30-881b-2e52555b7083 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:50.921908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b3ee46f-e995-4d30-881b-2e52555b7083 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:50.922919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b3ee46f-e995-4d30-881b-2e52555b7083 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:50.924854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b3ee46f-e995-4d30-881b-2e52555b7083 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:50.926506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b3ee46f-e995-4d30-881b-2e52555b7083 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:50.928183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b3ee46f-e995-4d30-881b-2e52555b7083 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:51.445471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b6d51e41-2440-44a0-9177-2868520b7d67 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:51.446892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b6d51e41-2440-44a0-9177-2868520b7d67 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:51.468211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6d51e41-2440-44a0-9177-2868520b7d67 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:51.469021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6d51e41-2440-44a0-9177-2868520b7d67 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:51.469683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6d51e41-2440-44a0-9177-2868520b7d67 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:51.472247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6d51e41-2440-44a0-9177-2868520b7d67 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:51.473665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6d51e41-2440-44a0-9177-2868520b7d67 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:51.475987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6d51e41-2440-44a0-9177-2868520b7d67 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:51.764350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b6d51e41-2440-44a0-9177-2868520b7d67 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:51.798054 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b6d51e41-2440-44a0-9177-2868520b7d67 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1271 microversion: 2.1 time: 0.356761 Sep 08 13:23:51.807383 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2684/5239] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:51 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1271 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:51.812567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6788d093-f384-4cdb-a1b9-77741859dfa9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:51.824136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6788d093-f384-4cdb-a1b9-77741859dfa9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:51.849444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6788d093-f384-4cdb-a1b9-77741859dfa9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:51.855255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6788d093-f384-4cdb-a1b9-77741859dfa9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:51.856029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6788d093-f384-4cdb-a1b9-77741859dfa9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:51.860539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6788d093-f384-4cdb-a1b9-77741859dfa9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:51.864438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6788d093-f384-4cdb-a1b9-77741859dfa9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:51.867806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6788d093-f384-4cdb-a1b9-77741859dfa9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:52.357337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4b3ee46f-e995-4d30-881b-2e52555b7083 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:52.388086 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4b3ee46f-e995-4d30-881b-2e52555b7083 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1470 microversion: 2.1 time: 1.489283 Sep 08 13:23:52.395786 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2556/5240] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:50 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1470 bytes in 1498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:52.503051 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6788d093-f384-4cdb-a1b9-77741859dfa9 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1464 microversion: 2.1 time: 0.693972 Sep 08 13:23:52.503942 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2685/5241] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:51 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1464 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:52.858881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5dd8efc4-6dea-469d-855b-a2f2e60aaa5e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:52.860067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5dd8efc4-6dea-469d-855b-a2f2e60aaa5e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:52.894056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5dd8efc4-6dea-469d-855b-a2f2e60aaa5e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:52.899543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5dd8efc4-6dea-469d-855b-a2f2e60aaa5e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:52.900170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5dd8efc4-6dea-469d-855b-a2f2e60aaa5e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:52.901579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5dd8efc4-6dea-469d-855b-a2f2e60aaa5e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:52.902445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5dd8efc4-6dea-469d-855b-a2f2e60aaa5e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:52.905695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5dd8efc4-6dea-469d-855b-a2f2e60aaa5e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:53.456227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6b78f3fa-bac7-4199-9c94-8b06c9531f0c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:53.457939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6b78f3fa-bac7-4199-9c94-8b06c9531f0c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:53.461750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5dd8efc4-6dea-469d-855b-a2f2e60aaa5e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:53.486318 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5dd8efc4-6dea-469d-855b-a2f2e60aaa5e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1271 microversion: 2.1 time: 0.636465 Sep 08 13:23:53.489629 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2557/5242] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:52 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1271 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:53.490289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b78f3fa-bac7-4199-9c94-8b06c9531f0c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:53.491773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b78f3fa-bac7-4199-9c94-8b06c9531f0c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:53.496185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b78f3fa-bac7-4199-9c94-8b06c9531f0c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:53.500007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b78f3fa-bac7-4199-9c94-8b06c9531f0c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:53.504954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b78f3fa-bac7-4199-9c94-8b06c9531f0c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:53.511574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6b78f3fa-bac7-4199-9c94-8b06c9531f0c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:53.533439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7dff2bf0-109d-4fba-83f4-d82efa12f479 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:53.534225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7dff2bf0-109d-4fba-83f4-d82efa12f479 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:53.563694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dff2bf0-109d-4fba-83f4-d82efa12f479 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:53.565056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dff2bf0-109d-4fba-83f4-d82efa12f479 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:53.573870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dff2bf0-109d-4fba-83f4-d82efa12f479 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:53.579014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dff2bf0-109d-4fba-83f4-d82efa12f479 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:53.587867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dff2bf0-109d-4fba-83f4-d82efa12f479 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:53.604271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dff2bf0-109d-4fba-83f4-d82efa12f479 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:54.282051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6b78f3fa-bac7-4199-9c94-8b06c9531f0c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e996bf8a26649fca6da3aa5ff9c5858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9116b26920f34a6697bde76eec67d525', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:54.317595 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6b78f3fa-bac7-4199-9c94-8b06c9531f0c tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 200 len: 1428 microversion: 2.1 time: 0.874516 Sep 08 13:23:54.323860 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2686/5243] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:53 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 1428 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:54.338436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-9e4186ec-2248-46fb-aad3-d528ff95e167 req-f3a0fe4f-0e22-40cb-8cf5-32ae633892a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46bf8338-c378-4fd3-87e7-63c5993f3b73", "name": "network-vif-deleted", "tag": "bc0857bf-d3a0-4699-8de2-ff0bd08a733e"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:23:54.377098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9e4186ec-2248-46fb-aad3-d528ff95e167 req-f3a0fe4f-0e22-40cb-8cf5-32ae633892a0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:54.381170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9e4186ec-2248-46fb-aad3-d528ff95e167 req-f3a0fe4f-0e22-40cb-8cf5-32ae633892a0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:54.383280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9e4186ec-2248-46fb-aad3-d528ff95e167 req-f3a0fe4f-0e22-40cb-8cf5-32ae633892a0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:54.417379 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-9e4186ec-2248-46fb-aad3-d528ff95e167 req-f3a0fe4f-0e22-40cb-8cf5-32ae633892a0 service nova] Creating event network-vif-deleted:bc0857bf-d3a0-4699-8de2-ff0bd08a733e for instance 46bf8338-c378-4fd3-87e7-63c5993f3b73 on n-h1-852084-10 Sep 08 13:23:54.434270 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-9e4186ec-2248-46fb-aad3-d528ff95e167 req-f3a0fe4f-0e22-40cb-8cf5-32ae633892a0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107744 Sep 08 13:23:54.438300 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2687/5244] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:54.514732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d98b5edd-54dd-4197-8d66-d47cd321830e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:54.516883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d98b5edd-54dd-4197-8d66-d47cd321830e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:54.535086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d98b5edd-54dd-4197-8d66-d47cd321830e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:54.538428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d98b5edd-54dd-4197-8d66-d47cd321830e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:54.540245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d98b5edd-54dd-4197-8d66-d47cd321830e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:54.542355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d98b5edd-54dd-4197-8d66-d47cd321830e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:54.545395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d98b5edd-54dd-4197-8d66-d47cd321830e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:54.546391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d98b5edd-54dd-4197-8d66-d47cd321830e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:54.902853 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7dff2bf0-109d-4fba-83f4-d82efa12f479 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1464 microversion: 2.1 time: 1.377105 Sep 08 13:23:54.906597 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2558/5245] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:53 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1464 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:55.365619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-5b47a22e-ae71-4cb6-bba4-f7d52a882248 req-5241ddc5-9a10-4c28-8c14-25922cf9ede7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349f4f33-226a-4bc7-a45f-91a7c5316ecb", "name": "network-vif-plugged", "status": "completed", "tag": "ac739bdf-3e78-4273-8710-21e1be72b831"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:23:55.409576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5b47a22e-ae71-4cb6-bba4-f7d52a882248 req-5241ddc5-9a10-4c28-8c14-25922cf9ede7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:55.410666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5b47a22e-ae71-4cb6-bba4-f7d52a882248 req-5241ddc5-9a10-4c28-8c14-25922cf9ede7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:55.411554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5b47a22e-ae71-4cb6-bba4-f7d52a882248 req-5241ddc5-9a10-4c28-8c14-25922cf9ede7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:55.495984 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-5b47a22e-ae71-4cb6-bba4-f7d52a882248 req-5241ddc5-9a10-4c28-8c14-25922cf9ede7 service nova] Creating event network-vif-plugged:ac739bdf-3e78-4273-8710-21e1be72b831 for instance 349f4f33-226a-4bc7-a45f-91a7c5316ecb on n-h1-852084-10 Sep 08 13:23:55.524743 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-5b47a22e-ae71-4cb6-bba4-f7d52a882248 req-5241ddc5-9a10-4c28-8c14-25922cf9ede7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180280 Sep 08 13:23:55.526466 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2559/5246] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:23:55.560838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-51eb86f0-9bc0-4734-a803-238422d5a542 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:55.563535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-51eb86f0-9bc0-4734-a803-238422d5a542 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] [instance: 46bf8338-c378-4fd3-87e7-63c5993f3b73] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:55.571413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51eb86f0-9bc0-4734-a803-238422d5a542 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:55.572249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51eb86f0-9bc0-4734-a803-238422d5a542 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:55.572888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51eb86f0-9bc0-4734-a803-238422d5a542 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:55.573841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51eb86f0-9bc0-4734-a803-238422d5a542 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:55.574789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51eb86f0-9bc0-4734-a803-238422d5a542 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:55.575730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51eb86f0-9bc0-4734-a803-238422d5a542 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:55.618836 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-51eb86f0-9bc0-4734-a803-238422d5a542 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] HTTP exception thrown: Instance 46bf8338-c378-4fd3-87e7-63c5993f3b73 could not be found. Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-51eb86f0-9bc0-4734-a803-238422d5a542 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Request method failure captured: Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 HTTP/1.1 Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGey4mpMm0xkJSgsyJac573HpSHVF8DTejIycpAfJJfSaRCNMIUAB2IfJBP1MprwmGC6rYXzwQK3AbzzszAqH-0jM49_jgiIiJ0ggXu7L1yQnwC9f1EY-pXk3c6waukc5ijs6s1gBFDNPSYAhWhxT0s_9xNzN8OaiYS67LKAOWL40jtc Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 9116b26920f34a6697bde76eec67d525 Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-VolumesNegativeTest-1216278382 Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9116b26920f34a6697bde76eec67d525"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9116b26920f34a6697bde76eec67d525"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9116b26920f34a6697bde76eec67d525"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9116b26920f34a6697bde76eec67d525"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-VolumesNegativeTest-1216278382 Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 9116b26920f34a6697bde76eec67d525 Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-VolumesNegativeTest-1216278382 Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-VolumesNegativeTest-1216278382-project Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 2e996bf8a26649fca6da3aa5ff9c5858 Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-VolumesNegativeTest-1216278382-project Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 46bf8338-c378-4fd3-87e7-63c5993f3b73 could not be found. Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '46bf8338-c378-4fd3-87e7-63c5993f3b73'} Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46bf8338-c378-4fd3-87e7-63c5993f3b73 could not be found. Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46bf8338-c378-4fd3-87e7-63c5993f3b73 could not be found. Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:23:55.621336 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:23:55.628711 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:23:55.628711 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:23:55.628711 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:23:55.628711 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:23:55.628711 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:23:55.628711 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46bf8338-c378-4fd3-87e7-63c5993f3b73 could not be found. Sep 08 13:23:55.628711 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:23:55.631839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-51eb86f0-9bc0-4734-a803-238422d5a542 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] Returning 404 to user: Instance 46bf8338-c378-4fd3-87e7-63c5993f3b73 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:23:55.633308 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-51eb86f0-9bc0-4734-a803-238422d5a542 tempest-VolumesNegativeTest-1216278382 tempest-VolumesNegativeTest-1216278382-project] 10.222.0.78 "GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73" status: 404 len: 111 microversion: 2.1 time: 0.094474 Sep 08 13:23:55.647258 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2560/5247] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:55 2022] GET /compute/v2.1/servers/46bf8338-c378-4fd3-87e7-63c5993f3b73 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:23:55.771118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d98b5edd-54dd-4197-8d66-d47cd321830e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:55.795792 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d98b5edd-54dd-4197-8d66-d47cd321830e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1271 microversion: 2.1 time: 1.288936 Sep 08 13:23:55.801485 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2688/5248] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:54 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1271 bytes in 1296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:55.934301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-52304e9c-e1e4-4d25-8df1-24f2a542f57a tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:55.936860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-52304e9c-e1e4-4d25-8df1-24f2a542f57a tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:55.995894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52304e9c-e1e4-4d25-8df1-24f2a542f57a tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:56.001551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52304e9c-e1e4-4d25-8df1-24f2a542f57a tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:56.007030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52304e9c-e1e4-4d25-8df1-24f2a542f57a tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:56.013052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52304e9c-e1e4-4d25-8df1-24f2a542f57a tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:56.016815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52304e9c-e1e4-4d25-8df1-24f2a542f57a tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:56.022216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52304e9c-e1e4-4d25-8df1-24f2a542f57a tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:56.841860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a5d28942-1ed6-4124-91c4-8ba2c398c807 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:56.842848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a5d28942-1ed6-4124-91c4-8ba2c398c807 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:56.858832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5d28942-1ed6-4124-91c4-8ba2c398c807 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:56.860648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5d28942-1ed6-4124-91c4-8ba2c398c807 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:56.862381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5d28942-1ed6-4124-91c4-8ba2c398c807 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:56.865558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5d28942-1ed6-4124-91c4-8ba2c398c807 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:56.867621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5d28942-1ed6-4124-91c4-8ba2c398c807 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:56.868444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5d28942-1ed6-4124-91c4-8ba2c398c807 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:56.902031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:57.344509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a5d28942-1ed6-4124-91c4-8ba2c398c807 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:57.380742 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a5d28942-1ed6-4124-91c4-8ba2c398c807 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1271 microversion: 2.1 time: 0.543374 Sep 08 13:23:57.384669 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2689/5249] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:56 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1271 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:57.480410 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-52304e9c-e1e4-4d25-8df1-24f2a542f57a tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1464 microversion: 2.1 time: 1.553802 Sep 08 13:23:57.500669 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2561/5250] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:55 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1464 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:23:58.424819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:58.430729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-09c29102-0d40-4e76-9aaf-c97c5de7b5aa tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:58.431528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-09c29102-0d40-4e76-9aaf-c97c5de7b5aa tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:58.482149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09c29102-0d40-4e76-9aaf-c97c5de7b5aa tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:58.482856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09c29102-0d40-4e76-9aaf-c97c5de7b5aa tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:58.483501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09c29102-0d40-4e76-9aaf-c97c5de7b5aa tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:58.487155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09c29102-0d40-4e76-9aaf-c97c5de7b5aa tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:58.490464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09c29102-0d40-4e76-9aaf-c97c5de7b5aa tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:58.491459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09c29102-0d40-4e76-9aaf-c97c5de7b5aa tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:58.530545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a34d2bd5-d52a-426f-aac1-0a5c0e5faab8 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:23:58.532517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a34d2bd5-d52a-426f-aac1-0a5c0e5faab8 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:23:58.543919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a34d2bd5-d52a-426f-aac1-0a5c0e5faab8 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:58.549747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a34d2bd5-d52a-426f-aac1-0a5c0e5faab8 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:58.552018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a34d2bd5-d52a-426f-aac1-0a5c0e5faab8 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:58.555181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a34d2bd5-d52a-426f-aac1-0a5c0e5faab8 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:23:58.557354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a34d2bd5-d52a-426f-aac1-0a5c0e5faab8 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:23:58.565581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a34d2bd5-d52a-426f-aac1-0a5c0e5faab8 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:23:58.724103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:59.270249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-09c29102-0d40-4e76-9aaf-c97c5de7b5aa tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:23:59.314595 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-09c29102-0d40-4e76-9aaf-c97c5de7b5aa tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1313 microversion: 2.1 time: 0.891448 Sep 08 13:23:59.349077 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2690/5251] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:58 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1313 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:23:59.628896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:23:59.654121 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a34d2bd5-d52a-426f-aac1-0a5c0e5faab8 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1464 microversion: 2.1 time: 1.128596 Sep 08 13:23:59.657418 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2562/5252] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:23:58 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1464 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:00.355119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc1d0618-5129-4607-9022-37abb9bdb40e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:00.356248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc1d0618-5129-4607-9022-37abb9bdb40e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:00.407432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:24:00.425583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc1d0618-5129-4607-9022-37abb9bdb40e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:00.426173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc1d0618-5129-4607-9022-37abb9bdb40e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:00.426900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc1d0618-5129-4607-9022-37abb9bdb40e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:00.430483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc1d0618-5129-4607-9022-37abb9bdb40e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:00.431171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc1d0618-5129-4607-9022-37abb9bdb40e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:00.431457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc1d0618-5129-4607-9022-37abb9bdb40e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:00.699391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cb2ddc1e-ae8f-48d2-9343-0bba97198b34 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:00.703601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cb2ddc1e-ae8f-48d2-9343-0bba97198b34 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:00.755152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb2ddc1e-ae8f-48d2-9343-0bba97198b34 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:00.770439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb2ddc1e-ae8f-48d2-9343-0bba97198b34 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:00.772711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb2ddc1e-ae8f-48d2-9343-0bba97198b34 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:00.775216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb2ddc1e-ae8f-48d2-9343-0bba97198b34 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:00.777014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb2ddc1e-ae8f-48d2-9343-0bba97198b34 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:00.780386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb2ddc1e-ae8f-48d2-9343-0bba97198b34 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:00.847250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc1d0618-5129-4607-9022-37abb9bdb40e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:00.863526 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc1d0618-5129-4607-9022-37abb9bdb40e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1313 microversion: 2.1 time: 0.516038 Sep 08 13:24:00.864803 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2691/5253] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:00 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:01.856541 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cb2ddc1e-ae8f-48d2-9343-0bba97198b34 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1648 microversion: 2.1 time: 1.164181 Sep 08 13:24:01.864543 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2563/5254] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:00 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1648 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:01.910163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc3531d6-8004-420f-9ffc-4659982130dd tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:01.910962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cc3531d6-8004-420f-9ffc-4659982130dd tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:01.921814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-19328c4a-7c28-4131-9950-686b31b550b2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:01.924214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-19328c4a-7c28-4131-9950-686b31b550b2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:01.931042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc3531d6-8004-420f-9ffc-4659982130dd tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:01.937366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc3531d6-8004-420f-9ffc-4659982130dd tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:01.937963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc3531d6-8004-420f-9ffc-4659982130dd tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:01.945307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc3531d6-8004-420f-9ffc-4659982130dd tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:01.946098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc3531d6-8004-420f-9ffc-4659982130dd tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:01.948521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc3531d6-8004-420f-9ffc-4659982130dd tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:01.951799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19328c4a-7c28-4131-9950-686b31b550b2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:01.953699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19328c4a-7c28-4131-9950-686b31b550b2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:01.956730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19328c4a-7c28-4131-9950-686b31b550b2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:01.963183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19328c4a-7c28-4131-9950-686b31b550b2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:01.971301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19328c4a-7c28-4131-9950-686b31b550b2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:01.972394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-19328c4a-7c28-4131-9950-686b31b550b2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:03.137334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-19328c4a-7c28-4131-9950-686b31b550b2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:03.151112 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-19328c4a-7c28-4131-9950-686b31b550b2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1313 microversion: 2.1 time: 1.236622 Sep 08 13:24:03.157137 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2564/5255] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:01 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1313 bytes in 1241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:03.163434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3243f454-edd8-43ce-ba75-50b60a7748df req-0a9c8a78-41a3-4f5e-9172-ac25b0db73da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04", "tag": "5e632452-98fc-4bbd-90f0-e48d357125f6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:24:03.198779 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc3531d6-8004-420f-9ffc-4659982130dd tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1648 microversion: 2.1 time: 1.283213 Sep 08 13:24:03.202552 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2692/5256] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:01 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1648 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:03.209545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3243f454-edd8-43ce-ba75-50b60a7748df req-0a9c8a78-41a3-4f5e-9172-ac25b0db73da service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:03.210569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3243f454-edd8-43ce-ba75-50b60a7748df req-0a9c8a78-41a3-4f5e-9172-ac25b0db73da service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:03.211256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3243f454-edd8-43ce-ba75-50b60a7748df req-0a9c8a78-41a3-4f5e-9172-ac25b0db73da service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:03.237672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-610551be-bcfb-478c-8d11-071c4a60a203 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:03.246326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-610551be-bcfb-478c-8d11-071c4a60a203 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:03.259748 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3243f454-edd8-43ce-ba75-50b60a7748df req-0a9c8a78-41a3-4f5e-9172-ac25b0db73da service nova] Creating event network-changed:5e632452-98fc-4bbd-90f0-e48d357125f6 for instance c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 on n-h2-852084-10 Sep 08 13:24:03.277054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-610551be-bcfb-478c-8d11-071c4a60a203 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:03.278499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-610551be-bcfb-478c-8d11-071c4a60a203 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:03.284224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-610551be-bcfb-478c-8d11-071c4a60a203 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:03.288580 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3243f454-edd8-43ce-ba75-50b60a7748df req-0a9c8a78-41a3-4f5e-9172-ac25b0db73da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127875 Sep 08 13:24:03.289767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-610551be-bcfb-478c-8d11-071c4a60a203 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:03.290906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-610551be-bcfb-478c-8d11-071c4a60a203 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:03.291961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-610551be-bcfb-478c-8d11-071c4a60a203 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:03.295050 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2565/5257] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:24:03.330666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-930012a4-5301-4fdd-a589-bec40ff53596 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:03.343810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-930012a4-5301-4fdd-a589-bec40ff53596 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:03.368584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-930012a4-5301-4fdd-a589-bec40ff53596 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:03.369835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-930012a4-5301-4fdd-a589-bec40ff53596 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:03.371104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-930012a4-5301-4fdd-a589-bec40ff53596 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:03.372812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-930012a4-5301-4fdd-a589-bec40ff53596 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:03.380280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-930012a4-5301-4fdd-a589-bec40ff53596 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:03.381848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-930012a4-5301-4fdd-a589-bec40ff53596 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:03.403499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-610551be-bcfb-478c-8d11-071c4a60a203 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:24:03.621532 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-610551be-bcfb-478c-8d11-071c4a60a203 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 204 len: 0 microversion: 2.1 time: 0.410233 Sep 08 13:24:03.622534 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2693/5258] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:24:03 2022] DELETE /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:24:03.640943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-abde0431-a927-4328-abe1-0602249fdb41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:03.642282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-abde0431-a927-4328-abe1-0602249fdb41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:03.659134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abde0431-a927-4328-abe1-0602249fdb41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:03.662036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abde0431-a927-4328-abe1-0602249fdb41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:03.666548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abde0431-a927-4328-abe1-0602249fdb41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:03.670544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abde0431-a927-4328-abe1-0602249fdb41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:03.673306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abde0431-a927-4328-abe1-0602249fdb41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:03.674629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abde0431-a927-4328-abe1-0602249fdb41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:04.041867 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-930012a4-5301-4fdd-a589-bec40ff53596 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1648 microversion: 2.1 time: 0.744512 Sep 08 13:24:04.056551 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2566/5259] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:03 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1648 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:04.192305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7db40847-55b3-46fd-a111-327f8af77523 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:04.199960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7db40847-55b3-46fd-a111-327f8af77523 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:04.260700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7db40847-55b3-46fd-a111-327f8af77523 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:04.261684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7db40847-55b3-46fd-a111-327f8af77523 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:04.272415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7db40847-55b3-46fd-a111-327f8af77523 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:04.280514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7db40847-55b3-46fd-a111-327f8af77523 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:04.281417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7db40847-55b3-46fd-a111-327f8af77523 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:04.282201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7db40847-55b3-46fd-a111-327f8af77523 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:04.383068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-abde0431-a927-4328-abe1-0602249fdb41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:04.397072 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-abde0431-a927-4328-abe1-0602249fdb41 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1552 microversion: 2.1 time: 0.766363 Sep 08 13:24:04.402534 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2694/5260] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:03 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1552 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:04.498530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1357019217", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "availability_zone": "nova:n-h2-852084-10", "networks": [{"uuid": "1accf130-38d5-4381-aef9-0a34f895737e"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:24:04.644909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] validate_networks() for [('1accf130-38d5-4381-aef9-0a34f895737e', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:24:06.788726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7db40847-55b3-46fd-a111-327f8af77523 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:06.830439 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7db40847-55b3-46fd-a111-327f8af77523 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1313 microversion: 2.1 time: 2.646533 Sep 08 13:24:06.835590 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2567/5261] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:04 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1313 bytes in 2656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:06.874363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f551cfe5-e18c-4cb9-b3d2-1419268c87d3 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:06.880229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f551cfe5-e18c-4cb9-b3d2-1419268c87d3 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:06.893452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:24:06.941570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f551cfe5-e18c-4cb9-b3d2-1419268c87d3 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:06.942787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f551cfe5-e18c-4cb9-b3d2-1419268c87d3 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:06.944546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f551cfe5-e18c-4cb9-b3d2-1419268c87d3 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:06.948492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f551cfe5-e18c-4cb9-b3d2-1419268c87d3 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:06.952315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f551cfe5-e18c-4cb9-b3d2-1419268c87d3 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:06.953476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f551cfe5-e18c-4cb9-b3d2-1419268c87d3 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:07.771878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:24:07.773944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:24:07.775125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:24:07.781221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:24:07.782359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:24:07.838955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:07.840765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:07.842332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:07.846411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:07.848071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:07.850766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:07.906228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Getting quotas for project a8689932c83541b59d0ce26909d9d959. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:24:07.922279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Getting quotas for user 3b7d980f46db446ca11f6cc1e76fbff6 and project a8689932c83541b59d0ce26909d9d959. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:24:07.957273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:24:07.963275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:24:08.069597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f551cfe5-e18c-4cb9-b3d2-1419268c87d3 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:08.088237 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f551cfe5-e18c-4cb9-b3d2-1419268c87d3 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1552 microversion: 2.1 time: 1.250528 Sep 08 13:24:08.090106 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2568/5262] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:06 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1552 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:08.114703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9f4ff70a-2aa9-4c9c-a430-54a1532d657b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:08.121363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9f4ff70a-2aa9-4c9c-a430-54a1532d657b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:08.128576 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-42981e59-5090-4622-87ac-7ceb87e6d4fe tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.634919 Sep 08 13:24:08.137952 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2695/5263] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:24:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:24:08.155262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-65b43bc2-80a1-4542-a62d-b4b5b82eae0f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:08.155562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f4ff70a-2aa9-4c9c-a430-54a1532d657b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:08.156255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f4ff70a-2aa9-4c9c-a430-54a1532d657b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:08.156948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f4ff70a-2aa9-4c9c-a430-54a1532d657b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:08.158600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f4ff70a-2aa9-4c9c-a430-54a1532d657b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:08.159687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f4ff70a-2aa9-4c9c-a430-54a1532d657b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:08.160421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f4ff70a-2aa9-4c9c-a430-54a1532d657b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:08.161881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-65b43bc2-80a1-4542-a62d-b4b5b82eae0f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:08.182393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-65b43bc2-80a1-4542-a62d-b4b5b82eae0f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:08.183382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-65b43bc2-80a1-4542-a62d-b4b5b82eae0f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:08.184363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-65b43bc2-80a1-4542-a62d-b4b5b82eae0f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:08.185375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-65b43bc2-80a1-4542-a62d-b4b5b82eae0f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:08.186097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-65b43bc2-80a1-4542-a62d-b4b5b82eae0f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:08.187125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-65b43bc2-80a1-4542-a62d-b4b5b82eae0f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:08.321147 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9f4ff70a-2aa9-4c9c-a430-54a1532d657b tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.226061 Sep 08 13:24:08.321799 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2569/5264] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:24:08 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments => generated 371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:24:08.356375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4cadc540-2920-4f59-899c-7e7229a79bc0 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:08.357445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4cadc540-2920-4f59-899c-7e7229a79bc0 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:08.982961 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4cadc540-2920-4f59-899c-7e7229a79bc0 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1329 microversion: 2.1 time: 0.659804 Sep 08 13:24:08.984652 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2570/5265] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:08 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1329 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:08.996714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-93cbdaab-aedb-4e97-b3a4-cac5c4f4f6c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:09.004283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-93cbdaab-aedb-4e97-b3a4-cac5c4f4f6c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:09.037602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93cbdaab-aedb-4e97-b3a4-cac5c4f4f6c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:09.044363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93cbdaab-aedb-4e97-b3a4-cac5c4f4f6c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:09.045233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93cbdaab-aedb-4e97-b3a4-cac5c4f4f6c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:09.047283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93cbdaab-aedb-4e97-b3a4-cac5c4f4f6c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:09.049121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93cbdaab-aedb-4e97-b3a4-cac5c4f4f6c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:09.061313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93cbdaab-aedb-4e97-b3a4-cac5c4f4f6c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:09.207149 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-93cbdaab-aedb-4e97-b3a4-cac5c4f4f6c7 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments/98e28928-c40d-49be-9132-dcab293e0a04" status: 200 len: 194 microversion: 2.1 time: 0.213911 Sep 08 13:24:09.213753 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2571/5266] 10.222.0.78 () {58 vars in 1413 bytes} [Thu Sep 8 13:24:08 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments/98e28928-c40d-49be-9132-dcab293e0a04 => generated 194 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:24:09.222818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c19079d9-06eb-4dbd-83d0-2a0b59e0eed1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:09.224222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c19079d9-06eb-4dbd-83d0-2a0b59e0eed1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:09.246889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c19079d9-06eb-4dbd-83d0-2a0b59e0eed1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:09.248288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c19079d9-06eb-4dbd-83d0-2a0b59e0eed1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:09.249361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c19079d9-06eb-4dbd-83d0-2a0b59e0eed1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:09.250526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c19079d9-06eb-4dbd-83d0-2a0b59e0eed1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:09.251528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c19079d9-06eb-4dbd-83d0-2a0b59e0eed1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:09.252275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c19079d9-06eb-4dbd-83d0-2a0b59e0eed1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:09.600765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-65b43bc2-80a1-4542-a62d-b4b5b82eae0f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:09.629288 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-65b43bc2-80a1-4542-a62d-b4b5b82eae0f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1313 microversion: 2.1 time: 1.488664 Sep 08 13:24:09.647281 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2696/5267] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:08 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1313 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:09.666185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd6b2420-3b3c-4f4c-b572-992b40126573 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:09.666185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dd6b2420-3b3c-4f4c-b572-992b40126573 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:09.682558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6b2420-3b3c-4f4c-b572-992b40126573 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:09.686083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6b2420-3b3c-4f4c-b572-992b40126573 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:09.688239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6b2420-3b3c-4f4c-b572-992b40126573 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:09.693097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6b2420-3b3c-4f4c-b572-992b40126573 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:09.698902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6b2420-3b3c-4f4c-b572-992b40126573 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:09.699882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6b2420-3b3c-4f4c-b572-992b40126573 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:09.916205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c19079d9-06eb-4dbd-83d0-2a0b59e0eed1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:09.948272 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c19079d9-06eb-4dbd-83d0-2a0b59e0eed1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1552 microversion: 2.1 time: 0.731915 Sep 08 13:24:09.953666 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2572/5268] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:09 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1552 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:10.027245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-259ab68e-bb00-4c76-b9f7-2b1695a58b67 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:10.029823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-dd6b2420-3b3c-4f4c-b572-992b40126573 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lazy-loading 'services' on Instance uuid 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:24:10.035219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-259ab68e-bb00-4c76-b9f7-2b1695a58b67 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:10.067707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-259ab68e-bb00-4c76-b9f7-2b1695a58b67 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:10.074029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-259ab68e-bb00-4c76-b9f7-2b1695a58b67 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:10.080227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-259ab68e-bb00-4c76-b9f7-2b1695a58b67 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:10.088184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-259ab68e-bb00-4c76-b9f7-2b1695a58b67 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:10.090211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-259ab68e-bb00-4c76-b9f7-2b1695a58b67 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:10.096792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-259ab68e-bb00-4c76-b9f7-2b1695a58b67 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:10.350298 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dd6b2420-3b3c-4f4c-b572-992b40126573 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments/98e28928-c40d-49be-9132-dcab293e0a04" status: 202 len: 0 microversion: 2.1 time: 0.712971 Sep 08 13:24:10.353496 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2697/5269] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:24:09 2022] DELETE /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments/98e28928-c40d-49be-9132-dcab293e0a04 => generated 0 bytes in 719 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:24:10.608361 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-259ab68e-bb00-4c76-b9f7-2b1695a58b67 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1338 microversion: 2.1 time: 0.590775 Sep 08 13:24:10.611588 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2573/5270] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:10 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1338 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:24:10.681383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8839c037-882f-4765-b42e-bf33ff359535 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:10.691324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8839c037-882f-4765-b42e-bf33ff359535 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:10.740127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8839c037-882f-4765-b42e-bf33ff359535 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:10.751829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8839c037-882f-4765-b42e-bf33ff359535 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:10.754934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8839c037-882f-4765-b42e-bf33ff359535 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:10.763742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8839c037-882f-4765-b42e-bf33ff359535 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:10.773416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8839c037-882f-4765-b42e-bf33ff359535 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:10.776988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8839c037-882f-4765-b42e-bf33ff359535 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:10.926898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c2c8c9ea-4c0e-4d5c-a99f-8035d8f60bb0 req-8bbf9f4f-e034-4939-a873-85ad91fb800a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c63671b3-14c6-4956-9131-8324104a48eb", "name": "network-vif-deleted", "tag": "7f1728cc-3a88-4e36-98ef-185c9951e7aa"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:24:10.967748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c2c8c9ea-4c0e-4d5c-a99f-8035d8f60bb0 req-8bbf9f4f-e034-4939-a873-85ad91fb800a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:10.971741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c2c8c9ea-4c0e-4d5c-a99f-8035d8f60bb0 req-8bbf9f4f-e034-4939-a873-85ad91fb800a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:10.974457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c2c8c9ea-4c0e-4d5c-a99f-8035d8f60bb0 req-8bbf9f4f-e034-4939-a873-85ad91fb800a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:11.031797 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c2c8c9ea-4c0e-4d5c-a99f-8035d8f60bb0 req-8bbf9f4f-e034-4939-a873-85ad91fb800a service nova] Creating event network-vif-deleted:7f1728cc-3a88-4e36-98ef-185c9951e7aa for instance c63671b3-14c6-4956-9131-8324104a48eb on n-h2-852084-10 Sep 08 13:24:11.055694 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c2c8c9ea-4c0e-4d5c-a99f-8035d8f60bb0 req-8bbf9f4f-e034-4939-a873-85ad91fb800a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132825 Sep 08 13:24:11.061455 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2574/5271] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:24:11.074694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7e097fb0-1f9e-456d-b9ab-df0acdfdd774 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:11.075727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7e097fb0-1f9e-456d-b9ab-df0acdfdd774 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:11.090149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e097fb0-1f9e-456d-b9ab-df0acdfdd774 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:11.090416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e097fb0-1f9e-456d-b9ab-df0acdfdd774 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:11.092615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e097fb0-1f9e-456d-b9ab-df0acdfdd774 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:11.095555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e097fb0-1f9e-456d-b9ab-df0acdfdd774 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:11.096706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e097fb0-1f9e-456d-b9ab-df0acdfdd774 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:11.099819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7e097fb0-1f9e-456d-b9ab-df0acdfdd774 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:11.785098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8839c037-882f-4765-b42e-bf33ff359535 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:11.797381 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8839c037-882f-4765-b42e-bf33ff359535 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1313 microversion: 2.1 time: 1.125784 Sep 08 13:24:11.798052 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2698/5272] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:10 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1313 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:11.824302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-941b5c7f-2d5d-46d7-8082-4a42ba51e594 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:11.838838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-941b5c7f-2d5d-46d7-8082-4a42ba51e594 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:11.881492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-941b5c7f-2d5d-46d7-8082-4a42ba51e594 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:11.882005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-941b5c7f-2d5d-46d7-8082-4a42ba51e594 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:11.882459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-941b5c7f-2d5d-46d7-8082-4a42ba51e594 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:11.883201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-941b5c7f-2d5d-46d7-8082-4a42ba51e594 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:11.894190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-941b5c7f-2d5d-46d7-8082-4a42ba51e594 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:11.894689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-941b5c7f-2d5d-46d7-8082-4a42ba51e594 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:11.917092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7e097fb0-1f9e-456d-b9ab-df0acdfdd774 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:11.931502 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7e097fb0-1f9e-456d-b9ab-df0acdfdd774 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 200 len: 1486 microversion: 2.1 time: 0.868459 Sep 08 13:24:11.949150 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2575/5273] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:11 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 1486 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:12.227367 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-941b5c7f-2d5d-46d7-8082-4a42ba51e594 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1424 microversion: 2.1 time: 0.411547 Sep 08 13:24:12.228369 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2699/5274] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:11 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1424 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:12.847915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-78161143-439e-4243-b363-8b8792d2fcc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:12.849241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-78161143-439e-4243-b363-8b8792d2fcc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:12.872162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78161143-439e-4243-b363-8b8792d2fcc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:12.881832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78161143-439e-4243-b363-8b8792d2fcc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:12.902815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78161143-439e-4243-b363-8b8792d2fcc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:12.905732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78161143-439e-4243-b363-8b8792d2fcc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:12.906629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78161143-439e-4243-b363-8b8792d2fcc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:12.907733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78161143-439e-4243-b363-8b8792d2fcc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:12.977614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1813355b-80b1-49f3-8bcf-3240dbdad81f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:12.979157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1813355b-80b1-49f3-8bcf-3240dbdad81f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: c63671b3-14c6-4956-9131-8324104a48eb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:12.993103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1813355b-80b1-49f3-8bcf-3240dbdad81f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:12.999278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1813355b-80b1-49f3-8bcf-3240dbdad81f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:13.001181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1813355b-80b1-49f3-8bcf-3240dbdad81f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:13.009389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1813355b-80b1-49f3-8bcf-3240dbdad81f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:13.021498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1813355b-80b1-49f3-8bcf-3240dbdad81f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:13.022424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1813355b-80b1-49f3-8bcf-3240dbdad81f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:13.082717 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-1813355b-80b1-49f3-8bcf-3240dbdad81f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] HTTP exception thrown: Instance c63671b3-14c6-4956-9131-8324104a48eb could not be found. Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1813355b-80b1-49f3-8bcf-3240dbdad81f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Request method failure captured: Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb HTTP/1.1 Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGewr8e9ByZ_foL6LwnyfRgSFwKUwALx7izO1TTDFkRh8AkAlQeEPNCRKPAKT7d7bgJfL1NGh2UASGnmNtbXZz7QLuEfNFYng7zZFg9vBpcftjf8tI1CSHCUN5RoScjLdVzJroeMK4b00mBxq3NV8UL5A0bEfnuI0udi20_EDXzrfJSI Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 8de9ce7e5cda42afa55b08b9158cb72f Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestNetworkBasicOps-309340670 Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8de9ce7e5cda42afa55b08b9158cb72f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8de9ce7e5cda42afa55b08b9158cb72f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8de9ce7e5cda42afa55b08b9158cb72f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8de9ce7e5cda42afa55b08b9158cb72f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestNetworkBasicOps-309340670 Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 8de9ce7e5cda42afa55b08b9158cb72f Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestNetworkBasicOps-309340670 Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestNetworkBasicOps-309340670-project Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: e8b4c622b66243558ea7c2395101382b Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestNetworkBasicOps-309340670-project Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance c63671b3-14c6-4956-9131-8324104a48eb could not be found. Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c63671b3-14c6-4956-9131-8324104a48eb'} Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c63671b3-14c6-4956-9131-8324104a48eb could not be found. Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c63671b3-14c6-4956-9131-8324104a48eb could not be found. Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:24:13.084825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:13.089692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:13.089692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:24:13.089692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:24:13.089692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:24:13.089692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:24:13.089692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c63671b3-14c6-4956-9131-8324104a48eb could not be found. Sep 08 13:24:13.089692 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:13.091917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1813355b-80b1-49f3-8bcf-3240dbdad81f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Returning 404 to user: Instance c63671b3-14c6-4956-9131-8324104a48eb could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:24:13.093142 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1813355b-80b1-49f3-8bcf-3240dbdad81f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb" status: 404 len: 111 microversion: 2.1 time: 0.119565 Sep 08 13:24:13.094310 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2700/5275] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:12 2022] GET /compute/v2.1/servers/c63671b3-14c6-4956-9131-8324104a48eb => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:24:13.270338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-80c04e76-ca10-4edf-883a-1d38e2acb486 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:13.271471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-80c04e76-ca10-4edf-883a-1d38e2acb486 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:13.285206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80c04e76-ca10-4edf-883a-1d38e2acb486 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:13.288902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80c04e76-ca10-4edf-883a-1d38e2acb486 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:13.290373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80c04e76-ca10-4edf-883a-1d38e2acb486 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:13.292496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80c04e76-ca10-4edf-883a-1d38e2acb486 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:13.293391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80c04e76-ca10-4edf-883a-1d38e2acb486 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:13.295595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80c04e76-ca10-4edf-883a-1d38e2acb486 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:13.746750 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-80c04e76-ca10-4edf-883a-1d38e2acb486 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1424 microversion: 2.1 time: 0.476163 Sep 08 13:24:13.748361 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2701/5276] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:13 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1424 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:14.002961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-78161143-439e-4243-b363-8b8792d2fcc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:14.023970 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-78161143-439e-4243-b363-8b8792d2fcc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1313 microversion: 2.1 time: 1.181994 Sep 08 13:24:14.025274 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2576/5277] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:12 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1313 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:14.789954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b0e076ae-8aae-443f-8c46-a70316c2de76 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:14.790869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b0e076ae-8aae-443f-8c46-a70316c2de76 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:14.807485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0e076ae-8aae-443f-8c46-a70316c2de76 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:14.809921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0e076ae-8aae-443f-8c46-a70316c2de76 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:14.810578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0e076ae-8aae-443f-8c46-a70316c2de76 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:14.813992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0e076ae-8aae-443f-8c46-a70316c2de76 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:14.815027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0e076ae-8aae-443f-8c46-a70316c2de76 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:14.817601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0e076ae-8aae-443f-8c46-a70316c2de76 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:15.063018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2fefdc37-1385-42f5-ac64-d08a257a3e17 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:15.065157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2fefdc37-1385-42f5-ac64-d08a257a3e17 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:15.086026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fefdc37-1385-42f5-ac64-d08a257a3e17 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:15.089554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fefdc37-1385-42f5-ac64-d08a257a3e17 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:15.090538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fefdc37-1385-42f5-ac64-d08a257a3e17 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:15.093767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fefdc37-1385-42f5-ac64-d08a257a3e17 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:15.097234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fefdc37-1385-42f5-ac64-d08a257a3e17 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:15.098055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fefdc37-1385-42f5-ac64-d08a257a3e17 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:15.479905 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b0e076ae-8aae-443f-8c46-a70316c2de76 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1466 microversion: 2.1 time: 0.693825 Sep 08 13:24:15.482804 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2702/5278] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:14 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1466 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:24:15.495189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e32c6d8-16fe-4422-b102-20959f2c687c tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '.version_select at 0x7fdb35a1d4c0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:15.546702 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3e32c6d8-16fe-4422-b102-20959f2c687c tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1176312275" status: 202 len: 0 microversion: 2.1 time: 0.060887 Sep 08 13:24:15.547797 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2703/5279] 10.222.0.78 () {58 vars in 1257 bytes} [Thu Sep 8 13:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1176312275 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:24:16.398681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2fefdc37-1385-42f5-ac64-d08a257a3e17 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:16.416969 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2fefdc37-1385-42f5-ac64-d08a257a3e17 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1313 microversion: 2.1 time: 1.357700 Sep 08 13:24:16.431380 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2577/5280] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:15 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1313 bytes in 1359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:16.536705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e6edae0-25e8-4c13-92f3-822203a266fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:16.537343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9e6edae0-25e8-4c13-92f3-822203a266fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:16.551928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e6edae0-25e8-4c13-92f3-822203a266fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:16.552460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e6edae0-25e8-4c13-92f3-822203a266fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:16.552917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e6edae0-25e8-4c13-92f3-822203a266fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:16.553680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e6edae0-25e8-4c13-92f3-822203a266fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:16.554140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e6edae0-25e8-4c13-92f3-822203a266fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:16.554576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e6edae0-25e8-4c13-92f3-822203a266fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:17.240267 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e6edae0-25e8-4c13-92f3-822203a266fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1466 microversion: 2.1 time: 0.706971 Sep 08 13:24:17.244540 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2704/5281] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:16 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1466 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:24:17.464255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ece22fc9-5209-415c-b208-018739ddaeb2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:17.473013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ece22fc9-5209-415c-b208-018739ddaeb2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:17.518632 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:24:17.521206 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 13:24:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 (ip 10.222.0.78) !!! Sep 08 13:24:17.526336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ece22fc9-5209-415c-b208-018739ddaeb2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:17.529023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ece22fc9-5209-415c-b208-018739ddaeb2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:17.529823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ece22fc9-5209-415c-b208-018739ddaeb2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:17.534121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ece22fc9-5209-415c-b208-018739ddaeb2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:17.535165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ece22fc9-5209-415c-b208-018739ddaeb2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:17.537638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ece22fc9-5209-415c-b208-018739ddaeb2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:18.293700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-de10362d-1f4f-4611-b2c5-092712443167 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:18.294308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-de10362d-1f4f-4611-b2c5-092712443167 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:18.297637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:24:18.298607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:24:18.327798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de10362d-1f4f-4611-b2c5-092712443167 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:18.328304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de10362d-1f4f-4611-b2c5-092712443167 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:18.328743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de10362d-1f4f-4611-b2c5-092712443167 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:18.340928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de10362d-1f4f-4611-b2c5-092712443167 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:18.346283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de10362d-1f4f-4611-b2c5-092712443167 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:18.349797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de10362d-1f4f-4611-b2c5-092712443167 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:18.980135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:24:19.194218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ece22fc9-5209-415c-b208-018739ddaeb2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:19.216771 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ece22fc9-5209-415c-b208-018739ddaeb2 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1313 microversion: 2.1 time: 1.764185 Sep 08 13:24:19.217507 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2578/5282] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:17 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1313 bytes in 1767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:19.356628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:24:19.366743 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-de10362d-1f4f-4611-b2c5-092712443167 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1466 microversion: 2.1 time: 1.077783 Sep 08 13:24:19.369926 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2705/5283] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:18 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1466 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:20.131679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-bcf93021-7080-49bc-9320-01bd63dacd5a req-6669f964-0cdc-4e90-8b38-3fc8ed433a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04", "name": "network-vif-plugged", "status": "completed", "tag": "5e632452-98fc-4bbd-90f0-e48d357125f6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:24:20.161008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bcf93021-7080-49bc-9320-01bd63dacd5a req-6669f964-0cdc-4e90-8b38-3fc8ed433a36 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:20.161620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bcf93021-7080-49bc-9320-01bd63dacd5a req-6669f964-0cdc-4e90-8b38-3fc8ed433a36 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:20.162085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-bcf93021-7080-49bc-9320-01bd63dacd5a req-6669f964-0cdc-4e90-8b38-3fc8ed433a36 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:20.199811 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-bcf93021-7080-49bc-9320-01bd63dacd5a req-6669f964-0cdc-4e90-8b38-3fc8ed433a36 service nova] Creating event network-vif-plugged:5e632452-98fc-4bbd-90f0-e48d357125f6 for instance c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 on n-h2-852084-10 Sep 08 13:24:20.208609 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-bcf93021-7080-49bc-9320-01bd63dacd5a req-6669f964-0cdc-4e90-8b38-3fc8ed433a36 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081207 Sep 08 13:24:20.216612 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2579/5284] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:24:20.270205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a5c34b30-7b60-4013-9a1d-c3dfce455a4c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:20.271565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a5c34b30-7b60-4013-9a1d-c3dfce455a4c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:20.293927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5c34b30-7b60-4013-9a1d-c3dfce455a4c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:20.297098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5c34b30-7b60-4013-9a1d-c3dfce455a4c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:20.302999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5c34b30-7b60-4013-9a1d-c3dfce455a4c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:20.304726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5c34b30-7b60-4013-9a1d-c3dfce455a4c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:20.307732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5c34b30-7b60-4013-9a1d-c3dfce455a4c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:20.310756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a5c34b30-7b60-4013-9a1d-c3dfce455a4c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:20.394796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-118941eb-2fd3-4d9c-8449-42c7b6d20220 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:20.395577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-118941eb-2fd3-4d9c-8449-42c7b6d20220 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:20.424631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-118941eb-2fd3-4d9c-8449-42c7b6d20220 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:20.425265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-118941eb-2fd3-4d9c-8449-42c7b6d20220 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:20.425853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-118941eb-2fd3-4d9c-8449-42c7b6d20220 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:20.426777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-118941eb-2fd3-4d9c-8449-42c7b6d20220 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:20.447282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-118941eb-2fd3-4d9c-8449-42c7b6d20220 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:20.448037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-118941eb-2fd3-4d9c-8449-42c7b6d20220 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:21.170045 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-118941eb-2fd3-4d9c-8449-42c7b6d20220 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1466 microversion: 2.1 time: 0.780215 Sep 08 13:24:21.181425 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2580/5285] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:20 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1466 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:21.323972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a5c34b30-7b60-4013-9a1d-c3dfce455a4c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:21.336990 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a5c34b30-7b60-4013-9a1d-c3dfce455a4c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1313 microversion: 2.1 time: 1.075502 Sep 08 13:24:21.337695 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2706/5286] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:20 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1313 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:21.631261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-1652b3cc-3bf1-4a7b-88e4-9c752b0a5bf7 req-3214d211-1172-4359-8c57-b10293cf71b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d24c2145-3970-41c4-8c43-9061d3e4bd35", "tag": "faf684ad-d855-46ed-a650-10f60bfda544"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:24:21.656721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1652b3cc-3bf1-4a7b-88e4-9c752b0a5bf7 req-3214d211-1172-4359-8c57-b10293cf71b5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:21.658069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1652b3cc-3bf1-4a7b-88e4-9c752b0a5bf7 req-3214d211-1172-4359-8c57-b10293cf71b5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:21.658732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1652b3cc-3bf1-4a7b-88e4-9c752b0a5bf7 req-3214d211-1172-4359-8c57-b10293cf71b5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:21.723515 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-1652b3cc-3bf1-4a7b-88e4-9c752b0a5bf7 req-3214d211-1172-4359-8c57-b10293cf71b5 service nova] Creating event network-changed:faf684ad-d855-46ed-a650-10f60bfda544 for instance d24c2145-3970-41c4-8c43-9061d3e4bd35 on n-h2-852084-10 Sep 08 13:24:21.740438 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-1652b3cc-3bf1-4a7b-88e4-9c752b0a5bf7 req-3214d211-1172-4359-8c57-b10293cf71b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112786 Sep 08 13:24:21.741735 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2581/5287] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:24:22.198813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc58e29f-2203-4ea5-a415-696a5bfd6968 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:22.200091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc58e29f-2203-4ea5-a415-696a5bfd6968 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:22.220992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc58e29f-2203-4ea5-a415-696a5bfd6968 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:22.225316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc58e29f-2203-4ea5-a415-696a5bfd6968 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:22.225881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc58e29f-2203-4ea5-a415-696a5bfd6968 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:22.226744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc58e29f-2203-4ea5-a415-696a5bfd6968 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:22.227365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc58e29f-2203-4ea5-a415-696a5bfd6968 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:22.232126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc58e29f-2203-4ea5-a415-696a5bfd6968 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:22.368217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-46737667-3a5c-470b-bf86-6ddc38224c0e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:22.369093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-46737667-3a5c-470b-bf86-6ddc38224c0e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:22.387092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46737667-3a5c-470b-bf86-6ddc38224c0e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:22.388052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46737667-3a5c-470b-bf86-6ddc38224c0e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:22.388732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46737667-3a5c-470b-bf86-6ddc38224c0e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:22.389761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46737667-3a5c-470b-bf86-6ddc38224c0e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:22.391958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46737667-3a5c-470b-bf86-6ddc38224c0e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:22.392696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46737667-3a5c-470b-bf86-6ddc38224c0e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:23.305433 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc58e29f-2203-4ea5-a415-696a5bfd6968 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1466 microversion: 2.1 time: 1.110497 Sep 08 13:24:23.306263 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2707/5288] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:22 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1466 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:24:23.745273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-46737667-3a5c-470b-bf86-6ddc38224c0e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:23.765294 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-46737667-3a5c-470b-bf86-6ddc38224c0e tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1462 microversion: 2.1 time: 1.402365 Sep 08 13:24:23.776845 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2582/5289] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:22 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1462 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:24:23.791570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-09d2400d-a313-4fe9-8310-5bc84f80ec7c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c1c2c73-22f9-4164-a832-c1b7f4db24ee", "device": "/dev/sdb"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:24:23.795476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-09d2400d-a313-4fe9-8310-5bc84f80ec7c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:23.820253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09d2400d-a313-4fe9-8310-5bc84f80ec7c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:23.821203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09d2400d-a313-4fe9-8310-5bc84f80ec7c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:23.821921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09d2400d-a313-4fe9-8310-5bc84f80ec7c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:23.823033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09d2400d-a313-4fe9-8310-5bc84f80ec7c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:23.824094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09d2400d-a313-4fe9-8310-5bc84f80ec7c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:23.825007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09d2400d-a313-4fe9-8310-5bc84f80ec7c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:24.351390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc0bb4e7-f0b7-4c06-8dff-1ec72983e76e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:24.352177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cc0bb4e7-f0b7-4c06-8dff-1ec72983e76e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:24.369245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc0bb4e7-f0b7-4c06-8dff-1ec72983e76e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:24.369770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc0bb4e7-f0b7-4c06-8dff-1ec72983e76e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:24.370313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc0bb4e7-f0b7-4c06-8dff-1ec72983e76e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:24.370982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc0bb4e7-f0b7-4c06-8dff-1ec72983e76e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:24.371489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc0bb4e7-f0b7-4c06-8dff-1ec72983e76e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:24.371927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc0bb4e7-f0b7-4c06-8dff-1ec72983e76e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:24.437802 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-09d2400d-a313-4fe9-8310-5bc84f80ec7c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "POST /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.650673 Sep 08 13:24:24.442832 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2708/5290] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:24:23 2022] POST /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04/os-volume_attachments => generated 194 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:24:24.474248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:24:24.819839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f0014811-a86b-4cc5-8f4a-efa446bd83df tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:24.820359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f0014811-a86b-4cc5-8f4a-efa446bd83df tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:24.848426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0014811-a86b-4cc5-8f4a-efa446bd83df tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:24.849262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0014811-a86b-4cc5-8f4a-efa446bd83df tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:24.849952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0014811-a86b-4cc5-8f4a-efa446bd83df tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:24.850929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0014811-a86b-4cc5-8f4a-efa446bd83df tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:24.855488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0014811-a86b-4cc5-8f4a-efa446bd83df tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:24.856236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0014811-a86b-4cc5-8f4a-efa446bd83df tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:24.934035 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f0014811-a86b-4cc5-8f4a-efa446bd83df tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments/ad804490-d617-4b28-9060-ea6d2e4aa67e" status: 200 len: 194 microversion: 2.1 time: 0.119132 Sep 08 13:24:24.956571 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2709/5291] 10.222.0.78 () {58 vars in 1413 bytes} [Thu Sep 8 13:24:24 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments/ad804490-d617-4b28-9060-ea6d2e4aa67e => generated 194 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:24:24.962166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7113593f-9a61-4311-ab04-25a7be802914 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:24.962672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7113593f-9a61-4311-ab04-25a7be802914 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:24.979325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7113593f-9a61-4311-ab04-25a7be802914 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:24.980068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7113593f-9a61-4311-ab04-25a7be802914 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:24.980840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7113593f-9a61-4311-ab04-25a7be802914 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:24.981789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7113593f-9a61-4311-ab04-25a7be802914 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:24.982447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7113593f-9a61-4311-ab04-25a7be802914 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:24.983057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7113593f-9a61-4311-ab04-25a7be802914 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:25.222406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-7113593f-9a61-4311-ab04-25a7be802914 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lazy-loading 'services' on Instance uuid 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:24:25.397996 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7113593f-9a61-4311-ab04-25a7be802914 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments/ad804490-d617-4b28-9060-ea6d2e4aa67e" status: 202 len: 0 microversion: 2.1 time: 0.439692 Sep 08 13:24:25.400861 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2710/5292] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:24:24 2022] DELETE /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments/ad804490-d617-4b28-9060-ea6d2e4aa67e => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:24:25.729549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-716a6825-f47d-4250-aa39-c0915e7cf9da tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:25.730166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-716a6825-f47d-4250-aa39-c0915e7cf9da tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:25.741905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-716a6825-f47d-4250-aa39-c0915e7cf9da tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:25.742417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-716a6825-f47d-4250-aa39-c0915e7cf9da tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:25.742867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-716a6825-f47d-4250-aa39-c0915e7cf9da tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:25.750227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-716a6825-f47d-4250-aa39-c0915e7cf9da tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:25.751308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-716a6825-f47d-4250-aa39-c0915e7cf9da tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:25.751989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-716a6825-f47d-4250-aa39-c0915e7cf9da tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:25.824819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-716a6825-f47d-4250-aa39-c0915e7cf9da tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:24:26.006937 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cc0bb4e7-f0b7-4c06-8dff-1ec72983e76e tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1466 microversion: 2.1 time: 1.658230 Sep 08 13:24:26.018815 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2583/5293] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:24 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1466 bytes in 1662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:26.031062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7100247d-73af-461e-90b0-f04feb4c2584 req-e9ee3fda-6515-4bb4-9d89-3b250e74340c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca964cbe-e495-4b9c-ad2f-44ff068729ff", "tag": "0c4a644f-842a-423d-ab02-ce5aa6a156f2"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:24:26.081520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7100247d-73af-461e-90b0-f04feb4c2584 req-e9ee3fda-6515-4bb4-9d89-3b250e74340c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:26.082214 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-716a6825-f47d-4250-aa39-c0915e7cf9da tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 204 len: 0 microversion: 2.1 time: 0.356889 Sep 08 13:24:26.083335 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2711/5294] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:24:25 2022] DELETE /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:24:26.085435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7100247d-73af-461e-90b0-f04feb4c2584 req-e9ee3fda-6515-4bb4-9d89-3b250e74340c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:26.087194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7100247d-73af-461e-90b0-f04feb4c2584 req-e9ee3fda-6515-4bb4-9d89-3b250e74340c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:26.095693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5298a061-e6a5-4b88-a376-9581de0f6c00 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:26.096555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5298a061-e6a5-4b88-a376-9581de0f6c00 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:26.103266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5298a061-e6a5-4b88-a376-9581de0f6c00 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:26.103952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5298a061-e6a5-4b88-a376-9581de0f6c00 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:26.104397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5298a061-e6a5-4b88-a376-9581de0f6c00 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:26.105165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5298a061-e6a5-4b88-a376-9581de0f6c00 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:26.105621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5298a061-e6a5-4b88-a376-9581de0f6c00 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:26.106157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5298a061-e6a5-4b88-a376-9581de0f6c00 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:26.132965 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7100247d-73af-461e-90b0-f04feb4c2584 req-e9ee3fda-6515-4bb4-9d89-3b250e74340c service nova] Creating event network-changed:0c4a644f-842a-423d-ab02-ce5aa6a156f2 for instance ca964cbe-e495-4b9c-ad2f-44ff068729ff on n-h1-852084-10 Sep 08 13:24:26.158750 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7100247d-73af-461e-90b0-f04feb4c2584 req-e9ee3fda-6515-4bb4-9d89-3b250e74340c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138225 Sep 08 13:24:26.160280 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2584/5295] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:24:26.860136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5298a061-e6a5-4b88-a376-9581de0f6c00 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:26.892356 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5298a061-e6a5-4b88-a376-9581de0f6c00 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1672 microversion: 2.1 time: 0.802142 Sep 08 13:24:26.900223 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2712/5296] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:26 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1672 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:27.054210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-987420a3-9b98-4162-b3b3-502d1c1675c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:27.055676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-987420a3-9b98-4162-b3b3-502d1c1675c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:27.070353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-987420a3-9b98-4162-b3b3-502d1c1675c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:27.071162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-987420a3-9b98-4162-b3b3-502d1c1675c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:27.071817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-987420a3-9b98-4162-b3b3-502d1c1675c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:27.072730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-987420a3-9b98-4162-b3b3-502d1c1675c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:27.073364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-987420a3-9b98-4162-b3b3-502d1c1675c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:27.075914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-987420a3-9b98-4162-b3b3-502d1c1675c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:27.425963 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-987420a3-9b98-4162-b3b3-502d1c1675c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1466 microversion: 2.1 time: 0.375859 Sep 08 13:24:27.440102 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2585/5297] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:27 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1466 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:27.936909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1de9b8c9-9430-4e97-8ecb-9ffd25f0cbc5 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:27.937993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1de9b8c9-9430-4e97-8ecb-9ffd25f0cbc5 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:27.981061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1de9b8c9-9430-4e97-8ecb-9ffd25f0cbc5 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:27.990600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1de9b8c9-9430-4e97-8ecb-9ffd25f0cbc5 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:27.991827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1de9b8c9-9430-4e97-8ecb-9ffd25f0cbc5 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:27.993423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1de9b8c9-9430-4e97-8ecb-9ffd25f0cbc5 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:27.995418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1de9b8c9-9430-4e97-8ecb-9ffd25f0cbc5 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:27.996505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1de9b8c9-9430-4e97-8ecb-9ffd25f0cbc5 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:28.459372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1de9b8c9-9430-4e97-8ecb-9ffd25f0cbc5 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:28.476343 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1de9b8c9-9430-4e97-8ecb-9ffd25f0cbc5 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1672 microversion: 2.1 time: 0.549651 Sep 08 13:24:28.495857 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2713/5298] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:27 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1672 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:28.507138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e7f8f37a-c62c-4214-8ee0-8c0fcbffcc32 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:28.508637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e7f8f37a-c62c-4214-8ee0-8c0fcbffcc32 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:28.562597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7f8f37a-c62c-4214-8ee0-8c0fcbffcc32 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:28.567490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7f8f37a-c62c-4214-8ee0-8c0fcbffcc32 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:28.570759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7f8f37a-c62c-4214-8ee0-8c0fcbffcc32 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:28.575064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7f8f37a-c62c-4214-8ee0-8c0fcbffcc32 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:28.576465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7f8f37a-c62c-4214-8ee0-8c0fcbffcc32 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:28.581976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7f8f37a-c62c-4214-8ee0-8c0fcbffcc32 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:29.526772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f1a12ae-c012-451e-8505-c945942c6a87 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:29.536253 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e7f8f37a-c62c-4214-8ee0-8c0fcbffcc32 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1466 microversion: 2.1 time: 1.024267 Sep 08 13:24:29.541291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1f1a12ae-c012-451e-8505-c945942c6a87 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:29.544504 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2586/5299] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:28 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1466 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:29.577947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f1a12ae-c012-451e-8505-c945942c6a87 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:29.580377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f1a12ae-c012-451e-8505-c945942c6a87 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:29.581832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f1a12ae-c012-451e-8505-c945942c6a87 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:29.585503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f1a12ae-c012-451e-8505-c945942c6a87 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:29.592499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f1a12ae-c012-451e-8505-c945942c6a87 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:29.593311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f1a12ae-c012-451e-8505-c945942c6a87 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:30.353924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1f1a12ae-c012-451e-8505-c945942c6a87 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:30.370879 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1f1a12ae-c012-451e-8505-c945942c6a87 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1672 microversion: 2.1 time: 0.855485 Sep 08 13:24:30.371966 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2714/5300] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:29 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1672 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:30.588174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-463d69d3-7241-4acb-9209-ba117041b053 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:30.589301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-463d69d3-7241-4acb-9209-ba117041b053 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:30.639673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-463d69d3-7241-4acb-9209-ba117041b053 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:30.640443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-463d69d3-7241-4acb-9209-ba117041b053 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:30.641265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-463d69d3-7241-4acb-9209-ba117041b053 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:30.642655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-463d69d3-7241-4acb-9209-ba117041b053 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:30.651518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-463d69d3-7241-4acb-9209-ba117041b053 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:30.663352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-463d69d3-7241-4acb-9209-ba117041b053 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:31.190400 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-463d69d3-7241-4acb-9209-ba117041b053 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1466 microversion: 2.1 time: 0.608274 Sep 08 13:24:31.193962 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2587/5301] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:30 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1466 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:31.400859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dcabf449-e080-4fda-a14c-b4517fbe176b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:31.403018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dcabf449-e080-4fda-a14c-b4517fbe176b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:31.419860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:24:31.424473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcabf449-e080-4fda-a14c-b4517fbe176b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:31.426042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcabf449-e080-4fda-a14c-b4517fbe176b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:31.428377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcabf449-e080-4fda-a14c-b4517fbe176b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:31.430407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcabf449-e080-4fda-a14c-b4517fbe176b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:31.431708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcabf449-e080-4fda-a14c-b4517fbe176b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:31.432824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcabf449-e080-4fda-a14c-b4517fbe176b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:31.499790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e29edece-c39f-459a-b0fe-8debe8b22fbf req-75c04fec-1a39-4b99-be3f-6d07683e96e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca964cbe-e495-4b9c-ad2f-44ff068729ff", "name": "network-vif-deleted", "tag": "0c4a644f-842a-423d-ab02-ce5aa6a156f2"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:24:31.530079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e29edece-c39f-459a-b0fe-8debe8b22fbf req-75c04fec-1a39-4b99-be3f-6d07683e96e9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:31.531641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e29edece-c39f-459a-b0fe-8debe8b22fbf req-75c04fec-1a39-4b99-be3f-6d07683e96e9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:31.532750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e29edece-c39f-459a-b0fe-8debe8b22fbf req-75c04fec-1a39-4b99-be3f-6d07683e96e9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:31.557601 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e29edece-c39f-459a-b0fe-8debe8b22fbf req-75c04fec-1a39-4b99-be3f-6d07683e96e9 service nova] Creating event network-vif-deleted:0c4a644f-842a-423d-ab02-ce5aa6a156f2 for instance ca964cbe-e495-4b9c-ad2f-44ff068729ff on n-h1-852084-10 Sep 08 13:24:31.573312 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e29edece-c39f-459a-b0fe-8debe8b22fbf req-75c04fec-1a39-4b99-be3f-6d07683e96e9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080860 Sep 08 13:24:31.576643 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2588/5302] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:24:31.697282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dcabf449-e080-4fda-a14c-b4517fbe176b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:31.716199 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dcabf449-e080-4fda-a14c-b4517fbe176b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 200 len: 1485 microversion: 2.1 time: 0.322861 Sep 08 13:24:31.727361 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2715/5303] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:31 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 1485 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:32.274431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-199daa2c-a1e8-4985-8f87-b894d784b7fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:32.282322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-199daa2c-a1e8-4985-8f87-b894d784b7fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:32.311601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-199daa2c-a1e8-4985-8f87-b894d784b7fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:32.315412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-199daa2c-a1e8-4985-8f87-b894d784b7fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:32.318706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-199daa2c-a1e8-4985-8f87-b894d784b7fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:32.320085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-199daa2c-a1e8-4985-8f87-b894d784b7fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:32.320971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-199daa2c-a1e8-4985-8f87-b894d784b7fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:32.321762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-199daa2c-a1e8-4985-8f87-b894d784b7fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:32.665214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7046c053-99c5-44f6-93b7-f0b5d2b4f696 req-09163abc-bad6-4636-b707-e79bdb99bced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24c2145-3970-41c4-8c43-9061d3e4bd35", "name": "network-vif-plugged", "status": "completed", "tag": "faf684ad-d855-46ed-a650-10f60bfda544"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:24:32.739291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7046c053-99c5-44f6-93b7-f0b5d2b4f696 req-09163abc-bad6-4636-b707-e79bdb99bced service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:32.743867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7046c053-99c5-44f6-93b7-f0b5d2b4f696 req-09163abc-bad6-4636-b707-e79bdb99bced service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:32.745189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7046c053-99c5-44f6-93b7-f0b5d2b4f696 req-09163abc-bad6-4636-b707-e79bdb99bced service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:32.794490 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7046c053-99c5-44f6-93b7-f0b5d2b4f696 req-09163abc-bad6-4636-b707-e79bdb99bced service nova] Creating event network-vif-plugged:faf684ad-d855-46ed-a650-10f60bfda544 for instance d24c2145-3970-41c4-8c43-9061d3e4bd35 on n-h2-852084-10 Sep 08 13:24:32.804467 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7046c053-99c5-44f6-93b7-f0b5d2b4f696 req-09163abc-bad6-4636-b707-e79bdb99bced service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149887 Sep 08 13:24:32.805909 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2716/5304] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:24:32.813389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d4fc662c-0a84-4f73-a10e-6c19f16b4079 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:32.814451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d4fc662c-0a84-4f73-a10e-6c19f16b4079 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: ca964cbe-e495-4b9c-ad2f-44ff068729ff] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:32.838377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4fc662c-0a84-4f73-a10e-6c19f16b4079 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:32.839326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4fc662c-0a84-4f73-a10e-6c19f16b4079 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:32.840817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4fc662c-0a84-4f73-a10e-6c19f16b4079 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:32.842199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4fc662c-0a84-4f73-a10e-6c19f16b4079 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:32.843162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4fc662c-0a84-4f73-a10e-6c19f16b4079 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:32.843901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4fc662c-0a84-4f73-a10e-6c19f16b4079 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:32.863992 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-d4fc662c-0a84-4f73-a10e-6c19f16b4079 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] HTTP exception thrown: Instance ca964cbe-e495-4b9c-ad2f-44ff068729ff could not be found. Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d4fc662c-0a84-4f73-a10e-6c19f16b4079 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Request method failure captured: Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff HTTP/1.1 Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGewr8e9ByZ_foL6LwnyfRgSFwKUwALx7izO1TTDFkRh8AkAlQeEPNCRKPAKT7d7bgJfL1NGh2UASGnmNtbXZz7QLuEfNFYng7zZFg9vBpcftjf8tI1CSHCUN5RoScjLdVzJroeMK4b00mBxq3NV8UL5A0bEfnuI0udi20_EDXzrfJSI Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 8de9ce7e5cda42afa55b08b9158cb72f Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestNetworkBasicOps-309340670 Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8de9ce7e5cda42afa55b08b9158cb72f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8de9ce7e5cda42afa55b08b9158cb72f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8de9ce7e5cda42afa55b08b9158cb72f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8de9ce7e5cda42afa55b08b9158cb72f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestNetworkBasicOps-309340670 Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 8de9ce7e5cda42afa55b08b9158cb72f Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestNetworkBasicOps-309340670 Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestNetworkBasicOps-309340670-project Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: e8b4c622b66243558ea7c2395101382b Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestNetworkBasicOps-309340670-project Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance ca964cbe-e495-4b9c-ad2f-44ff068729ff could not be found. Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'ca964cbe-e495-4b9c-ad2f-44ff068729ff'} Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca964cbe-e495-4b9c-ad2f-44ff068729ff could not be found. Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca964cbe-e495-4b9c-ad2f-44ff068729ff could not be found. Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:24:32.866048 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:32.871266 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:32.871266 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:24:32.871266 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:24:32.871266 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:24:32.871266 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:24:32.871266 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca964cbe-e495-4b9c-ad2f-44ff068729ff could not be found. Sep 08 13:24:32.871266 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:32.872774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d4fc662c-0a84-4f73-a10e-6c19f16b4079 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Returning 404 to user: Instance ca964cbe-e495-4b9c-ad2f-44ff068729ff could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:24:32.874247 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d4fc662c-0a84-4f73-a10e-6c19f16b4079 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff" status: 404 len: 111 microversion: 2.1 time: 0.066065 Sep 08 13:24:32.888264 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2717/5305] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:32 2022] GET /compute/v2.1/servers/ca964cbe-e495-4b9c-ad2f-44ff068729ff => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:24:32.970431 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-199daa2c-a1e8-4985-8f87-b894d784b7fb tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1466 microversion: 2.1 time: 0.728617 Sep 08 13:24:32.971728 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2589/5306] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:32 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1466 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:33.476515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc753b97-4470-4cc4-8b2a-09c2311d75ee tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '.version_select at 0x7fdb36c30ee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:33.558894 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc753b97-4470-4cc4-8b2a-09c2311d75ee tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-179052639" status: 202 len: 0 microversion: 2.1 time: 0.094694 Sep 08 13:24:33.560103 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2718/5307] 10.222.0.78 () {58 vars in 1254 bytes} [Thu Sep 8 13:24:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-179052639 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:24:34.013629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-67a15d2f-966c-4c91-ab0b-8308d952007b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:34.019462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-67a15d2f-966c-4c91-ab0b-8308d952007b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:34.033418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67a15d2f-966c-4c91-ab0b-8308d952007b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:34.034701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67a15d2f-966c-4c91-ab0b-8308d952007b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:34.035834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67a15d2f-966c-4c91-ab0b-8308d952007b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:34.037392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67a15d2f-966c-4c91-ab0b-8308d952007b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:34.038692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67a15d2f-966c-4c91-ab0b-8308d952007b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:34.040964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67a15d2f-966c-4c91-ab0b-8308d952007b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:34.499915 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-67a15d2f-966c-4c91-ab0b-8308d952007b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1466 microversion: 2.1 time: 0.493454 Sep 08 13:24:34.518896 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2590/5308] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:34 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1466 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:35.299196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9007b585-504d-44bb-b6be-0be7ed336d40 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:35.307400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9007b585-504d-44bb-b6be-0be7ed336d40 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:35.365647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9007b585-504d-44bb-b6be-0be7ed336d40 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:35.373151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9007b585-504d-44bb-b6be-0be7ed336d40 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:35.376266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9007b585-504d-44bb-b6be-0be7ed336d40 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:35.381003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9007b585-504d-44bb-b6be-0be7ed336d40 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:35.387185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9007b585-504d-44bb-b6be-0be7ed336d40 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:35.392629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9007b585-504d-44bb-b6be-0be7ed336d40 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:35.541832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-413242f2-b994-4d53-8a02-2e8753f26ae5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:35.545282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-413242f2-b994-4d53-8a02-2e8753f26ae5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:35.548331 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9007b585-504d-44bb-b6be-0be7ed336d40 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.257318 Sep 08 13:24:35.549315 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2719/5309] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:24:35 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments => generated 25 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:24:35.591713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-413242f2-b994-4d53-8a02-2e8753f26ae5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:35.592352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-413242f2-b994-4d53-8a02-2e8753f26ae5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:35.592827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-413242f2-b994-4d53-8a02-2e8753f26ae5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:35.593619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-413242f2-b994-4d53-8a02-2e8753f26ae5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:35.594096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-413242f2-b994-4d53-8a02-2e8753f26ae5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:35.594623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-413242f2-b994-4d53-8a02-2e8753f26ae5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:35.874503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dddde8ca-36ba-4c1a-adc7-df8f3d611d1d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:35.877417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dddde8ca-36ba-4c1a-adc7-df8f3d611d1d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:35.895165 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dddde8ca-36ba-4c1a-adc7-df8f3d611d1d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:35.896649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dddde8ca-36ba-4c1a-adc7-df8f3d611d1d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:35.897302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dddde8ca-36ba-4c1a-adc7-df8f3d611d1d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:35.898224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dddde8ca-36ba-4c1a-adc7-df8f3d611d1d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:35.898870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dddde8ca-36ba-4c1a-adc7-df8f3d611d1d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:35.901257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dddde8ca-36ba-4c1a-adc7-df8f3d611d1d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:35.981336 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dddde8ca-36ba-4c1a-adc7-df8f3d611d1d tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.111350 Sep 08 13:24:35.982080 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2720/5310] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:24:35 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 13:24:36.196122 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-413242f2-b994-4d53-8a02-2e8753f26ae5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1650 microversion: 2.1 time: 0.661508 Sep 08 13:24:36.197214 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2591/5311] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:35 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1650 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:36.240689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-645913b4-ca58-4029-8c82-a4e02d9061d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:36.241631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-645913b4-ca58-4029-8c82-a4e02d9061d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:36.247824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2357f506-31a5-40c3-8188-4b6adb90d71c tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:36.248963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2357f506-31a5-40c3-8188-4b6adb90d71c tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:36.265473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2357f506-31a5-40c3-8188-4b6adb90d71c tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:36.277828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2357f506-31a5-40c3-8188-4b6adb90d71c tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:36.278339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-645913b4-ca58-4029-8c82-a4e02d9061d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:36.279142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2357f506-31a5-40c3-8188-4b6adb90d71c tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:36.280295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2357f506-31a5-40c3-8188-4b6adb90d71c tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:36.280758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-645913b4-ca58-4029-8c82-a4e02d9061d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:36.281361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2357f506-31a5-40c3-8188-4b6adb90d71c tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:36.282585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2357f506-31a5-40c3-8188-4b6adb90d71c tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:36.283390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-645913b4-ca58-4029-8c82-a4e02d9061d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:36.290816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-645913b4-ca58-4029-8c82-a4e02d9061d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:36.292377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-645913b4-ca58-4029-8c82-a4e02d9061d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:36.294641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-645913b4-ca58-4029-8c82-a4e02d9061d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:36.477544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:24:36.537908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-645913b4-ca58-4029-8c82-a4e02d9061d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:24:36.757315 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-645913b4-ca58-4029-8c82-a4e02d9061d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 204 len: 0 microversion: 2.1 time: 0.517392 Sep 08 13:24:36.761967 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2721/5312] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:24:36 2022] DELETE /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:24:36.788269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc3c4a4d-4e82-4774-8e36-f27bec1dd958 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:36.791485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cc3c4a4d-4e82-4774-8e36-f27bec1dd958 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:36.819124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc3c4a4d-4e82-4774-8e36-f27bec1dd958 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:36.827011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc3c4a4d-4e82-4774-8e36-f27bec1dd958 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:36.827924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc3c4a4d-4e82-4774-8e36-f27bec1dd958 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:36.829374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc3c4a4d-4e82-4774-8e36-f27bec1dd958 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:36.830261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc3c4a4d-4e82-4774-8e36-f27bec1dd958 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:36.831860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc3c4a4d-4e82-4774-8e36-f27bec1dd958 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:37.017619 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2357f506-31a5-40c3-8188-4b6adb90d71c tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1650 microversion: 2.1 time: 0.769045 Sep 08 13:24:37.019851 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2592/5313] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:36 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1650 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:37.054591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-50503522-df3b-4cdd-8921-ae7a2e56b63b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:37.055705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-50503522-df3b-4cdd-8921-ae7a2e56b63b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:37.063411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=52 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:24:37.066591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50503522-df3b-4cdd-8921-ae7a2e56b63b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:37.067738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50503522-df3b-4cdd-8921-ae7a2e56b63b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:37.069285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50503522-df3b-4cdd-8921-ae7a2e56b63b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:37.070997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50503522-df3b-4cdd-8921-ae7a2e56b63b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:37.072020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50503522-df3b-4cdd-8921-ae7a2e56b63b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:37.072721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50503522-df3b-4cdd-8921-ae7a2e56b63b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:38.100943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cc3c4a4d-4e82-4774-8e36-f27bec1dd958 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:38.116508 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc3c4a4d-4e82-4774-8e36-f27bec1dd958 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1673 microversion: 2.1 time: 1.346977 Sep 08 13:24:38.118346 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2722/5314] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:36 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1673 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:24:38.156850 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-50503522-df3b-4cdd-8921-ae7a2e56b63b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1650 microversion: 2.1 time: 1.109041 Sep 08 13:24:38.160747 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2593/5315] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:37 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1650 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:38.207509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84db2407-b6c2-41df-ba4b-cfbeac0db65d tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:38.209001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-84db2407-b6c2-41df-ba4b-cfbeac0db65d tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:38.254992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84db2407-b6c2-41df-ba4b-cfbeac0db65d tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:38.256396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84db2407-b6c2-41df-ba4b-cfbeac0db65d tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:38.257643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84db2407-b6c2-41df-ba4b-cfbeac0db65d tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:38.259395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84db2407-b6c2-41df-ba4b-cfbeac0db65d tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:38.260591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84db2407-b6c2-41df-ba4b-cfbeac0db65d tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:38.262783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84db2407-b6c2-41df-ba4b-cfbeac0db65d tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:38.491444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-84db2407-b6c2-41df-ba4b-cfbeac0db65d tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:24:38.780336 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-84db2407-b6c2-41df-ba4b-cfbeac0db65d tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 204 len: 0 microversion: 2.1 time: 0.585591 Sep 08 13:24:38.782877 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2723/5316] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:24:38 2022] DELETE /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:24:38.793788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ce0430f0-a879-43cc-9135-eb74d74e43c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:38.795371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ce0430f0-a879-43cc-9135-eb74d74e43c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:38.806712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce0430f0-a879-43cc-9135-eb74d74e43c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:38.809858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce0430f0-a879-43cc-9135-eb74d74e43c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:38.810710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce0430f0-a879-43cc-9135-eb74d74e43c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:38.811877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce0430f0-a879-43cc-9135-eb74d74e43c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:38.812606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce0430f0-a879-43cc-9135-eb74d74e43c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:38.813344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ce0430f0-a879-43cc-9135-eb74d74e43c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:39.166992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-625e48dd-080f-4adc-a127-756ede326825 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:39.169839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-625e48dd-080f-4adc-a127-756ede326825 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:39.183093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-625e48dd-080f-4adc-a127-756ede326825 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:39.184650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-625e48dd-080f-4adc-a127-756ede326825 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:39.185974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-625e48dd-080f-4adc-a127-756ede326825 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:39.187650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-625e48dd-080f-4adc-a127-756ede326825 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:39.189007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-625e48dd-080f-4adc-a127-756ede326825 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:39.189721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-625e48dd-080f-4adc-a127-756ede326825 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:39.430724 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ce0430f0-a879-43cc-9135-eb74d74e43c4 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1656 microversion: 2.1 time: 0.635057 Sep 08 13:24:39.432585 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2594/5317] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:38 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1656 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:24:39.748888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-625e48dd-080f-4adc-a127-756ede326825 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:39.760825 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-625e48dd-080f-4adc-a127-756ede326825 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1673 microversion: 2.1 time: 0.604029 Sep 08 13:24:39.762398 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2724/5318] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:39 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1673 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:40.459098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c6963708-9484-40eb-b92a-7768358ddfa5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:40.460574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c6963708-9484-40eb-b92a-7768358ddfa5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:40.480204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6963708-9484-40eb-b92a-7768358ddfa5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:40.481012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6963708-9484-40eb-b92a-7768358ddfa5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:40.481634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6963708-9484-40eb-b92a-7768358ddfa5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:40.482739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6963708-9484-40eb-b92a-7768358ddfa5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:40.483734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6963708-9484-40eb-b92a-7768358ddfa5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:40.484350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6963708-9484-40eb-b92a-7768358ddfa5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:40.788580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da8d46d6-fe2a-42fb-ba1a-e1f05349e60f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:40.789248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-da8d46d6-fe2a-42fb-ba1a-e1f05349e60f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:40.808591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da8d46d6-fe2a-42fb-ba1a-e1f05349e60f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:40.809707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da8d46d6-fe2a-42fb-ba1a-e1f05349e60f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:40.810261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da8d46d6-fe2a-42fb-ba1a-e1f05349e60f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:40.824834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da8d46d6-fe2a-42fb-ba1a-e1f05349e60f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:40.825700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da8d46d6-fe2a-42fb-ba1a-e1f05349e60f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:40.826449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da8d46d6-fe2a-42fb-ba1a-e1f05349e60f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:41.723309 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c6963708-9484-40eb-b92a-7768358ddfa5 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1656 microversion: 2.1 time: 1.269240 Sep 08 13:24:41.723938 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2595/5319] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:40 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1656 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:24:42.634004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-da8d46d6-fe2a-42fb-ba1a-e1f05349e60f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:42.674464 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-da8d46d6-fe2a-42fb-ba1a-e1f05349e60f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1673 microversion: 2.1 time: 1.891940 Sep 08 13:24:42.676477 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2725/5320] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:40 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1673 bytes in 1895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:42.762595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e10dcf22-b068-44c3-a8bd-545da84e2b1b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:42.772153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e10dcf22-b068-44c3-a8bd-545da84e2b1b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:42.794073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e10dcf22-b068-44c3-a8bd-545da84e2b1b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:42.807353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e10dcf22-b068-44c3-a8bd-545da84e2b1b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:42.810964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e10dcf22-b068-44c3-a8bd-545da84e2b1b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:42.812555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e10dcf22-b068-44c3-a8bd-545da84e2b1b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:42.813980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e10dcf22-b068-44c3-a8bd-545da84e2b1b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:42.826530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e10dcf22-b068-44c3-a8bd-545da84e2b1b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:43.705567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1654130c-4f0f-4e5a-aa3f-4c55803408aa tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:43.706568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1654130c-4f0f-4e5a-aa3f-4c55803408aa tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:43.722680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1654130c-4f0f-4e5a-aa3f-4c55803408aa tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:43.730252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1654130c-4f0f-4e5a-aa3f-4c55803408aa tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:43.731372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1654130c-4f0f-4e5a-aa3f-4c55803408aa tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:43.732150 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e10dcf22-b068-44c3-a8bd-545da84e2b1b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1656 microversion: 2.1 time: 0.974726 Sep 08 13:24:43.738433 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2596/5321] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:42 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1656 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:43.764776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1654130c-4f0f-4e5a-aa3f-4c55803408aa tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:43.770336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1654130c-4f0f-4e5a-aa3f-4c55803408aa tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:43.771936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1654130c-4f0f-4e5a-aa3f-4c55803408aa tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:44.237791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1654130c-4f0f-4e5a-aa3f-4c55803408aa tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:44.273507 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1654130c-4f0f-4e5a-aa3f-4c55803408aa tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1605 microversion: 2.1 time: 0.572519 Sep 08 13:24:44.275573 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2726/5322] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:43 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1605 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:44.517745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2b8eeabe-1ec2-49ef-a04f-a0da4ce7a7cc req-c605f25d-84dd-4a6b-a287-365ae63d1ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d24c2145-3970-41c4-8c43-9061d3e4bd35", "name": "network-vif-deleted", "tag": "faf684ad-d855-46ed-a650-10f60bfda544"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:24:44.588250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2b8eeabe-1ec2-49ef-a04f-a0da4ce7a7cc req-c605f25d-84dd-4a6b-a287-365ae63d1ed9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:44.589291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2b8eeabe-1ec2-49ef-a04f-a0da4ce7a7cc req-c605f25d-84dd-4a6b-a287-365ae63d1ed9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:44.590355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2b8eeabe-1ec2-49ef-a04f-a0da4ce7a7cc req-c605f25d-84dd-4a6b-a287-365ae63d1ed9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:44.654841 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2b8eeabe-1ec2-49ef-a04f-a0da4ce7a7cc req-c605f25d-84dd-4a6b-a287-365ae63d1ed9 service nova] Creating event network-vif-deleted:faf684ad-d855-46ed-a650-10f60bfda544 for instance d24c2145-3970-41c4-8c43-9061d3e4bd35 on n-h2-852084-10 Sep 08 13:24:44.699568 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2b8eeabe-1ec2-49ef-a04f-a0da4ce7a7cc req-c605f25d-84dd-4a6b-a287-365ae63d1ed9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.200544 Sep 08 13:24:44.705921 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2597/5323] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:24:44.775292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:44.778291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:44.848010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:44.852489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:44.856516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:44.861514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:44.872955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:44.874473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:45.028543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:45.029444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:45.030215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:45.034649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lazy-loading 'fault' on Instance uuid d24c2145-3970-41c4-8c43-9061d3e4bd35 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:24:45.322947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-317a6c6a-687a-4057-b557-8761216aa9e8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:45.323895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-317a6c6a-687a-4057-b557-8761216aa9e8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:45.351761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-317a6c6a-687a-4057-b557-8761216aa9e8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:45.356238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-317a6c6a-687a-4057-b557-8761216aa9e8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:45.357650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-317a6c6a-687a-4057-b557-8761216aa9e8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:45.365316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-317a6c6a-687a-4057-b557-8761216aa9e8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:45.366973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-317a6c6a-687a-4057-b557-8761216aa9e8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:45.368269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-317a6c6a-687a-4057-b557-8761216aa9e8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:45.641673 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9631ed86-abf9-4fbc-8d3e-0a1e99829b57 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 200 len: 1456 microversion: 2.1 time: 0.864179 Sep 08 13:24:45.646945 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2727/5324] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:44 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 1456 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:45.884439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-317a6c6a-687a-4057-b557-8761216aa9e8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:45.919712 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-317a6c6a-687a-4057-b557-8761216aa9e8 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1605 microversion: 2.1 time: 0.601682 Sep 08 13:24:45.920338 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2598/5325] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:45 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1605 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:46.673281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3988962-3d81-4ae6-854b-4610b58c7897 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:46.686583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e3988962-3d81-4ae6-854b-4610b58c7897 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: d24c2145-3970-41c4-8c43-9061d3e4bd35] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:46.739552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3988962-3d81-4ae6-854b-4610b58c7897 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:46.748076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3988962-3d81-4ae6-854b-4610b58c7897 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:46.749415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3988962-3d81-4ae6-854b-4610b58c7897 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:46.751388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3988962-3d81-4ae6-854b-4610b58c7897 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:46.754279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3988962-3d81-4ae6-854b-4610b58c7897 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:46.760429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e3988962-3d81-4ae6-854b-4610b58c7897 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:46.804439 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e3988962-3d81-4ae6-854b-4610b58c7897 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] HTTP exception thrown: Instance d24c2145-3970-41c4-8c43-9061d3e4bd35 could not be found. Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3988962-3d81-4ae6-854b-4610b58c7897 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Request method failure captured: Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 HTTP/1.1 Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGezSKTX48xV4PQVV67D13ZNnaFW9hn6RTwD3mN-f5Ch5GcjbwBY9mqxq2FYmTgpG3CNycyILJ0F8n-cjIZJruQNolsZD2KKCdDBK-Ej_AYVAb3R3TkKLHcJpYuwnJZh70F2SOQSlnN8BmpmWR88GFOdbMM7vbTz6L0NF4VwIHQart-Q Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a8689932c83541b59d0ce26909d9d959 Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestServerMultinode-45714082 Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a8689932c83541b59d0ce26909d9d959"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a8689932c83541b59d0ce26909d9d959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a8689932c83541b59d0ce26909d9d959"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a8689932c83541b59d0ce26909d9d959"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestServerMultinode-45714082 Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a8689932c83541b59d0ce26909d9d959 Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestServerMultinode-45714082 Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestServerMultinode-45714082-project-admin Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 3b7d980f46db446ca11f6cc1e76fbff6 Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestServerMultinode-45714082-project-admin Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance d24c2145-3970-41c4-8c43-9061d3e4bd35 could not be found. Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'd24c2145-3970-41c4-8c43-9061d3e4bd35'} Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d24c2145-3970-41c4-8c43-9061d3e4bd35 could not be found. Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d24c2145-3970-41c4-8c43-9061d3e4bd35 could not be found. Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:24:46.815698 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:46.829106 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:46.829106 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:24:46.829106 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:24:46.829106 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:24:46.829106 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:24:46.829106 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d24c2145-3970-41c4-8c43-9061d3e4bd35 could not be found. Sep 08 13:24:46.829106 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:46.829106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e3988962-3d81-4ae6-854b-4610b58c7897 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Returning 404 to user: Instance d24c2145-3970-41c4-8c43-9061d3e4bd35 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:24:46.829106 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e3988962-3d81-4ae6-854b-4610b58c7897 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35" status: 404 len: 111 microversion: 2.1 time: 0.152250 Sep 08 13:24:46.829106 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2728/5326] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:46 2022] GET /compute/v2.1/servers/d24c2145-3970-41c4-8c43-9061d3e4bd35 => generated 111 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:24:46.835891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01e947ce-2a7a-4726-9905-16d7737c38cc tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:46.836732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-01e947ce-2a7a-4726-9905-16d7737c38cc tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:46.850663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01e947ce-2a7a-4726-9905-16d7737c38cc tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:46.851328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01e947ce-2a7a-4726-9905-16d7737c38cc tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:46.851855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01e947ce-2a7a-4726-9905-16d7737c38cc tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:46.852690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01e947ce-2a7a-4726-9905-16d7737c38cc tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:46.853250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01e947ce-2a7a-4726-9905-16d7737c38cc tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:46.853756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01e947ce-2a7a-4726-9905-16d7737c38cc tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:46.872088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-4b906f91-8b96-4eaf-a94f-f7e089bb16e5 req-7b707601-bde6-4ee4-8945-3cf6f1082f22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3abfe3b5-55c0-40e6-906f-a7770dd8e5c7", "name": "network-vif-deleted", "tag": "4f346bb7-ca7c-4060-b2f8-4bc559534eae"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:24:46.893497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-01e947ce-2a7a-4726-9905-16d7737c38cc tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:24:46.931793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4b906f91-8b96-4eaf-a94f-f7e089bb16e5 req-7b707601-bde6-4ee4-8945-3cf6f1082f22 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:46.932709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4b906f91-8b96-4eaf-a94f-f7e089bb16e5 req-7b707601-bde6-4ee4-8945-3cf6f1082f22 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:46.933531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4b906f91-8b96-4eaf-a94f-f7e089bb16e5 req-7b707601-bde6-4ee4-8945-3cf6f1082f22 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:47.006790 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-4b906f91-8b96-4eaf-a94f-f7e089bb16e5 req-7b707601-bde6-4ee4-8945-3cf6f1082f22 service nova] Creating event network-vif-deleted:4f346bb7-ca7c-4060-b2f8-4bc559534eae for instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 on n-h2-852084-10 Sep 08 13:24:47.030650 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-4b906f91-8b96-4eaf-a94f-f7e089bb16e5 req-7b707601-bde6-4ee4-8945-3cf6f1082f22 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167106 Sep 08 13:24:47.034444 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2729/5327] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:24:47.048663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:47.049473 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-01e947ce-2a7a-4726-9905-16d7737c38cc tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "DELETE /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 204 len: 0 microversion: 2.1 time: 0.223784 Sep 08 13:24:47.050178 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2599/5328] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:24:46 2022] DELETE /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:24:47.050777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:47.063990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:47.064520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:47.064984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:47.065820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:47.066831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:47.067636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:47.067959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92419a88-125b-49bf-877a-652600355564 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:47.070317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-92419a88-125b-49bf-877a-652600355564 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:47.108059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92419a88-125b-49bf-877a-652600355564 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:47.108949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92419a88-125b-49bf-877a-652600355564 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:47.112366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92419a88-125b-49bf-877a-652600355564 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:47.115676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92419a88-125b-49bf-877a-652600355564 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:47.118786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92419a88-125b-49bf-877a-652600355564 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:47.120328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92419a88-125b-49bf-877a-652600355564 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:47.122548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:47.123524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:47.124426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:47.125231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lazy-loading 'fault' on Instance uuid 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:24:47.134340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:24:47.234604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '334fc689cca7450f82f3603de32a5a19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ba356cf57224bcdb710a75c346f386d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:24:47.255565 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d47d2888-9d9b-4bfb-a881-f0c1f4c4b793 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 200 len: 1327 microversion: 2.1 time: 0.217529 Sep 08 13:24:47.280145 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2730/5329] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:47 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 1327 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:47.731529 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92419a88-125b-49bf-877a-652600355564 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1654 microversion: 2.1 time: 0.673586 Sep 08 13:24:47.732745 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2600/5330] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:47 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1654 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:48.314385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-621d7c36-7dc1-425c-87d3-f1da337809be tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:48.316092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-621d7c36-7dc1-425c-87d3-f1da337809be tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:48.366266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-621d7c36-7dc1-425c-87d3-f1da337809be tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:48.369834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-621d7c36-7dc1-425c-87d3-f1da337809be tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:48.371969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-621d7c36-7dc1-425c-87d3-f1da337809be tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:48.379173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-621d7c36-7dc1-425c-87d3-f1da337809be tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:48.381102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-621d7c36-7dc1-425c-87d3-f1da337809be tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:48.381903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-621d7c36-7dc1-425c-87d3-f1da337809be tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:48.477942 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-621d7c36-7dc1-425c-87d3-f1da337809be tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] HTTP exception thrown: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-621d7c36-7dc1-425c-87d3-f1da337809be tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Request method failure captured: Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 HTTP/1.1 Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGetgmztsiusn_P8f3XaXHyjRUrqNydbOYz3uBNxdYE_MYgT23N-5-QPgjltkJy0nGSbeedHTWwNUUit3mmNK4PQgt-YdZ5ktEtKb3y-56wwljeK9nY-ijij0bGAJwJDpEcVL-b_QZNGywutXZieMY8gzaKzqHIYv0HnZg56HrosdV_w Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 8ba356cf57224bcdb710a75c346f386d Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 8ba356cf57224bcdb710a75c346f386d Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachVolumeTestJSON-363111724-project Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 334fc689cca7450f82f3603de32a5a19 Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachVolumeTestJSON-363111724-project Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '3abfe3b5-55c0-40e6-906f-a7770dd8e5c7'} Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:24:48.492004 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:48.502969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:48.502969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:24:48.502969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:24:48.502969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:24:48.502969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:24:48.502969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:24:48.502969 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:48.514844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-621d7c36-7dc1-425c-87d3-f1da337809be tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Returning 404 to user: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:24:48.516150 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-621d7c36-7dc1-425c-87d3-f1da337809be tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 404 len: 111 microversion: 2.1 time: 0.219122 Sep 08 13:24:48.517815 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2731/5331] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:48 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 111 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:24:48.529767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7a915d0d-037f-4534-b574-eff9272ed50f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '.version_select at 0x7fdb3adbce50>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:48.585107 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7a915d0d-037f-4534-b574-eff9272ed50f tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2092730327" status: 202 len: 0 microversion: 2.1 time: 0.060810 Sep 08 13:24:48.586043 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2601/5332] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Sep 8 13:24:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2092730327 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:24:48.771851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ff74269-c338-4895-9182-a4523286bc77 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:48.772487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1ff74269-c338-4895-9182-a4523286bc77 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:48.782253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ff74269-c338-4895-9182-a4523286bc77 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:48.783508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ff74269-c338-4895-9182-a4523286bc77 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:48.784383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ff74269-c338-4895-9182-a4523286bc77 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:48.787937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ff74269-c338-4895-9182-a4523286bc77 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:48.789119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ff74269-c338-4895-9182-a4523286bc77 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:48.789986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ff74269-c338-4895-9182-a4523286bc77 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:49.295845 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1ff74269-c338-4895-9182-a4523286bc77 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1654 microversion: 2.1 time: 0.525089 Sep 08 13:24:49.300439 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2732/5333] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:48 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1654 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:24:50.375375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2e8fa7e9-3624-49a3-b781-c0036338365b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:50.376179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2e8fa7e9-3624-49a3-b781-c0036338365b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:50.395140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e8fa7e9-3624-49a3-b781-c0036338365b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:50.399421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e8fa7e9-3624-49a3-b781-c0036338365b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:50.400925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e8fa7e9-3624-49a3-b781-c0036338365b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:50.403991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e8fa7e9-3624-49a3-b781-c0036338365b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:50.407504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e8fa7e9-3624-49a3-b781-c0036338365b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:50.408416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e8fa7e9-3624-49a3-b781-c0036338365b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:51.445215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-dae2f64c-df53-45c6-a18d-c0780a35476d req-e3ba1f53-5694-41c0-964a-41ab5495b2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "349f4f33-226a-4bc7-a45f-91a7c5316ecb", "name": "network-vif-deleted", "tag": "ac739bdf-3e78-4273-8710-21e1be72b831"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:24:51.468421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dae2f64c-df53-45c6-a18d-c0780a35476d req-e3ba1f53-5694-41c0-964a-41ab5495b2d5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:51.468952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dae2f64c-df53-45c6-a18d-c0780a35476d req-e3ba1f53-5694-41c0-964a-41ab5495b2d5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:51.469524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dae2f64c-df53-45c6-a18d-c0780a35476d req-e3ba1f53-5694-41c0-964a-41ab5495b2d5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:51.509262 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-dae2f64c-df53-45c6-a18d-c0780a35476d req-e3ba1f53-5694-41c0-964a-41ab5495b2d5 service nova] Creating event network-vif-deleted:ac739bdf-3e78-4273-8710-21e1be72b831 for instance 349f4f33-226a-4bc7-a45f-91a7c5316ecb on n-h1-852084-10 Sep 08 13:24:51.525345 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-dae2f64c-df53-45c6-a18d-c0780a35476d req-e3ba1f53-5694-41c0-964a-41ab5495b2d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084493 Sep 08 13:24:51.526754 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2733/5334] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:24:52.192208 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2e8fa7e9-3624-49a3-b781-c0036338365b tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 200 len: 1654 microversion: 2.1 time: 1.843801 Sep 08 13:24:52.218087 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2602/5335] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:50 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 1654 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:24:53.228605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-766d873d-1540-4c73-af2a-59a8c9ea6030 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:24:53.229971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-766d873d-1540-4c73-af2a-59a8c9ea6030 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] [instance: 349f4f33-226a-4bc7-a45f-91a7c5316ecb] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:24:53.265929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-766d873d-1540-4c73-af2a-59a8c9ea6030 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:53.274006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-766d873d-1540-4c73-af2a-59a8c9ea6030 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:53.275438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-766d873d-1540-4c73-af2a-59a8c9ea6030 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:53.277107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-766d873d-1540-4c73-af2a-59a8c9ea6030 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:24:53.278280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-766d873d-1540-4c73-af2a-59a8c9ea6030 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:24:53.279456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-766d873d-1540-4c73-af2a-59a8c9ea6030 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:24:53.322336 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-766d873d-1540-4c73-af2a-59a8c9ea6030 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] HTTP exception thrown: Instance 349f4f33-226a-4bc7-a45f-91a7c5316ecb could not be found. Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-766d873d-1540-4c73-af2a-59a8c9ea6030 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Request method failure captured: Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb HTTP/1.1 Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGezSKTX48xV4PQVV67D13ZNnaFW9hn6RTwD3mN-f5Ch5GcjbwBY9mqxq2FYmTgpG3CNycyILJ0F8n-cjIZJruQNolsZD2KKCdDBK-Ej_AYVAb3R3TkKLHcJpYuwnJZh70F2SOQSlnN8BmpmWR88GFOdbMM7vbTz6L0NF4VwIHQart-Q Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a8689932c83541b59d0ce26909d9d959 Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestServerMultinode-45714082 Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a8689932c83541b59d0ce26909d9d959"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a8689932c83541b59d0ce26909d9d959"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a8689932c83541b59d0ce26909d9d959"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a8689932c83541b59d0ce26909d9d959"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestServerMultinode-45714082 Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a8689932c83541b59d0ce26909d9d959 Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestServerMultinode-45714082 Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestServerMultinode-45714082-project-admin Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 3b7d980f46db446ca11f6cc1e76fbff6 Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestServerMultinode-45714082-project-admin Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 349f4f33-226a-4bc7-a45f-91a7c5316ecb could not be found. Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '349f4f33-226a-4bc7-a45f-91a7c5316ecb'} Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 349f4f33-226a-4bc7-a45f-91a7c5316ecb could not be found. Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 349f4f33-226a-4bc7-a45f-91a7c5316ecb could not be found. Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:24:53.326950 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:53.332910 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:24:53.332910 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:24:53.332910 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:24:53.332910 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:24:53.332910 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:24:53.332910 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 349f4f33-226a-4bc7-a45f-91a7c5316ecb could not be found. Sep 08 13:24:53.332910 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:24:53.332910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-766d873d-1540-4c73-af2a-59a8c9ea6030 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] Returning 404 to user: Instance 349f4f33-226a-4bc7-a45f-91a7c5316ecb could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:24:53.332910 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-766d873d-1540-4c73-af2a-59a8c9ea6030 tempest-TestServerMultinode-45714082 tempest-TestServerMultinode-45714082-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb" status: 404 len: 111 microversion: 2.1 time: 0.106574 Sep 08 13:24:53.347941 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2734/5336] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:24:53 2022] GET /compute/v2.1/servers/349f4f33-226a-4bc7-a45f-91a7c5316ecb => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:25:12.911803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7aef3119-689a-4aff-8690-76a4f69988d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:25:12.912692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7aef3119-689a-4aff-8690-76a4f69988d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:25:12.917473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:12.941272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=11 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:12.960463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aef3119-689a-4aff-8690-76a4f69988d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:12.961318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aef3119-689a-4aff-8690-76a4f69988d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:12.961942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aef3119-689a-4aff-8690-76a4f69988d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:12.962811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aef3119-689a-4aff-8690-76a4f69988d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:12.963332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aef3119-689a-4aff-8690-76a4f69988d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:12.964411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aef3119-689a-4aff-8690-76a4f69988d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:13.008895 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-7aef3119-689a-4aff-8690-76a4f69988d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] HTTP exception thrown: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7aef3119-689a-4aff-8690-76a4f69988d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Request method failure captured: Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 HTTP/1.1 Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGetgmztsiusn_P8f3XaXHyjRUrqNydbOYz3uBNxdYE_MYgT23N-5-QPgjltkJy0nGSbeedHTWwNUUit3mmNK4PQgt-YdZ5ktEtKb3y-56wwljeK9nY-ijij0bGAJwJDpEcVL-b_QZNGywutXZieMY8gzaKzqHIYv0HnZg56HrosdV_w Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 8ba356cf57224bcdb710a75c346f386d Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 8ba356cf57224bcdb710a75c346f386d Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeTestJSON-363111724-project Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 334fc689cca7450f82f3603de32a5a19 Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeTestJSON-363111724-project Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '3abfe3b5-55c0-40e6-906f-a7770dd8e5c7'} Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:25:13.020051 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7aef3119-689a-4aff-8690-76a4f69988d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Returning 404 to user: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7aef3119-689a-4aff-8690-76a4f69988d0 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 404 len: 111 microversion: 2.1 time: 0.120094 Sep 08 13:25:13.029599 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2603/5337] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:25:12 2022] DELETE /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:25:13.044671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4db3040d-4a0c-4f10-afb3-8ffcd28a6f97 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:25:13.055683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4db3040d-4a0c-4f10-afb3-8ffcd28a6f97 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:25:13.090515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:13.093451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:13.106082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4db3040d-4a0c-4f10-afb3-8ffcd28a6f97 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:13.119440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4db3040d-4a0c-4f10-afb3-8ffcd28a6f97 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:13.133539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4db3040d-4a0c-4f10-afb3-8ffcd28a6f97 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:13.135194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4db3040d-4a0c-4f10-afb3-8ffcd28a6f97 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:13.145426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4db3040d-4a0c-4f10-afb3-8ffcd28a6f97 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:13.147045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4db3040d-4a0c-4f10-afb3-8ffcd28a6f97 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:13.258472 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-4db3040d-4a0c-4f10-afb3-8ffcd28a6f97 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] HTTP exception thrown: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4db3040d-4a0c-4f10-afb3-8ffcd28a6f97 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Request method failure captured: Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 HTTP/1.1 Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGetgmztsiusn_P8f3XaXHyjRUrqNydbOYz3uBNxdYE_MYgT23N-5-QPgjltkJy0nGSbeedHTWwNUUit3mmNK4PQgt-YdZ5ktEtKb3y-56wwljeK9nY-ijij0bGAJwJDpEcVL-b_QZNGywutXZieMY8gzaKzqHIYv0HnZg56HrosdV_w Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 8ba356cf57224bcdb710a75c346f386d Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 8ba356cf57224bcdb710a75c346f386d Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachVolumeTestJSON-363111724-project Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 334fc689cca7450f82f3603de32a5a19 Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachVolumeTestJSON-363111724-project Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '3abfe3b5-55c0-40e6-906f-a7770dd8e5c7'} Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:25:13.282731 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:25:13.299721 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:25:13.299721 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:25:13.299721 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:25:13.299721 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:25:13.299721 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:25:13.299721 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. Sep 08 13:25:13.299721 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:25:13.299721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4db3040d-4a0c-4f10-afb3-8ffcd28a6f97 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Returning 404 to user: Instance 3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:25:13.299721 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4db3040d-4a0c-4f10-afb3-8ffcd28a6f97 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7" status: 404 len: 111 microversion: 2.1 time: 0.262445 Sep 08 13:25:13.299721 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2735/5338] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:25:13 2022] GET /compute/v2.1/servers/3abfe3b5-55c0-40e6-906f-a7770dd8e5c7 => generated 111 bytes in 265 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:25:23.440182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54edd9c2-2c02-4cf0-a629-f58e6533d618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:25:23.442880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54edd9c2-2c02-4cf0-a629-f58e6533d618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:25:23.457827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:23.465209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:23.467056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54edd9c2-2c02-4cf0-a629-f58e6533d618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:23.467985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54edd9c2-2c02-4cf0-a629-f58e6533d618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:23.468587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54edd9c2-2c02-4cf0-a629-f58e6533d618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:23.472273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54edd9c2-2c02-4cf0-a629-f58e6533d618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:23.474642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54edd9c2-2c02-4cf0-a629-f58e6533d618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:23.476262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54edd9c2-2c02-4cf0-a629-f58e6533d618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:23.601446 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-54edd9c2-2c02-4cf0-a629-f58e6533d618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] HTTP exception thrown: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54edd9c2-2c02-4cf0-a629-f58e6533d618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Request method failure captured: Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac HTTP/1.1 Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGetgmztsiusn_P8f3XaXHyjRUrqNydbOYz3uBNxdYE_MYgT23N-5-QPgjltkJy0nGSbeedHTWwNUUit3mmNK4PQgt-YdZ5ktEtKb3y-56wwljeK9nY-ijij0bGAJwJDpEcVL-b_QZNGywutXZieMY8gzaKzqHIYv0HnZg56HrosdV_w Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 8ba356cf57224bcdb710a75c346f386d Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 8ba356cf57224bcdb710a75c346f386d Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeTestJSON-363111724-project Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 334fc689cca7450f82f3603de32a5a19 Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeTestJSON-363111724-project Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '96514589-9deb-48df-95d3-5b3c56d620ac'} Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:25:23.615439 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:25:23.634357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:25:23.634357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:25:23.634357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:25:23.634357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:25:23.634357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:25:23.634357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:25:23.634357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:25:23.634357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:25:23.634357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:25:23.634357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:25:23.634357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:25:23.640180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54edd9c2-2c02-4cf0-a629-f58e6533d618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Returning 404 to user: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:25:23.645322 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54edd9c2-2c02-4cf0-a629-f58e6533d618 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "DELETE /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 404 len: 111 microversion: 2.1 time: 0.214009 Sep 08 13:25:23.660062 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2604/5339] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:25:23 2022] DELETE /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 111 bytes in 230 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:25:23.665400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-163ac629-ba6d-4323-b81d-09bf3c72be73 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:25:23.666322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-163ac629-ba6d-4323-b81d-09bf3c72be73 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] [instance: 96514589-9deb-48df-95d3-5b3c56d620ac] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:25:23.696529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:23.710818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-163ac629-ba6d-4323-b81d-09bf3c72be73 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:23.716893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-163ac629-ba6d-4323-b81d-09bf3c72be73 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:23.717715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-163ac629-ba6d-4323-b81d-09bf3c72be73 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:23.719113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-163ac629-ba6d-4323-b81d-09bf3c72be73 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:23.748856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-163ac629-ba6d-4323-b81d-09bf3c72be73 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:23.749579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-163ac629-ba6d-4323-b81d-09bf3c72be73 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:23.861093 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-163ac629-ba6d-4323-b81d-09bf3c72be73 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] HTTP exception thrown: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-163ac629-ba6d-4323-b81d-09bf3c72be73 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Request method failure captured: Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac HTTP/1.1 Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGetgmztsiusn_P8f3XaXHyjRUrqNydbOYz3uBNxdYE_MYgT23N-5-QPgjltkJy0nGSbeedHTWwNUUit3mmNK4PQgt-YdZ5ktEtKb3y-56wwljeK9nY-ijij0bGAJwJDpEcVL-b_QZNGywutXZieMY8gzaKzqHIYv0HnZg56HrosdV_w Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 8ba356cf57224bcdb710a75c346f386d Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8ba356cf57224bcdb710a75c346f386d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 8ba356cf57224bcdb710a75c346f386d Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachVolumeTestJSON-363111724 Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachVolumeTestJSON-363111724-project Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 334fc689cca7450f82f3603de32a5a19 Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachVolumeTestJSON-363111724-project Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '96514589-9deb-48df-95d3-5b3c56d620ac'} Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:25:23.868602 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:25:23.877470 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:25:23.877470 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:25:23.877470 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:25:23.877470 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:25:23.877470 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:25:23.877470 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. Sep 08 13:25:23.877470 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:25:23.877470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-163ac629-ba6d-4323-b81d-09bf3c72be73 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] Returning 404 to user: Instance 96514589-9deb-48df-95d3-5b3c56d620ac could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:25:23.877470 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-163ac629-ba6d-4323-b81d-09bf3c72be73 tempest-AttachVolumeTestJSON-363111724 tempest-AttachVolumeTestJSON-363111724-project] 10.222.0.78 "GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac" status: 404 len: 111 microversion: 2.1 time: 0.214839 Sep 08 13:25:23.887757 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2736/5340] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:25:23 2022] GET /compute/v2.1/servers/96514589-9deb-48df-95d3-5b3c56d620ac => generated 111 bytes in 232 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:25:33.583773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-792dc873-80a1-413b-9a99-2b1758fbab3b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Action: 'create', calling method: .version_select at 0x7fdb3b08daf0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-410970946", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAULu9w5cZXFQLYjhay6P2Ls3GT98QmzSeEnNA9rLWJAPmp1F8sanenXBY0pKC20L3U/7o0EOe/gV0/rDb702fUOGNAifgD+nXyVtX7LqCQXAcHhQISmsa6XBmESCN8Ozg=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:25:33.628782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:33.632933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:33.670764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-792dc873-80a1-413b-9a99-2b1758fbab3b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Getting quotas for project 8de9ce7e5cda42afa55b08b9158cb72f. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:25:33.711708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-792dc873-80a1-413b-9a99-2b1758fbab3b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Getting quotas for user e8b4c622b66243558ea7c2395101382b and project 8de9ce7e5cda42afa55b08b9158cb72f. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:25:33.904886 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-792dc873-80a1-413b-9a99-2b1758fbab3b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.328649 Sep 08 13:25:33.919657 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2605/5341] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:25:33 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:25:38.729868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1786941568", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "771aeae2-d093-4c1b-bb72-c22a20aae63c"}], "key_name": "tempest-TestNetworkBasicOps-410970946", "security_groups": [{"name": "tempest-secgroup-smoke-1284802587"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:25:38.844804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:38.870428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:39.920476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] validate_networks() for [('771aeae2-d093-4c1b-bb72-c22a20aae63c', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:25:42.993523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:25:42.994812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:25:42.996629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:25:42.997397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:25:42.998158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:25:43.070121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:43.072283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:43.073156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:43.076929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:43.077571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:43.081259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:43.273050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Getting quotas for project 8de9ce7e5cda42afa55b08b9158cb72f. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:25:43.286504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Getting quotas for user e8b4c622b66243558ea7c2395101382b and project 8de9ce7e5cda42afa55b08b9158cb72f. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:25:43.333519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:25:43.344163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:25:43.488719 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-416a5ae5-0c82-4a81-8469-2daf8b4e74c1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 4.779581 Sep 08 13:25:43.489586 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2737/5342] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:25:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 4782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:25:43.528709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eff99ae9-65b6-4cd0-b1ba-a29065ce60f1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:25:43.529542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eff99ae9-65b6-4cd0-b1ba-a29065ce60f1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:25:43.774359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:44.447582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eff99ae9-65b6-4cd0-b1ba-a29065ce60f1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:25:44.478165 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eff99ae9-65b6-4cd0-b1ba-a29065ce60f1 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1248 microversion: 2.1 time: 0.974179 Sep 08 13:25:44.479776 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2606/5343] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:25:43 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1248 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:25:46.080488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c2e6ff1e-5341-4a5a-8403-a841c126d7af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:25:46.083935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c2e6ff1e-5341-4a5a-8403-a841c126d7af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:25:46.139470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2e6ff1e-5341-4a5a-8403-a841c126d7af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:46.140913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2e6ff1e-5341-4a5a-8403-a841c126d7af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:46.141779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2e6ff1e-5341-4a5a-8403-a841c126d7af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:46.175083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2e6ff1e-5341-4a5a-8403-a841c126d7af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:46.176316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2e6ff1e-5341-4a5a-8403-a841c126d7af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:46.177195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2e6ff1e-5341-4a5a-8403-a841c126d7af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:47.335132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c2e6ff1e-5341-4a5a-8403-a841c126d7af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:25:47.367857 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c2e6ff1e-5341-4a5a-8403-a841c126d7af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1252 microversion: 2.1 time: 1.840557 Sep 08 13:25:47.375072 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2738/5344] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:25:45 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1252 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:25:48.409655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-99ec7ae0-8759-404f-a110-9f7fd9e9333f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:25:48.412104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-99ec7ae0-8759-404f-a110-9f7fd9e9333f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:25:48.422373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99ec7ae0-8759-404f-a110-9f7fd9e9333f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:48.423616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99ec7ae0-8759-404f-a110-9f7fd9e9333f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:48.424625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99ec7ae0-8759-404f-a110-9f7fd9e9333f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:48.425762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99ec7ae0-8759-404f-a110-9f7fd9e9333f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:48.426550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99ec7ae0-8759-404f-a110-9f7fd9e9333f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:48.427310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99ec7ae0-8759-404f-a110-9f7fd9e9333f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:48.747966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-99ec7ae0-8759-404f-a110-9f7fd9e9333f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:25:48.786680 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-99ec7ae0-8759-404f-a110-9f7fd9e9333f tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1306 microversion: 2.1 time: 0.382634 Sep 08 13:25:48.797000 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2607/5345] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:25:48 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1306 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:25:49.829564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0eaeb2ee-5902-451a-88f7-5bb574345727 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:25:49.831169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0eaeb2ee-5902-451a-88f7-5bb574345727 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:25:49.856925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0eaeb2ee-5902-451a-88f7-5bb574345727 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:49.865523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0eaeb2ee-5902-451a-88f7-5bb574345727 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:49.866425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0eaeb2ee-5902-451a-88f7-5bb574345727 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:49.868696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0eaeb2ee-5902-451a-88f7-5bb574345727 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:49.871600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0eaeb2ee-5902-451a-88f7-5bb574345727 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:49.874929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0eaeb2ee-5902-451a-88f7-5bb574345727 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:50.134371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0eaeb2ee-5902-451a-88f7-5bb574345727 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:25:50.163355 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0eaeb2ee-5902-451a-88f7-5bb574345727 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1306 microversion: 2.1 time: 0.339012 Sep 08 13:25:50.227684 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2739/5346] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:25:49 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1306 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:25:51.247864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-acf36c52-6f77-4f1e-bc3a-47ba7b1961af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:25:51.252690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-acf36c52-6f77-4f1e-bc3a-47ba7b1961af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:25:51.287658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acf36c52-6f77-4f1e-bc3a-47ba7b1961af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:51.288822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acf36c52-6f77-4f1e-bc3a-47ba7b1961af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:51.291510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acf36c52-6f77-4f1e-bc3a-47ba7b1961af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:51.294487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acf36c52-6f77-4f1e-bc3a-47ba7b1961af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:51.298727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acf36c52-6f77-4f1e-bc3a-47ba7b1961af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:51.301475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-acf36c52-6f77-4f1e-bc3a-47ba7b1961af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:51.511706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-acf36c52-6f77-4f1e-bc3a-47ba7b1961af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:25:51.519078 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-acf36c52-6f77-4f1e-bc3a-47ba7b1961af tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1306 microversion: 2.1 time: 0.283594 Sep 08 13:25:51.524199 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2608/5347] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:25:51 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1306 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:25:52.591365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-17a0c634-c125-42b2-aebc-c0c9bed80a03 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:25:52.599192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-17a0c634-c125-42b2-aebc-c0c9bed80a03 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:25:52.614827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17a0c634-c125-42b2-aebc-c0c9bed80a03 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:52.617506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17a0c634-c125-42b2-aebc-c0c9bed80a03 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:52.618813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17a0c634-c125-42b2-aebc-c0c9bed80a03 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:52.620544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17a0c634-c125-42b2-aebc-c0c9bed80a03 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:52.621869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17a0c634-c125-42b2-aebc-c0c9bed80a03 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:52.623064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17a0c634-c125-42b2-aebc-c0c9bed80a03 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:53.143930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:53.310971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:53.740334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-17a0c634-c125-42b2-aebc-c0c9bed80a03 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:25:53.762525 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-17a0c634-c125-42b2-aebc-c0c9bed80a03 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1374 microversion: 2.1 time: 1.191189 Sep 08 13:25:53.765039 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2740/5348] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:25:52 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1374 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:25:54.803717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7f350f1f-b9af-4408-9f6b-a4ab88c81a3d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:25:54.805452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f350f1f-b9af-4408-9f6b-a4ab88c81a3d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:25:54.857866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:25:54.862703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f350f1f-b9af-4408-9f6b-a4ab88c81a3d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:54.866852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f350f1f-b9af-4408-9f6b-a4ab88c81a3d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:54.881140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f350f1f-b9af-4408-9f6b-a4ab88c81a3d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:54.888981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f350f1f-b9af-4408-9f6b-a4ab88c81a3d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:54.897819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f350f1f-b9af-4408-9f6b-a4ab88c81a3d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:54.901555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f350f1f-b9af-4408-9f6b-a4ab88c81a3d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:55.838374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f9caa552-7bbc-48ef-a525-d2a6bfacbb02 req-64675ade-734a-43ba-ab08-97705e8f1d71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bbd4085-933c-40d1-ba4c-18b095cbd291", "tag": "6c99972e-97f9-459d-bf1a-21487eca1dd6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:25:55.910228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f9caa552-7bbc-48ef-a525-d2a6bfacbb02 req-64675ade-734a-43ba-ab08-97705e8f1d71 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:55.911159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f9caa552-7bbc-48ef-a525-d2a6bfacbb02 req-64675ade-734a-43ba-ab08-97705e8f1d71 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:55.912071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f9caa552-7bbc-48ef-a525-d2a6bfacbb02 req-64675ade-734a-43ba-ab08-97705e8f1d71 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:55.953253 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f9caa552-7bbc-48ef-a525-d2a6bfacbb02 req-64675ade-734a-43ba-ab08-97705e8f1d71 service nova] Creating event network-changed:6c99972e-97f9-459d-bf1a-21487eca1dd6 for instance 6bbd4085-933c-40d1-ba4c-18b095cbd291 on n-h1-852084-10 Sep 08 13:25:55.970455 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f9caa552-7bbc-48ef-a525-d2a6bfacbb02 req-64675ade-734a-43ba-ab08-97705e8f1d71 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144830 Sep 08 13:25:55.971866 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2741/5349] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:25:56.730454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7f350f1f-b9af-4408-9f6b-a4ab88c81a3d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:25:56.842031 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7f350f1f-b9af-4408-9f6b-a4ab88c81a3d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1374 microversion: 2.1 time: 2.044312 Sep 08 13:25:56.853404 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2609/5350] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:25:54 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1374 bytes in 2064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:25:57.892485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-151048ff-d453-45db-8a9e-ce602615c1fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:25:57.894059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-151048ff-d453-45db-8a9e-ce602615c1fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:25:57.922480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-151048ff-d453-45db-8a9e-ce602615c1fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:57.924473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-151048ff-d453-45db-8a9e-ce602615c1fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:57.925401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-151048ff-d453-45db-8a9e-ce602615c1fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:57.931336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-151048ff-d453-45db-8a9e-ce602615c1fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:25:57.932084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-151048ff-d453-45db-8a9e-ce602615c1fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:25:57.933384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-151048ff-d453-45db-8a9e-ce602615c1fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:25:59.241540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-151048ff-d453-45db-8a9e-ce602615c1fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:25:59.274491 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-151048ff-d453-45db-8a9e-ce602615c1fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1374 microversion: 2.1 time: 1.384660 Sep 08 13:25:59.276121 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2742/5351] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:25:57 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1374 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:00.320155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-51d47227-80dd-4568-a97e-bf5db3f3a306 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:00.322912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-51d47227-80dd-4568-a97e-bf5db3f3a306 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:00.326870 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:26:00.327120 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 13:26:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 (ip 10.222.0.78) !!! Sep 08 13:26:00.351861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51d47227-80dd-4568-a97e-bf5db3f3a306 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:00.360234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51d47227-80dd-4568-a97e-bf5db3f3a306 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:00.361709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51d47227-80dd-4568-a97e-bf5db3f3a306 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:00.366866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51d47227-80dd-4568-a97e-bf5db3f3a306 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:00.368450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51d47227-80dd-4568-a97e-bf5db3f3a306 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:00.381019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-51d47227-80dd-4568-a97e-bf5db3f3a306 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:01.550555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-51d47227-80dd-4568-a97e-bf5db3f3a306 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:01.569677 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-51d47227-80dd-4568-a97e-bf5db3f3a306 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1374 microversion: 2.1 time: 1.254372 Sep 08 13:26:01.583275 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2610/5352] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:00 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1374 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:02.626380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dc4937b1-2742-4ebe-9a78-cb4851a9e76d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:02.627123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dc4937b1-2742-4ebe-9a78-cb4851a9e76d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:02.647284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc4937b1-2742-4ebe-9a78-cb4851a9e76d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:02.647893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc4937b1-2742-4ebe-9a78-cb4851a9e76d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:02.648372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc4937b1-2742-4ebe-9a78-cb4851a9e76d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:02.650761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc4937b1-2742-4ebe-9a78-cb4851a9e76d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:02.650761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc4937b1-2742-4ebe-9a78-cb4851a9e76d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:02.659751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc4937b1-2742-4ebe-9a78-cb4851a9e76d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:03.566641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dc4937b1-2742-4ebe-9a78-cb4851a9e76d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:03.633956 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dc4937b1-2742-4ebe-9a78-cb4851a9e76d tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1374 microversion: 2.1 time: 1.013991 Sep 08 13:26:03.664522 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2743/5353] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:02 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1374 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:26:04.696691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-84cf7d3c-197a-4078-a3a5-bfde446b75c7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:04.700418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-84cf7d3c-197a-4078-a3a5-bfde446b75c7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:04.727870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:26:04.735368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84cf7d3c-197a-4078-a3a5-bfde446b75c7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:04.736372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84cf7d3c-197a-4078-a3a5-bfde446b75c7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:04.737476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84cf7d3c-197a-4078-a3a5-bfde446b75c7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:04.738954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84cf7d3c-197a-4078-a3a5-bfde446b75c7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:04.758590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84cf7d3c-197a-4078-a3a5-bfde446b75c7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:04.761108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84cf7d3c-197a-4078-a3a5-bfde446b75c7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:05.377166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f614ac51-df79-4ce2-86bb-b15af9f173fe req-a603b71d-72b5-407a-a4dc-1281593e2ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbd4085-933c-40d1-ba4c-18b095cbd291", "name": "network-vif-plugged", "status": "completed", "tag": "6c99972e-97f9-459d-bf1a-21487eca1dd6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:05.437103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f614ac51-df79-4ce2-86bb-b15af9f173fe req-a603b71d-72b5-407a-a4dc-1281593e2ecf service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:05.442671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f614ac51-df79-4ce2-86bb-b15af9f173fe req-a603b71d-72b5-407a-a4dc-1281593e2ecf service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:05.443626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f614ac51-df79-4ce2-86bb-b15af9f173fe req-a603b71d-72b5-407a-a4dc-1281593e2ecf service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:05.554997 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f614ac51-df79-4ce2-86bb-b15af9f173fe req-a603b71d-72b5-407a-a4dc-1281593e2ecf service nova] Creating event network-vif-plugged:6c99972e-97f9-459d-bf1a-21487eca1dd6 for instance 6bbd4085-933c-40d1-ba4c-18b095cbd291 on n-h1-852084-10 Sep 08 13:26:05.568749 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f614ac51-df79-4ce2-86bb-b15af9f173fe req-a603b71d-72b5-407a-a4dc-1281593e2ecf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198067 Sep 08 13:26:05.598987 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2744/5354] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:26:06.014466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-84cf7d3c-197a-4078-a3a5-bfde446b75c7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:06.034340 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-84cf7d3c-197a-4078-a3a5-bfde446b75c7 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1374 microversion: 2.1 time: 1.342408 Sep 08 13:26:06.038648 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2611/5355] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:04 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1374 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:07.102447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-de50b62b-b086-472e-b6a3-b8b00b6ce5fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:07.106936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-de50b62b-b086-472e-b6a3-b8b00b6ce5fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:07.164518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de50b62b-b086-472e-b6a3-b8b00b6ce5fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:07.165906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de50b62b-b086-472e-b6a3-b8b00b6ce5fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:07.167037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de50b62b-b086-472e-b6a3-b8b00b6ce5fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:07.168678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de50b62b-b086-472e-b6a3-b8b00b6ce5fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:07.169839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de50b62b-b086-472e-b6a3-b8b00b6ce5fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:07.172511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de50b62b-b086-472e-b6a3-b8b00b6ce5fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:07.974813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-309e83b9-4df1-4085-9c45-e780e6778917 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Action: 'create', calling method: .version_select at 0x7fdb3a72d280>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1423824854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGl9Z69NE8G3rY5WEoiUXSh1qVvPiWfpnujyk9JiL/9R01kP6EWDKCn0fagAPBUz7TIA3Ai0C0C4+X6YW2EgaV1yUs2/OLfB+ZCw6c/mL92Hul9re77dPmrYwCsSjDKFcw=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:08.017962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-309e83b9-4df1-4085-9c45-e780e6778917 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Getting quotas for project 4f6be7a7724948c7af647f1b55e3e950. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:26:08.031012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-309e83b9-4df1-4085-9c45-e780e6778917 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Getting quotas for user cd883ee11e1f4a4a81a1a7ff9b0c8273 and project 4f6be7a7724948c7af647f1b55e3e950. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:26:08.092715 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-309e83b9-4df1-4085-9c45-e780e6778917 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.854457 Sep 08 13:26:08.095779 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2612/5356] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:26:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:26:08.326804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-de50b62b-b086-472e-b6a3-b8b00b6ce5fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:08.366918 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-de50b62b-b086-472e-b6a3-b8b00b6ce5fe tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1374 microversion: 2.1 time: 1.292008 Sep 08 13:26:08.385441 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2745/5357] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:07 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1374 bytes in 1314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:09.409546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7beb4776-5b40-4400-9c69-126adf195f85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:09.410392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7beb4776-5b40-4400-9c69-126adf195f85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:09.431586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7beb4776-5b40-4400-9c69-126adf195f85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:09.432245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7beb4776-5b40-4400-9c69-126adf195f85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:09.438135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7beb4776-5b40-4400-9c69-126adf195f85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:09.439305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7beb4776-5b40-4400-9c69-126adf195f85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:09.439998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7beb4776-5b40-4400-9c69-126adf195f85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:09.440639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7beb4776-5b40-4400-9c69-126adf195f85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:09.999035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7beb4776-5b40-4400-9c69-126adf195f85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:10.018815 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7beb4776-5b40-4400-9c69-126adf195f85 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1547 microversion: 2.1 time: 0.616538 Sep 08 13:26:10.019471 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2613/5358] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:09 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1547 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:26:10.046439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-83b16b3d-1788-4138-9d37-fd757906241e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:10.047782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-83b16b3d-1788-4138-9d37-fd757906241e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:10.051268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:26:10.066675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83b16b3d-1788-4138-9d37-fd757906241e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:10.071082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83b16b3d-1788-4138-9d37-fd757906241e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:10.073250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83b16b3d-1788-4138-9d37-fd757906241e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:10.080868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83b16b3d-1788-4138-9d37-fd757906241e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:10.081996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83b16b3d-1788-4138-9d37-fd757906241e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:10.082779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83b16b3d-1788-4138-9d37-fd757906241e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:10.165882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=43 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:26:10.691269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83b16b3d-1788-4138-9d37-fd757906241e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:10.725264 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-83b16b3d-1788-4138-9d37-fd757906241e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1547 microversion: 2.1 time: 0.682381 Sep 08 13:26:10.734922 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2746/5359] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:10 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1547 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:16.834372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1477909489", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1423824854", "security_groups": [{"name": "tempest-secgroup-smoke-725563629"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "9c432d8c-263c-49d1-861b-3c82b2f660f4"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:17.277500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] validate_networks() for [('9c432d8c-263c-49d1-861b-3c82b2f660f4', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:26:17.604010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc676b41-6ce7-4668-8a03-f1c904e00209 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: .version_select at 0x7fdb35994940>, body: {"keypair": {"name": "tempest-keypair-897128364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCmzIzFn0gK4oi5OIan4Kp/r/Y/Az0L6qR+V1iXc0LzoPY0WvF4Dr8rrgcvHicbdaXHjxgzaP+zsDJVsrR6VRiDqdY7tj79jUQWNG0kKnW6GcBVPDIUVnejv6Z6UunpDrw=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:17.669844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-fc676b41-6ce7-4668-8a03-f1c904e00209 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for project efc65cf30371430a9b085afea75e7a5b. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:26:17.679377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-fc676b41-6ce7-4668-8a03-f1c904e00209 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for user 1c622939c63749dc944918e2717cd09a and project efc65cf30371430a9b085afea75e7a5b. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:26:17.749657 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc676b41-6ce7-4668-8a03-f1c904e00209 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.295490 Sep 08 13:26:17.750491 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2747/5360] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:26:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:26:18.048762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:26:19.695436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Getting quotas for project 4f6be7a7724948c7af647f1b55e3e950. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:26:19.745082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Getting quotas for user cd883ee11e1f4a4a81a1a7ff9b0c8273 and project 4f6be7a7724948c7af647f1b55e3e950. Resources: dict_keys(['metadata_items']) {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:26:19.813933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:26:19.815593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:26:19.816988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:26:19.818497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:26:19.819553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:26:19.850825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:19.852117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:19.853083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:19.855463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:19.857596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:19.859277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:19.973181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=37 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:26:20.032025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Getting quotas for project 4f6be7a7724948c7af647f1b55e3e950. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:26:20.062761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Getting quotas for user cd883ee11e1f4a4a81a1a7ff9b0c8273 and project 4f6be7a7724948c7af647f1b55e3e950. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:26:20.118041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:26:20.132755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:26:20.212649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-5399d2d6-53a0-4c07-8f3e-c53ea5ef599e req-077a62ab-82ab-431f-a235-b0519b7fcca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bbd4085-933c-40d1-ba4c-18b095cbd291", "tag": "6c99972e-97f9-459d-bf1a-21487eca1dd6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:20.265116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5399d2d6-53a0-4c07-8f3e-c53ea5ef599e req-077a62ab-82ab-431f-a235-b0519b7fcca4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:20.268361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5399d2d6-53a0-4c07-8f3e-c53ea5ef599e req-077a62ab-82ab-431f-a235-b0519b7fcca4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:20.273463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5399d2d6-53a0-4c07-8f3e-c53ea5ef599e req-077a62ab-82ab-431f-a235-b0519b7fcca4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:20.311167 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-5399d2d6-53a0-4c07-8f3e-c53ea5ef599e req-077a62ab-82ab-431f-a235-b0519b7fcca4 service nova] Creating event network-changed:6c99972e-97f9-459d-bf1a-21487eca1dd6 for instance 6bbd4085-933c-40d1-ba4c-18b095cbd291 on n-h1-852084-10 Sep 08 13:26:20.348318 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-5399d2d6-53a0-4c07-8f3e-c53ea5ef599e req-077a62ab-82ab-431f-a235-b0519b7fcca4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.189424 Sep 08 13:26:20.351969 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2748/5361] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:26:20.379698 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-494780d3-09b1-4cf0-a7af-935705bbafaf tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.549325 Sep 08 13:26:20.385252 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2614/5362] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:26:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 3556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:26:20.411503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a674e810-3f6f-40f1-8191-30d55fb30767 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:20.418357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a674e810-3f6f-40f1-8191-30d55fb30767 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:20.664754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a674e810-3f6f-40f1-8191-30d55fb30767 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:20.713416 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a674e810-3f6f-40f1-8191-30d55fb30767 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1303 microversion: 2.1 time: 0.310565 Sep 08 13:26:20.726763 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2749/5363] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:20 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1303 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:21.760732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-343b2e0b-736d-4602-a4e8-5fbd755b6094 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:21.763947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-343b2e0b-736d-4602-a4e8-5fbd755b6094 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:22.106945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-343b2e0b-736d-4602-a4e8-5fbd755b6094 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:22.158352 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-343b2e0b-736d-4602-a4e8-5fbd755b6094 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1303 microversion: 2.1 time: 0.392977 Sep 08 13:26:22.172224 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2615/5364] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:21 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1303 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:23.213871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c94d854-31d0-48fa-b0fb-1392ad8af430 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:23.215359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5c94d854-31d0-48fa-b0fb-1392ad8af430 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:23.242546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c94d854-31d0-48fa-b0fb-1392ad8af430 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:23.243095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c94d854-31d0-48fa-b0fb-1392ad8af430 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:23.245904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c94d854-31d0-48fa-b0fb-1392ad8af430 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:23.249608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c94d854-31d0-48fa-b0fb-1392ad8af430 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:23.250467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c94d854-31d0-48fa-b0fb-1392ad8af430 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:23.250937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c94d854-31d0-48fa-b0fb-1392ad8af430 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:23.491578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5c94d854-31d0-48fa-b0fb-1392ad8af430 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:23.513911 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c94d854-31d0-48fa-b0fb-1392ad8af430 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1299 microversion: 2.1 time: 0.312392 Sep 08 13:26:23.531276 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2750/5365] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:23 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1299 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:26:23.777703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-204331350", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed1157e7-c274-4d74-a471-1eb655ce6d93"}], "security_groups": [{"name": "tempest-securitygroup--615801810"}], "key_name": "tempest-keypair-897128364", "user_data": "}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:24.144834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] validate_networks() for [('ed1157e7-c274-4d74-a471-1eb655ce6d93', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:26:24.561701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1c041db1-8629-4dd9-848d-d035dd072def tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:24.563435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1c041db1-8629-4dd9-848d-d035dd072def tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:24.589094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c041db1-8629-4dd9-848d-d035dd072def tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:24.590032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c041db1-8629-4dd9-848d-d035dd072def tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:24.595108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c041db1-8629-4dd9-848d-d035dd072def tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:24.598831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c041db1-8629-4dd9-848d-d035dd072def tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:24.599862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c041db1-8629-4dd9-848d-d035dd072def tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:24.605512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c041db1-8629-4dd9-848d-d035dd072def tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:25.003810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1c041db1-8629-4dd9-848d-d035dd072def tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:25.025225 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1c041db1-8629-4dd9-848d-d035dd072def tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1373 microversion: 2.1 time: 0.469864 Sep 08 13:26:25.025919 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2751/5366] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:24 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1373 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:26:26.062826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a53acadc-ef7a-49c1-8c16-b0221e974be3 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:26.066403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a53acadc-ef7a-49c1-8c16-b0221e974be3 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:26.092308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a53acadc-ef7a-49c1-8c16-b0221e974be3 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:26.093762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a53acadc-ef7a-49c1-8c16-b0221e974be3 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:26.094859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a53acadc-ef7a-49c1-8c16-b0221e974be3 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:26.098113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a53acadc-ef7a-49c1-8c16-b0221e974be3 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:26.099368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a53acadc-ef7a-49c1-8c16-b0221e974be3 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:26.100927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a53acadc-ef7a-49c1-8c16-b0221e974be3 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:26.430971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a53acadc-ef7a-49c1-8c16-b0221e974be3 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:26.453642 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a53acadc-ef7a-49c1-8c16-b0221e974be3 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1361 microversion: 2.1 time: 0.406084 Sep 08 13:26:26.455989 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2752/5367] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:26 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1361 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:26:27.356362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:26:27.359321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:26:27.361818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:26:27.363131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:26:27.364163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:26:27.387367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:27.389450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:27.391827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:27.393720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:27.394984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:27.395960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:27.453210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for project efc65cf30371430a9b085afea75e7a5b. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:26:27.470787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for user 1c622939c63749dc944918e2717cd09a and project efc65cf30371430a9b085afea75e7a5b. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:26:27.492766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eaec78de-1750-4e4f-af39-6bfababbaba9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:27.493545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eaec78de-1750-4e4f-af39-6bfababbaba9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:27.505676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:26:27.509464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eaec78de-1750-4e4f-af39-6bfababbaba9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:27.512335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:26:27.513028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eaec78de-1750-4e4f-af39-6bfababbaba9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:27.513676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eaec78de-1750-4e4f-af39-6bfababbaba9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:27.518283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eaec78de-1750-4e4f-af39-6bfababbaba9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:27.521093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eaec78de-1750-4e4f-af39-6bfababbaba9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:27.521796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eaec78de-1750-4e4f-af39-6bfababbaba9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:27.640240 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a0e0382e-6a84-4e6b-9798-855b6e3b7f9b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.873412 Sep 08 13:26:27.651355 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2616/5368] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:26:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 3877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:26:27.659608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-59717303-a360-4759-9889-a8cfcf46552d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:27.660304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-59717303-a360-4759-9889-a8cfcf46552d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:27.836279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eaec78de-1750-4e4f-af39-6bfababbaba9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:27.857870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-59717303-a360-4759-9889-a8cfcf46552d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:27.859159 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eaec78de-1750-4e4f-af39-6bfababbaba9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1361 microversion: 2.1 time: 0.370777 Sep 08 13:26:27.865488 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2753/5369] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:27 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1361 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:27.873353 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-59717303-a360-4759-9889-a8cfcf46552d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1240 microversion: 2.1 time: 0.218642 Sep 08 13:26:27.892542 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2617/5370] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:27 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1240 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:28.895951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-53637ba6-8488-4e23-9689-f19c2a23ac4b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:28.896748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-53637ba6-8488-4e23-9689-f19c2a23ac4b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:28.915333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53637ba6-8488-4e23-9689-f19c2a23ac4b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:28.917169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53637ba6-8488-4e23-9689-f19c2a23ac4b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:28.922053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-98b35481-48e9-4dfc-998b-ed011e16e0e7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:28.922979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-98b35481-48e9-4dfc-998b-ed011e16e0e7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:28.931688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53637ba6-8488-4e23-9689-f19c2a23ac4b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:28.933695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53637ba6-8488-4e23-9689-f19c2a23ac4b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:28.937029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53637ba6-8488-4e23-9689-f19c2a23ac4b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:28.940175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53637ba6-8488-4e23-9689-f19c2a23ac4b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:28.947698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98b35481-48e9-4dfc-998b-ed011e16e0e7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:28.953645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98b35481-48e9-4dfc-998b-ed011e16e0e7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:28.959004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98b35481-48e9-4dfc-998b-ed011e16e0e7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:28.959983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98b35481-48e9-4dfc-998b-ed011e16e0e7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:28.960554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98b35481-48e9-4dfc-998b-ed011e16e0e7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:28.961096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98b35481-48e9-4dfc-998b-ed011e16e0e7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:29.317748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-98b35481-48e9-4dfc-998b-ed011e16e0e7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:29.342154 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-98b35481-48e9-4dfc-998b-ed011e16e0e7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1244 microversion: 2.1 time: 0.426449 Sep 08 13:26:29.344582 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2618/5371] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:28 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1244 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:26:29.810806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-53637ba6-8488-4e23-9689-f19c2a23ac4b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:29.827971 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-53637ba6-8488-4e23-9689-f19c2a23ac4b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1428 microversion: 2.1 time: 0.935306 Sep 08 13:26:29.831792 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2754/5372] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:28 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1428 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:30.399814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-00a0926c-77b3-4070-adba-c3f8f049d6fd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:30.402354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-00a0926c-77b3-4070-adba-c3f8f049d6fd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:30.423951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00a0926c-77b3-4070-adba-c3f8f049d6fd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:30.434983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00a0926c-77b3-4070-adba-c3f8f049d6fd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:30.436106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00a0926c-77b3-4070-adba-c3f8f049d6fd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:30.437495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00a0926c-77b3-4070-adba-c3f8f049d6fd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:30.438386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00a0926c-77b3-4070-adba-c3f8f049d6fd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:30.439217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00a0926c-77b3-4070-adba-c3f8f049d6fd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:30.640745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-00a0926c-77b3-4070-adba-c3f8f049d6fd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:30.656219 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-00a0926c-77b3-4070-adba-c3f8f049d6fd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1298 microversion: 2.1 time: 0.270452 Sep 08 13:26:30.671765 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2619/5373] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:30 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1298 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:30.872755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5bfdaf8d-6925-402b-86de-677275fe7b7c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:30.873794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5bfdaf8d-6925-402b-86de-677275fe7b7c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:30.890677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:26:30.894519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bfdaf8d-6925-402b-86de-677275fe7b7c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:30.896000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bfdaf8d-6925-402b-86de-677275fe7b7c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:30.896670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bfdaf8d-6925-402b-86de-677275fe7b7c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:30.897888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bfdaf8d-6925-402b-86de-677275fe7b7c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:30.898939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bfdaf8d-6925-402b-86de-677275fe7b7c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:30.899950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bfdaf8d-6925-402b-86de-677275fe7b7c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:31.474016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5bfdaf8d-6925-402b-86de-677275fe7b7c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:31.494343 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5bfdaf8d-6925-402b-86de-677275fe7b7c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1428 microversion: 2.1 time: 0.629014 Sep 08 13:26:31.496223 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2755/5374] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:30 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1428 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:31.715046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38b1ad08-f7f8-478a-99c9-a3c3447fd015 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:31.721390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-38b1ad08-f7f8-478a-99c9-a3c3447fd015 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:31.750051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38b1ad08-f7f8-478a-99c9-a3c3447fd015 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:31.750846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38b1ad08-f7f8-478a-99c9-a3c3447fd015 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:31.751832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38b1ad08-f7f8-478a-99c9-a3c3447fd015 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:31.753254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38b1ad08-f7f8-478a-99c9-a3c3447fd015 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:31.753932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38b1ad08-f7f8-478a-99c9-a3c3447fd015 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:31.755087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38b1ad08-f7f8-478a-99c9-a3c3447fd015 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:32.543387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bbd59ce5-8cb8-42aa-9526-238b6dee2d06 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:32.547577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bbd59ce5-8cb8-42aa-9526-238b6dee2d06 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:32.582921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd59ce5-8cb8-42aa-9526-238b6dee2d06 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:32.589224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd59ce5-8cb8-42aa-9526-238b6dee2d06 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:32.595800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd59ce5-8cb8-42aa-9526-238b6dee2d06 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:32.597225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd59ce5-8cb8-42aa-9526-238b6dee2d06 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:32.598420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd59ce5-8cb8-42aa-9526-238b6dee2d06 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:32.605180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd59ce5-8cb8-42aa-9526-238b6dee2d06 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:32.943664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38b1ad08-f7f8-478a-99c9-a3c3447fd015 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:32.984621 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38b1ad08-f7f8-478a-99c9-a3c3447fd015 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1365 microversion: 2.1 time: 1.301637 Sep 08 13:26:33.006161 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2620/5375] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:31 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1365 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:33.078217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bbd59ce5-8cb8-42aa-9526-238b6dee2d06 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:33.114773 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bbd59ce5-8cb8-42aa-9526-238b6dee2d06 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1428 microversion: 2.1 time: 0.581057 Sep 08 13:26:33.117420 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2756/5376] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:32 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1428 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:26:33.253250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-780c8192-fffd-4eb6-97cc-c24520c6c74a req-4e937976-4ae0-4963-a36c-d13df168be88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47276fe9-eea9-4d51-80f3-b7fe29784971", "tag": "41cb2b60-aabd-4228-bf08-e10984f06014"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:33.280630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-780c8192-fffd-4eb6-97cc-c24520c6c74a req-4e937976-4ae0-4963-a36c-d13df168be88 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:33.282235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-780c8192-fffd-4eb6-97cc-c24520c6c74a req-4e937976-4ae0-4963-a36c-d13df168be88 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:33.283173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-780c8192-fffd-4eb6-97cc-c24520c6c74a req-4e937976-4ae0-4963-a36c-d13df168be88 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:33.314948 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-780c8192-fffd-4eb6-97cc-c24520c6c74a req-4e937976-4ae0-4963-a36c-d13df168be88 service nova] Creating event network-changed:41cb2b60-aabd-4228-bf08-e10984f06014 for instance 47276fe9-eea9-4d51-80f3-b7fe29784971 on n-h2-852084-10 Sep 08 13:26:33.321616 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-780c8192-fffd-4eb6-97cc-c24520c6c74a req-4e937976-4ae0-4963-a36c-d13df168be88 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075511 Sep 08 13:26:33.323257 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2621/5377] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:26:33.324721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-395bd2f2-317a-4a04-b166-3f59934aad4e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:33.330624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-395bd2f2-317a-4a04-b166-3f59934aad4e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:33.351108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-395bd2f2-317a-4a04-b166-3f59934aad4e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:33.353027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-395bd2f2-317a-4a04-b166-3f59934aad4e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:33.355833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-395bd2f2-317a-4a04-b166-3f59934aad4e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:33.358808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-395bd2f2-317a-4a04-b166-3f59934aad4e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:33.360943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-395bd2f2-317a-4a04-b166-3f59934aad4e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:33.362676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-395bd2f2-317a-4a04-b166-3f59934aad4e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:33.490223 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-395bd2f2-317a-4a04-b166-3f59934aad4e tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "POST /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291/action" status: 200 len: 24566 microversion: 2.1 time: 0.178608 Sep 08 13:26:33.499467 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2757/5378] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:26:33 2022] POST /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291/action => generated 24566 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:26:34.020447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d4df5ab-8d7d-4be5-ad5e-9f4496dc2620 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:34.021596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d4df5ab-8d7d-4be5-ad5e-9f4496dc2620 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:34.046262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d4df5ab-8d7d-4be5-ad5e-9f4496dc2620 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:34.049843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d4df5ab-8d7d-4be5-ad5e-9f4496dc2620 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:34.054716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d4df5ab-8d7d-4be5-ad5e-9f4496dc2620 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:34.056916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d4df5ab-8d7d-4be5-ad5e-9f4496dc2620 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:34.060461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d4df5ab-8d7d-4be5-ad5e-9f4496dc2620 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:34.060461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d4df5ab-8d7d-4be5-ad5e-9f4496dc2620 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:34.126464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f7d83566-138a-48e4-b4e4-ec62c6bd3d7b req-586c9985-664a-4b64-9b60-31c5a5a6ef88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c4aab1-021c-4648-8fe3-00d778b883f2", "tag": "f01cad41-e70a-4258-ba3e-e76ab21b0ddc"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:34.169704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f7d83566-138a-48e4-b4e4-ec62c6bd3d7b req-586c9985-664a-4b64-9b60-31c5a5a6ef88 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:34.171310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f7d83566-138a-48e4-b4e4-ec62c6bd3d7b req-586c9985-664a-4b64-9b60-31c5a5a6ef88 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:34.172079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f7d83566-138a-48e4-b4e4-ec62c6bd3d7b req-586c9985-664a-4b64-9b60-31c5a5a6ef88 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:34.227407 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f7d83566-138a-48e4-b4e4-ec62c6bd3d7b req-586c9985-664a-4b64-9b60-31c5a5a6ef88 service nova] Creating event network-changed:f01cad41-e70a-4258-ba3e-e76ab21b0ddc for instance 31c4aab1-021c-4648-8fe3-00d778b883f2 on n-h1-852084-10 Sep 08 13:26:34.255721 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f7d83566-138a-48e4-b4e4-ec62c6bd3d7b req-586c9985-664a-4b64-9b60-31c5a5a6ef88 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.143772 Sep 08 13:26:34.259149 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2758/5379] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:26:34.301004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-51e5ed78-64a4-4002-8e76-bea9c0fcf928 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:34.302420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-51e5ed78-64a4-4002-8e76-bea9c0fcf928 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:34.343112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51e5ed78-64a4-4002-8e76-bea9c0fcf928 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:34.344118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51e5ed78-64a4-4002-8e76-bea9c0fcf928 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:34.344822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51e5ed78-64a4-4002-8e76-bea9c0fcf928 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:34.359765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51e5ed78-64a4-4002-8e76-bea9c0fcf928 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:34.360614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51e5ed78-64a4-4002-8e76-bea9c0fcf928 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:34.361377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51e5ed78-64a4-4002-8e76-bea9c0fcf928 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:35.251142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8d4df5ab-8d7d-4be5-ad5e-9f4496dc2620 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:35.268190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-51e5ed78-64a4-4002-8e76-bea9c0fcf928 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:35.288985 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d4df5ab-8d7d-4be5-ad5e-9f4496dc2620 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1365 microversion: 2.1 time: 1.273812 Sep 08 13:26:35.290459 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2622/5380] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:34 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1365 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:26:35.297073 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-51e5ed78-64a4-4002-8e76-bea9c0fcf928 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1428 microversion: 2.1 time: 1.030141 Sep 08 13:26:35.298161 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2759/5381] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:34 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1428 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:36.343303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ee62b6a0-b284-4909-aff5-081890487d71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:36.344531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ee62b6a0-b284-4909-aff5-081890487d71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:36.356043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-417501b1-41fb-4756-a868-3a8d20d17bec tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:36.356934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=7 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:26:36.363371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-417501b1-41fb-4756-a868-3a8d20d17bec tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:36.378269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee62b6a0-b284-4909-aff5-081890487d71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:36.379178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee62b6a0-b284-4909-aff5-081890487d71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:36.380092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee62b6a0-b284-4909-aff5-081890487d71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:36.381342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee62b6a0-b284-4909-aff5-081890487d71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:36.382271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee62b6a0-b284-4909-aff5-081890487d71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:36.383025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ee62b6a0-b284-4909-aff5-081890487d71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:36.396832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-417501b1-41fb-4756-a868-3a8d20d17bec tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:36.398131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-417501b1-41fb-4756-a868-3a8d20d17bec tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:36.399176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-417501b1-41fb-4756-a868-3a8d20d17bec tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:36.400684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-417501b1-41fb-4756-a868-3a8d20d17bec tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:36.403355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-417501b1-41fb-4756-a868-3a8d20d17bec tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:36.404394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-417501b1-41fb-4756-a868-3a8d20d17bec tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:37.150539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-417501b1-41fb-4756-a868-3a8d20d17bec tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:37.192213 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-417501b1-41fb-4756-a868-3a8d20d17bec tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1428 microversion: 2.1 time: 0.850090 Sep 08 13:26:37.195168 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2760/5382] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:36 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1428 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:26:37.229088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ee62b6a0-b284-4909-aff5-081890487d71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:37.256237 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ee62b6a0-b284-4909-aff5-081890487d71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1365 microversion: 2.1 time: 0.918871 Sep 08 13:26:37.266148 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2623/5383] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:36 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1365 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:38.237728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f68ff642-4f4e-4ba0-ad62-ecf92e980f9f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:38.239806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f68ff642-4f4e-4ba0-ad62-ecf92e980f9f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:38.259720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f68ff642-4f4e-4ba0-ad62-ecf92e980f9f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:38.261374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f68ff642-4f4e-4ba0-ad62-ecf92e980f9f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:38.262496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f68ff642-4f4e-4ba0-ad62-ecf92e980f9f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:38.265370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f68ff642-4f4e-4ba0-ad62-ecf92e980f9f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:38.267025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f68ff642-4f4e-4ba0-ad62-ecf92e980f9f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:38.268313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f68ff642-4f4e-4ba0-ad62-ecf92e980f9f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:38.307028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6c545955-858b-4932-ad3c-ec2933af96e0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:38.307944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6c545955-858b-4932-ad3c-ec2933af96e0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:38.310920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:26:38.313953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=20 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:26:38.341945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c545955-858b-4932-ad3c-ec2933af96e0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:38.343402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c545955-858b-4932-ad3c-ec2933af96e0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:38.348944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c545955-858b-4932-ad3c-ec2933af96e0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:38.351238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c545955-858b-4932-ad3c-ec2933af96e0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:38.352141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c545955-858b-4932-ad3c-ec2933af96e0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:38.352947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c545955-858b-4932-ad3c-ec2933af96e0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:38.885528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f68ff642-4f4e-4ba0-ad62-ecf92e980f9f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:38.888035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c545955-858b-4932-ad3c-ec2933af96e0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:38.932052 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6c545955-858b-4932-ad3c-ec2933af96e0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1365 microversion: 2.1 time: 0.628616 Sep 08 13:26:38.933218 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2624/5384] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:38 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1365 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:38.944455 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f68ff642-4f4e-4ba0-ad62-ecf92e980f9f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1428 microversion: 2.1 time: 0.698748 Sep 08 13:26:38.946087 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2761/5385] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:38 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1428 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:39.963041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-255d4e4f-62ce-4b00-8eb4-d95651b683ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:39.968821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-255d4e4f-62ce-4b00-8eb4-d95651b683ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:40.000691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7695c8e6-0906-41e3-a047-2528a5235e6f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:40.008210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7695c8e6-0906-41e3-a047-2528a5235e6f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:40.031525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-255d4e4f-62ce-4b00-8eb4-d95651b683ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:40.040200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-255d4e4f-62ce-4b00-8eb4-d95651b683ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:40.040568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-255d4e4f-62ce-4b00-8eb4-d95651b683ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:40.041360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-255d4e4f-62ce-4b00-8eb4-d95651b683ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:40.045877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-255d4e4f-62ce-4b00-8eb4-d95651b683ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:40.046437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-255d4e4f-62ce-4b00-8eb4-d95651b683ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:40.058947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7695c8e6-0906-41e3-a047-2528a5235e6f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:40.061874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7695c8e6-0906-41e3-a047-2528a5235e6f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:40.064331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7695c8e6-0906-41e3-a047-2528a5235e6f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:40.074024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7695c8e6-0906-41e3-a047-2528a5235e6f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:40.078875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7695c8e6-0906-41e3-a047-2528a5235e6f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:40.084139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7695c8e6-0906-41e3-a047-2528a5235e6f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:40.842463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-255d4e4f-62ce-4b00-8eb4-d95651b683ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:40.866874 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-255d4e4f-62ce-4b00-8eb4-d95651b683ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1365 microversion: 2.1 time: 0.911047 Sep 08 13:26:40.870934 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2625/5386] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:39 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1365 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:40.881296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c48bdd75-c727-4941-bbec-13b2040f985b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:40.891469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c48bdd75-c727-4941-bbec-13b2040f985b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:40.914222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c48bdd75-c727-4941-bbec-13b2040f985b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:40.915356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c48bdd75-c727-4941-bbec-13b2040f985b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:40.918406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c48bdd75-c727-4941-bbec-13b2040f985b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:40.921264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c48bdd75-c727-4941-bbec-13b2040f985b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:40.923421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c48bdd75-c727-4941-bbec-13b2040f985b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:40.925247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c48bdd75-c727-4941-bbec-13b2040f985b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:41.005194 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c48bdd75-c727-4941-bbec-13b2040f985b tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "POST /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291/action" status: 200 len: 32635 microversion: 2.1 time: 0.131423 Sep 08 13:26:41.018750 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2626/5387] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:26:40 2022] POST /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291/action => generated 32635 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:26:41.084569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7695c8e6-0906-41e3-a047-2528a5235e6f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:41.104675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=78 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:26:41.118604 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7695c8e6-0906-41e3-a047-2528a5235e6f tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1428 microversion: 2.1 time: 1.130157 Sep 08 13:26:41.132965 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2762/5388] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:39 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1428 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:26:41.934693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-81cb86f4-2016-42d1-914b-00468a299edf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:41.940058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-81cb86f4-2016-42d1-914b-00468a299edf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:41.970199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81cb86f4-2016-42d1-914b-00468a299edf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:41.985582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81cb86f4-2016-42d1-914b-00468a299edf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:41.985582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81cb86f4-2016-42d1-914b-00468a299edf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:41.985582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81cb86f4-2016-42d1-914b-00468a299edf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:41.985582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81cb86f4-2016-42d1-914b-00468a299edf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:41.985582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-81cb86f4-2016-42d1-914b-00468a299edf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:42.167156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-04f96796-115a-452a-9a48-839fc6bafe5c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:42.168477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-04f96796-115a-452a-9a48-839fc6bafe5c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:42.184038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:26:42.207007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-04f96796-115a-452a-9a48-839fc6bafe5c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:42.215282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-04f96796-115a-452a-9a48-839fc6bafe5c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:42.216286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-04f96796-115a-452a-9a48-839fc6bafe5c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:42.218465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-04f96796-115a-452a-9a48-839fc6bafe5c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:42.225247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-04f96796-115a-452a-9a48-839fc6bafe5c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:42.226463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-04f96796-115a-452a-9a48-839fc6bafe5c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:43.609248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-81cb86f4-2016-42d1-914b-00468a299edf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:43.647808 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-81cb86f4-2016-42d1-914b-00468a299edf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1365 microversion: 2.1 time: 1.719825 Sep 08 13:26:43.660711 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2627/5389] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:41 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1365 bytes in 1732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:43.681368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f3451f2d-634e-4ec4-beb1-d3ca274fb3a4 req-3ed87630-50d7-4221-90cb-a24707eba79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47276fe9-eea9-4d51-80f3-b7fe29784971", "name": "network-vif-plugged", "status": "completed", "tag": "41cb2b60-aabd-4228-bf08-e10984f06014"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:43.734355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f3451f2d-634e-4ec4-beb1-d3ca274fb3a4 req-3ed87630-50d7-4221-90cb-a24707eba79f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:43.735659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f3451f2d-634e-4ec4-beb1-d3ca274fb3a4 req-3ed87630-50d7-4221-90cb-a24707eba79f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:43.738108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f3451f2d-634e-4ec4-beb1-d3ca274fb3a4 req-3ed87630-50d7-4221-90cb-a24707eba79f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:43.808729 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f3451f2d-634e-4ec4-beb1-d3ca274fb3a4 req-3ed87630-50d7-4221-90cb-a24707eba79f service nova] Creating event network-vif-plugged:41cb2b60-aabd-4228-bf08-e10984f06014 for instance 47276fe9-eea9-4d51-80f3-b7fe29784971 on n-h2-852084-10 Sep 08 13:26:43.837174 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f3451f2d-634e-4ec4-beb1-d3ca274fb3a4 req-3ed87630-50d7-4221-90cb-a24707eba79f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162264 Sep 08 13:26:43.839165 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2628/5390] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:26:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:26:43.958984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-04f96796-115a-452a-9a48-839fc6bafe5c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:44.009307 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-04f96796-115a-452a-9a48-839fc6bafe5c tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1428 microversion: 2.1 time: 1.847634 Sep 08 13:26:44.011819 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2763/5391] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:42 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1428 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:26:44.690393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a2da46cb-9db8-4b22-b718-cb8464ba6bcb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:44.696349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-790b25d1-5467-4fef-92da-706418c4f531 req-039ef75b-adf1-4288-80fa-df0ccd4cd892 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bbd4085-933c-40d1-ba4c-18b095cbd291", "tag": "6c99972e-97f9-459d-bf1a-21487eca1dd6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:44.696767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a2da46cb-9db8-4b22-b718-cb8464ba6bcb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:44.728220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-790b25d1-5467-4fef-92da-706418c4f531 req-039ef75b-adf1-4288-80fa-df0ccd4cd892 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:44.732219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2da46cb-9db8-4b22-b718-cb8464ba6bcb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:44.733937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2da46cb-9db8-4b22-b718-cb8464ba6bcb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:44.734939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2da46cb-9db8-4b22-b718-cb8464ba6bcb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:44.735789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-790b25d1-5467-4fef-92da-706418c4f531 req-039ef75b-adf1-4288-80fa-df0ccd4cd892 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:44.736830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2da46cb-9db8-4b22-b718-cb8464ba6bcb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:44.737870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-790b25d1-5467-4fef-92da-706418c4f531 req-039ef75b-adf1-4288-80fa-df0ccd4cd892 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:44.738132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2da46cb-9db8-4b22-b718-cb8464ba6bcb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:44.739246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2da46cb-9db8-4b22-b718-cb8464ba6bcb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:44.788786 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-790b25d1-5467-4fef-92da-706418c4f531 req-039ef75b-adf1-4288-80fa-df0ccd4cd892 service nova] Creating event network-changed:6c99972e-97f9-459d-bf1a-21487eca1dd6 for instance 6bbd4085-933c-40d1-ba4c-18b095cbd291 on n-h1-852084-10 Sep 08 13:26:44.812607 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-790b25d1-5467-4fef-92da-706418c4f531 req-039ef75b-adf1-4288-80fa-df0ccd4cd892 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124009 Sep 08 13:26:44.814615 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2764/5392] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:26:44.828436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd6db1b0-94ee-4615-882b-df4540aae40f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:44.829410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dd6db1b0-94ee-4615-882b-df4540aae40f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:44.851505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6db1b0-94ee-4615-882b-df4540aae40f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:44.852620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6db1b0-94ee-4615-882b-df4540aae40f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:44.853656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6db1b0-94ee-4615-882b-df4540aae40f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:44.857145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6db1b0-94ee-4615-882b-df4540aae40f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:44.858893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6db1b0-94ee-4615-882b-df4540aae40f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:44.863189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6db1b0-94ee-4615-882b-df4540aae40f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:44.911712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a2da46cb-9db8-4b22-b718-cb8464ba6bcb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:26:45.234927 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a2da46cb-9db8-4b22-b718-cb8464ba6bcb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 204 len: 0 microversion: 2.1 time: 0.551525 Sep 08 13:26:45.236726 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2629/5393] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:26:44 2022] DELETE /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:26:45.260308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9bc07e27-3680-4561-b909-7cd3333dc40a tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:45.262113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9bc07e27-3680-4561-b909-7cd3333dc40a tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:45.282274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bc07e27-3680-4561-b909-7cd3333dc40a tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:45.285820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bc07e27-3680-4561-b909-7cd3333dc40a tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:45.289636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bc07e27-3680-4561-b909-7cd3333dc40a tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:45.290928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bc07e27-3680-4561-b909-7cd3333dc40a tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:45.291319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bc07e27-3680-4561-b909-7cd3333dc40a tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:45.291779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bc07e27-3680-4561-b909-7cd3333dc40a tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:45.554036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dd6db1b0-94ee-4615-882b-df4540aae40f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:45.584656 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dd6db1b0-94ee-4615-882b-df4540aae40f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1365 microversion: 2.1 time: 0.767069 Sep 08 13:26:45.617082 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2765/5394] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:44 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1365 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:45.661913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0d27b9a0-f1b1-4a4f-bbf0-79034f44e617 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:45.672107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0d27b9a0-f1b1-4a4f-bbf0-79034f44e617 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:45.710088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d27b9a0-f1b1-4a4f-bbf0-79034f44e617 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:45.710940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d27b9a0-f1b1-4a4f-bbf0-79034f44e617 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:45.712994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d27b9a0-f1b1-4a4f-bbf0-79034f44e617 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:45.716397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d27b9a0-f1b1-4a4f-bbf0-79034f44e617 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:45.716968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d27b9a0-f1b1-4a4f-bbf0-79034f44e617 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:45.720190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d27b9a0-f1b1-4a4f-bbf0-79034f44e617 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:46.568617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9bc07e27-3680-4561-b909-7cd3333dc40a tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:46.603846 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9bc07e27-3680-4561-b909-7cd3333dc40a tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1428 microversion: 2.1 time: 1.364737 Sep 08 13:26:46.644380 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2630/5395] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:45 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1428 bytes in 1407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:46.669719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-92e01847-30e2-4df4-b5a4-c1aab5356208 req-53321bae-e874-458c-a04a-e975392e84c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c4aab1-021c-4648-8fe3-00d778b883f2", "name": "network-vif-plugged", "status": "completed", "tag": "f01cad41-e70a-4258-ba3e-e76ab21b0ddc"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:46.762240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-92e01847-30e2-4df4-b5a4-c1aab5356208 req-53321bae-e874-458c-a04a-e975392e84c6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:46.763130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-92e01847-30e2-4df4-b5a4-c1aab5356208 req-53321bae-e874-458c-a04a-e975392e84c6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:46.763978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-92e01847-30e2-4df4-b5a4-c1aab5356208 req-53321bae-e874-458c-a04a-e975392e84c6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:46.808991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0d27b9a0-f1b1-4a4f-bbf0-79034f44e617 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:46.823201 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0d27b9a0-f1b1-4a4f-bbf0-79034f44e617 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1672 microversion: 2.1 time: 1.204023 Sep 08 13:26:46.824139 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2766/5396] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:45 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1672 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:46.837197 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-92e01847-30e2-4df4-b5a4-c1aab5356208 req-53321bae-e874-458c-a04a-e975392e84c6 service nova] Creating event network-vif-plugged:f01cad41-e70a-4258-ba3e-e76ab21b0ddc for instance 31c4aab1-021c-4648-8fe3-00d778b883f2 on n-h1-852084-10 Sep 08 13:26:46.855584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4b15c29f-9931-4af9-8d0a-a29bf2deb8d1 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:46.856528 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-92e01847-30e2-4df4-b5a4-c1aab5356208 req-53321bae-e874-458c-a04a-e975392e84c6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209645 Sep 08 13:26:46.857693 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2631/5397] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:26:46.867887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4b15c29f-9931-4af9-8d0a-a29bf2deb8d1 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:46.882409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b15c29f-9931-4af9-8d0a-a29bf2deb8d1 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:46.887978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b15c29f-9931-4af9-8d0a-a29bf2deb8d1 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:46.888649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b15c29f-9931-4af9-8d0a-a29bf2deb8d1 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:46.890658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b15c29f-9931-4af9-8d0a-a29bf2deb8d1 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:46.891154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b15c29f-9931-4af9-8d0a-a29bf2deb8d1 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:46.891633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b15c29f-9931-4af9-8d0a-a29bf2deb8d1 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:47.240669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4b15c29f-9931-4af9-8d0a-a29bf2deb8d1 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:47.280239 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4b15c29f-9931-4af9-8d0a-a29bf2deb8d1 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1365 microversion: 2.1 time: 0.438415 Sep 08 13:26:47.282281 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2767/5398] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:46 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1365 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:47.729079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-67979d5a-375b-45de-bb68-706d1d772529 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:47.730239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-67979d5a-375b-45de-bb68-706d1d772529 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:47.750118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67979d5a-375b-45de-bb68-706d1d772529 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:47.750933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67979d5a-375b-45de-bb68-706d1d772529 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:47.751994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67979d5a-375b-45de-bb68-706d1d772529 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:47.762839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67979d5a-375b-45de-bb68-706d1d772529 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:47.765247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67979d5a-375b-45de-bb68-706d1d772529 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:47.765822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67979d5a-375b-45de-bb68-706d1d772529 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:47.867125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-840f9cd7-a5f8-4c84-83bc-364e17468bdb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:47.867768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-840f9cd7-a5f8-4c84-83bc-364e17468bdb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:47.900885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-840f9cd7-a5f8-4c84-83bc-364e17468bdb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:47.901917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-840f9cd7-a5f8-4c84-83bc-364e17468bdb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:47.902390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-840f9cd7-a5f8-4c84-83bc-364e17468bdb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:47.903189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-840f9cd7-a5f8-4c84-83bc-364e17468bdb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:47.908087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-840f9cd7-a5f8-4c84-83bc-364e17468bdb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:47.908795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-840f9cd7-a5f8-4c84-83bc-364e17468bdb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:48.646106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-840f9cd7-a5f8-4c84-83bc-364e17468bdb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8b4c622b66243558ea7c2395101382b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de9ce7e5cda42afa55b08b9158cb72f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:48.659482 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-840f9cd7-a5f8-4c84-83bc-364e17468bdb tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 200 len: 1672 microversion: 2.1 time: 0.802216 Sep 08 13:26:48.661779 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2768/5399] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:47 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 1672 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:48.687011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-67979d5a-375b-45de-bb68-706d1d772529 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:48.706763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-56d32c4f-7e18-4645-bcbb-3a0122c90f70 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:48.709936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-56d32c4f-7e18-4645-bcbb-3a0122c90f70 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:48.712528 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-67979d5a-375b-45de-bb68-706d1d772529 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1607 microversion: 2.1 time: 1.032042 Sep 08 13:26:48.713563 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2632/5400] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:47 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1607 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:26:48.739076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56d32c4f-7e18-4645-bcbb-3a0122c90f70 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:48.740400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56d32c4f-7e18-4645-bcbb-3a0122c90f70 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:48.752925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7cf3b951-fd83-493a-8732-41cf261087fe tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:48.754512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56d32c4f-7e18-4645-bcbb-3a0122c90f70 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:48.756509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7cf3b951-fd83-493a-8732-41cf261087fe tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:48.760653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56d32c4f-7e18-4645-bcbb-3a0122c90f70 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:48.764497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56d32c4f-7e18-4645-bcbb-3a0122c90f70 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:48.765818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-56d32c4f-7e18-4645-bcbb-3a0122c90f70 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:48.791189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cf3b951-fd83-493a-8732-41cf261087fe tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:48.792600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cf3b951-fd83-493a-8732-41cf261087fe tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:48.795140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cf3b951-fd83-493a-8732-41cf261087fe tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:48.796949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cf3b951-fd83-493a-8732-41cf261087fe tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:48.798240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cf3b951-fd83-493a-8732-41cf261087fe tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:48.799456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7cf3b951-fd83-493a-8732-41cf261087fe tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:49.546367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7cf3b951-fd83-493a-8732-41cf261087fe tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:49.575078 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7cf3b951-fd83-493a-8732-41cf261087fe tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1607 microversion: 2.1 time: 0.831960 Sep 08 13:26:49.592042 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2633/5401] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:48 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1607 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:49.605953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-56d32c4f-7e18-4645-bcbb-3a0122c90f70 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:49.624177 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-56d32c4f-7e18-4645-bcbb-3a0122c90f70 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1555 microversion: 2.1 time: 0.960346 Sep 08 13:26:49.624806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-da61a502-2d80-4ca0-a2fc-fc03787d6d19 req-6d96cb83-61f9-4237-9945-918b185fa852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bbd4085-933c-40d1-ba4c-18b095cbd291", "name": "network-vif-deleted", "tag": "6c99972e-97f9-459d-bf1a-21487eca1dd6"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:49.625920 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2769/5402] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:48 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1555 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:49.631970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-db5e027f-9f11-4cf5-a602-1d8b46259413 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:49.632529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-db5e027f-9f11-4cf5-a602-1d8b46259413 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:49.645863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db5e027f-9f11-4cf5-a602-1d8b46259413 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:49.646139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-da61a502-2d80-4ca0-a2fc-fc03787d6d19 req-6d96cb83-61f9-4237-9945-918b185fa852 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:49.646996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-da61a502-2d80-4ca0-a2fc-fc03787d6d19 req-6d96cb83-61f9-4237-9945-918b185fa852 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:49.647707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db5e027f-9f11-4cf5-a602-1d8b46259413 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:49.647912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-da61a502-2d80-4ca0-a2fc-fc03787d6d19 req-6d96cb83-61f9-4237-9945-918b185fa852 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:49.648829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db5e027f-9f11-4cf5-a602-1d8b46259413 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:49.650335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db5e027f-9f11-4cf5-a602-1d8b46259413 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:49.652298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db5e027f-9f11-4cf5-a602-1d8b46259413 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:49.657115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db5e027f-9f11-4cf5-a602-1d8b46259413 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:49.692122 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-da61a502-2d80-4ca0-a2fc-fc03787d6d19 req-6d96cb83-61f9-4237-9945-918b185fa852 service nova] Creating event network-vif-deleted:6c99972e-97f9-459d-bf1a-21487eca1dd6 for instance 6bbd4085-933c-40d1-ba4c-18b095cbd291 on n-h1-852084-10 Sep 08 13:26:49.753178 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-da61a502-2d80-4ca0-a2fc-fc03787d6d19 req-6d96cb83-61f9-4237-9945-918b185fa852 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146840 Sep 08 13:26:49.777252 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2634/5403] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:26:49.806459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-944d78b3-03d6-44a4-9d47-4c53de67b2fa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:49.810029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-944d78b3-03d6-44a4-9d47-4c53de67b2fa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:49.845769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-944d78b3-03d6-44a4-9d47-4c53de67b2fa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:49.849954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-944d78b3-03d6-44a4-9d47-4c53de67b2fa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:49.850794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-944d78b3-03d6-44a4-9d47-4c53de67b2fa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:49.864572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-944d78b3-03d6-44a4-9d47-4c53de67b2fa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:49.865482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-944d78b3-03d6-44a4-9d47-4c53de67b2fa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:49.866406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-944d78b3-03d6-44a4-9d47-4c53de67b2fa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:49.967463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:26:50.162236 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-944d78b3-03d6-44a4-9d47-4c53de67b2fa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.382804 Sep 08 13:26:50.163284 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2635/5404] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:26:49 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-interface => generated 285 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:26:50.178812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ca813a3e-4780-4c01-ae3c-cea9e840ad74 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:50.181090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ca813a3e-4780-4c01-ae3c-cea9e840ad74 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] [instance: 6bbd4085-933c-40d1-ba4c-18b095cbd291] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:26:50.216827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca813a3e-4780-4c01-ae3c-cea9e840ad74 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:50.218717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca813a3e-4780-4c01-ae3c-cea9e840ad74 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:50.219751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca813a3e-4780-4c01-ae3c-cea9e840ad74 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:50.221787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca813a3e-4780-4c01-ae3c-cea9e840ad74 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:50.223677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca813a3e-4780-4c01-ae3c-cea9e840ad74 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:50.226262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca813a3e-4780-4c01-ae3c-cea9e840ad74 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:50.284940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-db5e027f-9f11-4cf5-a602-1d8b46259413 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:26:50.289387 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-ca813a3e-4780-4c01-ae3c-cea9e840ad74 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] HTTP exception thrown: Instance 6bbd4085-933c-40d1-ba4c-18b095cbd291 could not be found. Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ca813a3e-4780-4c01-ae3c-cea9e840ad74 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Request method failure captured: Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 HTTP/1.1 Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGewr8e9ByZ_foL6LwnyfRgSFwKUwALx7izO1TTDFkRh8AkAlQeEPNCRKPAKT7d7bgJfL1NGh2UASGnmNtbXZz7QLuEfNFYng7zZFg9vBpcftjf8tI1CSHCUN5RoScjLdVzJroeMK4b00mBxq3NV8UL5A0bEfnuI0udi20_EDXzrfJSI Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 8de9ce7e5cda42afa55b08b9158cb72f Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestNetworkBasicOps-309340670 Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_8de9ce7e5cda42afa55b08b9158cb72f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/8de9ce7e5cda42afa55b08b9158cb72f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8de9ce7e5cda42afa55b08b9158cb72f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/8de9ce7e5cda42afa55b08b9158cb72f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestNetworkBasicOps-309340670 Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 8de9ce7e5cda42afa55b08b9158cb72f Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestNetworkBasicOps-309340670 Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestNetworkBasicOps-309340670-project Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: e8b4c622b66243558ea7c2395101382b Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestNetworkBasicOps-309340670-project Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 6bbd4085-933c-40d1-ba4c-18b095cbd291 could not be found. Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '6bbd4085-933c-40d1-ba4c-18b095cbd291'} Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bbd4085-933c-40d1-ba4c-18b095cbd291 could not be found. Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bbd4085-933c-40d1-ba4c-18b095cbd291 could not be found. Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:26:50.299261 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:26:50.310132 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:26:50.310132 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:26:50.310132 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:26:50.310132 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:26:50.310132 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:26:50.310132 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bbd4085-933c-40d1-ba4c-18b095cbd291 could not be found. Sep 08 13:26:50.310132 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:26:50.314135 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-db5e027f-9f11-4cf5-a602-1d8b46259413 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1607 microversion: 2.1 time: 0.686713 Sep 08 13:26:50.315789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ca813a3e-4780-4c01-ae3c-cea9e840ad74 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Returning 404 to user: Instance 6bbd4085-933c-40d1-ba4c-18b095cbd291 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:26:50.318481 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2770/5405] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:49 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1607 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:26:50.320448 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ca813a3e-4780-4c01-ae3c-cea9e840ad74 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291" status: 404 len: 111 microversion: 2.1 time: 0.146373 Sep 08 13:26:50.321974 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2636/5406] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:26:50 2022] GET /compute/v2.1/servers/6bbd4085-933c-40d1-ba4c-18b095cbd291 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:26:50.971115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-90321599-b4ef-47b1-91b7-c7dce4f7cf19 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] Calling method '.version_select at 0x7fdb35a370d0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:26:51.058677 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-90321599-b4ef-47b1-91b7-c7dce4f7cf19 tempest-TestNetworkBasicOps-309340670 tempest-TestNetworkBasicOps-309340670-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-410970946" status: 202 len: 0 microversion: 2.1 time: 0.093329 Sep 08 13:26:51.065029 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2771/5407] 10.222.0.78 () {58 vars in 1254 bytes} [Thu Sep 8 13:26:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-410970946 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:26:56.292800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-d0f596ba-90a6-4995-b5b0-467fb03700a9 req-0353c7b1-aef6-43f3-9322-4cfaa4c98911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31c4aab1-021c-4648-8fe3-00d778b883f2", "tag": "f01cad41-e70a-4258-ba3e-e76ab21b0ddc"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:26:56.335555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d0f596ba-90a6-4995-b5b0-467fb03700a9 req-0353c7b1-aef6-43f3-9322-4cfaa4c98911 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:26:56.336426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d0f596ba-90a6-4995-b5b0-467fb03700a9 req-0353c7b1-aef6-43f3-9322-4cfaa4c98911 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:26:56.337203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d0f596ba-90a6-4995-b5b0-467fb03700a9 req-0353c7b1-aef6-43f3-9322-4cfaa4c98911 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:26:56.385940 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d0f596ba-90a6-4995-b5b0-467fb03700a9 req-0353c7b1-aef6-43f3-9322-4cfaa4c98911 service nova] Creating event network-changed:f01cad41-e70a-4258-ba3e-e76ab21b0ddc for instance 31c4aab1-021c-4648-8fe3-00d778b883f2 on n-h1-852084-10 Sep 08 13:26:56.416061 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-d0f596ba-90a6-4995-b5b0-467fb03700a9 req-0353c7b1-aef6-43f3-9322-4cfaa4c98911 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130362 Sep 08 13:26:56.417910 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2637/5408] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:27:02.979031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=45 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:02.980579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:03.260822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-20e4410c-d406-4e5f-a207-f8f63ad3021c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:03.269297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-20e4410c-d406-4e5f-a207-f8f63ad3021c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:03.295293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20e4410c-d406-4e5f-a207-f8f63ad3021c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:03.308487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20e4410c-d406-4e5f-a207-f8f63ad3021c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:03.309793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20e4410c-d406-4e5f-a207-f8f63ad3021c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:03.311599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20e4410c-d406-4e5f-a207-f8f63ad3021c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:03.320510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20e4410c-d406-4e5f-a207-f8f63ad3021c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:03.321879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-20e4410c-d406-4e5f-a207-f8f63ad3021c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:03.465014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-20e4410c-d406-4e5f-a207-f8f63ad3021c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lazy-loading 'services' on Instance uuid c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:27:03.542057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-0bfa5e61-e0e0-4d1b-9a74-da2b0aa626e5 req-760cb7d6-b68c-4e55-9cc6-d138285347b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47276fe9-eea9-4d51-80f3-b7fe29784971", "tag": "41cb2b60-aabd-4228-bf08-e10984f06014"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:27:03.573929 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-20e4410c-d406-4e5f-a207-f8f63ad3021c tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04/os-volume_attachments/9c1c2c73-22f9-4164-a832-c1b7f4db24ee" status: 202 len: 0 microversion: 2.1 time: 0.325280 Sep 08 13:27:03.575660 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2638/5409] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:27:03 2022] DELETE /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04/os-volume_attachments/9c1c2c73-22f9-4164-a832-c1b7f4db24ee => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:27:03.585656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0bfa5e61-e0e0-4d1b-9a74-da2b0aa626e5 req-760cb7d6-b68c-4e55-9cc6-d138285347b6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:03.594989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0bfa5e61-e0e0-4d1b-9a74-da2b0aa626e5 req-760cb7d6-b68c-4e55-9cc6-d138285347b6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:03.596103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0bfa5e61-e0e0-4d1b-9a74-da2b0aa626e5 req-760cb7d6-b68c-4e55-9cc6-d138285347b6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:03.651422 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-0bfa5e61-e0e0-4d1b-9a74-da2b0aa626e5 req-760cb7d6-b68c-4e55-9cc6-d138285347b6 service nova] Creating event network-changed:41cb2b60-aabd-4228-bf08-e10984f06014 for instance 47276fe9-eea9-4d51-80f3-b7fe29784971 on n-h2-852084-10 Sep 08 13:27:03.668932 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-0bfa5e61-e0e0-4d1b-9a74-da2b0aa626e5 req-760cb7d6-b68c-4e55-9cc6-d138285347b6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.694103 Sep 08 13:27:03.675723 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2772/5410] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:27:14.677759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-023b7ca9-4ac9-4e74-9b78-b7f684efde1f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:14.680270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-023b7ca9-4ac9-4e74-9b78-b7f684efde1f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:14.687782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:14.689767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=14,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:14.703279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-023b7ca9-4ac9-4e74-9b78-b7f684efde1f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:14.704777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-023b7ca9-4ac9-4e74-9b78-b7f684efde1f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:14.705923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-023b7ca9-4ac9-4e74-9b78-b7f684efde1f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:14.708120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-023b7ca9-4ac9-4e74-9b78-b7f684efde1f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:14.709403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-023b7ca9-4ac9-4e74-9b78-b7f684efde1f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:14.710907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-023b7ca9-4ac9-4e74-9b78-b7f684efde1f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:14.768135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-023b7ca9-4ac9-4e74-9b78-b7f684efde1f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:27:15.000629 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-023b7ca9-4ac9-4e74-9b78-b7f684efde1f tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 204 len: 0 microversion: 2.1 time: 0.322938 Sep 08 13:27:15.008472 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2639/5411] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:27:14 2022] DELETE /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:27:15.021780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-18f90923-e9f7-41e3-ac16-07d388dcd13d tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:15.029248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-18f90923-e9f7-41e3-ac16-07d388dcd13d tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:15.034658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:15.035852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:15.067009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18f90923-e9f7-41e3-ac16-07d388dcd13d tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:15.067830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18f90923-e9f7-41e3-ac16-07d388dcd13d tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:15.068614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18f90923-e9f7-41e3-ac16-07d388dcd13d tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:15.069931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18f90923-e9f7-41e3-ac16-07d388dcd13d tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:15.072043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18f90923-e9f7-41e3-ac16-07d388dcd13d tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:15.073476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18f90923-e9f7-41e3-ac16-07d388dcd13d tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:15.501735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-18f90923-e9f7-41e3-ac16-07d388dcd13d tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:15.523292 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-18f90923-e9f7-41e3-ac16-07d388dcd13d tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1468 microversion: 2.1 time: 0.512167 Sep 08 13:27:15.527315 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2773/5412] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:15 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1468 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:16.562226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ed8d159e-b98a-479d-8b77-774733896dc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:16.567121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ed8d159e-b98a-479d-8b77-774733896dc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:16.584209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed8d159e-b98a-479d-8b77-774733896dc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:16.585691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed8d159e-b98a-479d-8b77-774733896dc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:16.587024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed8d159e-b98a-479d-8b77-774733896dc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:16.588874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed8d159e-b98a-479d-8b77-774733896dc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:16.590127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed8d159e-b98a-479d-8b77-774733896dc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:16.591187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed8d159e-b98a-479d-8b77-774733896dc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:17.103262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ed8d159e-b98a-479d-8b77-774733896dc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:17.126188 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ed8d159e-b98a-479d-8b77-774733896dc6 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1468 microversion: 2.1 time: 0.573833 Sep 08 13:27:17.131973 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2640/5413] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:16 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1468 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:17.750691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b075523f-f8f3-41c0-abb8-a2533e8daf2d req-97e8199c-b82f-4fc8-b2b5-1d2e00613da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04", "name": "network-vif-deleted", "tag": "5e632452-98fc-4bbd-90f0-e48d357125f6"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:27:17.791131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b075523f-f8f3-41c0-abb8-a2533e8daf2d req-97e8199c-b82f-4fc8-b2b5-1d2e00613da3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:17.791912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b075523f-f8f3-41c0-abb8-a2533e8daf2d req-97e8199c-b82f-4fc8-b2b5-1d2e00613da3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:17.795858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b075523f-f8f3-41c0-abb8-a2533e8daf2d req-97e8199c-b82f-4fc8-b2b5-1d2e00613da3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:17.830933 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b075523f-f8f3-41c0-abb8-a2533e8daf2d req-97e8199c-b82f-4fc8-b2b5-1d2e00613da3 service nova] Creating event network-vif-deleted:5e632452-98fc-4bbd-90f0-e48d357125f6 for instance c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 on n-h2-852084-10 Sep 08 13:27:17.892254 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b075523f-f8f3-41c0-abb8-a2533e8daf2d req-97e8199c-b82f-4fc8-b2b5-1d2e00613da3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153021 Sep 08 13:27:17.896246 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2774/5414] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:27:18.179208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:18.184568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:18.199410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:18.202314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:18.204960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:18.206162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:18.208056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:18.209848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:18.313057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:18.315576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:18.317105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:18.318138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lazy-loading 'fault' on Instance uuid c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:27:18.421388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a057989f7d646038f4bef908406ed9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe0c9479f36046769da581ad6c240e5f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:18.443625 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5224b3ba-7d4b-474c-999d-b719d55d1193 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 200 len: 1303 microversion: 2.1 time: 0.275068 Sep 08 13:27:18.445116 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2641/5415] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:18 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 1303 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:19.490487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ab0d9675-6586-4cf7-9e1b-6b9e8e639372 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:19.491974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ab0d9675-6586-4cf7-9e1b-6b9e8e639372 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] [instance: c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:19.505394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab0d9675-6586-4cf7-9e1b-6b9e8e639372 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:19.506535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab0d9675-6586-4cf7-9e1b-6b9e8e639372 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:19.508138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab0d9675-6586-4cf7-9e1b-6b9e8e639372 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:19.509826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab0d9675-6586-4cf7-9e1b-6b9e8e639372 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:19.511205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab0d9675-6586-4cf7-9e1b-6b9e8e639372 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:19.512774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab0d9675-6586-4cf7-9e1b-6b9e8e639372 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:19.544225 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-ab0d9675-6586-4cf7-9e1b-6b9e8e639372 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] HTTP exception thrown: Instance c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 could not be found. Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ab0d9675-6586-4cf7-9e1b-6b9e8e639372 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Request method failure captured: Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 HTTP/1.1 Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGezbeOKxwJ99qP3fcj6GRgLvzIJpVT-EwYL9IUCoLUdEQQPoHn9ZLfCvxrQjG_SvJM_Ut30wjRelxn4dTvmYGNvdw_Ebh5jGW9SnhK8M_laG8BCRfPyCavGGriWAaEVkVSjVM-AXCfjw1rnFouimXmuIDXACEMI8ZuIQEqajTZKsQPg Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: fe0c9479f36046769da581ad6c240e5f Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesBackupsTest-2129324806 Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_fe0c9479f36046769da581ad6c240e5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/fe0c9479f36046769da581ad6c240e5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fe0c9479f36046769da581ad6c240e5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/fe0c9479f36046769da581ad6c240e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesBackupsTest-2129324806 Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: fe0c9479f36046769da581ad6c240e5f Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesBackupsTest-2129324806 Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesBackupsTest-2129324806-project Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 5a057989f7d646038f4bef908406ed9f Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesBackupsTest-2129324806-project Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 could not be found. Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04'} Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 could not be found. Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 could not be found. Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:27:19.547977 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:27:19.560739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:27:19.560739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:27:19.560739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:27:19.560739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:27:19.560739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:27:19.560739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 could not be found. Sep 08 13:27:19.560739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:27:19.560739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ab0d9675-6586-4cf7-9e1b-6b9e8e639372 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] Returning 404 to user: Instance c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:27:19.560739 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ab0d9675-6586-4cf7-9e1b-6b9e8e639372 tempest-VolumesBackupsTest-2129324806 tempest-VolumesBackupsTest-2129324806-project] 10.222.0.78 "GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04" status: 404 len: 111 microversion: 2.1 time: 0.072389 Sep 08 13:27:19.560739 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2775/5416] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:19 2022] GET /compute/v2.1/servers/c9bc1fc4-0c86-4f86-81a2-ddad2e3eed04 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:27:26.615796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-940306a5-e2cb-4cfc-b5c6-4e2b2e5d46f9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:26.632033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-940306a5-e2cb-4cfc-b5c6-4e2b2e5d46f9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:26.666806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-940306a5-e2cb-4cfc-b5c6-4e2b2e5d46f9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:26.673111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-940306a5-e2cb-4cfc-b5c6-4e2b2e5d46f9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:26.673508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-940306a5-e2cb-4cfc-b5c6-4e2b2e5d46f9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:26.692799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-940306a5-e2cb-4cfc-b5c6-4e2b2e5d46f9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:26.701244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-940306a5-e2cb-4cfc-b5c6-4e2b2e5d46f9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:26.719951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-940306a5-e2cb-4cfc-b5c6-4e2b2e5d46f9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:26.780601 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-940306a5-e2cb-4cfc-b5c6-4e2b2e5d46f9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/ips" status: 200 len: 150 microversion: 2.1 time: 0.173203 Sep 08 13:27:26.790387 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2776/5417] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 13:27:26 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/ips => generated 150 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:27:26.969798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1924922320", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "ecd02795-d2c4-424a-a33f-15ca010b7f38"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:27:27.126388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] validate_networks() for [('ecd02795-d2c4-424a-a33f-15ca010b7f38', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:27:28.434892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:29.030931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:27:29.032372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:27:29.035485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:27:29.036705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:27:29.038822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:27:29.102790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:29.104753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:29.105777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:29.107701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:29.108876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:29.109914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:29.153054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Getting quotas for project 6c0fbc6ff8db40a9ac9c337957bcb3eb. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:27:29.170741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Getting quotas for user 6f9fe07216fc4d30854454643d2b061c and project 6c0fbc6ff8db40a9ac9c337957bcb3eb. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:27:29.191404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:27:29.193994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:27:29.256134 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad2ebceb-b2c7-43de-af05-45f403c674d5 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.841407 Sep 08 13:27:29.270146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f000b22-479f-46f2-8cfe-e4463deee565 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:29.270910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8f000b22-479f-46f2-8cfe-e4463deee565 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:29.275203 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2642/5418] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:27:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 2862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:27:29.466167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8f000b22-479f-46f2-8cfe-e4463deee565 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:29.493498 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f000b22-479f-46f2-8cfe-e4463deee565 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1214 microversion: 2.1 time: 0.227239 Sep 08 13:27:29.494507 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2777/5419] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:29 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1214 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:30.531723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a95475c5-5cde-449b-9e8a-19cedd81da26 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:30.533063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a95475c5-5cde-449b-9e8a-19cedd81da26 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:30.638498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a95475c5-5cde-449b-9e8a-19cedd81da26 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:30.653223 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a95475c5-5cde-449b-9e8a-19cedd81da26 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1214 microversion: 2.1 time: 0.127748 Sep 08 13:27:30.656322 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2643/5420] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:30 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:27:30.768886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-497dc190-6d09-43e0-81e4-00d500405ffd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:30.769655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-497dc190-6d09-43e0-81e4-00d500405ffd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:30.779003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-497dc190-6d09-43e0-81e4-00d500405ffd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:30.780005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-497dc190-6d09-43e0-81e4-00d500405ffd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:30.780556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-497dc190-6d09-43e0-81e4-00d500405ffd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:30.781428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-497dc190-6d09-43e0-81e4-00d500405ffd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:30.782198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-497dc190-6d09-43e0-81e4-00d500405ffd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:30.782915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-497dc190-6d09-43e0-81e4-00d500405ffd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:30.817273 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-497dc190-6d09-43e0-81e4-00d500405ffd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.054172 Sep 08 13:27:30.823195 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2778/5421] 10.222.0.78 () {58 vars in 1293 bytes} [Thu Sep 8 13:27:30 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971/os-server-password => generated 116 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:27:31.522067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-76a3253a-a9f0-4bce-8266-d3746ab6b3cc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44df3293-93c2-43bc-9cdd-32d0656fbdc4"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:27:31.546164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-76a3253a-a9f0-4bce-8266-d3746ab6b3cc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:31.570158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76a3253a-a9f0-4bce-8266-d3746ab6b3cc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:31.570870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76a3253a-a9f0-4bce-8266-d3746ab6b3cc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:31.572317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76a3253a-a9f0-4bce-8266-d3746ab6b3cc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:31.573319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76a3253a-a9f0-4bce-8266-d3746ab6b3cc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:31.573952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76a3253a-a9f0-4bce-8266-d3746ab6b3cc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:31.574540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76a3253a-a9f0-4bce-8266-d3746ab6b3cc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:31.699062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a0f16094-7b89-424f-945e-b4c67cf65740 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:31.702897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a0f16094-7b89-424f-945e-b4c67cf65740 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:31.735412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0f16094-7b89-424f-945e-b4c67cf65740 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:31.737000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0f16094-7b89-424f-945e-b4c67cf65740 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:31.740692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0f16094-7b89-424f-945e-b4c67cf65740 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:31.742390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0f16094-7b89-424f-945e-b4c67cf65740 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:31.761145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0f16094-7b89-424f-945e-b4c67cf65740 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:31.762151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a0f16094-7b89-424f-945e-b4c67cf65740 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:32.047485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a0f16094-7b89-424f-945e-b4c67cf65740 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:32.074094 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a0f16094-7b89-424f-945e-b4c67cf65740 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1266 microversion: 2.1 time: 0.379582 Sep 08 13:27:32.074761 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2779/5422] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:31 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1266 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:32.338763 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-76a3253a-a9f0-4bce-8266-d3746ab6b3cc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.827834 Sep 08 13:27:32.339762 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2644/5423] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:27:31 2022] POST /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments => generated 194 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:27:33.105413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-01c17417-272e-4e23-9853-30809f31866b tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:33.121916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-01c17417-272e-4e23-9853-30809f31866b tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:33.142291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01c17417-272e-4e23-9853-30809f31866b tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:33.142796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01c17417-272e-4e23-9853-30809f31866b tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:33.143285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01c17417-272e-4e23-9853-30809f31866b tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:33.144050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01c17417-272e-4e23-9853-30809f31866b tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:33.144517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01c17417-272e-4e23-9853-30809f31866b tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:33.144947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01c17417-272e-4e23-9853-30809f31866b tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:33.851429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-01c17417-272e-4e23-9853-30809f31866b tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:33.875941 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-01c17417-272e-4e23-9853-30809f31866b tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1272 microversion: 2.1 time: 0.778363 Sep 08 13:27:33.878267 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2780/5424] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:33 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1272 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:34.926517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-89c5bf90-c7bd-4669-bb6d-c7008ae70e60 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:34.929184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-89c5bf90-c7bd-4669-bb6d-c7008ae70e60 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:34.963162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89c5bf90-c7bd-4669-bb6d-c7008ae70e60 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:34.971342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89c5bf90-c7bd-4669-bb6d-c7008ae70e60 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:34.972550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89c5bf90-c7bd-4669-bb6d-c7008ae70e60 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:34.974131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89c5bf90-c7bd-4669-bb6d-c7008ae70e60 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:34.975285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89c5bf90-c7bd-4669-bb6d-c7008ae70e60 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:34.976431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-89c5bf90-c7bd-4669-bb6d-c7008ae70e60 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:35.656122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-89c5bf90-c7bd-4669-bb6d-c7008ae70e60 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:35.678995 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-89c5bf90-c7bd-4669-bb6d-c7008ae70e60 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1314 microversion: 2.1 time: 0.759611 Sep 08 13:27:35.687705 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2645/5425] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:34 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:36.712233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-37bfb238-cd08-4472-a499-650ef0d185a2 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:36.713103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-37bfb238-cd08-4472-a499-650ef0d185a2 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:36.736390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37bfb238-cd08-4472-a499-650ef0d185a2 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:36.737269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37bfb238-cd08-4472-a499-650ef0d185a2 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:36.738059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37bfb238-cd08-4472-a499-650ef0d185a2 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:36.739421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37bfb238-cd08-4472-a499-650ef0d185a2 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:36.740249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37bfb238-cd08-4472-a499-650ef0d185a2 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:36.741027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37bfb238-cd08-4472-a499-650ef0d185a2 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:37.013612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-37bfb238-cd08-4472-a499-650ef0d185a2 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:37.026323 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-37bfb238-cd08-4472-a499-650ef0d185a2 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1314 microversion: 2.1 time: 0.320921 Sep 08 13:27:37.026958 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2781/5426] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:36 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:37.425494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2a01f2bd-44b0-4d7f-a63b-afa1a738e835 req-5ce4d000-8da7-44f3-a393-55015fda7a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edf1eca3-3536-4223-98d9-0099f80e5a2d", "tag": "610682d3-6591-4129-b2c4-34a50fc4e4f2"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:27:37.480339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2a01f2bd-44b0-4d7f-a63b-afa1a738e835 req-5ce4d000-8da7-44f3-a393-55015fda7a19 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:37.481366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2a01f2bd-44b0-4d7f-a63b-afa1a738e835 req-5ce4d000-8da7-44f3-a393-55015fda7a19 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:37.482255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2a01f2bd-44b0-4d7f-a63b-afa1a738e835 req-5ce4d000-8da7-44f3-a393-55015fda7a19 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:37.531534 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2a01f2bd-44b0-4d7f-a63b-afa1a738e835 req-5ce4d000-8da7-44f3-a393-55015fda7a19 service nova] Creating event network-changed:610682d3-6591-4129-b2c4-34a50fc4e4f2 for instance edf1eca3-3536-4223-98d9-0099f80e5a2d on n-h1-852084-10 Sep 08 13:27:37.557948 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2a01f2bd-44b0-4d7f-a63b-afa1a738e835 req-5ce4d000-8da7-44f3-a393-55015fda7a19 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140078 Sep 08 13:27:37.561864 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2646/5427] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:27:38.070295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-daa3eef3-2c97-45c1-b6d9-d1dab6fea921 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:38.072773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-daa3eef3-2c97-45c1-b6d9-d1dab6fea921 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:38.087199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-daa3eef3-2c97-45c1-b6d9-d1dab6fea921 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:38.088849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-daa3eef3-2c97-45c1-b6d9-d1dab6fea921 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:38.089914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-daa3eef3-2c97-45c1-b6d9-d1dab6fea921 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:38.092178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-daa3eef3-2c97-45c1-b6d9-d1dab6fea921 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:38.093290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-daa3eef3-2c97-45c1-b6d9-d1dab6fea921 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:38.094340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-daa3eef3-2c97-45c1-b6d9-d1dab6fea921 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:38.401532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-daa3eef3-2c97-45c1-b6d9-d1dab6fea921 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:38.418813 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-daa3eef3-2c97-45c1-b6d9-d1dab6fea921 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1314 microversion: 2.1 time: 0.355234 Sep 08 13:27:38.421800 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2782/5428] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:38 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:39.455657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:39.466195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3e2f8cad-5fd1-4f8b-86df-ca7557ceb720 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:39.468821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3e2f8cad-5fd1-4f8b-86df-ca7557ceb720 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:39.482796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e2f8cad-5fd1-4f8b-86df-ca7557ceb720 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:39.484056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e2f8cad-5fd1-4f8b-86df-ca7557ceb720 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:39.485101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e2f8cad-5fd1-4f8b-86df-ca7557ceb720 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:39.486687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e2f8cad-5fd1-4f8b-86df-ca7557ceb720 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:39.488061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e2f8cad-5fd1-4f8b-86df-ca7557ceb720 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:39.489132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e2f8cad-5fd1-4f8b-86df-ca7557ceb720 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:39.799952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3e2f8cad-5fd1-4f8b-86df-ca7557ceb720 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:39.814404 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3e2f8cad-5fd1-4f8b-86df-ca7557ceb720 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1314 microversion: 2.1 time: 0.361922 Sep 08 13:27:39.828277 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2647/5429] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:39 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:40.864038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-03d169f7-e2be-4ee3-b624-83466e408f93 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:40.870017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-03d169f7-e2be-4ee3-b624-83466e408f93 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:40.898513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:40.905367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03d169f7-e2be-4ee3-b624-83466e408f93 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:40.906483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03d169f7-e2be-4ee3-b624-83466e408f93 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:40.907362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03d169f7-e2be-4ee3-b624-83466e408f93 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:40.908607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03d169f7-e2be-4ee3-b624-83466e408f93 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:40.909917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03d169f7-e2be-4ee3-b624-83466e408f93 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:40.910698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-03d169f7-e2be-4ee3-b624-83466e408f93 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:41.297314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-03d169f7-e2be-4ee3-b624-83466e408f93 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:41.317844 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-03d169f7-e2be-4ee3-b624-83466e408f93 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1314 microversion: 2.1 time: 0.466721 Sep 08 13:27:41.319394 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2783/5430] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:40 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1314 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:42.363721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-67c80cf4-396e-4858-9ff5-2ba2764bf41d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:42.367174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-67c80cf4-396e-4858-9ff5-2ba2764bf41d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:42.388534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:42.391833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67c80cf4-396e-4858-9ff5-2ba2764bf41d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:42.392704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67c80cf4-396e-4858-9ff5-2ba2764bf41d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:42.393789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67c80cf4-396e-4858-9ff5-2ba2764bf41d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:42.395420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67c80cf4-396e-4858-9ff5-2ba2764bf41d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:42.396528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67c80cf4-396e-4858-9ff5-2ba2764bf41d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:42.397894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67c80cf4-396e-4858-9ff5-2ba2764bf41d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:42.953537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-67c80cf4-396e-4858-9ff5-2ba2764bf41d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:42.978161 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-67c80cf4-396e-4858-9ff5-2ba2764bf41d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1314 microversion: 2.1 time: 0.625371 Sep 08 13:27:42.978807 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2648/5431] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:42 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1314 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:44.030382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-934b84b4-9113-4336-a64b-d0c16f15464f tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:44.033198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-934b84b4-9113-4336-a64b-d0c16f15464f tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:44.068197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-934b84b4-9113-4336-a64b-d0c16f15464f tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:44.073183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-934b84b4-9113-4336-a64b-d0c16f15464f tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:44.078909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-934b84b4-9113-4336-a64b-d0c16f15464f tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:44.087328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-934b84b4-9113-4336-a64b-d0c16f15464f tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:44.088120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-934b84b4-9113-4336-a64b-d0c16f15464f tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:44.088903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-934b84b4-9113-4336-a64b-d0c16f15464f tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:44.540306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-934b84b4-9113-4336-a64b-d0c16f15464f tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:44.560547 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-934b84b4-9113-4336-a64b-d0c16f15464f tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1314 microversion: 2.1 time: 0.545405 Sep 08 13:27:44.586668 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2784/5432] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:44 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1314 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:45.612154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-13a2bb82-8b92-4dec-a38d-60dcf2ab98ba tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:45.613483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-13a2bb82-8b92-4dec-a38d-60dcf2ab98ba tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:45.624757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:45.636081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13a2bb82-8b92-4dec-a38d-60dcf2ab98ba tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:45.637303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13a2bb82-8b92-4dec-a38d-60dcf2ab98ba tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:45.638840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13a2bb82-8b92-4dec-a38d-60dcf2ab98ba tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:45.640941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13a2bb82-8b92-4dec-a38d-60dcf2ab98ba tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:45.642063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13a2bb82-8b92-4dec-a38d-60dcf2ab98ba tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:45.643546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-13a2bb82-8b92-4dec-a38d-60dcf2ab98ba tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:45.990361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-13a2bb82-8b92-4dec-a38d-60dcf2ab98ba tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:46.013970 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-13a2bb82-8b92-4dec-a38d-60dcf2ab98ba tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1314 microversion: 2.1 time: 0.415183 Sep 08 13:27:46.015291 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2649/5433] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:45 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:46.085637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-736f3830-5c35-42d0-a154-3c2262768dde req-e76cefee-aeef-409f-ab57-bd3c339d966d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf1eca3-3536-4223-98d9-0099f80e5a2d", "name": "network-vif-plugged", "status": "completed", "tag": "610682d3-6591-4129-b2c4-34a50fc4e4f2"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:27:46.094336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=27 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:46.107251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-736f3830-5c35-42d0-a154-3c2262768dde req-e76cefee-aeef-409f-ab57-bd3c339d966d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:46.108155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-736f3830-5c35-42d0-a154-3c2262768dde req-e76cefee-aeef-409f-ab57-bd3c339d966d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:46.108589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-736f3830-5c35-42d0-a154-3c2262768dde req-e76cefee-aeef-409f-ab57-bd3c339d966d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:46.113809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=55 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:46.133583 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-736f3830-5c35-42d0-a154-3c2262768dde req-e76cefee-aeef-409f-ab57-bd3c339d966d service nova] Creating event network-vif-plugged:610682d3-6591-4129-b2c4-34a50fc4e4f2 for instance edf1eca3-3536-4223-98d9-0099f80e5a2d on n-h1-852084-10 Sep 08 13:27:46.140663 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-736f3830-5c35-42d0-a154-3c2262768dde req-e76cefee-aeef-409f-ab57-bd3c339d966d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.223911 Sep 08 13:27:46.142256 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2785/5434] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:27:47.058532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a3c7d47-22b5-4c98-ab73-6b6d1797905d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:47.061461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2a3c7d47-22b5-4c98-ab73-6b6d1797905d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:47.073786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a3c7d47-22b5-4c98-ab73-6b6d1797905d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:47.074807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a3c7d47-22b5-4c98-ab73-6b6d1797905d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:47.075682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a3c7d47-22b5-4c98-ab73-6b6d1797905d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:47.077366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a3c7d47-22b5-4c98-ab73-6b6d1797905d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:47.078301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a3c7d47-22b5-4c98-ab73-6b6d1797905d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:47.079463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a3c7d47-22b5-4c98-ab73-6b6d1797905d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:47.461477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2a3c7d47-22b5-4c98-ab73-6b6d1797905d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:47.469947 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a3c7d47-22b5-4c98-ab73-6b6d1797905d tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1314 microversion: 2.1 time: 0.418616 Sep 08 13:27:47.473489 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2650/5435] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:47 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1314 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:48.504462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c7eb8956-42fd-4027-a422-d6a1d0edaf8c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:48.505630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c7eb8956-42fd-4027-a422-d6a1d0edaf8c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:48.518228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7eb8956-42fd-4027-a422-d6a1d0edaf8c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:48.519128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7eb8956-42fd-4027-a422-d6a1d0edaf8c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:48.519963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7eb8956-42fd-4027-a422-d6a1d0edaf8c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:48.532890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7eb8956-42fd-4027-a422-d6a1d0edaf8c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:48.534061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7eb8956-42fd-4027-a422-d6a1d0edaf8c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:48.535094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c7eb8956-42fd-4027-a422-d6a1d0edaf8c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:48.859802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62d962aa-7d81-4703-a597-bd87f8409a38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: .version_select at 0x7fdb3b08dc10>, body: {"keypair": {"name": "tempest-keypair-1799906652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFTnN+ACBzS3VV1vxDeEE19R9+4dMW8PpX7zGxaQZYomB5BacN5HZOxaQHwRlqYUWIZm1vpN0uuA+O8grnlpe209x2iWnqGCsjlurPAS6gu0c1WMs3B5F4bt5oTdWu5XA=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:27:48.891888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-62d962aa-7d81-4703-a597-bd87f8409a38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for project efc65cf30371430a9b085afea75e7a5b. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:27:48.900590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-62d962aa-7d81-4703-a597-bd87f8409a38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for user 1c622939c63749dc944918e2717cd09a and project efc65cf30371430a9b085afea75e7a5b. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:27:48.945620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c7eb8956-42fd-4027-a422-d6a1d0edaf8c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:48.952861 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62d962aa-7d81-4703-a597-bd87f8409a38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.096439 Sep 08 13:27:48.953153 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2651/5436] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:27:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:27:48.965014 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c7eb8956-42fd-4027-a422-d6a1d0edaf8c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1498 microversion: 2.1 time: 0.471171 Sep 08 13:27:48.967974 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2786/5437] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:48 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1498 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:27:52.518278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1537859896", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed1157e7-c274-4d74-a471-1eb655ce6d93"}], "security_groups": [{"name": "tempest-securitygroup--1718664980"}], "key_name": "tempest-keypair-1799906652", "user_data": "}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:27:52.840006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] validate_networks() for [('ed1157e7-c274-4d74-a471-1eb655ce6d93', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:27:54.000881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:27:54.003164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:27:54.004358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:27:54.005176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:27:54.005938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:27:54.045802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:54.046615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:54.047457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:54.048903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:54.049830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:54.058038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:54.140327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for project efc65cf30371430a9b085afea75e7a5b. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:27:54.169897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for user 1c622939c63749dc944918e2717cd09a and project efc65cf30371430a9b085afea75e7a5b. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:27:54.226111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:27:54.251710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:27:54.470144 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a085d97b-9526-4681-b223-de6ec2789eba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.959052 Sep 08 13:27:54.475304 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2652/5438] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:27:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:27:54.493714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4f64aadb-bf21-4879-8514-a9e44756d158 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:54.499895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4f64aadb-bf21-4879-8514-a9e44756d158 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:54.768917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9bef464c-f037-42e5-99c6-78ec85c0e963 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:54.769414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9bef464c-f037-42e5-99c6-78ec85c0e963 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:54.788832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bef464c-f037-42e5-99c6-78ec85c0e963 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:54.793330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bef464c-f037-42e5-99c6-78ec85c0e963 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:54.802177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bef464c-f037-42e5-99c6-78ec85c0e963 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:54.811102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bef464c-f037-42e5-99c6-78ec85c0e963 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:54.827125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bef464c-f037-42e5-99c6-78ec85c0e963 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:54.847409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9bef464c-f037-42e5-99c6-78ec85c0e963 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:54.944505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4f64aadb-bf21-4879-8514-a9e44756d158 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:54.953301 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4f64aadb-bf21-4879-8514-a9e44756d158 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1242 microversion: 2.1 time: 0.467145 Sep 08 13:27:54.963930 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2787/5439] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:54 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1242 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:27:54.971487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9bef464c-f037-42e5-99c6-78ec85c0e963 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:27:55.205151 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9bef464c-f037-42e5-99c6-78ec85c0e963 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "DELETE /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 204 len: 0 microversion: 2.1 time: 0.442904 Sep 08 13:27:55.207651 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2653/5440] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:27:54 2022] DELETE /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 0 bytes in 447 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:27:55.217600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ff6b9079-3f20-4d3d-b9bb-11edf6c21aff tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:55.218386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff6b9079-3f20-4d3d-b9bb-11edf6c21aff tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:55.239196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff6b9079-3f20-4d3d-b9bb-11edf6c21aff tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:55.241331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff6b9079-3f20-4d3d-b9bb-11edf6c21aff tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:55.242430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff6b9079-3f20-4d3d-b9bb-11edf6c21aff tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:55.244045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff6b9079-3f20-4d3d-b9bb-11edf6c21aff tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:55.245120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff6b9079-3f20-4d3d-b9bb-11edf6c21aff tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:55.248786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff6b9079-3f20-4d3d-b9bb-11edf6c21aff tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:55.485354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ff6b9079-3f20-4d3d-b9bb-11edf6c21aff tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:55.495960 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ff6b9079-3f20-4d3d-b9bb-11edf6c21aff tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1504 microversion: 2.1 time: 0.282488 Sep 08 13:27:55.497590 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2788/5441] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:55 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1504 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:55.988060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2d8129b2-06de-4953-a1f0-756b6d25a6b7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:55.991499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2d8129b2-06de-4953-a1f0-756b6d25a6b7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:56.008438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d8129b2-06de-4953-a1f0-756b6d25a6b7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:56.009439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d8129b2-06de-4953-a1f0-756b6d25a6b7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:56.010143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d8129b2-06de-4953-a1f0-756b6d25a6b7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:56.011881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d8129b2-06de-4953-a1f0-756b6d25a6b7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:56.012972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d8129b2-06de-4953-a1f0-756b6d25a6b7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:56.014718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d8129b2-06de-4953-a1f0-756b6d25a6b7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:56.149472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2d8129b2-06de-4953-a1f0-756b6d25a6b7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:56.163020 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2d8129b2-06de-4953-a1f0-756b6d25a6b7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1294 microversion: 2.1 time: 0.183148 Sep 08 13:27:56.164024 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2654/5442] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:55 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1294 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:27:56.536750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6a9d7f6e-eed6-4e57-93c2-bef69d9878bb tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:56.539795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6a9d7f6e-eed6-4e57-93c2-bef69d9878bb tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:56.581518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a9d7f6e-eed6-4e57-93c2-bef69d9878bb tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:56.582414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a9d7f6e-eed6-4e57-93c2-bef69d9878bb tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:56.583277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a9d7f6e-eed6-4e57-93c2-bef69d9878bb tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:56.584628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a9d7f6e-eed6-4e57-93c2-bef69d9878bb tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:56.585485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a9d7f6e-eed6-4e57-93c2-bef69d9878bb tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:56.600540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a9d7f6e-eed6-4e57-93c2-bef69d9878bb tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:57.008493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6a9d7f6e-eed6-4e57-93c2-bef69d9878bb tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:57.027997 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6a9d7f6e-eed6-4e57-93c2-bef69d9878bb tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1504 microversion: 2.1 time: 0.499467 Sep 08 13:27:57.048960 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2789/5443] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:56 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1504 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:57.207891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7b2af4b2-b598-40e2-a3f7-0bdb78b1f16c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:57.208691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7b2af4b2-b598-40e2-a3f7-0bdb78b1f16c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:57.222649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b2af4b2-b598-40e2-a3f7-0bdb78b1f16c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:57.223311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b2af4b2-b598-40e2-a3f7-0bdb78b1f16c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:57.223973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b2af4b2-b598-40e2-a3f7-0bdb78b1f16c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:57.226174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b2af4b2-b598-40e2-a3f7-0bdb78b1f16c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:57.226893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b2af4b2-b598-40e2-a3f7-0bdb78b1f16c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:57.228109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b2af4b2-b598-40e2-a3f7-0bdb78b1f16c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:57.359443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7b2af4b2-b598-40e2-a3f7-0bdb78b1f16c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:57.369463 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7b2af4b2-b598-40e2-a3f7-0bdb78b1f16c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1300 microversion: 2.1 time: 0.167337 Sep 08 13:27:57.370919 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2655/5444] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:57 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1300 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:58.076820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d3187480-b543-4077-b09e-aefede170907 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:58.077645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d3187480-b543-4077-b09e-aefede170907 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:58.099054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3187480-b543-4077-b09e-aefede170907 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:58.099928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3187480-b543-4077-b09e-aefede170907 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:58.100728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3187480-b543-4077-b09e-aefede170907 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:58.102064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3187480-b543-4077-b09e-aefede170907 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:58.102865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3187480-b543-4077-b09e-aefede170907 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:58.103693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d3187480-b543-4077-b09e-aefede170907 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:58.426277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1bb1e38a-d289-4518-9326-a9af47ba7606 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:58.428608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1bb1e38a-d289-4518-9326-a9af47ba7606 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:27:58.442045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bb1e38a-d289-4518-9326-a9af47ba7606 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:58.443275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bb1e38a-d289-4518-9326-a9af47ba7606 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:58.445487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bb1e38a-d289-4518-9326-a9af47ba7606 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:58.447345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bb1e38a-d289-4518-9326-a9af47ba7606 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:58.449148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bb1e38a-d289-4518-9326-a9af47ba7606 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:58.450309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bb1e38a-d289-4518-9326-a9af47ba7606 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:58.503516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:27:58.941278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d3187480-b543-4077-b09e-aefede170907 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:58.952589 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d3187480-b543-4077-b09e-aefede170907 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1504 microversion: 2.1 time: 0.882246 Sep 08 13:27:58.969046 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2790/5445] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:58 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1504 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:59.129615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1bb1e38a-d289-4518-9326-a9af47ba7606 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:27:59.173322 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1bb1e38a-d289-4518-9326-a9af47ba7606 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1368 microversion: 2.1 time: 0.754881 Sep 08 13:27:59.189000 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2656/5446] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:58 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1368 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:27:59.398157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-18bdae8e-c642-4d95-bdf6-98d5fbc03726 req-5a1af4fa-503e-410a-b0a9-ce44a270c7ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edf1eca3-3536-4223-98d9-0099f80e5a2d", "name": "network-vif-deleted", "tag": "610682d3-6591-4129-b2c4-34a50fc4e4f2"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:27:59.453716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-18bdae8e-c642-4d95-bdf6-98d5fbc03726 req-5a1af4fa-503e-410a-b0a9-ce44a270c7ec service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:27:59.457636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-18bdae8e-c642-4d95-bdf6-98d5fbc03726 req-5a1af4fa-503e-410a-b0a9-ce44a270c7ec service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:27:59.458621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-18bdae8e-c642-4d95-bdf6-98d5fbc03726 req-5a1af4fa-503e-410a-b0a9-ce44a270c7ec service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:27:59.497231 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-18bdae8e-c642-4d95-bdf6-98d5fbc03726 req-5a1af4fa-503e-410a-b0a9-ce44a270c7ec service nova] Creating event network-vif-deleted:610682d3-6591-4129-b2c4-34a50fc4e4f2 for instance edf1eca3-3536-4223-98d9-0099f80e5a2d on n-h1-852084-10 Sep 08 13:27:59.507407 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-18bdae8e-c642-4d95-bdf6-98d5fbc03726 req-5a1af4fa-503e-410a-b0a9-ce44a270c7ec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120496 Sep 08 13:27:59.508568 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2791/5447] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:27:59.988266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:27:59.990355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:00.002049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:00.003127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:00.003997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:00.005080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:00.005828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:00.006469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:00.082067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:00.083497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:00.085212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:00.086159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lazy-loading 'fault' on Instance uuid edf1eca3-3536-4223-98d9-0099f80e5a2d {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:28:00.224994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-651740c9-216f-44c8-920b-46a0bae7e98f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:00.226459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-651740c9-216f-44c8-920b-46a0bae7e98f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:00.243140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-651740c9-216f-44c8-920b-46a0bae7e98f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:00.243976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-651740c9-216f-44c8-920b-46a0bae7e98f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:00.245040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-651740c9-216f-44c8-920b-46a0bae7e98f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:00.246803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-651740c9-216f-44c8-920b-46a0bae7e98f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:00.247946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-651740c9-216f-44c8-920b-46a0bae7e98f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:00.248940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-651740c9-216f-44c8-920b-46a0bae7e98f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:00.311778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f9fe07216fc4d30854454643d2b061c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c0fbc6ff8db40a9ac9c337957bcb3eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:28:00.346561 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4be9069e-2b39-4b60-b40a-a9683c5bbc87 tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 200 len: 1304 microversion: 2.1 time: 0.359094 Sep 08 13:28:00.348158 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2657/5448] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:27:59 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 1304 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:28:00.730595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-651740c9-216f-44c8-920b-46a0bae7e98f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:28:00.741097 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-651740c9-216f-44c8-920b-46a0bae7e98f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1368 microversion: 2.1 time: 0.526232 Sep 08 13:28:00.744197 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2792/5449] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:28:00 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1368 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:28:01.161658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-790c0f4d-4b54-42d9-92db-52451629c816 req-aaf576e8-94ec-46c8-81dc-37cdad61a770 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b683e9-3941-42a3-93e2-f68d4c5f0d4a", "tag": "567d9faa-8120-4e9d-bca1-569fd9c08e90"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:28:01.187905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-790c0f4d-4b54-42d9-92db-52451629c816 req-aaf576e8-94ec-46c8-81dc-37cdad61a770 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:01.188583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-790c0f4d-4b54-42d9-92db-52451629c816 req-aaf576e8-94ec-46c8-81dc-37cdad61a770 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:01.189124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-790c0f4d-4b54-42d9-92db-52451629c816 req-aaf576e8-94ec-46c8-81dc-37cdad61a770 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:01.215154 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-790c0f4d-4b54-42d9-92db-52451629c816 req-aaf576e8-94ec-46c8-81dc-37cdad61a770 service nova] Creating event network-changed:567d9faa-8120-4e9d-bca1-569fd9c08e90 for instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a on n-h2-852084-10 Sep 08 13:28:01.224919 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-790c0f4d-4b54-42d9-92db-52451629c816 req-aaf576e8-94ec-46c8-81dc-37cdad61a770 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066890 Sep 08 13:28:01.226024 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2658/5450] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:28:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:28:01.399071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3cb2327a-fc9d-403b-ab92-3bdf7107fc2c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:01.400498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3cb2327a-fc9d-403b-ab92-3bdf7107fc2c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] [instance: edf1eca3-3536-4223-98d9-0099f80e5a2d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:01.412470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cb2327a-fc9d-403b-ab92-3bdf7107fc2c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:01.414430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cb2327a-fc9d-403b-ab92-3bdf7107fc2c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:01.415359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cb2327a-fc9d-403b-ab92-3bdf7107fc2c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:01.416772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cb2327a-fc9d-403b-ab92-3bdf7107fc2c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:01.417693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cb2327a-fc9d-403b-ab92-3bdf7107fc2c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:01.418546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cb2327a-fc9d-403b-ab92-3bdf7107fc2c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:01.448796 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-3cb2327a-fc9d-403b-ab92-3bdf7107fc2c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] HTTP exception thrown: Instance edf1eca3-3536-4223-98d9-0099f80e5a2d could not be found. Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3cb2327a-fc9d-403b-ab92-3bdf7107fc2c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Request method failure captured: Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d HTTP/1.1 Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe27aW3c2BRUti5GTAZ-OsDLEbkw5-WVrkhcG5q-xas_2QnKUVp4_ByKK-hqZXlOpjJ7VANVDr2Agzl2tPR2qRGEzh1rIzOSrOAiA5beeRAWO_8TcO8IEJS7IHK2KcYn8bbufoqBG1olmb3QQX7WZt-RPbH9I_hndq9HaqfE6emWJf8 Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 6c0fbc6ff8db40a9ac9c337957bcb3eb Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-VolumesActionsTest-1924033913 Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_6c0fbc6ff8db40a9ac9c337957bcb3eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/6c0fbc6ff8db40a9ac9c337957bcb3eb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c0fbc6ff8db40a9ac9c337957bcb3eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/6c0fbc6ff8db40a9ac9c337957bcb3eb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-VolumesActionsTest-1924033913 Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 6c0fbc6ff8db40a9ac9c337957bcb3eb Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-VolumesActionsTest-1924033913 Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-VolumesActionsTest-1924033913-project Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6f9fe07216fc4d30854454643d2b061c Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-VolumesActionsTest-1924033913-project Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance edf1eca3-3536-4223-98d9-0099f80e5a2d could not be found. Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'edf1eca3-3536-4223-98d9-0099f80e5a2d'} Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edf1eca3-3536-4223-98d9-0099f80e5a2d could not be found. Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edf1eca3-3536-4223-98d9-0099f80e5a2d could not be found. Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:28:01.452473 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:28:01.468010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:28:01.468010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:28:01.468010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:28:01.468010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:28:01.468010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:28:01.468010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edf1eca3-3536-4223-98d9-0099f80e5a2d could not be found. Sep 08 13:28:01.468010 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:28:01.468010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3cb2327a-fc9d-403b-ab92-3bdf7107fc2c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] Returning 404 to user: Instance edf1eca3-3536-4223-98d9-0099f80e5a2d could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:28:01.468010 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3cb2327a-fc9d-403b-ab92-3bdf7107fc2c tempest-VolumesActionsTest-1924033913 tempest-VolumesActionsTest-1924033913-project] 10.222.0.78 "GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d" status: 404 len: 111 microversion: 2.1 time: 0.065710 Sep 08 13:28:01.468010 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2793/5451] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:28:01 2022] GET /compute/v2.1/servers/edf1eca3-3536-4223-98d9-0099f80e5a2d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:28:01.790250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-98d64387-09b8-4152-ab09-140409a24305 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:01.813268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-98d64387-09b8-4152-ab09-140409a24305 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:01.830269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98d64387-09b8-4152-ab09-140409a24305 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:01.831994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98d64387-09b8-4152-ab09-140409a24305 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:01.832522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98d64387-09b8-4152-ab09-140409a24305 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:01.833610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98d64387-09b8-4152-ab09-140409a24305 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:01.834152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98d64387-09b8-4152-ab09-140409a24305 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:01.834695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98d64387-09b8-4152-ab09-140409a24305 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:02.119665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-98d64387-09b8-4152-ab09-140409a24305 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:28:02.128625 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-98d64387-09b8-4152-ab09-140409a24305 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1368 microversion: 2.1 time: 0.353247 Sep 08 13:28:02.129235 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2659/5452] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:28:01 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1368 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:28:03.173900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f1d8704f-c7d5-4b83-950b-31dcd012ad42 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:03.180012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f1d8704f-c7d5-4b83-950b-31dcd012ad42 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:03.231382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1d8704f-c7d5-4b83-950b-31dcd012ad42 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:03.232986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1d8704f-c7d5-4b83-950b-31dcd012ad42 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:03.235849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1d8704f-c7d5-4b83-950b-31dcd012ad42 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:03.237442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1d8704f-c7d5-4b83-950b-31dcd012ad42 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:03.239801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1d8704f-c7d5-4b83-950b-31dcd012ad42 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:03.241396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1d8704f-c7d5-4b83-950b-31dcd012ad42 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:03.656388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f1d8704f-c7d5-4b83-950b-31dcd012ad42 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:28:03.696909 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f1d8704f-c7d5-4b83-950b-31dcd012ad42 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1368 microversion: 2.1 time: 0.528380 Sep 08 13:28:03.698119 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2794/5453] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:28:03 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1368 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:28:04.772112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e2a919c-0097-4227-a414-1ba755694b31 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:04.776375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6e2a919c-0097-4227-a414-1ba755694b31 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:04.795413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:28:04.797723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=10 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:28:04.801606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e2a919c-0097-4227-a414-1ba755694b31 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:04.803134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e2a919c-0097-4227-a414-1ba755694b31 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:04.804404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e2a919c-0097-4227-a414-1ba755694b31 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:04.806608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e2a919c-0097-4227-a414-1ba755694b31 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:04.807798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e2a919c-0097-4227-a414-1ba755694b31 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:04.808811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e2a919c-0097-4227-a414-1ba755694b31 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:05.113731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6e2a919c-0097-4227-a414-1ba755694b31 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:28:05.132906 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e2a919c-0097-4227-a414-1ba755694b31 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1368 microversion: 2.1 time: 0.371661 Sep 08 13:28:05.135194 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2660/5454] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:28:04 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1368 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:28:06.180290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f3532be8-dc37-4622-957c-02af194b2993 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:06.187850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f3532be8-dc37-4622-957c-02af194b2993 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:06.206330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:28:06.212405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3532be8-dc37-4622-957c-02af194b2993 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:06.213371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3532be8-dc37-4622-957c-02af194b2993 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:06.214480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3532be8-dc37-4622-957c-02af194b2993 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:06.215817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3532be8-dc37-4622-957c-02af194b2993 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:06.216655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3532be8-dc37-4622-957c-02af194b2993 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:06.217356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3532be8-dc37-4622-957c-02af194b2993 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:06.460068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f3532be8-dc37-4622-957c-02af194b2993 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:28:06.472900 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f3532be8-dc37-4622-957c-02af194b2993 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1368 microversion: 2.1 time: 0.297698 Sep 08 13:28:06.491311 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2795/5455] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:28:06 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1368 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:28:07.207288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0af17a5e-94fc-4766-b295-f5bdf093e4e8 req-cb20b624-ff3f-4cc8-828e-51159d2a7f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b683e9-3941-42a3-93e2-f68d4c5f0d4a", "name": "network-vif-plugged", "status": "completed", "tag": "567d9faa-8120-4e9d-bca1-569fd9c08e90"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:28:07.236367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0af17a5e-94fc-4766-b295-f5bdf093e4e8 req-cb20b624-ff3f-4cc8-828e-51159d2a7f15 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:07.237269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0af17a5e-94fc-4766-b295-f5bdf093e4e8 req-cb20b624-ff3f-4cc8-828e-51159d2a7f15 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:07.237939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0af17a5e-94fc-4766-b295-f5bdf093e4e8 req-cb20b624-ff3f-4cc8-828e-51159d2a7f15 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:07.296908 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0af17a5e-94fc-4766-b295-f5bdf093e4e8 req-cb20b624-ff3f-4cc8-828e-51159d2a7f15 service nova] Creating event network-vif-plugged:567d9faa-8120-4e9d-bca1-569fd9c08e90 for instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a on n-h2-852084-10 Sep 08 13:28:07.319378 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0af17a5e-94fc-4766-b295-f5bdf093e4e8 req-cb20b624-ff3f-4cc8-828e-51159d2a7f15 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113950 Sep 08 13:28:07.320358 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2661/5456] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:28:07.528180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-441de003-cfb4-4348-84cc-9b7880601226 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:07.530272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-441de003-cfb4-4348-84cc-9b7880601226 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:07.547073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441de003-cfb4-4348-84cc-9b7880601226 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:07.549509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441de003-cfb4-4348-84cc-9b7880601226 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:07.550593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441de003-cfb4-4348-84cc-9b7880601226 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:07.555363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441de003-cfb4-4348-84cc-9b7880601226 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:07.556085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441de003-cfb4-4348-84cc-9b7880601226 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:07.556693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441de003-cfb4-4348-84cc-9b7880601226 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:08.011323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-441de003-cfb4-4348-84cc-9b7880601226 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:28:08.052709 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-441de003-cfb4-4348-84cc-9b7880601226 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1368 microversion: 2.1 time: 0.527878 Sep 08 13:28:08.072405 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2796/5457] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:28:07 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1368 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:28:09.100457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-47fcef75-c9fd-431c-afe7-092238142fe8 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:09.101219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-47fcef75-c9fd-431c-afe7-092238142fe8 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:09.110301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47fcef75-c9fd-431c-afe7-092238142fe8 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:09.111072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47fcef75-c9fd-431c-afe7-092238142fe8 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:09.111546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47fcef75-c9fd-431c-afe7-092238142fe8 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:09.112471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47fcef75-c9fd-431c-afe7-092238142fe8 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:09.113115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47fcef75-c9fd-431c-afe7-092238142fe8 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:09.125098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-47fcef75-c9fd-431c-afe7-092238142fe8 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:09.439304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-47fcef75-c9fd-431c-afe7-092238142fe8 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:28:09.458976 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-47fcef75-c9fd-431c-afe7-092238142fe8 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1557 microversion: 2.1 time: 0.362896 Sep 08 13:28:09.459629 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2662/5458] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:28:09 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1557 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:28:09.501860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-48faef01-0898-4a26-820f-4d66fdadcdbc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:09.502550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-48faef01-0898-4a26-820f-4d66fdadcdbc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:09.514979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48faef01-0898-4a26-820f-4d66fdadcdbc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:09.515557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48faef01-0898-4a26-820f-4d66fdadcdbc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:09.516218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48faef01-0898-4a26-820f-4d66fdadcdbc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:09.517139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48faef01-0898-4a26-820f-4d66fdadcdbc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:09.517604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48faef01-0898-4a26-820f-4d66fdadcdbc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:09.518395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48faef01-0898-4a26-820f-4d66fdadcdbc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:09.618293 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-48faef01-0898-4a26-820f-4d66fdadcdbc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.125034 Sep 08 13:28:09.619276 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2797/5459] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:28:09 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a/os-interface => generated 284 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:28:11.668350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-446de773-64df-41c2-a1c1-bbed083d1105 req-4e72cf9e-a663-41a4-8508-893e4dd2d37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e8b683e9-3941-42a3-93e2-f68d4c5f0d4a", "tag": "567d9faa-8120-4e9d-bca1-569fd9c08e90"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:28:11.684012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-446de773-64df-41c2-a1c1-bbed083d1105 req-4e72cf9e-a663-41a4-8508-893e4dd2d37a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:11.684585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-446de773-64df-41c2-a1c1-bbed083d1105 req-4e72cf9e-a663-41a4-8508-893e4dd2d37a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:11.685107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-446de773-64df-41c2-a1c1-bbed083d1105 req-4e72cf9e-a663-41a4-8508-893e4dd2d37a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:11.703425 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-446de773-64df-41c2-a1c1-bbed083d1105 req-4e72cf9e-a663-41a4-8508-893e4dd2d37a service nova] Creating event network-changed:567d9faa-8120-4e9d-bca1-569fd9c08e90 for instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a on n-h2-852084-10 Sep 08 13:28:11.718956 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-446de773-64df-41c2-a1c1-bbed083d1105 req-4e72cf9e-a663-41a4-8508-893e4dd2d37a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055305 Sep 08 13:28:11.720126 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2663/5460] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:28:46.444131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=27 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:28:46.445124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=57 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:28:46.450438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2dab21f8-2d99-401c-9305-fa340f5e0c8a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:46.451180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2dab21f8-2d99-401c-9305-fa340f5e0c8a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:46.459744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2dab21f8-2d99-401c-9305-fa340f5e0c8a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:46.460450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2dab21f8-2d99-401c-9305-fa340f5e0c8a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:46.460769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2dab21f8-2d99-401c-9305-fa340f5e0c8a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:46.461707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2dab21f8-2d99-401c-9305-fa340f5e0c8a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:46.462362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2dab21f8-2d99-401c-9305-fa340f5e0c8a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:46.462934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2dab21f8-2d99-401c-9305-fa340f5e0c8a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:46.491366 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2dab21f8-2d99-401c-9305-fa340f5e0c8a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a/ips" status: 200 len: 149 microversion: 2.1 time: 0.049274 Sep 08 13:28:46.492252 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2798/5461] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 13:28:46 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a/ips => generated 149 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:28:46.513094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b0f03d3a-ded1-477f-9807-04961c376767 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44df3293-93c2-43bc-9cdd-32d0656fbdc4"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:28:46.517898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b0f03d3a-ded1-477f-9807-04961c376767 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:46.523759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:28:46.526455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=35 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:28:46.539007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0f03d3a-ded1-477f-9807-04961c376767 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:46.540312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0f03d3a-ded1-477f-9807-04961c376767 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:46.541168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0f03d3a-ded1-477f-9807-04961c376767 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:46.543775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0f03d3a-ded1-477f-9807-04961c376767 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:46.545465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0f03d3a-ded1-477f-9807-04961c376767 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:46.546638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0f03d3a-ded1-477f-9807-04961c376767 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:46.673369 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-b0f03d3a-ded1-477f-9807-04961c376767 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Invalid volume: volume 44df3293-93c2-43bc-9cdd-32d0656fbdc4 is already attached to instances: 31c4aab1-021c-4648-8fe3-00d778b883f2 Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b0f03d3a-ded1-477f-9807-04961c376767 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a/os-volume_attachments HTTP/1.1 Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 74 Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: {"volumeAttachment": {"volumeId": "44df3293-93c2-43bc-9cdd-32d0656fbdc4"}} Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid volume: volume 44df3293-93c2-43bc-9cdd-32d0656fbdc4 is already attached to instances: 31c4aab1-021c-4648-8fe3-00d778b883f2 Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'server_id': 'e8b683e9-3941-42a3-93e2-f68d4c5f0d4a', 'body': {'volumeAttachment': {'volumeId': '44df3293-93c2-43bc-9cdd-32d0656fbdc4'}}} Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 44df3293-93c2-43bc-9cdd-32d0656fbdc4 is already attached to instances: 31c4aab1-021c-4648-8fe3-00d778b883f2 Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:28:46.688747 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 44df3293-93c2-43bc-9cdd-32d0656fbdc4 is already attached to instances: 31c4aab1-021c-4648-8fe3-00d778b883f2 Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 44df3293-93c2-43bc-9cdd-32d0656fbdc4 is already attached to instances: 31c4aab1-021c-4648-8fe3-00d778b883f2 Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b0f03d3a-ded1-477f-9807-04961c376767 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 400 to user: Invalid volume: volume 44df3293-93c2-43bc-9cdd-32d0656fbdc4 is already attached to instances: 31c4aab1-021c-4648-8fe3-00d778b883f2 {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b0f03d3a-ded1-477f-9807-04961c376767 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.190528 Sep 08 13:28:46.697294 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2664/5462] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:28:46 2022] POST /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a/os-volume_attachments => generated 174 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:28:46.710005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eabfdd12-aa04-46a7-b61a-223c37af853e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:46.710883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eabfdd12-aa04-46a7-b61a-223c37af853e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:46.722438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eabfdd12-aa04-46a7-b61a-223c37af853e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:46.723285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eabfdd12-aa04-46a7-b61a-223c37af853e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:46.724010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eabfdd12-aa04-46a7-b61a-223c37af853e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:46.725227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eabfdd12-aa04-46a7-b61a-223c37af853e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:46.726045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eabfdd12-aa04-46a7-b61a-223c37af853e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:46.726809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eabfdd12-aa04-46a7-b61a-223c37af853e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:46.773657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eabfdd12-aa04-46a7-b61a-223c37af853e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:28:46.911434 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eabfdd12-aa04-46a7-b61a-223c37af853e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 204 len: 0 microversion: 2.1 time: 0.205148 Sep 08 13:28:46.912893 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2799/5463] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:28:46 2022] DELETE /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:28:46.924289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-424ccdc1-3916-4d38-9204-23748d83bb5a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:46.925324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-424ccdc1-3916-4d38-9204-23748d83bb5a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:46.942133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-424ccdc1-3916-4d38-9204-23748d83bb5a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:46.942639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-424ccdc1-3916-4d38-9204-23748d83bb5a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:46.943083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-424ccdc1-3916-4d38-9204-23748d83bb5a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:46.943845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-424ccdc1-3916-4d38-9204-23748d83bb5a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:46.944308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-424ccdc1-3916-4d38-9204-23748d83bb5a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:46.944739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-424ccdc1-3916-4d38-9204-23748d83bb5a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:47.326622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-424ccdc1-3916-4d38-9204-23748d83bb5a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:28:47.370549 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-424ccdc1-3916-4d38-9204-23748d83bb5a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1682 microversion: 2.1 time: 0.448259 Sep 08 13:28:47.374028 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2665/5464] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:28:46 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1682 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:28:48.412670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f616fbba-d774-4907-b65f-fbd3a768ab43 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:48.413803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f616fbba-d774-4907-b65f-fbd3a768ab43 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:48.441786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f616fbba-d774-4907-b65f-fbd3a768ab43 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:48.443014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f616fbba-d774-4907-b65f-fbd3a768ab43 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:48.447258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f616fbba-d774-4907-b65f-fbd3a768ab43 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:48.448858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f616fbba-d774-4907-b65f-fbd3a768ab43 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:48.457531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f616fbba-d774-4907-b65f-fbd3a768ab43 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:48.458604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f616fbba-d774-4907-b65f-fbd3a768ab43 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:49.097090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f616fbba-d774-4907-b65f-fbd3a768ab43 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:28:49.141311 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f616fbba-d774-4907-b65f-fbd3a768ab43 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1682 microversion: 2.1 time: 0.735614 Sep 08 13:28:49.145412 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2800/5465] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:28:48 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1682 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:28:49.777059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-137d0675-bb07-4ae8-ac59-5a85317e32e2 req-b9fea928-389d-4600-bffa-ba39c8da1c41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e8b683e9-3941-42a3-93e2-f68d4c5f0d4a", "name": "network-vif-deleted", "tag": "567d9faa-8120-4e9d-bca1-569fd9c08e90"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:28:49.857721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-137d0675-bb07-4ae8-ac59-5a85317e32e2 req-b9fea928-389d-4600-bffa-ba39c8da1c41 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:49.858515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-137d0675-bb07-4ae8-ac59-5a85317e32e2 req-b9fea928-389d-4600-bffa-ba39c8da1c41 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:49.859357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-137d0675-bb07-4ae8-ac59-5a85317e32e2 req-b9fea928-389d-4600-bffa-ba39c8da1c41 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:49.912437 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-137d0675-bb07-4ae8-ac59-5a85317e32e2 req-b9fea928-389d-4600-bffa-ba39c8da1c41 service nova] Creating event network-vif-deleted:567d9faa-8120-4e9d-bca1-569fd9c08e90 for instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a on n-h2-852084-10 Sep 08 13:28:49.938461 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-137d0675-bb07-4ae8-ac59-5a85317e32e2 req-b9fea928-389d-4600-bffa-ba39c8da1c41 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169403 Sep 08 13:28:49.939775 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2666/5466] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:28:50.188055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:50.189005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:50.228945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:50.229765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:50.230496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:50.244301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:50.245092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:50.245866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:50.324074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:50.325051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:50.325907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:50.327001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lazy-loading 'fault' on Instance uuid e8b683e9-3941-42a3-93e2-f68d4c5f0d4a {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:28:50.406231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:28:50.461616 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-da697fd0-54a8-40a8-ba1d-06452e00b286 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 200 len: 1332 microversion: 2.1 time: 0.276495 Sep 08 13:28:50.464290 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2801/5467] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:28:50 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 1332 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:28:51.528090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fdab8b5-984c-435e-833b-b7c461c3bb14 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:51.536560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1fdab8b5-984c-435e-833b-b7c461c3bb14 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:51.569579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fdab8b5-984c-435e-833b-b7c461c3bb14 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:51.571813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fdab8b5-984c-435e-833b-b7c461c3bb14 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:51.573024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fdab8b5-984c-435e-833b-b7c461c3bb14 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:51.575700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fdab8b5-984c-435e-833b-b7c461c3bb14 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:51.577739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fdab8b5-984c-435e-833b-b7c461c3bb14 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:51.578740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fdab8b5-984c-435e-833b-b7c461c3bb14 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:51.615476 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1fdab8b5-984c-435e-833b-b7c461c3bb14 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fdab8b5-984c-435e-833b-b7c461c3bb14 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a HTTP/1.1 Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'e8b683e9-3941-42a3-93e2-f68d4c5f0d4a'} Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:28:51.622807 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:28:51.630333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:28:51.630333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:28:51.630333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:28:51.630333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:28:51.630333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:28:51.630333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:28:51.630333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:28:51.640504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fdab8b5-984c-435e-833b-b7c461c3bb14 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 404 to user: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:28:51.641869 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1fdab8b5-984c-435e-833b-b7c461c3bb14 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 404 len: 111 microversion: 2.1 time: 0.124561 Sep 08 13:28:51.643999 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2667/5468] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:28:51 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:28:51.655443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1e3acc86-db97-47d1-a0a4-f41888423f64 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '.version_select at 0x7fdb35957b80>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:51.718288 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1e3acc86-db97-47d1-a0a4-f41888423f64 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799906652" status: 202 len: 0 microversion: 2.1 time: 0.068501 Sep 08 13:28:51.726244 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2802/5469] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Sep 8 13:28:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1799906652 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:28:53.516714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6611cf4a-70c4-4c2d-93bd-84e094d293ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:53.517546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6611cf4a-70c4-4c2d-93bd-84e094d293ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:53.530190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6611cf4a-70c4-4c2d-93bd-84e094d293ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:53.530994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6611cf4a-70c4-4c2d-93bd-84e094d293ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:53.531841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6611cf4a-70c4-4c2d-93bd-84e094d293ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:53.532983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6611cf4a-70c4-4c2d-93bd-84e094d293ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:53.533687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6611cf4a-70c4-4c2d-93bd-84e094d293ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:53.534596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6611cf4a-70c4-4c2d-93bd-84e094d293ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:53.779201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-6611cf4a-70c4-4c2d-93bd-84e094d293ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lazy-loading 'services' on Instance uuid 31c4aab1-021c-4648-8fe3-00d778b883f2 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:28:54.029956 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6611cf4a-70c4-4c2d-93bd-84e094d293ae tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments/44df3293-93c2-43bc-9cdd-32d0656fbdc4" status: 202 len: 0 microversion: 2.1 time: 0.520654 Sep 08 13:28:54.030915 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2668/5470] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:28:53 2022] DELETE /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments/44df3293-93c2-43bc-9cdd-32d0656fbdc4 => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:28:54.048708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e368755f-7b21-4a9e-b5ff-cc5d42db6422 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:54.051928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e368755f-7b21-4a9e-b5ff-cc5d42db6422 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:54.070014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e368755f-7b21-4a9e-b5ff-cc5d42db6422 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:54.071097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e368755f-7b21-4a9e-b5ff-cc5d42db6422 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:54.071097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e368755f-7b21-4a9e-b5ff-cc5d42db6422 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:54.071723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e368755f-7b21-4a9e-b5ff-cc5d42db6422 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:54.072197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e368755f-7b21-4a9e-b5ff-cc5d42db6422 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:54.072627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e368755f-7b21-4a9e-b5ff-cc5d42db6422 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:54.151962 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e368755f-7b21-4a9e-b5ff-cc5d42db6422 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113247 Sep 08 13:28:54.154582 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2803/5471] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:28:54 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:28:55.181910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3c5b2f4c-e3e6-41b0-a3b9-a2278e9eb62f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:55.192227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3c5b2f4c-e3e6-41b0-a3b9-a2278e9eb62f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:55.223515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c5b2f4c-e3e6-41b0-a3b9-a2278e9eb62f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:55.224402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c5b2f4c-e3e6-41b0-a3b9-a2278e9eb62f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:55.225207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c5b2f4c-e3e6-41b0-a3b9-a2278e9eb62f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:55.226997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c5b2f4c-e3e6-41b0-a3b9-a2278e9eb62f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:55.239884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c5b2f4c-e3e6-41b0-a3b9-a2278e9eb62f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:55.241243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c5b2f4c-e3e6-41b0-a3b9-a2278e9eb62f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:55.329846 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3c5b2f4c-e3e6-41b0-a3b9-a2278e9eb62f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160742 Sep 08 13:28:55.333796 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2669/5472] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:28:55 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments => generated 197 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:28:56.352696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7d3f7672-b176-4e2a-b64f-732ec3b3c584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:56.376186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7d3f7672-b176-4e2a-b64f-732ec3b3c584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:56.411036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d3f7672-b176-4e2a-b64f-732ec3b3c584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:56.411988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d3f7672-b176-4e2a-b64f-732ec3b3c584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:56.412776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d3f7672-b176-4e2a-b64f-732ec3b3c584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:56.414055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d3f7672-b176-4e2a-b64f-732ec3b3c584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:56.414912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d3f7672-b176-4e2a-b64f-732ec3b3c584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:56.430349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d3f7672-b176-4e2a-b64f-732ec3b3c584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:56.582253 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7d3f7672-b176-4e2a-b64f-732ec3b3c584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.238142 Sep 08 13:28:56.591261 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2804/5473] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:28:56 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:28:57.608238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-42f156a9-b168-49ca-843d-d4cd9c114d49 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:57.615544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-42f156a9-b168-49ca-843d-d4cd9c114d49 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:57.629168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42f156a9-b168-49ca-843d-d4cd9c114d49 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:57.631719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42f156a9-b168-49ca-843d-d4cd9c114d49 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:57.632863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42f156a9-b168-49ca-843d-d4cd9c114d49 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:57.635497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42f156a9-b168-49ca-843d-d4cd9c114d49 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:57.636782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42f156a9-b168-49ca-843d-d4cd9c114d49 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:57.637957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-42f156a9-b168-49ca-843d-d4cd9c114d49 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:57.750454 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-42f156a9-b168-49ca-843d-d4cd9c114d49 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152614 Sep 08 13:28:57.752591 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2670/5474] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:28:57 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:28:58.776387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2b861f2a-67d1-453b-a532-5729ff750c2f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:58.784783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2b861f2a-67d1-453b-a532-5729ff750c2f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:58.819517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b861f2a-67d1-453b-a532-5729ff750c2f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:58.820379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b861f2a-67d1-453b-a532-5729ff750c2f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:58.821171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b861f2a-67d1-453b-a532-5729ff750c2f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:58.823344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b861f2a-67d1-453b-a532-5729ff750c2f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:58.824318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b861f2a-67d1-453b-a532-5729ff750c2f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:58.824939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b861f2a-67d1-453b-a532-5729ff750c2f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:58.901728 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2b861f2a-67d1-453b-a532-5729ff750c2f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134902 Sep 08 13:28:58.908781 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2805/5475] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:28:58 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:28:59.927073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-793b12c5-f486-4f7d-8212-9d570bbcafcb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:28:59.929620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-793b12c5-f486-4f7d-8212-9d570bbcafcb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:28:59.942933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-793b12c5-f486-4f7d-8212-9d570bbcafcb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:59.943466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-793b12c5-f486-4f7d-8212-9d570bbcafcb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:59.943905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-793b12c5-f486-4f7d-8212-9d570bbcafcb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:28:59.944623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-793b12c5-f486-4f7d-8212-9d570bbcafcb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:28:59.945078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-793b12c5-f486-4f7d-8212-9d570bbcafcb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:28:59.945493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-793b12c5-f486-4f7d-8212-9d570bbcafcb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:00.045659 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-793b12c5-f486-4f7d-8212-9d570bbcafcb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120624 Sep 08 13:29:00.047024 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2671/5476] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:28:59 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:29:01.069750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-16bbcd26-54a5-47bc-b53a-01a5c1df0d8e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:01.076287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-16bbcd26-54a5-47bc-b53a-01a5c1df0d8e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:01.095715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16bbcd26-54a5-47bc-b53a-01a5c1df0d8e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:01.096860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16bbcd26-54a5-47bc-b53a-01a5c1df0d8e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:01.099447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16bbcd26-54a5-47bc-b53a-01a5c1df0d8e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:01.101502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16bbcd26-54a5-47bc-b53a-01a5c1df0d8e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:01.102602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16bbcd26-54a5-47bc-b53a-01a5c1df0d8e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:01.104189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-16bbcd26-54a5-47bc-b53a-01a5c1df0d8e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:01.178502 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-16bbcd26-54a5-47bc-b53a-01a5c1df0d8e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118650 Sep 08 13:29:01.188528 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2806/5477] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:29:01 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments => generated 197 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:29:02.209574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9cf0605c-c8e3-43b0-8c10-a838cc41f87d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:02.214565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9cf0605c-c8e3-43b0-8c10-a838cc41f87d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:02.240761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cf0605c-c8e3-43b0-8c10-a838cc41f87d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:02.242761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cf0605c-c8e3-43b0-8c10-a838cc41f87d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:02.248950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cf0605c-c8e3-43b0-8c10-a838cc41f87d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:02.252214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cf0605c-c8e3-43b0-8c10-a838cc41f87d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:02.257380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cf0605c-c8e3-43b0-8c10-a838cc41f87d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:02.258528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cf0605c-c8e3-43b0-8c10-a838cc41f87d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:02.405332 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9cf0605c-c8e3-43b0-8c10-a838cc41f87d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.211529 Sep 08 13:29:02.407857 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2672/5478] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:29:02 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments => generated 197 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:29:03.425850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a31d5809-94e1-4d46-b7bf-2f451aa99849 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:03.428340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a31d5809-94e1-4d46-b7bf-2f451aa99849 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:03.447097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a31d5809-94e1-4d46-b7bf-2f451aa99849 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:03.447905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a31d5809-94e1-4d46-b7bf-2f451aa99849 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:03.448515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a31d5809-94e1-4d46-b7bf-2f451aa99849 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:03.449402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a31d5809-94e1-4d46-b7bf-2f451aa99849 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:03.450052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a31d5809-94e1-4d46-b7bf-2f451aa99849 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:03.450625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a31d5809-94e1-4d46-b7bf-2f451aa99849 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:03.525994 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a31d5809-94e1-4d46-b7bf-2f451aa99849 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.105150 Sep 08 13:29:03.526498 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2807/5479] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:29:03 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2/os-volume_attachments => generated 25 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 08 13:29:03.743456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-88c831d7-857c-4bf7-84cc-f0e72b514d85 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:03.744559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-88c831d7-857c-4bf7-84cc-f0e72b514d85 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:03.766776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88c831d7-857c-4bf7-84cc-f0e72b514d85 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:03.768903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88c831d7-857c-4bf7-84cc-f0e72b514d85 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:03.769859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88c831d7-857c-4bf7-84cc-f0e72b514d85 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:03.771155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88c831d7-857c-4bf7-84cc-f0e72b514d85 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:03.773387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88c831d7-857c-4bf7-84cc-f0e72b514d85 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:03.774442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88c831d7-857c-4bf7-84cc-f0e72b514d85 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:03.844259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-88c831d7-857c-4bf7-84cc-f0e72b514d85 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:29:04.088587 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-88c831d7-857c-4bf7-84cc-f0e72b514d85 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 204 len: 0 microversion: 2.1 time: 0.371991 Sep 08 13:29:04.094665 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2673/5480] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:29:03 2022] DELETE /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:29:04.104030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f822a89d-4406-4f18-b45a-2bb143602d45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:04.105549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f822a89d-4406-4f18-b45a-2bb143602d45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:04.118068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f822a89d-4406-4f18-b45a-2bb143602d45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:04.119004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f822a89d-4406-4f18-b45a-2bb143602d45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:04.144833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f822a89d-4406-4f18-b45a-2bb143602d45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:04.153702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f822a89d-4406-4f18-b45a-2bb143602d45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:04.159652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f822a89d-4406-4f18-b45a-2bb143602d45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:04.163263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f822a89d-4406-4f18-b45a-2bb143602d45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:04.489614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f822a89d-4406-4f18-b45a-2bb143602d45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:04.504774 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f822a89d-4406-4f18-b45a-2bb143602d45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1680 microversion: 2.1 time: 0.408277 Sep 08 13:29:04.505915 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2808/5481] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:04 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1680 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:29:05.557260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-64e2b5d3-9c3a-450b-82bd-3ec410af4419 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:05.560488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-64e2b5d3-9c3a-450b-82bd-3ec410af4419 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:05.573592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64e2b5d3-9c3a-450b-82bd-3ec410af4419 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:05.575556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64e2b5d3-9c3a-450b-82bd-3ec410af4419 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:05.576611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64e2b5d3-9c3a-450b-82bd-3ec410af4419 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:05.578747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64e2b5d3-9c3a-450b-82bd-3ec410af4419 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:05.579930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64e2b5d3-9c3a-450b-82bd-3ec410af4419 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:05.581187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64e2b5d3-9c3a-450b-82bd-3ec410af4419 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:06.037287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-64e2b5d3-9c3a-450b-82bd-3ec410af4419 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:06.060809 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-64e2b5d3-9c3a-450b-82bd-3ec410af4419 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1680 microversion: 2.1 time: 0.512012 Sep 08 13:29:06.066777 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2674/5482] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:05 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1680 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:29:07.121980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4d96eec9-7925-42b0-8526-ae371c23deb6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:07.126904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4d96eec9-7925-42b0-8526-ae371c23deb6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:07.180019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d96eec9-7925-42b0-8526-ae371c23deb6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:07.191695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d96eec9-7925-42b0-8526-ae371c23deb6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:07.192799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d96eec9-7925-42b0-8526-ae371c23deb6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:07.194355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d96eec9-7925-42b0-8526-ae371c23deb6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:07.195463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d96eec9-7925-42b0-8526-ae371c23deb6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:07.196536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4d96eec9-7925-42b0-8526-ae371c23deb6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:07.456068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4d96eec9-7925-42b0-8526-ae371c23deb6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:07.474848 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4d96eec9-7925-42b0-8526-ae371c23deb6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1613 microversion: 2.1 time: 0.364576 Sep 08 13:29:07.477827 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2809/5483] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:07 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1613 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:29:08.258118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-61af3dbc-3458-46fc-8677-3a0c19893af6 req-142a9759-ea95-4a1a-a420-6d346ef87265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31c4aab1-021c-4648-8fe3-00d778b883f2", "name": "network-vif-deleted", "tag": "f01cad41-e70a-4258-ba3e-e76ab21b0ddc"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:29:08.288838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-61af3dbc-3458-46fc-8677-3a0c19893af6 req-142a9759-ea95-4a1a-a420-6d346ef87265 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:08.289695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-61af3dbc-3458-46fc-8677-3a0c19893af6 req-142a9759-ea95-4a1a-a420-6d346ef87265 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:08.291357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-61af3dbc-3458-46fc-8677-3a0c19893af6 req-142a9759-ea95-4a1a-a420-6d346ef87265 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:08.375271 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-61af3dbc-3458-46fc-8677-3a0c19893af6 req-142a9759-ea95-4a1a-a420-6d346ef87265 service nova] Creating event network-vif-deleted:f01cad41-e70a-4258-ba3e-e76ab21b0ddc for instance 31c4aab1-021c-4648-8fe3-00d778b883f2 on n-h1-852084-10 Sep 08 13:29:08.402183 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-61af3dbc-3458-46fc-8677-3a0c19893af6 req-142a9759-ea95-4a1a-a420-6d346ef87265 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.547838 Sep 08 13:29:08.409047 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2675/5484] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:29:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:29:08.507288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:08.513029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:08.557094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:08.558328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:08.561848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:08.563517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:08.567966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:08.569092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:08.705785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:08.708834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:08.719190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:08.720489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lazy-loading 'fault' on Instance uuid 31c4aab1-021c-4648-8fe3-00d778b883f2 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:29:08.783200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:08.792557 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-02cdc93b-03a3-44c9-ae79-6a2bc2897c45 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 200 len: 1330 microversion: 2.1 time: 0.292951 Sep 08 13:29:08.793554 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2810/5485] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:08 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 1330 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:29:09.826778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9c5713f8-cfb2-4e09-9285-01c005a36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:09.828133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9c5713f8-cfb2-4e09-9285-01c005a36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:09.862899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c5713f8-cfb2-4e09-9285-01c005a36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:09.863847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c5713f8-cfb2-4e09-9285-01c005a36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:09.864661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c5713f8-cfb2-4e09-9285-01c005a36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:09.865994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c5713f8-cfb2-4e09-9285-01c005a36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:09.866851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c5713f8-cfb2-4e09-9285-01c005a36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:09.867693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c5713f8-cfb2-4e09-9285-01c005a36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:09.946142 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-9c5713f8-cfb2-4e09-9285-01c005a36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9c5713f8-cfb2-4e09-9285-01c005a36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 HTTP/1.1 Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '31c4aab1-021c-4648-8fe3-00d778b883f2'} Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:29:09.951332 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:29:09.966751 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:29:09.966751 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:29:09.966751 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:29:09.966751 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:29:09.966751 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:29:09.966751 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:29:09.966751 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:29:09.966751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9c5713f8-cfb2-4e09-9285-01c005a36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 404 to user: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:29:09.966751 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9c5713f8-cfb2-4e09-9285-01c005a36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 404 len: 111 microversion: 2.1 time: 0.149757 Sep 08 13:29:09.966751 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2676/5486] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:09 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:29:09.978892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8458fdd-8fe4-4433-a60c-b59ef77b653e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '.version_select at 0x7fdb35ccac10>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:10.023721 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8458fdd-8fe4-4433-a60c-b59ef77b653e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-897128364" status: 202 len: 0 microversion: 2.1 time: 0.050610 Sep 08 13:29:10.026100 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2811/5487] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 13:29:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-897128364 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:29:11.381563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-854909d3-0e82-4638-906f-c37b2574942b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: .version_select at 0x7fdb3ad30c10>, body: {"keypair": {"name": "tempest-keypair-1363682362", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIV8yYyygnB2crabHmLLti3KYLpDxWFMKTVIDm9ovaWqLY46P6r1VFfHlPASRxsRGbkG+13CRLHV+QbOPimh7hHaVtXcaomoc5VsQdJAGPJaygqv0+uhatnpHZXHwLEd2A=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:29:11.402902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-854909d3-0e82-4638-906f-c37b2574942b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for project efc65cf30371430a9b085afea75e7a5b. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:29:11.410714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-854909d3-0e82-4638-906f-c37b2574942b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for user 1c622939c63749dc944918e2717cd09a and project efc65cf30371430a9b085afea75e7a5b. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:29:11.446764 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-854909d3-0e82-4638-906f-c37b2574942b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.072631 Sep 08 13:29:11.447891 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2677/5488] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:29:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:29:14.293689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-957624867", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed1157e7-c274-4d74-a471-1eb655ce6d93"}], "security_groups": [{"name": "tempest-securitygroup--1641577680"}], "key_name": "tempest-keypair-1363682362", "user_data": "}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:29:14.587551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] validate_networks() for [('ed1157e7-c274-4d74-a471-1eb655ce6d93', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:29:15.751498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:29:15.753469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:29:15.754509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:29:15.755407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:29:15.756254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:29:15.774844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:15.776137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:15.777239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:15.780011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:15.781128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:15.782134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:15.867545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for project efc65cf30371430a9b085afea75e7a5b. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:29:15.879024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for user 1c622939c63749dc944918e2717cd09a and project efc65cf30371430a9b085afea75e7a5b. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:29:15.911249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:29:15.917207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:29:16.085615 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d9fb5a63-40e3-484d-8548-60a5d465bf11 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.795623 Sep 08 13:29:16.087427 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2812/5489] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:29:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:29:16.110328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-06944ad2-fa12-404c-bd1f-c0ae46b36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:16.111619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-06944ad2-fa12-404c-bd1f-c0ae46b36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:16.282076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-06944ad2-fa12-404c-bd1f-c0ae46b36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:16.316282 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-06944ad2-fa12-404c-bd1f-c0ae46b36880 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1241 microversion: 2.1 time: 0.218898 Sep 08 13:29:16.319627 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2678/5490] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:16 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1241 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:29:17.368926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-41c52335-13e2-4c05-a542-26e61eafe027 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:17.370899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-41c52335-13e2-4c05-a542-26e61eafe027 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:17.383762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:29:17.387992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41c52335-13e2-4c05-a542-26e61eafe027 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:17.389285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41c52335-13e2-4c05-a542-26e61eafe027 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:17.390102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41c52335-13e2-4c05-a542-26e61eafe027 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:17.391496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41c52335-13e2-4c05-a542-26e61eafe027 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:17.392377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41c52335-13e2-4c05-a542-26e61eafe027 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:17.393130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41c52335-13e2-4c05-a542-26e61eafe027 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:17.403719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:29:17.508498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-41c52335-13e2-4c05-a542-26e61eafe027 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:17.519819 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-41c52335-13e2-4c05-a542-26e61eafe027 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1293 microversion: 2.1 time: 0.156289 Sep 08 13:29:17.531935 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2813/5491] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:17 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1293 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:29:18.557272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d6ee5b1b-d5d7-4c7f-b19d-2cca5731055b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:18.563728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d6ee5b1b-d5d7-4c7f-b19d-2cca5731055b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:18.581797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:29:18.586072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6ee5b1b-d5d7-4c7f-b19d-2cca5731055b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:18.588240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6ee5b1b-d5d7-4c7f-b19d-2cca5731055b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:18.594739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6ee5b1b-d5d7-4c7f-b19d-2cca5731055b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:18.595839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6ee5b1b-d5d7-4c7f-b19d-2cca5731055b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:18.596440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6ee5b1b-d5d7-4c7f-b19d-2cca5731055b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:18.596978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6ee5b1b-d5d7-4c7f-b19d-2cca5731055b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:18.649573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:29:18.809713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d6ee5b1b-d5d7-4c7f-b19d-2cca5731055b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:18.827585 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d6ee5b1b-d5d7-4c7f-b19d-2cca5731055b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1299 microversion: 2.1 time: 0.277486 Sep 08 13:29:18.829537 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2679/5492] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:18 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1299 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:29:19.857950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3f1315ef-ee99-4cc8-af7d-d240988a024e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:19.865118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3f1315ef-ee99-4cc8-af7d-d240988a024e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:19.899424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f1315ef-ee99-4cc8-af7d-d240988a024e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:19.904854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f1315ef-ee99-4cc8-af7d-d240988a024e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:19.905723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f1315ef-ee99-4cc8-af7d-d240988a024e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:19.908955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f1315ef-ee99-4cc8-af7d-d240988a024e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:19.912332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f1315ef-ee99-4cc8-af7d-d240988a024e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:19.913023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f1315ef-ee99-4cc8-af7d-d240988a024e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:20.398383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3f1315ef-ee99-4cc8-af7d-d240988a024e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:20.428750 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3f1315ef-ee99-4cc8-af7d-d240988a024e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1367 microversion: 2.1 time: 0.577378 Sep 08 13:29:20.443633 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2814/5493] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:19 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1367 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:29:21.417598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-d309dbbb-4b7a-461e-a721-9d8a944bf2d7 req-c6fab718-365b-416a-bbab-7aeab6b3252b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70835a0-c84c-4c65-b1ba-3404e8865d3f", "tag": "16034cbc-fb52-4bcf-afd5-e9432e448989"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:29:21.457865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d309dbbb-4b7a-461e-a721-9d8a944bf2d7 req-c6fab718-365b-416a-bbab-7aeab6b3252b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:21.462588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d309dbbb-4b7a-461e-a721-9d8a944bf2d7 req-c6fab718-365b-416a-bbab-7aeab6b3252b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:21.463905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d309dbbb-4b7a-461e-a721-9d8a944bf2d7 req-c6fab718-365b-416a-bbab-7aeab6b3252b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:21.478894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84231756-489e-493e-8c5c-96a6368cb84f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:21.480947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-84231756-489e-493e-8c5c-96a6368cb84f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:21.517744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84231756-489e-493e-8c5c-96a6368cb84f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:21.519170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84231756-489e-493e-8c5c-96a6368cb84f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:21.520720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84231756-489e-493e-8c5c-96a6368cb84f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:21.523487 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d309dbbb-4b7a-461e-a721-9d8a944bf2d7 req-c6fab718-365b-416a-bbab-7aeab6b3252b service nova] Creating event network-changed:16034cbc-fb52-4bcf-afd5-e9432e448989 for instance b70835a0-c84c-4c65-b1ba-3404e8865d3f on n-h1-852084-10 Sep 08 13:29:21.524074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84231756-489e-493e-8c5c-96a6368cb84f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:21.525408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84231756-489e-493e-8c5c-96a6368cb84f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:21.526550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84231756-489e-493e-8c5c-96a6368cb84f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:21.577701 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-d309dbbb-4b7a-461e-a721-9d8a944bf2d7 req-c6fab718-365b-416a-bbab-7aeab6b3252b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.167369 Sep 08 13:29:21.584196 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2680/5494] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:29:21.995083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-84231756-489e-493e-8c5c-96a6368cb84f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:22.016310 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-84231756-489e-493e-8c5c-96a6368cb84f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1367 microversion: 2.1 time: 0.550208 Sep 08 13:29:22.017845 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2815/5495] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:21 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1367 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:29:23.050062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c7adaa23-9301-4173-9ee3-926826f4dbdb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:23.051944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c7adaa23-9301-4173-9ee3-926826f4dbdb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:23.062866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7adaa23-9301-4173-9ee3-926826f4dbdb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:23.064541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7adaa23-9301-4173-9ee3-926826f4dbdb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:23.065194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7adaa23-9301-4173-9ee3-926826f4dbdb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:23.066133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7adaa23-9301-4173-9ee3-926826f4dbdb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:23.066768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7adaa23-9301-4173-9ee3-926826f4dbdb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:23.067392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7adaa23-9301-4173-9ee3-926826f4dbdb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:23.474298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c7adaa23-9301-4173-9ee3-926826f4dbdb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:23.505142 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c7adaa23-9301-4173-9ee3-926826f4dbdb tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1367 microversion: 2.1 time: 0.461350 Sep 08 13:29:23.509358 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2681/5496] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:23 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:29:24.546613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ce0e854a-60e7-4950-8ea8-49226896390d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:24.546613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ce0e854a-60e7-4950-8ea8-49226896390d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:24.595251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce0e854a-60e7-4950-8ea8-49226896390d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:24.597766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce0e854a-60e7-4950-8ea8-49226896390d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:24.598543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce0e854a-60e7-4950-8ea8-49226896390d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:24.599329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce0e854a-60e7-4950-8ea8-49226896390d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:24.599808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce0e854a-60e7-4950-8ea8-49226896390d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:24.600239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce0e854a-60e7-4950-8ea8-49226896390d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:24.962751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ce0e854a-60e7-4950-8ea8-49226896390d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:24.995718 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ce0e854a-60e7-4950-8ea8-49226896390d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1367 microversion: 2.1 time: 0.464137 Sep 08 13:29:24.996409 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2816/5497] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:24 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1367 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:29:26.026840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e59b3e4e-c326-4331-adbb-991185711c27 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:26.027818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e59b3e4e-c326-4331-adbb-991185711c27 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:26.039275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e59b3e4e-c326-4331-adbb-991185711c27 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:26.039786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e59b3e4e-c326-4331-adbb-991185711c27 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:26.040327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e59b3e4e-c326-4331-adbb-991185711c27 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:26.041143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e59b3e4e-c326-4331-adbb-991185711c27 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:26.042493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e59b3e4e-c326-4331-adbb-991185711c27 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:26.043192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e59b3e4e-c326-4331-adbb-991185711c27 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:26.299696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:29:26.544686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e59b3e4e-c326-4331-adbb-991185711c27 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:26.560027 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e59b3e4e-c326-4331-adbb-991185711c27 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1367 microversion: 2.1 time: 0.540352 Sep 08 13:29:26.561357 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2682/5498] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:26 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1367 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:29:27.612737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d92f4769-dd26-4aac-aa82-e3138bd1a515 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:27.615786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d92f4769-dd26-4aac-aa82-e3138bd1a515 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:27.623818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:29:27.625703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:29:27.636377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d92f4769-dd26-4aac-aa82-e3138bd1a515 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:27.638443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d92f4769-dd26-4aac-aa82-e3138bd1a515 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:27.640506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d92f4769-dd26-4aac-aa82-e3138bd1a515 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:27.641632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d92f4769-dd26-4aac-aa82-e3138bd1a515 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:27.643853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d92f4769-dd26-4aac-aa82-e3138bd1a515 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:27.646557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d92f4769-dd26-4aac-aa82-e3138bd1a515 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:27.659863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-47090921-3874-4b2c-b3fe-8e8dde293f86 req-42ca1458-2541-449e-b6b1-99a0c28f373f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70835a0-c84c-4c65-b1ba-3404e8865d3f", "name": "network-vif-plugged", "status": "completed", "tag": "16034cbc-fb52-4bcf-afd5-e9432e448989"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:29:27.718952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-47090921-3874-4b2c-b3fe-8e8dde293f86 req-42ca1458-2541-449e-b6b1-99a0c28f373f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:27.719760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-47090921-3874-4b2c-b3fe-8e8dde293f86 req-42ca1458-2541-449e-b6b1-99a0c28f373f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:27.720509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-47090921-3874-4b2c-b3fe-8e8dde293f86 req-42ca1458-2541-449e-b6b1-99a0c28f373f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:27.768325 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-47090921-3874-4b2c-b3fe-8e8dde293f86 req-42ca1458-2541-449e-b6b1-99a0c28f373f service nova] Creating event network-vif-plugged:16034cbc-fb52-4bcf-afd5-e9432e448989 for instance b70835a0-c84c-4c65-b1ba-3404e8865d3f on n-h1-852084-10 Sep 08 13:29:27.786703 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-47090921-3874-4b2c-b3fe-8e8dde293f86 req-42ca1458-2541-449e-b6b1-99a0c28f373f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132957 Sep 08 13:29:27.791482 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2683/5499] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:29:28.095009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d92f4769-dd26-4aac-aa82-e3138bd1a515 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:28.116827 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d92f4769-dd26-4aac-aa82-e3138bd1a515 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1367 microversion: 2.1 time: 0.513117 Sep 08 13:29:28.119204 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2817/5500] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:27 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1367 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:29:29.164892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-56fe1b44-c537-4b99-82ca-9602b990e20a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:29.166016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-56fe1b44-c537-4b99-82ca-9602b990e20a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:29.180615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56fe1b44-c537-4b99-82ca-9602b990e20a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:29.181866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56fe1b44-c537-4b99-82ca-9602b990e20a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:29.182889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56fe1b44-c537-4b99-82ca-9602b990e20a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:29.184953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56fe1b44-c537-4b99-82ca-9602b990e20a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:29.186081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56fe1b44-c537-4b99-82ca-9602b990e20a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:29.187041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56fe1b44-c537-4b99-82ca-9602b990e20a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:29.431355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-56fe1b44-c537-4b99-82ca-9602b990e20a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:29.445770 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-56fe1b44-c537-4b99-82ca-9602b990e20a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1367 microversion: 2.1 time: 0.286864 Sep 08 13:29:29.460799 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2684/5501] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:29 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:29:30.523167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-18e07f12-f414-4bce-9129-3ce3e290b84d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:30.524073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-18e07f12-f414-4bce-9129-3ce3e290b84d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:30.554412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18e07f12-f414-4bce-9129-3ce3e290b84d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:30.555306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18e07f12-f414-4bce-9129-3ce3e290b84d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:30.555969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18e07f12-f414-4bce-9129-3ce3e290b84d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:30.557065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18e07f12-f414-4bce-9129-3ce3e290b84d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:30.557726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18e07f12-f414-4bce-9129-3ce3e290b84d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:30.558353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18e07f12-f414-4bce-9129-3ce3e290b84d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:30.828175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-18e07f12-f414-4bce-9129-3ce3e290b84d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:29:30.844349 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-18e07f12-f414-4bce-9129-3ce3e290b84d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1557 microversion: 2.1 time: 0.339231 Sep 08 13:29:30.845267 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2818/5502] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:29:30 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1557 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:29:30.870633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-06af6a42-5c28-4d5d-b397-d62e5ff4b872 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:29:30.871466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-06af6a42-5c28-4d5d-b397-d62e5ff4b872 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:29:30.882079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-06af6a42-5c28-4d5d-b397-d62e5ff4b872 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:30.883178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-06af6a42-5c28-4d5d-b397-d62e5ff4b872 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:30.884158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-06af6a42-5c28-4d5d-b397-d62e5ff4b872 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:30.885689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-06af6a42-5c28-4d5d-b397-d62e5ff4b872 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:30.887324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-06af6a42-5c28-4d5d-b397-d62e5ff4b872 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:30.888629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-06af6a42-5c28-4d5d-b397-d62e5ff4b872 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:31.068571 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-06af6a42-5c28-4d5d-b397-d62e5ff4b872 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203921 Sep 08 13:29:31.069425 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2685/5503] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:29:30 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:29:33.151998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-9de15645-97d5-48bd-b14b-1fd1e4e44f30 req-b2e307da-b8ca-4637-91cf-663bc99cf2fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b70835a0-c84c-4c65-b1ba-3404e8865d3f", "tag": "16034cbc-fb52-4bcf-afd5-e9432e448989"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:29:33.190129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9de15645-97d5-48bd-b14b-1fd1e4e44f30 req-b2e307da-b8ca-4637-91cf-663bc99cf2fe service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:29:33.191005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9de15645-97d5-48bd-b14b-1fd1e4e44f30 req-b2e307da-b8ca-4637-91cf-663bc99cf2fe service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:29:33.198076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9de15645-97d5-48bd-b14b-1fd1e4e44f30 req-b2e307da-b8ca-4637-91cf-663bc99cf2fe service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:29:33.269261 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-9de15645-97d5-48bd-b14b-1fd1e4e44f30 req-b2e307da-b8ca-4637-91cf-663bc99cf2fe service nova] Creating event network-changed:16034cbc-fb52-4bcf-afd5-e9432e448989 for instance b70835a0-c84c-4c65-b1ba-3404e8865d3f on n-h1-852084-10 Sep 08 13:29:33.297015 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-9de15645-97d5-48bd-b14b-1fd1e4e44f30 req-b2e307da-b8ca-4637-91cf-663bc99cf2fe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161887 Sep 08 13:29:33.299383 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2819/5504] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:30:08.176285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=13 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:30:08.177931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=31 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:30:08.185867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4362c2e7-968b-48cc-829f-96ddc90a91c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:08.187782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4362c2e7-968b-48cc-829f-96ddc90a91c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:08.210890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4362c2e7-968b-48cc-829f-96ddc90a91c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:08.211686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4362c2e7-968b-48cc-829f-96ddc90a91c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:08.216894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4362c2e7-968b-48cc-829f-96ddc90a91c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:08.218277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4362c2e7-968b-48cc-829f-96ddc90a91c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:08.218816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4362c2e7-968b-48cc-829f-96ddc90a91c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:08.219683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4362c2e7-968b-48cc-829f-96ddc90a91c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:08.264217 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4362c2e7-968b-48cc-829f-96ddc90a91c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/ips" status: 200 len: 150 microversion: 2.1 time: 0.091290 Sep 08 13:30:08.266156 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2686/5505] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 13:30:08 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/ips => generated 150 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:30:11.176482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-34e2ee15-565d-4edb-9834-7afb91c5d76d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e94665c-c08c-4bb2-9dfd-34bd99831fd5"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:30:11.186227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-34e2ee15-565d-4edb-9834-7afb91c5d76d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:11.203676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=13 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:30:11.206615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=37 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:30:11.227023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34e2ee15-565d-4edb-9834-7afb91c5d76d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:11.228000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34e2ee15-565d-4edb-9834-7afb91c5d76d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:11.228829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34e2ee15-565d-4edb-9834-7afb91c5d76d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:11.247383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34e2ee15-565d-4edb-9834-7afb91c5d76d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:11.248626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34e2ee15-565d-4edb-9834-7afb91c5d76d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:11.250456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-34e2ee15-565d-4edb-9834-7afb91c5d76d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:11.850974 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-34e2ee15-565d-4edb-9834-7afb91c5d76d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684470 Sep 08 13:30:11.852425 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2820/5506] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:30:11 2022] POST /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments => generated 194 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:30:29.566900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5e83ae64-c0a7-4002-b08b-e50097f3f7d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e94665c-c08c-4bb2-9dfd-34bd99831fd5"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:30:29.578988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5e83ae64-c0a7-4002-b08b-e50097f3f7d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:29.603195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:30:29.604453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:30:29.608522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e83ae64-c0a7-4002-b08b-e50097f3f7d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:29.609471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e83ae64-c0a7-4002-b08b-e50097f3f7d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:29.610307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e83ae64-c0a7-4002-b08b-e50097f3f7d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:29.611907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e83ae64-c0a7-4002-b08b-e50097f3f7d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:29.612776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e83ae64-c0a7-4002-b08b-e50097f3f7d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:29.613542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e83ae64-c0a7-4002-b08b-e50097f3f7d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:29.870915 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-5e83ae64-c0a7-4002-b08b-e50097f3f7d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Invalid volume: volume 6e94665c-c08c-4bb2-9dfd-34bd99831fd5 is already attached to instances: b70835a0-c84c-4c65-b1ba-3404e8865d3f Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5e83ae64-c0a7-4002-b08b-e50097f3f7d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments HTTP/1.1 Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 74 Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: {"volumeAttachment": {"volumeId": "6e94665c-c08c-4bb2-9dfd-34bd99831fd5"}} Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid volume: volume 6e94665c-c08c-4bb2-9dfd-34bd99831fd5 is already attached to instances: b70835a0-c84c-4c65-b1ba-3404e8865d3f Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'server_id': 'b70835a0-c84c-4c65-b1ba-3404e8865d3f', 'body': {'volumeAttachment': {'volumeId': '6e94665c-c08c-4bb2-9dfd-34bd99831fd5'}}} Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6e94665c-c08c-4bb2-9dfd-34bd99831fd5 is already attached to instances: b70835a0-c84c-4c65-b1ba-3404e8865d3f Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:30:29.892666 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6e94665c-c08c-4bb2-9dfd-34bd99831fd5 is already attached to instances: b70835a0-c84c-4c65-b1ba-3404e8865d3f Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6e94665c-c08c-4bb2-9dfd-34bd99831fd5 is already attached to instances: b70835a0-c84c-4c65-b1ba-3404e8865d3f Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5e83ae64-c0a7-4002-b08b-e50097f3f7d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 400 to user: Invalid volume: volume 6e94665c-c08c-4bb2-9dfd-34bd99831fd5 is already attached to instances: b70835a0-c84c-4c65-b1ba-3404e8865d3f {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:30:29.898879 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5e83ae64-c0a7-4002-b08b-e50097f3f7d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.332452 Sep 08 13:30:29.902662 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2687/5507] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:30:29 2022] POST /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments => generated 174 bytes in 342 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:30:30.029887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-db2eba43-fea1-49ef-b08f-de970740323a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:30.053174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-db2eba43-fea1-49ef-b08f-de970740323a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:30.063621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:30:30.064053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:30:30.073854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db2eba43-fea1-49ef-b08f-de970740323a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:30.075050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db2eba43-fea1-49ef-b08f-de970740323a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:30.076403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db2eba43-fea1-49ef-b08f-de970740323a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:30.077888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db2eba43-fea1-49ef-b08f-de970740323a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:30.078657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db2eba43-fea1-49ef-b08f-de970740323a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:30.080070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-db2eba43-fea1-49ef-b08f-de970740323a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:30.262562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-db2eba43-fea1-49ef-b08f-de970740323a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lazy-loading 'services' on Instance uuid b70835a0-c84c-4c65-b1ba-3404e8865d3f {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:30:30.521154 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-db2eba43-fea1-49ef-b08f-de970740323a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments/6e94665c-c08c-4bb2-9dfd-34bd99831fd5" status: 202 len: 0 microversion: 2.1 time: 0.488589 Sep 08 13:30:30.531033 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2821/5508] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:30:30 2022] DELETE /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments/6e94665c-c08c-4bb2-9dfd-34bd99831fd5 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:30:30.541093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-440cebe7-15f3-4a42-9d23-413d53871a4a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:30.544811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-440cebe7-15f3-4a42-9d23-413d53871a4a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:30.578012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-440cebe7-15f3-4a42-9d23-413d53871a4a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:30.578755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-440cebe7-15f3-4a42-9d23-413d53871a4a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:30.580206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-440cebe7-15f3-4a42-9d23-413d53871a4a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:30.581452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-440cebe7-15f3-4a42-9d23-413d53871a4a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:30.582221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-440cebe7-15f3-4a42-9d23-413d53871a4a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:30.583163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-440cebe7-15f3-4a42-9d23-413d53871a4a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:30.709329 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-440cebe7-15f3-4a42-9d23-413d53871a4a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172711 Sep 08 13:30:30.716260 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2688/5509] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:30:30 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments => generated 197 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:30:31.740919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-371fd23e-6c18-47b7-99f3-7eb6c81cdaff tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:31.746458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-371fd23e-6c18-47b7-99f3-7eb6c81cdaff tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:31.779196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-371fd23e-6c18-47b7-99f3-7eb6c81cdaff tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:31.809201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-371fd23e-6c18-47b7-99f3-7eb6c81cdaff tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:31.809957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-371fd23e-6c18-47b7-99f3-7eb6c81cdaff tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:31.811332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-371fd23e-6c18-47b7-99f3-7eb6c81cdaff tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:31.812219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-371fd23e-6c18-47b7-99f3-7eb6c81cdaff tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:31.813126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-371fd23e-6c18-47b7-99f3-7eb6c81cdaff tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:32.023990 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-371fd23e-6c18-47b7-99f3-7eb6c81cdaff tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.303552 Sep 08 13:30:32.025758 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2822/5510] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:30:31 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments => generated 197 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:30:33.041663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dd147123-9b48-4199-b935-1dcbe4f238a6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:33.045799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dd147123-9b48-4199-b935-1dcbe4f238a6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:33.084335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dd147123-9b48-4199-b935-1dcbe4f238a6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:33.089200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dd147123-9b48-4199-b935-1dcbe4f238a6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:33.089688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dd147123-9b48-4199-b935-1dcbe4f238a6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:33.096923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dd147123-9b48-4199-b935-1dcbe4f238a6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:33.097801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dd147123-9b48-4199-b935-1dcbe4f238a6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:33.108046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dd147123-9b48-4199-b935-1dcbe4f238a6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:33.293642 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dd147123-9b48-4199-b935-1dcbe4f238a6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.253930 Sep 08 13:30:33.295453 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2689/5511] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:30:33 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments => generated 197 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:30:34.310417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be7cac4c-b34a-4de2-a960-6d245f3d218f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:34.319155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-be7cac4c-b34a-4de2-a960-6d245f3d218f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:34.349243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be7cac4c-b34a-4de2-a960-6d245f3d218f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:34.350042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be7cac4c-b34a-4de2-a960-6d245f3d218f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:34.354029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be7cac4c-b34a-4de2-a960-6d245f3d218f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:34.355045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be7cac4c-b34a-4de2-a960-6d245f3d218f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:34.358784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be7cac4c-b34a-4de2-a960-6d245f3d218f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:34.359462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be7cac4c-b34a-4de2-a960-6d245f3d218f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:34.466639 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-be7cac4c-b34a-4de2-a960-6d245f3d218f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.163031 Sep 08 13:30:34.469110 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2823/5512] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:30:34 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:30:35.489821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bac7845b-ec73-43f7-aea6-1d5592cae78b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:35.492376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bac7845b-ec73-43f7-aea6-1d5592cae78b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:35.504770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac7845b-ec73-43f7-aea6-1d5592cae78b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:35.505789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac7845b-ec73-43f7-aea6-1d5592cae78b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:35.506570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac7845b-ec73-43f7-aea6-1d5592cae78b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:35.507555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac7845b-ec73-43f7-aea6-1d5592cae78b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:35.508203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac7845b-ec73-43f7-aea6-1d5592cae78b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:35.509876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bac7845b-ec73-43f7-aea6-1d5592cae78b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:35.633529 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bac7845b-ec73-43f7-aea6-1d5592cae78b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.152071 Sep 08 13:30:35.641173 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2690/5513] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:30:35 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:30:36.658098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-59557179-f2b4-4b58-bc84-24a19729f244 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:36.661798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-59557179-f2b4-4b58-bc84-24a19729f244 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:36.733741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59557179-f2b4-4b58-bc84-24a19729f244 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:36.734618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59557179-f2b4-4b58-bc84-24a19729f244 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:36.735452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59557179-f2b4-4b58-bc84-24a19729f244 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:36.743745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59557179-f2b4-4b58-bc84-24a19729f244 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:36.743745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59557179-f2b4-4b58-bc84-24a19729f244 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:36.759549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-59557179-f2b4-4b58-bc84-24a19729f244 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:36.879647 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-59557179-f2b4-4b58-bc84-24a19729f244 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.231015 Sep 08 13:30:36.887588 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2824/5514] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:30:36 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments => generated 197 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:30:37.900630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-481e2957-db89-4692-8d45-2823a335256c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:37.903089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-481e2957-db89-4692-8d45-2823a335256c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:37.913899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-481e2957-db89-4692-8d45-2823a335256c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:37.914656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-481e2957-db89-4692-8d45-2823a335256c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:37.915406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-481e2957-db89-4692-8d45-2823a335256c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:37.916339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-481e2957-db89-4692-8d45-2823a335256c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:37.917727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-481e2957-db89-4692-8d45-2823a335256c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:37.918340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-481e2957-db89-4692-8d45-2823a335256c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:38.008218 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-481e2957-db89-4692-8d45-2823a335256c tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112075 Sep 08 13:30:38.015466 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2691/5515] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:30:37 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:30:39.024251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ab94c6ad-e747-4938-97bf-88f86e27e4a9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:39.027121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ab94c6ad-e747-4938-97bf-88f86e27e4a9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:39.044210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab94c6ad-e747-4938-97bf-88f86e27e4a9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:39.044716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab94c6ad-e747-4938-97bf-88f86e27e4a9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:39.045181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab94c6ad-e747-4938-97bf-88f86e27e4a9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:39.054141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab94c6ad-e747-4938-97bf-88f86e27e4a9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:39.055200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab94c6ad-e747-4938-97bf-88f86e27e4a9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:39.055920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab94c6ad-e747-4938-97bf-88f86e27e4a9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:39.152917 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ab94c6ad-e747-4938-97bf-88f86e27e4a9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133547 Sep 08 13:30:39.154867 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2825/5516] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:30:39 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:30:40.176220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e730bc74-65d3-47be-a586-9b7d90d8fb5e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:40.180328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e730bc74-65d3-47be-a586-9b7d90d8fb5e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:40.193795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e730bc74-65d3-47be-a586-9b7d90d8fb5e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:40.194708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e730bc74-65d3-47be-a586-9b7d90d8fb5e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:40.195629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e730bc74-65d3-47be-a586-9b7d90d8fb5e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:40.196921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e730bc74-65d3-47be-a586-9b7d90d8fb5e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:40.198476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e730bc74-65d3-47be-a586-9b7d90d8fb5e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:40.199542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e730bc74-65d3-47be-a586-9b7d90d8fb5e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:40.267211 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e730bc74-65d3-47be-a586-9b7d90d8fb5e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099740 Sep 08 13:30:40.268371 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2692/5517] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:30:40 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:30:40.992941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-536482621", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "7593ffbf-2f4d-4f57-99a9-264d2d047651", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd09c139-4c62-4afa-ac6f-48ed313685b7"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:30:41.095320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] validate_networks() for [('dd09c139-4c62-4afa-ac6f-48ed313685b7', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:30:41.291143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9fc84d98-39cc-4016-9f0d-01d4ddb7e0d2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:41.301674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9fc84d98-39cc-4016-9f0d-01d4ddb7e0d2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:41.319433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fc84d98-39cc-4016-9f0d-01d4ddb7e0d2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:41.322685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fc84d98-39cc-4016-9f0d-01d4ddb7e0d2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:41.323375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fc84d98-39cc-4016-9f0d-01d4ddb7e0d2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:41.324156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fc84d98-39cc-4016-9f0d-01d4ddb7e0d2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:41.324712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fc84d98-39cc-4016-9f0d-01d4ddb7e0d2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:41.325137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fc84d98-39cc-4016-9f0d-01d4ddb7e0d2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:41.386068 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9fc84d98-39cc-4016-9f0d-01d4ddb7e0d2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.103587 Sep 08 13:30:41.387467 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2693/5518] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:30:41 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:30:41.650283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eba92bed-ba43-4997-b3fd-ed62857de0c2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:41.651343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eba92bed-ba43-4997-b3fd-ed62857de0c2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:41.662638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eba92bed-ba43-4997-b3fd-ed62857de0c2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:41.664930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eba92bed-ba43-4997-b3fd-ed62857de0c2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:41.665914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eba92bed-ba43-4997-b3fd-ed62857de0c2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:41.667834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eba92bed-ba43-4997-b3fd-ed62857de0c2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:41.669797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eba92bed-ba43-4997-b3fd-ed62857de0c2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:41.670796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eba92bed-ba43-4997-b3fd-ed62857de0c2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:41.751795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:30:41.752588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:30:41.753505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:30:41.754272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:30:41.755044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:30:41.755750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eba92bed-ba43-4997-b3fd-ed62857de0c2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:30:41.778660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:41.779678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:41.780735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:41.782607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:41.783889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:41.784954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:41.839370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:30:41.853912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for user 6f65d872026946a7a6badc404b161499 and project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:30:41.883444 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eba92bed-ba43-4997-b3fd-ed62857de0c2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 204 len: 0 microversion: 2.1 time: 0.242454 Sep 08 13:30:41.889519 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2694/5519] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:30:41 2022] DELETE /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:30:41.902365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92378192-248c-4c06-8a30-f5466e472b35 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:41.904073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-92378192-248c-4c06-8a30-f5466e472b35 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:41.924705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92378192-248c-4c06-8a30-f5466e472b35 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:41.925584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92378192-248c-4c06-8a30-f5466e472b35 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:41.926408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92378192-248c-4c06-8a30-f5466e472b35 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:41.927934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92378192-248c-4c06-8a30-f5466e472b35 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:41.929149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92378192-248c-4c06-8a30-f5466e472b35 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:41.930436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92378192-248c-4c06-8a30-f5466e472b35 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:41.984784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:30:41.988976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7593ffbf-2f4d-4f57-99a9-264d2d047651',volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:30:42.250536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-92378192-248c-4c06-8a30-f5466e472b35 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:42.271705 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92378192-248c-4c06-8a30-f5466e472b35 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1682 microversion: 2.1 time: 0.379504 Sep 08 13:30:42.273260 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2695/5520] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:41 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1682 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:42.311832 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00dc5cb5-3e25-4066-b9e9-182438837436 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.322529 Sep 08 13:30:42.314633 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2826/5521] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:30:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:30:42.334133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-16778970-0c17-4229-a6f5-0e057acaa86c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:42.336528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-16778970-0c17-4229-a6f5-0e057acaa86c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:42.471287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-16778970-0c17-4229-a6f5-0e057acaa86c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:42.489531 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-16778970-0c17-4229-a6f5-0e057acaa86c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1056 microversion: 2.1 time: 0.162493 Sep 08 13:30:42.501066 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2696/5522] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:42 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1056 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:43.320134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-65cbce67-d2fb-4507-8e14-28348c237ffa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:43.322917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-65cbce67-d2fb-4507-8e14-28348c237ffa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:43.349244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-65cbce67-d2fb-4507-8e14-28348c237ffa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:43.350834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-65cbce67-d2fb-4507-8e14-28348c237ffa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:43.352116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-65cbce67-d2fb-4507-8e14-28348c237ffa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:43.353833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-65cbce67-d2fb-4507-8e14-28348c237ffa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:43.363057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-65cbce67-d2fb-4507-8e14-28348c237ffa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:43.365227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-65cbce67-d2fb-4507-8e14-28348c237ffa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:43.530754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e9ab10b-903c-45e9-b2b3-29ca81ecb580 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:43.538200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6e9ab10b-903c-45e9-b2b3-29ca81ecb580 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:43.770906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6e9ab10b-903c-45e9-b2b3-29ca81ecb580 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:43.784435 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e9ab10b-903c-45e9-b2b3-29ca81ecb580 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1056 microversion: 2.1 time: 0.267526 Sep 08 13:30:43.785576 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2697/5523] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:43 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1056 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:43.873828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-65cbce67-d2fb-4507-8e14-28348c237ffa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:43.886451 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-65cbce67-d2fb-4507-8e14-28348c237ffa tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1682 microversion: 2.1 time: 0.574668 Sep 08 13:30:43.892354 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2827/5524] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:43 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1682 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:44.864912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7f3174b6-be09-4cca-af83-f11c66bb09fc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:44.868824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f3174b6-be09-4cca-af83-f11c66bb09fc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:44.935955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2d50ca71-738b-4139-a99b-f4fbb19216ac tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:44.937085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2d50ca71-738b-4139-a99b-f4fbb19216ac tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:44.957531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d50ca71-738b-4139-a99b-f4fbb19216ac tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:44.959787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d50ca71-738b-4139-a99b-f4fbb19216ac tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:44.961362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d50ca71-738b-4139-a99b-f4fbb19216ac tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:44.963209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d50ca71-738b-4139-a99b-f4fbb19216ac tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:44.965208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d50ca71-738b-4139-a99b-f4fbb19216ac tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:44.966717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d50ca71-738b-4139-a99b-f4fbb19216ac tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:45.049102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7f3174b6-be09-4cca-af83-f11c66bb09fc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:45.067908 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7f3174b6-be09-4cca-af83-f11c66bb09fc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1056 microversion: 2.1 time: 0.234329 Sep 08 13:30:45.084947 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2698/5525] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:44 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1056 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:45.133405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2d50ca71-738b-4139-a99b-f4fbb19216ac tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:45.153766 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2d50ca71-738b-4139-a99b-f4fbb19216ac tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1614 microversion: 2.1 time: 0.226871 Sep 08 13:30:45.155541 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2828/5526] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:44 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1614 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:45.620820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e13112a0-3869-4e84-8da4-158cb182fb4c req-f8dab303-984d-43de-bfc1-6781c301f712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b70835a0-c84c-4c65-b1ba-3404e8865d3f", "name": "network-vif-deleted", "tag": "16034cbc-fb52-4bcf-afd5-e9432e448989"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:30:45.715632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e13112a0-3869-4e84-8da4-158cb182fb4c req-f8dab303-984d-43de-bfc1-6781c301f712 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:45.716531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e13112a0-3869-4e84-8da4-158cb182fb4c req-f8dab303-984d-43de-bfc1-6781c301f712 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:45.722216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e13112a0-3869-4e84-8da4-158cb182fb4c req-f8dab303-984d-43de-bfc1-6781c301f712 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:45.771786 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e13112a0-3869-4e84-8da4-158cb182fb4c req-f8dab303-984d-43de-bfc1-6781c301f712 service nova] Creating event network-vif-deleted:16034cbc-fb52-4bcf-afd5-e9432e448989 for instance b70835a0-c84c-4c65-b1ba-3404e8865d3f on n-h1-852084-10 Sep 08 13:30:45.792567 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e13112a0-3869-4e84-8da4-158cb182fb4c req-f8dab303-984d-43de-bfc1-6781c301f712 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174426 Sep 08 13:30:45.797903 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2699/5527] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:30:46.130994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d1ead8b0-4a21-4051-bb84-2a238b7e9126 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:46.132285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d1ead8b0-4a21-4051-bb84-2a238b7e9126 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:46.168161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1ead8b0-4a21-4051-bb84-2a238b7e9126 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:46.170891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1ead8b0-4a21-4051-bb84-2a238b7e9126 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:46.172109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1ead8b0-4a21-4051-bb84-2a238b7e9126 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:46.176541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1ead8b0-4a21-4051-bb84-2a238b7e9126 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:46.178430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1ead8b0-4a21-4051-bb84-2a238b7e9126 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:46.180228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1ead8b0-4a21-4051-bb84-2a238b7e9126 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:46.207126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:46.209545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:46.238820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:46.241130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:46.242361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:46.246078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:46.247718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:46.249258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:46.391788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:46.402269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:46.402821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d1ead8b0-4a21-4051-bb84-2a238b7e9126 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:46.403020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:46.403830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lazy-loading 'fault' on Instance uuid b70835a0-c84c-4c65-b1ba-3404e8865d3f {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:30:46.462366 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d1ead8b0-4a21-4051-bb84-2a238b7e9126 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1154 microversion: 2.1 time: 0.333620 Sep 08 13:30:46.469098 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2829/5528] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:46 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1154 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:46.549434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:46.575844 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d76e6662-e0fb-4468-94ba-efadc38ed49a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 200 len: 1331 microversion: 2.1 time: 0.385119 Sep 08 13:30:46.577744 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2700/5529] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:46 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 1331 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:30:47.499159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-66af77bc-9af3-4d5c-88a3-f68e189d923d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:47.500848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-66af77bc-9af3-4d5c-88a3-f68e189d923d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:47.519219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66af77bc-9af3-4d5c-88a3-f68e189d923d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:47.520633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66af77bc-9af3-4d5c-88a3-f68e189d923d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:47.521865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66af77bc-9af3-4d5c-88a3-f68e189d923d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:47.523703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66af77bc-9af3-4d5c-88a3-f68e189d923d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:47.525645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66af77bc-9af3-4d5c-88a3-f68e189d923d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:47.527490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66af77bc-9af3-4d5c-88a3-f68e189d923d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:47.603264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5ffb50e4-0715-42d1-abec-4d13dc49e19f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:47.604213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5ffb50e4-0715-42d1-abec-4d13dc49e19f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:47.618324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ffb50e4-0715-42d1-abec-4d13dc49e19f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:47.619399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ffb50e4-0715-42d1-abec-4d13dc49e19f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:47.621401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ffb50e4-0715-42d1-abec-4d13dc49e19f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:47.622709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ffb50e4-0715-42d1-abec-4d13dc49e19f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:47.625003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ffb50e4-0715-42d1-abec-4d13dc49e19f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:47.625470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5ffb50e4-0715-42d1-abec-4d13dc49e19f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:47.661397 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-5ffb50e4-0715-42d1-abec-4d13dc49e19f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5ffb50e4-0715-42d1-abec-4d13dc49e19f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f HTTP/1.1 Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'b70835a0-c84c-4c65-b1ba-3404e8865d3f'} Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:30:47.671497 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:30:47.675634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:30:47.675634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:30:47.675634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:30:47.675634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:30:47.675634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:30:47.675634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:30:47.675634 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:30:47.676057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5ffb50e4-0715-42d1-abec-4d13dc49e19f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 404 to user: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:30:47.676873 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5ffb50e4-0715-42d1-abec-4d13dc49e19f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 404 len: 111 microversion: 2.1 time: 0.077913 Sep 08 13:30:47.680470 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2701/5530] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:47 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:30:47.701174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b5f000d-6a08-4cd3-9d7f-0d2fd5aa8614 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '.version_select at 0x7fdb3bd08af0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:47.713243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-66af77bc-9af3-4d5c-88a3-f68e189d923d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:47.729283 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-66af77bc-9af3-4d5c-88a3-f68e189d923d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1172 microversion: 2.1 time: 0.239428 Sep 08 13:30:47.730665 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2830/5531] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:47 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1172 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:47.748512 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1b5f000d-6a08-4cd3-9d7f-0d2fd5aa8614 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363682362" status: 202 len: 0 microversion: 2.1 time: 0.062087 Sep 08 13:30:47.750262 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2702/5532] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Sep 8 13:30:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1363682362 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:30:48.772772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0cf72c38-6c6c-453d-9c4a-5a14b9ec571f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:48.774618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0cf72c38-6c6c-453d-9c4a-5a14b9ec571f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:48.787182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0cf72c38-6c6c-453d-9c4a-5a14b9ec571f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:48.789275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0cf72c38-6c6c-453d-9c4a-5a14b9ec571f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:48.790667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0cf72c38-6c6c-453d-9c4a-5a14b9ec571f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:48.792533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0cf72c38-6c6c-453d-9c4a-5a14b9ec571f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:48.793391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0cf72c38-6c6c-453d-9c4a-5a14b9ec571f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:48.795643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0cf72c38-6c6c-453d-9c4a-5a14b9ec571f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:49.602563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0cf72c38-6c6c-453d-9c4a-5a14b9ec571f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:49.616376 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0cf72c38-6c6c-453d-9c4a-5a14b9ec571f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1214 microversion: 2.1 time: 0.849133 Sep 08 13:30:49.617731 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2831/5533] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:48 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1214 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:49.850515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b784c872-d145-45f9-89c6-43dd33bb5611 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: .version_select at 0x7fdb3ae09160>, body: {"keypair": {"name": "tempest-keypair-1513543407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkmnBulAoBL+DoUjXXufCUn50YCvtTDJZ1LECfUQQM/mfUF+pWeQI9v+RWUge85s7QL21hiMK/BI9E98FHu5QJh5c9YXEwaEklogELypNH7cK/DHBZAMhBkxiGbPucfFA=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:30:49.886554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b784c872-d145-45f9-89c6-43dd33bb5611 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for project efc65cf30371430a9b085afea75e7a5b. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:30:49.898870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-b784c872-d145-45f9-89c6-43dd33bb5611 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for user 1c622939c63749dc944918e2717cd09a and project efc65cf30371430a9b085afea75e7a5b. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:30:49.943771 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b784c872-d145-45f9-89c6-43dd33bb5611 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097499 Sep 08 13:30:49.944556 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2703/5534] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:30:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:30:50.646074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e0c1ffd4-6594-4684-9584-ddbf37a33e1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:50.647530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e0c1ffd4-6594-4684-9584-ddbf37a33e1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:50.660522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e0c1ffd4-6594-4684-9584-ddbf37a33e1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:50.661900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e0c1ffd4-6594-4684-9584-ddbf37a33e1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:50.663363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e0c1ffd4-6594-4684-9584-ddbf37a33e1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:50.665398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e0c1ffd4-6594-4684-9584-ddbf37a33e1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:50.673356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e0c1ffd4-6594-4684-9584-ddbf37a33e1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:50.675169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e0c1ffd4-6594-4684-9584-ddbf37a33e1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:50.939164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e7d2be9a-c2c8-4d18-b58a-3fe1c8c6326f req-f9a7a3c6-86e0-48bd-bec5-41e01801cf81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53fdcf45-802d-4786-8ac0-1954b9ee0009", "tag": "2c45ec93-eac7-4883-9d69-42149fa59efd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:30:50.959124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e0c1ffd4-6594-4684-9584-ddbf37a33e1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:50.962620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e7d2be9a-c2c8-4d18-b58a-3fe1c8c6326f req-f9a7a3c6-86e0-48bd-bec5-41e01801cf81 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:50.962804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e7d2be9a-c2c8-4d18-b58a-3fe1c8c6326f req-f9a7a3c6-86e0-48bd-bec5-41e01801cf81 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:50.964188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e7d2be9a-c2c8-4d18-b58a-3fe1c8c6326f req-f9a7a3c6-86e0-48bd-bec5-41e01801cf81 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:50.989533 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e0c1ffd4-6594-4684-9584-ddbf37a33e1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1214 microversion: 2.1 time: 0.348972 Sep 08 13:30:50.991706 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2832/5535] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:50 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1214 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:50.993013 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e7d2be9a-c2c8-4d18-b58a-3fe1c8c6326f req-f9a7a3c6-86e0-48bd-bec5-41e01801cf81 service nova] Creating event network-changed:2c45ec93-eac7-4883-9d69-42149fa59efd for instance 53fdcf45-802d-4786-8ac0-1954b9ee0009 on n-h2-852084-10 Sep 08 13:30:51.009210 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e7d2be9a-c2c8-4d18-b58a-3fe1c8c6326f req-f9a7a3c6-86e0-48bd-bec5-41e01801cf81 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075109 Sep 08 13:30:51.010533 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2704/5536] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:30:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:30:52.037372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c99e32a8-a0db-4f3d-bd36-f7f08a6f30f0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:52.039429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c99e32a8-a0db-4f3d-bd36-f7f08a6f30f0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:52.050427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:30:52.051788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:30:52.054530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c99e32a8-a0db-4f3d-bd36-f7f08a6f30f0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:52.055699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c99e32a8-a0db-4f3d-bd36-f7f08a6f30f0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:52.056431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c99e32a8-a0db-4f3d-bd36-f7f08a6f30f0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:52.057467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c99e32a8-a0db-4f3d-bd36-f7f08a6f30f0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:52.058240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c99e32a8-a0db-4f3d-bd36-f7f08a6f30f0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:52.059004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c99e32a8-a0db-4f3d-bd36-f7f08a6f30f0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:52.285986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-267497981", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed1157e7-c274-4d74-a471-1eb655ce6d93"}], "security_groups": [{"name": "tempest-securitygroup--320183831"}], "key_name": "tempest-keypair-1513543407", "user_data": "}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:30:52.436906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c99e32a8-a0db-4f3d-bd36-f7f08a6f30f0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:52.468095 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c99e32a8-a0db-4f3d-bd36-f7f08a6f30f0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1214 microversion: 2.1 time: 0.435691 Sep 08 13:30:52.470726 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2833/5537] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:52 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1214 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:30:52.517455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] validate_networks() for [('ed1157e7-c274-4d74-a471-1eb655ce6d93', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:30:53.389150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:30:53.389899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:30:53.390116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:30:53.390477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:30:53.390923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:30:53.406643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:53.407598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:53.408382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:53.409374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:53.409926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:53.410440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:53.433682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for project efc65cf30371430a9b085afea75e7a5b. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:30:53.440350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Getting quotas for user 1c622939c63749dc944918e2717cd09a and project efc65cf30371430a9b085afea75e7a5b. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:30:53.463735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:30:53.472792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:30:53.522892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac141fdc-ee1b-43df-b359-72ac4f546abe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:53.524229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ac141fdc-ee1b-43df-b359-72ac4f546abe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:53.535668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac141fdc-ee1b-43df-b359-72ac4f546abe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:53.536552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac141fdc-ee1b-43df-b359-72ac4f546abe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:53.537326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac141fdc-ee1b-43df-b359-72ac4f546abe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:53.538539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac141fdc-ee1b-43df-b359-72ac4f546abe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:53.539730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac141fdc-ee1b-43df-b359-72ac4f546abe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:53.541995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac141fdc-ee1b-43df-b359-72ac4f546abe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:53.566736 n-d-852084-10 devstack@n-api.service[128971]: ERROR oslo.messaging._drivers.impl_rabbit [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [0cff7a8f-28d3-48a0-85b5-d0b15fdc4db0] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 13:30:53.744086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ac141fdc-ee1b-43df-b359-72ac4f546abe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:53.754066 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ac141fdc-ee1b-43df-b359-72ac4f546abe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1214 microversion: 2.1 time: 0.240144 Sep 08 13:30:53.754784 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2834/5538] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:53 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1214 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:30:54.576953 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [0cff7a8f-28d3-48a0-85b5-d0b15fdc4db0] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 36068. Sep 08 13:30:54.581776 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-621e893a-481e-4d63-89b3-17838edc4879 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.306734 Sep 08 13:30:54.582874 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2705/5539] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:30:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 2309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:30:54.604454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e5beb231-7c18-45bf-bcf5-479234d2d70a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:54.605793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e5beb231-7c18-45bf-bcf5-479234d2d70a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:54.707650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e5beb231-7c18-45bf-bcf5-479234d2d70a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:54.725148 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e5beb231-7c18-45bf-bcf5-479234d2d70a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1241 microversion: 2.1 time: 0.128523 Sep 08 13:30:54.726919 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2835/5540] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:54 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1241 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:54.780445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-37b35360-3977-4cbb-a153-26a58b8d6544 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:54.781431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-37b35360-3977-4cbb-a153-26a58b8d6544 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:54.792176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37b35360-3977-4cbb-a153-26a58b8d6544 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:54.793305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37b35360-3977-4cbb-a153-26a58b8d6544 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:54.793951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37b35360-3977-4cbb-a153-26a58b8d6544 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:54.795165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37b35360-3977-4cbb-a153-26a58b8d6544 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:54.795876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37b35360-3977-4cbb-a153-26a58b8d6544 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:54.796737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-37b35360-3977-4cbb-a153-26a58b8d6544 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:55.074053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-37b35360-3977-4cbb-a153-26a58b8d6544 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:55.098437 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-37b35360-3977-4cbb-a153-26a58b8d6544 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1214 microversion: 2.1 time: 0.322653 Sep 08 13:30:55.100153 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2706/5541] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:54 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1214 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:55.767929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3cbfcbf5-c7ae-4b7a-b914-238d2349fcf9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:55.768681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3cbfcbf5-c7ae-4b7a-b914-238d2349fcf9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:55.784421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cbfcbf5-c7ae-4b7a-b914-238d2349fcf9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:55.784920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cbfcbf5-c7ae-4b7a-b914-238d2349fcf9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:55.785595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cbfcbf5-c7ae-4b7a-b914-238d2349fcf9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:55.786547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cbfcbf5-c7ae-4b7a-b914-238d2349fcf9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:55.787425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cbfcbf5-c7ae-4b7a-b914-238d2349fcf9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:55.789114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cbfcbf5-c7ae-4b7a-b914-238d2349fcf9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:55.921408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3cbfcbf5-c7ae-4b7a-b914-238d2349fcf9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:55.937781 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3cbfcbf5-c7ae-4b7a-b914-238d2349fcf9 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1293 microversion: 2.1 time: 0.174109 Sep 08 13:30:55.943459 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2836/5542] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:55 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1293 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:56.134261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a17f6c8c-cde4-484e-b1f6-e9c50a252c7d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:56.139896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a17f6c8c-cde4-484e-b1f6-e9c50a252c7d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:56.158997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a17f6c8c-cde4-484e-b1f6-e9c50a252c7d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:56.164079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a17f6c8c-cde4-484e-b1f6-e9c50a252c7d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:56.165020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a17f6c8c-cde4-484e-b1f6-e9c50a252c7d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:56.167656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a17f6c8c-cde4-484e-b1f6-e9c50a252c7d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:56.168682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a17f6c8c-cde4-484e-b1f6-e9c50a252c7d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:56.169769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a17f6c8c-cde4-484e-b1f6-e9c50a252c7d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:56.534360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a17f6c8c-cde4-484e-b1f6-e9c50a252c7d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:56.552000 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a17f6c8c-cde4-484e-b1f6-e9c50a252c7d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1214 microversion: 2.1 time: 0.431902 Sep 08 13:30:56.553421 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2707/5543] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:56 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1214 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:30:56.989910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1af9bc6c-bcd0-403c-b69d-c84a1cf368f0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:56.991457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1af9bc6c-bcd0-403c-b69d-c84a1cf368f0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:57.008095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1af9bc6c-bcd0-403c-b69d-c84a1cf368f0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:57.008984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1af9bc6c-bcd0-403c-b69d-c84a1cf368f0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:57.017589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1af9bc6c-bcd0-403c-b69d-c84a1cf368f0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:57.018975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1af9bc6c-bcd0-403c-b69d-c84a1cf368f0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:57.022415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1af9bc6c-bcd0-403c-b69d-c84a1cf368f0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:57.023601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1af9bc6c-bcd0-403c-b69d-c84a1cf368f0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:57.210175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1af9bc6c-bcd0-403c-b69d-c84a1cf368f0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:57.229216 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1af9bc6c-bcd0-403c-b69d-c84a1cf368f0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1299 microversion: 2.1 time: 0.252530 Sep 08 13:30:57.231110 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2837/5544] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:56 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1299 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:57.586065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d6fc77ec-5e20-4150-8c14-6c9621a387ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:57.587135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d6fc77ec-5e20-4150-8c14-6c9621a387ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:57.611381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6fc77ec-5e20-4150-8c14-6c9621a387ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:57.611979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6fc77ec-5e20-4150-8c14-6c9621a387ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:57.612431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6fc77ec-5e20-4150-8c14-6c9621a387ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:57.613717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6fc77ec-5e20-4150-8c14-6c9621a387ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:57.614434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6fc77ec-5e20-4150-8c14-6c9621a387ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:57.614927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6fc77ec-5e20-4150-8c14-6c9621a387ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:58.002685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d6fc77ec-5e20-4150-8c14-6c9621a387ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:58.015178 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d6fc77ec-5e20-4150-8c14-6c9621a387ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1214 microversion: 2.1 time: 0.432939 Sep 08 13:30:58.016307 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2708/5545] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:57 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1214 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:58.276707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4168adf3-90f0-4c89-8765-36b787d9cd3e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:58.279039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4168adf3-90f0-4c89-8765-36b787d9cd3e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:58.309493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4168adf3-90f0-4c89-8765-36b787d9cd3e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:58.310028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4168adf3-90f0-4c89-8765-36b787d9cd3e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:58.310492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4168adf3-90f0-4c89-8765-36b787d9cd3e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:58.311269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4168adf3-90f0-4c89-8765-36b787d9cd3e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:58.311750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4168adf3-90f0-4c89-8765-36b787d9cd3e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:58.312205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4168adf3-90f0-4c89-8765-36b787d9cd3e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:58.391890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:30:58.652059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4168adf3-90f0-4c89-8765-36b787d9cd3e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:58.687642 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4168adf3-90f0-4c89-8765-36b787d9cd3e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1366 microversion: 2.1 time: 0.412038 Sep 08 13:30:58.694591 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2838/5546] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:58 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:59.065338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8873b91b-fa12-48d7-91f4-e6e1f5f95639 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:59.066082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8873b91b-fa12-48d7-91f4-e6e1f5f95639 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:59.087353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8873b91b-fa12-48d7-91f4-e6e1f5f95639 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:59.088033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8873b91b-fa12-48d7-91f4-e6e1f5f95639 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:59.089293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8873b91b-fa12-48d7-91f4-e6e1f5f95639 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:59.090329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8873b91b-fa12-48d7-91f4-e6e1f5f95639 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:59.091714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8873b91b-fa12-48d7-91f4-e6e1f5f95639 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:59.092653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8873b91b-fa12-48d7-91f4-e6e1f5f95639 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:59.160362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:30:59.694956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8873b91b-fa12-48d7-91f4-e6e1f5f95639 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:30:59.718815 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8873b91b-fa12-48d7-91f4-e6e1f5f95639 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1214 microversion: 2.1 time: 0.650337 Sep 08 13:30:59.723938 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2709/5547] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:59 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1214 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:30:59.772141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-522de1ef-530d-4a8a-b7e3-cfe5c8c8fbba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:30:59.773335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-522de1ef-530d-4a8a-b7e3-cfe5c8c8fbba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:30:59.830003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-522de1ef-530d-4a8a-b7e3-cfe5c8c8fbba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:59.830699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-522de1ef-530d-4a8a-b7e3-cfe5c8c8fbba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:59.833970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-522de1ef-530d-4a8a-b7e3-cfe5c8c8fbba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:30:59.834886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-522de1ef-530d-4a8a-b7e3-cfe5c8c8fbba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:30:59.835576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-522de1ef-530d-4a8a-b7e3-cfe5c8c8fbba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:30:59.838124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-522de1ef-530d-4a8a-b7e3-cfe5c8c8fbba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:00.370207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-522de1ef-530d-4a8a-b7e3-cfe5c8c8fbba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:00.403750 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-522de1ef-530d-4a8a-b7e3-cfe5c8c8fbba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1366 microversion: 2.1 time: 0.666253 Sep 08 13:31:00.432195 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2839/5548] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:30:59 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1366 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:00.568824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-97707b04-3fdf-457f-825b-1c34d992bfb3 req-0cf96d74-24ad-4cd2-9cf7-4da16ae50169 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6062f90a-3608-41a8-a9c7-ff273ce18f75", "tag": "5ff50012-37d8-4b87-8132-a04b2650a904"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:31:00.580167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:00.610962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-97707b04-3fdf-457f-825b-1c34d992bfb3 req-0cf96d74-24ad-4cd2-9cf7-4da16ae50169 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:00.611918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-97707b04-3fdf-457f-825b-1c34d992bfb3 req-0cf96d74-24ad-4cd2-9cf7-4da16ae50169 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:00.612609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-97707b04-3fdf-457f-825b-1c34d992bfb3 req-0cf96d74-24ad-4cd2-9cf7-4da16ae50169 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:00.656127 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-97707b04-3fdf-457f-825b-1c34d992bfb3 req-0cf96d74-24ad-4cd2-9cf7-4da16ae50169 service nova] Creating event network-changed:5ff50012-37d8-4b87-8132-a04b2650a904 for instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 on n-h1-852084-10 Sep 08 13:31:00.668683 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-97707b04-3fdf-457f-825b-1c34d992bfb3 req-0cf96d74-24ad-4cd2-9cf7-4da16ae50169 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103966 Sep 08 13:31:00.670955 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2710/5549] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:31:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:31:00.752758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d515bc64-73fb-4fff-8e52-232b22444556 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:00.754016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d515bc64-73fb-4fff-8e52-232b22444556 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:00.764653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:00.768199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d515bc64-73fb-4fff-8e52-232b22444556 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:00.778522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d515bc64-73fb-4fff-8e52-232b22444556 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:00.779295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d515bc64-73fb-4fff-8e52-232b22444556 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:00.785608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d515bc64-73fb-4fff-8e52-232b22444556 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:00.786345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d515bc64-73fb-4fff-8e52-232b22444556 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:00.786809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d515bc64-73fb-4fff-8e52-232b22444556 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:01.169291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d515bc64-73fb-4fff-8e52-232b22444556 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:01.205800 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d515bc64-73fb-4fff-8e52-232b22444556 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1214 microversion: 2.1 time: 0.456280 Sep 08 13:31:01.206790 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2840/5550] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:00 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1214 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:01.444965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3be833c2-39ed-48f3-a725-e67017f904fc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:01.445475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3be833c2-39ed-48f3-a725-e67017f904fc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:01.465164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3be833c2-39ed-48f3-a725-e67017f904fc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:01.465723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3be833c2-39ed-48f3-a725-e67017f904fc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:01.466180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3be833c2-39ed-48f3-a725-e67017f904fc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:01.466950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3be833c2-39ed-48f3-a725-e67017f904fc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:01.467477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3be833c2-39ed-48f3-a725-e67017f904fc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:01.472924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3be833c2-39ed-48f3-a725-e67017f904fc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:01.851946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3be833c2-39ed-48f3-a725-e67017f904fc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:01.889375 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3be833c2-39ed-48f3-a725-e67017f904fc tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1366 microversion: 2.1 time: 0.456992 Sep 08 13:31:01.899268 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2711/5551] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:01 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1366 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:02.236916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-594e5553-2254-4c13-8654-7862f912403e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:02.237592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-594e5553-2254-4c13-8654-7862f912403e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:02.292578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-594e5553-2254-4c13-8654-7862f912403e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:02.294031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-594e5553-2254-4c13-8654-7862f912403e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.037s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:02.295216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-594e5553-2254-4c13-8654-7862f912403e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:02.299468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-594e5553-2254-4c13-8654-7862f912403e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:02.301548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-594e5553-2254-4c13-8654-7862f912403e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:02.305707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-594e5553-2254-4c13-8654-7862f912403e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:02.647512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-594e5553-2254-4c13-8654-7862f912403e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:02.669302 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-594e5553-2254-4c13-8654-7862f912403e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1214 microversion: 2.1 time: 0.436308 Sep 08 13:31:02.673025 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2841/5552] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:02 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1214 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:31:02.919146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-119808ed-7a1f-4ab0-a136-6d14ac16a7e2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:02.922413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-119808ed-7a1f-4ab0-a136-6d14ac16a7e2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:02.941624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-119808ed-7a1f-4ab0-a136-6d14ac16a7e2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:02.942480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-119808ed-7a1f-4ab0-a136-6d14ac16a7e2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:02.943202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-119808ed-7a1f-4ab0-a136-6d14ac16a7e2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:02.944666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-119808ed-7a1f-4ab0-a136-6d14ac16a7e2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:02.945618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-119808ed-7a1f-4ab0-a136-6d14ac16a7e2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:02.946365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-119808ed-7a1f-4ab0-a136-6d14ac16a7e2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:03.231772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-119808ed-7a1f-4ab0-a136-6d14ac16a7e2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:03.251805 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-119808ed-7a1f-4ab0-a136-6d14ac16a7e2 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1366 microversion: 2.1 time: 0.341376 Sep 08 13:31:03.253597 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2712/5553] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:02 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1366 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:31:03.708146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-41ff8d96-94a5-4885-9f0c-9d7a2052c96e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:03.709500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-41ff8d96-94a5-4885-9f0c-9d7a2052c96e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:03.719645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41ff8d96-94a5-4885-9f0c-9d7a2052c96e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:03.720278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41ff8d96-94a5-4885-9f0c-9d7a2052c96e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:03.734731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41ff8d96-94a5-4885-9f0c-9d7a2052c96e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:03.735595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41ff8d96-94a5-4885-9f0c-9d7a2052c96e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:03.736099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41ff8d96-94a5-4885-9f0c-9d7a2052c96e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:03.736543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-41ff8d96-94a5-4885-9f0c-9d7a2052c96e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:04.014884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-41ff8d96-94a5-4885-9f0c-9d7a2052c96e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:04.027577 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-41ff8d96-94a5-4885-9f0c-9d7a2052c96e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1214 microversion: 2.1 time: 0.322839 Sep 08 13:31:04.028823 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2842/5554] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:03 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1214 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:04.287656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54338bb6-3a8b-4965-8209-da080d609481 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:04.288897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54338bb6-3a8b-4965-8209-da080d609481 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:04.296449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:04.297888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=16 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:04.312663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54338bb6-3a8b-4965-8209-da080d609481 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:04.313877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54338bb6-3a8b-4965-8209-da080d609481 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:04.315327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54338bb6-3a8b-4965-8209-da080d609481 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:04.317115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54338bb6-3a8b-4965-8209-da080d609481 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:04.318846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54338bb6-3a8b-4965-8209-da080d609481 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:04.319713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54338bb6-3a8b-4965-8209-da080d609481 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:04.584733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54338bb6-3a8b-4965-8209-da080d609481 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:04.616092 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54338bb6-3a8b-4965-8209-da080d609481 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1366 microversion: 2.1 time: 0.340206 Sep 08 13:31:04.619508 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2713/5555] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:04 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:05.071128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ed5373e9-c206-46c5-8c75-d03ecf0c7eb4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:05.073524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ed5373e9-c206-46c5-8c75-d03ecf0c7eb4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:05.104944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:05.108618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed5373e9-c206-46c5-8c75-d03ecf0c7eb4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:05.109688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed5373e9-c206-46c5-8c75-d03ecf0c7eb4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:05.110853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed5373e9-c206-46c5-8c75-d03ecf0c7eb4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:05.112289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed5373e9-c206-46c5-8c75-d03ecf0c7eb4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:05.113071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed5373e9-c206-46c5-8c75-d03ecf0c7eb4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:05.113912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed5373e9-c206-46c5-8c75-d03ecf0c7eb4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:05.391409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ed5373e9-c206-46c5-8c75-d03ecf0c7eb4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:05.401789 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ed5373e9-c206-46c5-8c75-d03ecf0c7eb4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1202 microversion: 2.1 time: 0.341140 Sep 08 13:31:05.403273 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2843/5556] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:05 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1202 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:05.650883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3c1cfb5-095a-4fd9-80b6-05f7ebd8bcf6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:05.651729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d3c1cfb5-095a-4fd9-80b6-05f7ebd8bcf6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:05.661295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3c1cfb5-095a-4fd9-80b6-05f7ebd8bcf6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:05.662796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3c1cfb5-095a-4fd9-80b6-05f7ebd8bcf6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:05.664021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3c1cfb5-095a-4fd9-80b6-05f7ebd8bcf6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:05.664887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3c1cfb5-095a-4fd9-80b6-05f7ebd8bcf6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:05.665430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3c1cfb5-095a-4fd9-80b6-05f7ebd8bcf6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:05.666886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3c1cfb5-095a-4fd9-80b6-05f7ebd8bcf6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:05.925745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d3c1cfb5-095a-4fd9-80b6-05f7ebd8bcf6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:05.940421 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3c1cfb5-095a-4fd9-80b6-05f7ebd8bcf6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1366 microversion: 2.1 time: 0.293210 Sep 08 13:31:05.942816 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2714/5557] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:05 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:06.437432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5eb246dd-f259-47d1-b389-ee94fa2ecdc2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:06.438128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5eb246dd-f259-47d1-b389-ee94fa2ecdc2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:06.446571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5eb246dd-f259-47d1-b389-ee94fa2ecdc2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:06.447078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5eb246dd-f259-47d1-b389-ee94fa2ecdc2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:06.447601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5eb246dd-f259-47d1-b389-ee94fa2ecdc2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:06.448360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5eb246dd-f259-47d1-b389-ee94fa2ecdc2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:06.449033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5eb246dd-f259-47d1-b389-ee94fa2ecdc2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:06.449473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5eb246dd-f259-47d1-b389-ee94fa2ecdc2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:06.676865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5eb246dd-f259-47d1-b389-ee94fa2ecdc2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:06.696273 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5eb246dd-f259-47d1-b389-ee94fa2ecdc2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1202 microversion: 2.1 time: 0.263536 Sep 08 13:31:06.698844 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2844/5558] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:06 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1202 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:06.985374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f38d8a4a-8834-4c11-a91c-f8a4fe8bd65f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:06.986592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f38d8a4a-8834-4c11-a91c-f8a4fe8bd65f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:06.995142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f38d8a4a-8834-4c11-a91c-f8a4fe8bd65f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:06.995818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f38d8a4a-8834-4c11-a91c-f8a4fe8bd65f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:06.996341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f38d8a4a-8834-4c11-a91c-f8a4fe8bd65f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:06.997173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f38d8a4a-8834-4c11-a91c-f8a4fe8bd65f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:06.997720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f38d8a4a-8834-4c11-a91c-f8a4fe8bd65f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:06.998160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f38d8a4a-8834-4c11-a91c-f8a4fe8bd65f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:07.200132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f38d8a4a-8834-4c11-a91c-f8a4fe8bd65f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:07.215517 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f38d8a4a-8834-4c11-a91c-f8a4fe8bd65f tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1366 microversion: 2.1 time: 0.235910 Sep 08 13:31:07.217728 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2715/5559] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:06 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:07.733286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-32673939-fcc5-40db-a52e-7551298d8e0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:07.736954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-32673939-fcc5-40db-a52e-7551298d8e0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:07.751026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32673939-fcc5-40db-a52e-7551298d8e0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:07.752429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32673939-fcc5-40db-a52e-7551298d8e0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:07.753534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32673939-fcc5-40db-a52e-7551298d8e0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:07.755244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32673939-fcc5-40db-a52e-7551298d8e0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:07.756745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32673939-fcc5-40db-a52e-7551298d8e0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:07.757845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32673939-fcc5-40db-a52e-7551298d8e0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:08.018927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2afcc5b6-ce40-488d-8f39-edadb055ed15 req-8547472e-8628-4cb2-be26-4687c0b5134d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6062f90a-3608-41a8-a9c7-ff273ce18f75", "name": "network-vif-plugged", "status": "completed", "tag": "5ff50012-37d8-4b87-8132-a04b2650a904"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:31:08.073198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2afcc5b6-ce40-488d-8f39-edadb055ed15 req-8547472e-8628-4cb2-be26-4687c0b5134d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:08.074799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2afcc5b6-ce40-488d-8f39-edadb055ed15 req-8547472e-8628-4cb2-be26-4687c0b5134d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:08.075885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2afcc5b6-ce40-488d-8f39-edadb055ed15 req-8547472e-8628-4cb2-be26-4687c0b5134d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:08.107777 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2afcc5b6-ce40-488d-8f39-edadb055ed15 req-8547472e-8628-4cb2-be26-4687c0b5134d service nova] Creating event network-vif-plugged:5ff50012-37d8-4b87-8132-a04b2650a904 for instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 on n-h1-852084-10 Sep 08 13:31:08.119934 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2afcc5b6-ce40-488d-8f39-edadb055ed15 req-8547472e-8628-4cb2-be26-4687c0b5134d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152664 Sep 08 13:31:08.121779 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2716/5560] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:31:08.148100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-32673939-fcc5-40db-a52e-7551298d8e0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:08.160186 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-32673939-fcc5-40db-a52e-7551298d8e0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1202 microversion: 2.1 time: 0.436401 Sep 08 13:31:08.160993 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2845/5561] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:07 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1202 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:08.261350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b3752ee9-e418-4b0c-8c63-155825376041 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:08.262381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b3752ee9-e418-4b0c-8c63-155825376041 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:08.273315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3752ee9-e418-4b0c-8c63-155825376041 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:08.275015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3752ee9-e418-4b0c-8c63-155825376041 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:08.277922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3752ee9-e418-4b0c-8c63-155825376041 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:08.279987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3752ee9-e418-4b0c-8c63-155825376041 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:08.281417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3752ee9-e418-4b0c-8c63-155825376041 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:08.283041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3752ee9-e418-4b0c-8c63-155825376041 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:08.551642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b3752ee9-e418-4b0c-8c63-155825376041 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:08.566113 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b3752ee9-e418-4b0c-8c63-155825376041 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1366 microversion: 2.1 time: 0.314432 Sep 08 13:31:08.567151 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2717/5562] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:08 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1366 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:31:09.200108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5b9fb894-f116-4cfd-8e22-eec1916e4c1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:09.201318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5b9fb894-f116-4cfd-8e22-eec1916e4c1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:09.215013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b9fb894-f116-4cfd-8e22-eec1916e4c1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:09.215886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b9fb894-f116-4cfd-8e22-eec1916e4c1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:09.216927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b9fb894-f116-4cfd-8e22-eec1916e4c1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:09.218252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b9fb894-f116-4cfd-8e22-eec1916e4c1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:09.219120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b9fb894-f116-4cfd-8e22-eec1916e4c1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:09.219973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b9fb894-f116-4cfd-8e22-eec1916e4c1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:09.537264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5b9fb894-f116-4cfd-8e22-eec1916e4c1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:09.550159 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5b9fb894-f116-4cfd-8e22-eec1916e4c1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1202 microversion: 2.1 time: 0.358780 Sep 08 13:31:09.551431 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2846/5563] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:09 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1202 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:09.597865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aca1cd61-d8e2-407c-8f4d-46c685acc48e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:09.600742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-aca1cd61-d8e2-407c-8f4d-46c685acc48e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:09.614443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aca1cd61-d8e2-407c-8f4d-46c685acc48e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:09.621416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aca1cd61-d8e2-407c-8f4d-46c685acc48e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:09.621416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aca1cd61-d8e2-407c-8f4d-46c685acc48e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:09.621416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aca1cd61-d8e2-407c-8f4d-46c685acc48e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:09.621416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aca1cd61-d8e2-407c-8f4d-46c685acc48e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:09.621416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aca1cd61-d8e2-407c-8f4d-46c685acc48e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:09.920216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-aca1cd61-d8e2-407c-8f4d-46c685acc48e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:09.934874 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-aca1cd61-d8e2-407c-8f4d-46c685acc48e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1555 microversion: 2.1 time: 0.344016 Sep 08 13:31:09.946585 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2718/5564] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:09 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1555 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:09.978363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-085ad478-775c-441f-9fdd-3eeacc2b7160 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:09.979374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-085ad478-775c-441f-9fdd-3eeacc2b7160 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:09.990685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-085ad478-775c-441f-9fdd-3eeacc2b7160 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:09.991586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-085ad478-775c-441f-9fdd-3eeacc2b7160 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:09.992680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-085ad478-775c-441f-9fdd-3eeacc2b7160 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:09.994268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-085ad478-775c-441f-9fdd-3eeacc2b7160 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:09.995176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-085ad478-775c-441f-9fdd-3eeacc2b7160 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:09.996004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-085ad478-775c-441f-9fdd-3eeacc2b7160 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:10.132041 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-085ad478-775c-441f-9fdd-3eeacc2b7160 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.160594 Sep 08 13:31:10.133080 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2847/5565] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:31:09 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:31:10.591696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d0019440-cd08-40d4-91b2-597ef4dcc5ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:10.592340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d0019440-cd08-40d4-91b2-597ef4dcc5ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:10.607114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0019440-cd08-40d4-91b2-597ef4dcc5ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:10.612669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0019440-cd08-40d4-91b2-597ef4dcc5ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:10.613439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0019440-cd08-40d4-91b2-597ef4dcc5ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:10.614477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0019440-cd08-40d4-91b2-597ef4dcc5ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:10.615381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0019440-cd08-40d4-91b2-597ef4dcc5ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:10.615820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0019440-cd08-40d4-91b2-597ef4dcc5ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:11.086973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d0019440-cd08-40d4-91b2-597ef4dcc5ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:11.104804 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d0019440-cd08-40d4-91b2-597ef4dcc5ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1202 microversion: 2.1 time: 0.517562 Sep 08 13:31:11.105760 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2719/5566] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:10 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1202 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:12.145058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3084cafb-3532-4ac6-ba65-1a08d278e5e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:12.146371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3084cafb-3532-4ac6-ba65-1a08d278e5e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:12.153587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3084cafb-3532-4ac6-ba65-1a08d278e5e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:12.154489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3084cafb-3532-4ac6-ba65-1a08d278e5e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:12.155118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3084cafb-3532-4ac6-ba65-1a08d278e5e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:12.156082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3084cafb-3532-4ac6-ba65-1a08d278e5e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:12.156761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3084cafb-3532-4ac6-ba65-1a08d278e5e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:12.157436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3084cafb-3532-4ac6-ba65-1a08d278e5e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:12.579634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-59496cc7-e5fd-44e8-bd57-51fcdc32a789 req-0681ed55-2100-4852-ac98-e187382a37ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6062f90a-3608-41a8-a9c7-ff273ce18f75", "tag": "5ff50012-37d8-4b87-8132-a04b2650a904"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:31:12.614057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-59496cc7-e5fd-44e8-bd57-51fcdc32a789 req-0681ed55-2100-4852-ac98-e187382a37ba service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:12.616535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-59496cc7-e5fd-44e8-bd57-51fcdc32a789 req-0681ed55-2100-4852-ac98-e187382a37ba service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:12.617803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-59496cc7-e5fd-44e8-bd57-51fcdc32a789 req-0681ed55-2100-4852-ac98-e187382a37ba service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:12.636462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3084cafb-3532-4ac6-ba65-1a08d278e5e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:12.666168 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-59496cc7-e5fd-44e8-bd57-51fcdc32a789 req-0681ed55-2100-4852-ac98-e187382a37ba service nova] Creating event network-changed:5ff50012-37d8-4b87-8132-a04b2650a904 for instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 on n-h1-852084-10 Sep 08 13:31:12.667323 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3084cafb-3532-4ac6-ba65-1a08d278e5e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1202 microversion: 2.1 time: 0.522773 Sep 08 13:31:12.670437 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2848/5567] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:12 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1202 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:12.687327 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-59496cc7-e5fd-44e8-bd57-51fcdc32a789 req-0681ed55-2100-4852-ac98-e187382a37ba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128281 Sep 08 13:31:12.689596 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2720/5568] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:31:13.721089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eb81d4c3-7577-47b8-9647-66099a303a2b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:13.721938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eb81d4c3-7577-47b8-9647-66099a303a2b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:13.750749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb81d4c3-7577-47b8-9647-66099a303a2b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:13.754340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb81d4c3-7577-47b8-9647-66099a303a2b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:13.755379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb81d4c3-7577-47b8-9647-66099a303a2b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:13.759024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb81d4c3-7577-47b8-9647-66099a303a2b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:13.761773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb81d4c3-7577-47b8-9647-66099a303a2b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:13.765817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb81d4c3-7577-47b8-9647-66099a303a2b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:14.135408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eb81d4c3-7577-47b8-9647-66099a303a2b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:14.167572 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eb81d4c3-7577-47b8-9647-66099a303a2b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1202 microversion: 2.1 time: 0.451592 Sep 08 13:31:14.169977 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2849/5569] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:13 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1202 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:15.207279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-590b9a87-f7f8-4a9e-8bd3-c91f3bf357dc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:15.208314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-590b9a87-f7f8-4a9e-8bd3-c91f3bf357dc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:15.231673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-590b9a87-f7f8-4a9e-8bd3-c91f3bf357dc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:15.232590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-590b9a87-f7f8-4a9e-8bd3-c91f3bf357dc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:15.235510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-590b9a87-f7f8-4a9e-8bd3-c91f3bf357dc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:15.237019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-590b9a87-f7f8-4a9e-8bd3-c91f3bf357dc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:15.241679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-590b9a87-f7f8-4a9e-8bd3-c91f3bf357dc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:15.242703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-590b9a87-f7f8-4a9e-8bd3-c91f3bf357dc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:15.504922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-590b9a87-f7f8-4a9e-8bd3-c91f3bf357dc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:15.523001 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-590b9a87-f7f8-4a9e-8bd3-c91f3bf357dc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1202 microversion: 2.1 time: 0.320869 Sep 08 13:31:15.524888 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2721/5570] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:15 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1202 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:31:15.954910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-4ff2b3a6-97fe-4eac-b029-c2865cae8f61 req-9f91775c-2d10-4a62-9b6a-2b7cb50262ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53fdcf45-802d-4786-8ac0-1954b9ee0009", "name": "network-vif-plugged", "status": "completed", "tag": "2c45ec93-eac7-4883-9d69-42149fa59efd"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:31:16.016049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4ff2b3a6-97fe-4eac-b029-c2865cae8f61 req-9f91775c-2d10-4a62-9b6a-2b7cb50262ba service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:16.017696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4ff2b3a6-97fe-4eac-b029-c2865cae8f61 req-9f91775c-2d10-4a62-9b6a-2b7cb50262ba service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:16.018371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4ff2b3a6-97fe-4eac-b029-c2865cae8f61 req-9f91775c-2d10-4a62-9b6a-2b7cb50262ba service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:16.040561 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-4ff2b3a6-97fe-4eac-b029-c2865cae8f61 req-9f91775c-2d10-4a62-9b6a-2b7cb50262ba service nova] Creating event network-vif-plugged:2c45ec93-eac7-4883-9d69-42149fa59efd for instance 53fdcf45-802d-4786-8ac0-1954b9ee0009 on n-h2-852084-10 Sep 08 13:31:16.051079 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-4ff2b3a6-97fe-4eac-b029-c2865cae8f61 req-9f91775c-2d10-4a62-9b6a-2b7cb50262ba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103401 Sep 08 13:31:16.052318 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2850/5571] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:31:16.567133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d217e3b0-3994-4279-86c1-b0026766db35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:16.568066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d217e3b0-3994-4279-86c1-b0026766db35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:16.581981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d217e3b0-3994-4279-86c1-b0026766db35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:16.582854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d217e3b0-3994-4279-86c1-b0026766db35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:16.583709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d217e3b0-3994-4279-86c1-b0026766db35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:16.584987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d217e3b0-3994-4279-86c1-b0026766db35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:16.585840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d217e3b0-3994-4279-86c1-b0026766db35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:16.586686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d217e3b0-3994-4279-86c1-b0026766db35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:16.813068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d217e3b0-3994-4279-86c1-b0026766db35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:16.823935 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d217e3b0-3994-4279-86c1-b0026766db35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1202 microversion: 2.1 time: 0.264391 Sep 08 13:31:16.826782 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2722/5572] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:16 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1202 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:17.866142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7137b7ca-f49d-4664-a9a6-6bf86e1627c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:17.868170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7137b7ca-f49d-4664-a9a6-6bf86e1627c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:17.882777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7137b7ca-f49d-4664-a9a6-6bf86e1627c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:17.883996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7137b7ca-f49d-4664-a9a6-6bf86e1627c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:17.885382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7137b7ca-f49d-4664-a9a6-6bf86e1627c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:17.886980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7137b7ca-f49d-4664-a9a6-6bf86e1627c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:17.888132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7137b7ca-f49d-4664-a9a6-6bf86e1627c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:17.889110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7137b7ca-f49d-4664-a9a6-6bf86e1627c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:18.127928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7137b7ca-f49d-4664-a9a6-6bf86e1627c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:18.145083 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7137b7ca-f49d-4664-a9a6-6bf86e1627c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1390 microversion: 2.1 time: 0.286085 Sep 08 13:31:18.146940 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2851/5573] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:17 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1390 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:18.189461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2a5f8c96-33ff-47fb-b1c0-c4ef3a21b156 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:18.190449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2a5f8c96-33ff-47fb-b1c0-c4ef3a21b156 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:18.204370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a5f8c96-33ff-47fb-b1c0-c4ef3a21b156 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:18.205558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a5f8c96-33ff-47fb-b1c0-c4ef3a21b156 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:18.206277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a5f8c96-33ff-47fb-b1c0-c4ef3a21b156 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:18.207516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a5f8c96-33ff-47fb-b1c0-c4ef3a21b156 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:18.208314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a5f8c96-33ff-47fb-b1c0-c4ef3a21b156 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:18.209039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2a5f8c96-33ff-47fb-b1c0-c4ef3a21b156 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:18.435321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2a5f8c96-33ff-47fb-b1c0-c4ef3a21b156 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:18.448815 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2a5f8c96-33ff-47fb-b1c0-c4ef3a21b156 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1390 microversion: 2.1 time: 0.267190 Sep 08 13:31:18.463566 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2723/5574] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:18 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1390 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:18.491824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-74b244ac-0402-4ecc-aaae-e6d6a5409de5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:18.493576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-74b244ac-0402-4ecc-aaae-e6d6a5409de5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:18.503938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74b244ac-0402-4ecc-aaae-e6d6a5409de5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:18.504530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74b244ac-0402-4ecc-aaae-e6d6a5409de5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:18.504996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74b244ac-0402-4ecc-aaae-e6d6a5409de5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:18.506227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74b244ac-0402-4ecc-aaae-e6d6a5409de5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:18.507001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74b244ac-0402-4ecc-aaae-e6d6a5409de5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:18.507798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74b244ac-0402-4ecc-aaae-e6d6a5409de5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:18.750945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-74b244ac-0402-4ecc-aaae-e6d6a5409de5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:18.768935 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-74b244ac-0402-4ecc-aaae-e6d6a5409de5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1390 microversion: 2.1 time: 0.286037 Sep 08 13:31:18.770068 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2852/5575] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:18 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1390 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:18.810431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f5736c6-d954-424f-bd89-24a9085ceb74 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:18.813899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f5736c6-d954-424f-bd89-24a9085ceb74 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:18.828079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f5736c6-d954-424f-bd89-24a9085ceb74 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:18.829023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f5736c6-d954-424f-bd89-24a9085ceb74 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:18.829827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f5736c6-d954-424f-bd89-24a9085ceb74 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:18.831425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f5736c6-d954-424f-bd89-24a9085ceb74 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:18.833503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f5736c6-d954-424f-bd89-24a9085ceb74 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:18.834643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f5736c6-d954-424f-bd89-24a9085ceb74 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:18.890284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f5736c6-d954-424f-bd89-24a9085ceb74 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:31:19.064146 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f5736c6-d954-424f-bd89-24a9085ceb74 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 204 len: 0 microversion: 2.1 time: 0.261132 Sep 08 13:31:19.065132 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2724/5576] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:31:18 2022] DELETE /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:31:19.077956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f8d489c5-ebfe-4d30-8d38-b4bcfe0b38de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:19.079343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f8d489c5-ebfe-4d30-8d38-b4bcfe0b38de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:19.087954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8d489c5-ebfe-4d30-8d38-b4bcfe0b38de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:19.088500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8d489c5-ebfe-4d30-8d38-b4bcfe0b38de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:19.088943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8d489c5-ebfe-4d30-8d38-b4bcfe0b38de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:19.089682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8d489c5-ebfe-4d30-8d38-b4bcfe0b38de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:19.090147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8d489c5-ebfe-4d30-8d38-b4bcfe0b38de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:19.090575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f8d489c5-ebfe-4d30-8d38-b4bcfe0b38de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:19.277681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f8d489c5-ebfe-4d30-8d38-b4bcfe0b38de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:19.289692 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f8d489c5-ebfe-4d30-8d38-b4bcfe0b38de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1396 microversion: 2.1 time: 0.218168 Sep 08 13:31:19.290834 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2853/5577] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:19 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1396 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:20.332639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b35ddef0-4099-4c27-978b-a67c5bcc4ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:20.333929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b35ddef0-4099-4c27-978b-a67c5bcc4ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:20.348286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b35ddef0-4099-4c27-978b-a67c5bcc4ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:20.349211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b35ddef0-4099-4c27-978b-a67c5bcc4ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:20.350033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b35ddef0-4099-4c27-978b-a67c5bcc4ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:20.351404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b35ddef0-4099-4c27-978b-a67c5bcc4ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:20.352313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b35ddef0-4099-4c27-978b-a67c5bcc4ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:20.353104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b35ddef0-4099-4c27-978b-a67c5bcc4ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:20.642303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b35ddef0-4099-4c27-978b-a67c5bcc4ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:20.660024 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b35ddef0-4099-4c27-978b-a67c5bcc4ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1396 microversion: 2.1 time: 0.335186 Sep 08 13:31:20.661686 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2725/5578] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:20 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1396 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:21.443872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-57006443-39fb-43af-9827-4f4726d8c19d req-ba1ff644-8aa7-4c76-9bfd-588881da3267 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53fdcf45-802d-4786-8ac0-1954b9ee0009", "name": "network-vif-deleted", "tag": "2c45ec93-eac7-4883-9d69-42149fa59efd"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:31:21.470528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-57006443-39fb-43af-9827-4f4726d8c19d req-ba1ff644-8aa7-4c76-9bfd-588881da3267 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:21.471532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-57006443-39fb-43af-9827-4f4726d8c19d req-ba1ff644-8aa7-4c76-9bfd-588881da3267 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:21.472417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-57006443-39fb-43af-9827-4f4726d8c19d req-ba1ff644-8aa7-4c76-9bfd-588881da3267 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:21.505220 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-57006443-39fb-43af-9827-4f4726d8c19d req-ba1ff644-8aa7-4c76-9bfd-588881da3267 service nova] Creating event network-vif-deleted:2c45ec93-eac7-4883-9d69-42149fa59efd for instance 53fdcf45-802d-4786-8ac0-1954b9ee0009 on n-h2-852084-10 Sep 08 13:31:21.516882 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-57006443-39fb-43af-9827-4f4726d8c19d req-ba1ff644-8aa7-4c76-9bfd-588881da3267 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088758 Sep 08 13:31:21.517557 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2854/5579] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:31:21.703431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a98f3fbb-2b0d-483a-81bc-272478394dd7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:21.704121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a98f3fbb-2b0d-483a-81bc-272478394dd7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:21.717256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a98f3fbb-2b0d-483a-81bc-272478394dd7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:21.717996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a98f3fbb-2b0d-483a-81bc-272478394dd7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:21.718657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a98f3fbb-2b0d-483a-81bc-272478394dd7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:21.719820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a98f3fbb-2b0d-483a-81bc-272478394dd7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:21.721375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a98f3fbb-2b0d-483a-81bc-272478394dd7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:21.721375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a98f3fbb-2b0d-483a-81bc-272478394dd7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:21.768462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:21.863939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a98f3fbb-2b0d-483a-81bc-272478394dd7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:21.884645 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a98f3fbb-2b0d-483a-81bc-272478394dd7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1187 microversion: 2.1 time: 0.185356 Sep 08 13:31:21.888583 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2726/5580] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:21 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1187 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:22.921398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4a65968-95b2-492c-b6c6-8bfebafb7d35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:22.922404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a4a65968-95b2-492c-b6c6-8bfebafb7d35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:22.948482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4a65968-95b2-492c-b6c6-8bfebafb7d35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:22.950688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4a65968-95b2-492c-b6c6-8bfebafb7d35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:22.952317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4a65968-95b2-492c-b6c6-8bfebafb7d35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:22.954385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4a65968-95b2-492c-b6c6-8bfebafb7d35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:22.955407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4a65968-95b2-492c-b6c6-8bfebafb7d35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:22.956333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4a65968-95b2-492c-b6c6-8bfebafb7d35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:23.116082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4a65968-95b2-492c-b6c6-8bfebafb7d35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:23.130700 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a4a65968-95b2-492c-b6c6-8bfebafb7d35 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1187 microversion: 2.1 time: 0.220233 Sep 08 13:31:23.134378 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2855/5581] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:22 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1187 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:24.157634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-da5f8b56-32f1-4003-a288-85521d98f42c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:24.158931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-da5f8b56-32f1-4003-a288-85521d98f42c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:24.169102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da5f8b56-32f1-4003-a288-85521d98f42c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:24.169608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da5f8b56-32f1-4003-a288-85521d98f42c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:24.170069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da5f8b56-32f1-4003-a288-85521d98f42c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:24.170833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da5f8b56-32f1-4003-a288-85521d98f42c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:24.171346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da5f8b56-32f1-4003-a288-85521d98f42c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:24.171796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da5f8b56-32f1-4003-a288-85521d98f42c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:24.293980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-da5f8b56-32f1-4003-a288-85521d98f42c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:24.310852 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-da5f8b56-32f1-4003-a288-85521d98f42c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1187 microversion: 2.1 time: 0.156971 Sep 08 13:31:24.324479 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2727/5582] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:24 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1187 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:25.354327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-392d3cbd-0e1e-4d0b-a44b-6e0c0a802f58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:25.356444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-392d3cbd-0e1e-4d0b-a44b-6e0c0a802f58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:25.364975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-392d3cbd-0e1e-4d0b-a44b-6e0c0a802f58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:25.366119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-392d3cbd-0e1e-4d0b-a44b-6e0c0a802f58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:25.366883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-392d3cbd-0e1e-4d0b-a44b-6e0c0a802f58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:25.368344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-392d3cbd-0e1e-4d0b-a44b-6e0c0a802f58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:25.369670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-392d3cbd-0e1e-4d0b-a44b-6e0c0a802f58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:25.370343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-392d3cbd-0e1e-4d0b-a44b-6e0c0a802f58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:25.490892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-392d3cbd-0e1e-4d0b-a44b-6e0c0a802f58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:25.504336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:25.508939 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-392d3cbd-0e1e-4d0b-a44b-6e0c0a802f58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1187 microversion: 2.1 time: 0.166355 Sep 08 13:31:25.509897 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2856/5583] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:25 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1187 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:26.558465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-759ce27f-25f6-4b0e-926a-c2ae4a11f948 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:26.560000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-759ce27f-25f6-4b0e-926a-c2ae4a11f948 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:26.574888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-759ce27f-25f6-4b0e-926a-c2ae4a11f948 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:26.575503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-759ce27f-25f6-4b0e-926a-c2ae4a11f948 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:26.576315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-759ce27f-25f6-4b0e-926a-c2ae4a11f948 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:26.577649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-759ce27f-25f6-4b0e-926a-c2ae4a11f948 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:26.578517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-759ce27f-25f6-4b0e-926a-c2ae4a11f948 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:26.579809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-759ce27f-25f6-4b0e-926a-c2ae4a11f948 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:26.722339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-759ce27f-25f6-4b0e-926a-c2ae4a11f948 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:26.741319 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-759ce27f-25f6-4b0e-926a-c2ae4a11f948 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1187 microversion: 2.1 time: 0.190339 Sep 08 13:31:26.744652 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2728/5584] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:26 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1187 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:27.794193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-22c70146-46be-4d47-9acb-346ee537b474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:27.800525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-22c70146-46be-4d47-9acb-346ee537b474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:27.832717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22c70146-46be-4d47-9acb-346ee537b474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:27.834185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22c70146-46be-4d47-9acb-346ee537b474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:27.835251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22c70146-46be-4d47-9acb-346ee537b474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:27.836840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22c70146-46be-4d47-9acb-346ee537b474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:27.837698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22c70146-46be-4d47-9acb-346ee537b474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:27.839467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22c70146-46be-4d47-9acb-346ee537b474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:28.005323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-22c70146-46be-4d47-9acb-346ee537b474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:28.025370 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-22c70146-46be-4d47-9acb-346ee537b474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 200 len: 1187 microversion: 2.1 time: 0.241922 Sep 08 13:31:28.027415 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2857/5585] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:27 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 1187 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:29.074010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-052b6728-2772-4583-b6a4-3bf75fdbf3e9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:29.075968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-052b6728-2772-4583-b6a4-3bf75fdbf3e9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 53fdcf45-802d-4786-8ac0-1954b9ee0009] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:29.090739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-052b6728-2772-4583-b6a4-3bf75fdbf3e9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:29.093155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-052b6728-2772-4583-b6a4-3bf75fdbf3e9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:29.093753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-052b6728-2772-4583-b6a4-3bf75fdbf3e9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:29.094550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-052b6728-2772-4583-b6a4-3bf75fdbf3e9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:29.095505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-052b6728-2772-4583-b6a4-3bf75fdbf3e9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:29.095854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-052b6728-2772-4583-b6a4-3bf75fdbf3e9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:29.138254 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-052b6728-2772-4583-b6a4-3bf75fdbf3e9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance 53fdcf45-802d-4786-8ac0-1954b9ee0009 could not be found. Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-052b6728-2772-4583-b6a4-3bf75fdbf3e9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 HTTP/1.1 Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 53fdcf45-802d-4786-8ac0-1954b9ee0009 could not be found. Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '53fdcf45-802d-4786-8ac0-1954b9ee0009'} Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53fdcf45-802d-4786-8ac0-1954b9ee0009 could not be found. Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53fdcf45-802d-4786-8ac0-1954b9ee0009 could not be found. Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:31:29.141536 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:29.146428 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:31:29.146428 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:31:29.146428 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:31:29.146428 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:31:29.146428 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:31:29.146428 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53fdcf45-802d-4786-8ac0-1954b9ee0009 could not be found. Sep 08 13:31:29.146428 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:29.146428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-052b6728-2772-4583-b6a4-3bf75fdbf3e9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance 53fdcf45-802d-4786-8ac0-1954b9ee0009 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:31:29.146428 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-052b6728-2772-4583-b6a4-3bf75fdbf3e9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009" status: 404 len: 111 microversion: 2.1 time: 0.074297 Sep 08 13:31:29.146428 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2729/5586] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:29 2022] GET /compute/v2.1/servers/53fdcf45-802d-4786-8ac0-1954b9ee0009 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:31:34.868658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2fbdec61-eb2a-4679-a0ff-e11f1bb90fc7 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:34.870134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2fbdec61-eb2a-4679-a0ff-e11f1bb90fc7 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:34.886699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=36 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:34.892318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2fbdec61-eb2a-4679-a0ff-e11f1bb90fc7 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:34.893354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2fbdec61-eb2a-4679-a0ff-e11f1bb90fc7 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:34.895367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2fbdec61-eb2a-4679-a0ff-e11f1bb90fc7 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:34.896691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2fbdec61-eb2a-4679-a0ff-e11f1bb90fc7 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:34.897593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2fbdec61-eb2a-4679-a0ff-e11f1bb90fc7 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:34.898580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2fbdec61-eb2a-4679-a0ff-e11f1bb90fc7 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:35.008264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2fbdec61-eb2a-4679-a0ff-e11f1bb90fc7 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:31:35.357206 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2fbdec61-eb2a-4679-a0ff-e11f1bb90fc7 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "DELETE /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 204 len: 0 microversion: 2.1 time: 1.000574 Sep 08 13:31:35.358067 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2858/5587] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:31:34 2022] DELETE /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 0 bytes in 1003 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:31:35.375746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cb4960af-c9b2-4e6a-906c-44849ea6d424 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:35.378838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cb4960af-c9b2-4e6a-906c-44849ea6d424 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:35.397397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:35.402840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb4960af-c9b2-4e6a-906c-44849ea6d424 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:35.404895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb4960af-c9b2-4e6a-906c-44849ea6d424 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:35.406548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb4960af-c9b2-4e6a-906c-44849ea6d424 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:35.408698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb4960af-c9b2-4e6a-906c-44849ea6d424 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:35.410562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb4960af-c9b2-4e6a-906c-44849ea6d424 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:35.414279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cb4960af-c9b2-4e6a-906c-44849ea6d424 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:35.710299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cb4960af-c9b2-4e6a-906c-44849ea6d424 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:35.736205 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cb4960af-c9b2-4e6a-906c-44849ea6d424 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1732 microversion: 2.1 time: 0.370886 Sep 08 13:31:35.737250 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2730/5588] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:35 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1732 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:36.783827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d8f48384-7305-4745-a961-14e19b0955ae tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:36.785134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d8f48384-7305-4745-a961-14e19b0955ae tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:36.809061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8f48384-7305-4745-a961-14e19b0955ae tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:36.811491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8f48384-7305-4745-a961-14e19b0955ae tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:36.813080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8f48384-7305-4745-a961-14e19b0955ae tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:36.817152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8f48384-7305-4745-a961-14e19b0955ae tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:36.818397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8f48384-7305-4745-a961-14e19b0955ae tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:36.819381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8f48384-7305-4745-a961-14e19b0955ae tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:37.258980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d8f48384-7305-4745-a961-14e19b0955ae tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:37.271733 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d8f48384-7305-4745-a961-14e19b0955ae tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1732 microversion: 2.1 time: 0.504009 Sep 08 13:31:37.287674 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2859/5589] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:36 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1732 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:37.836986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-896664161", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "88595987-7088-4721-9460-02d63b1ed8f8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd09c139-4c62-4afa-ac6f-48ed313685b7"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:31:37.956459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] validate_networks() for [('dd09c139-4c62-4afa-ac6f-48ed313685b7', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:31:38.314035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-80b9bf61-9b83-4e69-8693-63a71d44aedd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:38.316112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-80b9bf61-9b83-4e69-8693-63a71d44aedd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:38.336195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80b9bf61-9b83-4e69-8693-63a71d44aedd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:38.337288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80b9bf61-9b83-4e69-8693-63a71d44aedd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:38.338705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80b9bf61-9b83-4e69-8693-63a71d44aedd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:38.342291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80b9bf61-9b83-4e69-8693-63a71d44aedd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:38.343368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80b9bf61-9b83-4e69-8693-63a71d44aedd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:38.344268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80b9bf61-9b83-4e69-8693-63a71d44aedd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:38.496873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-80b9bf61-9b83-4e69-8693-63a71d44aedd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd883ee11e1f4a4a81a1a7ff9b0c8273', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6be7a7724948c7af647f1b55e3e950', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:38.518930 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-80b9bf61-9b83-4e69-8693-63a71d44aedd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 200 len: 1665 microversion: 2.1 time: 0.223912 Sep 08 13:31:38.532330 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2860/5590] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:38 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 1665 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:38.543555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-70c925be-88bf-4236-976e-0b849cfcade6 req-d74e34fe-2ad8-45db-8479-93ee752a68e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47276fe9-eea9-4d51-80f3-b7fe29784971", "name": "network-vif-deleted", "tag": "41cb2b60-aabd-4228-bf08-e10984f06014"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:31:38.573889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-70c925be-88bf-4236-976e-0b849cfcade6 req-d74e34fe-2ad8-45db-8479-93ee752a68e5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:38.574929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-70c925be-88bf-4236-976e-0b849cfcade6 req-d74e34fe-2ad8-45db-8479-93ee752a68e5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:38.579362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-70c925be-88bf-4236-976e-0b849cfcade6 req-d74e34fe-2ad8-45db-8479-93ee752a68e5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:38.612645 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-70c925be-88bf-4236-976e-0b849cfcade6 req-d74e34fe-2ad8-45db-8479-93ee752a68e5 service nova] Creating event network-vif-deleted:41cb2b60-aabd-4228-bf08-e10984f06014 for instance 47276fe9-eea9-4d51-80f3-b7fe29784971 on n-h2-852084-10 Sep 08 13:31:38.621032 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-70c925be-88bf-4236-976e-0b849cfcade6 req-d74e34fe-2ad8-45db-8479-93ee752a68e5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087226 Sep 08 13:31:38.624043 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2861/5591] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:31:38.914298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:31:38.914968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:31:38.916346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:31:38.916774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:31:38.917582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:31:38.940125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:38.940793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:38.941519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:38.942909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:38.944144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:38.945032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:38.992172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:31:38.999721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for user 6f65d872026946a7a6badc404b161499 and project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:31:39.227392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:31:39.232137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='88595987-7088-4721-9460-02d63b1ed8f8',volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:31:39.497577 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1a645df6-e2a6-47ab-b125-8475a45dbe09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.664522 Sep 08 13:31:39.505758 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2731/5592] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:31:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:31:39.516347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-885ab56d-646b-4448-8a7f-b27d582e21f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:39.517554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-885ab56d-646b-4448-8a7f-b27d582e21f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:39.546160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fdf998f1-f2a7-43a9-be43-d73e4da48f3b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:39.547623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fdf998f1-f2a7-43a9-be43-d73e4da48f3b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:39.560870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdf998f1-f2a7-43a9-be43-d73e4da48f3b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:39.561642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdf998f1-f2a7-43a9-be43-d73e4da48f3b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:39.562136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdf998f1-f2a7-43a9-be43-d73e4da48f3b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:39.562980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdf998f1-f2a7-43a9-be43-d73e4da48f3b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:39.567722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdf998f1-f2a7-43a9-be43-d73e4da48f3b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:39.574195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fdf998f1-f2a7-43a9-be43-d73e4da48f3b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:39.653549 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-fdf998f1-f2a7-43a9-be43-d73e4da48f3b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] HTTP exception thrown: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fdf998f1-f2a7-43a9-be43-d73e4da48f3b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Request method failure captured: Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 HTTP/1.1 Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe1NLKZVb4GafcwfyV-KyHk0g5dkd-svOmyC94dazf1RtBcJ8LoyGdXFvZaCRBx1Xt6dfCilOAT_5dl0MoiPlQLji8RNpgiZXc9PizLiO5K0D7Nm_FEbJSgj-ayRlQkREChpUcMs34xgNPmEGbwj3Fv6QONicyuq9_WzNNjocKiTHL8 Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4f6be7a7724948c7af647f1b55e3e950 Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestServerBasicOps-665725027 Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4f6be7a7724948c7af647f1b55e3e950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4f6be7a7724948c7af647f1b55e3e950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4f6be7a7724948c7af647f1b55e3e950"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4f6be7a7724948c7af647f1b55e3e950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestServerBasicOps-665725027 Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4f6be7a7724948c7af647f1b55e3e950 Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestServerBasicOps-665725027 Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestServerBasicOps-665725027-project Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: cd883ee11e1f4a4a81a1a7ff9b0c8273 Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestServerBasicOps-665725027-project Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '47276fe9-eea9-4d51-80f3-b7fe29784971'} Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:31:39.658357 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:39.664088 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:31:39.664088 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:31:39.664088 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:31:39.664088 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:31:39.664088 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:31:39.664088 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:39.664088 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:39.666824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fdf998f1-f2a7-43a9-be43-d73e4da48f3b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Returning 404 to user: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:31:39.668806 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fdf998f1-f2a7-43a9-be43-d73e4da48f3b tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 404 len: 111 microversion: 2.1 time: 0.127098 Sep 08 13:31:39.670152 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2732/5593] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:39 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:31:39.729879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-885ab56d-646b-4448-8a7f-b27d582e21f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:39.744574 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-885ab56d-646b-4448-8a7f-b27d582e21f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1056 microversion: 2.1 time: 0.236032 Sep 08 13:31:39.747014 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2862/5594] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:39 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1056 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:31:40.641370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ba5d663a-b80c-42c4-9d50-c796434eeaf0 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:40.642775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ba5d663a-b80c-42c4-9d50-c796434eeaf0 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:40.660153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba5d663a-b80c-42c4-9d50-c796434eeaf0 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:40.660753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba5d663a-b80c-42c4-9d50-c796434eeaf0 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:40.661244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba5d663a-b80c-42c4-9d50-c796434eeaf0 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:40.662099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba5d663a-b80c-42c4-9d50-c796434eeaf0 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:40.662583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba5d663a-b80c-42c4-9d50-c796434eeaf0 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:40.663704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ba5d663a-b80c-42c4-9d50-c796434eeaf0 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:40.703170 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-ba5d663a-b80c-42c4-9d50-c796434eeaf0 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] HTTP exception thrown: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ba5d663a-b80c-42c4-9d50-c796434eeaf0 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Request method failure captured: Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 HTTP/1.1 Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe1NLKZVb4GafcwfyV-KyHk0g5dkd-svOmyC94dazf1RtBcJ8LoyGdXFvZaCRBx1Xt6dfCilOAT_5dl0MoiPlQLji8RNpgiZXc9PizLiO5K0D7Nm_FEbJSgj-ayRlQkREChpUcMs34xgNPmEGbwj3Fv6QONicyuq9_WzNNjocKiTHL8 Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 4f6be7a7724948c7af647f1b55e3e950 Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestServerBasicOps-665725027 Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4f6be7a7724948c7af647f1b55e3e950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4f6be7a7724948c7af647f1b55e3e950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4f6be7a7724948c7af647f1b55e3e950"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4f6be7a7724948c7af647f1b55e3e950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestServerBasicOps-665725027 Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 4f6be7a7724948c7af647f1b55e3e950 Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestServerBasicOps-665725027 Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestServerBasicOps-665725027-project Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: cd883ee11e1f4a4a81a1a7ff9b0c8273 Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestServerBasicOps-665725027-project Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '47276fe9-eea9-4d51-80f3-b7fe29784971'} Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:31:40.705736 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ba5d663a-b80c-42c4-9d50-c796434eeaf0 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Returning 404 to user: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ba5d663a-b80c-42c4-9d50-c796434eeaf0 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "DELETE /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 404 len: 111 microversion: 2.1 time: 0.072245 Sep 08 13:31:40.714111 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2733/5595] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:31:40 2022] DELETE /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:31:40.719578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-de61c259-9956-4cca-9805-3b20f93d72a9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:40.720549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-de61c259-9956-4cca-9805-3b20f93d72a9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] [instance: 47276fe9-eea9-4d51-80f3-b7fe29784971] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:40.755114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de61c259-9956-4cca-9805-3b20f93d72a9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:40.755800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de61c259-9956-4cca-9805-3b20f93d72a9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:40.761151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de61c259-9956-4cca-9805-3b20f93d72a9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:40.763416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de61c259-9956-4cca-9805-3b20f93d72a9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:40.763934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de61c259-9956-4cca-9805-3b20f93d72a9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:40.764386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de61c259-9956-4cca-9805-3b20f93d72a9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:40.774094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-67e2f8bf-e2d5-4a98-a27c-adebba9cd425 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:40.775771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-67e2f8bf-e2d5-4a98-a27c-adebba9cd425 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:40.812585 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-de61c259-9956-4cca-9805-3b20f93d72a9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] HTTP exception thrown: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-de61c259-9956-4cca-9805-3b20f93d72a9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Request method failure captured: Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 HTTP/1.1 Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe1NLKZVb4GafcwfyV-KyHk0g5dkd-svOmyC94dazf1RtBcJ8LoyGdXFvZaCRBx1Xt6dfCilOAT_5dl0MoiPlQLji8RNpgiZXc9PizLiO5K0D7Nm_FEbJSgj-ayRlQkREChpUcMs34xgNPmEGbwj3Fv6QONicyuq9_WzNNjocKiTHL8 Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 4f6be7a7724948c7af647f1b55e3e950 Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestServerBasicOps-665725027 Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4f6be7a7724948c7af647f1b55e3e950"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4f6be7a7724948c7af647f1b55e3e950"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4f6be7a7724948c7af647f1b55e3e950"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4f6be7a7724948c7af647f1b55e3e950"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestServerBasicOps-665725027 Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 4f6be7a7724948c7af647f1b55e3e950 Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestServerBasicOps-665725027 Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestServerBasicOps-665725027-project Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: cd883ee11e1f4a4a81a1a7ff9b0c8273 Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestServerBasicOps-665725027-project Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '47276fe9-eea9-4d51-80f3-b7fe29784971'} Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:31:40.817970 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:31:40.824405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:31:40.824405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:31:40.824405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:31:40.824405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:31:40.824405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:31:40.824405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. Sep 08 13:31:40.824405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:31:40.824405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-de61c259-9956-4cca-9805-3b20f93d72a9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Returning 404 to user: Instance 47276fe9-eea9-4d51-80f3-b7fe29784971 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:31:40.824405 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-de61c259-9956-4cca-9805-3b20f93d72a9 tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971" status: 404 len: 111 microversion: 2.1 time: 0.105670 Sep 08 13:31:40.825994 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2863/5596] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:40 2022] GET /compute/v2.1/servers/47276fe9-eea9-4d51-80f3-b7fe29784971 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:31:40.892202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-67e2f8bf-e2d5-4a98-a27c-adebba9cd425 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:40.907319 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-67e2f8bf-e2d5-4a98-a27c-adebba9cd425 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1056 microversion: 2.1 time: 0.138796 Sep 08 13:31:40.915092 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2734/5597] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:40 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1056 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:41.293529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-741d7cf8-a1da-4852-8d1f-659ad44c58bd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] Calling method '.version_select at 0x7fdb35910f70>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:41.365428 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-741d7cf8-a1da-4852-8d1f-659ad44c58bd tempest-TestServerBasicOps-665725027 tempest-TestServerBasicOps-665725027-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1423824854" status: 202 len: 0 microversion: 2.1 time: 0.079902 Sep 08 13:31:41.373489 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2864/5598] 10.222.0.78 () {58 vars in 1254 bytes} [Thu Sep 8 13:31:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1423824854 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:31:41.941587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-96dd3b6b-76de-4328-ab3e-81ea2c7fc2c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:41.942672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-96dd3b6b-76de-4328-ab3e-81ea2c7fc2c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:41.944421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ab8add5-6040-4b51-bfd8-08a2a69ea317 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:41.946806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8ab8add5-6040-4b51-bfd8-08a2a69ea317 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:41.957225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96dd3b6b-76de-4328-ab3e-81ea2c7fc2c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:41.960311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96dd3b6b-76de-4328-ab3e-81ea2c7fc2c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:41.960750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96dd3b6b-76de-4328-ab3e-81ea2c7fc2c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:41.978317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96dd3b6b-76de-4328-ab3e-81ea2c7fc2c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:41.979365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96dd3b6b-76de-4328-ab3e-81ea2c7fc2c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:41.980776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96dd3b6b-76de-4328-ab3e-81ea2c7fc2c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:41.981520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ab8add5-6040-4b51-bfd8-08a2a69ea317 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:41.982593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ab8add5-6040-4b51-bfd8-08a2a69ea317 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:41.983758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ab8add5-6040-4b51-bfd8-08a2a69ea317 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:41.997508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ab8add5-6040-4b51-bfd8-08a2a69ea317 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:41.999480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ab8add5-6040-4b51-bfd8-08a2a69ea317 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:42.001090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ab8add5-6040-4b51-bfd8-08a2a69ea317 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:42.068146 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-96dd3b6b-76de-4328-ab3e-81ea2c7fc2c7 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/ips" status: 200 len: 148 microversion: 2.1 time: 0.349552 Sep 08 13:31:42.071184 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2735/5599] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Sep 8 13:31:41 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/ips => generated 148 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:31:42.177505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8ab8add5-6040-4b51-bfd8-08a2a69ea317 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:42.189431 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8ab8add5-6040-4b51-bfd8-08a2a69ea317 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1154 microversion: 2.1 time: 0.253971 Sep 08 13:31:42.203713 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2865/5600] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:41 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1154 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:43.219374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d111aeb4-4398-4ea9-8d55-9eb5f3bd7d8f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:43.220305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d111aeb4-4398-4ea9-8d55-9eb5f3bd7d8f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:43.246977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d111aeb4-4398-4ea9-8d55-9eb5f3bd7d8f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:43.256400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d111aeb4-4398-4ea9-8d55-9eb5f3bd7d8f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:43.257484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d111aeb4-4398-4ea9-8d55-9eb5f3bd7d8f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:43.258491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d111aeb4-4398-4ea9-8d55-9eb5f3bd7d8f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:43.259214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d111aeb4-4398-4ea9-8d55-9eb5f3bd7d8f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:43.259973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d111aeb4-4398-4ea9-8d55-9eb5f3bd7d8f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:44.363438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d111aeb4-4398-4ea9-8d55-9eb5f3bd7d8f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:44.413951 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d111aeb4-4398-4ea9-8d55-9eb5f3bd7d8f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1172 microversion: 2.1 time: 1.201239 Sep 08 13:31:44.415078 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2736/5601] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:43 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1172 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:31:45.479763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ad52eb4b-f4a8-46d0-81f9-92c4062fc62d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:45.487077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ad52eb4b-f4a8-46d0-81f9-92c4062fc62d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:45.522812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad52eb4b-f4a8-46d0-81f9-92c4062fc62d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:45.526592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad52eb4b-f4a8-46d0-81f9-92c4062fc62d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:45.550042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad52eb4b-f4a8-46d0-81f9-92c4062fc62d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:45.553664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad52eb4b-f4a8-46d0-81f9-92c4062fc62d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:45.558658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad52eb4b-f4a8-46d0-81f9-92c4062fc62d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:45.561535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad52eb4b-f4a8-46d0-81f9-92c4062fc62d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:46.472909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-45e219a2-4f78-489b-b1dd-e54e3952e1e4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59aac84f-1588-4166-abba-510b54406ee1"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:31:46.475790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-45e219a2-4f78-489b-b1dd-e54e3952e1e4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:46.495681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45e219a2-4f78-489b-b1dd-e54e3952e1e4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:46.496326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45e219a2-4f78-489b-b1dd-e54e3952e1e4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:46.500875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45e219a2-4f78-489b-b1dd-e54e3952e1e4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:46.501814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45e219a2-4f78-489b-b1dd-e54e3952e1e4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:46.502300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45e219a2-4f78-489b-b1dd-e54e3952e1e4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:46.502756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45e219a2-4f78-489b-b1dd-e54e3952e1e4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:46.735148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ad52eb4b-f4a8-46d0-81f9-92c4062fc62d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:46.756764 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ad52eb4b-f4a8-46d0-81f9-92c4062fc62d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1214 microversion: 2.1 time: 1.294815 Sep 08 13:31:46.757386 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2866/5602] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:45 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1214 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:47.121071 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-45e219a2-4f78-489b-b1dd-e54e3952e1e4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "POST /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.650731 Sep 08 13:31:47.122515 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2737/5603] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:31:46 2022] POST /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments => generated 194 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:31:47.794845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c009d1c3-2e89-4e70-9cbf-d455b5742f03 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:47.795777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c009d1c3-2e89-4e70-9cbf-d455b5742f03 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:47.821206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c009d1c3-2e89-4e70-9cbf-d455b5742f03 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:47.821754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c009d1c3-2e89-4e70-9cbf-d455b5742f03 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:47.823940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c009d1c3-2e89-4e70-9cbf-d455b5742f03 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:47.833789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c009d1c3-2e89-4e70-9cbf-d455b5742f03 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:47.834809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c009d1c3-2e89-4e70-9cbf-d455b5742f03 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:47.835514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c009d1c3-2e89-4e70-9cbf-d455b5742f03 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:48.486838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c009d1c3-2e89-4e70-9cbf-d455b5742f03 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:48.507782 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c009d1c3-2e89-4e70-9cbf-d455b5742f03 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1214 microversion: 2.1 time: 0.717645 Sep 08 13:31:48.508421 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2867/5604] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:47 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1214 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:48.679402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f0e1b19c-054d-4395-a485-a048f5e006ee req-72696b36-faac-429e-b89f-a48aba6cdd89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee38b1a3-2e53-4eea-8f32-635c00b2961c", "tag": "c0572a8b-8a25-4235-8119-66a661fc1834"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:31:48.768015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f0e1b19c-054d-4395-a485-a048f5e006ee req-72696b36-faac-429e-b89f-a48aba6cdd89 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:48.769092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f0e1b19c-054d-4395-a485-a048f5e006ee req-72696b36-faac-429e-b89f-a48aba6cdd89 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:48.782277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f0e1b19c-054d-4395-a485-a048f5e006ee req-72696b36-faac-429e-b89f-a48aba6cdd89 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:48.881852 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f0e1b19c-054d-4395-a485-a048f5e006ee req-72696b36-faac-429e-b89f-a48aba6cdd89 service nova] Creating event network-changed:c0572a8b-8a25-4235-8119-66a661fc1834 for instance ee38b1a3-2e53-4eea-8f32-635c00b2961c on n-h2-852084-10 Sep 08 13:31:48.914712 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f0e1b19c-054d-4395-a485-a048f5e006ee req-72696b36-faac-429e-b89f-a48aba6cdd89 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240626 Sep 08 13:31:48.918088 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2738/5605] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:31:49.533618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7b3ee42c-3f45-4c8d-9df0-bf6637bf9d96 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:49.534353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7b3ee42c-3f45-4c8d-9df0-bf6637bf9d96 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:49.543379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b3ee42c-3f45-4c8d-9df0-bf6637bf9d96 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:49.544122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b3ee42c-3f45-4c8d-9df0-bf6637bf9d96 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:49.544746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b3ee42c-3f45-4c8d-9df0-bf6637bf9d96 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:49.546090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b3ee42c-3f45-4c8d-9df0-bf6637bf9d96 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:49.546738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b3ee42c-3f45-4c8d-9df0-bf6637bf9d96 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:49.547665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7b3ee42c-3f45-4c8d-9df0-bf6637bf9d96 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:49.736694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:50.205716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7b3ee42c-3f45-4c8d-9df0-bf6637bf9d96 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:50.245132 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7b3ee42c-3f45-4c8d-9df0-bf6637bf9d96 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1214 microversion: 2.1 time: 0.710394 Sep 08 13:31:50.246586 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2868/5606] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:49 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1214 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:31:51.281523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:51.285333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:51.311434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62e4920c-2f75-44d1-8ede-b0b382f59184 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:51.315563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-62e4920c-2f75-44d1-8ede-b0b382f59184 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:51.357170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e4920c-2f75-44d1-8ede-b0b382f59184 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:51.367775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e4920c-2f75-44d1-8ede-b0b382f59184 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:51.369166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e4920c-2f75-44d1-8ede-b0b382f59184 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:51.371360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e4920c-2f75-44d1-8ede-b0b382f59184 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:51.372500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e4920c-2f75-44d1-8ede-b0b382f59184 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:51.373560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e4920c-2f75-44d1-8ede-b0b382f59184 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:52.038429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-62e4920c-2f75-44d1-8ede-b0b382f59184 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:52.056719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:31:52.060522 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62e4920c-2f75-44d1-8ede-b0b382f59184 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1214 microversion: 2.1 time: 0.780500 Sep 08 13:31:52.075566 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2739/5607] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:51 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1214 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:53.100355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5acbc015-8eb1-4109-96e8-08cf087f931a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:53.101526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5acbc015-8eb1-4109-96e8-08cf087f931a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:53.137605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5acbc015-8eb1-4109-96e8-08cf087f931a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:53.138694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5acbc015-8eb1-4109-96e8-08cf087f931a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:53.139995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5acbc015-8eb1-4109-96e8-08cf087f931a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:53.141384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5acbc015-8eb1-4109-96e8-08cf087f931a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:53.142330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5acbc015-8eb1-4109-96e8-08cf087f931a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:53.143039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5acbc015-8eb1-4109-96e8-08cf087f931a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:53.464936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5acbc015-8eb1-4109-96e8-08cf087f931a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:53.504857 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5acbc015-8eb1-4109-96e8-08cf087f931a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1214 microversion: 2.1 time: 0.413748 Sep 08 13:31:53.510731 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2869/5608] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:53 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1214 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:54.689219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4aa71eca-00a6-4e2e-a57f-705445a883d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:54.690275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4aa71eca-00a6-4e2e-a57f-705445a883d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:54.721078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4aa71eca-00a6-4e2e-a57f-705445a883d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:54.721798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4aa71eca-00a6-4e2e-a57f-705445a883d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:54.722527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4aa71eca-00a6-4e2e-a57f-705445a883d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:54.724667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4aa71eca-00a6-4e2e-a57f-705445a883d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:54.725983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4aa71eca-00a6-4e2e-a57f-705445a883d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:54.727582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4aa71eca-00a6-4e2e-a57f-705445a883d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:55.200550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4aa71eca-00a6-4e2e-a57f-705445a883d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:55.215537 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4aa71eca-00a6-4e2e-a57f-705445a883d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1214 microversion: 2.1 time: 0.536247 Sep 08 13:31:55.220949 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2740/5609] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:54 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1214 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:56.264016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1c6659fe-e876-49b9-a818-f1ee7fce57c4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:56.264790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1c6659fe-e876-49b9-a818-f1ee7fce57c4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:56.283158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c6659fe-e876-49b9-a818-f1ee7fce57c4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:56.283862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c6659fe-e876-49b9-a818-f1ee7fce57c4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:56.284422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c6659fe-e876-49b9-a818-f1ee7fce57c4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:56.285461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c6659fe-e876-49b9-a818-f1ee7fce57c4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:56.286955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c6659fe-e876-49b9-a818-f1ee7fce57c4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:56.287660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c6659fe-e876-49b9-a818-f1ee7fce57c4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:56.621883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1c6659fe-e876-49b9-a818-f1ee7fce57c4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:56.631373 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1c6659fe-e876-49b9-a818-f1ee7fce57c4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1214 microversion: 2.1 time: 0.371966 Sep 08 13:31:56.633448 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2870/5610] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:56 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1214 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:57.668879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-084a6a23-07b3-4daf-881b-7797fba710ac tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:57.669828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-084a6a23-07b3-4daf-881b-7797fba710ac tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:57.708157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-084a6a23-07b3-4daf-881b-7797fba710ac tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:57.709026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-084a6a23-07b3-4daf-881b-7797fba710ac tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:57.709705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-084a6a23-07b3-4daf-881b-7797fba710ac tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:57.710687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-084a6a23-07b3-4daf-881b-7797fba710ac tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:57.711412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-084a6a23-07b3-4daf-881b-7797fba710ac tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:57.712056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-084a6a23-07b3-4daf-881b-7797fba710ac tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:58.075317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-084a6a23-07b3-4daf-881b-7797fba710ac tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:31:58.127928 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-084a6a23-07b3-4daf-881b-7797fba710ac tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1214 microversion: 2.1 time: 0.467335 Sep 08 13:31:58.136346 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2741/5611] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:57 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1214 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:31:59.167061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-09eb72de-713d-46bf-9c7e-3dedda82a162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:31:59.167061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-09eb72de-713d-46bf-9c7e-3dedda82a162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:31:59.190921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09eb72de-713d-46bf-9c7e-3dedda82a162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:59.214308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09eb72de-713d-46bf-9c7e-3dedda82a162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:59.215549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09eb72de-713d-46bf-9c7e-3dedda82a162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:59.217110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09eb72de-713d-46bf-9c7e-3dedda82a162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:31:59.218633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09eb72de-713d-46bf-9c7e-3dedda82a162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:31:59.219106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09eb72de-713d-46bf-9c7e-3dedda82a162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:31:59.362338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:32:00.200587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-09eb72de-713d-46bf-9c7e-3dedda82a162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:00.216285 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-09eb72de-713d-46bf-9c7e-3dedda82a162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1214 microversion: 2.1 time: 1.052479 Sep 08 13:32:00.219809 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2871/5612] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:31:59 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1214 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:01.268418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-051938e1-155e-4036-8465-9f9a1b34d1cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:01.270675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-051938e1-155e-4036-8465-9f9a1b34d1cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:01.308859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-051938e1-155e-4036-8465-9f9a1b34d1cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:01.316053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-051938e1-155e-4036-8465-9f9a1b34d1cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:01.316053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-051938e1-155e-4036-8465-9f9a1b34d1cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:01.317403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-051938e1-155e-4036-8465-9f9a1b34d1cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:01.322373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-051938e1-155e-4036-8465-9f9a1b34d1cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:01.323015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-051938e1-155e-4036-8465-9f9a1b34d1cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:01.636913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-051938e1-155e-4036-8465-9f9a1b34d1cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:01.648678 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-051938e1-155e-4036-8465-9f9a1b34d1cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1202 microversion: 2.1 time: 0.385042 Sep 08 13:32:01.651661 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2742/5613] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:01 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1202 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:02.719380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3f2d8f10-602f-444e-8a1e-0348bdc2a67d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:02.726438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3f2d8f10-602f-444e-8a1e-0348bdc2a67d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:02.753347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2d8f10-602f-444e-8a1e-0348bdc2a67d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:02.754599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2d8f10-602f-444e-8a1e-0348bdc2a67d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:02.757222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2d8f10-602f-444e-8a1e-0348bdc2a67d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:02.765901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2d8f10-602f-444e-8a1e-0348bdc2a67d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:02.767280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2d8f10-602f-444e-8a1e-0348bdc2a67d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:02.768303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f2d8f10-602f-444e-8a1e-0348bdc2a67d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:03.116692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3f2d8f10-602f-444e-8a1e-0348bdc2a67d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:03.163828 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3f2d8f10-602f-444e-8a1e-0348bdc2a67d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1202 microversion: 2.1 time: 0.486361 Sep 08 13:32:03.166546 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2872/5614] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:02 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1202 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:04.197629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-87fcb4fd-1884-4aa3-9650-828d2a50b8ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:04.198413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-87fcb4fd-1884-4aa3-9650-828d2a50b8ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:04.252319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87fcb4fd-1884-4aa3-9650-828d2a50b8ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:04.253374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87fcb4fd-1884-4aa3-9650-828d2a50b8ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:04.254449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87fcb4fd-1884-4aa3-9650-828d2a50b8ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:04.256024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87fcb4fd-1884-4aa3-9650-828d2a50b8ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:04.256600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87fcb4fd-1884-4aa3-9650-828d2a50b8ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:04.257053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-87fcb4fd-1884-4aa3-9650-828d2a50b8ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:04.519632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-87fcb4fd-1884-4aa3-9650-828d2a50b8ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:04.539393 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-87fcb4fd-1884-4aa3-9650-828d2a50b8ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1202 microversion: 2.1 time: 0.347901 Sep 08 13:32:04.541307 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2743/5615] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:04 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1202 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:32:05.601276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd1d4bd6-87d3-41fd-981e-18151f38387b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:05.604891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dd1d4bd6-87d3-41fd-981e-18151f38387b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:05.642030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:32:05.646580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd1d4bd6-87d3-41fd-981e-18151f38387b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:05.647519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd1d4bd6-87d3-41fd-981e-18151f38387b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:05.648718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd1d4bd6-87d3-41fd-981e-18151f38387b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:05.650270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd1d4bd6-87d3-41fd-981e-18151f38387b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:05.651099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd1d4bd6-87d3-41fd-981e-18151f38387b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:05.652359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd1d4bd6-87d3-41fd-981e-18151f38387b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:06.189145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dd1d4bd6-87d3-41fd-981e-18151f38387b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:06.201122 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dd1d4bd6-87d3-41fd-981e-18151f38387b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1202 microversion: 2.1 time: 0.610676 Sep 08 13:32:06.215715 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2873/5616] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:05 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1202 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:07.227263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-63e148a9-d74a-4402-8435-5127b94e397e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:07.229271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-63e148a9-d74a-4402-8435-5127b94e397e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:07.239715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:32:07.241900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63e148a9-d74a-4402-8435-5127b94e397e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:07.243045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63e148a9-d74a-4402-8435-5127b94e397e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:07.244304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63e148a9-d74a-4402-8435-5127b94e397e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:07.245285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63e148a9-d74a-4402-8435-5127b94e397e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:07.246374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63e148a9-d74a-4402-8435-5127b94e397e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:07.247461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-63e148a9-d74a-4402-8435-5127b94e397e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:07.650261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-63e148a9-d74a-4402-8435-5127b94e397e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:07.700330 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-63e148a9-d74a-4402-8435-5127b94e397e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1202 microversion: 2.1 time: 0.477608 Sep 08 13:32:07.703152 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2744/5617] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:07 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1202 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:08.738320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ebd22571-9861-4b9c-a8fc-bdc3a7e11ad5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:08.740679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ebd22571-9861-4b9c-a8fc-bdc3a7e11ad5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:08.766277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebd22571-9861-4b9c-a8fc-bdc3a7e11ad5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:08.766989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebd22571-9861-4b9c-a8fc-bdc3a7e11ad5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:08.767888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebd22571-9861-4b9c-a8fc-bdc3a7e11ad5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:08.771834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebd22571-9861-4b9c-a8fc-bdc3a7e11ad5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:08.772767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebd22571-9861-4b9c-a8fc-bdc3a7e11ad5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:08.778760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebd22571-9861-4b9c-a8fc-bdc3a7e11ad5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:09.122656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ebd22571-9861-4b9c-a8fc-bdc3a7e11ad5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:09.154439 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ebd22571-9861-4b9c-a8fc-bdc3a7e11ad5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1202 microversion: 2.1 time: 0.423068 Sep 08 13:32:09.181947 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2874/5618] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:08 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1202 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:10.034213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ead15883-91f9-4745-97b9-c27facdbae71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:10.036909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ead15883-91f9-4745-97b9-c27facdbae71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:10.059999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ead15883-91f9-4745-97b9-c27facdbae71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:10.061577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ead15883-91f9-4745-97b9-c27facdbae71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:10.062748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ead15883-91f9-4745-97b9-c27facdbae71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:10.064594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ead15883-91f9-4745-97b9-c27facdbae71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:10.065853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ead15883-91f9-4745-97b9-c27facdbae71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:10.066974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ead15883-91f9-4745-97b9-c27facdbae71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:10.198137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-40abca40-a340-414c-8ccf-f8903a99144c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:10.198137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-40abca40-a340-414c-8ccf-f8903a99144c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:10.209267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40abca40-a340-414c-8ccf-f8903a99144c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:10.217556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40abca40-a340-414c-8ccf-f8903a99144c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:10.217556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40abca40-a340-414c-8ccf-f8903a99144c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:10.217556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40abca40-a340-414c-8ccf-f8903a99144c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:10.218150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40abca40-a340-414c-8ccf-f8903a99144c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:10.218512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40abca40-a340-414c-8ccf-f8903a99144c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:10.402303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-ead15883-91f9-4745-97b9-c27facdbae71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lazy-loading 'services' on Instance uuid 6062f90a-3608-41a8-a9c7-ff273ce18f75 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:32:10.655739 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ead15883-91f9-4745-97b9-c27facdbae71 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments/59aac84f-1588-4166-abba-510b54406ee1" status: 202 len: 0 microversion: 2.1 time: 0.627465 Sep 08 13:32:10.670163 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2745/5619] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:32:10 2022] DELETE /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments/59aac84f-1588-4166-abba-510b54406ee1 => generated 0 bytes in 645 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:32:10.722744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-10076379-a0b6-4cb8-af74-3a23d24a09f4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:10.730607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-10076379-a0b6-4cb8-af74-3a23d24a09f4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:10.776860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10076379-a0b6-4cb8-af74-3a23d24a09f4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:10.780931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10076379-a0b6-4cb8-af74-3a23d24a09f4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:10.781741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10076379-a0b6-4cb8-af74-3a23d24a09f4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:10.789146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10076379-a0b6-4cb8-af74-3a23d24a09f4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:10.798612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10076379-a0b6-4cb8-af74-3a23d24a09f4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:10.808316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10076379-a0b6-4cb8-af74-3a23d24a09f4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:10.910840 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-10076379-a0b6-4cb8-af74-3a23d24a09f4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.229391 Sep 08 13:32:10.911021 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2746/5620] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:32:10 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:32:11.773404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40abca40-a340-414c-8ccf-f8903a99144c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:11.784595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-38edc329-e151-40ff-ae9c-7fe3fca39e4d req-2850790d-13f0-4b8b-8179-e40e68843778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee38b1a3-2e53-4eea-8f32-635c00b2961c", "name": "network-vif-plugged", "status": "completed", "tag": "c0572a8b-8a25-4235-8119-66a661fc1834"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:32:11.839005 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-40abca40-a340-414c-8ccf-f8903a99144c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1202 microversion: 2.1 time: 1.651996 Sep 08 13:32:11.864174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-38edc329-e151-40ff-ae9c-7fe3fca39e4d req-2850790d-13f0-4b8b-8179-e40e68843778 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:11.864793 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2875/5621] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:10 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1202 bytes in 1679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:11.875676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-38edc329-e151-40ff-ae9c-7fe3fca39e4d req-2850790d-13f0-4b8b-8179-e40e68843778 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:11.876842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-38edc329-e151-40ff-ae9c-7fe3fca39e4d req-2850790d-13f0-4b8b-8179-e40e68843778 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:11.934699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-068ab60d-286a-4dca-a1be-61a2180c8683 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:11.939545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-068ab60d-286a-4dca-a1be-61a2180c8683 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:11.953693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-068ab60d-286a-4dca-a1be-61a2180c8683 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:11.955085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-068ab60d-286a-4dca-a1be-61a2180c8683 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:11.956012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-068ab60d-286a-4dca-a1be-61a2180c8683 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:11.958623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-068ab60d-286a-4dca-a1be-61a2180c8683 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:11.959550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-068ab60d-286a-4dca-a1be-61a2180c8683 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:11.960380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-068ab60d-286a-4dca-a1be-61a2180c8683 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:11.971487 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-38edc329-e151-40ff-ae9c-7fe3fca39e4d req-2850790d-13f0-4b8b-8179-e40e68843778 service nova] Creating event network-vif-plugged:c0572a8b-8a25-4235-8119-66a661fc1834 for instance ee38b1a3-2e53-4eea-8f32-635c00b2961c on n-h2-852084-10 Sep 08 13:32:12.006165 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-38edc329-e151-40ff-ae9c-7fe3fca39e4d req-2850790d-13f0-4b8b-8179-e40e68843778 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237934 Sep 08 13:32:12.012863 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2747/5622] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:32:12.098546 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-068ab60d-286a-4dca-a1be-61a2180c8683 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173685 Sep 08 13:32:12.100518 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2876/5623] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:32:11 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:32:12.895633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0bcff363-7285-45c4-bdbf-670e26ae23f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:12.896656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0bcff363-7285-45c4-bdbf-670e26ae23f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:12.911255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0bcff363-7285-45c4-bdbf-670e26ae23f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:12.912498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0bcff363-7285-45c4-bdbf-670e26ae23f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:12.913910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0bcff363-7285-45c4-bdbf-670e26ae23f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:12.916214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0bcff363-7285-45c4-bdbf-670e26ae23f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:12.917959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0bcff363-7285-45c4-bdbf-670e26ae23f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:12.919504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0bcff363-7285-45c4-bdbf-670e26ae23f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:13.117633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-675c5351-1135-49c7-b03e-f94b04fb6295 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:13.120654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-675c5351-1135-49c7-b03e-f94b04fb6295 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:13.140240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-675c5351-1135-49c7-b03e-f94b04fb6295 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:13.141057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-675c5351-1135-49c7-b03e-f94b04fb6295 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:13.141815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-675c5351-1135-49c7-b03e-f94b04fb6295 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:13.143140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-675c5351-1135-49c7-b03e-f94b04fb6295 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:13.143912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-675c5351-1135-49c7-b03e-f94b04fb6295 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:13.144623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-675c5351-1135-49c7-b03e-f94b04fb6295 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:13.247102 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-675c5351-1135-49c7-b03e-f94b04fb6295 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.134263 Sep 08 13:32:13.251814 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2877/5624] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:32:13 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments => generated 197 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:32:13.416950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0bcff363-7285-45c4-bdbf-670e26ae23f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:13.447969 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0bcff363-7285-45c4-bdbf-670e26ae23f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1202 microversion: 2.1 time: 0.559889 Sep 08 13:32:13.464606 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2748/5625] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:12 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1202 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:14.285443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4ee0305e-6e2a-4c63-be9e-21a3b930a451 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:14.292323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4ee0305e-6e2a-4c63-be9e-21a3b930a451 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:14.317196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ee0305e-6e2a-4c63-be9e-21a3b930a451 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:14.318618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ee0305e-6e2a-4c63-be9e-21a3b930a451 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:14.320072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ee0305e-6e2a-4c63-be9e-21a3b930a451 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:14.331970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ee0305e-6e2a-4c63-be9e-21a3b930a451 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:14.333273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ee0305e-6e2a-4c63-be9e-21a3b930a451 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:14.333927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ee0305e-6e2a-4c63-be9e-21a3b930a451 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:14.473012 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4ee0305e-6e2a-4c63-be9e-21a3b930a451 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.208054 Sep 08 13:32:14.481736 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2878/5626] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:32:14 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments => generated 197 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:32:14.494070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b9e9bf3b-99c3-41bb-be88-6d795e00deb0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:14.495214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b9e9bf3b-99c3-41bb-be88-6d795e00deb0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:14.538380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9e9bf3b-99c3-41bb-be88-6d795e00deb0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:14.549167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9e9bf3b-99c3-41bb-be88-6d795e00deb0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:14.550521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9e9bf3b-99c3-41bb-be88-6d795e00deb0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:14.551807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9e9bf3b-99c3-41bb-be88-6d795e00deb0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:14.557535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9e9bf3b-99c3-41bb-be88-6d795e00deb0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:14.565663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9e9bf3b-99c3-41bb-be88-6d795e00deb0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:14.900411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b9e9bf3b-99c3-41bb-be88-6d795e00deb0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:14.927451 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b9e9bf3b-99c3-41bb-be88-6d795e00deb0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1389 microversion: 2.1 time: 0.433761 Sep 08 13:32:14.931098 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2749/5627] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:14 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1389 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:14.975910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1947b24f-1db3-46d5-b173-3086f8611bf2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:14.976555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1947b24f-1db3-46d5-b173-3086f8611bf2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:15.014819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1947b24f-1db3-46d5-b173-3086f8611bf2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:15.016764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1947b24f-1db3-46d5-b173-3086f8611bf2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:15.017300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1947b24f-1db3-46d5-b173-3086f8611bf2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:15.018079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1947b24f-1db3-46d5-b173-3086f8611bf2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:15.018696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1947b24f-1db3-46d5-b173-3086f8611bf2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:15.019151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1947b24f-1db3-46d5-b173-3086f8611bf2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:15.495324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cd04bec2-f73f-4597-a158-9d07ea5fdeba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:15.517712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1947b24f-1db3-46d5-b173-3086f8611bf2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:15.519266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cd04bec2-f73f-4597-a158-9d07ea5fdeba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:15.538374 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1947b24f-1db3-46d5-b173-3086f8611bf2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1389 microversion: 2.1 time: 0.568536 Sep 08 13:32:15.538654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd04bec2-f73f-4597-a158-9d07ea5fdeba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:15.539886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd04bec2-f73f-4597-a158-9d07ea5fdeba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:15.541714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd04bec2-f73f-4597-a158-9d07ea5fdeba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:15.542412 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2879/5628] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:14 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1389 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:15.545617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd04bec2-f73f-4597-a158-9d07ea5fdeba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:15.546859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd04bec2-f73f-4597-a158-9d07ea5fdeba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:15.548831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cd04bec2-f73f-4597-a158-9d07ea5fdeba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:15.611481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-43dfb060-7d10-4721-be0c-0e2f21ad9080 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:15.614038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-43dfb060-7d10-4721-be0c-0e2f21ad9080 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:15.633938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43dfb060-7d10-4721-be0c-0e2f21ad9080 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:15.635078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43dfb060-7d10-4721-be0c-0e2f21ad9080 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:15.638396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43dfb060-7d10-4721-be0c-0e2f21ad9080 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:15.639488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43dfb060-7d10-4721-be0c-0e2f21ad9080 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:15.641858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43dfb060-7d10-4721-be0c-0e2f21ad9080 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:15.645573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-43dfb060-7d10-4721-be0c-0e2f21ad9080 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:15.646326 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cd04bec2-f73f-4597-a158-9d07ea5fdeba tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160847 Sep 08 13:32:15.650521 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2750/5629] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:32:15 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:32:16.352948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-43dfb060-7d10-4721-be0c-0e2f21ad9080 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:16.378641 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-43dfb060-7d10-4721-be0c-0e2f21ad9080 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1389 microversion: 2.1 time: 0.771773 Sep 08 13:32:16.387155 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2880/5630] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:15 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1389 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:16.415767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0b08ce17-7f50-4833-b4bc-47881a29c7fd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:16.417318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0b08ce17-7f50-4833-b4bc-47881a29c7fd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:16.453833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0b08ce17-7f50-4833-b4bc-47881a29c7fd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:16.455475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0b08ce17-7f50-4833-b4bc-47881a29c7fd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:16.456357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0b08ce17-7f50-4833-b4bc-47881a29c7fd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:16.461964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0b08ce17-7f50-4833-b4bc-47881a29c7fd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:16.466019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0b08ce17-7f50-4833-b4bc-47881a29c7fd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:16.468911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0b08ce17-7f50-4833-b4bc-47881a29c7fd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:16.567395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0b08ce17-7f50-4833-b4bc-47881a29c7fd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:32:16.679417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d011d1b0-b156-4f2a-b2c7-47e790749a8d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:16.686850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d011d1b0-b156-4f2a-b2c7-47e790749a8d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:16.702646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d011d1b0-b156-4f2a-b2c7-47e790749a8d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:16.704731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d011d1b0-b156-4f2a-b2c7-47e790749a8d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:16.705899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d011d1b0-b156-4f2a-b2c7-47e790749a8d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:16.707864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d011d1b0-b156-4f2a-b2c7-47e790749a8d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:16.708923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d011d1b0-b156-4f2a-b2c7-47e790749a8d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:16.710819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d011d1b0-b156-4f2a-b2c7-47e790749a8d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:16.838961 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0b08ce17-7f50-4833-b4bc-47881a29c7fd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 204 len: 0 microversion: 2.1 time: 0.432866 Sep 08 13:32:16.842851 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2751/5631] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:32:16 2022] DELETE /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:32:16.866758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a497fb67-bd55-4b4e-9888-2d0b3447f0bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:16.872316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a497fb67-bd55-4b4e-9888-2d0b3447f0bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:16.885844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a497fb67-bd55-4b4e-9888-2d0b3447f0bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:16.887575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a497fb67-bd55-4b4e-9888-2d0b3447f0bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:16.888778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a497fb67-bd55-4b4e-9888-2d0b3447f0bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:16.889487 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d011d1b0-b156-4f2a-b2c7-47e790749a8d tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.222985 Sep 08 13:32:16.895269 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2881/5632] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:32:16 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:32:16.900117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a497fb67-bd55-4b4e-9888-2d0b3447f0bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:16.901432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a497fb67-bd55-4b4e-9888-2d0b3447f0bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:16.902183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a497fb67-bd55-4b4e-9888-2d0b3447f0bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:17.221450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a497fb67-bd55-4b4e-9888-2d0b3447f0bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:17.245679 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a497fb67-bd55-4b4e-9888-2d0b3447f0bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1395 microversion: 2.1 time: 0.391156 Sep 08 13:32:17.246939 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2752/5633] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:16 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1395 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:17.910491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a699575d-0863-4deb-a82c-77752705e3d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:17.922474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a699575d-0863-4deb-a82c-77752705e3d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:17.942078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a699575d-0863-4deb-a82c-77752705e3d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:17.943404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a699575d-0863-4deb-a82c-77752705e3d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:17.944617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a699575d-0863-4deb-a82c-77752705e3d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:17.947807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a699575d-0863-4deb-a82c-77752705e3d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:17.949149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a699575d-0863-4deb-a82c-77752705e3d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:17.950111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a699575d-0863-4deb-a82c-77752705e3d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:18.043503 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a699575d-0863-4deb-a82c-77752705e3d6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140819 Sep 08 13:32:18.045248 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2882/5634] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:32:17 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:32:18.288728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fe884de1-716d-47ed-8004-d9ab929a7fa7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:18.289865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fe884de1-716d-47ed-8004-d9ab929a7fa7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:18.314967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe884de1-716d-47ed-8004-d9ab929a7fa7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:18.315803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe884de1-716d-47ed-8004-d9ab929a7fa7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:18.316546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe884de1-716d-47ed-8004-d9ab929a7fa7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:18.324812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe884de1-716d-47ed-8004-d9ab929a7fa7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:18.325606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe884de1-716d-47ed-8004-d9ab929a7fa7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:18.326316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe884de1-716d-47ed-8004-d9ab929a7fa7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:18.927090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fe884de1-716d-47ed-8004-d9ab929a7fa7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:18.940449 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fe884de1-716d-47ed-8004-d9ab929a7fa7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1395 microversion: 2.1 time: 0.660060 Sep 08 13:32:18.952219 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2753/5635] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:18 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1395 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:19.062274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-82385ce1-4ab9-4cc3-bc54-2a24fd175f38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:19.077681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-82385ce1-4ab9-4cc3-bc54-2a24fd175f38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:19.109672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82385ce1-4ab9-4cc3-bc54-2a24fd175f38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:19.111385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82385ce1-4ab9-4cc3-bc54-2a24fd175f38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:19.112229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82385ce1-4ab9-4cc3-bc54-2a24fd175f38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:19.121704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82385ce1-4ab9-4cc3-bc54-2a24fd175f38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:19.124912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82385ce1-4ab9-4cc3-bc54-2a24fd175f38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:19.125868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82385ce1-4ab9-4cc3-bc54-2a24fd175f38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:19.267688 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-82385ce1-4ab9-4cc3-bc54-2a24fd175f38 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.213753 Sep 08 13:32:19.279650 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2883/5636] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:32:19 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments => generated 197 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:32:19.995502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-78235ac5-d21b-491c-9f5a-e1f18c456cd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:19.996609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-78235ac5-d21b-491c-9f5a-e1f18c456cd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:20.023815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78235ac5-d21b-491c-9f5a-e1f18c456cd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:20.025315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78235ac5-d21b-491c-9f5a-e1f18c456cd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:20.026180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78235ac5-d21b-491c-9f5a-e1f18c456cd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:20.044031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78235ac5-d21b-491c-9f5a-e1f18c456cd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:20.045426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78235ac5-d21b-491c-9f5a-e1f18c456cd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:20.046616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-78235ac5-d21b-491c-9f5a-e1f18c456cd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:20.297904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-78235ac5-d21b-491c-9f5a-e1f18c456cd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:20.339411 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-78235ac5-d21b-491c-9f5a-e1f18c456cd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1187 microversion: 2.1 time: 0.348674 Sep 08 13:32:20.347497 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2884/5637] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:19 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1187 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:20.386510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ce053c53-6df7-412b-b825-703ed6ac6cd6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:20.392638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ce053c53-6df7-412b-b825-703ed6ac6cd6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:20.427906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce053c53-6df7-412b-b825-703ed6ac6cd6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:20.430890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce053c53-6df7-412b-b825-703ed6ac6cd6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:20.434755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce053c53-6df7-412b-b825-703ed6ac6cd6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:20.442158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce053c53-6df7-412b-b825-703ed6ac6cd6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:20.443701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce053c53-6df7-412b-b825-703ed6ac6cd6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:20.444675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ce053c53-6df7-412b-b825-703ed6ac6cd6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:20.507331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b3f7f889-9ef7-4740-9852-9702a3ea56b4 req-711f75e1-7724-4149-95a4-628eef05b7fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee38b1a3-2e53-4eea-8f32-635c00b2961c", "name": "network-vif-deleted", "tag": "c0572a8b-8a25-4235-8119-66a661fc1834"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:32:20.530730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b3f7f889-9ef7-4740-9852-9702a3ea56b4 req-711f75e1-7724-4149-95a4-628eef05b7fa service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:20.531381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b3f7f889-9ef7-4740-9852-9702a3ea56b4 req-711f75e1-7724-4149-95a4-628eef05b7fa service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:20.534493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b3f7f889-9ef7-4740-9852-9702a3ea56b4 req-711f75e1-7724-4149-95a4-628eef05b7fa service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:20.543820 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ce053c53-6df7-412b-b825-703ed6ac6cd6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.194205 Sep 08 13:32:20.549262 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2885/5638] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:32:20 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:32:20.597797 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b3f7f889-9ef7-4740-9852-9702a3ea56b4 req-711f75e1-7724-4149-95a4-628eef05b7fa service nova] Creating event network-vif-deleted:c0572a8b-8a25-4235-8119-66a661fc1834 for instance ee38b1a3-2e53-4eea-8f32-635c00b2961c on n-h2-852084-10 Sep 08 13:32:20.607399 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b3f7f889-9ef7-4740-9852-9702a3ea56b4 req-711f75e1-7724-4149-95a4-628eef05b7fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.691541 Sep 08 13:32:20.609321 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2754/5639] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:32:21.374145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-feae01d8-ebcd-4d29-811a-e3a5bddea3b1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:21.378617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-feae01d8-ebcd-4d29-811a-e3a5bddea3b1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:21.421362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-feae01d8-ebcd-4d29-811a-e3a5bddea3b1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:21.422230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-feae01d8-ebcd-4d29-811a-e3a5bddea3b1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:21.422964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-feae01d8-ebcd-4d29-811a-e3a5bddea3b1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:21.424234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-feae01d8-ebcd-4d29-811a-e3a5bddea3b1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:21.424992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-feae01d8-ebcd-4d29-811a-e3a5bddea3b1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:21.425670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-feae01d8-ebcd-4d29-811a-e3a5bddea3b1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:21.561588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-67e355ef-ba86-4643-9699-5a27327efaa6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:21.569155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-67e355ef-ba86-4643-9699-5a27327efaa6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:21.580881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e355ef-ba86-4643-9699-5a27327efaa6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:21.581496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e355ef-ba86-4643-9699-5a27327efaa6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:21.582018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e355ef-ba86-4643-9699-5a27327efaa6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:21.582928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e355ef-ba86-4643-9699-5a27327efaa6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:21.583487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e355ef-ba86-4643-9699-5a27327efaa6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:21.583925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67e355ef-ba86-4643-9699-5a27327efaa6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:21.613284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-feae01d8-ebcd-4d29-811a-e3a5bddea3b1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:21.685366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:32:21.699167 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-feae01d8-ebcd-4d29-811a-e3a5bddea3b1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1187 microversion: 2.1 time: 0.331188 Sep 08 13:32:21.704624 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2886/5640] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:21 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1187 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:21.777697 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-67e355ef-ba86-4643-9699-5a27327efaa6 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.221545 Sep 08 13:32:21.802679 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2755/5641] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:32:21 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments => generated 197 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:32:22.761560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ab13c564-19d2-4e50-a4d8-b5a2fce02759 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:22.764229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ab13c564-19d2-4e50-a4d8-b5a2fce02759 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:22.813380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab13c564-19d2-4e50-a4d8-b5a2fce02759 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:22.814388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab13c564-19d2-4e50-a4d8-b5a2fce02759 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:22.814793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a3d7f048-75ff-44a1-ab64-ce707ebf5703 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:22.816619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab13c564-19d2-4e50-a4d8-b5a2fce02759 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:22.818231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab13c564-19d2-4e50-a4d8-b5a2fce02759 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:22.819345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab13c564-19d2-4e50-a4d8-b5a2fce02759 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:22.820424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab13c564-19d2-4e50-a4d8-b5a2fce02759 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:22.829472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a3d7f048-75ff-44a1-ab64-ce707ebf5703 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:22.858310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3d7f048-75ff-44a1-ab64-ce707ebf5703 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:22.859121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3d7f048-75ff-44a1-ab64-ce707ebf5703 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:22.859886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3d7f048-75ff-44a1-ab64-ce707ebf5703 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:22.861033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3d7f048-75ff-44a1-ab64-ce707ebf5703 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:22.864602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3d7f048-75ff-44a1-ab64-ce707ebf5703 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:22.869345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3d7f048-75ff-44a1-ab64-ce707ebf5703 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:22.963099 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a3d7f048-75ff-44a1-ab64-ce707ebf5703 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.154931 Sep 08 13:32:22.975324 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2756/5642] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:32:22 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75/os-volume_attachments => generated 25 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:32:23.138286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ab13c564-19d2-4e50-a4d8-b5a2fce02759 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:23.148286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1e8f09a2-f52b-4493-9ce5-2937e20ceeaf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:23.151597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1e8f09a2-f52b-4493-9ce5-2937e20ceeaf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:23.155205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:32:23.172343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e8f09a2-f52b-4493-9ce5-2937e20ceeaf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:23.173408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e8f09a2-f52b-4493-9ce5-2937e20ceeaf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:23.174301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e8f09a2-f52b-4493-9ce5-2937e20ceeaf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:23.176812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e8f09a2-f52b-4493-9ce5-2937e20ceeaf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:23.178055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e8f09a2-f52b-4493-9ce5-2937e20ceeaf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:23.181421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e8f09a2-f52b-4493-9ce5-2937e20ceeaf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:23.197420 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ab13c564-19d2-4e50-a4d8-b5a2fce02759 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1187 microversion: 2.1 time: 0.445288 Sep 08 13:32:23.199764 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2887/5643] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:22 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1187 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:23.303952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1e8f09a2-f52b-4493-9ce5-2937e20ceeaf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:32:23.471908 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1e8f09a2-f52b-4493-9ce5-2937e20ceeaf tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 204 len: 0 microversion: 2.1 time: 0.334987 Sep 08 13:32:23.473263 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2757/5644] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:32:23 2022] DELETE /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:32:23.490896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-88923f99-7832-4e29-bd9f-2f070c0d4709 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:23.492569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-88923f99-7832-4e29-bd9f-2f070c0d4709 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:23.511188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88923f99-7832-4e29-bd9f-2f070c0d4709 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:23.518185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88923f99-7832-4e29-bd9f-2f070c0d4709 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:23.521331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88923f99-7832-4e29-bd9f-2f070c0d4709 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:23.523383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88923f99-7832-4e29-bd9f-2f070c0d4709 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:23.524631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88923f99-7832-4e29-bd9f-2f070c0d4709 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:23.525727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88923f99-7832-4e29-bd9f-2f070c0d4709 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:24.262837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4dcb2f3a-423d-4eac-8530-f3cb9bbd8961 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:24.266871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4dcb2f3a-423d-4eac-8530-f3cb9bbd8961 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:24.297907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dcb2f3a-423d-4eac-8530-f3cb9bbd8961 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:24.302811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dcb2f3a-423d-4eac-8530-f3cb9bbd8961 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:24.304036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dcb2f3a-423d-4eac-8530-f3cb9bbd8961 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:24.306375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dcb2f3a-423d-4eac-8530-f3cb9bbd8961 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:24.311642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dcb2f3a-423d-4eac-8530-f3cb9bbd8961 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:24.313234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dcb2f3a-423d-4eac-8530-f3cb9bbd8961 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:24.533245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4dcb2f3a-423d-4eac-8530-f3cb9bbd8961 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:24.566295 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4dcb2f3a-423d-4eac-8530-f3cb9bbd8961 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1187 microversion: 2.1 time: 0.329304 Sep 08 13:32:24.569701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-88923f99-7832-4e29-bd9f-2f070c0d4709 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:24.580248 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2758/5645] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:24 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1187 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:32:24.597271 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-88923f99-7832-4e29-bd9f-2f070c0d4709 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1679 microversion: 2.1 time: 1.116496 Sep 08 13:32:24.605424 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2888/5646] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:23 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1679 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:25.605279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3699dd3-f382-47c2-81ba-1e53313f11d5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:25.607038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d3699dd3-f382-47c2-81ba-1e53313f11d5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:25.619711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3699dd3-f382-47c2-81ba-1e53313f11d5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:25.621312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3699dd3-f382-47c2-81ba-1e53313f11d5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:25.622182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3699dd3-f382-47c2-81ba-1e53313f11d5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:25.623982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3699dd3-f382-47c2-81ba-1e53313f11d5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:25.625110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3699dd3-f382-47c2-81ba-1e53313f11d5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:25.625974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d3699dd3-f382-47c2-81ba-1e53313f11d5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:25.655424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3161bf7a-9296-4d89-925e-937da72fb673 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:25.659419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3161bf7a-9296-4d89-925e-937da72fb673 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:25.673624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3161bf7a-9296-4d89-925e-937da72fb673 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:25.674694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3161bf7a-9296-4d89-925e-937da72fb673 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:25.675628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3161bf7a-9296-4d89-925e-937da72fb673 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:25.676960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3161bf7a-9296-4d89-925e-937da72fb673 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:25.678664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3161bf7a-9296-4d89-925e-937da72fb673 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:25.681169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3161bf7a-9296-4d89-925e-937da72fb673 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:25.839162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d3699dd3-f382-47c2-81ba-1e53313f11d5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:25.861111 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3699dd3-f382-47c2-81ba-1e53313f11d5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1187 microversion: 2.1 time: 0.263121 Sep 08 13:32:25.911270 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2759/5647] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:25 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1187 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:26.127835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3161bf7a-9296-4d89-925e-937da72fb673 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:26.162231 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3161bf7a-9296-4d89-925e-937da72fb673 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1679 microversion: 2.1 time: 0.515864 Sep 08 13:32:26.182916 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2889/5648] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:25 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1679 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:26.911158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c028df52-88ed-48b0-96ba-c34b0c8dac05 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:26.913020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c028df52-88ed-48b0-96ba-c34b0c8dac05 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:26.922813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c028df52-88ed-48b0-96ba-c34b0c8dac05 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:26.924125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c028df52-88ed-48b0-96ba-c34b0c8dac05 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:26.928318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c028df52-88ed-48b0-96ba-c34b0c8dac05 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:26.929534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c028df52-88ed-48b0-96ba-c34b0c8dac05 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:26.930329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c028df52-88ed-48b0-96ba-c34b0c8dac05 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:26.933681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c028df52-88ed-48b0-96ba-c34b0c8dac05 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:27.091505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c028df52-88ed-48b0-96ba-c34b0c8dac05 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:27.106706 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c028df52-88ed-48b0-96ba-c34b0c8dac05 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1187 microversion: 2.1 time: 0.199802 Sep 08 13:32:27.132315 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2760/5649] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:26 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1187 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:32:27.224474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-62ad8b6f-81bf-4664-9657-a2b89c9548bd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:27.235311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-62ad8b6f-81bf-4664-9657-a2b89c9548bd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:27.272454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62ad8b6f-81bf-4664-9657-a2b89c9548bd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:27.287613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62ad8b6f-81bf-4664-9657-a2b89c9548bd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:27.287730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62ad8b6f-81bf-4664-9657-a2b89c9548bd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:27.291833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62ad8b6f-81bf-4664-9657-a2b89c9548bd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:27.309647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62ad8b6f-81bf-4664-9657-a2b89c9548bd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:27.310492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62ad8b6f-81bf-4664-9657-a2b89c9548bd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:27.510474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-62ad8b6f-81bf-4664-9657-a2b89c9548bd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:27.527098 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-62ad8b6f-81bf-4664-9657-a2b89c9548bd tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1612 microversion: 2.1 time: 0.314792 Sep 08 13:32:27.538702 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2890/5650] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:27 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1612 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:28.139522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-ee49f5b0-0e84-47b7-9acd-ab3a2cc5b2f4 req-b1c11df0-8d20-4e63-b8a1-b844f1109b51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6062f90a-3608-41a8-a9c7-ff273ce18f75", "name": "network-vif-deleted", "tag": "5ff50012-37d8-4b87-8132-a04b2650a904"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:32:28.140477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c8864a04-715b-4616-a5e0-9b08d0aa1470 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:28.141050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c8864a04-715b-4616-a5e0-9b08d0aa1470 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:28.164100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8864a04-715b-4616-a5e0-9b08d0aa1470 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:28.164627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8864a04-715b-4616-a5e0-9b08d0aa1470 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:28.169992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8864a04-715b-4616-a5e0-9b08d0aa1470 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:28.172724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8864a04-715b-4616-a5e0-9b08d0aa1470 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:28.176804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8864a04-715b-4616-a5e0-9b08d0aa1470 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:28.179787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8864a04-715b-4616-a5e0-9b08d0aa1470 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:28.182135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ee49f5b0-0e84-47b7-9acd-ab3a2cc5b2f4 req-b1c11df0-8d20-4e63-b8a1-b844f1109b51 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:28.183385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ee49f5b0-0e84-47b7-9acd-ab3a2cc5b2f4 req-b1c11df0-8d20-4e63-b8a1-b844f1109b51 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:28.184561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ee49f5b0-0e84-47b7-9acd-ab3a2cc5b2f4 req-b1c11df0-8d20-4e63-b8a1-b844f1109b51 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:28.225838 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-ee49f5b0-0e84-47b7-9acd-ab3a2cc5b2f4 req-b1c11df0-8d20-4e63-b8a1-b844f1109b51 service nova] Creating event network-vif-deleted:5ff50012-37d8-4b87-8132-a04b2650a904 for instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 on n-h1-852084-10 Sep 08 13:32:28.247811 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-ee49f5b0-0e84-47b7-9acd-ab3a2cc5b2f4 req-b1c11df0-8d20-4e63-b8a1-b844f1109b51 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118582 Sep 08 13:32:28.256493 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2761/5651] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:32:28.356772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c8864a04-715b-4616-a5e0-9b08d0aa1470 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:28.373753 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c8864a04-715b-4616-a5e0-9b08d0aa1470 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1187 microversion: 2.1 time: 0.238032 Sep 08 13:32:28.376752 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2891/5652] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:28 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1187 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:32:28.580413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:28.581784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:28.628054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:28.628804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:28.629527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:28.630553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:28.631281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:28.631953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:28.803049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:28.804063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:28.804936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:28.807083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lazy-loading 'fault' on Instance uuid 6062f90a-3608-41a8-a9c7-ff273ce18f75 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:32:28.914920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c622939c63749dc944918e2717cd09a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efc65cf30371430a9b085afea75e7a5b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:28.953241 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-08aa1f0e-2144-4f0d-8f40-d66cc5cbf584 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 200 len: 1331 microversion: 2.1 time: 0.383520 Sep 08 13:32:28.957736 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2762/5653] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:28 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 1331 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:29.426289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-345dc716-7ce6-481a-bf16-778560e43eea tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:29.428275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-345dc716-7ce6-481a-bf16-778560e43eea tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:29.467656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-345dc716-7ce6-481a-bf16-778560e43eea tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:29.475988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-345dc716-7ce6-481a-bf16-778560e43eea tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:29.477364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-345dc716-7ce6-481a-bf16-778560e43eea tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:29.479454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-345dc716-7ce6-481a-bf16-778560e43eea tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:29.480446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-345dc716-7ce6-481a-bf16-778560e43eea tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:29.484238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-345dc716-7ce6-481a-bf16-778560e43eea tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:29.617553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-345dc716-7ce6-481a-bf16-778560e43eea tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:29.630676 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-345dc716-7ce6-481a-bf16-778560e43eea tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1187 microversion: 2.1 time: 0.212340 Sep 08 13:32:29.646020 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2892/5654] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:29 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1187 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:30.006609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3eaea354-86ea-4c2b-8def-f5f6f2f8e46a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:30.007718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3eaea354-86ea-4c2b-8def-f5f6f2f8e46a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:30.023933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3eaea354-86ea-4c2b-8def-f5f6f2f8e46a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:30.026095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3eaea354-86ea-4c2b-8def-f5f6f2f8e46a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:30.028038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3eaea354-86ea-4c2b-8def-f5f6f2f8e46a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:30.029815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3eaea354-86ea-4c2b-8def-f5f6f2f8e46a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:30.031181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3eaea354-86ea-4c2b-8def-f5f6f2f8e46a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:30.032416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3eaea354-86ea-4c2b-8def-f5f6f2f8e46a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:30.077514 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-3eaea354-86ea-4c2b-8def-f5f6f2f8e46a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3eaea354-86ea-4c2b-8def-f5f6f2f8e46a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 HTTP/1.1 Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '6062f90a-3608-41a8-a9c7-ff273ce18f75'} Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:30.092182 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:30.101246 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:30.101246 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:30.101246 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:30.101246 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:32:30.101246 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:32:30.101246 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:30.101246 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:30.108876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3eaea354-86ea-4c2b-8def-f5f6f2f8e46a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 404 to user: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:32:30.112587 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3eaea354-86ea-4c2b-8def-f5f6f2f8e46a tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 404 len: 111 microversion: 2.1 time: 0.113826 Sep 08 13:32:30.112587 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2763/5655] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:29 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:32:30.124995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-20ce6f63-0d97-48be-9d58-755ced31f940 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '.version_select at 0x7fdb35e4f430>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:30.176158 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-20ce6f63-0d97-48be-9d58-755ced31f940 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513543407" status: 202 len: 0 microversion: 2.1 time: 0.056025 Sep 08 13:32:30.187184 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2893/5656] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Sep 8 13:32:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1513543407 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:32:30.668889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2c3fdbb5-3506-4aac-bfef-35d3f6d1711b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:30.670327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2c3fdbb5-3506-4aac-bfef-35d3f6d1711b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:30.688006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3fdbb5-3506-4aac-bfef-35d3f6d1711b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:30.688006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3fdbb5-3506-4aac-bfef-35d3f6d1711b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:30.689344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3fdbb5-3506-4aac-bfef-35d3f6d1711b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:30.690846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3fdbb5-3506-4aac-bfef-35d3f6d1711b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:30.693071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3fdbb5-3506-4aac-bfef-35d3f6d1711b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:30.693071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3fdbb5-3506-4aac-bfef-35d3f6d1711b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:30.862681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c3fdbb5-3506-4aac-bfef-35d3f6d1711b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:30.878304 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2c3fdbb5-3506-4aac-bfef-35d3f6d1711b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1187 microversion: 2.1 time: 0.217885 Sep 08 13:32:30.890199 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2764/5657] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:30 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1187 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:31.910231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2027985e-0d6a-4487-9674-8122f9f808e6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:31.912055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2027985e-0d6a-4487-9674-8122f9f808e6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:31.921878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2027985e-0d6a-4487-9674-8122f9f808e6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:31.922637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2027985e-0d6a-4487-9674-8122f9f808e6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:31.923654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2027985e-0d6a-4487-9674-8122f9f808e6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:31.924707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2027985e-0d6a-4487-9674-8122f9f808e6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:31.925400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2027985e-0d6a-4487-9674-8122f9f808e6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:31.926297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2027985e-0d6a-4487-9674-8122f9f808e6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:32.017366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2027985e-0d6a-4487-9674-8122f9f808e6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:32.029202 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2027985e-0d6a-4487-9674-8122f9f808e6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1187 microversion: 2.1 time: 0.123674 Sep 08 13:32:32.029825 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2894/5658] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:31 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1187 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:33.059601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fccc3135-c133-430b-9f04-ccd4cab42786 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:33.061045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fccc3135-c133-430b-9f04-ccd4cab42786 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:33.075013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fccc3135-c133-430b-9f04-ccd4cab42786 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:33.076071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fccc3135-c133-430b-9f04-ccd4cab42786 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:33.077184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fccc3135-c133-430b-9f04-ccd4cab42786 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:33.078748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fccc3135-c133-430b-9f04-ccd4cab42786 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:33.079657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fccc3135-c133-430b-9f04-ccd4cab42786 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:33.080619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fccc3135-c133-430b-9f04-ccd4cab42786 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:33.216352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fccc3135-c133-430b-9f04-ccd4cab42786 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:32:33.225884 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fccc3135-c133-430b-9f04-ccd4cab42786 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 200 len: 1187 microversion: 2.1 time: 0.175686 Sep 08 13:32:33.226484 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2765/5659] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:33 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 1187 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:32:34.257197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-586befcc-8556-49e8-8018-c1cdd91cdf00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:34.258154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-586befcc-8556-49e8-8018-c1cdd91cdf00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: ee38b1a3-2e53-4eea-8f32-635c00b2961c] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:34.269231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-586befcc-8556-49e8-8018-c1cdd91cdf00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:34.270388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-586befcc-8556-49e8-8018-c1cdd91cdf00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:34.271377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-586befcc-8556-49e8-8018-c1cdd91cdf00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:34.272913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-586befcc-8556-49e8-8018-c1cdd91cdf00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:34.273975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-586befcc-8556-49e8-8018-c1cdd91cdf00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:34.274901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-586befcc-8556-49e8-8018-c1cdd91cdf00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:34.295784 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-586befcc-8556-49e8-8018-c1cdd91cdf00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance ee38b1a3-2e53-4eea-8f32-635c00b2961c could not be found. Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-586befcc-8556-49e8-8018-c1cdd91cdf00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c HTTP/1.1 Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance ee38b1a3-2e53-4eea-8f32-635c00b2961c could not be found. Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'ee38b1a3-2e53-4eea-8f32-635c00b2961c'} Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee38b1a3-2e53-4eea-8f32-635c00b2961c could not be found. Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee38b1a3-2e53-4eea-8f32-635c00b2961c could not be found. Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:34.298046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:34.302996 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:34.302996 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:34.302996 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:34.302996 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:32:34.302996 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:32:34.302996 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee38b1a3-2e53-4eea-8f32-635c00b2961c could not be found. Sep 08 13:32:34.302996 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:34.304474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-586befcc-8556-49e8-8018-c1cdd91cdf00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance ee38b1a3-2e53-4eea-8f32-635c00b2961c could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:32:34.306135 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-586befcc-8556-49e8-8018-c1cdd91cdf00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c" status: 404 len: 111 microversion: 2.1 time: 0.053200 Sep 08 13:32:34.311204 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2895/5660] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:34 2022] GET /compute/v2.1/servers/ee38b1a3-2e53-4eea-8f32-635c00b2961c => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:32:37.449980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-27db62c7-472b-4bc7-a2f8-fba2dbdaa509 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:37.451110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-27db62c7-472b-4bc7-a2f8-fba2dbdaa509 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:37.454792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:32:37.474807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27db62c7-472b-4bc7-a2f8-fba2dbdaa509 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:37.475758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27db62c7-472b-4bc7-a2f8-fba2dbdaa509 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:37.480659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27db62c7-472b-4bc7-a2f8-fba2dbdaa509 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:37.482449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27db62c7-472b-4bc7-a2f8-fba2dbdaa509 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:37.483696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27db62c7-472b-4bc7-a2f8-fba2dbdaa509 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:37.484847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-27db62c7-472b-4bc7-a2f8-fba2dbdaa509 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:37.519527 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-27db62c7-472b-4bc7-a2f8-fba2dbdaa509 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-27db62c7-472b-4bc7-a2f8-fba2dbdaa509 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 HTTP/1.1 Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '6062f90a-3608-41a8-a9c7-ff273ce18f75'} Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:32:37.522965 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-27db62c7-472b-4bc7-a2f8-fba2dbdaa509 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 404 to user: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-27db62c7-472b-4bc7-a2f8-fba2dbdaa509 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 404 len: 111 microversion: 2.1 time: 0.083616 Sep 08 13:32:37.535604 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2766/5661] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:32:37 2022] DELETE /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:32:37.548540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75ec96c9-c66f-440e-9542-2f5246da0a28 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:37.552132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-75ec96c9-c66f-440e-9542-2f5246da0a28 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 6062f90a-3608-41a8-a9c7-ff273ce18f75] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:37.559257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:32:37.583444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75ec96c9-c66f-440e-9542-2f5246da0a28 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:37.584579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75ec96c9-c66f-440e-9542-2f5246da0a28 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:37.585907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75ec96c9-c66f-440e-9542-2f5246da0a28 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:37.588203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75ec96c9-c66f-440e-9542-2f5246da0a28 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:37.589971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75ec96c9-c66f-440e-9542-2f5246da0a28 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:37.590881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75ec96c9-c66f-440e-9542-2f5246da0a28 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:37.629668 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-75ec96c9-c66f-440e-9542-2f5246da0a28 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75ec96c9-c66f-440e-9542-2f5246da0a28 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 HTTP/1.1 Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '6062f90a-3608-41a8-a9c7-ff273ce18f75'} Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:37.633066 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:37.642364 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:37.642364 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:37.642364 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:37.642364 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:32:37.642364 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:32:37.642364 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. Sep 08 13:32:37.642364 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:37.645051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75ec96c9-c66f-440e-9542-2f5246da0a28 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 404 to user: Instance 6062f90a-3608-41a8-a9c7-ff273ce18f75 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:32:37.646766 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-75ec96c9-c66f-440e-9542-2f5246da0a28 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75" status: 404 len: 111 microversion: 2.1 time: 0.107535 Sep 08 13:32:37.648343 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2896/5662] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:37 2022] GET /compute/v2.1/servers/6062f90a-3608-41a8-a9c7-ff273ce18f75 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:32:46.004757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2093367f-8bb2-436a-b542-ef65846009d0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:46.004757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2093367f-8bb2-436a-b542-ef65846009d0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:46.028938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2093367f-8bb2-436a-b542-ef65846009d0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:46.029820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2093367f-8bb2-436a-b542-ef65846009d0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:46.030627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2093367f-8bb2-436a-b542-ef65846009d0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:46.031915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2093367f-8bb2-436a-b542-ef65846009d0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:46.032756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2093367f-8bb2-436a-b542-ef65846009d0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:46.033532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2093367f-8bb2-436a-b542-ef65846009d0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:46.068736 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-2093367f-8bb2-436a-b542-ef65846009d0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2093367f-8bb2-436a-b542-ef65846009d0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f HTTP/1.1 Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'b70835a0-c84c-4c65-b1ba-3404e8865d3f'} Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:32:46.077245 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:32:46.086072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:32:46.086072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.086072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:46.086072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.086072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:46.086072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:46.086072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:46.086072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:32:46.086072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:32:46.086072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:32:46.086072 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.091719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2093367f-8bb2-436a-b542-ef65846009d0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 404 to user: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:32:46.091719 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2093367f-8bb2-436a-b542-ef65846009d0 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 404 len: 111 microversion: 2.1 time: 0.092468 Sep 08 13:32:46.093646 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2767/5663] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:32:45 2022] DELETE /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:32:46.117741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7687ad65-4661-4e09-94d8-f072fd6c9da4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:46.126321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7687ad65-4661-4e09-94d8-f072fd6c9da4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: b70835a0-c84c-4c65-b1ba-3404e8865d3f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:46.176375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7687ad65-4661-4e09-94d8-f072fd6c9da4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:46.177097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7687ad65-4661-4e09-94d8-f072fd6c9da4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:46.177745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7687ad65-4661-4e09-94d8-f072fd6c9da4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:46.178541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7687ad65-4661-4e09-94d8-f072fd6c9da4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:46.179026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7687ad65-4661-4e09-94d8-f072fd6c9da4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:46.179501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7687ad65-4661-4e09-94d8-f072fd6c9da4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:46.217382 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-7687ad65-4661-4e09-94d8-f072fd6c9da4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7687ad65-4661-4e09-94d8-f072fd6c9da4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f HTTP/1.1 Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'b70835a0-c84c-4c65-b1ba-3404e8865d3f'} Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:46.227652 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.238694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:46.238694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:46.238694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:46.238694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:32:46.238694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:32:46.238694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. Sep 08 13:32:46.238694 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.238694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7687ad65-4661-4e09-94d8-f072fd6c9da4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 404 to user: Instance b70835a0-c84c-4c65-b1ba-3404e8865d3f could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:32:46.238694 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7687ad65-4661-4e09-94d8-f072fd6c9da4 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f" status: 404 len: 111 microversion: 2.1 time: 0.128429 Sep 08 13:32:46.238694 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2897/5664] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:46 2022] GET /compute/v2.1/servers/b70835a0-c84c-4c65-b1ba-3404e8865d3f => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:32:46.256992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a7ef5f60-20bd-4f90-80c0-ffe9fc7c7874 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:46.263155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a7ef5f60-20bd-4f90-80c0-ffe9fc7c7874 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:46.279057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7ef5f60-20bd-4f90-80c0-ffe9fc7c7874 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:46.280064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7ef5f60-20bd-4f90-80c0-ffe9fc7c7874 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:46.280844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7ef5f60-20bd-4f90-80c0-ffe9fc7c7874 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:46.281759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7ef5f60-20bd-4f90-80c0-ffe9fc7c7874 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:46.282484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7ef5f60-20bd-4f90-80c0-ffe9fc7c7874 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:46.283201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7ef5f60-20bd-4f90-80c0-ffe9fc7c7874 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:46.308989 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-a7ef5f60-20bd-4f90-80c0-ffe9fc7c7874 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a7ef5f60-20bd-4f90-80c0-ffe9fc7c7874 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a HTTP/1.1 Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'e8b683e9-3941-42a3-93e2-f68d4c5f0d4a'} Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:32:46.310998 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a7ef5f60-20bd-4f90-80c0-ffe9fc7c7874 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 404 to user: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:32:46.318262 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a7ef5f60-20bd-4f90-80c0-ffe9fc7c7874 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 404 len: 111 microversion: 2.1 time: 0.070298 Sep 08 13:32:46.325585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-88e5ae63-2c2e-4aa2-bd58-1df02f5a8c6b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:46.326552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-88e5ae63-2c2e-4aa2-bd58-1df02f5a8c6b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: e8b683e9-3941-42a3-93e2-f68d4c5f0d4a] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:46.330103 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2768/5665] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:32:46 2022] DELETE /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:32:46.339153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88e5ae63-2c2e-4aa2-bd58-1df02f5a8c6b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:46.339955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88e5ae63-2c2e-4aa2-bd58-1df02f5a8c6b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:46.341011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88e5ae63-2c2e-4aa2-bd58-1df02f5a8c6b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:46.341981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88e5ae63-2c2e-4aa2-bd58-1df02f5a8c6b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:46.342625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88e5ae63-2c2e-4aa2-bd58-1df02f5a8c6b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:46.343429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88e5ae63-2c2e-4aa2-bd58-1df02f5a8c6b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:46.368299 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-88e5ae63-2c2e-4aa2-bd58-1df02f5a8c6b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-88e5ae63-2c2e-4aa2-bd58-1df02f5a8c6b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a HTTP/1.1 Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'e8b683e9-3941-42a3-93e2-f68d4c5f0d4a'} Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:46.370862 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.381825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:46.381825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:46.381825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:46.381825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:32:46.381825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:32:46.381825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. Sep 08 13:32:46.381825 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:46.381825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-88e5ae63-2c2e-4aa2-bd58-1df02f5a8c6b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 404 to user: Instance e8b683e9-3941-42a3-93e2-f68d4c5f0d4a could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:32:46.381825 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-88e5ae63-2c2e-4aa2-bd58-1df02f5a8c6b tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a" status: 404 len: 111 microversion: 2.1 time: 0.052605 Sep 08 13:32:46.388991 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2898/5666] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:46 2022] GET /compute/v2.1/servers/e8b683e9-3941-42a3-93e2-f68d4c5f0d4a => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:32:57.762659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ea1b3e1e-b49e-4f2e-952e-2346ca560d6e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:57.766205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ea1b3e1e-b49e-4f2e-952e-2346ca560d6e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:57.810596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=5 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:32:57.815301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:32:57.828612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea1b3e1e-b49e-4f2e-952e-2346ca560d6e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:57.829690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea1b3e1e-b49e-4f2e-952e-2346ca560d6e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:57.830659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea1b3e1e-b49e-4f2e-952e-2346ca560d6e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:57.835882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea1b3e1e-b49e-4f2e-952e-2346ca560d6e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:57.844278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea1b3e1e-b49e-4f2e-952e-2346ca560d6e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:57.844866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea1b3e1e-b49e-4f2e-952e-2346ca560d6e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:57.868682 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-ea1b3e1e-b49e-4f2e-952e-2346ca560d6e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ea1b3e1e-b49e-4f2e-952e-2346ca560d6e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 HTTP/1.1 Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '31c4aab1-021c-4648-8fe3-00d778b883f2'} Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:32:57.870442 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ea1b3e1e-b49e-4f2e-952e-2346ca560d6e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 404 to user: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ea1b3e1e-b49e-4f2e-952e-2346ca560d6e tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "DELETE /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 404 len: 111 microversion: 2.1 time: 0.123241 Sep 08 13:32:57.879708 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2769/5667] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:32:57 2022] DELETE /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 111 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:32:57.893008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-51350bb6-ce79-4bb7-be98-7fd3a94b7912 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:32:57.899809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-51350bb6-ce79-4bb7-be98-7fd3a94b7912 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] [instance: 31c4aab1-021c-4648-8fe3-00d778b883f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:32:57.908488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=5 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:32:57.909780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=45 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:32:57.914496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51350bb6-ce79-4bb7-be98-7fd3a94b7912 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:57.916866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51350bb6-ce79-4bb7-be98-7fd3a94b7912 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:57.918541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51350bb6-ce79-4bb7-be98-7fd3a94b7912 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:57.920365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51350bb6-ce79-4bb7-be98-7fd3a94b7912 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:32:57.920971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51350bb6-ce79-4bb7-be98-7fd3a94b7912 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:32:57.921677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-51350bb6-ce79-4bb7-be98-7fd3a94b7912 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:32:57.976219 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-51350bb6-ce79-4bb7-be98-7fd3a94b7912 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] HTTP exception thrown: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-51350bb6-ce79-4bb7-be98-7fd3a94b7912 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Request method failure captured: Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 HTTP/1.1 Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe151YXXM8cLU3JUpQ5hjfjBlINIv7FHjVP58fgL3m_jLale4UtktkdS0LRF8LH8c_g6pUROocWsCxoE9NISW61jhOi2QKmUPf1LUL7gZN814tDM5tR2G8ztujv7jQjRV0xs9BY6UPc0qT6Y1PbexJcXkdVAKk1AmVsQw9QnwN116WI Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/efc65cf30371430a9b085afea75e7a5b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: efc65cf30371430a9b085afea75e7a5b Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-838979797 Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 1c622939c63749dc944918e2717cd09a Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-AttachVolumeNegativeTest-838979797-project Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '31c4aab1-021c-4648-8fe3-00d778b883f2'} Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:32:57.978791 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:57.983370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:32:57.983370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:32:57.983370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:32:57.983370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:32:57.983370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:32:57.983370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. Sep 08 13:32:57.983370 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:32:57.988088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-51350bb6-ce79-4bb7-be98-7fd3a94b7912 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] Returning 404 to user: Instance 31c4aab1-021c-4648-8fe3-00d778b883f2 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:32:57.992266 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-51350bb6-ce79-4bb7-be98-7fd3a94b7912 tempest-AttachVolumeNegativeTest-838979797 tempest-AttachVolumeNegativeTest-838979797-project] 10.222.0.78 "GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2" status: 404 len: 111 microversion: 2.1 time: 0.106006 Sep 08 13:32:57.998119 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2899/5668] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:32:57 2022] GET /compute/v2.1/servers/31c4aab1-021c-4648-8fe3-00d778b883f2 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:33:00.231980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-220755987", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "52dd2454-27eb-44b4-956f-16a527d64aa7"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:33:01.018216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] validate_networks() for [('52dd2454-27eb-44b4-956f-16a527d64aa7', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:33:02.037555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:33:02.038677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:33:02.039486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:33:02.047997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:33:02.047997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:33:02.057391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:02.058975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:02.059524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:02.060420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:02.061166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:02.062080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:02.095200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Getting quotas for project c5137eef4e924ae7a7fd8fe51de61cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:33:02.108254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Getting quotas for user 8ea7d998c5e244199aa6a68e288d44c1 and project c5137eef4e924ae7a7fd8fe51de61cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:33:02.130740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:33:02.134356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:33:02.224459 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-121502e4-2661-486b-b916-d8324ee7d9c9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.002280 Sep 08 13:33:02.226259 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2770/5669] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:33:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2006 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:33:02.241820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b0808dc6-9212-43e0-b877-e911eb95d506 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:02.244095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b0808dc6-9212-43e0-b877-e911eb95d506 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:02.583905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0808dc6-9212-43e0-b877-e911eb95d506 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:02.609023 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b0808dc6-9212-43e0-b877-e911eb95d506 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1218 microversion: 2.1 time: 0.374229 Sep 08 13:33:02.609796 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2900/5670] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:02 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1218 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:33:03.649314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b38849b1-5182-42f5-9586-7f3fd4913e12 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:03.650276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b38849b1-5182-42f5-9586-7f3fd4913e12 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:03.802444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b38849b1-5182-42f5-9586-7f3fd4913e12 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:03.817840 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b38849b1-5182-42f5-9586-7f3fd4913e12 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1218 microversion: 2.1 time: 0.179588 Sep 08 13:33:03.831911 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2771/5671] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:03 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:04.874577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3fcf9bf2-cb44-44fb-afa1-059f92eb3067 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:04.884012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3fcf9bf2-cb44-44fb-afa1-059f92eb3067 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:04.906504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fcf9bf2-cb44-44fb-afa1-059f92eb3067 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:04.907429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fcf9bf2-cb44-44fb-afa1-059f92eb3067 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:04.915780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fcf9bf2-cb44-44fb-afa1-059f92eb3067 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:04.916783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fcf9bf2-cb44-44fb-afa1-059f92eb3067 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:04.917569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fcf9bf2-cb44-44fb-afa1-059f92eb3067 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:04.918154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fcf9bf2-cb44-44fb-afa1-059f92eb3067 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:05.129539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3fcf9bf2-cb44-44fb-afa1-059f92eb3067 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:05.155384 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3fcf9bf2-cb44-44fb-afa1-059f92eb3067 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1288 microversion: 2.1 time: 0.288050 Sep 08 13:33:05.158187 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2901/5672] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:04 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1288 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:06.186108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6487373a-176d-40df-885c-f71c08ade0a6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:06.188448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6487373a-176d-40df-885c-f71c08ade0a6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:06.205865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6487373a-176d-40df-885c-f71c08ade0a6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:06.207659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6487373a-176d-40df-885c-f71c08ade0a6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:06.209298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6487373a-176d-40df-885c-f71c08ade0a6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:06.212550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6487373a-176d-40df-885c-f71c08ade0a6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:06.214776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6487373a-176d-40df-885c-f71c08ade0a6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:06.216713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6487373a-176d-40df-885c-f71c08ade0a6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:06.482948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6487373a-176d-40df-885c-f71c08ade0a6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:06.507147 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6487373a-176d-40df-885c-f71c08ade0a6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1276 microversion: 2.1 time: 0.327247 Sep 08 13:33:06.510293 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2772/5673] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:06 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1276 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:33:07.557194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d39d0e19-6c5c-4f0a-a3c6-47ecc8c41ca1 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:07.558204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d39d0e19-6c5c-4f0a-a3c6-47ecc8c41ca1 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:07.575648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d39d0e19-6c5c-4f0a-a3c6-47ecc8c41ca1 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:07.576429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d39d0e19-6c5c-4f0a-a3c6-47ecc8c41ca1 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:07.576893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d39d0e19-6c5c-4f0a-a3c6-47ecc8c41ca1 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:07.578009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d39d0e19-6c5c-4f0a-a3c6-47ecc8c41ca1 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:07.578795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d39d0e19-6c5c-4f0a-a3c6-47ecc8c41ca1 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:07.579363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d39d0e19-6c5c-4f0a-a3c6-47ecc8c41ca1 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:08.244748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d39d0e19-6c5c-4f0a-a3c6-47ecc8c41ca1 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:08.275928 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d39d0e19-6c5c-4f0a-a3c6-47ecc8c41ca1 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1318 microversion: 2.1 time: 0.723452 Sep 08 13:33:08.291965 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2902/5674] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:07 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1318 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:09.248917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3c1854e6-e45d-417b-9b70-5ac0a43f7169 req-81579861-8c78-449d-9f0b-e5bf4c3e8986 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd8651bb-d64b-4cf5-a244-2cbeb4039bf7", "tag": "4e1d804f-a7e7-4f53-8d01-d8a5c2aca400"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:33:09.262286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3c1854e6-e45d-417b-9b70-5ac0a43f7169 req-81579861-8c78-449d-9f0b-e5bf4c3e8986 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:09.263100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3c1854e6-e45d-417b-9b70-5ac0a43f7169 req-81579861-8c78-449d-9f0b-e5bf4c3e8986 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:09.263756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3c1854e6-e45d-417b-9b70-5ac0a43f7169 req-81579861-8c78-449d-9f0b-e5bf4c3e8986 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:09.282456 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3c1854e6-e45d-417b-9b70-5ac0a43f7169 req-81579861-8c78-449d-9f0b-e5bf4c3e8986 service nova] Creating event network-changed:4e1d804f-a7e7-4f53-8d01-d8a5c2aca400 for instance fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 on n-h2-852084-10 Sep 08 13:33:09.291048 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3c1854e6-e45d-417b-9b70-5ac0a43f7169 req-81579861-8c78-449d-9f0b-e5bf4c3e8986 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048060 Sep 08 13:33:09.296853 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2773/5675] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:33:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:33:09.312673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ebc21b26-abaa-495f-8799-68c20aec23aa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:09.314962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ebc21b26-abaa-495f-8799-68c20aec23aa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:09.345783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc21b26-abaa-495f-8799-68c20aec23aa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:09.349711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc21b26-abaa-495f-8799-68c20aec23aa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:09.351526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc21b26-abaa-495f-8799-68c20aec23aa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:09.355771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc21b26-abaa-495f-8799-68c20aec23aa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:09.357282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc21b26-abaa-495f-8799-68c20aec23aa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:09.358169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebc21b26-abaa-495f-8799-68c20aec23aa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:09.840661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ebc21b26-abaa-495f-8799-68c20aec23aa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:09.856614 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ebc21b26-abaa-495f-8799-68c20aec23aa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1318 microversion: 2.1 time: 0.555861 Sep 08 13:33:09.858674 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2903/5676] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:09 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:10.893001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-49d9cfc6-9b56-40c3-a603-722620dee548 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:10.899346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-49d9cfc6-9b56-40c3-a603-722620dee548 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:10.930492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49d9cfc6-9b56-40c3-a603-722620dee548 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:10.931737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49d9cfc6-9b56-40c3-a603-722620dee548 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:10.933090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49d9cfc6-9b56-40c3-a603-722620dee548 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:10.934736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49d9cfc6-9b56-40c3-a603-722620dee548 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:10.935964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49d9cfc6-9b56-40c3-a603-722620dee548 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:10.937067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49d9cfc6-9b56-40c3-a603-722620dee548 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:11.413385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-49d9cfc6-9b56-40c3-a603-722620dee548 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:11.451453 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-49d9cfc6-9b56-40c3-a603-722620dee548 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1318 microversion: 2.1 time: 0.569459 Sep 08 13:33:11.473271 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2774/5677] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:10 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:12.502985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e84151b1-bd76-44ea-ae9a-998d493bdc99 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:12.504219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e84151b1-bd76-44ea-ae9a-998d493bdc99 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:12.529388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e84151b1-bd76-44ea-ae9a-998d493bdc99 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:12.531127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e84151b1-bd76-44ea-ae9a-998d493bdc99 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:12.532414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e84151b1-bd76-44ea-ae9a-998d493bdc99 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:12.534860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e84151b1-bd76-44ea-ae9a-998d493bdc99 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:12.536062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e84151b1-bd76-44ea-ae9a-998d493bdc99 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:12.537863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e84151b1-bd76-44ea-ae9a-998d493bdc99 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:12.601497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:12.929806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e84151b1-bd76-44ea-ae9a-998d493bdc99 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:12.950901 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e84151b1-bd76-44ea-ae9a-998d493bdc99 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1318 microversion: 2.1 time: 0.452276 Sep 08 13:33:12.952469 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2904/5678] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:12 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:14.001388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-118800a1-2847-4327-9979-80db54533b4c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:14.003482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-118800a1-2847-4327-9979-80db54533b4c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:14.027520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:14.032360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:14.043014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-118800a1-2847-4327-9979-80db54533b4c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:14.043882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-118800a1-2847-4327-9979-80db54533b4c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:14.047807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-118800a1-2847-4327-9979-80db54533b4c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:14.049758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-118800a1-2847-4327-9979-80db54533b4c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:14.052901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-118800a1-2847-4327-9979-80db54533b4c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:14.055524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-118800a1-2847-4327-9979-80db54533b4c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:14.340212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-118800a1-2847-4327-9979-80db54533b4c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:14.359779 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-118800a1-2847-4327-9979-80db54533b4c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1318 microversion: 2.1 time: 0.370167 Sep 08 13:33:14.361189 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2775/5679] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:13 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:15.249186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-8909db7a-6a42-43e0-9b27-e091d0f7ab85 req-36203427-e727-43ea-921a-19713d0b88f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8651bb-d64b-4cf5-a244-2cbeb4039bf7", "name": "network-vif-plugged", "status": "completed", "tag": "4e1d804f-a7e7-4f53-8d01-d8a5c2aca400"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:33:15.284555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8909db7a-6a42-43e0-9b27-e091d0f7ab85 req-36203427-e727-43ea-921a-19713d0b88f0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:15.285561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8909db7a-6a42-43e0-9b27-e091d0f7ab85 req-36203427-e727-43ea-921a-19713d0b88f0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:15.287445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8909db7a-6a42-43e0-9b27-e091d0f7ab85 req-36203427-e727-43ea-921a-19713d0b88f0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:15.336823 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-8909db7a-6a42-43e0-9b27-e091d0f7ab85 req-36203427-e727-43ea-921a-19713d0b88f0 service nova] Creating event network-vif-plugged:4e1d804f-a7e7-4f53-8d01-d8a5c2aca400 for instance fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 on n-h2-852084-10 Sep 08 13:33:15.348445 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-8909db7a-6a42-43e0-9b27-e091d0f7ab85 req-36203427-e727-43ea-921a-19713d0b88f0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.725764 Sep 08 13:33:15.350064 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2905/5680] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:33:15.393307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3a426fe6-a76c-496c-aaa6-9fd80df5fc68 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:15.394291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3a426fe6-a76c-496c-aaa6-9fd80df5fc68 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:15.411108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a426fe6-a76c-496c-aaa6-9fd80df5fc68 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:15.412362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a426fe6-a76c-496c-aaa6-9fd80df5fc68 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:15.413267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a426fe6-a76c-496c-aaa6-9fd80df5fc68 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:15.415161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a426fe6-a76c-496c-aaa6-9fd80df5fc68 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:15.416585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a426fe6-a76c-496c-aaa6-9fd80df5fc68 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:15.418025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3a426fe6-a76c-496c-aaa6-9fd80df5fc68 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:15.850755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3a426fe6-a76c-496c-aaa6-9fd80df5fc68 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:15.867506 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3a426fe6-a76c-496c-aaa6-9fd80df5fc68 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1318 microversion: 2.1 time: 0.479560 Sep 08 13:33:15.869294 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2776/5681] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:15 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1318 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:33:16.904380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eef3f2a1-c0ff-43ec-adf0-70adbde4cbba tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:16.907017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eef3f2a1-c0ff-43ec-adf0-70adbde4cbba tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:16.920810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef3f2a1-c0ff-43ec-adf0-70adbde4cbba tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:16.922299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef3f2a1-c0ff-43ec-adf0-70adbde4cbba tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:16.923567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef3f2a1-c0ff-43ec-adf0-70adbde4cbba tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:16.925612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef3f2a1-c0ff-43ec-adf0-70adbde4cbba tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:16.926882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef3f2a1-c0ff-43ec-adf0-70adbde4cbba tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:16.928264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eef3f2a1-c0ff-43ec-adf0-70adbde4cbba tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:17.859619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eef3f2a1-c0ff-43ec-adf0-70adbde4cbba tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:17.873115 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eef3f2a1-c0ff-43ec-adf0-70adbde4cbba tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1506 microversion: 2.1 time: 0.980928 Sep 08 13:33:17.874062 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2906/5682] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:16 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1506 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:22.518892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-120171611", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d81fdf75-03de-4e51-ade6-b8efc07bf25f", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "dd09c139-4c62-4afa-ac6f-48ed313685b7"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:33:22.717348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] validate_networks() for [('dd09c139-4c62-4afa-ac6f-48ed313685b7', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:33:23.421571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:33:23.422716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:33:23.423257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:33:23.423674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:33:23.424211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:33:23.438823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:23.439358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:23.439817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:23.440588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:23.441096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:23.441964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:23.486449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:33:23.495980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for user 6f65d872026946a7a6badc404b161499 and project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:33:23.531080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:33:23.534983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='d81fdf75-03de-4e51-ade6-b8efc07bf25f',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:33:23.721471 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d946135-98b9-45ce-8e23-d13350e61e3f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206624 Sep 08 13:33:23.722353 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2777/5683] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:33:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:33:23.740396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-83ce8b34-1921-4b47-b5bc-a6541e2d9d16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:23.742745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-83ce8b34-1921-4b47-b5bc-a6541e2d9d16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:23.814876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83ce8b34-1921-4b47-b5bc-a6541e2d9d16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:23.824218 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-83ce8b34-1921-4b47-b5bc-a6541e2d9d16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1056 microversion: 2.1 time: 0.090411 Sep 08 13:33:23.824942 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2907/5684] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:23 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1056 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:24.860027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2abbd886-06cf-43ce-80ab-d97e2c3ed6af tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:24.861687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2abbd886-06cf-43ce-80ab-d97e2c3ed6af tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:24.881377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2abbd886-06cf-43ce-80ab-d97e2c3ed6af tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:24.882401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2abbd886-06cf-43ce-80ab-d97e2c3ed6af tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:24.883661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2abbd886-06cf-43ce-80ab-d97e2c3ed6af tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:24.884663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2abbd886-06cf-43ce-80ab-d97e2c3ed6af tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:24.885382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2abbd886-06cf-43ce-80ab-d97e2c3ed6af tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:24.886044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2abbd886-06cf-43ce-80ab-d97e2c3ed6af tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:25.116932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2abbd886-06cf-43ce-80ab-d97e2c3ed6af tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:25.156557 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2abbd886-06cf-43ce-80ab-d97e2c3ed6af tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1052 microversion: 2.1 time: 0.300927 Sep 08 13:33:25.158734 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2778/5685] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:24 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1052 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:33:26.246921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d02fb49a-e0eb-4467-b3bd-c5e6a23a8809 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:26.248634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d02fb49a-e0eb-4467-b3bd-c5e6a23a8809 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:26.281918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d02fb49a-e0eb-4467-b3bd-c5e6a23a8809 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:26.282415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d02fb49a-e0eb-4467-b3bd-c5e6a23a8809 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:26.283066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d02fb49a-e0eb-4467-b3bd-c5e6a23a8809 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:26.294815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d02fb49a-e0eb-4467-b3bd-c5e6a23a8809 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:26.295554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d02fb49a-e0eb-4467-b3bd-c5e6a23a8809 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:26.296150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d02fb49a-e0eb-4467-b3bd-c5e6a23a8809 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:26.473266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d02fb49a-e0eb-4467-b3bd-c5e6a23a8809 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:26.485461 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d02fb49a-e0eb-4467-b3bd-c5e6a23a8809 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1126 microversion: 2.1 time: 0.296957 Sep 08 13:33:26.492692 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2908/5686] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:26 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1126 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:27.553670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-531cc753-70ef-42a4-976e-8a2cc7c905b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:27.558458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-531cc753-70ef-42a4-976e-8a2cc7c905b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:27.592268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-531cc753-70ef-42a4-976e-8a2cc7c905b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:27.592882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-531cc753-70ef-42a4-976e-8a2cc7c905b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:27.593422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-531cc753-70ef-42a4-976e-8a2cc7c905b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:27.594517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-531cc753-70ef-42a4-976e-8a2cc7c905b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:27.595187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-531cc753-70ef-42a4-976e-8a2cc7c905b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:27.595704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-531cc753-70ef-42a4-976e-8a2cc7c905b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:28.171595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-531cc753-70ef-42a4-976e-8a2cc7c905b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:28.182982 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-531cc753-70ef-42a4-976e-8a2cc7c905b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.649878 Sep 08 13:33:28.188310 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2779/5687] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:27 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:29.217740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3a7f65ac-5adf-46fc-9f81-ffb768041453 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:29.218783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3a7f65ac-5adf-46fc-9f81-ffb768041453 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:29.229430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=25 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:29.248103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a7f65ac-5adf-46fc-9f81-ffb768041453 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:29.248103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a7f65ac-5adf-46fc-9f81-ffb768041453 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:29.248561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a7f65ac-5adf-46fc-9f81-ffb768041453 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:29.252118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a7f65ac-5adf-46fc-9f81-ffb768041453 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:29.256255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a7f65ac-5adf-46fc-9f81-ffb768041453 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:29.260359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a7f65ac-5adf-46fc-9f81-ffb768041453 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:29.310286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=41 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:29.573935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3a7f65ac-5adf-46fc-9f81-ffb768041453 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:29.604680 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3a7f65ac-5adf-46fc-9f81-ffb768041453 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.395215 Sep 08 13:33:29.606884 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2909/5688] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:29 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:29.748726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-78049e05-1d28-467b-a5b8-b22e15e110a7 req-15cec984-ef22-4356-9324-801b75633877 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "899c3627-5b35-48e1-b1b6-7c4f870a934d", "tag": "6f03ab2b-887e-48b8-baaa-5b9b811fb2b5"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:33:29.797185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:29.802526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-78049e05-1d28-467b-a5b8-b22e15e110a7 req-15cec984-ef22-4356-9324-801b75633877 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:29.807088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-78049e05-1d28-467b-a5b8-b22e15e110a7 req-15cec984-ef22-4356-9324-801b75633877 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:29.810149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-78049e05-1d28-467b-a5b8-b22e15e110a7 req-15cec984-ef22-4356-9324-801b75633877 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:29.869244 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-78049e05-1d28-467b-a5b8-b22e15e110a7 req-15cec984-ef22-4356-9324-801b75633877 service nova] Creating event network-changed:6f03ab2b-887e-48b8-baaa-5b9b811fb2b5 for instance 899c3627-5b35-48e1-b1b6-7c4f870a934d on n-h1-852084-10 Sep 08 13:33:29.882193 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-78049e05-1d28-467b-a5b8-b22e15e110a7 req-15cec984-ef22-4356-9324-801b75633877 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139681 Sep 08 13:33:29.883642 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2780/5689] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:33:30.658407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f70dd31-fb3e-4cee-ae1a-2cb91e90a27c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:30.659566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8f70dd31-fb3e-4cee-ae1a-2cb91e90a27c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:30.726286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f70dd31-fb3e-4cee-ae1a-2cb91e90a27c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:30.729386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f70dd31-fb3e-4cee-ae1a-2cb91e90a27c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:30.730188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f70dd31-fb3e-4cee-ae1a-2cb91e90a27c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:30.734922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f70dd31-fb3e-4cee-ae1a-2cb91e90a27c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:30.739933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f70dd31-fb3e-4cee-ae1a-2cb91e90a27c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:30.740977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f70dd31-fb3e-4cee-ae1a-2cb91e90a27c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:31.120567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8f70dd31-fb3e-4cee-ae1a-2cb91e90a27c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:31.138123 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f70dd31-fb3e-4cee-ae1a-2cb91e90a27c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.489275 Sep 08 13:33:31.140297 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2910/5690] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:30 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:32.196840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c3464a9b-35bb-46f0-b244-baec76ee4e8c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:32.198130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c3464a9b-35bb-46f0-b244-baec76ee4e8c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:32.230898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3464a9b-35bb-46f0-b244-baec76ee4e8c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:32.235182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3464a9b-35bb-46f0-b244-baec76ee4e8c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:32.236299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3464a9b-35bb-46f0-b244-baec76ee4e8c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:32.241543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3464a9b-35bb-46f0-b244-baec76ee4e8c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:32.246230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3464a9b-35bb-46f0-b244-baec76ee4e8c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:32.250476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3464a9b-35bb-46f0-b244-baec76ee4e8c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:32.290630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=47 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:32.658231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c3464a9b-35bb-46f0-b244-baec76ee4e8c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:32.684349 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c3464a9b-35bb-46f0-b244-baec76ee4e8c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.500290 Sep 08 13:33:32.687014 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2781/5691] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:32 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:33.737401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-225c878d-020e-485d-b48e-63f8c9646bf0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:33.747862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-225c878d-020e-485d-b48e-63f8c9646bf0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:33.767991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-225c878d-020e-485d-b48e-63f8c9646bf0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:33.770587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-225c878d-020e-485d-b48e-63f8c9646bf0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:33.771888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-225c878d-020e-485d-b48e-63f8c9646bf0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:33.779881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-225c878d-020e-485d-b48e-63f8c9646bf0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:33.780969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-225c878d-020e-485d-b48e-63f8c9646bf0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:33.781845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-225c878d-020e-485d-b48e-63f8c9646bf0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:33.835645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:34.081288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-225c878d-020e-485d-b48e-63f8c9646bf0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:34.093956 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-225c878d-020e-485d-b48e-63f8c9646bf0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.365355 Sep 08 13:33:34.095326 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2911/5692] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:33 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:35.127757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44c3beda-b9f9-4f44-9421-bbae988c966d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:35.130435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-44c3beda-b9f9-4f44-9421-bbae988c966d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:35.131711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:35.136889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:33:35.147263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44c3beda-b9f9-4f44-9421-bbae988c966d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:35.148203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44c3beda-b9f9-4f44-9421-bbae988c966d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:35.149763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44c3beda-b9f9-4f44-9421-bbae988c966d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:35.150512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44c3beda-b9f9-4f44-9421-bbae988c966d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:35.151655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44c3beda-b9f9-4f44-9421-bbae988c966d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:35.152719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44c3beda-b9f9-4f44-9421-bbae988c966d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:35.404986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-44c3beda-b9f9-4f44-9421-bbae988c966d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:35.417942 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-44c3beda-b9f9-4f44-9421-bbae988c966d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.295526 Sep 08 13:33:35.431265 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2782/5693] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:35 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:36.474236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f8c196a-5acf-4db2-8c86-062413c6e98f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:36.480385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f8c196a-5acf-4db2-8c86-062413c6e98f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:36.530962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8c196a-5acf-4db2-8c86-062413c6e98f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:36.536487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8c196a-5acf-4db2-8c86-062413c6e98f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:36.538917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8c196a-5acf-4db2-8c86-062413c6e98f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:36.547345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8c196a-5acf-4db2-8c86-062413c6e98f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:36.549599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8c196a-5acf-4db2-8c86-062413c6e98f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:36.551658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f8c196a-5acf-4db2-8c86-062413c6e98f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:36.933999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f8c196a-5acf-4db2-8c86-062413c6e98f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:36.953548 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f8c196a-5acf-4db2-8c86-062413c6e98f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.502549 Sep 08 13:33:36.954341 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2912/5694] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:36 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:37.994344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6a3cb14a-4be2-4bfa-812d-701c74befcd4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:37.995917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6a3cb14a-4be2-4bfa-812d-701c74befcd4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:38.044861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a3cb14a-4be2-4bfa-812d-701c74befcd4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:38.063788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a3cb14a-4be2-4bfa-812d-701c74befcd4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:38.064600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a3cb14a-4be2-4bfa-812d-701c74befcd4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:38.068393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a3cb14a-4be2-4bfa-812d-701c74befcd4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:38.071790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a3cb14a-4be2-4bfa-812d-701c74befcd4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:38.079800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a3cb14a-4be2-4bfa-812d-701c74befcd4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:38.416709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6a3cb14a-4be2-4bfa-812d-701c74befcd4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:38.452510 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6a3cb14a-4be2-4bfa-812d-701c74befcd4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.472878 Sep 08 13:33:38.475406 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2783/5695] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:37 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:39.529524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e366baf-51bd-4332-adad-c6190f7e76ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:39.532019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6e366baf-51bd-4332-adad-c6190f7e76ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:39.546457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e366baf-51bd-4332-adad-c6190f7e76ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:39.547412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e366baf-51bd-4332-adad-c6190f7e76ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:39.548193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e366baf-51bd-4332-adad-c6190f7e76ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:39.549451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e366baf-51bd-4332-adad-c6190f7e76ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:39.550992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e366baf-51bd-4332-adad-c6190f7e76ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:39.552426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e366baf-51bd-4332-adad-c6190f7e76ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:40.148577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6e366baf-51bd-4332-adad-c6190f7e76ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:40.162040 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6e366baf-51bd-4332-adad-c6190f7e76ef tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.641113 Sep 08 13:33:40.165661 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2913/5696] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:39 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:41.198986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d4fcf7aa-2231-49fc-83bc-ec9357229394 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:41.200496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d4fcf7aa-2231-49fc-83bc-ec9357229394 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:41.214171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4fcf7aa-2231-49fc-83bc-ec9357229394 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:41.214674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4fcf7aa-2231-49fc-83bc-ec9357229394 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:41.214901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4fcf7aa-2231-49fc-83bc-ec9357229394 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:41.221078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4fcf7aa-2231-49fc-83bc-ec9357229394 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:41.222325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4fcf7aa-2231-49fc-83bc-ec9357229394 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:41.226821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4fcf7aa-2231-49fc-83bc-ec9357229394 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:41.485111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d4fcf7aa-2231-49fc-83bc-ec9357229394 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:41.498836 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d4fcf7aa-2231-49fc-83bc-ec9357229394 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.304217 Sep 08 13:33:41.500994 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2784/5697] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:41 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:42.578422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2a028ed1-63d7-45f3-9531-b691d18a8976 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:42.581683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2a028ed1-63d7-45f3-9531-b691d18a8976 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:42.602279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a028ed1-63d7-45f3-9531-b691d18a8976 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:42.604328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a028ed1-63d7-45f3-9531-b691d18a8976 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:42.605424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a028ed1-63d7-45f3-9531-b691d18a8976 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:42.607599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a028ed1-63d7-45f3-9531-b691d18a8976 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:42.609150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a028ed1-63d7-45f3-9531-b691d18a8976 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:42.610059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a028ed1-63d7-45f3-9531-b691d18a8976 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:43.013468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2a028ed1-63d7-45f3-9531-b691d18a8976 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:43.063919 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2a028ed1-63d7-45f3-9531-b691d18a8976 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.505564 Sep 08 13:33:43.066550 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2914/5698] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:42 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:44.111255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-427bc437-7b92-4bf8-a9ec-4b380d017eeb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:44.114449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-427bc437-7b92-4bf8-a9ec-4b380d017eeb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:44.130343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-427bc437-7b92-4bf8-a9ec-4b380d017eeb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:44.131401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-427bc437-7b92-4bf8-a9ec-4b380d017eeb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:44.137680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-427bc437-7b92-4bf8-a9ec-4b380d017eeb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:44.139565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-427bc437-7b92-4bf8-a9ec-4b380d017eeb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:44.140975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-427bc437-7b92-4bf8-a9ec-4b380d017eeb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:44.142207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-427bc437-7b92-4bf8-a9ec-4b380d017eeb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:44.494957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-427bc437-7b92-4bf8-a9ec-4b380d017eeb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:44.507153 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-427bc437-7b92-4bf8-a9ec-4b380d017eeb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.408640 Sep 08 13:33:44.518801 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2785/5699] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:44 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:45.545532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d279bba5-bb3a-43ef-8568-b4b14b2264b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:45.557151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d279bba5-bb3a-43ef-8568-b4b14b2264b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:45.589619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d279bba5-bb3a-43ef-8568-b4b14b2264b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:45.604611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d279bba5-bb3a-43ef-8568-b4b14b2264b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:45.606077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d279bba5-bb3a-43ef-8568-b4b14b2264b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:45.609856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d279bba5-bb3a-43ef-8568-b4b14b2264b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:45.611471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d279bba5-bb3a-43ef-8568-b4b14b2264b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:45.612895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d279bba5-bb3a-43ef-8568-b4b14b2264b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:45.953360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d279bba5-bb3a-43ef-8568-b4b14b2264b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:45.967622 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d279bba5-bb3a-43ef-8568-b4b14b2264b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.436317 Sep 08 13:33:45.969326 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2915/5700] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:45 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:47.009716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db3aac40-4c06-49e1-90aa-e90811b8230b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:47.011881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-db3aac40-4c06-49e1-90aa-e90811b8230b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:47.046184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db3aac40-4c06-49e1-90aa-e90811b8230b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:47.052906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db3aac40-4c06-49e1-90aa-e90811b8230b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:47.052906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db3aac40-4c06-49e1-90aa-e90811b8230b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:47.054844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db3aac40-4c06-49e1-90aa-e90811b8230b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:47.055721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db3aac40-4c06-49e1-90aa-e90811b8230b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:47.058701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db3aac40-4c06-49e1-90aa-e90811b8230b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:47.515586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-db3aac40-4c06-49e1-90aa-e90811b8230b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:47.573357 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-db3aac40-4c06-49e1-90aa-e90811b8230b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.566976 Sep 08 13:33:47.575263 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2786/5701] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:47 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:48.617617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c058623-e3aa-415e-92f1-ce48cec946d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:48.619910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5c058623-e3aa-415e-92f1-ce48cec946d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:48.635445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c058623-e3aa-415e-92f1-ce48cec946d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:48.636145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c058623-e3aa-415e-92f1-ce48cec946d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:48.647589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c058623-e3aa-415e-92f1-ce48cec946d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:48.649992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c058623-e3aa-415e-92f1-ce48cec946d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:48.650678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c058623-e3aa-415e-92f1-ce48cec946d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:48.651293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c058623-e3aa-415e-92f1-ce48cec946d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:48.935836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5c058623-e3aa-415e-92f1-ce48cec946d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:48.971653 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c058623-e3aa-415e-92f1-ce48cec946d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.363679 Sep 08 13:33:48.972666 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2916/5702] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:48 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:50.015106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ab8dd2f8-8c05-4878-8f08-e6979c6f8c49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:50.019555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ab8dd2f8-8c05-4878-8f08-e6979c6f8c49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:50.039930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab8dd2f8-8c05-4878-8f08-e6979c6f8c49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:50.041610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab8dd2f8-8c05-4878-8f08-e6979c6f8c49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:50.042804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab8dd2f8-8c05-4878-8f08-e6979c6f8c49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:50.047067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab8dd2f8-8c05-4878-8f08-e6979c6f8c49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:50.048914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab8dd2f8-8c05-4878-8f08-e6979c6f8c49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:50.050139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab8dd2f8-8c05-4878-8f08-e6979c6f8c49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:50.407173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ab8dd2f8-8c05-4878-8f08-e6979c6f8c49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:50.434790 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ab8dd2f8-8c05-4878-8f08-e6979c6f8c49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.428131 Sep 08 13:33:50.436359 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2787/5703] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:50 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:51.473156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b785fe8a-a8ff-4348-a56d-297660dbe691 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:51.474273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b785fe8a-a8ff-4348-a56d-297660dbe691 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:51.492769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b785fe8a-a8ff-4348-a56d-297660dbe691 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:51.497012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b785fe8a-a8ff-4348-a56d-297660dbe691 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:51.500028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b785fe8a-a8ff-4348-a56d-297660dbe691 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:51.501297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b785fe8a-a8ff-4348-a56d-297660dbe691 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:51.505572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b785fe8a-a8ff-4348-a56d-297660dbe691 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:51.510168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b785fe8a-a8ff-4348-a56d-297660dbe691 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:51.799629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b785fe8a-a8ff-4348-a56d-297660dbe691 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:51.811807 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b785fe8a-a8ff-4348-a56d-297660dbe691 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.345685 Sep 08 13:33:51.812429 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2917/5704] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:51 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:52.837172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-82491bfc-bb7f-4711-9240-cd85c3b691e2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:52.838417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-82491bfc-bb7f-4711-9240-cd85c3b691e2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:52.845830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82491bfc-bb7f-4711-9240-cd85c3b691e2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:52.846327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82491bfc-bb7f-4711-9240-cd85c3b691e2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:52.846868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82491bfc-bb7f-4711-9240-cd85c3b691e2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:52.847823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82491bfc-bb7f-4711-9240-cd85c3b691e2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:52.848448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82491bfc-bb7f-4711-9240-cd85c3b691e2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:52.849068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82491bfc-bb7f-4711-9240-cd85c3b691e2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:53.075990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-82491bfc-bb7f-4711-9240-cd85c3b691e2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:53.093678 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-82491bfc-bb7f-4711-9240-cd85c3b691e2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.260200 Sep 08 13:33:53.095385 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2788/5705] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:52 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:54.146126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-81403ba9-ebbb-4723-983f-61f8f811b8c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:54.148762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-81403ba9-ebbb-4723-983f-61f8f811b8c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:54.165060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81403ba9-ebbb-4723-983f-61f8f811b8c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:54.166418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81403ba9-ebbb-4723-983f-61f8f811b8c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:54.167587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81403ba9-ebbb-4723-983f-61f8f811b8c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:54.169505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81403ba9-ebbb-4723-983f-61f8f811b8c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:54.171152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81403ba9-ebbb-4723-983f-61f8f811b8c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:54.172903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81403ba9-ebbb-4723-983f-61f8f811b8c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:54.499740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-81403ba9-ebbb-4723-983f-61f8f811b8c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:54.535901 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-81403ba9-ebbb-4723-983f-61f8f811b8c0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.392940 Sep 08 13:33:54.547677 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2918/5706] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:54 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:55.603589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c3aeae19-2830-4fb9-8666-d48f8e0503c1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:55.607729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c3aeae19-2830-4fb9-8666-d48f8e0503c1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:55.623142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3aeae19-2830-4fb9-8666-d48f8e0503c1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:55.624621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3aeae19-2830-4fb9-8666-d48f8e0503c1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:55.625769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3aeae19-2830-4fb9-8666-d48f8e0503c1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:55.627583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3aeae19-2830-4fb9-8666-d48f8e0503c1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:55.628978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3aeae19-2830-4fb9-8666-d48f8e0503c1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:55.630495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3aeae19-2830-4fb9-8666-d48f8e0503c1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:56.054883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c3aeae19-2830-4fb9-8666-d48f8e0503c1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:56.092291 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c3aeae19-2830-4fb9-8666-d48f8e0503c1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1168 microversion: 2.1 time: 0.506918 Sep 08 13:33:56.093075 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2789/5707] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:55 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1168 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:57.124244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4cb8ae6b-0289-4d05-a14c-a05d6cf31f84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:57.128136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4cb8ae6b-0289-4d05-a14c-a05d6cf31f84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:57.144968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cb8ae6b-0289-4d05-a14c-a05d6cf31f84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:57.163768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cb8ae6b-0289-4d05-a14c-a05d6cf31f84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:57.165042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cb8ae6b-0289-4d05-a14c-a05d6cf31f84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:57.166682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cb8ae6b-0289-4d05-a14c-a05d6cf31f84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:57.169917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cb8ae6b-0289-4d05-a14c-a05d6cf31f84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:57.172928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4cb8ae6b-0289-4d05-a14c-a05d6cf31f84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:57.530334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4cb8ae6b-0289-4d05-a14c-a05d6cf31f84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:57.545674 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4cb8ae6b-0289-4d05-a14c-a05d6cf31f84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1214 microversion: 2.1 time: 0.428422 Sep 08 13:33:57.547657 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2919/5708] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:57 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1214 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:33:58.473661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5662f478-7778-423b-a3c5-29950788a30c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e57eaf3c-1154-47eb-a432-f38287f88021", "device": "/dev/sdb"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:33:58.476826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5662f478-7778-423b-a3c5-29950788a30c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:58.490778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5662f478-7778-423b-a3c5-29950788a30c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:58.492956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5662f478-7778-423b-a3c5-29950788a30c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:58.494121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5662f478-7778-423b-a3c5-29950788a30c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:58.495462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5662f478-7778-423b-a3c5-29950788a30c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:58.496329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5662f478-7778-423b-a3c5-29950788a30c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:58.497053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5662f478-7778-423b-a3c5-29950788a30c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:58.572940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0a00f867-f12e-49ba-95fc-f770df6896fb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:33:58.573930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0a00f867-f12e-49ba-95fc-f770df6896fb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:33:58.587541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a00f867-f12e-49ba-95fc-f770df6896fb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:58.588861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a00f867-f12e-49ba-95fc-f770df6896fb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:58.590921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a00f867-f12e-49ba-95fc-f770df6896fb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:58.592946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a00f867-f12e-49ba-95fc-f770df6896fb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:33:58.594059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a00f867-f12e-49ba-95fc-f770df6896fb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:33:58.594767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0a00f867-f12e-49ba-95fc-f770df6896fb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:33:59.026461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0a00f867-f12e-49ba-95fc-f770df6896fb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:33:59.048984 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0a00f867-f12e-49ba-95fc-f770df6896fb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1202 microversion: 2.1 time: 0.478946 Sep 08 13:33:59.052960 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2920/5709] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:33:58 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1202 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:33:59.170990 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5662f478-7778-423b-a3c5-29950788a30c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "POST /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.699629 Sep 08 13:33:59.175101 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2790/5710] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:33:58 2022] POST /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7/os-volume_attachments => generated 194 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:34:00.091426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-952b663a-eee9-4373-ad2e-590478ab13bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:00.092929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-952b663a-eee9-4373-ad2e-590478ab13bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:00.107125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=24 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:00.110255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-952b663a-eee9-4373-ad2e-590478ab13bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:00.111026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-952b663a-eee9-4373-ad2e-590478ab13bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:00.112130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-952b663a-eee9-4373-ad2e-590478ab13bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:00.113105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-952b663a-eee9-4373-ad2e-590478ab13bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:00.113955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-952b663a-eee9-4373-ad2e-590478ab13bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:00.114734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-952b663a-eee9-4373-ad2e-590478ab13bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:00.118980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=72 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:00.357596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-952b663a-eee9-4373-ad2e-590478ab13bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:00.369555 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-952b663a-eee9-4373-ad2e-590478ab13bd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1202 microversion: 2.1 time: 0.286804 Sep 08 13:34:00.384275 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2921/5711] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:00 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1202 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:01.412326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b62b61a4-7315-4a1f-812b-da219db9e269 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:01.415789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b62b61a4-7315-4a1f-812b-da219db9e269 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:01.431510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b62b61a4-7315-4a1f-812b-da219db9e269 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:01.433222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b62b61a4-7315-4a1f-812b-da219db9e269 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:01.434402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b62b61a4-7315-4a1f-812b-da219db9e269 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:01.436156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b62b61a4-7315-4a1f-812b-da219db9e269 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:01.436970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b62b61a4-7315-4a1f-812b-da219db9e269 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:01.438202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b62b61a4-7315-4a1f-812b-da219db9e269 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:01.723197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b62b61a4-7315-4a1f-812b-da219db9e269 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:01.735671 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b62b61a4-7315-4a1f-812b-da219db9e269 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1202 microversion: 2.1 time: 0.334884 Sep 08 13:34:01.752285 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2791/5712] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:01 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1202 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:02.776149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c3299446-17e7-459f-8b88-d3387a0c75d3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:02.779851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c3299446-17e7-459f-8b88-d3387a0c75d3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:02.803179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3299446-17e7-459f-8b88-d3387a0c75d3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:02.806692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3299446-17e7-459f-8b88-d3387a0c75d3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:02.810464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3299446-17e7-459f-8b88-d3387a0c75d3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:02.815443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3299446-17e7-459f-8b88-d3387a0c75d3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:02.816707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3299446-17e7-459f-8b88-d3387a0c75d3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:02.817832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3299446-17e7-459f-8b88-d3387a0c75d3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:03.387109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c3299446-17e7-459f-8b88-d3387a0c75d3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:03.399763 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c3299446-17e7-459f-8b88-d3387a0c75d3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1202 microversion: 2.1 time: 0.638189 Sep 08 13:34:03.401170 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2922/5713] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:02 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1202 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:04.446839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f5f237ba-d7a7-4ce1-8fe3-fe418b048fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:04.448188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f5f237ba-d7a7-4ce1-8fe3-fe418b048fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:04.464962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=24 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:04.472637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5f237ba-d7a7-4ce1-8fe3-fe418b048fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:04.474297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5f237ba-d7a7-4ce1-8fe3-fe418b048fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:04.475564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5f237ba-d7a7-4ce1-8fe3-fe418b048fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:04.477551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5f237ba-d7a7-4ce1-8fe3-fe418b048fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:04.478876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5f237ba-d7a7-4ce1-8fe3-fe418b048fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:04.480180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5f237ba-d7a7-4ce1-8fe3-fe418b048fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:04.490781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:04.868410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f5f237ba-d7a7-4ce1-8fe3-fe418b048fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:04.888930 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f5f237ba-d7a7-4ce1-8fe3-fe418b048fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1202 microversion: 2.1 time: 0.449543 Sep 08 13:34:04.890615 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2792/5714] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:04 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1202 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:05.940158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-67de4ccf-a249-44c9-a281-6a6463a278ed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:05.941822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-67de4ccf-a249-44c9-a281-6a6463a278ed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:05.968115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67de4ccf-a249-44c9-a281-6a6463a278ed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:05.969875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67de4ccf-a249-44c9-a281-6a6463a278ed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:05.972173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67de4ccf-a249-44c9-a281-6a6463a278ed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:05.976160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67de4ccf-a249-44c9-a281-6a6463a278ed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:05.978211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67de4ccf-a249-44c9-a281-6a6463a278ed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:05.981833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67de4ccf-a249-44c9-a281-6a6463a278ed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:06.499071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-67de4ccf-a249-44c9-a281-6a6463a278ed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:06.524316 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-67de4ccf-a249-44c9-a281-6a6463a278ed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1202 microversion: 2.1 time: 0.591651 Sep 08 13:34:06.531275 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2923/5715] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:05 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1202 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:07.554110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-702a9e5e-6940-413e-936d-677edc33b466 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:07.556200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-702a9e5e-6940-413e-936d-677edc33b466 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:07.589757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-702a9e5e-6940-413e-936d-677edc33b466 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:07.590764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-702a9e5e-6940-413e-936d-677edc33b466 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:07.596184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-702a9e5e-6940-413e-936d-677edc33b466 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:07.597242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-702a9e5e-6940-413e-936d-677edc33b466 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:07.598070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-702a9e5e-6940-413e-936d-677edc33b466 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:07.598525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-702a9e5e-6940-413e-936d-677edc33b466 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:07.983098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-702a9e5e-6940-413e-936d-677edc33b466 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:07.997066 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-702a9e5e-6940-413e-936d-677edc33b466 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1202 microversion: 2.1 time: 0.451428 Sep 08 13:34:08.021281 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2793/5716] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:07 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1202 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:09.033272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-abf371a4-ecca-4a8d-81d6-62c5ef684f52 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:09.034460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-abf371a4-ecca-4a8d-81d6-62c5ef684f52 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:09.051254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abf371a4-ecca-4a8d-81d6-62c5ef684f52 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:09.052648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abf371a4-ecca-4a8d-81d6-62c5ef684f52 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:09.054935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abf371a4-ecca-4a8d-81d6-62c5ef684f52 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:09.057282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abf371a4-ecca-4a8d-81d6-62c5ef684f52 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:09.059389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abf371a4-ecca-4a8d-81d6-62c5ef684f52 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:09.060781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abf371a4-ecca-4a8d-81d6-62c5ef684f52 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:09.334907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-abf371a4-ecca-4a8d-81d6-62c5ef684f52 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:09.384356 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-abf371a4-ecca-4a8d-81d6-62c5ef684f52 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1202 microversion: 2.1 time: 0.357979 Sep 08 13:34:09.388020 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2924/5717] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:09 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1202 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:10.422353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ed326b7-752f-41fd-80e7-a66aedd16ada tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:10.424009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ed326b7-752f-41fd-80e7-a66aedd16ada tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:10.441479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed326b7-752f-41fd-80e7-a66aedd16ada tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:10.442439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed326b7-752f-41fd-80e7-a66aedd16ada tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:10.443357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed326b7-752f-41fd-80e7-a66aedd16ada tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:10.444514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed326b7-752f-41fd-80e7-a66aedd16ada tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:10.445300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed326b7-752f-41fd-80e7-a66aedd16ada tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:10.448404 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ed326b7-752f-41fd-80e7-a66aedd16ada tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:10.782199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ed326b7-752f-41fd-80e7-a66aedd16ada tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:10.795692 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ed326b7-752f-41fd-80e7-a66aedd16ada tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1202 microversion: 2.1 time: 0.376955 Sep 08 13:34:10.811259 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2794/5718] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:10 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1202 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:34:11.848948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-73641981-4f16-4f0d-823f-f1d329216eb7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:11.851472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-73641981-4f16-4f0d-823f-f1d329216eb7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:11.877335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73641981-4f16-4f0d-823f-f1d329216eb7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:11.881266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73641981-4f16-4f0d-823f-f1d329216eb7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:11.889666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73641981-4f16-4f0d-823f-f1d329216eb7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:11.891507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73641981-4f16-4f0d-823f-f1d329216eb7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:11.895023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73641981-4f16-4f0d-823f-f1d329216eb7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:11.896281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-73641981-4f16-4f0d-823f-f1d329216eb7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:12.241991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-723f8061-1bc7-47cc-9977-878fcf4ef0fe req-4b04572c-78cc-4d40-82ab-74af0b413717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899c3627-5b35-48e1-b1b6-7c4f870a934d", "name": "network-vif-plugged", "status": "completed", "tag": "6f03ab2b-887e-48b8-baaa-5b9b811fb2b5"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:34:12.283006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-723f8061-1bc7-47cc-9977-878fcf4ef0fe req-4b04572c-78cc-4d40-82ab-74af0b413717 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:12.284770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-723f8061-1bc7-47cc-9977-878fcf4ef0fe req-4b04572c-78cc-4d40-82ab-74af0b413717 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:12.286570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-723f8061-1bc7-47cc-9977-878fcf4ef0fe req-4b04572c-78cc-4d40-82ab-74af0b413717 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:12.336791 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-723f8061-1bc7-47cc-9977-878fcf4ef0fe req-4b04572c-78cc-4d40-82ab-74af0b413717 service nova] Creating event network-vif-plugged:6f03ab2b-887e-48b8-baaa-5b9b811fb2b5 for instance 899c3627-5b35-48e1-b1b6-7c4f870a934d on n-h1-852084-10 Sep 08 13:34:12.354958 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-723f8061-1bc7-47cc-9977-878fcf4ef0fe req-4b04572c-78cc-4d40-82ab-74af0b413717 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119712 Sep 08 13:34:12.361858 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2795/5719] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:34:12.465466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-73641981-4f16-4f0d-823f-f1d329216eb7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:12.498355 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-73641981-4f16-4f0d-823f-f1d329216eb7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1202 microversion: 2.1 time: 0.673430 Sep 08 13:34:12.508189 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2925/5720] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:11 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1202 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:13.567107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-071b2bb8-3c9c-4d03-8b5c-d9d239daf505 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:13.573655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-071b2bb8-3c9c-4d03-8b5c-d9d239daf505 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:13.624786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-071b2bb8-3c9c-4d03-8b5c-d9d239daf505 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:13.635997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-071b2bb8-3c9c-4d03-8b5c-d9d239daf505 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:13.645138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-071b2bb8-3c9c-4d03-8b5c-d9d239daf505 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:13.649294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-071b2bb8-3c9c-4d03-8b5c-d9d239daf505 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:13.651923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-071b2bb8-3c9c-4d03-8b5c-d9d239daf505 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:13.654105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-071b2bb8-3c9c-4d03-8b5c-d9d239daf505 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:14.069769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-071b2bb8-3c9c-4d03-8b5c-d9d239daf505 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:14.091729 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-071b2bb8-3c9c-4d03-8b5c-d9d239daf505 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1202 microversion: 2.1 time: 0.554347 Sep 08 13:34:14.095712 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2796/5721] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:13 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1202 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:15.138765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-68d887d0-3059-4ae6-8aec-fc562cde5b91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:15.140649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-68d887d0-3059-4ae6-8aec-fc562cde5b91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:15.172857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68d887d0-3059-4ae6-8aec-fc562cde5b91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:15.175853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68d887d0-3059-4ae6-8aec-fc562cde5b91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:15.176760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68d887d0-3059-4ae6-8aec-fc562cde5b91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:15.184608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68d887d0-3059-4ae6-8aec-fc562cde5b91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:15.185837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68d887d0-3059-4ae6-8aec-fc562cde5b91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:15.186662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68d887d0-3059-4ae6-8aec-fc562cde5b91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:15.603872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-68d887d0-3059-4ae6-8aec-fc562cde5b91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:15.630391 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-68d887d0-3059-4ae6-8aec-fc562cde5b91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1389 microversion: 2.1 time: 0.504256 Sep 08 13:34:15.639699 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2926/5722] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:15 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1389 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:34:15.671001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-609326a2-fa9f-43d5-a50f-4d791abbf614 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:15.671880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-609326a2-fa9f-43d5-a50f-4d791abbf614 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:15.683671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-609326a2-fa9f-43d5-a50f-4d791abbf614 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:15.685832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-609326a2-fa9f-43d5-a50f-4d791abbf614 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:15.686833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-609326a2-fa9f-43d5-a50f-4d791abbf614 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:15.688493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-609326a2-fa9f-43d5-a50f-4d791abbf614 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:15.689763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-609326a2-fa9f-43d5-a50f-4d791abbf614 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:15.691350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-609326a2-fa9f-43d5-a50f-4d791abbf614 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:16.105695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-609326a2-fa9f-43d5-a50f-4d791abbf614 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:16.129050 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-609326a2-fa9f-43d5-a50f-4d791abbf614 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1389 microversion: 2.1 time: 0.461821 Sep 08 13:34:16.139611 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2797/5723] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:15 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1389 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:34:16.187653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0dec521b-962a-4f85-aabd-d0c041bfe731 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:16.187653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0dec521b-962a-4f85-aabd-d0c041bfe731 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:16.196679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0dec521b-962a-4f85-aabd-d0c041bfe731 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:16.198108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0dec521b-962a-4f85-aabd-d0c041bfe731 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:16.198893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0dec521b-962a-4f85-aabd-d0c041bfe731 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:16.200518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0dec521b-962a-4f85-aabd-d0c041bfe731 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:16.201423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0dec521b-962a-4f85-aabd-d0c041bfe731 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:16.202151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0dec521b-962a-4f85-aabd-d0c041bfe731 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:16.616943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0dec521b-962a-4f85-aabd-d0c041bfe731 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:16.653504 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0dec521b-962a-4f85-aabd-d0c041bfe731 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1389 microversion: 2.1 time: 0.482660 Sep 08 13:34:16.661641 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2927/5724] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:16 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1389 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:16.887275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9aca636e-9f56-4fc6-8475-23e5f60b7474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:16.888082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9aca636e-9f56-4fc6-8475-23e5f60b7474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:16.899586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aca636e-9f56-4fc6-8475-23e5f60b7474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:16.900364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aca636e-9f56-4fc6-8475-23e5f60b7474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:16.901018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aca636e-9f56-4fc6-8475-23e5f60b7474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:16.902009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aca636e-9f56-4fc6-8475-23e5f60b7474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:16.902615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aca636e-9f56-4fc6-8475-23e5f60b7474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:16.903254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9aca636e-9f56-4fc6-8475-23e5f60b7474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:16.949631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9aca636e-9f56-4fc6-8475-23e5f60b7474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:34:17.132303 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9aca636e-9f56-4fc6-8475-23e5f60b7474 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 204 len: 0 microversion: 2.1 time: 0.248114 Sep 08 13:34:17.134975 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2798/5725] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:34:16 2022] DELETE /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:34:17.148799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e8b8c74-7bfc-49ab-8d28-b2a6bdf5fdbc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:17.149632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9e8b8c74-7bfc-49ab-8d28-b2a6bdf5fdbc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:17.165294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e8b8c74-7bfc-49ab-8d28-b2a6bdf5fdbc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:17.168677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e8b8c74-7bfc-49ab-8d28-b2a6bdf5fdbc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:17.170159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e8b8c74-7bfc-49ab-8d28-b2a6bdf5fdbc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:17.173615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e8b8c74-7bfc-49ab-8d28-b2a6bdf5fdbc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:17.174621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e8b8c74-7bfc-49ab-8d28-b2a6bdf5fdbc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:17.180256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e8b8c74-7bfc-49ab-8d28-b2a6bdf5fdbc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:17.650303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9e8b8c74-7bfc-49ab-8d28-b2a6bdf5fdbc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:17.661354 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e8b8c74-7bfc-49ab-8d28-b2a6bdf5fdbc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1395 microversion: 2.1 time: 0.519183 Sep 08 13:34:17.676505 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2928/5726] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:17 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1395 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:18.733587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36110617-9cf9-4229-8844-9fa2fa4fa33e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:18.735985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-36110617-9cf9-4229-8844-9fa2fa4fa33e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:18.766622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36110617-9cf9-4229-8844-9fa2fa4fa33e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:18.769098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36110617-9cf9-4229-8844-9fa2fa4fa33e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:18.770283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36110617-9cf9-4229-8844-9fa2fa4fa33e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:18.773032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36110617-9cf9-4229-8844-9fa2fa4fa33e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:18.778268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36110617-9cf9-4229-8844-9fa2fa4fa33e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:18.783020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36110617-9cf9-4229-8844-9fa2fa4fa33e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:19.204241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-36110617-9cf9-4229-8844-9fa2fa4fa33e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:19.244911 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36110617-9cf9-4229-8844-9fa2fa4fa33e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1395 microversion: 2.1 time: 0.546675 Sep 08 13:34:19.259271 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2799/5727] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:18 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1395 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:20.297291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-116eafdd-c047-41c4-b2da-c56915f1d350 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:20.298106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-116eafdd-c047-41c4-b2da-c56915f1d350 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:20.311845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-116eafdd-c047-41c4-b2da-c56915f1d350 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:20.314507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-116eafdd-c047-41c4-b2da-c56915f1d350 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:20.318560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-116eafdd-c047-41c4-b2da-c56915f1d350 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:20.319584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-116eafdd-c047-41c4-b2da-c56915f1d350 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:20.320085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-116eafdd-c047-41c4-b2da-c56915f1d350 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:20.320531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-116eafdd-c047-41c4-b2da-c56915f1d350 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:20.566148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-116eafdd-c047-41c4-b2da-c56915f1d350 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:20.608643 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-116eafdd-c047-41c4-b2da-c56915f1d350 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1353 microversion: 2.1 time: 0.300838 Sep 08 13:34:20.625302 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2929/5728] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:20 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1353 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:21.660685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0c428cac-af24-4a08-8421-4c73a578c906 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:21.663091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0c428cac-af24-4a08-8421-4c73a578c906 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:21.719265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c428cac-af24-4a08-8421-4c73a578c906 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:21.732688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c428cac-af24-4a08-8421-4c73a578c906 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:21.733892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c428cac-af24-4a08-8421-4c73a578c906 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:21.738069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c428cac-af24-4a08-8421-4c73a578c906 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:21.739313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c428cac-af24-4a08-8421-4c73a578c906 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:21.740294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c428cac-af24-4a08-8421-4c73a578c906 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:22.026158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b5e2f05b-5a7d-4cc6-b485-cfe4550a7f48 req-76010971-2b56-4b78-a3b4-c233c9769302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "899c3627-5b35-48e1-b1b6-7c4f870a934d", "name": "network-vif-deleted", "tag": "6f03ab2b-887e-48b8-baaa-5b9b811fb2b5"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:34:22.086442 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0c428cac-af24-4a08-8421-4c73a578c906 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:22.109103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b5e2f05b-5a7d-4cc6-b485-cfe4550a7f48 req-76010971-2b56-4b78-a3b4-c233c9769302 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:22.111191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b5e2f05b-5a7d-4cc6-b485-cfe4550a7f48 req-76010971-2b56-4b78-a3b4-c233c9769302 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:22.112649 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0c428cac-af24-4a08-8421-4c73a578c906 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1187 microversion: 2.1 time: 0.458332 Sep 08 13:34:22.115206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b5e2f05b-5a7d-4cc6-b485-cfe4550a7f48 req-76010971-2b56-4b78-a3b4-c233c9769302 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:22.129993 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2930/5729] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:21 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1187 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:22.153059 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b5e2f05b-5a7d-4cc6-b485-cfe4550a7f48 req-76010971-2b56-4b78-a3b4-c233c9769302 service nova] Creating event network-vif-deleted:6f03ab2b-887e-48b8-baaa-5b9b811fb2b5 for instance 899c3627-5b35-48e1-b1b6-7c4f870a934d on n-h1-852084-10 Sep 08 13:34:22.164701 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b5e2f05b-5a7d-4cc6-b485-cfe4550a7f48 req-76010971-2b56-4b78-a3b4-c233c9769302 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.487668 Sep 08 13:34:22.170930 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2800/5730] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:34:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:34:23.194955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-66275419-0bfc-4b0d-bb08-80837a8dd38a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:23.195837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-66275419-0bfc-4b0d-bb08-80837a8dd38a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:23.228434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66275419-0bfc-4b0d-bb08-80837a8dd38a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:23.228952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66275419-0bfc-4b0d-bb08-80837a8dd38a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:23.229403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66275419-0bfc-4b0d-bb08-80837a8dd38a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:23.230166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66275419-0bfc-4b0d-bb08-80837a8dd38a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:23.230640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66275419-0bfc-4b0d-bb08-80837a8dd38a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:23.231081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-66275419-0bfc-4b0d-bb08-80837a8dd38a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:23.483194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-66275419-0bfc-4b0d-bb08-80837a8dd38a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:23.499030 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-66275419-0bfc-4b0d-bb08-80837a8dd38a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1187 microversion: 2.1 time: 0.325568 Sep 08 13:34:23.500388 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2931/5731] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:23 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1187 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:24.540570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c3992cac-8963-4afa-9dea-e4945c5f2d84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:24.541914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c3992cac-8963-4afa-9dea-e4945c5f2d84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:24.561408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3992cac-8963-4afa-9dea-e4945c5f2d84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:24.567708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3992cac-8963-4afa-9dea-e4945c5f2d84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:24.568285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3992cac-8963-4afa-9dea-e4945c5f2d84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:24.569074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3992cac-8963-4afa-9dea-e4945c5f2d84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:24.569709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3992cac-8963-4afa-9dea-e4945c5f2d84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:24.570160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3992cac-8963-4afa-9dea-e4945c5f2d84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:24.806094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c3992cac-8963-4afa-9dea-e4945c5f2d84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:24.826973 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c3992cac-8963-4afa-9dea-e4945c5f2d84 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1187 microversion: 2.1 time: 0.291659 Sep 08 13:34:24.830447 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2801/5732] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:24 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1187 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:25.896608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-002a1b59-7486-40f9-9917-271b8e3d4727 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:25.907893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-002a1b59-7486-40f9-9917-271b8e3d4727 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:25.959889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-002a1b59-7486-40f9-9917-271b8e3d4727 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:25.969051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-002a1b59-7486-40f9-9917-271b8e3d4727 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:25.973742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-002a1b59-7486-40f9-9917-271b8e3d4727 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:25.982007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-002a1b59-7486-40f9-9917-271b8e3d4727 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:25.984071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-002a1b59-7486-40f9-9917-271b8e3d4727 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:25.984925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-002a1b59-7486-40f9-9917-271b8e3d4727 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:26.678354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-002a1b59-7486-40f9-9917-271b8e3d4727 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:26.701858 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-002a1b59-7486-40f9-9917-271b8e3d4727 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1187 microversion: 2.1 time: 0.805685 Sep 08 13:34:26.704069 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2932/5733] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:25 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1187 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:34:27.751661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-654f1ed7-b9a3-4877-bd32-a483978d70fa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:27.752697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-654f1ed7-b9a3-4877-bd32-a483978d70fa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:27.836859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-654f1ed7-b9a3-4877-bd32-a483978d70fa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:27.837867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-654f1ed7-b9a3-4877-bd32-a483978d70fa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:27.838680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-654f1ed7-b9a3-4877-bd32-a483978d70fa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:27.840041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-654f1ed7-b9a3-4877-bd32-a483978d70fa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:27.851016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-654f1ed7-b9a3-4877-bd32-a483978d70fa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:27.851959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-654f1ed7-b9a3-4877-bd32-a483978d70fa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:28.183767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-654f1ed7-b9a3-4877-bd32-a483978d70fa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:28.221878 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-654f1ed7-b9a3-4877-bd32-a483978d70fa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1187 microversion: 2.1 time: 0.478192 Sep 08 13:34:28.224540 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2802/5734] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:27 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1187 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:29.286255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-62bb9780-d605-4ff6-8768-8e23bf3e457c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:29.291161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-62bb9780-d605-4ff6-8768-8e23bf3e457c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:29.330168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62bb9780-d605-4ff6-8768-8e23bf3e457c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:29.331059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62bb9780-d605-4ff6-8768-8e23bf3e457c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:29.331762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62bb9780-d605-4ff6-8768-8e23bf3e457c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:29.332726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62bb9780-d605-4ff6-8768-8e23bf3e457c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:29.333225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62bb9780-d605-4ff6-8768-8e23bf3e457c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:29.334042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62bb9780-d605-4ff6-8768-8e23bf3e457c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:29.623824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-62bb9780-d605-4ff6-8768-8e23bf3e457c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:29.638692 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-62bb9780-d605-4ff6-8768-8e23bf3e457c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1187 microversion: 2.1 time: 0.367974 Sep 08 13:34:29.641684 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2933/5735] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:29 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1187 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:30.671201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5a88046-07bd-4350-8060-3847bc31a8b9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:30.672906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c5a88046-07bd-4350-8060-3847bc31a8b9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:30.708787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5a88046-07bd-4350-8060-3847bc31a8b9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:30.727062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5a88046-07bd-4350-8060-3847bc31a8b9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:30.731606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5a88046-07bd-4350-8060-3847bc31a8b9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:30.734856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5a88046-07bd-4350-8060-3847bc31a8b9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:30.736309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5a88046-07bd-4350-8060-3847bc31a8b9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:30.737432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5a88046-07bd-4350-8060-3847bc31a8b9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:30.891936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c5a88046-07bd-4350-8060-3847bc31a8b9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:30.905378 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c5a88046-07bd-4350-8060-3847bc31a8b9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1187 microversion: 2.1 time: 0.240137 Sep 08 13:34:30.906010 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2803/5736] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:30 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1187 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:31.947894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3b47b6df-055f-45a4-a468-725aad0d3061 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:31.948994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3b47b6df-055f-45a4-a468-725aad0d3061 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:31.977347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=26 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:32.002080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b47b6df-055f-45a4-a468-725aad0d3061 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:32.002946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b47b6df-055f-45a4-a468-725aad0d3061 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:32.003820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b47b6df-055f-45a4-a468-725aad0d3061 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:32.007143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b47b6df-055f-45a4-a468-725aad0d3061 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:32.009962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b47b6df-055f-45a4-a468-725aad0d3061 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:32.010825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b47b6df-055f-45a4-a468-725aad0d3061 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:32.037897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=78 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:32.191878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3b47b6df-055f-45a4-a468-725aad0d3061 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:32.212434 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3b47b6df-055f-45a4-a468-725aad0d3061 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1187 microversion: 2.1 time: 0.276455 Sep 08 13:34:32.227371 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2934/5737] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:31 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1187 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:34:33.269770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:33.272260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:33.287909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:33.291307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:33.292738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:33.294352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:33.295767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:33.296838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:33.411826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:33.412735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:33.418743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:33.420514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lazy-loading 'fault' on Instance uuid 899c3627-5b35-48e1-b1b6-7c4f870a934d {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:34:33.599465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:33.632293 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d9b26760-e762-432e-b97d-14e7e8af88f6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 200 len: 1146 microversion: 2.1 time: 0.372212 Sep 08 13:34:33.637656 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2804/5738] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:33 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 1146 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:34:34.696339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3a133c3c-4152-4a08-b9eb-ac355d7d85cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:34.698142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3a133c3c-4152-4a08-b9eb-ac355d7d85cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:34.718282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a133c3c-4152-4a08-b9eb-ac355d7d85cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:34.719170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a133c3c-4152-4a08-b9eb-ac355d7d85cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:34.727741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a133c3c-4152-4a08-b9eb-ac355d7d85cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:34.728655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a133c3c-4152-4a08-b9eb-ac355d7d85cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:34.729367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a133c3c-4152-4a08-b9eb-ac355d7d85cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:34.730025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a133c3c-4152-4a08-b9eb-ac355d7d85cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:34.805882 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-3a133c3c-4152-4a08-b9eb-ac355d7d85cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3a133c3c-4152-4a08-b9eb-ac355d7d85cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d HTTP/1.1 Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '899c3627-5b35-48e1-b1b6-7c4f870a934d'} Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:34:34.807739 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:34:34.826590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:34:34.826590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:34:34.826590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:34:34.826590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:34:34.826590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:34:34.826590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:34.826590 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:34:34.826590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3a133c3c-4152-4a08-b9eb-ac355d7d85cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:34:34.826590 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3a133c3c-4152-4a08-b9eb-ac355d7d85cb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 404 len: 111 microversion: 2.1 time: 0.118320 Sep 08 13:34:34.826590 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2935/5739] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:34 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:34:36.441377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-25cd9683-5050-477c-bf20-bd501593bb06 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:36.442326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-25cd9683-5050-477c-bf20-bd501593bb06 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:36.459253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:36.461213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25cd9683-5050-477c-bf20-bd501593bb06 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:36.462393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25cd9683-5050-477c-bf20-bd501593bb06 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:36.463095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25cd9683-5050-477c-bf20-bd501593bb06 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:36.463930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25cd9683-5050-477c-bf20-bd501593bb06 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:36.464416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25cd9683-5050-477c-bf20-bd501593bb06 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:36.464848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25cd9683-5050-477c-bf20-bd501593bb06 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:36.480793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:34:36.761158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-25cd9683-5050-477c-bf20-bd501593bb06 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lazy-loading 'services' on Instance uuid fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:34:36.939997 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-25cd9683-5050-477c-bf20-bd501593bb06 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7/os-volume_attachments/e57eaf3c-1154-47eb-a432-f38287f88021" status: 202 len: 0 microversion: 2.1 time: 0.504086 Sep 08 13:34:36.940642 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2805/5740] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:34:36 2022] DELETE /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7/os-volume_attachments/e57eaf3c-1154-47eb-a432-f38287f88021 => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:34:38.335560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c22737bc-623f-4b60-838d-0032bff9c479 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:38.339570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c22737bc-623f-4b60-838d-0032bff9c479 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:38.368413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c22737bc-623f-4b60-838d-0032bff9c479 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:38.371033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c22737bc-623f-4b60-838d-0032bff9c479 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:38.372192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c22737bc-623f-4b60-838d-0032bff9c479 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:38.375445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c22737bc-623f-4b60-838d-0032bff9c479 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:38.376138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c22737bc-623f-4b60-838d-0032bff9c479 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:38.377107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c22737bc-623f-4b60-838d-0032bff9c479 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:38.397091 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-c22737bc-623f-4b60-838d-0032bff9c479 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c22737bc-623f-4b60-838d-0032bff9c479 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d HTTP/1.1 Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '899c3627-5b35-48e1-b1b6-7c4f870a934d'} Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:34:38.399098 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:34:38.404794 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:38.404794 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:34:38.404794 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:34:38.404794 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:34:38.404794 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:34:38.404794 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:34:38.404794 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:34:38.404794 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:34:38.404794 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:34:38.404794 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:38.404794 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:34:38.406817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c22737bc-623f-4b60-838d-0032bff9c479 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:34:38.408368 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c22737bc-623f-4b60-838d-0032bff9c479 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 404 len: 111 microversion: 2.1 time: 0.081598 Sep 08 13:34:38.409266 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2936/5741] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:34:38 2022] DELETE /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:34:38.423196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ed494fdd-c670-4f24-b75e-518e8880ec2d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:38.430760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ed494fdd-c670-4f24-b75e-518e8880ec2d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 899c3627-5b35-48e1-b1b6-7c4f870a934d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:38.462615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed494fdd-c670-4f24-b75e-518e8880ec2d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:38.463672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed494fdd-c670-4f24-b75e-518e8880ec2d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:38.464616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed494fdd-c670-4f24-b75e-518e8880ec2d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:38.466286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed494fdd-c670-4f24-b75e-518e8880ec2d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:38.467438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed494fdd-c670-4f24-b75e-518e8880ec2d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:38.468594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ed494fdd-c670-4f24-b75e-518e8880ec2d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:38.517485 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-ed494fdd-c670-4f24-b75e-518e8880ec2d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ed494fdd-c670-4f24-b75e-518e8880ec2d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d HTTP/1.1 Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '899c3627-5b35-48e1-b1b6-7c4f870a934d'} Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:34:38.528408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:34:38.538070 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:34:38.538070 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:34:38.538070 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:34:38.538070 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:34:38.538070 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:34:38.538070 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. Sep 08 13:34:38.538070 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:34:38.541955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ed494fdd-c670-4f24-b75e-518e8880ec2d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance 899c3627-5b35-48e1-b1b6-7c4f870a934d could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:34:38.543745 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ed494fdd-c670-4f24-b75e-518e8880ec2d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d" status: 404 len: 111 microversion: 2.1 time: 0.128553 Sep 08 13:34:38.545705 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2806/5742] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:38 2022] GET /compute/v2.1/servers/899c3627-5b35-48e1-b1b6-7c4f870a934d => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:34:45.354161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-811bb184-aae8-44d2-9a5a-29fa5e78c75d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:45.354830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-811bb184-aae8-44d2-9a5a-29fa5e78c75d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:45.362980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-811bb184-aae8-44d2-9a5a-29fa5e78c75d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:45.363649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-811bb184-aae8-44d2-9a5a-29fa5e78c75d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:45.364189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-811bb184-aae8-44d2-9a5a-29fa5e78c75d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:45.365041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-811bb184-aae8-44d2-9a5a-29fa5e78c75d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:45.365615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-811bb184-aae8-44d2-9a5a-29fa5e78c75d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:45.366198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-811bb184-aae8-44d2-9a5a-29fa5e78c75d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:45.405431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-811bb184-aae8-44d2-9a5a-29fa5e78c75d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:34:45.576118 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-811bb184-aae8-44d2-9a5a-29fa5e78c75d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 204 len: 0 microversion: 2.1 time: 0.225906 Sep 08 13:34:45.578426 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2937/5743] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:34:45 2022] DELETE /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:34:45.598276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1c898ef9-0df9-47a9-9ee7-93fda30369ca tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:45.599770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1c898ef9-0df9-47a9-9ee7-93fda30369ca tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:45.621022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c898ef9-0df9-47a9-9ee7-93fda30369ca tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:45.622363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c898ef9-0df9-47a9-9ee7-93fda30369ca tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:45.624882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c898ef9-0df9-47a9-9ee7-93fda30369ca tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:45.627297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c898ef9-0df9-47a9-9ee7-93fda30369ca tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:45.628244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c898ef9-0df9-47a9-9ee7-93fda30369ca tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:45.629024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c898ef9-0df9-47a9-9ee7-93fda30369ca tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:45.927643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1c898ef9-0df9-47a9-9ee7-93fda30369ca tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:45.952610 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1c898ef9-0df9-47a9-9ee7-93fda30369ca tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1512 microversion: 2.1 time: 0.366275 Sep 08 13:34:45.954063 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2807/5744] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:45 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1512 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:46.982078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8de2aef1-637f-4ec6-b2b1-94f969af3baa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:46.982943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8de2aef1-637f-4ec6-b2b1-94f969af3baa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:47.005397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8de2aef1-637f-4ec6-b2b1-94f969af3baa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:47.010194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8de2aef1-637f-4ec6-b2b1-94f969af3baa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:47.010863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8de2aef1-637f-4ec6-b2b1-94f969af3baa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:47.011860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8de2aef1-637f-4ec6-b2b1-94f969af3baa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:47.012342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8de2aef1-637f-4ec6-b2b1-94f969af3baa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:47.012785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8de2aef1-637f-4ec6-b2b1-94f969af3baa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:47.345530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8de2aef1-637f-4ec6-b2b1-94f969af3baa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:47.373886 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8de2aef1-637f-4ec6-b2b1-94f969af3baa tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1512 microversion: 2.1 time: 0.396473 Sep 08 13:34:47.409300 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2938/5745] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:46 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1512 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:34:48.263140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9fc7925c-e8fb-4fd7-848e-591d2e64f7b8 req-71277a46-fca9-4bb6-bc3a-ccb4d64457d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd8651bb-d64b-4cf5-a244-2cbeb4039bf7", "name": "network-vif-deleted", "tag": "4e1d804f-a7e7-4f53-8d01-d8a5c2aca400"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:34:48.280542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9fc7925c-e8fb-4fd7-848e-591d2e64f7b8 req-71277a46-fca9-4bb6-bc3a-ccb4d64457d9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:48.281566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9fc7925c-e8fb-4fd7-848e-591d2e64f7b8 req-71277a46-fca9-4bb6-bc3a-ccb4d64457d9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:48.282185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9fc7925c-e8fb-4fd7-848e-591d2e64f7b8 req-71277a46-fca9-4bb6-bc3a-ccb4d64457d9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:48.302438 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9fc7925c-e8fb-4fd7-848e-591d2e64f7b8 req-71277a46-fca9-4bb6-bc3a-ccb4d64457d9 service nova] Creating event network-vif-deleted:4e1d804f-a7e7-4f53-8d01-d8a5c2aca400 for instance fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 on n-h2-852084-10 Sep 08 13:34:48.311979 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9fc7925c-e8fb-4fd7-848e-591d2e64f7b8 req-71277a46-fca9-4bb6-bc3a-ccb4d64457d9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054440 Sep 08 13:34:48.316092 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2808/5746] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:34:48.433453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:48.434625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:48.449248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:48.450139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:48.450603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:48.451642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:48.452134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:48.452579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:48.511206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:48.512129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:48.512830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:48.513824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lazy-loading 'fault' on Instance uuid fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:34:48.594346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:34:48.604042 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e609991-2c9b-4ebc-9908-35896c856718 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 200 len: 1308 microversion: 2.1 time: 0.181983 Sep 08 13:34:48.607788 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2939/5747] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:48 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 1308 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:34:49.641380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f1710cca-0682-472f-883b-5a97e575965f tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:34:49.643662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f1710cca-0682-472f-883b-5a97e575965f tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: fd8651bb-d64b-4cf5-a244-2cbeb4039bf7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:34:49.651482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1710cca-0682-472f-883b-5a97e575965f tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:49.652379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1710cca-0682-472f-883b-5a97e575965f tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:49.653096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1710cca-0682-472f-883b-5a97e575965f tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:49.654561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1710cca-0682-472f-883b-5a97e575965f tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:34:49.655383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1710cca-0682-472f-883b-5a97e575965f tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:34:49.656049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f1710cca-0682-472f-883b-5a97e575965f tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:34:49.673697 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-f1710cca-0682-472f-883b-5a97e575965f tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] HTTP exception thrown: Instance fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 could not be found. Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f1710cca-0682-472f-883b-5a97e575965f tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Request method failure captured: Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 HTTP/1.1 Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe6hSH3Fi2Zs0UpFIgOhcpq8Xvh_tDUYdnz1llnNO6B80qYdjSTStNLLRCvTV7DZ7TEcxkTyIFMHSHa0ZHkH_n6zXzyYX7sgSe2P3tWqAInnU8qP03vPkH-zllhvVUGZnNpuwPKB0Mmm6BNpyb2IDS7wwXpIq8BfNKWfAKNxFzlDX74 Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c5137eef4e924ae7a7fd8fe51de61cd8 Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1714563036 Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c5137eef4e924ae7a7fd8fe51de61cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c5137eef4e924ae7a7fd8fe51de61cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5137eef4e924ae7a7fd8fe51de61cd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5137eef4e924ae7a7fd8fe51de61cd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-VolumesSnapshotTestJSON-1714563036 Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c5137eef4e924ae7a7fd8fe51de61cd8 Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1714563036 Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-VolumesSnapshotTestJSON-1714563036-project Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 8ea7d998c5e244199aa6a68e288d44c1 Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-VolumesSnapshotTestJSON-1714563036-project Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 could not be found. Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'fd8651bb-d64b-4cf5-a244-2cbeb4039bf7'} Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 could not be found. Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 could not be found. Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:34:49.676495 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:34:49.712777 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:34:49.712777 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:34:49.712777 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:34:49.712777 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:34:49.712777 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:34:49.712777 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 could not be found. Sep 08 13:34:49.712777 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:34:49.712777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f1710cca-0682-472f-883b-5a97e575965f tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Returning 404 to user: Instance fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:34:49.712777 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f1710cca-0682-472f-883b-5a97e575965f tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7" status: 404 len: 111 microversion: 2.1 time: 0.044129 Sep 08 13:34:49.712777 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2809/5748] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:34:49 2022] GET /compute/v2.1/servers/fd8651bb-d64b-4cf5-a244-2cbeb4039bf7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:35:00.842529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-815017418", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "52dd2454-27eb-44b4-956f-16a527d64aa7"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:35:00.868750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:00.871276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:01.031744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] validate_networks() for [('52dd2454-27eb-44b4-956f-16a527d64aa7', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:35:01.992428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:35:01.993443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:35:01.994634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:35:01.995100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:35:01.995888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:35:02.012860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:02.013707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:02.014547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:02.015895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:02.016725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:02.017481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:02.057848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Getting quotas for project c5137eef4e924ae7a7fd8fe51de61cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:35:02.071873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Getting quotas for user 8ea7d998c5e244199aa6a68e288d44c1 and project c5137eef4e924ae7a7fd8fe51de61cd8. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:35:02.106175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:35:02.110923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:35:02.216114 n-d-852084-10 devstack@n-api.service[128970]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [018e4039-7a6a-4e6b-93ca-34465946a0bf] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 13:35:03.225858 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [018e4039-7a6a-4e6b-93ca-34465946a0bf] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 42236. Sep 08 13:35:03.232703 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2d8afead-6582-4d58-892e-f4b3ab4548d7 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.394919 Sep 08 13:35:03.233904 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2940/5749] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:35:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2398 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:35:03.254683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01f8f1a5-e496-4e1e-b519-31317f49924c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:03.258129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-01f8f1a5-e496-4e1e-b519-31317f49924c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:03.284665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=9 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:03.286288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:03.405970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-01f8f1a5-e496-4e1e-b519-31317f49924c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:03.423832 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-01f8f1a5-e496-4e1e-b519-31317f49924c tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1218 microversion: 2.1 time: 0.175888 Sep 08 13:35:03.440345 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2810/5750] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:03 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1218 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:04.457614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-96ceb053-69e7-4bce-86df-eb64e3a6c038 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:04.458491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-96ceb053-69e7-4bce-86df-eb64e3a6c038 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:04.478315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96ceb053-69e7-4bce-86df-eb64e3a6c038 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:04.479773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96ceb053-69e7-4bce-86df-eb64e3a6c038 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:04.481805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96ceb053-69e7-4bce-86df-eb64e3a6c038 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:04.483328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96ceb053-69e7-4bce-86df-eb64e3a6c038 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:04.484090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96ceb053-69e7-4bce-86df-eb64e3a6c038 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:04.485062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-96ceb053-69e7-4bce-86df-eb64e3a6c038 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:04.676737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-96ceb053-69e7-4bce-86df-eb64e3a6c038 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:04.701629 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-96ceb053-69e7-4bce-86df-eb64e3a6c038 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1270 microversion: 2.1 time: 0.244415 Sep 08 13:35:04.721170 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2941/5751] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:04 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1270 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:05.750107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-878b772a-527f-4749-80dd-a11cd08efc4b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:05.752329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-878b772a-527f-4749-80dd-a11cd08efc4b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:05.767560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-878b772a-527f-4749-80dd-a11cd08efc4b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:05.768366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-878b772a-527f-4749-80dd-a11cd08efc4b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:05.769148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-878b772a-527f-4749-80dd-a11cd08efc4b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:05.770392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-878b772a-527f-4749-80dd-a11cd08efc4b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:05.771059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-878b772a-527f-4749-80dd-a11cd08efc4b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:05.772271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-878b772a-527f-4749-80dd-a11cd08efc4b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:05.866528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-878b772a-527f-4749-80dd-a11cd08efc4b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:05.879286 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-878b772a-527f-4749-80dd-a11cd08efc4b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1276 microversion: 2.1 time: 0.139673 Sep 08 13:35:05.881865 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2811/5752] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:05 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1276 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:06.927531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-72f66938-685d-4fc6-94e9-ed69be389233 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:06.930294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-72f66938-685d-4fc6-94e9-ed69be389233 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:06.939483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72f66938-685d-4fc6-94e9-ed69be389233 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:06.940316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72f66938-685d-4fc6-94e9-ed69be389233 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:06.941100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72f66938-685d-4fc6-94e9-ed69be389233 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:06.942035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72f66938-685d-4fc6-94e9-ed69be389233 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:06.942897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72f66938-685d-4fc6-94e9-ed69be389233 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:06.956315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-72f66938-685d-4fc6-94e9-ed69be389233 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:07.412577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-72f66938-685d-4fc6-94e9-ed69be389233 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:07.439485 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-72f66938-685d-4fc6-94e9-ed69be389233 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1318 microversion: 2.1 time: 0.514461 Sep 08 13:35:07.451638 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2942/5753] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:06 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1318 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:08.380877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-38329f9f-233c-42ad-94b0-cf71a0a3e931 req-75ecfa0f-c421-4f7a-8e3d-20abe7d01193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7431a659-9337-4802-8a8a-8c328bb4f8d9", "tag": "58fa93e6-6c2a-42c7-8810-9108484cc178"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:35:08.400945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-38329f9f-233c-42ad-94b0-cf71a0a3e931 req-75ecfa0f-c421-4f7a-8e3d-20abe7d01193 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:08.401654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-38329f9f-233c-42ad-94b0-cf71a0a3e931 req-75ecfa0f-c421-4f7a-8e3d-20abe7d01193 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:08.402822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-38329f9f-233c-42ad-94b0-cf71a0a3e931 req-75ecfa0f-c421-4f7a-8e3d-20abe7d01193 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:08.455167 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-38329f9f-233c-42ad-94b0-cf71a0a3e931 req-75ecfa0f-c421-4f7a-8e3d-20abe7d01193 service nova] Creating event network-changed:58fa93e6-6c2a-42c7-8810-9108484cc178 for instance 7431a659-9337-4802-8a8a-8c328bb4f8d9 on n-h1-852084-10 Sep 08 13:35:08.468759 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-38329f9f-233c-42ad-94b0-cf71a0a3e931 req-75ecfa0f-c421-4f7a-8e3d-20abe7d01193 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093909 Sep 08 13:35:08.475748 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2812/5754] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:35:08.484542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7ccbfa92-8615-4099-9fbd-16b38e6a178d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:08.485225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7ccbfa92-8615-4099-9fbd-16b38e6a178d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:08.493802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ccbfa92-8615-4099-9fbd-16b38e6a178d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:08.494200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ccbfa92-8615-4099-9fbd-16b38e6a178d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:08.494654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ccbfa92-8615-4099-9fbd-16b38e6a178d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:08.495493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ccbfa92-8615-4099-9fbd-16b38e6a178d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:08.495918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ccbfa92-8615-4099-9fbd-16b38e6a178d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:08.497001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ccbfa92-8615-4099-9fbd-16b38e6a178d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:08.829151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ccbfa92-8615-4099-9fbd-16b38e6a178d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:08.845395 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7ccbfa92-8615-4099-9fbd-16b38e6a178d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1318 microversion: 2.1 time: 0.376208 Sep 08 13:35:08.851138 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2943/5755] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:08 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:35:09.890615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dc1245f1-680b-4706-81aa-31d8e6ea14fd tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:09.891897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dc1245f1-680b-4706-81aa-31d8e6ea14fd tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:09.904323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc1245f1-680b-4706-81aa-31d8e6ea14fd tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:09.906024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc1245f1-680b-4706-81aa-31d8e6ea14fd tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:09.907156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc1245f1-680b-4706-81aa-31d8e6ea14fd tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:09.909062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc1245f1-680b-4706-81aa-31d8e6ea14fd tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:09.910886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc1245f1-680b-4706-81aa-31d8e6ea14fd tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:09.916092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc1245f1-680b-4706-81aa-31d8e6ea14fd tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:10.200681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dc1245f1-680b-4706-81aa-31d8e6ea14fd tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:10.224921 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dc1245f1-680b-4706-81aa-31d8e6ea14fd tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1318 microversion: 2.1 time: 0.343038 Sep 08 13:35:10.248672 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2813/5756] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:09 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1318 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:11.301560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79cbe8b3-d5c5-4025-a888-ccf63114f4dc tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:11.302665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-79cbe8b3-d5c5-4025-a888-ccf63114f4dc tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:11.328341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79cbe8b3-d5c5-4025-a888-ccf63114f4dc tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:11.328999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79cbe8b3-d5c5-4025-a888-ccf63114f4dc tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:11.329711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79cbe8b3-d5c5-4025-a888-ccf63114f4dc tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:11.330854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79cbe8b3-d5c5-4025-a888-ccf63114f4dc tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:11.335920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79cbe8b3-d5c5-4025-a888-ccf63114f4dc tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:11.340293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79cbe8b3-d5c5-4025-a888-ccf63114f4dc tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:11.624113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-79cbe8b3-d5c5-4025-a888-ccf63114f4dc tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:11.640691 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-79cbe8b3-d5c5-4025-a888-ccf63114f4dc tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1318 microversion: 2.1 time: 0.346531 Sep 08 13:35:11.642237 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2944/5757] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:11 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:12.682988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-815b5366-522b-4acc-91e8-76fecc3489db tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:12.687715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-815b5366-522b-4acc-91e8-76fecc3489db tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:12.721513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-815b5366-522b-4acc-91e8-76fecc3489db tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:12.728301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-815b5366-522b-4acc-91e8-76fecc3489db tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:12.729713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-815b5366-522b-4acc-91e8-76fecc3489db tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:12.730558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-815b5366-522b-4acc-91e8-76fecc3489db tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:12.731565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-815b5366-522b-4acc-91e8-76fecc3489db tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:12.732345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-815b5366-522b-4acc-91e8-76fecc3489db tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:13.197711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-815b5366-522b-4acc-91e8-76fecc3489db tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:13.213405 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-815b5366-522b-4acc-91e8-76fecc3489db tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1318 microversion: 2.1 time: 0.545102 Sep 08 13:35:13.215513 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2814/5758] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:12 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1318 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:14.283270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b42b2730-c3d5-4a96-8daf-fe5975011ef3 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:14.284443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b42b2730-c3d5-4a96-8daf-fe5975011ef3 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:14.292178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:14.296621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:14.318329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b42b2730-c3d5-4a96-8daf-fe5975011ef3 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:14.319766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b42b2730-c3d5-4a96-8daf-fe5975011ef3 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:14.320625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b42b2730-c3d5-4a96-8daf-fe5975011ef3 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:14.323207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b42b2730-c3d5-4a96-8daf-fe5975011ef3 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:14.326715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b42b2730-c3d5-4a96-8daf-fe5975011ef3 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:14.327652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b42b2730-c3d5-4a96-8daf-fe5975011ef3 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:14.631359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b42b2730-c3d5-4a96-8daf-fe5975011ef3 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:14.644540 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b42b2730-c3d5-4a96-8daf-fe5975011ef3 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1318 microversion: 2.1 time: 0.368987 Sep 08 13:35:14.645825 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2945/5759] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:14 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:14.907285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-8a3d96d9-1c88-4ae2-b422-5debfb3257c9 req-83e33f3e-3886-4244-a490-4f9df1f80ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7431a659-9337-4802-8a8a-8c328bb4f8d9", "name": "network-vif-plugged", "status": "completed", "tag": "58fa93e6-6c2a-42c7-8810-9108484cc178"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:35:14.916165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:14.930903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8a3d96d9-1c88-4ae2-b422-5debfb3257c9 req-83e33f3e-3886-4244-a490-4f9df1f80ab6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:14.932533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8a3d96d9-1c88-4ae2-b422-5debfb3257c9 req-83e33f3e-3886-4244-a490-4f9df1f80ab6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:14.939498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8a3d96d9-1c88-4ae2-b422-5debfb3257c9 req-83e33f3e-3886-4244-a490-4f9df1f80ab6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:14.964282 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-8a3d96d9-1c88-4ae2-b422-5debfb3257c9 req-83e33f3e-3886-4244-a490-4f9df1f80ab6 service nova] Creating event network-vif-plugged:58fa93e6-6c2a-42c7-8810-9108484cc178 for instance 7431a659-9337-4802-8a8a-8c328bb4f8d9 on n-h1-852084-10 Sep 08 13:35:14.977097 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-8a3d96d9-1c88-4ae2-b422-5debfb3257c9 req-83e33f3e-3886-4244-a490-4f9df1f80ab6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074521 Sep 08 13:35:14.980008 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2815/5760] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:35:15.689207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3c95eb4f-05ab-4ace-944a-a0140fa469c8 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:15.690849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3c95eb4f-05ab-4ace-944a-a0140fa469c8 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:15.720429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c95eb4f-05ab-4ace-944a-a0140fa469c8 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:15.721336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c95eb4f-05ab-4ace-944a-a0140fa469c8 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:15.722166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c95eb4f-05ab-4ace-944a-a0140fa469c8 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:15.723679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c95eb4f-05ab-4ace-944a-a0140fa469c8 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:15.725455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c95eb4f-05ab-4ace-944a-a0140fa469c8 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:15.726710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c95eb4f-05ab-4ace-944a-a0140fa469c8 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:16.051018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3c95eb4f-05ab-4ace-944a-a0140fa469c8 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:16.070482 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3c95eb4f-05ab-4ace-944a-a0140fa469c8 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1318 microversion: 2.1 time: 0.388741 Sep 08 13:35:16.072778 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2946/5761] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:15 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:17.133390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5068ab49-38b7-4f27-b439-fccdfa153e07 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:17.138219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5068ab49-38b7-4f27-b439-fccdfa153e07 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:17.187672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5068ab49-38b7-4f27-b439-fccdfa153e07 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:17.189187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5068ab49-38b7-4f27-b439-fccdfa153e07 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:17.190242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5068ab49-38b7-4f27-b439-fccdfa153e07 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:17.192183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5068ab49-38b7-4f27-b439-fccdfa153e07 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:17.193537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5068ab49-38b7-4f27-b439-fccdfa153e07 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:17.194694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5068ab49-38b7-4f27-b439-fccdfa153e07 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:17.556462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5068ab49-38b7-4f27-b439-fccdfa153e07 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:17.577531 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5068ab49-38b7-4f27-b439-fccdfa153e07 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1506 microversion: 2.1 time: 0.464844 Sep 08 13:35:17.578641 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2816/5762] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:17 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:17.613523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6578197-599c-4179-b03c-8821991f52e9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e09302d-9717-4a6c-9e21-18ba3ae119eb", "device": "/dev/sdb"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:35:17.621661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f6578197-599c-4179-b03c-8821991f52e9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:17.641859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6578197-599c-4179-b03c-8821991f52e9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:17.643469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6578197-599c-4179-b03c-8821991f52e9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:17.644930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6578197-599c-4179-b03c-8821991f52e9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:17.646975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6578197-599c-4179-b03c-8821991f52e9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:17.648108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6578197-599c-4179-b03c-8821991f52e9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:17.649386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6578197-599c-4179-b03c-8821991f52e9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:18.055324 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f6578197-599c-4179-b03c-8821991f52e9 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "POST /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.450705 Sep 08 13:35:18.056442 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2947/5763] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:35:17 2022] POST /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9/os-volume_attachments => generated 194 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:35:24.103755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1506231633", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "265bf528-804c-47f7-b2f2-f09cd27783af", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "dd09c139-4c62-4afa-ac6f-48ed313685b7"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:35:24.586956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] validate_networks() for [('dd09c139-4c62-4afa-ac6f-48ed313685b7', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:35:25.241301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:35:25.242362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:35:25.242362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:35:25.242796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:35:25.243406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:35:25.254084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:25.254819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:25.255475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:25.256672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:25.257303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:25.257903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:25.277270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:35:25.284650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for user 6f65d872026946a7a6badc404b161499 and project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:35:25.382712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:35:25.385852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='265bf528-804c-47f7-b2f2-f09cd27783af',volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:35:25.712157 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0594f9df-b0df-4e19-84be-5565975f4cb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.618288 Sep 08 13:35:25.722479 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2817/5764] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:35:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:35:25.752727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e8db0ee-3355-47f2-8434-a9e63f294666 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:25.760439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e8db0ee-3355-47f2-8434-a9e63f294666 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:26.116647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e8db0ee-3355-47f2-8434-a9e63f294666 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:26.130264 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e8db0ee-3355-47f2-8434-a9e63f294666 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1071 microversion: 2.1 time: 0.405013 Sep 08 13:35:26.137783 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2948/5765] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:25 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1071 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:27.184735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-67cd4937-fca8-4536-9908-afe788d2f70c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:27.185532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-67cd4937-fca8-4536-9908-afe788d2f70c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:27.208006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67cd4937-fca8-4536-9908-afe788d2f70c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:27.208674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67cd4937-fca8-4536-9908-afe788d2f70c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:27.209156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67cd4937-fca8-4536-9908-afe788d2f70c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:27.209906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67cd4937-fca8-4536-9908-afe788d2f70c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:27.211459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67cd4937-fca8-4536-9908-afe788d2f70c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:27.212303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67cd4937-fca8-4536-9908-afe788d2f70c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:27.711418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-67cd4937-fca8-4536-9908-afe788d2f70c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:27.742339 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-67cd4937-fca8-4536-9908-afe788d2f70c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1113 microversion: 2.1 time: 0.562370 Sep 08 13:35:27.746525 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2818/5766] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:27 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1113 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:28.784400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0d500d12-1b32-4db6-9d88-78882eae722c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:28.785962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0d500d12-1b32-4db6-9d88-78882eae722c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:28.802077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:28.823816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d500d12-1b32-4db6-9d88-78882eae722c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:28.824795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d500d12-1b32-4db6-9d88-78882eae722c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:28.826946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d500d12-1b32-4db6-9d88-78882eae722c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:28.828999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d500d12-1b32-4db6-9d88-78882eae722c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:28.832978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d500d12-1b32-4db6-9d88-78882eae722c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:28.834360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d500d12-1b32-4db6-9d88-78882eae722c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:28.986470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0d500d12-1b32-4db6-9d88-78882eae722c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:29.028787 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0d500d12-1b32-4db6-9d88-78882eae722c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1187 microversion: 2.1 time: 0.246500 Sep 08 13:35:29.033470 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2949/5767] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:28 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1187 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:30.088516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aa2a1b9f-1c01-4a08-a31f-bacb21270808 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:30.095204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-aa2a1b9f-1c01-4a08-a31f-bacb21270808 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:30.119120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa2a1b9f-1c01-4a08-a31f-bacb21270808 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:30.119909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa2a1b9f-1c01-4a08-a31f-bacb21270808 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:30.120544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa2a1b9f-1c01-4a08-a31f-bacb21270808 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:30.121625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa2a1b9f-1c01-4a08-a31f-bacb21270808 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:30.122303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa2a1b9f-1c01-4a08-a31f-bacb21270808 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:30.122928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa2a1b9f-1c01-4a08-a31f-bacb21270808 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:30.665076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-aa2a1b9f-1c01-4a08-a31f-bacb21270808 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:30.699380 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-aa2a1b9f-1c01-4a08-a31f-bacb21270808 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1229 microversion: 2.1 time: 0.621156 Sep 08 13:35:30.699380 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2819/5768] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:30 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1229 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:31.749586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26f09780-91c5-4cc4-9298-245a50fbb2a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:31.754682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-26f09780-91c5-4cc4-9298-245a50fbb2a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:31.777938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:31.842383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26f09780-91c5-4cc4-9298-245a50fbb2a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:31.850199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26f09780-91c5-4cc4-9298-245a50fbb2a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:31.851253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26f09780-91c5-4cc4-9298-245a50fbb2a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:31.852466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26f09780-91c5-4cc4-9298-245a50fbb2a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:31.864317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26f09780-91c5-4cc4-9298-245a50fbb2a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:31.864779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26f09780-91c5-4cc4-9298-245a50fbb2a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:32.293821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-76ae2ad2-7274-45ed-bc2a-925b7b9b3f99 req-a59fd6ab-7d02-4a07-8e75-f32e62ac3628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0de350-5a12-4cf5-baed-833edfbaafe1", "tag": "05a481cf-f474-46f7-a0e3-632a64ed95e1"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:35:32.364679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-76ae2ad2-7274-45ed-bc2a-925b7b9b3f99 req-a59fd6ab-7d02-4a07-8e75-f32e62ac3628 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:32.365810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-76ae2ad2-7274-45ed-bc2a-925b7b9b3f99 req-a59fd6ab-7d02-4a07-8e75-f32e62ac3628 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:32.371907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-76ae2ad2-7274-45ed-bc2a-925b7b9b3f99 req-a59fd6ab-7d02-4a07-8e75-f32e62ac3628 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:32.417765 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-76ae2ad2-7274-45ed-bc2a-925b7b9b3f99 req-a59fd6ab-7d02-4a07-8e75-f32e62ac3628 service nova] Creating event network-changed:05a481cf-f474-46f7-a0e3-632a64ed95e1 for instance fa0de350-5a12-4cf5-baed-833edfbaafe1 on n-h2-852084-10 Sep 08 13:35:32.460742 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-76ae2ad2-7274-45ed-bc2a-925b7b9b3f99 req-a59fd6ab-7d02-4a07-8e75-f32e62ac3628 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.174955 Sep 08 13:35:32.469947 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2820/5769] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:35:32.930878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26f09780-91c5-4cc4-9298-245a50fbb2a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:32.952320 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-26f09780-91c5-4cc4-9298-245a50fbb2a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1229 microversion: 2.1 time: 1.217130 Sep 08 13:35:32.954159 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2950/5770] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:31 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1229 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:34.001169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c223ab05-bdcd-420f-adc4-7d118a58cdfb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:34.002294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c223ab05-bdcd-420f-adc4-7d118a58cdfb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:34.050084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:34.081091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c223ab05-bdcd-420f-adc4-7d118a58cdfb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:34.081994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c223ab05-bdcd-420f-adc4-7d118a58cdfb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:34.082813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c223ab05-bdcd-420f-adc4-7d118a58cdfb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:34.086432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c223ab05-bdcd-420f-adc4-7d118a58cdfb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:34.086432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c223ab05-bdcd-420f-adc4-7d118a58cdfb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:34.087659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c223ab05-bdcd-420f-adc4-7d118a58cdfb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:34.201803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=45 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:34.814519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c223ab05-bdcd-420f-adc4-7d118a58cdfb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:34.876546 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c223ab05-bdcd-420f-adc4-7d118a58cdfb tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1229 microversion: 2.1 time: 0.884444 Sep 08 13:35:34.881276 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2821/5771] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:33 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1229 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:36.125358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26a9135e-3490-4393-947c-3e642e33f546 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:36.126928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-26a9135e-3490-4393-947c-3e642e33f546 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:36.137023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:36.140874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26a9135e-3490-4393-947c-3e642e33f546 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:36.142026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26a9135e-3490-4393-947c-3e642e33f546 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:36.142682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26a9135e-3490-4393-947c-3e642e33f546 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:36.144137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26a9135e-3490-4393-947c-3e642e33f546 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:36.145164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26a9135e-3490-4393-947c-3e642e33f546 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:36.145854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26a9135e-3490-4393-947c-3e642e33f546 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:36.469512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26a9135e-3490-4393-947c-3e642e33f546 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:36.504273 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-26a9135e-3490-4393-947c-3e642e33f546 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1229 microversion: 2.1 time: 0.585849 Sep 08 13:35:36.505845 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2951/5772] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:35 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1229 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:37.589710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c0d24cf5-d0d8-45cd-a25e-48b7a2e580c3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:37.593618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c0d24cf5-d0d8-45cd-a25e-48b7a2e580c3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:37.607007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:37.622271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:35:37.624722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0d24cf5-d0d8-45cd-a25e-48b7a2e580c3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:37.626411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0d24cf5-d0d8-45cd-a25e-48b7a2e580c3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:37.626655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0d24cf5-d0d8-45cd-a25e-48b7a2e580c3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:37.628360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0d24cf5-d0d8-45cd-a25e-48b7a2e580c3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:37.629550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0d24cf5-d0d8-45cd-a25e-48b7a2e580c3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:37.630432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0d24cf5-d0d8-45cd-a25e-48b7a2e580c3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:37.953770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c0d24cf5-d0d8-45cd-a25e-48b7a2e580c3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:37.970782 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c0d24cf5-d0d8-45cd-a25e-48b7a2e580c3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1217 microversion: 2.1 time: 0.397529 Sep 08 13:35:37.984750 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2822/5773] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:37 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1217 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:39.022724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0769ee28-62a1-4c00-85ed-ba4d2b3df33a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:39.024630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0769ee28-62a1-4c00-85ed-ba4d2b3df33a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:39.038645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0769ee28-62a1-4c00-85ed-ba4d2b3df33a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:39.039343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0769ee28-62a1-4c00-85ed-ba4d2b3df33a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:39.040835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0769ee28-62a1-4c00-85ed-ba4d2b3df33a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:39.042381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0769ee28-62a1-4c00-85ed-ba4d2b3df33a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:39.043719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0769ee28-62a1-4c00-85ed-ba4d2b3df33a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:39.046164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0769ee28-62a1-4c00-85ed-ba4d2b3df33a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:39.281605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0769ee28-62a1-4c00-85ed-ba4d2b3df33a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:39.296288 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0769ee28-62a1-4c00-85ed-ba4d2b3df33a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1217 microversion: 2.1 time: 0.285690 Sep 08 13:35:39.297960 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2952/5774] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:39 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1217 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:40.337361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-026e8cef-aeed-4df9-9794-5a63f7522eb5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:40.338332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-026e8cef-aeed-4df9-9794-5a63f7522eb5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:40.357769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-026e8cef-aeed-4df9-9794-5a63f7522eb5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:40.364832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-026e8cef-aeed-4df9-9794-5a63f7522eb5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:40.366109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-026e8cef-aeed-4df9-9794-5a63f7522eb5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:40.370691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-026e8cef-aeed-4df9-9794-5a63f7522eb5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:40.375985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-026e8cef-aeed-4df9-9794-5a63f7522eb5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:40.377362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-026e8cef-aeed-4df9-9794-5a63f7522eb5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:40.657123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-026e8cef-aeed-4df9-9794-5a63f7522eb5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:40.672037 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-026e8cef-aeed-4df9-9794-5a63f7522eb5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1217 microversion: 2.1 time: 0.343135 Sep 08 13:35:40.687270 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2823/5775] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:40 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1217 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:35:41.712271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-46c8550c-7cfc-4c33-8dcb-c789fc63f359 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:41.713106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-46c8550c-7cfc-4c33-8dcb-c789fc63f359 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:41.720797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46c8550c-7cfc-4c33-8dcb-c789fc63f359 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:41.721578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46c8550c-7cfc-4c33-8dcb-c789fc63f359 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:41.722219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46c8550c-7cfc-4c33-8dcb-c789fc63f359 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:41.723401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46c8550c-7cfc-4c33-8dcb-c789fc63f359 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:41.724112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46c8550c-7cfc-4c33-8dcb-c789fc63f359 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:41.724585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46c8550c-7cfc-4c33-8dcb-c789fc63f359 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:42.036161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-46c8550c-7cfc-4c33-8dcb-c789fc63f359 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:42.106486 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-46c8550c-7cfc-4c33-8dcb-c789fc63f359 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1217 microversion: 2.1 time: 0.388964 Sep 08 13:35:42.130337 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2953/5776] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:41 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1217 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:43.151566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7a1043c2-d5da-4efa-9377-a642eccd5d6c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:43.152230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7a1043c2-d5da-4efa-9377-a642eccd5d6c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:43.165366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a1043c2-d5da-4efa-9377-a642eccd5d6c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:43.166675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a1043c2-d5da-4efa-9377-a642eccd5d6c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:43.167136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a1043c2-d5da-4efa-9377-a642eccd5d6c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:43.168462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a1043c2-d5da-4efa-9377-a642eccd5d6c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:43.169157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a1043c2-d5da-4efa-9377-a642eccd5d6c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:43.169776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a1043c2-d5da-4efa-9377-a642eccd5d6c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:43.566662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7a1043c2-d5da-4efa-9377-a642eccd5d6c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:43.601731 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7a1043c2-d5da-4efa-9377-a642eccd5d6c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1217 microversion: 2.1 time: 0.449763 Sep 08 13:35:43.604789 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2824/5777] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:43 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1217 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:44.648724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-930f5a16-973a-49e6-8f08-a4fac649a796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:44.649539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-930f5a16-973a-49e6-8f08-a4fac649a796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:44.670088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-930f5a16-973a-49e6-8f08-a4fac649a796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:44.671042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-930f5a16-973a-49e6-8f08-a4fac649a796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:44.671804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-930f5a16-973a-49e6-8f08-a4fac649a796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:44.672973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-930f5a16-973a-49e6-8f08-a4fac649a796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:44.673732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-930f5a16-973a-49e6-8f08-a4fac649a796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:44.674416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-930f5a16-973a-49e6-8f08-a4fac649a796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:44.951090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-930f5a16-973a-49e6-8f08-a4fac649a796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:44.960926 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-930f5a16-973a-49e6-8f08-a4fac649a796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1217 microversion: 2.1 time: 0.317292 Sep 08 13:35:44.980054 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2954/5778] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:44 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1217 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:46.002264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44b05897-1e78-4c09-927a-910761d8c2b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:46.006913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-44b05897-1e78-4c09-927a-910761d8c2b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:46.026882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b05897-1e78-4c09-927a-910761d8c2b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:46.030018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b05897-1e78-4c09-927a-910761d8c2b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:46.031192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b05897-1e78-4c09-927a-910761d8c2b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:46.032898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b05897-1e78-4c09-927a-910761d8c2b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:46.037406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b05897-1e78-4c09-927a-910761d8c2b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:46.037689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44b05897-1e78-4c09-927a-910761d8c2b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:46.295435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-44b05897-1e78-4c09-927a-910761d8c2b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:46.314369 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-44b05897-1e78-4c09-927a-910761d8c2b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1217 microversion: 2.1 time: 0.328504 Sep 08 13:35:46.324135 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2825/5779] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:45 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1217 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:35:47.362325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e80d630-a98f-400b-826e-c186d21a1650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:47.363197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e80d630-a98f-400b-826e-c186d21a1650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:47.375837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e80d630-a98f-400b-826e-c186d21a1650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:47.376351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e80d630-a98f-400b-826e-c186d21a1650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:47.376794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e80d630-a98f-400b-826e-c186d21a1650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:47.382312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e80d630-a98f-400b-826e-c186d21a1650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:47.382834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e80d630-a98f-400b-826e-c186d21a1650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:47.383316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e80d630-a98f-400b-826e-c186d21a1650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:47.386362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-53e49ff7-05d5-46b4-889b-10d322f16226 req-1486d76a-7615-409b-a8ee-f9ca6b679da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0de350-5a12-4cf5-baed-833edfbaafe1", "name": "network-vif-plugged", "status": "completed", "tag": "05a481cf-f474-46f7-a0e3-632a64ed95e1"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:35:47.448088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-53e49ff7-05d5-46b4-889b-10d322f16226 req-1486d76a-7615-409b-a8ee-f9ca6b679da3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:47.455968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-53e49ff7-05d5-46b4-889b-10d322f16226 req-1486d76a-7615-409b-a8ee-f9ca6b679da3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:47.457444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-53e49ff7-05d5-46b4-889b-10d322f16226 req-1486d76a-7615-409b-a8ee-f9ca6b679da3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:47.508887 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-53e49ff7-05d5-46b4-889b-10d322f16226 req-1486d76a-7615-409b-a8ee-f9ca6b679da3 service nova] Creating event network-vif-plugged:05a481cf-f474-46f7-a0e3-632a64ed95e1 for instance fa0de350-5a12-4cf5-baed-833edfbaafe1 on n-h2-852084-10 Sep 08 13:35:47.515492 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-53e49ff7-05d5-46b4-889b-10d322f16226 req-1486d76a-7615-409b-a8ee-f9ca6b679da3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.141846 Sep 08 13:35:47.520715 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2826/5780] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:35:47.778032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e80d630-a98f-400b-826e-c186d21a1650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:47.790739 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e80d630-a98f-400b-826e-c186d21a1650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1217 microversion: 2.1 time: 0.432001 Sep 08 13:35:47.791858 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2955/5781] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:47 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1217 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:48.823016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8dd9ada6-f30a-473b-8329-ed014a8f9a0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:48.824244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8dd9ada6-f30a-473b-8329-ed014a8f9a0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:48.837689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dd9ada6-f30a-473b-8329-ed014a8f9a0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:48.838204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dd9ada6-f30a-473b-8329-ed014a8f9a0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:48.838763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dd9ada6-f30a-473b-8329-ed014a8f9a0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:48.839516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dd9ada6-f30a-473b-8329-ed014a8f9a0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:48.841032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dd9ada6-f30a-473b-8329-ed014a8f9a0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:48.842194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8dd9ada6-f30a-473b-8329-ed014a8f9a0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:49.201230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8dd9ada6-f30a-473b-8329-ed014a8f9a0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:49.223559 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8dd9ada6-f30a-473b-8329-ed014a8f9a0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1217 microversion: 2.1 time: 0.408262 Sep 08 13:35:49.226447 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2827/5782] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:48 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1217 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:50.280838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6cebfe04-d848-4020-bab2-afc0f807e4d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:50.283385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6cebfe04-d848-4020-bab2-afc0f807e4d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:50.310509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6cebfe04-d848-4020-bab2-afc0f807e4d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:50.316642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6cebfe04-d848-4020-bab2-afc0f807e4d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:50.317552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6cebfe04-d848-4020-bab2-afc0f807e4d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:50.320348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6cebfe04-d848-4020-bab2-afc0f807e4d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:50.320613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6cebfe04-d848-4020-bab2-afc0f807e4d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:50.321029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6cebfe04-d848-4020-bab2-afc0f807e4d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:50.653732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6cebfe04-d848-4020-bab2-afc0f807e4d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:50.680138 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6cebfe04-d848-4020-bab2-afc0f807e4d2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1405 microversion: 2.1 time: 0.406148 Sep 08 13:35:50.732230 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2956/5783] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:50 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:50.782728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b25b1e89-d088-4521-ba46-d6b34d5d3795 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:50.787460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b25b1e89-d088-4521-ba46-d6b34d5d3795 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:50.819198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25b1e89-d088-4521-ba46-d6b34d5d3795 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:50.819980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25b1e89-d088-4521-ba46-d6b34d5d3795 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:50.820538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25b1e89-d088-4521-ba46-d6b34d5d3795 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:50.821619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25b1e89-d088-4521-ba46-d6b34d5d3795 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:50.823641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25b1e89-d088-4521-ba46-d6b34d5d3795 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:50.825273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b25b1e89-d088-4521-ba46-d6b34d5d3795 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:51.024385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b25b1e89-d088-4521-ba46-d6b34d5d3795 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:51.042003 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b25b1e89-d088-4521-ba46-d6b34d5d3795 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1405 microversion: 2.1 time: 0.272061 Sep 08 13:35:51.059277 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2828/5784] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:50 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1405 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:51.120878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c01c9a17-7796-417e-888e-d82a939490d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-330001931"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:35:51.139271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c01c9a17-7796-417e-888e-d82a939490d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:51.176022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c01c9a17-7796-417e-888e-d82a939490d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:51.176945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c01c9a17-7796-417e-888e-d82a939490d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:51.178342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c01c9a17-7796-417e-888e-d82a939490d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:51.183572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c01c9a17-7796-417e-888e-d82a939490d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:51.184868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c01c9a17-7796-417e-888e-d82a939490d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:51.188462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c01c9a17-7796-417e-888e-d82a939490d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:51.399680 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.compute.api [None req-c01c9a17-7796-417e-888e-d82a939490d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Attempting to quiesce instance before volume snapshot. Sep 08 13:35:51.466154 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.compute.api [None req-c01c9a17-7796-417e-888e-d82a939490d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Sep 08 13:35:51.664974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c01c9a17-7796-417e-888e-d82a939490d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Creating snapshot from volume 265bf528-804c-47f7-b2f2-f09cd27783af. {{(pid=128970) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Sep 08 13:35:53.582367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-82c54270-0076-4266-ada9-cf714f3ae07e tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:53.583282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-82c54270-0076-4266-ada9-cf714f3ae07e tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:53.608287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82c54270-0076-4266-ada9-cf714f3ae07e tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:53.609275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82c54270-0076-4266-ada9-cf714f3ae07e tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:53.609832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82c54270-0076-4266-ada9-cf714f3ae07e tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:53.611068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82c54270-0076-4266-ada9-cf714f3ae07e tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:53.612003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82c54270-0076-4266-ada9-cf714f3ae07e tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:53.612873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-82c54270-0076-4266-ada9-cf714f3ae07e tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:53.828775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-82c54270-0076-4266-ada9-cf714f3ae07e tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lazy-loading 'services' on Instance uuid 7431a659-9337-4802-8a8a-8c328bb4f8d9 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:35:54.060551 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c01c9a17-7796-417e-888e-d82a939490d1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "POST /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1/action" status: 202 len: 0 microversion: 2.1 time: 2.903716 Sep 08 13:35:54.081585 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2957/5785] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:35:51 2022] POST /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1/action => generated 0 bytes in 2969 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 13:35:54.097870 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-82c54270-0076-4266-ada9-cf714f3ae07e tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9/os-volume_attachments/1e09302d-9717-4a6c-9e21-18ba3ae119eb" status: 202 len: 0 microversion: 2.1 time: 0.522986 Sep 08 13:35:54.100705 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2829/5786] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:35:53 2022] DELETE /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9/os-volume_attachments/1e09302d-9717-4a6c-9e21-18ba3ae119eb => generated 0 bytes in 527 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:35:55.524752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-535865516", "imageRef": "1576738d-f1f8-4b55-97a6-82dce2456c4c", "flavorRef": "452", "networks": [{"uuid": "dd09c139-4c62-4afa-ac6f-48ed313685b7"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:35:55.629479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] validate_networks() for [('dd09c139-4c62-4afa-ac6f-48ed313685b7', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:35:56.532030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:35:56.533086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:35:56.533773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:35:56.534506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:35:56.535248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:35:56.553042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:56.554089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:56.555171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:56.556914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:56.557989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:56.558532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:56.587425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:35:56.594025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for user 6f65d872026946a7a6badc404b161499 and project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:35:56.614808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:35:56.620030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='22cfe2d2-b519-4ef9-8dff-71cd9ec334a1',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:35:56.753072 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dfc661ce-8ec2-43e9-b536-69bed4a6713b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.245195 Sep 08 13:35:56.757408 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2958/5787] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:35:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:35:56.781714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-87b45371-8ac2-40b5-a894-dd828689c3ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:56.787394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-87b45371-8ac2-40b5-a894-dd828689c3ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:56.972905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-87b45371-8ac2-40b5-a894-dd828689c3ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:57.001187 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-87b45371-8ac2-40b5-a894-dd828689c3ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1229 microversion: 2.1 time: 0.226424 Sep 08 13:35:57.025346 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2830/5788] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:56 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1229 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:58.059703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c3a383d0-c126-4559-82f3-36d7afedb8e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:58.062755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c3a383d0-c126-4559-82f3-36d7afedb8e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:58.076953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3a383d0-c126-4559-82f3-36d7afedb8e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:58.078464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3a383d0-c126-4559-82f3-36d7afedb8e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:58.079743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3a383d0-c126-4559-82f3-36d7afedb8e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:58.081509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3a383d0-c126-4559-82f3-36d7afedb8e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:58.082790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3a383d0-c126-4559-82f3-36d7afedb8e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:58.084614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c3a383d0-c126-4559-82f3-36d7afedb8e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:58.208400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c3a383d0-c126-4559-82f3-36d7afedb8e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:35:58.226601 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c3a383d0-c126-4559-82f3-36d7afedb8e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1233 microversion: 2.1 time: 0.177068 Sep 08 13:35:58.230347 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2959/5789] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:58 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1233 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:35:59.287955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f56f0f73-50a9-4618-b38a-a59871d21fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:35:59.289256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f56f0f73-50a9-4618-b38a-a59871d21fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:35:59.319557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f56f0f73-50a9-4618-b38a-a59871d21fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:59.324988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f56f0f73-50a9-4618-b38a-a59871d21fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:59.326920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f56f0f73-50a9-4618-b38a-a59871d21fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:35:59.329006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f56f0f73-50a9-4618-b38a-a59871d21fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:35:59.342383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f56f0f73-50a9-4618-b38a-a59871d21fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:35:59.343509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f56f0f73-50a9-4618-b38a-a59871d21fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:00.249934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f56f0f73-50a9-4618-b38a-a59871d21fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:00.306188 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f56f0f73-50a9-4618-b38a-a59871d21fb9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1299 microversion: 2.1 time: 1.026750 Sep 08 13:36:00.325240 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2831/5790] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:35:59 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1299 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:01.385112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d10fa745-5055-4692-a6a5-f0a3463312b8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:01.404153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d10fa745-5055-4692-a6a5-f0a3463312b8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:01.449445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d10fa745-5055-4692-a6a5-f0a3463312b8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:01.454556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d10fa745-5055-4692-a6a5-f0a3463312b8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:01.455814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d10fa745-5055-4692-a6a5-f0a3463312b8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:01.465803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d10fa745-5055-4692-a6a5-f0a3463312b8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:01.472712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d10fa745-5055-4692-a6a5-f0a3463312b8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:01.473939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d10fa745-5055-4692-a6a5-f0a3463312b8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:01.484369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:02.185470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d10fa745-5055-4692-a6a5-f0a3463312b8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:02.207304 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d10fa745-5055-4692-a6a5-f0a3463312b8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.835980 Sep 08 13:36:02.220233 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2960/5791] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:01 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:03.247788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0de8f14e-0b18-4047-aef3-cb316e990605 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:03.256577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0de8f14e-0b18-4047-aef3-cb316e990605 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:03.284413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:03.300242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0de8f14e-0b18-4047-aef3-cb316e990605 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:03.307956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0de8f14e-0b18-4047-aef3-cb316e990605 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:03.312647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0de8f14e-0b18-4047-aef3-cb316e990605 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:03.318739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0de8f14e-0b18-4047-aef3-cb316e990605 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:03.321195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0de8f14e-0b18-4047-aef3-cb316e990605 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:03.328987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0de8f14e-0b18-4047-aef3-cb316e990605 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:03.356093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-99e7fb94-670d-4bb8-9129-341b8afdfb9b req-688e7e4d-e35e-4158-ad85-0a65027294fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a846a957-fcf3-4d20-a86d-d585a7e34f21", "tag": "30b56e29-5db0-4cfd-8cef-941b4c4f4b16"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:36:03.399626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-99e7fb94-670d-4bb8-9129-341b8afdfb9b req-688e7e4d-e35e-4158-ad85-0a65027294fc service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:03.400614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-99e7fb94-670d-4bb8-9129-341b8afdfb9b req-688e7e4d-e35e-4158-ad85-0a65027294fc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:03.404377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-99e7fb94-670d-4bb8-9129-341b8afdfb9b req-688e7e4d-e35e-4158-ad85-0a65027294fc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:03.453490 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-99e7fb94-670d-4bb8-9129-341b8afdfb9b req-688e7e4d-e35e-4158-ad85-0a65027294fc service nova] Creating event network-changed:30b56e29-5db0-4cfd-8cef-941b4c4f4b16 for instance a846a957-fcf3-4d20-a86d-d585a7e34f21 on n-h2-852084-10 Sep 08 13:36:03.475581 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-99e7fb94-670d-4bb8-9129-341b8afdfb9b req-688e7e4d-e35e-4158-ad85-0a65027294fc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.255589 Sep 08 13:36:03.477486 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2832/5792] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:36:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:36:03.623606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-08d16dcd-cd48-4336-ba12-083e6c951d1b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:03.629044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-08d16dcd-cd48-4336-ba12-083e6c951d1b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:03.644953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08d16dcd-cd48-4336-ba12-083e6c951d1b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:03.647857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08d16dcd-cd48-4336-ba12-083e6c951d1b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:03.649172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08d16dcd-cd48-4336-ba12-083e6c951d1b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:03.650879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08d16dcd-cd48-4336-ba12-083e6c951d1b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:03.652246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08d16dcd-cd48-4336-ba12-083e6c951d1b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:03.653301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-08d16dcd-cd48-4336-ba12-083e6c951d1b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:03.719758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-08d16dcd-cd48-4336-ba12-083e6c951d1b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:36:03.804832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0de8f14e-0b18-4047-aef3-cb316e990605 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:03.828640 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0de8f14e-0b18-4047-aef3-cb316e990605 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.588740 Sep 08 13:36:03.830387 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2961/5793] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:03 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:03.960955 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-08d16dcd-cd48-4336-ba12-083e6c951d1b tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 204 len: 0 microversion: 2.1 time: 0.366829 Sep 08 13:36:03.961496 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2833/5794] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:36:03 2022] DELETE /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:36:03.976610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c2b3516b-c140-43e0-8b38-d63273395287 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:03.978551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c2b3516b-c140-43e0-8b38-d63273395287 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:03.993169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2b3516b-c140-43e0-8b38-d63273395287 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:03.994987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2b3516b-c140-43e0-8b38-d63273395287 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:03.995837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2b3516b-c140-43e0-8b38-d63273395287 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:03.997335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2b3516b-c140-43e0-8b38-d63273395287 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:03.998138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2b3516b-c140-43e0-8b38-d63273395287 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:03.999060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2b3516b-c140-43e0-8b38-d63273395287 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:04.378785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c2b3516b-c140-43e0-8b38-d63273395287 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:04.392020 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c2b3516b-c140-43e0-8b38-d63273395287 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1512 microversion: 2.1 time: 0.423811 Sep 08 13:36:04.407259 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2962/5795] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:03 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1512 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:04.869917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fd77fd91-4896-420d-951f-091547cc7904 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:04.870700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fd77fd91-4896-420d-951f-091547cc7904 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:04.880926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:04.898822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd77fd91-4896-420d-951f-091547cc7904 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:04.899492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd77fd91-4896-420d-951f-091547cc7904 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:04.900149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd77fd91-4896-420d-951f-091547cc7904 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:04.900925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd77fd91-4896-420d-951f-091547cc7904 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:04.901387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd77fd91-4896-420d-951f-091547cc7904 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:04.901827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fd77fd91-4896-420d-951f-091547cc7904 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:04.907279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:05.422496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ab99151-0422-4f47-97ae-b60e9896768d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:05.423719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6ab99151-0422-4f47-97ae-b60e9896768d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:05.453406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ab99151-0422-4f47-97ae-b60e9896768d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:05.454306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ab99151-0422-4f47-97ae-b60e9896768d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:05.455104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ab99151-0422-4f47-97ae-b60e9896768d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:05.468880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ab99151-0422-4f47-97ae-b60e9896768d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:05.469812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ab99151-0422-4f47-97ae-b60e9896768d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:05.470665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ab99151-0422-4f47-97ae-b60e9896768d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:05.734638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fd77fd91-4896-420d-951f-091547cc7904 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:05.762448 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fd77fd91-4896-420d-951f-091547cc7904 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.899415 Sep 08 13:36:05.775857 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2834/5796] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:04 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:06.145492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6ab99151-0422-4f47-97ae-b60e9896768d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:06.174902 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6ab99151-0422-4f47-97ae-b60e9896768d tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1512 microversion: 2.1 time: 0.759062 Sep 08 13:36:06.188215 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2963/5797] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:05 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1512 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:06.813513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fc87f83-2277-47b2-8497-35d9536c9dfa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:06.814692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1fc87f83-2277-47b2-8497-35d9536c9dfa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:06.869209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc87f83-2277-47b2-8497-35d9536c9dfa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:06.877682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc87f83-2277-47b2-8497-35d9536c9dfa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:06.878660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc87f83-2277-47b2-8497-35d9536c9dfa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:06.888042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc87f83-2277-47b2-8497-35d9536c9dfa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:06.888647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc87f83-2277-47b2-8497-35d9536c9dfa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:06.889209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc87f83-2277-47b2-8497-35d9536c9dfa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:06.999580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:07.225144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c487e79-145f-4102-b04a-20d2edb39402 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:07.226291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5c487e79-145f-4102-b04a-20d2edb39402 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:07.248795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:07.250173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:07.304464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c487e79-145f-4102-b04a-20d2edb39402 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:07.305726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c487e79-145f-4102-b04a-20d2edb39402 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:07.306791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c487e79-145f-4102-b04a-20d2edb39402 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:07.308419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c487e79-145f-4102-b04a-20d2edb39402 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:07.309523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c487e79-145f-4102-b04a-20d2edb39402 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:07.310566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c487e79-145f-4102-b04a-20d2edb39402 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:07.575905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1fc87f83-2277-47b2-8497-35d9536c9dfa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:07.616781 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1fc87f83-2277-47b2-8497-35d9536c9dfa tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.809347 Sep 08 13:36:07.636759 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2835/5798] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:06 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:07.743313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5c487e79-145f-4102-b04a-20d2edb39402 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:07.782873 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c487e79-145f-4102-b04a-20d2edb39402 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1470 microversion: 2.1 time: 0.563727 Sep 08 13:36:07.796448 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2964/5799] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:07 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1470 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:36:08.340662 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:36:08.341222 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 13:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Sep 08 13:36:08.666878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac694e20-2c25-4844-bf94-7ef039561769 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:08.668648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ac694e20-2c25-4844-bf94-7ef039561769 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:08.690506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac694e20-2c25-4844-bf94-7ef039561769 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:08.691383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac694e20-2c25-4844-bf94-7ef039561769 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:08.692033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac694e20-2c25-4844-bf94-7ef039561769 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:08.695707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac694e20-2c25-4844-bf94-7ef039561769 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:08.696576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac694e20-2c25-4844-bf94-7ef039561769 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:08.697227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac694e20-2c25-4844-bf94-7ef039561769 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:08.799411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-aacb9ac8-1596-45d9-a1d0-f4d61ddf0382 req-97456f33-5260-4582-9e9b-7fae234dcff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7431a659-9337-4802-8a8a-8c328bb4f8d9", "name": "network-vif-deleted", "tag": "58fa93e6-6c2a-42c7-8810-9108484cc178"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:36:08.865691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-aacb9ac8-1596-45d9-a1d0-f4d61ddf0382 req-97456f33-5260-4582-9e9b-7fae234dcff2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:08.869960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-aacb9ac8-1596-45d9-a1d0-f4d61ddf0382 req-97456f33-5260-4582-9e9b-7fae234dcff2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:08.872168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-aacb9ac8-1596-45d9-a1d0-f4d61ddf0382 req-97456f33-5260-4582-9e9b-7fae234dcff2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:08.935446 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-aacb9ac8-1596-45d9-a1d0-f4d61ddf0382 req-97456f33-5260-4582-9e9b-7fae234dcff2 service nova] Creating event network-vif-deleted:58fa93e6-6c2a-42c7-8810-9108484cc178 for instance 7431a659-9337-4802-8a8a-8c328bb4f8d9 on n-h1-852084-10 Sep 08 13:36:08.962046 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-aacb9ac8-1596-45d9-a1d0-f4d61ddf0382 req-97456f33-5260-4582-9e9b-7fae234dcff2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.704775 Sep 08 13:36:08.968313 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2836/5800] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:36:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:36:08.993177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:08.995086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:09.006212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:09.007392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:09.008109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:09.009141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:09.010074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:09.010964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:09.070332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:09.071285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:09.071896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:09.072523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lazy-loading 'fault' on Instance uuid 7431a659-9337-4802-8a8a-8c328bb4f8d9 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:36:09.190959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ea7d998c5e244199aa6a68e288d44c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5137eef4e924ae7a7fd8fe51de61cd8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:09.204114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ac694e20-2c25-4844-bf94-7ef039561769 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:09.218679 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-707a1b7e-a3e3-45bd-b4b5-f4a3c98100f6 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 200 len: 1308 microversion: 2.1 time: 0.247887 Sep 08 13:36:09.221819 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2837/5801] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:08 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 1308 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:09.233547 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ac694e20-2c25-4844-bf94-7ef039561769 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.572961 Sep 08 13:36:09.246012 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2965/5802] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:08 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:10.279975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e681dd1-5e91-4ce3-aa1c-7d04a7f43823 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:10.283862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3e681dd1-5e91-4ce3-aa1c-7d04a7f43823 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:10.289505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-93585b5f-17d3-4f0a-8233-1398d0f98105 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:10.290641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-93585b5f-17d3-4f0a-8233-1398d0f98105 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] [instance: 7431a659-9337-4802-8a8a-8c328bb4f8d9] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:10.295082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e681dd1-5e91-4ce3-aa1c-7d04a7f43823 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:10.296295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e681dd1-5e91-4ce3-aa1c-7d04a7f43823 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:10.297200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e681dd1-5e91-4ce3-aa1c-7d04a7f43823 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:10.298593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e681dd1-5e91-4ce3-aa1c-7d04a7f43823 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:10.299660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e681dd1-5e91-4ce3-aa1c-7d04a7f43823 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:10.300509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e681dd1-5e91-4ce3-aa1c-7d04a7f43823 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:10.336478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93585b5f-17d3-4f0a-8233-1398d0f98105 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:10.340070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93585b5f-17d3-4f0a-8233-1398d0f98105 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:10.343065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93585b5f-17d3-4f0a-8233-1398d0f98105 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:10.345819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93585b5f-17d3-4f0a-8233-1398d0f98105 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:10.347945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93585b5f-17d3-4f0a-8233-1398d0f98105 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:10.350837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93585b5f-17d3-4f0a-8233-1398d0f98105 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:10.425663 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-93585b5f-17d3-4f0a-8233-1398d0f98105 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] HTTP exception thrown: Instance 7431a659-9337-4802-8a8a-8c328bb4f8d9 could not be found. Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-93585b5f-17d3-4f0a-8233-1398d0f98105 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Request method failure captured: Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 HTTP/1.1 Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe6hSH3Fi2Zs0UpFIgOhcpq8Xvh_tDUYdnz1llnNO6B80qYdjSTStNLLRCvTV7DZ7TEcxkTyIFMHSHa0ZHkH_n6zXzyYX7sgSe2P3tWqAInnU8qP03vPkH-zllhvVUGZnNpuwPKB0Mmm6BNpyb2IDS7wwXpIq8BfNKWfAKNxFzlDX74 Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c5137eef4e924ae7a7fd8fe51de61cd8 Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1714563036 Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c5137eef4e924ae7a7fd8fe51de61cd8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c5137eef4e924ae7a7fd8fe51de61cd8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5137eef4e924ae7a7fd8fe51de61cd8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5137eef4e924ae7a7fd8fe51de61cd8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-VolumesSnapshotTestJSON-1714563036 Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c5137eef4e924ae7a7fd8fe51de61cd8 Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1714563036 Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-VolumesSnapshotTestJSON-1714563036-project Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 8ea7d998c5e244199aa6a68e288d44c1 Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-VolumesSnapshotTestJSON-1714563036-project Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 7431a659-9337-4802-8a8a-8c328bb4f8d9 could not be found. Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '7431a659-9337-4802-8a8a-8c328bb4f8d9'} Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7431a659-9337-4802-8a8a-8c328bb4f8d9 could not be found. Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7431a659-9337-4802-8a8a-8c328bb4f8d9 could not be found. Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:36:10.438931 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:36:10.448864 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:36:10.448864 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:36:10.448864 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:36:10.448864 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:36:10.448864 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:36:10.448864 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7431a659-9337-4802-8a8a-8c328bb4f8d9 could not be found. Sep 08 13:36:10.448864 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:36:10.448864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-93585b5f-17d3-4f0a-8233-1398d0f98105 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] Returning 404 to user: Instance 7431a659-9337-4802-8a8a-8c328bb4f8d9 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:36:10.465709 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-93585b5f-17d3-4f0a-8233-1398d0f98105 tempest-VolumesSnapshotTestJSON-1714563036 tempest-VolumesSnapshotTestJSON-1714563036-project] 10.222.0.78 "GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9" status: 404 len: 111 microversion: 2.1 time: 0.199153 Sep 08 13:36:10.465709 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2838/5803] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:10 2022] GET /compute/v2.1/servers/7431a659-9337-4802-8a8a-8c328bb4f8d9 => generated 111 bytes in 202 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:36:10.740920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3e681dd1-5e91-4ce3-aa1c-7d04a7f43823 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:10.794906 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3e681dd1-5e91-4ce3-aa1c-7d04a7f43823 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.529820 Sep 08 13:36:10.797197 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2966/5804] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:10 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:11.862823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a1f48f0c-3147-4cb9-8a9c-dda131940815 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:11.880044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a1f48f0c-3147-4cb9-8a9c-dda131940815 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:11.956892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1f48f0c-3147-4cb9-8a9c-dda131940815 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:11.956892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1f48f0c-3147-4cb9-8a9c-dda131940815 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:11.956892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1f48f0c-3147-4cb9-8a9c-dda131940815 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:11.957712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1f48f0c-3147-4cb9-8a9c-dda131940815 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:11.958599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1f48f0c-3147-4cb9-8a9c-dda131940815 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:11.976332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1f48f0c-3147-4cb9-8a9c-dda131940815 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:12.423992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a1f48f0c-3147-4cb9-8a9c-dda131940815 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:12.437300 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a1f48f0c-3147-4cb9-8a9c-dda131940815 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.590758 Sep 08 13:36:12.438669 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2839/5805] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:11 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:36:13.542461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b0eddc88-81e5-44e3-8911-80a2af6442a6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:13.543608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b0eddc88-81e5-44e3-8911-80a2af6442a6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:13.567083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0eddc88-81e5-44e3-8911-80a2af6442a6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:13.568173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0eddc88-81e5-44e3-8911-80a2af6442a6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:13.568643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0eddc88-81e5-44e3-8911-80a2af6442a6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:13.569627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0eddc88-81e5-44e3-8911-80a2af6442a6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:13.570291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0eddc88-81e5-44e3-8911-80a2af6442a6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:13.570927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b0eddc88-81e5-44e3-8911-80a2af6442a6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:14.162802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b0eddc88-81e5-44e3-8911-80a2af6442a6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:14.195035 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b0eddc88-81e5-44e3-8911-80a2af6442a6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.655695 Sep 08 13:36:14.207356 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2967/5806] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:13 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:15.282589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0513bad7-cbb3-4fbb-af89-209d86b915cd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:15.292905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0513bad7-cbb3-4fbb-af89-209d86b915cd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:15.363290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0513bad7-cbb3-4fbb-af89-209d86b915cd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:15.371348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0513bad7-cbb3-4fbb-af89-209d86b915cd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:15.372377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0513bad7-cbb3-4fbb-af89-209d86b915cd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:15.374231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0513bad7-cbb3-4fbb-af89-209d86b915cd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:15.375643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0513bad7-cbb3-4fbb-af89-209d86b915cd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:15.376696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0513bad7-cbb3-4fbb-af89-209d86b915cd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:15.883493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0513bad7-cbb3-4fbb-af89-209d86b915cd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:15.930037 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0513bad7-cbb3-4fbb-af89-209d86b915cd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.671840 Sep 08 13:36:15.959676 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2840/5807] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:15 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:16.974922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9618e9e5-ec95-4f49-b36f-59b0160beec0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:16.976403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9618e9e5-ec95-4f49-b36f-59b0160beec0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:16.985616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9618e9e5-ec95-4f49-b36f-59b0160beec0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:16.986125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9618e9e5-ec95-4f49-b36f-59b0160beec0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:16.986606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9618e9e5-ec95-4f49-b36f-59b0160beec0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:16.987630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9618e9e5-ec95-4f49-b36f-59b0160beec0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:16.988571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9618e9e5-ec95-4f49-b36f-59b0160beec0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:16.989272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9618e9e5-ec95-4f49-b36f-59b0160beec0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:17.558664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9618e9e5-ec95-4f49-b36f-59b0160beec0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:17.589394 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9618e9e5-ec95-4f49-b36f-59b0160beec0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.617779 Sep 08 13:36:17.592497 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2968/5808] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:16 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:36:18.628734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-23e2d82f-d15b-4386-b7d3-3af4588d1fe7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:18.630553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-23e2d82f-d15b-4386-b7d3-3af4588d1fe7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:18.639809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e2d82f-d15b-4386-b7d3-3af4588d1fe7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:18.641690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e2d82f-d15b-4386-b7d3-3af4588d1fe7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:18.642389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e2d82f-d15b-4386-b7d3-3af4588d1fe7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:18.643666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e2d82f-d15b-4386-b7d3-3af4588d1fe7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:18.644390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e2d82f-d15b-4386-b7d3-3af4588d1fe7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:18.645013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e2d82f-d15b-4386-b7d3-3af4588d1fe7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:19.047689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-23e2d82f-d15b-4386-b7d3-3af4588d1fe7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:19.100261 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-23e2d82f-d15b-4386-b7d3-3af4588d1fe7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.461557 Sep 08 13:36:19.101566 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2841/5809] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:18 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:20.132527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7c915878-e625-48c6-be39-02013b82e974 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:20.133330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7c915878-e625-48c6-be39-02013b82e974 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:20.155891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c915878-e625-48c6-be39-02013b82e974 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:20.157354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c915878-e625-48c6-be39-02013b82e974 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:20.158451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c915878-e625-48c6-be39-02013b82e974 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:20.160135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c915878-e625-48c6-be39-02013b82e974 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:20.162204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c915878-e625-48c6-be39-02013b82e974 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:20.163755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c915878-e625-48c6-be39-02013b82e974 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:20.443714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7c915878-e625-48c6-be39-02013b82e974 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:20.465264 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7c915878-e625-48c6-be39-02013b82e974 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.339700 Sep 08 13:36:20.467040 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2969/5810] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:20 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:21.491503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-55f99770-e2b5-43cd-a787-6f5a9fb5d31d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:21.492128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-55f99770-e2b5-43cd-a787-6f5a9fb5d31d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:21.511073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f99770-e2b5-43cd-a787-6f5a9fb5d31d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:21.512577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f99770-e2b5-43cd-a787-6f5a9fb5d31d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:21.513234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f99770-e2b5-43cd-a787-6f5a9fb5d31d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:21.514191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f99770-e2b5-43cd-a787-6f5a9fb5d31d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:21.514849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f99770-e2b5-43cd-a787-6f5a9fb5d31d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:21.515516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f99770-e2b5-43cd-a787-6f5a9fb5d31d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:21.881657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-55f99770-e2b5-43cd-a787-6f5a9fb5d31d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:21.898322 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-55f99770-e2b5-43cd-a787-6f5a9fb5d31d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.411180 Sep 08 13:36:21.898933 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2842/5811] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:21 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:22.960258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0fcc7ec2-50cc-45f8-8911-6b1f2700ea91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:22.973698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0fcc7ec2-50cc-45f8-8911-6b1f2700ea91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:23.016629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fcc7ec2-50cc-45f8-8911-6b1f2700ea91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:23.017787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fcc7ec2-50cc-45f8-8911-6b1f2700ea91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:23.019433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fcc7ec2-50cc-45f8-8911-6b1f2700ea91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:23.021707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fcc7ec2-50cc-45f8-8911-6b1f2700ea91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:23.022814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fcc7ec2-50cc-45f8-8911-6b1f2700ea91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:23.024130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0fcc7ec2-50cc-45f8-8911-6b1f2700ea91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:23.506068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0fcc7ec2-50cc-45f8-8911-6b1f2700ea91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:23.523439 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0fcc7ec2-50cc-45f8-8911-6b1f2700ea91 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.588401 Sep 08 13:36:23.539702 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2970/5812] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:22 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:24.563178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9100a7fc-fcb0-48b3-b680-148b1a164b48 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:24.564677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9100a7fc-fcb0-48b3-b680-148b1a164b48 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:24.604299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9100a7fc-fcb0-48b3-b680-148b1a164b48 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:24.605616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9100a7fc-fcb0-48b3-b680-148b1a164b48 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:24.606593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9100a7fc-fcb0-48b3-b680-148b1a164b48 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:24.608840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9100a7fc-fcb0-48b3-b680-148b1a164b48 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:24.609802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9100a7fc-fcb0-48b3-b680-148b1a164b48 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:24.610634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9100a7fc-fcb0-48b3-b680-148b1a164b48 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:25.093714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9100a7fc-fcb0-48b3-b680-148b1a164b48 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:25.113068 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9100a7fc-fcb0-48b3-b680-148b1a164b48 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.563869 Sep 08 13:36:25.115511 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2843/5813] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:24 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:26.167808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fff3282d-4bb9-4f5c-8b2c-c84c08d19bfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:26.170512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fff3282d-4bb9-4f5c-8b2c-c84c08d19bfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:26.197323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fff3282d-4bb9-4f5c-8b2c-c84c08d19bfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:26.198591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fff3282d-4bb9-4f5c-8b2c-c84c08d19bfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:26.199971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fff3282d-4bb9-4f5c-8b2c-c84c08d19bfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:26.201683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fff3282d-4bb9-4f5c-8b2c-c84c08d19bfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:26.203078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fff3282d-4bb9-4f5c-8b2c-c84c08d19bfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:26.204296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fff3282d-4bb9-4f5c-8b2c-c84c08d19bfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:26.725142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fff3282d-4bb9-4f5c-8b2c-c84c08d19bfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:26.781982 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fff3282d-4bb9-4f5c-8b2c-c84c08d19bfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.631832 Sep 08 13:36:26.785959 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2971/5814] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:26 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:27.839916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b0f52867-98d8-4a8a-9af6-a7b6b6577662 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:27.843296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b0f52867-98d8-4a8a-9af6-a7b6b6577662 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:27.863691 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0f52867-98d8-4a8a-9af6-a7b6b6577662 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:27.865138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0f52867-98d8-4a8a-9af6-a7b6b6577662 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:27.866281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0f52867-98d8-4a8a-9af6-a7b6b6577662 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:27.868027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0f52867-98d8-4a8a-9af6-a7b6b6577662 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:27.869220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0f52867-98d8-4a8a-9af6-a7b6b6577662 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:27.870330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b0f52867-98d8-4a8a-9af6-a7b6b6577662 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:28.306322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b0f52867-98d8-4a8a-9af6-a7b6b6577662 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:28.336336 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b0f52867-98d8-4a8a-9af6-a7b6b6577662 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.503659 Sep 08 13:36:28.338931 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2844/5815] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:27 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:29.367776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-abf86cb0-0fb7-4636-bb55-6fe05ec913e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:29.376488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-abf86cb0-0fb7-4636-bb55-6fe05ec913e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:29.405667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abf86cb0-0fb7-4636-bb55-6fe05ec913e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:29.431036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abf86cb0-0fb7-4636-bb55-6fe05ec913e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:29.437763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abf86cb0-0fb7-4636-bb55-6fe05ec913e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:29.454880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abf86cb0-0fb7-4636-bb55-6fe05ec913e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:29.458763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abf86cb0-0fb7-4636-bb55-6fe05ec913e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:29.461146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abf86cb0-0fb7-4636-bb55-6fe05ec913e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:29.965154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-abf86cb0-0fb7-4636-bb55-6fe05ec913e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:29.983858 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-abf86cb0-0fb7-4636-bb55-6fe05ec913e5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1341 microversion: 2.1 time: 0.620050 Sep 08 13:36:29.985315 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2972/5816] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:29 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1341 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:31.073708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-106ef9ec-bdc5-429f-857f-e3cabbbd35f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:31.078403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-106ef9ec-bdc5-429f-857f-e3cabbbd35f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:31.109960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-106ef9ec-bdc5-429f-857f-e3cabbbd35f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:31.111478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-106ef9ec-bdc5-429f-857f-e3cabbbd35f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:31.112837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-106ef9ec-bdc5-429f-857f-e3cabbbd35f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:31.116762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-106ef9ec-bdc5-429f-857f-e3cabbbd35f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:31.118787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-106ef9ec-bdc5-429f-857f-e3cabbbd35f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:31.120237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-106ef9ec-bdc5-429f-857f-e3cabbbd35f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:31.480893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-106ef9ec-bdc5-429f-857f-e3cabbbd35f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:31.515217 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-106ef9ec-bdc5-429f-857f-e3cabbbd35f7 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1375 microversion: 2.1 time: 0.490855 Sep 08 13:36:31.516181 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2845/5817] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:31 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1375 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:32.558183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-294352d7-50c7-4688-9ce6-67f3c421dd16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:32.560501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-294352d7-50c7-4688-9ce6-67f3c421dd16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:32.579612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-294352d7-50c7-4688-9ce6-67f3c421dd16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:32.579612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-294352d7-50c7-4688-9ce6-67f3c421dd16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:32.579612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-294352d7-50c7-4688-9ce6-67f3c421dd16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:32.579612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-294352d7-50c7-4688-9ce6-67f3c421dd16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:32.579612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-294352d7-50c7-4688-9ce6-67f3c421dd16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:32.579612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-294352d7-50c7-4688-9ce6-67f3c421dd16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:32.588319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=78 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:32.947940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-294352d7-50c7-4688-9ce6-67f3c421dd16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:32.960013 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-294352d7-50c7-4688-9ce6-67f3c421dd16 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1375 microversion: 2.1 time: 0.409329 Sep 08 13:36:32.964088 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2973/5818] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:32 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1375 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:34.000823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e132f61a-8ed5-43c7-b848-fcac23ca7c19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:34.002717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e132f61a-8ed5-43c7-b848-fcac23ca7c19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:34.012541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e132f61a-8ed5-43c7-b848-fcac23ca7c19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:34.013033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e132f61a-8ed5-43c7-b848-fcac23ca7c19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:34.013499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e132f61a-8ed5-43c7-b848-fcac23ca7c19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:34.014183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e132f61a-8ed5-43c7-b848-fcac23ca7c19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:34.014728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e132f61a-8ed5-43c7-b848-fcac23ca7c19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:34.015106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e132f61a-8ed5-43c7-b848-fcac23ca7c19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:34.259960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e132f61a-8ed5-43c7-b848-fcac23ca7c19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:34.274519 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e132f61a-8ed5-43c7-b848-fcac23ca7c19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1375 microversion: 2.1 time: 0.277669 Sep 08 13:36:34.287266 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2846/5819] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:33 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1375 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:36:35.327336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1078a4d4-8721-490e-886a-1d67f34dbcfd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:35.335473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1078a4d4-8721-490e-886a-1d67f34dbcfd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:35.340850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=26 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:35.355003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1078a4d4-8721-490e-886a-1d67f34dbcfd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:35.356340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1078a4d4-8721-490e-886a-1d67f34dbcfd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:35.357258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1078a4d4-8721-490e-886a-1d67f34dbcfd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:35.358688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1078a4d4-8721-490e-886a-1d67f34dbcfd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:35.359644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1078a4d4-8721-490e-886a-1d67f34dbcfd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:35.361217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1078a4d4-8721-490e-886a-1d67f34dbcfd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:35.625300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1078a4d4-8721-490e-886a-1d67f34dbcfd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:35.656263 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1078a4d4-8721-490e-886a-1d67f34dbcfd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1375 microversion: 2.1 time: 0.341228 Sep 08 13:36:35.657787 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2974/5820] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:35 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1375 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:36:36.696631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2f83746-31b6-40af-84c7-85ee63a0f081 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:36.700554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2f83746-31b6-40af-84c7-85ee63a0f081 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:36.718147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=28 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:36.737945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f83746-31b6-40af-84c7-85ee63a0f081 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:36.739142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f83746-31b6-40af-84c7-85ee63a0f081 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:36.740363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f83746-31b6-40af-84c7-85ee63a0f081 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:36.741975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f83746-31b6-40af-84c7-85ee63a0f081 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:36.743381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f83746-31b6-40af-84c7-85ee63a0f081 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:36.744552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f83746-31b6-40af-84c7-85ee63a0f081 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:36.789453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=72 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:36:37.171450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f2f83746-31b6-40af-84c7-85ee63a0f081 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:37.206950 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2f83746-31b6-40af-84c7-85ee63a0f081 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1375 microversion: 2.1 time: 0.524838 Sep 08 13:36:37.212177 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2847/5821] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:36 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1375 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:38.264312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-19a2c24c-437e-4748-87f9-ee70369c9391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:38.265671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-19a2c24c-437e-4748-87f9-ee70369c9391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:38.279372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19a2c24c-437e-4748-87f9-ee70369c9391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:38.283166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19a2c24c-437e-4748-87f9-ee70369c9391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:38.284003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19a2c24c-437e-4748-87f9-ee70369c9391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:38.284973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19a2c24c-437e-4748-87f9-ee70369c9391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:38.285642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19a2c24c-437e-4748-87f9-ee70369c9391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:38.287366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-19a2c24c-437e-4748-87f9-ee70369c9391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:38.618242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-19a2c24c-437e-4748-87f9-ee70369c9391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:38.635704 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-19a2c24c-437e-4748-87f9-ee70369c9391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1375 microversion: 2.1 time: 0.383593 Sep 08 13:36:38.637723 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2975/5822] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:38 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1375 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:39.689188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1ff5fe76-6475-488a-8a43-b7a36401a71f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:39.690756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1ff5fe76-6475-488a-8a43-b7a36401a71f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:39.710420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ff5fe76-6475-488a-8a43-b7a36401a71f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:39.711291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ff5fe76-6475-488a-8a43-b7a36401a71f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:39.712640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ff5fe76-6475-488a-8a43-b7a36401a71f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:39.714479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ff5fe76-6475-488a-8a43-b7a36401a71f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:39.714479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ff5fe76-6475-488a-8a43-b7a36401a71f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:39.714824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ff5fe76-6475-488a-8a43-b7a36401a71f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:39.988331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1ff5fe76-6475-488a-8a43-b7a36401a71f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:39.999807 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1ff5fe76-6475-488a-8a43-b7a36401a71f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1375 microversion: 2.1 time: 0.323392 Sep 08 13:36:40.019286 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2848/5823] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:39 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1375 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:41.045808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e876159d-782f-45cf-bb15-913aa568267b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:41.046693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e876159d-782f-45cf-bb15-913aa568267b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:41.066908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e876159d-782f-45cf-bb15-913aa568267b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:41.067661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e876159d-782f-45cf-bb15-913aa568267b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:41.069616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e876159d-782f-45cf-bb15-913aa568267b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:41.070483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e876159d-782f-45cf-bb15-913aa568267b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:41.070991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e876159d-782f-45cf-bb15-913aa568267b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:41.071495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e876159d-782f-45cf-bb15-913aa568267b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:41.445433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e876159d-782f-45cf-bb15-913aa568267b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:41.465920 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e876159d-782f-45cf-bb15-913aa568267b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1375 microversion: 2.1 time: 0.423989 Sep 08 13:36:41.467740 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2976/5824] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:41 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1375 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:41.939808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-348c8e62-79e7-4ad0-83c0-09b028391da0 req-a99add65-9441-45de-a2b3-b1e6c06c71b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a846a957-fcf3-4d20-a86d-d585a7e34f21", "name": "network-vif-plugged", "status": "completed", "tag": "30b56e29-5db0-4cfd-8cef-941b4c4f4b16"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:36:41.962290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-348c8e62-79e7-4ad0-83c0-09b028391da0 req-a99add65-9441-45de-a2b3-b1e6c06c71b1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:41.963387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-348c8e62-79e7-4ad0-83c0-09b028391da0 req-a99add65-9441-45de-a2b3-b1e6c06c71b1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:41.964302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-348c8e62-79e7-4ad0-83c0-09b028391da0 req-a99add65-9441-45de-a2b3-b1e6c06c71b1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:41.989536 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-348c8e62-79e7-4ad0-83c0-09b028391da0 req-a99add65-9441-45de-a2b3-b1e6c06c71b1 service nova] Creating event network-vif-plugged:30b56e29-5db0-4cfd-8cef-941b4c4f4b16 for instance a846a957-fcf3-4d20-a86d-d585a7e34f21 on n-h2-852084-10 Sep 08 13:36:41.998544 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-348c8e62-79e7-4ad0-83c0-09b028391da0 req-a99add65-9441-45de-a2b3-b1e6c06c71b1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.209088 Sep 08 13:36:41.999918 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2849/5825] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:36:42.518187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a6a514d4-421c-4e00-9197-b4c270f9db54 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:42.521546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a6a514d4-421c-4e00-9197-b4c270f9db54 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:42.538817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6a514d4-421c-4e00-9197-b4c270f9db54 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:42.540275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6a514d4-421c-4e00-9197-b4c270f9db54 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:42.541390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6a514d4-421c-4e00-9197-b4c270f9db54 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:42.543579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6a514d4-421c-4e00-9197-b4c270f9db54 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:42.544760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6a514d4-421c-4e00-9197-b4c270f9db54 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:42.545946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6a514d4-421c-4e00-9197-b4c270f9db54 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:43.054136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a6a514d4-421c-4e00-9197-b4c270f9db54 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:43.081631 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a6a514d4-421c-4e00-9197-b4c270f9db54 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1375 microversion: 2.1 time: 0.571975 Sep 08 13:36:43.082422 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2977/5826] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:42 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1375 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:44.128323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e2117067-c390-45f4-bfd0-4e407e93d162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:44.129116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e2117067-c390-45f4-bfd0-4e407e93d162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:44.156022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e2117067-c390-45f4-bfd0-4e407e93d162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:44.156820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e2117067-c390-45f4-bfd0-4e407e93d162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:44.157265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e2117067-c390-45f4-bfd0-4e407e93d162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:44.158012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e2117067-c390-45f4-bfd0-4e407e93d162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:44.158474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e2117067-c390-45f4-bfd0-4e407e93d162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:44.158905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e2117067-c390-45f4-bfd0-4e407e93d162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:44.510800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e2117067-c390-45f4-bfd0-4e407e93d162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:44.522672 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e2117067-c390-45f4-bfd0-4e407e93d162 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1562 microversion: 2.1 time: 0.399007 Sep 08 13:36:44.523303 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2850/5827] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:44 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1562 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:36:44.568534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3ae64a9b-3a7d-4c92-9d40-c20df5abbdd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:44.570004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3ae64a9b-3a7d-4c92-9d40-c20df5abbdd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:44.597425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ae64a9b-3a7d-4c92-9d40-c20df5abbdd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:44.598457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ae64a9b-3a7d-4c92-9d40-c20df5abbdd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:44.599755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ae64a9b-3a7d-4c92-9d40-c20df5abbdd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:44.600808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ae64a9b-3a7d-4c92-9d40-c20df5abbdd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:44.601566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ae64a9b-3a7d-4c92-9d40-c20df5abbdd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:44.602281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3ae64a9b-3a7d-4c92-9d40-c20df5abbdd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:45.179334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3ae64a9b-3a7d-4c92-9d40-c20df5abbdd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:45.210106 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3ae64a9b-3a7d-4c92-9d40-c20df5abbdd2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1562 microversion: 2.1 time: 0.646046 Sep 08 13:36:45.211081 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2978/5828] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:44 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1562 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:36:45.363258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-592fd871-19c3-4353-b2e3-1c4e0d02d736 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:45.364632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-592fd871-19c3-4353-b2e3-1c4e0d02d736 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:45.383587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-592fd871-19c3-4353-b2e3-1c4e0d02d736 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:45.383587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-592fd871-19c3-4353-b2e3-1c4e0d02d736 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:45.383587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-592fd871-19c3-4353-b2e3-1c4e0d02d736 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:45.383587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-592fd871-19c3-4353-b2e3-1c4e0d02d736 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:45.383587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-592fd871-19c3-4353-b2e3-1c4e0d02d736 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:45.383587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-592fd871-19c3-4353-b2e3-1c4e0d02d736 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:45.442226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-592fd871-19c3-4353-b2e3-1c4e0d02d736 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:36:45.583355 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-592fd871-19c3-4353-b2e3-1c4e0d02d736 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 204 len: 0 microversion: 2.1 time: 0.224090 Sep 08 13:36:45.587685 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2851/5829] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:36:45 2022] DELETE /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:36:45.596849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3212a8df-ba2f-432f-aad5-b743837f674f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:45.599707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3212a8df-ba2f-432f-aad5-b743837f674f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:45.613549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3212a8df-ba2f-432f-aad5-b743837f674f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:45.615621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3212a8df-ba2f-432f-aad5-b743837f674f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:45.617611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3212a8df-ba2f-432f-aad5-b743837f674f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:45.621159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3212a8df-ba2f-432f-aad5-b743837f674f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:45.622599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3212a8df-ba2f-432f-aad5-b743837f674f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:45.623890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3212a8df-ba2f-432f-aad5-b743837f674f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:45.907893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3212a8df-ba2f-432f-aad5-b743837f674f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:45.923352 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3212a8df-ba2f-432f-aad5-b743837f674f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1568 microversion: 2.1 time: 0.333422 Sep 08 13:36:45.925526 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2979/5830] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:45 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1568 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:36:46.970969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fbc07bbc-9195-416a-9b94-4674580b0c8e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:46.972867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fbc07bbc-9195-416a-9b94-4674580b0c8e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:47.005970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbc07bbc-9195-416a-9b94-4674580b0c8e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:47.007048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbc07bbc-9195-416a-9b94-4674580b0c8e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:47.008237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbc07bbc-9195-416a-9b94-4674580b0c8e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:47.009468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbc07bbc-9195-416a-9b94-4674580b0c8e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:47.010408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbc07bbc-9195-416a-9b94-4674580b0c8e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:47.010975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbc07bbc-9195-416a-9b94-4674580b0c8e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:47.364466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fbc07bbc-9195-416a-9b94-4674580b0c8e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:47.381112 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fbc07bbc-9195-416a-9b94-4674580b0c8e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1568 microversion: 2.1 time: 0.428740 Sep 08 13:36:47.400865 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2852/5831] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:46 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1568 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:48.094087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2cc86b63-eca1-4cc6-baa7-fb88cdeb7f0a req-a1781103-a555-4413-a450-990e7f49386c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a846a957-fcf3-4d20-a86d-d585a7e34f21", "name": "network-vif-deleted", "tag": "30b56e29-5db0-4cfd-8cef-941b4c4f4b16"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:36:48.120093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2cc86b63-eca1-4cc6-baa7-fb88cdeb7f0a req-a1781103-a555-4413-a450-990e7f49386c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:48.120688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2cc86b63-eca1-4cc6-baa7-fb88cdeb7f0a req-a1781103-a555-4413-a450-990e7f49386c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:48.121153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2cc86b63-eca1-4cc6-baa7-fb88cdeb7f0a req-a1781103-a555-4413-a450-990e7f49386c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:48.160500 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2cc86b63-eca1-4cc6-baa7-fb88cdeb7f0a req-a1781103-a555-4413-a450-990e7f49386c service nova] Creating event network-vif-deleted:30b56e29-5db0-4cfd-8cef-941b4c4f4b16 for instance a846a957-fcf3-4d20-a86d-d585a7e34f21 on n-h2-852084-10 Sep 08 13:36:48.182163 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2cc86b63-eca1-4cc6-baa7-fb88cdeb7f0a req-a1781103-a555-4413-a450-990e7f49386c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092666 Sep 08 13:36:48.182713 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2980/5832] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:36:48.421216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fe34abf0-049f-4728-9b77-a4955d16a957 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:48.425396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fe34abf0-049f-4728-9b77-a4955d16a957 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:48.452493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe34abf0-049f-4728-9b77-a4955d16a957 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:48.459211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe34abf0-049f-4728-9b77-a4955d16a957 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:48.460321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe34abf0-049f-4728-9b77-a4955d16a957 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:48.461696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe34abf0-049f-4728-9b77-a4955d16a957 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:48.462900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe34abf0-049f-4728-9b77-a4955d16a957 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:48.463766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe34abf0-049f-4728-9b77-a4955d16a957 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:48.668965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fe34abf0-049f-4728-9b77-a4955d16a957 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:48.702248 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fe34abf0-049f-4728-9b77-a4955d16a957 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1360 microversion: 2.1 time: 0.288784 Sep 08 13:36:48.708412 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2853/5833] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:48 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1360 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:49.737648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6034a1ff-628a-46ba-84bd-13a058f2aa8a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:49.738556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6034a1ff-628a-46ba-84bd-13a058f2aa8a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:49.758178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6034a1ff-628a-46ba-84bd-13a058f2aa8a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:49.758795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6034a1ff-628a-46ba-84bd-13a058f2aa8a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:49.759315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6034a1ff-628a-46ba-84bd-13a058f2aa8a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:49.760489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6034a1ff-628a-46ba-84bd-13a058f2aa8a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:49.761899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6034a1ff-628a-46ba-84bd-13a058f2aa8a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:49.761899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6034a1ff-628a-46ba-84bd-13a058f2aa8a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:49.914872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6034a1ff-628a-46ba-84bd-13a058f2aa8a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:49.929161 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6034a1ff-628a-46ba-84bd-13a058f2aa8a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1360 microversion: 2.1 time: 0.197219 Sep 08 13:36:49.930468 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2981/5834] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:49 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1360 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:36:50.971993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38c0c8c6-d1cd-4425-8035-1ec5c2e20ed2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:50.973171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-38c0c8c6-d1cd-4425-8035-1ec5c2e20ed2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:51.004153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38c0c8c6-d1cd-4425-8035-1ec5c2e20ed2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:51.016770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38c0c8c6-d1cd-4425-8035-1ec5c2e20ed2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:51.018052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38c0c8c6-d1cd-4425-8035-1ec5c2e20ed2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:51.019791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38c0c8c6-d1cd-4425-8035-1ec5c2e20ed2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:51.021012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38c0c8c6-d1cd-4425-8035-1ec5c2e20ed2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:51.022111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38c0c8c6-d1cd-4425-8035-1ec5c2e20ed2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:51.237377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38c0c8c6-d1cd-4425-8035-1ec5c2e20ed2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:51.253539 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38c0c8c6-d1cd-4425-8035-1ec5c2e20ed2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1360 microversion: 2.1 time: 0.289316 Sep 08 13:36:51.255467 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2854/5835] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:50 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1360 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:52.309050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-109da612-cec4-4a5c-b336-fdf05a32136a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:52.310390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-109da612-cec4-4a5c-b336-fdf05a32136a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:52.344331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-109da612-cec4-4a5c-b336-fdf05a32136a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:52.345304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-109da612-cec4-4a5c-b336-fdf05a32136a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:52.346156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-109da612-cec4-4a5c-b336-fdf05a32136a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:52.360950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-109da612-cec4-4a5c-b336-fdf05a32136a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:52.361867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-109da612-cec4-4a5c-b336-fdf05a32136a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:52.362712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-109da612-cec4-4a5c-b336-fdf05a32136a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:52.528600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-109da612-cec4-4a5c-b336-fdf05a32136a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:52.548933 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-109da612-cec4-4a5c-b336-fdf05a32136a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1360 microversion: 2.1 time: 0.245003 Sep 08 13:36:52.550489 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2982/5836] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:52 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1360 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:53.591636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0e2523f0-0285-4fc8-9ff4-150140528819 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:53.594345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0e2523f0-0285-4fc8-9ff4-150140528819 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:53.607814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e2523f0-0285-4fc8-9ff4-150140528819 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:53.609036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e2523f0-0285-4fc8-9ff4-150140528819 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:53.610325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e2523f0-0285-4fc8-9ff4-150140528819 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:53.612297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e2523f0-0285-4fc8-9ff4-150140528819 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:53.619108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e2523f0-0285-4fc8-9ff4-150140528819 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:53.620545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e2523f0-0285-4fc8-9ff4-150140528819 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:53.786861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0e2523f0-0285-4fc8-9ff4-150140528819 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:53.807417 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0e2523f0-0285-4fc8-9ff4-150140528819 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1360 microversion: 2.1 time: 0.226075 Sep 08 13:36:53.809417 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2855/5837] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:53 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1360 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:54.871957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f25662d6-d153-4a62-a867-2c3719975767 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:54.875144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f25662d6-d153-4a62-a867-2c3719975767 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:54.895371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f25662d6-d153-4a62-a867-2c3719975767 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:54.897976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f25662d6-d153-4a62-a867-2c3719975767 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:54.899038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f25662d6-d153-4a62-a867-2c3719975767 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:54.900874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f25662d6-d153-4a62-a867-2c3719975767 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:54.902134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f25662d6-d153-4a62-a867-2c3719975767 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:54.903137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f25662d6-d153-4a62-a867-2c3719975767 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:55.077145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f25662d6-d153-4a62-a867-2c3719975767 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:55.096091 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f25662d6-d153-4a62-a867-2c3719975767 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1360 microversion: 2.1 time: 0.240018 Sep 08 13:36:55.111971 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2983/5838] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:54 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1360 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:56.139323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-649c55e0-b94d-45c9-9ca5-c77069315ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:56.140842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-649c55e0-b94d-45c9-9ca5-c77069315ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:56.155779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-649c55e0-b94d-45c9-9ca5-c77069315ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:56.157201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-649c55e0-b94d-45c9-9ca5-c77069315ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:56.158298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-649c55e0-b94d-45c9-9ca5-c77069315ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:56.161254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-649c55e0-b94d-45c9-9ca5-c77069315ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:56.161254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-649c55e0-b94d-45c9-9ca5-c77069315ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:56.162026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-649c55e0-b94d-45c9-9ca5-c77069315ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:56.312960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-649c55e0-b94d-45c9-9ca5-c77069315ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:56.334351 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-649c55e0-b94d-45c9-9ca5-c77069315ed1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1360 microversion: 2.1 time: 0.202516 Sep 08 13:36:56.336055 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2856/5839] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:56 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1360 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:57.375630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:57.388877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:57.401980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:57.403443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:57.404568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:57.406215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:57.407662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:57.408811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:57.600273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:57.606103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:57.607922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:57.620568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lazy-loading 'fault' on Instance uuid a846a957-fcf3-4d20-a86d-d585a7e34f21 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:36:57.780242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:36:57.796910 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0adc151c-573f-4d5f-a57f-18d8aaf022c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 200 len: 1319 microversion: 2.1 time: 0.428609 Sep 08 13:36:57.813673 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2984/5840] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:57 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 1319 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:36:58.853874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4dea28ba-1ef3-4e59-9ca8-b6a016d55f1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:36:58.854980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4dea28ba-1ef3-4e59-9ca8-b6a016d55f1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:36:58.884616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dea28ba-1ef3-4e59-9ca8-b6a016d55f1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:58.890801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dea28ba-1ef3-4e59-9ca8-b6a016d55f1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:58.891836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dea28ba-1ef3-4e59-9ca8-b6a016d55f1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:58.893632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dea28ba-1ef3-4e59-9ca8-b6a016d55f1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:36:58.894863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dea28ba-1ef3-4e59-9ca8-b6a016d55f1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:36:58.897522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dea28ba-1ef3-4e59-9ca8-b6a016d55f1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:36:58.943142 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-4dea28ba-1ef3-4e59-9ca8-b6a016d55f1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4dea28ba-1ef3-4e59-9ca8-b6a016d55f1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 HTTP/1.1 Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'a846a957-fcf3-4d20-a86d-d585a7e34f21'} Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:36:58.970592 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:36:58.976887 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:36:58.976887 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:36:58.976887 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:36:58.976887 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:36:58.976887 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:36:58.976887 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:36:58.976887 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:36:58.976887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4dea28ba-1ef3-4e59-9ca8-b6a016d55f1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:36:58.976887 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4dea28ba-1ef3-4e59-9ca8-b6a016d55f1e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 404 len: 111 microversion: 2.1 time: 0.128252 Sep 08 13:36:58.976887 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2857/5841] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:36:58 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:37:06.029558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6def308c-caae-4303-a64d-9ee2bec0207e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:06.030433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6def308c-caae-4303-a64d-9ee2bec0207e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:06.038565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=24 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:06.040915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6def308c-caae-4303-a64d-9ee2bec0207e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:06.041857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6def308c-caae-4303-a64d-9ee2bec0207e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:06.042390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6def308c-caae-4303-a64d-9ee2bec0207e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:06.043504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6def308c-caae-4303-a64d-9ee2bec0207e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:06.043953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6def308c-caae-4303-a64d-9ee2bec0207e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:06.044481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6def308c-caae-4303-a64d-9ee2bec0207e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:06.103078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=70 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:06.111613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6def308c-caae-4303-a64d-9ee2bec0207e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:37:06.277855 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6def308c-caae-4303-a64d-9ee2bec0207e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 204 len: 0 microversion: 2.1 time: 0.248620 Sep 08 13:37:06.280307 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2985/5842] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:37:06 2022] DELETE /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:37:06.293361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-25c60f7e-ace3-44d1-b673-4512a8b85446 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:06.295698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-25c60f7e-ace3-44d1-b673-4512a8b85446 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:06.305938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c60f7e-ace3-44d1-b673-4512a8b85446 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:06.306873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c60f7e-ace3-44d1-b673-4512a8b85446 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:06.307769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c60f7e-ace3-44d1-b673-4512a8b85446 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:06.309609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c60f7e-ace3-44d1-b673-4512a8b85446 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:06.310709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c60f7e-ace3-44d1-b673-4512a8b85446 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:06.311453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-25c60f7e-ace3-44d1-b673-4512a8b85446 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:06.737120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-25c60f7e-ace3-44d1-b673-4512a8b85446 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:06.758746 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-25c60f7e-ace3-44d1-b673-4512a8b85446 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1411 microversion: 2.1 time: 0.470906 Sep 08 13:37:06.760323 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2858/5843] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:06 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1411 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:37:07.791104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89e2cc5b-ff41-4da5-ba75-137158d79bc6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:07.792521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-89e2cc5b-ff41-4da5-ba75-137158d79bc6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:07.828643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e2cc5b-ff41-4da5-ba75-137158d79bc6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:07.829911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e2cc5b-ff41-4da5-ba75-137158d79bc6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:07.830725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e2cc5b-ff41-4da5-ba75-137158d79bc6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:07.834644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e2cc5b-ff41-4da5-ba75-137158d79bc6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:07.835674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e2cc5b-ff41-4da5-ba75-137158d79bc6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:07.836502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e2cc5b-ff41-4da5-ba75-137158d79bc6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:08.220457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6bbcea98-fa6a-4976-91c5-862124ce9821 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Action: 'create', calling method: .version_select at 0x7fdb39c93a60>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-15331025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN39phep8Wd19aJqBOji6bQA5At0bVAQXvaCa+gBL4XLMy7LWJaWS9g/5F2hg3uYNOaBuL6ik1NSGu/PX/ZNzbyouHxahjZNzpKYMulLSJOnRHcEVVPsQLRRqbFyeLVBBg=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:37:08.232936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:08.266157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-6bbcea98-fa6a-4976-91c5-862124ce9821 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Getting quotas for project 2a9ec535db3b43ddbf685fefd8d63133. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:37:08.277033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-6bbcea98-fa6a-4976-91c5-862124ce9821 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Getting quotas for user 893137c9f7ed48659241bc46293e77e1 and project 2a9ec535db3b43ddbf685fefd8d63133. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:37:08.337251 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6bbcea98-fa6a-4976-91c5-862124ce9821 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.467031 Sep 08 13:37:08.339519 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2859/5844] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:37:07 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:37:08.995149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-89e2cc5b-ff41-4da5-ba75-137158d79bc6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:09.031889 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-89e2cc5b-ff41-4da5-ba75-137158d79bc6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1411 microversion: 2.1 time: 1.248876 Sep 08 13:37:09.033585 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2986/5845] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:07 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1411 bytes in 1252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:37:09.680434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-6f340fb6-a188-45f8-b8d4-925fc19a909c req-3436e552-7211-4353-b0bb-5ed181942645 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0de350-5a12-4cf5-baed-833edfbaafe1", "name": "network-vif-deleted", "tag": "05a481cf-f474-46f7-a0e3-632a64ed95e1"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:37:09.706401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6f340fb6-a188-45f8-b8d4-925fc19a909c req-3436e552-7211-4353-b0bb-5ed181942645 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:09.708208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6f340fb6-a188-45f8-b8d4-925fc19a909c req-3436e552-7211-4353-b0bb-5ed181942645 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:09.722716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6f340fb6-a188-45f8-b8d4-925fc19a909c req-3436e552-7211-4353-b0bb-5ed181942645 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:09.740618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:09.761777 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-6f340fb6-a188-45f8-b8d4-925fc19a909c req-3436e552-7211-4353-b0bb-5ed181942645 service nova] Creating event network-vif-deleted:05a481cf-f474-46f7-a0e3-632a64ed95e1 for instance fa0de350-5a12-4cf5-baed-833edfbaafe1 on n-h2-852084-10 Sep 08 13:37:09.770738 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-6f340fb6-a188-45f8-b8d4-925fc19a909c req-3436e552-7211-4353-b0bb-5ed181942645 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110865 Sep 08 13:37:09.771766 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2860/5846] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:37:10.081369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b6c98f83-fbe2-4183-84d2-4f9a6c47866a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:10.087603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b6c98f83-fbe2-4183-84d2-4f9a6c47866a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:10.112111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6c98f83-fbe2-4183-84d2-4f9a6c47866a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:10.117123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6c98f83-fbe2-4183-84d2-4f9a6c47866a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:10.117990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6c98f83-fbe2-4183-84d2-4f9a6c47866a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:10.119347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6c98f83-fbe2-4183-84d2-4f9a6c47866a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:10.120329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6c98f83-fbe2-4183-84d2-4f9a6c47866a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:10.121154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6c98f83-fbe2-4183-84d2-4f9a6c47866a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:10.397841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b6c98f83-fbe2-4183-84d2-4f9a6c47866a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:10.428742 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b6c98f83-fbe2-4183-84d2-4f9a6c47866a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1202 microversion: 2.1 time: 0.354589 Sep 08 13:37:10.452330 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2987/5847] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:10 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1202 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:11.475770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f088569a-be63-45bb-aa5a-35e3f875a3de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:11.478460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f088569a-be63-45bb-aa5a-35e3f875a3de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:11.495131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f088569a-be63-45bb-aa5a-35e3f875a3de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:11.496154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f088569a-be63-45bb-aa5a-35e3f875a3de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:11.496897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f088569a-be63-45bb-aa5a-35e3f875a3de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:11.498635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f088569a-be63-45bb-aa5a-35e3f875a3de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:11.499607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f088569a-be63-45bb-aa5a-35e3f875a3de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:11.500388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f088569a-be63-45bb-aa5a-35e3f875a3de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:11.686145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f088569a-be63-45bb-aa5a-35e3f875a3de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:11.700714 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f088569a-be63-45bb-aa5a-35e3f875a3de tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1202 microversion: 2.1 time: 0.231237 Sep 08 13:37:11.701326 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2861/5848] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:11 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1202 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:12.726781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-39a39389-7e3e-4e06-a979-f70408fea3a4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:12.728323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-39a39389-7e3e-4e06-a979-f70408fea3a4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:12.746405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39a39389-7e3e-4e06-a979-f70408fea3a4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:12.747876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39a39389-7e3e-4e06-a979-f70408fea3a4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:12.749867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39a39389-7e3e-4e06-a979-f70408fea3a4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:12.751704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39a39389-7e3e-4e06-a979-f70408fea3a4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:12.755656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39a39389-7e3e-4e06-a979-f70408fea3a4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:12.757783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39a39389-7e3e-4e06-a979-f70408fea3a4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:12.925159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-39a39389-7e3e-4e06-a979-f70408fea3a4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:12.948831 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-39a39389-7e3e-4e06-a979-f70408fea3a4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1202 microversion: 2.1 time: 0.226994 Sep 08 13:37:12.949507 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2988/5849] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:12 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1202 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:37:13.990891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-981e5f9a-c0bb-4b3d-83dd-6a8f6120b25e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:14.005183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-981e5f9a-c0bb-4b3d-83dd-6a8f6120b25e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:14.063329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-981e5f9a-c0bb-4b3d-83dd-6a8f6120b25e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:14.064758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-981e5f9a-c0bb-4b3d-83dd-6a8f6120b25e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:14.069297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-981e5f9a-c0bb-4b3d-83dd-6a8f6120b25e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:14.071898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-981e5f9a-c0bb-4b3d-83dd-6a8f6120b25e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:14.073836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-981e5f9a-c0bb-4b3d-83dd-6a8f6120b25e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:14.076091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-981e5f9a-c0bb-4b3d-83dd-6a8f6120b25e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:14.309943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-981e5f9a-c0bb-4b3d-83dd-6a8f6120b25e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:14.343909 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-981e5f9a-c0bb-4b3d-83dd-6a8f6120b25e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1202 microversion: 2.1 time: 0.365054 Sep 08 13:37:14.371666 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2862/5850] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:13 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1202 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:15.406685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5bbff0e7-0f58-40a8-b1bd-81b48c968e3d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:15.413086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5bbff0e7-0f58-40a8-b1bd-81b48c968e3d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:15.443032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bbff0e7-0f58-40a8-b1bd-81b48c968e3d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:15.444664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bbff0e7-0f58-40a8-b1bd-81b48c968e3d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:15.445923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bbff0e7-0f58-40a8-b1bd-81b48c968e3d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:15.448097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bbff0e7-0f58-40a8-b1bd-81b48c968e3d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:15.452570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bbff0e7-0f58-40a8-b1bd-81b48c968e3d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:15.454089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bbff0e7-0f58-40a8-b1bd-81b48c968e3d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:15.666447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5bbff0e7-0f58-40a8-b1bd-81b48c968e3d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:15.688947 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5bbff0e7-0f58-40a8-b1bd-81b48c968e3d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1202 microversion: 2.1 time: 0.289630 Sep 08 13:37:15.692592 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2989/5851] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:15 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1202 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:16.744599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-724a9db6-d0b6-4194-b580-e0ea35c26629 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:16.761727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-724a9db6-d0b6-4194-b580-e0ea35c26629 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:16.803373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-724a9db6-d0b6-4194-b580-e0ea35c26629 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:16.806365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-724a9db6-d0b6-4194-b580-e0ea35c26629 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:16.808324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-724a9db6-d0b6-4194-b580-e0ea35c26629 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:16.811169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-724a9db6-d0b6-4194-b580-e0ea35c26629 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:16.812603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-724a9db6-d0b6-4194-b580-e0ea35c26629 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:16.815465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-724a9db6-d0b6-4194-b580-e0ea35c26629 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:17.062485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-724a9db6-d0b6-4194-b580-e0ea35c26629 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:17.097033 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-724a9db6-d0b6-4194-b580-e0ea35c26629 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1202 microversion: 2.1 time: 0.372847 Sep 08 13:37:17.104479 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2863/5852] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:16 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1202 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:18.153619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e7e069df-cbef-4d9a-812d-01fc768a1475 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:18.161260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e7e069df-cbef-4d9a-812d-01fc768a1475 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:18.192141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7e069df-cbef-4d9a-812d-01fc768a1475 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:18.193485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7e069df-cbef-4d9a-812d-01fc768a1475 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:18.201865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7e069df-cbef-4d9a-812d-01fc768a1475 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:18.203658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7e069df-cbef-4d9a-812d-01fc768a1475 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:18.208949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7e069df-cbef-4d9a-812d-01fc768a1475 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:18.212789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7e069df-cbef-4d9a-812d-01fc768a1475 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:18.418085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e7e069df-cbef-4d9a-812d-01fc768a1475 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:18.433690 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e7e069df-cbef-4d9a-812d-01fc768a1475 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1202 microversion: 2.1 time: 0.291460 Sep 08 13:37:18.435119 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2990/5853] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:18 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1202 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:19.491776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62fbc6cc-6e3f-483f-9e10-0d6268cf6393 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:19.493424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-62fbc6cc-6e3f-483f-9e10-0d6268cf6393 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:19.530058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:19.538893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62fbc6cc-6e3f-483f-9e10-0d6268cf6393 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:19.539759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62fbc6cc-6e3f-483f-9e10-0d6268cf6393 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:19.540431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62fbc6cc-6e3f-483f-9e10-0d6268cf6393 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:19.541582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62fbc6cc-6e3f-483f-9e10-0d6268cf6393 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:19.545490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62fbc6cc-6e3f-483f-9e10-0d6268cf6393 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:19.546648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62fbc6cc-6e3f-483f-9e10-0d6268cf6393 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:19.793890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-62fbc6cc-6e3f-483f-9e10-0d6268cf6393 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:19.860794 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62fbc6cc-6e3f-483f-9e10-0d6268cf6393 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 200 len: 1202 microversion: 2.1 time: 0.384924 Sep 08 13:37:19.868332 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2864/5854] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:19 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 1202 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:20.427075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-1627948337-access_point-1881459328", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "e0034a7c-a2a8-4fdd-be3b-90e1a1b55c00"}], "key_name": "tempest-TestSecurityGroupsBasicOps-15331025", "security_groups": [{"name": "tempest-secgroup_access--2001424668"}, {"name": "tempest-secgroup_general--70874033"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:37:20.753220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] validate_networks() for [('e0034a7c-a2a8-4fdd-be3b-90e1a1b55c00', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:37:20.903721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-004281ec-9365-43b1-b430-27a4a1e69f25 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:20.905075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-004281ec-9365-43b1-b430-27a4a1e69f25 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:20.933673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-004281ec-9365-43b1-b430-27a4a1e69f25 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:20.934731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-004281ec-9365-43b1-b430-27a4a1e69f25 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:20.935602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-004281ec-9365-43b1-b430-27a4a1e69f25 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:20.936951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-004281ec-9365-43b1-b430-27a4a1e69f25 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:20.937896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-004281ec-9365-43b1-b430-27a4a1e69f25 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:20.938905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-004281ec-9365-43b1-b430-27a4a1e69f25 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:20.997783 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-004281ec-9365-43b1-b430-27a4a1e69f25 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-004281ec-9365-43b1-b430-27a4a1e69f25 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 HTTP/1.1 Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'fa0de350-5a12-4cf5-baed-833edfbaafe1'} Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:37:21.001395 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:37:21.011820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:21.011820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:37:21.011820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:37:21.011820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:37:21.011820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:37:21.011820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:21.011820 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:37:21.011820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-004281ec-9365-43b1-b430-27a4a1e69f25 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:37:21.011820 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-004281ec-9365-43b1-b430-27a4a1e69f25 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 404 len: 111 microversion: 2.1 time: 0.111910 Sep 08 13:37:21.019611 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2865/5855] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:20 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:37:22.011672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:37:22.012656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:37:22.013970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:37:22.014946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:37:22.016347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:37:22.057414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:22.058957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:22.060200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:22.062080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:22.063602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:22.064649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:22.125733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Getting quotas for project 2a9ec535db3b43ddbf685fefd8d63133. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:37:22.138752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Getting quotas for user 893137c9f7ed48659241bc46293e77e1 and project 2a9ec535db3b43ddbf685fefd8d63133. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:37:22.172622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:37:22.178341 n-d-852084-10 devstack@n-api.service[128970]: WARNING nova.utils [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-1627948337-access_point-1881459328 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-1627948337-ac Sep 08 13:37:22.180639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:37:22.386671 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f95b1c2e-0294-4661-bf0c-c2cce290a269 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 1.963132 Sep 08 13:37:22.400255 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2991/5856] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:37:20 2022] POST /compute/v2.1/servers => generated 456 bytes in 1979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:37:22.414189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a0f2897d-8706-45da-9a20-534e0606246d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:22.414912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a0f2897d-8706-45da-9a20-534e0606246d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:22.614176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a0f2897d-8706-45da-9a20-534e0606246d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:22.642188 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a0f2897d-8706-45da-9a20-534e0606246d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1293 microversion: 2.1 time: 0.232367 Sep 08 13:37:22.643800 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2866/5857] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:22 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1293 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:23.669919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-465ecf69-bfca-4891-9d9e-36c22d98bd75 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:23.671414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-465ecf69-bfca-4891-9d9e-36c22d98bd75 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:23.858409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-465ecf69-bfca-4891-9d9e-36c22d98bd75 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:23.880141 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-465ecf69-bfca-4891-9d9e-36c22d98bd75 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1293 microversion: 2.1 time: 0.214969 Sep 08 13:37:23.896488 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2992/5858] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:23 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1293 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:24.922883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-481b9584-5a70-4170-a659-9bb2ad9b5c6b tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:24.924716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-481b9584-5a70-4170-a659-9bb2ad9b5c6b tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:24.934510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-481b9584-5a70-4170-a659-9bb2ad9b5c6b tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:24.935387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-481b9584-5a70-4170-a659-9bb2ad9b5c6b tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:24.936196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-481b9584-5a70-4170-a659-9bb2ad9b5c6b tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:24.937202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-481b9584-5a70-4170-a659-9bb2ad9b5c6b tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:24.938028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-481b9584-5a70-4170-a659-9bb2ad9b5c6b tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:24.938980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-481b9584-5a70-4170-a659-9bb2ad9b5c6b tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:25.024373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-481b9584-5a70-4170-a659-9bb2ad9b5c6b tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:25.035490 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-481b9584-5a70-4170-a659-9bb2ad9b5c6b tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1345 microversion: 2.1 time: 0.116538 Sep 08 13:37:25.036798 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2867/5859] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:24 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1345 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:26.082278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f9c7491a-8280-4cca-bcaa-4021bed084c9 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:26.087997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f9c7491a-8280-4cca-bcaa-4021bed084c9 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:26.133157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9c7491a-8280-4cca-bcaa-4021bed084c9 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:26.134458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9c7491a-8280-4cca-bcaa-4021bed084c9 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:26.135611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9c7491a-8280-4cca-bcaa-4021bed084c9 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:26.141160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9c7491a-8280-4cca-bcaa-4021bed084c9 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:26.142101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9c7491a-8280-4cca-bcaa-4021bed084c9 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:26.144304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f9c7491a-8280-4cca-bcaa-4021bed084c9 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:26.744860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f9c7491a-8280-4cca-bcaa-4021bed084c9 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:26.767096 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f9c7491a-8280-4cca-bcaa-4021bed084c9 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1351 microversion: 2.1 time: 0.693853 Sep 08 13:37:26.784172 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2993/5860] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:26 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1351 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:27.817396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-efb1db53-fefb-43e9-9e19-1b59a6845bd1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:27.841707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-efb1db53-fefb-43e9-9e19-1b59a6845bd1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:27.899890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efb1db53-fefb-43e9-9e19-1b59a6845bd1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:27.903663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efb1db53-fefb-43e9-9e19-1b59a6845bd1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:27.905022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efb1db53-fefb-43e9-9e19-1b59a6845bd1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:27.906797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efb1db53-fefb-43e9-9e19-1b59a6845bd1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:27.910791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efb1db53-fefb-43e9-9e19-1b59a6845bd1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:27.919910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efb1db53-fefb-43e9-9e19-1b59a6845bd1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:28.507789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-efb1db53-fefb-43e9-9e19-1b59a6845bd1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:28.520894 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-efb1db53-fefb-43e9-9e19-1b59a6845bd1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1469 microversion: 2.1 time: 0.715022 Sep 08 13:37:28.521509 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2868/5861] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:27 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1469 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:29.177323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-8cf0e5c3-4d56-410f-8926-267ec36f981a req-a0d7d58f-52b6-455e-ae75-0568362e83cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2888231-fc98-4390-b7b1-0a01797b2d42", "tag": "4657ae4d-4f0f-40e9-9beb-f7fbaa11447f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:37:29.232339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8cf0e5c3-4d56-410f-8926-267ec36f981a req-a0d7d58f-52b6-455e-ae75-0568362e83cf service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:29.240293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8cf0e5c3-4d56-410f-8926-267ec36f981a req-a0d7d58f-52b6-455e-ae75-0568362e83cf service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:29.241154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8cf0e5c3-4d56-410f-8926-267ec36f981a req-a0d7d58f-52b6-455e-ae75-0568362e83cf service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:29.267215 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-8cf0e5c3-4d56-410f-8926-267ec36f981a req-a0d7d58f-52b6-455e-ae75-0568362e83cf service nova] Creating event network-changed:4657ae4d-4f0f-40e9-9beb-f7fbaa11447f for instance c2888231-fc98-4390-b7b1-0a01797b2d42 on n-h2-852084-10 Sep 08 13:37:29.288860 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-8cf0e5c3-4d56-410f-8926-267ec36f981a req-a0d7d58f-52b6-455e-ae75-0568362e83cf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116971 Sep 08 13:37:29.289962 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2994/5862] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:37:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:37:29.565305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1984fbb1-dbf3-4b54-b300-bde99a96ff1d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:29.571384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1984fbb1-dbf3-4b54-b300-bde99a96ff1d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:29.631622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1984fbb1-dbf3-4b54-b300-bde99a96ff1d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:29.633880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1984fbb1-dbf3-4b54-b300-bde99a96ff1d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:29.634275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1984fbb1-dbf3-4b54-b300-bde99a96ff1d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:29.636136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1984fbb1-dbf3-4b54-b300-bde99a96ff1d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:29.636619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1984fbb1-dbf3-4b54-b300-bde99a96ff1d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:29.639615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1984fbb1-dbf3-4b54-b300-bde99a96ff1d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:30.510693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1984fbb1-dbf3-4b54-b300-bde99a96ff1d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:30.526631 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1984fbb1-dbf3-4b54-b300-bde99a96ff1d tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1469 microversion: 2.1 time: 0.971586 Sep 08 13:37:30.533649 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2869/5863] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:29 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1469 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:31.571365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-36b4b04c-2571-4ae3-9fd5-5133d4502690 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:31.572752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-36b4b04c-2571-4ae3-9fd5-5133d4502690 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:31.580182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bc0f95a3-2624-4ed7-98c3-ffdb775f100e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:31.581592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bc0f95a3-2624-4ed7-98c3-ffdb775f100e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:31.588524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36b4b04c-2571-4ae3-9fd5-5133d4502690 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:31.593885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36b4b04c-2571-4ae3-9fd5-5133d4502690 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:31.594571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36b4b04c-2571-4ae3-9fd5-5133d4502690 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:31.595668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36b4b04c-2571-4ae3-9fd5-5133d4502690 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:31.603178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36b4b04c-2571-4ae3-9fd5-5133d4502690 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:31.604203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36b4b04c-2571-4ae3-9fd5-5133d4502690 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:31.611552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc0f95a3-2624-4ed7-98c3-ffdb775f100e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:31.612559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc0f95a3-2624-4ed7-98c3-ffdb775f100e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:31.618805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc0f95a3-2624-4ed7-98c3-ffdb775f100e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:31.620650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc0f95a3-2624-4ed7-98c3-ffdb775f100e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:31.621115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc0f95a3-2624-4ed7-98c3-ffdb775f100e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:31.621666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc0f95a3-2624-4ed7-98c3-ffdb775f100e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:31.631154 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-36b4b04c-2571-4ae3-9fd5-5133d4502690 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-36b4b04c-2571-4ae3-9fd5-5133d4502690 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 HTTP/1.1 Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'a846a957-fcf3-4d20-a86d-d585a7e34f21'} Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:37:31.633465 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:37:31.638860 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:37:31.638860 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:31.638860 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:37:31.638860 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:31.638860 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:31.638860 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:37:31.638860 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:37:31.638860 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:37:31.638860 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:37:31.638860 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:37:31.638860 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:31.642369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-36b4b04c-2571-4ae3-9fd5-5133d4502690 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:37:31.643689 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-36b4b04c-2571-4ae3-9fd5-5133d4502690 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 404 len: 111 microversion: 2.1 time: 0.085846 Sep 08 13:37:31.650650 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2995/5864] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:37:31 2022] DELETE /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:37:31.658683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca2f1288-3363-414f-adc7-8feacb950dfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:31.663138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ca2f1288-3363-414f-adc7-8feacb950dfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a846a957-fcf3-4d20-a86d-d585a7e34f21] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:31.686417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca2f1288-3363-414f-adc7-8feacb950dfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:31.687259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca2f1288-3363-414f-adc7-8feacb950dfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:31.689710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca2f1288-3363-414f-adc7-8feacb950dfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:31.693416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca2f1288-3363-414f-adc7-8feacb950dfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:31.694120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca2f1288-3363-414f-adc7-8feacb950dfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:31.694821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca2f1288-3363-414f-adc7-8feacb950dfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:31.721094 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-ca2f1288-3363-414f-adc7-8feacb950dfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca2f1288-3363-414f-adc7-8feacb950dfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 HTTP/1.1 Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'a846a957-fcf3-4d20-a86d-d585a7e34f21'} Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:37:31.724146 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:31.730460 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:31.730460 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:37:31.730460 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:37:31.730460 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:37:31.730460 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:37:31.730460 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. Sep 08 13:37:31.730460 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:31.732223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca2f1288-3363-414f-adc7-8feacb950dfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance a846a957-fcf3-4d20-a86d-d585a7e34f21 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:37:31.733404 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca2f1288-3363-414f-adc7-8feacb950dfe tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21" status: 404 len: 111 microversion: 2.1 time: 0.079116 Sep 08 13:37:31.735543 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2996/5865] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:31 2022] GET /compute/v2.1/servers/a846a957-fcf3-4d20-a86d-d585a7e34f21 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:37:32.020592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bc0f95a3-2624-4ed7-98c3-ffdb775f100e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:32.044720 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bc0f95a3-2624-4ed7-98c3-ffdb775f100e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1469 microversion: 2.1 time: 0.469070 Sep 08 13:37:32.065241 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2870/5866] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:31 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1469 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:37:32.827189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c1ea2d5c-6d7a-4def-a1a1-1fd154299b0c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:32.828083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c1ea2d5c-6d7a-4def-a1a1-1fd154299b0c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:32.842154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1ea2d5c-6d7a-4def-a1a1-1fd154299b0c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1ea2d5c-6d7a-4def-a1a1-1fd154299b0c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1ea2d5c-6d7a-4def-a1a1-1fd154299b0c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1ea2d5c-6d7a-4def-a1a1-1fd154299b0c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1ea2d5c-6d7a-4def-a1a1-1fd154299b0c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1ea2d5c-6d7a-4def-a1a1-1fd154299b0c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-c1ea2d5c-6d7a-4def-a1a1-1fd154299b0c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c1ea2d5c-6d7a-4def-a1a1-1fd154299b0c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 HTTP/1.1 Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:37:33.055634 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'fa0de350-5a12-4cf5-baed-833edfbaafe1'} Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c1ea2d5c-6d7a-4def-a1a1-1fd154299b0c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c1ea2d5c-6d7a-4def-a1a1-1fd154299b0c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 404 len: 111 microversion: 2.1 time: 0.131008 Sep 08 13:37:33.064290 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2997/5867] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:37:32 2022] DELETE /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fcf42c2-7371-4dec-aeed-bb7afae8c1a1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1fcf42c2-7371-4dec-aeed-bb7afae8c1a1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: fa0de350-5a12-4cf5-baed-833edfbaafe1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fcf42c2-7371-4dec-aeed-bb7afae8c1a1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fcf42c2-7371-4dec-aeed-bb7afae8c1a1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fcf42c2-7371-4dec-aeed-bb7afae8c1a1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fcf42c2-7371-4dec-aeed-bb7afae8c1a1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fcf42c2-7371-4dec-aeed-bb7afae8c1a1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fcf42c2-7371-4dec-aeed-bb7afae8c1a1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1fcf42c2-7371-4dec-aeed-bb7afae8c1a1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fcf42c2-7371-4dec-aeed-bb7afae8c1a1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 HTTP/1.1 Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:37:33.074137 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'fa0de350-5a12-4cf5-baed-833edfbaafe1'} Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:37:33.078809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fcf42c2-7371-4dec-aeed-bb7afae8c1a1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance fa0de350-5a12-4cf5-baed-833edfbaafe1 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:37:33.086361 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1fcf42c2-7371-4dec-aeed-bb7afae8c1a1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1" status: 404 len: 111 microversion: 2.1 time: 0.074213 Sep 08 13:37:33.086361 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2871/5868] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:32 2022] GET /compute/v2.1/servers/fa0de350-5a12-4cf5-baed-833edfbaafe1 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:37:33.094702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1c928fc3-add5-45b4-9904-99fbd91b3827 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:33.099037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1c928fc3-add5-45b4-9904-99fbd91b3827 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:33.114307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c928fc3-add5-45b4-9904-99fbd91b3827 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:33.115272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c928fc3-add5-45b4-9904-99fbd91b3827 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:33.116093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c928fc3-add5-45b4-9904-99fbd91b3827 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:33.117408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c928fc3-add5-45b4-9904-99fbd91b3827 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:33.118307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c928fc3-add5-45b4-9904-99fbd91b3827 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:33.119147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c928fc3-add5-45b4-9904-99fbd91b3827 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:33.175346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fb65e0d8-23f8-4d03-82cd-b72a8ab9c794 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Action: 'create', calling method: .version_select at 0x7fdb39cfce50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1418132249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGoxTPbQ+kNDoRqmMhmROzmufRZr7F16coThusWf9oBILog+Gqu9puZLFf5cdZUL0WEKD1xkNnCvphWQDTBiYAONuC9ncqiXEK3M6xcs+L8SXuaEHrCnF+fi8gecHx9WHQ=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:37:33.197408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-fb65e0d8-23f8-4d03-82cd-b72a8ab9c794 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for project c2e0170321894cfeae69bdf34f6a4517. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:37:33.209124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-fb65e0d8-23f8-4d03-82cd-b72a8ab9c794 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for user 6f65d872026946a7a6badc404b161499 and project c2e0170321894cfeae69bdf34f6a4517. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:37:33.261741 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fb65e0d8-23f8-4d03-82cd-b72a8ab9c794 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.094433 Sep 08 13:37:33.263174 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2872/5869] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:37:33 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:37:33.425877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1c928fc3-add5-45b4-9904-99fbd91b3827 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:33.447429 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1c928fc3-add5-45b4-9904-99fbd91b3827 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1469 microversion: 2.1 time: 0.360596 Sep 08 13:37:33.456523 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2998/5870] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:33 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1469 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:34.492687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2fa5629a-cff0-4e99-bab3-a599e9ba50be tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:34.493914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2fa5629a-cff0-4e99-bab3-a599e9ba50be tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:34.539635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fa5629a-cff0-4e99-bab3-a599e9ba50be tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:34.540798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fa5629a-cff0-4e99-bab3-a599e9ba50be tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:34.541648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fa5629a-cff0-4e99-bab3-a599e9ba50be tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:34.543019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fa5629a-cff0-4e99-bab3-a599e9ba50be tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:34.546978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fa5629a-cff0-4e99-bab3-a599e9ba50be tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:34.548473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2fa5629a-cff0-4e99-bab3-a599e9ba50be tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:34.936631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2fa5629a-cff0-4e99-bab3-a599e9ba50be tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:34.960980 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2fa5629a-cff0-4e99-bab3-a599e9ba50be tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1469 microversion: 2.1 time: 0.476751 Sep 08 13:37:34.962993 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2873/5871] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:34 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1469 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:36.000161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-55a20193-3063-47d9-b607-209db827bea5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:36.001136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-55a20193-3063-47d9-b607-209db827bea5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:36.013644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:36.026296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55a20193-3063-47d9-b607-209db827bea5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:36.029062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55a20193-3063-47d9-b607-209db827bea5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:36.032176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55a20193-3063-47d9-b607-209db827bea5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:36.033793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55a20193-3063-47d9-b607-209db827bea5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:36.054853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55a20193-3063-47d9-b607-209db827bea5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:36.058530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-55a20193-3063-47d9-b607-209db827bea5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:36.071977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3a898183-ac43-4e4e-9148-0f05bd75786e req-e3451ace-13c1-4057-8b67-c23055555f31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2888231-fc98-4390-b7b1-0a01797b2d42", "name": "network-vif-plugged", "status": "completed", "tag": "4657ae4d-4f0f-40e9-9beb-f7fbaa11447f"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:37:36.103512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3a898183-ac43-4e4e-9148-0f05bd75786e req-e3451ace-13c1-4057-8b67-c23055555f31 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:36.104488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3a898183-ac43-4e4e-9148-0f05bd75786e req-e3451ace-13c1-4057-8b67-c23055555f31 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:36.105300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3a898183-ac43-4e4e-9148-0f05bd75786e req-e3451ace-13c1-4057-8b67-c23055555f31 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:36.129737 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3a898183-ac43-4e4e-9148-0f05bd75786e req-e3451ace-13c1-4057-8b67-c23055555f31 service nova] Creating event network-vif-plugged:4657ae4d-4f0f-40e9-9beb-f7fbaa11447f for instance c2888231-fc98-4390-b7b1-0a01797b2d42 on n-h2-852084-10 Sep 08 13:37:36.144524 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3a898183-ac43-4e4e-9148-0f05bd75786e req-e3451ace-13c1-4057-8b67-c23055555f31 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078370 Sep 08 13:37:36.147967 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2874/5872] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:37:36.494926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-55a20193-3063-47d9-b607-209db827bea5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:36.505206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:36.516664 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-55a20193-3063-47d9-b607-209db827bea5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1469 microversion: 2.1 time: 0.523186 Sep 08 13:37:36.521078 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 2999/5873] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:35 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1469 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:37.562413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-03c226fe-3cad-4534-8999-71d52838df39 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:37.563824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-03c226fe-3cad-4534-8999-71d52838df39 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:37.574546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03c226fe-3cad-4534-8999-71d52838df39 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:37.575427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03c226fe-3cad-4534-8999-71d52838df39 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:37.576139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03c226fe-3cad-4534-8999-71d52838df39 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:37.577258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03c226fe-3cad-4534-8999-71d52838df39 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:37.578064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03c226fe-3cad-4534-8999-71d52838df39 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:37.578785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03c226fe-3cad-4534-8999-71d52838df39 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:38.133132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-03c226fe-3cad-4534-8999-71d52838df39 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:38.143361 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-03c226fe-3cad-4534-8999-71d52838df39 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1469 microversion: 2.1 time: 0.597766 Sep 08 13:37:38.149915 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2875/5874] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:37 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1469 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:39.173896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6da9b53-463b-4ce7-a3ce-d1ef41f13d32 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:39.175141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f6da9b53-463b-4ce7-a3ce-d1ef41f13d32 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:39.179686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:39.204155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6da9b53-463b-4ce7-a3ce-d1ef41f13d32 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:39.204677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6da9b53-463b-4ce7-a3ce-d1ef41f13d32 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:39.205367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6da9b53-463b-4ce7-a3ce-d1ef41f13d32 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:39.207661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6da9b53-463b-4ce7-a3ce-d1ef41f13d32 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:39.209366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6da9b53-463b-4ce7-a3ce-d1ef41f13d32 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:39.210394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6da9b53-463b-4ce7-a3ce-d1ef41f13d32 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:39.624639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f6da9b53-463b-4ce7-a3ce-d1ef41f13d32 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:39.649862 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f6da9b53-463b-4ce7-a3ce-d1ef41f13d32 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1640 microversion: 2.1 time: 0.484161 Sep 08 13:37:39.668382 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3000/5875] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:39 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1640 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:39.698148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-64d01afb-a9cc-4f72-b0e9-a37f59b44520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:39.705408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-64d01afb-a9cc-4f72-b0e9-a37f59b44520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:39.733103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:39.742977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64d01afb-a9cc-4f72-b0e9-a37f59b44520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:39.747376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64d01afb-a9cc-4f72-b0e9-a37f59b44520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:39.747926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64d01afb-a9cc-4f72-b0e9-a37f59b44520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:39.749246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64d01afb-a9cc-4f72-b0e9-a37f59b44520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:39.750039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64d01afb-a9cc-4f72-b0e9-a37f59b44520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:39.756764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64d01afb-a9cc-4f72-b0e9-a37f59b44520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:40.209573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-64d01afb-a9cc-4f72-b0e9-a37f59b44520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:37:40.266033 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-64d01afb-a9cc-4f72-b0e9-a37f59b44520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1640 microversion: 2.1 time: 0.573973 Sep 08 13:37:40.279303 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2876/5876] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:39 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1640 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:37:40.314250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9fbb0167-3bb3-4e73-9278-6fb3d8063722 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:37:40.315203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9fbb0167-3bb3-4e73-9278-6fb3d8063722 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:37:40.333406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9fbb0167-3bb3-4e73-9278-6fb3d8063722 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:40.333915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9fbb0167-3bb3-4e73-9278-6fb3d8063722 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:40.334384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9fbb0167-3bb3-4e73-9278-6fb3d8063722 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:40.335807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9fbb0167-3bb3-4e73-9278-6fb3d8063722 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:40.336557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9fbb0167-3bb3-4e73-9278-6fb3d8063722 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:40.337013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9fbb0167-3bb3-4e73-9278-6fb3d8063722 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:41.115636 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9fbb0167-3bb3-4e73-9278-6fb3d8063722 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1793 microversion: 2.1 time: 0.806056 Sep 08 13:37:41.116546 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3001/5877] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:37:40 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1793 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:37:45.626241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:46.032957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2cd34c0c-00d3-4d71-8e00-f75f3bc1fa7d req-529de7db-c0ee-47fe-8511-b8ce9fba87d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2888231-fc98-4390-b7b1-0a01797b2d42", "tag": "4657ae4d-4f0f-40e9-9beb-f7fbaa11447f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:37:46.068723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2cd34c0c-00d3-4d71-8e00-f75f3bc1fa7d req-529de7db-c0ee-47fe-8511-b8ce9fba87d0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:37:46.069282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2cd34c0c-00d3-4d71-8e00-f75f3bc1fa7d req-529de7db-c0ee-47fe-8511-b8ce9fba87d0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:37:46.072678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2cd34c0c-00d3-4d71-8e00-f75f3bc1fa7d req-529de7db-c0ee-47fe-8511-b8ce9fba87d0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:37:46.113910 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2cd34c0c-00d3-4d71-8e00-f75f3bc1fa7d req-529de7db-c0ee-47fe-8511-b8ce9fba87d0 service nova] Creating event network-changed:4657ae4d-4f0f-40e9-9beb-f7fbaa11447f for instance c2888231-fc98-4390-b7b1-0a01797b2d42 on n-h2-852084-10 Sep 08 13:37:46.127346 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2cd34c0c-00d3-4d71-8e00-f75f3bc1fa7d req-529de7db-c0ee-47fe-8511-b8ce9fba87d0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099494 Sep 08 13:37:46.128477 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3002/5878] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:37:46.292307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8ec0422e-91d5-4ecb-86ad-269a5cd1b5ba tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'create', calling method: .version_select at 0x7fdb39f350d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1654183059", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxEIr+jISbvAeAhl0RXB3WNf+mOqgm6astFLSOIONaUSia6o7PRpe8jn4Gs6ls5BCzqZvvkYLRUxxjSVLJC1EqE8yV4U7iJQC90ZczEXj2FF/qE70Mp4fs298tK4EovRg=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:37:46.350429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-8ec0422e-91d5-4ecb-86ad-269a5cd1b5ba tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for project cbd130c38aeb4b23b1907212bfe92619. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:37:46.369554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-8ec0422e-91d5-4ecb-86ad-269a5cd1b5ba tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for user c3fb5a1860bd4f118dc19ec38c1796d1 and project cbd130c38aeb4b23b1907212bfe92619. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:37:46.426487 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8ec0422e-91d5-4ecb-86ad-269a5cd1b5ba tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.805811 Sep 08 13:37:46.438083 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2877/5879] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:37:45 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:37:58.884784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-848943811", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "90719597-2c06-4f3c-9348-406db3150a40"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1654183059", "security_groups": [{"name": "tempest-secgroup-smoke-928162512"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:37:58.914940 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:37:58.915384 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 13:37:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Sep 08 13:37:58.920146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=5 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:58.921281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=15 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:37:59.148311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] validate_networks() for [('90719597-2c06-4f3c-9348-406db3150a40', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:38:00.161930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:38:00.162771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:38:00.162962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:38:00.163387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:38:00.164128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:38:00.198084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:00.199678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:00.200686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:00.208796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:00.216671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:00.219010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:00.268107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for project cbd130c38aeb4b23b1907212bfe92619. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:38:00.280385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for user c3fb5a1860bd4f118dc19ec38c1796d1 and project cbd130c38aeb4b23b1907212bfe92619. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:38:00.310317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:38:00.315913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:38:00.412058 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8b94c019-32e1-4fd9-9d74-f62a664807d9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.540442 Sep 08 13:38:00.428788 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3003/5880] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:37:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:38:00.432150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4db7abfe-6b0d-42f5-99fe-3dbfeb279a34 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:00.433308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4db7abfe-6b0d-42f5-99fe-3dbfeb279a34 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:00.437066 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:38:00.437353 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 13:38:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d (ip 10.222.0.78) !!! Sep 08 13:38:00.460148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=73 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:00.465644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:00.468962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=12,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:00.582517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4db7abfe-6b0d-42f5-99fe-3dbfeb279a34 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:00.592251 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4db7abfe-6b0d-42f5-99fe-3dbfeb279a34 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1266 microversion: 2.1 time: 0.166872 Sep 08 13:38:00.593962 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2878/5881] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:00 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:01.644315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2c1ff977-7848-4f64-b857-b6061230c9e6 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:01.645171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2c1ff977-7848-4f64-b857-b6061230c9e6 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:01.672826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1ff977-7848-4f64-b857-b6061230c9e6 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:01.678611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1ff977-7848-4f64-b857-b6061230c9e6 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:01.679958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1ff977-7848-4f64-b857-b6061230c9e6 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:01.700261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1ff977-7848-4f64-b857-b6061230c9e6 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:01.701347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1ff977-7848-4f64-b857-b6061230c9e6 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:01.702415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1ff977-7848-4f64-b857-b6061230c9e6 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:01.889477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2c1ff977-7848-4f64-b857-b6061230c9e6 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:01.926476 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2c1ff977-7848-4f64-b857-b6061230c9e6 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1270 microversion: 2.1 time: 0.290202 Sep 08 13:38:01.928280 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3004/5882] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:01 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1270 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:02.961762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b58e950-378a-4695-a7f5-90447af8b2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:02.962778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1b58e950-378a-4695-a7f5-90447af8b2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:02.999904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b58e950-378a-4695-a7f5-90447af8b2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:03.000805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b58e950-378a-4695-a7f5-90447af8b2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:03.001632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b58e950-378a-4695-a7f5-90447af8b2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:03.002991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b58e950-378a-4695-a7f5-90447af8b2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:03.004436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b58e950-378a-4695-a7f5-90447af8b2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:03.005177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b58e950-378a-4695-a7f5-90447af8b2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:03.130124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1b58e950-378a-4695-a7f5-90447af8b2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:03.146773 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1b58e950-378a-4695-a7f5-90447af8b2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1324 microversion: 2.1 time: 0.192635 Sep 08 13:38:03.151739 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2879/5883] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:02 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1324 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:04.197694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1e0e7bdd-9645-4376-b0da-06477ed381d8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:04.198972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1e0e7bdd-9645-4376-b0da-06477ed381d8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:04.229019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e0e7bdd-9645-4376-b0da-06477ed381d8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:04.229966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e0e7bdd-9645-4376-b0da-06477ed381d8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:04.230813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e0e7bdd-9645-4376-b0da-06477ed381d8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:04.232247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e0e7bdd-9645-4376-b0da-06477ed381d8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:04.243850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e0e7bdd-9645-4376-b0da-06477ed381d8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:04.244970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e0e7bdd-9645-4376-b0da-06477ed381d8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:04.685238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1e0e7bdd-9645-4376-b0da-06477ed381d8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:04.698375 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1e0e7bdd-9645-4376-b0da-06477ed381d8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1391 microversion: 2.1 time: 0.509720 Sep 08 13:38:04.703976 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3005/5884] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:04 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1391 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:05.733535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-64ceddb1-7d97-425f-9f78-914c8364fc6d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:05.738292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-64ceddb1-7d97-425f-9f78-914c8364fc6d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:05.756721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64ceddb1-7d97-425f-9f78-914c8364fc6d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:05.757417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64ceddb1-7d97-425f-9f78-914c8364fc6d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:05.761501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64ceddb1-7d97-425f-9f78-914c8364fc6d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:05.766163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64ceddb1-7d97-425f-9f78-914c8364fc6d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:05.767325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64ceddb1-7d97-425f-9f78-914c8364fc6d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:05.768537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64ceddb1-7d97-425f-9f78-914c8364fc6d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:05.899729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b1141e19-a0ea-46db-be70-1ec91ec2b741 req-a9376804-9dd7-457a-a363-a8286c7603f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16259878-2ec8-465b-8777-b178ff771d9d", "tag": "251d8243-f2b8-4578-bdc0-9bada8b3f1d9"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:05.914763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b1141e19-a0ea-46db-be70-1ec91ec2b741 req-a9376804-9dd7-457a-a363-a8286c7603f7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:05.926744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b1141e19-a0ea-46db-be70-1ec91ec2b741 req-a9376804-9dd7-457a-a363-a8286c7603f7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:05.929249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b1141e19-a0ea-46db-be70-1ec91ec2b741 req-a9376804-9dd7-457a-a363-a8286c7603f7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:05.949564 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b1141e19-a0ea-46db-be70-1ec91ec2b741 req-a9376804-9dd7-457a-a363-a8286c7603f7 service nova] Creating event network-changed:251d8243-f2b8-4578-bdc0-9bada8b3f1d9 for instance 16259878-2ec8-465b-8777-b178ff771d9d on n-h1-852084-10 Sep 08 13:38:05.975824 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b1141e19-a0ea-46db-be70-1ec91ec2b741 req-a9376804-9dd7-457a-a363-a8286c7603f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080772 Sep 08 13:38:05.976956 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3006/5885] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:38:06.027055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-64ceddb1-7d97-425f-9f78-914c8364fc6d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:06.038868 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-64ceddb1-7d97-425f-9f78-914c8364fc6d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1391 microversion: 2.1 time: 0.313792 Sep 08 13:38:06.040590 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2880/5886] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:05 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1391 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:06.734490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-777c8991-09f3-41c6-b5d0-664b80916bd6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Action: 'create', calling method: .version_select at 0x7fdb37006e50>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-765478080", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNY7tC2sbHSom5a7cN5fKRjHaRgCfrTvuyS0Vv2/Rz6lVvfrTqj2MeBX2MQwjMdz4C9GfEw9NqkOUPq6uQD//Jwuz6FLxj6I/cl0HFVN5tbKdSux5jBN4Na2uVeLDnryVA=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:06.771411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-777c8991-09f3-41c6-b5d0-664b80916bd6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Getting quotas for project 1c8da2571de94d3ea65fdd8536a7cab7. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:38:06.780186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-777c8991-09f3-41c6-b5d0-664b80916bd6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Getting quotas for user 5461fd7292894933988ca9b07b70d2a3 and project 1c8da2571de94d3ea65fdd8536a7cab7. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:38:06.820734 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-777c8991-09f3-41c6-b5d0-664b80916bd6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.091626 Sep 08 13:38:06.821915 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3007/5887] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:38:06 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:38:07.065798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6dac5352-fcac-4dfa-86d5-ba2658eb5f1d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:07.067383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6dac5352-fcac-4dfa-86d5-ba2658eb5f1d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:07.076280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6dac5352-fcac-4dfa-86d5-ba2658eb5f1d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:07.077211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6dac5352-fcac-4dfa-86d5-ba2658eb5f1d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:07.078246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6dac5352-fcac-4dfa-86d5-ba2658eb5f1d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:07.079472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6dac5352-fcac-4dfa-86d5-ba2658eb5f1d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:07.080211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6dac5352-fcac-4dfa-86d5-ba2658eb5f1d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:07.080761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6dac5352-fcac-4dfa-86d5-ba2658eb5f1d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:07.466922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6dac5352-fcac-4dfa-86d5-ba2658eb5f1d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:07.479093 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6dac5352-fcac-4dfa-86d5-ba2658eb5f1d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1391 microversion: 2.1 time: 0.418162 Sep 08 13:38:07.479942 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2881/5888] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:07 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1391 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:08.509060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-70f920ee-e653-40bd-b2b2-34349f9557e5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:08.511828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-70f920ee-e653-40bd-b2b2-34349f9557e5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:08.541654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f920ee-e653-40bd-b2b2-34349f9557e5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:08.542962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f920ee-e653-40bd-b2b2-34349f9557e5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:08.544391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f920ee-e653-40bd-b2b2-34349f9557e5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:08.546051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f920ee-e653-40bd-b2b2-34349f9557e5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:08.549205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f920ee-e653-40bd-b2b2-34349f9557e5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:08.551030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70f920ee-e653-40bd-b2b2-34349f9557e5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:09.080934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-70f920ee-e653-40bd-b2b2-34349f9557e5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:09.099534 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-70f920ee-e653-40bd-b2b2-34349f9557e5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1391 microversion: 2.1 time: 0.598977 Sep 08 13:38:09.101489 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3008/5889] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:08 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1391 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:10.142528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-73a01655-d559-40f5-b0a3-fd8ebd781ae0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:10.143809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-73a01655-d559-40f5-b0a3-fd8ebd781ae0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:10.144101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-1951044298", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "32cc234a-a3c7-4cb7-b10a-78f03249a10a", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-765478080", "security_groups": [{"name": "tempest-secgroup-smoke-1501970575"}], "networks": [{"uuid": "efc0da92-30c9-4bcb-a9e8-884c6d2512da"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:10.155422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73a01655-d559-40f5-b0a3-fd8ebd781ae0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:10.156428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73a01655-d559-40f5-b0a3-fd8ebd781ae0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:10.157355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73a01655-d559-40f5-b0a3-fd8ebd781ae0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:10.160075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73a01655-d559-40f5-b0a3-fd8ebd781ae0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:10.162376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73a01655-d559-40f5-b0a3-fd8ebd781ae0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:10.163434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73a01655-d559-40f5-b0a3-fd8ebd781ae0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:10.260288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:10.384462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] validate_networks() for [('efc0da92-30c9-4bcb-a9e8-884c6d2512da', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:38:10.491363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-73a01655-d559-40f5-b0a3-fd8ebd781ae0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:10.502539 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-73a01655-d559-40f5-b0a3-fd8ebd781ae0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1391 microversion: 2.1 time: 0.367909 Sep 08 13:38:10.503162 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2882/5890] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:10 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1391 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:10.969960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:38:10.971083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:38:10.972264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:38:10.973295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:38:10.974593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:38:10.995360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:10.996691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:10.997486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:10.998864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:11.000045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:11.001455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:11.038325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Getting quotas for project 1c8da2571de94d3ea65fdd8536a7cab7. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:38:11.051086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Getting quotas for user 5461fd7292894933988ca9b07b70d2a3 and project 1c8da2571de94d3ea65fdd8536a7cab7. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:38:11.117402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1676579272", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1418132249", "security_groups": [{"name": "tempest-secgroup-smoke-834206503"}], "block_device_mapping_v2": [{"uuid": "c7514d65-8c06-4683-a242-6a42a89b86dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd09c139-4c62-4afa-ac6f-48ed313685b7"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:11.129571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:11.149109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:38:11.151415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='32cc234a-a3c7-4cb7-b10a-78f03249a10a',volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:38:11.272335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] validate_networks() for [('dd09c139-4c62-4afa-ac6f-48ed313685b7', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:38:11.365354 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cde23003-36cc-41e1-8781-8dd30f664366 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.225747 Sep 08 13:38:11.366441 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3009/5891] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:38:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 13:38:11.384145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b84a270c-344e-4f43-94b7-9f753ccacba8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:11.385181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b84a270c-344e-4f43-94b7-9f753ccacba8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:11.474275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b84a270c-344e-4f43-94b7-9f753ccacba8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:11.519553 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b84a270c-344e-4f43-94b7-9f753ccacba8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1098 microversion: 2.1 time: 0.127455 Sep 08 13:38:11.521743 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3010/5892] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:11 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1098 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:11.546856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89605958-527d-4d82-8e17-e40789daf4ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:11.551707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-89605958-527d-4d82-8e17-e40789daf4ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:11.559504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89605958-527d-4d82-8e17-e40789daf4ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:11.560435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89605958-527d-4d82-8e17-e40789daf4ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:11.561267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89605958-527d-4d82-8e17-e40789daf4ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:11.562709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89605958-527d-4d82-8e17-e40789daf4ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:11.563486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89605958-527d-4d82-8e17-e40789daf4ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:11.563992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89605958-527d-4d82-8e17-e40789daf4ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:11.803565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-89605958-527d-4d82-8e17-e40789daf4ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:11.819967 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-89605958-527d-4d82-8e17-e40789daf4ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1391 microversion: 2.1 time: 0.294016 Sep 08 13:38:11.832206 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3011/5893] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:11 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1391 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:11.854716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7ca8cced-c279-48a0-a8ee-65f4c159e664 req-626b5ef4-acb5-4dd2-81ea-464e008d22dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16259878-2ec8-465b-8777-b178ff771d9d", "name": "network-vif-plugged", "status": "completed", "tag": "251d8243-f2b8-4578-bdc0-9bada8b3f1d9"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:11.872701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7ca8cced-c279-48a0-a8ee-65f4c159e664 req-626b5ef4-acb5-4dd2-81ea-464e008d22dd service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:11.874078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7ca8cced-c279-48a0-a8ee-65f4c159e664 req-626b5ef4-acb5-4dd2-81ea-464e008d22dd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:11.875129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7ca8cced-c279-48a0-a8ee-65f4c159e664 req-626b5ef4-acb5-4dd2-81ea-464e008d22dd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:11.889428 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7ca8cced-c279-48a0-a8ee-65f4c159e664 req-626b5ef4-acb5-4dd2-81ea-464e008d22dd service nova] Creating event network-vif-plugged:251d8243-f2b8-4578-bdc0-9bada8b3f1d9 for instance 16259878-2ec8-465b-8777-b178ff771d9d on n-h1-852084-10 Sep 08 13:38:11.896022 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7ca8cced-c279-48a0-a8ee-65f4c159e664 req-626b5ef4-acb5-4dd2-81ea-464e008d22dd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061874 Sep 08 13:38:11.897077 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3012/5894] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:38:12.218774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:38:12.219579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:38:12.220211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:38:12.220806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:38:12.221533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:38:12.234943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:12.235503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:12.235917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:12.236669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:12.237126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:12.237609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:12.261299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:38:12.270669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for user 6f65d872026946a7a6badc404b161499 and project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:38:12.375999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:38:12.379048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7514d65-8c06-4683-a242-6a42a89b86dd',volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:38:12.557487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-01e4468e-ef82-4621-a52b-2db7d09b54e8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:12.558953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-01e4468e-ef82-4621-a52b-2db7d09b54e8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:12.571200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01e4468e-ef82-4621-a52b-2db7d09b54e8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:12.572072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01e4468e-ef82-4621-a52b-2db7d09b54e8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:12.572740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01e4468e-ef82-4621-a52b-2db7d09b54e8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:12.574404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01e4468e-ef82-4621-a52b-2db7d09b54e8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:12.582504 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3dfe17e0-fe3c-42ab-b58e-2922e3fff748 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.470869 Sep 08 13:38:12.589623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01e4468e-ef82-4621-a52b-2db7d09b54e8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:12.590709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01e4468e-ef82-4621-a52b-2db7d09b54e8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:12.593920 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2883/5895] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:38:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 1484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:38:12.603016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a4ea698a-0461-499a-be33-6ccd8ccbb340 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:12.604392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a4ea698a-0461-499a-be33-6ccd8ccbb340 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:12.701454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a4ea698a-0461-499a-be33-6ccd8ccbb340 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:12.718922 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a4ea698a-0461-499a-be33-6ccd8ccbb340 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1095 microversion: 2.1 time: 0.123488 Sep 08 13:38:12.719686 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2884/5896] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:12 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1095 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:12.773203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-01e4468e-ef82-4621-a52b-2db7d09b54e8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:12.789198 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-01e4468e-ef82-4621-a52b-2db7d09b54e8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1140 microversion: 2.1 time: 0.239018 Sep 08 13:38:12.789711 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3013/5897] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:12 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1140 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:12.862470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c2a0cc0b-0b8c-497c-85a0-a3fff67bc9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:12.865746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c2a0cc0b-0b8c-497c-85a0-a3fff67bc9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:12.889881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2a0cc0b-0b8c-497c-85a0-a3fff67bc9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:12.890745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2a0cc0b-0b8c-497c-85a0-a3fff67bc9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:12.891689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2a0cc0b-0b8c-497c-85a0-a3fff67bc9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:12.893204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2a0cc0b-0b8c-497c-85a0-a3fff67bc9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:12.894314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2a0cc0b-0b8c-497c-85a0-a3fff67bc9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:12.895115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c2a0cc0b-0b8c-497c-85a0-a3fff67bc9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:13.127205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c2a0cc0b-0b8c-497c-85a0-a3fff67bc9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:13.142751 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c2a0cc0b-0b8c-497c-85a0-a3fff67bc9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1391 microversion: 2.1 time: 0.287265 Sep 08 13:38:13.148177 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2885/5898] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:12 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1391 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:13.749180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-124f0556-5e4a-471b-b2ad-e164a90e2d65 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:13.750740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-124f0556-5e4a-471b-b2ad-e164a90e2d65 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:13.759045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-124f0556-5e4a-471b-b2ad-e164a90e2d65 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:13.759586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-124f0556-5e4a-471b-b2ad-e164a90e2d65 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:13.760289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-124f0556-5e4a-471b-b2ad-e164a90e2d65 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:13.761084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-124f0556-5e4a-471b-b2ad-e164a90e2d65 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:13.761565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-124f0556-5e4a-471b-b2ad-e164a90e2d65 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:13.762478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-124f0556-5e4a-471b-b2ad-e164a90e2d65 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:13.815391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a324e99d-0084-467a-ba90-f6d1f3a5d400 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:13.816293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a324e99d-0084-467a-ba90-f6d1f3a5d400 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:13.827217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a324e99d-0084-467a-ba90-f6d1f3a5d400 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:13.828480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a324e99d-0084-467a-ba90-f6d1f3a5d400 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:13.829313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a324e99d-0084-467a-ba90-f6d1f3a5d400 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:13.830699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a324e99d-0084-467a-ba90-f6d1f3a5d400 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:13.832093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a324e99d-0084-467a-ba90-f6d1f3a5d400 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:13.832875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a324e99d-0084-467a-ba90-f6d1f3a5d400 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:13.867593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-124f0556-5e4a-471b-b2ad-e164a90e2d65 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:13.890442 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-124f0556-5e4a-471b-b2ad-e164a90e2d65 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1137 microversion: 2.1 time: 0.145132 Sep 08 13:38:13.892872 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3014/5899] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:13 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1137 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:14.006477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a324e99d-0084-467a-ba90-f6d1f3a5d400 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:14.023722 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a324e99d-0084-467a-ba90-f6d1f3a5d400 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1214 microversion: 2.1 time: 0.213051 Sep 08 13:38:14.025303 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2886/5900] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:13 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:14.178020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fd7fa614-fd6b-4e79-aca3-0431e5744a15 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:14.178950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fd7fa614-fd6b-4e79-aca3-0431e5744a15 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:14.200719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd7fa614-fd6b-4e79-aca3-0431e5744a15 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:14.202017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd7fa614-fd6b-4e79-aca3-0431e5744a15 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:14.205327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd7fa614-fd6b-4e79-aca3-0431e5744a15 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:14.208847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd7fa614-fd6b-4e79-aca3-0431e5744a15 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:14.212125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd7fa614-fd6b-4e79-aca3-0431e5744a15 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:14.213445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd7fa614-fd6b-4e79-aca3-0431e5744a15 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:14.658580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fd7fa614-fd6b-4e79-aca3-0431e5744a15 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:14.671667 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fd7fa614-fd6b-4e79-aca3-0431e5744a15 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1562 microversion: 2.1 time: 0.500542 Sep 08 13:38:14.673453 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3015/5901] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:14 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1562 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:14.720678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ae593fb-818d-460e-bae3-095a6a3ecef8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:14.722292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ae593fb-818d-460e-bae3-095a6a3ecef8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:14.738393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ae593fb-818d-460e-bae3-095a6a3ecef8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:14.740289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ae593fb-818d-460e-bae3-095a6a3ecef8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:14.741762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ae593fb-818d-460e-bae3-095a6a3ecef8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:14.749001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ae593fb-818d-460e-bae3-095a6a3ecef8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:14.749001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ae593fb-818d-460e-bae3-095a6a3ecef8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:14.749001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ae593fb-818d-460e-bae3-095a6a3ecef8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:14.927281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f512fe5d-1344-415c-b042-9fcf2181e796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:14.928207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f512fe5d-1344-415c-b042-9fcf2181e796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:14.938935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f512fe5d-1344-415c-b042-9fcf2181e796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:14.939926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f512fe5d-1344-415c-b042-9fcf2181e796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:14.940472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f512fe5d-1344-415c-b042-9fcf2181e796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:14.942072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f512fe5d-1344-415c-b042-9fcf2181e796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:14.943553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f512fe5d-1344-415c-b042-9fcf2181e796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:14.944332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f512fe5d-1344-415c-b042-9fcf2181e796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:15.096278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f512fe5d-1344-415c-b042-9fcf2181e796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:15.116770 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f512fe5d-1344-415c-b042-9fcf2181e796 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1211 microversion: 2.1 time: 0.193471 Sep 08 13:38:15.118698 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3016/5902] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:14 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1211 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:15.132119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4e37bac-7015-42bd-a303-226c4d7ecded tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:15.133824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a4e37bac-7015-42bd-a303-226c4d7ecded tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:15.152104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4e37bac-7015-42bd-a303-226c4d7ecded tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:15.154364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4e37bac-7015-42bd-a303-226c4d7ecded tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:15.156959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4e37bac-7015-42bd-a303-226c4d7ecded tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:15.168218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4e37bac-7015-42bd-a303-226c4d7ecded tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:15.169797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4e37bac-7015-42bd-a303-226c4d7ecded tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:15.177367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4e37bac-7015-42bd-a303-226c4d7ecded tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:15.238839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ae593fb-818d-460e-bae3-095a6a3ecef8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:15.262125 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ae593fb-818d-460e-bae3-095a6a3ecef8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1562 microversion: 2.1 time: 0.547909 Sep 08 13:38:15.270690 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2887/5903] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:14 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1562 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:15.912059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4e37bac-7015-42bd-a303-226c4d7ecded tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:15.950636 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a4e37bac-7015-42bd-a303-226c4d7ecded tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1282 microversion: 2.1 time: 0.829437 Sep 08 13:38:15.964275 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3017/5904] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:15 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1282 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:16.161147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d5c772f1-d456-456e-bffa-2451be10ec95 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:16.161961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d5c772f1-d456-456e-bffa-2451be10ec95 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:16.182163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5c772f1-d456-456e-bffa-2451be10ec95 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:16.184055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5c772f1-d456-456e-bffa-2451be10ec95 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:16.185179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5c772f1-d456-456e-bffa-2451be10ec95 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:16.188191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5c772f1-d456-456e-bffa-2451be10ec95 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:16.189049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5c772f1-d456-456e-bffa-2451be10ec95 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:16.190156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5c772f1-d456-456e-bffa-2451be10ec95 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:16.407587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d5c772f1-d456-456e-bffa-2451be10ec95 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:16.433365 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d5c772f1-d456-456e-bffa-2451be10ec95 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1211 microversion: 2.1 time: 0.277618 Sep 08 13:38:16.434287 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2888/5905] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:16 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1211 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:16.995810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fab04d7b-d2eb-4504-b018-b7a5488b83eb tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:16.997893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fab04d7b-d2eb-4504-b018-b7a5488b83eb tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:17.008624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fab04d7b-d2eb-4504-b018-b7a5488b83eb tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:17.009452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fab04d7b-d2eb-4504-b018-b7a5488b83eb tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:17.010156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fab04d7b-d2eb-4504-b018-b7a5488b83eb tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:17.011440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fab04d7b-d2eb-4504-b018-b7a5488b83eb tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:17.012385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fab04d7b-d2eb-4504-b018-b7a5488b83eb tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:17.013265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fab04d7b-d2eb-4504-b018-b7a5488b83eb tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:17.478874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a305f75d-f8db-454e-b4c4-828b4da45f04 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:17.480063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a305f75d-f8db-454e-b4c4-828b4da45f04 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:17.493324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a305f75d-f8db-454e-b4c4-828b4da45f04 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:17.494936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a305f75d-f8db-454e-b4c4-828b4da45f04 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:17.496023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a305f75d-f8db-454e-b4c4-828b4da45f04 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:17.497029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a305f75d-f8db-454e-b4c4-828b4da45f04 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:17.498603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a305f75d-f8db-454e-b4c4-828b4da45f04 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:17.499528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a305f75d-f8db-454e-b4c4-828b4da45f04 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:17.819582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fab04d7b-d2eb-4504-b018-b7a5488b83eb tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:17.855755 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fab04d7b-d2eb-4504-b018-b7a5488b83eb tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1282 microversion: 2.1 time: 0.868004 Sep 08 13:38:17.884579 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3018/5906] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:16 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1282 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:17.974530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a305f75d-f8db-454e-b4c4-828b4da45f04 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:18.037072 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a305f75d-f8db-454e-b4c4-828b4da45f04 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1278 microversion: 2.1 time: 0.562205 Sep 08 13:38:18.038186 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2889/5907] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:17 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1278 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:18.740734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-d90ecb04-c922-4c73-b819-c802685c598d req-3ff1c1c2-e305-4b12-9b84-c08836eb1c0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2163760c-c909-4c33-8b11-ec59a37d3b06", "tag": "ce1af655-8223-49ec-abc2-e506d1114d41"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:18.797223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d90ecb04-c922-4c73-b819-c802685c598d req-3ff1c1c2-e305-4b12-9b84-c08836eb1c0f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:18.800669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d90ecb04-c922-4c73-b819-c802685c598d req-3ff1c1c2-e305-4b12-9b84-c08836eb1c0f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:18.801387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3eeb661b-1fbc-4d58-a152-fc8f681b76d4 req-c114d626-9205-48a1-8376-947a86178503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc4b2224-da7c-4884-a959-f880d4af9288", "tag": "5c1dbb5f-ff8f-4faf-807f-fcfefc7fa64d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:18.803747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-d90ecb04-c922-4c73-b819-c802685c598d req-3ff1c1c2-e305-4b12-9b84-c08836eb1c0f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:18.835642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3eeb661b-1fbc-4d58-a152-fc8f681b76d4 req-c114d626-9205-48a1-8376-947a86178503 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:18.836503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3eeb661b-1fbc-4d58-a152-fc8f681b76d4 req-c114d626-9205-48a1-8376-947a86178503 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:18.837161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3eeb661b-1fbc-4d58-a152-fc8f681b76d4 req-c114d626-9205-48a1-8376-947a86178503 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:18.858858 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-d90ecb04-c922-4c73-b819-c802685c598d req-3ff1c1c2-e305-4b12-9b84-c08836eb1c0f service nova] Creating event network-changed:ce1af655-8223-49ec-abc2-e506d1114d41 for instance 2163760c-c909-4c33-8b11-ec59a37d3b06 on n-h2-852084-10 Sep 08 13:38:18.869924 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3eeb661b-1fbc-4d58-a152-fc8f681b76d4 req-c114d626-9205-48a1-8376-947a86178503 service nova] Creating event network-changed:5c1dbb5f-ff8f-4faf-807f-fcfefc7fa64d for instance dc4b2224-da7c-4884-a959-f880d4af9288 on n-h1-852084-10 Sep 08 13:38:18.874632 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-d90ecb04-c922-4c73-b819-c802685c598d req-3ff1c1c2-e305-4b12-9b84-c08836eb1c0f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136488 Sep 08 13:38:18.877543 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3019/5908] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:38:18.913741 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3eeb661b-1fbc-4d58-a152-fc8f681b76d4 req-c114d626-9205-48a1-8376-947a86178503 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116018 Sep 08 13:38:18.917634 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2890/5909] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:38:18.921054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c9e8479c-87cd-4ad8-953e-bc7e9452e627 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:18.925997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c9e8479c-87cd-4ad8-953e-bc7e9452e627 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:18.939695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9e8479c-87cd-4ad8-953e-bc7e9452e627 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:18.941069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9e8479c-87cd-4ad8-953e-bc7e9452e627 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:18.942086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9e8479c-87cd-4ad8-953e-bc7e9452e627 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:18.943343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9e8479c-87cd-4ad8-953e-bc7e9452e627 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:18.944135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9e8479c-87cd-4ad8-953e-bc7e9452e627 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:18.945391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9e8479c-87cd-4ad8-953e-bc7e9452e627 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:19.076422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6331f441-6c50-48f6-9cb0-7b36f810b102 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:19.077344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6331f441-6c50-48f6-9cb0-7b36f810b102 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:19.096075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6331f441-6c50-48f6-9cb0-7b36f810b102 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:19.097701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6331f441-6c50-48f6-9cb0-7b36f810b102 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:19.098682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6331f441-6c50-48f6-9cb0-7b36f810b102 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:19.099734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6331f441-6c50-48f6-9cb0-7b36f810b102 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:19.100477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6331f441-6c50-48f6-9cb0-7b36f810b102 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:19.101819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6331f441-6c50-48f6-9cb0-7b36f810b102 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:19.401784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c9e8479c-87cd-4ad8-953e-bc7e9452e627 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:19.424685 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c9e8479c-87cd-4ad8-953e-bc7e9452e627 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1282 microversion: 2.1 time: 0.519508 Sep 08 13:38:19.425587 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3020/5910] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:18 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1282 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:20.166351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6331f441-6c50-48f6-9cb0-7b36f810b102 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:20.193946 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6331f441-6c50-48f6-9cb0-7b36f810b102 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1278 microversion: 2.1 time: 1.134410 Sep 08 13:38:20.199807 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2891/5911] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:19 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1278 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:20.472383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3e8a7c7f-b016-4338-9b2d-3dd98d1be01f tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:20.481997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3e8a7c7f-b016-4338-9b2d-3dd98d1be01f tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:20.505549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e8a7c7f-b016-4338-9b2d-3dd98d1be01f tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:20.506938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e8a7c7f-b016-4338-9b2d-3dd98d1be01f tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:20.509217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e8a7c7f-b016-4338-9b2d-3dd98d1be01f tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:20.511132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e8a7c7f-b016-4338-9b2d-3dd98d1be01f tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:20.513481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e8a7c7f-b016-4338-9b2d-3dd98d1be01f tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:20.514986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3e8a7c7f-b016-4338-9b2d-3dd98d1be01f tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:21.016079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:21.171103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3e8a7c7f-b016-4338-9b2d-3dd98d1be01f tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:21.182629 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3e8a7c7f-b016-4338-9b2d-3dd98d1be01f tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1282 microversion: 2.1 time: 0.734682 Sep 08 13:38:21.185376 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3021/5912] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:20 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1282 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:21.239744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-94aa8a7d-7e9c-4e88-a3c4-ec2cce765975 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:21.242759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-94aa8a7d-7e9c-4e88-a3c4-ec2cce765975 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:21.272074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94aa8a7d-7e9c-4e88-a3c4-ec2cce765975 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:21.273036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94aa8a7d-7e9c-4e88-a3c4-ec2cce765975 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:21.274761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94aa8a7d-7e9c-4e88-a3c4-ec2cce765975 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:21.277544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94aa8a7d-7e9c-4e88-a3c4-ec2cce765975 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:21.278260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94aa8a7d-7e9c-4e88-a3c4-ec2cce765975 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:21.280711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94aa8a7d-7e9c-4e88-a3c4-ec2cce765975 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:21.563060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-94aa8a7d-7e9c-4e88-a3c4-ec2cce765975 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:21.574564 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-94aa8a7d-7e9c-4e88-a3c4-ec2cce765975 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1278 microversion: 2.1 time: 0.351822 Sep 08 13:38:21.588514 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2892/5913] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:21 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1278 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:22.208005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e68d8008-b96a-4676-a43e-70b52a9646e2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:22.209469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e68d8008-b96a-4676-a43e-70b52a9646e2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:22.227895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=18 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:22.230945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e68d8008-b96a-4676-a43e-70b52a9646e2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:22.236945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e68d8008-b96a-4676-a43e-70b52a9646e2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:22.238452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e68d8008-b96a-4676-a43e-70b52a9646e2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:22.244398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e68d8008-b96a-4676-a43e-70b52a9646e2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:22.245423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e68d8008-b96a-4676-a43e-70b52a9646e2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:22.247204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e68d8008-b96a-4676-a43e-70b52a9646e2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:22.628849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e1396b06-45a9-4821-ad28-c715aceeaf6e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:22.636883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e1396b06-45a9-4821-ad28-c715aceeaf6e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:22.646748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:22.681859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1396b06-45a9-4821-ad28-c715aceeaf6e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:22.688699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1396b06-45a9-4821-ad28-c715aceeaf6e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:22.689712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1396b06-45a9-4821-ad28-c715aceeaf6e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:22.691019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1396b06-45a9-4821-ad28-c715aceeaf6e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:22.692044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1396b06-45a9-4821-ad28-c715aceeaf6e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:22.702195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1396b06-45a9-4821-ad28-c715aceeaf6e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:22.722668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:23.003639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e68d8008-b96a-4676-a43e-70b52a9646e2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:23.040103 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e68d8008-b96a-4676-a43e-70b52a9646e2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1282 microversion: 2.1 time: 0.836716 Sep 08 13:38:23.041754 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3022/5914] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:22 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1282 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:23.078163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-32f5222f-aad4-4377-801f-6923dd20c012 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:23.080662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-32f5222f-aad4-4377-801f-6923dd20c012 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:23.114797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32f5222f-aad4-4377-801f-6923dd20c012 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:23.118605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32f5222f-aad4-4377-801f-6923dd20c012 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:23.119661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32f5222f-aad4-4377-801f-6923dd20c012 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:23.124517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32f5222f-aad4-4377-801f-6923dd20c012 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:23.125419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32f5222f-aad4-4377-801f-6923dd20c012 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:23.128555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32f5222f-aad4-4377-801f-6923dd20c012 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:23.228218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e1396b06-45a9-4821-ad28-c715aceeaf6e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:23.246693 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e1396b06-45a9-4821-ad28-c715aceeaf6e tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1278 microversion: 2.1 time: 0.629470 Sep 08 13:38:23.250005 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2893/5915] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:22 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1278 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:23.267135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3801e11c-f9c3-45a0-9c96-5d9b01fadd93 req-ffcec302-7c9d-4fb9-9b16-60ea61cec4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16259878-2ec8-465b-8777-b178ff771d9d", "tag": "251d8243-f2b8-4578-bdc0-9bada8b3f1d9"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:23.294186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3801e11c-f9c3-45a0-9c96-5d9b01fadd93 req-ffcec302-7c9d-4fb9-9b16-60ea61cec4a6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:23.296754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3801e11c-f9c3-45a0-9c96-5d9b01fadd93 req-ffcec302-7c9d-4fb9-9b16-60ea61cec4a6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:23.299475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3801e11c-f9c3-45a0-9c96-5d9b01fadd93 req-ffcec302-7c9d-4fb9-9b16-60ea61cec4a6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:23.333058 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3801e11c-f9c3-45a0-9c96-5d9b01fadd93 req-ffcec302-7c9d-4fb9-9b16-60ea61cec4a6 service nova] Creating event network-changed:251d8243-f2b8-4578-bdc0-9bada8b3f1d9 for instance 16259878-2ec8-465b-8777-b178ff771d9d on n-h1-852084-10 Sep 08 13:38:23.342673 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3801e11c-f9c3-45a0-9c96-5d9b01fadd93 req-ffcec302-7c9d-4fb9-9b16-60ea61cec4a6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088285 Sep 08 13:38:23.344496 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2894/5916] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:38:23.557445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-32f5222f-aad4-4377-801f-6923dd20c012 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:23.576980 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-32f5222f-aad4-4377-801f-6923dd20c012 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1562 microversion: 2.1 time: 0.528336 Sep 08 13:38:23.577968 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3023/5917] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:23 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1562 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:24.077019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2b79a5e9-4a49-40ad-8c34-8ac8411a91d1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:24.079746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2b79a5e9-4a49-40ad-8c34-8ac8411a91d1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:24.093880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b79a5e9-4a49-40ad-8c34-8ac8411a91d1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:24.095500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b79a5e9-4a49-40ad-8c34-8ac8411a91d1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:24.098112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b79a5e9-4a49-40ad-8c34-8ac8411a91d1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:24.102745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b79a5e9-4a49-40ad-8c34-8ac8411a91d1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:24.103784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b79a5e9-4a49-40ad-8c34-8ac8411a91d1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:24.106364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2b79a5e9-4a49-40ad-8c34-8ac8411a91d1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:24.280534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7f320771-9b3b-4ccd-9f7b-b7b535bba2b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:24.281774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7f320771-9b3b-4ccd-9f7b-b7b535bba2b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:24.375713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f320771-9b3b-4ccd-9f7b-b7b535bba2b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:24.376704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f320771-9b3b-4ccd-9f7b-b7b535bba2b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:24.377440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f320771-9b3b-4ccd-9f7b-b7b535bba2b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:24.378899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f320771-9b3b-4ccd-9f7b-b7b535bba2b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:24.381068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f320771-9b3b-4ccd-9f7b-b7b535bba2b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:24.386703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f320771-9b3b-4ccd-9f7b-b7b535bba2b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:24.672564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2b79a5e9-4a49-40ad-8c34-8ac8411a91d1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:24.709108 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2b79a5e9-4a49-40ad-8c34-8ac8411a91d1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1282 microversion: 2.1 time: 0.634526 Sep 08 13:38:24.710467 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2895/5918] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:24 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1282 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:24.976761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7f320771-9b3b-4ccd-9f7b-b7b535bba2b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:24.982378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:25.002617 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7f320771-9b3b-4ccd-9f7b-b7b535bba2b6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1278 microversion: 2.1 time: 0.727747 Sep 08 13:38:25.016400 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3024/5919] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:24 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1278 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:25.755014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-601a56d3-6d41-443d-aef1-12753fd6da8e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:25.757428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-601a56d3-6d41-443d-aef1-12753fd6da8e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:25.787896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-601a56d3-6d41-443d-aef1-12753fd6da8e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:25.794936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-601a56d3-6d41-443d-aef1-12753fd6da8e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:25.795917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-601a56d3-6d41-443d-aef1-12753fd6da8e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:25.797662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-601a56d3-6d41-443d-aef1-12753fd6da8e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:25.798643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-601a56d3-6d41-443d-aef1-12753fd6da8e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:25.799546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-601a56d3-6d41-443d-aef1-12753fd6da8e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:26.056698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-11ddc243-d0bc-4135-9d61-a423c82a2263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:26.063330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-11ddc243-d0bc-4135-9d61-a423c82a2263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:26.117691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11ddc243-d0bc-4135-9d61-a423c82a2263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:26.118612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11ddc243-d0bc-4135-9d61-a423c82a2263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:26.119498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11ddc243-d0bc-4135-9d61-a423c82a2263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:26.124099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11ddc243-d0bc-4135-9d61-a423c82a2263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:26.127858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11ddc243-d0bc-4135-9d61-a423c82a2263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:26.129724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11ddc243-d0bc-4135-9d61-a423c82a2263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:26.609024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-601a56d3-6d41-443d-aef1-12753fd6da8e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:26.618807 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-601a56d3-6d41-443d-aef1-12753fd6da8e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1282 microversion: 2.1 time: 0.877786 Sep 08 13:38:26.621147 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2896/5920] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:25 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1282 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:26.687206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-11ddc243-d0bc-4135-9d61-a423c82a2263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:26.701375 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-11ddc243-d0bc-4135-9d61-a423c82a2263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1278 microversion: 2.1 time: 0.667915 Sep 08 13:38:26.707081 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3025/5921] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:26 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1278 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:27.663817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1c4cbedf-4c74-429a-89f9-ac64ab730fe6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:27.665122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1c4cbedf-4c74-429a-89f9-ac64ab730fe6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:27.679828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c4cbedf-4c74-429a-89f9-ac64ab730fe6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:27.680918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c4cbedf-4c74-429a-89f9-ac64ab730fe6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:27.689637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c4cbedf-4c74-429a-89f9-ac64ab730fe6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:27.691553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c4cbedf-4c74-429a-89f9-ac64ab730fe6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:27.692244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c4cbedf-4c74-429a-89f9-ac64ab730fe6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:27.692889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c4cbedf-4c74-429a-89f9-ac64ab730fe6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:27.743088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-69e0aa5d-9400-4857-9afe-f649097b0f00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:27.744016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-69e0aa5d-9400-4857-9afe-f649097b0f00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:27.760790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69e0aa5d-9400-4857-9afe-f649097b0f00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:27.762681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69e0aa5d-9400-4857-9afe-f649097b0f00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:27.763275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69e0aa5d-9400-4857-9afe-f649097b0f00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:27.766825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69e0aa5d-9400-4857-9afe-f649097b0f00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:27.768148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69e0aa5d-9400-4857-9afe-f649097b0f00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:27.775921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69e0aa5d-9400-4857-9afe-f649097b0f00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:28.173074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1c4cbedf-4c74-429a-89f9-ac64ab730fe6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:28.188398 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1c4cbedf-4c74-429a-89f9-ac64ab730fe6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1282 microversion: 2.1 time: 0.532730 Sep 08 13:38:28.196954 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2897/5922] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:27 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1282 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:28.238493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-69e0aa5d-9400-4857-9afe-f649097b0f00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:28.273446 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-69e0aa5d-9400-4857-9afe-f649097b0f00 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1278 microversion: 2.1 time: 0.534856 Sep 08 13:38:28.297446 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3026/5923] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:27 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1278 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:28.961444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1567023091", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "93a114a4-a9e6-48d3-9019-650e813fe8d8"}], "key_name": "tempest-TestSecurityGroupsBasicOps-15331025", "security_groups": []}, "os:scheduler_hints": {"different_host": ["c2888231-fc98-4390-b7b1-0a01797b2d42"]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:29.050521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] validate_networks() for [('93a114a4-a9e6-48d3-9019-650e813fe8d8', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:38:29.244431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5b7ff7e6-bb82-4296-8812-84efd3873519 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:29.248641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5b7ff7e6-bb82-4296-8812-84efd3873519 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:29.265788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:29.276961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b7ff7e6-bb82-4296-8812-84efd3873519 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:29.302684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b7ff7e6-bb82-4296-8812-84efd3873519 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:29.303942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b7ff7e6-bb82-4296-8812-84efd3873519 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:29.305907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b7ff7e6-bb82-4296-8812-84efd3873519 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:29.307109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b7ff7e6-bb82-4296-8812-84efd3873519 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:29.308338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b7ff7e6-bb82-4296-8812-84efd3873519 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:29.785577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5b7ff7e6-bb82-4296-8812-84efd3873519 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:29.805694 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5b7ff7e6-bb82-4296-8812-84efd3873519 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1270 microversion: 2.1 time: 0.569340 Sep 08 13:38:29.808150 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3027/5924] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:29 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1270 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:29.819071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-29b49ae6-b82d-4832-b5b9-bd15041ed246 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:29.820751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-29b49ae6-b82d-4832-b5b9-bd15041ed246 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:29.843181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29b49ae6-b82d-4832-b5b9-bd15041ed246 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:29.845338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29b49ae6-b82d-4832-b5b9-bd15041ed246 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:29.846060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29b49ae6-b82d-4832-b5b9-bd15041ed246 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:29.848308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29b49ae6-b82d-4832-b5b9-bd15041ed246 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:29.849494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29b49ae6-b82d-4832-b5b9-bd15041ed246 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:29.850823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-29b49ae6-b82d-4832-b5b9-bd15041ed246 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:29.872431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:38:29.873248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:38:29.873917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:38:29.874438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:38:29.874971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:38:29.890246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:29.891281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:29.892435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:29.893813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:29.894423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:29.894965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:29.940045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Getting quotas for project 2a9ec535db3b43ddbf685fefd8d63133. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:38:29.955276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Getting quotas for user 893137c9f7ed48659241bc46293e77e1 and project 2a9ec535db3b43ddbf685fefd8d63133. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:38:29.992800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:38:29.997771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:38:30.100947 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-16b68951-638c-42ff-99e3-a8c748f73a7f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.147303 Sep 08 13:38:30.102448 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2898/5925] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:38:28 2022] POST /compute/v2.1/servers => generated 361 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:38:30.116845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2cde2909-f7db-4bb4-93e7-210e5d203533 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:30.118241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2cde2909-f7db-4bb4-93e7-210e5d203533 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:30.215130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2cde2909-f7db-4bb4-93e7-210e5d203533 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:30.236577 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2cde2909-f7db-4bb4-93e7-210e5d203533 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1240 microversion: 2.1 time: 0.124905 Sep 08 13:38:30.242820 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2899/5926] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:30 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1240 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:30.264695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-29b49ae6-b82d-4832-b5b9-bd15041ed246 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:30.299040 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-29b49ae6-b82d-4832-b5b9-bd15041ed246 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1278 microversion: 2.1 time: 0.487330 Sep 08 13:38:30.302564 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3028/5927] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:29 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1278 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:30.840145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ab79e6f2-0da7-4e1d-a8e7-a5606cb4b43e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:30.841338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ab79e6f2-0da7-4e1d-a8e7-a5606cb4b43e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:30.855571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:30.857425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab79e6f2-0da7-4e1d-a8e7-a5606cb4b43e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:30.858201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab79e6f2-0da7-4e1d-a8e7-a5606cb4b43e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:30.859272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab79e6f2-0da7-4e1d-a8e7-a5606cb4b43e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:30.862880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab79e6f2-0da7-4e1d-a8e7-a5606cb4b43e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:30.865829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab79e6f2-0da7-4e1d-a8e7-a5606cb4b43e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:30.868280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab79e6f2-0da7-4e1d-a8e7-a5606cb4b43e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:30.873652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=99 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:31.207804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ab79e6f2-0da7-4e1d-a8e7-a5606cb4b43e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:31.222877 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ab79e6f2-0da7-4e1d-a8e7-a5606cb4b43e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1270 microversion: 2.1 time: 0.389803 Sep 08 13:38:31.224180 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2900/5928] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:30 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1270 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:31.274000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9124d2a7-de08-4d23-93b3-3006b77c0520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:31.274726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9124d2a7-de08-4d23-93b3-3006b77c0520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:31.284972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9124d2a7-de08-4d23-93b3-3006b77c0520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:31.285491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9124d2a7-de08-4d23-93b3-3006b77c0520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:31.285947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9124d2a7-de08-4d23-93b3-3006b77c0520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:31.286930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9124d2a7-de08-4d23-93b3-3006b77c0520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:31.287472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9124d2a7-de08-4d23-93b3-3006b77c0520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:31.287924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9124d2a7-de08-4d23-93b3-3006b77c0520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:31.341812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c710e200-e176-4573-b7d8-3a9a4eb5a39d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:31.343264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c710e200-e176-4573-b7d8-3a9a4eb5a39d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:31.356066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c710e200-e176-4573-b7d8-3a9a4eb5a39d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:31.357145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c710e200-e176-4573-b7d8-3a9a4eb5a39d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:31.358076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c710e200-e176-4573-b7d8-3a9a4eb5a39d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:31.359911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c710e200-e176-4573-b7d8-3a9a4eb5a39d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:31.360961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c710e200-e176-4573-b7d8-3a9a4eb5a39d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:31.361904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c710e200-e176-4573-b7d8-3a9a4eb5a39d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:31.392938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9124d2a7-de08-4d23-93b3-3006b77c0520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:31.406480 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9124d2a7-de08-4d23-93b3-3006b77c0520 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1236 microversion: 2.1 time: 0.137406 Sep 08 13:38:31.408033 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3029/5929] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:31 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1236 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:31.622364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c710e200-e176-4573-b7d8-3a9a4eb5a39d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:31.635548 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c710e200-e176-4573-b7d8-3a9a4eb5a39d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1266 microversion: 2.1 time: 0.304569 Sep 08 13:38:31.636976 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2901/5930] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:31 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:32.260676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-880edf34-d9dd-4917-9cfc-9d2d06016fc8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:32.261858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-880edf34-d9dd-4917-9cfc-9d2d06016fc8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:32.276873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-880edf34-d9dd-4917-9cfc-9d2d06016fc8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:32.277972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-880edf34-d9dd-4917-9cfc-9d2d06016fc8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:32.279010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-880edf34-d9dd-4917-9cfc-9d2d06016fc8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:32.280292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-880edf34-d9dd-4917-9cfc-9d2d06016fc8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:32.281143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-880edf34-d9dd-4917-9cfc-9d2d06016fc8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:32.282012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-880edf34-d9dd-4917-9cfc-9d2d06016fc8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:32.446939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1daa25f5-c621-4e7b-b9af-1ed6e577292a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:32.450697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1daa25f5-c621-4e7b-b9af-1ed6e577292a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:32.467147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1daa25f5-c621-4e7b-b9af-1ed6e577292a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:32.467694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1daa25f5-c621-4e7b-b9af-1ed6e577292a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:32.468226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1daa25f5-c621-4e7b-b9af-1ed6e577292a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:32.474588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1daa25f5-c621-4e7b-b9af-1ed6e577292a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:32.476731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1daa25f5-c621-4e7b-b9af-1ed6e577292a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:32.477398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1daa25f5-c621-4e7b-b9af-1ed6e577292a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:32.657946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1daa25f5-c621-4e7b-b9af-1ed6e577292a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:32.666581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-880edf34-d9dd-4917-9cfc-9d2d06016fc8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:32.675319 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1daa25f5-c621-4e7b-b9af-1ed6e577292a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1310 microversion: 2.1 time: 0.232587 Sep 08 13:38:32.676527 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2902/5931] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:32 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1310 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:32.683029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2bb8d061-c85a-4d13-b233-07ab3207a9a3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:32.684016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2bb8d061-c85a-4d13-b233-07ab3207a9a3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:32.690664 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-880edf34-d9dd-4917-9cfc-9d2d06016fc8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1270 microversion: 2.1 time: 0.434034 Sep 08 13:38:32.691685 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3030/5932] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:32 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1270 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:32.695544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bb8d061-c85a-4d13-b233-07ab3207a9a3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:32.696334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bb8d061-c85a-4d13-b233-07ab3207a9a3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:32.696930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bb8d061-c85a-4d13-b233-07ab3207a9a3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:32.697871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bb8d061-c85a-4d13-b233-07ab3207a9a3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:32.698572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bb8d061-c85a-4d13-b233-07ab3207a9a3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:32.699160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2bb8d061-c85a-4d13-b233-07ab3207a9a3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:32.965074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2bb8d061-c85a-4d13-b233-07ab3207a9a3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:32.981155 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2bb8d061-c85a-4d13-b233-07ab3207a9a3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1266 microversion: 2.1 time: 0.302112 Sep 08 13:38:32.982501 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2903/5933] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:32 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:33.719870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-999bebe5-749f-421f-9c94-892bd6407d8e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:33.720730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-999bebe5-749f-421f-9c94-892bd6407d8e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:33.729325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-999bebe5-749f-421f-9c94-892bd6407d8e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:33.730131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-999bebe5-749f-421f-9c94-892bd6407d8e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:33.730773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-999bebe5-749f-421f-9c94-892bd6407d8e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:33.731787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-999bebe5-749f-421f-9c94-892bd6407d8e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:33.732529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-999bebe5-749f-421f-9c94-892bd6407d8e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:33.733555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-999bebe5-749f-421f-9c94-892bd6407d8e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:33.735977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ecfaeb52-86e7-4d39-a1b6-e1cce7689ed2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:33.737263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ecfaeb52-86e7-4d39-a1b6-e1cce7689ed2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:33.747588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ecfaeb52-86e7-4d39-a1b6-e1cce7689ed2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:33.748271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ecfaeb52-86e7-4d39-a1b6-e1cce7689ed2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:33.748727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ecfaeb52-86e7-4d39-a1b6-e1cce7689ed2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:33.749758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ecfaeb52-86e7-4d39-a1b6-e1cce7689ed2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:33.750243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ecfaeb52-86e7-4d39-a1b6-e1cce7689ed2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:33.750680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ecfaeb52-86e7-4d39-a1b6-e1cce7689ed2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:33.923022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-999bebe5-749f-421f-9c94-892bd6407d8e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:33.934901 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-999bebe5-749f-421f-9c94-892bd6407d8e tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1298 microversion: 2.1 time: 0.219276 Sep 08 13:38:33.935782 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3031/5934] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:33 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1298 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:34.022859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1283c454-1155-43b5-a19d-5c773ca70717 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:34.024428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1283c454-1155-43b5-a19d-5c773ca70717 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:34.042868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1283c454-1155-43b5-a19d-5c773ca70717 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:34.043287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ecfaeb52-86e7-4d39-a1b6-e1cce7689ed2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:34.043957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1283c454-1155-43b5-a19d-5c773ca70717 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:34.044792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1283c454-1155-43b5-a19d-5c773ca70717 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:34.046504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1283c454-1155-43b5-a19d-5c773ca70717 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:34.047395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1283c454-1155-43b5-a19d-5c773ca70717 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:34.048508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1283c454-1155-43b5-a19d-5c773ca70717 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:34.061485 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ecfaeb52-86e7-4d39-a1b6-e1cce7689ed2 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1270 microversion: 2.1 time: 0.330397 Sep 08 13:38:34.084107 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2904/5935] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:33 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1270 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:34.278740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1283c454-1155-43b5-a19d-5c773ca70717 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:34.292794 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1283c454-1155-43b5-a19d-5c773ca70717 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1266 microversion: 2.1 time: 0.277245 Sep 08 13:38:34.294147 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3032/5936] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:34 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1266 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:34.509472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a011135c-b86f-4d4d-9e74-0d8287ff80d7 req-aa5bdf25-2d34-4337-ba37-cf9375fe06d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58bc5a3c-b066-4cfd-a19d-17f3e97fe270", "tag": "64f4fdf5-5411-4246-aadf-a393d556b51a"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:34.526486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a011135c-b86f-4d4d-9e74-0d8287ff80d7 req-aa5bdf25-2d34-4337-ba37-cf9375fe06d3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:34.527835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a011135c-b86f-4d4d-9e74-0d8287ff80d7 req-aa5bdf25-2d34-4337-ba37-cf9375fe06d3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:34.529030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a011135c-b86f-4d4d-9e74-0d8287ff80d7 req-aa5bdf25-2d34-4337-ba37-cf9375fe06d3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:34.551869 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a011135c-b86f-4d4d-9e74-0d8287ff80d7 req-aa5bdf25-2d34-4337-ba37-cf9375fe06d3 service nova] Creating event network-changed:64f4fdf5-5411-4246-aadf-a393d556b51a for instance 58bc5a3c-b066-4cfd-a19d-17f3e97fe270 on n-h1-852084-10 Sep 08 13:38:34.558682 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a011135c-b86f-4d4d-9e74-0d8287ff80d7 req-aa5bdf25-2d34-4337-ba37-cf9375fe06d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055900 Sep 08 13:38:34.559759 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2905/5937] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:38:34.966621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2ee85ce3-6ef2-494c-970a-f6c2e4eb6c68 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:34.967342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2ee85ce3-6ef2-494c-970a-f6c2e4eb6c68 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:34.975781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ee85ce3-6ef2-494c-970a-f6c2e4eb6c68 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:34.976294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ee85ce3-6ef2-494c-970a-f6c2e4eb6c68 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:34.976752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ee85ce3-6ef2-494c-970a-f6c2e4eb6c68 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:34.977498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ee85ce3-6ef2-494c-970a-f6c2e4eb6c68 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:34.978036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ee85ce3-6ef2-494c-970a-f6c2e4eb6c68 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:34.978433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2ee85ce3-6ef2-494c-970a-f6c2e4eb6c68 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:35.110720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bef5487a-12dc-4e34-bb67-8aee24aeed0e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:35.112053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bef5487a-12dc-4e34-bb67-8aee24aeed0e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:35.123504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bef5487a-12dc-4e34-bb67-8aee24aeed0e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:35.124372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bef5487a-12dc-4e34-bb67-8aee24aeed0e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:35.125228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bef5487a-12dc-4e34-bb67-8aee24aeed0e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:35.126451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bef5487a-12dc-4e34-bb67-8aee24aeed0e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:35.127329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bef5487a-12dc-4e34-bb67-8aee24aeed0e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:35.128642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bef5487a-12dc-4e34-bb67-8aee24aeed0e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:35.129412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2ee85ce3-6ef2-494c-970a-f6c2e4eb6c68 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:35.140874 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2ee85ce3-6ef2-494c-970a-f6c2e4eb6c68 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1298 microversion: 2.1 time: 0.178173 Sep 08 13:38:35.141775 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3033/5938] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:34 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:35.324312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bef5487a-12dc-4e34-bb67-8aee24aeed0e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:35.328348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c2075d9b-5876-45ad-95ad-860ade2f2ebf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:35.328998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c2075d9b-5876-45ad-95ad-860ade2f2ebf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:35.336404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2075d9b-5876-45ad-95ad-860ade2f2ebf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:35.336962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2075d9b-5876-45ad-95ad-860ade2f2ebf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:35.337430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2075d9b-5876-45ad-95ad-860ade2f2ebf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:35.338190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2075d9b-5876-45ad-95ad-860ade2f2ebf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:35.339328 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bef5487a-12dc-4e34-bb67-8aee24aeed0e tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1270 microversion: 2.1 time: 0.238753 Sep 08 13:38:35.339581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2075d9b-5876-45ad-95ad-860ade2f2ebf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:35.339940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2075d9b-5876-45ad-95ad-860ade2f2ebf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:35.340283 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2906/5939] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:35 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:35.519640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c2075d9b-5876-45ad-95ad-860ade2f2ebf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:35.532332 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c2075d9b-5876-45ad-95ad-860ade2f2ebf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1266 microversion: 2.1 time: 0.208227 Sep 08 13:38:35.532964 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3034/5940] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:35 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:36.175303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fba2fdc8-3272-4647-a7c0-a1f3f83e91e1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:36.176675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fba2fdc8-3272-4647-a7c0-a1f3f83e91e1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:36.191680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fba2fdc8-3272-4647-a7c0-a1f3f83e91e1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:36.193038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fba2fdc8-3272-4647-a7c0-a1f3f83e91e1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:36.194203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fba2fdc8-3272-4647-a7c0-a1f3f83e91e1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:36.195886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fba2fdc8-3272-4647-a7c0-a1f3f83e91e1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:36.197419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fba2fdc8-3272-4647-a7c0-a1f3f83e91e1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:36.198516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fba2fdc8-3272-4647-a7c0-a1f3f83e91e1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:36.360491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fba2fdc8-3272-4647-a7c0-a1f3f83e91e1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:36.371645 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fba2fdc8-3272-4647-a7c0-a1f3f83e91e1 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1298 microversion: 2.1 time: 0.204028 Sep 08 13:38:36.372404 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2907/5941] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:36 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1298 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:36.388412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f970391c-44c8-43b1-add6-70e3249dc1be tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:36.389451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f970391c-44c8-43b1-add6-70e3249dc1be tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:36.404620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f970391c-44c8-43b1-add6-70e3249dc1be tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:36.405078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f970391c-44c8-43b1-add6-70e3249dc1be tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:36.405816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f970391c-44c8-43b1-add6-70e3249dc1be tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:36.407147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f970391c-44c8-43b1-add6-70e3249dc1be tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:36.408055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f970391c-44c8-43b1-add6-70e3249dc1be tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:36.408865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f970391c-44c8-43b1-add6-70e3249dc1be tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:36.559601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2c265cc5-aa62-418c-b02f-f61b0121dd19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:36.560544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2c265cc5-aa62-418c-b02f-f61b0121dd19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:36.575692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c265cc5-aa62-418c-b02f-f61b0121dd19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:36.578187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c265cc5-aa62-418c-b02f-f61b0121dd19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:36.579770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c265cc5-aa62-418c-b02f-f61b0121dd19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:36.582275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c265cc5-aa62-418c-b02f-f61b0121dd19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:36.582959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c265cc5-aa62-418c-b02f-f61b0121dd19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:36.583452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c265cc5-aa62-418c-b02f-f61b0121dd19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:36.648531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f970391c-44c8-43b1-add6-70e3249dc1be tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:36.661445 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f970391c-44c8-43b1-add6-70e3249dc1be tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1270 microversion: 2.1 time: 0.280005 Sep 08 13:38:36.679332 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3035/5942] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:36 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1270 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:36.809747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c265cc5-aa62-418c-b02f-f61b0121dd19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:36.819725 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2c265cc5-aa62-418c-b02f-f61b0121dd19 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1266 microversion: 2.1 time: 0.265519 Sep 08 13:38:36.820636 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2908/5943] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:36 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1266 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:37.410313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b055afb8-7ccd-4032-9072-357ab0a254bf tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:37.411131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b055afb8-7ccd-4032-9072-357ab0a254bf tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:37.419735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b055afb8-7ccd-4032-9072-357ab0a254bf tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:37.420543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b055afb8-7ccd-4032-9072-357ab0a254bf tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:37.421131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b055afb8-7ccd-4032-9072-357ab0a254bf tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:37.422233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b055afb8-7ccd-4032-9072-357ab0a254bf tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:37.422898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b055afb8-7ccd-4032-9072-357ab0a254bf tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:37.423724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b055afb8-7ccd-4032-9072-357ab0a254bf tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:37.542268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b055afb8-7ccd-4032-9072-357ab0a254bf tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:37.557796 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b055afb8-7ccd-4032-9072-357ab0a254bf tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1298 microversion: 2.1 time: 0.152142 Sep 08 13:38:37.559013 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3036/5944] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:37 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:37.693547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bd718716-f9eb-4433-8286-1a7730171c9c tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:37.695117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bd718716-f9eb-4433-8286-1a7730171c9c tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:37.711957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd718716-f9eb-4433-8286-1a7730171c9c tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:37.712826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd718716-f9eb-4433-8286-1a7730171c9c tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:37.713721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd718716-f9eb-4433-8286-1a7730171c9c tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:37.714980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd718716-f9eb-4433-8286-1a7730171c9c tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:37.715865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd718716-f9eb-4433-8286-1a7730171c9c tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:37.716629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd718716-f9eb-4433-8286-1a7730171c9c tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:37.846955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-23faf217-8e10-4069-aab1-5aee71248f3c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:37.847642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-23faf217-8e10-4069-aab1-5aee71248f3c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:37.854983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23faf217-8e10-4069-aab1-5aee71248f3c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:37.855545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23faf217-8e10-4069-aab1-5aee71248f3c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:37.856173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23faf217-8e10-4069-aab1-5aee71248f3c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:37.856755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23faf217-8e10-4069-aab1-5aee71248f3c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:37.857244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23faf217-8e10-4069-aab1-5aee71248f3c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:37.858014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-23faf217-8e10-4069-aab1-5aee71248f3c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:37.963740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bd718716-f9eb-4433-8286-1a7730171c9c tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:37.975832 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bd718716-f9eb-4433-8286-1a7730171c9c tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1270 microversion: 2.1 time: 0.290121 Sep 08 13:38:37.987759 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2909/5945] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:37 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1270 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:38.073218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-23faf217-8e10-4069-aab1-5aee71248f3c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:38.084749 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-23faf217-8e10-4069-aab1-5aee71248f3c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1266 microversion: 2.1 time: 0.241738 Sep 08 13:38:38.085651 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3037/5946] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:37 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1266 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:38.302305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-432ccb06-ed27-4229-b163-a163991b5111 req-9d3fdd02-bdef-497c-bbc8-3ddf54985283 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2163760c-c909-4c33-8b11-ec59a37d3b06", "name": "network-vif-plugged", "status": "completed", "tag": "ce1af655-8223-49ec-abc2-e506d1114d41"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:38.321881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-432ccb06-ed27-4229-b163-a163991b5111 req-9d3fdd02-bdef-497c-bbc8-3ddf54985283 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:38.322783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-432ccb06-ed27-4229-b163-a163991b5111 req-9d3fdd02-bdef-497c-bbc8-3ddf54985283 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:38.323642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-432ccb06-ed27-4229-b163-a163991b5111 req-9d3fdd02-bdef-497c-bbc8-3ddf54985283 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:38.347409 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-432ccb06-ed27-4229-b163-a163991b5111 req-9d3fdd02-bdef-497c-bbc8-3ddf54985283 service nova] Creating event network-vif-plugged:ce1af655-8223-49ec-abc2-e506d1114d41 for instance 2163760c-c909-4c33-8b11-ec59a37d3b06 on n-h2-852084-10 Sep 08 13:38:38.359198 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-432ccb06-ed27-4229-b163-a163991b5111 req-9d3fdd02-bdef-497c-bbc8-3ddf54985283 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064375 Sep 08 13:38:38.361108 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2910/5947] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:38:38.599203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-414a8aee-02fd-4cce-9ce0-18893851c408 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:38.600045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-414a8aee-02fd-4cce-9ce0-18893851c408 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:38.608345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-414a8aee-02fd-4cce-9ce0-18893851c408 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:38.609240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-414a8aee-02fd-4cce-9ce0-18893851c408 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:38.609980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-414a8aee-02fd-4cce-9ce0-18893851c408 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:38.610769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-414a8aee-02fd-4cce-9ce0-18893851c408 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:38.611284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-414a8aee-02fd-4cce-9ce0-18893851c408 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:38.611735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-414a8aee-02fd-4cce-9ce0-18893851c408 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:38.726995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-414a8aee-02fd-4cce-9ce0-18893851c408 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:38.736918 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-414a8aee-02fd-4cce-9ce0-18893851c408 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1298 microversion: 2.1 time: 0.143151 Sep 08 13:38:38.737979 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3038/5948] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:38 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1298 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:39.024829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2046a42-2203-441a-a5e4-bdea24dfc9f6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:39.027094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2046a42-2203-441a-a5e4-bdea24dfc9f6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:39.040500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2046a42-2203-441a-a5e4-bdea24dfc9f6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:39.041325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2046a42-2203-441a-a5e4-bdea24dfc9f6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:39.042128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2046a42-2203-441a-a5e4-bdea24dfc9f6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:39.043523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2046a42-2203-441a-a5e4-bdea24dfc9f6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:39.044377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2046a42-2203-441a-a5e4-bdea24dfc9f6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:39.045280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2046a42-2203-441a-a5e4-bdea24dfc9f6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:39.119715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8d036608-5f9a-4167-ad25-660cf1315c0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:39.124102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8d036608-5f9a-4167-ad25-660cf1315c0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:39.133465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d036608-5f9a-4167-ad25-660cf1315c0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:39.134361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d036608-5f9a-4167-ad25-660cf1315c0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:39.135139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d036608-5f9a-4167-ad25-660cf1315c0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:39.136403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d036608-5f9a-4167-ad25-660cf1315c0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:39.137190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d036608-5f9a-4167-ad25-660cf1315c0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:39.137856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d036608-5f9a-4167-ad25-660cf1315c0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:39.300895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f2046a42-2203-441a-a5e4-bdea24dfc9f6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:39.316292 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2046a42-2203-441a-a5e4-bdea24dfc9f6 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1270 microversion: 2.1 time: 0.298877 Sep 08 13:38:39.317379 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2911/5949] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:39 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1270 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:39.363704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8d036608-5f9a-4167-ad25-660cf1315c0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:39.373459 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8d036608-5f9a-4167-ad25-660cf1315c0f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1266 microversion: 2.1 time: 0.261568 Sep 08 13:38:39.374074 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3039/5950] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:39 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:39.459122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c1ede1bf-fc26-4ec3-9eb6-048af22fa8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:39.462741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c1ede1bf-fc26-4ec3-9eb6-048af22fa8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:39.469625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c1ede1bf-fc26-4ec3-9eb6-048af22fa8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:39.470131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c1ede1bf-fc26-4ec3-9eb6-048af22fa8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:39.470574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c1ede1bf-fc26-4ec3-9eb6-048af22fa8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:39.471342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c1ede1bf-fc26-4ec3-9eb6-048af22fa8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:39.471978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c1ede1bf-fc26-4ec3-9eb6-048af22fa8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:39.472411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c1ede1bf-fc26-4ec3-9eb6-048af22fa8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:39.533219 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c1ede1bf-fc26-4ec3-9eb6-048af22fa8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d/action" status: 200 len: 24561 microversion: 2.1 time: 0.078492 Sep 08 13:38:39.534426 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2912/5951] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:38:39 2022] POST /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d/action => generated 24561 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:38:39.762347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fae1eb6f-4190-473c-aca0-e6a8bcfad019 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:39.763193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fae1eb6f-4190-473c-aca0-e6a8bcfad019 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:39.771984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fae1eb6f-4190-473c-aca0-e6a8bcfad019 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:39.772502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fae1eb6f-4190-473c-aca0-e6a8bcfad019 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:39.772970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fae1eb6f-4190-473c-aca0-e6a8bcfad019 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:39.773767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fae1eb6f-4190-473c-aca0-e6a8bcfad019 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:39.774256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fae1eb6f-4190-473c-aca0-e6a8bcfad019 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:39.774710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fae1eb6f-4190-473c-aca0-e6a8bcfad019 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:39.893931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fae1eb6f-4190-473c-aca0-e6a8bcfad019 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:39.909861 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fae1eb6f-4190-473c-aca0-e6a8bcfad019 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1298 microversion: 2.1 time: 0.150647 Sep 08 13:38:39.910875 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3040/5952] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:39 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1298 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:40.352409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b9cf3703-3cbe-419b-9073-a6360fb686b3 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:40.353506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b9cf3703-3cbe-419b-9073-a6360fb686b3 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:40.356401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:40.357911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:40.369690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9cf3703-3cbe-419b-9073-a6360fb686b3 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:40.370208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9cf3703-3cbe-419b-9073-a6360fb686b3 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:40.370653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9cf3703-3cbe-419b-9073-a6360fb686b3 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:40.371442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9cf3703-3cbe-419b-9073-a6360fb686b3 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:40.371912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9cf3703-3cbe-419b-9073-a6360fb686b3 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:40.372336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b9cf3703-3cbe-419b-9073-a6360fb686b3 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:40.402567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e919eb5-6284-43ef-aba9-012a0a5174e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:40.403658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e919eb5-6284-43ef-aba9-012a0a5174e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:40.413370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e919eb5-6284-43ef-aba9-012a0a5174e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:40.413899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e919eb5-6284-43ef-aba9-012a0a5174e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:40.414737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e919eb5-6284-43ef-aba9-012a0a5174e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:40.415529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e919eb5-6284-43ef-aba9-012a0a5174e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:40.416010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e919eb5-6284-43ef-aba9-012a0a5174e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:40.416804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e919eb5-6284-43ef-aba9-012a0a5174e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:40.452348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=100 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:40.749581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b9cf3703-3cbe-419b-9073-a6360fb686b3 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:40.763062 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b9cf3703-3cbe-419b-9073-a6360fb686b3 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1458 microversion: 2.1 time: 0.416185 Sep 08 13:38:40.763768 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2913/5953] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:40 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1458 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:40.769877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-ee4e0fb8-6d0b-48a5-a073-9848f36ad058 req-b6f49872-1ae0-47d5-8650-1f370b253d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58bc5a3c-b066-4cfd-a19d-17f3e97fe270", "name": "network-vif-plugged", "status": "completed", "tag": "64f4fdf5-5411-4246-aadf-a393d556b51a"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:40.771815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e919eb5-6284-43ef-aba9-012a0a5174e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:40.781151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ee4e0fb8-6d0b-48a5-a073-9848f36ad058 req-b6f49872-1ae0-47d5-8650-1f370b253d1e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:40.781773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ee4e0fb8-6d0b-48a5-a073-9848f36ad058 req-b6f49872-1ae0-47d5-8650-1f370b253d1e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:40.782303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ee4e0fb8-6d0b-48a5-a073-9848f36ad058 req-b6f49872-1ae0-47d5-8650-1f370b253d1e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:40.791652 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e919eb5-6284-43ef-aba9-012a0a5174e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1266 microversion: 2.1 time: 0.395725 Sep 08 13:38:40.792922 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3041/5954] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:40 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1266 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:40.797458 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-ee4e0fb8-6d0b-48a5-a073-9848f36ad058 req-b6f49872-1ae0-47d5-8650-1f370b253d1e service nova] Creating event network-vif-plugged:64f4fdf5-5411-4246-aadf-a393d556b51a for instance 58bc5a3c-b066-4cfd-a19d-17f3e97fe270 on n-h1-852084-10 Sep 08 13:38:40.803986 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-ee4e0fb8-6d0b-48a5-a073-9848f36ad058 req-b6f49872-1ae0-47d5-8650-1f370b253d1e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038372 Sep 08 13:38:40.805311 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2914/5955] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:38:40.823053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ef3b0c3-b27a-4ea0-909c-2825c63a25ee tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:40.824604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8ef3b0c3-b27a-4ea0-909c-2825c63a25ee tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:40.836166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ef3b0c3-b27a-4ea0-909c-2825c63a25ee tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:40.837361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ef3b0c3-b27a-4ea0-909c-2825c63a25ee tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:40.838365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ef3b0c3-b27a-4ea0-909c-2825c63a25ee tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:40.839872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ef3b0c3-b27a-4ea0-909c-2825c63a25ee tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:40.841054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ef3b0c3-b27a-4ea0-909c-2825c63a25ee tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:40.842062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ef3b0c3-b27a-4ea0-909c-2825c63a25ee tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:40.942644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4dabbd42-ad18-4eb8-b8c4-ac6148b83d0f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:40.944468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4dabbd42-ad18-4eb8-b8c4-ac6148b83d0f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:40.959451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dabbd42-ad18-4eb8-b8c4-ac6148b83d0f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:40.960826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dabbd42-ad18-4eb8-b8c4-ac6148b83d0f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:40.961893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dabbd42-ad18-4eb8-b8c4-ac6148b83d0f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:40.963533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dabbd42-ad18-4eb8-b8c4-ac6148b83d0f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:40.964639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dabbd42-ad18-4eb8-b8c4-ac6148b83d0f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:40.965873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dabbd42-ad18-4eb8-b8c4-ac6148b83d0f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:41.134456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8ef3b0c3-b27a-4ea0-909c-2825c63a25ee tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:41.147989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4dabbd42-ad18-4eb8-b8c4-ac6148b83d0f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:41.154091 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8ef3b0c3-b27a-4ea0-909c-2825c63a25ee tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1458 microversion: 2.1 time: 0.343538 Sep 08 13:38:41.156075 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3042/5956] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:40 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1458 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:41.162997 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4dabbd42-ad18-4eb8-b8c4-ac6148b83d0f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1298 microversion: 2.1 time: 0.229272 Sep 08 13:38:41.164334 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2915/5957] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:40 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1298 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:41.843773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0f705a5a-e923-4ad7-a204-064d58728e1a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:41.845457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0f705a5a-e923-4ad7-a204-064d58728e1a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:41.860655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f705a5a-e923-4ad7-a204-064d58728e1a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:41.861832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f705a5a-e923-4ad7-a204-064d58728e1a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:41.863143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f705a5a-e923-4ad7-a204-064d58728e1a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:41.864766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f705a5a-e923-4ad7-a204-064d58728e1a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:41.865771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f705a5a-e923-4ad7-a204-064d58728e1a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:41.867076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f705a5a-e923-4ad7-a204-064d58728e1a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:42.189462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0f705a5a-e923-4ad7-a204-064d58728e1a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:42.193575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b3987130-c1b8-4cbc-97d9-db6d40a5ea0c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:42.194956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b3987130-c1b8-4cbc-97d9-db6d40a5ea0c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:42.212147 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0f705a5a-e923-4ad7-a204-064d58728e1a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1266 microversion: 2.1 time: 0.379521 Sep 08 13:38:42.213740 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3043/5958] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:41 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1266 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:42.215513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3987130-c1b8-4cbc-97d9-db6d40a5ea0c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:42.219718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3987130-c1b8-4cbc-97d9-db6d40a5ea0c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:42.222515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3987130-c1b8-4cbc-97d9-db6d40a5ea0c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:42.226093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3987130-c1b8-4cbc-97d9-db6d40a5ea0c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:42.228382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3987130-c1b8-4cbc-97d9-db6d40a5ea0c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:42.228690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b3987130-c1b8-4cbc-97d9-db6d40a5ea0c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:42.418245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b3987130-c1b8-4cbc-97d9-db6d40a5ea0c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:42.433252 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b3987130-c1b8-4cbc-97d9-db6d40a5ea0c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1298 microversion: 2.1 time: 0.249803 Sep 08 13:38:42.434386 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2916/5959] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:42 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1298 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:42.840205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-1e25c073-a5bb-4e92-8bf9-51b6c621fa6a req-c6f68ebf-5386-43b4-a0cb-2ee0135bec6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc4b2224-da7c-4884-a959-f880d4af9288", "name": "network-vif-plugged", "status": "completed", "tag": "5c1dbb5f-ff8f-4faf-807f-fcfefc7fa64d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:42.863319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1e25c073-a5bb-4e92-8bf9-51b6c621fa6a req-c6f68ebf-5386-43b4-a0cb-2ee0135bec6a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:42.864203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1e25c073-a5bb-4e92-8bf9-51b6c621fa6a req-c6f68ebf-5386-43b4-a0cb-2ee0135bec6a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:42.865017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1e25c073-a5bb-4e92-8bf9-51b6c621fa6a req-c6f68ebf-5386-43b4-a0cb-2ee0135bec6a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:42.888061 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1e25c073-a5bb-4e92-8bf9-51b6c621fa6a req-c6f68ebf-5386-43b4-a0cb-2ee0135bec6a service nova] Creating event network-vif-plugged:5c1dbb5f-ff8f-4faf-807f-fcfefc7fa64d for instance dc4b2224-da7c-4884-a959-f880d4af9288 on n-h1-852084-10 Sep 08 13:38:42.898070 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-1e25c073-a5bb-4e92-8bf9-51b6c621fa6a req-c6f68ebf-5386-43b4-a0cb-2ee0135bec6a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066052 Sep 08 13:38:42.899772 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3044/5960] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:38:43.254391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-69d7427a-187b-4c55-a989-910393c1a11d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:43.256193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-69d7427a-187b-4c55-a989-910393c1a11d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:43.264929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d7427a-187b-4c55-a989-910393c1a11d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:43.265601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d7427a-187b-4c55-a989-910393c1a11d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:43.266126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d7427a-187b-4c55-a989-910393c1a11d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:43.268887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d7427a-187b-4c55-a989-910393c1a11d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:43.270245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d7427a-187b-4c55-a989-910393c1a11d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:43.271484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69d7427a-187b-4c55-a989-910393c1a11d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:43.467292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dae6c472-740a-4cee-abb6-4a4b4f28b8a0 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:43.470000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dae6c472-740a-4cee-abb6-4a4b4f28b8a0 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:43.485188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dae6c472-740a-4cee-abb6-4a4b4f28b8a0 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:43.486610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dae6c472-740a-4cee-abb6-4a4b4f28b8a0 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:43.487615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dae6c472-740a-4cee-abb6-4a4b4f28b8a0 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:43.489351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dae6c472-740a-4cee-abb6-4a4b4f28b8a0 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:43.490244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dae6c472-740a-4cee-abb6-4a4b4f28b8a0 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:43.491434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dae6c472-740a-4cee-abb6-4a4b4f28b8a0 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:43.644759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-69d7427a-187b-4c55-a989-910393c1a11d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:43.662060 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-69d7427a-187b-4c55-a989-910393c1a11d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1266 microversion: 2.1 time: 0.414067 Sep 08 13:38:43.663593 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2917/5961] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:43 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1266 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:43.708734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dae6c472-740a-4cee-abb6-4a4b4f28b8a0 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:43.724753 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dae6c472-740a-4cee-abb6-4a4b4f28b8a0 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1471 microversion: 2.1 time: 0.266260 Sep 08 13:38:43.726232 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3045/5962] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:43 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1471 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:43.755299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2d5d94ad-3fd3-479d-bceb-5955f241fd90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:43.756480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2d5d94ad-3fd3-479d-bceb-5955f241fd90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:43.770922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d5d94ad-3fd3-479d-bceb-5955f241fd90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:43.771781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d5d94ad-3fd3-479d-bceb-5955f241fd90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:43.772560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d5d94ad-3fd3-479d-bceb-5955f241fd90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:43.774138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d5d94ad-3fd3-479d-bceb-5955f241fd90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:43.774756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d5d94ad-3fd3-479d-bceb-5955f241fd90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:43.775493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d5d94ad-3fd3-479d-bceb-5955f241fd90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:44.449082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2d5d94ad-3fd3-479d-bceb-5955f241fd90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:44.464141 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2d5d94ad-3fd3-479d-bceb-5955f241fd90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1471 microversion: 2.1 time: 0.712867 Sep 08 13:38:44.464769 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2918/5963] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:43 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1471 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:44.510466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9d6e5d58-73e0-4c0b-9612-8e9e50e3a8cf tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:44.511723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9d6e5d58-73e0-4c0b-9612-8e9e50e3a8cf tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:44.526020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6e5d58-73e0-4c0b-9612-8e9e50e3a8cf tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:44.526914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6e5d58-73e0-4c0b-9612-8e9e50e3a8cf tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:44.528246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6e5d58-73e0-4c0b-9612-8e9e50e3a8cf tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:44.534290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6e5d58-73e0-4c0b-9612-8e9e50e3a8cf tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:44.535605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6e5d58-73e0-4c0b-9612-8e9e50e3a8cf tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:44.536603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6e5d58-73e0-4c0b-9612-8e9e50e3a8cf tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:44.675625 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9d6e5d58-73e0-4c0b-9612-8e9e50e3a8cf tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1624 microversion: 2.1 time: 0.171343 Sep 08 13:38:44.676639 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3046/5964] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:44 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1624 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:44.711067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4371bfc8-20f1-41ee-9452-93a742846a09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:44.713118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4371bfc8-20f1-41ee-9452-93a742846a09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:44.730519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d6a96dcb-89af-4e92-a41a-8851f18e46e8 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:44.731718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d6a96dcb-89af-4e92-a41a-8851f18e46e8 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:44.738401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4371bfc8-20f1-41ee-9452-93a742846a09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:44.738785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4371bfc8-20f1-41ee-9452-93a742846a09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:44.739587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4371bfc8-20f1-41ee-9452-93a742846a09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:44.740983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4371bfc8-20f1-41ee-9452-93a742846a09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:44.741821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4371bfc8-20f1-41ee-9452-93a742846a09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:44.742597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4371bfc8-20f1-41ee-9452-93a742846a09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:44.748206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6a96dcb-89af-4e92-a41a-8851f18e46e8 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:44.749531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6a96dcb-89af-4e92-a41a-8851f18e46e8 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:44.751784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6a96dcb-89af-4e92-a41a-8851f18e46e8 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:44.753799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6a96dcb-89af-4e92-a41a-8851f18e46e8 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:44.754960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6a96dcb-89af-4e92-a41a-8851f18e46e8 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:44.756068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6a96dcb-89af-4e92-a41a-8851f18e46e8 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:44.765288 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:45.149624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4371bfc8-20f1-41ee-9452-93a742846a09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:45.169595 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d6a96dcb-89af-4e92-a41a-8851f18e46e8 tempest-TestSecurityGroupsBasicOps-837003396 tempest-TestSecurityGroupsBasicOps-837003396-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1912 microversion: 2.1 time: 0.449957 Sep 08 13:38:45.171292 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3047/5965] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:44 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1912 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:45.180741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-dfc7dfe0-895d-4b51-9c30-6f0e4c63ba2c req-5c09b729-fa68-47c2-965e-107cdf068546 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2163760c-c909-4c33-8b11-ec59a37d3b06", "tag": "ce1af655-8223-49ec-abc2-e506d1114d41"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:45.195904 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4371bfc8-20f1-41ee-9452-93a742846a09 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1453 microversion: 2.1 time: 0.503096 Sep 08 13:38:45.197671 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2919/5966] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:44 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1453 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:45.200734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dfc7dfe0-895d-4b51-9c30-6f0e4c63ba2c req-5c09b729-fa68-47c2-965e-107cdf068546 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:45.202015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dfc7dfe0-895d-4b51-9c30-6f0e4c63ba2c req-5c09b729-fa68-47c2-965e-107cdf068546 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:45.203170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-dfc7dfe0-895d-4b51-9c30-6f0e4c63ba2c req-5c09b729-fa68-47c2-965e-107cdf068546 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:45.245784 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-dfc7dfe0-895d-4b51-9c30-6f0e4c63ba2c req-5c09b729-fa68-47c2-965e-107cdf068546 service nova] Creating event network-changed:ce1af655-8223-49ec-abc2-e506d1114d41 for instance 2163760c-c909-4c33-8b11-ec59a37d3b06 on n-h2-852084-10 Sep 08 13:38:45.251095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6c569e3f-3fb3-40eb-8d5b-daab1b5c7bc8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:45.252434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6c569e3f-3fb3-40eb-8d5b-daab1b5c7bc8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:45.256841 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-dfc7dfe0-895d-4b51-9c30-6f0e4c63ba2c req-5c09b729-fa68-47c2-965e-107cdf068546 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082946 Sep 08 13:38:45.258912 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3048/5967] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:38:45.264324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c569e3f-3fb3-40eb-8d5b-daab1b5c7bc8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:45.265827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c569e3f-3fb3-40eb-8d5b-daab1b5c7bc8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:45.267539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c569e3f-3fb3-40eb-8d5b-daab1b5c7bc8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:45.270679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c569e3f-3fb3-40eb-8d5b-daab1b5c7bc8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:45.272045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c569e3f-3fb3-40eb-8d5b-daab1b5c7bc8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:45.273213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c569e3f-3fb3-40eb-8d5b-daab1b5c7bc8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:45.409372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-95bd89cc-5f7f-4f0a-b9ad-289e5114dee2 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:45.416567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-95bd89cc-5f7f-4f0a-b9ad-289e5114dee2 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:45.433825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95bd89cc-5f7f-4f0a-b9ad-289e5114dee2 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:45.435883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95bd89cc-5f7f-4f0a-b9ad-289e5114dee2 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:45.437345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95bd89cc-5f7f-4f0a-b9ad-289e5114dee2 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:45.441058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95bd89cc-5f7f-4f0a-b9ad-289e5114dee2 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:45.444562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95bd89cc-5f7f-4f0a-b9ad-289e5114dee2 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:45.446241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95bd89cc-5f7f-4f0a-b9ad-289e5114dee2 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:45.503078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-95bd89cc-5f7f-4f0a-b9ad-289e5114dee2 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:38:45.658481 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-95bd89cc-5f7f-4f0a-b9ad-289e5114dee2 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "DELETE /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 204 len: 0 microversion: 2.1 time: 0.263141 Sep 08 13:38:45.661159 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3049/5968] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:38:45 2022] DELETE /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:38:45.672582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c569e3f-3fb3-40eb-8d5b-daab1b5c7bc8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:45.678415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-77141e32-91c7-4da6-8632-597f7bdc7458 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:45.679443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-77141e32-91c7-4da6-8632-597f7bdc7458 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:45.688627 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6c569e3f-3fb3-40eb-8d5b-daab1b5c7bc8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1453 microversion: 2.1 time: 0.441882 Sep 08 13:38:45.689742 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2920/5969] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:45 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1453 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:45.719065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77141e32-91c7-4da6-8632-597f7bdc7458 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:45.723176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77141e32-91c7-4da6-8632-597f7bdc7458 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:45.724534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77141e32-91c7-4da6-8632-597f7bdc7458 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:45.727636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77141e32-91c7-4da6-8632-597f7bdc7458 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:45.728572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77141e32-91c7-4da6-8632-597f7bdc7458 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:45.731647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-77141e32-91c7-4da6-8632-597f7bdc7458 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:46.033454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-77141e32-91c7-4da6-8632-597f7bdc7458 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:46.060272 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-77141e32-91c7-4da6-8632-597f7bdc7458 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1477 microversion: 2.1 time: 0.391689 Sep 08 13:38:46.067303 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3050/5970] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:45 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1477 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:47.028341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f319cd95-2a9a-49b8-bad8-121a8ad55cf2 req-5e380cba-18dd-40d4-9da4-bca65dafa41c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2163760c-c909-4c33-8b11-ec59a37d3b06", "tag": "ce1af655-8223-49ec-abc2-e506d1114d41"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:47.047280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f319cd95-2a9a-49b8-bad8-121a8ad55cf2 req-5e380cba-18dd-40d4-9da4-bca65dafa41c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:47.048878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f319cd95-2a9a-49b8-bad8-121a8ad55cf2 req-5e380cba-18dd-40d4-9da4-bca65dafa41c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:47.050261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f319cd95-2a9a-49b8-bad8-121a8ad55cf2 req-5e380cba-18dd-40d4-9da4-bca65dafa41c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:47.068753 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f319cd95-2a9a-49b8-bad8-121a8ad55cf2 req-5e380cba-18dd-40d4-9da4-bca65dafa41c service nova] Creating event network-changed:ce1af655-8223-49ec-abc2-e506d1114d41 for instance 2163760c-c909-4c33-8b11-ec59a37d3b06 on n-h2-852084-10 Sep 08 13:38:47.075174 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f319cd95-2a9a-49b8-bad8-121a8ad55cf2 req-5e380cba-18dd-40d4-9da4-bca65dafa41c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059704 Sep 08 13:38:47.075993 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2921/5971] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:38:47.092933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f2a87a3-9439-407b-8826-9c1fb1ca18cd tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:47.095156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f2a87a3-9439-407b-8826-9c1fb1ca18cd tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:47.115278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f2a87a3-9439-407b-8826-9c1fb1ca18cd tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:47.118903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f2a87a3-9439-407b-8826-9c1fb1ca18cd tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:47.120592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f2a87a3-9439-407b-8826-9c1fb1ca18cd tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:47.124178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f2a87a3-9439-407b-8826-9c1fb1ca18cd tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:47.126424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f2a87a3-9439-407b-8826-9c1fb1ca18cd tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:47.128335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f2a87a3-9439-407b-8826-9c1fb1ca18cd tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:47.343120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f2a87a3-9439-407b-8826-9c1fb1ca18cd tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:47.352768 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f2a87a3-9439-407b-8826-9c1fb1ca18cd tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1477 microversion: 2.1 time: 0.268981 Sep 08 13:38:47.354946 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3051/5972] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:47 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:48.387268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9cf5649c-41a9-4f72-9848-3bbef8b532b5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:48.388754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9cf5649c-41a9-4f72-9848-3bbef8b532b5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:48.400589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cf5649c-41a9-4f72-9848-3bbef8b532b5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:48.401501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cf5649c-41a9-4f72-9848-3bbef8b532b5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:48.408505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cf5649c-41a9-4f72-9848-3bbef8b532b5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:48.408505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cf5649c-41a9-4f72-9848-3bbef8b532b5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:48.408505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cf5649c-41a9-4f72-9848-3bbef8b532b5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:48.408505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9cf5649c-41a9-4f72-9848-3bbef8b532b5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:48.543804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9cf5649c-41a9-4f72-9848-3bbef8b532b5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:48.554481 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9cf5649c-41a9-4f72-9848-3bbef8b532b5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1477 microversion: 2.1 time: 0.177312 Sep 08 13:38:48.555199 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2922/5973] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:48 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1477 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:49.123345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ef307edd-d6ec-4283-8364-03c4266af2af req-e34306ab-9dce-4948-bedc-35ffe882be82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2163760c-c909-4c33-8b11-ec59a37d3b06", "tag": "ce1af655-8223-49ec-abc2-e506d1114d41"}, {"server_uuid": "58bc5a3c-b066-4cfd-a19d-17f3e97fe270", "name": "network-vif-deleted", "tag": "64f4fdf5-5411-4246-aadf-a393d556b51a"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:49.132594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ef307edd-d6ec-4283-8364-03c4266af2af req-e34306ab-9dce-4948-bedc-35ffe882be82 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:49.133363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ef307edd-d6ec-4283-8364-03c4266af2af req-e34306ab-9dce-4948-bedc-35ffe882be82 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:49.134145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ef307edd-d6ec-4283-8364-03c4266af2af req-e34306ab-9dce-4948-bedc-35ffe882be82 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:49.164777 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ef307edd-d6ec-4283-8364-03c4266af2af req-e34306ab-9dce-4948-bedc-35ffe882be82 service nova] Creating event network-changed:ce1af655-8223-49ec-abc2-e506d1114d41 for instance 2163760c-c909-4c33-8b11-ec59a37d3b06 on n-h2-852084-10 Sep 08 13:38:49.165775 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ef307edd-d6ec-4283-8364-03c4266af2af req-e34306ab-9dce-4948-bedc-35ffe882be82 service nova] Creating event network-vif-deleted:64f4fdf5-5411-4246-aadf-a393d556b51a for instance 58bc5a3c-b066-4cfd-a19d-17f3e97fe270 on n-h1-852084-10 Sep 08 13:38:49.185073 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ef307edd-d6ec-4283-8364-03c4266af2af req-e34306ab-9dce-4948-bedc-35ffe882be82 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.075160 Sep 08 13:38:49.185073 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3052/5974] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:38:49.588971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:49.591595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:49.610756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:49.612598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:49.613841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:49.615604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:49.616419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:49.617081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:49.719858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:49.722601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:49.722601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:49.723494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lazy-loading 'fault' on Instance uuid 58bc5a3c-b066-4cfd-a19d-17f3e97fe270 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:38:49.802224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:49.812004 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-18dc05c6-5c71-4f74-b41d-0182ace6c454 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 200 len: 1330 microversion: 2.1 time: 0.234331 Sep 08 13:38:49.813227 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2923/5975] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:49 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 1330 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:50.466791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a69b3d4e-4311-4532-a514-f90dc549e30f tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:50.468423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a69b3d4e-4311-4532-a514-f90dc549e30f tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:50.478273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a69b3d4e-4311-4532-a514-f90dc549e30f tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:50.478852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a69b3d4e-4311-4532-a514-f90dc549e30f tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:50.479705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a69b3d4e-4311-4532-a514-f90dc549e30f tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:50.480434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a69b3d4e-4311-4532-a514-f90dc549e30f tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:50.480931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a69b3d4e-4311-4532-a514-f90dc549e30f tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:50.481459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a69b3d4e-4311-4532-a514-f90dc549e30f tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:50.842508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1731b161-2fac-4537-94de-054482f8f3d5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:50.844502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1731b161-2fac-4537-94de-054482f8f3d5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: 58bc5a3c-b066-4cfd-a19d-17f3e97fe270] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:50.859021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1731b161-2fac-4537-94de-054482f8f3d5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:50.859826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1731b161-2fac-4537-94de-054482f8f3d5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:50.860385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1731b161-2fac-4537-94de-054482f8f3d5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:50.862520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1731b161-2fac-4537-94de-054482f8f3d5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:50.863261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1731b161-2fac-4537-94de-054482f8f3d5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:50.863829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1731b161-2fac-4537-94de-054482f8f3d5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:50.887471 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1731b161-2fac-4537-94de-054482f8f3d5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] HTTP exception thrown: Instance 58bc5a3c-b066-4cfd-a19d-17f3e97fe270 could not be found. Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1731b161-2fac-4537-94de-054482f8f3d5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Request method failure captured: Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 HTTP/1.1 Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfABoxUFendb3j7EGWGdJQgtJQOMQiVERRM86NuUcV9MplqqgpcLHE-jXa5xSB-bs6L8LAdlN5wsUylTI1Dkxfh1lyfdRFx-wst0P25R2W7Wvlaktl01aqNqBeC09YHrajDTExQWsiSmcl2s7TAcFM_rtYsn-g-llhfYtA2_4cvqGdo Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 2a9ec535db3b43ddbf685fefd8d63133 Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1627948337 Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2a9ec535db3b43ddbf685fefd8d63133"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2a9ec535db3b43ddbf685fefd8d63133"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a9ec535db3b43ddbf685fefd8d63133"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a9ec535db3b43ddbf685fefd8d63133"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1627948337 Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 2a9ec535db3b43ddbf685fefd8d63133 Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1627948337 Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestSecurityGroupsBasicOps-1627948337-project Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 893137c9f7ed48659241bc46293e77e1 Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1627948337-project Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 58bc5a3c-b066-4cfd-a19d-17f3e97fe270 could not be found. Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '58bc5a3c-b066-4cfd-a19d-17f3e97fe270'} Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58bc5a3c-b066-4cfd-a19d-17f3e97fe270 could not be found. Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58bc5a3c-b066-4cfd-a19d-17f3e97fe270 could not be found. Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:38:50.891797 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:38:50.898900 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:38:50.898900 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:38:50.898900 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:38:50.898900 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:38:50.898900 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:38:50.898900 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:38:50.898900 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58bc5a3c-b066-4cfd-a19d-17f3e97fe270 could not be found. Sep 08 13:38:50.898900 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:38:50.898900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1731b161-2fac-4537-94de-054482f8f3d5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Returning 404 to user: Instance 58bc5a3c-b066-4cfd-a19d-17f3e97fe270 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:38:50.898900 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1731b161-2fac-4537-94de-054482f8f3d5 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270" status: 404 len: 111 microversion: 2.1 time: 0.062175 Sep 08 13:38:50.903453 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2924/5976] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:50 2022] GET /compute/v2.1/servers/58bc5a3c-b066-4cfd-a19d-17f3e97fe270 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:38:50.934264 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a69b3d4e-4311-4532-a514-f90dc549e30f tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1833 microversion: 2.1 time: 0.473832 Sep 08 13:38:50.935562 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3053/5977] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:50 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1833 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:50.978565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e638706f-3f89-4d18-a5da-e3937afc2658 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:50.979729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e638706f-3f89-4d18-a5da-e3937afc2658 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:50.991682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e638706f-3f89-4d18-a5da-e3937afc2658 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:50.993019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e638706f-3f89-4d18-a5da-e3937afc2658 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:50.994117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e638706f-3f89-4d18-a5da-e3937afc2658 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:50.995976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e638706f-3f89-4d18-a5da-e3937afc2658 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:50.997292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e638706f-3f89-4d18-a5da-e3937afc2658 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:50.998427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e638706f-3f89-4d18-a5da-e3937afc2658 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:51.241817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e638706f-3f89-4d18-a5da-e3937afc2658 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:51.260594 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e638706f-3f89-4d18-a5da-e3937afc2658 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1680 microversion: 2.1 time: 0.289743 Sep 08 13:38:51.262648 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2925/5978] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:50 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1680 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:51.270095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-4d8ae422-9fb0-49d2-b917-dc1e5bc7b057 req-10062bfa-b0fa-4cd7-ae0a-cc3a55c701b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc4b2224-da7c-4884-a959-f880d4af9288", "tag": "5c1dbb5f-ff8f-4faf-807f-fcfefc7fa64d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:51.290356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4d8ae422-9fb0-49d2-b917-dc1e5bc7b057 req-10062bfa-b0fa-4cd7-ae0a-cc3a55c701b6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:51.293045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4d8ae422-9fb0-49d2-b917-dc1e5bc7b057 req-10062bfa-b0fa-4cd7-ae0a-cc3a55c701b6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:51.293817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4d8ae422-9fb0-49d2-b917-dc1e5bc7b057 req-10062bfa-b0fa-4cd7-ae0a-cc3a55c701b6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:51.312738 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-4d8ae422-9fb0-49d2-b917-dc1e5bc7b057 req-10062bfa-b0fa-4cd7-ae0a-cc3a55c701b6 service nova] Creating event network-changed:5c1dbb5f-ff8f-4faf-807f-fcfefc7fa64d for instance dc4b2224-da7c-4884-a959-f880d4af9288 on n-h1-852084-10 Sep 08 13:38:51.319651 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-4d8ae422-9fb0-49d2-b917-dc1e5bc7b057 req-10062bfa-b0fa-4cd7-ae0a-cc3a55c701b6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061696 Sep 08 13:38:51.321550 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3054/5979] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:38:51.439560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-668428d2-99bd-4a6d-ac7f-3b59fb3fdc26 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:51.443590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-668428d2-99bd-4a6d-ac7f-3b59fb3fdc26 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:51.450934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-668428d2-99bd-4a6d-ac7f-3b59fb3fdc26 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:51.451695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-668428d2-99bd-4a6d-ac7f-3b59fb3fdc26 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:51.451943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-668428d2-99bd-4a6d-ac7f-3b59fb3fdc26 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:51.453229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-668428d2-99bd-4a6d-ac7f-3b59fb3fdc26 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:51.456857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-668428d2-99bd-4a6d-ac7f-3b59fb3fdc26 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:51.457347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-668428d2-99bd-4a6d-ac7f-3b59fb3fdc26 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:51.525233 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-668428d2-99bd-4a6d-ac7f-3b59fb3fdc26 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d/action" status: 200 len: 32635 microversion: 2.1 time: 0.093753 Sep 08 13:38:51.530726 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2926/5980] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:38:51 2022] POST /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d/action => generated 32635 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:38:51.707766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-37c20ba2-8a77-4603-b2f7-ade201378a15 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:51.709244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-37c20ba2-8a77-4603-b2f7-ade201378a15 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:51.722801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37c20ba2-8a77-4603-b2f7-ade201378a15 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:51.725168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37c20ba2-8a77-4603-b2f7-ade201378a15 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:51.726012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37c20ba2-8a77-4603-b2f7-ade201378a15 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:51.727537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37c20ba2-8a77-4603-b2f7-ade201378a15 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:51.729030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37c20ba2-8a77-4603-b2f7-ade201378a15 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:51.729801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37c20ba2-8a77-4603-b2f7-ade201378a15 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:51.816387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-37c20ba2-8a77-4603-b2f7-ade201378a15 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0d1d6a584f6a46b6a5b264947437cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc60d9404f47998fe3d656a2be095a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:51.817628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-37c20ba2-8a77-4603-b2f7-ade201378a15 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] flavor_id is None. Assuming migration. {{(pid=128970) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 08 13:38:51.818512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-37c20ba2-8a77-4603-b2f7-ade201378a15 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128970) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 13:38:52.322393 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-37c20ba2-8a77-4603-b2f7-ade201378a15 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d/action" status: 202 len: 0 microversion: 2.1 time: 0.622319 Sep 08 13:38:52.324088 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3055/5981] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:38:51 2022] POST /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d/action => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:38:52.337224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-da293113-bc6d-46ba-b434-2d49333b430b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:52.338007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-da293113-bc6d-46ba-b434-2d49333b430b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:52.347302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da293113-bc6d-46ba-b434-2d49333b430b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:52.347828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da293113-bc6d-46ba-b434-2d49333b430b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:52.348274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da293113-bc6d-46ba-b434-2d49333b430b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:52.349103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da293113-bc6d-46ba-b434-2d49333b430b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:52.349924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da293113-bc6d-46ba-b434-2d49333b430b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:52.350615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da293113-bc6d-46ba-b434-2d49333b430b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:52.694775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-da293113-bc6d-46ba-b434-2d49333b430b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:52.711909 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-da293113-bc6d-46ba-b434-2d49333b430b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1689 microversion: 2.1 time: 0.381002 Sep 08 13:38:52.727702 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2927/5982] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:52 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1689 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:53.745320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8a961c76-1442-4401-9123-decfc5df6ba3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:53.746387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8a961c76-1442-4401-9123-decfc5df6ba3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:53.760551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a961c76-1442-4401-9123-decfc5df6ba3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:53.761679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a961c76-1442-4401-9123-decfc5df6ba3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:53.765477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a961c76-1442-4401-9123-decfc5df6ba3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:53.765477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a961c76-1442-4401-9123-decfc5df6ba3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:53.765477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a961c76-1442-4401-9123-decfc5df6ba3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:53.767094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8a961c76-1442-4401-9123-decfc5df6ba3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:54.038070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8a961c76-1442-4401-9123-decfc5df6ba3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:54.053910 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8a961c76-1442-4401-9123-decfc5df6ba3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1689 microversion: 2.1 time: 0.316411 Sep 08 13:38:54.055932 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3056/5983] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:53 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1689 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:55.099904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5a2d78d1-7db5-49cc-8547-4117244a63c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:55.104816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5a2d78d1-7db5-49cc-8547-4117244a63c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:55.135605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a2d78d1-7db5-49cc-8547-4117244a63c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:55.137267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a2d78d1-7db5-49cc-8547-4117244a63c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:55.139919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a2d78d1-7db5-49cc-8547-4117244a63c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:55.141930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a2d78d1-7db5-49cc-8547-4117244a63c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:55.143092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a2d78d1-7db5-49cc-8547-4117244a63c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:55.144574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5a2d78d1-7db5-49cc-8547-4117244a63c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:55.613105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5a2d78d1-7db5-49cc-8547-4117244a63c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:55.643162 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5a2d78d1-7db5-49cc-8547-4117244a63c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1689 microversion: 2.1 time: 0.548343 Sep 08 13:38:55.644696 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2928/5984] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:55 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1689 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:56.717860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d1c8e12e-35c8-4758-8d03-f2ca1375ce8b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:56.720495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d1c8e12e-35c8-4758-8d03-f2ca1375ce8b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:56.734826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1c8e12e-35c8-4758-8d03-f2ca1375ce8b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:56.736027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1c8e12e-35c8-4758-8d03-f2ca1375ce8b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:56.737903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1c8e12e-35c8-4758-8d03-f2ca1375ce8b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:56.740657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1c8e12e-35c8-4758-8d03-f2ca1375ce8b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:56.742292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1c8e12e-35c8-4758-8d03-f2ca1375ce8b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:56.743503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1c8e12e-35c8-4758-8d03-f2ca1375ce8b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:56.792989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:57.106776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d1c8e12e-35c8-4758-8d03-f2ca1375ce8b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:57.126432 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d1c8e12e-35c8-4758-8d03-f2ca1375ce8b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1694 microversion: 2.1 time: 0.430053 Sep 08 13:38:57.128667 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3057/5985] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:56 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1694 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:58.180102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-556d7124-05ad-42e0-b1d2-0b3fcffabb9b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:58.181952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-556d7124-05ad-42e0-b1d2-0b3fcffabb9b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:58.190966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-556d7124-05ad-42e0-b1d2-0b3fcffabb9b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:58.191810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-556d7124-05ad-42e0-b1d2-0b3fcffabb9b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:58.192521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-556d7124-05ad-42e0-b1d2-0b3fcffabb9b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:58.193627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-556d7124-05ad-42e0-b1d2-0b3fcffabb9b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:58.194338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-556d7124-05ad-42e0-b1d2-0b3fcffabb9b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:58.195169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-556d7124-05ad-42e0-b1d2-0b3fcffabb9b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:58.402123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-556d7124-05ad-42e0-b1d2-0b3fcffabb9b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:58.415268 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-556d7124-05ad-42e0-b1d2-0b3fcffabb9b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1694 microversion: 2.1 time: 0.241382 Sep 08 13:38:58.427367 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2929/5986] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:58 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1694 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:38:58.676968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-850f966e-8548-4227-96cc-720e9bf2b03a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:58.677912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-850f966e-8548-4227-96cc-720e9bf2b03a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:58.682337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-4004c4f4-f699-45a6-bee8-0e3b93b3ab6b req-c342d133-1a4f-44f4-867e-1fb8b6fbb085 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2888231-fc98-4390-b7b1-0a01797b2d42", "tag": "4657ae4d-4f0f-40e9-9beb-f7fbaa11447f"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:38:58.703727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-850f966e-8548-4227-96cc-720e9bf2b03a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:58.704503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-850f966e-8548-4227-96cc-720e9bf2b03a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:58.706276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-850f966e-8548-4227-96cc-720e9bf2b03a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:58.706276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-850f966e-8548-4227-96cc-720e9bf2b03a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:58.706860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-850f966e-8548-4227-96cc-720e9bf2b03a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:58.707531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-850f966e-8548-4227-96cc-720e9bf2b03a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:58.709989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4004c4f4-f699-45a6-bee8-0e3b93b3ab6b req-c342d133-1a4f-44f4-867e-1fb8b6fbb085 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:58.711275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4004c4f4-f699-45a6-bee8-0e3b93b3ab6b req-c342d133-1a4f-44f4-867e-1fb8b6fbb085 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:58.712344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4004c4f4-f699-45a6-bee8-0e3b93b3ab6b req-c342d133-1a4f-44f4-867e-1fb8b6fbb085 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:58.742750 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-4004c4f4-f699-45a6-bee8-0e3b93b3ab6b req-c342d133-1a4f-44f4-867e-1fb8b6fbb085 service nova] Creating event network-changed:4657ae4d-4f0f-40e9-9beb-f7fbaa11447f for instance c2888231-fc98-4390-b7b1-0a01797b2d42 on n-h2-852084-10 Sep 08 13:38:58.753960 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-4004c4f4-f699-45a6-bee8-0e3b93b3ab6b req-c342d133-1a4f-44f4-867e-1fb8b6fbb085 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081159 Sep 08 13:38:58.755436 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2930/5987] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:38:58.766544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-850f966e-8548-4227-96cc-720e9bf2b03a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:38:58.910769 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-850f966e-8548-4227-96cc-720e9bf2b03a tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 204 len: 0 microversion: 2.1 time: 0.239074 Sep 08 13:38:58.910769 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3058/5988] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:38:58 2022] DELETE /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:38:58.931252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad4986d5-f4ec-4ac9-a7ad-82e379aeb94c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:58.932887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad4986d5-f4ec-4ac9-a7ad-82e379aeb94c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:58.947607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad4986d5-f4ec-4ac9-a7ad-82e379aeb94c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:58.948493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad4986d5-f4ec-4ac9-a7ad-82e379aeb94c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:58.950224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad4986d5-f4ec-4ac9-a7ad-82e379aeb94c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:58.950781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad4986d5-f4ec-4ac9-a7ad-82e379aeb94c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:58.951695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad4986d5-f4ec-4ac9-a7ad-82e379aeb94c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:58.952495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad4986d5-f4ec-4ac9-a7ad-82e379aeb94c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:59.206552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ad4986d5-f4ec-4ac9-a7ad-82e379aeb94c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:59.223164 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad4986d5-f4ec-4ac9-a7ad-82e379aeb94c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1765 microversion: 2.1 time: 0.303947 Sep 08 13:38:59.224261 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2931/5989] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:58 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1765 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:38:59.463465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d99fd857-57c6-4db5-b715-7f9b33f78556 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:38:59.465109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d99fd857-57c6-4db5-b715-7f9b33f78556 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:38:59.468789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:38:59.479479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d99fd857-57c6-4db5-b715-7f9b33f78556 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:59.480416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d99fd857-57c6-4db5-b715-7f9b33f78556 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:59.481315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d99fd857-57c6-4db5-b715-7f9b33f78556 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:59.482581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d99fd857-57c6-4db5-b715-7f9b33f78556 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:38:59.483541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d99fd857-57c6-4db5-b715-7f9b33f78556 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:38:59.484335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d99fd857-57c6-4db5-b715-7f9b33f78556 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:38:59.703700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d99fd857-57c6-4db5-b715-7f9b33f78556 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:38:59.718271 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d99fd857-57c6-4db5-b715-7f9b33f78556 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1694 microversion: 2.1 time: 0.263852 Sep 08 13:38:59.718915 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3059/5990] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:38:59 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1694 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:00.252745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e628fbf5-594d-45f3-bf33-ecc332f7284c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:00.253844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e628fbf5-594d-45f3-bf33-ecc332f7284c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:00.263399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e628fbf5-594d-45f3-bf33-ecc332f7284c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:00.264088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e628fbf5-594d-45f3-bf33-ecc332f7284c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:00.264639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e628fbf5-594d-45f3-bf33-ecc332f7284c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:00.265845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e628fbf5-594d-45f3-bf33-ecc332f7284c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:00.266632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e628fbf5-594d-45f3-bf33-ecc332f7284c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:00.267134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e628fbf5-594d-45f3-bf33-ecc332f7284c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:00.740477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e628fbf5-594d-45f3-bf33-ecc332f7284c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:00.756319 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e628fbf5-594d-45f3-bf33-ecc332f7284c tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1765 microversion: 2.1 time: 0.509544 Sep 08 13:39:00.767379 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2932/5991] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:00 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1765 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:00.767633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8bd0599c-eef0-4cd7-a07d-e91970c3ec11 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:00.767633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8bd0599c-eef0-4cd7-a07d-e91970c3ec11 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:00.779010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8bd0599c-eef0-4cd7-a07d-e91970c3ec11 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:00.780012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8bd0599c-eef0-4cd7-a07d-e91970c3ec11 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:00.780805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8bd0599c-eef0-4cd7-a07d-e91970c3ec11 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:00.782116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8bd0599c-eef0-4cd7-a07d-e91970c3ec11 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:00.783059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8bd0599c-eef0-4cd7-a07d-e91970c3ec11 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:00.783550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8bd0599c-eef0-4cd7-a07d-e91970c3ec11 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:01.470676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8bd0599c-eef0-4cd7-a07d-e91970c3ec11 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:01.482071 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8bd0599c-eef0-4cd7-a07d-e91970c3ec11 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1694 microversion: 2.1 time: 0.726245 Sep 08 13:39:01.500033 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3060/5992] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:00 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1694 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:39:01.832331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-6090525d-e236-48df-8233-3863e4bab845 req-4275f71f-6fa9-493a-8481-87a974fca0a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2888231-fc98-4390-b7b1-0a01797b2d42", "name": "network-vif-deleted", "tag": "4657ae4d-4f0f-40e9-9beb-f7fbaa11447f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:39:01.849806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6090525d-e236-48df-8233-3863e4bab845 req-4275f71f-6fa9-493a-8481-87a974fca0a7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:01.850015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-46d5360c-4774-41b6-bd41-c1321591108f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:01.850981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-46d5360c-4774-41b6-bd41-c1321591108f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:01.851188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6090525d-e236-48df-8233-3863e4bab845 req-4275f71f-6fa9-493a-8481-87a974fca0a7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:01.851980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6090525d-e236-48df-8233-3863e4bab845 req-4275f71f-6fa9-493a-8481-87a974fca0a7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:01.860556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=68 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:01.873208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46d5360c-4774-41b6-bd41-c1321591108f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:01.874409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46d5360c-4774-41b6-bd41-c1321591108f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:01.874907 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-6090525d-e236-48df-8233-3863e4bab845 req-4275f71f-6fa9-493a-8481-87a974fca0a7 service nova] Creating event network-vif-deleted:4657ae4d-4f0f-40e9-9beb-f7fbaa11447f for instance c2888231-fc98-4390-b7b1-0a01797b2d42 on n-h2-852084-10 Sep 08 13:39:01.875628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46d5360c-4774-41b6-bd41-c1321591108f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:01.877225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46d5360c-4774-41b6-bd41-c1321591108f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:01.878588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46d5360c-4774-41b6-bd41-c1321591108f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:01.879986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-46d5360c-4774-41b6-bd41-c1321591108f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:01.887176 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-6090525d-e236-48df-8233-3863e4bab845 req-4275f71f-6fa9-493a-8481-87a974fca0a7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062351 Sep 08 13:39:01.889099 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3061/5993] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:39:01.988599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-46d5360c-4774-41b6-bd41-c1321591108f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '893137c9f7ed48659241bc46293e77e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a9ec535db3b43ddbf685fefd8d63133', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:01.998110 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-46d5360c-4774-41b6-bd41-c1321591108f tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 200 len: 1378 microversion: 2.1 time: 0.186319 Sep 08 13:39:01.998924 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2933/5994] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:01 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 1378 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:02.524110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-752a4730-9947-4170-a984-06f372b144d1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:02.524990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-752a4730-9947-4170-a984-06f372b144d1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:02.536971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-752a4730-9947-4170-a984-06f372b144d1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:02.537905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-752a4730-9947-4170-a984-06f372b144d1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:02.538967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-752a4730-9947-4170-a984-06f372b144d1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:02.540345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-752a4730-9947-4170-a984-06f372b144d1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:02.541267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-752a4730-9947-4170-a984-06f372b144d1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:02.542115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-752a4730-9947-4170-a984-06f372b144d1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:02.781804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-752a4730-9947-4170-a984-06f372b144d1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:02.794596 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-752a4730-9947-4170-a984-06f372b144d1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1694 microversion: 2.1 time: 0.276741 Sep 08 13:39:02.795267 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3062/5995] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:02 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1694 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:39:03.038755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6ac95170-607d-4d64-af33-a16c8a395d90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:03.039617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6ac95170-607d-4d64-af33-a16c8a395d90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] [instance: c2888231-fc98-4390-b7b1-0a01797b2d42] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:03.047966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ac95170-607d-4d64-af33-a16c8a395d90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:03.048602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ac95170-607d-4d64-af33-a16c8a395d90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:03.049100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ac95170-607d-4d64-af33-a16c8a395d90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:03.049946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ac95170-607d-4d64-af33-a16c8a395d90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:03.050528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ac95170-607d-4d64-af33-a16c8a395d90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:03.051026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ac95170-607d-4d64-af33-a16c8a395d90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:03.069336 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-6ac95170-607d-4d64-af33-a16c8a395d90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] HTTP exception thrown: Instance c2888231-fc98-4390-b7b1-0a01797b2d42 could not be found. Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6ac95170-607d-4d64-af33-a16c8a395d90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Request method failure captured: Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 HTTP/1.1 Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfABoxUFendb3j7EGWGdJQgtJQOMQiVERRM86NuUcV9MplqqgpcLHE-jXa5xSB-bs6L8LAdlN5wsUylTI1Dkxfh1lyfdRFx-wst0P25R2W7Wvlaktl01aqNqBeC09YHrajDTExQWsiSmcl2s7TAcFM_rtYsn-g-llhfYtA2_4cvqGdo Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 2a9ec535db3b43ddbf685fefd8d63133 Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-1627948337 Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2a9ec535db3b43ddbf685fefd8d63133"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2a9ec535db3b43ddbf685fefd8d63133"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a9ec535db3b43ddbf685fefd8d63133"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2a9ec535db3b43ddbf685fefd8d63133"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestSecurityGroupsBasicOps-1627948337 Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 2a9ec535db3b43ddbf685fefd8d63133 Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-1627948337 Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestSecurityGroupsBasicOps-1627948337-project Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 893137c9f7ed48659241bc46293e77e1 Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestSecurityGroupsBasicOps-1627948337-project Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance c2888231-fc98-4390-b7b1-0a01797b2d42 could not be found. Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'c2888231-fc98-4390-b7b1-0a01797b2d42'} Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2888231-fc98-4390-b7b1-0a01797b2d42 could not be found. Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2888231-fc98-4390-b7b1-0a01797b2d42 could not be found. Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:03.072306 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:39:03.078934 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:03.078934 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:39:03.078934 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:39:03.078934 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:39:03.078934 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:39:03.078934 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:39:03.078934 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2888231-fc98-4390-b7b1-0a01797b2d42 could not be found. Sep 08 13:39:03.078934 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:03.078934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6ac95170-607d-4d64-af33-a16c8a395d90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Returning 404 to user: Instance c2888231-fc98-4390-b7b1-0a01797b2d42 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:39:03.078934 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6ac95170-607d-4d64-af33-a16c8a395d90 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42" status: 404 len: 111 microversion: 2.1 time: 0.041273 Sep 08 13:39:03.078934 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2934/5996] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:03 2022] GET /compute/v2.1/servers/c2888231-fc98-4390-b7b1-0a01797b2d42 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:39:03.829378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-472eda58-10ba-4bb2-ab72-a6a57537dc46 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:03.831066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-472eda58-10ba-4bb2-ab72-a6a57537dc46 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:03.848061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-472eda58-10ba-4bb2-ab72-a6a57537dc46 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:03.848908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-472eda58-10ba-4bb2-ab72-a6a57537dc46 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:03.849696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-472eda58-10ba-4bb2-ab72-a6a57537dc46 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:03.850998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-472eda58-10ba-4bb2-ab72-a6a57537dc46 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:03.851888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-472eda58-10ba-4bb2-ab72-a6a57537dc46 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:03.852682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-472eda58-10ba-4bb2-ab72-a6a57537dc46 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:04.110537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-472eda58-10ba-4bb2-ab72-a6a57537dc46 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:04.121423 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-472eda58-10ba-4bb2-ab72-a6a57537dc46 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1694 microversion: 2.1 time: 0.300575 Sep 08 13:39:04.131439 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3063/5997] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:03 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1694 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:39:05.165426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2c3a4212-31f1-4273-b108-c5be2a59bcab tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:05.166820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2c3a4212-31f1-4273-b108-c5be2a59bcab tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:05.179661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3a4212-31f1-4273-b108-c5be2a59bcab tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:05.180633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3a4212-31f1-4273-b108-c5be2a59bcab tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:05.181595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3a4212-31f1-4273-b108-c5be2a59bcab tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:05.182867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3a4212-31f1-4273-b108-c5be2a59bcab tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:05.183443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3a4212-31f1-4273-b108-c5be2a59bcab tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:05.183889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2c3a4212-31f1-4273-b108-c5be2a59bcab tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:05.421634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2c3a4212-31f1-4273-b108-c5be2a59bcab tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:05.440649 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2c3a4212-31f1-4273-b108-c5be2a59bcab tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1694 microversion: 2.1 time: 0.285101 Sep 08 13:39:05.442168 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2935/5998] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:05 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1694 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:06.469869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b09a2390-49cd-44b7-8d45-cf6a11bc9b6c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:06.472122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b09a2390-49cd-44b7-8d45-cf6a11bc9b6c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:06.482375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b09a2390-49cd-44b7-8d45-cf6a11bc9b6c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:06.482946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b09a2390-49cd-44b7-8d45-cf6a11bc9b6c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:06.483434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b09a2390-49cd-44b7-8d45-cf6a11bc9b6c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:06.484177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b09a2390-49cd-44b7-8d45-cf6a11bc9b6c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:06.484660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b09a2390-49cd-44b7-8d45-cf6a11bc9b6c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:06.485104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b09a2390-49cd-44b7-8d45-cf6a11bc9b6c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:06.850634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b09a2390-49cd-44b7-8d45-cf6a11bc9b6c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:06.868492 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b09a2390-49cd-44b7-8d45-cf6a11bc9b6c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1694 microversion: 2.1 time: 0.402553 Sep 08 13:39:06.870723 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3064/5999] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:06 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1694 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:39:07.914064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ff8838e-0618-4458-9b63-2df854ebcd18 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:07.915398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ff8838e-0618-4458-9b63-2df854ebcd18 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:07.922559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ff8838e-0618-4458-9b63-2df854ebcd18 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:07.923055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ff8838e-0618-4458-9b63-2df854ebcd18 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:07.923532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ff8838e-0618-4458-9b63-2df854ebcd18 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:07.924813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ff8838e-0618-4458-9b63-2df854ebcd18 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:07.925276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ff8838e-0618-4458-9b63-2df854ebcd18 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:07.925729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ff8838e-0618-4458-9b63-2df854ebcd18 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:08.152892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ff8838e-0618-4458-9b63-2df854ebcd18 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:08.170008 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ff8838e-0618-4458-9b63-2df854ebcd18 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1694 microversion: 2.1 time: 0.259998 Sep 08 13:39:08.171318 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2936/6000] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:07 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1694 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:39:09.080887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d9a8a81b-7a5e-4d70-9535-e5e200ac0a27 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] Calling method '.version_select at 0x7fdb3f12ab80>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:09.125004 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d9a8a81b-7a5e-4d70-9535-e5e200ac0a27 tempest-TestSecurityGroupsBasicOps-1627948337 tempest-TestSecurityGroupsBasicOps-1627948337-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-15331025" status: 202 len: 0 microversion: 2.1 time: 0.052837 Sep 08 13:39:09.126761 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3065/6001] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 13:39:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-15331025 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:39:09.218813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-418d55c5-e6b6-4ef4-b528-c3feead8c17b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:09.221158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-418d55c5-e6b6-4ef4-b528-c3feead8c17b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:09.237499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-418d55c5-e6b6-4ef4-b528-c3feead8c17b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:09.240488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-418d55c5-e6b6-4ef4-b528-c3feead8c17b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:09.243445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-418d55c5-e6b6-4ef4-b528-c3feead8c17b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:09.245798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-418d55c5-e6b6-4ef4-b528-c3feead8c17b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:09.246957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-418d55c5-e6b6-4ef4-b528-c3feead8c17b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:09.248111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-418d55c5-e6b6-4ef4-b528-c3feead8c17b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:09.613723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-418d55c5-e6b6-4ef4-b528-c3feead8c17b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:09.641887 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-418d55c5-e6b6-4ef4-b528-c3feead8c17b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1693 microversion: 2.1 time: 0.431902 Sep 08 13:39:09.646930 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2937/6002] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:09 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1693 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:09.719518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b838022d-6603-42f3-a1bb-ac4a13cf5904 req-127c7f73-847b-415d-b76d-98fe7f4dc53f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16259878-2ec8-465b-8777-b178ff771d9d", "name": "network-vif-unplugged", "status": "completed", "tag": "251d8243-f2b8-4578-bdc0-9bada8b3f1d9"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:39:09.734914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b838022d-6603-42f3-a1bb-ac4a13cf5904 req-127c7f73-847b-415d-b76d-98fe7f4dc53f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:09.735883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b838022d-6603-42f3-a1bb-ac4a13cf5904 req-127c7f73-847b-415d-b76d-98fe7f4dc53f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:09.736798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b838022d-6603-42f3-a1bb-ac4a13cf5904 req-127c7f73-847b-415d-b76d-98fe7f4dc53f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:09.765775 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b838022d-6603-42f3-a1bb-ac4a13cf5904 req-127c7f73-847b-415d-b76d-98fe7f4dc53f service nova] Creating event network-vif-unplugged:251d8243-f2b8-4578-bdc0-9bada8b3f1d9 for instance 16259878-2ec8-465b-8777-b178ff771d9d on n-h2-852084-10 Sep 08 13:39:09.779312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-b838022d-6603-42f3-a1bb-ac4a13cf5904 req-127c7f73-847b-415d-b76d-98fe7f4dc53f service nova] Instance 16259878-2ec8-465b-8777-b178ff771d9d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:39:09.801373 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b838022d-6603-42f3-a1bb-ac4a13cf5904 req-127c7f73-847b-415d-b76d-98fe7f4dc53f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087969 Sep 08 13:39:09.802395 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3066/6003] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:39:10.677538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-867809f6-f26d-4750-8a07-280003f7a49d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:10.678609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-867809f6-f26d-4750-8a07-280003f7a49d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:10.706583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-867809f6-f26d-4750-8a07-280003f7a49d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:10.707176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-867809f6-f26d-4750-8a07-280003f7a49d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:10.707777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-867809f6-f26d-4750-8a07-280003f7a49d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:10.708688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-867809f6-f26d-4750-8a07-280003f7a49d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:10.709459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-867809f6-f26d-4750-8a07-280003f7a49d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:10.710166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-867809f6-f26d-4750-8a07-280003f7a49d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:10.740936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=100 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:11.225955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-867809f6-f26d-4750-8a07-280003f7a49d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:11.243032 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-867809f6-f26d-4750-8a07-280003f7a49d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1693 microversion: 2.1 time: 0.570627 Sep 08 13:39:11.244172 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2938/6004] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:10 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1693 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:11.898868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-44b70d0d-32d2-4c2d-9cf7-2fd839389f6d req-42cc106b-647d-4436-9fc1-cf125c54d1af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16259878-2ec8-465b-8777-b178ff771d9d", "tag": "251d8243-f2b8-4578-bdc0-9bada8b3f1d9"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:39:11.926000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-44b70d0d-32d2-4c2d-9cf7-2fd839389f6d req-42cc106b-647d-4436-9fc1-cf125c54d1af service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:11.927349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-44b70d0d-32d2-4c2d-9cf7-2fd839389f6d req-42cc106b-647d-4436-9fc1-cf125c54d1af service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:11.927970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-44b70d0d-32d2-4c2d-9cf7-2fd839389f6d req-42cc106b-647d-4436-9fc1-cf125c54d1af service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:11.948334 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-44b70d0d-32d2-4c2d-9cf7-2fd839389f6d req-42cc106b-647d-4436-9fc1-cf125c54d1af service nova] Creating event network-changed:251d8243-f2b8-4578-bdc0-9bada8b3f1d9 for instance 16259878-2ec8-465b-8777-b178ff771d9d on n-h2-852084-10 Sep 08 13:39:11.961258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-44b70d0d-32d2-4c2d-9cf7-2fd839389f6d req-42cc106b-647d-4436-9fc1-cf125c54d1af service nova] Instance 16259878-2ec8-465b-8777-b178ff771d9d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:39:12.051440 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-44b70d0d-32d2-4c2d-9cf7-2fd839389f6d req-42cc106b-647d-4436-9fc1-cf125c54d1af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176188 Sep 08 13:39:12.053238 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3067/6005] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:39:12.286934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-93d0a6b0-5afe-4d56-ad0b-24d113989d0b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:12.288119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-93d0a6b0-5afe-4d56-ad0b-24d113989d0b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:12.300322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93d0a6b0-5afe-4d56-ad0b-24d113989d0b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:12.300891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93d0a6b0-5afe-4d56-ad0b-24d113989d0b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:12.301453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93d0a6b0-5afe-4d56-ad0b-24d113989d0b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:12.302227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93d0a6b0-5afe-4d56-ad0b-24d113989d0b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:12.303580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93d0a6b0-5afe-4d56-ad0b-24d113989d0b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:12.304258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-93d0a6b0-5afe-4d56-ad0b-24d113989d0b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:13.053766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-93d0a6b0-5afe-4d56-ad0b-24d113989d0b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:13.070284 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-93d0a6b0-5afe-4d56-ad0b-24d113989d0b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1693 microversion: 2.1 time: 0.788235 Sep 08 13:39:13.073007 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2939/6006] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:12 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1693 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:14.104271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-508ff78c-7eb8-4da6-b972-32c6442f49d3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:14.105779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-508ff78c-7eb8-4da6-b972-32c6442f49d3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:14.121797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-508ff78c-7eb8-4da6-b972-32c6442f49d3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:14.122766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-508ff78c-7eb8-4da6-b972-32c6442f49d3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:14.123646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-508ff78c-7eb8-4da6-b972-32c6442f49d3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:14.125056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-508ff78c-7eb8-4da6-b972-32c6442f49d3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:14.125969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-508ff78c-7eb8-4da6-b972-32c6442f49d3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:14.126785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-508ff78c-7eb8-4da6-b972-32c6442f49d3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:14.353942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-508ff78c-7eb8-4da6-b972-32c6442f49d3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:14.367769 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-508ff78c-7eb8-4da6-b972-32c6442f49d3 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1691 microversion: 2.1 time: 0.273130 Sep 08 13:39:14.368900 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3068/6007] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:14 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1691 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:15.410925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-690a3fd0-9697-4d05-a07f-ebb523cb4131 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:15.414728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-690a3fd0-9697-4d05-a07f-ebb523cb4131 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:15.426795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-690a3fd0-9697-4d05-a07f-ebb523cb4131 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:15.428418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-690a3fd0-9697-4d05-a07f-ebb523cb4131 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:15.429177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-690a3fd0-9697-4d05-a07f-ebb523cb4131 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:15.430276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-690a3fd0-9697-4d05-a07f-ebb523cb4131 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:15.430848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-690a3fd0-9697-4d05-a07f-ebb523cb4131 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:15.431310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-690a3fd0-9697-4d05-a07f-ebb523cb4131 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:15.662476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-690a3fd0-9697-4d05-a07f-ebb523cb4131 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:15.672420 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-690a3fd0-9697-4d05-a07f-ebb523cb4131 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1688 microversion: 2.1 time: 0.270577 Sep 08 13:39:15.673340 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2940/6008] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:15 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1688 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:15.704357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6d59b50-d4d6-41e8-aa07-368102b6a689 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:39:15.705108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f6d59b50-d4d6-41e8-aa07-368102b6a689 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:15.718414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6d59b50-d4d6-41e8-aa07-368102b6a689 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:15.719269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6d59b50-d4d6-41e8-aa07-368102b6a689 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:15.719987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6d59b50-d4d6-41e8-aa07-368102b6a689 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:15.721798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6d59b50-d4d6-41e8-aa07-368102b6a689 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:15.722754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6d59b50-d4d6-41e8-aa07-368102b6a689 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:15.723586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6d59b50-d4d6-41e8-aa07-368102b6a689 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:15.837127 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f6d59b50-d4d6-41e8-aa07-368102b6a689 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d/action" status: 204 len: 0 microversion: 2.1 time: 0.139484 Sep 08 13:39:15.838807 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3069/6009] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:39:15 2022] POST /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d/action => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:39:15.851177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-07d93318-8f4a-4438-8ed4-0570f7441b52 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:15.851986 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-07d93318-8f4a-4438-8ed4-0570f7441b52 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:15.860464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07d93318-8f4a-4438-8ed4-0570f7441b52 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:15.861968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07d93318-8f4a-4438-8ed4-0570f7441b52 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:15.862581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07d93318-8f4a-4438-8ed4-0570f7441b52 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:15.863795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07d93318-8f4a-4438-8ed4-0570f7441b52 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:15.864624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07d93318-8f4a-4438-8ed4-0570f7441b52 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:15.865279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07d93318-8f4a-4438-8ed4-0570f7441b52 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:16.061786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-07d93318-8f4a-4438-8ed4-0570f7441b52 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:16.072667 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-07d93318-8f4a-4438-8ed4-0570f7441b52 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1688 microversion: 2.1 time: 0.227008 Sep 08 13:39:16.073343 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2941/6010] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:15 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1688 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:17.110863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4439e10a-d0ca-457d-8de4-77df4ff9a1c8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:17.112061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4439e10a-d0ca-457d-8de4-77df4ff9a1c8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:17.121045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4439e10a-d0ca-457d-8de4-77df4ff9a1c8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:17.121899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4439e10a-d0ca-457d-8de4-77df4ff9a1c8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:17.122704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4439e10a-d0ca-457d-8de4-77df4ff9a1c8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:17.123964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4439e10a-d0ca-457d-8de4-77df4ff9a1c8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:17.125326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4439e10a-d0ca-457d-8de4-77df4ff9a1c8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:17.126146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4439e10a-d0ca-457d-8de4-77df4ff9a1c8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:17.350799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4439e10a-d0ca-457d-8de4-77df4ff9a1c8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:17.363305 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4439e10a-d0ca-457d-8de4-77df4ff9a1c8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1688 microversion: 2.1 time: 0.262482 Sep 08 13:39:17.364220 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3070/6011] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:17 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1688 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:18.390306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e884b314-2a7d-435b-983d-fdba74c842cc tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:18.390969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e884b314-2a7d-435b-983d-fdba74c842cc tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:18.398850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e884b314-2a7d-435b-983d-fdba74c842cc tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:18.399403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e884b314-2a7d-435b-983d-fdba74c842cc tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:18.399847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e884b314-2a7d-435b-983d-fdba74c842cc tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:18.400569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e884b314-2a7d-435b-983d-fdba74c842cc tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:18.401035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e884b314-2a7d-435b-983d-fdba74c842cc tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:18.401468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e884b314-2a7d-435b-983d-fdba74c842cc tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:18.411277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-249b677b-9fa0-476e-bca1-a7d13fb8c7bb req-650ff4d0-0c0b-4ae8-877f-4441671fd9b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16259878-2ec8-465b-8777-b178ff771d9d", "name": "network-vif-plugged", "status": "completed", "tag": "251d8243-f2b8-4578-bdc0-9bada8b3f1d9"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:39:18.426417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-249b677b-9fa0-476e-bca1-a7d13fb8c7bb req-650ff4d0-0c0b-4ae8-877f-4441671fd9b1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:18.427625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-249b677b-9fa0-476e-bca1-a7d13fb8c7bb req-650ff4d0-0c0b-4ae8-877f-4441671fd9b1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:18.428542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-249b677b-9fa0-476e-bca1-a7d13fb8c7bb req-650ff4d0-0c0b-4ae8-877f-4441671fd9b1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:18.452014 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-249b677b-9fa0-476e-bca1-a7d13fb8c7bb req-650ff4d0-0c0b-4ae8-877f-4441671fd9b1 service nova] Creating event network-vif-plugged:251d8243-f2b8-4578-bdc0-9bada8b3f1d9 for instance 16259878-2ec8-465b-8777-b178ff771d9d on n-h2-852084-10 Sep 08 13:39:18.461786 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-249b677b-9fa0-476e-bca1-a7d13fb8c7bb req-650ff4d0-0c0b-4ae8-877f-4441671fd9b1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057322 Sep 08 13:39:18.463339 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3071/6012] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:39:18.590735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e884b314-2a7d-435b-983d-fdba74c842cc tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:18.601239 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e884b314-2a7d-435b-983d-fdba74c842cc tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1680 microversion: 2.1 time: 0.215171 Sep 08 13:39:18.604350 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2942/6013] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:18 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1680 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:21.624667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-013bfd95-ac0b-4bff-b6b0-8880b97553dc tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:21.626884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-013bfd95-ac0b-4bff-b6b0-8880b97553dc tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:21.631255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-376243b2-c5a0-4860-91d4-616277a6df6e req-b0f8b3ce-f807-48f5-a7ba-c46c578c5c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2163760c-c909-4c33-8b11-ec59a37d3b06", "tag": "ce1af655-8223-49ec-abc2-e506d1114d41"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:39:21.637744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013bfd95-ac0b-4bff-b6b0-8880b97553dc tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:21.638421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013bfd95-ac0b-4bff-b6b0-8880b97553dc tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:21.639174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013bfd95-ac0b-4bff-b6b0-8880b97553dc tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:21.640601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013bfd95-ac0b-4bff-b6b0-8880b97553dc tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:21.641534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013bfd95-ac0b-4bff-b6b0-8880b97553dc tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:21.642294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013bfd95-ac0b-4bff-b6b0-8880b97553dc tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:21.660042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-376243b2-c5a0-4860-91d4-616277a6df6e req-b0f8b3ce-f807-48f5-a7ba-c46c578c5c7b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:21.661536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-376243b2-c5a0-4860-91d4-616277a6df6e req-b0f8b3ce-f807-48f5-a7ba-c46c578c5c7b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:21.662530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-376243b2-c5a0-4860-91d4-616277a6df6e req-b0f8b3ce-f807-48f5-a7ba-c46c578c5c7b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:21.692586 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-376243b2-c5a0-4860-91d4-616277a6df6e req-b0f8b3ce-f807-48f5-a7ba-c46c578c5c7b service nova] Creating event network-changed:ce1af655-8223-49ec-abc2-e506d1114d41 for instance 2163760c-c909-4c33-8b11-ec59a37d3b06 on n-h2-852084-10 Sep 08 13:39:21.694882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-013bfd95-ac0b-4bff-b6b0-8880b97553dc tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:39:21.705759 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-376243b2-c5a0-4860-91d4-616277a6df6e req-b0f8b3ce-f807-48f5-a7ba-c46c578c5c7b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084172 Sep 08 13:39:21.707483 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2943/6014] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:39:21.820465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:21.878118 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-013bfd95-ac0b-4bff-b6b0-8880b97553dc tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 204 len: 0 microversion: 2.1 time: 0.262109 Sep 08 13:39:21.879110 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3072/6015] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:39:21 2022] DELETE /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:39:21.895345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-76fdb8fb-1449-4222-aea0-f6f76e0aa376 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:21.896699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-76fdb8fb-1449-4222-aea0-f6f76e0aa376 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:21.905650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76fdb8fb-1449-4222-aea0-f6f76e0aa376 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:21.906164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76fdb8fb-1449-4222-aea0-f6f76e0aa376 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:21.906851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76fdb8fb-1449-4222-aea0-f6f76e0aa376 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:21.907708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76fdb8fb-1449-4222-aea0-f6f76e0aa376 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:21.908253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76fdb8fb-1449-4222-aea0-f6f76e0aa376 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:21.910429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76fdb8fb-1449-4222-aea0-f6f76e0aa376 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:22.213263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-76fdb8fb-1449-4222-aea0-f6f76e0aa376 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:22.230070 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-76fdb8fb-1449-4222-aea0-f6f76e0aa376 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1583 microversion: 2.1 time: 0.342032 Sep 08 13:39:22.231303 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2944/6016] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:21 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1583 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:23.279584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a476f06a-4e92-40b2-8c76-944e3e88cc08 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:23.280932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a476f06a-4e92-40b2-8c76-944e3e88cc08 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:23.291491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a476f06a-4e92-40b2-8c76-944e3e88cc08 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:23.292342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a476f06a-4e92-40b2-8c76-944e3e88cc08 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:23.293051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a476f06a-4e92-40b2-8c76-944e3e88cc08 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:23.293943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a476f06a-4e92-40b2-8c76-944e3e88cc08 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:23.294783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a476f06a-4e92-40b2-8c76-944e3e88cc08 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:23.295590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a476f06a-4e92-40b2-8c76-944e3e88cc08 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:23.722919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a476f06a-4e92-40b2-8c76-944e3e88cc08 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:23.733065 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a476f06a-4e92-40b2-8c76-944e3e88cc08 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1583 microversion: 2.1 time: 0.460773 Sep 08 13:39:23.733873 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3073/6017] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:23 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1583 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:24.353500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-21525430-12db-4423-ac25-16e05e085178 req-2a2fd1c7-2ee8-440c-aca5-d3f15e70577b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2163760c-c909-4c33-8b11-ec59a37d3b06", "name": "network-vif-deleted", "tag": "ce1af655-8223-49ec-abc2-e506d1114d41"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:39:24.366380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-21525430-12db-4423-ac25-16e05e085178 req-2a2fd1c7-2ee8-440c-aca5-d3f15e70577b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:24.366793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-21525430-12db-4423-ac25-16e05e085178 req-2a2fd1c7-2ee8-440c-aca5-d3f15e70577b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:24.367581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-21525430-12db-4423-ac25-16e05e085178 req-2a2fd1c7-2ee8-440c-aca5-d3f15e70577b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:24.386000 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-21525430-12db-4423-ac25-16e05e085178 req-2a2fd1c7-2ee8-440c-aca5-d3f15e70577b service nova] Creating event network-vif-deleted:ce1af655-8223-49ec-abc2-e506d1114d41 for instance 2163760c-c909-4c33-8b11-ec59a37d3b06 on n-h2-852084-10 Sep 08 13:39:24.393609 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-21525430-12db-4423-ac25-16e05e085178 req-2a2fd1c7-2ee8-440c-aca5-d3f15e70577b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046251 Sep 08 13:39:24.394323 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2945/6018] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:39:24.769312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fa2653f1-2b2f-4a42-ae90-6cdcdc136a4b tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:24.771501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fa2653f1-2b2f-4a42-ae90-6cdcdc136a4b tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:24.787346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa2653f1-2b2f-4a42-ae90-6cdcdc136a4b tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:24.788262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa2653f1-2b2f-4a42-ae90-6cdcdc136a4b tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:24.789096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa2653f1-2b2f-4a42-ae90-6cdcdc136a4b tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:24.790490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa2653f1-2b2f-4a42-ae90-6cdcdc136a4b tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:24.791509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa2653f1-2b2f-4a42-ae90-6cdcdc136a4b tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:24.792246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa2653f1-2b2f-4a42-ae90-6cdcdc136a4b tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:24.918737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fa2653f1-2b2f-4a42-ae90-6cdcdc136a4b tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:24.932625 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fa2653f1-2b2f-4a42-ae90-6cdcdc136a4b tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1229 microversion: 2.1 time: 0.177018 Sep 08 13:39:24.933676 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3074/6019] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:24 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1229 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:25.980991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38b8c6e6-cec0-4304-acab-8a959016afa1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:25.982309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-38b8c6e6-cec0-4304-acab-8a959016afa1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:25.995422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38b8c6e6-cec0-4304-acab-8a959016afa1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:25.996717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38b8c6e6-cec0-4304-acab-8a959016afa1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:25.997777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38b8c6e6-cec0-4304-acab-8a959016afa1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:25.999528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38b8c6e6-cec0-4304-acab-8a959016afa1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:26.000643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38b8c6e6-cec0-4304-acab-8a959016afa1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:26.001446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38b8c6e6-cec0-4304-acab-8a959016afa1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:26.114964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38b8c6e6-cec0-4304-acab-8a959016afa1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:26.129134 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38b8c6e6-cec0-4304-acab-8a959016afa1 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1229 microversion: 2.1 time: 0.158740 Sep 08 13:39:26.129902 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2946/6020] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:25 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1229 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:27.164330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c0571be4-c485-49b4-be86-791b0778d5f9 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:27.166280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c0571be4-c485-49b4-be86-791b0778d5f9 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:27.176307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0571be4-c485-49b4-be86-791b0778d5f9 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:27.176830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0571be4-c485-49b4-be86-791b0778d5f9 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:27.177484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0571be4-c485-49b4-be86-791b0778d5f9 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:27.178316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0571be4-c485-49b4-be86-791b0778d5f9 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:27.178876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0571be4-c485-49b4-be86-791b0778d5f9 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:27.179514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0571be4-c485-49b4-be86-791b0778d5f9 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:27.271636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c0571be4-c485-49b4-be86-791b0778d5f9 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:27.285702 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c0571be4-c485-49b4-be86-791b0778d5f9 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1229 microversion: 2.1 time: 0.126873 Sep 08 13:39:27.287042 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3075/6021] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:27 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1229 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:28.325573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b22c4609-d67d-4036-a9b1-8cfddcd7b21a tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:28.326346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b22c4609-d67d-4036-a9b1-8cfddcd7b21a tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:28.336346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b22c4609-d67d-4036-a9b1-8cfddcd7b21a tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:28.337141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b22c4609-d67d-4036-a9b1-8cfddcd7b21a tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:28.337950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b22c4609-d67d-4036-a9b1-8cfddcd7b21a tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:28.339188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b22c4609-d67d-4036-a9b1-8cfddcd7b21a tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:28.339998 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b22c4609-d67d-4036-a9b1-8cfddcd7b21a tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:28.340727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b22c4609-d67d-4036-a9b1-8cfddcd7b21a tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:28.462752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b22c4609-d67d-4036-a9b1-8cfddcd7b21a tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:28.474060 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b22c4609-d67d-4036-a9b1-8cfddcd7b21a tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1229 microversion: 2.1 time: 0.154263 Sep 08 13:39:28.474991 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2947/6022] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:28 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1229 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:29.501714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ccd2111c-85fd-433f-99d6-40a6581b83a8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:29.503250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ccd2111c-85fd-433f-99d6-40a6581b83a8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:29.507170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:29.516143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccd2111c-85fd-433f-99d6-40a6581b83a8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:29.516644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccd2111c-85fd-433f-99d6-40a6581b83a8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:29.517235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccd2111c-85fd-433f-99d6-40a6581b83a8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:29.518525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccd2111c-85fd-433f-99d6-40a6581b83a8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:29.518998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccd2111c-85fd-433f-99d6-40a6581b83a8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:29.519463 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ccd2111c-85fd-433f-99d6-40a6581b83a8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:29.624457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ccd2111c-85fd-433f-99d6-40a6581b83a8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5461fd7292894933988ca9b07b70d2a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1c8da2571de94d3ea65fdd8536a7cab7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:29.636645 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ccd2111c-85fd-433f-99d6-40a6581b83a8 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 200 len: 1229 microversion: 2.1 time: 0.141088 Sep 08 13:39:29.637824 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3076/6023] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:29 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 1229 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:39:30.677976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-123d4353-318c-49f7-bf8f-d803150f7325 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:30.679024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-123d4353-318c-49f7-bf8f-d803150f7325 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] [instance: 2163760c-c909-4c33-8b11-ec59a37d3b06] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:30.691243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-123d4353-318c-49f7-bf8f-d803150f7325 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:30.692221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-123d4353-318c-49f7-bf8f-d803150f7325 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:30.692984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-123d4353-318c-49f7-bf8f-d803150f7325 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:30.694291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-123d4353-318c-49f7-bf8f-d803150f7325 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:30.695143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-123d4353-318c-49f7-bf8f-d803150f7325 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:30.696253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-123d4353-318c-49f7-bf8f-d803150f7325 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:30.715836 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-123d4353-318c-49f7-bf8f-d803150f7325 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] HTTP exception thrown: Instance 2163760c-c909-4c33-8b11-ec59a37d3b06 could not be found. Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-123d4353-318c-49f7-bf8f-d803150f7325 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Request method failure captured: Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 HTTP/1.1 Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe9WMGTRSbyiWqFGLHpVBalJ5CnOTENFDxRB_NCwOtnHLogkCUNBrDEtS9e_QQOEjUCCYTOCb55DuPf0CMwbzRJtU_2OKvkuDcKzjeRiLW3KSxLca6029b2PWeS6X6c1hNqLjxmPWxdAxOYa7MPvfppMCyzZKDQoYK53z_iE6U3wqqU Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 1c8da2571de94d3ea65fdd8536a7cab7 Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestVolumeBackupRestore-572710634 Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_1c8da2571de94d3ea65fdd8536a7cab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/1c8da2571de94d3ea65fdd8536a7cab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1c8da2571de94d3ea65fdd8536a7cab7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/1c8da2571de94d3ea65fdd8536a7cab7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestVolumeBackupRestore-572710634 Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 1c8da2571de94d3ea65fdd8536a7cab7 Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestVolumeBackupRestore-572710634 Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestVolumeBackupRestore-572710634-project Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 5461fd7292894933988ca9b07b70d2a3 Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestVolumeBackupRestore-572710634-project Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 2163760c-c909-4c33-8b11-ec59a37d3b06 could not be found. Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '2163760c-c909-4c33-8b11-ec59a37d3b06'} Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2163760c-c909-4c33-8b11-ec59a37d3b06 could not be found. Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2163760c-c909-4c33-8b11-ec59a37d3b06 could not be found. Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:39:30.717628 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:30.723296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:39:30.723296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:39:30.723296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:39:30.723296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:39:30.723296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:39:30.723296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2163760c-c909-4c33-8b11-ec59a37d3b06 could not be found. Sep 08 13:39:30.723296 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:30.723296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-123d4353-318c-49f7-bf8f-d803150f7325 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Returning 404 to user: Instance 2163760c-c909-4c33-8b11-ec59a37d3b06 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:39:30.723296 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-123d4353-318c-49f7-bf8f-d803150f7325 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06" status: 404 len: 111 microversion: 2.1 time: 0.046450 Sep 08 13:39:30.723296 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2948/6024] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:30 2022] GET /compute/v2.1/servers/2163760c-c909-4c33-8b11-ec59a37d3b06 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:39:31.306526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0996a312-e68b-4902-ac84-2ff07db590b0 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] Calling method '.version_select at 0x7fdb36bcd820>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:31.337785 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0996a312-e68b-4902-ac84-2ff07db590b0 tempest-TestVolumeBackupRestore-572710634 tempest-TestVolumeBackupRestore-572710634-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-765478080" status: 202 len: 0 microversion: 2.1 time: 0.366385 Sep 08 13:39:31.338835 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3077/6025] 10.222.0.78 () {58 vars in 1266 bytes} [Thu Sep 8 13:39:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-765478080 => generated 0 bytes in 369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:39:41.044292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a5e6f799-6894-4e11-8201-95b8e108f7fa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:39:41.047366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a5e6f799-6894-4e11-8201-95b8e108f7fa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:41.053969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=31 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:41.055795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=51 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:41.066290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5e6f799-6894-4e11-8201-95b8e108f7fa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:41.070374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5e6f799-6894-4e11-8201-95b8e108f7fa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:41.071803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5e6f799-6894-4e11-8201-95b8e108f7fa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:41.073136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5e6f799-6894-4e11-8201-95b8e108f7fa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:41.073973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5e6f799-6894-4e11-8201-95b8e108f7fa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:41.074743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a5e6f799-6894-4e11-8201-95b8e108f7fa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:41.178487 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a5e6f799-6894-4e11-8201-95b8e108f7fa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d/action" status: 200 len: 24541 microversion: 2.1 time: 0.139862 Sep 08 13:39:41.183361 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2949/6026] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:39:41 2022] POST /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d/action => generated 24541 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:39:47.489982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28e50922-13ac-43c0-9e32-128ec6bb473d tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:47.492063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-28e50922-13ac-43c0-9e32-128ec6bb473d tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:47.499556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=24 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:47.501105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=4,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:39:47.513624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28e50922-13ac-43c0-9e32-128ec6bb473d tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:47.514592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28e50922-13ac-43c0-9e32-128ec6bb473d tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:47.515570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28e50922-13ac-43c0-9e32-128ec6bb473d tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:47.516968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28e50922-13ac-43c0-9e32-128ec6bb473d tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:47.518815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28e50922-13ac-43c0-9e32-128ec6bb473d tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:47.520057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28e50922-13ac-43c0-9e32-128ec6bb473d tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:47.730581 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-28e50922-13ac-43c0-9e32-128ec6bb473d tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1833 microversion: 2.1 time: 0.249700 Sep 08 13:39:47.744301 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3078/6027] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:47 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1833 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:49.815435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-511ba66f-75a9-47ba-9180-d8741efcec8d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:49.816676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-511ba66f-75a9-47ba-9180-d8741efcec8d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:49.826082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-511ba66f-75a9-47ba-9180-d8741efcec8d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:49.826786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-511ba66f-75a9-47ba-9180-d8741efcec8d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:49.827618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-511ba66f-75a9-47ba-9180-d8741efcec8d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:49.829250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-511ba66f-75a9-47ba-9180-d8741efcec8d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:49.831122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-511ba66f-75a9-47ba-9180-d8741efcec8d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:49.831694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7f6a4f2c-f693-4270-a8d7-f2d203c63745 req-9d27e45b-160f-4cec-94c7-a547df37ee1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16259878-2ec8-465b-8777-b178ff771d9d", "tag": "251d8243-f2b8-4578-bdc0-9bada8b3f1d9"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:39:49.833377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-511ba66f-75a9-47ba-9180-d8741efcec8d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:49.864392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7f6a4f2c-f693-4270-a8d7-f2d203c63745 req-9d27e45b-160f-4cec-94c7-a547df37ee1e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:49.865590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7f6a4f2c-f693-4270-a8d7-f2d203c63745 req-9d27e45b-160f-4cec-94c7-a547df37ee1e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:49.867968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7f6a4f2c-f693-4270-a8d7-f2d203c63745 req-9d27e45b-160f-4cec-94c7-a547df37ee1e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:49.901642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-511ba66f-75a9-47ba-9180-d8741efcec8d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:39:49.906037 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7f6a4f2c-f693-4270-a8d7-f2d203c63745 req-9d27e45b-160f-4cec-94c7-a547df37ee1e service nova] Creating event network-changed:251d8243-f2b8-4578-bdc0-9bada8b3f1d9 for instance 16259878-2ec8-465b-8777-b178ff771d9d on n-h2-852084-10 Sep 08 13:39:49.917473 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7f6a4f2c-f693-4270-a8d7-f2d203c63745 req-9d27e45b-160f-4cec-94c7-a547df37ee1e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101482 Sep 08 13:39:49.929384 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3079/6028] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:39:50.175982 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-511ba66f-75a9-47ba-9180-d8741efcec8d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "DELETE /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 204 len: 0 microversion: 2.1 time: 0.367824 Sep 08 13:39:50.177139 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2950/6029] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:39:49 2022] DELETE /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:39:50.188613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-18ed53ea-e0e7-4140-bb56-eb3097d7fbcb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:50.190198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-18ed53ea-e0e7-4140-bb56-eb3097d7fbcb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:50.199458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18ed53ea-e0e7-4140-bb56-eb3097d7fbcb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:50.200228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18ed53ea-e0e7-4140-bb56-eb3097d7fbcb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:50.200966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18ed53ea-e0e7-4140-bb56-eb3097d7fbcb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:50.202133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18ed53ea-e0e7-4140-bb56-eb3097d7fbcb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:50.203168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18ed53ea-e0e7-4140-bb56-eb3097d7fbcb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:50.203926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18ed53ea-e0e7-4140-bb56-eb3097d7fbcb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:50.489800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-18ed53ea-e0e7-4140-bb56-eb3097d7fbcb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:50.499914 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-18ed53ea-e0e7-4140-bb56-eb3097d7fbcb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1686 microversion: 2.1 time: 0.316910 Sep 08 13:39:50.500522 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3080/6030] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:50 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1686 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:51.527143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-99039230-a1dc-48c8-bd33-9038507bf9db tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:51.528398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-99039230-a1dc-48c8-bd33-9038507bf9db tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:51.538904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99039230-a1dc-48c8-bd33-9038507bf9db tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:51.539674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99039230-a1dc-48c8-bd33-9038507bf9db tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:51.540396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99039230-a1dc-48c8-bd33-9038507bf9db tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:51.541418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99039230-a1dc-48c8-bd33-9038507bf9db tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:51.542158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99039230-a1dc-48c8-bd33-9038507bf9db tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:51.542891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99039230-a1dc-48c8-bd33-9038507bf9db tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:51.953025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-99039230-a1dc-48c8-bd33-9038507bf9db tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:39:51.963553 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-99039230-a1dc-48c8-bd33-9038507bf9db tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 200 len: 1686 microversion: 2.1 time: 0.441999 Sep 08 13:39:51.964611 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2951/6031] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:51 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 1686 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:39:52.280846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-5b67a62f-4c18-42f7-96d1-07642ff2f5c8 req-a946cccc-1dea-4f2c-9e46-433caddb2f5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16259878-2ec8-465b-8777-b178ff771d9d", "name": "network-vif-deleted", "tag": "251d8243-f2b8-4578-bdc0-9bada8b3f1d9"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:39:52.304410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5b67a62f-4c18-42f7-96d1-07642ff2f5c8 req-a946cccc-1dea-4f2c-9e46-433caddb2f5d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:52.305019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5b67a62f-4c18-42f7-96d1-07642ff2f5c8 req-a946cccc-1dea-4f2c-9e46-433caddb2f5d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:52.305522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5b67a62f-4c18-42f7-96d1-07642ff2f5c8 req-a946cccc-1dea-4f2c-9e46-433caddb2f5d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:52.324791 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-5b67a62f-4c18-42f7-96d1-07642ff2f5c8 req-a946cccc-1dea-4f2c-9e46-433caddb2f5d service nova] Creating event network-vif-deleted:251d8243-f2b8-4578-bdc0-9bada8b3f1d9 for instance 16259878-2ec8-465b-8777-b178ff771d9d on n-h2-852084-10 Sep 08 13:39:52.330906 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-5b67a62f-4c18-42f7-96d1-07642ff2f5c8 req-a946cccc-1dea-4f2c-9e46-433caddb2f5d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057500 Sep 08 13:39:52.331857 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3081/6032] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:39:52.997514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5116c98-a0ec-4376-af42-51cfa41a0094 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:52.998137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c5116c98-a0ec-4376-af42-51cfa41a0094 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 16259878-2ec8-465b-8777-b178ff771d9d] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:39:53.006944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5116c98-a0ec-4376-af42-51cfa41a0094 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:53.007647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5116c98-a0ec-4376-af42-51cfa41a0094 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:53.008211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5116c98-a0ec-4376-af42-51cfa41a0094 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:53.009066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5116c98-a0ec-4376-af42-51cfa41a0094 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:39:53.009685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5116c98-a0ec-4376-af42-51cfa41a0094 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:39:53.010191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5116c98-a0ec-4376-af42-51cfa41a0094 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:39:53.035827 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-c5116c98-a0ec-4376-af42-51cfa41a0094 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] HTTP exception thrown: Instance 16259878-2ec8-465b-8777-b178ff771d9d could not be found. Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5116c98-a0ec-4376-af42-51cfa41a0094 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Request method failure captured: Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d HTTP/1.1 Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfAnDjCiija-3DB5W4J6ri-fu6OcpUbo-W8mx5zngP02-J7_POIIpc3-zpJO-dfrroJuHCv8EsActPv5vuSWguNHoH76B17-De96TjlaxEdNnya3aBd8z3oBNyuhh5JRVQPwN6yVLxLYfY3oQXXo567eBhy9Fhj_K2TtE8cZ_abBrJY Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: cbd130c38aeb4b23b1907212bfe92619 Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2131984032 Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2131984032 Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: cbd130c38aeb4b23b1907212bfe92619 Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2131984032 Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestNetworkAdvancedServerOps-2131984032-project Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: c3fb5a1860bd4f118dc19ec38c1796d1 Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2131984032-project Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 16259878-2ec8-465b-8777-b178ff771d9d could not be found. Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '16259878-2ec8-465b-8777-b178ff771d9d'} Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16259878-2ec8-465b-8777-b178ff771d9d could not be found. Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16259878-2ec8-465b-8777-b178ff771d9d could not be found. Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:53.038835 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:39:53.046359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:53.046359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:39:53.046359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:39:53.046359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:39:53.046359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:39:53.046359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:39:53.046359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16259878-2ec8-465b-8777-b178ff771d9d could not be found. Sep 08 13:39:53.046359 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:39:53.046359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5116c98-a0ec-4376-af42-51cfa41a0094 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Returning 404 to user: Instance 16259878-2ec8-465b-8777-b178ff771d9d could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:39:53.046359 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c5116c98-a0ec-4376-af42-51cfa41a0094 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d" status: 404 len: 111 microversion: 2.1 time: 0.048814 Sep 08 13:39:53.046359 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2952/6033] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:39:52 2022] GET /compute/v2.1/servers/16259878-2ec8-465b-8777-b178ff771d9d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:39:57.801164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1630e879-a53d-4cfa-b793-f061df7be516 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '.version_select at 0x7fdb36c30280>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:39:57.828773 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1630e879-a53d-4cfa-b793-f061df7be516 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1654183059" status: 202 len: 0 microversion: 2.1 time: 0.034304 Sep 08 13:39:57.830142 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3082/6034] 10.222.0.78 () {58 vars in 1284 bytes} [Thu Sep 8 13:39:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1654183059 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:39:57.875151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e9c2596d-7fe6-4046-92bb-f1a5a251397f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'create', calling method: .version_select at 0x7fdb3acdf310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2022353560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAl1JFaLM2QAgMsLX8Q32jCFZsACh+qE5UauuF4bkSNvd7/mpmhekl2+FGhvOCCc2L/hz/9SJARs+ZG2Hhzfx8RhlSnhyI3XHWZA/v08gb8PgRGa9TGiSccWMQDfauZ+hA=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:39:57.896286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-e9c2596d-7fe6-4046-92bb-f1a5a251397f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for project cbd130c38aeb4b23b1907212bfe92619. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:39:57.902802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-e9c2596d-7fe6-4046-92bb-f1a5a251397f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for user c3fb5a1860bd4f118dc19ec38c1796d1 and project cbd130c38aeb4b23b1907212bfe92619. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:39:57.933332 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e9c2596d-7fe6-4046-92bb-f1a5a251397f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.062580 Sep 08 13:39:57.934131 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2953/6035] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:39:57 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:40:06.834187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-183700445", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "cc1f9572-427c-4c7b-bf04-fe1b7bf04db5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2022353560", "security_groups": [{"name": "tempest-secgroup-smoke-2140966808"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:40:06.859146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=16 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:07.010633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] validate_networks() for [('cc1f9572-427c-4c7b-bf04-fe1b7bf04db5', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:40:07.555277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:40:07.555898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:40:07.556613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:40:07.557128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:40:07.557813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:40:07.573476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:07.573982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:07.574461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:07.575487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:07.575970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:07.576419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:07.603793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for project cbd130c38aeb4b23b1907212bfe92619. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:40:07.614145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for user c3fb5a1860bd4f118dc19ec38c1796d1 and project cbd130c38aeb4b23b1907212bfe92619. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:40:07.642117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:40:07.644814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:40:07.717244 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f19177d3-d778-4108-91c8-38d84cb0c714 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.886803 Sep 08 13:40:07.718400 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3083/6036] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:40:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:40:07.734604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:07.741748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-782ea48c-1447-4687-ba79-63586933da22 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:07.749138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-782ea48c-1447-4687-ba79-63586933da22 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:07.850075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-782ea48c-1447-4687-ba79-63586933da22 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:07.861656 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-782ea48c-1447-4687-ba79-63586933da22 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1266 microversion: 2.1 time: 0.128521 Sep 08 13:40:07.862268 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2954/6037] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:07 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:08.897192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e557a2f-82d3-4763-a036-2ef8f2a30dda tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:08.898619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6e557a2f-82d3-4763-a036-2ef8f2a30dda tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:08.913359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e557a2f-82d3-4763-a036-2ef8f2a30dda tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:08.914558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e557a2f-82d3-4763-a036-2ef8f2a30dda tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:08.917543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e557a2f-82d3-4763-a036-2ef8f2a30dda tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:08.919297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e557a2f-82d3-4763-a036-2ef8f2a30dda tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:08.920370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e557a2f-82d3-4763-a036-2ef8f2a30dda tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:08.921355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e557a2f-82d3-4763-a036-2ef8f2a30dda tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:09.025858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6e557a2f-82d3-4763-a036-2ef8f2a30dda tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:09.039118 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6e557a2f-82d3-4763-a036-2ef8f2a30dda tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1318 microversion: 2.1 time: 0.151703 Sep 08 13:40:09.055106 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3084/6038] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:08 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:10.069257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a28f1f89-97a3-49e0-9353-02e16430385b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:10.070103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a28f1f89-97a3-49e0-9353-02e16430385b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:10.085151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28f1f89-97a3-49e0-9353-02e16430385b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:10.085668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28f1f89-97a3-49e0-9353-02e16430385b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:10.086320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28f1f89-97a3-49e0-9353-02e16430385b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:10.087090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28f1f89-97a3-49e0-9353-02e16430385b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:10.087590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28f1f89-97a3-49e0-9353-02e16430385b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:10.088223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28f1f89-97a3-49e0-9353-02e16430385b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:10.208620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a28f1f89-97a3-49e0-9353-02e16430385b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:10.221614 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a28f1f89-97a3-49e0-9353-02e16430385b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1324 microversion: 2.1 time: 0.161684 Sep 08 13:40:10.222642 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2955/6039] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:10 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:11.261390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cb5680e8-bddd-46ca-8498-c243830dc4a0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:11.262648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cb5680e8-bddd-46ca-8498-c243830dc4a0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:11.275756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb5680e8-bddd-46ca-8498-c243830dc4a0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:11.276696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb5680e8-bddd-46ca-8498-c243830dc4a0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:11.277490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb5680e8-bddd-46ca-8498-c243830dc4a0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:11.278799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb5680e8-bddd-46ca-8498-c243830dc4a0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:11.279713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb5680e8-bddd-46ca-8498-c243830dc4a0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:11.280747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb5680e8-bddd-46ca-8498-c243830dc4a0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:11.534017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cb5680e8-bddd-46ca-8498-c243830dc4a0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:11.547134 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cb5680e8-bddd-46ca-8498-c243830dc4a0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1392 microversion: 2.1 time: 0.292285 Sep 08 13:40:11.548662 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3085/6040] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:11 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1392 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:11.578746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-1489e056-d293-44e0-8bf6-9e7c69f06d09 req-78789b4a-f1e6-4c2e-b5b0-4f74188ffdff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60054117-39ad-4edf-a396-0b380a14da05", "tag": "cea95bce-21f6-4039-99c0-2cf826a83480"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:40:11.589774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:11.601386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1489e056-d293-44e0-8bf6-9e7c69f06d09 req-78789b4a-f1e6-4c2e-b5b0-4f74188ffdff service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:11.602004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1489e056-d293-44e0-8bf6-9e7c69f06d09 req-78789b4a-f1e6-4c2e-b5b0-4f74188ffdff service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:11.602631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1489e056-d293-44e0-8bf6-9e7c69f06d09 req-78789b4a-f1e6-4c2e-b5b0-4f74188ffdff service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:11.620893 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-1489e056-d293-44e0-8bf6-9e7c69f06d09 req-78789b4a-f1e6-4c2e-b5b0-4f74188ffdff service nova] Creating event network-changed:cea95bce-21f6-4039-99c0-2cf826a83480 for instance 60054117-39ad-4edf-a396-0b380a14da05 on n-h2-852084-10 Sep 08 13:40:11.627892 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-1489e056-d293-44e0-8bf6-9e7c69f06d09 req-78789b4a-f1e6-4c2e-b5b0-4f74188ffdff service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057533 Sep 08 13:40:11.628713 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2956/6041] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:40:12.587206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fbbdc843-1f5a-4345-bc47-6d8b5dde7ccb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:12.588231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fbbdc843-1f5a-4345-bc47-6d8b5dde7ccb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:12.599636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbbdc843-1f5a-4345-bc47-6d8b5dde7ccb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:12.600435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbbdc843-1f5a-4345-bc47-6d8b5dde7ccb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:12.601146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbbdc843-1f5a-4345-bc47-6d8b5dde7ccb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:12.602299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbbdc843-1f5a-4345-bc47-6d8b5dde7ccb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:12.603031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbbdc843-1f5a-4345-bc47-6d8b5dde7ccb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:12.603772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbbdc843-1f5a-4345-bc47-6d8b5dde7ccb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:12.840521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fbbdc843-1f5a-4345-bc47-6d8b5dde7ccb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:12.849858 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fbbdc843-1f5a-4345-bc47-6d8b5dde7ccb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1392 microversion: 2.1 time: 0.269195 Sep 08 13:40:12.850462 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3086/6042] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:12 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1392 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:13.888046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-57736751-88fb-49d0-8781-39a8b88bd365 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:13.889392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-57736751-88fb-49d0-8781-39a8b88bd365 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:13.904872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57736751-88fb-49d0-8781-39a8b88bd365 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:13.905793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57736751-88fb-49d0-8781-39a8b88bd365 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:13.907325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57736751-88fb-49d0-8781-39a8b88bd365 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:13.908229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57736751-88fb-49d0-8781-39a8b88bd365 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:13.909118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57736751-88fb-49d0-8781-39a8b88bd365 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:13.909921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-57736751-88fb-49d0-8781-39a8b88bd365 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:14.171544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-57736751-88fb-49d0-8781-39a8b88bd365 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:14.196741 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-57736751-88fb-49d0-8781-39a8b88bd365 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1392 microversion: 2.1 time: 0.317402 Sep 08 13:40:14.197544 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2957/6043] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:13 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1392 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:40:15.226611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f4eda2e2-d3c5-43be-88c7-7bb5cfbf81f0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:15.228131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f4eda2e2-d3c5-43be-88c7-7bb5cfbf81f0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:15.241743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4eda2e2-d3c5-43be-88c7-7bb5cfbf81f0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:15.242648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4eda2e2-d3c5-43be-88c7-7bb5cfbf81f0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:15.243747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4eda2e2-d3c5-43be-88c7-7bb5cfbf81f0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:15.245143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4eda2e2-d3c5-43be-88c7-7bb5cfbf81f0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:15.246231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4eda2e2-d3c5-43be-88c7-7bb5cfbf81f0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:15.247022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f4eda2e2-d3c5-43be-88c7-7bb5cfbf81f0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:15.411489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f4eda2e2-d3c5-43be-88c7-7bb5cfbf81f0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:15.420456 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f4eda2e2-d3c5-43be-88c7-7bb5cfbf81f0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1392 microversion: 2.1 time: 0.200264 Sep 08 13:40:15.421055 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3087/6044] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:15 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1392 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:16.450503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3621064f-7d6a-4634-b44f-3e6b0ac66434 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:16.451980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3621064f-7d6a-4634-b44f-3e6b0ac66434 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:16.465193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3621064f-7d6a-4634-b44f-3e6b0ac66434 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:16.466119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3621064f-7d6a-4634-b44f-3e6b0ac66434 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:16.467143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3621064f-7d6a-4634-b44f-3e6b0ac66434 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:16.468603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3621064f-7d6a-4634-b44f-3e6b0ac66434 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:16.469479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3621064f-7d6a-4634-b44f-3e6b0ac66434 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:16.470764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3621064f-7d6a-4634-b44f-3e6b0ac66434 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:16.515938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-20e8ff56-3547-4592-8f95-dc47b9684be5 req-8a385979-9a65-4c66-96c6-a94ab2106a55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60054117-39ad-4edf-a396-0b380a14da05", "name": "network-vif-plugged", "status": "completed", "tag": "cea95bce-21f6-4039-99c0-2cf826a83480"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:40:16.539001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-20e8ff56-3547-4592-8f95-dc47b9684be5 req-8a385979-9a65-4c66-96c6-a94ab2106a55 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:16.539791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-20e8ff56-3547-4592-8f95-dc47b9684be5 req-8a385979-9a65-4c66-96c6-a94ab2106a55 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:16.540422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-20e8ff56-3547-4592-8f95-dc47b9684be5 req-8a385979-9a65-4c66-96c6-a94ab2106a55 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:16.564439 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-20e8ff56-3547-4592-8f95-dc47b9684be5 req-8a385979-9a65-4c66-96c6-a94ab2106a55 service nova] Creating event network-vif-plugged:cea95bce-21f6-4039-99c0-2cf826a83480 for instance 60054117-39ad-4edf-a396-0b380a14da05 on n-h2-852084-10 Sep 08 13:40:16.575662 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-20e8ff56-3547-4592-8f95-dc47b9684be5 req-8a385979-9a65-4c66-96c6-a94ab2106a55 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066884 Sep 08 13:40:16.577678 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3088/6045] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:40:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:40:16.750911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3621064f-7d6a-4634-b44f-3e6b0ac66434 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:16.766173 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3621064f-7d6a-4634-b44f-3e6b0ac66434 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1392 microversion: 2.1 time: 0.323150 Sep 08 13:40:16.768043 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2958/6046] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:16 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1392 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:17.807655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:17.808886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:17.815269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89f9ab60-6740-490b-84b7-12c6179232a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:17.816218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-89f9ab60-6740-490b-84b7-12c6179232a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:17.819406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:17.830408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89f9ab60-6740-490b-84b7-12c6179232a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:17.831067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89f9ab60-6740-490b-84b7-12c6179232a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:17.831678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89f9ab60-6740-490b-84b7-12c6179232a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:17.832668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89f9ab60-6740-490b-84b7-12c6179232a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:17.833276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89f9ab60-6740-490b-84b7-12c6179232a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:17.833834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89f9ab60-6740-490b-84b7-12c6179232a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:18.041509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-89f9ab60-6740-490b-84b7-12c6179232a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:18.051648 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-89f9ab60-6740-490b-84b7-12c6179232a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1392 microversion: 2.1 time: 0.246587 Sep 08 13:40:18.052552 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3089/6047] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:17 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1392 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:19.081243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f6af4a02-dca7-4fe0-a9c4-cebb1b769b31 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:19.082024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f6af4a02-dca7-4fe0-a9c4-cebb1b769b31 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:19.086314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:19.095401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6af4a02-dca7-4fe0-a9c4-cebb1b769b31 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:19.096044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6af4a02-dca7-4fe0-a9c4-cebb1b769b31 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:19.096580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6af4a02-dca7-4fe0-a9c4-cebb1b769b31 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:19.097552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6af4a02-dca7-4fe0-a9c4-cebb1b769b31 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:19.098201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6af4a02-dca7-4fe0-a9c4-cebb1b769b31 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:19.098896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6af4a02-dca7-4fe0-a9c4-cebb1b769b31 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:19.294088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f6af4a02-dca7-4fe0-a9c4-cebb1b769b31 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:19.304660 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f6af4a02-dca7-4fe0-a9c4-cebb1b769b31 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1564 microversion: 2.1 time: 0.229768 Sep 08 13:40:19.305312 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2959/6048] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:19 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1564 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:40:19.347287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-62f39a00-d5be-4db4-8aa8-f4a0dbc1ee21 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:19.348198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-62f39a00-d5be-4db4-8aa8-f4a0dbc1ee21 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:19.361600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62f39a00-d5be-4db4-8aa8-f4a0dbc1ee21 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:19.362517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62f39a00-d5be-4db4-8aa8-f4a0dbc1ee21 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:19.363394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62f39a00-d5be-4db4-8aa8-f4a0dbc1ee21 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:19.364754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62f39a00-d5be-4db4-8aa8-f4a0dbc1ee21 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:19.365628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62f39a00-d5be-4db4-8aa8-f4a0dbc1ee21 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:19.366433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62f39a00-d5be-4db4-8aa8-f4a0dbc1ee21 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:19.565866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-62f39a00-d5be-4db4-8aa8-f4a0dbc1ee21 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:19.576108 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-62f39a00-d5be-4db4-8aa8-f4a0dbc1ee21 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1564 microversion: 2.1 time: 0.236878 Sep 08 13:40:19.576720 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3090/6049] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:19 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1564 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:21.787679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0a600a49-81cf-4046-a2c7-3a8d96cde292 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:21.788680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0a600a49-81cf-4046-a2c7-3a8d96cde292 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:21.794992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-264243f7-225d-4884-9ae7-85eb3f1cdf8c req-ec9e3276-7f39-46ab-a142-82fff4018766 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60054117-39ad-4edf-a396-0b380a14da05", "tag": "cea95bce-21f6-4039-99c0-2cf826a83480"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:40:21.801150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a600a49-81cf-4046-a2c7-3a8d96cde292 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:21.802206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a600a49-81cf-4046-a2c7-3a8d96cde292 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:21.803982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a600a49-81cf-4046-a2c7-3a8d96cde292 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:21.805159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a600a49-81cf-4046-a2c7-3a8d96cde292 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:21.806029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a600a49-81cf-4046-a2c7-3a8d96cde292 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:21.806804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a600a49-81cf-4046-a2c7-3a8d96cde292 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:21.809215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-264243f7-225d-4884-9ae7-85eb3f1cdf8c req-ec9e3276-7f39-46ab-a142-82fff4018766 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:21.809862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-264243f7-225d-4884-9ae7-85eb3f1cdf8c req-ec9e3276-7f39-46ab-a142-82fff4018766 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:21.810582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-264243f7-225d-4884-9ae7-85eb3f1cdf8c req-ec9e3276-7f39-46ab-a142-82fff4018766 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:21.826447 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-264243f7-225d-4884-9ae7-85eb3f1cdf8c req-ec9e3276-7f39-46ab-a142-82fff4018766 service nova] Creating event network-changed:cea95bce-21f6-4039-99c0-2cf826a83480 for instance 60054117-39ad-4edf-a396-0b380a14da05 on n-h2-852084-10 Sep 08 13:40:21.834785 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-264243f7-225d-4884-9ae7-85eb3f1cdf8c req-ec9e3276-7f39-46ab-a142-82fff4018766 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056381 Sep 08 13:40:21.836202 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3091/6050] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:40:22.293083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0a600a49-81cf-4046-a2c7-3a8d96cde292 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:22.304607 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0a600a49-81cf-4046-a2c7-3a8d96cde292 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1564 microversion: 2.1 time: 0.531880 Sep 08 13:40:22.305263 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2960/6051] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:21 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1564 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:43.648057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=5 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:43.649338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=42 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:43.658045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-57398472-b7b0-4929-abba-57e66e3f8421 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:40:43.662166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-57398472-b7b0-4929-abba-57e66e3f8421 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:43.675940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57398472-b7b0-4929-abba-57e66e3f8421 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:43.676870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57398472-b7b0-4929-abba-57e66e3f8421 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:43.677709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57398472-b7b0-4929-abba-57e66e3f8421 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:43.679059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57398472-b7b0-4929-abba-57e66e3f8421 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:43.679995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57398472-b7b0-4929-abba-57e66e3f8421 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:43.680816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-57398472-b7b0-4929-abba-57e66e3f8421 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:43.774749 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-57398472-b7b0-4929-abba-57e66e3f8421 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05/action" status: 200 len: 24569 microversion: 2.1 time: 0.129954 Sep 08 13:40:43.786639 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3092/6052] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:40:43 2022] POST /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05/action => generated 24569 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:40:48.239066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=9 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:48.240385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=32 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:40:48.553700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d16d58fc-24af-47ed-86d0-b19123c81997 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:48.554203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d16d58fc-24af-47ed-86d0-b19123c81997 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:48.561739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d16d58fc-24af-47ed-86d0-b19123c81997 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:48.562246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d16d58fc-24af-47ed-86d0-b19123c81997 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:48.562698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d16d58fc-24af-47ed-86d0-b19123c81997 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:48.563473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d16d58fc-24af-47ed-86d0-b19123c81997 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:48.563941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d16d58fc-24af-47ed-86d0-b19123c81997 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:48.564381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d16d58fc-24af-47ed-86d0-b19123c81997 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:48.597760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d16d58fc-24af-47ed-86d0-b19123c81997 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:40:48.734182 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d16d58fc-24af-47ed-86d0-b19123c81997 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 204 len: 0 microversion: 2.1 time: 0.504608 Sep 08 13:40:48.734812 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2961/6053] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:40:48 2022] DELETE /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:40:48.744484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4bb4c969-0978-4865-8a85-5039ad1de905 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:48.745218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4bb4c969-0978-4865-8a85-5039ad1de905 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:48.754232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bb4c969-0978-4865-8a85-5039ad1de905 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:48.754834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bb4c969-0978-4865-8a85-5039ad1de905 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:48.755533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bb4c969-0978-4865-8a85-5039ad1de905 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:48.756569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bb4c969-0978-4865-8a85-5039ad1de905 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:48.757407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bb4c969-0978-4865-8a85-5039ad1de905 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:48.757760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4bb4c969-0978-4865-8a85-5039ad1de905 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:49.111625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4bb4c969-0978-4865-8a85-5039ad1de905 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:49.124950 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4bb4c969-0978-4865-8a85-5039ad1de905 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1577 microversion: 2.1 time: 0.384694 Sep 08 13:40:49.126398 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3093/6054] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:48 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1577 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:40:50.172384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b6ec19a-3be3-43db-ad44-4272321bf849 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:50.174214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1b6ec19a-3be3-43db-ad44-4272321bf849 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:50.184267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b6ec19a-3be3-43db-ad44-4272321bf849 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:50.185261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b6ec19a-3be3-43db-ad44-4272321bf849 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:50.186062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b6ec19a-3be3-43db-ad44-4272321bf849 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:50.186836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b6ec19a-3be3-43db-ad44-4272321bf849 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:50.187346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b6ec19a-3be3-43db-ad44-4272321bf849 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:50.187790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b6ec19a-3be3-43db-ad44-4272321bf849 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:50.478258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1b6ec19a-3be3-43db-ad44-4272321bf849 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:50.494244 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1b6ec19a-3be3-43db-ad44-4272321bf849 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1577 microversion: 2.1 time: 0.325375 Sep 08 13:40:50.495449 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2962/6055] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:50 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1577 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:40:51.533646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-226c4d9a-c077-4997-9730-23712fbba8f4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:51.534744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-226c4d9a-c077-4997-9730-23712fbba8f4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:51.548795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-226c4d9a-c077-4997-9730-23712fbba8f4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:51.549691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-226c4d9a-c077-4997-9730-23712fbba8f4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:51.550517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-226c4d9a-c077-4997-9730-23712fbba8f4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:51.551947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-226c4d9a-c077-4997-9730-23712fbba8f4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:51.552837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-226c4d9a-c077-4997-9730-23712fbba8f4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:51.553617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-226c4d9a-c077-4997-9730-23712fbba8f4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:51.656873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-226c4d9a-c077-4997-9730-23712fbba8f4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:51.670926 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-226c4d9a-c077-4997-9730-23712fbba8f4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1510 microversion: 2.1 time: 0.144710 Sep 08 13:40:51.672328 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3094/6056] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:51 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:52.170886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b520f857-2a21-4853-98a5-25f2ec1cbd90 req-1abd972c-ec57-4161-84fa-54a06bd02a4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc4b2224-da7c-4884-a959-f880d4af9288", "name": "network-vif-deleted", "tag": "5c1dbb5f-ff8f-4faf-807f-fcfefc7fa64d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:40:52.190214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b520f857-2a21-4853-98a5-25f2ec1cbd90 req-1abd972c-ec57-4161-84fa-54a06bd02a4e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:52.191499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b520f857-2a21-4853-98a5-25f2ec1cbd90 req-1abd972c-ec57-4161-84fa-54a06bd02a4e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:52.191915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b520f857-2a21-4853-98a5-25f2ec1cbd90 req-1abd972c-ec57-4161-84fa-54a06bd02a4e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:52.210207 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b520f857-2a21-4853-98a5-25f2ec1cbd90 req-1abd972c-ec57-4161-84fa-54a06bd02a4e service nova] Creating event network-vif-deleted:5c1dbb5f-ff8f-4faf-807f-fcfefc7fa64d for instance dc4b2224-da7c-4884-a959-f880d4af9288 on n-h1-852084-10 Sep 08 13:40:52.220353 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b520f857-2a21-4853-98a5-25f2ec1cbd90 req-1abd972c-ec57-4161-84fa-54a06bd02a4e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058479 Sep 08 13:40:52.221940 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2963/6057] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:40:52.707082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2085753f-ba9f-4ae0-9f17-09c7a5900b5d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:52.709775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2085753f-ba9f-4ae0-9f17-09c7a5900b5d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:52.718206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2085753f-ba9f-4ae0-9f17-09c7a5900b5d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:52.720515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2085753f-ba9f-4ae0-9f17-09c7a5900b5d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:52.720989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2085753f-ba9f-4ae0-9f17-09c7a5900b5d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:52.721852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2085753f-ba9f-4ae0-9f17-09c7a5900b5d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:52.722343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2085753f-ba9f-4ae0-9f17-09c7a5900b5d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:52.722801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2085753f-ba9f-4ae0-9f17-09c7a5900b5d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:52.806565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2085753f-ba9f-4ae0-9f17-09c7a5900b5d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:52.823984 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2085753f-ba9f-4ae0-9f17-09c7a5900b5d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1226 microversion: 2.1 time: 0.120948 Sep 08 13:40:52.825539 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3095/6058] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:52 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1226 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:53.856473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a7cadea8-0df2-4bc8-92e3-7939b3ff26bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:53.857784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a7cadea8-0df2-4bc8-92e3-7939b3ff26bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:53.869856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7cadea8-0df2-4bc8-92e3-7939b3ff26bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:53.870615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7cadea8-0df2-4bc8-92e3-7939b3ff26bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:53.871438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7cadea8-0df2-4bc8-92e3-7939b3ff26bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:53.872694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7cadea8-0df2-4bc8-92e3-7939b3ff26bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:53.873533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7cadea8-0df2-4bc8-92e3-7939b3ff26bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:53.874305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a7cadea8-0df2-4bc8-92e3-7939b3ff26bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:53.992999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a7cadea8-0df2-4bc8-92e3-7939b3ff26bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:54.006990 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a7cadea8-0df2-4bc8-92e3-7939b3ff26bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1226 microversion: 2.1 time: 0.160229 Sep 08 13:40:54.007662 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2964/6059] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:53 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1226 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:54.843262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-639320e0-7561-44e4-a7d6-4525c903e44b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:54.845065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-639320e0-7561-44e4-a7d6-4525c903e44b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:54.858395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-639320e0-7561-44e4-a7d6-4525c903e44b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:54.859340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-639320e0-7561-44e4-a7d6-4525c903e44b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:54.860162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-639320e0-7561-44e4-a7d6-4525c903e44b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:54.861494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-639320e0-7561-44e4-a7d6-4525c903e44b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:54.862350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-639320e0-7561-44e4-a7d6-4525c903e44b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:54.863171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-639320e0-7561-44e4-a7d6-4525c903e44b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:55.036822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1bd6a761-e478-4584-92d2-35fa03096fcd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:55.037947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1bd6a761-e478-4584-92d2-35fa03096fcd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:55.049028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd6a761-e478-4584-92d2-35fa03096fcd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:55.051342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd6a761-e478-4584-92d2-35fa03096fcd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:55.052124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd6a761-e478-4584-92d2-35fa03096fcd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:55.053921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd6a761-e478-4584-92d2-35fa03096fcd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:55.054769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd6a761-e478-4584-92d2-35fa03096fcd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:55.055730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bd6a761-e478-4584-92d2-35fa03096fcd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:55.062774 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-639320e0-7561-44e4-a7d6-4525c903e44b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1836 microversion: 2.1 time: 0.226589 Sep 08 13:40:55.067001 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3096/6060] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:54 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1836 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:55.096962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c045baa0-7a9a-474a-add3-efe6bdfcd5c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:55.098602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c045baa0-7a9a-474a-add3-efe6bdfcd5c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:55.111110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c045baa0-7a9a-474a-add3-efe6bdfcd5c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:55.112142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c045baa0-7a9a-474a-add3-efe6bdfcd5c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:55.113041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c045baa0-7a9a-474a-add3-efe6bdfcd5c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:55.114523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c045baa0-7a9a-474a-add3-efe6bdfcd5c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:55.115360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c045baa0-7a9a-474a-add3-efe6bdfcd5c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:55.116378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c045baa0-7a9a-474a-add3-efe6bdfcd5c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:55.159731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1bd6a761-e478-4584-92d2-35fa03096fcd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:55.182592 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1bd6a761-e478-4584-92d2-35fa03096fcd tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1226 microversion: 2.1 time: 0.153141 Sep 08 13:40:55.187366 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2965/6061] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:55 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:55.368645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c045baa0-7a9a-474a-add3-efe6bdfcd5c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:55.386018 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c045baa0-7a9a-474a-add3-efe6bdfcd5c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1683 microversion: 2.1 time: 0.296445 Sep 08 13:40:55.387330 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3097/6062] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:55 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1683 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:55.550118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-061d0c97-c4c9-4c7e-b43c-e636178841f9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:40:55.552638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-061d0c97-c4c9-4c7e-b43c-e636178841f9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:55.559539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-061d0c97-c4c9-4c7e-b43c-e636178841f9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:55.560044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-061d0c97-c4c9-4c7e-b43c-e636178841f9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:55.560491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-061d0c97-c4c9-4c7e-b43c-e636178841f9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:55.561216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-061d0c97-c4c9-4c7e-b43c-e636178841f9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:55.561679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-061d0c97-c4c9-4c7e-b43c-e636178841f9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:55.562118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-061d0c97-c4c9-4c7e-b43c-e636178841f9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:55.638843 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-061d0c97-c4c9-4c7e-b43c-e636178841f9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05/action" status: 200 len: 32644 microversion: 2.1 time: 0.093606 Sep 08 13:40:55.639596 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2966/6063] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:40:55 2022] POST /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05/action => generated 32644 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:40:55.819368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c27f98f1-1ea1-4b27-a10a-489309c6331e tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:40:55.820412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c27f98f1-1ea1-4b27-a10a-489309c6331e tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:55.828855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c27f98f1-1ea1-4b27-a10a-489309c6331e tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:55.829827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c27f98f1-1ea1-4b27-a10a-489309c6331e tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:55.830625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c27f98f1-1ea1-4b27-a10a-489309c6331e tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:55.831995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c27f98f1-1ea1-4b27-a10a-489309c6331e tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:55.832890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c27f98f1-1ea1-4b27-a10a-489309c6331e tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:55.833680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c27f98f1-1ea1-4b27-a10a-489309c6331e tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:55.894572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c27f98f1-1ea1-4b27-a10a-489309c6331e tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0d1d6a584f6a46b6a5b264947437cbef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51dc60d9404f47998fe3d656a2be095a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:55.895683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c27f98f1-1ea1-4b27-a10a-489309c6331e tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 60054117-39ad-4edf-a396-0b380a14da05] flavor_id is None. Assuming migration. {{(pid=128970) resize /opt/stack/nova/nova/compute/api.py:4196}} Sep 08 13:40:55.896481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c27f98f1-1ea1-4b27-a10a-489309c6331e tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128970) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 13:40:56.084542 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c27f98f1-1ea1-4b27-a10a-489309c6331e tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05/action" status: 202 len: 0 microversion: 2.1 time: 0.272367 Sep 08 13:40:56.090749 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3098/6064] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:40:55 2022] POST /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05/action => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:40:56.097512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62780e8c-b84c-4d00-bdd2-6aeafa5f20ee tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:56.098270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-62780e8c-b84c-4d00-bdd2-6aeafa5f20ee tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:56.112649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62780e8c-b84c-4d00-bdd2-6aeafa5f20ee tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:56.113784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62780e8c-b84c-4d00-bdd2-6aeafa5f20ee tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:56.114618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62780e8c-b84c-4d00-bdd2-6aeafa5f20ee tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:56.116042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62780e8c-b84c-4d00-bdd2-6aeafa5f20ee tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:56.117164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62780e8c-b84c-4d00-bdd2-6aeafa5f20ee tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:56.118519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62780e8c-b84c-4d00-bdd2-6aeafa5f20ee tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:56.215693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e6b20b73-b996-4ea8-af4c-64582ae4e6e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:56.216896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e6b20b73-b996-4ea8-af4c-64582ae4e6e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:56.229162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6b20b73-b996-4ea8-af4c-64582ae4e6e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:56.230154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6b20b73-b996-4ea8-af4c-64582ae4e6e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:56.231036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6b20b73-b996-4ea8-af4c-64582ae4e6e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:56.232517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6b20b73-b996-4ea8-af4c-64582ae4e6e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:56.233387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6b20b73-b996-4ea8-af4c-64582ae4e6e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:56.234409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6b20b73-b996-4ea8-af4c-64582ae4e6e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:56.388686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6b20b73-b996-4ea8-af4c-64582ae4e6e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:56.395642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-62780e8c-b84c-4d00-bdd2-6aeafa5f20ee tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:56.406156 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e6b20b73-b996-4ea8-af4c-64582ae4e6e8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1226 microversion: 2.1 time: 0.198372 Sep 08 13:40:56.406790 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62780e8c-b84c-4d00-bdd2-6aeafa5f20ee tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1692 microversion: 2.1 time: 0.314291 Sep 08 13:40:56.408013 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3099/6065] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:56 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1226 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:40:56.408201 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2967/6066] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:56 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1692 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:57.447564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8fa59d5e-0905-46a5-8f85-f66e9b3e4512 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:57.449583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8fa59d5e-0905-46a5-8f85-f66e9b3e4512 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:57.452338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-55f73e02-3697-4984-b6b3-60b6c2e82798 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:57.455217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-55f73e02-3697-4984-b6b3-60b6c2e82798 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:57.463793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f73e02-3697-4984-b6b3-60b6c2e82798 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:57.464722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f73e02-3697-4984-b6b3-60b6c2e82798 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:57.465368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f73e02-3697-4984-b6b3-60b6c2e82798 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:57.465695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fa59d5e-0905-46a5-8f85-f66e9b3e4512 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:57.466591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f73e02-3697-4984-b6b3-60b6c2e82798 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:57.466721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fa59d5e-0905-46a5-8f85-f66e9b3e4512 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:57.467370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f73e02-3697-4984-b6b3-60b6c2e82798 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:57.467491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fa59d5e-0905-46a5-8f85-f66e9b3e4512 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:57.468091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-55f73e02-3697-4984-b6b3-60b6c2e82798 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:57.468635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fa59d5e-0905-46a5-8f85-f66e9b3e4512 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:57.469403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fa59d5e-0905-46a5-8f85-f66e9b3e4512 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:57.470179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8fa59d5e-0905-46a5-8f85-f66e9b3e4512 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:57.637632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8fa59d5e-0905-46a5-8f85-f66e9b3e4512 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:57.649111 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8fa59d5e-0905-46a5-8f85-f66e9b3e4512 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 200 len: 1226 microversion: 2.1 time: 0.208683 Sep 08 13:40:57.649740 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3100/6067] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:57 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 1226 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:57.731486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-55f73e02-3697-4984-b6b3-60b6c2e82798 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:57.746961 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-55f73e02-3697-4984-b6b3-60b6c2e82798 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1692 microversion: 2.1 time: 0.304759 Sep 08 13:40:57.748219 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2968/6068] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:57 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1692 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:58.674559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79485699-5f0e-413c-a7e9-9d42ea5a9df2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:58.675788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-79485699-5f0e-413c-a7e9-9d42ea5a9df2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:58.686343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79485699-5f0e-413c-a7e9-9d42ea5a9df2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:58.687157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79485699-5f0e-413c-a7e9-9d42ea5a9df2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:58.687879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79485699-5f0e-413c-a7e9-9d42ea5a9df2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:58.689684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79485699-5f0e-413c-a7e9-9d42ea5a9df2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:58.690430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79485699-5f0e-413c-a7e9-9d42ea5a9df2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:58.691107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79485699-5f0e-413c-a7e9-9d42ea5a9df2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:58.710765 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-79485699-5f0e-413c-a7e9-9d42ea5a9df2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79485699-5f0e-413c-a7e9-9d42ea5a9df2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 HTTP/1.1 Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'dc4b2224-da7c-4884-a959-f880d4af9288'} Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:40:58.712534 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:40:58.719131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:40:58.719131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:40:58.719131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:40:58.719131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:40:58.719131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:40:58.719131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:40:58.719131 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:40:58.719131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79485699-5f0e-413c-a7e9-9d42ea5a9df2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:40:58.719131 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-79485699-5f0e-413c-a7e9-9d42ea5a9df2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 404 len: 111 microversion: 2.1 time: 0.044736 Sep 08 13:40:58.719131 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3101/6069] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:58 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:40:58.776770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-236404aa-9b41-4ea5-99d3-9eb03ec0cf61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:58.777863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-236404aa-9b41-4ea5-99d3-9eb03ec0cf61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:40:58.795363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-236404aa-9b41-4ea5-99d3-9eb03ec0cf61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:58.796426 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-236404aa-9b41-4ea5-99d3-9eb03ec0cf61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:58.797538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-236404aa-9b41-4ea5-99d3-9eb03ec0cf61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:58.799694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-236404aa-9b41-4ea5-99d3-9eb03ec0cf61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:58.800795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-236404aa-9b41-4ea5-99d3-9eb03ec0cf61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:58.801011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1439149362", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1418132249", "security_groups": [{"name": "tempest-secgroup-smoke-834206503"}], "block_device_mapping_v2": [{"uuid": "c7514d65-8c06-4683-a242-6a42a89b86dd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd09c139-4c62-4afa-ac6f-48ed313685b7"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:40:58.802118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-236404aa-9b41-4ea5-99d3-9eb03ec0cf61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:59.113875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] validate_networks() for [('dd09c139-4c62-4afa-ac6f-48ed313685b7', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:40:59.121885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-236404aa-9b41-4ea5-99d3-9eb03ec0cf61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:40:59.136336 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-236404aa-9b41-4ea5-99d3-9eb03ec0cf61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1692 microversion: 2.1 time: 0.366724 Sep 08 13:40:59.137446 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2969/6070] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:58 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1692 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:40:59.616067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:40:59.616561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:40:59.617098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:40:59.617564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:40:59.618037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:40:59.629282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:59.629785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:59.630242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:59.631008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:40:59.631520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:40:59.631963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:40:59.653611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:40:59.662076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for user 6f65d872026946a7a6badc404b161499 and project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:40:59.736056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:40:59.738478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c7514d65-8c06-4683-a242-6a42a89b86dd',volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:40:59.910300 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f1e70b10-9d27-45bd-9050-6cf01c689a43 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.118968 Sep 08 13:40:59.911295 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3102/6071] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:40:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 1121 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:40:59.923480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-14bbfc03-bae7-4b81-becf-730b423d2f41 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:40:59.924290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-14bbfc03-bae7-4b81-becf-730b423d2f41 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:00.005614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-14bbfc03-bae7-4b81-becf-730b423d2f41 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:00.020618 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-14bbfc03-bae7-4b81-becf-730b423d2f41 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1095 microversion: 2.1 time: 0.101661 Sep 08 13:41:00.021670 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2970/6072] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:40:59 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1095 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:00.174008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-330b98e9-b6c3-4545-b8e6-0d1e0b6ab272 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:00.174899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-330b98e9-b6c3-4545-b8e6-0d1e0b6ab272 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:00.181616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-330b98e9-b6c3-4545-b8e6-0d1e0b6ab272 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:00.182135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-330b98e9-b6c3-4545-b8e6-0d1e0b6ab272 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:00.182783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-330b98e9-b6c3-4545-b8e6-0d1e0b6ab272 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:00.184404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-330b98e9-b6c3-4545-b8e6-0d1e0b6ab272 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:00.185070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-330b98e9-b6c3-4545-b8e6-0d1e0b6ab272 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:00.185679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-330b98e9-b6c3-4545-b8e6-0d1e0b6ab272 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:00.360727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-330b98e9-b6c3-4545-b8e6-0d1e0b6ab272 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:00.370848 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-330b98e9-b6c3-4545-b8e6-0d1e0b6ab272 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1697 microversion: 2.1 time: 0.200682 Sep 08 13:41:00.371529 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3103/6073] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:00 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1697 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:41:01.060544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0920df9a-7cd8-4ef0-b834-41832c93d6f2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:01.061566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0920df9a-7cd8-4ef0-b834-41832c93d6f2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:01.070908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0920df9a-7cd8-4ef0-b834-41832c93d6f2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:01.071435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0920df9a-7cd8-4ef0-b834-41832c93d6f2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:01.071887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0920df9a-7cd8-4ef0-b834-41832c93d6f2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:01.072643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0920df9a-7cd8-4ef0-b834-41832c93d6f2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:01.073117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0920df9a-7cd8-4ef0-b834-41832c93d6f2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:01.073555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0920df9a-7cd8-4ef0-b834-41832c93d6f2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:01.177020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0920df9a-7cd8-4ef0-b834-41832c93d6f2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:01.187596 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0920df9a-7cd8-4ef0-b834-41832c93d6f2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1201 microversion: 2.1 time: 0.130714 Sep 08 13:41:01.188625 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2971/6074] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:01 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1201 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:01.417572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5415343f-2d80-462e-a3bd-2f0905ea17c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:01.419340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5415343f-2d80-462e-a3bd-2f0905ea17c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:01.429908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5415343f-2d80-462e-a3bd-2f0905ea17c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:01.431259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5415343f-2d80-462e-a3bd-2f0905ea17c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:01.432206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5415343f-2d80-462e-a3bd-2f0905ea17c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:01.433572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5415343f-2d80-462e-a3bd-2f0905ea17c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:01.434548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5415343f-2d80-462e-a3bd-2f0905ea17c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:01.435423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5415343f-2d80-462e-a3bd-2f0905ea17c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:01.637467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5415343f-2d80-462e-a3bd-2f0905ea17c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:01.648334 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5415343f-2d80-462e-a3bd-2f0905ea17c9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1697 microversion: 2.1 time: 0.235449 Sep 08 13:41:01.655295 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3104/6075] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:01 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1697 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:02.219137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d90f0b14-02bf-4cf2-be46-531cef0820a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:02.220568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d90f0b14-02bf-4cf2-be46-531cef0820a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:02.229641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d90f0b14-02bf-4cf2-be46-531cef0820a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:02.230613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d90f0b14-02bf-4cf2-be46-531cef0820a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:02.231075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d90f0b14-02bf-4cf2-be46-531cef0820a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:02.232006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d90f0b14-02bf-4cf2-be46-531cef0820a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:02.232647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d90f0b14-02bf-4cf2-be46-531cef0820a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:02.234597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d90f0b14-02bf-4cf2-be46-531cef0820a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:02.529746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d90f0b14-02bf-4cf2-be46-531cef0820a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:02.549239 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d90f0b14-02bf-4cf2-be46-531cef0820a9 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1278 microversion: 2.1 time: 0.337364 Sep 08 13:41:02.559307 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2972/6076] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:02 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1278 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:02.679243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f3f0b2e-a382-4ead-aaa0-b1cf67322799 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:02.680579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8f3f0b2e-a382-4ead-aaa0-b1cf67322799 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:02.705862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f3f0b2e-a382-4ead-aaa0-b1cf67322799 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:02.706879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f3f0b2e-a382-4ead-aaa0-b1cf67322799 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:02.707554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f3f0b2e-a382-4ead-aaa0-b1cf67322799 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:02.708587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f3f0b2e-a382-4ead-aaa0-b1cf67322799 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:02.709078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f3f0b2e-a382-4ead-aaa0-b1cf67322799 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:02.709928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f3f0b2e-a382-4ead-aaa0-b1cf67322799 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:02.872783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8f3f0b2e-a382-4ead-aaa0-b1cf67322799 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:02.888797 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f3f0b2e-a382-4ead-aaa0-b1cf67322799 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1697 microversion: 2.1 time: 0.218526 Sep 08 13:41:02.890187 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3105/6077] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:02 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1697 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:03.252182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-54641ff1-8dca-4ab4-9822-96bf246adf14 req-f76e633d-1340-40c6-987c-1f39ccf35f44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7625f4fb-73bf-469e-aeeb-0f97105e57e8", "tag": "616d7a73-9376-4b73-8f78-83f12aef8afe"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:41:03.270671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-54641ff1-8dca-4ab4-9822-96bf246adf14 req-f76e633d-1340-40c6-987c-1f39ccf35f44 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:03.271312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-54641ff1-8dca-4ab4-9822-96bf246adf14 req-f76e633d-1340-40c6-987c-1f39ccf35f44 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:03.272059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-54641ff1-8dca-4ab4-9822-96bf246adf14 req-f76e633d-1340-40c6-987c-1f39ccf35f44 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:03.289493 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-54641ff1-8dca-4ab4-9822-96bf246adf14 req-f76e633d-1340-40c6-987c-1f39ccf35f44 service nova] Creating event network-changed:616d7a73-9376-4b73-8f78-83f12aef8afe for instance 7625f4fb-73bf-469e-aeeb-0f97105e57e8 on n-h1-852084-10 Sep 08 13:41:03.296919 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-54641ff1-8dca-4ab4-9822-96bf246adf14 req-f76e633d-1340-40c6-987c-1f39ccf35f44 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056768 Sep 08 13:41:03.297631 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2973/6078] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:41:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:41:03.582418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f753b4a9-b65a-4be7-9bad-9943613ab97a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:03.584525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f753b4a9-b65a-4be7-9bad-9943613ab97a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:03.597450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f753b4a9-b65a-4be7-9bad-9943613ab97a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:03.598536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f753b4a9-b65a-4be7-9bad-9943613ab97a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:03.599522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f753b4a9-b65a-4be7-9bad-9943613ab97a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:03.601226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f753b4a9-b65a-4be7-9bad-9943613ab97a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:03.602489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f753b4a9-b65a-4be7-9bad-9943613ab97a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:03.603591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f753b4a9-b65a-4be7-9bad-9943613ab97a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:03.838100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f753b4a9-b65a-4be7-9bad-9943613ab97a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:03.848940 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f753b4a9-b65a-4be7-9bad-9943613ab97a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1278 microversion: 2.1 time: 0.275821 Sep 08 13:41:03.855357 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3106/6079] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:03 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1278 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:41:03.916600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cfe7fd7e-e0fd-4f04-84dd-811fd51b9a84 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:03.918427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cfe7fd7e-e0fd-4f04-84dd-811fd51b9a84 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:03.930335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfe7fd7e-e0fd-4f04-84dd-811fd51b9a84 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:03.931181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfe7fd7e-e0fd-4f04-84dd-811fd51b9a84 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:03.932852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfe7fd7e-e0fd-4f04-84dd-811fd51b9a84 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:03.933864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfe7fd7e-e0fd-4f04-84dd-811fd51b9a84 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:03.934488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfe7fd7e-e0fd-4f04-84dd-811fd51b9a84 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:03.935064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cfe7fd7e-e0fd-4f04-84dd-811fd51b9a84 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:04.178261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cfe7fd7e-e0fd-4f04-84dd-811fd51b9a84 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:04.194522 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cfe7fd7e-e0fd-4f04-84dd-811fd51b9a84 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1697 microversion: 2.1 time: 0.283184 Sep 08 13:41:04.195723 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2974/6080] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:03 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1697 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:04.890520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f45d4a93-9f0e-43ff-93c6-54925bb07bc5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:04.891817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f45d4a93-9f0e-43ff-93c6-54925bb07bc5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:04.905642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f45d4a93-9f0e-43ff-93c6-54925bb07bc5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:04.906566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f45d4a93-9f0e-43ff-93c6-54925bb07bc5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:04.907866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f45d4a93-9f0e-43ff-93c6-54925bb07bc5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:04.909224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f45d4a93-9f0e-43ff-93c6-54925bb07bc5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:04.910109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f45d4a93-9f0e-43ff-93c6-54925bb07bc5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:04.910925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f45d4a93-9f0e-43ff-93c6-54925bb07bc5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:05.148855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f45d4a93-9f0e-43ff-93c6-54925bb07bc5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:05.159162 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f45d4a93-9f0e-43ff-93c6-54925bb07bc5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1278 microversion: 2.1 time: 0.276176 Sep 08 13:41:05.159998 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3107/6081] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:04 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1278 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:05.227387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ddac7c15-7d43-4ded-8beb-a98ea2a96d25 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:05.228435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ddac7c15-7d43-4ded-8beb-a98ea2a96d25 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:05.236669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddac7c15-7d43-4ded-8beb-a98ea2a96d25 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:05.237150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddac7c15-7d43-4ded-8beb-a98ea2a96d25 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:05.237794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddac7c15-7d43-4ded-8beb-a98ea2a96d25 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:05.238524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddac7c15-7d43-4ded-8beb-a98ea2a96d25 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:05.239055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddac7c15-7d43-4ded-8beb-a98ea2a96d25 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:05.239512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ddac7c15-7d43-4ded-8beb-a98ea2a96d25 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:05.406353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ddac7c15-7d43-4ded-8beb-a98ea2a96d25 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:05.417505 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ddac7c15-7d43-4ded-8beb-a98ea2a96d25 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1697 microversion: 2.1 time: 0.194429 Sep 08 13:41:05.418298 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2975/6082] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:05 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1697 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:06.191089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3d03f443-2f35-4835-bca5-ff2f6c7f0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:06.192233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3d03f443-2f35-4835-bca5-ff2f6c7f0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:06.206174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d03f443-2f35-4835-bca5-ff2f6c7f0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:06.207126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d03f443-2f35-4835-bca5-ff2f6c7f0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:06.208249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d03f443-2f35-4835-bca5-ff2f6c7f0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:06.209328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d03f443-2f35-4835-bca5-ff2f6c7f0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:06.210227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d03f443-2f35-4835-bca5-ff2f6c7f0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:06.211048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3d03f443-2f35-4835-bca5-ff2f6c7f0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:06.251965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:06.455670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0f1f9038-c94a-48da-b532-3602b24f7419 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:06.455670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0f1f9038-c94a-48da-b532-3602b24f7419 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:06.470982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f1f9038-c94a-48da-b532-3602b24f7419 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:06.471905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f1f9038-c94a-48da-b532-3602b24f7419 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:06.472729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f1f9038-c94a-48da-b532-3602b24f7419 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:06.474119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f1f9038-c94a-48da-b532-3602b24f7419 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:06.475068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f1f9038-c94a-48da-b532-3602b24f7419 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:06.475983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f1f9038-c94a-48da-b532-3602b24f7419 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:06.495400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3d03f443-2f35-4835-bca5-ff2f6c7f0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:06.511143 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3d03f443-2f35-4835-bca5-ff2f6c7f0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1278 microversion: 2.1 time: 0.327108 Sep 08 13:41:06.512316 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3108/6083] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:06 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1278 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:06.704094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0f1f9038-c94a-48da-b532-3602b24f7419 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:06.721754 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0f1f9038-c94a-48da-b532-3602b24f7419 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1697 microversion: 2.1 time: 0.280748 Sep 08 13:41:06.722986 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2976/6084] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:06 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1697 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:41:07.542668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-694ce947-f805-4fad-86c5-6230e3a60abc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:07.545962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-694ce947-f805-4fad-86c5-6230e3a60abc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:07.553689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-694ce947-f805-4fad-86c5-6230e3a60abc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:07.554205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-694ce947-f805-4fad-86c5-6230e3a60abc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:07.554667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-694ce947-f805-4fad-86c5-6230e3a60abc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:07.555456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-694ce947-f805-4fad-86c5-6230e3a60abc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:07.555943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-694ce947-f805-4fad-86c5-6230e3a60abc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:07.556392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-694ce947-f805-4fad-86c5-6230e3a60abc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:07.729892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-694ce947-f805-4fad-86c5-6230e3a60abc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:07.741388 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-694ce947-f805-4fad-86c5-6230e3a60abc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1278 microversion: 2.1 time: 0.202825 Sep 08 13:41:07.742315 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3109/6085] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:07 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1278 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:07.765338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3cdab628-96fd-46ee-853e-90c5c1d7f8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:07.766240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3cdab628-96fd-46ee-853e-90c5c1d7f8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:07.775760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3cdab628-96fd-46ee-853e-90c5c1d7f8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:07.776433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3cdab628-96fd-46ee-853e-90c5c1d7f8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:07.777003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3cdab628-96fd-46ee-853e-90c5c1d7f8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:07.777794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3cdab628-96fd-46ee-853e-90c5c1d7f8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:07.778306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3cdab628-96fd-46ee-853e-90c5c1d7f8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:07.778788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3cdab628-96fd-46ee-853e-90c5c1d7f8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:07.966788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3cdab628-96fd-46ee-853e-90c5c1d7f8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:07.979645 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3cdab628-96fd-46ee-853e-90c5c1d7f8b8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1697 microversion: 2.1 time: 0.223284 Sep 08 13:41:07.980715 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2977/6086] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:07 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1697 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:08.774320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9acdcd43-85e0-4ebe-9997-c2d3355fc901 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:08.775435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9acdcd43-85e0-4ebe-9997-c2d3355fc901 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:08.785890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9acdcd43-85e0-4ebe-9997-c2d3355fc901 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:08.786400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9acdcd43-85e0-4ebe-9997-c2d3355fc901 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:08.786878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9acdcd43-85e0-4ebe-9997-c2d3355fc901 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:08.787657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9acdcd43-85e0-4ebe-9997-c2d3355fc901 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:08.788133 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9acdcd43-85e0-4ebe-9997-c2d3355fc901 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:08.788573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9acdcd43-85e0-4ebe-9997-c2d3355fc901 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:09.026349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e5413f82-45c3-4c22-89ff-e84f2b68993a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:09.027542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e5413f82-45c3-4c22-89ff-e84f2b68993a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:09.041912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5413f82-45c3-4c22-89ff-e84f2b68993a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:09.042785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5413f82-45c3-4c22-89ff-e84f2b68993a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:09.043621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5413f82-45c3-4c22-89ff-e84f2b68993a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:09.044871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5413f82-45c3-4c22-89ff-e84f2b68993a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:09.045657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5413f82-45c3-4c22-89ff-e84f2b68993a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:09.046422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e5413f82-45c3-4c22-89ff-e84f2b68993a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:09.084421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:09.257980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9acdcd43-85e0-4ebe-9997-c2d3355fc901 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:09.268103 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9acdcd43-85e0-4ebe-9997-c2d3355fc901 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1266 microversion: 2.1 time: 0.498262 Sep 08 13:41:09.268834 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3110/6087] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:08 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1266 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:09.356877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e5413f82-45c3-4c22-89ff-e84f2b68993a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:09.366339 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e5413f82-45c3-4c22-89ff-e84f2b68993a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1697 microversion: 2.1 time: 0.347719 Sep 08 13:41:09.366954 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2978/6088] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:09 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1697 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:10.313368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c865cb08-594b-49f8-a9a6-5d15d4fb929a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:10.314534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c865cb08-594b-49f8-a9a6-5d15d4fb929a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:10.317727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:10.319138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:10.332715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c865cb08-594b-49f8-a9a6-5d15d4fb929a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:10.333536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c865cb08-594b-49f8-a9a6-5d15d4fb929a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:10.334235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c865cb08-594b-49f8-a9a6-5d15d4fb929a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:10.335552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c865cb08-594b-49f8-a9a6-5d15d4fb929a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:10.336394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c865cb08-594b-49f8-a9a6-5d15d4fb929a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:10.337191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c865cb08-594b-49f8-a9a6-5d15d4fb929a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:10.389167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:10.398275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bd6fdb9d-0242-45be-bd6d-8c4cbb742a47 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:10.399500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bd6fdb9d-0242-45be-bd6d-8c4cbb742a47 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:10.411106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd6fdb9d-0242-45be-bd6d-8c4cbb742a47 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:10.412016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd6fdb9d-0242-45be-bd6d-8c4cbb742a47 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:10.412832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd6fdb9d-0242-45be-bd6d-8c4cbb742a47 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:10.414091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd6fdb9d-0242-45be-bd6d-8c4cbb742a47 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:10.414930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd6fdb9d-0242-45be-bd6d-8c4cbb742a47 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:10.415736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bd6fdb9d-0242-45be-bd6d-8c4cbb742a47 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:10.594558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c865cb08-594b-49f8-a9a6-5d15d4fb929a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:10.610757 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c865cb08-594b-49f8-a9a6-5d15d4fb929a tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1266 microversion: 2.1 time: 0.304056 Sep 08 13:41:10.611442 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3111/6089] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:10 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:10.668373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bd6fdb9d-0242-45be-bd6d-8c4cbb742a47 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:10.685884 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bd6fdb9d-0242-45be-bd6d-8c4cbb742a47 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1697 microversion: 2.1 time: 0.297536 Sep 08 13:41:10.687065 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2979/6090] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:10 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1697 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:41:11.638581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2686d1cc-4e53-4f68-9659-fcfda9dc0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:11.639507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2686d1cc-4e53-4f68-9659-fcfda9dc0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:11.649488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2686d1cc-4e53-4f68-9659-fcfda9dc0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:11.650215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2686d1cc-4e53-4f68-9659-fcfda9dc0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:11.650849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2686d1cc-4e53-4f68-9659-fcfda9dc0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:11.651731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2686d1cc-4e53-4f68-9659-fcfda9dc0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:11.652287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2686d1cc-4e53-4f68-9659-fcfda9dc0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:11.652795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2686d1cc-4e53-4f68-9659-fcfda9dc0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:11.718133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dad884ed-5748-47d7-9a2c-c9bfdfa45f62 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:11.720913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dad884ed-5748-47d7-9a2c-c9bfdfa45f62 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:11.738762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dad884ed-5748-47d7-9a2c-c9bfdfa45f62 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:11.740097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dad884ed-5748-47d7-9a2c-c9bfdfa45f62 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:11.741169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dad884ed-5748-47d7-9a2c-c9bfdfa45f62 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:11.742881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dad884ed-5748-47d7-9a2c-c9bfdfa45f62 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:11.744036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dad884ed-5748-47d7-9a2c-c9bfdfa45f62 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:11.745328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dad884ed-5748-47d7-9a2c-c9bfdfa45f62 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:11.919190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2686d1cc-4e53-4f68-9659-fcfda9dc0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:11.932977 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2686d1cc-4e53-4f68-9659-fcfda9dc0650 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1266 microversion: 2.1 time: 0.300203 Sep 08 13:41:11.934807 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3112/6091] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:11 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:12.017884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dad884ed-5748-47d7-9a2c-c9bfdfa45f62 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:12.027592 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dad884ed-5748-47d7-9a2c-c9bfdfa45f62 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1696 microversion: 2.1 time: 0.317469 Sep 08 13:41:12.028543 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2980/6092] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:11 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1696 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:41:12.045621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-68bc4804-ba59-46c4-9deb-1a8321bfd547 req-d55e55fc-2380-46f4-8eec-200dcc17a319 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60054117-39ad-4edf-a396-0b380a14da05", "name": "network-vif-unplugged", "status": "completed", "tag": "cea95bce-21f6-4039-99c0-2cf826a83480"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:41:12.063267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-68bc4804-ba59-46c4-9deb-1a8321bfd547 req-d55e55fc-2380-46f4-8eec-200dcc17a319 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:12.064196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-68bc4804-ba59-46c4-9deb-1a8321bfd547 req-d55e55fc-2380-46f4-8eec-200dcc17a319 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:12.065150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-68bc4804-ba59-46c4-9deb-1a8321bfd547 req-d55e55fc-2380-46f4-8eec-200dcc17a319 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:12.090339 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-68bc4804-ba59-46c4-9deb-1a8321bfd547 req-d55e55fc-2380-46f4-8eec-200dcc17a319 service nova] Creating event network-vif-unplugged:cea95bce-21f6-4039-99c0-2cf826a83480 for instance 60054117-39ad-4edf-a396-0b380a14da05 on n-h1-852084-10 Sep 08 13:41:12.097538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-68bc4804-ba59-46c4-9deb-1a8321bfd547 req-d55e55fc-2380-46f4-8eec-200dcc17a319 service nova] Instance 60054117-39ad-4edf-a396-0b380a14da05 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:41:12.115456 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-68bc4804-ba59-46c4-9deb-1a8321bfd547 req-d55e55fc-2380-46f4-8eec-200dcc17a319 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.177709 Sep 08 13:41:12.116499 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3113/6093] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:41:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:41:12.982073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-767e97f6-c07b-44b3-a762-c1ecb1c051b4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:12.984028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-767e97f6-c07b-44b3-a762-c1ecb1c051b4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:12.996070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-767e97f6-c07b-44b3-a762-c1ecb1c051b4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:12.997010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-767e97f6-c07b-44b3-a762-c1ecb1c051b4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:12.997928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-767e97f6-c07b-44b3-a762-c1ecb1c051b4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:12.999519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-767e97f6-c07b-44b3-a762-c1ecb1c051b4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:13.001052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-767e97f6-c07b-44b3-a762-c1ecb1c051b4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:13.001882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-767e97f6-c07b-44b3-a762-c1ecb1c051b4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:13.062550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-93a3cc03-a78a-49aa-819d-21ec689c3b33 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:13.064846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-93a3cc03-a78a-49aa-819d-21ec689c3b33 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:13.073054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93a3cc03-a78a-49aa-819d-21ec689c3b33 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:13.073809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93a3cc03-a78a-49aa-819d-21ec689c3b33 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:13.074509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93a3cc03-a78a-49aa-819d-21ec689c3b33 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:13.075289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93a3cc03-a78a-49aa-819d-21ec689c3b33 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:13.075796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93a3cc03-a78a-49aa-819d-21ec689c3b33 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:13.076236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93a3cc03-a78a-49aa-819d-21ec689c3b33 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:13.385713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-767e97f6-c07b-44b3-a762-c1ecb1c051b4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:13.401640 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-767e97f6-c07b-44b3-a762-c1ecb1c051b4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1266 microversion: 2.1 time: 0.424388 Sep 08 13:41:13.402705 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2981/6094] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:12 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1266 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:13.411571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-93a3cc03-a78a-49aa-819d-21ec689c3b33 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:13.427392 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-93a3cc03-a78a-49aa-819d-21ec689c3b33 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1696 microversion: 2.1 time: 0.369578 Sep 08 13:41:13.428480 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3114/6095] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:13 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1696 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:41:14.134790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-6844e2df-99d8-4594-9194-e83319089ffe req-b86b1962-f8e1-4ff9-a8e7-6c88c567b90c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60054117-39ad-4edf-a396-0b380a14da05", "tag": "cea95bce-21f6-4039-99c0-2cf826a83480"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:41:14.147508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6844e2df-99d8-4594-9194-e83319089ffe req-b86b1962-f8e1-4ff9-a8e7-6c88c567b90c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:14.148120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6844e2df-99d8-4594-9194-e83319089ffe req-b86b1962-f8e1-4ff9-a8e7-6c88c567b90c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:14.148594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6844e2df-99d8-4594-9194-e83319089ffe req-b86b1962-f8e1-4ff9-a8e7-6c88c567b90c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:14.166567 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-6844e2df-99d8-4594-9194-e83319089ffe req-b86b1962-f8e1-4ff9-a8e7-6c88c567b90c service nova] Creating event network-changed:cea95bce-21f6-4039-99c0-2cf826a83480 for instance 60054117-39ad-4edf-a396-0b380a14da05 on n-h1-852084-10 Sep 08 13:41:14.174713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-6844e2df-99d8-4594-9194-e83319089ffe req-b86b1962-f8e1-4ff9-a8e7-6c88c567b90c service nova] Instance 60054117-39ad-4edf-a396-0b380a14da05 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:41:14.189629 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-6844e2df-99d8-4594-9194-e83319089ffe req-b86b1962-f8e1-4ff9-a8e7-6c88c567b90c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058210 Sep 08 13:41:14.190913 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2982/6096] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:41:14.436908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-942b4c54-fae9-4eb0-b716-67ec25d6c876 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:14.438638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-942b4c54-fae9-4eb0-b716-67ec25d6c876 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:14.442702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:14.450539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-942b4c54-fae9-4eb0-b716-67ec25d6c876 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:14.451362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-942b4c54-fae9-4eb0-b716-67ec25d6c876 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:14.452065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-942b4c54-fae9-4eb0-b716-67ec25d6c876 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:14.452903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-942b4c54-fae9-4eb0-b716-67ec25d6c876 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:14.453489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-942b4c54-fae9-4eb0-b716-67ec25d6c876 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:14.454039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-942b4c54-fae9-4eb0-b716-67ec25d6c876 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:14.472425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eccb2414-ef09-4622-8855-243d617108de tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:14.474511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eccb2414-ef09-4622-8855-243d617108de tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:14.488939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eccb2414-ef09-4622-8855-243d617108de tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:14.489793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eccb2414-ef09-4622-8855-243d617108de tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:14.490572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eccb2414-ef09-4622-8855-243d617108de tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:14.492704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eccb2414-ef09-4622-8855-243d617108de tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:14.493576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eccb2414-ef09-4622-8855-243d617108de tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:14.494471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eccb2414-ef09-4622-8855-243d617108de tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:14.836872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-942b4c54-fae9-4eb0-b716-67ec25d6c876 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:14.852644 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-942b4c54-fae9-4eb0-b716-67ec25d6c876 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1266 microversion: 2.1 time: 0.423247 Sep 08 13:41:14.855297 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3115/6097] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:14 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1266 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:14.888263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eccb2414-ef09-4622-8855-243d617108de tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:14.907740 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eccb2414-ef09-4622-8855-243d617108de tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1694 microversion: 2.1 time: 0.443718 Sep 08 13:41:14.911828 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2983/6098] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:14 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1694 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:15.907666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-95de155d-ca41-4d95-983b-f55720d66263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:15.909927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-95de155d-ca41-4d95-983b-f55720d66263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:15.922543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95de155d-ca41-4d95-983b-f55720d66263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:15.923926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95de155d-ca41-4d95-983b-f55720d66263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:15.924796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95de155d-ca41-4d95-983b-f55720d66263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:15.926143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95de155d-ca41-4d95-983b-f55720d66263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:15.927331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95de155d-ca41-4d95-983b-f55720d66263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:15.928122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95de155d-ca41-4d95-983b-f55720d66263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:15.951101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-308f3c57-61bf-4383-bae7-e04209832569 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:15.954736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-308f3c57-61bf-4383-bae7-e04209832569 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:15.968366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-308f3c57-61bf-4383-bae7-e04209832569 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:15.969821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-308f3c57-61bf-4383-bae7-e04209832569 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:15.970873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-308f3c57-61bf-4383-bae7-e04209832569 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:15.972977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-308f3c57-61bf-4383-bae7-e04209832569 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:15.974045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-308f3c57-61bf-4383-bae7-e04209832569 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:15.975199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-308f3c57-61bf-4383-bae7-e04209832569 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:16.341508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-95de155d-ca41-4d95-983b-f55720d66263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:16.354162 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-95de155d-ca41-4d95-983b-f55720d66263 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1266 microversion: 2.1 time: 0.454183 Sep 08 13:41:16.355382 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3116/6099] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:15 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1266 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:16.359525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-308f3c57-61bf-4383-bae7-e04209832569 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:16.370004 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-308f3c57-61bf-4383-bae7-e04209832569 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1691 microversion: 2.1 time: 0.426701 Sep 08 13:41:16.370872 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2984/6100] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:15 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1691 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:41:16.397937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8279983-9f4f-4b84-b895-4a27268decf1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:41:16.398930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b8279983-9f4f-4b84-b895-4a27268decf1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:16.409942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8279983-9f4f-4b84-b895-4a27268decf1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:16.410755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8279983-9f4f-4b84-b895-4a27268decf1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:16.411578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8279983-9f4f-4b84-b895-4a27268decf1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:16.412750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8279983-9f4f-4b84-b895-4a27268decf1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:16.413509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8279983-9f4f-4b84-b895-4a27268decf1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:16.414219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8279983-9f4f-4b84-b895-4a27268decf1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:16.642563 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8279983-9f4f-4b84-b895-4a27268decf1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05/action" status: 202 len: 0 microversion: 2.1 time: 0.250551 Sep 08 13:41:16.644838 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3117/6101] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:41:16 2022] POST /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:41:16.661761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3bda9bd3-d562-4554-bd51-c806b4e43254 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:16.662956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3bda9bd3-d562-4554-bd51-c806b4e43254 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:16.685068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bda9bd3-d562-4554-bd51-c806b4e43254 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:16.687612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bda9bd3-d562-4554-bd51-c806b4e43254 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:16.688494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bda9bd3-d562-4554-bd51-c806b4e43254 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:16.690281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bda9bd3-d562-4554-bd51-c806b4e43254 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:16.692068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bda9bd3-d562-4554-bd51-c806b4e43254 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:16.692860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3bda9bd3-d562-4554-bd51-c806b4e43254 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:17.012256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3bda9bd3-d562-4554-bd51-c806b4e43254 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:17.028727 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3bda9bd3-d562-4554-bd51-c806b4e43254 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1690 microversion: 2.1 time: 0.375556 Sep 08 13:41:17.030023 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2985/6102] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:16 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1690 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:17.237007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-76d8115c-b013-4b4a-8819-0645a30a2c74 req-ee795f68-fc86-406e-9111-8ba1a3e6fb6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7625f4fb-73bf-469e-aeeb-0f97105e57e8", "name": "network-vif-plugged", "status": "completed", "tag": "616d7a73-9376-4b73-8f78-83f12aef8afe"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:41:17.254639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-76d8115c-b013-4b4a-8819-0645a30a2c74 req-ee795f68-fc86-406e-9111-8ba1a3e6fb6d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:17.255358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-76d8115c-b013-4b4a-8819-0645a30a2c74 req-ee795f68-fc86-406e-9111-8ba1a3e6fb6d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:17.256068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-76d8115c-b013-4b4a-8819-0645a30a2c74 req-ee795f68-fc86-406e-9111-8ba1a3e6fb6d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:17.270164 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-76d8115c-b013-4b4a-8819-0645a30a2c74 req-ee795f68-fc86-406e-9111-8ba1a3e6fb6d service nova] Creating event network-vif-plugged:616d7a73-9376-4b73-8f78-83f12aef8afe for instance 7625f4fb-73bf-469e-aeeb-0f97105e57e8 on n-h1-852084-10 Sep 08 13:41:17.276792 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-76d8115c-b013-4b4a-8819-0645a30a2c74 req-ee795f68-fc86-406e-9111-8ba1a3e6fb6d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046365 Sep 08 13:41:17.278413 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3118/6103] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:41:17.400282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0337278-7649-43d9-8669-da73b31830e1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:17.401717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0337278-7649-43d9-8669-da73b31830e1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:17.413797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0337278-7649-43d9-8669-da73b31830e1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:17.414864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0337278-7649-43d9-8669-da73b31830e1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:17.415816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0337278-7649-43d9-8669-da73b31830e1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:17.417458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0337278-7649-43d9-8669-da73b31830e1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:17.418695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0337278-7649-43d9-8669-da73b31830e1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:17.419863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0337278-7649-43d9-8669-da73b31830e1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:17.668171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0337278-7649-43d9-8669-da73b31830e1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:17.678987 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0337278-7649-43d9-8669-da73b31830e1 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1266 microversion: 2.1 time: 0.287210 Sep 08 13:41:17.696638 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2986/6104] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:17 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1266 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:18.059253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4027dc56-624f-4165-b585-1d2240e14d78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:18.059988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4027dc56-624f-4165-b585-1d2240e14d78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:18.067730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4027dc56-624f-4165-b585-1d2240e14d78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:18.068489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4027dc56-624f-4165-b585-1d2240e14d78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:18.068938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4027dc56-624f-4165-b585-1d2240e14d78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:18.069667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4027dc56-624f-4165-b585-1d2240e14d78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:18.070403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4027dc56-624f-4165-b585-1d2240e14d78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:18.070876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4027dc56-624f-4165-b585-1d2240e14d78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:18.245498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4027dc56-624f-4165-b585-1d2240e14d78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:18.256303 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4027dc56-624f-4165-b585-1d2240e14d78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1690 microversion: 2.1 time: 0.201347 Sep 08 13:41:18.256927 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3119/6105] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:18 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1690 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:18.707657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a50803aa-e875-4d1f-b874-6f0ff14ad8c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:18.708226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a50803aa-e875-4d1f-b874-6f0ff14ad8c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:18.710781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:18.720818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a50803aa-e875-4d1f-b874-6f0ff14ad8c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:18.721470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a50803aa-e875-4d1f-b874-6f0ff14ad8c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:18.722180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a50803aa-e875-4d1f-b874-6f0ff14ad8c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:18.723105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a50803aa-e875-4d1f-b874-6f0ff14ad8c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:18.725031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a50803aa-e875-4d1f-b874-6f0ff14ad8c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:18.725031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a50803aa-e875-4d1f-b874-6f0ff14ad8c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:18.969705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a50803aa-e875-4d1f-b874-6f0ff14ad8c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:18.983475 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a50803aa-e875-4d1f-b874-6f0ff14ad8c5 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1266 microversion: 2.1 time: 0.279834 Sep 08 13:41:18.984533 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2987/6106] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:18 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1266 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:41:19.280498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00b15c34-aa20-4e15-a905-a183d919d777 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:19.281391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00b15c34-aa20-4e15-a905-a183d919d777 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:19.289437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00b15c34-aa20-4e15-a905-a183d919d777 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:19.289954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00b15c34-aa20-4e15-a905-a183d919d777 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:19.290411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00b15c34-aa20-4e15-a905-a183d919d777 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:19.291153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00b15c34-aa20-4e15-a905-a183d919d777 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:19.291671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00b15c34-aa20-4e15-a905-a183d919d777 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:19.292120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00b15c34-aa20-4e15-a905-a183d919d777 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:19.484342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9c051ee5-fdc5-495f-aab6-8360d164ac8c req-0dc2557a-c256-4f16-adce-60dfda03cac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60054117-39ad-4edf-a396-0b380a14da05", "name": "network-vif-plugged", "status": "completed", "tag": "cea95bce-21f6-4039-99c0-2cf826a83480"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:41:19.503879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9c051ee5-fdc5-495f-aab6-8360d164ac8c req-0dc2557a-c256-4f16-adce-60dfda03cac9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:19.504760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9c051ee5-fdc5-495f-aab6-8360d164ac8c req-0dc2557a-c256-4f16-adce-60dfda03cac9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:19.505586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9c051ee5-fdc5-495f-aab6-8360d164ac8c req-0dc2557a-c256-4f16-adce-60dfda03cac9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:19.511468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00b15c34-aa20-4e15-a905-a183d919d777 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:19.520072 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9c051ee5-fdc5-495f-aab6-8360d164ac8c req-0dc2557a-c256-4f16-adce-60dfda03cac9 service nova] Creating event network-vif-plugged:cea95bce-21f6-4039-99c0-2cf826a83480 for instance 60054117-39ad-4edf-a396-0b380a14da05 on n-h1-852084-10 Sep 08 13:41:19.526254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-9c051ee5-fdc5-495f-aab6-8360d164ac8c req-0dc2557a-c256-4f16-adce-60dfda03cac9 service nova] Instance 60054117-39ad-4edf-a396-0b380a14da05 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:41:19.526575 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00b15c34-aa20-4e15-a905-a183d919d777 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1690 microversion: 2.1 time: 0.249599 Sep 08 13:41:19.527375 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3120/6107] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:19 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1690 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:19.539661 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9c051ee5-fdc5-495f-aab6-8360d164ac8c req-0dc2557a-c256-4f16-adce-60dfda03cac9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063141 Sep 08 13:41:19.540605 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2988/6108] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:41:20.009573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3870774e-195a-4b0c-a8dc-047ee5950aed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:20.010477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3870774e-195a-4b0c-a8dc-047ee5950aed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:20.020448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3870774e-195a-4b0c-a8dc-047ee5950aed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:20.020974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3870774e-195a-4b0c-a8dc-047ee5950aed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:20.021430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3870774e-195a-4b0c-a8dc-047ee5950aed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:20.022323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3870774e-195a-4b0c-a8dc-047ee5950aed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:20.022808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3870774e-195a-4b0c-a8dc-047ee5950aed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:20.023627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3870774e-195a-4b0c-a8dc-047ee5950aed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:20.255190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3870774e-195a-4b0c-a8dc-047ee5950aed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:20.270572 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3870774e-195a-4b0c-a8dc-047ee5950aed tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1454 microversion: 2.1 time: 0.264676 Sep 08 13:41:20.271785 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3121/6109] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:20 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1454 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:20.317897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f51e70d1-96f1-4e06-b5db-8d0351dfa7ee tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:20.320126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f51e70d1-96f1-4e06-b5db-8d0351dfa7ee tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:20.331389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f51e70d1-96f1-4e06-b5db-8d0351dfa7ee tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:20.332198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f51e70d1-96f1-4e06-b5db-8d0351dfa7ee tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:20.333334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f51e70d1-96f1-4e06-b5db-8d0351dfa7ee tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:20.334307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f51e70d1-96f1-4e06-b5db-8d0351dfa7ee tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:20.334997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f51e70d1-96f1-4e06-b5db-8d0351dfa7ee tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:20.335654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f51e70d1-96f1-4e06-b5db-8d0351dfa7ee tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:20.556013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7cf7b7d0-7e39-4b47-abd8-964e7f3f36fb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:20.556786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7cf7b7d0-7e39-4b47-abd8-964e7f3f36fb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:20.566027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7cf7b7d0-7e39-4b47-abd8-964e7f3f36fb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:20.566623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7cf7b7d0-7e39-4b47-abd8-964e7f3f36fb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:20.567155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7cf7b7d0-7e39-4b47-abd8-964e7f3f36fb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:20.568754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7cf7b7d0-7e39-4b47-abd8-964e7f3f36fb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:20.569528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7cf7b7d0-7e39-4b47-abd8-964e7f3f36fb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:20.570061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7cf7b7d0-7e39-4b47-abd8-964e7f3f36fb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:20.606569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f51e70d1-96f1-4e06-b5db-8d0351dfa7ee tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:20.623828 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f51e70d1-96f1-4e06-b5db-8d0351dfa7ee tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1454 microversion: 2.1 time: 0.316717 Sep 08 13:41:20.624651 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2989/6110] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:20 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1454 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:20.875569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7cf7b7d0-7e39-4b47-abd8-964e7f3f36fb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:20.886293 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7cf7b7d0-7e39-4b47-abd8-964e7f3f36fb tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1690 microversion: 2.1 time: 0.334772 Sep 08 13:41:20.887538 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3122/6111] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:20 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1690 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:21.333592 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:41:21.334227 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 13:41:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Sep 08 13:41:21.444090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-47bcb4f6-d244-4052-9a1a-3a1509051977 req-57b17996-576d-4e02-af28-b97c8e0867ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60054117-39ad-4edf-a396-0b380a14da05", "name": "network-vif-unplugged", "status": "completed", "tag": "cea95bce-21f6-4039-99c0-2cf826a83480"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:41:21.462138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-47bcb4f6-d244-4052-9a1a-3a1509051977 req-57b17996-576d-4e02-af28-b97c8e0867ef service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:21.462800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-47bcb4f6-d244-4052-9a1a-3a1509051977 req-57b17996-576d-4e02-af28-b97c8e0867ef service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:21.463271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-47bcb4f6-d244-4052-9a1a-3a1509051977 req-57b17996-576d-4e02-af28-b97c8e0867ef service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:21.477170 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-47bcb4f6-d244-4052-9a1a-3a1509051977 req-57b17996-576d-4e02-af28-b97c8e0867ef service nova] Creating event network-vif-unplugged:cea95bce-21f6-4039-99c0-2cf826a83480 for instance 60054117-39ad-4edf-a396-0b380a14da05 on n-h2-852084-10 Sep 08 13:41:21.486710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-47bcb4f6-d244-4052-9a1a-3a1509051977 req-57b17996-576d-4e02-af28-b97c8e0867ef service nova] Instance 60054117-39ad-4edf-a396-0b380a14da05 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:41:21.502946 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-47bcb4f6-d244-4052-9a1a-3a1509051977 req-57b17996-576d-4e02-af28-b97c8e0867ef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.180932 Sep 08 13:41:21.504294 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2990/6112] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:41:21.923000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e9696260-7d54-481e-bfbb-93ce85878316 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:21.924247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e9696260-7d54-481e-bfbb-93ce85878316 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:21.937893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9696260-7d54-481e-bfbb-93ce85878316 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:21.938811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9696260-7d54-481e-bfbb-93ce85878316 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:21.939702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9696260-7d54-481e-bfbb-93ce85878316 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:21.941328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9696260-7d54-481e-bfbb-93ce85878316 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:21.942244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9696260-7d54-481e-bfbb-93ce85878316 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:21.943084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e9696260-7d54-481e-bfbb-93ce85878316 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:22.463256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e9696260-7d54-481e-bfbb-93ce85878316 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:22.480249 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e9696260-7d54-481e-bfbb-93ce85878316 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1690 microversion: 2.1 time: 0.565238 Sep 08 13:41:22.481547 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3123/6113] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:21 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1690 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:23.382820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-67a1cf87-53ae-4853-9d59-57f9f9a12d49 req-33ef17f2-bb91-440e-9446-19caf44a6710 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7625f4fb-73bf-469e-aeeb-0f97105e57e8", "tag": "616d7a73-9376-4b73-8f78-83f12aef8afe"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:41:23.398718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-67a1cf87-53ae-4853-9d59-57f9f9a12d49 req-33ef17f2-bb91-440e-9446-19caf44a6710 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:23.399206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-67a1cf87-53ae-4853-9d59-57f9f9a12d49 req-33ef17f2-bb91-440e-9446-19caf44a6710 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:23.399684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-67a1cf87-53ae-4853-9d59-57f9f9a12d49 req-33ef17f2-bb91-440e-9446-19caf44a6710 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:23.413190 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-67a1cf87-53ae-4853-9d59-57f9f9a12d49 req-33ef17f2-bb91-440e-9446-19caf44a6710 service nova] Creating event network-changed:616d7a73-9376-4b73-8f78-83f12aef8afe for instance 7625f4fb-73bf-469e-aeeb-0f97105e57e8 on n-h1-852084-10 Sep 08 13:41:23.418872 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-67a1cf87-53ae-4853-9d59-57f9f9a12d49 req-33ef17f2-bb91-440e-9446-19caf44a6710 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043420 Sep 08 13:41:23.419548 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2991/6114] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:41:23.527057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-37c3f20e-6e0c-46ab-ac14-ee939a54f1b7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:23.530262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-37c3f20e-6e0c-46ab-ac14-ee939a54f1b7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:23.544366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37c3f20e-6e0c-46ab-ac14-ee939a54f1b7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:23.544734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c210b6df-fb23-47de-bd3e-6268381b8c88 req-c49e4c89-c3d9-44ed-81dc-5afababac0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60054117-39ad-4edf-a396-0b380a14da05", "tag": "cea95bce-21f6-4039-99c0-2cf826a83480"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:41:23.545773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37c3f20e-6e0c-46ab-ac14-ee939a54f1b7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:23.546662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37c3f20e-6e0c-46ab-ac14-ee939a54f1b7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:23.548167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37c3f20e-6e0c-46ab-ac14-ee939a54f1b7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:23.549158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37c3f20e-6e0c-46ab-ac14-ee939a54f1b7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:23.549987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-37c3f20e-6e0c-46ab-ac14-ee939a54f1b7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:23.557047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c210b6df-fb23-47de-bd3e-6268381b8c88 req-c49e4c89-c3d9-44ed-81dc-5afababac0d3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:23.558510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c210b6df-fb23-47de-bd3e-6268381b8c88 req-c49e4c89-c3d9-44ed-81dc-5afababac0d3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:23.559073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c210b6df-fb23-47de-bd3e-6268381b8c88 req-c49e4c89-c3d9-44ed-81dc-5afababac0d3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:23.580157 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c210b6df-fb23-47de-bd3e-6268381b8c88 req-c49e4c89-c3d9-44ed-81dc-5afababac0d3 service nova] Creating event network-changed:cea95bce-21f6-4039-99c0-2cf826a83480 for instance 60054117-39ad-4edf-a396-0b380a14da05 on n-h2-852084-10 Sep 08 13:41:23.595083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-c210b6df-fb23-47de-bd3e-6268381b8c88 req-c49e4c89-c3d9-44ed-81dc-5afababac0d3 service nova] Instance 60054117-39ad-4edf-a396-0b380a14da05 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:41:23.598423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:23.612427 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c210b6df-fb23-47de-bd3e-6268381b8c88 req-c49e4c89-c3d9-44ed-81dc-5afababac0d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071902 Sep 08 13:41:23.613712 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2992/6115] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:41:23.832410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-37c3f20e-6e0c-46ab-ac14-ee939a54f1b7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:23.849434 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-37c3f20e-6e0c-46ab-ac14-ee939a54f1b7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1690 microversion: 2.1 time: 0.329244 Sep 08 13:41:23.851779 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3124/6116] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:23 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1690 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:24.891780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6f28eea9-a6f4-4782-8729-835e052cf055 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:24.901225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6f28eea9-a6f4-4782-8729-835e052cf055 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:24.925794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f28eea9-a6f4-4782-8729-835e052cf055 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:24.927292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f28eea9-a6f4-4782-8729-835e052cf055 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:24.929227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f28eea9-a6f4-4782-8729-835e052cf055 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:24.931524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f28eea9-a6f4-4782-8729-835e052cf055 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:24.932858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f28eea9-a6f4-4782-8729-835e052cf055 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:24.933920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f28eea9-a6f4-4782-8729-835e052cf055 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:25.391875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6f28eea9-a6f4-4782-8729-835e052cf055 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:25.404224 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6f28eea9-a6f4-4782-8729-835e052cf055 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1683 microversion: 2.1 time: 0.521727 Sep 08 13:41:25.405296 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2993/6117] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:24 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1683 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:26.885452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c4204a2e-5fe2-414e-8021-2c820a2d5fc4 req-4a2dceb6-8259-42e8-abfa-28d130b8f181 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60054117-39ad-4edf-a396-0b380a14da05", "name": "network-vif-plugged", "status": "completed", "tag": "cea95bce-21f6-4039-99c0-2cf826a83480"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:41:26.899892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c4204a2e-5fe2-414e-8021-2c820a2d5fc4 req-4a2dceb6-8259-42e8-abfa-28d130b8f181 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:26.900392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c4204a2e-5fe2-414e-8021-2c820a2d5fc4 req-4a2dceb6-8259-42e8-abfa-28d130b8f181 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:26.900966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c4204a2e-5fe2-414e-8021-2c820a2d5fc4 req-4a2dceb6-8259-42e8-abfa-28d130b8f181 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:26.922001 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c4204a2e-5fe2-414e-8021-2c820a2d5fc4 req-4a2dceb6-8259-42e8-abfa-28d130b8f181 service nova] Creating event network-vif-plugged:cea95bce-21f6-4039-99c0-2cf826a83480 for instance 60054117-39ad-4edf-a396-0b380a14da05 on n-h2-852084-10 Sep 08 13:41:26.929830 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c4204a2e-5fe2-414e-8021-2c820a2d5fc4 req-4a2dceb6-8259-42e8-abfa-28d130b8f181 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048407 Sep 08 13:41:26.931354 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3125/6118] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:41:49.670927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-076d6c44-411d-463b-8e29-36ba8f5a5b78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:41:49.675444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-076d6c44-411d-463b-8e29-36ba8f5a5b78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:49.683667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=13 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:49.685558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=80 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:49.696213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-076d6c44-411d-463b-8e29-36ba8f5a5b78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:49.697362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-076d6c44-411d-463b-8e29-36ba8f5a5b78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:49.698202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-076d6c44-411d-463b-8e29-36ba8f5a5b78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:49.699603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-076d6c44-411d-463b-8e29-36ba8f5a5b78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:49.700495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-076d6c44-411d-463b-8e29-36ba8f5a5b78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:49.701299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-076d6c44-411d-463b-8e29-36ba8f5a5b78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:49.791499 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-076d6c44-411d-463b-8e29-36ba8f5a5b78 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05/action" status: 200 len: 63183 microversion: 2.1 time: 0.128613 Sep 08 13:41:49.792222 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2994/6119] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:41:49 2022] POST /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05/action => generated 63183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:41:56.093208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=25 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:56.096043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=5 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:41:56.105944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a6ec62a5-fe03-4e7d-b1ea-3834efd687ab tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:56.107384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a6ec62a5-fe03-4e7d-b1ea-3834efd687ab tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:56.116754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6ec62a5-fe03-4e7d-b1ea-3834efd687ab tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:56.117344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6ec62a5-fe03-4e7d-b1ea-3834efd687ab tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:56.117790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6ec62a5-fe03-4e7d-b1ea-3834efd687ab tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:56.118519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6ec62a5-fe03-4e7d-b1ea-3834efd687ab tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:56.118992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6ec62a5-fe03-4e7d-b1ea-3834efd687ab tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:56.119480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6ec62a5-fe03-4e7d-b1ea-3834efd687ab tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:56.297385 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a6ec62a5-fe03-4e7d-b1ea-3834efd687ab tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1836 microversion: 2.1 time: 0.208480 Sep 08 13:41:56.298298 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3126/6120] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:56 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1836 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:57.498621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c6c671b0-d183-4bc3-b8fe-f27ef23be9ef tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:57.500478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c6c671b0-d183-4bc3-b8fe-f27ef23be9ef tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:57.500675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-bba2e05e-aa9f-4537-9e25-ce9aa3cf139f req-fc64de7e-cb20-45bb-8c77-43cefdd0e182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60054117-39ad-4edf-a396-0b380a14da05", "tag": "cea95bce-21f6-4039-99c0-2cf826a83480"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:41:57.511060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6c671b0-d183-4bc3-b8fe-f27ef23be9ef tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:57.511820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6c671b0-d183-4bc3-b8fe-f27ef23be9ef tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:57.512026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bba2e05e-aa9f-4537-9e25-ce9aa3cf139f req-fc64de7e-cb20-45bb-8c77-43cefdd0e182 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:57.512437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bba2e05e-aa9f-4537-9e25-ce9aa3cf139f req-fc64de7e-cb20-45bb-8c77-43cefdd0e182 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:57.513037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6c671b0-d183-4bc3-b8fe-f27ef23be9ef tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:57.513281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bba2e05e-aa9f-4537-9e25-ce9aa3cf139f req-fc64de7e-cb20-45bb-8c77-43cefdd0e182 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:57.514304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6c671b0-d183-4bc3-b8fe-f27ef23be9ef tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:57.514957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6c671b0-d183-4bc3-b8fe-f27ef23be9ef tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:57.516247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6c671b0-d183-4bc3-b8fe-f27ef23be9ef tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:57.533164 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-bba2e05e-aa9f-4537-9e25-ce9aa3cf139f req-fc64de7e-cb20-45bb-8c77-43cefdd0e182 service nova] Creating event network-changed:cea95bce-21f6-4039-99c0-2cf826a83480 for instance 60054117-39ad-4edf-a396-0b380a14da05 on n-h2-852084-10 Sep 08 13:41:57.542826 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-bba2e05e-aa9f-4537-9e25-ce9aa3cf139f req-fc64de7e-cb20-45bb-8c77-43cefdd0e182 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046426 Sep 08 13:41:57.545169 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3127/6121] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:41:57.568121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c6c671b0-d183-4bc3-b8fe-f27ef23be9ef tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:41:57.710027 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c6c671b0-d183-4bc3-b8fe-f27ef23be9ef tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "DELETE /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 204 len: 0 microversion: 2.1 time: 0.215827 Sep 08 13:41:57.713499 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2995/6122] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:41:57 2022] DELETE /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:41:57.724171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-81a1b8b3-250b-4b97-8b8a-dd120404f310 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:57.725854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-81a1b8b3-250b-4b97-8b8a-dd120404f310 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:57.736221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81a1b8b3-250b-4b97-8b8a-dd120404f310 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:57.736917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81a1b8b3-250b-4b97-8b8a-dd120404f310 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:57.737604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81a1b8b3-250b-4b97-8b8a-dd120404f310 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:57.739061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81a1b8b3-250b-4b97-8b8a-dd120404f310 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:57.739788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81a1b8b3-250b-4b97-8b8a-dd120404f310 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:57.740388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81a1b8b3-250b-4b97-8b8a-dd120404f310 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:57.913160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-81a1b8b3-250b-4b97-8b8a-dd120404f310 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:57.929885 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-81a1b8b3-250b-4b97-8b8a-dd120404f310 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1689 microversion: 2.1 time: 0.210433 Sep 08 13:41:57.930953 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3128/6123] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:57 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1689 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:41:58.974782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d474cf8-8c6f-42f0-95a7-5ed7e58afb4b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:41:58.976402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d474cf8-8c6f-42f0-95a7-5ed7e58afb4b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:41:58.986915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d474cf8-8c6f-42f0-95a7-5ed7e58afb4b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:58.987535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d474cf8-8c6f-42f0-95a7-5ed7e58afb4b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:58.988762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d474cf8-8c6f-42f0-95a7-5ed7e58afb4b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:58.989896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d474cf8-8c6f-42f0-95a7-5ed7e58afb4b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:41:58.990461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d474cf8-8c6f-42f0-95a7-5ed7e58afb4b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:41:58.990965 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d474cf8-8c6f-42f0-95a7-5ed7e58afb4b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:41:59.751022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8d474cf8-8c6f-42f0-95a7-5ed7e58afb4b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:41:59.766544 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d474cf8-8c6f-42f0-95a7-5ed7e58afb4b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 200 len: 1689 microversion: 2.1 time: 0.796705 Sep 08 13:41:59.767349 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2996/6124] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:41:58 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 1689 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:00.247687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-1dfd3b7e-c23a-45dd-8d60-d306f5bd9512 req-252f379e-ce86-42fd-9c30-3f94d82d7162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60054117-39ad-4edf-a396-0b380a14da05", "name": "network-vif-deleted", "tag": "cea95bce-21f6-4039-99c0-2cf826a83480"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:42:00.263903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1dfd3b7e-c23a-45dd-8d60-d306f5bd9512 req-252f379e-ce86-42fd-9c30-3f94d82d7162 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:00.264802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1dfd3b7e-c23a-45dd-8d60-d306f5bd9512 req-252f379e-ce86-42fd-9c30-3f94d82d7162 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:00.266422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1dfd3b7e-c23a-45dd-8d60-d306f5bd9512 req-252f379e-ce86-42fd-9c30-3f94d82d7162 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:00.283942 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1dfd3b7e-c23a-45dd-8d60-d306f5bd9512 req-252f379e-ce86-42fd-9c30-3f94d82d7162 service nova] Creating event network-vif-deleted:cea95bce-21f6-4039-99c0-2cf826a83480 for instance 60054117-39ad-4edf-a396-0b380a14da05 on n-h2-852084-10 Sep 08 13:42:00.290691 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-1dfd3b7e-c23a-45dd-8d60-d306f5bd9512 req-252f379e-ce86-42fd-9c30-3f94d82d7162 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050947 Sep 08 13:42:00.291577 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3129/6125] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:42:00.807613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-77f0d068-becd-44cb-b333-c5dfd6a6a06a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:00.808235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-77f0d068-becd-44cb-b333-c5dfd6a6a06a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 60054117-39ad-4edf-a396-0b380a14da05] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:00.817109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77f0d068-becd-44cb-b333-c5dfd6a6a06a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:00.817606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77f0d068-becd-44cb-b333-c5dfd6a6a06a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:00.818047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77f0d068-becd-44cb-b333-c5dfd6a6a06a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:00.818816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77f0d068-becd-44cb-b333-c5dfd6a6a06a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:00.819572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77f0d068-becd-44cb-b333-c5dfd6a6a06a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:00.820121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77f0d068-becd-44cb-b333-c5dfd6a6a06a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:00.842852 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-77f0d068-becd-44cb-b333-c5dfd6a6a06a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] HTTP exception thrown: Instance 60054117-39ad-4edf-a396-0b380a14da05 could not be found. Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-77f0d068-becd-44cb-b333-c5dfd6a6a06a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Request method failure captured: Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 HTTP/1.1 Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfAnDjCiija-3DB5W4J6ri-fu6OcpUbo-W8mx5zngP02-J7_POIIpc3-zpJO-dfrroJuHCv8EsActPv5vuSWguNHoH76B17-De96TjlaxEdNnya3aBd8z3oBNyuhh5JRVQPwN6yVLxLYfY3oQXXo567eBhy9Fhj_K2TtE8cZ_abBrJY Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: cbd130c38aeb4b23b1907212bfe92619 Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2131984032 Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2131984032 Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: cbd130c38aeb4b23b1907212bfe92619 Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2131984032 Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestNetworkAdvancedServerOps-2131984032-project Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: c3fb5a1860bd4f118dc19ec38c1796d1 Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2131984032-project Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 60054117-39ad-4edf-a396-0b380a14da05 could not be found. Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '60054117-39ad-4edf-a396-0b380a14da05'} Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60054117-39ad-4edf-a396-0b380a14da05 could not be found. Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60054117-39ad-4edf-a396-0b380a14da05 could not be found. Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:42:00.845179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:42:00.851831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:42:00.851831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:42:00.851831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:42:00.851831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:42:00.851831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:42:00.851831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:42:00.851831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60054117-39ad-4edf-a396-0b380a14da05 could not be found. Sep 08 13:42:00.851831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:42:00.851831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-77f0d068-becd-44cb-b333-c5dfd6a6a06a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Returning 404 to user: Instance 60054117-39ad-4edf-a396-0b380a14da05 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:42:00.851831 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-77f0d068-becd-44cb-b333-c5dfd6a6a06a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05" status: 404 len: 111 microversion: 2.1 time: 0.043452 Sep 08 13:42:00.851831 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2997/6126] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:00 2022] GET /compute/v2.1/servers/60054117-39ad-4edf-a396-0b380a14da05 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:42:05.028783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-553d60a5-4fd4-4744-ab21-7769ebb66bb7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '.version_select at 0x7fdb36c30c10>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:05.035842 n-d-852084-10 devstack@n-api.service[128970]: ERROR oslo.messaging._drivers.impl_rabbit [None req-553d60a5-4fd4-4744-ab21-7769ebb66bb7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [df791da4-da81-4316-98f2-55ec2733e369] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 13:42:06.045927 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [None req-553d60a5-4fd4-4744-ab21-7769ebb66bb7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [df791da4-da81-4316-98f2-55ec2733e369] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 46840. Sep 08 13:42:06.079293 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-553d60a5-4fd4-4744-ab21-7769ebb66bb7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2022353560" status: 202 len: 0 microversion: 2.1 time: 1.060948 Sep 08 13:42:06.079911 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3130/6127] 10.222.0.78 () {58 vars in 1284 bytes} [Thu Sep 8 13:42:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2022353560 => generated 0 bytes in 1063 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:42:06.141432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-976d02f4-4de2-4953-825b-5e40973230ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'create', calling method: .version_select at 0x7fdb3acdf310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1924952969", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH11ya9y0mqWflnlfqoUY4tOuhltGTf31InLEFO+ydEJWmYdGvQ0XkYJS2SBBGXQGkR9xdoZWHG4ktlIXPQl/xzS4O+b16u/cO8b7Ukvi9qAZkZ7WuxXlRNpeI06IJCsPg=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:42:06.159932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-976d02f4-4de2-4953-825b-5e40973230ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for project cbd130c38aeb4b23b1907212bfe92619. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:42:06.167161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-976d02f4-4de2-4953-825b-5e40973230ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for user c3fb5a1860bd4f118dc19ec38c1796d1 and project cbd130c38aeb4b23b1907212bfe92619. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:42:06.210879 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-976d02f4-4de2-4953-825b-5e40973230ae tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.080850 Sep 08 13:42:06.211867 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2998/6128] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:42:06 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:42:13.547095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=16 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:13.555393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1144726350", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "097114f7-514c-407f-bb77-3de833deb608"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1924952969", "security_groups": [{"name": "tempest-secgroup-smoke-1240817295"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:42:13.741981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] validate_networks() for [('097114f7-514c-407f-bb77-3de833deb608', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:42:14.390985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:42:14.391573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:42:14.392085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:42:14.392513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:42:14.392952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:42:14.405818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:14.406333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:14.406789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:14.407627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:14.408310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:14.409105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:14.436319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for project cbd130c38aeb4b23b1907212bfe92619. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:42:14.443735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for user c3fb5a1860bd4f118dc19ec38c1796d1 and project cbd130c38aeb4b23b1907212bfe92619. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:42:14.463099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:42:14.466589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:42:14.551547 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f3205ac2-0648-4bb3-8f44-3930e06c6299 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.008467 Sep 08 13:42:14.556911 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3131/6129] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:42:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:42:14.565397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:14.581290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7b2bf77f-f086-4c81-830b-862b5bea7915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:14.582448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7b2bf77f-f086-4c81-830b-862b5bea7915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:14.736312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7b2bf77f-f086-4c81-830b-862b5bea7915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:42:14.771334 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7b2bf77f-f086-4c81-830b-862b5bea7915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1267 microversion: 2.1 time: 0.208983 Sep 08 13:42:14.773586 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 2999/6130] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:14 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1267 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:15.802823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2f5acfb1-776e-4490-8787-24aa659acb68 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:15.808277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2f5acfb1-776e-4490-8787-24aa659acb68 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:15.815511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f5acfb1-776e-4490-8787-24aa659acb68 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:15.816833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f5acfb1-776e-4490-8787-24aa659acb68 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:15.816833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f5acfb1-776e-4490-8787-24aa659acb68 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:15.817384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f5acfb1-776e-4490-8787-24aa659acb68 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:15.818034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f5acfb1-776e-4490-8787-24aa659acb68 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:15.819004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f5acfb1-776e-4490-8787-24aa659acb68 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:15.913210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2f5acfb1-776e-4490-8787-24aa659acb68 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:42:15.927287 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2f5acfb1-776e-4490-8787-24aa659acb68 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1319 microversion: 2.1 time: 0.133001 Sep 08 13:42:15.928044 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3132/6131] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:15 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1319 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:16.955982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0e219045-d1a3-491e-8520-4588da9a2dd4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:16.958478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0e219045-d1a3-491e-8520-4588da9a2dd4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:16.972326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e219045-d1a3-491e-8520-4588da9a2dd4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:16.973750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e219045-d1a3-491e-8520-4588da9a2dd4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:16.974908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e219045-d1a3-491e-8520-4588da9a2dd4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:16.976429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e219045-d1a3-491e-8520-4588da9a2dd4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:16.977611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e219045-d1a3-491e-8520-4588da9a2dd4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:16.978657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0e219045-d1a3-491e-8520-4588da9a2dd4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:17.095810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0e219045-d1a3-491e-8520-4588da9a2dd4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:42:17.108158 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0e219045-d1a3-491e-8520-4588da9a2dd4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1325 microversion: 2.1 time: 0.158996 Sep 08 13:42:17.109724 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3000/6132] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:16 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1325 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:18.156951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be31add0-80af-4dc1-ac78-967cfa40828f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:18.157671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-be31add0-80af-4dc1-ac78-967cfa40828f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:18.165513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be31add0-80af-4dc1-ac78-967cfa40828f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:18.166350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be31add0-80af-4dc1-ac78-967cfa40828f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:18.167047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be31add0-80af-4dc1-ac78-967cfa40828f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:18.168061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be31add0-80af-4dc1-ac78-967cfa40828f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:18.168768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be31add0-80af-4dc1-ac78-967cfa40828f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:18.169427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be31add0-80af-4dc1-ac78-967cfa40828f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:18.482976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-be31add0-80af-4dc1-ac78-967cfa40828f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:42:18.501460 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-be31add0-80af-4dc1-ac78-967cfa40828f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1393 microversion: 2.1 time: 0.348142 Sep 08 13:42:18.502988 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3133/6133] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:18 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1393 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:42:18.838682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-42ddcd0d-d4de-47ce-b7be-5d69459af876 req-6df6a99e-11c4-40e9-a379-e007488fbf2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d96fbe1-350b-4cf4-a42c-b65048746aaa", "tag": "c757e7cb-d886-494b-995a-7467bca03e28"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:42:18.850074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-42ddcd0d-d4de-47ce-b7be-5d69459af876 req-6df6a99e-11c4-40e9-a379-e007488fbf2e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:18.850743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-42ddcd0d-d4de-47ce-b7be-5d69459af876 req-6df6a99e-11c4-40e9-a379-e007488fbf2e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:18.851452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-42ddcd0d-d4de-47ce-b7be-5d69459af876 req-6df6a99e-11c4-40e9-a379-e007488fbf2e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:18.864960 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-42ddcd0d-d4de-47ce-b7be-5d69459af876 req-6df6a99e-11c4-40e9-a379-e007488fbf2e service nova] Creating event network-changed:c757e7cb-d886-494b-995a-7467bca03e28 for instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa on n-h2-852084-10 Sep 08 13:42:18.870519 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-42ddcd0d-d4de-47ce-b7be-5d69459af876 req-6df6a99e-11c4-40e9-a379-e007488fbf2e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036164 Sep 08 13:42:18.871291 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3001/6134] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:42:19.531918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f3db5b5-31d4-4268-81eb-46530e6b2366 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:19.533130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f3db5b5-31d4-4268-81eb-46530e6b2366 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:19.546744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f3db5b5-31d4-4268-81eb-46530e6b2366 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:19.547714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f3db5b5-31d4-4268-81eb-46530e6b2366 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:19.548546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f3db5b5-31d4-4268-81eb-46530e6b2366 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:19.549888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f3db5b5-31d4-4268-81eb-46530e6b2366 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:19.550785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f3db5b5-31d4-4268-81eb-46530e6b2366 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:19.551654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f3db5b5-31d4-4268-81eb-46530e6b2366 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:19.708033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f3db5b5-31d4-4268-81eb-46530e6b2366 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:42:19.716482 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f3db5b5-31d4-4268-81eb-46530e6b2366 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1393 microversion: 2.1 time: 0.193490 Sep 08 13:42:19.717162 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3134/6135] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:19 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1393 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:20.747873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-729edb2c-b36a-4bb6-a914-82832b0e54d0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:20.749131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-729edb2c-b36a-4bb6-a914-82832b0e54d0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:20.755505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:20.763838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-729edb2c-b36a-4bb6-a914-82832b0e54d0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:20.764726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-729edb2c-b36a-4bb6-a914-82832b0e54d0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:20.765829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-729edb2c-b36a-4bb6-a914-82832b0e54d0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:20.767360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-729edb2c-b36a-4bb6-a914-82832b0e54d0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:20.768330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-729edb2c-b36a-4bb6-a914-82832b0e54d0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:20.769142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-729edb2c-b36a-4bb6-a914-82832b0e54d0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:20.963554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-729edb2c-b36a-4bb6-a914-82832b0e54d0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:42:20.979168 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-729edb2c-b36a-4bb6-a914-82832b0e54d0 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1393 microversion: 2.1 time: 0.241112 Sep 08 13:42:20.980448 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3002/6136] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:20 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1393 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:22.017039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fdc1e0cb-235f-4cd9-ba04-d23103f4f4b9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:22.017991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fdc1e0cb-235f-4cd9-ba04-d23103f4f4b9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:22.026106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdc1e0cb-235f-4cd9-ba04-d23103f4f4b9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:22.026803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdc1e0cb-235f-4cd9-ba04-d23103f4f4b9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:22.027538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdc1e0cb-235f-4cd9-ba04-d23103f4f4b9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:22.028461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdc1e0cb-235f-4cd9-ba04-d23103f4f4b9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:22.029027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdc1e0cb-235f-4cd9-ba04-d23103f4f4b9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:22.029522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdc1e0cb-235f-4cd9-ba04-d23103f4f4b9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:22.180496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fdc1e0cb-235f-4cd9-ba04-d23103f4f4b9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:42:22.189216 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fdc1e0cb-235f-4cd9-ba04-d23103f4f4b9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1393 microversion: 2.1 time: 0.176661 Sep 08 13:42:22.189825 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3135/6137] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:22 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1393 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:42:23.229675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-82523296-59f5-4b16-b4ea-a089e06b4740 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:23.230992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-82523296-59f5-4b16-b4ea-a089e06b4740 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:23.245809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82523296-59f5-4b16-b4ea-a089e06b4740 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:23.246502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82523296-59f5-4b16-b4ea-a089e06b4740 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:23.247303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82523296-59f5-4b16-b4ea-a089e06b4740 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:23.248625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82523296-59f5-4b16-b4ea-a089e06b4740 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:23.250058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82523296-59f5-4b16-b4ea-a089e06b4740 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:23.250841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82523296-59f5-4b16-b4ea-a089e06b4740 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:23.254194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-704fc9b1-f585-4e11-9e19-28964c847a3a req-68b77740-6532-482a-a9c2-f29d86defbc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d96fbe1-350b-4cf4-a42c-b65048746aaa", "name": "network-vif-plugged", "status": "completed", "tag": "c757e7cb-d886-494b-995a-7467bca03e28"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:42:23.264730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-704fc9b1-f585-4e11-9e19-28964c847a3a req-68b77740-6532-482a-a9c2-f29d86defbc3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:23.265260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-704fc9b1-f585-4e11-9e19-28964c847a3a req-68b77740-6532-482a-a9c2-f29d86defbc3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:23.265706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-704fc9b1-f585-4e11-9e19-28964c847a3a req-68b77740-6532-482a-a9c2-f29d86defbc3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:23.279007 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-704fc9b1-f585-4e11-9e19-28964c847a3a req-68b77740-6532-482a-a9c2-f29d86defbc3 service nova] Creating event network-vif-plugged:c757e7cb-d886-494b-995a-7467bca03e28 for instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa on n-h2-852084-10 Sep 08 13:42:23.285060 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-704fc9b1-f585-4e11-9e19-28964c847a3a req-68b77740-6532-482a-a9c2-f29d86defbc3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177128 Sep 08 13:42:23.285697 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3003/6138] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:42:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:42:23.501573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-82523296-59f5-4b16-b4ea-a089e06b4740 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:42:23.510266 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-82523296-59f5-4b16-b4ea-a089e06b4740 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1393 microversion: 2.1 time: 0.287422 Sep 08 13:42:23.510870 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3136/6139] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:23 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1393 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:42:24.540399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2cf19e3b-5827-4493-9903-e382d168e915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:24.541290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2cf19e3b-5827-4493-9903-e382d168e915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:24.549566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cf19e3b-5827-4493-9903-e382d168e915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:24.550059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cf19e3b-5827-4493-9903-e382d168e915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:24.550493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cf19e3b-5827-4493-9903-e382d168e915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:24.551197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cf19e3b-5827-4493-9903-e382d168e915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:24.551678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cf19e3b-5827-4493-9903-e382d168e915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:24.552100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cf19e3b-5827-4493-9903-e382d168e915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:24.717239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2cf19e3b-5827-4493-9903-e382d168e915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:42:24.726642 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2cf19e3b-5827-4493-9903-e382d168e915 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1565 microversion: 2.1 time: 0.190453 Sep 08 13:42:24.727415 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3004/6140] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:24 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1565 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:24.752070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aac4f53b-3d52-419f-a513-6a6fe2a010d7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:24.752711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aac4f53b-3d52-419f-a513-6a6fe2a010d7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:24.755612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:24.756336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:24.762845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aac4f53b-3d52-419f-a513-6a6fe2a010d7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:24.763592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aac4f53b-3d52-419f-a513-6a6fe2a010d7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:24.764032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aac4f53b-3d52-419f-a513-6a6fe2a010d7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:24.764763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aac4f53b-3d52-419f-a513-6a6fe2a010d7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:24.765233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aac4f53b-3d52-419f-a513-6a6fe2a010d7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:24.765669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aac4f53b-3d52-419f-a513-6a6fe2a010d7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:24.919537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aac4f53b-3d52-419f-a513-6a6fe2a010d7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:42:24.928888 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aac4f53b-3d52-419f-a513-6a6fe2a010d7 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1565 microversion: 2.1 time: 0.181621 Sep 08 13:42:24.929494 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3137/6141] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:24 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1565 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:26.985071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-78321952-3bbd-414b-b6b6-673bc52eb0ea tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:26.986242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-78321952-3bbd-414b-b6b6-673bc52eb0ea tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:26.986390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e5721cfa-6b35-4487-bf75-588fc62f7ed4 req-3cccc817-7909-4b2c-9af4-fc4f9c03d779 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d96fbe1-350b-4cf4-a42c-b65048746aaa", "tag": "c757e7cb-d886-494b-995a-7467bca03e28"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:42:26.995901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:26.997318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:27.001652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78321952-3bbd-414b-b6b6-673bc52eb0ea tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:27.003176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78321952-3bbd-414b-b6b6-673bc52eb0ea tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:27.004609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78321952-3bbd-414b-b6b6-673bc52eb0ea tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:27.006164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78321952-3bbd-414b-b6b6-673bc52eb0ea tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:27.007245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78321952-3bbd-414b-b6b6-673bc52eb0ea tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:27.007850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e5721cfa-6b35-4487-bf75-588fc62f7ed4 req-3cccc817-7909-4b2c-9af4-fc4f9c03d779 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:27.008644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e5721cfa-6b35-4487-bf75-588fc62f7ed4 req-3cccc817-7909-4b2c-9af4-fc4f9c03d779 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:27.008781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-78321952-3bbd-414b-b6b6-673bc52eb0ea tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:27.009386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e5721cfa-6b35-4487-bf75-588fc62f7ed4 req-3cccc817-7909-4b2c-9af4-fc4f9c03d779 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:27.033746 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e5721cfa-6b35-4487-bf75-588fc62f7ed4 req-3cccc817-7909-4b2c-9af4-fc4f9c03d779 service nova] Creating event network-changed:c757e7cb-d886-494b-995a-7467bca03e28 for instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa on n-h2-852084-10 Sep 08 13:42:27.043182 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e5721cfa-6b35-4487-bf75-588fc62f7ed4 req-3cccc817-7909-4b2c-9af4-fc4f9c03d779 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064388 Sep 08 13:42:27.045277 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3138/6142] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:42:27.270020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-78321952-3bbd-414b-b6b6-673bc52eb0ea tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:42:27.278623 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-78321952-3bbd-414b-b6b6-673bc52eb0ea tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1565 microversion: 2.1 time: 0.301540 Sep 08 13:42:27.279271 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3005/6143] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:26 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1565 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:50.599001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=40 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:50.599825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:50.700010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-82c4cd0f-0091-40db-bf58-dc86ee7a03bf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:42:50.704337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-82c4cd0f-0091-40db-bf58-dc86ee7a03bf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:50.716349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82c4cd0f-0091-40db-bf58-dc86ee7a03bf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:50.717259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82c4cd0f-0091-40db-bf58-dc86ee7a03bf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:50.718094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82c4cd0f-0091-40db-bf58-dc86ee7a03bf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:50.719426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82c4cd0f-0091-40db-bf58-dc86ee7a03bf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:50.720287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82c4cd0f-0091-40db-bf58-dc86ee7a03bf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:50.721062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-82c4cd0f-0091-40db-bf58-dc86ee7a03bf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:50.821160 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-82c4cd0f-0091-40db-bf58-dc86ee7a03bf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa/action" status: 200 len: 24570 microversion: 2.1 time: 0.224027 Sep 08 13:42:50.821934 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3139/6144] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:42:50 2022] POST /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa/action => generated 24570 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 08 13:42:57.149323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-02430e71-6fc6-46bd-a6fb-ea25e06a1277 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:57.149967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-02430e71-6fc6-46bd-a6fb-ea25e06a1277 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:57.152676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=7 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:57.153613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=28 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:42:57.160086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02430e71-6fc6-46bd-a6fb-ea25e06a1277 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:57.160590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02430e71-6fc6-46bd-a6fb-ea25e06a1277 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:57.161036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02430e71-6fc6-46bd-a6fb-ea25e06a1277 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:57.161773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02430e71-6fc6-46bd-a6fb-ea25e06a1277 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:57.162228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02430e71-6fc6-46bd-a6fb-ea25e06a1277 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:57.162659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-02430e71-6fc6-46bd-a6fb-ea25e06a1277 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:57.437220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-02430e71-6fc6-46bd-a6fb-ea25e06a1277 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:42:57.465341 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-02430e71-6fc6-46bd-a6fb-ea25e06a1277 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1683 microversion: 2.1 time: 0.307570 Sep 08 13:42:57.466552 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3006/6145] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:57 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1683 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:42:57.629796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5aa79b07-8d48-423e-9bbe-e80c804b8560 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:42:57.633808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5aa79b07-8d48-423e-9bbe-e80c804b8560 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:57.648113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5aa79b07-8d48-423e-9bbe-e80c804b8560 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:57.649068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5aa79b07-8d48-423e-9bbe-e80c804b8560 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:57.649816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5aa79b07-8d48-423e-9bbe-e80c804b8560 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:57.651097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5aa79b07-8d48-423e-9bbe-e80c804b8560 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:57.651988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5aa79b07-8d48-423e-9bbe-e80c804b8560 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:57.652794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5aa79b07-8d48-423e-9bbe-e80c804b8560 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:57.739644 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5aa79b07-8d48-423e-9bbe-e80c804b8560 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa/action" status: 200 len: 32639 microversion: 2.1 time: 0.117880 Sep 08 13:42:57.740378 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3140/6146] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:42:57 2022] POST /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa/action => generated 32639 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:42:58.072062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-15a18dd7-075c-4701-bf9e-921d256fb2d7 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:42:58.072938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-15a18dd7-075c-4701-bf9e-921d256fb2d7 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:58.081085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15a18dd7-075c-4701-bf9e-921d256fb2d7 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:58.081625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15a18dd7-075c-4701-bf9e-921d256fb2d7 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:58.082220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15a18dd7-075c-4701-bf9e-921d256fb2d7 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:58.083174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15a18dd7-075c-4701-bf9e-921d256fb2d7 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:58.083781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15a18dd7-075c-4701-bf9e-921d256fb2d7 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:58.084267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15a18dd7-075c-4701-bf9e-921d256fb2d7 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:58.258242 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-15a18dd7-075c-4701-bf9e-921d256fb2d7 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1836 microversion: 2.1 time: 0.336775 Sep 08 13:42:58.259094 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3007/6147] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:42:57 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1836 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:42:58.297761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b2d80422-fe47-4ce1-b5c0-8b5c6ff19b10 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:42:58.300795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b2d80422-fe47-4ce1-b5c0-8b5c6ff19b10 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:42:58.309204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2d80422-fe47-4ce1-b5c0-8b5c6ff19b10 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:58.309711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2d80422-fe47-4ce1-b5c0-8b5c6ff19b10 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:58.310162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2d80422-fe47-4ce1-b5c0-8b5c6ff19b10 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:58.310910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2d80422-fe47-4ce1-b5c0-8b5c6ff19b10 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:42:58.311477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2d80422-fe47-4ce1-b5c0-8b5c6ff19b10 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:42:58.311926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2d80422-fe47-4ce1-b5c0-8b5c6ff19b10 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:42:58.347933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-b2d80422-fe47-4ce1-b5c0-8b5c6ff19b10 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lazy-loading 'flavor' on Instance uuid 3d96fbe1-350b-4cf4-a42c-b65048746aaa {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:42:58.365449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b2d80422-fe47-4ce1-b5c0-8b5c6ff19b10 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Going to try to live migrate instance to another host {{(pid=128970) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Sep 08 13:43:01.157286 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b2d80422-fe47-4ce1-b5c0-8b5c6ff19b10 tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa/action" status: 202 len: 0 microversion: 2.1 time: 2.864223 Sep 08 13:43:01.159785 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3141/6148] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:42:58 2022] POST /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa/action => generated 0 bytes in 2870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:43:01.172117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1d9b6dc0-67ce-4505-9dd4-e277c6567944 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:01.172913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1d9b6dc0-67ce-4505-9dd4-e277c6567944 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:01.182383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d9b6dc0-67ce-4505-9dd4-e277c6567944 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:01.183258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d9b6dc0-67ce-4505-9dd4-e277c6567944 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:01.184076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d9b6dc0-67ce-4505-9dd4-e277c6567944 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:01.185341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d9b6dc0-67ce-4505-9dd4-e277c6567944 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:01.185916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d9b6dc0-67ce-4505-9dd4-e277c6567944 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:01.187070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1d9b6dc0-67ce-4505-9dd4-e277c6567944 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:01.448642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1d9b6dc0-67ce-4505-9dd4-e277c6567944 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:01.464907 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1d9b6dc0-67ce-4505-9dd4-e277c6567944 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1693 microversion: 2.1 time: 0.297389 Sep 08 13:43:01.466342 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3008/6149] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:01 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1693 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:02.514802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f73a0c56-8cb1-4345-abb6-aabe1ca9ada2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:02.515650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f73a0c56-8cb1-4345-abb6-aabe1ca9ada2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:02.528169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f73a0c56-8cb1-4345-abb6-aabe1ca9ada2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:02.528662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f73a0c56-8cb1-4345-abb6-aabe1ca9ada2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:02.529117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f73a0c56-8cb1-4345-abb6-aabe1ca9ada2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:02.529888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f73a0c56-8cb1-4345-abb6-aabe1ca9ada2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:02.530931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f73a0c56-8cb1-4345-abb6-aabe1ca9ada2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:02.531421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f73a0c56-8cb1-4345-abb6-aabe1ca9ada2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:02.790306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f73a0c56-8cb1-4345-abb6-aabe1ca9ada2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:02.804354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-df49227e-92ac-49e7-a609-efe0f0236cd7 req-6c3f90bc-4d4e-40aa-9b3b-4f49180cd001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d96fbe1-350b-4cf4-a42c-b65048746aaa", "name": "network-vif-unplugged", "status": "completed", "tag": "c757e7cb-d886-494b-995a-7467bca03e28"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:02.807753 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f73a0c56-8cb1-4345-abb6-aabe1ca9ada2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1693 microversion: 2.1 time: 0.299711 Sep 08 13:43:02.808858 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3142/6150] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:02 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1693 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:43:02.829639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-df49227e-92ac-49e7-a609-efe0f0236cd7 req-6c3f90bc-4d4e-40aa-9b3b-4f49180cd001 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:02.830658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-df49227e-92ac-49e7-a609-efe0f0236cd7 req-6c3f90bc-4d4e-40aa-9b3b-4f49180cd001 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:02.831700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-df49227e-92ac-49e7-a609-efe0f0236cd7 req-6c3f90bc-4d4e-40aa-9b3b-4f49180cd001 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:02.877725 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-df49227e-92ac-49e7-a609-efe0f0236cd7 req-6c3f90bc-4d4e-40aa-9b3b-4f49180cd001 service nova] Creating event network-vif-unplugged:c757e7cb-d886-494b-995a-7467bca03e28 for instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa on n-h2-852084-10 Sep 08 13:43:02.895373 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-df49227e-92ac-49e7-a609-efe0f0236cd7 req-6c3f90bc-4d4e-40aa-9b3b-4f49180cd001 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.095711 Sep 08 13:43:02.898313 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3009/6151] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:43:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:43:03.866073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2c1c3a06-0d34-4ce6-ae11-6a436f37b40f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:03.867476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2c1c3a06-0d34-4ce6-ae11-6a436f37b40f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:03.877249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1c3a06-0d34-4ce6-ae11-6a436f37b40f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:03.878256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1c3a06-0d34-4ce6-ae11-6a436f37b40f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:03.879046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1c3a06-0d34-4ce6-ae11-6a436f37b40f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:03.879996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1c3a06-0d34-4ce6-ae11-6a436f37b40f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:03.880652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1c3a06-0d34-4ce6-ae11-6a436f37b40f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:03.881243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2c1c3a06-0d34-4ce6-ae11-6a436f37b40f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:04.209536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2c1c3a06-0d34-4ce6-ae11-6a436f37b40f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:04.219191 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2c1c3a06-0d34-4ce6-ae11-6a436f37b40f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1693 microversion: 2.1 time: 0.358157 Sep 08 13:43:04.219848 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3143/6152] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:03 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1693 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:04.964796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-ca2d9e2f-e677-4405-a0a1-c124033ff687 req-6f76170f-0143-4fea-a646-1e13646a5a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d96fbe1-350b-4cf4-a42c-b65048746aaa", "tag": "c757e7cb-d886-494b-995a-7467bca03e28"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:04.987326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ca2d9e2f-e677-4405-a0a1-c124033ff687 req-6f76170f-0143-4fea-a646-1e13646a5a61 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:04.988272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ca2d9e2f-e677-4405-a0a1-c124033ff687 req-6f76170f-0143-4fea-a646-1e13646a5a61 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:04.989006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ca2d9e2f-e677-4405-a0a1-c124033ff687 req-6f76170f-0143-4fea-a646-1e13646a5a61 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:05.023696 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-ca2d9e2f-e677-4405-a0a1-c124033ff687 req-6f76170f-0143-4fea-a646-1e13646a5a61 service nova] Creating event network-changed:c757e7cb-d886-494b-995a-7467bca03e28 for instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa on n-h2-852084-10 Sep 08 13:43:05.034591 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-ca2d9e2f-e677-4405-a0a1-c124033ff687 req-6f76170f-0143-4fea-a646-1e13646a5a61 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076116 Sep 08 13:43:05.036325 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3010/6153] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:43:05.254751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1f10df15-6306-4ad1-89dc-101c70cc0bbe tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:05.257216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1f10df15-6306-4ad1-89dc-101c70cc0bbe tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:05.270220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f10df15-6306-4ad1-89dc-101c70cc0bbe tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:05.271689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f10df15-6306-4ad1-89dc-101c70cc0bbe tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:05.272847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f10df15-6306-4ad1-89dc-101c70cc0bbe tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:05.274511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f10df15-6306-4ad1-89dc-101c70cc0bbe tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:05.275733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f10df15-6306-4ad1-89dc-101c70cc0bbe tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:05.276903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1f10df15-6306-4ad1-89dc-101c70cc0bbe tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:05.668455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1f10df15-6306-4ad1-89dc-101c70cc0bbe tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:05.681596 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1f10df15-6306-4ad1-89dc-101c70cc0bbe tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1693 microversion: 2.1 time: 0.434509 Sep 08 13:43:05.682805 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3144/6154] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:05 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1693 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:43:06.718544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ffc571c3-4cb8-431f-a25b-d1fe2176897b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:06.720143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ffc571c3-4cb8-431f-a25b-d1fe2176897b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:06.735267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffc571c3-4cb8-431f-a25b-d1fe2176897b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:06.736166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffc571c3-4cb8-431f-a25b-d1fe2176897b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:06.737293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffc571c3-4cb8-431f-a25b-d1fe2176897b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:06.738625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffc571c3-4cb8-431f-a25b-d1fe2176897b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:06.739421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffc571c3-4cb8-431f-a25b-d1fe2176897b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:06.740237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ffc571c3-4cb8-431f-a25b-d1fe2176897b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:06.949858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ffc571c3-4cb8-431f-a25b-d1fe2176897b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:06.966523 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ffc571c3-4cb8-431f-a25b-d1fe2176897b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1693 microversion: 2.1 time: 0.253478 Sep 08 13:43:06.967887 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3011/6155] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:06 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1693 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:08.008258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f755d88c-eef3-4fdd-811a-0cd83abe8b74 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:08.010044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f755d88c-eef3-4fdd-811a-0cd83abe8b74 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:08.022654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f755d88c-eef3-4fdd-811a-0cd83abe8b74 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:08.023534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f755d88c-eef3-4fdd-811a-0cd83abe8b74 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:08.024304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f755d88c-eef3-4fdd-811a-0cd83abe8b74 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:08.025519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f755d88c-eef3-4fdd-811a-0cd83abe8b74 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:08.026556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f755d88c-eef3-4fdd-811a-0cd83abe8b74 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:08.027317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f755d88c-eef3-4fdd-811a-0cd83abe8b74 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:08.304243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f755d88c-eef3-4fdd-811a-0cd83abe8b74 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:08.322137 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f755d88c-eef3-4fdd-811a-0cd83abe8b74 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1693 microversion: 2.1 time: 0.320346 Sep 08 13:43:08.323277 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3145/6156] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:08 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1693 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:43:09.347642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db8fc70e-9aa7-4888-915c-b432bd7ba2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:09.348508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-db8fc70e-9aa7-4888-915c-b432bd7ba2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:09.356444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db8fc70e-9aa7-4888-915c-b432bd7ba2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:09.356955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db8fc70e-9aa7-4888-915c-b432bd7ba2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:09.357400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db8fc70e-9aa7-4888-915c-b432bd7ba2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:09.358637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db8fc70e-9aa7-4888-915c-b432bd7ba2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:09.359191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db8fc70e-9aa7-4888-915c-b432bd7ba2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:09.359752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db8fc70e-9aa7-4888-915c-b432bd7ba2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:09.574843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-db8fc70e-9aa7-4888-915c-b432bd7ba2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:09.584314 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-db8fc70e-9aa7-4888-915c-b432bd7ba2a8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1693 microversion: 2.1 time: 0.241719 Sep 08 13:43:09.585175 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3012/6157] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:09 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1693 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:09.748431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-379961176", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1418132249", "security_groups": [{"name": "tempest-secgroup-smoke-834206503"}], "block_device_mapping_v2": [{"uuid": "69ee7b1e-724a-4c72-9a2d-5d0ceb580c98", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dd09c139-4c62-4afa-ac6f-48ed313685b7"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:09.927287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] validate_networks() for [('dd09c139-4c62-4afa-ac6f-48ed313685b7', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:43:10.519038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:43:10.519767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:43:10.520496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:43:10.521177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:43:10.522022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:43:10.534199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:10.534832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:10.535428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:10.536470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:10.537154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:10.537923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:10.570776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:43:10.582249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Getting quotas for user 6f65d872026946a7a6badc404b161499 and project c2e0170321894cfeae69bdf34f6a4517. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:43:10.625755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6a408d43-b39b-4349-862c-3fc6fcda64ad tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:10.628542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6a408d43-b39b-4349-862c-3fc6fcda64ad tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:10.638222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a408d43-b39b-4349-862c-3fc6fcda64ad tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:10.639070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a408d43-b39b-4349-862c-3fc6fcda64ad tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:10.639774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a408d43-b39b-4349-862c-3fc6fcda64ad tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:10.640714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a408d43-b39b-4349-862c-3fc6fcda64ad tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:10.641394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a408d43-b39b-4349-862c-3fc6fcda64ad tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:10.642018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a408d43-b39b-4349-862c-3fc6fcda64ad tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:10.711409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:43:10.713798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='69ee7b1e-724a-4c72-9a2d-5d0ceb580c98',volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:43:10.856464 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6a408d43-b39b-4349-862c-3fc6fcda64ad tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:10.866878 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6a408d43-b39b-4349-862c-3fc6fcda64ad tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1693 microversion: 2.1 time: 0.251344 Sep 08 13:43:10.868412 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3013/6158] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:10 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1693 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:43:10.928858 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ff0f57c9-c057-4200-b103-2e383e1abb55 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.184688 Sep 08 13:43:10.929837 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3146/6159] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:43:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:43:10.941974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f913a479-5463-4398-8637-5f16a04ec6db tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:10.943286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f913a479-5463-4398-8637-5f16a04ec6db tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:11.026001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f913a479-5463-4398-8637-5f16a04ec6db tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:11.041955 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f913a479-5463-4398-8637-5f16a04ec6db tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1094 microversion: 2.1 time: 0.104091 Sep 08 13:43:11.043306 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3014/6160] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:10 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1094 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:11.896163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4d12050-0b21-4d75-8bcf-6b3537fbe36b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:11.896802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e4d12050-0b21-4d75-8bcf-6b3537fbe36b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:11.905452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4d12050-0b21-4d75-8bcf-6b3537fbe36b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:11.906332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4d12050-0b21-4d75-8bcf-6b3537fbe36b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:11.906952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4d12050-0b21-4d75-8bcf-6b3537fbe36b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:11.907910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4d12050-0b21-4d75-8bcf-6b3537fbe36b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:11.908613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4d12050-0b21-4d75-8bcf-6b3537fbe36b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:11.909353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4d12050-0b21-4d75-8bcf-6b3537fbe36b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:12.066908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2cbad900-bf45-4a70-b913-9a14e514abf8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:12.067799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2cbad900-bf45-4a70-b913-9a14e514abf8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:12.076845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cbad900-bf45-4a70-b913-9a14e514abf8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:12.077535 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cbad900-bf45-4a70-b913-9a14e514abf8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:12.078061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cbad900-bf45-4a70-b913-9a14e514abf8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:12.078831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cbad900-bf45-4a70-b913-9a14e514abf8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:12.079396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cbad900-bf45-4a70-b913-9a14e514abf8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:12.079839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2cbad900-bf45-4a70-b913-9a14e514abf8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:12.121391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e4d12050-0b21-4d75-8bcf-6b3537fbe36b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:12.131629 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e4d12050-0b21-4d75-8bcf-6b3537fbe36b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1683 microversion: 2.1 time: 0.240393 Sep 08 13:43:12.138347 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3147/6161] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:11 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1683 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:12.162054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3242ea2e-9eff-4dd1-8fa8-e3a4bf3d027b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:12.163219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3242ea2e-9eff-4dd1-8fa8-e3a4bf3d027b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:12.175040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3242ea2e-9eff-4dd1-8fa8-e3a4bf3d027b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:12.176003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3242ea2e-9eff-4dd1-8fa8-e3a4bf3d027b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:12.176900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3242ea2e-9eff-4dd1-8fa8-e3a4bf3d027b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:12.178288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3242ea2e-9eff-4dd1-8fa8-e3a4bf3d027b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:12.179272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3242ea2e-9eff-4dd1-8fa8-e3a4bf3d027b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:12.180185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3242ea2e-9eff-4dd1-8fa8-e3a4bf3d027b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:12.183282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2cbad900-bf45-4a70-b913-9a14e514abf8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:12.194880 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2cbad900-bf45-4a70-b913-9a14e514abf8 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1192 microversion: 2.1 time: 0.132351 Sep 08 13:43:12.207537 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3015/6162] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:12 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1192 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:43:12.430112 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3242ea2e-9eff-4dd1-8fa8-e3a4bf3d027b tempest-TestNetworkAdvancedServerOps-2076325641 tempest-TestNetworkAdvancedServerOps-2076325641-project-admin] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1836 microversion: 2.1 time: 0.275407 Sep 08 13:43:12.431213 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3148/6163] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:12 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1836 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:12.456669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2063f88a-120c-4b3d-b604-fa4c7604dcf8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:12.457537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2063f88a-120c-4b3d-b604-fa4c7604dcf8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:12.465440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2063f88a-120c-4b3d-b604-fa4c7604dcf8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:12.466601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2063f88a-120c-4b3d-b604-fa4c7604dcf8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:12.467361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2063f88a-120c-4b3d-b604-fa4c7604dcf8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:12.468344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2063f88a-120c-4b3d-b604-fa4c7604dcf8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:12.468977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2063f88a-120c-4b3d-b604-fa4c7604dcf8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:12.469718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2063f88a-120c-4b3d-b604-fa4c7604dcf8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:12.666186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2063f88a-120c-4b3d-b604-fa4c7604dcf8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:12.676053 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2063f88a-120c-4b3d-b604-fa4c7604dcf8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1683 microversion: 2.1 time: 0.224310 Sep 08 13:43:12.676457 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3016/6164] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:12 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1683 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:13.233932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3fa51304-b9a6-438a-9983-9cb1e7220484 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:13.234643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3fa51304-b9a6-438a-9983-9cb1e7220484 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:13.243167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fa51304-b9a6-438a-9983-9cb1e7220484 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:13.243734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fa51304-b9a6-438a-9983-9cb1e7220484 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:13.244404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fa51304-b9a6-438a-9983-9cb1e7220484 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:13.245173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fa51304-b9a6-438a-9983-9cb1e7220484 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:13.245662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fa51304-b9a6-438a-9983-9cb1e7220484 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:13.246179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fa51304-b9a6-438a-9983-9cb1e7220484 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:13.478582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3fa51304-b9a6-438a-9983-9cb1e7220484 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:13.489841 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3fa51304-b9a6-438a-9983-9cb1e7220484 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1277 microversion: 2.1 time: 0.260140 Sep 08 13:43:13.491473 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3149/6165] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:13 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1277 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:14.300852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-39d245dc-3418-4406-a344-4311f245924e req-cc3fb050-8055-49c5-8dde-6ea185cf56d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6efae46-049b-4956-8165-4f798b565738", "tag": "4d5f101d-2d74-4980-9280-a76ad5f550cd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:14.318830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-39d245dc-3418-4406-a344-4311f245924e req-cc3fb050-8055-49c5-8dde-6ea185cf56d3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:14.319726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-39d245dc-3418-4406-a344-4311f245924e req-cc3fb050-8055-49c5-8dde-6ea185cf56d3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:14.320265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-39d245dc-3418-4406-a344-4311f245924e req-cc3fb050-8055-49c5-8dde-6ea185cf56d3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:14.344772 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-39d245dc-3418-4406-a344-4311f245924e req-cc3fb050-8055-49c5-8dde-6ea185cf56d3 service nova] Creating event network-changed:4d5f101d-2d74-4980-9280-a76ad5f550cd for instance a6efae46-049b-4956-8165-4f798b565738 on n-h1-852084-10 Sep 08 13:43:14.354541 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-39d245dc-3418-4406-a344-4311f245924e req-cc3fb050-8055-49c5-8dde-6ea185cf56d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055122 Sep 08 13:43:14.354748 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3017/6166] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:43:14.517772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89e192d6-3703-49d1-81a6-d7aef4a8e6d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:14.518683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-89e192d6-3703-49d1-81a6-d7aef4a8e6d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:14.527392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e192d6-3703-49d1-81a6-d7aef4a8e6d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:14.527915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e192d6-3703-49d1-81a6-d7aef4a8e6d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:14.528386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e192d6-3703-49d1-81a6-d7aef4a8e6d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:14.529137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e192d6-3703-49d1-81a6-d7aef4a8e6d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:14.529613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e192d6-3703-49d1-81a6-d7aef4a8e6d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:14.530845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89e192d6-3703-49d1-81a6-d7aef4a8e6d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:14.734116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-89e192d6-3703-49d1-81a6-d7aef4a8e6d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:14.749707 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-89e192d6-3703-49d1-81a6-d7aef4a8e6d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1277 microversion: 2.1 time: 0.235888 Sep 08 13:43:14.750840 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3150/6167] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:14 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:43:14.830902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38a5130b-dd9c-4493-85f3-fee54c5b880f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:14.836129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-38a5130b-dd9c-4493-85f3-fee54c5b880f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:14.847973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38a5130b-dd9c-4493-85f3-fee54c5b880f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:14.848940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38a5130b-dd9c-4493-85f3-fee54c5b880f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:14.849604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38a5130b-dd9c-4493-85f3-fee54c5b880f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:14.850713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38a5130b-dd9c-4493-85f3-fee54c5b880f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:14.851570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38a5130b-dd9c-4493-85f3-fee54c5b880f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:14.852235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38a5130b-dd9c-4493-85f3-fee54c5b880f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:14.924747 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38a5130b-dd9c-4493-85f3-fee54c5b880f tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa/action" status: 200 len: 38521 microversion: 2.1 time: 0.103621 Sep 08 13:43:14.928030 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3018/6168] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:43:14 2022] POST /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa/action => generated 38521 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:43:15.785682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8cbbc0cd-966b-414d-bc56-9d90224f5923 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:15.787546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8cbbc0cd-966b-414d-bc56-9d90224f5923 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:15.805871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cbbc0cd-966b-414d-bc56-9d90224f5923 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:15.806967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cbbc0cd-966b-414d-bc56-9d90224f5923 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:15.807884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cbbc0cd-966b-414d-bc56-9d90224f5923 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:15.809414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cbbc0cd-966b-414d-bc56-9d90224f5923 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:15.810536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cbbc0cd-966b-414d-bc56-9d90224f5923 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:15.811690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cbbc0cd-966b-414d-bc56-9d90224f5923 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:16.192927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8cbbc0cd-966b-414d-bc56-9d90224f5923 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:16.206634 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8cbbc0cd-966b-414d-bc56-9d90224f5923 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1277 microversion: 2.1 time: 0.435722 Sep 08 13:43:16.219904 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3151/6169] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:15 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1277 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:16.537641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-185dd490-19c9-42a6-8f98-e6cf1338dd19 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:16.538425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c5cced4c-6d16-4b23-9bef-cf55ab001868 req-2a8fcc64-a3bd-4bd6-824f-bbd36dfb4371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d96fbe1-350b-4cf4-a42c-b65048746aaa", "tag": "c757e7cb-d886-494b-995a-7467bca03e28"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:16.539804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-185dd490-19c9-42a6-8f98-e6cf1338dd19 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:16.555696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-185dd490-19c9-42a6-8f98-e6cf1338dd19 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:16.556577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-185dd490-19c9-42a6-8f98-e6cf1338dd19 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:16.557385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-185dd490-19c9-42a6-8f98-e6cf1338dd19 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:16.558714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-185dd490-19c9-42a6-8f98-e6cf1338dd19 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:16.559630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-185dd490-19c9-42a6-8f98-e6cf1338dd19 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:16.560443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-185dd490-19c9-42a6-8f98-e6cf1338dd19 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:16.577699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c5cced4c-6d16-4b23-9bef-cf55ab001868 req-2a8fcc64-a3bd-4bd6-824f-bbd36dfb4371 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:16.578190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c5cced4c-6d16-4b23-9bef-cf55ab001868 req-2a8fcc64-a3bd-4bd6-824f-bbd36dfb4371 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:16.578630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c5cced4c-6d16-4b23-9bef-cf55ab001868 req-2a8fcc64-a3bd-4bd6-824f-bbd36dfb4371 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:16.593829 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c5cced4c-6d16-4b23-9bef-cf55ab001868 req-2a8fcc64-a3bd-4bd6-824f-bbd36dfb4371 service nova] Creating event network-changed:c757e7cb-d886-494b-995a-7467bca03e28 for instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa on n-h1-852084-10 Sep 08 13:43:16.600299 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c5cced4c-6d16-4b23-9bef-cf55ab001868 req-2a8fcc64-a3bd-4bd6-824f-bbd36dfb4371 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067924 Sep 08 13:43:16.600767 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3152/6170] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:43:16.611782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-185dd490-19c9-42a6-8f98-e6cf1338dd19 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:43:16.765292 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-185dd490-19c9-42a6-8f98-e6cf1338dd19 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 204 len: 0 microversion: 2.1 time: 0.234429 Sep 08 13:43:16.772256 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3019/6171] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:43:16 2022] DELETE /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:43:16.779279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5f333f28-66e6-412d-b4de-4b718d034f61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:16.780109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5f333f28-66e6-412d-b4de-4b718d034f61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:16.787402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f333f28-66e6-412d-b4de-4b718d034f61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:16.788726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f333f28-66e6-412d-b4de-4b718d034f61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:16.789375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f333f28-66e6-412d-b4de-4b718d034f61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:16.791273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f333f28-66e6-412d-b4de-4b718d034f61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:16.791982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f333f28-66e6-412d-b4de-4b718d034f61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:16.792599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f333f28-66e6-412d-b4de-4b718d034f61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:17.002983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5f333f28-66e6-412d-b4de-4b718d034f61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:17.015884 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5f333f28-66e6-412d-b4de-4b718d034f61 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1689 microversion: 2.1 time: 0.241364 Sep 08 13:43:17.028106 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3153/6172] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:16 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1689 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:17.243341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a70b2c4b-3426-4df0-a8c5-ce98c85ee10b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:17.244050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a70b2c4b-3426-4df0-a8c5-ce98c85ee10b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:17.251913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a70b2c4b-3426-4df0-a8c5-ce98c85ee10b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:17.253135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a70b2c4b-3426-4df0-a8c5-ce98c85ee10b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:17.253135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a70b2c4b-3426-4df0-a8c5-ce98c85ee10b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:17.253906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a70b2c4b-3426-4df0-a8c5-ce98c85ee10b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:17.254505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a70b2c4b-3426-4df0-a8c5-ce98c85ee10b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:17.255034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a70b2c4b-3426-4df0-a8c5-ce98c85ee10b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:17.462784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a70b2c4b-3426-4df0-a8c5-ce98c85ee10b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:17.478963 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a70b2c4b-3426-4df0-a8c5-ce98c85ee10b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1277 microversion: 2.1 time: 0.239836 Sep 08 13:43:17.481017 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3020/6173] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:17 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:18.064941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7ab0b96b-0788-4813-abad-927701ccaedd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:18.068263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7ab0b96b-0788-4813-abad-927701ccaedd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:18.088636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ab0b96b-0788-4813-abad-927701ccaedd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:18.090004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ab0b96b-0788-4813-abad-927701ccaedd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:18.091342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ab0b96b-0788-4813-abad-927701ccaedd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:18.093958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ab0b96b-0788-4813-abad-927701ccaedd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:18.096403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ab0b96b-0788-4813-abad-927701ccaedd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:18.097815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ab0b96b-0788-4813-abad-927701ccaedd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:18.133185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-ba2aba36-c3f0-42c3-92ee-05bb2139d711 req-81e1151d-e662-4234-9719-0f7f33f71c11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d96fbe1-350b-4cf4-a42c-b65048746aaa", "name": "network-vif-deleted", "tag": "c757e7cb-d886-494b-995a-7467bca03e28"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:18.151717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ba2aba36-c3f0-42c3-92ee-05bb2139d711 req-81e1151d-e662-4234-9719-0f7f33f71c11 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:18.153715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ba2aba36-c3f0-42c3-92ee-05bb2139d711 req-81e1151d-e662-4234-9719-0f7f33f71c11 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:18.154232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ba2aba36-c3f0-42c3-92ee-05bb2139d711 req-81e1151d-e662-4234-9719-0f7f33f71c11 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:18.184726 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-ba2aba36-c3f0-42c3-92ee-05bb2139d711 req-81e1151d-e662-4234-9719-0f7f33f71c11 service nova] Creating event network-vif-deleted:c757e7cb-d886-494b-995a-7467bca03e28 for instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa on n-h1-852084-10 Sep 08 13:43:18.193939 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-ba2aba36-c3f0-42c3-92ee-05bb2139d711 req-81e1151d-e662-4234-9719-0f7f33f71c11 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062800 Sep 08 13:43:18.200612 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3021/6174] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:43:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:43:18.251136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ab0b96b-0788-4813-abad-927701ccaedd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:18.289327 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7ab0b96b-0788-4813-abad-927701ccaedd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 200 len: 1503 microversion: 2.1 time: 0.233434 Sep 08 13:43:18.292186 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3154/6175] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:18 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 1503 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:18.527469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8edc9551-0f46-4d8f-9ebf-82984f0e4c40 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:18.528349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8edc9551-0f46-4d8f-9ebf-82984f0e4c40 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:18.538179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8edc9551-0f46-4d8f-9ebf-82984f0e4c40 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:18.539184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8edc9551-0f46-4d8f-9ebf-82984f0e4c40 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:18.539957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8edc9551-0f46-4d8f-9ebf-82984f0e4c40 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:18.545816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8edc9551-0f46-4d8f-9ebf-82984f0e4c40 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:18.547217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8edc9551-0f46-4d8f-9ebf-82984f0e4c40 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:18.548386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8edc9551-0f46-4d8f-9ebf-82984f0e4c40 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:18.816886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8edc9551-0f46-4d8f-9ebf-82984f0e4c40 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:18.842779 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8edc9551-0f46-4d8f-9ebf-82984f0e4c40 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1277 microversion: 2.1 time: 0.320279 Sep 08 13:43:18.860391 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3022/6176] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:18 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1277 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:19.321414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a122c9bc-28c8-4a7b-9de1-1193a0fc2b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:19.322476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a122c9bc-28c8-4a7b-9de1-1193a0fc2b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 3d96fbe1-350b-4cf4-a42c-b65048746aaa] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:19.331760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a122c9bc-28c8-4a7b-9de1-1193a0fc2b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:19.332287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a122c9bc-28c8-4a7b-9de1-1193a0fc2b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:19.332851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a122c9bc-28c8-4a7b-9de1-1193a0fc2b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:19.334021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a122c9bc-28c8-4a7b-9de1-1193a0fc2b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:19.334389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a122c9bc-28c8-4a7b-9de1-1193a0fc2b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:19.335004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a122c9bc-28c8-4a7b-9de1-1193a0fc2b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:19.359081 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-a122c9bc-28c8-4a7b-9de1-1193a0fc2b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] HTTP exception thrown: Instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa could not be found. Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a122c9bc-28c8-4a7b-9de1-1193a0fc2b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Request method failure captured: Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa HTTP/1.1 Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfAnDjCiija-3DB5W4J6ri-fu6OcpUbo-W8mx5zngP02-J7_POIIpc3-zpJO-dfrroJuHCv8EsActPv5vuSWguNHoH76B17-De96TjlaxEdNnya3aBd8z3oBNyuhh5JRVQPwN6yVLxLYfY3oQXXo567eBhy9Fhj_K2TtE8cZ_abBrJY Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: cbd130c38aeb4b23b1907212bfe92619 Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2131984032 Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2131984032 Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: cbd130c38aeb4b23b1907212bfe92619 Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2131984032 Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestNetworkAdvancedServerOps-2131984032-project Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: c3fb5a1860bd4f118dc19ec38c1796d1 Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2131984032-project Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa could not be found. Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '3d96fbe1-350b-4cf4-a42c-b65048746aaa'} Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa could not be found. Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa could not be found. Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:43:19.362715 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:43:19.380117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:43:19.380117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:43:19.380117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:43:19.380117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:43:19.380117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:43:19.380117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:43:19.380117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa could not be found. Sep 08 13:43:19.380117 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:43:19.380117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a122c9bc-28c8-4a7b-9de1-1193a0fc2b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Returning 404 to user: Instance 3d96fbe1-350b-4cf4-a42c-b65048746aaa could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:43:19.380117 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a122c9bc-28c8-4a7b-9de1-1193a0fc2b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa" status: 404 len: 111 microversion: 2.1 time: 0.048666 Sep 08 13:43:19.380117 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3155/6177] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:19 2022] GET /compute/v2.1/servers/3d96fbe1-350b-4cf4-a42c-b65048746aaa => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:43:19.879358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bcc43be2-5aeb-4481-91ff-b5a9c7e33d49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:19.880810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bcc43be2-5aeb-4481-91ff-b5a9c7e33d49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:19.890503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcc43be2-5aeb-4481-91ff-b5a9c7e33d49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:19.891166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcc43be2-5aeb-4481-91ff-b5a9c7e33d49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:19.891775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcc43be2-5aeb-4481-91ff-b5a9c7e33d49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:19.892590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcc43be2-5aeb-4481-91ff-b5a9c7e33d49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:19.893149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcc43be2-5aeb-4481-91ff-b5a9c7e33d49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:19.893783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcc43be2-5aeb-4481-91ff-b5a9c7e33d49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:20.659411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bcc43be2-5aeb-4481-91ff-b5a9c7e33d49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:20.675837 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bcc43be2-5aeb-4481-91ff-b5a9c7e33d49 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1265 microversion: 2.1 time: 0.799694 Sep 08 13:43:20.675837 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3023/6178] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:19 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1265 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:43:21.699309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e1248665-6a92-48e2-8491-33ae10454391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:21.700132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e1248665-6a92-48e2-8491-33ae10454391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:21.704854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:21.710088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:21.710459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:21.719510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1248665-6a92-48e2-8491-33ae10454391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:21.720035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1248665-6a92-48e2-8491-33ae10454391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:21.720507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1248665-6a92-48e2-8491-33ae10454391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:21.721258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1248665-6a92-48e2-8491-33ae10454391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:21.721963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1248665-6a92-48e2-8491-33ae10454391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:21.722809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1248665-6a92-48e2-8491-33ae10454391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:21.730307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:21.966531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e1248665-6a92-48e2-8491-33ae10454391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:21.981679 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e1248665-6a92-48e2-8491-33ae10454391 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1265 microversion: 2.1 time: 0.286910 Sep 08 13:43:21.982828 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3156/6179] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:21 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:23.016193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4f039865-5e75-4417-a475-cd88ee33fd81 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:23.018586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4f039865-5e75-4417-a475-cd88ee33fd81 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:23.029864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:23.034082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f039865-5e75-4417-a475-cd88ee33fd81 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:23.035525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f039865-5e75-4417-a475-cd88ee33fd81 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:23.036188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f039865-5e75-4417-a475-cd88ee33fd81 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:23.038694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f039865-5e75-4417-a475-cd88ee33fd81 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:23.039848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f039865-5e75-4417-a475-cd88ee33fd81 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:23.040636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f039865-5e75-4417-a475-cd88ee33fd81 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:23.296498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4f039865-5e75-4417-a475-cd88ee33fd81 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:23.303346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:23.314768 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4f039865-5e75-4417-a475-cd88ee33fd81 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1265 microversion: 2.1 time: 0.307086 Sep 08 13:43:23.316379 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3024/6180] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:23 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1265 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:24.341966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-83cc2d97-71e3-4905-9280-66bb3cc2c5bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:24.343128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-83cc2d97-71e3-4905-9280-66bb3cc2c5bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:24.356213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83cc2d97-71e3-4905-9280-66bb3cc2c5bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:24.358084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83cc2d97-71e3-4905-9280-66bb3cc2c5bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:24.359077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83cc2d97-71e3-4905-9280-66bb3cc2c5bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:24.360677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83cc2d97-71e3-4905-9280-66bb3cc2c5bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:24.362671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83cc2d97-71e3-4905-9280-66bb3cc2c5bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:24.363955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83cc2d97-71e3-4905-9280-66bb3cc2c5bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:24.565117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83cc2d97-71e3-4905-9280-66bb3cc2c5bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:24.576139 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-83cc2d97-71e3-4905-9280-66bb3cc2c5bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1265 microversion: 2.1 time: 0.238815 Sep 08 13:43:24.577395 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3157/6181] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:24 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:24.716233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-70128092-a2a6-4e6b-9ead-444904cdea87 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '.version_select at 0x7fdb39e9ab80>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:24.745344 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-70128092-a2a6-4e6b-9ead-444904cdea87 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1924952969" status: 202 len: 0 microversion: 2.1 time: 0.036449 Sep 08 13:43:24.746047 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3025/6182] 10.222.0.78 () {58 vars in 1284 bytes} [Thu Sep 8 13:43:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1924952969 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:43:24.787376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-878249e7-0826-4159-88f7-e1c0a73fb8a2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'create', calling method: .version_select at 0x7fdb35918af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-255168672", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLV/xUuNcVT6sFu1L9HsWx35QCm1lLHSTSIkNZc9fANztY6xKdWtQnm3RqLdtAFpJ8jQp/hPpbzU1JcW5ipAMCg0+WNalX3KPSbkkBhdCmjVsd7IZo2iOPBbpqRm+D5mxg=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:24.806836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-878249e7-0826-4159-88f7-e1c0a73fb8a2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for project cbd130c38aeb4b23b1907212bfe92619. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:43:24.814903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-878249e7-0826-4159-88f7-e1c0a73fb8a2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for user c3fb5a1860bd4f118dc19ec38c1796d1 and project cbd130c38aeb4b23b1907212bfe92619. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:43:24.845325 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-878249e7-0826-4159-88f7-e1c0a73fb8a2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.065777 Sep 08 13:43:24.845935 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3158/6183] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:43:24 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:43:25.611147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7617cc29-7d85-40fa-b19a-828eab6c425b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:25.612089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7617cc29-7d85-40fa-b19a-828eab6c425b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:25.623368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7617cc29-7d85-40fa-b19a-828eab6c425b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:25.624270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7617cc29-7d85-40fa-b19a-828eab6c425b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:25.625078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7617cc29-7d85-40fa-b19a-828eab6c425b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:25.626683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7617cc29-7d85-40fa-b19a-828eab6c425b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:25.627587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7617cc29-7d85-40fa-b19a-828eab6c425b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:25.628369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7617cc29-7d85-40fa-b19a-828eab6c425b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:25.851490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7617cc29-7d85-40fa-b19a-828eab6c425b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:25.860919 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7617cc29-7d85-40fa-b19a-828eab6c425b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1265 microversion: 2.1 time: 0.257427 Sep 08 13:43:25.861593 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3026/6184] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:25 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:26.887882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5fb9553d-b87c-4e43-a140-4f95768785ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:26.888716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5fb9553d-b87c-4e43-a140-4f95768785ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:26.899749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5fb9553d-b87c-4e43-a140-4f95768785ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:26.900520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5fb9553d-b87c-4e43-a140-4f95768785ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:26.901135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5fb9553d-b87c-4e43-a140-4f95768785ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:26.901893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5fb9553d-b87c-4e43-a140-4f95768785ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:26.902380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5fb9553d-b87c-4e43-a140-4f95768785ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:26.902861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5fb9553d-b87c-4e43-a140-4f95768785ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:27.066636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5fb9553d-b87c-4e43-a140-4f95768785ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:27.076382 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5fb9553d-b87c-4e43-a140-4f95768785ca tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1265 microversion: 2.1 time: 0.194721 Sep 08 13:43:27.077145 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3159/6185] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:26 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:28.103309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ef96cec3-4bcb-4c54-8112-305afece40d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:28.105113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ef96cec3-4bcb-4c54-8112-305afece40d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:28.114083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:28.117434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef96cec3-4bcb-4c54-8112-305afece40d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:28.118188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef96cec3-4bcb-4c54-8112-305afece40d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:28.118913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef96cec3-4bcb-4c54-8112-305afece40d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:28.120013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef96cec3-4bcb-4c54-8112-305afece40d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:28.120735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef96cec3-4bcb-4c54-8112-305afece40d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:28.121438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ef96cec3-4bcb-4c54-8112-305afece40d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:28.308570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ef96cec3-4bcb-4c54-8112-305afece40d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:28.324517 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ef96cec3-4bcb-4c54-8112-305afece40d6 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1265 microversion: 2.1 time: 0.225750 Sep 08 13:43:28.325540 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3027/6186] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:28 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1265 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:29.366089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00c4dba8-b255-4949-93ee-f94a866479d0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:29.368530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00c4dba8-b255-4949-93ee-f94a866479d0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:29.384433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00c4dba8-b255-4949-93ee-f94a866479d0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:29.385914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00c4dba8-b255-4949-93ee-f94a866479d0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:29.387267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00c4dba8-b255-4949-93ee-f94a866479d0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:29.389113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00c4dba8-b255-4949-93ee-f94a866479d0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:29.390230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00c4dba8-b255-4949-93ee-f94a866479d0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:29.391355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00c4dba8-b255-4949-93ee-f94a866479d0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:29.543826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-25a208c2-9088-47d6-a257-6374d3e95d67 req-902589ea-b344-47c9-a147-5ac6171a4d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6efae46-049b-4956-8165-4f798b565738", "name": "network-vif-plugged", "status": "completed", "tag": "4d5f101d-2d74-4980-9280-a76ad5f550cd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:29.564463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-25a208c2-9088-47d6-a257-6374d3e95d67 req-902589ea-b344-47c9-a147-5ac6171a4d49 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:29.565215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-25a208c2-9088-47d6-a257-6374d3e95d67 req-902589ea-b344-47c9-a147-5ac6171a4d49 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:29.565799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-25a208c2-9088-47d6-a257-6374d3e95d67 req-902589ea-b344-47c9-a147-5ac6171a4d49 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:29.586068 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-25a208c2-9088-47d6-a257-6374d3e95d67 req-902589ea-b344-47c9-a147-5ac6171a4d49 service nova] Creating event network-vif-plugged:4d5f101d-2d74-4980-9280-a76ad5f550cd for instance a6efae46-049b-4956-8165-4f798b565738 on n-h1-852084-10 Sep 08 13:43:29.596514 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-25a208c2-9088-47d6-a257-6374d3e95d67 req-902589ea-b344-47c9-a147-5ac6171a4d49 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058426 Sep 08 13:43:29.598155 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3028/6187] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:43:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:43:29.874744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00c4dba8-b255-4949-93ee-f94a866479d0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:29.886254 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00c4dba8-b255-4949-93ee-f94a866479d0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1265 microversion: 2.1 time: 0.528092 Sep 08 13:43:29.909915 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3160/6188] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:29 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1265 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:30.931176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0ef1bcab-09bf-4c82-9a9d-69012d268df3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:30.946328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0ef1bcab-09bf-4c82-9a9d-69012d268df3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:30.970749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ef1bcab-09bf-4c82-9a9d-69012d268df3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:30.972151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ef1bcab-09bf-4c82-9a9d-69012d268df3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:30.973890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ef1bcab-09bf-4c82-9a9d-69012d268df3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:30.978821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ef1bcab-09bf-4c82-9a9d-69012d268df3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:30.981660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ef1bcab-09bf-4c82-9a9d-69012d268df3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:30.983677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ef1bcab-09bf-4c82-9a9d-69012d268df3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:31.360038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0ef1bcab-09bf-4c82-9a9d-69012d268df3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:31.368640 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0ef1bcab-09bf-4c82-9a9d-69012d268df3 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1453 microversion: 2.1 time: 0.452077 Sep 08 13:43:31.369441 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3029/6189] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:30 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1453 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:31.396965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52d36633-4a38-4bf4-ad08-effbcc98640b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:31.403626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-52d36633-4a38-4bf4-ad08-effbcc98640b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:31.420870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52d36633-4a38-4bf4-ad08-effbcc98640b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:31.421757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52d36633-4a38-4bf4-ad08-effbcc98640b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:31.422449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52d36633-4a38-4bf4-ad08-effbcc98640b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:31.423567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52d36633-4a38-4bf4-ad08-effbcc98640b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:31.425512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52d36633-4a38-4bf4-ad08-effbcc98640b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:31.426745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52d36633-4a38-4bf4-ad08-effbcc98640b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:31.779465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-52d36633-4a38-4bf4-ad08-effbcc98640b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:31.793088 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-52d36633-4a38-4bf4-ad08-effbcc98640b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1453 microversion: 2.1 time: 0.399595 Sep 08 13:43:31.816415 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3161/6190] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:31 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1453 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:43:33.138204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-31884102", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "2c159a3c-1a35-4341-b1d9-efdbb64809cc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-255168672", "security_groups": [{"name": "tempest-secgroup-smoke-739408073"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:33.401459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] validate_networks() for [('2c159a3c-1a35-4341-b1d9-efdbb64809cc', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:43:34.644673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:43:34.645809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:43:34.646307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:43:34.646692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:43:34.647290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:43:34.657801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:34.658295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:34.658926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:34.659721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:34.660359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:34.660977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:34.703249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for project cbd130c38aeb4b23b1907212bfe92619. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:43:34.712044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Getting quotas for user c3fb5a1860bd4f118dc19ec38c1796d1 and project cbd130c38aeb4b23b1907212bfe92619. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:43:34.727964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:43:34.731083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:43:34.811309 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f5e63ebd-a59b-4cdf-8b8d-469ec95a8116 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.683753 Sep 08 13:43:34.815554 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3030/6191] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:43:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:43:34.832278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cd40a211-299c-4648-85c6-d548b0b84090 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:34.835659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cd40a211-299c-4648-85c6-d548b0b84090 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:34.840845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:34.958701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cd40a211-299c-4648-85c6-d548b0b84090 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:34.988199 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cd40a211-299c-4648-85c6-d548b0b84090 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1264 microversion: 2.1 time: 0.162193 Sep 08 13:43:34.991088 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3162/6192] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:34 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:35.153466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c84690fd-c7a4-4fec-a2e4-8f3675b994de req-eb225411-d795-4701-add3-0fe0126ea5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6efae46-049b-4956-8165-4f798b565738", "tag": "4d5f101d-2d74-4980-9280-a76ad5f550cd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:35.171942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c84690fd-c7a4-4fec-a2e4-8f3675b994de req-eb225411-d795-4701-add3-0fe0126ea5da service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:35.172662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c84690fd-c7a4-4fec-a2e4-8f3675b994de req-eb225411-d795-4701-add3-0fe0126ea5da service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:35.173190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c84690fd-c7a4-4fec-a2e4-8f3675b994de req-eb225411-d795-4701-add3-0fe0126ea5da service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:35.189053 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c84690fd-c7a4-4fec-a2e4-8f3675b994de req-eb225411-d795-4701-add3-0fe0126ea5da service nova] Creating event network-changed:4d5f101d-2d74-4980-9280-a76ad5f550cd for instance a6efae46-049b-4956-8165-4f798b565738 on n-h1-852084-10 Sep 08 13:43:35.200844 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c84690fd-c7a4-4fec-a2e4-8f3675b994de req-eb225411-d795-4701-add3-0fe0126ea5da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054129 Sep 08 13:43:35.206765 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3031/6193] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:43:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:43:36.022658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-958496cd-16f7-4dfa-b9e9-2e5d90398549 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:36.024229 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-958496cd-16f7-4dfa-b9e9-2e5d90398549 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:36.037383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-958496cd-16f7-4dfa-b9e9-2e5d90398549 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:36.038392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-958496cd-16f7-4dfa-b9e9-2e5d90398549 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:36.039193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-958496cd-16f7-4dfa-b9e9-2e5d90398549 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:36.040194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-958496cd-16f7-4dfa-b9e9-2e5d90398549 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:36.041294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-958496cd-16f7-4dfa-b9e9-2e5d90398549 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:36.042190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-958496cd-16f7-4dfa-b9e9-2e5d90398549 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:36.153469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-958496cd-16f7-4dfa-b9e9-2e5d90398549 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:36.168035 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-958496cd-16f7-4dfa-b9e9-2e5d90398549 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1316 microversion: 2.1 time: 0.149517 Sep 08 13:43:36.169850 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3163/6194] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:36 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1316 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:43:37.208715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0b12d52-12ee-4e4e-a4f9-50d3222ea004 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:37.209715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0b12d52-12ee-4e4e-a4f9-50d3222ea004 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:37.227364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b12d52-12ee-4e4e-a4f9-50d3222ea004 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:37.233285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b12d52-12ee-4e4e-a4f9-50d3222ea004 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:37.238438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b12d52-12ee-4e4e-a4f9-50d3222ea004 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:37.240376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b12d52-12ee-4e4e-a4f9-50d3222ea004 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:37.241262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b12d52-12ee-4e4e-a4f9-50d3222ea004 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:37.242066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0b12d52-12ee-4e4e-a4f9-50d3222ea004 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:37.411135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0b12d52-12ee-4e4e-a4f9-50d3222ea004 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:37.433001 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0b12d52-12ee-4e4e-a4f9-50d3222ea004 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1322 microversion: 2.1 time: 0.232455 Sep 08 13:43:37.434707 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3032/6195] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:37 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1322 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:38.474348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-46d4973c-c434-4435-8759-84a4fb46e362 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:38.475327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-46d4973c-c434-4435-8759-84a4fb46e362 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:38.488874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46d4973c-c434-4435-8759-84a4fb46e362 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:38.489492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46d4973c-c434-4435-8759-84a4fb46e362 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:38.493938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46d4973c-c434-4435-8759-84a4fb46e362 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:38.495062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46d4973c-c434-4435-8759-84a4fb46e362 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:38.496803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46d4973c-c434-4435-8759-84a4fb46e362 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:38.497330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46d4973c-c434-4435-8759-84a4fb46e362 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:38.757079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-46d4973c-c434-4435-8759-84a4fb46e362 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:38.768738 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-46d4973c-c434-4435-8759-84a4fb46e362 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1389 microversion: 2.1 time: 0.301324 Sep 08 13:43:38.769511 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3164/6196] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:38 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1389 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:38.887160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-eee1c3ac-56d2-477b-ab72-02132f0ae74c req-5894214d-a5ba-4917-813d-262f059dc988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f9f008-4198-4dd9-b1f8-23f715cad853", "tag": "5d51a179-a805-4c52-a9ea-786b9507c86b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:38.908352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-eee1c3ac-56d2-477b-ab72-02132f0ae74c req-5894214d-a5ba-4917-813d-262f059dc988 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:38.908877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-eee1c3ac-56d2-477b-ab72-02132f0ae74c req-5894214d-a5ba-4917-813d-262f059dc988 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:38.909321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-eee1c3ac-56d2-477b-ab72-02132f0ae74c req-5894214d-a5ba-4917-813d-262f059dc988 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:38.924165 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-eee1c3ac-56d2-477b-ab72-02132f0ae74c req-5894214d-a5ba-4917-813d-262f059dc988 service nova] Creating event network-changed:5d51a179-a805-4c52-a9ea-786b9507c86b for instance 23f9f008-4198-4dd9-b1f8-23f715cad853 on n-h2-852084-10 Sep 08 13:43:38.929565 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-eee1c3ac-56d2-477b-ab72-02132f0ae74c req-5894214d-a5ba-4917-813d-262f059dc988 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051263 Sep 08 13:43:38.930220 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3033/6197] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:43:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:43:39.793451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f2c5924e-2caa-4602-9e71-6794ca2f9649 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:39.794164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f2c5924e-2caa-4602-9e71-6794ca2f9649 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:39.803304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2c5924e-2caa-4602-9e71-6794ca2f9649 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:39.803823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2c5924e-2caa-4602-9e71-6794ca2f9649 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:39.804291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2c5924e-2caa-4602-9e71-6794ca2f9649 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:39.805065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2c5924e-2caa-4602-9e71-6794ca2f9649 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:39.805550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2c5924e-2caa-4602-9e71-6794ca2f9649 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:39.806018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2c5924e-2caa-4602-9e71-6794ca2f9649 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:39.982154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f2c5924e-2caa-4602-9e71-6794ca2f9649 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:39.997337 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f2c5924e-2caa-4602-9e71-6794ca2f9649 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1389 microversion: 2.1 time: 0.208114 Sep 08 13:43:39.998421 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3165/6198] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:39 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1389 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:43:41.037743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2533c889-604b-435f-91ef-750167e9128d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:41.038472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2533c889-604b-435f-91ef-750167e9128d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:41.046736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2533c889-604b-435f-91ef-750167e9128d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:41.047263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2533c889-604b-435f-91ef-750167e9128d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:41.047714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2533c889-604b-435f-91ef-750167e9128d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:41.048439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2533c889-604b-435f-91ef-750167e9128d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:41.048905 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2533c889-604b-435f-91ef-750167e9128d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:41.049337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2533c889-604b-435f-91ef-750167e9128d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:41.217250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2533c889-604b-435f-91ef-750167e9128d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:41.226450 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2533c889-604b-435f-91ef-750167e9128d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1389 microversion: 2.1 time: 0.194254 Sep 08 13:43:41.227636 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3034/6199] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:41 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1389 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:43:42.254983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e74980ab-e698-46f4-abbd-47b4e6395da8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:42.255779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e74980ab-e698-46f4-abbd-47b4e6395da8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:42.265696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e74980ab-e698-46f4-abbd-47b4e6395da8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:42.266643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e74980ab-e698-46f4-abbd-47b4e6395da8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:42.267504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e74980ab-e698-46f4-abbd-47b4e6395da8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:42.268675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e74980ab-e698-46f4-abbd-47b4e6395da8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:42.269163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e74980ab-e698-46f4-abbd-47b4e6395da8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:42.269612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e74980ab-e698-46f4-abbd-47b4e6395da8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:42.445370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e74980ab-e698-46f4-abbd-47b4e6395da8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:42.455814 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e74980ab-e698-46f4-abbd-47b4e6395da8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1389 microversion: 2.1 time: 0.205911 Sep 08 13:43:42.456434 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3166/6200] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:42 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1389 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:43.482297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f3e619bf-9745-488e-814e-f74fe75f9b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:43.483676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f3e619bf-9745-488e-814e-f74fe75f9b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:43.492896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3e619bf-9745-488e-814e-f74fe75f9b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:43.493767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3e619bf-9745-488e-814e-f74fe75f9b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:43.494383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3e619bf-9745-488e-814e-f74fe75f9b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:43.495713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3e619bf-9745-488e-814e-f74fe75f9b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:43.497599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3e619bf-9745-488e-814e-f74fe75f9b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:43.498466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f3e619bf-9745-488e-814e-f74fe75f9b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:43.539908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-19f052ca-2213-4f94-a960-5f4bad8f0ad9 req-66a75a39-a5c5-41cd-8b62-f908878726e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f9f008-4198-4dd9-b1f8-23f715cad853", "name": "network-vif-plugged", "status": "completed", "tag": "5d51a179-a805-4c52-a9ea-786b9507c86b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:43.562151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-19f052ca-2213-4f94-a960-5f4bad8f0ad9 req-66a75a39-a5c5-41cd-8b62-f908878726e2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:43.568129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-19f052ca-2213-4f94-a960-5f4bad8f0ad9 req-66a75a39-a5c5-41cd-8b62-f908878726e2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:43.568726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-19f052ca-2213-4f94-a960-5f4bad8f0ad9 req-66a75a39-a5c5-41cd-8b62-f908878726e2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:43.584012 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-19f052ca-2213-4f94-a960-5f4bad8f0ad9 req-66a75a39-a5c5-41cd-8b62-f908878726e2 service nova] Creating event network-vif-plugged:5d51a179-a805-4c52-a9ea-786b9507c86b for instance 23f9f008-4198-4dd9-b1f8-23f715cad853 on n-h2-852084-10 Sep 08 13:43:43.590046 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-19f052ca-2213-4f94-a960-5f4bad8f0ad9 req-66a75a39-a5c5-41cd-8b62-f908878726e2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054133 Sep 08 13:43:43.590795 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3167/6201] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:43:43.761100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f3e619bf-9745-488e-814e-f74fe75f9b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:43.773137 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f3e619bf-9745-488e-814e-f74fe75f9b79 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1389 microversion: 2.1 time: 0.294081 Sep 08 13:43:43.774290 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3035/6202] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:43 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1389 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:44.806291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-286ce194-6a9f-456d-97dc-95fcba0fe33c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:44.808106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-286ce194-6a9f-456d-97dc-95fcba0fe33c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:44.826518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-286ce194-6a9f-456d-97dc-95fcba0fe33c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:44.828620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-286ce194-6a9f-456d-97dc-95fcba0fe33c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:44.829574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-286ce194-6a9f-456d-97dc-95fcba0fe33c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:44.830975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-286ce194-6a9f-456d-97dc-95fcba0fe33c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:44.831935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-286ce194-6a9f-456d-97dc-95fcba0fe33c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:44.833553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-286ce194-6a9f-456d-97dc-95fcba0fe33c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:44.973049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:45.036125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-286ce194-6a9f-456d-97dc-95fcba0fe33c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:45.044721 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-286ce194-6a9f-456d-97dc-95fcba0fe33c tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1561 microversion: 2.1 time: 0.248566 Sep 08 13:43:45.045375 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3168/6203] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:44 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1561 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:45.077721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fe987eca-1fd7-4470-9331-b93e749f78a5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:45.078797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fe987eca-1fd7-4470-9331-b93e749f78a5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:45.083265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:45.083989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:43:45.090302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe987eca-1fd7-4470-9331-b93e749f78a5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:45.090791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe987eca-1fd7-4470-9331-b93e749f78a5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:45.091251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe987eca-1fd7-4470-9331-b93e749f78a5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:45.091960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe987eca-1fd7-4470-9331-b93e749f78a5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:45.092416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe987eca-1fd7-4470-9331-b93e749f78a5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:45.092837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe987eca-1fd7-4470-9331-b93e749f78a5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:45.245175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fe987eca-1fd7-4470-9331-b93e749f78a5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:45.256473 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fe987eca-1fd7-4470-9331-b93e749f78a5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1561 microversion: 2.1 time: 0.187200 Sep 08 13:43:45.257083 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3036/6204] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:45 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:43:47.569688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ac42f1f-9759-4c64-b951-9d46ed4a364d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:43:47.570445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8ac42f1f-9759-4c64-b951-9d46ed4a364d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:43:47.571060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-eec2d26f-1857-44c0-a68d-847bda243b4f req-8dd35e93-0eb8-4a88-a4e5-9a66633d3bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f9f008-4198-4dd9-b1f8-23f715cad853", "tag": "5d51a179-a805-4c52-a9ea-786b9507c86b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:43:47.583638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-eec2d26f-1857-44c0-a68d-847bda243b4f req-8dd35e93-0eb8-4a88-a4e5-9a66633d3bb8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:47.584045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-eec2d26f-1857-44c0-a68d-847bda243b4f req-8dd35e93-0eb8-4a88-a4e5-9a66633d3bb8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:47.584491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-eec2d26f-1857-44c0-a68d-847bda243b4f req-8dd35e93-0eb8-4a88-a4e5-9a66633d3bb8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:47.585512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ac42f1f-9759-4c64-b951-9d46ed4a364d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:47.586425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ac42f1f-9759-4c64-b951-9d46ed4a364d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:47.587272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ac42f1f-9759-4c64-b951-9d46ed4a364d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:47.588622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ac42f1f-9759-4c64-b951-9d46ed4a364d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:43:47.589534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ac42f1f-9759-4c64-b951-9d46ed4a364d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:43:47.590569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8ac42f1f-9759-4c64-b951-9d46ed4a364d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:43:47.604056 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-eec2d26f-1857-44c0-a68d-847bda243b4f req-8dd35e93-0eb8-4a88-a4e5-9a66633d3bb8 service nova] Creating event network-changed:5d51a179-a805-4c52-a9ea-786b9507c86b for instance 23f9f008-4198-4dd9-b1f8-23f715cad853 on n-h2-852084-10 Sep 08 13:43:47.612175 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-eec2d26f-1857-44c0-a68d-847bda243b4f req-8dd35e93-0eb8-4a88-a4e5-9a66633d3bb8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044181 Sep 08 13:43:47.612835 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3037/6205] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:43:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:43:47.899378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8ac42f1f-9759-4c64-b951-9d46ed4a364d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:43:47.918773 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8ac42f1f-9759-4c64-b951-9d46ed4a364d tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1561 microversion: 2.1 time: 0.355827 Sep 08 13:43:47.926836 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3169/6206] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:43:47 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1561 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:10.344087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:10.344977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=52 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:10.349692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4b37b47d-c757-4593-a53c-423cd7a65ab5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:44:10.352029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4b37b47d-c757-4593-a53c-423cd7a65ab5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:10.359861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b37b47d-c757-4593-a53c-423cd7a65ab5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:10.360382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b37b47d-c757-4593-a53c-423cd7a65ab5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:10.360814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b37b47d-c757-4593-a53c-423cd7a65ab5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:10.361526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b37b47d-c757-4593-a53c-423cd7a65ab5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:10.361979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b37b47d-c757-4593-a53c-423cd7a65ab5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:10.362403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b37b47d-c757-4593-a53c-423cd7a65ab5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:10.428858 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4b37b47d-c757-4593-a53c-423cd7a65ab5 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853/action" status: 200 len: 24568 microversion: 2.1 time: 0.087422 Sep 08 13:44:10.429769 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3038/6207] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:44:10 2022] POST /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853/action => generated 24568 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:44:21.497129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:44:21.500899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:21.504047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:21.504891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=67 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:21.513853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:21.514387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:21.514950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:21.515744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:21.516336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:21.516786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:21.614258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:44:21.614696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:44:21.615191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:44:21.615646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:44:21.616085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:44:21.691259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:21.701187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:21.702075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:21.702875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:21.704296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:21.705258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:21.706575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:21.750701 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e0cbd90-4048-47ff-8430-a495e56ef8a9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853/action" status: 202 len: 1135 microversion: 2.1 time: 0.258803 Sep 08 13:44:21.751881 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3170/6208] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:44:21 2022] POST /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853/action => generated 1135 bytes in 261 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Sep 08 13:44:21.774206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71e56221-f7f7-43a2-ba35-b26bbc46bc89 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:21.775082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-71e56221-f7f7-43a2-ba35-b26bbc46bc89 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:21.780290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:21.781446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:44:21.787433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71e56221-f7f7-43a2-ba35-b26bbc46bc89 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:21.787779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71e56221-f7f7-43a2-ba35-b26bbc46bc89 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:21.788194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71e56221-f7f7-43a2-ba35-b26bbc46bc89 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:21.789123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71e56221-f7f7-43a2-ba35-b26bbc46bc89 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:21.789862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71e56221-f7f7-43a2-ba35-b26bbc46bc89 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:21.790521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71e56221-f7f7-43a2-ba35-b26bbc46bc89 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:22.004198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-71e56221-f7f7-43a2-ba35-b26bbc46bc89 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:22.015666 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-71e56221-f7f7-43a2-ba35-b26bbc46bc89 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.246139 Sep 08 13:44:22.016273 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3039/6209] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:21 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:23.052449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d8e28078-ee4e-4906-ae98-95cf03e6082a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:23.053361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d8e28078-ee4e-4906-ae98-95cf03e6082a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:23.062560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8e28078-ee4e-4906-ae98-95cf03e6082a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:23.063145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8e28078-ee4e-4906-ae98-95cf03e6082a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:23.063815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8e28078-ee4e-4906-ae98-95cf03e6082a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:23.064670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8e28078-ee4e-4906-ae98-95cf03e6082a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:23.065152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8e28078-ee4e-4906-ae98-95cf03e6082a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:23.065593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8e28078-ee4e-4906-ae98-95cf03e6082a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:23.231130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d8e28078-ee4e-4906-ae98-95cf03e6082a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:23.239989 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d8e28078-ee4e-4906-ae98-95cf03e6082a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.192548 Sep 08 13:44:23.240590 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3171/6210] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:23 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:24.266606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-543cc16c-4d3f-4958-9ef7-a2871706491b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:24.267292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-543cc16c-4d3f-4958-9ef7-a2871706491b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:24.275844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-543cc16c-4d3f-4958-9ef7-a2871706491b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:24.276562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-543cc16c-4d3f-4958-9ef7-a2871706491b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:24.277006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-543cc16c-4d3f-4958-9ef7-a2871706491b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:24.277888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-543cc16c-4d3f-4958-9ef7-a2871706491b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:24.278399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-543cc16c-4d3f-4958-9ef7-a2871706491b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:24.278844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-543cc16c-4d3f-4958-9ef7-a2871706491b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:24.446340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-543cc16c-4d3f-4958-9ef7-a2871706491b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:24.461844 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-543cc16c-4d3f-4958-9ef7-a2871706491b tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.198929 Sep 08 13:44:24.463024 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3040/6211] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:24 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:25.501266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-932b5312-e4d5-4755-bd7f-20ad688accb9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:25.501851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-932b5312-e4d5-4755-bd7f-20ad688accb9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:25.509385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-932b5312-e4d5-4755-bd7f-20ad688accb9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:25.509894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-932b5312-e4d5-4755-bd7f-20ad688accb9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:25.510354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-932b5312-e4d5-4755-bd7f-20ad688accb9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:25.511093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-932b5312-e4d5-4755-bd7f-20ad688accb9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:25.511613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-932b5312-e4d5-4755-bd7f-20ad688accb9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:25.512058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-932b5312-e4d5-4755-bd7f-20ad688accb9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:25.683073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-932b5312-e4d5-4755-bd7f-20ad688accb9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:25.693048 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-932b5312-e4d5-4755-bd7f-20ad688accb9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.196410 Sep 08 13:44:25.693675 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3172/6212] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:25 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:44:26.723731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-381d3af1-2832-4579-83e7-414ed1e05be1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:26.724506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-381d3af1-2832-4579-83e7-414ed1e05be1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:26.731822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-381d3af1-2832-4579-83e7-414ed1e05be1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:26.732319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-381d3af1-2832-4579-83e7-414ed1e05be1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:26.732757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-381d3af1-2832-4579-83e7-414ed1e05be1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:26.733470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-381d3af1-2832-4579-83e7-414ed1e05be1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:26.733927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-381d3af1-2832-4579-83e7-414ed1e05be1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:26.734350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-381d3af1-2832-4579-83e7-414ed1e05be1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:26.918186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-381d3af1-2832-4579-83e7-414ed1e05be1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:26.926986 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-381d3af1-2832-4579-83e7-414ed1e05be1 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.211778 Sep 08 13:44:26.927645 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3041/6213] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:26 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:27.967036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f2511b96-0849-4e8d-b21b-7bba8be81cd9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:27.967991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f2511b96-0849-4e8d-b21b-7bba8be81cd9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:27.976145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2511b96-0849-4e8d-b21b-7bba8be81cd9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:27.976668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2511b96-0849-4e8d-b21b-7bba8be81cd9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:27.977240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2511b96-0849-4e8d-b21b-7bba8be81cd9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:27.978099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2511b96-0849-4e8d-b21b-7bba8be81cd9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:27.978534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2511b96-0849-4e8d-b21b-7bba8be81cd9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:27.978986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2511b96-0849-4e8d-b21b-7bba8be81cd9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:28.160665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f2511b96-0849-4e8d-b21b-7bba8be81cd9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:28.169973 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f2511b96-0849-4e8d-b21b-7bba8be81cd9 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.207933 Sep 08 13:44:28.170590 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3173/6214] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:27 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:44:29.194942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-21f4048d-aed7-439d-b6c7-ad971a427596 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:29.195568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-21f4048d-aed7-439d-b6c7-ad971a427596 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:29.207160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21f4048d-aed7-439d-b6c7-ad971a427596 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:29.208190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21f4048d-aed7-439d-b6c7-ad971a427596 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:29.209215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21f4048d-aed7-439d-b6c7-ad971a427596 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:29.210814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21f4048d-aed7-439d-b6c7-ad971a427596 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:29.211831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21f4048d-aed7-439d-b6c7-ad971a427596 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:29.212598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21f4048d-aed7-439d-b6c7-ad971a427596 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:29.403896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-21f4048d-aed7-439d-b6c7-ad971a427596 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:29.413335 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-21f4048d-aed7-439d-b6c7-ad971a427596 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.222733 Sep 08 13:44:29.413956 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3042/6215] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:29 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:30.437856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f48d3c9f-9bc6-4f4e-99fc-6d7f55c80678 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:30.438626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f48d3c9f-9bc6-4f4e-99fc-6d7f55c80678 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:30.449865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f48d3c9f-9bc6-4f4e-99fc-6d7f55c80678 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:30.451614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f48d3c9f-9bc6-4f4e-99fc-6d7f55c80678 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:30.452142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f48d3c9f-9bc6-4f4e-99fc-6d7f55c80678 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:30.452936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f48d3c9f-9bc6-4f4e-99fc-6d7f55c80678 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:30.453425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f48d3c9f-9bc6-4f4e-99fc-6d7f55c80678 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:30.453899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f48d3c9f-9bc6-4f4e-99fc-6d7f55c80678 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:30.621781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f48d3c9f-9bc6-4f4e-99fc-6d7f55c80678 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:30.634527 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f48d3c9f-9bc6-4f4e-99fc-6d7f55c80678 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.200676 Sep 08 13:44:30.635714 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3174/6216] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:30 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:31.661235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-be815614-d7b1-40f8-9a73-046619d93356 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:31.662430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-be815614-d7b1-40f8-9a73-046619d93356 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:31.674729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be815614-d7b1-40f8-9a73-046619d93356 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:31.675670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be815614-d7b1-40f8-9a73-046619d93356 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:31.676485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be815614-d7b1-40f8-9a73-046619d93356 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:31.677767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be815614-d7b1-40f8-9a73-046619d93356 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:31.678634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be815614-d7b1-40f8-9a73-046619d93356 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:31.679485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be815614-d7b1-40f8-9a73-046619d93356 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:31.853577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-be815614-d7b1-40f8-9a73-046619d93356 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:31.862118 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-be815614-d7b1-40f8-9a73-046619d93356 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.206469 Sep 08 13:44:31.862731 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3043/6217] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:31 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:44:32.885747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b26ab251-9ad2-4ec6-9bff-b554fca2fabd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:32.889222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b26ab251-9ad2-4ec6-9bff-b554fca2fabd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:32.896922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b26ab251-9ad2-4ec6-9bff-b554fca2fabd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:32.897426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b26ab251-9ad2-4ec6-9bff-b554fca2fabd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:32.897887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b26ab251-9ad2-4ec6-9bff-b554fca2fabd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:32.898606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b26ab251-9ad2-4ec6-9bff-b554fca2fabd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:32.899092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b26ab251-9ad2-4ec6-9bff-b554fca2fabd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:32.899576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b26ab251-9ad2-4ec6-9bff-b554fca2fabd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:33.048687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b26ab251-9ad2-4ec6-9bff-b554fca2fabd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:33.057373 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b26ab251-9ad2-4ec6-9bff-b554fca2fabd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.175376 Sep 08 13:44:33.057995 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3175/6218] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:32 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:34.083106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-99c52a65-566b-4651-b447-0c62e5dcdacf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:34.083921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-99c52a65-566b-4651-b447-0c62e5dcdacf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:34.091241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99c52a65-566b-4651-b447-0c62e5dcdacf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:34.091747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99c52a65-566b-4651-b447-0c62e5dcdacf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:34.092190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99c52a65-566b-4651-b447-0c62e5dcdacf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:34.092915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99c52a65-566b-4651-b447-0c62e5dcdacf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:34.093372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99c52a65-566b-4651-b447-0c62e5dcdacf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:34.093802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-99c52a65-566b-4651-b447-0c62e5dcdacf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:34.257182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-99c52a65-566b-4651-b447-0c62e5dcdacf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:34.266027 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-99c52a65-566b-4651-b447-0c62e5dcdacf tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.187509 Sep 08 13:44:34.266648 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3044/6219] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:34 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:35.292646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8cb163c6-3f13-4855-8ec4-1843487e9b45 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:35.293385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8cb163c6-3f13-4855-8ec4-1843487e9b45 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:35.301994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cb163c6-3f13-4855-8ec4-1843487e9b45 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:35.302786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cb163c6-3f13-4855-8ec4-1843487e9b45 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:35.303278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cb163c6-3f13-4855-8ec4-1843487e9b45 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:35.304066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cb163c6-3f13-4855-8ec4-1843487e9b45 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:35.304688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cb163c6-3f13-4855-8ec4-1843487e9b45 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:35.305147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8cb163c6-3f13-4855-8ec4-1843487e9b45 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:35.498809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8cb163c6-3f13-4855-8ec4-1843487e9b45 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:35.508531 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8cb163c6-3f13-4855-8ec4-1843487e9b45 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.220014 Sep 08 13:44:35.509525 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3176/6220] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:35 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:36.533728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36b6503b-1c3b-4e3e-91e6-99fdc59290ca tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:36.534576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-36b6503b-1c3b-4e3e-91e6-99fdc59290ca tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:36.542531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b6503b-1c3b-4e3e-91e6-99fdc59290ca tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:36.543099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b6503b-1c3b-4e3e-91e6-99fdc59290ca tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:36.543620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b6503b-1c3b-4e3e-91e6-99fdc59290ca tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:36.544853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b6503b-1c3b-4e3e-91e6-99fdc59290ca tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:36.545356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b6503b-1c3b-4e3e-91e6-99fdc59290ca tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:36.545830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b6503b-1c3b-4e3e-91e6-99fdc59290ca tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:36.706392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-36b6503b-1c3b-4e3e-91e6-99fdc59290ca tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:36.715533 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36b6503b-1c3b-4e3e-91e6-99fdc59290ca tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.185718 Sep 08 13:44:36.716654 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3045/6221] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:36 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:37.743503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ae377f16-0ffb-45ee-ba20-c7e9a916c9a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:37.744338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ae377f16-0ffb-45ee-ba20-c7e9a916c9a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:37.752146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae377f16-0ffb-45ee-ba20-c7e9a916c9a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:37.752568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae377f16-0ffb-45ee-ba20-c7e9a916c9a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:37.753062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae377f16-0ffb-45ee-ba20-c7e9a916c9a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:37.753742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae377f16-0ffb-45ee-ba20-c7e9a916c9a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:37.754208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae377f16-0ffb-45ee-ba20-c7e9a916c9a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:37.754643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ae377f16-0ffb-45ee-ba20-c7e9a916c9a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:37.908587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ae377f16-0ffb-45ee-ba20-c7e9a916c9a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:37.917461 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ae377f16-0ffb-45ee-ba20-c7e9a916c9a4 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1688 microversion: 2.1 time: 0.180293 Sep 08 13:44:37.918064 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3177/6222] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:37 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:38.941712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2aee2ceb-ae23-47f1-bc9f-728fc38b945e tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:38.942345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2aee2ceb-ae23-47f1-bc9f-728fc38b945e tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:38.950806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2aee2ceb-ae23-47f1-bc9f-728fc38b945e tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:38.951397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2aee2ceb-ae23-47f1-bc9f-728fc38b945e tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:38.951845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2aee2ceb-ae23-47f1-bc9f-728fc38b945e tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:38.952571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2aee2ceb-ae23-47f1-bc9f-728fc38b945e tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:38.953034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2aee2ceb-ae23-47f1-bc9f-728fc38b945e tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:38.953468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2aee2ceb-ae23-47f1-bc9f-728fc38b945e tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:39.110518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2aee2ceb-ae23-47f1-bc9f-728fc38b945e tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:39.121146 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2aee2ceb-ae23-47f1-bc9f-728fc38b945e tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1694 microversion: 2.1 time: 0.183614 Sep 08 13:44:39.122139 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3046/6223] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:38 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1694 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:40.159782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-27da83ad-2527-4935-be5b-5c8a896f61fd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:40.160932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-27da83ad-2527-4935-be5b-5c8a896f61fd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:40.173727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-27da83ad-2527-4935-be5b-5c8a896f61fd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:40.174666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-27da83ad-2527-4935-be5b-5c8a896f61fd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:40.175545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-27da83ad-2527-4935-be5b-5c8a896f61fd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:40.176932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-27da83ad-2527-4935-be5b-5c8a896f61fd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:40.177830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-27da83ad-2527-4935-be5b-5c8a896f61fd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:40.179377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-27da83ad-2527-4935-be5b-5c8a896f61fd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:40.386608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-27da83ad-2527-4935-be5b-5c8a896f61fd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:40.395996 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-27da83ad-2527-4935-be5b-5c8a896f61fd tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1694 microversion: 2.1 time: 0.243206 Sep 08 13:44:40.396598 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3178/6224] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:40 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1694 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:41.421396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c49dc4dd-89c1-43b3-9184-acb66520d287 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:44:41.421995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c49dc4dd-89c1-43b3-9184-acb66520d287 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:44:41.434544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c49dc4dd-89c1-43b3-9184-acb66520d287 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:41.435053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c49dc4dd-89c1-43b3-9184-acb66520d287 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:41.435555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c49dc4dd-89c1-43b3-9184-acb66520d287 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:41.436283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c49dc4dd-89c1-43b3-9184-acb66520d287 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:41.436741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c49dc4dd-89c1-43b3-9184-acb66520d287 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:41.437166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c49dc4dd-89c1-43b3-9184-acb66520d287 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:41.587380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c49dc4dd-89c1-43b3-9184-acb66520d287 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:44:41.596367 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c49dc4dd-89c1-43b3-9184-acb66520d287 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1679 microversion: 2.1 time: 0.179322 Sep 08 13:44:41.596970 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3047/6225] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:44:41 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:44:41.789479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c8c2130c-8d53-418c-9ea9-f03823e79581 req-8e81e90d-1048-46af-8d17-b2e72c21f86c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f9f008-4198-4dd9-b1f8-23f715cad853", "name": "network-vif-plugged", "status": "completed", "tag": "5d51a179-a805-4c52-a9ea-786b9507c86b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:44:41.812899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c8c2130c-8d53-418c-9ea9-f03823e79581 req-8e81e90d-1048-46af-8d17-b2e72c21f86c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:41.814455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c8c2130c-8d53-418c-9ea9-f03823e79581 req-8e81e90d-1048-46af-8d17-b2e72c21f86c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:41.814663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c8c2130c-8d53-418c-9ea9-f03823e79581 req-8e81e90d-1048-46af-8d17-b2e72c21f86c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:41.838007 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c8c2130c-8d53-418c-9ea9-f03823e79581 req-8e81e90d-1048-46af-8d17-b2e72c21f86c service nova] Creating event network-vif-plugged:5d51a179-a805-4c52-a9ea-786b9507c86b for instance 23f9f008-4198-4dd9-b1f8-23f715cad853 on n-h2-852084-10 Sep 08 13:44:41.844793 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c8c2130c-8d53-418c-9ea9-f03823e79581 req-8e81e90d-1048-46af-8d17-b2e72c21f86c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062524 Sep 08 13:44:41.845427 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3179/6226] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:44:43.871772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7f63753a-ece8-4963-baaa-1bd7b0474423 req-effd59ab-500e-4794-b3d3-45639b3a5030 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f9f008-4198-4dd9-b1f8-23f715cad853", "name": "network-vif-unplugged", "status": "completed", "tag": "5d51a179-a805-4c52-a9ea-786b9507c86b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:44:43.887813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7f63753a-ece8-4963-baaa-1bd7b0474423 req-effd59ab-500e-4794-b3d3-45639b3a5030 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:44:43.888307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7f63753a-ece8-4963-baaa-1bd7b0474423 req-effd59ab-500e-4794-b3d3-45639b3a5030 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:44:43.888745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7f63753a-ece8-4963-baaa-1bd7b0474423 req-effd59ab-500e-4794-b3d3-45639b3a5030 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:44:43.902324 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7f63753a-ece8-4963-baaa-1bd7b0474423 req-effd59ab-500e-4794-b3d3-45639b3a5030 service nova] Creating event network-vif-unplugged:5d51a179-a805-4c52-a9ea-786b9507c86b for instance 23f9f008-4198-4dd9-b1f8-23f715cad853 on n-h2-852084-10 Sep 08 13:44:43.908103 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7f63753a-ece8-4963-baaa-1bd7b0474423 req-effd59ab-500e-4794-b3d3-45639b3a5030 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041313 Sep 08 13:44:43.909003 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3048/6227] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:05.876492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=24 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:05.877271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:05.881777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc583f3a-c3ba-4868-bb81-eaedb2052f91 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:05.884195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cc583f3a-c3ba-4868-bb81-eaedb2052f91 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:05.892121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc583f3a-c3ba-4868-bb81-eaedb2052f91 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:05.892620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc583f3a-c3ba-4868-bb81-eaedb2052f91 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:05.893074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc583f3a-c3ba-4868-bb81-eaedb2052f91 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:05.893801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc583f3a-c3ba-4868-bb81-eaedb2052f91 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:05.894270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc583f3a-c3ba-4868-bb81-eaedb2052f91 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:05.894712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc583f3a-c3ba-4868-bb81-eaedb2052f91 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:05.951749 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc583f3a-c3ba-4868-bb81-eaedb2052f91 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "POST /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853/action" status: 200 len: 24568 microversion: 2.1 time: 0.076894 Sep 08 13:45:05.952485 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3180/6228] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:45:05 2022] POST /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853/action => generated 24568 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 13:45:15.678923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=20 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:15.680629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=56 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:15.682551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c1e054bc-70b1-4747-a285-2955fda76bf0 req-fc3c28ee-79c9-47be-a5fa-d12c2e341216 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6efae46-049b-4956-8165-4f798b565738", "tag": "4d5f101d-2d74-4980-9280-a76ad5f550cd"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:15.692542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ab4e9a44-f51d-4f56-a063-8c4492ef69b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:15.693987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ab4e9a44-f51d-4f56-a063-8c4492ef69b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:15.694602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c1e054bc-70b1-4747-a285-2955fda76bf0 req-fc3c28ee-79c9-47be-a5fa-d12c2e341216 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:15.695101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c1e054bc-70b1-4747-a285-2955fda76bf0 req-fc3c28ee-79c9-47be-a5fa-d12c2e341216 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:15.695586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c1e054bc-70b1-4747-a285-2955fda76bf0 req-fc3c28ee-79c9-47be-a5fa-d12c2e341216 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:15.708923 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c1e054bc-70b1-4747-a285-2955fda76bf0 req-fc3c28ee-79c9-47be-a5fa-d12c2e341216 service nova] Creating event network-changed:4d5f101d-2d74-4980-9280-a76ad5f550cd for instance a6efae46-049b-4956-8165-4f798b565738 on n-h1-852084-10 Sep 08 13:45:15.710751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab4e9a44-f51d-4f56-a063-8c4492ef69b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:15.712007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab4e9a44-f51d-4f56-a063-8c4492ef69b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:15.713055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab4e9a44-f51d-4f56-a063-8c4492ef69b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:15.714707 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c1e054bc-70b1-4747-a285-2955fda76bf0 req-fc3c28ee-79c9-47be-a5fa-d12c2e341216 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037416 Sep 08 13:45:15.717047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab4e9a44-f51d-4f56-a063-8c4492ef69b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:15.720132 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3181/6229] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:45:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:45:15.720852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab4e9a44-f51d-4f56-a063-8c4492ef69b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:15.721788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ab4e9a44-f51d-4f56-a063-8c4492ef69b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:15.757270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ab4e9a44-f51d-4f56-a063-8c4492ef69b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:45:15.854096 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ab4e9a44-f51d-4f56-a063-8c4492ef69b2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 204 len: 0 microversion: 2.1 time: 0.176650 Sep 08 13:45:15.854096 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3049/6230] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:45:15 2022] DELETE /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:15.864423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc20179a-b55b-4bec-b4ef-6019b7eb0082 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:15.865445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc20179a-b55b-4bec-b4ef-6019b7eb0082 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:15.873270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc20179a-b55b-4bec-b4ef-6019b7eb0082 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:15.873270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc20179a-b55b-4bec-b4ef-6019b7eb0082 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:15.873769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc20179a-b55b-4bec-b4ef-6019b7eb0082 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:15.874756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc20179a-b55b-4bec-b4ef-6019b7eb0082 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:15.875265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc20179a-b55b-4bec-b4ef-6019b7eb0082 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:15.875962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc20179a-b55b-4bec-b4ef-6019b7eb0082 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:16.025184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc20179a-b55b-4bec-b4ef-6019b7eb0082 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:16.034082 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc20179a-b55b-4bec-b4ef-6019b7eb0082 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1578 microversion: 2.1 time: 0.174022 Sep 08 13:45:16.034684 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3182/6231] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:15 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1578 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:17.058922 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-60de4307-50fe-4e99-ab9c-bd318c4b897b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:17.060432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-60de4307-50fe-4e99-ab9c-bd318c4b897b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:17.068036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-60de4307-50fe-4e99-ab9c-bd318c4b897b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:17.068527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-60de4307-50fe-4e99-ab9c-bd318c4b897b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:17.068961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-60de4307-50fe-4e99-ab9c-bd318c4b897b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:17.069679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-60de4307-50fe-4e99-ab9c-bd318c4b897b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:17.070131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-60de4307-50fe-4e99-ab9c-bd318c4b897b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:17.070599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-60de4307-50fe-4e99-ab9c-bd318c4b897b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:17.354260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-60de4307-50fe-4e99-ab9c-bd318c4b897b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:17.369813 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-60de4307-50fe-4e99-ab9c-bd318c4b897b tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1578 microversion: 2.1 time: 0.314850 Sep 08 13:45:17.371330 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3050/6232] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:17 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1578 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:18.257529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-12731947-1872-4211-9e98-66074a06d18a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:18.259824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-12731947-1872-4211-9e98-66074a06d18a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:18.264677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-94650324-5b4f-48ed-a6b3-f2911bd5de88 req-0f178b15-2c9f-43f6-b948-c99447d61729 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23f9f008-4198-4dd9-b1f8-23f715cad853", "tag": "5d51a179-a805-4c52-a9ea-786b9507c86b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:18.271089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12731947-1872-4211-9e98-66074a06d18a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:18.271903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12731947-1872-4211-9e98-66074a06d18a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:18.272549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12731947-1872-4211-9e98-66074a06d18a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:18.273304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12731947-1872-4211-9e98-66074a06d18a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:18.273777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12731947-1872-4211-9e98-66074a06d18a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:18.274220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12731947-1872-4211-9e98-66074a06d18a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:18.279318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-94650324-5b4f-48ed-a6b3-f2911bd5de88 req-0f178b15-2c9f-43f6-b948-c99447d61729 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:18.280075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-94650324-5b4f-48ed-a6b3-f2911bd5de88 req-0f178b15-2c9f-43f6-b948-c99447d61729 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:18.280692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-94650324-5b4f-48ed-a6b3-f2911bd5de88 req-0f178b15-2c9f-43f6-b948-c99447d61729 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:18.295283 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-94650324-5b4f-48ed-a6b3-f2911bd5de88 req-0f178b15-2c9f-43f6-b948-c99447d61729 service nova] Creating event network-changed:5d51a179-a805-4c52-a9ea-786b9507c86b for instance 23f9f008-4198-4dd9-b1f8-23f715cad853 on n-h2-852084-10 Sep 08 13:45:18.301635 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-94650324-5b4f-48ed-a6b3-f2911bd5de88 req-0f178b15-2c9f-43f6-b948-c99447d61729 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041539 Sep 08 13:45:18.302760 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3051/6233] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:45:18.317078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-12731947-1872-4211-9e98-66074a06d18a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:45:18.321565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-881217cf-5bac-48d3-a2ee-200ce6b7c74d req-de34bde1-7980-4c7d-869b-6a1aefe7e8bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6efae46-049b-4956-8165-4f798b565738", "name": "network-vif-deleted", "tag": "4d5f101d-2d74-4980-9280-a76ad5f550cd"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:18.333458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-881217cf-5bac-48d3-a2ee-200ce6b7c74d req-de34bde1-7980-4c7d-869b-6a1aefe7e8bc service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:18.335397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-881217cf-5bac-48d3-a2ee-200ce6b7c74d req-de34bde1-7980-4c7d-869b-6a1aefe7e8bc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:18.335861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-881217cf-5bac-48d3-a2ee-200ce6b7c74d req-de34bde1-7980-4c7d-869b-6a1aefe7e8bc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:18.349870 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-881217cf-5bac-48d3-a2ee-200ce6b7c74d req-de34bde1-7980-4c7d-869b-6a1aefe7e8bc service nova] Creating event network-vif-deleted:4d5f101d-2d74-4980-9280-a76ad5f550cd for instance a6efae46-049b-4956-8165-4f798b565738 on n-h1-852084-10 Sep 08 13:45:18.356269 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-881217cf-5bac-48d3-a2ee-200ce6b7c74d req-de34bde1-7980-4c7d-869b-6a1aefe7e8bc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050057 Sep 08 13:45:18.372990 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3052/6234] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:18.407078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-77f75d9d-0e3a-4452-a610-052a0d0f7983 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:18.408399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-77f75d9d-0e3a-4452-a610-052a0d0f7983 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:18.419750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77f75d9d-0e3a-4452-a610-052a0d0f7983 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:18.425729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77f75d9d-0e3a-4452-a610-052a0d0f7983 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:18.429484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77f75d9d-0e3a-4452-a610-052a0d0f7983 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:18.431276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77f75d9d-0e3a-4452-a610-052a0d0f7983 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:18.432813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77f75d9d-0e3a-4452-a610-052a0d0f7983 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:18.435747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-77f75d9d-0e3a-4452-a610-052a0d0f7983 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:18.444741 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-12731947-1872-4211-9e98-66074a06d18a tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "DELETE /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 204 len: 0 microversion: 2.1 time: 0.191277 Sep 08 13:45:18.449231 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3183/6235] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:45:18 2022] DELETE /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:18.459675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a058cfd1-73ba-488c-8c6e-86f6e294fda8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:18.460981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a058cfd1-73ba-488c-8c6e-86f6e294fda8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:18.469713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a058cfd1-73ba-488c-8c6e-86f6e294fda8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:18.470717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a058cfd1-73ba-488c-8c6e-86f6e294fda8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:18.471491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a058cfd1-73ba-488c-8c6e-86f6e294fda8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:18.472980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a058cfd1-73ba-488c-8c6e-86f6e294fda8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:18.473618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a058cfd1-73ba-488c-8c6e-86f6e294fda8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:18.474224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a058cfd1-73ba-488c-8c6e-86f6e294fda8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:18.685271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-77f75d9d-0e3a-4452-a610-052a0d0f7983 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:18.697401 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-77f75d9d-0e3a-4452-a610-052a0d0f7983 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1225 microversion: 2.1 time: 0.298631 Sep 08 13:45:18.698011 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3053/6236] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:18 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1225 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:18.742799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a058cfd1-73ba-488c-8c6e-86f6e294fda8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:18.755581 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a058cfd1-73ba-488c-8c6e-86f6e294fda8 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1685 microversion: 2.1 time: 0.301155 Sep 08 13:45:18.771255 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3184/6237] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:18 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1685 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:45:19.726541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0bcbca30-19cb-4d89-a259-0625b2209c58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:19.727652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0bcbca30-19cb-4d89-a259-0625b2209c58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:19.736804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0bcbca30-19cb-4d89-a259-0625b2209c58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:19.737468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0bcbca30-19cb-4d89-a259-0625b2209c58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:19.737999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0bcbca30-19cb-4d89-a259-0625b2209c58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:19.738801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0bcbca30-19cb-4d89-a259-0625b2209c58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:19.739386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0bcbca30-19cb-4d89-a259-0625b2209c58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:19.739910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0bcbca30-19cb-4d89-a259-0625b2209c58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:19.780882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2deeb387-6a3a-4bf7-8bf0-562fc1cd9200 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:19.781783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2deeb387-6a3a-4bf7-8bf0-562fc1cd9200 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:19.789395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2deeb387-6a3a-4bf7-8bf0-562fc1cd9200 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:19.790050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2deeb387-6a3a-4bf7-8bf0-562fc1cd9200 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:19.790609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2deeb387-6a3a-4bf7-8bf0-562fc1cd9200 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:19.791455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2deeb387-6a3a-4bf7-8bf0-562fc1cd9200 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:19.792184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2deeb387-6a3a-4bf7-8bf0-562fc1cd9200 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:19.792781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2deeb387-6a3a-4bf7-8bf0-562fc1cd9200 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:19.832716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0bcbca30-19cb-4d89-a259-0625b2209c58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:19.844671 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0bcbca30-19cb-4d89-a259-0625b2209c58 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1225 microversion: 2.1 time: 0.126348 Sep 08 13:45:19.845713 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3054/6238] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:19 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1225 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:20.139926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2deeb387-6a3a-4bf7-8bf0-562fc1cd9200 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:20.148112 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2deeb387-6a3a-4bf7-8bf0-562fc1cd9200 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1685 microversion: 2.1 time: 0.371528 Sep 08 13:45:20.159347 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3185/6239] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:19 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1685 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:20.515017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-59313161-ce54-45d0-ac1d-d7e7dfbd092e req-643c83aa-97b2-4333-9467-8adec126c602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23f9f008-4198-4dd9-b1f8-23f715cad853", "name": "network-vif-deleted", "tag": "5d51a179-a805-4c52-a9ea-786b9507c86b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:20.524960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-59313161-ce54-45d0-ac1d-d7e7dfbd092e req-643c83aa-97b2-4333-9467-8adec126c602 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:20.525548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-59313161-ce54-45d0-ac1d-d7e7dfbd092e req-643c83aa-97b2-4333-9467-8adec126c602 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:20.525977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-59313161-ce54-45d0-ac1d-d7e7dfbd092e req-643c83aa-97b2-4333-9467-8adec126c602 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:20.538164 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-59313161-ce54-45d0-ac1d-d7e7dfbd092e req-643c83aa-97b2-4333-9467-8adec126c602 service nova] Creating event network-vif-deleted:5d51a179-a805-4c52-a9ea-786b9507c86b for instance 23f9f008-4198-4dd9-b1f8-23f715cad853 on n-h2-852084-10 Sep 08 13:45:20.544547 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-59313161-ce54-45d0-ac1d-d7e7dfbd092e req-643c83aa-97b2-4333-9467-8adec126c602 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032501 Sep 08 13:45:20.545307 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3055/6240] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:45:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:45:20.868208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-40abdc6e-2004-4eca-8efc-bad0aec355e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:20.868859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-40abdc6e-2004-4eca-8efc-bad0aec355e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:20.883362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40abdc6e-2004-4eca-8efc-bad0aec355e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:20.884080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40abdc6e-2004-4eca-8efc-bad0aec355e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:20.884700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40abdc6e-2004-4eca-8efc-bad0aec355e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:20.885772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40abdc6e-2004-4eca-8efc-bad0aec355e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:20.886254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40abdc6e-2004-4eca-8efc-bad0aec355e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:20.886840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40abdc6e-2004-4eca-8efc-bad0aec355e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:20.963082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40abdc6e-2004-4eca-8efc-bad0aec355e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:20.980266 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-40abdc6e-2004-4eca-8efc-bad0aec355e0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1225 microversion: 2.1 time: 0.115977 Sep 08 13:45:20.982853 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3186/6241] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:20 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1225 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:21.178942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:21.179968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:21.188206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:21.189494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:21.190982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:21.192000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:21.192713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:21.193668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:21.239592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:21.240118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:21.240812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:21.241279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lazy-loading 'fault' on Instance uuid 23f9f008-4198-4dd9-b1f8-23f715cad853 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:45:21.292971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3fb5a1860bd4f118dc19ec38c1796d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbd130c38aeb4b23b1907212bfe92619', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:21.301551 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b15f1acd-1299-48b3-826b-9557f2aad2c2 tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 200 len: 1354 microversion: 2.1 time: 0.128669 Sep 08 13:45:21.302155 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3056/6242] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:21 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 1354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:22.006243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-62524a63-1a48-46a4-ac42-d894098c1077 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:22.007375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-62524a63-1a48-46a4-ac42-d894098c1077 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:22.019108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62524a63-1a48-46a4-ac42-d894098c1077 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:22.020024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62524a63-1a48-46a4-ac42-d894098c1077 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:22.020797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62524a63-1a48-46a4-ac42-d894098c1077 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:22.022072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62524a63-1a48-46a4-ac42-d894098c1077 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:22.022927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62524a63-1a48-46a4-ac42-d894098c1077 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:22.023742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62524a63-1a48-46a4-ac42-d894098c1077 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:22.119878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-62524a63-1a48-46a4-ac42-d894098c1077 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:22.130489 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-62524a63-1a48-46a4-ac42-d894098c1077 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1225 microversion: 2.1 time: 0.128932 Sep 08 13:45:22.131103 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3187/6243] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:22 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1225 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:45:22.327029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-264d4bb7-6d91-4bff-b514-ca5822bde9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:22.327615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-264d4bb7-6d91-4bff-b514-ca5822bde9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] [instance: 23f9f008-4198-4dd9-b1f8-23f715cad853] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:22.335100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-264d4bb7-6d91-4bff-b514-ca5822bde9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:22.335637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-264d4bb7-6d91-4bff-b514-ca5822bde9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:22.336080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-264d4bb7-6d91-4bff-b514-ca5822bde9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:22.336802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-264d4bb7-6d91-4bff-b514-ca5822bde9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:22.337266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-264d4bb7-6d91-4bff-b514-ca5822bde9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:22.337809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-264d4bb7-6d91-4bff-b514-ca5822bde9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:22.354740 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-264d4bb7-6d91-4bff-b514-ca5822bde9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] HTTP exception thrown: Instance 23f9f008-4198-4dd9-b1f8-23f715cad853 could not be found. Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-264d4bb7-6d91-4bff-b514-ca5822bde9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Request method failure captured: Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 HTTP/1.1 Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfAnDjCiija-3DB5W4J6ri-fu6OcpUbo-W8mx5zngP02-J7_POIIpc3-zpJO-dfrroJuHCv8EsActPv5vuSWguNHoH76B17-De96TjlaxEdNnya3aBd8z3oBNyuhh5JRVQPwN6yVLxLYfY3oQXXo567eBhy9Fhj_K2TtE8cZ_abBrJY Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: cbd130c38aeb4b23b1907212bfe92619 Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-2131984032 Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/cbd130c38aeb4b23b1907212bfe92619"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestNetworkAdvancedServerOps-2131984032 Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: cbd130c38aeb4b23b1907212bfe92619 Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-2131984032 Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestNetworkAdvancedServerOps-2131984032-project Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: c3fb5a1860bd4f118dc19ec38c1796d1 Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestNetworkAdvancedServerOps-2131984032-project Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 23f9f008-4198-4dd9-b1f8-23f715cad853 could not be found. Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '23f9f008-4198-4dd9-b1f8-23f715cad853'} Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23f9f008-4198-4dd9-b1f8-23f715cad853 could not be found. Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23f9f008-4198-4dd9-b1f8-23f715cad853 could not be found. Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:22.356509 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:45:22.361852 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:22.361852 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:22.361852 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:45:22.361852 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:45:22.361852 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:45:22.361852 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:45:22.361852 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23f9f008-4198-4dd9-b1f8-23f715cad853 could not be found. Sep 08 13:45:22.361852 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:22.361852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-264d4bb7-6d91-4bff-b514-ca5822bde9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Returning 404 to user: Instance 23f9f008-4198-4dd9-b1f8-23f715cad853 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:45:22.361852 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-264d4bb7-6d91-4bff-b514-ca5822bde9aa tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853" status: 404 len: 111 microversion: 2.1 time: 0.036118 Sep 08 13:45:22.361852 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3057/6244] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:22 2022] GET /compute/v2.1/servers/23f9f008-4198-4dd9-b1f8-23f715cad853 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:45:23.155932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:23.156733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:23.165471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:23.166057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:23.166705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:23.167699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:23.168143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:23.168734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:23.204581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:23.205096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:23.205573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:23.206034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lazy-loading 'fault' on Instance uuid a6efae46-049b-4956-8165-4f798b565738 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:45:23.256012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:23.265690 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-53eccb6b-5629-4acc-b2af-3965c0e4a73f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 200 len: 1230 microversion: 2.1 time: 0.113889 Sep 08 13:45:23.266325 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3188/6245] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:23 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 1230 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:24.291287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5d57b3ee-8c86-4b61-8beb-629d60e7c9a2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:24.291939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5d57b3ee-8c86-4b61-8beb-629d60e7c9a2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: a6efae46-049b-4956-8165-4f798b565738] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:24.301800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d57b3ee-8c86-4b61-8beb-629d60e7c9a2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:24.302641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d57b3ee-8c86-4b61-8beb-629d60e7c9a2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:24.303557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d57b3ee-8c86-4b61-8beb-629d60e7c9a2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:24.304497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d57b3ee-8c86-4b61-8beb-629d60e7c9a2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:24.305436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d57b3ee-8c86-4b61-8beb-629d60e7c9a2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:24.305947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d57b3ee-8c86-4b61-8beb-629d60e7c9a2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:24.323066 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-5d57b3ee-8c86-4b61-8beb-629d60e7c9a2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance a6efae46-049b-4956-8165-4f798b565738 could not be found. Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5d57b3ee-8c86-4b61-8beb-629d60e7c9a2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 HTTP/1.1 Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance a6efae46-049b-4956-8165-4f798b565738 could not be found. Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'a6efae46-049b-4956-8165-4f798b565738'} Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6efae46-049b-4956-8165-4f798b565738 could not be found. Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6efae46-049b-4956-8165-4f798b565738 could not be found. Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:45:24.325703 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:24.334277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:24.334277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:45:24.334277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:45:24.334277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:45:24.334277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:45:24.334277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6efae46-049b-4956-8165-4f798b565738 could not be found. Sep 08 13:45:24.334277 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:24.334277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5d57b3ee-8c86-4b61-8beb-629d60e7c9a2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance a6efae46-049b-4956-8165-4f798b565738 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:45:24.334277 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5d57b3ee-8c86-4b61-8beb-629d60e7c9a2 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738" status: 404 len: 111 microversion: 2.1 time: 0.040284 Sep 08 13:45:24.334277 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3058/6246] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:24 2022] GET /compute/v2.1/servers/a6efae46-049b-4956-8165-4f798b565738 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:45:26.240747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dcaf3634-5d82-4260-8d91-349c1894a6ee tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] Calling method '.version_select at 0x7fdb35a37280>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:26.268146 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dcaf3634-5d82-4260-8d91-349c1894a6ee tempest-TestNetworkAdvancedServerOps-2131984032 tempest-TestNetworkAdvancedServerOps-2131984032-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-255168672" status: 202 len: 0 microversion: 2.1 time: 0.045203 Sep 08 13:45:26.268744 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3189/6247] 10.222.0.78 () {58 vars in 1281 bytes} [Thu Sep 8 13:45:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-255168672 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:45:30.797509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38ccf0ac-f488-4d2d-9ecc-cc02a5756301 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:30.798684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-38ccf0ac-f488-4d2d-9ecc-cc02a5756301 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:30.800728 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-4bbe5041-fbb8-4033-a905-7d0545203aad req-e09f1139-bfd5-4261-90b5-8689f0f66049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7625f4fb-73bf-469e-aeeb-0f97105e57e8", "tag": "616d7a73-9376-4b73-8f78-83f12aef8afe"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:30.812695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4bbe5041-fbb8-4033-a905-7d0545203aad req-e09f1139-bfd5-4261-90b5-8689f0f66049 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:30.813275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4bbe5041-fbb8-4033-a905-7d0545203aad req-e09f1139-bfd5-4261-90b5-8689f0f66049 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:30.813990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4bbe5041-fbb8-4033-a905-7d0545203aad req-e09f1139-bfd5-4261-90b5-8689f0f66049 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:30.827135 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-4bbe5041-fbb8-4033-a905-7d0545203aad req-e09f1139-bfd5-4261-90b5-8689f0f66049 service nova] Creating event network-changed:616d7a73-9376-4b73-8f78-83f12aef8afe for instance 7625f4fb-73bf-469e-aeeb-0f97105e57e8 on n-h1-852084-10 Sep 08 13:45:30.834779 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-4bbe5041-fbb8-4033-a905-7d0545203aad req-e09f1139-bfd5-4261-90b5-8689f0f66049 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038199 Sep 08 13:45:30.835844 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3190/6248] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:45:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:45:30.843286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38ccf0ac-f488-4d2d-9ecc-cc02a5756301 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:30.845064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38ccf0ac-f488-4d2d-9ecc-cc02a5756301 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:30.845705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38ccf0ac-f488-4d2d-9ecc-cc02a5756301 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:30.848040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38ccf0ac-f488-4d2d-9ecc-cc02a5756301 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:30.848676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38ccf0ac-f488-4d2d-9ecc-cc02a5756301 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:30.849435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38ccf0ac-f488-4d2d-9ecc-cc02a5756301 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:30.895405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-38ccf0ac-f488-4d2d-9ecc-cc02a5756301 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:45:31.031633 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38ccf0ac-f488-4d2d-9ecc-cc02a5756301 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 204 len: 0 microversion: 2.1 time: 0.236382 Sep 08 13:45:31.033248 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3059/6249] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:45:30 2022] DELETE /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:45:31.052561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-20fefc9a-9119-426c-b71e-93ca0216ea13 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:31.053301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-20fefc9a-9119-426c-b71e-93ca0216ea13 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:31.070171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-20fefc9a-9119-426c-b71e-93ca0216ea13 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:31.071731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-20fefc9a-9119-426c-b71e-93ca0216ea13 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:31.073895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-20fefc9a-9119-426c-b71e-93ca0216ea13 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:31.075520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-20fefc9a-9119-426c-b71e-93ca0216ea13 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:31.076226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-20fefc9a-9119-426c-b71e-93ca0216ea13 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:31.078128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-20fefc9a-9119-426c-b71e-93ca0216ea13 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:31.285263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-20fefc9a-9119-426c-b71e-93ca0216ea13 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:31.297203 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-20fefc9a-9119-426c-b71e-93ca0216ea13 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1579 microversion: 2.1 time: 0.257640 Sep 08 13:45:31.297812 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3191/6250] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:31 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1579 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:32.322725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5e2d812b-a038-4a1a-850b-cefd92a94ddf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:32.325156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5e2d812b-a038-4a1a-850b-cefd92a94ddf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:32.333505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e2d812b-a038-4a1a-850b-cefd92a94ddf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:32.334291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e2d812b-a038-4a1a-850b-cefd92a94ddf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:32.334595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e2d812b-a038-4a1a-850b-cefd92a94ddf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:32.335590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e2d812b-a038-4a1a-850b-cefd92a94ddf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:32.336057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e2d812b-a038-4a1a-850b-cefd92a94ddf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:32.336495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e2d812b-a038-4a1a-850b-cefd92a94ddf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:32.481321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5e2d812b-a038-4a1a-850b-cefd92a94ddf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:32.489892 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5e2d812b-a038-4a1a-850b-cefd92a94ddf tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1579 microversion: 2.1 time: 0.171890 Sep 08 13:45:32.490492 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3060/6251] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:32 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1579 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:32.974129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b0e675c4-2a45-4c1d-81e9-da8382f894e7 req-10f534a7-76d0-4bfe-80ea-fb81cc77fae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7625f4fb-73bf-469e-aeeb-0f97105e57e8", "name": "network-vif-deleted", "tag": "616d7a73-9376-4b73-8f78-83f12aef8afe"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:45:32.988465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b0e675c4-2a45-4c1d-81e9-da8382f894e7 req-10f534a7-76d0-4bfe-80ea-fb81cc77fae2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:32.989137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b0e675c4-2a45-4c1d-81e9-da8382f894e7 req-10f534a7-76d0-4bfe-80ea-fb81cc77fae2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:32.989723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b0e675c4-2a45-4c1d-81e9-da8382f894e7 req-10f534a7-76d0-4bfe-80ea-fb81cc77fae2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:33.004176 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b0e675c4-2a45-4c1d-81e9-da8382f894e7 req-10f534a7-76d0-4bfe-80ea-fb81cc77fae2 service nova] Creating event network-vif-deleted:616d7a73-9376-4b73-8f78-83f12aef8afe for instance 7625f4fb-73bf-469e-aeeb-0f97105e57e8 on n-h1-852084-10 Sep 08 13:45:33.009555 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b0e675c4-2a45-4c1d-81e9-da8382f894e7 req-10f534a7-76d0-4bfe-80ea-fb81cc77fae2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039201 Sep 08 13:45:33.010528 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3192/6252] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:45:33.514844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bcbc4604-6bee-43f2-b900-afee38e6aaa4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:33.515418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bcbc4604-6bee-43f2-b900-afee38e6aaa4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:33.522467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcbc4604-6bee-43f2-b900-afee38e6aaa4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:33.522964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcbc4604-6bee-43f2-b900-afee38e6aaa4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:33.523445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcbc4604-6bee-43f2-b900-afee38e6aaa4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:33.524189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcbc4604-6bee-43f2-b900-afee38e6aaa4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:33.524630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcbc4604-6bee-43f2-b900-afee38e6aaa4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:33.525069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bcbc4604-6bee-43f2-b900-afee38e6aaa4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:33.597952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bcbc4604-6bee-43f2-b900-afee38e6aaa4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:33.607446 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bcbc4604-6bee-43f2-b900-afee38e6aaa4 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1226 microversion: 2.1 time: 0.097092 Sep 08 13:45:33.608047 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3061/6253] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:33 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:34.633048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-795c4945-cd74-4a36-8bbc-ddc9f941407d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:34.633834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-795c4945-cd74-4a36-8bbc-ddc9f941407d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:34.640733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-795c4945-cd74-4a36-8bbc-ddc9f941407d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:34.641252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-795c4945-cd74-4a36-8bbc-ddc9f941407d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:34.641714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-795c4945-cd74-4a36-8bbc-ddc9f941407d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:34.642444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-795c4945-cd74-4a36-8bbc-ddc9f941407d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:34.642920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-795c4945-cd74-4a36-8bbc-ddc9f941407d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:34.643400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-795c4945-cd74-4a36-8bbc-ddc9f941407d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:34.712873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-795c4945-cd74-4a36-8bbc-ddc9f941407d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:34.723829 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-795c4945-cd74-4a36-8bbc-ddc9f941407d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1226 microversion: 2.1 time: 0.096053 Sep 08 13:45:34.724398 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3193/6254] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:34 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:35.748485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-828f6d0b-895b-476c-9ff3-eab8dfb2798c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:35.749388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-828f6d0b-895b-476c-9ff3-eab8dfb2798c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:35.757354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-828f6d0b-895b-476c-9ff3-eab8dfb2798c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:35.757854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-828f6d0b-895b-476c-9ff3-eab8dfb2798c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:35.758296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-828f6d0b-895b-476c-9ff3-eab8dfb2798c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:35.759020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-828f6d0b-895b-476c-9ff3-eab8dfb2798c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:35.759503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-828f6d0b-895b-476c-9ff3-eab8dfb2798c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:35.759936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-828f6d0b-895b-476c-9ff3-eab8dfb2798c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:35.825650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-828f6d0b-895b-476c-9ff3-eab8dfb2798c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:35.834975 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-828f6d0b-895b-476c-9ff3-eab8dfb2798c tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1226 microversion: 2.1 time: 0.091221 Sep 08 13:45:35.835669 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3062/6255] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:35 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:36.859145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c0d2c79f-8bad-43bc-ab7f-3a6777ffd63f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:36.859833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c0d2c79f-8bad-43bc-ab7f-3a6777ffd63f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:36.862548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:36.868878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0d2c79f-8bad-43bc-ab7f-3a6777ffd63f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:36.869367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0d2c79f-8bad-43bc-ab7f-3a6777ffd63f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:36.870224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0d2c79f-8bad-43bc-ab7f-3a6777ffd63f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:36.871017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0d2c79f-8bad-43bc-ab7f-3a6777ffd63f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:36.871548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0d2c79f-8bad-43bc-ab7f-3a6777ffd63f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:36.871994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c0d2c79f-8bad-43bc-ab7f-3a6777ffd63f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:36.875483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:45:36.942417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c0d2c79f-8bad-43bc-ab7f-3a6777ffd63f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f65d872026946a7a6badc404b161499', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2e0170321894cfeae69bdf34f6a4517', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:45:36.951683 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c0d2c79f-8bad-43bc-ab7f-3a6777ffd63f tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 200 len: 1226 microversion: 2.1 time: 0.097098 Sep 08 13:45:36.953059 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3194/6256] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:36 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:45:37.977071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1026f6de-dbec-4247-a643-f553f920d9bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:37.977728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1026f6de-dbec-4247-a643-f553f920d9bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: 7625f4fb-73bf-469e-aeeb-0f97105e57e8] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:37.984661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1026f6de-dbec-4247-a643-f553f920d9bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:37.985150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1026f6de-dbec-4247-a643-f553f920d9bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:37.985577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1026f6de-dbec-4247-a643-f553f920d9bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:37.986273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1026f6de-dbec-4247-a643-f553f920d9bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:37.986722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1026f6de-dbec-4247-a643-f553f920d9bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:37.987136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1026f6de-dbec-4247-a643-f553f920d9bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:38.001121 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1026f6de-dbec-4247-a643-f553f920d9bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance 7625f4fb-73bf-469e-aeeb-0f97105e57e8 could not be found. Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1026f6de-dbec-4247-a643-f553f920d9bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 HTTP/1.1 Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 7625f4fb-73bf-469e-aeeb-0f97105e57e8 could not be found. Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '7625f4fb-73bf-469e-aeeb-0f97105e57e8'} Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7625f4fb-73bf-469e-aeeb-0f97105e57e8 could not be found. Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7625f4fb-73bf-469e-aeeb-0f97105e57e8 could not be found. Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:45:38.002843 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.007401 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:38.007401 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:45:38.007401 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:45:38.007401 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:45:38.007401 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:45:38.007401 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7625f4fb-73bf-469e-aeeb-0f97105e57e8 could not be found. Sep 08 13:45:38.007401 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.007401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1026f6de-dbec-4247-a643-f553f920d9bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance 7625f4fb-73bf-469e-aeeb-0f97105e57e8 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:45:38.007401 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1026f6de-dbec-4247-a643-f553f920d9bc tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8" status: 404 len: 111 microversion: 2.1 time: 0.031286 Sep 08 13:45:38.007401 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3063/6257] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:37 2022] GET /compute/v2.1/servers/7625f4fb-73bf-469e-aeeb-0f97105e57e8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:45:38.460041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aa5c406f-c878-42e6-894b-db036fe5f898 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:38.460649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aa5c406f-c878-42e6-894b-db036fe5f898 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:38.467182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa5c406f-c878-42e6-894b-db036fe5f898 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:38.467723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa5c406f-c878-42e6-894b-db036fe5f898 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:38.468171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa5c406f-c878-42e6-894b-db036fe5f898 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:38.468890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa5c406f-c878-42e6-894b-db036fe5f898 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:38.469400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa5c406f-c878-42e6-894b-db036fe5f898 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:38.469837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa5c406f-c878-42e6-894b-db036fe5f898 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:38.488730 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-aa5c406f-c878-42e6-894b-db036fe5f898 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aa5c406f-c878-42e6-894b-db036fe5f898 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 HTTP/1.1 Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'dc4b2224-da7c-4884-a959-f880d4af9288'} Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:45:38.490454 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aa5c406f-c878-42e6-894b-db036fe5f898 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aa5c406f-c878-42e6-894b-db036fe5f898 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 404 len: 111 microversion: 2.1 time: 0.035923 Sep 08 13:45:38.494756 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3195/6258] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:45:38 2022] DELETE /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:45:38.501520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b5d82472-5d9d-4c0f-be9c-28530ea7636d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:38.502141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b5d82472-5d9d-4c0f-be9c-28530ea7636d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] [instance: dc4b2224-da7c-4884-a959-f880d4af9288] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:45:38.508335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5d82472-5d9d-4c0f-be9c-28530ea7636d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:38.508837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5d82472-5d9d-4c0f-be9c-28530ea7636d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:38.509264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5d82472-5d9d-4c0f-be9c-28530ea7636d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:38.509971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5d82472-5d9d-4c0f-be9c-28530ea7636d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:45:38.510425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5d82472-5d9d-4c0f-be9c-28530ea7636d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:45:38.510852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b5d82472-5d9d-4c0f-be9c-28530ea7636d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:45:38.526229 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-b5d82472-5d9d-4c0f-be9c-28530ea7636d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] HTTP exception thrown: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b5d82472-5d9d-4c0f-be9c-28530ea7636d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Request method failure captured: Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 HTTP/1.1 Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGe5wnK4L4V2L23Lz6HNK8HcwGEI1s_UI_0QG1pMOIX4D6mAcdfomy3lGmnJ_rykQmbvWOz9UujmFgTn_jyAYKRKgltZ0Gu0tGrxKS2FVXW9GeKRmkP2qcF6Dv-gxMdlDX3B0pwabjZgJROUU5uXRzZoUTphJs9UpYHR5Ht7dKmeSqfs Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c2e0170321894cfeae69bdf34f6a4517"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestVolumeBootPattern-193702513 Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: c2e0170321894cfeae69bdf34f6a4517 Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestVolumeBootPattern-193702513 Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6f65d872026946a7a6badc404b161499 Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestVolumeBootPattern-193702513-project Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'dc4b2224-da7c-4884-a959-f880d4af9288'} Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:45:38.527865 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.532542 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:45:38.532542 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:45:38.532542 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:45:38.532542 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:45:38.532542 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:45:38.532542 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. Sep 08 13:45:38.532542 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:45:38.532542 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b5d82472-5d9d-4c0f-be9c-28530ea7636d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Returning 404 to user: Instance dc4b2224-da7c-4884-a959-f880d4af9288 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:45:38.532542 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b5d82472-5d9d-4c0f-be9c-28530ea7636d tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288" status: 404 len: 111 microversion: 2.1 time: 0.031690 Sep 08 13:45:38.532542 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3064/6259] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:45:38 2022] GET /compute/v2.1/servers/dc4b2224-da7c-4884-a959-f880d4af9288 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:45:42.010556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bb1debe8-c3af-4208-9b23-ab2c073f38b0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] Calling method '.version_select at 0x7fdb340fb280>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:45:42.045829 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bb1debe8-c3af-4208-9b23-ab2c073f38b0 tempest-TestVolumeBootPattern-193702513 tempest-TestVolumeBootPattern-193702513-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1418132249" status: 202 len: 0 microversion: 2.1 time: 0.038929 Sep 08 13:45:42.046567 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3196/6260] 10.222.0.78 () {58 vars in 1263 bytes} [Thu Sep 8 13:45:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1418132249 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:46:00.900493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:00.901373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:01.025111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1329801870", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:01.210493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] validate_networks() for None {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:46:01.511728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:46:01.512146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:46:01.512612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:46:01.513013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:46:01.513509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:46:01.522258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:01.522837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:01.523424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:01.524160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:01.524609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:01.525030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:01.543253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Getting quotas for project ab6c2ea2a3904e999d5157bc9376b2e7. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:46:01.548462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Getting quotas for user 3b5c15714f7e4c508ef01212bebe2ea5 and project ab6c2ea2a3904e999d5157bc9376b2e7. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:46:01.562060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:46:01.564444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:46:01.611494 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-667e65e5-0506-4e4c-ae8e-6dfa0c381faa tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716377 Sep 08 13:46:01.612163 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3065/6261] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:46:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:46:01.625958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f728a620-3ab0-4fea-a95e-2223daa71b83 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:01.626677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f728a620-3ab0-4fea-a95e-2223daa71b83 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:01.630533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=7 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:01.631333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:01.805990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f728a620-3ab0-4fea-a95e-2223daa71b83 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c15714f7e4c508ef01212bebe2ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c2ea2a3904e999d5157bc9376b2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:01.814425 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f728a620-3ab0-4fea-a95e-2223daa71b83 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99" status: 200 len: 1222 microversion: 2.1 time: 0.192194 Sep 08 13:46:01.815018 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3197/6262] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:01 2022] GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 => generated 1222 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:02.843740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-03100d3c-2daa-4120-8a6b-3cb7a9717d85 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:02.844625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-03100d3c-2daa-4120-8a6b-3cb7a9717d85 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:02.856849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03100d3c-2daa-4120-8a6b-3cb7a9717d85 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:02.857689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03100d3c-2daa-4120-8a6b-3cb7a9717d85 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:02.858156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03100d3c-2daa-4120-8a6b-3cb7a9717d85 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:02.859122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03100d3c-2daa-4120-8a6b-3cb7a9717d85 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:02.859550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03100d3c-2daa-4120-8a6b-3cb7a9717d85 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:02.859987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-03100d3c-2daa-4120-8a6b-3cb7a9717d85 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:02.937436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-03100d3c-2daa-4120-8a6b-3cb7a9717d85 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c15714f7e4c508ef01212bebe2ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c2ea2a3904e999d5157bc9376b2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:02.945425 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-03100d3c-2daa-4120-8a6b-3cb7a9717d85 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99" status: 200 len: 1292 microversion: 2.1 time: 0.109492 Sep 08 13:46:02.946009 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3066/6263] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:02 2022] GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 => generated 1292 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:03.970739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d8322903-5dc1-48ba-86e6-44e37fd4db07 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:03.972023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d8322903-5dc1-48ba-86e6-44e37fd4db07 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:03.979390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8322903-5dc1-48ba-86e6-44e37fd4db07 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:03.980203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8322903-5dc1-48ba-86e6-44e37fd4db07 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:03.981341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8322903-5dc1-48ba-86e6-44e37fd4db07 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:03.982227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8322903-5dc1-48ba-86e6-44e37fd4db07 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:03.982843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8322903-5dc1-48ba-86e6-44e37fd4db07 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:03.983501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d8322903-5dc1-48ba-86e6-44e37fd4db07 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:04.243067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d8322903-5dc1-48ba-86e6-44e37fd4db07 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c15714f7e4c508ef01212bebe2ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c2ea2a3904e999d5157bc9376b2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:04.251171 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d8322903-5dc1-48ba-86e6-44e37fd4db07 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99" status: 200 len: 1322 microversion: 2.1 time: 0.284544 Sep 08 13:46:04.251787 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3198/6264] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:03 2022] GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 => generated 1322 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:04.649503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-ff99242d-420e-4b75-bb27-31b16bb3bd53 req-00ebdbd1-4e38-4c47-a5a9-9540836b5a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42fb51c5-4908-41f2-b3bb-951d26f5cc99", "tag": "450c0e50-f9c1-48eb-b552-c633032c2898"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:04.663576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ff99242d-420e-4b75-bb27-31b16bb3bd53 req-00ebdbd1-4e38-4c47-a5a9-9540836b5a8b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:04.664184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ff99242d-420e-4b75-bb27-31b16bb3bd53 req-00ebdbd1-4e38-4c47-a5a9-9540836b5a8b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:04.664745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ff99242d-420e-4b75-bb27-31b16bb3bd53 req-00ebdbd1-4e38-4c47-a5a9-9540836b5a8b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:04.677942 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-ff99242d-420e-4b75-bb27-31b16bb3bd53 req-00ebdbd1-4e38-4c47-a5a9-9540836b5a8b service nova] Creating event network-changed:450c0e50-f9c1-48eb-b552-c633032c2898 for instance 42fb51c5-4908-41f2-b3bb-951d26f5cc99 on n-h2-852084-10 Sep 08 13:46:04.683083 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-ff99242d-420e-4b75-bb27-31b16bb3bd53 req-00ebdbd1-4e38-4c47-a5a9-9540836b5a8b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037568 Sep 08 13:46:04.684250 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3067/6265] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:05.274749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-df312c8f-7628-47eb-9924-ac4ff2ff66f2 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:05.275407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-df312c8f-7628-47eb-9924-ac4ff2ff66f2 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:05.282744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df312c8f-7628-47eb-9924-ac4ff2ff66f2 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:05.283302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df312c8f-7628-47eb-9924-ac4ff2ff66f2 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:05.283723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df312c8f-7628-47eb-9924-ac4ff2ff66f2 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:05.284435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df312c8f-7628-47eb-9924-ac4ff2ff66f2 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:05.284901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df312c8f-7628-47eb-9924-ac4ff2ff66f2 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:05.285338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df312c8f-7628-47eb-9924-ac4ff2ff66f2 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:05.413073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-df312c8f-7628-47eb-9924-ac4ff2ff66f2 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c15714f7e4c508ef01212bebe2ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c2ea2a3904e999d5157bc9376b2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:05.421489 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-df312c8f-7628-47eb-9924-ac4ff2ff66f2 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99" status: 200 len: 1322 microversion: 2.1 time: 0.150642 Sep 08 13:46:05.422067 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3199/6266] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:05 2022] GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:06.445308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4ad1c283-3299-4f1d-a706-55f5b3180657 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:06.446167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4ad1c283-3299-4f1d-a706-55f5b3180657 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:06.453885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ad1c283-3299-4f1d-a706-55f5b3180657 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:06.454455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ad1c283-3299-4f1d-a706-55f5b3180657 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:06.454931 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ad1c283-3299-4f1d-a706-55f5b3180657 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:06.455742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ad1c283-3299-4f1d-a706-55f5b3180657 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:06.456263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ad1c283-3299-4f1d-a706-55f5b3180657 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:06.456750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4ad1c283-3299-4f1d-a706-55f5b3180657 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:06.594602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4ad1c283-3299-4f1d-a706-55f5b3180657 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c15714f7e4c508ef01212bebe2ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c2ea2a3904e999d5157bc9376b2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:06.602825 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4ad1c283-3299-4f1d-a706-55f5b3180657 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99" status: 200 len: 1322 microversion: 2.1 time: 0.161789 Sep 08 13:46:06.603675 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3068/6267] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:06 2022] GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:07.626810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-df7e90e2-9b1c-42ae-bf44-bc9f5c7c1989 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:07.634606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-df7e90e2-9b1c-42ae-bf44-bc9f5c7c1989 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:07.637105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df7e90e2-9b1c-42ae-bf44-bc9f5c7c1989 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:07.637645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df7e90e2-9b1c-42ae-bf44-bc9f5c7c1989 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:07.638137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df7e90e2-9b1c-42ae-bf44-bc9f5c7c1989 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:07.638859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df7e90e2-9b1c-42ae-bf44-bc9f5c7c1989 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:07.639368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df7e90e2-9b1c-42ae-bf44-bc9f5c7c1989 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:07.639813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df7e90e2-9b1c-42ae-bf44-bc9f5c7c1989 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:07.768738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-df7e90e2-9b1c-42ae-bf44-bc9f5c7c1989 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c15714f7e4c508ef01212bebe2ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c2ea2a3904e999d5157bc9376b2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:07.776746 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-df7e90e2-9b1c-42ae-bf44-bc9f5c7c1989 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99" status: 200 len: 1322 microversion: 2.1 time: 0.154166 Sep 08 13:46:07.777324 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3200/6268] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:07 2022] GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:08.347345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-99e1baab-f9b6-4c6e-b93c-70972f435969 req-7d709f33-d6fc-49af-ad3b-e26e307a86b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fb51c5-4908-41f2-b3bb-951d26f5cc99", "name": "network-vif-plugged", "status": "completed", "tag": "450c0e50-f9c1-48eb-b552-c633032c2898"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:08.359874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-99e1baab-f9b6-4c6e-b93c-70972f435969 req-7d709f33-d6fc-49af-ad3b-e26e307a86b0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:08.360362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-99e1baab-f9b6-4c6e-b93c-70972f435969 req-7d709f33-d6fc-49af-ad3b-e26e307a86b0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:08.360795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-99e1baab-f9b6-4c6e-b93c-70972f435969 req-7d709f33-d6fc-49af-ad3b-e26e307a86b0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:08.372420 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-99e1baab-f9b6-4c6e-b93c-70972f435969 req-7d709f33-d6fc-49af-ad3b-e26e307a86b0 service nova] Creating event network-vif-plugged:450c0e50-f9c1-48eb-b552-c633032c2898 for instance 42fb51c5-4908-41f2-b3bb-951d26f5cc99 on n-h2-852084-10 Sep 08 13:46:08.377674 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-99e1baab-f9b6-4c6e-b93c-70972f435969 req-7d709f33-d6fc-49af-ad3b-e26e307a86b0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034146 Sep 08 13:46:08.378418 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3069/6269] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:08.799568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e1f7070f-eb3c-455a-8c33-398e26a0ac04 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:08.800148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e1f7070f-eb3c-455a-8c33-398e26a0ac04 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:08.806847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1f7070f-eb3c-455a-8c33-398e26a0ac04 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:08.807381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1f7070f-eb3c-455a-8c33-398e26a0ac04 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:08.807835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1f7070f-eb3c-455a-8c33-398e26a0ac04 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:08.808579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1f7070f-eb3c-455a-8c33-398e26a0ac04 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:08.809050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1f7070f-eb3c-455a-8c33-398e26a0ac04 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:08.809487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1f7070f-eb3c-455a-8c33-398e26a0ac04 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:08.942142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e1f7070f-eb3c-455a-8c33-398e26a0ac04 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c15714f7e4c508ef01212bebe2ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c2ea2a3904e999d5157bc9376b2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:08.950060 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e1f7070f-eb3c-455a-8c33-398e26a0ac04 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99" status: 200 len: 1322 microversion: 2.1 time: 0.154851 Sep 08 13:46:08.950631 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3201/6270] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:08 2022] GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:46:09.974848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7aee8767-5d58-40ef-ab96-6af22d9a5158 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:09.975606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7aee8767-5d58-40ef-ab96-6af22d9a5158 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:09.982866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aee8767-5d58-40ef-ab96-6af22d9a5158 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:09.983393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aee8767-5d58-40ef-ab96-6af22d9a5158 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:09.983839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aee8767-5d58-40ef-ab96-6af22d9a5158 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:09.984550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aee8767-5d58-40ef-ab96-6af22d9a5158 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:09.985004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aee8767-5d58-40ef-ab96-6af22d9a5158 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:09.985431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7aee8767-5d58-40ef-ab96-6af22d9a5158 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:10.123580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7aee8767-5d58-40ef-ab96-6af22d9a5158 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c15714f7e4c508ef01212bebe2ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c2ea2a3904e999d5157bc9376b2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:10.132019 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7aee8767-5d58-40ef-ab96-6af22d9a5158 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99" status: 200 len: 1472 microversion: 2.1 time: 0.162343 Sep 08 13:46:10.132624 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3070/6271] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:09 2022] GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 => generated 1472 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:10.225852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d78b6d2e-0a60-43d8-b18b-141f9d5f9ed7 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Calling method '.version_select at 0x7fdb34097f70>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:10.296785 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d78b6d2e-0a60-43d8-b18b-141f9d5f9ed7 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/bbed261ce5ff440084ce4410efdd0669" status: 200 len: 371 microversion: 2.1 time: 0.133618 Sep 08 13:46:10.297373 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3202/6272] 10.222.0.78 () {58 vars in 1242 bytes} [Thu Sep 8 13:46:10 2022] GET /compute/v2.1/os-quota-sets/bbed261ce5ff440084ce4410efdd0669 => generated 371 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:46:10.310387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-da2f9eb7-d061-4bbc-8390-d02f8acd7cf8 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1357052179", "id": 403172541, "os-flavor-access:is_public": "True"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:10.329376 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-da2f9eb7-d061-4bbc-8390-d02f8acd7cf8 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.023379 Sep 08 13:46:10.329991 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3071/6273] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:46:10 2022] POST /compute/v2.1/flavors => generated 435 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:10.343170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "403172541"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:10.345481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:10.352484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:10.352484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:10.352881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:10.353607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:10.354082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:10.354523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:10.441619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0f49f15dd4d94e739770605a92033199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed261ce5ff440084ce4410efdd0669', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:10.447896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1357052179 {{(pid=128970) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 13:46:10.455282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:10.455776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:10.456222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:10.456952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:10.457412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:10.457846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:10.479071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Getting quotas for project ab6c2ea2a3904e999d5157bc9376b2e7. Resources: {'cores', 'ram'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:46:10.484821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Getting quotas for user 3b5c15714f7e4c508ef01212bebe2ea5 and project ab6c2ea2a3904e999d5157bc9376b2e7. Resources: {'cores', 'ram'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:46:10.498751 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.compute.api [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] ram quota exceeded for bbed261ce5ff440084ce4410efdd0669, tried to resize instance. Sep 08 13:46:10.499328 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Request method failure captured: Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99/action HTTP/1.1 Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 38 Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfIYjU0abz5u3fwrjH8j0_QIW_doOWX3UI9BOLj9-1STZz5hCKM9-KDNZoKHXEypYAzU8CEsZ3Z_1HrIGDiVLb2LNtoZH8mKZ09Eoc6j0z92KnTX90Q6NpuACUYLtna45PrrZq-VbNAaCJz9JHD0yHrXzYOV33VqkTb-_n-aAVIFalU Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: bbed261ce5ff440084ce4410efdd0669 Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2140406222 Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,admin,reader Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,admin,reader Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bbed261ce5ff440084ce4410efdd0669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bbed261ce5ff440084ce4410efdd0669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bbed261ce5ff440084ce4410efdd0669"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bbed261ce5ff440084ce4410efdd0669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2140406222 Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: bbed261ce5ff440084ce4410efdd0669 Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2140406222 Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersAdminNegativeTestJSON-2140406222-project-admin Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 0f49f15dd4d94e739770605a92033199 Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2140406222-project-admin Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: {"resize": {"flavorRef": "403172541"}} Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '42fb51c5-4908-41f2-b3bb-951d26f5cc99', 'body': {'resize': {'flavorRef': '403172541'}}} Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:46:10.501327 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-28d2f7a9-1ba5-42cc-b4c1-43cf8a4c9a03 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99/action" status: 403 len: 118 microversion: 2.1 time: 0.164276 Sep 08 13:46:10.506063 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3203/6274] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:46:10 2022] POST /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99/action => generated 118 bytes in 165 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:46:10.514566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d3d77474-d895-47a9-8112-2418caeff1a6 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:10.532725 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d3d77474-d895-47a9-8112-2418caeff1a6 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/403172541" status: 202 len: 0 microversion: 2.1 time: 0.021888 Sep 08 13:46:10.533320 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3072/6275] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 13:46:10 2022] DELETE /compute/v2.1/flavors/403172541 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:46:10.541695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9d2efe56-80f4-4a85-a5bf-1ac71369954d tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:10.563005 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9d2efe56-80f4-4a85-a5bf-1ac71369954d tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024888 Sep 08 13:46:10.563621 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3204/6276] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 13:46:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:10.584146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec66ff68-9d9c-48d3-b082-3cb7a97e1ceb tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Calling method '.version_select at 0x7fdb3a0375e0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:10.655601 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ec66ff68-9d9c-48d3-b082-3cb7a97e1ceb tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] 10.222.0.78 "GET /compute/v2.1/os-quota-sets/bbed261ce5ff440084ce4410efdd0669" status: 200 len: 371 microversion: 2.1 time: 0.075149 Sep 08 13:46:10.656191 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3073/6277] 10.222.0.78 () {58 vars in 1242 bytes} [Thu Sep 8 13:46:10 2022] GET /compute/v2.1/os-quota-sets/bbed261ce5ff440084ce4410efdd0669 => generated 371 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:46:10.670065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c93a8c09-d67a-4445-97ed-0440d2ac052b tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-829659118", "id": 790162690, "os-flavor-access:is_public": "True"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:10.688740 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c93a8c09-d67a-4445-97ed-0440d2ac052b tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.023296 Sep 08 13:46:10.689353 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3205/6278] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:46:10 2022] POST /compute/v2.1/flavors => generated 433 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:10.701932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "790162690"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:10.704133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:10.710388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:10.710909 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:10.711376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:10.712083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:10.712540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:10.712964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:10.804358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '0f49f15dd4d94e739770605a92033199', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbed261ce5ff440084ce4410efdd0669', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:10.810479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-829659118 {{(pid=128971) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 13:46:10.817156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:10.817632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:10.818063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:10.818786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:10.819258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:10.819684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:10.842642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Getting quotas for project ab6c2ea2a3904e999d5157bc9376b2e7. Resources: {'cores', 'ram'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:46:10.848033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Getting quotas for user 3b5c15714f7e4c508ef01212bebe2ea5 and project ab6c2ea2a3904e999d5157bc9376b2e7. Resources: {'cores', 'ram'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:46:10.860676 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.compute.api [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] cores quota exceeded for bbed261ce5ff440084ce4410efdd0669, tried to resize instance. Sep 08 13:46:10.861212 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Request method failure captured: Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99/action HTTP/1.1 Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 38 Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfIYjU0abz5u3fwrjH8j0_QIW_doOWX3UI9BOLj9-1STZz5hCKM9-KDNZoKHXEypYAzU8CEsZ3Z_1HrIGDiVLb2LNtoZH8mKZ09Eoc6j0z92KnTX90Q6NpuACUYLtna45PrrZq-VbNAaCJz9JHD0yHrXzYOV33VqkTb-_n-aAVIFalU Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: bbed261ce5ff440084ce4410efdd0669 Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2140406222 Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,admin,reader Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,admin,reader Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_bbed261ce5ff440084ce4410efdd0669"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/bbed261ce5ff440084ce4410efdd0669"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bbed261ce5ff440084ce4410efdd0669"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/bbed261ce5ff440084ce4410efdd0669"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2140406222 Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: bbed261ce5ff440084ce4410efdd0669 Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2140406222 Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersAdminNegativeTestJSON-2140406222-project-admin Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 0f49f15dd4d94e739770605a92033199 Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2140406222-project-admin Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: {"resize": {"flavorRef": "790162690"}} Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '42fb51c5-4908-41f2-b3bb-951d26f5cc99', 'body': {'resize': {'flavorRef': '790162690'}}} Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:46:10.863321 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1b8aa137-3478-4f80-8dfd-4c59cbcf7223 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] 10.222.0.78 "POST /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99/action" status: 403 len: 113 microversion: 2.1 time: 0.167237 Sep 08 13:46:10.867755 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3074/6279] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:46:10 2022] POST /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99/action => generated 113 bytes in 168 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:46:10.873555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4b0d2fd1-721f-4ee6-995a-924707d5d172 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:10.890976 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4b0d2fd1-721f-4ee6-995a-924707d5d172 tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] 10.222.0.78 "DELETE /compute/v2.1/flavors/790162690" status: 202 len: 0 microversion: 2.1 time: 0.021154 Sep 08 13:46:10.891601 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3206/6280] 10.222.0.78 () {58 vars in 1158 bytes} [Thu Sep 8 13:46:10 2022] DELETE /compute/v2.1/flavors/790162690 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:46:10.899587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0f240fa2-66f4-45d5-872d-9a431cbdbf6f tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:10.921839 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0f240fa2-66f4-45d5-872d-9a431cbdbf6f tempest-ServersAdminNegativeTestJSON-2140406222 tempest-ServersAdminNegativeTestJSON-2140406222-project-admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025857 Sep 08 13:46:10.922442 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3075/6281] 10.222.0.78 () {58 vars in 1146 bytes} [Thu Sep 8 13:46:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:10.943236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c6615070-5cd5-45f1-8d70-accfb130ea96 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:10.943778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c6615070-5cd5-45f1-8d70-accfb130ea96 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:10.950677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6615070-5cd5-45f1-8d70-accfb130ea96 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:10.951182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6615070-5cd5-45f1-8d70-accfb130ea96 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:10.951681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6615070-5cd5-45f1-8d70-accfb130ea96 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:10.952388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6615070-5cd5-45f1-8d70-accfb130ea96 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:10.952862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6615070-5cd5-45f1-8d70-accfb130ea96 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:10.953303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6615070-5cd5-45f1-8d70-accfb130ea96 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:10.980596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c6615070-5cd5-45f1-8d70-accfb130ea96 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:46:11.069277 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c6615070-5cd5-45f1-8d70-accfb130ea96 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "DELETE /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99" status: 204 len: 0 microversion: 2.1 time: 0.129547 Sep 08 13:46:11.069786 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3207/6282] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:46:10 2022] DELETE /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:46:11.080073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d074a1fe-5019-4460-9cc4-d853b02a422c tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:11.080694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d074a1fe-5019-4460-9cc4-d853b02a422c tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:11.087042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d074a1fe-5019-4460-9cc4-d853b02a422c tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:11.087574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d074a1fe-5019-4460-9cc4-d853b02a422c tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:11.088014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d074a1fe-5019-4460-9cc4-d853b02a422c tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:11.088719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d074a1fe-5019-4460-9cc4-d853b02a422c tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:11.089176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d074a1fe-5019-4460-9cc4-d853b02a422c tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:11.090236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d074a1fe-5019-4460-9cc4-d853b02a422c tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:11.234784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d074a1fe-5019-4460-9cc4-d853b02a422c tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c15714f7e4c508ef01212bebe2ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c2ea2a3904e999d5157bc9376b2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:11.243172 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d074a1fe-5019-4460-9cc4-d853b02a422c tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99" status: 200 len: 1478 microversion: 2.1 time: 0.168074 Sep 08 13:46:11.243887 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3076/6283] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:11 2022] GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 => generated 1478 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:12.267640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-397672a3-96b1-4c20-aaf4-64797faa1ae4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:12.268355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-397672a3-96b1-4c20-aaf4-64797faa1ae4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:12.275521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-397672a3-96b1-4c20-aaf4-64797faa1ae4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:12.275958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-397672a3-96b1-4c20-aaf4-64797faa1ae4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:12.276409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-397672a3-96b1-4c20-aaf4-64797faa1ae4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:12.277777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-397672a3-96b1-4c20-aaf4-64797faa1ae4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:12.278255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-397672a3-96b1-4c20-aaf4-64797faa1ae4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:12.278676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-397672a3-96b1-4c20-aaf4-64797faa1ae4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:12.486706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-397672a3-96b1-4c20-aaf4-64797faa1ae4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b5c15714f7e4c508ef01212bebe2ea5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6c2ea2a3904e999d5157bc9376b2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:12.495514 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-397672a3-96b1-4c20-aaf4-64797faa1ae4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99" status: 200 len: 1478 microversion: 2.1 time: 0.232053 Sep 08 13:46:12.496122 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3208/6284] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:12 2022] GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 => generated 1478 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:12.860339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-fec203d3-cbd9-49f4-baf1-bfebeffcbcc6 req-bdc65bdb-8fb7-4954-9bfc-51b2180f9f66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42fb51c5-4908-41f2-b3bb-951d26f5cc99", "name": "network-vif-deleted", "tag": "450c0e50-f9c1-48eb-b552-c633032c2898"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:12.872433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fec203d3-cbd9-49f4-baf1-bfebeffcbcc6 req-bdc65bdb-8fb7-4954-9bfc-51b2180f9f66 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:12.873217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fec203d3-cbd9-49f4-baf1-bfebeffcbcc6 req-bdc65bdb-8fb7-4954-9bfc-51b2180f9f66 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:12.873891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-fec203d3-cbd9-49f4-baf1-bfebeffcbcc6 req-bdc65bdb-8fb7-4954-9bfc-51b2180f9f66 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:12.887338 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-fec203d3-cbd9-49f4-baf1-bfebeffcbcc6 req-bdc65bdb-8fb7-4954-9bfc-51b2180f9f66 service nova] Creating event network-vif-deleted:450c0e50-f9c1-48eb-b552-c633032c2898 for instance 42fb51c5-4908-41f2-b3bb-951d26f5cc99 on n-h2-852084-10 Sep 08 13:46:12.893094 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-fec203d3-cbd9-49f4-baf1-bfebeffcbcc6 req-bdc65bdb-8fb7-4954-9bfc-51b2180f9f66 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036476 Sep 08 13:46:12.894050 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3077/6285] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:13.518907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-afea8ff0-ac81-4f15-b71a-a916c8e539f4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:13.519568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-afea8ff0-ac81-4f15-b71a-a916c8e539f4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] [instance: 42fb51c5-4908-41f2-b3bb-951d26f5cc99] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:13.526467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afea8ff0-ac81-4f15-b71a-a916c8e539f4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:13.527480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afea8ff0-ac81-4f15-b71a-a916c8e539f4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:13.527935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afea8ff0-ac81-4f15-b71a-a916c8e539f4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:13.528631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afea8ff0-ac81-4f15-b71a-a916c8e539f4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:13.529098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afea8ff0-ac81-4f15-b71a-a916c8e539f4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:13.529538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-afea8ff0-ac81-4f15-b71a-a916c8e539f4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:13.543779 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-afea8ff0-ac81-4f15-b71a-a916c8e539f4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] HTTP exception thrown: Instance 42fb51c5-4908-41f2-b3bb-951d26f5cc99 could not be found. Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-afea8ff0-ac81-4f15-b71a-a916c8e539f4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Request method failure captured: Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 HTTP/1.1 Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfIY4JEIoQEUxqkCE1F2hUrTX8lMYClpgtrbuptqcxtwkZvDr4CLNjiUemI-MYSwabH9irdgPf06_Ja5NNDrr1bwnh3-VJxUNrV5o_z7LhxsOMKZQaIq3i4cR0uaFXi-FJfXWE3-4pEGB0-bg_UeARlSZk4hHFUz1bc7yBaWE8zapaU Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: ab6c2ea2a3904e999d5157bc9376b2e7 Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1720555137 Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ab6c2ea2a3904e999d5157bc9376b2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ab6c2ea2a3904e999d5157bc9376b2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ab6c2ea2a3904e999d5157bc9376b2e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ab6c2ea2a3904e999d5157bc9376b2e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1720555137 Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: ab6c2ea2a3904e999d5157bc9376b2e7 Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1720555137 Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersAdminNegativeTestJSON-1720555137-project Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 3b5c15714f7e4c508ef01212bebe2ea5 Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1720555137-project Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 42fb51c5-4908-41f2-b3bb-951d26f5cc99 could not be found. Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '42fb51c5-4908-41f2-b3bb-951d26f5cc99'} Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42fb51c5-4908-41f2-b3bb-951d26f5cc99 could not be found. Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42fb51c5-4908-41f2-b3bb-951d26f5cc99 could not be found. Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.545466 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:46:13.550393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.550393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:46:13.550393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:46:13.550393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:46:13.550393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:46:13.550393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:46:13.550393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42fb51c5-4908-41f2-b3bb-951d26f5cc99 could not be found. Sep 08 13:46:13.550393 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:46:13.550393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-afea8ff0-ac81-4f15-b71a-a916c8e539f4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] Returning 404 to user: Instance 42fb51c5-4908-41f2-b3bb-951d26f5cc99 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:46:13.550393 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-afea8ff0-ac81-4f15-b71a-a916c8e539f4 tempest-ServersAdminNegativeTestJSON-1720555137 tempest-ServersAdminNegativeTestJSON-1720555137-project] 10.222.0.78 "GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99" status: 404 len: 111 microversion: 2.1 time: 0.031909 Sep 08 13:46:13.550393 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3209/6286] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:13 2022] GET /compute/v2.1/servers/42fb51c5-4908-41f2-b3bb-951d26f5cc99 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:46:19.960582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1180154507", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "4925197d-91d4-45ef-82b4-a60d9cab35a9"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:20.016082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] validate_networks() for [('4925197d-91d4-45ef-82b4-a60d9cab35a9', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:46:20.420302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:46:20.420772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:46:20.421204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:46:20.421613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:46:20.422056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:46:20.431351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:20.431848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:20.432290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:20.433544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:20.434210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:20.434642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:20.453333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Getting quotas for project b00dbda7a7884e3f8e1c88bfe8a54c7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:46:20.462767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Getting quotas for user a4d8dd14ea644f398d946c4896d37394 and project b00dbda7a7884e3f8e1c88bfe8a54c7e. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:46:20.481316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:46:20.483827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:46:20.534335 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a71c99bb-7225-487c-bf86-0c73970b4349 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.724915 Sep 08 13:46:20.535627 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3078/6287] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:46:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:46:20.547125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0501cb66-441e-4865-b9bb-178e6a7416d1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:20.548651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0501cb66-441e-4865-b9bb-178e6a7416d1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:20.561514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:20.562808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:20.621435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0501cb66-441e-4865-b9bb-178e6a7416d1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:20.631458 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0501cb66-441e-4865-b9bb-178e6a7416d1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1215 microversion: 2.1 time: 0.088600 Sep 08 13:46:20.632660 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3210/6288] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:20 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1215 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:21.654956 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:46:21.655711 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 13:46:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 (ip 10.222.0.78) !!! Sep 08 13:46:21.659515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-26095f6a-61b6-4ed9-9c05-96a0496840cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:21.660847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-26095f6a-61b6-4ed9-9c05-96a0496840cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:21.668568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26095f6a-61b6-4ed9-9c05-96a0496840cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:21.669070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26095f6a-61b6-4ed9-9c05-96a0496840cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:21.669518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26095f6a-61b6-4ed9-9c05-96a0496840cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:21.670220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26095f6a-61b6-4ed9-9c05-96a0496840cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:21.670701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26095f6a-61b6-4ed9-9c05-96a0496840cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:21.671104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-26095f6a-61b6-4ed9-9c05-96a0496840cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:21.743339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-26095f6a-61b6-4ed9-9c05-96a0496840cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:21.752863 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-26095f6a-61b6-4ed9-9c05-96a0496840cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1267 microversion: 2.1 time: 0.099890 Sep 08 13:46:21.753469 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3079/6289] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:21 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1267 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:22.778591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e2931b0-7902-491f-898a-34e69f602f46 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:22.783563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e2931b0-7902-491f-898a-34e69f602f46 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:22.801865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e2931b0-7902-491f-898a-34e69f602f46 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:22.803111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e2931b0-7902-491f-898a-34e69f602f46 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:22.803708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e2931b0-7902-491f-898a-34e69f602f46 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:22.804761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e2931b0-7902-491f-898a-34e69f602f46 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:22.805248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e2931b0-7902-491f-898a-34e69f602f46 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:22.805810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e2931b0-7902-491f-898a-34e69f602f46 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:23.071692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e2931b0-7902-491f-898a-34e69f602f46 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:23.090247 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e2931b0-7902-491f-898a-34e69f602f46 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1315 microversion: 2.1 time: 0.315686 Sep 08 13:46:23.102776 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3211/6290] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:22 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:23.742305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f09efffd-4ecc-45ea-96fa-29dd495984f6 req-64061903-b38c-495c-974a-c26128516601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eee99b4-c911-48b8-9639-0c235a286eb7", "tag": "a84bc41a-8154-4b84-b345-0e80cf1c3859"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:23.764309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f09efffd-4ecc-45ea-96fa-29dd495984f6 req-64061903-b38c-495c-974a-c26128516601 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:23.764795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f09efffd-4ecc-45ea-96fa-29dd495984f6 req-64061903-b38c-495c-974a-c26128516601 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:23.765231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f09efffd-4ecc-45ea-96fa-29dd495984f6 req-64061903-b38c-495c-974a-c26128516601 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:23.777337 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f09efffd-4ecc-45ea-96fa-29dd495984f6 req-64061903-b38c-495c-974a-c26128516601 service nova] Creating event network-changed:a84bc41a-8154-4b84-b345-0e80cf1c3859 for instance 2eee99b4-c911-48b8-9639-0c235a286eb7 on n-h2-852084-10 Sep 08 13:46:23.782826 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f09efffd-4ecc-45ea-96fa-29dd495984f6 req-64061903-b38c-495c-974a-c26128516601 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122891 Sep 08 13:46:23.783864 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3080/6291] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:24.114577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0f3ed78a-cea4-4117-ab34-2425b821dad1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:24.115246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0f3ed78a-cea4-4117-ab34-2425b821dad1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:24.123360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f3ed78a-cea4-4117-ab34-2425b821dad1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:24.124369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f3ed78a-cea4-4117-ab34-2425b821dad1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:24.124581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f3ed78a-cea4-4117-ab34-2425b821dad1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:24.125322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f3ed78a-cea4-4117-ab34-2425b821dad1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:24.125799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f3ed78a-cea4-4117-ab34-2425b821dad1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:24.126232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f3ed78a-cea4-4117-ab34-2425b821dad1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:24.273154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0f3ed78a-cea4-4117-ab34-2425b821dad1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:24.281819 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0f3ed78a-cea4-4117-ab34-2425b821dad1 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1315 microversion: 2.1 time: 0.171651 Sep 08 13:46:24.282413 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3212/6292] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:24 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:25.307218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f67e5c37-49ff-4444-ba15-9147a54a4c0f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:25.307873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f67e5c37-49ff-4444-ba15-9147a54a4c0f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:25.314627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f67e5c37-49ff-4444-ba15-9147a54a4c0f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:25.315117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f67e5c37-49ff-4444-ba15-9147a54a4c0f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:25.315654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f67e5c37-49ff-4444-ba15-9147a54a4c0f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:25.316357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f67e5c37-49ff-4444-ba15-9147a54a4c0f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:25.316812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f67e5c37-49ff-4444-ba15-9147a54a4c0f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:25.317241 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f67e5c37-49ff-4444-ba15-9147a54a4c0f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:25.468458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f67e5c37-49ff-4444-ba15-9147a54a4c0f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:25.476999 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f67e5c37-49ff-4444-ba15-9147a54a4c0f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1315 microversion: 2.1 time: 0.175034 Sep 08 13:46:25.477600 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3081/6293] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:25 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:26.501650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4aa442b6-542c-42d5-b7a0-f37a13174da9 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:26.502142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4aa442b6-542c-42d5-b7a0-f37a13174da9 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:26.511725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa442b6-542c-42d5-b7a0-f37a13174da9 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:26.512243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa442b6-542c-42d5-b7a0-f37a13174da9 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:26.512740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa442b6-542c-42d5-b7a0-f37a13174da9 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:26.513846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa442b6-542c-42d5-b7a0-f37a13174da9 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:26.514318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa442b6-542c-42d5-b7a0-f37a13174da9 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:26.514760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa442b6-542c-42d5-b7a0-f37a13174da9 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:26.652888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4aa442b6-542c-42d5-b7a0-f37a13174da9 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:26.661727 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4aa442b6-542c-42d5-b7a0-f37a13174da9 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1315 microversion: 2.1 time: 0.164444 Sep 08 13:46:26.662318 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3213/6294] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:26 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:27.685463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6f3aa1cf-cedb-486f-8e08-760db7b94fcb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:27.686084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6f3aa1cf-cedb-486f-8e08-760db7b94fcb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:27.693064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f3aa1cf-cedb-486f-8e08-760db7b94fcb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:27.693554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f3aa1cf-cedb-486f-8e08-760db7b94fcb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:27.693997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f3aa1cf-cedb-486f-8e08-760db7b94fcb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:27.694709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f3aa1cf-cedb-486f-8e08-760db7b94fcb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:27.695171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f3aa1cf-cedb-486f-8e08-760db7b94fcb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:27.695626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f3aa1cf-cedb-486f-8e08-760db7b94fcb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:27.840285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6f3aa1cf-cedb-486f-8e08-760db7b94fcb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:27.848279 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6f3aa1cf-cedb-486f-8e08-760db7b94fcb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1315 microversion: 2.1 time: 0.166811 Sep 08 13:46:27.848871 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3082/6295] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:27 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:28.447069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2fa69646-b912-4a79-8b45-2a9715526654 req-8beb4a7b-f461-49d6-ab21-d647589f5ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eee99b4-c911-48b8-9639-0c235a286eb7", "name": "network-vif-plugged", "status": "completed", "tag": "a84bc41a-8154-4b84-b345-0e80cf1c3859"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:28.459126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2fa69646-b912-4a79-8b45-2a9715526654 req-8beb4a7b-f461-49d6-ab21-d647589f5ef9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:28.459759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2fa69646-b912-4a79-8b45-2a9715526654 req-8beb4a7b-f461-49d6-ab21-d647589f5ef9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:28.460227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2fa69646-b912-4a79-8b45-2a9715526654 req-8beb4a7b-f461-49d6-ab21-d647589f5ef9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:28.472304 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2fa69646-b912-4a79-8b45-2a9715526654 req-8beb4a7b-f461-49d6-ab21-d647589f5ef9 service nova] Creating event network-vif-plugged:a84bc41a-8154-4b84-b345-0e80cf1c3859 for instance 2eee99b4-c911-48b8-9639-0c235a286eb7 on n-h2-852084-10 Sep 08 13:46:28.477674 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2fa69646-b912-4a79-8b45-2a9715526654 req-8beb4a7b-f461-49d6-ab21-d647589f5ef9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034772 Sep 08 13:46:28.478316 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3214/6296] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:46:28.872378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9798a057-7727-4f05-ab89-85b1fbc5f807 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:28.872994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9798a057-7727-4f05-ab89-85b1fbc5f807 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:28.880057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9798a057-7727-4f05-ab89-85b1fbc5f807 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:28.880543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9798a057-7727-4f05-ab89-85b1fbc5f807 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:28.880983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9798a057-7727-4f05-ab89-85b1fbc5f807 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:28.881683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9798a057-7727-4f05-ab89-85b1fbc5f807 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:28.882134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9798a057-7727-4f05-ab89-85b1fbc5f807 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:28.882553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9798a057-7727-4f05-ab89-85b1fbc5f807 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:29.022273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9798a057-7727-4f05-ab89-85b1fbc5f807 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:29.031119 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9798a057-7727-4f05-ab89-85b1fbc5f807 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1315 microversion: 2.1 time: 0.162826 Sep 08 13:46:29.031767 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3083/6297] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:28 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:46:30.056215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0e3d97a1-58cc-41a3-85de-05c7f847ecc7 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:30.056938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0e3d97a1-58cc-41a3-85de-05c7f847ecc7 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:30.063115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e3d97a1-58cc-41a3-85de-05c7f847ecc7 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:30.063647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e3d97a1-58cc-41a3-85de-05c7f847ecc7 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:30.064089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e3d97a1-58cc-41a3-85de-05c7f847ecc7 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:30.064794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e3d97a1-58cc-41a3-85de-05c7f847ecc7 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:30.065258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e3d97a1-58cc-41a3-85de-05c7f847ecc7 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:30.065698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e3d97a1-58cc-41a3-85de-05c7f847ecc7 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:30.198829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0e3d97a1-58cc-41a3-85de-05c7f847ecc7 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:30.206911 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0e3d97a1-58cc-41a3-85de-05c7f847ecc7 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1503 microversion: 2.1 time: 0.155831 Sep 08 13:46:30.207520 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3215/6298] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:30 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:30.229657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:46:30.232482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:30.239443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:30.239938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:30.240383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:30.241089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:30.241546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:30.241976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:30.270489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:30.276210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Old instance type m1.heat2, new instance type m1.heat {{(pid=128971) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 13:46:30.283599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:46:30.284057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:46:30.284538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:46:30.284955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:46:30.285374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:46:30.349606 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8b41e4a8-4866-42bf-90c4-bdbd07e9a5fb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "POST /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7/action" status: 202 len: 0 microversion: 2.1 time: 0.123880 Sep 08 13:46:30.350229 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3084/6299] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:46:30 2022] POST /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:46:30.359308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-17fe2a56-5794-46fc-affc-258d991f21fd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:30.359942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-17fe2a56-5794-46fc-affc-258d991f21fd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:30.365996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fe2a56-5794-46fc-affc-258d991f21fd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:30.366443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fe2a56-5794-46fc-affc-258d991f21fd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:30.366902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fe2a56-5794-46fc-affc-258d991f21fd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:30.367654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fe2a56-5794-46fc-affc-258d991f21fd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:30.368128 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fe2a56-5794-46fc-affc-258d991f21fd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:30.368570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-17fe2a56-5794-46fc-affc-258d991f21fd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:30.505619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-17fe2a56-5794-46fc-affc-258d991f21fd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:30.513673 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-17fe2a56-5794-46fc-affc-258d991f21fd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1512 microversion: 2.1 time: 0.159099 Sep 08 13:46:30.514441 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3216/6300] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:30 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1512 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:31.534165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=7 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:31.534981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=14 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:31.540995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2502a74b-66b4-41e1-89db-c1a3c315e08f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:31.541783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2502a74b-66b4-41e1-89db-c1a3c315e08f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:31.544536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:31.551968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2502a74b-66b4-41e1-89db-c1a3c315e08f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:31.552530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2502a74b-66b4-41e1-89db-c1a3c315e08f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:31.552982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2502a74b-66b4-41e1-89db-c1a3c315e08f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:31.553701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2502a74b-66b4-41e1-89db-c1a3c315e08f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:31.554164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2502a74b-66b4-41e1-89db-c1a3c315e08f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:31.554604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2502a74b-66b4-41e1-89db-c1a3c315e08f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:31.558459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:31.818559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2502a74b-66b4-41e1-89db-c1a3c315e08f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:31.827376 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2502a74b-66b4-41e1-89db-c1a3c315e08f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1512 microversion: 2.1 time: 0.293997 Sep 08 13:46:31.839621 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3085/6301] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:31 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1512 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:32.852145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cf2e7795-2889-4af3-8f4c-db51258693cb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:32.852830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cf2e7795-2889-4af3-8f4c-db51258693cb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:32.854844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:32.856500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:32.862410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf2e7795-2889-4af3-8f4c-db51258693cb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:32.862911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf2e7795-2889-4af3-8f4c-db51258693cb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:32.863403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf2e7795-2889-4af3-8f4c-db51258693cb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:32.864107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf2e7795-2889-4af3-8f4c-db51258693cb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:32.864573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf2e7795-2889-4af3-8f4c-db51258693cb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:32.865014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf2e7795-2889-4af3-8f4c-db51258693cb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:32.869618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:46:33.002278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cf2e7795-2889-4af3-8f4c-db51258693cb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:33.010859 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cf2e7795-2889-4af3-8f4c-db51258693cb tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.162441 Sep 08 13:46:33.012054 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3217/6302] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:32 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:34.035184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c0d6974a-a85f-4701-9499-4048dbd4b3cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:34.035861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c0d6974a-a85f-4701-9499-4048dbd4b3cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:34.042776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0d6974a-a85f-4701-9499-4048dbd4b3cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:34.043307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0d6974a-a85f-4701-9499-4048dbd4b3cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:34.043751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0d6974a-a85f-4701-9499-4048dbd4b3cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:34.044451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0d6974a-a85f-4701-9499-4048dbd4b3cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:34.044914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0d6974a-a85f-4701-9499-4048dbd4b3cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:34.045405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0d6974a-a85f-4701-9499-4048dbd4b3cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:34.181708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c0d6974a-a85f-4701-9499-4048dbd4b3cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:34.189470 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c0d6974a-a85f-4701-9499-4048dbd4b3cd tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.158266 Sep 08 13:46:34.190049 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3086/6303] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:34 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:35.213694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fd67c8fd-b567-4f29-a03d-dbf275e80d16 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:35.214833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fd67c8fd-b567-4f29-a03d-dbf275e80d16 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:35.221726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd67c8fd-b567-4f29-a03d-dbf275e80d16 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:35.222222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd67c8fd-b567-4f29-a03d-dbf275e80d16 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:35.222686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd67c8fd-b567-4f29-a03d-dbf275e80d16 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:35.223410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd67c8fd-b567-4f29-a03d-dbf275e80d16 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:35.223879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd67c8fd-b567-4f29-a03d-dbf275e80d16 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:35.224318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd67c8fd-b567-4f29-a03d-dbf275e80d16 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:35.358685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fd67c8fd-b567-4f29-a03d-dbf275e80d16 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:35.366484 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fd67c8fd-b567-4f29-a03d-dbf275e80d16 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.156695 Sep 08 13:46:35.367051 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3218/6304] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:35 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:36.389552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1eb56814-fb70-4998-b14e-5b0136464653 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:36.390164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1eb56814-fb70-4998-b14e-5b0136464653 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:36.396772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1eb56814-fb70-4998-b14e-5b0136464653 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:36.397243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1eb56814-fb70-4998-b14e-5b0136464653 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:36.397804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1eb56814-fb70-4998-b14e-5b0136464653 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:36.398492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1eb56814-fb70-4998-b14e-5b0136464653 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:36.398969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1eb56814-fb70-4998-b14e-5b0136464653 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:36.399424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1eb56814-fb70-4998-b14e-5b0136464653 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:36.536620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1eb56814-fb70-4998-b14e-5b0136464653 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:36.544627 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1eb56814-fb70-4998-b14e-5b0136464653 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.159658 Sep 08 13:46:36.545213 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3087/6305] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:36 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:37.567780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2238cdb2-9aee-4ac2-90d2-a298aa72a7ca tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:37.568403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2238cdb2-9aee-4ac2-90d2-a298aa72a7ca tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:37.575380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2238cdb2-9aee-4ac2-90d2-a298aa72a7ca tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:37.575875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2238cdb2-9aee-4ac2-90d2-a298aa72a7ca tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:37.576319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2238cdb2-9aee-4ac2-90d2-a298aa72a7ca tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:37.577016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2238cdb2-9aee-4ac2-90d2-a298aa72a7ca tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:37.577480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2238cdb2-9aee-4ac2-90d2-a298aa72a7ca tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:37.577916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2238cdb2-9aee-4ac2-90d2-a298aa72a7ca tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:37.709309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2238cdb2-9aee-4ac2-90d2-a298aa72a7ca tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:37.717289 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2238cdb2-9aee-4ac2-90d2-a298aa72a7ca tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.153450 Sep 08 13:46:37.717866 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3219/6306] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:37 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:38.740863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-90b875c0-86a0-495a-b777-c65bf7ae3c18 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:38.741478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-90b875c0-86a0-495a-b777-c65bf7ae3c18 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:38.749100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90b875c0-86a0-495a-b777-c65bf7ae3c18 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:38.749527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90b875c0-86a0-495a-b777-c65bf7ae3c18 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:38.749967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90b875c0-86a0-495a-b777-c65bf7ae3c18 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:38.750658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90b875c0-86a0-495a-b777-c65bf7ae3c18 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:38.751115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90b875c0-86a0-495a-b777-c65bf7ae3c18 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:38.751563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90b875c0-86a0-495a-b777-c65bf7ae3c18 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:38.897702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-90b875c0-86a0-495a-b777-c65bf7ae3c18 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:38.906352 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-90b875c0-86a0-495a-b777-c65bf7ae3c18 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.169388 Sep 08 13:46:38.906945 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3088/6307] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:38 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:39.930216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-219c4faf-80e4-4380-b626-7f52afd2a8ae tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:39.930850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-219c4faf-80e4-4380-b626-7f52afd2a8ae tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:39.937551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-219c4faf-80e4-4380-b626-7f52afd2a8ae tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:39.938053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-219c4faf-80e4-4380-b626-7f52afd2a8ae tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:39.938507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-219c4faf-80e4-4380-b626-7f52afd2a8ae tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:39.939211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-219c4faf-80e4-4380-b626-7f52afd2a8ae tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:39.939707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-219c4faf-80e4-4380-b626-7f52afd2a8ae tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:39.940146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-219c4faf-80e4-4380-b626-7f52afd2a8ae tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:40.070015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-219c4faf-80e4-4380-b626-7f52afd2a8ae tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:40.078519 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-219c4faf-80e4-4380-b626-7f52afd2a8ae tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.152237 Sep 08 13:46:40.079094 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3220/6308] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:39 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:41.102015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cea0646b-61d5-45a9-a5e9-c973b71b6ddc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:41.102707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cea0646b-61d5-45a9-a5e9-c973b71b6ddc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:41.110011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cea0646b-61d5-45a9-a5e9-c973b71b6ddc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:41.110512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cea0646b-61d5-45a9-a5e9-c973b71b6ddc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:41.110964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cea0646b-61d5-45a9-a5e9-c973b71b6ddc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:41.111719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cea0646b-61d5-45a9-a5e9-c973b71b6ddc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:41.112182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cea0646b-61d5-45a9-a5e9-c973b71b6ddc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:41.112614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cea0646b-61d5-45a9-a5e9-c973b71b6ddc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:41.248085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cea0646b-61d5-45a9-a5e9-c973b71b6ddc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:41.256944 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cea0646b-61d5-45a9-a5e9-c973b71b6ddc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.158870 Sep 08 13:46:41.257529 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3089/6309] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:41 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:42.280691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-74b71c31-e3ed-432a-a447-6790352f731a tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:42.281330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-74b71c31-e3ed-432a-a447-6790352f731a tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:42.288154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74b71c31-e3ed-432a-a447-6790352f731a tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:42.288642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74b71c31-e3ed-432a-a447-6790352f731a tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:42.289086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74b71c31-e3ed-432a-a447-6790352f731a tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:42.289784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74b71c31-e3ed-432a-a447-6790352f731a tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:42.290248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74b71c31-e3ed-432a-a447-6790352f731a tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:42.290682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74b71c31-e3ed-432a-a447-6790352f731a tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:42.422982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-74b71c31-e3ed-432a-a447-6790352f731a tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:42.431941 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-74b71c31-e3ed-432a-a447-6790352f731a tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.155768 Sep 08 13:46:42.432528 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3221/6310] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:42 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:43.456119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2d6e0046-ef07-42b6-bfc5-ecdffd90d096 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:43.456855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2d6e0046-ef07-42b6-bfc5-ecdffd90d096 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:43.464330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d6e0046-ef07-42b6-bfc5-ecdffd90d096 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:43.464830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d6e0046-ef07-42b6-bfc5-ecdffd90d096 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:43.465274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d6e0046-ef07-42b6-bfc5-ecdffd90d096 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:43.465983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d6e0046-ef07-42b6-bfc5-ecdffd90d096 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:43.466448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d6e0046-ef07-42b6-bfc5-ecdffd90d096 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:43.466906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d6e0046-ef07-42b6-bfc5-ecdffd90d096 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:43.602077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2d6e0046-ef07-42b6-bfc5-ecdffd90d096 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:43.610072 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2d6e0046-ef07-42b6-bfc5-ecdffd90d096 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.158085 Sep 08 13:46:43.610877 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3090/6311] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:43 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:44.633875 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ed2ed8f5-f9fc-4dd9-8597-890dbe7641a4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:44.634511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ed2ed8f5-f9fc-4dd9-8597-890dbe7641a4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:44.642140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed2ed8f5-f9fc-4dd9-8597-890dbe7641a4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:44.642653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed2ed8f5-f9fc-4dd9-8597-890dbe7641a4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:44.643110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed2ed8f5-f9fc-4dd9-8597-890dbe7641a4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:44.643859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed2ed8f5-f9fc-4dd9-8597-890dbe7641a4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:44.644332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed2ed8f5-f9fc-4dd9-8597-890dbe7641a4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:44.644775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed2ed8f5-f9fc-4dd9-8597-890dbe7641a4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:44.795858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ed2ed8f5-f9fc-4dd9-8597-890dbe7641a4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:44.803939 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ed2ed8f5-f9fc-4dd9-8597-890dbe7641a4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.173968 Sep 08 13:46:44.804560 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3222/6312] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:44 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:45.828916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a3640d4e-a28c-49e8-878c-90b71e150112 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:45.829614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a3640d4e-a28c-49e8-878c-90b71e150112 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:45.837336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3640d4e-a28c-49e8-878c-90b71e150112 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:45.837637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3640d4e-a28c-49e8-878c-90b71e150112 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:45.838049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3640d4e-a28c-49e8-878c-90b71e150112 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:45.838778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3640d4e-a28c-49e8-878c-90b71e150112 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:45.839260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3640d4e-a28c-49e8-878c-90b71e150112 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:45.839703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a3640d4e-a28c-49e8-878c-90b71e150112 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:45.985196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a3640d4e-a28c-49e8-878c-90b71e150112 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:45.993381 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a3640d4e-a28c-49e8-878c-90b71e150112 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.169343 Sep 08 13:46:45.993965 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3091/6313] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:45 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:47.017178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d44ddbe4-237a-4576-b0ab-990585428f05 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:47.017944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d44ddbe4-237a-4576-b0ab-990585428f05 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:47.024981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d44ddbe4-237a-4576-b0ab-990585428f05 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:47.025482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d44ddbe4-237a-4576-b0ab-990585428f05 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:47.025938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d44ddbe4-237a-4576-b0ab-990585428f05 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:47.027250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d44ddbe4-237a-4576-b0ab-990585428f05 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:47.027713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d44ddbe4-237a-4576-b0ab-990585428f05 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:47.028180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d44ddbe4-237a-4576-b0ab-990585428f05 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:47.162429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d44ddbe4-237a-4576-b0ab-990585428f05 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:47.170841 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d44ddbe4-237a-4576-b0ab-990585428f05 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.157566 Sep 08 13:46:47.171466 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3223/6314] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:47 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:48.194201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4f1b0f54-d8ea-4b91-ba45-04f488b88056 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:48.194879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4f1b0f54-d8ea-4b91-ba45-04f488b88056 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:48.202226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f1b0f54-d8ea-4b91-ba45-04f488b88056 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:48.202724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f1b0f54-d8ea-4b91-ba45-04f488b88056 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:48.203168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f1b0f54-d8ea-4b91-ba45-04f488b88056 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:48.204019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f1b0f54-d8ea-4b91-ba45-04f488b88056 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:48.204498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f1b0f54-d8ea-4b91-ba45-04f488b88056 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:48.205008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f1b0f54-d8ea-4b91-ba45-04f488b88056 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:48.349451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4f1b0f54-d8ea-4b91-ba45-04f488b88056 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:48.357578 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4f1b0f54-d8ea-4b91-ba45-04f488b88056 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.167280 Sep 08 13:46:48.358184 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3092/6315] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:48 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:49.382054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e5f0ed7e-28f5-49b1-88eb-1763fe7ea181 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:49.382690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e5f0ed7e-28f5-49b1-88eb-1763fe7ea181 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:49.390428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5f0ed7e-28f5-49b1-88eb-1763fe7ea181 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:49.390942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5f0ed7e-28f5-49b1-88eb-1763fe7ea181 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:49.391432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5f0ed7e-28f5-49b1-88eb-1763fe7ea181 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:49.392147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5f0ed7e-28f5-49b1-88eb-1763fe7ea181 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:49.392621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5f0ed7e-28f5-49b1-88eb-1763fe7ea181 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:49.393064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e5f0ed7e-28f5-49b1-88eb-1763fe7ea181 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:49.528858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e5f0ed7e-28f5-49b1-88eb-1763fe7ea181 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:49.536882 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e5f0ed7e-28f5-49b1-88eb-1763fe7ea181 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.158764 Sep 08 13:46:49.537472 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3224/6316] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:49 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:50.560206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0339f185-83f0-4438-913f-ca58eed8cca4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:50.560874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0339f185-83f0-4438-913f-ca58eed8cca4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:50.567738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0339f185-83f0-4438-913f-ca58eed8cca4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:50.568223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0339f185-83f0-4438-913f-ca58eed8cca4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:50.568658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0339f185-83f0-4438-913f-ca58eed8cca4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:50.569338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0339f185-83f0-4438-913f-ca58eed8cca4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:50.569790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0339f185-83f0-4438-913f-ca58eed8cca4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:50.570210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0339f185-83f0-4438-913f-ca58eed8cca4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:50.706174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0339f185-83f0-4438-913f-ca58eed8cca4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:50.715092 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0339f185-83f0-4438-913f-ca58eed8cca4 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.158778 Sep 08 13:46:50.715697 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3093/6317] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:50 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:51.740180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0de00384-cc32-46fe-b557-bf5c97ab2905 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:51.740843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0de00384-cc32-46fe-b557-bf5c97ab2905 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:51.748515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0de00384-cc32-46fe-b557-bf5c97ab2905 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:51.749020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0de00384-cc32-46fe-b557-bf5c97ab2905 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:51.749476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0de00384-cc32-46fe-b557-bf5c97ab2905 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:51.750194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0de00384-cc32-46fe-b557-bf5c97ab2905 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:51.750666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0de00384-cc32-46fe-b557-bf5c97ab2905 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:51.751103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0de00384-cc32-46fe-b557-bf5c97ab2905 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:51.890963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0de00384-cc32-46fe-b557-bf5c97ab2905 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:51.899168 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0de00384-cc32-46fe-b557-bf5c97ab2905 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.163725 Sep 08 13:46:51.899785 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3225/6318] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:51 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:52.922274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-023d1a57-2578-4704-ad9d-78e96ee185df tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:52.922816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-023d1a57-2578-4704-ad9d-78e96ee185df tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:52.929992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-023d1a57-2578-4704-ad9d-78e96ee185df tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:52.930486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-023d1a57-2578-4704-ad9d-78e96ee185df tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:52.930929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-023d1a57-2578-4704-ad9d-78e96ee185df tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:52.931668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-023d1a57-2578-4704-ad9d-78e96ee185df tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:52.932126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-023d1a57-2578-4704-ad9d-78e96ee185df tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:52.933158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-023d1a57-2578-4704-ad9d-78e96ee185df tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:53.081330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-023d1a57-2578-4704-ad9d-78e96ee185df tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:53.090190 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-023d1a57-2578-4704-ad9d-78e96ee185df tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.171919 Sep 08 13:46:53.090793 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3094/6319] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:52 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:54.114848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-21f3e8cc-0a85-4e89-8dc2-15e6222cd4bc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:54.115667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-21f3e8cc-0a85-4e89-8dc2-15e6222cd4bc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:54.125784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21f3e8cc-0a85-4e89-8dc2-15e6222cd4bc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:54.126348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21f3e8cc-0a85-4e89-8dc2-15e6222cd4bc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:54.126746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21f3e8cc-0a85-4e89-8dc2-15e6222cd4bc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:54.127802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21f3e8cc-0a85-4e89-8dc2-15e6222cd4bc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:54.128067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21f3e8cc-0a85-4e89-8dc2-15e6222cd4bc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:54.128584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21f3e8cc-0a85-4e89-8dc2-15e6222cd4bc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:54.273794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-21f3e8cc-0a85-4e89-8dc2-15e6222cd4bc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:54.284152 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-21f3e8cc-0a85-4e89-8dc2-15e6222cd4bc tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.173414 Sep 08 13:46:54.284808 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3226/6320] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:54 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:46:55.308727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-322342b0-8d63-4c7c-a0f0-2423ee46b50f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:55.309770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-322342b0-8d63-4c7c-a0f0-2423ee46b50f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:55.317365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-322342b0-8d63-4c7c-a0f0-2423ee46b50f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:55.317887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-322342b0-8d63-4c7c-a0f0-2423ee46b50f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:55.318318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-322342b0-8d63-4c7c-a0f0-2423ee46b50f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:55.319069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-322342b0-8d63-4c7c-a0f0-2423ee46b50f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:55.319570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-322342b0-8d63-4c7c-a0f0-2423ee46b50f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:55.320006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-322342b0-8d63-4c7c-a0f0-2423ee46b50f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:55.465253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-322342b0-8d63-4c7c-a0f0-2423ee46b50f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:55.473869 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-322342b0-8d63-4c7c-a0f0-2423ee46b50f tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.169283 Sep 08 13:46:55.474465 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3095/6321] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:55 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:56.497924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-692250bb-d8e0-48b4-ab55-198995bd9ec8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:56.498612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-692250bb-d8e0-48b4-ab55-198995bd9ec8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:56.506231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-692250bb-d8e0-48b4-ab55-198995bd9ec8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:56.507007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-692250bb-d8e0-48b4-ab55-198995bd9ec8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:56.507278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-692250bb-d8e0-48b4-ab55-198995bd9ec8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:56.507908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-692250bb-d8e0-48b4-ab55-198995bd9ec8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:56.508371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-692250bb-d8e0-48b4-ab55-198995bd9ec8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:56.508803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-692250bb-d8e0-48b4-ab55-198995bd9ec8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:56.645657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-692250bb-d8e0-48b4-ab55-198995bd9ec8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:56.654404 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-692250bb-d8e0-48b4-ab55-198995bd9ec8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.160434 Sep 08 13:46:56.655013 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3227/6322] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:56 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:57.678724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7984c77d-e54d-4ec2-8192-429ed1d8abc2 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:57.679393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7984c77d-e54d-4ec2-8192-429ed1d8abc2 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:57.687120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7984c77d-e54d-4ec2-8192-429ed1d8abc2 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:57.687646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7984c77d-e54d-4ec2-8192-429ed1d8abc2 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:57.688081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7984c77d-e54d-4ec2-8192-429ed1d8abc2 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:57.688786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7984c77d-e54d-4ec2-8192-429ed1d8abc2 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:57.689529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7984c77d-e54d-4ec2-8192-429ed1d8abc2 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:57.689964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7984c77d-e54d-4ec2-8192-429ed1d8abc2 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:57.826907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7984c77d-e54d-4ec2-8192-429ed1d8abc2 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:57.835159 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7984c77d-e54d-4ec2-8192-429ed1d8abc2 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.160806 Sep 08 13:46:57.835767 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3096/6323] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:57 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:46:58.861372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eab6a170-cf42-4878-9a51-e196d79ee163 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:46:58.862065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eab6a170-cf42-4878-9a51-e196d79ee163 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:46:58.873343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eab6a170-cf42-4878-9a51-e196d79ee163 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:58.873852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eab6a170-cf42-4878-9a51-e196d79ee163 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:58.874317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eab6a170-cf42-4878-9a51-e196d79ee163 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:58.875068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eab6a170-cf42-4878-9a51-e196d79ee163 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:46:58.875588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eab6a170-cf42-4878-9a51-e196d79ee163 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:46:58.876052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eab6a170-cf42-4878-9a51-e196d79ee163 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:46:59.013144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-eab6a170-cf42-4878-9a51-e196d79ee163 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:46:59.021282 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eab6a170-cf42-4878-9a51-e196d79ee163 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1517 microversion: 2.1 time: 0.163847 Sep 08 13:46:59.021984 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3228/6324] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:46:58 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:47:00.046591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e17b7925-9b4d-42e9-9df2-73f3bd185b48 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:00.047740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e17b7925-9b4d-42e9-9df2-73f3bd185b48 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:00.064016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3a22f691-1716-45b5-940d-e14504f51ae4 req-231dc3b5-b1c5-4aab-be0f-cd3857c38d13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eee99b4-c911-48b8-9639-0c235a286eb7", "name": "network-vif-unplugged", "status": "completed", "tag": "a84bc41a-8154-4b84-b345-0e80cf1c3859"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:47:00.067623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e17b7925-9b4d-42e9-9df2-73f3bd185b48 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:00.068228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e17b7925-9b4d-42e9-9df2-73f3bd185b48 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:00.068904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e17b7925-9b4d-42e9-9df2-73f3bd185b48 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:00.069671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e17b7925-9b4d-42e9-9df2-73f3bd185b48 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:00.070152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e17b7925-9b4d-42e9-9df2-73f3bd185b48 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:00.070672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e17b7925-9b4d-42e9-9df2-73f3bd185b48 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:00.077882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3a22f691-1716-45b5-940d-e14504f51ae4 req-231dc3b5-b1c5-4aab-be0f-cd3857c38d13 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:00.078366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3a22f691-1716-45b5-940d-e14504f51ae4 req-231dc3b5-b1c5-4aab-be0f-cd3857c38d13 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:00.078811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3a22f691-1716-45b5-940d-e14504f51ae4 req-231dc3b5-b1c5-4aab-be0f-cd3857c38d13 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:00.091931 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3a22f691-1716-45b5-940d-e14504f51ae4 req-231dc3b5-b1c5-4aab-be0f-cd3857c38d13 service nova] Creating event network-vif-unplugged:a84bc41a-8154-4b84-b345-0e80cf1c3859 for instance 2eee99b4-c911-48b8-9639-0c235a286eb7 on n-h1-852084-10 Sep 08 13:47:00.100148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-3a22f691-1716-45b5-940d-e14504f51ae4 req-231dc3b5-b1c5-4aab-be0f-cd3857c38d13 service nova] Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:47:00.113502 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3a22f691-1716-45b5-940d-e14504f51ae4 req-231dc3b5-b1c5-4aab-be0f-cd3857c38d13 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134538 Sep 08 13:47:00.114160 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3097/6325] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:46:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:47:00.214542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e17b7925-9b4d-42e9-9df2-73f3bd185b48 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:00.222398 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e17b7925-9b4d-42e9-9df2-73f3bd185b48 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1516 microversion: 2.1 time: 0.180079 Sep 08 13:47:00.222996 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3229/6326] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:00 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1516 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:01.248311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3c717012-c99c-40c1-818c-5266500b78d8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:01.248973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3c717012-c99c-40c1-818c-5266500b78d8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:01.255424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c717012-c99c-40c1-818c-5266500b78d8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:01.255918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c717012-c99c-40c1-818c-5266500b78d8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:01.256364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c717012-c99c-40c1-818c-5266500b78d8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:01.257075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c717012-c99c-40c1-818c-5266500b78d8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:01.257537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c717012-c99c-40c1-818c-5266500b78d8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:01.257970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c717012-c99c-40c1-818c-5266500b78d8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:01.394270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3c717012-c99c-40c1-818c-5266500b78d8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:01.402734 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3c717012-c99c-40c1-818c-5266500b78d8 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1514 microversion: 2.1 time: 0.160410 Sep 08 13:47:01.403368 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3098/6327] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:01 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:47:02.145777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-cadcbb5f-744b-494e-b655-058dacd1c762 req-7ea536c1-aa11-457c-9b62-f579eefbcb0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eee99b4-c911-48b8-9639-0c235a286eb7", "tag": "a84bc41a-8154-4b84-b345-0e80cf1c3859"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:47:02.156052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cadcbb5f-744b-494e-b655-058dacd1c762 req-7ea536c1-aa11-457c-9b62-f579eefbcb0b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:02.156545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cadcbb5f-744b-494e-b655-058dacd1c762 req-7ea536c1-aa11-457c-9b62-f579eefbcb0b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:02.156991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-cadcbb5f-744b-494e-b655-058dacd1c762 req-7ea536c1-aa11-457c-9b62-f579eefbcb0b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:02.168542 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-cadcbb5f-744b-494e-b655-058dacd1c762 req-7ea536c1-aa11-457c-9b62-f579eefbcb0b service nova] Creating event network-changed:a84bc41a-8154-4b84-b345-0e80cf1c3859 for instance 2eee99b4-c911-48b8-9639-0c235a286eb7 on n-h1-852084-10 Sep 08 13:47:02.173856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-cadcbb5f-744b-494e-b655-058dacd1c762 req-7ea536c1-aa11-457c-9b62-f579eefbcb0b service nova] Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:47:02.185283 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-cadcbb5f-744b-494e-b655-058dacd1c762 req-7ea536c1-aa11-457c-9b62-f579eefbcb0b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043105 Sep 08 13:47:02.185898 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3230/6328] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:47:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:47:02.431606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-64a8d4eb-3ffc-47e9-9d60-9938ae273d09 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:02.433191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-64a8d4eb-3ffc-47e9-9d60-9938ae273d09 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:02.440581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=28 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:02.447068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64a8d4eb-3ffc-47e9-9d60-9938ae273d09 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:02.448692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64a8d4eb-3ffc-47e9-9d60-9938ae273d09 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:02.449132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64a8d4eb-3ffc-47e9-9d60-9938ae273d09 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:02.449896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64a8d4eb-3ffc-47e9-9d60-9938ae273d09 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:02.450632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64a8d4eb-3ffc-47e9-9d60-9938ae273d09 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:02.451076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64a8d4eb-3ffc-47e9-9d60-9938ae273d09 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:02.458448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=82 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:02.692566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-64a8d4eb-3ffc-47e9-9d60-9938ae273d09 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:02.701756 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-64a8d4eb-3ffc-47e9-9d60-9938ae273d09 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1514 microversion: 2.1 time: 0.278477 Sep 08 13:47:02.706417 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3099/6329] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:02 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:03.727871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-74270513-17a4-4b59-a22a-8f70ffde4e31 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:03.728587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-74270513-17a4-4b59-a22a-8f70ffde4e31 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:03.730590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=28 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:03.736057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74270513-17a4-4b59-a22a-8f70ffde4e31 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:03.736548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74270513-17a4-4b59-a22a-8f70ffde4e31 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:03.736994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74270513-17a4-4b59-a22a-8f70ffde4e31 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:03.737804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74270513-17a4-4b59-a22a-8f70ffde4e31 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:03.738264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74270513-17a4-4b59-a22a-8f70ffde4e31 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:03.738695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74270513-17a4-4b59-a22a-8f70ffde4e31 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:03.743197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=82 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:03.875509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-74270513-17a4-4b59-a22a-8f70ffde4e31 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:03.883479 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-74270513-17a4-4b59-a22a-8f70ffde4e31 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1511 microversion: 2.1 time: 0.161073 Sep 08 13:47:03.884074 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3231/6330] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:03 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:03.909306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5eac1484-a422-4732-bb80-cb3301319564 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:03.909884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5eac1484-a422-4732-bb80-cb3301319564 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:03.916930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eac1484-a422-4732-bb80-cb3301319564 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:03.917441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eac1484-a422-4732-bb80-cb3301319564 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:03.917877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eac1484-a422-4732-bb80-cb3301319564 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:03.918563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eac1484-a422-4732-bb80-cb3301319564 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:03.919017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eac1484-a422-4732-bb80-cb3301319564 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:03.919460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eac1484-a422-4732-bb80-cb3301319564 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:03.951200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5eac1484-a422-4732-bb80-cb3301319564 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:47:04.004189 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.compute.api [None req-5eac1484-a422-4732-bb80-cb3301319564 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Found an unconfirmed migration during delete, id: 16, status: finished Sep 08 13:47:05.712826 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5eac1484-a422-4732-bb80-cb3301319564 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 204 len: 0 microversion: 2.1 time: 1.807386 Sep 08 13:47:05.714323 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3100/6331] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:47:03 2022] DELETE /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 0 bytes in 1809 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:47:05.723937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c6fc3c82-3db2-4a26-aa0b-5cfd95bd6c11 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:05.723937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c6fc3c82-3db2-4a26-aa0b-5cfd95bd6c11 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:05.730341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6fc3c82-3db2-4a26-aa0b-5cfd95bd6c11 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:05.730841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6fc3c82-3db2-4a26-aa0b-5cfd95bd6c11 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:05.731348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6fc3c82-3db2-4a26-aa0b-5cfd95bd6c11 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:05.732063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6fc3c82-3db2-4a26-aa0b-5cfd95bd6c11 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:05.732526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6fc3c82-3db2-4a26-aa0b-5cfd95bd6c11 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:05.732961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6fc3c82-3db2-4a26-aa0b-5cfd95bd6c11 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:05.875849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c6fc3c82-3db2-4a26-aa0b-5cfd95bd6c11 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:05.883696 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c6fc3c82-3db2-4a26-aa0b-5cfd95bd6c11 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1503 microversion: 2.1 time: 0.165031 Sep 08 13:47:05.884281 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3232/6332] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:05 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:06.421564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2ba05827-bf21-4a9b-847e-a92f93397afb req-c769add1-e5ed-4939-be40-ff4ee77252a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eee99b4-c911-48b8-9639-0c235a286eb7", "name": "network-vif-plugged", "status": "completed", "tag": "a84bc41a-8154-4b84-b345-0e80cf1c3859"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:47:06.432841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2ba05827-bf21-4a9b-847e-a92f93397afb req-c769add1-e5ed-4939-be40-ff4ee77252a2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:06.433440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2ba05827-bf21-4a9b-847e-a92f93397afb req-c769add1-e5ed-4939-be40-ff4ee77252a2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:06.433946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2ba05827-bf21-4a9b-847e-a92f93397afb req-c769add1-e5ed-4939-be40-ff4ee77252a2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:06.446008 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2ba05827-bf21-4a9b-847e-a92f93397afb req-c769add1-e5ed-4939-be40-ff4ee77252a2 service nova] Creating event network-vif-plugged:a84bc41a-8154-4b84-b345-0e80cf1c3859 for instance 2eee99b4-c911-48b8-9639-0c235a286eb7 on n-h1-852084-10 Sep 08 13:47:06.451912 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2ba05827-bf21-4a9b-847e-a92f93397afb req-c769add1-e5ed-4939-be40-ff4ee77252a2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034479 Sep 08 13:47:06.452515 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3101/6333] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:47:06.907811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-411fb423-543c-4dbf-bd59-8d6de9c6b883 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:06.908471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-411fb423-543c-4dbf-bd59-8d6de9c6b883 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:06.915447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-411fb423-543c-4dbf-bd59-8d6de9c6b883 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:06.915970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-411fb423-543c-4dbf-bd59-8d6de9c6b883 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:06.916423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-411fb423-543c-4dbf-bd59-8d6de9c6b883 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:06.917159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-411fb423-543c-4dbf-bd59-8d6de9c6b883 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:06.917622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-411fb423-543c-4dbf-bd59-8d6de9c6b883 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:06.918066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-411fb423-543c-4dbf-bd59-8d6de9c6b883 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:07.050858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-411fb423-543c-4dbf-bd59-8d6de9c6b883 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a4d8dd14ea644f398d946c4896d37394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00dbda7a7884e3f8e1c88bfe8a54c7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:07.059778 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-411fb423-543c-4dbf-bd59-8d6de9c6b883 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 200 len: 1503 microversion: 2.1 time: 0.156097 Sep 08 13:47:07.060370 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3233/6334] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:06 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:07.512999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c6c239a5-3124-4798-bd22-da2f83db6477 req-2e320d0a-62cb-4bf3-ab1f-11423135424b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eee99b4-c911-48b8-9639-0c235a286eb7", "name": "network-vif-deleted", "tag": "a84bc41a-8154-4b84-b345-0e80cf1c3859"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:47:07.524522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c6c239a5-3124-4798-bd22-da2f83db6477 req-2e320d0a-62cb-4bf3-ab1f-11423135424b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:07.525123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c6c239a5-3124-4798-bd22-da2f83db6477 req-2e320d0a-62cb-4bf3-ab1f-11423135424b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:07.525614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c6c239a5-3124-4798-bd22-da2f83db6477 req-2e320d0a-62cb-4bf3-ab1f-11423135424b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:07.538755 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c6c239a5-3124-4798-bd22-da2f83db6477 req-2e320d0a-62cb-4bf3-ab1f-11423135424b service nova] Creating event network-vif-deleted:a84bc41a-8154-4b84-b345-0e80cf1c3859 for instance 2eee99b4-c911-48b8-9639-0c235a286eb7 on n-h1-852084-10 Sep 08 13:47:07.544173 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c6c239a5-3124-4798-bd22-da2f83db6477 req-2e320d0a-62cb-4bf3-ab1f-11423135424b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037611 Sep 08 13:47:07.545001 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3102/6335] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:47:08.082592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-831871ff-acc0-4827-8428-7d83bc281973 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:08.083219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-831871ff-acc0-4827-8428-7d83bc281973 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:08.091091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-831871ff-acc0-4827-8428-7d83bc281973 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:08.091618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-831871ff-acc0-4827-8428-7d83bc281973 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:08.092097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-831871ff-acc0-4827-8428-7d83bc281973 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:08.092835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-831871ff-acc0-4827-8428-7d83bc281973 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:08.093302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-831871ff-acc0-4827-8428-7d83bc281973 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:08.093735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-831871ff-acc0-4827-8428-7d83bc281973 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:08.107863 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-831871ff-acc0-4827-8428-7d83bc281973 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] HTTP exception thrown: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-831871ff-acc0-4827-8428-7d83bc281973 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Request method failure captured: Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 HTTP/1.1 Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfIrnY336dIzetNoYLXUeg7jTjSSTWTfw8Y4UjE0eP6mtNQYPJbCCI0BmSKkeiP5DbMd_qOmdZv_yBWZGiPMFRgTPsSQSQcyojz_0WkNAHxJ-rQoBYsYmWO1wWtsIMVa8zdMclL-z-VWczze79W5edCK5dk0TyeoyNea32WT9xFrHLk Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b00dbda7a7884e3f8e1c88bfe8a54c7e Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-671329275 Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b00dbda7a7884e3f8e1c88bfe8a54c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b00dbda7a7884e3f8e1c88bfe8a54c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b00dbda7a7884e3f8e1c88bfe8a54c7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b00dbda7a7884e3f8e1c88bfe8a54c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-671329275 Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b00dbda7a7884e3f8e1c88bfe8a54c7e Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-671329275 Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-671329275-project Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: a4d8dd14ea644f398d946c4896d37394 Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-671329275-project Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '2eee99b4-c911-48b8-9639-0c235a286eb7'} Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:47:08.109554 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.114111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:47:08.114111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:47:08.114111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:47:08.114111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:47:08.114111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:47:08.114111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.114111 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.114111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-831871ff-acc0-4827-8428-7d83bc281973 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Returning 404 to user: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:47:08.114111 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-831871ff-acc0-4827-8428-7d83bc281973 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 404 len: 111 microversion: 2.1 time: 0.032334 Sep 08 13:47:08.114111 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3234/6336] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:08 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:47:08.131465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-495d103d-934f-4e74-b100-8eb04c8e27f3 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:08.132022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-495d103d-934f-4e74-b100-8eb04c8e27f3 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:08.139125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-495d103d-934f-4e74-b100-8eb04c8e27f3 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:08.139641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-495d103d-934f-4e74-b100-8eb04c8e27f3 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:08.140152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-495d103d-934f-4e74-b100-8eb04c8e27f3 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:08.140856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-495d103d-934f-4e74-b100-8eb04c8e27f3 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:08.141307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-495d103d-934f-4e74-b100-8eb04c8e27f3 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:08.141730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-495d103d-934f-4e74-b100-8eb04c8e27f3 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:08.155874 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-495d103d-934f-4e74-b100-8eb04c8e27f3 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] HTTP exception thrown: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-495d103d-934f-4e74-b100-8eb04c8e27f3 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Request method failure captured: Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 HTTP/1.1 Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfIrnY336dIzetNoYLXUeg7jTjSSTWTfw8Y4UjE0eP6mtNQYPJbCCI0BmSKkeiP5DbMd_qOmdZv_yBWZGiPMFRgTPsSQSQcyojz_0WkNAHxJ-rQoBYsYmWO1wWtsIMVa8zdMclL-z-VWczze79W5edCK5dk0TyeoyNea32WT9xFrHLk Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: b00dbda7a7884e3f8e1c88bfe8a54c7e Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-DeleteServersTestJSON-671329275 Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b00dbda7a7884e3f8e1c88bfe8a54c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b00dbda7a7884e3f8e1c88bfe8a54c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b00dbda7a7884e3f8e1c88bfe8a54c7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b00dbda7a7884e3f8e1c88bfe8a54c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-DeleteServersTestJSON-671329275 Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: b00dbda7a7884e3f8e1c88bfe8a54c7e Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-DeleteServersTestJSON-671329275 Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-DeleteServersTestJSON-671329275-project Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: a4d8dd14ea644f398d946c4896d37394 Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-DeleteServersTestJSON-671329275-project Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '2eee99b4-c911-48b8-9639-0c235a286eb7'} Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:47:08.157561 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-495d103d-934f-4e74-b100-8eb04c8e27f3 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Returning 404 to user: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-495d103d-934f-4e74-b100-8eb04c8e27f3 tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 404 len: 111 microversion: 2.1 time: 0.032529 Sep 08 13:47:08.161486 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3103/6337] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:47:08 2022] DELETE /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:47:08.167828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c30521d-ffa1-4708-a7e7-a4f6fc0f77da tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:08.168465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6c30521d-ffa1-4708-a7e7-a4f6fc0f77da tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] [instance: 2eee99b4-c911-48b8-9639-0c235a286eb7] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:08.174584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c30521d-ffa1-4708-a7e7-a4f6fc0f77da tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:08.175079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c30521d-ffa1-4708-a7e7-a4f6fc0f77da tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:08.175559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c30521d-ffa1-4708-a7e7-a4f6fc0f77da tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:08.176265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c30521d-ffa1-4708-a7e7-a4f6fc0f77da tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:08.176749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c30521d-ffa1-4708-a7e7-a4f6fc0f77da tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:08.177167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c30521d-ffa1-4708-a7e7-a4f6fc0f77da tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:08.192342 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-6c30521d-ffa1-4708-a7e7-a4f6fc0f77da tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] HTTP exception thrown: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c30521d-ffa1-4708-a7e7-a4f6fc0f77da tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Request method failure captured: Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 HTTP/1.1 Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfIrnY336dIzetNoYLXUeg7jTjSSTWTfw8Y4UjE0eP6mtNQYPJbCCI0BmSKkeiP5DbMd_qOmdZv_yBWZGiPMFRgTPsSQSQcyojz_0WkNAHxJ-rQoBYsYmWO1wWtsIMVa8zdMclL-z-VWczze79W5edCK5dk0TyeoyNea32WT9xFrHLk Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: b00dbda7a7884e3f8e1c88bfe8a54c7e Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-DeleteServersTestJSON-671329275 Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b00dbda7a7884e3f8e1c88bfe8a54c7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b00dbda7a7884e3f8e1c88bfe8a54c7e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b00dbda7a7884e3f8e1c88bfe8a54c7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b00dbda7a7884e3f8e1c88bfe8a54c7e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-DeleteServersTestJSON-671329275 Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: b00dbda7a7884e3f8e1c88bfe8a54c7e Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-DeleteServersTestJSON-671329275 Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-DeleteServersTestJSON-671329275-project Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: a4d8dd14ea644f398d946c4896d37394 Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-DeleteServersTestJSON-671329275-project Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '2eee99b4-c911-48b8-9639-0c235a286eb7'} Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:47:08.194058 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.198635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:47:08.198635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:47:08.198635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:47:08.198635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:47:08.198635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:47:08.198635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. Sep 08 13:47:08.198635 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:47:08.198635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c30521d-ffa1-4708-a7e7-a4f6fc0f77da tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] Returning 404 to user: Instance 2eee99b4-c911-48b8-9639-0c235a286eb7 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:47:08.198635 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6c30521d-ffa1-4708-a7e7-a4f6fc0f77da tempest-DeleteServersTestJSON-671329275 tempest-DeleteServersTestJSON-671329275-project] 10.222.0.78 "GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7" status: 404 len: 111 microversion: 2.1 time: 0.031698 Sep 08 13:47:08.198635 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3235/6338] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:08 2022] GET /compute/v2.1/servers/2eee99b4-c911-48b8-9639-0c235a286eb7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:47:17.270503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-121765468", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "c0c7c3f7-e7ec-47b7-a511-f6edc795f5ae"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:47:17.326754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] validate_networks() for [('c0c7c3f7-e7ec-47b7-a511-f6edc795f5ae', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:47:17.703103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:47:17.703591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:47:17.704070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:47:17.704482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:47:17.704896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:47:17.714554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:17.715158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:17.715643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:17.716779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:17.717531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:17.718198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:17.745382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Getting quotas for project 003eaae0b49a4b7aa10b32d6047c82fd. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:47:17.753871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Getting quotas for user 6a2507cbdeb640149b0a09405f28e2f8 and project 003eaae0b49a4b7aa10b32d6047c82fd. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:47:17.774243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:47:17.776808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:47:17.829757 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7df1f036-bf36-49dd-bac8-606d3e30f6fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.685594 Sep 08 13:47:17.830421 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3104/6339] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:47:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:47:17.842942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e0543936-3e5e-4440-84c6-1302f5207933 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:17.843647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e0543936-3e5e-4440-84c6-1302f5207933 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:17.903486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e0543936-3e5e-4440-84c6-1302f5207933 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:17.910582 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e0543936-3e5e-4440-84c6-1302f5207933 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1217 microversion: 2.1 time: 0.072334 Sep 08 13:47:17.911423 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3236/6340] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:17 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:18.937230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-97743f6f-c4bd-4776-809e-cb8b1b550869 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:18.938634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-97743f6f-c4bd-4776-809e-cb8b1b550869 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:18.948242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97743f6f-c4bd-4776-809e-cb8b1b550869 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:18.949107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97743f6f-c4bd-4776-809e-cb8b1b550869 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:18.949742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97743f6f-c4bd-4776-809e-cb8b1b550869 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:18.950676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97743f6f-c4bd-4776-809e-cb8b1b550869 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:18.952005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97743f6f-c4bd-4776-809e-cb8b1b550869 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:18.952671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97743f6f-c4bd-4776-809e-cb8b1b550869 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:19.033840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-97743f6f-c4bd-4776-809e-cb8b1b550869 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:19.043090 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-97743f6f-c4bd-4776-809e-cb8b1b550869 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1287 microversion: 2.1 time: 0.112699 Sep 08 13:47:19.043903 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3105/6341] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:18 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:20.067359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bb9cf735-b229-4bb9-be8f-6982cf0c0ce6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:20.067985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bb9cf735-b229-4bb9-be8f-6982cf0c0ce6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:20.069961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=21 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:20.083103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb9cf735-b229-4bb9-be8f-6982cf0c0ce6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:20.083646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb9cf735-b229-4bb9-be8f-6982cf0c0ce6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:20.084094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb9cf735-b229-4bb9-be8f-6982cf0c0ce6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:20.084812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb9cf735-b229-4bb9-be8f-6982cf0c0ce6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:20.085277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb9cf735-b229-4bb9-be8f-6982cf0c0ce6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:20.085709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb9cf735-b229-4bb9-be8f-6982cf0c0ce6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:20.243100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bb9cf735-b229-4bb9-be8f-6982cf0c0ce6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:20.253556 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bb9cf735-b229-4bb9-be8f-6982cf0c0ce6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1317 microversion: 2.1 time: 0.189625 Sep 08 13:47:20.254925 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3237/6342] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:20 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1317 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:20.651202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b0a97c53-4778-4f31-ad14-1fe08738c16c req-a7d6d19b-26c4-4601-9efa-916dc871f914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f", "tag": "786253f1-3ba8-4bb1-95b3-0a1e49ff4181"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:47:20.668798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b0a97c53-4778-4f31-ad14-1fe08738c16c req-a7d6d19b-26c4-4601-9efa-916dc871f914 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:20.681098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b0a97c53-4778-4f31-ad14-1fe08738c16c req-a7d6d19b-26c4-4601-9efa-916dc871f914 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:20.683040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b0a97c53-4778-4f31-ad14-1fe08738c16c req-a7d6d19b-26c4-4601-9efa-916dc871f914 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:20.702655 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b0a97c53-4778-4f31-ad14-1fe08738c16c req-a7d6d19b-26c4-4601-9efa-916dc871f914 service nova] Creating event network-changed:786253f1-3ba8-4bb1-95b3-0a1e49ff4181 for instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f on n-h1-852084-10 Sep 08 13:47:20.712612 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b0a97c53-4778-4f31-ad14-1fe08738c16c req-a7d6d19b-26c4-4601-9efa-916dc871f914 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065311 Sep 08 13:47:20.716071 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3106/6343] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:47:21.277732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-53bea52b-c509-4be7-bc18-ade768a99c0d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:21.278388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-53bea52b-c509-4be7-bc18-ade768a99c0d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:21.285441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53bea52b-c509-4be7-bc18-ade768a99c0d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:21.285940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53bea52b-c509-4be7-bc18-ade768a99c0d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:21.286395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53bea52b-c509-4be7-bc18-ade768a99c0d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:21.287106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53bea52b-c509-4be7-bc18-ade768a99c0d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:21.287607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53bea52b-c509-4be7-bc18-ade768a99c0d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:21.288050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-53bea52b-c509-4be7-bc18-ade768a99c0d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:21.425722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-53bea52b-c509-4be7-bc18-ade768a99c0d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:21.434000 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-53bea52b-c509-4be7-bc18-ade768a99c0d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1317 microversion: 2.1 time: 0.160149 Sep 08 13:47:21.434561 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3238/6344] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:21 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:22.458545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fea108dc-246a-4fae-91eb-1d44110997f8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:22.459364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fea108dc-246a-4fae-91eb-1d44110997f8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:22.466502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fea108dc-246a-4fae-91eb-1d44110997f8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:22.466990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fea108dc-246a-4fae-91eb-1d44110997f8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:22.467528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fea108dc-246a-4fae-91eb-1d44110997f8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:22.468220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fea108dc-246a-4fae-91eb-1d44110997f8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:22.468677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fea108dc-246a-4fae-91eb-1d44110997f8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:22.469107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fea108dc-246a-4fae-91eb-1d44110997f8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:22.615191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fea108dc-246a-4fae-91eb-1d44110997f8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:22.623291 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fea108dc-246a-4fae-91eb-1d44110997f8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1317 microversion: 2.1 time: 0.169125 Sep 08 13:47:22.624395 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3107/6345] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:22 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:23.647298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-855c824c-8907-41bb-97f7-bd1b3675eb26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:23.647954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-855c824c-8907-41bb-97f7-bd1b3675eb26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:23.655315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-855c824c-8907-41bb-97f7-bd1b3675eb26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:23.655811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-855c824c-8907-41bb-97f7-bd1b3675eb26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:23.656258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-855c824c-8907-41bb-97f7-bd1b3675eb26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:23.656952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-855c824c-8907-41bb-97f7-bd1b3675eb26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:23.657415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-855c824c-8907-41bb-97f7-bd1b3675eb26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:23.657850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-855c824c-8907-41bb-97f7-bd1b3675eb26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:23.806526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-855c824c-8907-41bb-97f7-bd1b3675eb26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:23.814855 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-855c824c-8907-41bb-97f7-bd1b3675eb26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1317 microversion: 2.1 time: 0.171482 Sep 08 13:47:23.815509 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3239/6346] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:23 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:24.838943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ca9bcc49-803b-46e8-a877-b613a5173c1d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:24.839521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ca9bcc49-803b-46e8-a877-b613a5173c1d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:24.846684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca9bcc49-803b-46e8-a877-b613a5173c1d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:24.847165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca9bcc49-803b-46e8-a877-b613a5173c1d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:24.847633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca9bcc49-803b-46e8-a877-b613a5173c1d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:24.848344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca9bcc49-803b-46e8-a877-b613a5173c1d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:24.848805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca9bcc49-803b-46e8-a877-b613a5173c1d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:24.849238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca9bcc49-803b-46e8-a877-b613a5173c1d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:24.992687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ca9bcc49-803b-46e8-a877-b613a5173c1d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:25.001134 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ca9bcc49-803b-46e8-a877-b613a5173c1d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1317 microversion: 2.1 time: 0.166689 Sep 08 13:47:25.001721 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3108/6347] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:24 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:26.024187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-013ed3f5-ede9-4354-a473-516fb6fe71fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:26.024871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-013ed3f5-ede9-4354-a473-516fb6fe71fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:26.032220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013ed3f5-ede9-4354-a473-516fb6fe71fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:26.032721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013ed3f5-ede9-4354-a473-516fb6fe71fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:26.033172 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013ed3f5-ede9-4354-a473-516fb6fe71fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:26.033908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013ed3f5-ede9-4354-a473-516fb6fe71fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:26.034375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013ed3f5-ede9-4354-a473-516fb6fe71fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:26.034815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013ed3f5-ede9-4354-a473-516fb6fe71fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:26.171418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-013ed3f5-ede9-4354-a473-516fb6fe71fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:26.179242 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-013ed3f5-ede9-4354-a473-516fb6fe71fa tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1317 microversion: 2.1 time: 0.159141 Sep 08 13:47:26.179896 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3240/6348] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:26 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1317 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:26.545645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9eba58e2-90a4-40cb-8180-3e5f171740ff req-687a68fb-0c44-494a-be91-186847a010c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f", "name": "network-vif-plugged", "status": "completed", "tag": "786253f1-3ba8-4bb1-95b3-0a1e49ff4181"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:47:26.555755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9eba58e2-90a4-40cb-8180-3e5f171740ff req-687a68fb-0c44-494a-be91-186847a010c9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:26.556234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9eba58e2-90a4-40cb-8180-3e5f171740ff req-687a68fb-0c44-494a-be91-186847a010c9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:26.556662 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9eba58e2-90a4-40cb-8180-3e5f171740ff req-687a68fb-0c44-494a-be91-186847a010c9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:26.568103 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9eba58e2-90a4-40cb-8180-3e5f171740ff req-687a68fb-0c44-494a-be91-186847a010c9 service nova] Creating event network-vif-plugged:786253f1-3ba8-4bb1-95b3-0a1e49ff4181 for instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f on n-h1-852084-10 Sep 08 13:47:26.573174 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9eba58e2-90a4-40cb-8180-3e5f171740ff req-687a68fb-0c44-494a-be91-186847a010c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091910 Sep 08 13:47:26.573716 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3109/6349] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:47:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:47:27.202381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f4d9e64-21f5-48eb-ab57-a8ea0aca4a3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:27.203014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8f4d9e64-21f5-48eb-ab57-a8ea0aca4a3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:27.209902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f4d9e64-21f5-48eb-ab57-a8ea0aca4a3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:27.210404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f4d9e64-21f5-48eb-ab57-a8ea0aca4a3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:27.210852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f4d9e64-21f5-48eb-ab57-a8ea0aca4a3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:27.211592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f4d9e64-21f5-48eb-ab57-a8ea0aca4a3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:27.212066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f4d9e64-21f5-48eb-ab57-a8ea0aca4a3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:27.212503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f4d9e64-21f5-48eb-ab57-a8ea0aca4a3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:27.345347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8f4d9e64-21f5-48eb-ab57-a8ea0aca4a3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:27.353281 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f4d9e64-21f5-48eb-ab57-a8ea0aca4a3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1317 microversion: 2.1 time: 0.155132 Sep 08 13:47:27.354467 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3241/6350] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:27 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:28.374723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:28.375509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:28.380073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6ca31a0c-b58a-4f3a-a621-5fe5ada8cb60 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:28.380883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6ca31a0c-b58a-4f3a-a621-5fe5ada8cb60 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:28.389093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ca31a0c-b58a-4f3a-a621-5fe5ada8cb60 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:28.389620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ca31a0c-b58a-4f3a-a621-5fe5ada8cb60 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:28.390014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ca31a0c-b58a-4f3a-a621-5fe5ada8cb60 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:28.390718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ca31a0c-b58a-4f3a-a621-5fe5ada8cb60 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:28.392260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ca31a0c-b58a-4f3a-a621-5fe5ada8cb60 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:28.392260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ca31a0c-b58a-4f3a-a621-5fe5ada8cb60 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:28.536031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6ca31a0c-b58a-4f3a-a621-5fe5ada8cb60 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:28.544574 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6ca31a0c-b58a-4f3a-a621-5fe5ada8cb60 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1507 microversion: 2.1 time: 0.171595 Sep 08 13:47:28.545172 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3110/6351] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:28 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1507 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:28.567397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9aeeffe7-ddd9-49e0-8a12-36a1d88f8245 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:28.568121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9aeeffe7-ddd9-49e0-8a12-36a1d88f8245 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:28.569926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:28.577099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9aeeffe7-ddd9-49e0-8a12-36a1d88f8245 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:28.577596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9aeeffe7-ddd9-49e0-8a12-36a1d88f8245 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:28.578050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9aeeffe7-ddd9-49e0-8a12-36a1d88f8245 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:28.579331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9aeeffe7-ddd9-49e0-8a12-36a1d88f8245 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:28.580013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9aeeffe7-ddd9-49e0-8a12-36a1d88f8245 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:28.580461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9aeeffe7-ddd9-49e0-8a12-36a1d88f8245 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:28.726134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9aeeffe7-ddd9-49e0-8a12-36a1d88f8245 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:28.734476 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9aeeffe7-ddd9-49e0-8a12-36a1d88f8245 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1507 microversion: 2.1 time: 0.170933 Sep 08 13:47:28.735066 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3242/6352] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:28 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:28.756928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9d0a3bac-d898-464c-bd29-00fa64ec1133 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:47:28.759447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9d0a3bac-d898-464c-bd29-00fa64ec1133 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:28.765664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d0a3bac-d898-464c-bd29-00fa64ec1133 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:28.766159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d0a3bac-d898-464c-bd29-00fa64ec1133 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:28.766597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d0a3bac-d898-464c-bd29-00fa64ec1133 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:28.767319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d0a3bac-d898-464c-bd29-00fa64ec1133 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:28.767766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d0a3bac-d898-464c-bd29-00fa64ec1133 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:28.768188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d0a3bac-d898-464c-bd29-00fa64ec1133 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:28.832066 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9d0a3bac-d898-464c-bd29-00fa64ec1133 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "PUT /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1079 microversion: 2.1 time: 0.078897 Sep 08 13:47:28.835438 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3111/6353] 10.222.0.78 () {60 vars in 1256 bytes} [Thu Sep 8 13:47:28 2022] PUT /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1079 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:28.852707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-864110d9-00f6-4cef-b9e0-29bd522facaf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:28.853337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-864110d9-00f6-4cef-b9e0-29bd522facaf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:28.860025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-864110d9-00f6-4cef-b9e0-29bd522facaf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:28.860522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-864110d9-00f6-4cef-b9e0-29bd522facaf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:28.860972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-864110d9-00f6-4cef-b9e0-29bd522facaf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:28.861874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-864110d9-00f6-4cef-b9e0-29bd522facaf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:28.862340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-864110d9-00f6-4cef-b9e0-29bd522facaf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:28.862775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-864110d9-00f6-4cef-b9e0-29bd522facaf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:29.005411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-864110d9-00f6-4cef-b9e0-29bd522facaf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:29.013547 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-864110d9-00f6-4cef-b9e0-29bd522facaf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1505 microversion: 2.1 time: 0.164709 Sep 08 13:47:29.014133 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3243/6354] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:28 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1505 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:29.035898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54a49377-23d9-42f1-815d-2d8393e04c59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:29.036518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54a49377-23d9-42f1-815d-2d8393e04c59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:29.043246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54a49377-23d9-42f1-815d-2d8393e04c59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:29.043734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54a49377-23d9-42f1-815d-2d8393e04c59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:29.044172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54a49377-23d9-42f1-815d-2d8393e04c59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:29.044861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54a49377-23d9-42f1-815d-2d8393e04c59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:29.045313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54a49377-23d9-42f1-815d-2d8393e04c59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:29.045735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54a49377-23d9-42f1-815d-2d8393e04c59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:29.177679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54a49377-23d9-42f1-815d-2d8393e04c59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:29.185583 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54a49377-23d9-42f1-815d-2d8393e04c59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1505 microversion: 2.1 time: 0.153596 Sep 08 13:47:29.186168 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3112/6355] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:29 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:29.208540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:47:29.210866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:29.217582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:29.218073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:29.218518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:29.219219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:29.219731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:29.220163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:29.251262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:29.257231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Old instance type m1.heat2, new instance type m1.heat {{(pid=128970) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 13:47:29.264472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:47:29.264902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:47:29.265385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:47:29.265801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:47:29.266221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:47:29.332979 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d4c8394c-be18-44e3-be2d-f8d891a2db3d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "POST /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f/action" status: 202 len: 0 microversion: 2.1 time: 0.128372 Sep 08 13:47:29.333609 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3244/6356] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:47:29 2022] POST /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:47:29.343193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc402171-092b-44ab-99ef-5cdb11fb64fb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:29.343845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cc402171-092b-44ab-99ef-5cdb11fb64fb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:29.349834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc402171-092b-44ab-99ef-5cdb11fb64fb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:29.350334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc402171-092b-44ab-99ef-5cdb11fb64fb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:29.350774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc402171-092b-44ab-99ef-5cdb11fb64fb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:29.351945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc402171-092b-44ab-99ef-5cdb11fb64fb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:29.352438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc402171-092b-44ab-99ef-5cdb11fb64fb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:29.352877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc402171-092b-44ab-99ef-5cdb11fb64fb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:29.507897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cc402171-092b-44ab-99ef-5cdb11fb64fb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:29.517177 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cc402171-092b-44ab-99ef-5cdb11fb64fb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1516 microversion: 2.1 time: 0.178685 Sep 08 13:47:29.517788 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3113/6357] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:29 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1516 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:30.539460 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b79e001e-b023-4c80-9552-70b1b1869b79 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:30.540100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b79e001e-b023-4c80-9552-70b1b1869b79 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:30.548514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b79e001e-b023-4c80-9552-70b1b1869b79 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:30.549043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b79e001e-b023-4c80-9552-70b1b1869b79 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:30.549500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b79e001e-b023-4c80-9552-70b1b1869b79 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:30.550217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b79e001e-b023-4c80-9552-70b1b1869b79 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:30.550689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b79e001e-b023-4c80-9552-70b1b1869b79 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:30.551147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b79e001e-b023-4c80-9552-70b1b1869b79 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:30.689888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b79e001e-b023-4c80-9552-70b1b1869b79 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:30.698596 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b79e001e-b023-4c80-9552-70b1b1869b79 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1516 microversion: 2.1 time: 0.163097 Sep 08 13:47:30.699197 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3245/6358] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:30 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1516 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:31.722813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-baf40350-eab2-4bce-8911-5035c97b0fbf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:31.723454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-baf40350-eab2-4bce-8911-5035c97b0fbf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:31.731161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf40350-eab2-4bce-8911-5035c97b0fbf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:31.731690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf40350-eab2-4bce-8911-5035c97b0fbf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:31.732169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf40350-eab2-4bce-8911-5035c97b0fbf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:31.732863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf40350-eab2-4bce-8911-5035c97b0fbf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:31.733352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf40350-eab2-4bce-8911-5035c97b0fbf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:31.733773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-baf40350-eab2-4bce-8911-5035c97b0fbf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:31.881901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-baf40350-eab2-4bce-8911-5035c97b0fbf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:31.891951 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-baf40350-eab2-4bce-8911-5035c97b0fbf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.172641 Sep 08 13:47:31.892699 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3114/6359] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:31 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:32.916730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a6bcf2d6-5bef-4d60-9860-265a8a6c27ae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:32.917279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a6bcf2d6-5bef-4d60-9860-265a8a6c27ae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:32.924560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6bcf2d6-5bef-4d60-9860-265a8a6c27ae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:32.925187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6bcf2d6-5bef-4d60-9860-265a8a6c27ae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:32.925739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6bcf2d6-5bef-4d60-9860-265a8a6c27ae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:32.926455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6bcf2d6-5bef-4d60-9860-265a8a6c27ae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:32.926926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6bcf2d6-5bef-4d60-9860-265a8a6c27ae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:32.927404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6bcf2d6-5bef-4d60-9860-265a8a6c27ae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:33.056209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a6bcf2d6-5bef-4d60-9860-265a8a6c27ae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:33.064622 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a6bcf2d6-5bef-4d60-9860-265a8a6c27ae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.152432 Sep 08 13:47:33.065205 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3246/6360] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:32 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:34.090668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff6b81f2-27c2-4c8b-896b-34481a01b529 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:34.091390 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ff6b81f2-27c2-4c8b-896b-34481a01b529 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:34.094131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:34.099655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff6b81f2-27c2-4c8b-896b-34481a01b529 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:34.100074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff6b81f2-27c2-4c8b-896b-34481a01b529 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:34.100516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff6b81f2-27c2-4c8b-896b-34481a01b529 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:34.101234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff6b81f2-27c2-4c8b-896b-34481a01b529 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:34.101693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff6b81f2-27c2-4c8b-896b-34481a01b529 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:34.102119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff6b81f2-27c2-4c8b-896b-34481a01b529 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:34.106329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:34.243154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ff6b81f2-27c2-4c8b-896b-34481a01b529 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:34.251065 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ff6b81f2-27c2-4c8b-896b-34481a01b529 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.164955 Sep 08 13:47:34.251692 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3115/6361] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:34 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:35.275195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-24396e66-30c1-4ef3-a694-bb66a8b50504 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:35.276471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-24396e66-30c1-4ef3-a694-bb66a8b50504 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:35.279450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=38 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:35.285057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24396e66-30c1-4ef3-a694-bb66a8b50504 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:35.285564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24396e66-30c1-4ef3-a694-bb66a8b50504 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:35.286028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24396e66-30c1-4ef3-a694-bb66a8b50504 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:35.286792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24396e66-30c1-4ef3-a694-bb66a8b50504 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:35.287291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24396e66-30c1-4ef3-a694-bb66a8b50504 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:35.287670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24396e66-30c1-4ef3-a694-bb66a8b50504 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:35.424404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-24396e66-30c1-4ef3-a694-bb66a8b50504 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:35.432225 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-24396e66-30c1-4ef3-a694-bb66a8b50504 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.160888 Sep 08 13:47:35.432762 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3247/6362] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:35 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:36.456618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8aaa15fe-4ae4-4457-b30d-83f3003da66f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:36.457248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8aaa15fe-4ae4-4457-b30d-83f3003da66f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:36.464476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8aaa15fe-4ae4-4457-b30d-83f3003da66f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:36.464961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8aaa15fe-4ae4-4457-b30d-83f3003da66f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:36.465396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8aaa15fe-4ae4-4457-b30d-83f3003da66f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:36.466089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8aaa15fe-4ae4-4457-b30d-83f3003da66f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:36.466564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8aaa15fe-4ae4-4457-b30d-83f3003da66f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:36.466989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8aaa15fe-4ae4-4457-b30d-83f3003da66f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:36.601571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8aaa15fe-4ae4-4457-b30d-83f3003da66f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:36.609877 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8aaa15fe-4ae4-4457-b30d-83f3003da66f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.157197 Sep 08 13:47:36.610529 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3116/6363] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:36 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:37.634201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7921b36c-1294-46f5-8f13-2a2de215d44a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:37.635396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7921b36c-1294-46f5-8f13-2a2de215d44a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:37.642129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7921b36c-1294-46f5-8f13-2a2de215d44a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:37.642631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7921b36c-1294-46f5-8f13-2a2de215d44a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:37.643089 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7921b36c-1294-46f5-8f13-2a2de215d44a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:37.643829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7921b36c-1294-46f5-8f13-2a2de215d44a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:37.644300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7921b36c-1294-46f5-8f13-2a2de215d44a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:37.644757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7921b36c-1294-46f5-8f13-2a2de215d44a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:37.777249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7921b36c-1294-46f5-8f13-2a2de215d44a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:37.785109 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7921b36c-1294-46f5-8f13-2a2de215d44a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.154932 Sep 08 13:47:37.785691 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3248/6364] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:37 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:38.808439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9738ddb2-048e-4eb9-9a0f-a2fff4791542 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:38.808976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9738ddb2-048e-4eb9-9a0f-a2fff4791542 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:38.815959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9738ddb2-048e-4eb9-9a0f-a2fff4791542 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:38.816444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9738ddb2-048e-4eb9-9a0f-a2fff4791542 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:38.816890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9738ddb2-048e-4eb9-9a0f-a2fff4791542 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:38.817592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9738ddb2-048e-4eb9-9a0f-a2fff4791542 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:38.818052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9738ddb2-048e-4eb9-9a0f-a2fff4791542 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:38.818484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9738ddb2-048e-4eb9-9a0f-a2fff4791542 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:38.955821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9738ddb2-048e-4eb9-9a0f-a2fff4791542 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:38.964333 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9738ddb2-048e-4eb9-9a0f-a2fff4791542 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.160475 Sep 08 13:47:38.964917 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3117/6365] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:38 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:39.987877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7fb33838-2592-49f4-b1c6-9a5affa9a85c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:39.988510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7fb33838-2592-49f4-b1c6-9a5affa9a85c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:39.995736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fb33838-2592-49f4-b1c6-9a5affa9a85c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:39.996235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fb33838-2592-49f4-b1c6-9a5affa9a85c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:39.996680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fb33838-2592-49f4-b1c6-9a5affa9a85c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:39.997388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fb33838-2592-49f4-b1c6-9a5affa9a85c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:39.997851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fb33838-2592-49f4-b1c6-9a5affa9a85c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:39.998287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7fb33838-2592-49f4-b1c6-9a5affa9a85c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:40.137951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7fb33838-2592-49f4-b1c6-9a5affa9a85c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:40.145886 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7fb33838-2592-49f4-b1c6-9a5affa9a85c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.161944 Sep 08 13:47:40.146508 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3249/6366] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:39 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:41.168527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4fba370d-f1ae-44b9-81c2-2817682eb722 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:41.169169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4fba370d-f1ae-44b9-81c2-2817682eb722 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:41.176202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fba370d-f1ae-44b9-81c2-2817682eb722 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:41.176629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fba370d-f1ae-44b9-81c2-2817682eb722 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:41.177141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fba370d-f1ae-44b9-81c2-2817682eb722 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:41.177839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fba370d-f1ae-44b9-81c2-2817682eb722 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:41.178295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fba370d-f1ae-44b9-81c2-2817682eb722 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:41.178723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fba370d-f1ae-44b9-81c2-2817682eb722 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:41.311502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4fba370d-f1ae-44b9-81c2-2817682eb722 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:41.319426 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4fba370d-f1ae-44b9-81c2-2817682eb722 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.154759 Sep 08 13:47:41.320039 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3118/6367] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:41 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:42.344868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-91783f0e-173a-438d-84e5-e0a4d06bbc56 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:42.345486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-91783f0e-173a-438d-84e5-e0a4d06bbc56 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:42.352323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91783f0e-173a-438d-84e5-e0a4d06bbc56 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:42.352809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91783f0e-173a-438d-84e5-e0a4d06bbc56 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:42.353254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91783f0e-173a-438d-84e5-e0a4d06bbc56 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:42.354590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91783f0e-173a-438d-84e5-e0a4d06bbc56 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:42.355051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91783f0e-173a-438d-84e5-e0a4d06bbc56 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:42.355507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-91783f0e-173a-438d-84e5-e0a4d06bbc56 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:42.488955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-91783f0e-173a-438d-84e5-e0a4d06bbc56 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:42.497226 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-91783f0e-173a-438d-84e5-e0a4d06bbc56 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.156300 Sep 08 13:47:42.497804 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3250/6368] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:42 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:43.521533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1a7d6840-f578-4a76-a193-a23f8e375294 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:43.522147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1a7d6840-f578-4a76-a193-a23f8e375294 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:43.529800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a7d6840-f578-4a76-a193-a23f8e375294 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:43.530287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a7d6840-f578-4a76-a193-a23f8e375294 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:43.530725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a7d6840-f578-4a76-a193-a23f8e375294 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:43.531446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a7d6840-f578-4a76-a193-a23f8e375294 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:43.531897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a7d6840-f578-4a76-a193-a23f8e375294 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:43.532319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a7d6840-f578-4a76-a193-a23f8e375294 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:43.669671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1a7d6840-f578-4a76-a193-a23f8e375294 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:43.677622 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1a7d6840-f578-4a76-a193-a23f8e375294 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.160675 Sep 08 13:47:43.678313 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3119/6369] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:43 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:44.700123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-26257717-8811-45a2-83a0-ca309d0fad69 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:44.700736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-26257717-8811-45a2-83a0-ca309d0fad69 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:44.707895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26257717-8811-45a2-83a0-ca309d0fad69 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:44.708464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26257717-8811-45a2-83a0-ca309d0fad69 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:44.708831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26257717-8811-45a2-83a0-ca309d0fad69 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:44.709527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26257717-8811-45a2-83a0-ca309d0fad69 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:44.709991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26257717-8811-45a2-83a0-ca309d0fad69 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:44.710419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-26257717-8811-45a2-83a0-ca309d0fad69 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:44.838895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-26257717-8811-45a2-83a0-ca309d0fad69 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:44.848184 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-26257717-8811-45a2-83a0-ca309d0fad69 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.151983 Sep 08 13:47:44.848784 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3251/6370] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:44 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:45.872484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-628c5318-4894-4600-881c-974ca9970f6b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:45.873100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-628c5318-4894-4600-881c-974ca9970f6b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:45.882795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-628c5318-4894-4600-881c-974ca9970f6b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:45.883321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-628c5318-4894-4600-881c-974ca9970f6b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:45.883764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-628c5318-4894-4600-881c-974ca9970f6b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:45.884459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-628c5318-4894-4600-881c-974ca9970f6b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:45.885408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-628c5318-4894-4600-881c-974ca9970f6b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:45.885837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-628c5318-4894-4600-881c-974ca9970f6b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:46.019045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-628c5318-4894-4600-881c-974ca9970f6b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:46.026818 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-628c5318-4894-4600-881c-974ca9970f6b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.158411 Sep 08 13:47:46.027430 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3120/6371] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:45 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:47.052977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-74232306-51a6-4e67-a678-fbf569bc25c3 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:47.053582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-74232306-51a6-4e67-a678-fbf569bc25c3 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:47.060681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74232306-51a6-4e67-a678-fbf569bc25c3 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:47.061171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74232306-51a6-4e67-a678-fbf569bc25c3 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:47.061625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74232306-51a6-4e67-a678-fbf569bc25c3 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:47.062315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74232306-51a6-4e67-a678-fbf569bc25c3 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:47.062774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74232306-51a6-4e67-a678-fbf569bc25c3 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:47.063205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74232306-51a6-4e67-a678-fbf569bc25c3 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:47.067148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:47:47.194943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-74232306-51a6-4e67-a678-fbf569bc25c3 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:47.203191 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-74232306-51a6-4e67-a678-fbf569bc25c3 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.154109 Sep 08 13:47:47.203848 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3252/6372] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:47 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:48.226281 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d9f62379-00f6-4f55-a89c-2fb0f9ce57e6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:48.226969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d9f62379-00f6-4f55-a89c-2fb0f9ce57e6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:48.233984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9f62379-00f6-4f55-a89c-2fb0f9ce57e6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:48.234466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9f62379-00f6-4f55-a89c-2fb0f9ce57e6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:48.234903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9f62379-00f6-4f55-a89c-2fb0f9ce57e6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:48.235654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9f62379-00f6-4f55-a89c-2fb0f9ce57e6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:48.236110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9f62379-00f6-4f55-a89c-2fb0f9ce57e6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:48.236534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d9f62379-00f6-4f55-a89c-2fb0f9ce57e6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:48.384384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d9f62379-00f6-4f55-a89c-2fb0f9ce57e6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:48.392386 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d9f62379-00f6-4f55-a89c-2fb0f9ce57e6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.170218 Sep 08 13:47:48.392966 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3121/6373] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:48 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:49.416533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-87b38150-ddef-4a78-b851-19e29f434b2d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:49.417161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-87b38150-ddef-4a78-b851-19e29f434b2d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:49.424062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87b38150-ddef-4a78-b851-19e29f434b2d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:49.424564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87b38150-ddef-4a78-b851-19e29f434b2d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:49.425016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87b38150-ddef-4a78-b851-19e29f434b2d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:49.425775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87b38150-ddef-4a78-b851-19e29f434b2d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:49.426198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87b38150-ddef-4a78-b851-19e29f434b2d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:49.426640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-87b38150-ddef-4a78-b851-19e29f434b2d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:49.553807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-87b38150-ddef-4a78-b851-19e29f434b2d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:49.562249 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-87b38150-ddef-4a78-b851-19e29f434b2d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.150156 Sep 08 13:47:49.562829 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3253/6374] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:49 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:50.585547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9702fa55-8ab7-415a-8a91-fa3bc5baf9b6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:50.586163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9702fa55-8ab7-415a-8a91-fa3bc5baf9b6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:50.593729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9702fa55-8ab7-415a-8a91-fa3bc5baf9b6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:50.594244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9702fa55-8ab7-415a-8a91-fa3bc5baf9b6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:50.594675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9702fa55-8ab7-415a-8a91-fa3bc5baf9b6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:50.595384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9702fa55-8ab7-415a-8a91-fa3bc5baf9b6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:50.595836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9702fa55-8ab7-415a-8a91-fa3bc5baf9b6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:50.596257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9702fa55-8ab7-415a-8a91-fa3bc5baf9b6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:50.735115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9702fa55-8ab7-415a-8a91-fa3bc5baf9b6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:50.743609 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9702fa55-8ab7-415a-8a91-fa3bc5baf9b6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.161973 Sep 08 13:47:50.744188 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3122/6375] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:50 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:51.766624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b5c89748-6e3f-41b0-bb35-899c934cfc59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:51.767265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b5c89748-6e3f-41b0-bb35-899c934cfc59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:51.774195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5c89748-6e3f-41b0-bb35-899c934cfc59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:51.774684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5c89748-6e3f-41b0-bb35-899c934cfc59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:51.775127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5c89748-6e3f-41b0-bb35-899c934cfc59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:51.775847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5c89748-6e3f-41b0-bb35-899c934cfc59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:51.776311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5c89748-6e3f-41b0-bb35-899c934cfc59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:51.776743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b5c89748-6e3f-41b0-bb35-899c934cfc59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:51.911377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b5c89748-6e3f-41b0-bb35-899c934cfc59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:51.919249 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b5c89748-6e3f-41b0-bb35-899c934cfc59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.156589 Sep 08 13:47:51.919844 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3254/6376] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:51 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:52.942170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9ff9c663-fbee-4146-86e9-1f4c157391ce tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:52.942764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9ff9c663-fbee-4146-86e9-1f4c157391ce tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:52.950453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ff9c663-fbee-4146-86e9-1f4c157391ce tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:52.950942 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ff9c663-fbee-4146-86e9-1f4c157391ce tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:52.951412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ff9c663-fbee-4146-86e9-1f4c157391ce tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:52.952364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ff9c663-fbee-4146-86e9-1f4c157391ce tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:52.952820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ff9c663-fbee-4146-86e9-1f4c157391ce tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:52.953247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ff9c663-fbee-4146-86e9-1f4c157391ce tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:53.081597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9ff9c663-fbee-4146-86e9-1f4c157391ce tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:53.089921 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9ff9c663-fbee-4146-86e9-1f4c157391ce tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.151771 Sep 08 13:47:53.090510 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3123/6377] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:52 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:54.113176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3a39530f-ea64-48ff-9e1d-92d408ec4e80 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:54.113801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3a39530f-ea64-48ff-9e1d-92d408ec4e80 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:54.120785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a39530f-ea64-48ff-9e1d-92d408ec4e80 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:54.121307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a39530f-ea64-48ff-9e1d-92d408ec4e80 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:54.121759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a39530f-ea64-48ff-9e1d-92d408ec4e80 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:54.122465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a39530f-ea64-48ff-9e1d-92d408ec4e80 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:54.122924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a39530f-ea64-48ff-9e1d-92d408ec4e80 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:54.123396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a39530f-ea64-48ff-9e1d-92d408ec4e80 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:54.549837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3a39530f-ea64-48ff-9e1d-92d408ec4e80 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:54.558195 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3a39530f-ea64-48ff-9e1d-92d408ec4e80 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.448966 Sep 08 13:47:54.558790 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3255/6378] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:54 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:55.582437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7ea7a404-752b-427a-babe-1c48dabed70f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:55.582969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7ea7a404-752b-427a-babe-1c48dabed70f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:55.590530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ea7a404-752b-427a-babe-1c48dabed70f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:55.591021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ea7a404-752b-427a-babe-1c48dabed70f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:55.591486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ea7a404-752b-427a-babe-1c48dabed70f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:55.592181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ea7a404-752b-427a-babe-1c48dabed70f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:55.592641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ea7a404-752b-427a-babe-1c48dabed70f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:55.593074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ea7a404-752b-427a-babe-1c48dabed70f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:55.721834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7ea7a404-752b-427a-babe-1c48dabed70f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:55.730062 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7ea7a404-752b-427a-babe-1c48dabed70f tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.151728 Sep 08 13:47:55.730708 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3124/6379] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:55 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:56.753785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-229d2799-c8d1-4e28-a29d-9497e32c937b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:56.754421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-229d2799-c8d1-4e28-a29d-9497e32c937b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:56.761305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-229d2799-c8d1-4e28-a29d-9497e32c937b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:56.761822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-229d2799-c8d1-4e28-a29d-9497e32c937b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:56.762259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-229d2799-c8d1-4e28-a29d-9497e32c937b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:56.762960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-229d2799-c8d1-4e28-a29d-9497e32c937b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:56.763465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-229d2799-c8d1-4e28-a29d-9497e32c937b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:56.763907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-229d2799-c8d1-4e28-a29d-9497e32c937b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:56.894733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-229d2799-c8d1-4e28-a29d-9497e32c937b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:56.903159 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-229d2799-c8d1-4e28-a29d-9497e32c937b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.153363 Sep 08 13:47:56.903787 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3256/6380] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:56 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:57.926130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e652cdad-469d-4e00-a21e-18e3c79d7585 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:57.926753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e652cdad-469d-4e00-a21e-18e3c79d7585 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:57.933803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e652cdad-469d-4e00-a21e-18e3c79d7585 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:57.934295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e652cdad-469d-4e00-a21e-18e3c79d7585 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:57.934732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e652cdad-469d-4e00-a21e-18e3c79d7585 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:57.935460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e652cdad-469d-4e00-a21e-18e3c79d7585 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:57.935915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e652cdad-469d-4e00-a21e-18e3c79d7585 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:57.936342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e652cdad-469d-4e00-a21e-18e3c79d7585 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:58.078080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e652cdad-469d-4e00-a21e-18e3c79d7585 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:58.088000 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e652cdad-469d-4e00-a21e-18e3c79d7585 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1521 microversion: 2.1 time: 0.165781 Sep 08 13:47:58.088714 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3125/6381] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:57 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:47:58.632309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c3db8df8-56ad-4c6e-a3f6-024faff4cf25 req-e946da1d-6be4-47b8-8888-e06a0fa2f071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f", "name": "network-vif-unplugged", "status": "completed", "tag": "786253f1-3ba8-4bb1-95b3-0a1e49ff4181"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:47:58.644388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c3db8df8-56ad-4c6e-a3f6-024faff4cf25 req-e946da1d-6be4-47b8-8888-e06a0fa2f071 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:58.644963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c3db8df8-56ad-4c6e-a3f6-024faff4cf25 req-e946da1d-6be4-47b8-8888-e06a0fa2f071 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:58.645323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c3db8df8-56ad-4c6e-a3f6-024faff4cf25 req-e946da1d-6be4-47b8-8888-e06a0fa2f071 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:58.659968 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c3db8df8-56ad-4c6e-a3f6-024faff4cf25 req-e946da1d-6be4-47b8-8888-e06a0fa2f071 service nova] Creating event network-vif-unplugged:786253f1-3ba8-4bb1-95b3-0a1e49ff4181 for instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f on n-h2-852084-10 Sep 08 13:47:58.667184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-c3db8df8-56ad-4c6e-a3f6-024faff4cf25 req-e946da1d-6be4-47b8-8888-e06a0fa2f071 service nova] Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:47:58.679609 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c3db8df8-56ad-4c6e-a3f6-024faff4cf25 req-e946da1d-6be4-47b8-8888-e06a0fa2f071 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051049 Sep 08 13:47:58.680241 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3257/6382] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:47:59.112902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4a90db57-821b-430c-bbb4-94feda899c24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:47:59.113694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4a90db57-821b-430c-bbb4-94feda899c24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:47:59.123066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a90db57-821b-430c-bbb4-94feda899c24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:59.123615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a90db57-821b-430c-bbb4-94feda899c24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:59.124064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a90db57-821b-430c-bbb4-94feda899c24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:59.124781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a90db57-821b-430c-bbb4-94feda899c24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:47:59.125247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a90db57-821b-430c-bbb4-94feda899c24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:47:59.125673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4a90db57-821b-430c-bbb4-94feda899c24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:47:59.371672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4a90db57-821b-430c-bbb4-94feda899c24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:47:59.380091 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4a90db57-821b-430c-bbb4-94feda899c24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1520 microversion: 2.1 time: 0.271420 Sep 08 13:47:59.380682 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3126/6383] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:47:59 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:00.405797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-58f0c7fc-5bbf-42c1-b90a-82edb1e2ee12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:00.406527 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58f0c7fc-5bbf-42c1-b90a-82edb1e2ee12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:00.413337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58f0c7fc-5bbf-42c1-b90a-82edb1e2ee12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:00.413862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58f0c7fc-5bbf-42c1-b90a-82edb1e2ee12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:00.414314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58f0c7fc-5bbf-42c1-b90a-82edb1e2ee12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:00.415020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58f0c7fc-5bbf-42c1-b90a-82edb1e2ee12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:00.415541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58f0c7fc-5bbf-42c1-b90a-82edb1e2ee12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:00.416609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58f0c7fc-5bbf-42c1-b90a-82edb1e2ee12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:00.554270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-58f0c7fc-5bbf-42c1-b90a-82edb1e2ee12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:00.563300 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-58f0c7fc-5bbf-42c1-b90a-82edb1e2ee12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1518 microversion: 2.1 time: 0.163234 Sep 08 13:48:00.563894 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3258/6384] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:00 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:00.710599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-8326461c-49c3-4f46-bb90-f44acfbeef9a req-a342b2a8-040f-48b7-95a7-5383b2496067 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f", "tag": "786253f1-3ba8-4bb1-95b3-0a1e49ff4181"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:00.721055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8326461c-49c3-4f46-bb90-f44acfbeef9a req-a342b2a8-040f-48b7-95a7-5383b2496067 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:00.721628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8326461c-49c3-4f46-bb90-f44acfbeef9a req-a342b2a8-040f-48b7-95a7-5383b2496067 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:00.721958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8326461c-49c3-4f46-bb90-f44acfbeef9a req-a342b2a8-040f-48b7-95a7-5383b2496067 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:00.734970 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-8326461c-49c3-4f46-bb90-f44acfbeef9a req-a342b2a8-040f-48b7-95a7-5383b2496067 service nova] Creating event network-changed:786253f1-3ba8-4bb1-95b3-0a1e49ff4181 for instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f on n-h2-852084-10 Sep 08 13:48:00.740571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-8326461c-49c3-4f46-bb90-f44acfbeef9a req-a342b2a8-040f-48b7-95a7-5383b2496067 service nova] Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:48:00.752146 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-8326461c-49c3-4f46-bb90-f44acfbeef9a req-a342b2a8-040f-48b7-95a7-5383b2496067 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045162 Sep 08 13:48:00.752818 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3127/6385] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:48:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:48:01.588793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d6ea5d32-82a3-46a1-821c-541bb34d70dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:01.589369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d6ea5d32-82a3-46a1-821c-541bb34d70dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:01.596386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6ea5d32-82a3-46a1-821c-541bb34d70dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:01.596888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6ea5d32-82a3-46a1-821c-541bb34d70dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:01.597341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6ea5d32-82a3-46a1-821c-541bb34d70dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:01.598047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6ea5d32-82a3-46a1-821c-541bb34d70dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:01.598513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6ea5d32-82a3-46a1-821c-541bb34d70dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:01.598950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d6ea5d32-82a3-46a1-821c-541bb34d70dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:01.734870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d6ea5d32-82a3-46a1-821c-541bb34d70dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:01.743418 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d6ea5d32-82a3-46a1-821c-541bb34d70dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1515 microversion: 2.1 time: 0.159143 Sep 08 13:48:01.744500 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3259/6386] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:01 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:01.769534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e01f062a-3f20-4b47-9770-cb0c523397b4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:01.770172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e01f062a-3f20-4b47-9770-cb0c523397b4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:01.777082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e01f062a-3f20-4b47-9770-cb0c523397b4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:01.777577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e01f062a-3f20-4b47-9770-cb0c523397b4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:01.778021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e01f062a-3f20-4b47-9770-cb0c523397b4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:01.778721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e01f062a-3f20-4b47-9770-cb0c523397b4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:01.779184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e01f062a-3f20-4b47-9770-cb0c523397b4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:01.779640 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e01f062a-3f20-4b47-9770-cb0c523397b4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:01.847718 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e01f062a-3f20-4b47-9770-cb0c523397b4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "POST /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f/action" status: 204 len: 0 microversion: 2.1 time: 0.083761 Sep 08 13:48:01.848357 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3128/6387] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:48:01 2022] POST /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f/action => generated 0 bytes in 86 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:48:01.856532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-32cc483e-99f9-4b26-a50e-bc1d890e8dbc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:01.857253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-32cc483e-99f9-4b26-a50e-bc1d890e8dbc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:01.864293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32cc483e-99f9-4b26-a50e-bc1d890e8dbc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:01.864924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32cc483e-99f9-4b26-a50e-bc1d890e8dbc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:01.865632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32cc483e-99f9-4b26-a50e-bc1d890e8dbc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:01.866408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32cc483e-99f9-4b26-a50e-bc1d890e8dbc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:01.866940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32cc483e-99f9-4b26-a50e-bc1d890e8dbc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:01.867435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-32cc483e-99f9-4b26-a50e-bc1d890e8dbc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:02.011947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-32cc483e-99f9-4b26-a50e-bc1d890e8dbc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:02.020173 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-32cc483e-99f9-4b26-a50e-bc1d890e8dbc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1515 microversion: 2.1 time: 0.167520 Sep 08 13:48:02.020799 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3260/6388] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:01 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1515 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:03.046954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a46a1514-9162-472c-a3e4-3cfa326aa486 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:03.048258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a46a1514-9162-472c-a3e4-3cfa326aa486 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:03.055194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a46a1514-9162-472c-a3e4-3cfa326aa486 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:03.055983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a46a1514-9162-472c-a3e4-3cfa326aa486 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:03.057136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a46a1514-9162-472c-a3e4-3cfa326aa486 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:03.057851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a46a1514-9162-472c-a3e4-3cfa326aa486 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:03.058299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a46a1514-9162-472c-a3e4-3cfa326aa486 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:03.058724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a46a1514-9162-472c-a3e4-3cfa326aa486 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:03.209213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a46a1514-9162-472c-a3e4-3cfa326aa486 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:03.217809 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a46a1514-9162-472c-a3e4-3cfa326aa486 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1507 microversion: 2.1 time: 0.177239 Sep 08 13:48:03.218633 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3129/6389] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:03 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:48:03.240921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c2b58929-6e29-45f4-9f4a-fd8c4347b380 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:03.241559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c2b58929-6e29-45f4-9f4a-fd8c4347b380 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:03.249947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2b58929-6e29-45f4-9f4a-fd8c4347b380 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:03.250467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2b58929-6e29-45f4-9f4a-fd8c4347b380 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:03.250923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2b58929-6e29-45f4-9f4a-fd8c4347b380 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:03.251669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2b58929-6e29-45f4-9f4a-fd8c4347b380 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:03.252380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2b58929-6e29-45f4-9f4a-fd8c4347b380 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:03.252644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c2b58929-6e29-45f4-9f4a-fd8c4347b380 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:03.389484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c2b58929-6e29-45f4-9f4a-fd8c4347b380 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:03.397355 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c2b58929-6e29-45f4-9f4a-fd8c4347b380 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1507 microversion: 2.1 time: 0.160499 Sep 08 13:48:03.397960 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3261/6390] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:03 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:03.423780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e28478a-635d-4233-963f-5effe0827b50 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Action: 'create', calling method: .version_select at 0x7fdb3ae2de50>, body: {"keypair": {"name": "tempest-keypair-397022567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSpsGeNm55Tp0nVPT5jBLXdbT1Nmr6apR41Phneaypj2WFoM/oztuU86GOLRe3wP9H1ET97tQIYTq/9xVzyQeRH0W7P5gXg6IUvOVgKaK3za7eHyqx3Vc69CG1DwPujbA=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:03.439255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-6e28478a-635d-4233-963f-5effe0827b50 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Getting quotas for project 003eaae0b49a4b7aa10b32d6047c82fd. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:48:03.444373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-6e28478a-635d-4233-963f-5effe0827b50 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Getting quotas for user 6a2507cbdeb640149b0a09405f28e2f8 and project 003eaae0b49a4b7aa10b32d6047c82fd. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:48:03.474107 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e28478a-635d-4233-963f-5effe0827b50 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.054073 Sep 08 13:48:03.474688 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3130/6391] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:48:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:48:04.696485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d34af968-afa6-494a-903b-d1be2d430b26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:04.697248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d34af968-afa6-494a-903b-d1be2d430b26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:04.704562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d34af968-afa6-494a-903b-d1be2d430b26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:04.705049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d34af968-afa6-494a-903b-d1be2d430b26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:04.705496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d34af968-afa6-494a-903b-d1be2d430b26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:04.706221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d34af968-afa6-494a-903b-d1be2d430b26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:04.706681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d34af968-afa6-494a-903b-d1be2d430b26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:04.707118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d34af968-afa6-494a-903b-d1be2d430b26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:04.841221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d34af968-afa6-494a-903b-d1be2d430b26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:04.850108 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d34af968-afa6-494a-903b-d1be2d430b26 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 200 len: 1507 microversion: 2.1 time: 0.157485 Sep 08 13:48:04.850721 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3262/6392] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:04 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:48:04.874150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7f5305c5-d57a-4aa2-9030-6418e0bced59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:04.874767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f5305c5-d57a-4aa2-9030-6418e0bced59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:04.876736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:04.884434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f5305c5-d57a-4aa2-9030-6418e0bced59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:04.884434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f5305c5-d57a-4aa2-9030-6418e0bced59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:04.884728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f5305c5-d57a-4aa2-9030-6418e0bced59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:04.885401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f5305c5-d57a-4aa2-9030-6418e0bced59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:04.885861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f5305c5-d57a-4aa2-9030-6418e0bced59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:04.886313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f5305c5-d57a-4aa2-9030-6418e0bced59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:04.891140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:04.915160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f5305c5-d57a-4aa2-9030-6418e0bced59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:48:04.959190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e217fbd1-9831-43c9-bd1d-54222a88fc44 req-d8a5921e-fc2c-4f4b-8e7d-563238fa1ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f", "name": "network-vif-plugged", "status": "completed", "tag": "786253f1-3ba8-4bb1-95b3-0a1e49ff4181"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:04.969138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e217fbd1-9831-43c9-bd1d-54222a88fc44 req-d8a5921e-fc2c-4f4b-8e7d-563238fa1ccd service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:04.969692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e217fbd1-9831-43c9-bd1d-54222a88fc44 req-d8a5921e-fc2c-4f4b-8e7d-563238fa1ccd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:04.970093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e217fbd1-9831-43c9-bd1d-54222a88fc44 req-d8a5921e-fc2c-4f4b-8e7d-563238fa1ccd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:05.011748 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7f5305c5-d57a-4aa2-9030-6418e0bced59 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "DELETE /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 204 len: 0 microversion: 2.1 time: 0.141763 Sep 08 13:48:05.013058 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3131/6393] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:48:04 2022] DELETE /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:48:05.081944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1908815351", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "c0c7c3f7-e7ec-47b7-a511-f6edc795f5ae"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:05.143016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] validate_networks() for [('c0c7c3f7-e7ec-47b7-a511-f6edc795f5ae', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:48:05.266283 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e217fbd1-9831-43c9-bd1d-54222a88fc44 req-d8a5921e-fc2c-4f4b-8e7d-563238fa1ccd service nova] Creating event network-vif-plugged:786253f1-3ba8-4bb1-95b3-0a1e49ff4181 for instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f on n-h2-852084-10 Sep 08 13:48:05.271853 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e217fbd1-9831-43c9-bd1d-54222a88fc44 req-d8a5921e-fc2c-4f4b-8e7d-563238fa1ccd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.316275 Sep 08 13:48:05.272463 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3263/6394] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:48:05.532474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:48:05.532898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:48:05.533515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:48:05.533920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:48:05.534334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:48:05.544401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:05.544885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:05.545319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:05.546042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:05.546492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:05.546916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:05.564993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Getting quotas for project 003eaae0b49a4b7aa10b32d6047c82fd. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:48:05.570339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Getting quotas for user 6a2507cbdeb640149b0a09405f28e2f8 and project 003eaae0b49a4b7aa10b32d6047c82fd. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:48:05.583153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:48:05.585668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:48:05.642918 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2f4c93e-7d9c-49d9-b029-5350c9fddd65 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.565895 Sep 08 13:48:05.643815 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3132/6395] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:48:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:48:05.656391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-880c4580-c4aa-4e61-a473-6f704052ffe2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:05.657151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-880c4580-c4aa-4e61-a473-6f704052ffe2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:05.659280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=34 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:05.727328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-880c4580-c4aa-4e61-a473-6f704052ffe2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:05.736586 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-880c4580-c4aa-4e61-a473-6f704052ffe2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1218 microversion: 2.1 time: 0.084644 Sep 08 13:48:05.737302 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3264/6396] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:05 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:06.761319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e7319ede-47e4-4042-ab9d-1d2cd9180e12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:06.762174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e7319ede-47e4-4042-ab9d-1d2cd9180e12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:06.769656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7319ede-47e4-4042-ab9d-1d2cd9180e12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:06.770150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7319ede-47e4-4042-ab9d-1d2cd9180e12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:06.770791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7319ede-47e4-4042-ab9d-1d2cd9180e12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:06.771546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7319ede-47e4-4042-ab9d-1d2cd9180e12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:06.772007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7319ede-47e4-4042-ab9d-1d2cd9180e12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:06.772439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7319ede-47e4-4042-ab9d-1d2cd9180e12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:06.879269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e7319ede-47e4-4042-ab9d-1d2cd9180e12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:06.896841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c6441170-fa68-4b0f-9397-e3d6cf513076 req-6b20f698-4896-449e-bf84-bfacae5158fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f", "name": "network-vif-deleted", "tag": "786253f1-3ba8-4bb1-95b3-0a1e49ff4181"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:06.902668 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e7319ede-47e4-4042-ab9d-1d2cd9180e12 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1270 microversion: 2.1 time: 0.146274 Sep 08 13:48:06.906974 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3133/6397] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:06 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:48:06.921485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c6441170-fa68-4b0f-9397-e3d6cf513076 req-6b20f698-4896-449e-bf84-bfacae5158fd service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:06.922287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c6441170-fa68-4b0f-9397-e3d6cf513076 req-6b20f698-4896-449e-bf84-bfacae5158fd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:06.922903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c6441170-fa68-4b0f-9397-e3d6cf513076 req-6b20f698-4896-449e-bf84-bfacae5158fd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:06.936479 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c6441170-fa68-4b0f-9397-e3d6cf513076 req-6b20f698-4896-449e-bf84-bfacae5158fd service nova] Creating event network-vif-deleted:786253f1-3ba8-4bb1-95b3-0a1e49ff4181 for instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f on n-h2-852084-10 Sep 08 13:48:06.942095 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c6441170-fa68-4b0f-9397-e3d6cf513076 req-6b20f698-4896-449e-bf84-bfacae5158fd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053423 Sep 08 13:48:06.943286 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3265/6398] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:48:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:48:07.936406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-375b368d-b8ed-4314-8596-e0b3d9a82f63 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:07.937255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-375b368d-b8ed-4314-8596-e0b3d9a82f63 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:07.944575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-375b368d-b8ed-4314-8596-e0b3d9a82f63 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:07.945163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-375b368d-b8ed-4314-8596-e0b3d9a82f63 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:07.945769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-375b368d-b8ed-4314-8596-e0b3d9a82f63 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:07.946494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-375b368d-b8ed-4314-8596-e0b3d9a82f63 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:07.947623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-375b368d-b8ed-4314-8596-e0b3d9a82f63 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:07.948379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-375b368d-b8ed-4314-8596-e0b3d9a82f63 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:08.186517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-375b368d-b8ed-4314-8596-e0b3d9a82f63 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:08.194736 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-375b368d-b8ed-4314-8596-e0b3d9a82f63 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1318 microversion: 2.1 time: 0.263154 Sep 08 13:48:08.195359 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3134/6399] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:07 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1318 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:08.962143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c9703894-f08d-4c5c-b77e-cf7166f2bc6a req-215f64d3-4f18-459e-a293-5953d4c77628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba6ea40-1435-46e5-be8f-62f59bfa08f2", "tag": "f974a26b-00c6-4125-bfcd-374b00c0af7b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:08.972755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c9703894-f08d-4c5c-b77e-cf7166f2bc6a req-215f64d3-4f18-459e-a293-5953d4c77628 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:08.973250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c9703894-f08d-4c5c-b77e-cf7166f2bc6a req-215f64d3-4f18-459e-a293-5953d4c77628 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:08.973775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c9703894-f08d-4c5c-b77e-cf7166f2bc6a req-215f64d3-4f18-459e-a293-5953d4c77628 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:08.985243 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c9703894-f08d-4c5c-b77e-cf7166f2bc6a req-215f64d3-4f18-459e-a293-5953d4c77628 service nova] Creating event network-changed:f974a26b-00c6-4125-bfcd-374b00c0af7b for instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 on n-h2-852084-10 Sep 08 13:48:08.990313 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c9703894-f08d-4c5c-b77e-cf7166f2bc6a req-215f64d3-4f18-459e-a293-5953d4c77628 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033503 Sep 08 13:48:08.990915 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3266/6400] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:48:09.218660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-303c0f3a-8ea7-42ee-9aa5-d119f74d502e tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:09.219269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-303c0f3a-8ea7-42ee-9aa5-d119f74d502e tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:09.226482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-303c0f3a-8ea7-42ee-9aa5-d119f74d502e tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:09.226966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-303c0f3a-8ea7-42ee-9aa5-d119f74d502e tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:09.227434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-303c0f3a-8ea7-42ee-9aa5-d119f74d502e tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:09.228654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-303c0f3a-8ea7-42ee-9aa5-d119f74d502e tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:09.229106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-303c0f3a-8ea7-42ee-9aa5-d119f74d502e tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:09.229529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-303c0f3a-8ea7-42ee-9aa5-d119f74d502e tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:09.368291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-303c0f3a-8ea7-42ee-9aa5-d119f74d502e tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:09.376492 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-303c0f3a-8ea7-42ee-9aa5-d119f74d502e tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1318 microversion: 2.1 time: 0.161834 Sep 08 13:48:09.377071 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3135/6401] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:09 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:10.399473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4afee945-d953-484a-bfea-21c0a78ba5f2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:10.400221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4afee945-d953-484a-bfea-21c0a78ba5f2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:10.407334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4afee945-d953-484a-bfea-21c0a78ba5f2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:10.407831 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4afee945-d953-484a-bfea-21c0a78ba5f2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:10.408274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4afee945-d953-484a-bfea-21c0a78ba5f2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:10.408995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4afee945-d953-484a-bfea-21c0a78ba5f2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:10.409456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4afee945-d953-484a-bfea-21c0a78ba5f2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:10.409890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4afee945-d953-484a-bfea-21c0a78ba5f2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:10.541182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4afee945-d953-484a-bfea-21c0a78ba5f2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:10.549005 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4afee945-d953-484a-bfea-21c0a78ba5f2 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1318 microversion: 2.1 time: 0.153979 Sep 08 13:48:10.549582 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3267/6402] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:10 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:11.572607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2ea3f355-cd2b-4fca-8a53-e4d33e00876a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:11.573405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2ea3f355-cd2b-4fca-8a53-e4d33e00876a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:11.580744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ea3f355-cd2b-4fca-8a53-e4d33e00876a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:11.581227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ea3f355-cd2b-4fca-8a53-e4d33e00876a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:11.581653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ea3f355-cd2b-4fca-8a53-e4d33e00876a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:11.582428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ea3f355-cd2b-4fca-8a53-e4d33e00876a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:11.582917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ea3f355-cd2b-4fca-8a53-e4d33e00876a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:11.583369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ea3f355-cd2b-4fca-8a53-e4d33e00876a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:11.729362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2ea3f355-cd2b-4fca-8a53-e4d33e00876a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:11.737570 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2ea3f355-cd2b-4fca-8a53-e4d33e00876a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1318 microversion: 2.1 time: 0.169071 Sep 08 13:48:11.738162 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3136/6403] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:11 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:48:12.764662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b1684c02-c479-471b-92a4-82edf78d5cae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:12.765275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b1684c02-c479-471b-92a4-82edf78d5cae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:12.772472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1684c02-c479-471b-92a4-82edf78d5cae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:12.772989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1684c02-c479-471b-92a4-82edf78d5cae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:12.773457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1684c02-c479-471b-92a4-82edf78d5cae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:12.774161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1684c02-c479-471b-92a4-82edf78d5cae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:12.774624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1684c02-c479-471b-92a4-82edf78d5cae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:12.775056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1684c02-c479-471b-92a4-82edf78d5cae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:12.915108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b1684c02-c479-471b-92a4-82edf78d5cae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:12.923620 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b1684c02-c479-471b-92a4-82edf78d5cae tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1318 microversion: 2.1 time: 0.163904 Sep 08 13:48:12.924231 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3268/6404] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:12 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:13.947596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d55d662-a5a4-4603-aa3b-6285dab542e7 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:13.948228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d55d662-a5a4-4603-aa3b-6285dab542e7 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:13.956270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d55d662-a5a4-4603-aa3b-6285dab542e7 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:13.956846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d55d662-a5a4-4603-aa3b-6285dab542e7 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:13.957283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d55d662-a5a4-4603-aa3b-6285dab542e7 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:13.958045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d55d662-a5a4-4603-aa3b-6285dab542e7 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:13.958528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d55d662-a5a4-4603-aa3b-6285dab542e7 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:13.958946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d55d662-a5a4-4603-aa3b-6285dab542e7 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:14.093439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8d55d662-a5a4-4603-aa3b-6285dab542e7 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:14.101676 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d55d662-a5a4-4603-aa3b-6285dab542e7 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1318 microversion: 2.1 time: 0.158378 Sep 08 13:48:14.102259 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3137/6405] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:13 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:15.127127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89829f8e-7f08-44fe-b415-0fa7fc88f139 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:15.127812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-89829f8e-7f08-44fe-b415-0fa7fc88f139 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:15.136541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89829f8e-7f08-44fe-b415-0fa7fc88f139 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:15.137060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89829f8e-7f08-44fe-b415-0fa7fc88f139 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:15.137521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89829f8e-7f08-44fe-b415-0fa7fc88f139 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:15.138250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89829f8e-7f08-44fe-b415-0fa7fc88f139 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:15.139048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9c55f4b2-01f3-4661-a6ed-b9f58fa087e2 req-2b173e05-f540-4fcf-bf65-90abd24459bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba6ea40-1435-46e5-be8f-62f59bfa08f2", "name": "network-vif-plugged", "status": "completed", "tag": "f974a26b-00c6-4125-bfcd-374b00c0af7b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:15.139558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89829f8e-7f08-44fe-b415-0fa7fc88f139 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:15.139558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89829f8e-7f08-44fe-b415-0fa7fc88f139 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:15.154498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9c55f4b2-01f3-4661-a6ed-b9f58fa087e2 req-2b173e05-f540-4fcf-bf65-90abd24459bc service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:15.154990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9c55f4b2-01f3-4661-a6ed-b9f58fa087e2 req-2b173e05-f540-4fcf-bf65-90abd24459bc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:15.155458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9c55f4b2-01f3-4661-a6ed-b9f58fa087e2 req-2b173e05-f540-4fcf-bf65-90abd24459bc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:15.168542 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9c55f4b2-01f3-4661-a6ed-b9f58fa087e2 req-2b173e05-f540-4fcf-bf65-90abd24459bc service nova] Creating event network-vif-plugged:f974a26b-00c6-4125-bfcd-374b00c0af7b for instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 on n-h2-852084-10 Sep 08 13:48:15.174151 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9c55f4b2-01f3-4661-a6ed-b9f58fa087e2 req-2b173e05-f540-4fcf-bf65-90abd24459bc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040949 Sep 08 13:48:15.175097 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3138/6406] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:48:15.311499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-89829f8e-7f08-44fe-b415-0fa7fc88f139 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:15.320284 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-89829f8e-7f08-44fe-b415-0fa7fc88f139 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1318 microversion: 2.1 time: 0.197517 Sep 08 13:48:15.320886 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3269/6407] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:15 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1318 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:16.340973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:16.341726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=10 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:16.347800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-625fb24d-5bf4-45aa-8dc3-5b890ae98bcf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:16.348547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-625fb24d-5bf4-45aa-8dc3-5b890ae98bcf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:16.356038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-625fb24d-5bf4-45aa-8dc3-5b890ae98bcf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:16.356598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-625fb24d-5bf4-45aa-8dc3-5b890ae98bcf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:16.357042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-625fb24d-5bf4-45aa-8dc3-5b890ae98bcf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:16.357817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-625fb24d-5bf4-45aa-8dc3-5b890ae98bcf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:16.358321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-625fb24d-5bf4-45aa-8dc3-5b890ae98bcf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:16.358787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-625fb24d-5bf4-45aa-8dc3-5b890ae98bcf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:16.499120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-625fb24d-5bf4-45aa-8dc3-5b890ae98bcf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:16.507089 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-625fb24d-5bf4-45aa-8dc3-5b890ae98bcf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1318 microversion: 2.1 time: 0.167253 Sep 08 13:48:16.507933 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3139/6408] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:16 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:17.532163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-af28393b-a220-4351-8988-aeee0cb8fb44 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:17.532854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-af28393b-a220-4351-8988-aeee0cb8fb44 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:17.534827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:17.541766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af28393b-a220-4351-8988-aeee0cb8fb44 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:17.542278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af28393b-a220-4351-8988-aeee0cb8fb44 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:17.542741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af28393b-a220-4351-8988-aeee0cb8fb44 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:17.543491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af28393b-a220-4351-8988-aeee0cb8fb44 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:17.543973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af28393b-a220-4351-8988-aeee0cb8fb44 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:17.544420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-af28393b-a220-4351-8988-aeee0cb8fb44 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:17.547025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=87 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:17.675205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-af28393b-a220-4351-8988-aeee0cb8fb44 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:17.683132 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-af28393b-a220-4351-8988-aeee0cb8fb44 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1509 microversion: 2.1 time: 0.154898 Sep 08 13:48:17.683750 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3270/6409] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:17 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:17.706439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-33150940-33d5-4f67-a9df-7646c39be551 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:17.707136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33150940-33d5-4f67-a9df-7646c39be551 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:17.715064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33150940-33d5-4f67-a9df-7646c39be551 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:17.715595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33150940-33d5-4f67-a9df-7646c39be551 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:17.716053 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33150940-33d5-4f67-a9df-7646c39be551 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:17.716795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33150940-33d5-4f67-a9df-7646c39be551 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:17.717279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33150940-33d5-4f67-a9df-7646c39be551 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:17.717713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33150940-33d5-4f67-a9df-7646c39be551 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:17.858787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-33150940-33d5-4f67-a9df-7646c39be551 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:17.867122 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-33150940-33d5-4f67-a9df-7646c39be551 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1509 microversion: 2.1 time: 0.164835 Sep 08 13:48:17.867745 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3140/6410] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:17 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:17.889676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:17.892013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:17.898482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:17.899005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:17.899584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:17.900869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:17.901346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:17.901793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:17.931814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:17.937396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Old instance type m1.heat2, new instance type m1.heat {{(pid=128970) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 13:48:17.944131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:48:17.944573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:48:17.945066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:48:17.945489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:48:17.945918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:48:18.012022 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aa30d283-9010-496a-89ae-ec46537e37cc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "POST /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2/action" status: 202 len: 0 microversion: 2.1 time: 0.126562 Sep 08 13:48:18.012676 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3271/6411] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:48:17 2022] POST /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:48:18.021384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e8fb097-7e84-4da8-b22f-539711dc409b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:18.022050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6e8fb097-7e84-4da8-b22f-539711dc409b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:18.029032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e8fb097-7e84-4da8-b22f-539711dc409b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:18.029549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e8fb097-7e84-4da8-b22f-539711dc409b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:18.030016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e8fb097-7e84-4da8-b22f-539711dc409b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:18.030770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e8fb097-7e84-4da8-b22f-539711dc409b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:18.031265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e8fb097-7e84-4da8-b22f-539711dc409b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:18.031705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e8fb097-7e84-4da8-b22f-539711dc409b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:18.185403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6e8fb097-7e84-4da8-b22f-539711dc409b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:18.193851 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e8fb097-7e84-4da8-b22f-539711dc409b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1516 microversion: 2.1 time: 0.176773 Sep 08 13:48:18.194545 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3141/6412] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:18 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1516 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:19.219700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4772131c-de5b-4675-bb4b-eaea957c87ef tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:19.220304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4772131c-de5b-4675-bb4b-eaea957c87ef tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:19.227194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4772131c-de5b-4675-bb4b-eaea957c87ef tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:19.227716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4772131c-de5b-4675-bb4b-eaea957c87ef tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:19.228799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4772131c-de5b-4675-bb4b-eaea957c87ef tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:19.229499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4772131c-de5b-4675-bb4b-eaea957c87ef tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:19.229966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4772131c-de5b-4675-bb4b-eaea957c87ef tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:19.230400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4772131c-de5b-4675-bb4b-eaea957c87ef tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:19.370507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4772131c-de5b-4675-bb4b-eaea957c87ef tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:19.379939 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4772131c-de5b-4675-bb4b-eaea957c87ef tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1516 microversion: 2.1 time: 0.164813 Sep 08 13:48:19.380745 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3272/6413] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:19 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:20.404753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-da0f48e5-8f60-4930-849e-f485d51b61b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:20.405438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-da0f48e5-8f60-4930-849e-f485d51b61b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:20.412312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da0f48e5-8f60-4930-849e-f485d51b61b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:20.412786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da0f48e5-8f60-4930-849e-f485d51b61b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:20.413214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da0f48e5-8f60-4930-849e-f485d51b61b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:20.413893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da0f48e5-8f60-4930-849e-f485d51b61b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:20.414345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da0f48e5-8f60-4930-849e-f485d51b61b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:20.414761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-da0f48e5-8f60-4930-849e-f485d51b61b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:20.545068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-da0f48e5-8f60-4930-849e-f485d51b61b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:20.552799 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-da0f48e5-8f60-4930-849e-f485d51b61b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.152982 Sep 08 13:48:20.553380 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3142/6414] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:20 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:21.576048 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4aa16dd6-581f-4ff5-9100-9b8e9a510850 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:21.576712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4aa16dd6-581f-4ff5-9100-9b8e9a510850 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:21.584131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa16dd6-581f-4ff5-9100-9b8e9a510850 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:21.584639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa16dd6-581f-4ff5-9100-9b8e9a510850 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:21.585098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa16dd6-581f-4ff5-9100-9b8e9a510850 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:21.585811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa16dd6-581f-4ff5-9100-9b8e9a510850 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:21.586287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa16dd6-581f-4ff5-9100-9b8e9a510850 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:21.586733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4aa16dd6-581f-4ff5-9100-9b8e9a510850 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:21.732461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4aa16dd6-581f-4ff5-9100-9b8e9a510850 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:21.740769 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4aa16dd6-581f-4ff5-9100-9b8e9a510850 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.168624 Sep 08 13:48:21.741362 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3273/6415] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:21 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:22.766551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9e7a1fde-69a1-4766-822e-f927ba4dc249 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:22.767163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9e7a1fde-69a1-4766-822e-f927ba4dc249 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:22.774253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e7a1fde-69a1-4766-822e-f927ba4dc249 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:22.774756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e7a1fde-69a1-4766-822e-f927ba4dc249 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:22.775204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e7a1fde-69a1-4766-822e-f927ba4dc249 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:22.776129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e7a1fde-69a1-4766-822e-f927ba4dc249 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:22.776488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e7a1fde-69a1-4766-822e-f927ba4dc249 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:22.777067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e7a1fde-69a1-4766-822e-f927ba4dc249 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:22.910772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9e7a1fde-69a1-4766-822e-f927ba4dc249 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:22.919135 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9e7a1fde-69a1-4766-822e-f927ba4dc249 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.156437 Sep 08 13:48:22.919960 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3143/6416] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:22 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:48:23.943650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b3bdc404-04b6-4afa-ad79-74d18154e359 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:23.944045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b3bdc404-04b6-4afa-ad79-74d18154e359 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:23.951284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3bdc404-04b6-4afa-ad79-74d18154e359 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:23.951762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3bdc404-04b6-4afa-ad79-74d18154e359 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:23.952516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3bdc404-04b6-4afa-ad79-74d18154e359 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:23.953241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3bdc404-04b6-4afa-ad79-74d18154e359 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:23.953774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3bdc404-04b6-4afa-ad79-74d18154e359 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:23.954161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3bdc404-04b6-4afa-ad79-74d18154e359 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:24.089675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b3bdc404-04b6-4afa-ad79-74d18154e359 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:24.097715 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b3bdc404-04b6-4afa-ad79-74d18154e359 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.158974 Sep 08 13:48:24.098366 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3274/6417] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:23 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:25.121874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-21d121a4-26fa-464c-ab7a-8ec60a3c824b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:25.122494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-21d121a4-26fa-464c-ab7a-8ec60a3c824b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:25.129644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21d121a4-26fa-464c-ab7a-8ec60a3c824b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:25.130137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21d121a4-26fa-464c-ab7a-8ec60a3c824b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:25.130606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21d121a4-26fa-464c-ab7a-8ec60a3c824b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:25.131309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21d121a4-26fa-464c-ab7a-8ec60a3c824b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:25.131769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21d121a4-26fa-464c-ab7a-8ec60a3c824b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:25.132198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21d121a4-26fa-464c-ab7a-8ec60a3c824b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:25.264790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-21d121a4-26fa-464c-ab7a-8ec60a3c824b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:25.272712 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-21d121a4-26fa-464c-ab7a-8ec60a3c824b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.155157 Sep 08 13:48:25.273296 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3144/6418] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:25 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:26.297598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60d39064-14cd-4253-8221-2ba215a9d9e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:26.298227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-60d39064-14cd-4253-8221-2ba215a9d9e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:26.305117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60d39064-14cd-4253-8221-2ba215a9d9e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:26.305615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60d39064-14cd-4253-8221-2ba215a9d9e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:26.306701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60d39064-14cd-4253-8221-2ba215a9d9e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:26.307559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60d39064-14cd-4253-8221-2ba215a9d9e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:26.308029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60d39064-14cd-4253-8221-2ba215a9d9e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:26.308466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60d39064-14cd-4253-8221-2ba215a9d9e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:26.449299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-60d39064-14cd-4253-8221-2ba215a9d9e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:26.457394 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-60d39064-14cd-4253-8221-2ba215a9d9e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.163774 Sep 08 13:48:26.458056 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3275/6419] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:26 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:27.480946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0a5de7a9-89d9-4b6a-9500-29433fcc24dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:27.481588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0a5de7a9-89d9-4b6a-9500-29433fcc24dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:27.488582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a5de7a9-89d9-4b6a-9500-29433fcc24dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:27.489062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a5de7a9-89d9-4b6a-9500-29433fcc24dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:27.489495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a5de7a9-89d9-4b6a-9500-29433fcc24dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:27.490186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a5de7a9-89d9-4b6a-9500-29433fcc24dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:27.490635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a5de7a9-89d9-4b6a-9500-29433fcc24dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:27.491059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a5de7a9-89d9-4b6a-9500-29433fcc24dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:27.630438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0a5de7a9-89d9-4b6a-9500-29433fcc24dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:27.638749 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0a5de7a9-89d9-4b6a-9500-29433fcc24dc tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.161777 Sep 08 13:48:27.639648 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3145/6420] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:27 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:28.661858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ff8c7bbf-4607-4cef-9e30-d338e5c59e95 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:28.662503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff8c7bbf-4607-4cef-9e30-d338e5c59e95 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:28.669753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff8c7bbf-4607-4cef-9e30-d338e5c59e95 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:28.670266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff8c7bbf-4607-4cef-9e30-d338e5c59e95 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:28.670726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff8c7bbf-4607-4cef-9e30-d338e5c59e95 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:28.672629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff8c7bbf-4607-4cef-9e30-d338e5c59e95 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:28.673111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff8c7bbf-4607-4cef-9e30-d338e5c59e95 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:28.673563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff8c7bbf-4607-4cef-9e30-d338e5c59e95 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:28.817298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ff8c7bbf-4607-4cef-9e30-d338e5c59e95 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:28.825758 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ff8c7bbf-4607-4cef-9e30-d338e5c59e95 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.167863 Sep 08 13:48:28.826339 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3276/6421] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:28 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:29.849824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1fc60f88-ed16-4eea-9360-140143b360bf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:29.850446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1fc60f88-ed16-4eea-9360-140143b360bf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:29.858105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc60f88-ed16-4eea-9360-140143b360bf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:29.858598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc60f88-ed16-4eea-9360-140143b360bf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:29.859038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc60f88-ed16-4eea-9360-140143b360bf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:29.859769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc60f88-ed16-4eea-9360-140143b360bf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:29.860229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc60f88-ed16-4eea-9360-140143b360bf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:29.860657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1fc60f88-ed16-4eea-9360-140143b360bf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:29.995463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1fc60f88-ed16-4eea-9360-140143b360bf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:30.008047 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1fc60f88-ed16-4eea-9360-140143b360bf tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.161336 Sep 08 13:48:30.008721 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3146/6422] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:29 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:31.037608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9786f23d-e921-4733-a08e-6e938384990a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:31.038321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9786f23d-e921-4733-a08e-6e938384990a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:31.046479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9786f23d-e921-4733-a08e-6e938384990a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:31.047211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9786f23d-e921-4733-a08e-6e938384990a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:31.047518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9786f23d-e921-4733-a08e-6e938384990a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:31.048285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9786f23d-e921-4733-a08e-6e938384990a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:31.048826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9786f23d-e921-4733-a08e-6e938384990a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:31.049343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9786f23d-e921-4733-a08e-6e938384990a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:31.184227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9786f23d-e921-4733-a08e-6e938384990a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:31.192006 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9786f23d-e921-4733-a08e-6e938384990a tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.158436 Sep 08 13:48:31.192586 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3277/6423] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:31 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:32.216418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7626ecd1-ad20-4f83-b9f3-d6e001441cc5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:32.217033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7626ecd1-ad20-4f83-b9f3-d6e001441cc5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:32.223933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7626ecd1-ad20-4f83-b9f3-d6e001441cc5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:32.224417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7626ecd1-ad20-4f83-b9f3-d6e001441cc5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:32.224848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7626ecd1-ad20-4f83-b9f3-d6e001441cc5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:32.225531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7626ecd1-ad20-4f83-b9f3-d6e001441cc5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:32.225978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7626ecd1-ad20-4f83-b9f3-d6e001441cc5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:32.226424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7626ecd1-ad20-4f83-b9f3-d6e001441cc5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:32.241649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:32.358614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7626ecd1-ad20-4f83-b9f3-d6e001441cc5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:32.367253 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7626ecd1-ad20-4f83-b9f3-d6e001441cc5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.155277 Sep 08 13:48:32.367870 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3147/6424] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:32 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:33.391552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8d5ccdb5-b13c-4172-bdd0-4424cb682df1 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:33.392205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8d5ccdb5-b13c-4172-bdd0-4424cb682df1 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:33.399099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d5ccdb5-b13c-4172-bdd0-4424cb682df1 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:33.399631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d5ccdb5-b13c-4172-bdd0-4424cb682df1 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:33.400084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d5ccdb5-b13c-4172-bdd0-4424cb682df1 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:33.400789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d5ccdb5-b13c-4172-bdd0-4424cb682df1 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:33.401257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d5ccdb5-b13c-4172-bdd0-4424cb682df1 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:33.401697 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8d5ccdb5-b13c-4172-bdd0-4424cb682df1 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:33.534847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8d5ccdb5-b13c-4172-bdd0-4424cb682df1 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:33.542707 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8d5ccdb5-b13c-4172-bdd0-4424cb682df1 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.155163 Sep 08 13:48:33.543307 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3278/6425] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:33 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:34.566289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e48e6fb5-21eb-4aa8-8eeb-5ba51a1dfebe tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:34.567019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e48e6fb5-21eb-4aa8-8eeb-5ba51a1dfebe tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:34.573898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e48e6fb5-21eb-4aa8-8eeb-5ba51a1dfebe tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:34.574387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e48e6fb5-21eb-4aa8-8eeb-5ba51a1dfebe tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:34.574828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e48e6fb5-21eb-4aa8-8eeb-5ba51a1dfebe tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:34.575549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e48e6fb5-21eb-4aa8-8eeb-5ba51a1dfebe tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:34.576008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e48e6fb5-21eb-4aa8-8eeb-5ba51a1dfebe tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:34.576436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e48e6fb5-21eb-4aa8-8eeb-5ba51a1dfebe tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:34.707154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e48e6fb5-21eb-4aa8-8eeb-5ba51a1dfebe tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:34.715966 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e48e6fb5-21eb-4aa8-8eeb-5ba51a1dfebe tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.153603 Sep 08 13:48:34.716636 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3148/6426] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:34 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:35.740323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1c98a69f-817d-4119-9cef-f3c981032db5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:35.741032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1c98a69f-817d-4119-9cef-f3c981032db5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:35.743829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=36 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:35.749036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c98a69f-817d-4119-9cef-f3c981032db5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:35.749535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c98a69f-817d-4119-9cef-f3c981032db5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:35.749987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c98a69f-817d-4119-9cef-f3c981032db5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:35.750694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c98a69f-817d-4119-9cef-f3c981032db5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:35.751163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c98a69f-817d-4119-9cef-f3c981032db5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:35.751625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c98a69f-817d-4119-9cef-f3c981032db5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:35.894750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1c98a69f-817d-4119-9cef-f3c981032db5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:35.903858 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1c98a69f-817d-4119-9cef-f3c981032db5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.167732 Sep 08 13:48:35.904453 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3279/6427] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:35 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:36.928174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db9f834b-892d-44b7-8b9f-3afeff1d29b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:36.928832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-db9f834b-892d-44b7-8b9f-3afeff1d29b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:36.931871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:36.937233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db9f834b-892d-44b7-8b9f-3afeff1d29b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:36.937727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db9f834b-892d-44b7-8b9f-3afeff1d29b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:36.938166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db9f834b-892d-44b7-8b9f-3afeff1d29b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:36.938870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db9f834b-892d-44b7-8b9f-3afeff1d29b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:36.939367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db9f834b-892d-44b7-8b9f-3afeff1d29b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:36.939805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db9f834b-892d-44b7-8b9f-3afeff1d29b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:37.075150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-db9f834b-892d-44b7-8b9f-3afeff1d29b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:37.083710 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-db9f834b-892d-44b7-8b9f-3afeff1d29b5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.159836 Sep 08 13:48:37.084293 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3149/6428] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:36 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:38.106897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6bfcc282-7894-4b99-bae5-f01918e134d6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:38.107605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6bfcc282-7894-4b99-bae5-f01918e134d6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:38.114579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bfcc282-7894-4b99-bae5-f01918e134d6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:38.115111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bfcc282-7894-4b99-bae5-f01918e134d6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:38.115594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bfcc282-7894-4b99-bae5-f01918e134d6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:38.116355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bfcc282-7894-4b99-bae5-f01918e134d6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:38.116830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bfcc282-7894-4b99-bae5-f01918e134d6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:38.117276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6bfcc282-7894-4b99-bae5-f01918e134d6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:38.256639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6bfcc282-7894-4b99-bae5-f01918e134d6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:38.264991 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6bfcc282-7894-4b99-bae5-f01918e134d6 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.162893 Sep 08 13:48:38.265570 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3280/6429] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:38 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:39.289447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c7aaedc3-2858-473e-b636-dd884882d7e5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:39.290080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c7aaedc3-2858-473e-b636-dd884882d7e5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:39.298165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7aaedc3-2858-473e-b636-dd884882d7e5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:39.298661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7aaedc3-2858-473e-b636-dd884882d7e5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:39.299103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7aaedc3-2858-473e-b636-dd884882d7e5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:39.299831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7aaedc3-2858-473e-b636-dd884882d7e5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:39.300291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7aaedc3-2858-473e-b636-dd884882d7e5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:39.300721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7aaedc3-2858-473e-b636-dd884882d7e5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:39.435660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c7aaedc3-2858-473e-b636-dd884882d7e5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:39.443624 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c7aaedc3-2858-473e-b636-dd884882d7e5 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.158194 Sep 08 13:48:39.444220 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3150/6430] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:39 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:40.468031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4f1a1689-edba-4750-aa6f-840915f8ca38 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:40.468651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4f1a1689-edba-4750-aa6f-840915f8ca38 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:40.470913 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:48:40.471062 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 13:48:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 (ip 10.222.0.78) !!! Sep 08 13:48:40.480896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f1a1689-edba-4750-aa6f-840915f8ca38 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:40.481395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f1a1689-edba-4750-aa6f-840915f8ca38 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:40.481844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f1a1689-edba-4750-aa6f-840915f8ca38 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:40.482550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f1a1689-edba-4750-aa6f-840915f8ca38 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:40.483032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f1a1689-edba-4750-aa6f-840915f8ca38 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:40.483551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f1a1689-edba-4750-aa6f-840915f8ca38 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:40.616637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4f1a1689-edba-4750-aa6f-840915f8ca38 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:40.624406 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4f1a1689-edba-4750-aa6f-840915f8ca38 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.160506 Sep 08 13:48:40.624985 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3281/6431] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:40 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:41.648622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1e2f7867-5f44-45d3-8642-ca02b7826e85 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:41.649161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1e2f7867-5f44-45d3-8642-ca02b7826e85 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:41.656681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e2f7867-5f44-45d3-8642-ca02b7826e85 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:41.657171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e2f7867-5f44-45d3-8642-ca02b7826e85 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:41.657608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e2f7867-5f44-45d3-8642-ca02b7826e85 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:41.658302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e2f7867-5f44-45d3-8642-ca02b7826e85 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:41.658755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e2f7867-5f44-45d3-8642-ca02b7826e85 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:41.659180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e2f7867-5f44-45d3-8642-ca02b7826e85 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:41.797081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1e2f7867-5f44-45d3-8642-ca02b7826e85 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:41.804811 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1e2f7867-5f44-45d3-8642-ca02b7826e85 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.160231 Sep 08 13:48:41.805393 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3151/6432] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:41 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:42.829343 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-893d7b9d-1ab7-4c5d-a5de-3f7d3a8f5996 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:42.829904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-893d7b9d-1ab7-4c5d-a5de-3f7d3a8f5996 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:42.837994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-893d7b9d-1ab7-4c5d-a5de-3f7d3a8f5996 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:42.838475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-893d7b9d-1ab7-4c5d-a5de-3f7d3a8f5996 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:42.839103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-893d7b9d-1ab7-4c5d-a5de-3f7d3a8f5996 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:42.839861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-893d7b9d-1ab7-4c5d-a5de-3f7d3a8f5996 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:42.840335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-893d7b9d-1ab7-4c5d-a5de-3f7d3a8f5996 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:42.840785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-893d7b9d-1ab7-4c5d-a5de-3f7d3a8f5996 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:42.977967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-893d7b9d-1ab7-4c5d-a5de-3f7d3a8f5996 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:42.985962 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-893d7b9d-1ab7-4c5d-a5de-3f7d3a8f5996 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.161039 Sep 08 13:48:42.986542 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3282/6433] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:42 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:44.010403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1e4da744-b31d-4ded-8e72-f9e4b95d2340 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:44.011255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1e4da744-b31d-4ded-8e72-f9e4b95d2340 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:44.017975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e4da744-b31d-4ded-8e72-f9e4b95d2340 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:44.018461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e4da744-b31d-4ded-8e72-f9e4b95d2340 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:44.018897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e4da744-b31d-4ded-8e72-f9e4b95d2340 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:44.019617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e4da744-b31d-4ded-8e72-f9e4b95d2340 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:44.020071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e4da744-b31d-4ded-8e72-f9e4b95d2340 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:44.020494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e4da744-b31d-4ded-8e72-f9e4b95d2340 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:44.159003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1e4da744-b31d-4ded-8e72-f9e4b95d2340 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:44.167815 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1e4da744-b31d-4ded-8e72-f9e4b95d2340 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.162065 Sep 08 13:48:44.168433 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3152/6434] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:44 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:45.191852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0ebffdcd-6123-45fe-b824-e7c576d5aa72 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:45.192505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0ebffdcd-6123-45fe-b824-e7c576d5aa72 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:45.200161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ebffdcd-6123-45fe-b824-e7c576d5aa72 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:45.200688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ebffdcd-6123-45fe-b824-e7c576d5aa72 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:45.201177 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ebffdcd-6123-45fe-b824-e7c576d5aa72 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:45.201919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ebffdcd-6123-45fe-b824-e7c576d5aa72 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:45.202415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ebffdcd-6123-45fe-b824-e7c576d5aa72 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:45.203130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0ebffdcd-6123-45fe-b824-e7c576d5aa72 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:45.339496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0ebffdcd-6123-45fe-b824-e7c576d5aa72 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:45.349578 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0ebffdcd-6123-45fe-b824-e7c576d5aa72 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.161724 Sep 08 13:48:45.350195 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3283/6435] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:45 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:46.373454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-af7c9e5d-ed5e-4460-8239-d5b6454b0072 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:46.374072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-af7c9e5d-ed5e-4460-8239-d5b6454b0072 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:46.382105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af7c9e5d-ed5e-4460-8239-d5b6454b0072 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:46.382701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af7c9e5d-ed5e-4460-8239-d5b6454b0072 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:46.383474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af7c9e5d-ed5e-4460-8239-d5b6454b0072 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:46.384839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af7c9e5d-ed5e-4460-8239-d5b6454b0072 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:46.385303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af7c9e5d-ed5e-4460-8239-d5b6454b0072 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:46.385769 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-af7c9e5d-ed5e-4460-8239-d5b6454b0072 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:46.519054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-af7c9e5d-ed5e-4460-8239-d5b6454b0072 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:46.528362 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-af7c9e5d-ed5e-4460-8239-d5b6454b0072 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1521 microversion: 2.1 time: 0.158856 Sep 08 13:48:46.528933 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3153/6436] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:46 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:47.471860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b05375f9-af93-472d-831a-b5a24d6c64a9 req-351ceba5-48b3-486a-919c-ca02574b069f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba6ea40-1435-46e5-be8f-62f59bfa08f2", "name": "network-vif-unplugged", "status": "completed", "tag": "f974a26b-00c6-4125-bfcd-374b00c0af7b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:47.482775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b05375f9-af93-472d-831a-b5a24d6c64a9 req-351ceba5-48b3-486a-919c-ca02574b069f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:47.483433 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b05375f9-af93-472d-831a-b5a24d6c64a9 req-351ceba5-48b3-486a-919c-ca02574b069f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:47.484029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b05375f9-af93-472d-831a-b5a24d6c64a9 req-351ceba5-48b3-486a-919c-ca02574b069f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:47.497177 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b05375f9-af93-472d-831a-b5a24d6c64a9 req-351ceba5-48b3-486a-919c-ca02574b069f service nova] Creating event network-vif-unplugged:f974a26b-00c6-4125-bfcd-374b00c0af7b for instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 on n-h1-852084-10 Sep 08 13:48:47.502833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-b05375f9-af93-472d-831a-b5a24d6c64a9 req-351ceba5-48b3-486a-919c-ca02574b069f service nova] Instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:48:47.515075 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b05375f9-af93-472d-831a-b5a24d6c64a9 req-351ceba5-48b3-486a-919c-ca02574b069f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047792 Sep 08 13:48:47.515964 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3284/6437] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:48:47.552134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0a6413b6-8f97-4d69-aef0-65a97cb590c8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:47.552776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0a6413b6-8f97-4d69-aef0-65a97cb590c8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:47.560483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a6413b6-8f97-4d69-aef0-65a97cb590c8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:47.561071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a6413b6-8f97-4d69-aef0-65a97cb590c8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:47.561523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a6413b6-8f97-4d69-aef0-65a97cb590c8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:47.562242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a6413b6-8f97-4d69-aef0-65a97cb590c8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:47.562699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a6413b6-8f97-4d69-aef0-65a97cb590c8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:47.563138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0a6413b6-8f97-4d69-aef0-65a97cb590c8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:47.701595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0a6413b6-8f97-4d69-aef0-65a97cb590c8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:47.710973 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0a6413b6-8f97-4d69-aef0-65a97cb590c8 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1520 microversion: 2.1 time: 0.162774 Sep 08 13:48:47.711603 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3154/6438] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:47 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:48.736839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-303784cc-915c-4a78-a4f9-24bfefee0779 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:48.737658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-303784cc-915c-4a78-a4f9-24bfefee0779 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:48.744002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-303784cc-915c-4a78-a4f9-24bfefee0779 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:48.744503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-303784cc-915c-4a78-a4f9-24bfefee0779 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:48.744958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-303784cc-915c-4a78-a4f9-24bfefee0779 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:48.745666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-303784cc-915c-4a78-a4f9-24bfefee0779 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:48.746175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-303784cc-915c-4a78-a4f9-24bfefee0779 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:48.746657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-303784cc-915c-4a78-a4f9-24bfefee0779 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:48.750803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:48:48.886932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-303784cc-915c-4a78-a4f9-24bfefee0779 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:48.894915 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-303784cc-915c-4a78-a4f9-24bfefee0779 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1518 microversion: 2.1 time: 0.163836 Sep 08 13:48:48.895552 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3285/6439] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:48 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1518 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:49.546153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2892ac90-2d1a-434b-9d56-d509df864499 req-f3a5f94d-425d-4c5c-8f8f-c82e3f66f307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba6ea40-1435-46e5-be8f-62f59bfa08f2", "tag": "f974a26b-00c6-4125-bfcd-374b00c0af7b"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:49.557212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2892ac90-2d1a-434b-9d56-d509df864499 req-f3a5f94d-425d-4c5c-8f8f-c82e3f66f307 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:49.557695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2892ac90-2d1a-434b-9d56-d509df864499 req-f3a5f94d-425d-4c5c-8f8f-c82e3f66f307 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:49.558139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2892ac90-2d1a-434b-9d56-d509df864499 req-f3a5f94d-425d-4c5c-8f8f-c82e3f66f307 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:49.570113 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2892ac90-2d1a-434b-9d56-d509df864499 req-f3a5f94d-425d-4c5c-8f8f-c82e3f66f307 service nova] Creating event network-changed:f974a26b-00c6-4125-bfcd-374b00c0af7b for instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 on n-h1-852084-10 Sep 08 13:48:49.579738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-2892ac90-2d1a-434b-9d56-d509df864499 req-f3a5f94d-425d-4c5c-8f8f-c82e3f66f307 service nova] Instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:48:49.590871 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2892ac90-2d1a-434b-9d56-d509df864499 req-f3a5f94d-425d-4c5c-8f8f-c82e3f66f307 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048782 Sep 08 13:48:49.591534 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3155/6440] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:48:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:48:49.920703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7d8bb744-852f-4257-bc46-165ac26bae24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:49.922138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7d8bb744-852f-4257-bc46-165ac26bae24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:49.929378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d8bb744-852f-4257-bc46-165ac26bae24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:49.929924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d8bb744-852f-4257-bc46-165ac26bae24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:49.930408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d8bb744-852f-4257-bc46-165ac26bae24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:49.931185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d8bb744-852f-4257-bc46-165ac26bae24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:49.931680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d8bb744-852f-4257-bc46-165ac26bae24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:49.932123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7d8bb744-852f-4257-bc46-165ac26bae24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:50.173626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7d8bb744-852f-4257-bc46-165ac26bae24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:50.183935 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7d8bb744-852f-4257-bc46-165ac26bae24 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1515 microversion: 2.1 time: 0.267534 Sep 08 13:48:50.185002 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3286/6441] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:49 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1515 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:50.208852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4fbbebeb-f00f-4024-9407-62122495b186 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:50.209481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4fbbebeb-f00f-4024-9407-62122495b186 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:50.216668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fbbebeb-f00f-4024-9407-62122495b186 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:50.217162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fbbebeb-f00f-4024-9407-62122495b186 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:50.217606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fbbebeb-f00f-4024-9407-62122495b186 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:50.219087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fbbebeb-f00f-4024-9407-62122495b186 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:50.219774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fbbebeb-f00f-4024-9407-62122495b186 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:50.220301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4fbbebeb-f00f-4024-9407-62122495b186 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:50.284428 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4fbbebeb-f00f-4024-9407-62122495b186 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "POST /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2/action" status: 204 len: 0 microversion: 2.1 time: 0.079821 Sep 08 13:48:50.285135 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3156/6442] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:48:50 2022] POST /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2/action => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:48:50.294709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8262c46-cf75-4b72-a125-f61e686d57c0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:50.295412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b8262c46-cf75-4b72-a125-f61e686d57c0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:50.302440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8262c46-cf75-4b72-a125-f61e686d57c0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:50.303163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8262c46-cf75-4b72-a125-f61e686d57c0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:50.303758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8262c46-cf75-4b72-a125-f61e686d57c0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:50.304641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8262c46-cf75-4b72-a125-f61e686d57c0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:50.305398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8262c46-cf75-4b72-a125-f61e686d57c0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:50.306618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8262c46-cf75-4b72-a125-f61e686d57c0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:50.548456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b8262c46-cf75-4b72-a125-f61e686d57c0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:50.557739 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8262c46-cf75-4b72-a125-f61e686d57c0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1515 microversion: 2.1 time: 0.268133 Sep 08 13:48:50.558334 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3287/6443] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:50 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1515 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:51.584729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-202568cb-b22d-4899-ad1d-4d5cf29ce4cb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:51.585435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-202568cb-b22d-4899-ad1d-4d5cf29ce4cb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:51.593486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202568cb-b22d-4899-ad1d-4d5cf29ce4cb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:51.594012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202568cb-b22d-4899-ad1d-4d5cf29ce4cb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:51.594414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202568cb-b22d-4899-ad1d-4d5cf29ce4cb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:51.595120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202568cb-b22d-4899-ad1d-4d5cf29ce4cb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:51.595637 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202568cb-b22d-4899-ad1d-4d5cf29ce4cb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:51.596063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-202568cb-b22d-4899-ad1d-4d5cf29ce4cb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:51.751676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-202568cb-b22d-4899-ad1d-4d5cf29ce4cb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:51.760529 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-202568cb-b22d-4899-ad1d-4d5cf29ce4cb tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1507 microversion: 2.1 time: 0.182585 Sep 08 13:48:51.761138 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3157/6444] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:51 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:51.784390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-49eccad8-1500-45c3-b7e2-2a6c868bda5b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:51.785023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-49eccad8-1500-45c3-b7e2-2a6c868bda5b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:51.792067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-49eccad8-1500-45c3-b7e2-2a6c868bda5b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:51.792496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-49eccad8-1500-45c3-b7e2-2a6c868bda5b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:51.792946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-49eccad8-1500-45c3-b7e2-2a6c868bda5b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:51.793677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-49eccad8-1500-45c3-b7e2-2a6c868bda5b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:51.794149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-49eccad8-1500-45c3-b7e2-2a6c868bda5b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:51.794587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-49eccad8-1500-45c3-b7e2-2a6c868bda5b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:51.945882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-49eccad8-1500-45c3-b7e2-2a6c868bda5b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:51.955023 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-49eccad8-1500-45c3-b7e2-2a6c868bda5b tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1507 microversion: 2.1 time: 0.174585 Sep 08 13:48:51.955673 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3288/6445] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:51 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1507 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:51.977776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ccddb0a-b021-48ea-a319-79b63b1cc772 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:51.978396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ccddb0a-b021-48ea-a319-79b63b1cc772 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:51.984384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ccddb0a-b021-48ea-a319-79b63b1cc772 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:51.984868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ccddb0a-b021-48ea-a319-79b63b1cc772 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:51.985310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ccddb0a-b021-48ea-a319-79b63b1cc772 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:51.986001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ccddb0a-b021-48ea-a319-79b63b1cc772 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:51.986456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ccddb0a-b021-48ea-a319-79b63b1cc772 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:51.986880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ccddb0a-b021-48ea-a319-79b63b1cc772 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:52.119244 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ccddb0a-b021-48ea-a319-79b63b1cc772 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:52.127165 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ccddb0a-b021-48ea-a319-79b63b1cc772 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1507 microversion: 2.1 time: 0.153260 Sep 08 13:48:52.127761 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3158/6446] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:51 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:52.150187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-58a2f554-fc97-4157-826c-298345f58b25 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:52.150694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58a2f554-fc97-4157-826c-298345f58b25 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:52.156712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58a2f554-fc97-4157-826c-298345f58b25 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:52.157208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58a2f554-fc97-4157-826c-298345f58b25 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:52.157658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58a2f554-fc97-4157-826c-298345f58b25 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:52.158358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58a2f554-fc97-4157-826c-298345f58b25 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:52.158823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58a2f554-fc97-4157-826c-298345f58b25 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:52.159282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58a2f554-fc97-4157-826c-298345f58b25 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:52.187413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58a2f554-fc97-4157-826c-298345f58b25 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:48:52.265249 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-58a2f554-fc97-4157-826c-298345f58b25 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 204 len: 0 microversion: 2.1 time: 0.118970 Sep 08 13:48:52.266095 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3289/6447] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:48:52 2022] DELETE /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:48:52.282979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c174f50a-6fb3-4ab3-a7f1-d9ef343f0513 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:52.283515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c174f50a-6fb3-4ab3-a7f1-d9ef343f0513 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:52.289577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c174f50a-6fb3-4ab3-a7f1-d9ef343f0513 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:52.290698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c174f50a-6fb3-4ab3-a7f1-d9ef343f0513 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:52.291140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c174f50a-6fb3-4ab3-a7f1-d9ef343f0513 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:52.291861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c174f50a-6fb3-4ab3-a7f1-d9ef343f0513 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:52.292327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c174f50a-6fb3-4ab3-a7f1-d9ef343f0513 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:52.292753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c174f50a-6fb3-4ab3-a7f1-d9ef343f0513 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:52.318328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c174f50a-6fb3-4ab3-a7f1-d9ef343f0513 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:48:52.365495 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.compute.api [None req-c174f50a-6fb3-4ab3-a7f1-d9ef343f0513 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Instance is already in deleting state, ignoring this request Sep 08 13:48:52.366320 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c174f50a-6fb3-4ab3-a7f1-d9ef343f0513 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 204 len: 0 microversion: 2.1 time: 0.087629 Sep 08 13:48:52.366900 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3159/6448] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:48:52 2022] DELETE /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:48:52.375937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9705dcbd-e5a3-4893-86ab-761986538897 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:52.376670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9705dcbd-e5a3-4893-86ab-761986538897 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:52.382803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9705dcbd-e5a3-4893-86ab-761986538897 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:52.383349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9705dcbd-e5a3-4893-86ab-761986538897 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:52.384409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9705dcbd-e5a3-4893-86ab-761986538897 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:52.385047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9705dcbd-e5a3-4893-86ab-761986538897 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:52.385521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9705dcbd-e5a3-4893-86ab-761986538897 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:52.386005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9705dcbd-e5a3-4893-86ab-761986538897 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:52.517774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9705dcbd-e5a3-4893-86ab-761986538897 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:52.526422 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9705dcbd-e5a3-4893-86ab-761986538897 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1513 microversion: 2.1 time: 0.154857 Sep 08 13:48:52.527008 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3290/6449] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:52 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:53.549634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a66bc4d6-0b50-4bff-a083-de066644266c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:53.550262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a66bc4d6-0b50-4bff-a083-de066644266c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:53.557376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a66bc4d6-0b50-4bff-a083-de066644266c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:53.557877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a66bc4d6-0b50-4bff-a083-de066644266c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:53.558316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a66bc4d6-0b50-4bff-a083-de066644266c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:53.559044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a66bc4d6-0b50-4bff-a083-de066644266c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:53.559530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a66bc4d6-0b50-4bff-a083-de066644266c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:53.559961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a66bc4d6-0b50-4bff-a083-de066644266c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:53.720575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a66bc4d6-0b50-4bff-a083-de066644266c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a2507cbdeb640149b0a09405f28e2f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '003eaae0b49a4b7aa10b32d6047c82fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:48:53.731154 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a66bc4d6-0b50-4bff-a083-de066644266c tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 200 len: 1513 microversion: 2.1 time: 0.185357 Sep 08 13:48:53.731797 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3160/6450] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:53 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 1513 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:48:54.053054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f2d6456a-2a6d-4228-a48d-7623a0fa7170 req-a1f05c11-5264-4a06-a961-478118679fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba6ea40-1435-46e5-be8f-62f59bfa08f2", "name": "network-vif-deleted", "tag": "f974a26b-00c6-4125-bfcd-374b00c0af7b"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:48:54.075601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f2d6456a-2a6d-4228-a48d-7623a0fa7170 req-a1f05c11-5264-4a06-a961-478118679fa9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:54.076482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f2d6456a-2a6d-4228-a48d-7623a0fa7170 req-a1f05c11-5264-4a06-a961-478118679fa9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:54.077326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f2d6456a-2a6d-4228-a48d-7623a0fa7170 req-a1f05c11-5264-4a06-a961-478118679fa9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:54.092863 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f2d6456a-2a6d-4228-a48d-7623a0fa7170 req-a1f05c11-5264-4a06-a961-478118679fa9 service nova] Creating event network-vif-deleted:f974a26b-00c6-4125-bfcd-374b00c0af7b for instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 on n-h1-852084-10 Sep 08 13:48:54.098041 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f2d6456a-2a6d-4228-a48d-7623a0fa7170 req-a1f05c11-5264-4a06-a961-478118679fa9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052615 Sep 08 13:48:54.099204 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3291/6451] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:48:54.754154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c22c7f2f-41f3-4507-ad17-9d94c19481e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:54.754811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c22c7f2f-41f3-4507-ad17-9d94c19481e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 5ba6ea40-1435-46e5-be8f-62f59bfa08f2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:54.762375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c22c7f2f-41f3-4507-ad17-9d94c19481e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:54.762854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c22c7f2f-41f3-4507-ad17-9d94c19481e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:54.763317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c22c7f2f-41f3-4507-ad17-9d94c19481e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:54.764021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c22c7f2f-41f3-4507-ad17-9d94c19481e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:54.764478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c22c7f2f-41f3-4507-ad17-9d94c19481e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:54.764910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c22c7f2f-41f3-4507-ad17-9d94c19481e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:54.779666 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-c22c7f2f-41f3-4507-ad17-9d94c19481e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] HTTP exception thrown: Instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 could not be found. Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c22c7f2f-41f3-4507-ad17-9d94c19481e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Request method failure captured: Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 HTTP/1.1 Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfJkCNpIeWEAR2WhNrR7LfycFvK2nKf6KPePbIuiv7APmVsxtvSkRFFsIh0-LnL6S70L_ngQqK-EUgChfOhtJGv7CyIug44Us_x3lkimylIZ1ZgNrvzqzX2PwO6LdqclwF2ECyYu3oqbPpCm_LThcFvf1qdbfVyHGLpYebRMIodxi4E Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 003eaae0b49a4b7aa10b32d6047c82fd Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerDiskConfigTestJSON-31498285 Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_003eaae0b49a4b7aa10b32d6047c82fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/003eaae0b49a4b7aa10b32d6047c82fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/003eaae0b49a4b7aa10b32d6047c82fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/003eaae0b49a4b7aa10b32d6047c82fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerDiskConfigTestJSON-31498285 Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 003eaae0b49a4b7aa10b32d6047c82fd Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-31498285 Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerDiskConfigTestJSON-31498285-project Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6a2507cbdeb640149b0a09405f28e2f8 Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerDiskConfigTestJSON-31498285-project Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 could not be found. Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '5ba6ea40-1435-46e5-be8f-62f59bfa08f2'} Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 could not be found. Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 could not be found. Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:48:54.781343 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:48:54.785579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:48:54.785579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:48:54.785579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:48:54.785579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:48:54.785579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:48:54.785579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 could not be found. Sep 08 13:48:54.785579 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:48:54.785579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c22c7f2f-41f3-4507-ad17-9d94c19481e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Returning 404 to user: Instance 5ba6ea40-1435-46e5-be8f-62f59bfa08f2 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:48:54.785579 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c22c7f2f-41f3-4507-ad17-9d94c19481e4 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2" status: 404 len: 111 microversion: 2.1 time: 0.032615 Sep 08 13:48:54.785579 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3161/6452] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:54 2022] GET /compute/v2.1/servers/5ba6ea40-1435-46e5-be8f-62f59bfa08f2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:48:54.792161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aea4174f-a44e-494c-9ed2-d631e73c0d0d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '.version_select at 0x7fdb2477dee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:54.815850 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aea4174f-a44e-494c-9ed2-d631e73c0d0d tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-397022567" status: 202 len: 0 microversion: 2.1 time: 0.027759 Sep 08 13:48:54.816539 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3292/6453] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 13:48:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-397022567 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:48:55.478997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5fcc865b-459b-470e-b918-5bd9ed443f33 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:55.479530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5fcc865b-459b-470e-b918-5bd9ed443f33 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:55.485595 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fcc865b-459b-470e-b918-5bd9ed443f33 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:55.486084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fcc865b-459b-470e-b918-5bd9ed443f33 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:55.486525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fcc865b-459b-470e-b918-5bd9ed443f33 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:55.487410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fcc865b-459b-470e-b918-5bd9ed443f33 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:55.487843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fcc865b-459b-470e-b918-5bd9ed443f33 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:55.488279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5fcc865b-459b-470e-b918-5bd9ed443f33 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:55.502368 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-5fcc865b-459b-470e-b918-5bd9ed443f33 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] HTTP exception thrown: Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f could not be found. Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5fcc865b-459b-470e-b918-5bd9ed443f33 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Request method failure captured: Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f HTTP/1.1 Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfJkCNpIeWEAR2WhNrR7LfycFvK2nKf6KPePbIuiv7APmVsxtvSkRFFsIh0-LnL6S70L_ngQqK-EUgChfOhtJGv7CyIug44Us_x3lkimylIZ1ZgNrvzqzX2PwO6LdqclwF2ECyYu3oqbPpCm_LThcFvf1qdbfVyHGLpYebRMIodxi4E Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 003eaae0b49a4b7aa10b32d6047c82fd Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerDiskConfigTestJSON-31498285 Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_003eaae0b49a4b7aa10b32d6047c82fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/003eaae0b49a4b7aa10b32d6047c82fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/003eaae0b49a4b7aa10b32d6047c82fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/003eaae0b49a4b7aa10b32d6047c82fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerDiskConfigTestJSON-31498285 Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 003eaae0b49a4b7aa10b32d6047c82fd Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-31498285 Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerDiskConfigTestJSON-31498285-project Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 6a2507cbdeb640149b0a09405f28e2f8 Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerDiskConfigTestJSON-31498285-project Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f could not be found. Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f'} Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f could not be found. Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:48:55.503957 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f could not be found. Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f could not be found. Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5fcc865b-459b-470e-b918-5bd9ed443f33 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Returning 404 to user: Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5fcc865b-459b-470e-b918-5bd9ed443f33 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "DELETE /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 404 len: 111 microversion: 2.1 time: 0.030473 Sep 08 13:48:55.507851 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3162/6454] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:48:55 2022] DELETE /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:48:55.515727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dacb2351-090b-4131-b474-7d0e64b14bd0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:48:55.516490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dacb2351-090b-4131-b474-7d0e64b14bd0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] [instance: 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:48:55.523181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dacb2351-090b-4131-b474-7d0e64b14bd0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:55.523764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dacb2351-090b-4131-b474-7d0e64b14bd0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:55.524633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dacb2351-090b-4131-b474-7d0e64b14bd0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:55.524981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dacb2351-090b-4131-b474-7d0e64b14bd0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:48:55.525456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dacb2351-090b-4131-b474-7d0e64b14bd0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:48:55.525901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dacb2351-090b-4131-b474-7d0e64b14bd0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:48:55.539201 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-dacb2351-090b-4131-b474-7d0e64b14bd0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] HTTP exception thrown: Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f could not be found. Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dacb2351-090b-4131-b474-7d0e64b14bd0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Request method failure captured: Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f HTTP/1.1 Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfJkCNpIeWEAR2WhNrR7LfycFvK2nKf6KPePbIuiv7APmVsxtvSkRFFsIh0-LnL6S70L_ngQqK-EUgChfOhtJGv7CyIug44Us_x3lkimylIZ1ZgNrvzqzX2PwO6LdqclwF2ECyYu3oqbPpCm_LThcFvf1qdbfVyHGLpYebRMIodxi4E Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 003eaae0b49a4b7aa10b32d6047c82fd Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerDiskConfigTestJSON-31498285 Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_003eaae0b49a4b7aa10b32d6047c82fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/003eaae0b49a4b7aa10b32d6047c82fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/003eaae0b49a4b7aa10b32d6047c82fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/003eaae0b49a4b7aa10b32d6047c82fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerDiskConfigTestJSON-31498285 Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 003eaae0b49a4b7aa10b32d6047c82fd Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-31498285 Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerDiskConfigTestJSON-31498285-project Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 6a2507cbdeb640149b0a09405f28e2f8 Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerDiskConfigTestJSON-31498285-project Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f could not be found. Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f'} Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f could not be found. Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f could not be found. Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:48:55.541391 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:48:55.546623 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:48:55.546623 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:48:55.546623 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:48:55.546623 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:48:55.546623 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:48:55.546623 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f could not be found. Sep 08 13:48:55.546623 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:48:55.546623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dacb2351-090b-4131-b474-7d0e64b14bd0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] Returning 404 to user: Instance 282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:48:55.546623 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dacb2351-090b-4131-b474-7d0e64b14bd0 tempest-ServerDiskConfigTestJSON-31498285 tempest-ServerDiskConfigTestJSON-31498285-project] 10.222.0.78 "GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f" status: 404 len: 111 microversion: 2.1 time: 0.032046 Sep 08 13:48:55.546623 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3293/6455] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:48:55 2022] GET /compute/v2.1/servers/282ea3bf-4d74-48e4-bf72-c6dd5f2ebb2f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:49:05.517630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=27 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:49:05.518806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:49:05.676357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dbbe2cc1-00c5-48e4-bb4f-7a56d13a294d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'create', calling method: .version_select at 0x7fdb3a72a1f0>, body: {"keypair": {"name": "tempest-keypair-783440952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMp8pzmJq7Tpv/QoDh305Tl3TPgG8/+dJJMleUuV8B9OtD0cG1asAupKIuB4f7WyVH3Z6yzcLdR7mudVzL40JW3sVUZVg0KzwIun7/dO1xVmeulEqF+Yk77cYRTjIfz2lA=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:49:05.693215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-dbbe2cc1-00c5-48e4-bb4f-7a56d13a294d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:49:05.699791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-dbbe2cc1-00c5-48e4-bb4f-7a56d13a294d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for user 660a56a892a645f3949629bc47b7ce94 and project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:49:05.726547 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dbbe2cc1-00c5-48e4-bb4f-7a56d13a294d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.219745 Sep 08 13:49:05.727086 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3163/6456] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:49:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:49:07.235894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:49:07.237416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:49:07.242594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1543198411", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "152acfcb-1ab2-4c75-8556-f2471248ba62"}], "security_groups": [{"name": "tempest-securitygroup--1696640897"}], "key_name": "tempest-keypair-783440952", "user_data": "}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:49:07.368150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] validate_networks() for [('152acfcb-1ab2-4c75-8556-f2471248ba62', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:49:07.866218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:49:07.866660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:49:07.867321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:49:07.867768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:49:07.868205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:49:07.877445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:07.878118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:07.878575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:07.879359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:07.879834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:07.880276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:07.898650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:49:07.904993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for user 660a56a892a645f3949629bc47b7ce94 and project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:49:07.918992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:49:07.921375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:49:07.972906 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1c4c1e88-caf3-4c6a-bd1c-c27b59369151 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.738672 Sep 08 13:49:07.973681 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3294/6457] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:49:07 2022] POST /compute/v2.1/servers => generated 409 bytes in 740 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:49:07.985825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d2e2dfd3-8505-47e2-8dba-e8524f2bfe5b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:07.986583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d2e2dfd3-8505-47e2-8dba-e8524f2bfe5b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:08.050116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d2e2dfd3-8505-47e2-8dba-e8524f2bfe5b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:08.057308 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d2e2dfd3-8505-47e2-8dba-e8524f2bfe5b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1238 microversion: 2.1 time: 0.075803 Sep 08 13:49:08.058259 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3164/6458] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:07 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1238 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:49:09.084259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d2c7c307-99ed-4ba5-8220-f835a68cc168 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:09.085276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d2c7c307-99ed-4ba5-8220-f835a68cc168 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:09.094058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2c7c307-99ed-4ba5-8220-f835a68cc168 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:09.094730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2c7c307-99ed-4ba5-8220-f835a68cc168 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:09.095321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2c7c307-99ed-4ba5-8220-f835a68cc168 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:09.096161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2c7c307-99ed-4ba5-8220-f835a68cc168 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:09.096754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2c7c307-99ed-4ba5-8220-f835a68cc168 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:09.097300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2c7c307-99ed-4ba5-8220-f835a68cc168 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:09.188797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d2c7c307-99ed-4ba5-8220-f835a68cc168 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:09.198372 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d2c7c307-99ed-4ba5-8220-f835a68cc168 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1290 microversion: 2.1 time: 0.120303 Sep 08 13:49:09.199363 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3295/6459] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:09 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1290 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:49:10.239112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7487b5a5-f011-4ce0-83bf-532b303de103 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:10.240586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7487b5a5-f011-4ce0-83bf-532b303de103 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:10.247846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7487b5a5-f011-4ce0-83bf-532b303de103 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:10.248373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7487b5a5-f011-4ce0-83bf-532b303de103 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:10.248841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7487b5a5-f011-4ce0-83bf-532b303de103 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:10.249552 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7487b5a5-f011-4ce0-83bf-532b303de103 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:10.250274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7487b5a5-f011-4ce0-83bf-532b303de103 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:10.250712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7487b5a5-f011-4ce0-83bf-532b303de103 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:10.423726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7487b5a5-f011-4ce0-83bf-532b303de103 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:10.439902 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7487b5a5-f011-4ce0-83bf-532b303de103 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1364 microversion: 2.1 time: 0.204470 Sep 08 13:49:10.449996 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3165/6460] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:10 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:49:11.342823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f362c045-6738-438a-9ff8-56daf37abe87 req-f85ef075-0113-4838-84d5-92c9b591b2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802f7eab-898e-44d1-b478-582d5e149a51", "tag": "289108ba-54db-40eb-9ff2-a9f9fdfed48c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:49:11.355817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f362c045-6738-438a-9ff8-56daf37abe87 req-f85ef075-0113-4838-84d5-92c9b591b2e4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:11.356332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f362c045-6738-438a-9ff8-56daf37abe87 req-f85ef075-0113-4838-84d5-92c9b591b2e4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:11.356790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f362c045-6738-438a-9ff8-56daf37abe87 req-f85ef075-0113-4838-84d5-92c9b591b2e4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:11.369541 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f362c045-6738-438a-9ff8-56daf37abe87 req-f85ef075-0113-4838-84d5-92c9b591b2e4 service nova] Creating event network-changed:289108ba-54db-40eb-9ff2-a9f9fdfed48c for instance 802f7eab-898e-44d1-b478-582d5e149a51 on n-h1-852084-10 Sep 08 13:49:11.374824 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f362c045-6738-438a-9ff8-56daf37abe87 req-f85ef075-0113-4838-84d5-92c9b591b2e4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035769 Sep 08 13:49:11.375485 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3296/6461] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:49:11.471504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0d637e7b-92bb-412a-844b-aaaa1a693c33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:11.472136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0d637e7b-92bb-412a-844b-aaaa1a693c33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:11.478958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d637e7b-92bb-412a-844b-aaaa1a693c33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:11.479481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d637e7b-92bb-412a-844b-aaaa1a693c33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:11.479938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d637e7b-92bb-412a-844b-aaaa1a693c33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:11.480642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d637e7b-92bb-412a-844b-aaaa1a693c33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:11.481095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d637e7b-92bb-412a-844b-aaaa1a693c33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:11.481517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0d637e7b-92bb-412a-844b-aaaa1a693c33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:11.630190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0d637e7b-92bb-412a-844b-aaaa1a693c33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:11.639489 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0d637e7b-92bb-412a-844b-aaaa1a693c33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1364 microversion: 2.1 time: 0.174823 Sep 08 13:49:11.640094 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3166/6462] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:11 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:49:12.664962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bbd2def3-ee09-428b-ba9a-9830855db0cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:12.665707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bbd2def3-ee09-428b-ba9a-9830855db0cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:12.672469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd2def3-ee09-428b-ba9a-9830855db0cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:12.672980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd2def3-ee09-428b-ba9a-9830855db0cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:12.673535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd2def3-ee09-428b-ba9a-9830855db0cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:12.674393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd2def3-ee09-428b-ba9a-9830855db0cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:12.674874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd2def3-ee09-428b-ba9a-9830855db0cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:12.675348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbd2def3-ee09-428b-ba9a-9830855db0cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:12.818402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bbd2def3-ee09-428b-ba9a-9830855db0cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:12.827689 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bbd2def3-ee09-428b-ba9a-9830855db0cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1364 microversion: 2.1 time: 0.168770 Sep 08 13:49:12.828563 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3297/6463] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:12 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:49:13.853354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-52b2286f-6640-41c6-908b-24e626968bc4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:13.853990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-52b2286f-6640-41c6-908b-24e626968bc4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:13.862124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52b2286f-6640-41c6-908b-24e626968bc4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:13.862617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52b2286f-6640-41c6-908b-24e626968bc4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:13.863058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52b2286f-6640-41c6-908b-24e626968bc4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:13.863813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52b2286f-6640-41c6-908b-24e626968bc4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:13.864275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52b2286f-6640-41c6-908b-24e626968bc4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:13.864704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-52b2286f-6640-41c6-908b-24e626968bc4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:14.017245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-52b2286f-6640-41c6-908b-24e626968bc4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:14.025169 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-52b2286f-6640-41c6-908b-24e626968bc4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1364 microversion: 2.1 time: 0.177501 Sep 08 13:49:14.025745 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3167/6464] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:13 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:49:15.048545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-df0d62a4-c01a-453d-8547-c201c1e2278d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:15.049291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-df0d62a4-c01a-453d-8547-c201c1e2278d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:15.057718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df0d62a4-c01a-453d-8547-c201c1e2278d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:15.058224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df0d62a4-c01a-453d-8547-c201c1e2278d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:15.058674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df0d62a4-c01a-453d-8547-c201c1e2278d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:15.059424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df0d62a4-c01a-453d-8547-c201c1e2278d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:15.059895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df0d62a4-c01a-453d-8547-c201c1e2278d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:15.060329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df0d62a4-c01a-453d-8547-c201c1e2278d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:15.201477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-df0d62a4-c01a-453d-8547-c201c1e2278d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:15.214497 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-df0d62a4-c01a-453d-8547-c201c1e2278d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1364 microversion: 2.1 time: 0.168694 Sep 08 13:49:15.214987 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3298/6465] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:15 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:49:16.239600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad655b23-fa2c-4dd8-b44d-2654f00e29e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:16.240557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad655b23-fa2c-4dd8-b44d-2654f00e29e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:16.249086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad655b23-fa2c-4dd8-b44d-2654f00e29e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:16.249705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad655b23-fa2c-4dd8-b44d-2654f00e29e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:16.250240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad655b23-fa2c-4dd8-b44d-2654f00e29e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:16.251235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad655b23-fa2c-4dd8-b44d-2654f00e29e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:16.251814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad655b23-fa2c-4dd8-b44d-2654f00e29e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:16.252277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad655b23-fa2c-4dd8-b44d-2654f00e29e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:16.389669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ad655b23-fa2c-4dd8-b44d-2654f00e29e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:16.398081 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad655b23-fa2c-4dd8-b44d-2654f00e29e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1364 microversion: 2.1 time: 0.163530 Sep 08 13:49:16.398771 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3168/6466] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:16 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:49:16.988294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f7a454a6-2c3b-41f3-a835-d6204816d093 req-6594c421-e4a5-41a2-acbb-aebce2f64194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802f7eab-898e-44d1-b478-582d5e149a51", "name": "network-vif-plugged", "status": "completed", "tag": "289108ba-54db-40eb-9ff2-a9f9fdfed48c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:49:16.999417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f7a454a6-2c3b-41f3-a835-d6204816d093 req-6594c421-e4a5-41a2-acbb-aebce2f64194 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:17.000125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f7a454a6-2c3b-41f3-a835-d6204816d093 req-6594c421-e4a5-41a2-acbb-aebce2f64194 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:17.000571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f7a454a6-2c3b-41f3-a835-d6204816d093 req-6594c421-e4a5-41a2-acbb-aebce2f64194 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:17.012011 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f7a454a6-2c3b-41f3-a835-d6204816d093 req-6594c421-e4a5-41a2-acbb-aebce2f64194 service nova] Creating event network-vif-plugged:289108ba-54db-40eb-9ff2-a9f9fdfed48c for instance 802f7eab-898e-44d1-b478-582d5e149a51 on n-h1-852084-10 Sep 08 13:49:17.017172 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f7a454a6-2c3b-41f3-a835-d6204816d093 req-6594c421-e4a5-41a2-acbb-aebce2f64194 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032774 Sep 08 13:49:17.017841 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3299/6467] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:49:17.422121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0c097eb5-68f9-4f6f-87f0-9b08af74d5ce tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:17.422877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0c097eb5-68f9-4f6f-87f0-9b08af74d5ce tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:17.429715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c097eb5-68f9-4f6f-87f0-9b08af74d5ce tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:17.430202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c097eb5-68f9-4f6f-87f0-9b08af74d5ce tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:17.430672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c097eb5-68f9-4f6f-87f0-9b08af74d5ce tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:17.431447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c097eb5-68f9-4f6f-87f0-9b08af74d5ce tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:17.431914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c097eb5-68f9-4f6f-87f0-9b08af74d5ce tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:17.432323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c097eb5-68f9-4f6f-87f0-9b08af74d5ce tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:17.572440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0c097eb5-68f9-4f6f-87f0-9b08af74d5ce tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:17.581223 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0c097eb5-68f9-4f6f-87f0-9b08af74d5ce tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1364 microversion: 2.1 time: 0.163118 Sep 08 13:49:17.581810 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3169/6468] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:17 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:49:18.603447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:49:18.604271 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:49:18.609904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5ad19d52-3d26-43d4-bc87-212aebd0132c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:18.610626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5ad19d52-3d26-43d4-bc87-212aebd0132c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:18.618643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ad19d52-3d26-43d4-bc87-212aebd0132c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:18.619154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ad19d52-3d26-43d4-bc87-212aebd0132c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:18.619632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ad19d52-3d26-43d4-bc87-212aebd0132c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:18.620337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ad19d52-3d26-43d4-bc87-212aebd0132c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:18.620805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ad19d52-3d26-43d4-bc87-212aebd0132c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:18.621249 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ad19d52-3d26-43d4-bc87-212aebd0132c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:18.753155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5ad19d52-3d26-43d4-bc87-212aebd0132c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:18.761017 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5ad19d52-3d26-43d4-bc87-212aebd0132c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1550 microversion: 2.1 time: 0.159127 Sep 08 13:49:18.761595 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3300/6469] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:18 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:49:18.783606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e65c04a8-bfd3-4e81-bfc2-0a3c9db65a3c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:18.784265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e65c04a8-bfd3-4e81-bfc2-0a3c9db65a3c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:18.786075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:49:18.792408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e65c04a8-bfd3-4e81-bfc2-0a3c9db65a3c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:18.792892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e65c04a8-bfd3-4e81-bfc2-0a3c9db65a3c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:18.793328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e65c04a8-bfd3-4e81-bfc2-0a3c9db65a3c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:18.794014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e65c04a8-bfd3-4e81-bfc2-0a3c9db65a3c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:18.794463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e65c04a8-bfd3-4e81-bfc2-0a3c9db65a3c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:18.794883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e65c04a8-bfd3-4e81-bfc2-0a3c9db65a3c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:18.880089 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e65c04a8-bfd3-4e81-bfc2-0a3c9db65a3c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100304 Sep 08 13:49:18.880696 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3170/6470] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:49:18 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:49:19.855928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c2b296f4-823a-406b-966b-839fbf2854ff req-74dff495-61c2-4333-992e-a8e092b69ad8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802f7eab-898e-44d1-b478-582d5e149a51", "tag": "289108ba-54db-40eb-9ff2-a9f9fdfed48c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:49:19.866385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c2b296f4-823a-406b-966b-839fbf2854ff req-74dff495-61c2-4333-992e-a8e092b69ad8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:19.866881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c2b296f4-823a-406b-966b-839fbf2854ff req-74dff495-61c2-4333-992e-a8e092b69ad8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:19.867370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c2b296f4-823a-406b-966b-839fbf2854ff req-74dff495-61c2-4333-992e-a8e092b69ad8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:19.882875 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c2b296f4-823a-406b-966b-839fbf2854ff req-74dff495-61c2-4333-992e-a8e092b69ad8 service nova] Creating event network-changed:289108ba-54db-40eb-9ff2-a9f9fdfed48c for instance 802f7eab-898e-44d1-b478-582d5e149a51 on n-h1-852084-10 Sep 08 13:49:19.889135 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c2b296f4-823a-406b-966b-839fbf2854ff req-74dff495-61c2-4333-992e-a8e092b69ad8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037156 Sep 08 13:49:19.889914 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3301/6471] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:49:56.046696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:49:56.048089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=34 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:49:56.053723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ccf64341-813b-483d-9975-80f1e40f7262 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:56.054351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ccf64341-813b-483d-9975-80f1e40f7262 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:56.062388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccf64341-813b-483d-9975-80f1e40f7262 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:56.062875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccf64341-813b-483d-9975-80f1e40f7262 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:56.063337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccf64341-813b-483d-9975-80f1e40f7262 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:56.064031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccf64341-813b-483d-9975-80f1e40f7262 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:56.064482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccf64341-813b-483d-9975-80f1e40f7262 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:56.064904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ccf64341-813b-483d-9975-80f1e40f7262 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:56.208127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ccf64341-813b-483d-9975-80f1e40f7262 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:56.219158 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ccf64341-813b-483d-9975-80f1e40f7262 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1668 microversion: 2.1 time: 0.174498 Sep 08 13:49:56.220066 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3171/6472] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:56 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1668 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:49:56.251080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7ede50da-252e-4742-b219-452df0379aa6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:56.252425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7ede50da-252e-4742-b219-452df0379aa6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:56.254791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:49:56.255489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=32 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:49:56.263727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ede50da-252e-4742-b219-452df0379aa6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:56.264233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ede50da-252e-4742-b219-452df0379aa6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:56.264682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ede50da-252e-4742-b219-452df0379aa6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:56.265400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ede50da-252e-4742-b219-452df0379aa6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:56.265867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ede50da-252e-4742-b219-452df0379aa6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:56.266338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7ede50da-252e-4742-b219-452df0379aa6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:56.417479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7ede50da-252e-4742-b219-452df0379aa6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:56.425651 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7ede50da-252e-4742-b219-452df0379aa6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1668 microversion: 2.1 time: 0.183133 Sep 08 13:49:56.426233 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3302/6473] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:56 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1668 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:49:56.450450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-84996f44-9bae-44e6-9800-545c80a6bf34 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:56.451075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-84996f44-9bae-44e6-9800-545c80a6bf34 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:56.458125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84996f44-9bae-44e6-9800-545c80a6bf34 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:56.458622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84996f44-9bae-44e6-9800-545c80a6bf34 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:56.459118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84996f44-9bae-44e6-9800-545c80a6bf34 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:56.460034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84996f44-9bae-44e6-9800-545c80a6bf34 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:56.461351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84996f44-9bae-44e6-9800-545c80a6bf34 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:56.462084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-84996f44-9bae-44e6-9800-545c80a6bf34 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:56.599067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-84996f44-9bae-44e6-9800-545c80a6bf34 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:56.606917 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-84996f44-9bae-44e6-9800-545c80a6bf34 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1668 microversion: 2.1 time: 0.162132 Sep 08 13:49:56.607462 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3172/6474] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:56 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1668 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:49:56.629407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:49:56.631689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:56.638154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:56.638660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:56.639109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:56.639889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:56.640349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:56.640793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:56.669274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:56.674774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Old instance type m1.heat2, new instance type m1.heat {{(pid=128970) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 13:49:56.681393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:49:56.681834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:49:56.682328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:49:56.682755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:49:56.683180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:49:56.751663 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9b4f062b-0519-47f8-bfb0-fe72aab219eb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51/action" status: 202 len: 0 microversion: 2.1 time: 0.126234 Sep 08 13:49:56.752317 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3303/6475] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:49:56 2022] POST /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:49:56.760701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-75455730-4f52-4a0d-9ae4-712226622c73 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:56.761402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-75455730-4f52-4a0d-9ae4-712226622c73 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:56.767959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75455730-4f52-4a0d-9ae4-712226622c73 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:56.768453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75455730-4f52-4a0d-9ae4-712226622c73 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:56.769035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75455730-4f52-4a0d-9ae4-712226622c73 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:56.769731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75455730-4f52-4a0d-9ae4-712226622c73 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:56.770179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75455730-4f52-4a0d-9ae4-712226622c73 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:56.770601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75455730-4f52-4a0d-9ae4-712226622c73 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:56.919685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-75455730-4f52-4a0d-9ae4-712226622c73 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:56.927910 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-75455730-4f52-4a0d-9ae4-712226622c73 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1677 microversion: 2.1 time: 0.171128 Sep 08 13:49:56.928523 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3173/6476] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:56 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:49:57.956125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-655dbc26-322f-4a07-8a6d-b4bc366ad931 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:57.956769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-655dbc26-322f-4a07-8a6d-b4bc366ad931 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:57.965466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-655dbc26-322f-4a07-8a6d-b4bc366ad931 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:57.965984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-655dbc26-322f-4a07-8a6d-b4bc366ad931 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:57.966440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-655dbc26-322f-4a07-8a6d-b4bc366ad931 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:57.967164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-655dbc26-322f-4a07-8a6d-b4bc366ad931 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:57.967669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-655dbc26-322f-4a07-8a6d-b4bc366ad931 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:57.968115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-655dbc26-322f-4a07-8a6d-b4bc366ad931 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:58.109424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-655dbc26-322f-4a07-8a6d-b4bc366ad931 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:58.118305 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-655dbc26-322f-4a07-8a6d-b4bc366ad931 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1677 microversion: 2.1 time: 0.169269 Sep 08 13:49:58.119256 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3304/6477] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:57 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:49:59.142940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-04ddec58-16b4-4bbf-9df4-2ee1ac10bd86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:49:59.143704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-04ddec58-16b4-4bbf-9df4-2ee1ac10bd86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:49:59.151730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04ddec58-16b4-4bbf-9df4-2ee1ac10bd86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:59.152232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04ddec58-16b4-4bbf-9df4-2ee1ac10bd86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:59.152673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04ddec58-16b4-4bbf-9df4-2ee1ac10bd86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:59.153381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04ddec58-16b4-4bbf-9df4-2ee1ac10bd86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:49:59.153830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04ddec58-16b4-4bbf-9df4-2ee1ac10bd86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:49:59.154256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04ddec58-16b4-4bbf-9df4-2ee1ac10bd86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:49:59.327039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-04ddec58-16b4-4bbf-9df4-2ee1ac10bd86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:49:59.335499 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-04ddec58-16b4-4bbf-9df4-2ee1ac10bd86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1682 microversion: 2.1 time: 0.196611 Sep 08 13:49:59.336105 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3174/6478] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:49:59 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1682 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:00.360709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-24fa9ea9-5628-44c7-86b9-40bf5f94ef86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:00.361353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-24fa9ea9-5628-44c7-86b9-40bf5f94ef86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:00.368901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24fa9ea9-5628-44c7-86b9-40bf5f94ef86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:00.369412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24fa9ea9-5628-44c7-86b9-40bf5f94ef86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:00.369868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24fa9ea9-5628-44c7-86b9-40bf5f94ef86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:00.370606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24fa9ea9-5628-44c7-86b9-40bf5f94ef86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:00.371081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24fa9ea9-5628-44c7-86b9-40bf5f94ef86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:00.371546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-24fa9ea9-5628-44c7-86b9-40bf5f94ef86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:00.510713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-24fa9ea9-5628-44c7-86b9-40bf5f94ef86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:00.519251 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-24fa9ea9-5628-44c7-86b9-40bf5f94ef86 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1682 microversion: 2.1 time: 0.163183 Sep 08 13:50:00.519882 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3305/6479] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:00 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:01.543961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6ddd999a-fee3-4573-8b80-ab4cac18b87d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:01.544579 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6ddd999a-fee3-4573-8b80-ab4cac18b87d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:01.551647 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ddd999a-fee3-4573-8b80-ab4cac18b87d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:01.552137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ddd999a-fee3-4573-8b80-ab4cac18b87d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:01.552575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ddd999a-fee3-4573-8b80-ab4cac18b87d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:01.553276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ddd999a-fee3-4573-8b80-ab4cac18b87d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:01.553727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ddd999a-fee3-4573-8b80-ab4cac18b87d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:01.554155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ddd999a-fee3-4573-8b80-ab4cac18b87d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:01.690792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6ddd999a-fee3-4573-8b80-ab4cac18b87d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:01.699592 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6ddd999a-fee3-4573-8b80-ab4cac18b87d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1682 microversion: 2.1 time: 0.159472 Sep 08 13:50:01.700229 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3175/6480] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:01 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:02.723594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-69f6335e-9b3a-4120-b850-34c11aeb5ce0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:02.724238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-69f6335e-9b3a-4120-b850-34c11aeb5ce0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:02.731594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69f6335e-9b3a-4120-b850-34c11aeb5ce0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:02.732090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69f6335e-9b3a-4120-b850-34c11aeb5ce0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:02.732536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69f6335e-9b3a-4120-b850-34c11aeb5ce0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:02.733240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69f6335e-9b3a-4120-b850-34c11aeb5ce0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:02.733722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69f6335e-9b3a-4120-b850-34c11aeb5ce0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:02.734187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69f6335e-9b3a-4120-b850-34c11aeb5ce0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:02.869740 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-69f6335e-9b3a-4120-b850-34c11aeb5ce0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:02.877774 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-69f6335e-9b3a-4120-b850-34c11aeb5ce0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1682 microversion: 2.1 time: 0.158331 Sep 08 13:50:02.878353 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3306/6481] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:02 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:03.902960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-32016ab0-7f91-43b4-8cec-ced32145634f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:03.903612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-32016ab0-7f91-43b4-8cec-ced32145634f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:03.910789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32016ab0-7f91-43b4-8cec-ced32145634f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:03.911594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32016ab0-7f91-43b4-8cec-ced32145634f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:03.912191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32016ab0-7f91-43b4-8cec-ced32145634f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:03.913036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32016ab0-7f91-43b4-8cec-ced32145634f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:03.913601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32016ab0-7f91-43b4-8cec-ced32145634f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:03.914639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-32016ab0-7f91-43b4-8cec-ced32145634f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:04.049704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-32016ab0-7f91-43b4-8cec-ced32145634f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:04.058598 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-32016ab0-7f91-43b4-8cec-ced32145634f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1682 microversion: 2.1 time: 0.159961 Sep 08 13:50:04.059449 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3176/6482] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:03 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:05.082320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ae6e3d9-fd49-448f-aa09-957cb678d107 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:05.082951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6ae6e3d9-fd49-448f-aa09-957cb678d107 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:05.090710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ae6e3d9-fd49-448f-aa09-957cb678d107 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:05.091206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ae6e3d9-fd49-448f-aa09-957cb678d107 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:05.091690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ae6e3d9-fd49-448f-aa09-957cb678d107 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:05.092395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ae6e3d9-fd49-448f-aa09-957cb678d107 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:05.092868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ae6e3d9-fd49-448f-aa09-957cb678d107 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:05.093308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ae6e3d9-fd49-448f-aa09-957cb678d107 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:05.225761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6ae6e3d9-fd49-448f-aa09-957cb678d107 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:05.234261 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6ae6e3d9-fd49-448f-aa09-957cb678d107 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1682 microversion: 2.1 time: 0.156099 Sep 08 13:50:05.234877 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3307/6483] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:05 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:50:06.264237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d027a533-b883-4e16-b764-af93cc629b65 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:06.265406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d027a533-b883-4e16-b764-af93cc629b65 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:06.272622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d027a533-b883-4e16-b764-af93cc629b65 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:06.273115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d027a533-b883-4e16-b764-af93cc629b65 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:06.274270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d027a533-b883-4e16-b764-af93cc629b65 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:06.274919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d027a533-b883-4e16-b764-af93cc629b65 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:06.275415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d027a533-b883-4e16-b764-af93cc629b65 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:06.275892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d027a533-b883-4e16-b764-af93cc629b65 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:06.409686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d027a533-b883-4e16-b764-af93cc629b65 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:06.418001 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d027a533-b883-4e16-b764-af93cc629b65 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1682 microversion: 2.1 time: 0.159195 Sep 08 13:50:06.418813 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3177/6484] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:06 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:07.442843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-67396058-2fb7-434d-9a21-ee39a41fca58 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:07.443520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-67396058-2fb7-434d-9a21-ee39a41fca58 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:07.450447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67396058-2fb7-434d-9a21-ee39a41fca58 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:07.450960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67396058-2fb7-434d-9a21-ee39a41fca58 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:07.451464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67396058-2fb7-434d-9a21-ee39a41fca58 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:07.452186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67396058-2fb7-434d-9a21-ee39a41fca58 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:07.452664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67396058-2fb7-434d-9a21-ee39a41fca58 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:07.453115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-67396058-2fb7-434d-9a21-ee39a41fca58 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:07.586472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-67396058-2fb7-434d-9a21-ee39a41fca58 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:07.594253 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-67396058-2fb7-434d-9a21-ee39a41fca58 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1682 microversion: 2.1 time: 0.155393 Sep 08 13:50:07.594839 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3308/6485] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:07 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:08.618349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f89543ee-c187-406a-8107-bf86586e7d97 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:08.619127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f89543ee-c187-406a-8107-bf86586e7d97 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:08.626157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f89543ee-c187-406a-8107-bf86586e7d97 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:08.626655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f89543ee-c187-406a-8107-bf86586e7d97 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:08.627099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f89543ee-c187-406a-8107-bf86586e7d97 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:08.627886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f89543ee-c187-406a-8107-bf86586e7d97 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:08.628348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f89543ee-c187-406a-8107-bf86586e7d97 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:08.628805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f89543ee-c187-406a-8107-bf86586e7d97 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:08.774715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f89543ee-c187-406a-8107-bf86586e7d97 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:08.782542 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f89543ee-c187-406a-8107-bf86586e7d97 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1682 microversion: 2.1 time: 0.168800 Sep 08 13:50:08.783115 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3178/6486] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:08 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:09.806279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-85535449-2dad-43ec-ac76-86cf578ea65d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:09.806967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-85535449-2dad-43ec-ac76-86cf578ea65d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:09.814147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85535449-2dad-43ec-ac76-86cf578ea65d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:09.814662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85535449-2dad-43ec-ac76-86cf578ea65d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:09.815138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85535449-2dad-43ec-ac76-86cf578ea65d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:09.815902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85535449-2dad-43ec-ac76-86cf578ea65d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:09.816381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85535449-2dad-43ec-ac76-86cf578ea65d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:09.816835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-85535449-2dad-43ec-ac76-86cf578ea65d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:09.954994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-85535449-2dad-43ec-ac76-86cf578ea65d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:09.963743 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-85535449-2dad-43ec-ac76-86cf578ea65d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1682 microversion: 2.1 time: 0.161388 Sep 08 13:50:09.964348 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3309/6487] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:09 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:10.988441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5b1f0fd6-df2f-4bc3-95a6-aecda5b9b670 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:10.989035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5b1f0fd6-df2f-4bc3-95a6-aecda5b9b670 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:10.997008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b1f0fd6-df2f-4bc3-95a6-aecda5b9b670 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:10.997486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b1f0fd6-df2f-4bc3-95a6-aecda5b9b670 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:10.998123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b1f0fd6-df2f-4bc3-95a6-aecda5b9b670 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:10.998833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b1f0fd6-df2f-4bc3-95a6-aecda5b9b670 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:10.999319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b1f0fd6-df2f-4bc3-95a6-aecda5b9b670 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:10.999745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5b1f0fd6-df2f-4bc3-95a6-aecda5b9b670 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:11.219300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5b1f0fd6-df2f-4bc3-95a6-aecda5b9b670 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:11.229837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-97d2e53b-c512-4c43-8296-a32e10695619 req-cc5d3b82-42c4-4476-8f19-5674db696b6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802f7eab-898e-44d1-b478-582d5e149a51", "name": "network-vif-unplugged", "status": "completed", "tag": "289108ba-54db-40eb-9ff2-a9f9fdfed48c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:50:11.235656 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5b1f0fd6-df2f-4bc3-95a6-aecda5b9b670 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1681 microversion: 2.1 time: 0.250908 Sep 08 13:50:11.237025 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3179/6488] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:10 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:11.243646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97d2e53b-c512-4c43-8296-a32e10695619 req-cc5d3b82-42c4-4476-8f19-5674db696b6c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:11.244368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97d2e53b-c512-4c43-8296-a32e10695619 req-cc5d3b82-42c4-4476-8f19-5674db696b6c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:11.245005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97d2e53b-c512-4c43-8296-a32e10695619 req-cc5d3b82-42c4-4476-8f19-5674db696b6c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:11.264990 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-97d2e53b-c512-4c43-8296-a32e10695619 req-cc5d3b82-42c4-4476-8f19-5674db696b6c service nova] Creating event network-vif-unplugged:289108ba-54db-40eb-9ff2-a9f9fdfed48c for instance 802f7eab-898e-44d1-b478-582d5e149a51 on n-h2-852084-10 Sep 08 13:50:11.270960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-97d2e53b-c512-4c43-8296-a32e10695619 req-cc5d3b82-42c4-4476-8f19-5674db696b6c service nova] Instance 802f7eab-898e-44d1-b478-582d5e149a51 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:50:11.282909 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-97d2e53b-c512-4c43-8296-a32e10695619 req-cc5d3b82-42c4-4476-8f19-5674db696b6c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057137 Sep 08 13:50:11.283566 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3310/6489] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:50:12.262842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3acf2967-75d8-4597-a436-5c1852931643 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:12.263487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3acf2967-75d8-4597-a436-5c1852931643 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:12.273690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3acf2967-75d8-4597-a436-5c1852931643 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:12.274189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3acf2967-75d8-4597-a436-5c1852931643 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:12.274735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3acf2967-75d8-4597-a436-5c1852931643 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:12.275494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3acf2967-75d8-4597-a436-5c1852931643 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:12.275972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3acf2967-75d8-4597-a436-5c1852931643 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:12.276376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3acf2967-75d8-4597-a436-5c1852931643 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:12.554929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3acf2967-75d8-4597-a436-5c1852931643 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:12.564522 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3acf2967-75d8-4597-a436-5c1852931643 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1681 microversion: 2.1 time: 0.306624 Sep 08 13:50:12.565434 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3180/6490] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:12 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:13.321291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-0eb21e64-0edb-46d6-b6a5-2b1330b5999e req-b958fc8e-3767-4a7d-8fa2-db9c876f665c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "802f7eab-898e-44d1-b478-582d5e149a51", "tag": "289108ba-54db-40eb-9ff2-a9f9fdfed48c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:50:13.331614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0eb21e64-0edb-46d6-b6a5-2b1330b5999e req-b958fc8e-3767-4a7d-8fa2-db9c876f665c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:13.332111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0eb21e64-0edb-46d6-b6a5-2b1330b5999e req-b958fc8e-3767-4a7d-8fa2-db9c876f665c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:13.332558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-0eb21e64-0edb-46d6-b6a5-2b1330b5999e req-b958fc8e-3767-4a7d-8fa2-db9c876f665c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:13.348858 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-0eb21e64-0edb-46d6-b6a5-2b1330b5999e req-b958fc8e-3767-4a7d-8fa2-db9c876f665c service nova] Creating event network-changed:289108ba-54db-40eb-9ff2-a9f9fdfed48c for instance 802f7eab-898e-44d1-b478-582d5e149a51 on n-h2-852084-10 Sep 08 13:50:13.354972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-0eb21e64-0edb-46d6-b6a5-2b1330b5999e req-b958fc8e-3767-4a7d-8fa2-db9c876f665c service nova] Instance 802f7eab-898e-44d1-b478-582d5e149a51 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:50:13.367660 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-0eb21e64-0edb-46d6-b6a5-2b1330b5999e req-b958fc8e-3767-4a7d-8fa2-db9c876f665c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050646 Sep 08 13:50:13.368298 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3311/6491] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:50:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:50:13.589465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5eee162d-e9fb-47b1-9d92-f3b7392831bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:13.590227 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5eee162d-e9fb-47b1-9d92-f3b7392831bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:13.601002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eee162d-e9fb-47b1-9d92-f3b7392831bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:13.601497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eee162d-e9fb-47b1-9d92-f3b7392831bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:13.602439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eee162d-e9fb-47b1-9d92-f3b7392831bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:13.603153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eee162d-e9fb-47b1-9d92-f3b7392831bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:13.603660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eee162d-e9fb-47b1-9d92-f3b7392831bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:13.604176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5eee162d-e9fb-47b1-9d92-f3b7392831bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:13.765072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5eee162d-e9fb-47b1-9d92-f3b7392831bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:13.773945 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5eee162d-e9fb-47b1-9d92-f3b7392831bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1679 microversion: 2.1 time: 0.189214 Sep 08 13:50:13.774553 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3181/6492] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:13 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:14.800721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b2373315-3a09-4d96-a079-6aa0265b1cf1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:14.801417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b2373315-3a09-4d96-a079-6aa0265b1cf1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:14.808538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2373315-3a09-4d96-a079-6aa0265b1cf1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:14.809013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2373315-3a09-4d96-a079-6aa0265b1cf1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:14.809664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2373315-3a09-4d96-a079-6aa0265b1cf1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:14.810373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2373315-3a09-4d96-a079-6aa0265b1cf1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:14.810842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2373315-3a09-4d96-a079-6aa0265b1cf1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:14.811302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2373315-3a09-4d96-a079-6aa0265b1cf1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:14.983385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b2373315-3a09-4d96-a079-6aa0265b1cf1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:14.993312 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b2373315-3a09-4d96-a079-6aa0265b1cf1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1676 microversion: 2.1 time: 0.197914 Sep 08 13:50:14.994148 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3312/6493] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:14 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1676 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:15.030772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7c37d989-8669-4b1a-b430-3250b9aa7c9f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:50:15.031815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7c37d989-8669-4b1a-b430-3250b9aa7c9f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:15.041150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c37d989-8669-4b1a-b430-3250b9aa7c9f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:15.041786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c37d989-8669-4b1a-b430-3250b9aa7c9f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:15.042385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c37d989-8669-4b1a-b430-3250b9aa7c9f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:15.043449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c37d989-8669-4b1a-b430-3250b9aa7c9f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:15.043920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c37d989-8669-4b1a-b430-3250b9aa7c9f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:15.044353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c37d989-8669-4b1a-b430-3250b9aa7c9f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:15.151032 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7c37d989-8669-4b1a-b430-3250b9aa7c9f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51/action" status: 204 len: 0 microversion: 2.1 time: 0.128450 Sep 08 13:50:15.151782 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3182/6494] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:50:15 2022] POST /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51/action => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:50:15.161614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8416e160-6710-4bc6-ad7b-635f02ff2e26 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:15.163086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8416e160-6710-4bc6-ad7b-635f02ff2e26 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:15.175357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8416e160-6710-4bc6-ad7b-635f02ff2e26 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:15.175993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8416e160-6710-4bc6-ad7b-635f02ff2e26 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:15.176564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8416e160-6710-4bc6-ad7b-635f02ff2e26 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:15.177435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8416e160-6710-4bc6-ad7b-635f02ff2e26 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:15.178406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8416e160-6710-4bc6-ad7b-635f02ff2e26 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:15.178874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8416e160-6710-4bc6-ad7b-635f02ff2e26 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:15.384394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8416e160-6710-4bc6-ad7b-635f02ff2e26 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:15.394741 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8416e160-6710-4bc6-ad7b-635f02ff2e26 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1676 microversion: 2.1 time: 0.237473 Sep 08 13:50:15.395461 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3313/6495] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:15 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1676 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:16.421046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7bd37443-1a3a-4ae5-8e6d-144d30abbe21 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:16.421873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7bd37443-1a3a-4ae5-8e6d-144d30abbe21 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:16.432397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bd37443-1a3a-4ae5-8e6d-144d30abbe21 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:16.433065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bd37443-1a3a-4ae5-8e6d-144d30abbe21 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:16.434118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bd37443-1a3a-4ae5-8e6d-144d30abbe21 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:16.435195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bd37443-1a3a-4ae5-8e6d-144d30abbe21 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:16.436165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bd37443-1a3a-4ae5-8e6d-144d30abbe21 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:16.436762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7bd37443-1a3a-4ae5-8e6d-144d30abbe21 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:16.628129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7bd37443-1a3a-4ae5-8e6d-144d30abbe21 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:16.639494 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7bd37443-1a3a-4ae5-8e6d-144d30abbe21 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1676 microversion: 2.1 time: 0.223700 Sep 08 13:50:16.640288 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3183/6496] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:16 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:17.670411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d314949a-09ac-4f7c-ad13-0cc0059d838f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:17.671069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d314949a-09ac-4f7c-ad13-0cc0059d838f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:17.679663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d314949a-09ac-4f7c-ad13-0cc0059d838f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:17.680286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d314949a-09ac-4f7c-ad13-0cc0059d838f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:17.680787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d314949a-09ac-4f7c-ad13-0cc0059d838f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:17.681542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d314949a-09ac-4f7c-ad13-0cc0059d838f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:17.682139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d314949a-09ac-4f7c-ad13-0cc0059d838f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:17.682490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d314949a-09ac-4f7c-ad13-0cc0059d838f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:17.868135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d314949a-09ac-4f7c-ad13-0cc0059d838f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:17.883446 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d314949a-09ac-4f7c-ad13-0cc0059d838f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1668 microversion: 2.1 time: 0.219841 Sep 08 13:50:17.884577 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3314/6497] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:17 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1668 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:17.925335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4c3fed1e-ff63-4361-87de-b54f6d669c85 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:17.926239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4c3fed1e-ff63-4361-87de-b54f6d669c85 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:17.939543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c3fed1e-ff63-4361-87de-b54f6d669c85 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:17.940425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c3fed1e-ff63-4361-87de-b54f6d669c85 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:17.941225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c3fed1e-ff63-4361-87de-b54f6d669c85 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:17.942565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c3fed1e-ff63-4361-87de-b54f6d669c85 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:17.943519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c3fed1e-ff63-4361-87de-b54f6d669c85 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:17.944293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4c3fed1e-ff63-4361-87de-b54f6d669c85 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:18.096066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4c3fed1e-ff63-4361-87de-b54f6d669c85 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:18.104564 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4c3fed1e-ff63-4361-87de-b54f6d669c85 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1668 microversion: 2.1 time: 0.186873 Sep 08 13:50:18.105339 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3184/6498] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:17 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1668 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:18.133797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2b841b90-5826-4795-a6c8-9db243c26ada tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:18.134518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2b841b90-5826-4795-a6c8-9db243c26ada tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:18.141578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b841b90-5826-4795-a6c8-9db243c26ada tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:18.142131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b841b90-5826-4795-a6c8-9db243c26ada tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:18.142620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b841b90-5826-4795-a6c8-9db243c26ada tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:18.143457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b841b90-5826-4795-a6c8-9db243c26ada tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:18.143999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b841b90-5826-4795-a6c8-9db243c26ada tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:18.144479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b841b90-5826-4795-a6c8-9db243c26ada tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:18.301986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2b841b90-5826-4795-a6c8-9db243c26ada tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:18.311891 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2b841b90-5826-4795-a6c8-9db243c26ada tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1668 microversion: 2.1 time: 0.183286 Sep 08 13:50:18.312718 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3315/6499] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:18 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1668 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:18.354330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-15d0a6e9-fe66-47df-bdf7-b653b946a88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:18.355216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-15d0a6e9-fe66-47df-bdf7-b653b946a88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:18.365856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15d0a6e9-fe66-47df-bdf7-b653b946a88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:18.366809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15d0a6e9-fe66-47df-bdf7-b653b946a88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:18.367628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15d0a6e9-fe66-47df-bdf7-b653b946a88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:18.368839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15d0a6e9-fe66-47df-bdf7-b653b946a88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:18.369663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15d0a6e9-fe66-47df-bdf7-b653b946a88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:18.370412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15d0a6e9-fe66-47df-bdf7-b653b946a88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:18.419622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-15d0a6e9-fe66-47df-bdf7-b653b946a88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:50:18.466024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:18.555909 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-15d0a6e9-fe66-47df-bdf7-b653b946a88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "DELETE /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 204 len: 0 microversion: 2.1 time: 0.207898 Sep 08 13:50:18.556843 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3185/6500] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:50:18 2022] DELETE /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:50:18.566983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1689fc65-b3a4-44f1-b039-d493043616ad tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:18.567656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1689fc65-b3a4-44f1-b039-d493043616ad tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:18.574782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1689fc65-b3a4-44f1-b039-d493043616ad tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:18.575315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1689fc65-b3a4-44f1-b039-d493043616ad tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:18.575782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1689fc65-b3a4-44f1-b039-d493043616ad tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:18.576656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1689fc65-b3a4-44f1-b039-d493043616ad tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:18.578438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1689fc65-b3a4-44f1-b039-d493043616ad tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:18.578438 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1689fc65-b3a4-44f1-b039-d493043616ad tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:18.769139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1689fc65-b3a4-44f1-b039-d493043616ad tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:18.778996 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1689fc65-b3a4-44f1-b039-d493043616ad tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1674 microversion: 2.1 time: 0.216157 Sep 08 13:50:18.779688 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3316/6501] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:18 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1674 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:50:19.636526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-169e95bd-17c5-49ce-871a-923f2886e49e req-ef60f14d-eaf4-4dfe-b5b6-457647f617e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802f7eab-898e-44d1-b478-582d5e149a51", "name": "network-vif-plugged", "status": "completed", "tag": "289108ba-54db-40eb-9ff2-a9f9fdfed48c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:50:19.662687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-169e95bd-17c5-49ce-871a-923f2886e49e req-ef60f14d-eaf4-4dfe-b5b6-457647f617e2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:19.663697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-169e95bd-17c5-49ce-871a-923f2886e49e req-ef60f14d-eaf4-4dfe-b5b6-457647f617e2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:19.664474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-169e95bd-17c5-49ce-871a-923f2886e49e req-ef60f14d-eaf4-4dfe-b5b6-457647f617e2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:19.685380 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-169e95bd-17c5-49ce-871a-923f2886e49e req-ef60f14d-eaf4-4dfe-b5b6-457647f617e2 service nova] Creating event network-vif-plugged:289108ba-54db-40eb-9ff2-a9f9fdfed48c for instance 802f7eab-898e-44d1-b478-582d5e149a51 on n-h2-852084-10 Sep 08 13:50:19.693226 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-169e95bd-17c5-49ce-871a-923f2886e49e req-ef60f14d-eaf4-4dfe-b5b6-457647f617e2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062829 Sep 08 13:50:19.694377 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3186/6502] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:50:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:50:19.804027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f43ec36c-4d98-400f-a639-1ef4140ffe1a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:19.805153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f43ec36c-4d98-400f-a639-1ef4140ffe1a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:19.813696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43ec36c-4d98-400f-a639-1ef4140ffe1a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:19.814418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43ec36c-4d98-400f-a639-1ef4140ffe1a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:19.815018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43ec36c-4d98-400f-a639-1ef4140ffe1a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:19.816118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43ec36c-4d98-400f-a639-1ef4140ffe1a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:19.816694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43ec36c-4d98-400f-a639-1ef4140ffe1a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:19.817196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f43ec36c-4d98-400f-a639-1ef4140ffe1a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:20.086739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f43ec36c-4d98-400f-a639-1ef4140ffe1a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:20.091334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:20.098797 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f43ec36c-4d98-400f-a639-1ef4140ffe1a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1674 microversion: 2.1 time: 0.298854 Sep 08 13:50:20.099670 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3317/6503] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:19 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1674 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:21.132066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-18d53a70-41ca-4350-8321-cebf223bfc03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:21.134357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-18d53a70-41ca-4350-8321-cebf223bfc03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:21.149235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18d53a70-41ca-4350-8321-cebf223bfc03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:21.150678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18d53a70-41ca-4350-8321-cebf223bfc03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:21.152023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18d53a70-41ca-4350-8321-cebf223bfc03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:21.153666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18d53a70-41ca-4350-8321-cebf223bfc03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:21.154453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18d53a70-41ca-4350-8321-cebf223bfc03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:21.155353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-18d53a70-41ca-4350-8321-cebf223bfc03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:21.185854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-167c1e06-7579-4b2c-aa92-e23a333f68a1 req-018d58de-62b6-4aac-afba-8af52e1f7ba6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "802f7eab-898e-44d1-b478-582d5e149a51", "name": "network-vif-deleted", "tag": "289108ba-54db-40eb-9ff2-a9f9fdfed48c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:50:21.206973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-167c1e06-7579-4b2c-aa92-e23a333f68a1 req-018d58de-62b6-4aac-afba-8af52e1f7ba6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:21.208167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-167c1e06-7579-4b2c-aa92-e23a333f68a1 req-018d58de-62b6-4aac-afba-8af52e1f7ba6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:21.209105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-167c1e06-7579-4b2c-aa92-e23a333f68a1 req-018d58de-62b6-4aac-afba-8af52e1f7ba6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:21.231262 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-167c1e06-7579-4b2c-aa92-e23a333f68a1 req-018d58de-62b6-4aac-afba-8af52e1f7ba6 service nova] Creating event network-vif-deleted:289108ba-54db-40eb-9ff2-a9f9fdfed48c for instance 802f7eab-898e-44d1-b478-582d5e149a51 on n-h2-852084-10 Sep 08 13:50:21.240110 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-167c1e06-7579-4b2c-aa92-e23a333f68a1 req-018d58de-62b6-4aac-afba-8af52e1f7ba6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062464 Sep 08 13:50:21.242367 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3318/6504] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:50:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:50:21.291675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-18d53a70-41ca-4350-8321-cebf223bfc03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:21.302159 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-18d53a70-41ca-4350-8321-cebf223bfc03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 200 len: 1606 microversion: 2.1 time: 0.177600 Sep 08 13:50:21.303187 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3187/6505] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:21 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 1606 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:22.331752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b45093b3-8caf-488e-8d72-0027ea1e4929 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:22.332537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b45093b3-8caf-488e-8d72-0027ea1e4929 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:22.340456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b45093b3-8caf-488e-8d72-0027ea1e4929 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:22.341315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b45093b3-8caf-488e-8d72-0027ea1e4929 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:22.341779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b45093b3-8caf-488e-8d72-0027ea1e4929 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:22.342529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b45093b3-8caf-488e-8d72-0027ea1e4929 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:22.343000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b45093b3-8caf-488e-8d72-0027ea1e4929 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:22.343473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b45093b3-8caf-488e-8d72-0027ea1e4929 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:22.364165 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-b45093b3-8caf-488e-8d72-0027ea1e4929 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b45093b3-8caf-488e-8d72-0027ea1e4929 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 HTTP/1.1 Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '802f7eab-898e-44d1-b478-582d5e149a51'} Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:50:22.366468 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:50:22.376928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:50:22.376928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:50:22.376928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:50:22.376928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:50:22.376928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:50:22.376928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:50:22.376928 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:50:22.376928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b45093b3-8caf-488e-8d72-0027ea1e4929 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:50:22.376928 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b45093b3-8caf-488e-8d72-0027ea1e4929 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 404 len: 111 microversion: 2.1 time: 0.043179 Sep 08 13:50:22.376928 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3319/6506] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:22 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:50:22.389799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a0cd5cfb-4aa9-47c4-ac7f-3fca6e6c274f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:22.390718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a0cd5cfb-4aa9-47c4-ac7f-3fca6e6c274f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:22.399150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0cd5cfb-4aa9-47c4-ac7f-3fca6e6c274f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:22.399682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0cd5cfb-4aa9-47c4-ac7f-3fca6e6c274f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:22.400138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0cd5cfb-4aa9-47c4-ac7f-3fca6e6c274f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:22.400901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0cd5cfb-4aa9-47c4-ac7f-3fca6e6c274f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:22.401378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0cd5cfb-4aa9-47c4-ac7f-3fca6e6c274f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:22.401814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0cd5cfb-4aa9-47c4-ac7f-3fca6e6c274f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:22.420864 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-a0cd5cfb-4aa9-47c4-ac7f-3fca6e6c274f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a0cd5cfb-4aa9-47c4-ac7f-3fca6e6c274f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 HTTP/1.1 Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '802f7eab-898e-44d1-b478-582d5e149a51'} Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:50:22.422973 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:50:22.432788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:50:22.432788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:50:22.432788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:50:22.432788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:50:22.432788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:50:22.432788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:50:22.432788 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:50:22.432788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a0cd5cfb-4aa9-47c4-ac7f-3fca6e6c274f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:50:22.432788 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a0cd5cfb-4aa9-47c4-ac7f-3fca6e6c274f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 404 len: 111 microversion: 2.1 time: 0.039457 Sep 08 13:50:22.432788 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3188/6507] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:22 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:50:22.500505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1107830952", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "152acfcb-1ab2-4c75-8556-f2471248ba62"}], "security_groups": [{"name": "tempest-securitygroup--1696640897"}], "key_name": "tempest-keypair-783440952", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:50:22.637885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] validate_networks() for [('152acfcb-1ab2-4c75-8556-f2471248ba62', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:50:23.228171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:50:23.228652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:50:23.229340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:50:23.230047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:50:23.230910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:50:23.246925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:23.247518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:23.247998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:23.248828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:23.249283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:23.249754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:23.268911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:50:23.275661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for user 660a56a892a645f3949629bc47b7ce94 and project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:50:23.294832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:50:23.298733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:50:23.356338 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a248815e-eb66-4ef5-8103-9a18c6ff59b7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.862567 Sep 08 13:50:23.360675 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3320/6508] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:50:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 865 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:50:23.375357 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cfc4c5cb-34cf-44ce-a805-c018411479d0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:23.376099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cfc4c5cb-34cf-44ce-a805-c018411479d0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:23.452929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cfc4c5cb-34cf-44ce-a805-c018411479d0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:23.463351 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cfc4c5cb-34cf-44ce-a805-c018411479d0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1238 microversion: 2.1 time: 0.094534 Sep 08 13:50:23.463958 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3189/6509] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:23 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1238 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:24.488484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1aa81118-1af8-41ea-a098-a25d64e1f014 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:24.489246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1aa81118-1af8-41ea-a098-a25d64e1f014 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:24.497140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1aa81118-1af8-41ea-a098-a25d64e1f014 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:24.497661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1aa81118-1af8-41ea-a098-a25d64e1f014 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:24.498318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1aa81118-1af8-41ea-a098-a25d64e1f014 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:24.498873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1aa81118-1af8-41ea-a098-a25d64e1f014 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:24.499377 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1aa81118-1af8-41ea-a098-a25d64e1f014 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:24.499837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1aa81118-1af8-41ea-a098-a25d64e1f014 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:24.586479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1aa81118-1af8-41ea-a098-a25d64e1f014 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:24.600004 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1aa81118-1af8-41ea-a098-a25d64e1f014 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1290 microversion: 2.1 time: 0.115171 Sep 08 13:50:24.600883 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3321/6510] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:24 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1290 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:25.630165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-479613b9-d184-4677-9b1b-1580fca2725f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:25.631206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-479613b9-d184-4677-9b1b-1580fca2725f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:25.641698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479613b9-d184-4677-9b1b-1580fca2725f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:25.642566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479613b9-d184-4677-9b1b-1580fca2725f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:25.652491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479613b9-d184-4677-9b1b-1580fca2725f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:25.654305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479613b9-d184-4677-9b1b-1580fca2725f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:25.655469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479613b9-d184-4677-9b1b-1580fca2725f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:25.656523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-479613b9-d184-4677-9b1b-1580fca2725f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:25.916101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-479613b9-d184-4677-9b1b-1580fca2725f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:25.928173 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-479613b9-d184-4677-9b1b-1580fca2725f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1364 microversion: 2.1 time: 0.302972 Sep 08 13:50:25.928793 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3190/6511] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:25 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1364 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:26.879807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-e978e093-3dd6-46cc-b0ed-571fc697e6e1 req-d1b4d6d6-8382-447f-8a3e-f9c5511ecad4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4b07b4-5711-4b49-a9d9-f5c4923447be", "tag": "27ce5361-3d8f-4fb0-ac8d-bdff7683ba41"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:50:26.901196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:26.906068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e978e093-3dd6-46cc-b0ed-571fc697e6e1 req-d1b4d6d6-8382-447f-8a3e-f9c5511ecad4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:26.906965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e978e093-3dd6-46cc-b0ed-571fc697e6e1 req-d1b4d6d6-8382-447f-8a3e-f9c5511ecad4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:26.907844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-e978e093-3dd6-46cc-b0ed-571fc697e6e1 req-d1b4d6d6-8382-447f-8a3e-f9c5511ecad4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:26.933901 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-e978e093-3dd6-46cc-b0ed-571fc697e6e1 req-d1b4d6d6-8382-447f-8a3e-f9c5511ecad4 service nova] Creating event network-changed:27ce5361-3d8f-4fb0-ac8d-bdff7683ba41 for instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be on n-h1-852084-10 Sep 08 13:50:26.943569 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-e978e093-3dd6-46cc-b0ed-571fc697e6e1 req-d1b4d6d6-8382-447f-8a3e-f9c5511ecad4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069978 Sep 08 13:50:26.945276 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3322/6512] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:50:26.968213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b1c6e8f-e15b-43ba-a86a-5bc1722bd0f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:26.969329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6b1c6e8f-e15b-43ba-a86a-5bc1722bd0f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:26.973685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:26.981612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b1c6e8f-e15b-43ba-a86a-5bc1722bd0f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:26.982109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b1c6e8f-e15b-43ba-a86a-5bc1722bd0f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:26.982786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b1c6e8f-e15b-43ba-a86a-5bc1722bd0f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:26.983553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b1c6e8f-e15b-43ba-a86a-5bc1722bd0f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:26.984013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b1c6e8f-e15b-43ba-a86a-5bc1722bd0f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:26.984437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b1c6e8f-e15b-43ba-a86a-5bc1722bd0f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:27.177582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6b1c6e8f-e15b-43ba-a86a-5bc1722bd0f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:27.190290 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6b1c6e8f-e15b-43ba-a86a-5bc1722bd0f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1364 microversion: 2.1 time: 0.228929 Sep 08 13:50:27.192079 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3191/6513] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:26 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:28.229505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2d6e263c-f15c-4528-a996-bb07a57361e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:28.230669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2d6e263c-f15c-4528-a996-bb07a57361e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:28.242253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d6e263c-f15c-4528-a996-bb07a57361e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:28.242765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d6e263c-f15c-4528-a996-bb07a57361e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:28.242765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d6e263c-f15c-4528-a996-bb07a57361e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:28.243997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d6e263c-f15c-4528-a996-bb07a57361e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:28.244636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d6e263c-f15c-4528-a996-bb07a57361e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:28.245160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d6e263c-f15c-4528-a996-bb07a57361e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:28.447689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2d6e263c-f15c-4528-a996-bb07a57361e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:28.458936 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2d6e263c-f15c-4528-a996-bb07a57361e6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1364 microversion: 2.1 time: 0.236693 Sep 08 13:50:28.460867 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3323/6514] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:28 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:50:29.502626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-33e3b313-f6bc-44dd-b730-121fff748007 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:29.503959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33e3b313-f6bc-44dd-b730-121fff748007 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:29.516309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33e3b313-f6bc-44dd-b730-121fff748007 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:29.517026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33e3b313-f6bc-44dd-b730-121fff748007 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:29.517522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33e3b313-f6bc-44dd-b730-121fff748007 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:29.518335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33e3b313-f6bc-44dd-b730-121fff748007 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:29.518930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33e3b313-f6bc-44dd-b730-121fff748007 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:29.519430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33e3b313-f6bc-44dd-b730-121fff748007 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:29.704575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-33e3b313-f6bc-44dd-b730-121fff748007 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:29.717126 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-33e3b313-f6bc-44dd-b730-121fff748007 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1364 microversion: 2.1 time: 0.221713 Sep 08 13:50:29.717738 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3192/6515] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:29 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1364 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:30.745314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-200cc301-6601-46e0-8074-51fca18e1e99 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:30.746310 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-200cc301-6601-46e0-8074-51fca18e1e99 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:30.756963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-200cc301-6601-46e0-8074-51fca18e1e99 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:30.757610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-200cc301-6601-46e0-8074-51fca18e1e99 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:30.758065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-200cc301-6601-46e0-8074-51fca18e1e99 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:30.759022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-200cc301-6601-46e0-8074-51fca18e1e99 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:30.759528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-200cc301-6601-46e0-8074-51fca18e1e99 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:30.759970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-200cc301-6601-46e0-8074-51fca18e1e99 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:30.957337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-200cc301-6601-46e0-8074-51fca18e1e99 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:30.967789 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-200cc301-6601-46e0-8074-51fca18e1e99 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1364 microversion: 2.1 time: 0.227334 Sep 08 13:50:30.968490 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3324/6516] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:30 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:31.999940 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5f3b58c7-ef58-46d3-8501-bb653549f3e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:32.000956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5f3b58c7-ef58-46d3-8501-bb653549f3e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:32.012897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f3b58c7-ef58-46d3-8501-bb653549f3e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:32.013726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f3b58c7-ef58-46d3-8501-bb653549f3e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:32.014480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f3b58c7-ef58-46d3-8501-bb653549f3e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:32.015685 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f3b58c7-ef58-46d3-8501-bb653549f3e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:32.016419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f3b58c7-ef58-46d3-8501-bb653549f3e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:32.017124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5f3b58c7-ef58-46d3-8501-bb653549f3e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:32.212176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5f3b58c7-ef58-46d3-8501-bb653549f3e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:32.226576 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5f3b58c7-ef58-46d3-8501-bb653549f3e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1364 microversion: 2.1 time: 0.231934 Sep 08 13:50:32.227555 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3193/6517] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:31 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:33.255161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8807597b-459c-4636-b80a-4694e71ed70e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:33.256682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8807597b-459c-4636-b80a-4694e71ed70e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:33.262040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:33.271719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8807597b-459c-4636-b80a-4694e71ed70e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:33.272517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8807597b-459c-4636-b80a-4694e71ed70e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:33.273781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8807597b-459c-4636-b80a-4694e71ed70e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:33.274989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8807597b-459c-4636-b80a-4694e71ed70e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:33.275841 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8807597b-459c-4636-b80a-4694e71ed70e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:33.276538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8807597b-459c-4636-b80a-4694e71ed70e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:33.284213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:33.414525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-1f2e2ecd-458a-4193-bc1c-93b98a1f8974 req-518ff9ae-0a7a-4d2e-8bfb-49968426ae58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4b07b4-5711-4b49-a9d9-f5c4923447be", "name": "network-vif-plugged", "status": "completed", "tag": "27ce5361-3d8f-4fb0-ac8d-bdff7683ba41"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:50:33.432605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1f2e2ecd-458a-4193-bc1c-93b98a1f8974 req-518ff9ae-0a7a-4d2e-8bfb-49968426ae58 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:33.433509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1f2e2ecd-458a-4193-bc1c-93b98a1f8974 req-518ff9ae-0a7a-4d2e-8bfb-49968426ae58 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:33.434273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1f2e2ecd-458a-4193-bc1c-93b98a1f8974 req-518ff9ae-0a7a-4d2e-8bfb-49968426ae58 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:33.451704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8807597b-459c-4636-b80a-4694e71ed70e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:33.454299 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-1f2e2ecd-458a-4193-bc1c-93b98a1f8974 req-518ff9ae-0a7a-4d2e-8bfb-49968426ae58 service nova] Creating event network-vif-plugged:27ce5361-3d8f-4fb0-ac8d-bdff7683ba41 for instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be on n-h1-852084-10 Sep 08 13:50:33.461415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:50:33.462721 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8807597b-459c-4636-b80a-4694e71ed70e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1364 microversion: 2.1 time: 0.211777 Sep 08 13:50:33.463387 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3325/6518] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:33 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1364 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:33.465312 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-1f2e2ecd-458a-4193-bc1c-93b98a1f8974 req-518ff9ae-0a7a-4d2e-8bfb-49968426ae58 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057577 Sep 08 13:50:33.466290 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3194/6519] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:50:34.488634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2172e871-9522-4ee1-beac-ab7ab1fa563a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:34.489269 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2172e871-9522-4ee1-beac-ab7ab1fa563a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:34.496543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2172e871-9522-4ee1-beac-ab7ab1fa563a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:34.497074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2172e871-9522-4ee1-beac-ab7ab1fa563a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:34.497519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2172e871-9522-4ee1-beac-ab7ab1fa563a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:34.498252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2172e871-9522-4ee1-beac-ab7ab1fa563a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:34.498730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2172e871-9522-4ee1-beac-ab7ab1fa563a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:34.499347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2172e871-9522-4ee1-beac-ab7ab1fa563a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:34.664638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2172e871-9522-4ee1-beac-ab7ab1fa563a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:34.675085 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2172e871-9522-4ee1-beac-ab7ab1fa563a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1364 microversion: 2.1 time: 0.190422 Sep 08 13:50:34.679264 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3326/6520] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:34 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1364 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:35.704486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fba3fa13-7b29-4921-a14a-bc86ee00ae3b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:35.705469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fba3fa13-7b29-4921-a14a-bc86ee00ae3b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:35.712572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fba3fa13-7b29-4921-a14a-bc86ee00ae3b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:35.713067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fba3fa13-7b29-4921-a14a-bc86ee00ae3b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:35.713503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fba3fa13-7b29-4921-a14a-bc86ee00ae3b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:35.714217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fba3fa13-7b29-4921-a14a-bc86ee00ae3b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:35.714672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fba3fa13-7b29-4921-a14a-bc86ee00ae3b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:35.715096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fba3fa13-7b29-4921-a14a-bc86ee00ae3b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:35.855527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fba3fa13-7b29-4921-a14a-bc86ee00ae3b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:50:35.864178 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fba3fa13-7b29-4921-a14a-bc86ee00ae3b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1550 microversion: 2.1 time: 0.164965 Sep 08 13:50:35.864856 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3195/6521] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:50:35 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:50:35.889075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-742ac6b1-6a84-4da9-9855-672d9ed40c5c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:50:35.889641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-742ac6b1-6a84-4da9-9855-672d9ed40c5c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:50:35.897293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-742ac6b1-6a84-4da9-9855-672d9ed40c5c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:35.898511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-742ac6b1-6a84-4da9-9855-672d9ed40c5c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:35.898983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-742ac6b1-6a84-4da9-9855-672d9ed40c5c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:35.899753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-742ac6b1-6a84-4da9-9855-672d9ed40c5c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:35.900234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-742ac6b1-6a84-4da9-9855-672d9ed40c5c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:35.900680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-742ac6b1-6a84-4da9-9855-672d9ed40c5c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:35.982199 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-742ac6b1-6a84-4da9-9855-672d9ed40c5c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097830 Sep 08 13:50:35.982832 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3327/6522] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:50:35 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:50:37.277240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-b8beb8fc-e17e-41df-8f4e-8de2d1db9f97 req-990fd0e9-114b-4460-b23c-01e36ec87b3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4b07b4-5711-4b49-a9d9-f5c4923447be", "tag": "27ce5361-3d8f-4fb0-ac8d-bdff7683ba41"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:50:37.289056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b8beb8fc-e17e-41df-8f4e-8de2d1db9f97 req-990fd0e9-114b-4460-b23c-01e36ec87b3d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:50:37.289566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b8beb8fc-e17e-41df-8f4e-8de2d1db9f97 req-990fd0e9-114b-4460-b23c-01e36ec87b3d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:50:37.289994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-b8beb8fc-e17e-41df-8f4e-8de2d1db9f97 req-990fd0e9-114b-4460-b23c-01e36ec87b3d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:50:37.302186 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-b8beb8fc-e17e-41df-8f4e-8de2d1db9f97 req-990fd0e9-114b-4460-b23c-01e36ec87b3d service nova] Creating event network-changed:27ce5361-3d8f-4fb0-ac8d-bdff7683ba41 for instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be on n-h1-852084-10 Sep 08 13:50:37.308119 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-b8beb8fc-e17e-41df-8f4e-8de2d1db9f97 req-990fd0e9-114b-4460-b23c-01e36ec87b3d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034950 Sep 08 13:50:37.308730 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3196/6523] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:51:07.739067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=11 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:07.740406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=42 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:07.744699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-252fbbca-b1af-42c4-9741-75af7b9f1b50 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:51:07.752078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252fbbca-b1af-42c4-9741-75af7b9f1b50 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:07.752580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252fbbca-b1af-42c4-9741-75af7b9f1b50 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:07.753026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252fbbca-b1af-42c4-9741-75af7b9f1b50 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:07.777305 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-252fbbca-b1af-42c4-9741-75af7b9f1b50 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Going to try to stop instance {{(pid=128970) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 13:51:07.824669 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-252fbbca-b1af-42c4-9741-75af7b9f1b50 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be/action" status: 202 len: 0 microversion: 2.1 time: 0.087390 Sep 08 13:51:07.825357 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3328/6524] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:51:07 2022] POST /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:51:07.832641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=11 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:07.833417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:07.838451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e0b6c661-e85d-45b4-8d7e-017b7c6a724d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:07.839184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e0b6c661-e85d-45b4-8d7e-017b7c6a724d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:07.848515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0b6c661-e85d-45b4-8d7e-017b7c6a724d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:07.849529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0b6c661-e85d-45b4-8d7e-017b7c6a724d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:07.849993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0b6c661-e85d-45b4-8d7e-017b7c6a724d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:07.850710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0b6c661-e85d-45b4-8d7e-017b7c6a724d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:07.851172 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0b6c661-e85d-45b4-8d7e-017b7c6a724d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:07.851628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e0b6c661-e85d-45b4-8d7e-017b7c6a724d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:08.048791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e0b6c661-e85d-45b4-8d7e-017b7c6a724d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:08.057369 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e0b6c661-e85d-45b4-8d7e-017b7c6a724d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1678 microversion: 2.1 time: 0.227154 Sep 08 13:51:08.057971 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3197/6525] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:07 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:09.082808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84e64a60-cd60-4f99-8e63-de1720df18c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:09.084221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-84e64a60-cd60-4f99-8e63-de1720df18c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:09.090620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84e64a60-cd60-4f99-8e63-de1720df18c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:09.091120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84e64a60-cd60-4f99-8e63-de1720df18c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:09.091614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84e64a60-cd60-4f99-8e63-de1720df18c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:09.092321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84e64a60-cd60-4f99-8e63-de1720df18c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:09.092817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84e64a60-cd60-4f99-8e63-de1720df18c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:09.093252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84e64a60-cd60-4f99-8e63-de1720df18c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:09.300546 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-84e64a60-cd60-4f99-8e63-de1720df18c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:09.310968 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-84e64a60-cd60-4f99-8e63-de1720df18c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1678 microversion: 2.1 time: 0.233644 Sep 08 13:51:09.311677 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3329/6526] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:09 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1678 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:10.338518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-97d981a6-d05e-41b4-86c1-8e724c0d21e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:10.339812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-97d981a6-d05e-41b4-86c1-8e724c0d21e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:10.347582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97d981a6-d05e-41b4-86c1-8e724c0d21e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:10.348194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97d981a6-d05e-41b4-86c1-8e724c0d21e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:10.349339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97d981a6-d05e-41b4-86c1-8e724c0d21e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:10.350265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97d981a6-d05e-41b4-86c1-8e724c0d21e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:10.350730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97d981a6-d05e-41b4-86c1-8e724c0d21e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:10.351157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-97d981a6-d05e-41b4-86c1-8e724c0d21e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:10.504002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-97d981a6-d05e-41b4-86c1-8e724c0d21e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:10.512371 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-97d981a6-d05e-41b4-86c1-8e724c0d21e3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1678 microversion: 2.1 time: 0.177955 Sep 08 13:51:10.512973 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3198/6527] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:10 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1678 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:11.537772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-aba64e24-5bb3-49e7-a653-fac02d9ac8f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:11.538452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-aba64e24-5bb3-49e7-a653-fac02d9ac8f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:11.545661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aba64e24-5bb3-49e7-a653-fac02d9ac8f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:11.546169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aba64e24-5bb3-49e7-a653-fac02d9ac8f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:11.546626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aba64e24-5bb3-49e7-a653-fac02d9ac8f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:11.547574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aba64e24-5bb3-49e7-a653-fac02d9ac8f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:11.547886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aba64e24-5bb3-49e7-a653-fac02d9ac8f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:11.548349 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-aba64e24-5bb3-49e7-a653-fac02d9ac8f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:11.692160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-aba64e24-5bb3-49e7-a653-fac02d9ac8f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:11.700687 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-aba64e24-5bb3-49e7-a653-fac02d9ac8f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1678 microversion: 2.1 time: 0.167386 Sep 08 13:51:11.701503 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3330/6528] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:11 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:12.725490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d42a2979-7f4b-4ada-962e-1a92d53bca16 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:12.726210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d42a2979-7f4b-4ada-962e-1a92d53bca16 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:12.733409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d42a2979-7f4b-4ada-962e-1a92d53bca16 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:12.733894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d42a2979-7f4b-4ada-962e-1a92d53bca16 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:12.734537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d42a2979-7f4b-4ada-962e-1a92d53bca16 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:12.735266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d42a2979-7f4b-4ada-962e-1a92d53bca16 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:12.735725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d42a2979-7f4b-4ada-962e-1a92d53bca16 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:12.736146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d42a2979-7f4b-4ada-962e-1a92d53bca16 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:12.899840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d42a2979-7f4b-4ada-962e-1a92d53bca16 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:12.908413 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d42a2979-7f4b-4ada-962e-1a92d53bca16 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1678 microversion: 2.1 time: 0.187387 Sep 08 13:51:12.909039 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3199/6529] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:12 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:13.933741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-12b34c2e-0ae7-4373-b5e7-5b7b95034d33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:13.934553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-12b34c2e-0ae7-4373-b5e7-5b7b95034d33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:13.945652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12b34c2e-0ae7-4373-b5e7-5b7b95034d33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:13.946477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12b34c2e-0ae7-4373-b5e7-5b7b95034d33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:13.947212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12b34c2e-0ae7-4373-b5e7-5b7b95034d33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:13.948482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12b34c2e-0ae7-4373-b5e7-5b7b95034d33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:13.949443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12b34c2e-0ae7-4373-b5e7-5b7b95034d33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:13.949978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-12b34c2e-0ae7-4373-b5e7-5b7b95034d33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:14.097607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-12b34c2e-0ae7-4373-b5e7-5b7b95034d33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:14.105734 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-12b34c2e-0ae7-4373-b5e7-5b7b95034d33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1678 microversion: 2.1 time: 0.176670 Sep 08 13:51:14.106343 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3331/6530] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:13 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:15.128907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a1030159-e968-49f1-931a-4584e14a5ebd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:15.129683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a1030159-e968-49f1-931a-4584e14a5ebd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:15.137374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1030159-e968-49f1-931a-4584e14a5ebd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:15.137879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1030159-e968-49f1-931a-4584e14a5ebd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:15.138325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1030159-e968-49f1-931a-4584e14a5ebd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:15.139381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1030159-e968-49f1-931a-4584e14a5ebd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:15.139559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1030159-e968-49f1-931a-4584e14a5ebd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:15.139948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a1030159-e968-49f1-931a-4584e14a5ebd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:15.295914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a1030159-e968-49f1-931a-4584e14a5ebd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:15.306568 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a1030159-e968-49f1-931a-4584e14a5ebd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1678 microversion: 2.1 time: 0.181503 Sep 08 13:51:15.307141 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3200/6531] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:15 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1678 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:16.332199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5b924e8e-5527-4e11-8ca8-6a8b7527311d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:16.333096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5b924e8e-5527-4e11-8ca8-6a8b7527311d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:16.344653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b924e8e-5527-4e11-8ca8-6a8b7527311d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:16.345574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b924e8e-5527-4e11-8ca8-6a8b7527311d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:16.346507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b924e8e-5527-4e11-8ca8-6a8b7527311d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:16.348403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b924e8e-5527-4e11-8ca8-6a8b7527311d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:16.349308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b924e8e-5527-4e11-8ca8-6a8b7527311d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:16.350134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5b924e8e-5527-4e11-8ca8-6a8b7527311d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:16.514791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5b924e8e-5527-4e11-8ca8-6a8b7527311d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:16.523987 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5b924e8e-5527-4e11-8ca8-6a8b7527311d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1678 microversion: 2.1 time: 0.196799 Sep 08 13:51:16.524717 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3332/6532] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:16 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:17.548238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d2f69e16-080f-4d9d-b2bc-68c28f0595cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:17.548831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d2f69e16-080f-4d9d-b2bc-68c28f0595cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:17.556380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2f69e16-080f-4d9d-b2bc-68c28f0595cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:17.556864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2f69e16-080f-4d9d-b2bc-68c28f0595cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:17.557293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2f69e16-080f-4d9d-b2bc-68c28f0595cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:17.557987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2f69e16-080f-4d9d-b2bc-68c28f0595cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:17.558503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2f69e16-080f-4d9d-b2bc-68c28f0595cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:17.558850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d2f69e16-080f-4d9d-b2bc-68c28f0595cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:17.704129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d2f69e16-080f-4d9d-b2bc-68c28f0595cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:17.714075 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d2f69e16-080f-4d9d-b2bc-68c28f0595cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1678 microversion: 2.1 time: 0.169705 Sep 08 13:51:17.714668 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3201/6533] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:17 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1678 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:18.745246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-976fa156-7a29-477c-b4f7-59587652423f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:18.746401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-976fa156-7a29-477c-b4f7-59587652423f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:18.759428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-976fa156-7a29-477c-b4f7-59587652423f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:18.760330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-976fa156-7a29-477c-b4f7-59587652423f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:18.761134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-976fa156-7a29-477c-b4f7-59587652423f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:18.762397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-976fa156-7a29-477c-b4f7-59587652423f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:18.763257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-976fa156-7a29-477c-b4f7-59587652423f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:18.764105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-976fa156-7a29-477c-b4f7-59587652423f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:18.958590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-976fa156-7a29-477c-b4f7-59587652423f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:18.972928 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-976fa156-7a29-477c-b4f7-59587652423f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1655 microversion: 2.1 time: 0.234876 Sep 08 13:51:18.973990 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3333/6534] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:18 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1655 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:18.997826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:51:19.000049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:19.007731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:19.008337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:19.008785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:19.009522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:19.009991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:19.010400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:19.046125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:19.055452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Old instance type m1.heat2, new instance type m1.heat {{(pid=128971) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 13:51:19.070343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:51:19.071025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:51:19.071253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:51:19.071771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:51:19.072224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:51:19.148718 n-d-852084-10 devstack@n-api.service[128971]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [0cff7a8f-28d3-48a0-85b5-d0b15fdc4db0] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 13:51:20.156892 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [0cff7a8f-28d3-48a0-85b5-d0b15fdc4db0] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 48758. Sep 08 13:51:20.161190 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e36d1e95-6f55-491c-965a-1cdcd0734da8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be/action" status: 202 len: 0 microversion: 2.1 time: 1.167711 Sep 08 13:51:20.162095 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3202/6535] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:51:18 2022] POST /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be/action => generated 0 bytes in 1169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 13:51:20.170620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fd0604ee-ba9e-400f-9584-dde003b9b683 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:20.171401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fd0604ee-ba9e-400f-9584-dde003b9b683 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:20.185341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd0604ee-ba9e-400f-9584-dde003b9b683 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:20.186282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd0604ee-ba9e-400f-9584-dde003b9b683 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:20.187186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd0604ee-ba9e-400f-9584-dde003b9b683 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:20.188576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd0604ee-ba9e-400f-9584-dde003b9b683 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:20.189520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd0604ee-ba9e-400f-9584-dde003b9b683 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:20.190315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd0604ee-ba9e-400f-9584-dde003b9b683 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:20.352237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fd0604ee-ba9e-400f-9584-dde003b9b683 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:20.361735 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fd0604ee-ba9e-400f-9584-dde003b9b683 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1678 microversion: 2.1 time: 0.194448 Sep 08 13:51:20.362413 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3334/6536] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:20 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:21.397911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d7e651a6-9a4d-44dc-a649-6b4a70cca2f6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:21.399201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d7e651a6-9a4d-44dc-a649-6b4a70cca2f6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:21.407217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7e651a6-9a4d-44dc-a649-6b4a70cca2f6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:21.407810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7e651a6-9a4d-44dc-a649-6b4a70cca2f6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:21.408289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7e651a6-9a4d-44dc-a649-6b4a70cca2f6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:21.409928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7e651a6-9a4d-44dc-a649-6b4a70cca2f6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:21.410599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7e651a6-9a4d-44dc-a649-6b4a70cca2f6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:21.411405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7e651a6-9a4d-44dc-a649-6b4a70cca2f6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:21.573904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d7e651a6-9a4d-44dc-a649-6b4a70cca2f6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:21.583858 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d7e651a6-9a4d-44dc-a649-6b4a70cca2f6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1678 microversion: 2.1 time: 0.194675 Sep 08 13:51:21.584480 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3203/6537] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:21 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:22.610653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-48a10b10-2913-49a5-87a1-461345173019 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:22.611208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-48a10b10-2913-49a5-87a1-461345173019 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:22.620101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a10b10-2913-49a5-87a1-461345173019 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:22.620613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a10b10-2913-49a5-87a1-461345173019 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:22.621073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a10b10-2913-49a5-87a1-461345173019 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:22.621803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a10b10-2913-49a5-87a1-461345173019 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:22.622277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a10b10-2913-49a5-87a1-461345173019 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:22.622724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48a10b10-2913-49a5-87a1-461345173019 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:22.764076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-48a10b10-2913-49a5-87a1-461345173019 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:22.772895 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-48a10b10-2913-49a5-87a1-461345173019 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1683 microversion: 2.1 time: 0.166575 Sep 08 13:51:22.773500 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3335/6538] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:22 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:23.797403 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-de0e785a-c7cd-4e19-a9d9-387aba515e55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:23.798034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-de0e785a-c7cd-4e19-a9d9-387aba515e55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:23.806186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de0e785a-c7cd-4e19-a9d9-387aba515e55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:23.806672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de0e785a-c7cd-4e19-a9d9-387aba515e55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:23.807106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de0e785a-c7cd-4e19-a9d9-387aba515e55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:23.807876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de0e785a-c7cd-4e19-a9d9-387aba515e55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:23.808324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de0e785a-c7cd-4e19-a9d9-387aba515e55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:23.808768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de0e785a-c7cd-4e19-a9d9-387aba515e55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:23.957972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-de0e785a-c7cd-4e19-a9d9-387aba515e55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:23.966272 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-de0e785a-c7cd-4e19-a9d9-387aba515e55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1683 microversion: 2.1 time: 0.172864 Sep 08 13:51:23.966858 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3204/6539] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:23 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:24.989985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3020f4f8-0fc5-4a84-8a46-fa1e29ba64bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:24.990835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3020f4f8-0fc5-4a84-8a46-fa1e29ba64bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:25.000729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3020f4f8-0fc5-4a84-8a46-fa1e29ba64bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:25.001330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3020f4f8-0fc5-4a84-8a46-fa1e29ba64bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:25.001880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3020f4f8-0fc5-4a84-8a46-fa1e29ba64bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:25.003568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3020f4f8-0fc5-4a84-8a46-fa1e29ba64bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:25.005346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3020f4f8-0fc5-4a84-8a46-fa1e29ba64bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:25.005346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3020f4f8-0fc5-4a84-8a46-fa1e29ba64bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:25.054407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-1c995a0e-35e1-42bf-9acb-8c9c3d5b9395 req-d59a5b5a-54cd-4512-a5cc-1a528ecc61d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4b07b4-5711-4b49-a9d9-f5c4923447be", "name": "network-vif-unplugged", "status": "completed", "tag": "27ce5361-3d8f-4fb0-ac8d-bdff7683ba41"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:51:25.064572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1c995a0e-35e1-42bf-9acb-8c9c3d5b9395 req-d59a5b5a-54cd-4512-a5cc-1a528ecc61d5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:25.065270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1c995a0e-35e1-42bf-9acb-8c9c3d5b9395 req-d59a5b5a-54cd-4512-a5cc-1a528ecc61d5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:25.065730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1c995a0e-35e1-42bf-9acb-8c9c3d5b9395 req-d59a5b5a-54cd-4512-a5cc-1a528ecc61d5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:25.079567 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1c995a0e-35e1-42bf-9acb-8c9c3d5b9395 req-d59a5b5a-54cd-4512-a5cc-1a528ecc61d5 service nova] Creating event network-vif-unplugged:27ce5361-3d8f-4fb0-ac8d-bdff7683ba41 for instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be on n-h2-852084-10 Sep 08 13:51:25.086084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-1c995a0e-35e1-42bf-9acb-8c9c3d5b9395 req-d59a5b5a-54cd-4512-a5cc-1a528ecc61d5 service nova] Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:51:25.099875 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-1c995a0e-35e1-42bf-9acb-8c9c3d5b9395 req-d59a5b5a-54cd-4512-a5cc-1a528ecc61d5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121713 Sep 08 13:51:25.100508 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3336/6540] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:51:25.295954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3020f4f8-0fc5-4a84-8a46-fa1e29ba64bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:25.305638 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3020f4f8-0fc5-4a84-8a46-fa1e29ba64bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1682 microversion: 2.1 time: 0.320292 Sep 08 13:51:25.306243 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3205/6541] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:24 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1682 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:51:26.332892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4e6186d6-b784-4622-8932-9363e4d75305 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:26.334145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4e6186d6-b784-4622-8932-9363e4d75305 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:26.345930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e6186d6-b784-4622-8932-9363e4d75305 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:26.346606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e6186d6-b784-4622-8932-9363e4d75305 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:26.347082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e6186d6-b784-4622-8932-9363e4d75305 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:26.348836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e6186d6-b784-4622-8932-9363e4d75305 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:26.349336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e6186d6-b784-4622-8932-9363e4d75305 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:26.349788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4e6186d6-b784-4622-8932-9363e4d75305 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:26.577483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4e6186d6-b784-4622-8932-9363e4d75305 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:26.593257 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4e6186d6-b784-4622-8932-9363e4d75305 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1682 microversion: 2.1 time: 0.265898 Sep 08 13:51:26.595271 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3337/6542] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:26 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1682 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:27.130907 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-78e07f86-1cf4-4cb2-b17f-922d110e2576 req-9d8b0ec8-7c1b-463a-adc8-8ab23ecb7b66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f4b07b4-5711-4b49-a9d9-f5c4923447be", "tag": "27ce5361-3d8f-4fb0-ac8d-bdff7683ba41"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:51:27.158030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-78e07f86-1cf4-4cb2-b17f-922d110e2576 req-9d8b0ec8-7c1b-463a-adc8-8ab23ecb7b66 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:27.158610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-78e07f86-1cf4-4cb2-b17f-922d110e2576 req-9d8b0ec8-7c1b-463a-adc8-8ab23ecb7b66 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:27.159079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-78e07f86-1cf4-4cb2-b17f-922d110e2576 req-9d8b0ec8-7c1b-463a-adc8-8ab23ecb7b66 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:27.190656 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-78e07f86-1cf4-4cb2-b17f-922d110e2576 req-9d8b0ec8-7c1b-463a-adc8-8ab23ecb7b66 service nova] Creating event network-changed:27ce5361-3d8f-4fb0-ac8d-bdff7683ba41 for instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be on n-h2-852084-10 Sep 08 13:51:27.202458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-78e07f86-1cf4-4cb2-b17f-922d110e2576 req-9d8b0ec8-7c1b-463a-adc8-8ab23ecb7b66 service nova] Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:51:27.224880 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-78e07f86-1cf4-4cb2-b17f-922d110e2576 req-9d8b0ec8-7c1b-463a-adc8-8ab23ecb7b66 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100112 Sep 08 13:51:27.226257 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3206/6543] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:51:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:51:27.620509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-361de6b9-ddca-4b7a-a48c-0b62c78cc362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:27.621158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-361de6b9-ddca-4b7a-a48c-0b62c78cc362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:27.629983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-361de6b9-ddca-4b7a-a48c-0b62c78cc362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:27.630506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-361de6b9-ddca-4b7a-a48c-0b62c78cc362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:27.631014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-361de6b9-ddca-4b7a-a48c-0b62c78cc362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:27.631745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-361de6b9-ddca-4b7a-a48c-0b62c78cc362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:27.632222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-361de6b9-ddca-4b7a-a48c-0b62c78cc362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:27.632669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-361de6b9-ddca-4b7a-a48c-0b62c78cc362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:27.831399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-361de6b9-ddca-4b7a-a48c-0b62c78cc362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:27.840252 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-361de6b9-ddca-4b7a-a48c-0b62c78cc362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1680 microversion: 2.1 time: 0.223690 Sep 08 13:51:27.840867 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3338/6544] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:27 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1680 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:28.868477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6ae39039-375b-48c7-acce-ccaf59e4b0d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:28.869191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6ae39039-375b-48c7-acce-ccaf59e4b0d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:28.877620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ae39039-375b-48c7-acce-ccaf59e4b0d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:28.878112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ae39039-375b-48c7-acce-ccaf59e4b0d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:28.878544 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ae39039-375b-48c7-acce-ccaf59e4b0d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:28.879272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ae39039-375b-48c7-acce-ccaf59e4b0d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:28.879737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ae39039-375b-48c7-acce-ccaf59e4b0d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:28.880145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6ae39039-375b-48c7-acce-ccaf59e4b0d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:29.044836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6ae39039-375b-48c7-acce-ccaf59e4b0d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:29.057219 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6ae39039-375b-48c7-acce-ccaf59e4b0d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1676 microversion: 2.1 time: 0.195664 Sep 08 13:51:29.057816 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3207/6545] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:28 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:29.086376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-07832b39-61ea-4134-817d-b66c4187e446 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:51:29.087207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-07832b39-61ea-4134-817d-b66c4187e446 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:29.099293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07832b39-61ea-4134-817d-b66c4187e446 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:29.100220 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07832b39-61ea-4134-817d-b66c4187e446 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:29.100840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07832b39-61ea-4134-817d-b66c4187e446 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:29.102084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07832b39-61ea-4134-817d-b66c4187e446 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:29.102879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07832b39-61ea-4134-817d-b66c4187e446 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:29.103586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-07832b39-61ea-4134-817d-b66c4187e446 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:29.221728 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-07832b39-61ea-4134-817d-b66c4187e446 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be/action" status: 204 len: 0 microversion: 2.1 time: 0.141829 Sep 08 13:51:29.222941 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3339/6546] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:51:29 2022] POST /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be/action => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:51:29.236128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d798f8c0-795f-4845-982e-d42171c42827 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:29.237162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d798f8c0-795f-4845-982e-d42171c42827 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:29.245004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d798f8c0-795f-4845-982e-d42171c42827 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:29.245619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d798f8c0-795f-4845-982e-d42171c42827 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:29.246159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d798f8c0-795f-4845-982e-d42171c42827 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:29.246798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d798f8c0-795f-4845-982e-d42171c42827 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:29.247347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d798f8c0-795f-4845-982e-d42171c42827 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:29.247761 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d798f8c0-795f-4845-982e-d42171c42827 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:29.428347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d798f8c0-795f-4845-982e-d42171c42827 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:29.438856 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d798f8c0-795f-4845-982e-d42171c42827 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1676 microversion: 2.1 time: 0.206802 Sep 08 13:51:29.439573 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3208/6547] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:29 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1676 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:30.468199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1ee21c30-e490-41d9-aa82-249eeaf4326e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:30.468928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1ee21c30-e490-41d9-aa82-249eeaf4326e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:30.481795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ee21c30-e490-41d9-aa82-249eeaf4326e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:30.482316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ee21c30-e490-41d9-aa82-249eeaf4326e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:30.482772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ee21c30-e490-41d9-aa82-249eeaf4326e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:30.483544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ee21c30-e490-41d9-aa82-249eeaf4326e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:30.484018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ee21c30-e490-41d9-aa82-249eeaf4326e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:30.484487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1ee21c30-e490-41d9-aa82-249eeaf4326e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:30.653576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1ee21c30-e490-41d9-aa82-249eeaf4326e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:30.662406 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1ee21c30-e490-41d9-aa82-249eeaf4326e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1676 microversion: 2.1 time: 0.199765 Sep 08 13:51:30.663353 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3340/6548] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:30 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1676 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:31.686597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a0a5be86-ee7c-456e-b016-6c00eb519a7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:31.687345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a0a5be86-ee7c-456e-b016-6c00eb519a7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:31.695169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0a5be86-ee7c-456e-b016-6c00eb519a7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:31.695726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0a5be86-ee7c-456e-b016-6c00eb519a7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:31.696167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0a5be86-ee7c-456e-b016-6c00eb519a7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:31.696913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0a5be86-ee7c-456e-b016-6c00eb519a7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:31.697374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0a5be86-ee7c-456e-b016-6c00eb519a7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:31.697826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a0a5be86-ee7c-456e-b016-6c00eb519a7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:31.839613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a0a5be86-ee7c-456e-b016-6c00eb519a7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:31.848311 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a0a5be86-ee7c-456e-b016-6c00eb519a7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1655 microversion: 2.1 time: 0.165692 Sep 08 13:51:31.849101 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3209/6549] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:31 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1655 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:31.873156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4a3d459e-6347-419a-b8d4-9fbbe343730d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:31.873794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4a3d459e-6347-419a-b8d4-9fbbe343730d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:31.881491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a3d459e-6347-419a-b8d4-9fbbe343730d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:31.881997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a3d459e-6347-419a-b8d4-9fbbe343730d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:31.882455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a3d459e-6347-419a-b8d4-9fbbe343730d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:31.883170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a3d459e-6347-419a-b8d4-9fbbe343730d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:31.883666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a3d459e-6347-419a-b8d4-9fbbe343730d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:31.884116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a3d459e-6347-419a-b8d4-9fbbe343730d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:31.925058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9471992e-059d-4bb9-a555-c4e0f2ad81b1 req-4b05dda7-1ef9-484e-9015-05e1f935f519 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4b07b4-5711-4b49-a9d9-f5c4923447be", "name": "network-vif-plugged", "status": "completed", "tag": "27ce5361-3d8f-4fb0-ac8d-bdff7683ba41"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:51:31.937723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9471992e-059d-4bb9-a555-c4e0f2ad81b1 req-4b05dda7-1ef9-484e-9015-05e1f935f519 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:31.938133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9471992e-059d-4bb9-a555-c4e0f2ad81b1 req-4b05dda7-1ef9-484e-9015-05e1f935f519 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:31.938568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9471992e-059d-4bb9-a555-c4e0f2ad81b1 req-4b05dda7-1ef9-484e-9015-05e1f935f519 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:31.956170 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9471992e-059d-4bb9-a555-c4e0f2ad81b1 req-4b05dda7-1ef9-484e-9015-05e1f935f519 service nova] Creating event network-vif-plugged:27ce5361-3d8f-4fb0-ac8d-bdff7683ba41 for instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be on n-h2-852084-10 Sep 08 13:51:31.962501 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9471992e-059d-4bb9-a555-c4e0f2ad81b1 req-4b05dda7-1ef9-484e-9015-05e1f935f519 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041280 Sep 08 13:51:31.963667 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3210/6550] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:51:32.036618 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4a3d459e-6347-419a-b8d4-9fbbe343730d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:32.045923 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4a3d459e-6347-419a-b8d4-9fbbe343730d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1655 microversion: 2.1 time: 0.177349 Sep 08 13:51:32.046518 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3341/6551] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:31 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1655 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:32.070864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d6a735cf-ef03-4363-b9a6-0a61b98589d0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:51:32.078160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6a735cf-ef03-4363-b9a6-0a61b98589d0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:32.078650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6a735cf-ef03-4363-b9a6-0a61b98589d0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:32.079249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6a735cf-ef03-4363-b9a6-0a61b98589d0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:32.104453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d6a735cf-ef03-4363-b9a6-0a61b98589d0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Going to try to start instance {{(pid=128971) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 13:51:32.150376 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d6a735cf-ef03-4363-b9a6-0a61b98589d0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be/action" status: 202 len: 0 microversion: 2.1 time: 0.083585 Sep 08 13:51:32.151210 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3211/6552] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:51:32 2022] POST /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:51:32.159834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ad9c37b6-09a8-4311-9d6f-879f14d7ba80 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:32.160504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ad9c37b6-09a8-4311-9d6f-879f14d7ba80 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:32.166665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad9c37b6-09a8-4311-9d6f-879f14d7ba80 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:32.167445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad9c37b6-09a8-4311-9d6f-879f14d7ba80 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:32.167943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad9c37b6-09a8-4311-9d6f-879f14d7ba80 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:32.168764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad9c37b6-09a8-4311-9d6f-879f14d7ba80 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:32.169264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad9c37b6-09a8-4311-9d6f-879f14d7ba80 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:32.169825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad9c37b6-09a8-4311-9d6f-879f14d7ba80 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:32.385058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ad9c37b6-09a8-4311-9d6f-879f14d7ba80 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:32.387735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:32.395699 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ad9c37b6-09a8-4311-9d6f-879f14d7ba80 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1664 microversion: 2.1 time: 0.240093 Sep 08 13:51:32.396587 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3342/6553] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:32 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1664 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:33.421136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f6c811f9-a7e5-409f-9154-e40b4d27b1cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:33.421836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f6c811f9-a7e5-409f-9154-e40b4d27b1cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:33.429020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6c811f9-a7e5-409f-9154-e40b4d27b1cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:33.429509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6c811f9-a7e5-409f-9154-e40b4d27b1cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:33.429947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6c811f9-a7e5-409f-9154-e40b4d27b1cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:33.430652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6c811f9-a7e5-409f-9154-e40b4d27b1cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:33.431107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6c811f9-a7e5-409f-9154-e40b4d27b1cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:33.431566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6c811f9-a7e5-409f-9154-e40b4d27b1cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:33.436514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:33.569125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f6c811f9-a7e5-409f-9154-e40b4d27b1cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:33.577393 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f6c811f9-a7e5-409f-9154-e40b4d27b1cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1668 microversion: 2.1 time: 0.161455 Sep 08 13:51:33.577980 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3212/6554] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:33 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:51:33.600473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2535b9ec-9530-411a-955d-220374812b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:33.601021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2535b9ec-9530-411a-955d-220374812b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:33.610496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2535b9ec-9530-411a-955d-220374812b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:33.611606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2535b9ec-9530-411a-955d-220374812b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:33.612066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2535b9ec-9530-411a-955d-220374812b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:33.612792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2535b9ec-9530-411a-955d-220374812b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:33.613266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2535b9ec-9530-411a-955d-220374812b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:33.613707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2535b9ec-9530-411a-955d-220374812b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:33.640667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2535b9ec-9530-411a-955d-220374812b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:51:33.724147 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2535b9ec-9530-411a-955d-220374812b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 204 len: 0 microversion: 2.1 time: 0.127275 Sep 08 13:51:33.724763 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3343/6555] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:51:33 2022] DELETE /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:51:33.733010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7a18ec3d-4db6-4a12-baa0-e2e801ecbb60 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:33.733984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7a18ec3d-4db6-4a12-baa0-e2e801ecbb60 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:33.740214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a18ec3d-4db6-4a12-baa0-e2e801ecbb60 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:33.740705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a18ec3d-4db6-4a12-baa0-e2e801ecbb60 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:33.741140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a18ec3d-4db6-4a12-baa0-e2e801ecbb60 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:33.741839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a18ec3d-4db6-4a12-baa0-e2e801ecbb60 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:33.742298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a18ec3d-4db6-4a12-baa0-e2e801ecbb60 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:33.742724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7a18ec3d-4db6-4a12-baa0-e2e801ecbb60 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:33.883751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7a18ec3d-4db6-4a12-baa0-e2e801ecbb60 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:33.891829 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7a18ec3d-4db6-4a12-baa0-e2e801ecbb60 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1674 microversion: 2.1 time: 0.162756 Sep 08 13:51:33.892438 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3213/6556] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:33 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:34.915734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b4b694b8-16b0-429c-a324-5094bfc05514 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:34.916378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b4b694b8-16b0-429c-a324-5094bfc05514 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:34.923330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4b694b8-16b0-429c-a324-5094bfc05514 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:34.923842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4b694b8-16b0-429c-a324-5094bfc05514 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:34.924307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4b694b8-16b0-429c-a324-5094bfc05514 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:34.925026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4b694b8-16b0-429c-a324-5094bfc05514 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:34.925504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4b694b8-16b0-429c-a324-5094bfc05514 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:34.925952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b4b694b8-16b0-429c-a324-5094bfc05514 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:35.101090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b4b694b8-16b0-429c-a324-5094bfc05514 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:35.110577 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b4b694b8-16b0-429c-a324-5094bfc05514 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1674 microversion: 2.1 time: 0.198864 Sep 08 13:51:35.111484 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3344/6557] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:34 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1674 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:36.137109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-10b1f15e-f60f-4253-811f-c7fddfbe77e1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:36.138746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-10b1f15e-f60f-4253-811f-c7fddfbe77e1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:36.143418 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:51:36.143763 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 13:51:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be (ip 10.222.0.78) !!! Sep 08 13:51:36.149388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10b1f15e-f60f-4253-811f-c7fddfbe77e1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:36.149879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10b1f15e-f60f-4253-811f-c7fddfbe77e1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:36.150350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10b1f15e-f60f-4253-811f-c7fddfbe77e1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:36.151117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10b1f15e-f60f-4253-811f-c7fddfbe77e1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:36.151625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10b1f15e-f60f-4253-811f-c7fddfbe77e1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:36.152057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-10b1f15e-f60f-4253-811f-c7fddfbe77e1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:36.236720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-10b1f15e-f60f-4253-811f-c7fddfbe77e1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:36.245304 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-10b1f15e-f60f-4253-811f-c7fddfbe77e1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 200 len: 1606 microversion: 2.1 time: 0.114805 Sep 08 13:51:36.256423 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3214/6558] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:36 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 1606 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:36.320459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-9a9ca627-2000-49b1-b836-60e701092810 req-c99ced91-5919-4a5e-96b8-7be8cce52f54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f4b07b4-5711-4b49-a9d9-f5c4923447be", "name": "network-vif-deleted", "tag": "27ce5361-3d8f-4fb0-ac8d-bdff7683ba41"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:51:36.333825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9a9ca627-2000-49b1-b836-60e701092810 req-c99ced91-5919-4a5e-96b8-7be8cce52f54 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:36.334704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9a9ca627-2000-49b1-b836-60e701092810 req-c99ced91-5919-4a5e-96b8-7be8cce52f54 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:36.335665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9a9ca627-2000-49b1-b836-60e701092810 req-c99ced91-5919-4a5e-96b8-7be8cce52f54 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:36.350859 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-9a9ca627-2000-49b1-b836-60e701092810 req-c99ced91-5919-4a5e-96b8-7be8cce52f54 service nova] Creating event network-vif-deleted:27ce5361-3d8f-4fb0-ac8d-bdff7683ba41 for instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be on n-h2-852084-10 Sep 08 13:51:36.357228 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-9a9ca627-2000-49b1-b836-60e701092810 req-c99ced91-5919-4a5e-96b8-7be8cce52f54 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048433 Sep 08 13:51:36.357957 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3345/6559] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:51:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:51:37.271591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7dba4255-6d61-4247-83b1-192536fc3606 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:37.272201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7dba4255-6d61-4247-83b1-192536fc3606 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:37.281853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dba4255-6d61-4247-83b1-192536fc3606 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:37.282352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dba4255-6d61-4247-83b1-192536fc3606 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:37.282806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dba4255-6d61-4247-83b1-192536fc3606 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:37.283585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dba4255-6d61-4247-83b1-192536fc3606 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:37.284055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dba4255-6d61-4247-83b1-192536fc3606 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:37.285182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7dba4255-6d61-4247-83b1-192536fc3606 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:37.300105 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-7dba4255-6d61-4247-83b1-192536fc3606 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7dba4255-6d61-4247-83b1-192536fc3606 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be HTTP/1.1 Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '1f4b07b4-5711-4b49-a9d9-f5c4923447be'} Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:51:37.301808 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:51:37.306615 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:51:37.306615 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:51:37.306615 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:51:37.306615 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:51:37.306615 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:51:37.306615 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:51:37.306615 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:51:37.306615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7dba4255-6d61-4247-83b1-192536fc3606 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:51:37.306615 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7dba4255-6d61-4247-83b1-192536fc3606 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 404 len: 111 microversion: 2.1 time: 0.036170 Sep 08 13:51:37.306615 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3215/6560] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:37 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:51:37.328014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d49d6df6-9f32-463f-8784-537efe5f8b64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:37.330799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d49d6df6-9f32-463f-8784-537efe5f8b64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:37.338509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d49d6df6-9f32-463f-8784-537efe5f8b64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:37.339204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d49d6df6-9f32-463f-8784-537efe5f8b64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:37.339694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d49d6df6-9f32-463f-8784-537efe5f8b64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:37.340988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d49d6df6-9f32-463f-8784-537efe5f8b64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:37.342152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d49d6df6-9f32-463f-8784-537efe5f8b64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:37.342754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d49d6df6-9f32-463f-8784-537efe5f8b64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:37.363990 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-d49d6df6-9f32-463f-8784-537efe5f8b64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d49d6df6-9f32-463f-8784-537efe5f8b64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be HTTP/1.1 Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '1f4b07b4-5711-4b49-a9d9-f5c4923447be'} Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:51:37.365772 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:51:37.370068 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:51:37.370068 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:51:37.370068 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:51:37.370068 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:51:37.370068 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:51:37.370068 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:51:37.370068 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:51:37.370068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d49d6df6-9f32-463f-8784-537efe5f8b64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:51:37.370068 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d49d6df6-9f32-463f-8784-537efe5f8b64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 404 len: 111 microversion: 2.1 time: 0.044647 Sep 08 13:51:37.370068 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3346/6561] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:37 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:51:37.434561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-551337430", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "152acfcb-1ab2-4c75-8556-f2471248ba62"}], "security_groups": [{"name": "tempest-securitygroup--1696640897"}], "key_name": "tempest-keypair-783440952", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:51:37.551098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] validate_networks() for [('152acfcb-1ab2-4c75-8556-f2471248ba62', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:51:38.019470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:51:38.019916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:51:38.020533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:51:38.020958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:51:38.021513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:51:38.023406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=47 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:38.032486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:38.032980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:38.033427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:38.034158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:38.034621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:38.035050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:38.052980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:51:38.058755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for user 660a56a892a645f3949629bc47b7ce94 and project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:51:38.072049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:51:38.074492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:51:38.131809 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-33995207-812f-45f0-ab6b-c06da6f1ebe4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.700959 Sep 08 13:51:38.132817 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3216/6562] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:51:37 2022] POST /compute/v2.1/servers => generated 406 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:51:38.145191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8ba34d34-5722-43c3-9f5f-dafce0601f6c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:38.145967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8ba34d34-5722-43c3-9f5f-dafce0601f6c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:38.148166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:38.215104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8ba34d34-5722-43c3-9f5f-dafce0601f6c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:38.223348 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8ba34d34-5722-43c3-9f5f-dafce0601f6c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1237 microversion: 2.1 time: 0.082914 Sep 08 13:51:38.223950 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3347/6563] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:38 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:51:39.251553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7beb8cc7-feaa-477c-ba35-e94d4182a8c6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:39.252719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7beb8cc7-feaa-477c-ba35-e94d4182a8c6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:39.263841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7beb8cc7-feaa-477c-ba35-e94d4182a8c6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:39.264336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7beb8cc7-feaa-477c-ba35-e94d4182a8c6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:39.264775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7beb8cc7-feaa-477c-ba35-e94d4182a8c6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:39.265491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7beb8cc7-feaa-477c-ba35-e94d4182a8c6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:39.266760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7beb8cc7-feaa-477c-ba35-e94d4182a8c6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:39.267214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7beb8cc7-feaa-477c-ba35-e94d4182a8c6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:39.358765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7beb8cc7-feaa-477c-ba35-e94d4182a8c6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:39.368861 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7beb8cc7-feaa-477c-ba35-e94d4182a8c6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1307 microversion: 2.1 time: 0.125916 Sep 08 13:51:39.369456 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3217/6564] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:39 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1307 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:40.413789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc79b1c0-9edd-4fd2-9c77-acccd12f5b27 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:40.414559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc79b1c0-9edd-4fd2-9c77-acccd12f5b27 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:40.425921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc79b1c0-9edd-4fd2-9c77-acccd12f5b27 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:40.426928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc79b1c0-9edd-4fd2-9c77-acccd12f5b27 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:40.427892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc79b1c0-9edd-4fd2-9c77-acccd12f5b27 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:40.428950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc79b1c0-9edd-4fd2-9c77-acccd12f5b27 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:40.429597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc79b1c0-9edd-4fd2-9c77-acccd12f5b27 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:40.430259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc79b1c0-9edd-4fd2-9c77-acccd12f5b27 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:40.725067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc79b1c0-9edd-4fd2-9c77-acccd12f5b27 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:40.734316 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc79b1c0-9edd-4fd2-9c77-acccd12f5b27 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1363 microversion: 2.1 time: 0.324436 Sep 08 13:51:40.735582 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3348/6565] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:40 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:40.941847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-839d04ac-5594-4db4-bd6d-9fbbfd5e63f8 req-001a0d22-cb87-4cdd-a08b-7923573f75fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2429d89-36fb-4a98-81e9-6f04bf206199", "tag": "04c890fd-753d-4eee-a4bd-dcbb98509600"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:51:40.962602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-839d04ac-5594-4db4-bd6d-9fbbfd5e63f8 req-001a0d22-cb87-4cdd-a08b-7923573f75fc service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:40.963513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-839d04ac-5594-4db4-bd6d-9fbbfd5e63f8 req-001a0d22-cb87-4cdd-a08b-7923573f75fc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:40.963949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-839d04ac-5594-4db4-bd6d-9fbbfd5e63f8 req-001a0d22-cb87-4cdd-a08b-7923573f75fc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:40.982046 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-839d04ac-5594-4db4-bd6d-9fbbfd5e63f8 req-001a0d22-cb87-4cdd-a08b-7923573f75fc service nova] Creating event network-changed:04c890fd-753d-4eee-a4bd-dcbb98509600 for instance d2429d89-36fb-4a98-81e9-6f04bf206199 on n-h2-852084-10 Sep 08 13:51:40.988080 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-839d04ac-5594-4db4-bd6d-9fbbfd5e63f8 req-001a0d22-cb87-4cdd-a08b-7923573f75fc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059175 Sep 08 13:51:40.988882 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3218/6566] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:51:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:51:41.762290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd5627bb-029f-47a1-b69a-fb4d0e5162bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:41.763039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dd5627bb-029f-47a1-b69a-fb4d0e5162bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:41.771894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd5627bb-029f-47a1-b69a-fb4d0e5162bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:41.772474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd5627bb-029f-47a1-b69a-fb4d0e5162bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:41.772882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd5627bb-029f-47a1-b69a-fb4d0e5162bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:41.773634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd5627bb-029f-47a1-b69a-fb4d0e5162bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:41.774156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd5627bb-029f-47a1-b69a-fb4d0e5162bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:41.774606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd5627bb-029f-47a1-b69a-fb4d0e5162bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:41.927769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dd5627bb-029f-47a1-b69a-fb4d0e5162bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:41.935723 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dd5627bb-029f-47a1-b69a-fb4d0e5162bd tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1363 microversion: 2.1 time: 0.177588 Sep 08 13:51:41.936320 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3349/6567] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:41 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:42.961554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e020215f-37a8-439e-961a-86e49bdcf16e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:42.962258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e020215f-37a8-439e-961a-86e49bdcf16e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:42.970639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e020215f-37a8-439e-961a-86e49bdcf16e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:42.971211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e020215f-37a8-439e-961a-86e49bdcf16e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:42.971749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e020215f-37a8-439e-961a-86e49bdcf16e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:42.972454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e020215f-37a8-439e-961a-86e49bdcf16e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:42.972923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e020215f-37a8-439e-961a-86e49bdcf16e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:42.973330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e020215f-37a8-439e-961a-86e49bdcf16e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:43.178100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e020215f-37a8-439e-961a-86e49bdcf16e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:43.186667 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e020215f-37a8-439e-961a-86e49bdcf16e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1363 microversion: 2.1 time: 0.229656 Sep 08 13:51:43.187445 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3219/6568] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:42 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1363 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:44.212517 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-773637c0-adf0-4afa-97b2-ef15ef8bc37c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:44.213278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-773637c0-adf0-4afa-97b2-ef15ef8bc37c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:44.221366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-773637c0-adf0-4afa-97b2-ef15ef8bc37c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:44.221876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-773637c0-adf0-4afa-97b2-ef15ef8bc37c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:44.222334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-773637c0-adf0-4afa-97b2-ef15ef8bc37c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:44.223077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-773637c0-adf0-4afa-97b2-ef15ef8bc37c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:44.223585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-773637c0-adf0-4afa-97b2-ef15ef8bc37c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:44.224026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-773637c0-adf0-4afa-97b2-ef15ef8bc37c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:44.367072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-773637c0-adf0-4afa-97b2-ef15ef8bc37c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:44.381524 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-773637c0-adf0-4afa-97b2-ef15ef8bc37c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1363 microversion: 2.1 time: 0.172536 Sep 08 13:51:44.382643 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3350/6569] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:44 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:45.407529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5aed17d7-39a7-40ba-9474-53a8c2a8f4e7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:45.408343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5aed17d7-39a7-40ba-9474-53a8c2a8f4e7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:45.415894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5aed17d7-39a7-40ba-9474-53a8c2a8f4e7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:45.416398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5aed17d7-39a7-40ba-9474-53a8c2a8f4e7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:45.416839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5aed17d7-39a7-40ba-9474-53a8c2a8f4e7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:45.417585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5aed17d7-39a7-40ba-9474-53a8c2a8f4e7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:45.418057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5aed17d7-39a7-40ba-9474-53a8c2a8f4e7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:45.418495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5aed17d7-39a7-40ba-9474-53a8c2a8f4e7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:45.573625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5aed17d7-39a7-40ba-9474-53a8c2a8f4e7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:45.583672 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5aed17d7-39a7-40ba-9474-53a8c2a8f4e7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1363 microversion: 2.1 time: 0.180162 Sep 08 13:51:45.584299 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3220/6570] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:45 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:45.948880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7c8a5d3a-ed36-4774-971b-e3d2a7c76123 req-fbbe5f3d-c6c5-462b-852e-046217f84711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2429d89-36fb-4a98-81e9-6f04bf206199", "name": "network-vif-plugged", "status": "completed", "tag": "04c890fd-753d-4eee-a4bd-dcbb98509600"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:51:45.960151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7c8a5d3a-ed36-4774-971b-e3d2a7c76123 req-fbbe5f3d-c6c5-462b-852e-046217f84711 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:45.960650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7c8a5d3a-ed36-4774-971b-e3d2a7c76123 req-fbbe5f3d-c6c5-462b-852e-046217f84711 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:45.961134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7c8a5d3a-ed36-4774-971b-e3d2a7c76123 req-fbbe5f3d-c6c5-462b-852e-046217f84711 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:45.973030 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7c8a5d3a-ed36-4774-971b-e3d2a7c76123 req-fbbe5f3d-c6c5-462b-852e-046217f84711 service nova] Creating event network-vif-plugged:04c890fd-753d-4eee-a4bd-dcbb98509600 for instance d2429d89-36fb-4a98-81e9-6f04bf206199 on n-h2-852084-10 Sep 08 13:51:45.978022 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7c8a5d3a-ed36-4774-971b-e3d2a7c76123 req-fbbe5f3d-c6c5-462b-852e-046217f84711 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033132 Sep 08 13:51:45.978669 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3351/6571] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:51:46.609028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1bea01c9-2c31-4460-9dae-00b45e2b9063 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:46.609680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1bea01c9-2c31-4460-9dae-00b45e2b9063 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:46.617014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bea01c9-2c31-4460-9dae-00b45e2b9063 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:46.617509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bea01c9-2c31-4460-9dae-00b45e2b9063 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:46.617948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bea01c9-2c31-4460-9dae-00b45e2b9063 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:46.618648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bea01c9-2c31-4460-9dae-00b45e2b9063 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:46.619110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bea01c9-2c31-4460-9dae-00b45e2b9063 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:46.619572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1bea01c9-2c31-4460-9dae-00b45e2b9063 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:46.764686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1bea01c9-2c31-4460-9dae-00b45e2b9063 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:46.772890 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1bea01c9-2c31-4460-9dae-00b45e2b9063 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1363 microversion: 2.1 time: 0.167909 Sep 08 13:51:46.773492 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3221/6572] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:46 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:51:47.804268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-46cdc8c0-e2aa-4b78-98d8-32955159d4d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:47.805190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-46cdc8c0-e2aa-4b78-98d8-32955159d4d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:47.817151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46cdc8c0-e2aa-4b78-98d8-32955159d4d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:47.817900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46cdc8c0-e2aa-4b78-98d8-32955159d4d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:47.818522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46cdc8c0-e2aa-4b78-98d8-32955159d4d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:47.819716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46cdc8c0-e2aa-4b78-98d8-32955159d4d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:47.820365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46cdc8c0-e2aa-4b78-98d8-32955159d4d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:47.820858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-46cdc8c0-e2aa-4b78-98d8-32955159d4d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:47.966849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-46cdc8c0-e2aa-4b78-98d8-32955159d4d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:51:47.975019 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-46cdc8c0-e2aa-4b78-98d8-32955159d4d8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1550 microversion: 2.1 time: 0.181384 Sep 08 13:51:47.975428 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3352/6573] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:51:47 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1550 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:51:47.998837 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aeb6c81b-605c-4caf-9bf6-474f26294549 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:51:48.000020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-aeb6c81b-605c-4caf-9bf6-474f26294549 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:51:48.006916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aeb6c81b-605c-4caf-9bf6-474f26294549 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:48.007474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aeb6c81b-605c-4caf-9bf6-474f26294549 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:48.007924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aeb6c81b-605c-4caf-9bf6-474f26294549 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:48.008689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aeb6c81b-605c-4caf-9bf6-474f26294549 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:48.009160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aeb6c81b-605c-4caf-9bf6-474f26294549 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:48.009594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aeb6c81b-605c-4caf-9bf6-474f26294549 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:48.042779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:48.065730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:48.088921 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-aeb6c81b-605c-4caf-9bf6-474f26294549 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094043 Sep 08 13:51:48.089564 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3222/6574] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:51:47 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:51:49.357321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-af6097ca-ffd9-46a5-a292-8ba20c288637 req-6edf19d8-4ab2-45d9-aa42-650e328d09ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2429d89-36fb-4a98-81e9-6f04bf206199", "tag": "04c890fd-753d-4eee-a4bd-dcbb98509600"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:51:49.363016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:51:49.369688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-af6097ca-ffd9-46a5-a292-8ba20c288637 req-6edf19d8-4ab2-45d9-aa42-650e328d09ea service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:51:49.370277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-af6097ca-ffd9-46a5-a292-8ba20c288637 req-6edf19d8-4ab2-45d9-aa42-650e328d09ea service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:51:49.370735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-af6097ca-ffd9-46a5-a292-8ba20c288637 req-6edf19d8-4ab2-45d9-aa42-650e328d09ea service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:51:49.383087 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-af6097ca-ffd9-46a5-a292-8ba20c288637 req-6edf19d8-4ab2-45d9-aa42-650e328d09ea service nova] Creating event network-changed:04c890fd-753d-4eee-a4bd-dcbb98509600 for instance d2429d89-36fb-4a98-81e9-6f04bf206199 on n-h2-852084-10 Sep 08 13:51:49.388383 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-af6097ca-ffd9-46a5-a292-8ba20c288637 req-6edf19d8-4ab2-45d9-aa42-650e328d09ea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034862 Sep 08 13:51:49.389023 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3353/6575] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:22.284514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:22.286902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:22.290466 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:22.291682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=50 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:22.299039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:22.299568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:22.300016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:22.300736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:22.301194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:22.301629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:22.334125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:22.342231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Old instance type m1.heat2, new instance type m1.heat {{(pid=128971) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 13:52:22.352497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:52:22.353398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:52:22.354636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:52:22.355429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:52:22.356208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:52:22.443105 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-aa48ff0b-9d07-4887-ba13-f34377b235f7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199/action" status: 202 len: 0 microversion: 2.1 time: 0.162582 Sep 08 13:52:22.443762 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3223/6576] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:52:22 2022] POST /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:52:22.450747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=15 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:22.452032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:22.453591 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:52:22.453734 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 13:52:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 (ip 10.222.0.78) !!! Sep 08 13:52:22.458496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fb671956-be7e-4053-a4a8-0a91d5ae1a87 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:22.459419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fb671956-be7e-4053-a4a8-0a91d5ae1a87 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:22.470047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb671956-be7e-4053-a4a8-0a91d5ae1a87 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:22.470722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb671956-be7e-4053-a4a8-0a91d5ae1a87 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:22.471312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb671956-be7e-4053-a4a8-0a91d5ae1a87 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:22.472108 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb671956-be7e-4053-a4a8-0a91d5ae1a87 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:22.472577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb671956-be7e-4053-a4a8-0a91d5ae1a87 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:22.473018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fb671956-be7e-4053-a4a8-0a91d5ae1a87 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:22.641118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fb671956-be7e-4053-a4a8-0a91d5ae1a87 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:22.651576 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fb671956-be7e-4053-a4a8-0a91d5ae1a87 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1677 microversion: 2.1 time: 0.202384 Sep 08 13:52:22.652228 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3354/6577] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:22 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:23.677482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2db0717e-f62f-4143-928e-ba8a7fc21aa0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:23.678101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2db0717e-f62f-4143-928e-ba8a7fc21aa0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:23.686130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2db0717e-f62f-4143-928e-ba8a7fc21aa0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:23.686625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2db0717e-f62f-4143-928e-ba8a7fc21aa0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:23.687058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2db0717e-f62f-4143-928e-ba8a7fc21aa0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:23.687801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2db0717e-f62f-4143-928e-ba8a7fc21aa0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:23.688252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2db0717e-f62f-4143-928e-ba8a7fc21aa0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:23.688680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2db0717e-f62f-4143-928e-ba8a7fc21aa0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:23.835584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2db0717e-f62f-4143-928e-ba8a7fc21aa0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:23.844097 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2db0717e-f62f-4143-928e-ba8a7fc21aa0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1677 microversion: 2.1 time: 0.171441 Sep 08 13:52:23.844705 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3224/6578] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:23 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1677 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:52:24.873204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ee417242-131d-4c30-bc88-18418a6a9438 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:24.874403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ee417242-131d-4c30-bc88-18418a6a9438 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:24.882879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee417242-131d-4c30-bc88-18418a6a9438 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:24.883426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee417242-131d-4c30-bc88-18418a6a9438 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:24.883887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee417242-131d-4c30-bc88-18418a6a9438 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:24.884622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee417242-131d-4c30-bc88-18418a6a9438 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:24.885097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee417242-131d-4c30-bc88-18418a6a9438 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:24.885541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ee417242-131d-4c30-bc88-18418a6a9438 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:25.021576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ee417242-131d-4c30-bc88-18418a6a9438 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:25.029955 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ee417242-131d-4c30-bc88-18418a6a9438 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.164467 Sep 08 13:52:25.030539 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3355/6579] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:24 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:26.054701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-22e92990-3378-43ef-b829-ff5dbc99bf17 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:26.055531 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-22e92990-3378-43ef-b829-ff5dbc99bf17 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:26.065125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22e92990-3378-43ef-b829-ff5dbc99bf17 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:26.065690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22e92990-3378-43ef-b829-ff5dbc99bf17 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:26.066166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22e92990-3378-43ef-b829-ff5dbc99bf17 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:26.066956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22e92990-3378-43ef-b829-ff5dbc99bf17 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:26.067588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22e92990-3378-43ef-b829-ff5dbc99bf17 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:26.067967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22e92990-3378-43ef-b829-ff5dbc99bf17 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:26.239570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-22e92990-3378-43ef-b829-ff5dbc99bf17 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:26.248750 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-22e92990-3378-43ef-b829-ff5dbc99bf17 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.198432 Sep 08 13:52:26.249350 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3225/6580] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:26 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:27.273817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0f059846-a4b5-4ee8-a713-214f9d5134ae tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:27.274450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0f059846-a4b5-4ee8-a713-214f9d5134ae tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:27.282106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f059846-a4b5-4ee8-a713-214f9d5134ae tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:27.282614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f059846-a4b5-4ee8-a713-214f9d5134ae tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:27.283062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f059846-a4b5-4ee8-a713-214f9d5134ae tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:27.283816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f059846-a4b5-4ee8-a713-214f9d5134ae tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:27.284281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f059846-a4b5-4ee8-a713-214f9d5134ae tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:27.284720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f059846-a4b5-4ee8-a713-214f9d5134ae tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:27.435384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0f059846-a4b5-4ee8-a713-214f9d5134ae tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:27.443640 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0f059846-a4b5-4ee8-a713-214f9d5134ae tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.173994 Sep 08 13:52:27.444233 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3356/6581] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:27 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:28.468619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6a5c9067-17dd-4506-8cf0-fce5a1b08055 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:28.469277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6a5c9067-17dd-4506-8cf0-fce5a1b08055 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:28.477060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a5c9067-17dd-4506-8cf0-fce5a1b08055 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:28.477586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a5c9067-17dd-4506-8cf0-fce5a1b08055 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:28.478566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a5c9067-17dd-4506-8cf0-fce5a1b08055 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:28.479349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a5c9067-17dd-4506-8cf0-fce5a1b08055 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:28.479835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a5c9067-17dd-4506-8cf0-fce5a1b08055 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:28.480290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a5c9067-17dd-4506-8cf0-fce5a1b08055 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:28.637293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6a5c9067-17dd-4506-8cf0-fce5a1b08055 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:28.645630 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6a5c9067-17dd-4506-8cf0-fce5a1b08055 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.181130 Sep 08 13:52:28.646234 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3226/6582] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:28 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:29.671639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d0d04f2-8b0b-439f-b871-0946560193d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:29.672296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6d0d04f2-8b0b-439f-b871-0946560193d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:29.679560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d0d04f2-8b0b-439f-b871-0946560193d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:29.680112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d0d04f2-8b0b-439f-b871-0946560193d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:29.680581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d0d04f2-8b0b-439f-b871-0946560193d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:29.681872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d0d04f2-8b0b-439f-b871-0946560193d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:29.682355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d0d04f2-8b0b-439f-b871-0946560193d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:29.682817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6d0d04f2-8b0b-439f-b871-0946560193d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:29.846345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6d0d04f2-8b0b-439f-b871-0946560193d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:29.857600 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6d0d04f2-8b0b-439f-b871-0946560193d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.191038 Sep 08 13:52:29.858317 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3357/6583] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:29 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:30.883260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6c511e6b-8488-4866-819a-ebde4b0ccfec tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:30.884003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6c511e6b-8488-4866-819a-ebde4b0ccfec tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:30.891503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c511e6b-8488-4866-819a-ebde4b0ccfec tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:30.892002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c511e6b-8488-4866-819a-ebde4b0ccfec tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:30.892440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c511e6b-8488-4866-819a-ebde4b0ccfec tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:30.893155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c511e6b-8488-4866-819a-ebde4b0ccfec tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:30.893610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c511e6b-8488-4866-819a-ebde4b0ccfec tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:30.894041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c511e6b-8488-4866-819a-ebde4b0ccfec tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:31.056150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c511e6b-8488-4866-819a-ebde4b0ccfec tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:31.064538 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6c511e6b-8488-4866-819a-ebde4b0ccfec tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.185245 Sep 08 13:52:31.065151 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3227/6584] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:30 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:32.090109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-40503c4d-1cc8-4918-8330-f084a3ecec98 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:32.090957 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-40503c4d-1cc8-4918-8330-f084a3ecec98 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:32.098585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40503c4d-1cc8-4918-8330-f084a3ecec98 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:32.099200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40503c4d-1cc8-4918-8330-f084a3ecec98 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:32.099813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40503c4d-1cc8-4918-8330-f084a3ecec98 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:32.100777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40503c4d-1cc8-4918-8330-f084a3ecec98 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:32.101267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40503c4d-1cc8-4918-8330-f084a3ecec98 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:32.101710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-40503c4d-1cc8-4918-8330-f084a3ecec98 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:32.262597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-40503c4d-1cc8-4918-8330-f084a3ecec98 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:32.271601 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-40503c4d-1cc8-4918-8330-f084a3ecec98 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.186401 Sep 08 13:52:32.272300 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3358/6585] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:32 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:52:33.298882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c147de24-c703-4864-bc46-8583ffb86ede tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:33.300003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c147de24-c703-4864-bc46-8583ffb86ede tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:33.308609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c147de24-c703-4864-bc46-8583ffb86ede tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:33.309108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c147de24-c703-4864-bc46-8583ffb86ede tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:33.309538 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c147de24-c703-4864-bc46-8583ffb86ede tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:33.310246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c147de24-c703-4864-bc46-8583ffb86ede tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:33.310717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c147de24-c703-4864-bc46-8583ffb86ede tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:33.311134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c147de24-c703-4864-bc46-8583ffb86ede tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:33.468109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c147de24-c703-4864-bc46-8583ffb86ede tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:33.477323 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c147de24-c703-4864-bc46-8583ffb86ede tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.182434 Sep 08 13:52:33.477982 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3228/6586] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:33 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:52:34.501969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-48288394-727b-4d1d-8887-16ea7b9497a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:34.502602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-48288394-727b-4d1d-8887-16ea7b9497a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:34.510796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48288394-727b-4d1d-8887-16ea7b9497a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:34.511347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48288394-727b-4d1d-8887-16ea7b9497a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:34.511792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48288394-727b-4d1d-8887-16ea7b9497a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:34.512512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48288394-727b-4d1d-8887-16ea7b9497a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:34.512986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48288394-727b-4d1d-8887-16ea7b9497a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:34.513427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-48288394-727b-4d1d-8887-16ea7b9497a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:34.669156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-48288394-727b-4d1d-8887-16ea7b9497a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:34.677602 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-48288394-727b-4d1d-8887-16ea7b9497a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.180211 Sep 08 13:52:34.678211 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3359/6587] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:34 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:35.702658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bdacb722-474c-4dd7-9bca-348ac810bcfb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:35.703293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bdacb722-474c-4dd7-9bca-348ac810bcfb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:35.710050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bdacb722-474c-4dd7-9bca-348ac810bcfb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:35.710513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bdacb722-474c-4dd7-9bca-348ac810bcfb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:35.710957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bdacb722-474c-4dd7-9bca-348ac810bcfb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:35.712458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bdacb722-474c-4dd7-9bca-348ac810bcfb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:35.712914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bdacb722-474c-4dd7-9bca-348ac810bcfb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:35.713331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bdacb722-474c-4dd7-9bca-348ac810bcfb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:35.845299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bdacb722-474c-4dd7-9bca-348ac810bcfb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:35.853444 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bdacb722-474c-4dd7-9bca-348ac810bcfb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.154867 Sep 08 13:52:35.854018 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3229/6588] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:35 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:36.877730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3400c1d6-354b-44f8-a76f-c255380b75bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:36.878287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3400c1d6-354b-44f8-a76f-c255380b75bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:36.885070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3400c1d6-354b-44f8-a76f-c255380b75bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:36.885570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3400c1d6-354b-44f8-a76f-c255380b75bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:36.886017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3400c1d6-354b-44f8-a76f-c255380b75bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:36.886732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3400c1d6-354b-44f8-a76f-c255380b75bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:36.887194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3400c1d6-354b-44f8-a76f-c255380b75bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:36.887658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3400c1d6-354b-44f8-a76f-c255380b75bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:37.026608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3400c1d6-354b-44f8-a76f-c255380b75bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:37.035172 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3400c1d6-354b-44f8-a76f-c255380b75bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.161429 Sep 08 13:52:37.035805 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3360/6589] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:36 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:38.060985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c0f2f9e1-4f95-457e-a51e-5ca9aa9f110d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:38.061627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c0f2f9e1-4f95-457e-a51e-5ca9aa9f110d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:38.068752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0f2f9e1-4f95-457e-a51e-5ca9aa9f110d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:38.069371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0f2f9e1-4f95-457e-a51e-5ca9aa9f110d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:38.070076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0f2f9e1-4f95-457e-a51e-5ca9aa9f110d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:38.071558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0f2f9e1-4f95-457e-a51e-5ca9aa9f110d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:38.072019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0f2f9e1-4f95-457e-a51e-5ca9aa9f110d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:38.072457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c0f2f9e1-4f95-457e-a51e-5ca9aa9f110d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:38.204141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c0f2f9e1-4f95-457e-a51e-5ca9aa9f110d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:38.212710 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c0f2f9e1-4f95-457e-a51e-5ca9aa9f110d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.155642 Sep 08 13:52:38.213231 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3230/6590] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:38 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:39.236552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-801249b6-1d1d-46ef-8c9b-c292c25d83a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:39.237201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-801249b6-1d1d-46ef-8c9b-c292c25d83a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:39.244614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-801249b6-1d1d-46ef-8c9b-c292c25d83a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:39.245113 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-801249b6-1d1d-46ef-8c9b-c292c25d83a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:39.245558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-801249b6-1d1d-46ef-8c9b-c292c25d83a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:39.246260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-801249b6-1d1d-46ef-8c9b-c292c25d83a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:39.246722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-801249b6-1d1d-46ef-8c9b-c292c25d83a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:39.247155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-801249b6-1d1d-46ef-8c9b-c292c25d83a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:39.402938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-801249b6-1d1d-46ef-8c9b-c292c25d83a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:39.410909 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-801249b6-1d1d-46ef-8c9b-c292c25d83a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.178281 Sep 08 13:52:39.411544 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3361/6591] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:39 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:40.434938 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0dd271c0-527d-40de-9907-daa4d7af73a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:40.435528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0dd271c0-527d-40de-9907-daa4d7af73a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:40.442811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0dd271c0-527d-40de-9907-daa4d7af73a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:40.443332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0dd271c0-527d-40de-9907-daa4d7af73a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:40.443820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0dd271c0-527d-40de-9907-daa4d7af73a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:40.444821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0dd271c0-527d-40de-9907-daa4d7af73a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:40.445313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0dd271c0-527d-40de-9907-daa4d7af73a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:40.445739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0dd271c0-527d-40de-9907-daa4d7af73a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:40.579797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0dd271c0-527d-40de-9907-daa4d7af73a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:40.588388 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0dd271c0-527d-40de-9907-daa4d7af73a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1682 microversion: 2.1 time: 0.157454 Sep 08 13:52:40.588975 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3231/6592] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:40 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:41.612663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f7f1d6e3-59d8-4092-9067-1f338d969630 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:41.613453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f7f1d6e3-59d8-4092-9067-1f338d969630 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:41.620952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f1d6e3-59d8-4092-9067-1f338d969630 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:41.621897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f1d6e3-59d8-4092-9067-1f338d969630 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:41.622032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f1d6e3-59d8-4092-9067-1f338d969630 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:41.622650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f1d6e3-59d8-4092-9067-1f338d969630 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:41.623118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f1d6e3-59d8-4092-9067-1f338d969630 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:41.623630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f1d6e3-59d8-4092-9067-1f338d969630 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:41.768281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f7f1d6e3-59d8-4092-9067-1f338d969630 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:41.776065 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f7f1d6e3-59d8-4092-9067-1f338d969630 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1681 microversion: 2.1 time: 0.167372 Sep 08 13:52:41.776581 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3362/6593] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:41 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:52:42.401548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-80c1c740-5330-4e77-bd81-0e5ca367ba62 req-54b69fc6-1f5d-46f9-ad05-d04d6b7cd101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2429d89-36fb-4a98-81e9-6f04bf206199", "name": "network-vif-unplugged", "status": "completed", "tag": "04c890fd-753d-4eee-a4bd-dcbb98509600"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:42.411869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-80c1c740-5330-4e77-bd81-0e5ca367ba62 req-54b69fc6-1f5d-46f9-ad05-d04d6b7cd101 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:42.412607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-80c1c740-5330-4e77-bd81-0e5ca367ba62 req-54b69fc6-1f5d-46f9-ad05-d04d6b7cd101 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:42.412927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-80c1c740-5330-4e77-bd81-0e5ca367ba62 req-54b69fc6-1f5d-46f9-ad05-d04d6b7cd101 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:42.426971 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-80c1c740-5330-4e77-bd81-0e5ca367ba62 req-54b69fc6-1f5d-46f9-ad05-d04d6b7cd101 service nova] Creating event network-vif-unplugged:04c890fd-753d-4eee-a4bd-dcbb98509600 for instance d2429d89-36fb-4a98-81e9-6f04bf206199 on n-h1-852084-10 Sep 08 13:52:42.433468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-80c1c740-5330-4e77-bd81-0e5ca367ba62 req-54b69fc6-1f5d-46f9-ad05-d04d6b7cd101 service nova] Instance d2429d89-36fb-4a98-81e9-6f04bf206199 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:52:42.445713 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-80c1c740-5330-4e77-bd81-0e5ca367ba62 req-54b69fc6-1f5d-46f9-ad05-d04d6b7cd101 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.138835 Sep 08 13:52:42.446517 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3232/6594] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:52:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:42.800484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e6fa739-68f6-4cc9-8623-9587b8835a12 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:42.802227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2e6fa739-68f6-4cc9-8623-9587b8835a12 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:42.810465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e6fa739-68f6-4cc9-8623-9587b8835a12 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:42.811098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e6fa739-68f6-4cc9-8623-9587b8835a12 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:42.811884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e6fa739-68f6-4cc9-8623-9587b8835a12 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:42.812686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e6fa739-68f6-4cc9-8623-9587b8835a12 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:42.813239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e6fa739-68f6-4cc9-8623-9587b8835a12 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:42.813758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e6fa739-68f6-4cc9-8623-9587b8835a12 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:42.983217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2e6fa739-68f6-4cc9-8623-9587b8835a12 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:42.991755 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2e6fa739-68f6-4cc9-8623-9587b8835a12 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1681 microversion: 2.1 time: 0.195098 Sep 08 13:52:42.992358 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3363/6595] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:42 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1681 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:44.016844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36b11936-44d6-41be-b45c-23e416ec9f7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:44.017651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-36b11936-44d6-41be-b45c-23e416ec9f7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:44.026787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b11936-44d6-41be-b45c-23e416ec9f7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:44.027666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b11936-44d6-41be-b45c-23e416ec9f7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:44.027811 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b11936-44d6-41be-b45c-23e416ec9f7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:44.028459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b11936-44d6-41be-b45c-23e416ec9f7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:44.028868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b11936-44d6-41be-b45c-23e416ec9f7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:44.029290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36b11936-44d6-41be-b45c-23e416ec9f7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:44.179756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-36b11936-44d6-41be-b45c-23e416ec9f7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:44.187890 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36b11936-44d6-41be-b45c-23e416ec9f7a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1679 microversion: 2.1 time: 0.175798 Sep 08 13:52:44.188611 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3233/6596] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:44 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:44.463037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b8dbb651-344d-470f-8c51-dcfdc6b525df req-de5e3599-30b1-4750-9701-16eb687dddda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2429d89-36fb-4a98-81e9-6f04bf206199", "tag": "04c890fd-753d-4eee-a4bd-dcbb98509600"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:44.476796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b8dbb651-344d-470f-8c51-dcfdc6b525df req-de5e3599-30b1-4750-9701-16eb687dddda service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:44.477364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b8dbb651-344d-470f-8c51-dcfdc6b525df req-de5e3599-30b1-4750-9701-16eb687dddda service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:44.477814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b8dbb651-344d-470f-8c51-dcfdc6b525df req-de5e3599-30b1-4750-9701-16eb687dddda service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:44.492059 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b8dbb651-344d-470f-8c51-dcfdc6b525df req-de5e3599-30b1-4750-9701-16eb687dddda service nova] Creating event network-changed:04c890fd-753d-4eee-a4bd-dcbb98509600 for instance d2429d89-36fb-4a98-81e9-6f04bf206199 on n-h1-852084-10 Sep 08 13:52:44.497878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-b8dbb651-344d-470f-8c51-dcfdc6b525df req-de5e3599-30b1-4750-9701-16eb687dddda service nova] Instance d2429d89-36fb-4a98-81e9-6f04bf206199 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:52:44.510420 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b8dbb651-344d-470f-8c51-dcfdc6b525df req-de5e3599-30b1-4750-9701-16eb687dddda service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051999 Sep 08 13:52:44.511052 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3364/6597] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:52:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:45.213008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7ab551e7-affa-4de6-8611-c0d6eebbed03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:45.213541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7ab551e7-affa-4de6-8611-c0d6eebbed03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:45.220678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ab551e7-affa-4de6-8611-c0d6eebbed03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:45.221165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ab551e7-affa-4de6-8611-c0d6eebbed03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:45.221606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ab551e7-affa-4de6-8611-c0d6eebbed03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:45.222312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ab551e7-affa-4de6-8611-c0d6eebbed03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:45.222767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ab551e7-affa-4de6-8611-c0d6eebbed03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:45.223195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7ab551e7-affa-4de6-8611-c0d6eebbed03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:45.362757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7ab551e7-affa-4de6-8611-c0d6eebbed03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:45.371917 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7ab551e7-affa-4de6-8611-c0d6eebbed03 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1676 microversion: 2.1 time: 0.162984 Sep 08 13:52:45.372555 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3234/6598] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:45 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:45.396609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:45.397267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:45.403542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:45.404039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:45.404487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:45.405182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:45.405653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:45.406091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:45.443787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:45.445200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:45.445645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:45.446380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:45.446846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:45.447313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:45.467266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'cores', 'ram'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:52:45.473164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for user 660a56a892a645f3949629bc47b7ce94 and project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'cores', 'ram'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:52:45.588107 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-441c1dd5-c52e-4116-bc77-99d96a7826cf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199/action" status: 202 len: 0 microversion: 2.1 time: 0.195503 Sep 08 13:52:45.588856 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3365/6599] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:52:45 2022] POST /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:52:45.597205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92febf3b-6b8f-49e9-a24c-697a7128b440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:45.597826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-92febf3b-6b8f-49e9-a24c-697a7128b440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:45.604792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92febf3b-6b8f-49e9-a24c-697a7128b440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:45.605280 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92febf3b-6b8f-49e9-a24c-697a7128b440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:45.605722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92febf3b-6b8f-49e9-a24c-697a7128b440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:45.606434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92febf3b-6b8f-49e9-a24c-697a7128b440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:45.606885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92febf3b-6b8f-49e9-a24c-697a7128b440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:45.607343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92febf3b-6b8f-49e9-a24c-697a7128b440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:45.746486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-92febf3b-6b8f-49e9-a24c-697a7128b440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:45.755968 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92febf3b-6b8f-49e9-a24c-697a7128b440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1675 microversion: 2.1 time: 0.162733 Sep 08 13:52:45.756669 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3235/6600] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:45 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1675 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:46.781780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e082be4-2a84-4a5f-a0ac-f6c8f87a5dc1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:46.782508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9e082be4-2a84-4a5f-a0ac-f6c8f87a5dc1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:46.790122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e082be4-2a84-4a5f-a0ac-f6c8f87a5dc1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:46.790780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e082be4-2a84-4a5f-a0ac-f6c8f87a5dc1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:46.791100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e082be4-2a84-4a5f-a0ac-f6c8f87a5dc1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:46.791874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e082be4-2a84-4a5f-a0ac-f6c8f87a5dc1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:46.792352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e082be4-2a84-4a5f-a0ac-f6c8f87a5dc1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:46.792797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e082be4-2a84-4a5f-a0ac-f6c8f87a5dc1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:46.937853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9e082be4-2a84-4a5f-a0ac-f6c8f87a5dc1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:46.946703 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e082be4-2a84-4a5f-a0ac-f6c8f87a5dc1 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1675 microversion: 2.1 time: 0.170168 Sep 08 13:52:46.947298 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3366/6601] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:46 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:47.971402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0604ef01-7a60-4c28-8340-a1027a92acaa tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:47.972016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0604ef01-7a60-4c28-8340-a1027a92acaa tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:47.980295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0604ef01-7a60-4c28-8340-a1027a92acaa tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:47.980810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0604ef01-7a60-4c28-8340-a1027a92acaa tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:47.981247 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0604ef01-7a60-4c28-8340-a1027a92acaa tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:47.981963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0604ef01-7a60-4c28-8340-a1027a92acaa tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:47.982667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0604ef01-7a60-4c28-8340-a1027a92acaa tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:47.983098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0604ef01-7a60-4c28-8340-a1027a92acaa tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:48.154582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0604ef01-7a60-4c28-8340-a1027a92acaa tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:48.164972 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0604ef01-7a60-4c28-8340-a1027a92acaa tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1675 microversion: 2.1 time: 0.198201 Sep 08 13:52:48.166141 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3236/6602] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:47 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1675 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:48.176380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-ce313e25-a7f7-41c9-8577-1b266ffc6d06 req-bcd2cbc3-8dba-403a-88d1-b080c0978a69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2429d89-36fb-4a98-81e9-6f04bf206199", "name": "network-vif-plugged", "status": "completed", "tag": "04c890fd-753d-4eee-a4bd-dcbb98509600"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:48.189753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ce313e25-a7f7-41c9-8577-1b266ffc6d06 req-bcd2cbc3-8dba-403a-88d1-b080c0978a69 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:48.190242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ce313e25-a7f7-41c9-8577-1b266ffc6d06 req-bcd2cbc3-8dba-403a-88d1-b080c0978a69 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:48.190866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-ce313e25-a7f7-41c9-8577-1b266ffc6d06 req-bcd2cbc3-8dba-403a-88d1-b080c0978a69 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:48.205015 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-ce313e25-a7f7-41c9-8577-1b266ffc6d06 req-bcd2cbc3-8dba-403a-88d1-b080c0978a69 service nova] Creating event network-vif-plugged:04c890fd-753d-4eee-a4bd-dcbb98509600 for instance d2429d89-36fb-4a98-81e9-6f04bf206199 on n-h2-852084-10 Sep 08 13:52:48.211540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-ce313e25-a7f7-41c9-8577-1b266ffc6d06 req-bcd2cbc3-8dba-403a-88d1-b080c0978a69 service nova] Instance d2429d89-36fb-4a98-81e9-6f04bf206199 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:52:48.223337 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-ce313e25-a7f7-41c9-8577-1b266ffc6d06 req-bcd2cbc3-8dba-403a-88d1-b080c0978a69 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147342 Sep 08 13:52:48.224210 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3367/6603] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:48.797540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-eda6ff8a-d1b5-4922-8af9-7c8fe9be6389 req-dabb8dc4-a91d-4477-8256-818ac30cdb5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2429d89-36fb-4a98-81e9-6f04bf206199", "name": "network-vif-unplugged", "status": "completed", "tag": "04c890fd-753d-4eee-a4bd-dcbb98509600"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:48.809436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-eda6ff8a-d1b5-4922-8af9-7c8fe9be6389 req-dabb8dc4-a91d-4477-8256-818ac30cdb5f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:48.809897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-eda6ff8a-d1b5-4922-8af9-7c8fe9be6389 req-dabb8dc4-a91d-4477-8256-818ac30cdb5f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:48.810437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-eda6ff8a-d1b5-4922-8af9-7c8fe9be6389 req-dabb8dc4-a91d-4477-8256-818ac30cdb5f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:48.824481 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-eda6ff8a-d1b5-4922-8af9-7c8fe9be6389 req-dabb8dc4-a91d-4477-8256-818ac30cdb5f service nova] Creating event network-vif-unplugged:04c890fd-753d-4eee-a4bd-dcbb98509600 for instance d2429d89-36fb-4a98-81e9-6f04bf206199 on n-h2-852084-10 Sep 08 13:52:48.830236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-eda6ff8a-d1b5-4922-8af9-7c8fe9be6389 req-dabb8dc4-a91d-4477-8256-818ac30cdb5f service nova] Instance d2429d89-36fb-4a98-81e9-6f04bf206199 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:52:48.843679 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-eda6ff8a-d1b5-4922-8af9-7c8fe9be6389 req-dabb8dc4-a91d-4477-8256-818ac30cdb5f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049520 Sep 08 13:52:48.844549 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3237/6604] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:49.193306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7e626b32-f786-4dee-8f96-5bcd9d142930 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:49.195124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7e626b32-f786-4dee-8f96-5bcd9d142930 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:49.205505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e626b32-f786-4dee-8f96-5bcd9d142930 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:49.206080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e626b32-f786-4dee-8f96-5bcd9d142930 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:49.206488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e626b32-f786-4dee-8f96-5bcd9d142930 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:49.207248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e626b32-f786-4dee-8f96-5bcd9d142930 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:49.207737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e626b32-f786-4dee-8f96-5bcd9d142930 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:49.208182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7e626b32-f786-4dee-8f96-5bcd9d142930 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:49.214571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:49.484596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7e626b32-f786-4dee-8f96-5bcd9d142930 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:49.494137 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7e626b32-f786-4dee-8f96-5bcd9d142930 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1675 microversion: 2.1 time: 0.306237 Sep 08 13:52:49.503275 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3368/6605] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:49 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1675 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:50.520478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b67b1797-e7f8-4039-ba65-872e8845c011 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:50.521187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b67b1797-e7f8-4039-ba65-872e8845c011 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:50.529092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b67b1797-e7f8-4039-ba65-872e8845c011 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:50.529601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b67b1797-e7f8-4039-ba65-872e8845c011 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:50.530047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b67b1797-e7f8-4039-ba65-872e8845c011 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:50.530771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b67b1797-e7f8-4039-ba65-872e8845c011 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:50.531297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b67b1797-e7f8-4039-ba65-872e8845c011 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:50.531690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b67b1797-e7f8-4039-ba65-872e8845c011 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:50.682385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b67b1797-e7f8-4039-ba65-872e8845c011 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:50.686642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:50.693218 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b67b1797-e7f8-4039-ba65-872e8845c011 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1675 microversion: 2.1 time: 0.177986 Sep 08 13:52:50.694636 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3238/6606] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:50 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:50.860925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-79e2db7a-8666-491f-8f8c-5fe6c4f06a3a req-e3e0e57a-63f4-413c-bad9-393ec3a3a625 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2429d89-36fb-4a98-81e9-6f04bf206199", "tag": "04c890fd-753d-4eee-a4bd-dcbb98509600"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:50.872440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-79e2db7a-8666-491f-8f8c-5fe6c4f06a3a req-e3e0e57a-63f4-413c-bad9-393ec3a3a625 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:50.872929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-79e2db7a-8666-491f-8f8c-5fe6c4f06a3a req-e3e0e57a-63f4-413c-bad9-393ec3a3a625 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:50.873381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-79e2db7a-8666-491f-8f8c-5fe6c4f06a3a req-e3e0e57a-63f4-413c-bad9-393ec3a3a625 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:50.886069 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-79e2db7a-8666-491f-8f8c-5fe6c4f06a3a req-e3e0e57a-63f4-413c-bad9-393ec3a3a625 service nova] Creating event network-changed:04c890fd-753d-4eee-a4bd-dcbb98509600 for instance d2429d89-36fb-4a98-81e9-6f04bf206199 on n-h2-852084-10 Sep 08 13:52:50.891927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-79e2db7a-8666-491f-8f8c-5fe6c4f06a3a req-e3e0e57a-63f4-413c-bad9-393ec3a3a625 service nova] Instance d2429d89-36fb-4a98-81e9-6f04bf206199 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:52:50.903068 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-79e2db7a-8666-491f-8f8c-5fe6c4f06a3a req-e3e0e57a-63f4-413c-bad9-393ec3a3a625 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045917 Sep 08 13:52:50.903719 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3369/6607] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:51.719475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0f9ae622-fd66-4f03-95fc-ccbae3dc2d9d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:51.720199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0f9ae622-fd66-4f03-95fc-ccbae3dc2d9d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:51.730557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f9ae622-fd66-4f03-95fc-ccbae3dc2d9d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:51.731440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f9ae622-fd66-4f03-95fc-ccbae3dc2d9d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:51.732201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f9ae622-fd66-4f03-95fc-ccbae3dc2d9d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:51.733952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f9ae622-fd66-4f03-95fc-ccbae3dc2d9d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:51.733952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f9ae622-fd66-4f03-95fc-ccbae3dc2d9d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:51.734204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f9ae622-fd66-4f03-95fc-ccbae3dc2d9d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:52.025779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0f9ae622-fd66-4f03-95fc-ccbae3dc2d9d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:52.034535 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0f9ae622-fd66-4f03-95fc-ccbae3dc2d9d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1668 microversion: 2.1 time: 0.319691 Sep 08 13:52:52.035140 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3239/6608] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:51 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1668 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:52.059918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e95fb553-da0f-485e-bfe8-e8da5dd54b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:52.060644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e95fb553-da0f-485e-bfe8-e8da5dd54b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:52.067334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e95fb553-da0f-485e-bfe8-e8da5dd54b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:52.067842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e95fb553-da0f-485e-bfe8-e8da5dd54b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:52.068303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e95fb553-da0f-485e-bfe8-e8da5dd54b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:52.069966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e95fb553-da0f-485e-bfe8-e8da5dd54b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:52.070489 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e95fb553-da0f-485e-bfe8-e8da5dd54b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:52.070942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e95fb553-da0f-485e-bfe8-e8da5dd54b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:52.219803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e95fb553-da0f-485e-bfe8-e8da5dd54b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:52.230129 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e95fb553-da0f-485e-bfe8-e8da5dd54b33 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1668 microversion: 2.1 time: 0.175315 Sep 08 13:52:52.230865 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3370/6609] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:52 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1668 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:52.255432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db7e06cb-df1f-44bd-9c64-0485d1626b45 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:52.255698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-db7e06cb-df1f-44bd-9c64-0485d1626b45 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:52.261911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db7e06cb-df1f-44bd-9c64-0485d1626b45 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:52.262408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db7e06cb-df1f-44bd-9c64-0485d1626b45 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:52.262836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db7e06cb-df1f-44bd-9c64-0485d1626b45 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:52.263576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db7e06cb-df1f-44bd-9c64-0485d1626b45 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:52.264024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db7e06cb-df1f-44bd-9c64-0485d1626b45 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:52.264449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db7e06cb-df1f-44bd-9c64-0485d1626b45 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:52.406563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-db7e06cb-df1f-44bd-9c64-0485d1626b45 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:52.415285 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-db7e06cb-df1f-44bd-9c64-0485d1626b45 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1668 microversion: 2.1 time: 0.164176 Sep 08 13:52:52.415883 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3240/6610] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:52 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1668 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:52.441726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6a09509a-e65f-4b0c-9377-bb53c97d38b5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:52.442248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6a09509a-e65f-4b0c-9377-bb53c97d38b5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:52.448870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a09509a-e65f-4b0c-9377-bb53c97d38b5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:52.449379 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a09509a-e65f-4b0c-9377-bb53c97d38b5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:52.450109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a09509a-e65f-4b0c-9377-bb53c97d38b5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:52.450649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a09509a-e65f-4b0c-9377-bb53c97d38b5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:52.451195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a09509a-e65f-4b0c-9377-bb53c97d38b5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:52.452330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6a09509a-e65f-4b0c-9377-bb53c97d38b5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:52.479352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6a09509a-e65f-4b0c-9377-bb53c97d38b5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:52:52.543563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:52.562863 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6a09509a-e65f-4b0c-9377-bb53c97d38b5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 204 len: 0 microversion: 2.1 time: 0.124787 Sep 08 13:52:52.564222 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3371/6611] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:52:52 2022] DELETE /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:52:52.573609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eec6edb5-6fd9-436f-8a61-b56ccd38d88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:52.574432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eec6edb5-6fd9-436f-8a61-b56ccd38d88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:52.576397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=41 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:52.582251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eec6edb5-6fd9-436f-8a61-b56ccd38d88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:52.582741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eec6edb5-6fd9-436f-8a61-b56ccd38d88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:52.583175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eec6edb5-6fd9-436f-8a61-b56ccd38d88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:52.583900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eec6edb5-6fd9-436f-8a61-b56ccd38d88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:52.584878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eec6edb5-6fd9-436f-8a61-b56ccd38d88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:52.585300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eec6edb5-6fd9-436f-8a61-b56ccd38d88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:52.726804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eec6edb5-6fd9-436f-8a61-b56ccd38d88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:52.735756 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eec6edb5-6fd9-436f-8a61-b56ccd38d88f tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1674 microversion: 2.1 time: 0.166379 Sep 08 13:52:52.736292 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3241/6612] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:52 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:52:53.764755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f59ca396-202e-4857-9b97-1ba662260bb9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:53.765719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f59ca396-202e-4857-9b97-1ba662260bb9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:53.776703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f59ca396-202e-4857-9b97-1ba662260bb9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:53.777219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f59ca396-202e-4857-9b97-1ba662260bb9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:53.777729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f59ca396-202e-4857-9b97-1ba662260bb9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:53.778471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f59ca396-202e-4857-9b97-1ba662260bb9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:53.778949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f59ca396-202e-4857-9b97-1ba662260bb9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:53.779439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f59ca396-202e-4857-9b97-1ba662260bb9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:54.009170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f59ca396-202e-4857-9b97-1ba662260bb9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:54.018630 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f59ca396-202e-4857-9b97-1ba662260bb9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1674 microversion: 2.1 time: 0.260540 Sep 08 13:52:54.019581 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3372/6613] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:53 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1674 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:54.904205 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-08393f2a-7248-49c4-9918-ffdb6332cb9c req-1a508eb2-8a13-4c3e-8e29-65eeff3a7013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2429d89-36fb-4a98-81e9-6f04bf206199", "name": "network-vif-deleted", "tag": "04c890fd-753d-4eee-a4bd-dcbb98509600"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:54.929899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-08393f2a-7248-49c4-9918-ffdb6332cb9c req-1a508eb2-8a13-4c3e-8e29-65eeff3a7013 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:54.930533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-08393f2a-7248-49c4-9918-ffdb6332cb9c req-1a508eb2-8a13-4c3e-8e29-65eeff3a7013 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:54.931311 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-08393f2a-7248-49c4-9918-ffdb6332cb9c req-1a508eb2-8a13-4c3e-8e29-65eeff3a7013 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:54.950926 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-08393f2a-7248-49c4-9918-ffdb6332cb9c req-1a508eb2-8a13-4c3e-8e29-65eeff3a7013 service nova] Creating event network-vif-deleted:04c890fd-753d-4eee-a4bd-dcbb98509600 for instance d2429d89-36fb-4a98-81e9-6f04bf206199 on n-h2-852084-10 Sep 08 13:52:54.956381 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-08393f2a-7248-49c4-9918-ffdb6332cb9c req-1a508eb2-8a13-4c3e-8e29-65eeff3a7013 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056666 Sep 08 13:52:54.957169 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3242/6614] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:52:55.042683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:55.043397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:55.051786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:55.052302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:55.053254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:55.054612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:55.055278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:55.055751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:55.101211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:55.101984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:55.102449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:55.102930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lazy-loading 'fault' on Instance uuid d2429d89-36fb-4a98-81e9-6f04bf206199 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:52:55.150836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:55.160042 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6159586d-47fd-4227-9f7c-5251bf651f55 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 200 len: 1327 microversion: 2.1 time: 0.121481 Sep 08 13:52:55.160802 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3373/6615] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:55 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 1327 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:56.186862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-23e02f40-ac3b-4613-9684-e5e91e5904f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:56.187625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-23e02f40-ac3b-4613-9684-e5e91e5904f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:56.195059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e02f40-ac3b-4613-9684-e5e91e5904f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:56.195605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e02f40-ac3b-4613-9684-e5e91e5904f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:56.196138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e02f40-ac3b-4613-9684-e5e91e5904f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:56.196950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e02f40-ac3b-4613-9684-e5e91e5904f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:56.197414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e02f40-ac3b-4613-9684-e5e91e5904f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:56.197844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-23e02f40-ac3b-4613-9684-e5e91e5904f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:56.214995 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-23e02f40-ac3b-4613-9684-e5e91e5904f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-23e02f40-ac3b-4613-9684-e5e91e5904f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 HTTP/1.1 Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'd2429d89-36fb-4a98-81e9-6f04bf206199'} Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:56.216796 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:52:56.222154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:56.222154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:56.222154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:56.222154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:52:56.222154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:52:56.222154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:52:56.222154 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:52:56.222154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-23e02f40-ac3b-4613-9684-e5e91e5904f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:56.222154 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-23e02f40-ac3b-4613-9684-e5e91e5904f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 404 len: 111 microversion: 2.1 time: 0.037234 Sep 08 13:52:56.222154 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3243/6616] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:56 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:52:56.233462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:52:56.238511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79c5e6da-74fe-494c-b8dd-9d5f2661cd83 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:56.239159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-79c5e6da-74fe-494c-b8dd-9d5f2661cd83 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:56.245966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79c5e6da-74fe-494c-b8dd-9d5f2661cd83 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:56.246496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79c5e6da-74fe-494c-b8dd-9d5f2661cd83 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:56.246940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79c5e6da-74fe-494c-b8dd-9d5f2661cd83 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:56.247719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79c5e6da-74fe-494c-b8dd-9d5f2661cd83 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:56.248216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79c5e6da-74fe-494c-b8dd-9d5f2661cd83 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:56.248966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-79c5e6da-74fe-494c-b8dd-9d5f2661cd83 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:56.269088 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-79c5e6da-74fe-494c-b8dd-9d5f2661cd83 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79c5e6da-74fe-494c-b8dd-9d5f2661cd83 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 HTTP/1.1 Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'd2429d89-36fb-4a98-81e9-6f04bf206199'} Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:52:56.270804 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:52:56.275811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:52:56.275811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:52:56.275811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:52:56.275811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:52:56.275811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:52:56.275811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:52:56.275811 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:52:56.275811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-79c5e6da-74fe-494c-b8dd-9d5f2661cd83 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:52:56.275811 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-79c5e6da-74fe-494c-b8dd-9d5f2661cd83 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 404 len: 111 microversion: 2.1 time: 0.040352 Sep 08 13:52:56.275811 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3374/6617] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:56 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:52:56.327034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-822547618", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "152acfcb-1ab2-4c75-8556-f2471248ba62"}], "security_groups": [{"name": "tempest-securitygroup--1696640897"}], "key_name": "tempest-keypair-783440952", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:56.445151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] validate_networks() for [('152acfcb-1ab2-4c75-8556-f2471248ba62', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:52:56.847861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:52:56.848299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:52:56.848772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:52:56.849726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:52:56.850120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:52:56.859823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:56.860321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:56.860764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:56.861506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:56.861964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:56.862397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:56.880856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:52:56.886860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for user 660a56a892a645f3949629bc47b7ce94 and project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:52:56.900416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:52:56.902798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:52:56.964751 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-862f6fa6-0d0e-4d6d-9675-f1eea307e503 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.641508 Sep 08 13:52:56.965410 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3244/6618] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:52:56 2022] POST /compute/v2.1/servers => generated 406 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:52:56.977806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc742d77-9eb3-4d71-bb5b-10e141278764 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:56.978450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc742d77-9eb3-4d71-bb5b-10e141278764 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:57.039607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc742d77-9eb3-4d71-bb5b-10e141278764 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:57.049083 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc742d77-9eb3-4d71-bb5b-10e141278764 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1237 microversion: 2.1 time: 0.073960 Sep 08 13:52:57.049083 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3375/6619] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:56 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:58.073223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d48e28d0-ebda-4268-9045-604ac7184aef tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:58.074193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d48e28d0-ebda-4268-9045-604ac7184aef tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:58.084278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d48e28d0-ebda-4268-9045-604ac7184aef tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:58.085463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d48e28d0-ebda-4268-9045-604ac7184aef tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:58.086301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d48e28d0-ebda-4268-9045-604ac7184aef tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:58.087336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d48e28d0-ebda-4268-9045-604ac7184aef tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:58.087921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d48e28d0-ebda-4268-9045-604ac7184aef tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:58.088453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d48e28d0-ebda-4268-9045-604ac7184aef tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:58.180656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d48e28d0-ebda-4268-9045-604ac7184aef tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:58.191458 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d48e28d0-ebda-4268-9045-604ac7184aef tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1307 microversion: 2.1 time: 0.123131 Sep 08 13:52:58.192227 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3245/6620] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:58 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1307 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:52:59.218884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c9702957-8067-4264-87a3-90a0d3055474 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:52:59.219576 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c9702957-8067-4264-87a3-90a0d3055474 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:52:59.227880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9702957-8067-4264-87a3-90a0d3055474 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:59.228429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9702957-8067-4264-87a3-90a0d3055474 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:59.229090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9702957-8067-4264-87a3-90a0d3055474 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:59.229827 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9702957-8067-4264-87a3-90a0d3055474 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:59.230303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9702957-8067-4264-87a3-90a0d3055474 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:59.230753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9702957-8067-4264-87a3-90a0d3055474 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:59.392437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c9702957-8067-4264-87a3-90a0d3055474 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:52:59.400720 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c9702957-8067-4264-87a3-90a0d3055474 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1363 microversion: 2.1 time: 0.186154 Sep 08 13:52:59.401403 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3376/6621] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:52:59 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:52:59.712449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-4e47a644-c8e7-4e03-ac6f-f1d916e74e9f req-7a194e75-6ca4-41a5-9379-6996d0dceeeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10572fbb-bca8-4993-af60-0eebe01e9633", "tag": "31e7e5c9-0f71-486b-bf77-b2d75e18669d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:52:59.726373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4e47a644-c8e7-4e03-ac6f-f1d916e74e9f req-7a194e75-6ca4-41a5-9379-6996d0dceeeb service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:52:59.727219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4e47a644-c8e7-4e03-ac6f-f1d916e74e9f req-7a194e75-6ca4-41a5-9379-6996d0dceeeb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:52:59.727782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-4e47a644-c8e7-4e03-ac6f-f1d916e74e9f req-7a194e75-6ca4-41a5-9379-6996d0dceeeb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:52:59.742820 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-4e47a644-c8e7-4e03-ac6f-f1d916e74e9f req-7a194e75-6ca4-41a5-9379-6996d0dceeeb service nova] Creating event network-changed:31e7e5c9-0f71-486b-bf77-b2d75e18669d for instance 10572fbb-bca8-4993-af60-0eebe01e9633 on n-h1-852084-10 Sep 08 13:52:59.751096 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-4e47a644-c8e7-4e03-ac6f-f1d916e74e9f req-7a194e75-6ca4-41a5-9379-6996d0dceeeb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042729 Sep 08 13:52:59.752259 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3246/6622] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:00.424214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5d58fa9c-0e1b-4c56-a71c-9eee4f93b4e4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:00.424757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5d58fa9c-0e1b-4c56-a71c-9eee4f93b4e4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:00.432280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d58fa9c-0e1b-4c56-a71c-9eee4f93b4e4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:00.432805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d58fa9c-0e1b-4c56-a71c-9eee4f93b4e4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:00.433288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d58fa9c-0e1b-4c56-a71c-9eee4f93b4e4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:00.434055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d58fa9c-0e1b-4c56-a71c-9eee4f93b4e4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:00.434530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d58fa9c-0e1b-4c56-a71c-9eee4f93b4e4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:00.434967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d58fa9c-0e1b-4c56-a71c-9eee4f93b4e4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:00.575159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5d58fa9c-0e1b-4c56-a71c-9eee4f93b4e4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:00.584161 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5d58fa9c-0e1b-4c56-a71c-9eee4f93b4e4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1363 microversion: 2.1 time: 0.163219 Sep 08 13:53:00.584812 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3377/6623] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:00 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:01.613565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4dbec7bb-27ac-48be-ac33-c5f4d9f4c4b3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:01.614512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4dbec7bb-27ac-48be-ac33-c5f4d9f4c4b3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:01.621474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dbec7bb-27ac-48be-ac33-c5f4d9f4c4b3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:01.621990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dbec7bb-27ac-48be-ac33-c5f4d9f4c4b3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:01.622484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dbec7bb-27ac-48be-ac33-c5f4d9f4c4b3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:01.623305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dbec7bb-27ac-48be-ac33-c5f4d9f4c4b3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:01.623794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dbec7bb-27ac-48be-ac33-c5f4d9f4c4b3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:01.624310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4dbec7bb-27ac-48be-ac33-c5f4d9f4c4b3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:01.836092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4dbec7bb-27ac-48be-ac33-c5f4d9f4c4b3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:01.852718 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4dbec7bb-27ac-48be-ac33-c5f4d9f4c4b3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1363 microversion: 2.1 time: 0.244878 Sep 08 13:53:01.853840 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3247/6624] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:01 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1363 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:02.893668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c36f4f16-d871-4c44-94a3-6150f91a3428 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:02.894711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c36f4f16-d871-4c44-94a3-6150f91a3428 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:02.905905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c36f4f16-d871-4c44-94a3-6150f91a3428 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:02.906413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c36f4f16-d871-4c44-94a3-6150f91a3428 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:02.906862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c36f4f16-d871-4c44-94a3-6150f91a3428 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:02.907620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c36f4f16-d871-4c44-94a3-6150f91a3428 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:02.908093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c36f4f16-d871-4c44-94a3-6150f91a3428 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:02.908530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c36f4f16-d871-4c44-94a3-6150f91a3428 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:03.069866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c36f4f16-d871-4c44-94a3-6150f91a3428 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:03.078711 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c36f4f16-d871-4c44-94a3-6150f91a3428 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1363 microversion: 2.1 time: 0.190963 Sep 08 13:53:03.079362 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3378/6625] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:02 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:04.111514 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a28c638f-4e96-4f48-b89d-8ed7a05f92cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:04.112584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a28c638f-4e96-4f48-b89d-8ed7a05f92cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:04.122977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28c638f-4e96-4f48-b89d-8ed7a05f92cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:04.123916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28c638f-4e96-4f48-b89d-8ed7a05f92cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:04.124621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28c638f-4e96-4f48-b89d-8ed7a05f92cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:04.125745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28c638f-4e96-4f48-b89d-8ed7a05f92cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:04.126496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28c638f-4e96-4f48-b89d-8ed7a05f92cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:04.127211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a28c638f-4e96-4f48-b89d-8ed7a05f92cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:04.316716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a28c638f-4e96-4f48-b89d-8ed7a05f92cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:04.326744 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a28c638f-4e96-4f48-b89d-8ed7a05f92cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1363 microversion: 2.1 time: 0.223515 Sep 08 13:53:04.327513 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3248/6626] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:04 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:05.351560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-786c81a0-0435-4450-a38c-1cf42e712c2a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:05.352340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-786c81a0-0435-4450-a38c-1cf42e712c2a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:05.360609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-786c81a0-0435-4450-a38c-1cf42e712c2a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:05.361137 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-786c81a0-0435-4450-a38c-1cf42e712c2a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:05.361599 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-786c81a0-0435-4450-a38c-1cf42e712c2a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:05.362342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-786c81a0-0435-4450-a38c-1cf42e712c2a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:05.362817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-786c81a0-0435-4450-a38c-1cf42e712c2a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:05.363289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-786c81a0-0435-4450-a38c-1cf42e712c2a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:05.525845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-786c81a0-0435-4450-a38c-1cf42e712c2a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:05.534570 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-786c81a0-0435-4450-a38c-1cf42e712c2a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1363 microversion: 2.1 time: 0.186971 Sep 08 13:53:05.535174 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3379/6627] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:05 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:06.158144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-96e1732b-aea0-4f91-a2e7-4734a441733b req-6cdc21f8-067a-44a4-88c5-8a8db9e767c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10572fbb-bca8-4993-af60-0eebe01e9633", "name": "network-vif-plugged", "status": "completed", "tag": "31e7e5c9-0f71-486b-bf77-b2d75e18669d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:06.170792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-96e1732b-aea0-4f91-a2e7-4734a441733b req-6cdc21f8-067a-44a4-88c5-8a8db9e767c9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:06.171575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-96e1732b-aea0-4f91-a2e7-4734a441733b req-6cdc21f8-067a-44a4-88c5-8a8db9e767c9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:06.172155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-96e1732b-aea0-4f91-a2e7-4734a441733b req-6cdc21f8-067a-44a4-88c5-8a8db9e767c9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:06.187700 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-96e1732b-aea0-4f91-a2e7-4734a441733b req-6cdc21f8-067a-44a4-88c5-8a8db9e767c9 service nova] Creating event network-vif-plugged:31e7e5c9-0f71-486b-bf77-b2d75e18669d for instance 10572fbb-bca8-4993-af60-0eebe01e9633 on n-h1-852084-10 Sep 08 13:53:06.193694 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-96e1732b-aea0-4f91-a2e7-4734a441733b req-6cdc21f8-067a-44a4-88c5-8a8db9e767c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039780 Sep 08 13:53:06.194349 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3249/6628] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:06.572573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4efd5077-72ac-449e-bc68-0a4176f94362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:06.573148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4efd5077-72ac-449e-bc68-0a4176f94362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:06.581963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4efd5077-72ac-449e-bc68-0a4176f94362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:06.583164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4efd5077-72ac-449e-bc68-0a4176f94362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:06.583776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4efd5077-72ac-449e-bc68-0a4176f94362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:06.584604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4efd5077-72ac-449e-bc68-0a4176f94362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:06.585153 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4efd5077-72ac-449e-bc68-0a4176f94362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:06.585634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4efd5077-72ac-449e-bc68-0a4176f94362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:06.737772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4efd5077-72ac-449e-bc68-0a4176f94362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:06.746758 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4efd5077-72ac-449e-bc68-0a4176f94362 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1363 microversion: 2.1 time: 0.178645 Sep 08 13:53:06.747396 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3380/6629] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:06 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:07.769106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:07.770411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:07.775827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fbdaaae5-3b27-4c7a-a987-86b6c582dbee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:07.776543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fbdaaae5-3b27-4c7a-a987-86b6c582dbee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:07.784122 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbdaaae5-3b27-4c7a-a987-86b6c582dbee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:07.784616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbdaaae5-3b27-4c7a-a987-86b6c582dbee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:07.785160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbdaaae5-3b27-4c7a-a987-86b6c582dbee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:07.786380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbdaaae5-3b27-4c7a-a987-86b6c582dbee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:07.786831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbdaaae5-3b27-4c7a-a987-86b6c582dbee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:07.787284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fbdaaae5-3b27-4c7a-a987-86b6c582dbee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:07.961826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fbdaaae5-3b27-4c7a-a987-86b6c582dbee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:07.970393 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fbdaaae5-3b27-4c7a-a987-86b6c582dbee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1549 microversion: 2.1 time: 0.201986 Sep 08 13:53:07.971011 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3250/6630] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:07 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1549 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:53:07.996713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9442cbfa-d47f-4de9-8472-7bc7bdc9efde tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:07.997344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9442cbfa-d47f-4de9-8472-7bc7bdc9efde tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:07.999457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:08.013762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9442cbfa-d47f-4de9-8472-7bc7bdc9efde tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:08.014326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9442cbfa-d47f-4de9-8472-7bc7bdc9efde tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:08.014826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9442cbfa-d47f-4de9-8472-7bc7bdc9efde tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:08.015658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9442cbfa-d47f-4de9-8472-7bc7bdc9efde tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:08.016171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9442cbfa-d47f-4de9-8472-7bc7bdc9efde tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:08.016691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9442cbfa-d47f-4de9-8472-7bc7bdc9efde tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:08.124177 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9442cbfa-d47f-4de9-8472-7bc7bdc9efde tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.131784 Sep 08 13:53:08.124809 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3381/6631] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:53:07 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633/os-interface => generated 284 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:09.276609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-a88989c4-0d4d-4bae-b800-2a721fa7deed req-62ae7eba-b95e-434f-89d4-eec13a2acfcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10572fbb-bca8-4993-af60-0eebe01e9633", "tag": "31e7e5c9-0f71-486b-bf77-b2d75e18669d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:09.288295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a88989c4-0d4d-4bae-b800-2a721fa7deed req-62ae7eba-b95e-434f-89d4-eec13a2acfcb service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:09.288767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a88989c4-0d4d-4bae-b800-2a721fa7deed req-62ae7eba-b95e-434f-89d4-eec13a2acfcb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:09.289202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-a88989c4-0d4d-4bae-b800-2a721fa7deed req-62ae7eba-b95e-434f-89d4-eec13a2acfcb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:09.308987 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-a88989c4-0d4d-4bae-b800-2a721fa7deed req-62ae7eba-b95e-434f-89d4-eec13a2acfcb service nova] Creating event network-changed:31e7e5c9-0f71-486b-bf77-b2d75e18669d for instance 10572fbb-bca8-4993-af60-0eebe01e9633 on n-h1-852084-10 Sep 08 13:53:09.317768 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-a88989c4-0d4d-4bae-b800-2a721fa7deed req-62ae7eba-b95e-434f-89d4-eec13a2acfcb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046119 Sep 08 13:53:09.318808 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3251/6632] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:53:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:43.264563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:43.266061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:43.273285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bfc89cec-2f2a-4aff-a0af-ee141d1344bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:43.273945 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bfc89cec-2f2a-4aff-a0af-ee141d1344bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:43.284785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfc89cec-2f2a-4aff-a0af-ee141d1344bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:43.285360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfc89cec-2f2a-4aff-a0af-ee141d1344bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:43.285833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfc89cec-2f2a-4aff-a0af-ee141d1344bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:43.286623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfc89cec-2f2a-4aff-a0af-ee141d1344bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:43.287473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfc89cec-2f2a-4aff-a0af-ee141d1344bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:43.287980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bfc89cec-2f2a-4aff-a0af-ee141d1344bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:43.473763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bfc89cec-2f2a-4aff-a0af-ee141d1344bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:43.487134 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bfc89cec-2f2a-4aff-a0af-ee141d1344bf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1667 microversion: 2.1 time: 0.226362 Sep 08 13:53:43.488244 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3382/6633] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:43 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1667 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:43.516066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d59a541c-ba64-4144-9afd-4c26f0a29a78 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e0b1655-95bb-4296-8a5e-dd77a4a95e5f"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:43.520108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d59a541c-ba64-4144-9afd-4c26f0a29a78 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:43.526381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:43.527642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=54 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:43.539006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d59a541c-ba64-4144-9afd-4c26f0a29a78 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:43.539924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d59a541c-ba64-4144-9afd-4c26f0a29a78 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:43.540718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d59a541c-ba64-4144-9afd-4c26f0a29a78 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:43.541994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d59a541c-ba64-4144-9afd-4c26f0a29a78 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:43.542843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d59a541c-ba64-4144-9afd-4c26f0a29a78 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:43.543630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d59a541c-ba64-4144-9afd-4c26f0a29a78 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:44.001048 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d59a541c-ba64-4144-9afd-4c26f0a29a78 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.491903 Sep 08 13:53:44.001951 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3252/6634] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:53:43 2022] POST /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633/os-volume_attachments => generated 194 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:53:56.163189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:53:56.169312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:56.169312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:56.169779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:56.177076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:56.177585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:56.178047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:56.178784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:56.179277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:56.179775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:56.212619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:56.219787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Old instance type m1.heat2, new instance type m1.heat {{(pid=128970) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 13:53:56.227924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:53:56.228361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:53:56.228851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:53:56.229273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:53:56.229698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:53:56.310216 n-d-852084-10 devstack@n-api.service[128970]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [018e4039-7a6a-4e6b-93ca-34465946a0bf] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 13:53:57.320671 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [018e4039-7a6a-4e6b-93ca-34465946a0bf] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 49130. Sep 08 13:53:57.327260 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6857c236-f460-4964-869e-4158716477c5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633/action" status: 202 len: 0 microversion: 2.1 time: 1.167429 Sep 08 13:53:57.328375 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3383/6635] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:53:56 2022] POST /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633/action => generated 0 bytes in 1170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:53:57.338955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:57.343435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:53:57.349744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2f24d1f-428c-429a-9acf-d7257ec8f163 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:57.350701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2f24d1f-428c-429a-9acf-d7257ec8f163 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:57.364704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f24d1f-428c-429a-9acf-d7257ec8f163 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:57.365402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f24d1f-428c-429a-9acf-d7257ec8f163 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:57.366183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f24d1f-428c-429a-9acf-d7257ec8f163 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:57.367488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f24d1f-428c-429a-9acf-d7257ec8f163 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:57.368549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f24d1f-428c-429a-9acf-d7257ec8f163 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:57.369276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2f24d1f-428c-429a-9acf-d7257ec8f163 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:57.569753 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f2f24d1f-428c-429a-9acf-d7257ec8f163 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:57.581836 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2f24d1f-428c-429a-9acf-d7257ec8f163 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1722 microversion: 2.1 time: 0.246629 Sep 08 13:53:57.582427 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3253/6636] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:57 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1722 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:58.614003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-719d19cf-a1d4-4f65-9164-053f55d777d9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:58.615057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-719d19cf-a1d4-4f65-9164-053f55d777d9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:58.627801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-719d19cf-a1d4-4f65-9164-053f55d777d9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:58.628673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-719d19cf-a1d4-4f65-9164-053f55d777d9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:58.629178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-719d19cf-a1d4-4f65-9164-053f55d777d9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:58.630145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-719d19cf-a1d4-4f65-9164-053f55d777d9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:58.630992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-719d19cf-a1d4-4f65-9164-053f55d777d9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:58.631833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-719d19cf-a1d4-4f65-9164-053f55d777d9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:58.859458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-719d19cf-a1d4-4f65-9164-053f55d777d9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:53:58.870357 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-719d19cf-a1d4-4f65-9164-053f55d777d9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1722 microversion: 2.1 time: 0.265309 Sep 08 13:53:58.871011 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3384/6637] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:58 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1722 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:53:59.898720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e3687c0-2f4e-4369-b5ed-e84979137c4c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:53:59.899682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6e3687c0-2f4e-4369-b5ed-e84979137c4c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:53:59.909148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e3687c0-2f4e-4369-b5ed-e84979137c4c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:59.909668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e3687c0-2f4e-4369-b5ed-e84979137c4c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:59.910112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e3687c0-2f4e-4369-b5ed-e84979137c4c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:53:59.910823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e3687c0-2f4e-4369-b5ed-e84979137c4c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:53:59.911306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e3687c0-2f4e-4369-b5ed-e84979137c4c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:53:59.911778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e3687c0-2f4e-4369-b5ed-e84979137c4c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:00.123101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6e3687c0-2f4e-4369-b5ed-e84979137c4c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:00.132173 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e3687c0-2f4e-4369-b5ed-e84979137c4c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1727 microversion: 2.1 time: 0.238369 Sep 08 13:54:00.132775 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3254/6638] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:53:59 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1727 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:01.161784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ff63a7a0-60dc-4a53-8cd2-bbc25a9196c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:01.162425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ff63a7a0-60dc-4a53-8cd2-bbc25a9196c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:01.170081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff63a7a0-60dc-4a53-8cd2-bbc25a9196c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:01.170598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff63a7a0-60dc-4a53-8cd2-bbc25a9196c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:01.171059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff63a7a0-60dc-4a53-8cd2-bbc25a9196c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:01.171839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff63a7a0-60dc-4a53-8cd2-bbc25a9196c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:01.172321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff63a7a0-60dc-4a53-8cd2-bbc25a9196c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:01.172770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ff63a7a0-60dc-4a53-8cd2-bbc25a9196c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:01.342762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ff63a7a0-60dc-4a53-8cd2-bbc25a9196c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:01.354844 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ff63a7a0-60dc-4a53-8cd2-bbc25a9196c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1727 microversion: 2.1 time: 0.197255 Sep 08 13:54:01.355534 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3385/6639] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:01 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:02.382963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7319075c-e886-4dcf-82e8-4a39bbf9efd4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:02.383897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7319075c-e886-4dcf-82e8-4a39bbf9efd4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:02.394671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7319075c-e886-4dcf-82e8-4a39bbf9efd4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:02.395212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7319075c-e886-4dcf-82e8-4a39bbf9efd4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:02.395847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7319075c-e886-4dcf-82e8-4a39bbf9efd4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:02.396472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7319075c-e886-4dcf-82e8-4a39bbf9efd4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:02.396934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7319075c-e886-4dcf-82e8-4a39bbf9efd4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:02.397367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7319075c-e886-4dcf-82e8-4a39bbf9efd4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:02.574272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7319075c-e886-4dcf-82e8-4a39bbf9efd4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:02.589199 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7319075c-e886-4dcf-82e8-4a39bbf9efd4 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1727 microversion: 2.1 time: 0.210426 Sep 08 13:54:02.590215 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3255/6640] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:02 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:03.623107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-81bdad68-31ed-4146-b589-4a55d8a84bbe tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:03.623783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-81bdad68-31ed-4146-b589-4a55d8a84bbe tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:03.632046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81bdad68-31ed-4146-b589-4a55d8a84bbe tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:03.632556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81bdad68-31ed-4146-b589-4a55d8a84bbe tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:03.633014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81bdad68-31ed-4146-b589-4a55d8a84bbe tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:03.633766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81bdad68-31ed-4146-b589-4a55d8a84bbe tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:03.634219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81bdad68-31ed-4146-b589-4a55d8a84bbe tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:03.634661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81bdad68-31ed-4146-b589-4a55d8a84bbe tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:03.792742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-81bdad68-31ed-4146-b589-4a55d8a84bbe tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:03.804526 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-81bdad68-31ed-4146-b589-4a55d8a84bbe tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1727 microversion: 2.1 time: 0.186017 Sep 08 13:54:03.805133 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3386/6641] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:03 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1727 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:04.830314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-85668555-e808-47ef-b9d3-def291508d95 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:04.830951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-85668555-e808-47ef-b9d3-def291508d95 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:04.838763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85668555-e808-47ef-b9d3-def291508d95 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:04.839302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85668555-e808-47ef-b9d3-def291508d95 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:04.839750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85668555-e808-47ef-b9d3-def291508d95 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:04.840606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85668555-e808-47ef-b9d3-def291508d95 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:04.841095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85668555-e808-47ef-b9d3-def291508d95 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:04.841528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85668555-e808-47ef-b9d3-def291508d95 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:05.013379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-85668555-e808-47ef-b9d3-def291508d95 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:05.022831 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-85668555-e808-47ef-b9d3-def291508d95 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1727 microversion: 2.1 time: 0.197317 Sep 08 13:54:05.023624 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3256/6642] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:04 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1727 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:06.129471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9467b134-9a08-4823-ba9a-fed16214c5a0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:06.130138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9467b134-9a08-4823-ba9a-fed16214c5a0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:06.140410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9467b134-9a08-4823-ba9a-fed16214c5a0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:06.141425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9467b134-9a08-4823-ba9a-fed16214c5a0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:06.142226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9467b134-9a08-4823-ba9a-fed16214c5a0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:06.143509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9467b134-9a08-4823-ba9a-fed16214c5a0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:06.144134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9467b134-9a08-4823-ba9a-fed16214c5a0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:06.144903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9467b134-9a08-4823-ba9a-fed16214c5a0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:06.362055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9467b134-9a08-4823-ba9a-fed16214c5a0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:06.378025 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9467b134-9a08-4823-ba9a-fed16214c5a0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1727 microversion: 2.1 time: 0.333796 Sep 08 13:54:06.379197 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3387/6643] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:06 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1727 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:07.413213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a02c2a61-9744-4df5-84ee-2088222bde1d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:07.413855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a02c2a61-9744-4df5-84ee-2088222bde1d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:07.422180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a02c2a61-9744-4df5-84ee-2088222bde1d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:07.422673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a02c2a61-9744-4df5-84ee-2088222bde1d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:07.423102 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a02c2a61-9744-4df5-84ee-2088222bde1d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:07.424011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a02c2a61-9744-4df5-84ee-2088222bde1d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:07.424398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a02c2a61-9744-4df5-84ee-2088222bde1d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:07.424848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a02c2a61-9744-4df5-84ee-2088222bde1d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:07.612699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a02c2a61-9744-4df5-84ee-2088222bde1d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:07.625519 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a02c2a61-9744-4df5-84ee-2088222bde1d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1727 microversion: 2.1 time: 0.217735 Sep 08 13:54:07.627133 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3257/6644] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:07 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:08.663073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4a906f18-d305-4ee4-9fbf-f00459ce1aaf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:08.664042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4a906f18-d305-4ee4-9fbf-f00459ce1aaf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:08.673779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a906f18-d305-4ee4-9fbf-f00459ce1aaf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:08.674286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a906f18-d305-4ee4-9fbf-f00459ce1aaf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:08.674737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a906f18-d305-4ee4-9fbf-f00459ce1aaf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:08.675499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a906f18-d305-4ee4-9fbf-f00459ce1aaf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:08.675964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a906f18-d305-4ee4-9fbf-f00459ce1aaf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:08.676399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4a906f18-d305-4ee4-9fbf-f00459ce1aaf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:08.873650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4a906f18-d305-4ee4-9fbf-f00459ce1aaf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:08.885359 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4a906f18-d305-4ee4-9fbf-f00459ce1aaf tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1727 microversion: 2.1 time: 0.236469 Sep 08 13:54:08.886175 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3388/6645] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:08 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1727 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:09.914345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dda1aa0a-2ba7-4642-b848-45564cdd5f64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:09.915256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dda1aa0a-2ba7-4642-b848-45564cdd5f64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:09.924682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dda1aa0a-2ba7-4642-b848-45564cdd5f64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:09.925279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dda1aa0a-2ba7-4642-b848-45564cdd5f64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:09.925731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dda1aa0a-2ba7-4642-b848-45564cdd5f64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:09.926473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dda1aa0a-2ba7-4642-b848-45564cdd5f64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:09.926945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dda1aa0a-2ba7-4642-b848-45564cdd5f64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:09.927424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dda1aa0a-2ba7-4642-b848-45564cdd5f64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:10.114226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-dda1aa0a-2ba7-4642-b848-45564cdd5f64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:10.125896 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dda1aa0a-2ba7-4642-b848-45564cdd5f64 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1727 microversion: 2.1 time: 0.216863 Sep 08 13:54:10.126669 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3258/6646] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:09 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1727 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:11.163734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3fbe0e7f-f7a8-4414-b5b1-3136ceecf935 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:11.164506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3fbe0e7f-f7a8-4414-b5b1-3136ceecf935 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:11.172334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fbe0e7f-f7a8-4414-b5b1-3136ceecf935 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:11.172850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fbe0e7f-f7a8-4414-b5b1-3136ceecf935 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:11.173314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fbe0e7f-f7a8-4414-b5b1-3136ceecf935 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:11.174059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fbe0e7f-f7a8-4414-b5b1-3136ceecf935 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:11.174540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fbe0e7f-f7a8-4414-b5b1-3136ceecf935 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:11.174997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3fbe0e7f-f7a8-4414-b5b1-3136ceecf935 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:11.399682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3fbe0e7f-f7a8-4414-b5b1-3136ceecf935 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:11.415635 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3fbe0e7f-f7a8-4414-b5b1-3136ceecf935 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1727 microversion: 2.1 time: 0.257586 Sep 08 13:54:11.416680 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3389/6647] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:11 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1727 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:12.471077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8889f36a-7ff9-42f9-95d6-3c73f9f2d9b9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:12.472243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8889f36a-7ff9-42f9-95d6-3c73f9f2d9b9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:12.485616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8889f36a-7ff9-42f9-95d6-3c73f9f2d9b9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:12.486435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8889f36a-7ff9-42f9-95d6-3c73f9f2d9b9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:12.487214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8889f36a-7ff9-42f9-95d6-3c73f9f2d9b9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:12.488525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8889f36a-7ff9-42f9-95d6-3c73f9f2d9b9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:12.489343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8889f36a-7ff9-42f9-95d6-3c73f9f2d9b9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:12.490140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8889f36a-7ff9-42f9-95d6-3c73f9f2d9b9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:12.676505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8889f36a-7ff9-42f9-95d6-3c73f9f2d9b9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:12.686908 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8889f36a-7ff9-42f9-95d6-3c73f9f2d9b9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1727 microversion: 2.1 time: 0.223195 Sep 08 13:54:12.687782 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3259/6648] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:12 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1727 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:13.724194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6ef5cf90-a281-4b81-bd40-5b9b186064f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:13.725710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6ef5cf90-a281-4b81-bd40-5b9b186064f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:13.736912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ef5cf90-a281-4b81-bd40-5b9b186064f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:13.737646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ef5cf90-a281-4b81-bd40-5b9b186064f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:13.738299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ef5cf90-a281-4b81-bd40-5b9b186064f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:13.739362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ef5cf90-a281-4b81-bd40-5b9b186064f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:13.739974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ef5cf90-a281-4b81-bd40-5b9b186064f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:13.740468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6ef5cf90-a281-4b81-bd40-5b9b186064f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:13.960543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6ef5cf90-a281-4b81-bd40-5b9b186064f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:13.976369 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6ef5cf90-a281-4b81-bd40-5b9b186064f8 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1727 microversion: 2.1 time: 0.261284 Sep 08 13:54:13.982579 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3390/6649] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:13 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1727 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:15.019286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71975404-be73-4698-8d2a-6123d0cc34a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:15.020439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-71975404-be73-4698-8d2a-6123d0cc34a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:15.036367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71975404-be73-4698-8d2a-6123d0cc34a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:15.037486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71975404-be73-4698-8d2a-6123d0cc34a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:15.038130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71975404-be73-4698-8d2a-6123d0cc34a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:15.039483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71975404-be73-4698-8d2a-6123d0cc34a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:15.040297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71975404-be73-4698-8d2a-6123d0cc34a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:15.041096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-71975404-be73-4698-8d2a-6123d0cc34a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:15.116670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-9fe491d8-be60-448e-bd3f-a8d137205c3b req-7817e276-99d8-4314-acd3-8a8605933e9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10572fbb-bca8-4993-af60-0eebe01e9633", "name": "network-vif-unplugged", "status": "completed", "tag": "31e7e5c9-0f71-486b-bf77-b2d75e18669d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:15.142047 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9fe491d8-be60-448e-bd3f-a8d137205c3b req-7817e276-99d8-4314-acd3-8a8605933e9b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:15.143182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9fe491d8-be60-448e-bd3f-a8d137205c3b req-7817e276-99d8-4314-acd3-8a8605933e9b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:15.143812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9fe491d8-be60-448e-bd3f-a8d137205c3b req-7817e276-99d8-4314-acd3-8a8605933e9b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:15.171640 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-9fe491d8-be60-448e-bd3f-a8d137205c3b req-7817e276-99d8-4314-acd3-8a8605933e9b service nova] Creating event network-vif-unplugged:31e7e5c9-0f71-486b-bf77-b2d75e18669d for instance 10572fbb-bca8-4993-af60-0eebe01e9633 on n-h2-852084-10 Sep 08 13:54:15.182684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-9fe491d8-be60-448e-bd3f-a8d137205c3b req-7817e276-99d8-4314-acd3-8a8605933e9b service nova] Instance 10572fbb-bca8-4993-af60-0eebe01e9633 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:54:15.200768 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-9fe491d8-be60-448e-bd3f-a8d137205c3b req-7817e276-99d8-4314-acd3-8a8605933e9b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092294 Sep 08 13:54:15.201896 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3391/6650] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:54:15.362452 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-71975404-be73-4698-8d2a-6123d0cc34a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:15.380231 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-71975404-be73-4698-8d2a-6123d0cc34a6 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1726 microversion: 2.1 time: 0.365573 Sep 08 13:54:15.381352 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3260/6651] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:15 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1726 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:16.429648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f326a1b-9761-48a3-9550-6df0de5eced5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:16.430888 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f326a1b-9761-48a3-9550-6df0de5eced5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:16.442635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f326a1b-9761-48a3-9550-6df0de5eced5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:16.443515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f326a1b-9761-48a3-9550-6df0de5eced5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:16.444311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f326a1b-9761-48a3-9550-6df0de5eced5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:16.445542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f326a1b-9761-48a3-9550-6df0de5eced5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:16.446360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f326a1b-9761-48a3-9550-6df0de5eced5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:16.447118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f326a1b-9761-48a3-9550-6df0de5eced5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:16.711621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6f326a1b-9761-48a3-9550-6df0de5eced5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:16.723147 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f326a1b-9761-48a3-9550-6df0de5eced5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1726 microversion: 2.1 time: 0.303207 Sep 08 13:54:16.723815 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3392/6652] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:16 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1726 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:17.225674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f1578ea8-f26b-4594-91e9-f8d04a2ef8ee req-afbecac6-7004-4ab1-8fae-c6d212a0b08b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10572fbb-bca8-4993-af60-0eebe01e9633", "tag": "31e7e5c9-0f71-486b-bf77-b2d75e18669d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:17.244341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f1578ea8-f26b-4594-91e9-f8d04a2ef8ee req-afbecac6-7004-4ab1-8fae-c6d212a0b08b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:17.244881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f1578ea8-f26b-4594-91e9-f8d04a2ef8ee req-afbecac6-7004-4ab1-8fae-c6d212a0b08b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:17.245512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f1578ea8-f26b-4594-91e9-f8d04a2ef8ee req-afbecac6-7004-4ab1-8fae-c6d212a0b08b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:17.274388 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f1578ea8-f26b-4594-91e9-f8d04a2ef8ee req-afbecac6-7004-4ab1-8fae-c6d212a0b08b service nova] Creating event network-changed:31e7e5c9-0f71-486b-bf77-b2d75e18669d for instance 10572fbb-bca8-4993-af60-0eebe01e9633 on n-h2-852084-10 Sep 08 13:54:17.287380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-f1578ea8-f26b-4594-91e9-f8d04a2ef8ee req-afbecac6-7004-4ab1-8fae-c6d212a0b08b service nova] Instance 10572fbb-bca8-4993-af60-0eebe01e9633 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:54:17.301766 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f1578ea8-f26b-4594-91e9-f8d04a2ef8ee req-afbecac6-7004-4ab1-8fae-c6d212a0b08b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083061 Sep 08 13:54:17.302705 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3261/6653] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:17.751046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a68eef00-fdbd-429c-b7aa-e65598eca7b2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:17.752795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a68eef00-fdbd-429c-b7aa-e65598eca7b2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:17.768347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a68eef00-fdbd-429c-b7aa-e65598eca7b2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:17.769439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a68eef00-fdbd-429c-b7aa-e65598eca7b2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:17.770366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a68eef00-fdbd-429c-b7aa-e65598eca7b2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:17.771923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a68eef00-fdbd-429c-b7aa-e65598eca7b2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:17.773026 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a68eef00-fdbd-429c-b7aa-e65598eca7b2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:17.773970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a68eef00-fdbd-429c-b7aa-e65598eca7b2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:18.381970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a68eef00-fdbd-429c-b7aa-e65598eca7b2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:18.395039 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a68eef00-fdbd-429c-b7aa-e65598eca7b2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1724 microversion: 2.1 time: 0.649462 Sep 08 13:54:18.403297 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3393/6654] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:17 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1724 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:19.428626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-388ad711-5be1-48a0-a3c5-a339cafb50ee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:19.429946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-388ad711-5be1-48a0-a3c5-a339cafb50ee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:19.437773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-388ad711-5be1-48a0-a3c5-a339cafb50ee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:19.439307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-388ad711-5be1-48a0-a3c5-a339cafb50ee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:19.439307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-388ad711-5be1-48a0-a3c5-a339cafb50ee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:19.439901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-388ad711-5be1-48a0-a3c5-a339cafb50ee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:19.440377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-388ad711-5be1-48a0-a3c5-a339cafb50ee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:19.440826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-388ad711-5be1-48a0-a3c5-a339cafb50ee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:19.664904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-388ad711-5be1-48a0-a3c5-a339cafb50ee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:19.679835 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-388ad711-5be1-48a0-a3c5-a339cafb50ee tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1724 microversion: 2.1 time: 0.257570 Sep 08 13:54:19.681078 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3262/6655] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:19 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1724 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:20.718954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9d6d8f40-18a7-4641-899a-c957ad0082e2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:20.719869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9d6d8f40-18a7-4641-899a-c957ad0082e2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:20.731465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6d8f40-18a7-4641-899a-c957ad0082e2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:20.732372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6d8f40-18a7-4641-899a-c957ad0082e2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:20.733176 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6d8f40-18a7-4641-899a-c957ad0082e2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:20.734465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6d8f40-18a7-4641-899a-c957ad0082e2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:20.735381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6d8f40-18a7-4641-899a-c957ad0082e2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:20.736150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9d6d8f40-18a7-4641-899a-c957ad0082e2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:20.960651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9d6d8f40-18a7-4641-899a-c957ad0082e2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:20.978309 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9d6d8f40-18a7-4641-899a-c957ad0082e2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1724 microversion: 2.1 time: 0.265979 Sep 08 13:54:20.980096 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3394/6656] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:20 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:22.021192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9f905900-9756-4255-9826-7131e6d8cc88 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:22.022435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9f905900-9756-4255-9826-7131e6d8cc88 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:22.037134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f905900-9756-4255-9826-7131e6d8cc88 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:22.037935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f905900-9756-4255-9826-7131e6d8cc88 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:22.038756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f905900-9756-4255-9826-7131e6d8cc88 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:22.040468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f905900-9756-4255-9826-7131e6d8cc88 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:22.041334 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f905900-9756-4255-9826-7131e6d8cc88 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:22.042159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f905900-9756-4255-9826-7131e6d8cc88 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:22.298378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9f905900-9756-4255-9826-7131e6d8cc88 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:22.313878 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9f905900-9756-4255-9826-7131e6d8cc88 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1724 microversion: 2.1 time: 0.300558 Sep 08 13:54:22.314742 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3263/6657] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:22 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1724 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:23.353268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7bc966ac-bd4f-4221-9e55-172084bf9452 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:23.354821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7bc966ac-bd4f-4221-9e55-172084bf9452 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:23.366300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bc966ac-bd4f-4221-9e55-172084bf9452 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:23.367261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bc966ac-bd4f-4221-9e55-172084bf9452 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:23.368092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bc966ac-bd4f-4221-9e55-172084bf9452 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:23.369167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bc966ac-bd4f-4221-9e55-172084bf9452 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:23.369847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bc966ac-bd4f-4221-9e55-172084bf9452 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:23.370687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7bc966ac-bd4f-4221-9e55-172084bf9452 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:23.574436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7bc966ac-bd4f-4221-9e55-172084bf9452 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:23.587698 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7bc966ac-bd4f-4221-9e55-172084bf9452 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1724 microversion: 2.1 time: 0.241379 Sep 08 13:54:23.588448 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3395/6658] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:23 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:24.614611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92222ba7-b7bb-4a0c-8259-12c721e10fcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:24.615363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-92222ba7-b7bb-4a0c-8259-12c721e10fcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:24.623061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92222ba7-b7bb-4a0c-8259-12c721e10fcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:24.623876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92222ba7-b7bb-4a0c-8259-12c721e10fcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:24.624511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92222ba7-b7bb-4a0c-8259-12c721e10fcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:24.625630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92222ba7-b7bb-4a0c-8259-12c721e10fcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:24.626392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92222ba7-b7bb-4a0c-8259-12c721e10fcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:24.627182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92222ba7-b7bb-4a0c-8259-12c721e10fcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:24.851713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-92222ba7-b7bb-4a0c-8259-12c721e10fcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:24.865420 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92222ba7-b7bb-4a0c-8259-12c721e10fcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1724 microversion: 2.1 time: 0.254500 Sep 08 13:54:24.866396 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3264/6659] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:24 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:25.909087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d300db0d-1734-49c4-bf27-b8445f242736 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:25.909976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d300db0d-1734-49c4-bf27-b8445f242736 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:25.921749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d300db0d-1734-49c4-bf27-b8445f242736 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:25.922393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d300db0d-1734-49c4-bf27-b8445f242736 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:25.923183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d300db0d-1734-49c4-bf27-b8445f242736 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:25.924548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d300db0d-1734-49c4-bf27-b8445f242736 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:25.924732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d300db0d-1734-49c4-bf27-b8445f242736 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:25.925279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d300db0d-1734-49c4-bf27-b8445f242736 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:26.142054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d300db0d-1734-49c4-bf27-b8445f242736 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:26.151872 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d300db0d-1734-49c4-bf27-b8445f242736 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1724 microversion: 2.1 time: 0.249652 Sep 08 13:54:26.152471 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3396/6660] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:25 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:27.179723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-58459674-986d-4bc5-96e3-58aaca932f61 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:27.180386 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-58459674-986d-4bc5-96e3-58aaca932f61 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:27.189268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58459674-986d-4bc5-96e3-58aaca932f61 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:27.189776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58459674-986d-4bc5-96e3-58aaca932f61 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:27.190218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58459674-986d-4bc5-96e3-58aaca932f61 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:27.190984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58459674-986d-4bc5-96e3-58aaca932f61 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:27.191496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58459674-986d-4bc5-96e3-58aaca932f61 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:27.191933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58459674-986d-4bc5-96e3-58aaca932f61 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:27.389624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-58459674-986d-4bc5-96e3-58aaca932f61 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:27.405422 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-58459674-986d-4bc5-96e3-58aaca932f61 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1724 microversion: 2.1 time: 0.229865 Sep 08 13:54:27.406409 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3265/6661] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:27 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:28.433605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fd0d34c1-d22a-4ed2-831e-0c4e25d97891 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:28.434441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fd0d34c1-d22a-4ed2-831e-0c4e25d97891 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:28.437965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=33 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:28.444533 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd0d34c1-d22a-4ed2-831e-0c4e25d97891 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:28.445100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd0d34c1-d22a-4ed2-831e-0c4e25d97891 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:28.445524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd0d34c1-d22a-4ed2-831e-0c4e25d97891 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:28.446277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd0d34c1-d22a-4ed2-831e-0c4e25d97891 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:28.446753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd0d34c1-d22a-4ed2-831e-0c4e25d97891 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:28.447175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd0d34c1-d22a-4ed2-831e-0c4e25d97891 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:28.450281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:28.643356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fd0d34c1-d22a-4ed2-831e-0c4e25d97891 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:28.654129 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fd0d34c1-d22a-4ed2-831e-0c4e25d97891 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1724 microversion: 2.1 time: 0.225302 Sep 08 13:54:28.654877 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3397/6662] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:28 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:29.680233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d0d68987-d756-4fcf-9bb8-dbc1757c6e4e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:29.681161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d0d68987-d756-4fcf-9bb8-dbc1757c6e4e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:29.686168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=27 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:29.691884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0d68987-d756-4fcf-9bb8-dbc1757c6e4e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:29.692425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0d68987-d756-4fcf-9bb8-dbc1757c6e4e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:29.692832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0d68987-d756-4fcf-9bb8-dbc1757c6e4e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:29.693547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0d68987-d756-4fcf-9bb8-dbc1757c6e4e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:29.694012 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0d68987-d756-4fcf-9bb8-dbc1757c6e4e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:29.694440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d0d68987-d756-4fcf-9bb8-dbc1757c6e4e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:29.698373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=77 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:29.870026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d0d68987-d756-4fcf-9bb8-dbc1757c6e4e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:29.886902 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d0d68987-d756-4fcf-9bb8-dbc1757c6e4e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1724 microversion: 2.1 time: 0.211095 Sep 08 13:54:29.888035 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3266/6663] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:29 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:30.916819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3f4c3f7b-9eab-498b-88a4-1359094dd122 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:30.917885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3f4c3f7b-9eab-498b-88a4-1359094dd122 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:30.927080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f4c3f7b-9eab-498b-88a4-1359094dd122 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:30.928013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f4c3f7b-9eab-498b-88a4-1359094dd122 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:30.928696 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f4c3f7b-9eab-498b-88a4-1359094dd122 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:30.929555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f4c3f7b-9eab-498b-88a4-1359094dd122 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:30.930032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f4c3f7b-9eab-498b-88a4-1359094dd122 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:30.930624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3f4c3f7b-9eab-498b-88a4-1359094dd122 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.127931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3f4c3f7b-9eab-498b-88a4-1359094dd122 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:31.139556 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3f4c3f7b-9eab-498b-88a4-1359094dd122 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1721 microversion: 2.1 time: 0.229237 Sep 08 13:54:31.140175 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3398/6664] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:30 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1721 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:31.164436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:31.165109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:31.172625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.173117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.173554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.174317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.174913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.175372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.218621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.219104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.219574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.220302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.220754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.221180 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.249041 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'cores', 'ram'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:54:31.261442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Getting quotas for user 660a56a892a645f3949629bc47b7ce94 and project 3f58eb220bff4de78f77ff67eeb4b95c. Resources: {'cores', 'ram'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:54:31.403779 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4f10a8c1-36c2-4fc3-ac98-75b5727db429 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "POST /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633/action" status: 202 len: 0 microversion: 2.1 time: 0.242896 Sep 08 13:54:31.404957 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3267/6665] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:54:31 2022] POST /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:54:31.418673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-10bafd0d-c9f6-445b-a211-37cbce4dab53 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:31.419748 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-10bafd0d-c9f6-445b-a211-37cbce4dab53 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:31.430447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10bafd0d-c9f6-445b-a211-37cbce4dab53 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.431001 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10bafd0d-c9f6-445b-a211-37cbce4dab53 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.432067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10bafd0d-c9f6-445b-a211-37cbce4dab53 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.432926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10bafd0d-c9f6-445b-a211-37cbce4dab53 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:31.433327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10bafd0d-c9f6-445b-a211-37cbce4dab53 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:31.433773 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-10bafd0d-c9f6-445b-a211-37cbce4dab53 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:31.705365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-10bafd0d-c9f6-445b-a211-37cbce4dab53 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:31.716274 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-10bafd0d-c9f6-445b-a211-37cbce4dab53 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.303996 Sep 08 13:54:31.716904 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3399/6666] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:31 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:32.746945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2d125963-5cf7-47c6-b0c8-97d818aee91b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:32.748335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2d125963-5cf7-47c6-b0c8-97d818aee91b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:32.764002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d125963-5cf7-47c6-b0c8-97d818aee91b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:32.765008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d125963-5cf7-47c6-b0c8-97d818aee91b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:32.765980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d125963-5cf7-47c6-b0c8-97d818aee91b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:32.767350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d125963-5cf7-47c6-b0c8-97d818aee91b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:32.768375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d125963-5cf7-47c6-b0c8-97d818aee91b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:32.768635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d125963-5cf7-47c6-b0c8-97d818aee91b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:32.990853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2d125963-5cf7-47c6-b0c8-97d818aee91b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:33.006366 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2d125963-5cf7-47c6-b0c8-97d818aee91b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.266697 Sep 08 13:54:33.007424 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3268/6667] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:32 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:34.036387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9a223fc1-fcea-40f1-a103-dbdd4ff0005b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:34.039139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9a223fc1-fcea-40f1-a103-dbdd4ff0005b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:34.048491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a223fc1-fcea-40f1-a103-dbdd4ff0005b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.049244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a223fc1-fcea-40f1-a103-dbdd4ff0005b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.049807 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a223fc1-fcea-40f1-a103-dbdd4ff0005b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.050897 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a223fc1-fcea-40f1-a103-dbdd4ff0005b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.051714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a223fc1-fcea-40f1-a103-dbdd4ff0005b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.052388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a223fc1-fcea-40f1-a103-dbdd4ff0005b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.287734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9a223fc1-fcea-40f1-a103-dbdd4ff0005b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:34.303065 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9a223fc1-fcea-40f1-a103-dbdd4ff0005b tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.271569 Sep 08 13:54:34.304146 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3400/6668] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:34 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:54:34.911957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-69cb461a-d99a-4d06-a3ae-70d18d060f0b req-806544a6-9df7-49dc-ad0d-ac4bb40729c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10572fbb-bca8-4993-af60-0eebe01e9633", "name": "network-vif-plugged", "status": "completed", "tag": "31e7e5c9-0f71-486b-bf77-b2d75e18669d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:34.932970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-69cb461a-d99a-4d06-a3ae-70d18d060f0b req-806544a6-9df7-49dc-ad0d-ac4bb40729c1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:34.933937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-69cb461a-d99a-4d06-a3ae-70d18d060f0b req-806544a6-9df7-49dc-ad0d-ac4bb40729c1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:34.934566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-69cb461a-d99a-4d06-a3ae-70d18d060f0b req-806544a6-9df7-49dc-ad0d-ac4bb40729c1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:34.951442 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-69cb461a-d99a-4d06-a3ae-70d18d060f0b req-806544a6-9df7-49dc-ad0d-ac4bb40729c1 service nova] Creating event network-vif-plugged:31e7e5c9-0f71-486b-bf77-b2d75e18669d for instance 10572fbb-bca8-4993-af60-0eebe01e9633 on n-h2-852084-10 Sep 08 13:54:34.959529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-69cb461a-d99a-4d06-a3ae-70d18d060f0b req-806544a6-9df7-49dc-ad0d-ac4bb40729c1 service nova] Instance 10572fbb-bca8-4993-af60-0eebe01e9633 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:54:34.983188 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-69cb461a-d99a-4d06-a3ae-70d18d060f0b req-806544a6-9df7-49dc-ad0d-ac4bb40729c1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075793 Sep 08 13:54:34.985349 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3269/6669] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:35.335207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e97ae37c-56d6-41e9-9eeb-0d5255e50ef3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:35.336485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e97ae37c-56d6-41e9-9eeb-0d5255e50ef3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:35.353986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e97ae37c-56d6-41e9-9eeb-0d5255e50ef3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:35.354926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e97ae37c-56d6-41e9-9eeb-0d5255e50ef3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:35.355825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e97ae37c-56d6-41e9-9eeb-0d5255e50ef3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:35.357276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e97ae37c-56d6-41e9-9eeb-0d5255e50ef3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:35.358188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e97ae37c-56d6-41e9-9eeb-0d5255e50ef3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:35.359098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e97ae37c-56d6-41e9-9eeb-0d5255e50ef3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:35.582867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e97ae37c-56d6-41e9-9eeb-0d5255e50ef3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:35.594897 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e97ae37c-56d6-41e9-9eeb-0d5255e50ef3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.267337 Sep 08 13:54:35.595711 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3401/6670] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:35 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:36.627285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b773faac-c1e0-41b7-908a-cbc8f1699440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:36.628539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b773faac-c1e0-41b7-908a-cbc8f1699440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:36.641794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b773faac-c1e0-41b7-908a-cbc8f1699440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:36.642653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b773faac-c1e0-41b7-908a-cbc8f1699440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:36.643446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b773faac-c1e0-41b7-908a-cbc8f1699440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:36.644677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b773faac-c1e0-41b7-908a-cbc8f1699440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:36.645507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b773faac-c1e0-41b7-908a-cbc8f1699440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:36.646274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b773faac-c1e0-41b7-908a-cbc8f1699440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:36.877192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b773faac-c1e0-41b7-908a-cbc8f1699440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:36.888720 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b773faac-c1e0-41b7-908a-cbc8f1699440 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.270068 Sep 08 13:54:36.889322 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3270/6671] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:36 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:37.927605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0139f925-a65a-41e9-abbb-5860f1fbb568 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:37.928467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0139f925-a65a-41e9-abbb-5860f1fbb568 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:37.939215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0139f925-a65a-41e9-abbb-5860f1fbb568 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:37.939976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0139f925-a65a-41e9-abbb-5860f1fbb568 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:37.940631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0139f925-a65a-41e9-abbb-5860f1fbb568 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:37.941602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0139f925-a65a-41e9-abbb-5860f1fbb568 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:37.942445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0139f925-a65a-41e9-abbb-5860f1fbb568 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:37.943136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0139f925-a65a-41e9-abbb-5860f1fbb568 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:38.178881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0139f925-a65a-41e9-abbb-5860f1fbb568 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:38.190733 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0139f925-a65a-41e9-abbb-5860f1fbb568 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.269379 Sep 08 13:54:38.192997 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3402/6672] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:37 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:38.398778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-c72e199c-9fe0-40c7-b116-540320912eec req-5923a62b-27a8-4149-b2b4-f075249a666a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10572fbb-bca8-4993-af60-0eebe01e9633", "name": "network-vif-unplugged", "status": "completed", "tag": "31e7e5c9-0f71-486b-bf77-b2d75e18669d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:38.418059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c72e199c-9fe0-40c7-b116-540320912eec req-5923a62b-27a8-4149-b2b4-f075249a666a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:38.418935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c72e199c-9fe0-40c7-b116-540320912eec req-5923a62b-27a8-4149-b2b4-f075249a666a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:38.419856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-c72e199c-9fe0-40c7-b116-540320912eec req-5923a62b-27a8-4149-b2b4-f075249a666a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:38.447051 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-c72e199c-9fe0-40c7-b116-540320912eec req-5923a62b-27a8-4149-b2b4-f075249a666a service nova] Creating event network-vif-unplugged:31e7e5c9-0f71-486b-bf77-b2d75e18669d for instance 10572fbb-bca8-4993-af60-0eebe01e9633 on n-h1-852084-10 Sep 08 13:54:38.457793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-c72e199c-9fe0-40c7-b116-540320912eec req-5923a62b-27a8-4149-b2b4-f075249a666a service nova] Instance 10572fbb-bca8-4993-af60-0eebe01e9633 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:54:38.479507 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-c72e199c-9fe0-40c7-b116-540320912eec req-5923a62b-27a8-4149-b2b4-f075249a666a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087994 Sep 08 13:54:38.480484 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3271/6673] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:39.222345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6c98f172-8a90-4792-9636-001c29b977d5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:39.223197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6c98f172-8a90-4792-9636-001c29b977d5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:39.232731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c98f172-8a90-4792-9636-001c29b977d5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:39.233589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c98f172-8a90-4792-9636-001c29b977d5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:39.234353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c98f172-8a90-4792-9636-001c29b977d5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:39.235614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c98f172-8a90-4792-9636-001c29b977d5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:39.236422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c98f172-8a90-4792-9636-001c29b977d5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:39.237777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6c98f172-8a90-4792-9636-001c29b977d5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:39.453623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6c98f172-8a90-4792-9636-001c29b977d5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:39.469090 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6c98f172-8a90-4792-9636-001c29b977d5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.252634 Sep 08 13:54:39.470208 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3403/6674] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:39 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:40.512306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-88dd4584-4ade-4baf-909e-e70f7e45b6d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:40.513583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-88dd4584-4ade-4baf-909e-e70f7e45b6d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:40.520086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f9ce8351-5d63-406d-a2a6-a633ceb39b9c req-37099549-81a4-4b66-bcbc-d63c6d6ba3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10572fbb-bca8-4993-af60-0eebe01e9633", "tag": "31e7e5c9-0f71-486b-bf77-b2d75e18669d"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:40.527509 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88dd4584-4ade-4baf-909e-e70f7e45b6d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:40.528338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88dd4584-4ade-4baf-909e-e70f7e45b6d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:40.529176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88dd4584-4ade-4baf-909e-e70f7e45b6d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:40.530757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88dd4584-4ade-4baf-909e-e70f7e45b6d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:40.531627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88dd4584-4ade-4baf-909e-e70f7e45b6d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:40.532414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88dd4584-4ade-4baf-909e-e70f7e45b6d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:40.539681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f9ce8351-5d63-406d-a2a6-a633ceb39b9c req-37099549-81a4-4b66-bcbc-d63c6d6ba3c5 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:40.540933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f9ce8351-5d63-406d-a2a6-a633ceb39b9c req-37099549-81a4-4b66-bcbc-d63c6d6ba3c5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:40.541709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f9ce8351-5d63-406d-a2a6-a633ceb39b9c req-37099549-81a4-4b66-bcbc-d63c6d6ba3c5 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:40.565972 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f9ce8351-5d63-406d-a2a6-a633ceb39b9c req-37099549-81a4-4b66-bcbc-d63c6d6ba3c5 service nova] Creating event network-changed:31e7e5c9-0f71-486b-bf77-b2d75e18669d for instance 10572fbb-bca8-4993-af60-0eebe01e9633 on n-h1-852084-10 Sep 08 13:54:40.579635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-f9ce8351-5d63-406d-a2a6-a633ceb39b9c req-37099549-81a4-4b66-bcbc-d63c6d6ba3c5 service nova] Instance 10572fbb-bca8-4993-af60-0eebe01e9633 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 13:54:40.593271 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f9ce8351-5d63-406d-a2a6-a633ceb39b9c req-37099549-81a4-4b66-bcbc-d63c6d6ba3c5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080031 Sep 08 13:54:40.594330 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3404/6675] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:54:40.906380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-88dd4584-4ade-4baf-909e-e70f7e45b6d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:40.934712 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-88dd4584-4ade-4baf-909e-e70f7e45b6d7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.429604 Sep 08 13:54:40.939471 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3272/6676] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:40 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:41.964867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-804ce9f6-ba73-4fd9-8aa5-8c9dcb4c02db tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:41.965499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-804ce9f6-ba73-4fd9-8aa5-8c9dcb4c02db tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:41.974060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-804ce9f6-ba73-4fd9-8aa5-8c9dcb4c02db tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:41.974793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-804ce9f6-ba73-4fd9-8aa5-8c9dcb4c02db tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:41.975613 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-804ce9f6-ba73-4fd9-8aa5-8c9dcb4c02db tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:41.976625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-804ce9f6-ba73-4fd9-8aa5-8c9dcb4c02db tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:41.977558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-804ce9f6-ba73-4fd9-8aa5-8c9dcb4c02db tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:41.978010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-804ce9f6-ba73-4fd9-8aa5-8c9dcb4c02db tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:42.213525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-804ce9f6-ba73-4fd9-8aa5-8c9dcb4c02db tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:42.225401 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-804ce9f6-ba73-4fd9-8aa5-8c9dcb4c02db tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.265455 Sep 08 13:54:42.225895 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3405/6677] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:41 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:43.264796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7f575bca-69ad-48ce-9d0e-ada015f47e8c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:43.265608 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f575bca-69ad-48ce-9d0e-ada015f47e8c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:43.268032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:43.279131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f575bca-69ad-48ce-9d0e-ada015f47e8c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:43.280188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f575bca-69ad-48ce-9d0e-ada015f47e8c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:43.281076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f575bca-69ad-48ce-9d0e-ada015f47e8c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:43.282419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f575bca-69ad-48ce-9d0e-ada015f47e8c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:43.283370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f575bca-69ad-48ce-9d0e-ada015f47e8c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:43.284255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f575bca-69ad-48ce-9d0e-ada015f47e8c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:43.521973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7f575bca-69ad-48ce-9d0e-ada015f47e8c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:43.536707 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7f575bca-69ad-48ce-9d0e-ada015f47e8c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.276660 Sep 08 13:54:43.544814 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3273/6678] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:43 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:44.574361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2a6e71a4-7952-47c8-b138-b45d2a4c550c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:44.575687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2a6e71a4-7952-47c8-b138-b45d2a4c550c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:44.588225 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a6e71a4-7952-47c8-b138-b45d2a4c550c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:44.589123 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a6e71a4-7952-47c8-b138-b45d2a4c550c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:44.589933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a6e71a4-7952-47c8-b138-b45d2a4c550c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:44.591164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a6e71a4-7952-47c8-b138-b45d2a4c550c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:44.592052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a6e71a4-7952-47c8-b138-b45d2a4c550c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:44.592847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2a6e71a4-7952-47c8-b138-b45d2a4c550c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:44.808608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2a6e71a4-7952-47c8-b138-b45d2a4c550c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:44.822945 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2a6e71a4-7952-47c8-b138-b45d2a4c550c tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.255003 Sep 08 13:54:44.824051 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3406/6679] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:44 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:45.872930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b84bbecb-acad-4268-a2a9-1cbb1c2be295 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:45.874209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b84bbecb-acad-4268-a2a9-1cbb1c2be295 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:45.888021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b84bbecb-acad-4268-a2a9-1cbb1c2be295 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:45.888873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b84bbecb-acad-4268-a2a9-1cbb1c2be295 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:45.889616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b84bbecb-acad-4268-a2a9-1cbb1c2be295 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:45.890714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b84bbecb-acad-4268-a2a9-1cbb1c2be295 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:45.891540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b84bbecb-acad-4268-a2a9-1cbb1c2be295 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:45.892302 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b84bbecb-acad-4268-a2a9-1cbb1c2be295 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:46.124216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b84bbecb-acad-4268-a2a9-1cbb1c2be295 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:46.136579 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b84bbecb-acad-4268-a2a9-1cbb1c2be295 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.273361 Sep 08 13:54:46.137489 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3274/6680] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:45 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:47.167180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-06ae9bb6-8b4b-42b9-a84a-106b10c180a5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:47.168204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-06ae9bb6-8b4b-42b9-a84a-106b10c180a5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:47.176939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06ae9bb6-8b4b-42b9-a84a-106b10c180a5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:47.177458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06ae9bb6-8b4b-42b9-a84a-106b10c180a5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:47.177921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06ae9bb6-8b4b-42b9-a84a-106b10c180a5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:47.178647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06ae9bb6-8b4b-42b9-a84a-106b10c180a5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:47.179146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06ae9bb6-8b4b-42b9-a84a-106b10c180a5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:47.180253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-06ae9bb6-8b4b-42b9-a84a-106b10c180a5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:47.351726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-06ae9bb6-8b4b-42b9-a84a-106b10c180a5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:47.365355 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-06ae9bb6-8b4b-42b9-a84a-106b10c180a5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.205507 Sep 08 13:54:47.366378 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3407/6681] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:47 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:48.397490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b702437-0fb3-48b8-bfcf-c1fba675d78d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:48.398360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1b702437-0fb3-48b8-bfcf-c1fba675d78d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:48.407297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b702437-0fb3-48b8-bfcf-c1fba675d78d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:48.407902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b702437-0fb3-48b8-bfcf-c1fba675d78d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:48.408342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b702437-0fb3-48b8-bfcf-c1fba675d78d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:48.409051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b702437-0fb3-48b8-bfcf-c1fba675d78d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:48.409499 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b702437-0fb3-48b8-bfcf-c1fba675d78d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:48.410014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b702437-0fb3-48b8-bfcf-c1fba675d78d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:48.618706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1b702437-0fb3-48b8-bfcf-c1fba675d78d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:48.634929 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1b702437-0fb3-48b8-bfcf-c1fba675d78d tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.241789 Sep 08 13:54:48.635913 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3275/6682] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:48 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:49.673173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-75289660-6af4-4467-9f8c-147375488324 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:49.673877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-75289660-6af4-4467-9f8c-147375488324 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:49.682983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75289660-6af4-4467-9f8c-147375488324 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:49.684021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75289660-6af4-4467-9f8c-147375488324 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:49.684591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75289660-6af4-4467-9f8c-147375488324 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:49.685443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75289660-6af4-4467-9f8c-147375488324 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:49.686019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75289660-6af4-4467-9f8c-147375488324 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:49.686568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-75289660-6af4-4467-9f8c-147375488324 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:49.877554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-75289660-6af4-4467-9f8c-147375488324 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:49.889213 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-75289660-6af4-4467-9f8c-147375488324 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.220325 Sep 08 13:54:49.889838 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3408/6683] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:49 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:50.916346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-329808a6-0ba2-4d1e-8bea-d228cbba6226 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:50.917237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-329808a6-0ba2-4d1e-8bea-d228cbba6226 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:50.924768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-329808a6-0ba2-4d1e-8bea-d228cbba6226 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:50.925312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-329808a6-0ba2-4d1e-8bea-d228cbba6226 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:50.925738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-329808a6-0ba2-4d1e-8bea-d228cbba6226 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:50.926453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-329808a6-0ba2-4d1e-8bea-d228cbba6226 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:50.926913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-329808a6-0ba2-4d1e-8bea-d228cbba6226 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:50.927365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-329808a6-0ba2-4d1e-8bea-d228cbba6226 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:51.120434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-329808a6-0ba2-4d1e-8bea-d228cbba6226 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:51.136694 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-329808a6-0ba2-4d1e-8bea-d228cbba6226 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.224047 Sep 08 13:54:51.137661 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3276/6684] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:50 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:52.170627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-934907aa-b29c-4339-a981-2d0de054a7e0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:52.171794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-934907aa-b29c-4339-a981-2d0de054a7e0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:52.184635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-934907aa-b29c-4339-a981-2d0de054a7e0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:52.185435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-934907aa-b29c-4339-a981-2d0de054a7e0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:52.186221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-934907aa-b29c-4339-a981-2d0de054a7e0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:52.188076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-934907aa-b29c-4339-a981-2d0de054a7e0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:52.189043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-934907aa-b29c-4339-a981-2d0de054a7e0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:52.189845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-934907aa-b29c-4339-a981-2d0de054a7e0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:52.434903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-934907aa-b29c-4339-a981-2d0de054a7e0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:52.448763 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-934907aa-b29c-4339-a981-2d0de054a7e0 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1720 microversion: 2.1 time: 0.285846 Sep 08 13:54:52.449631 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3409/6685] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:52 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1720 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:53.479440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-33523878-2f38-4704-9c6a-007f5faf47a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:53.481429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33523878-2f38-4704-9c6a-007f5faf47a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:53.495111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33523878-2f38-4704-9c6a-007f5faf47a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:53.495996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33523878-2f38-4704-9c6a-007f5faf47a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:53.496560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33523878-2f38-4704-9c6a-007f5faf47a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:53.497935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33523878-2f38-4704-9c6a-007f5faf47a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:53.498612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33523878-2f38-4704-9c6a-007f5faf47a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:53.499192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33523878-2f38-4704-9c6a-007f5faf47a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:53.741912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-33523878-2f38-4704-9c6a-007f5faf47a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:53.758925 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-33523878-2f38-4704-9c6a-007f5faf47a7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1713 microversion: 2.1 time: 0.287447 Sep 08 13:54:53.760092 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3277/6686] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:53 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1713 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:53.792799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0182203b-86fe-44fe-93d3-24b7b0a87d77 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:53.793911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0182203b-86fe-44fe-93d3-24b7b0a87d77 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:53.806603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0182203b-86fe-44fe-93d3-24b7b0a87d77 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:53.807493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0182203b-86fe-44fe-93d3-24b7b0a87d77 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:53.808264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0182203b-86fe-44fe-93d3-24b7b0a87d77 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:53.809754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0182203b-86fe-44fe-93d3-24b7b0a87d77 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:53.810567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0182203b-86fe-44fe-93d3-24b7b0a87d77 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:53.811336 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0182203b-86fe-44fe-93d3-24b7b0a87d77 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:54.014645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0182203b-86fe-44fe-93d3-24b7b0a87d77 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:54.029012 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0182203b-86fe-44fe-93d3-24b7b0a87d77 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1713 microversion: 2.1 time: 0.243921 Sep 08 13:54:54.029716 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3410/6687] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:53 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1713 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:54.057553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-94a974a3-b1e3-4d85-addb-ac6db9924258 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:54.058963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-94a974a3-b1e3-4d85-addb-ac6db9924258 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:54.070051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94a974a3-b1e3-4d85-addb-ac6db9924258 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:54.070953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94a974a3-b1e3-4d85-addb-ac6db9924258 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:54.071785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94a974a3-b1e3-4d85-addb-ac6db9924258 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:54.073093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94a974a3-b1e3-4d85-addb-ac6db9924258 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:54.073939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94a974a3-b1e3-4d85-addb-ac6db9924258 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:54.074725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94a974a3-b1e3-4d85-addb-ac6db9924258 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:54.274075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-94a974a3-b1e3-4d85-addb-ac6db9924258 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:54.289817 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-94a974a3-b1e3-4d85-addb-ac6db9924258 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1713 microversion: 2.1 time: 0.240535 Sep 08 13:54:54.290487 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3278/6688] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:54 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1713 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:54.316056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-acf33d3d-dff3-40ad-9939-31a469066bcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:54.316592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-acf33d3d-dff3-40ad-9939-31a469066bcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:54.329131 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acf33d3d-dff3-40ad-9939-31a469066bcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:54.329846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acf33d3d-dff3-40ad-9939-31a469066bcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:54.330416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acf33d3d-dff3-40ad-9939-31a469066bcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:54.331473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acf33d3d-dff3-40ad-9939-31a469066bcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:54.332156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acf33d3d-dff3-40ad-9939-31a469066bcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:54.332919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acf33d3d-dff3-40ad-9939-31a469066bcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:54.367418 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-acf33d3d-dff3-40ad-9939-31a469066bcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:54:54.482852 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-acf33d3d-dff3-40ad-9939-31a469066bcc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "DELETE /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 204 len: 0 microversion: 2.1 time: 0.170588 Sep 08 13:54:54.483957 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3411/6689] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:54:54 2022] DELETE /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:54:54.495522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-eff24be4-f9cf-4aab-a9bb-4120241250a3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:54.496308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-eff24be4-f9cf-4aab-a9bb-4120241250a3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:54.506265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eff24be4-f9cf-4aab-a9bb-4120241250a3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:54.508137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eff24be4-f9cf-4aab-a9bb-4120241250a3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:54.508831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eff24be4-f9cf-4aab-a9bb-4120241250a3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:54.510060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eff24be4-f9cf-4aab-a9bb-4120241250a3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:54.511058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eff24be4-f9cf-4aab-a9bb-4120241250a3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:54.511825 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-eff24be4-f9cf-4aab-a9bb-4120241250a3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:54.728738 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-eff24be4-f9cf-4aab-a9bb-4120241250a3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:54.739560 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-eff24be4-f9cf-4aab-a9bb-4120241250a3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1719 microversion: 2.1 time: 0.248939 Sep 08 13:54:54.740289 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3279/6690] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:54 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1719 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:55.771815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f55e0ae6-894e-4187-9371-438a8472513a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:55.773055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f55e0ae6-894e-4187-9371-438a8472513a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:55.781303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f55e0ae6-894e-4187-9371-438a8472513a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:55.782084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f55e0ae6-894e-4187-9371-438a8472513a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:55.782647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f55e0ae6-894e-4187-9371-438a8472513a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:55.783561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f55e0ae6-894e-4187-9371-438a8472513a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:55.784166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f55e0ae6-894e-4187-9371-438a8472513a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:55.784713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f55e0ae6-894e-4187-9371-438a8472513a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:55.806682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:56.009278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f55e0ae6-894e-4187-9371-438a8472513a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:56.020849 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f55e0ae6-894e-4187-9371-438a8472513a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1719 microversion: 2.1 time: 0.256386 Sep 08 13:54:56.021587 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3412/6691] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:55 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1719 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:56.789829 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-59f528fe-44c5-41e8-916d-020df1714a2e req-ae58c218-8fdc-4e65-8b87-f05ce36da8e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10572fbb-bca8-4993-af60-0eebe01e9633", "name": "network-vif-plugged", "status": "completed", "tag": "31e7e5c9-0f71-486b-bf77-b2d75e18669d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:56.813332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-59f528fe-44c5-41e8-916d-020df1714a2e req-ae58c218-8fdc-4e65-8b87-f05ce36da8e3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:56.814103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-59f528fe-44c5-41e8-916d-020df1714a2e req-ae58c218-8fdc-4e65-8b87-f05ce36da8e3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:56.814789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-59f528fe-44c5-41e8-916d-020df1714a2e req-ae58c218-8fdc-4e65-8b87-f05ce36da8e3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:56.835684 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-59f528fe-44c5-41e8-916d-020df1714a2e req-ae58c218-8fdc-4e65-8b87-f05ce36da8e3 service nova] Creating event network-vif-plugged:31e7e5c9-0f71-486b-bf77-b2d75e18669d for instance 10572fbb-bca8-4993-af60-0eebe01e9633 on n-h1-852084-10 Sep 08 13:54:56.841555 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-59f528fe-44c5-41e8-916d-020df1714a2e req-ae58c218-8fdc-4e65-8b87-f05ce36da8e3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064912 Sep 08 13:54:56.842612 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3280/6692] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:57.047473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cb21b2f2-458a-4c4c-b396-496663de88f3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:57.048620 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cb21b2f2-458a-4c4c-b396-496663de88f3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:57.059925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb21b2f2-458a-4c4c-b396-496663de88f3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:57.060502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb21b2f2-458a-4c4c-b396-496663de88f3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:57.060977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb21b2f2-458a-4c4c-b396-496663de88f3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:57.061711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb21b2f2-458a-4c4c-b396-496663de88f3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:57.062550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb21b2f2-458a-4c4c-b396-496663de88f3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:57.063154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cb21b2f2-458a-4c4c-b396-496663de88f3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:57.177359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cb21b2f2-458a-4c4c-b396-496663de88f3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:57.193541 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cb21b2f2-458a-4c4c-b396-496663de88f3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1651 microversion: 2.1 time: 0.150672 Sep 08 13:54:57.194706 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3413/6693] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:57 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1651 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:57.505018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-54a182b4-c41b-4f57-acbe-d26408dac48a req-95d81dc2-b84d-4c4a-8723-30fa89ccf5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10572fbb-bca8-4993-af60-0eebe01e9633", "name": "network-vif-deleted", "tag": "31e7e5c9-0f71-486b-bf77-b2d75e18669d"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:54:57.523387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-54a182b4-c41b-4f57-acbe-d26408dac48a req-95d81dc2-b84d-4c4a-8723-30fa89ccf5d2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:57.526026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-54a182b4-c41b-4f57-acbe-d26408dac48a req-95d81dc2-b84d-4c4a-8723-30fa89ccf5d2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:57.529932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-54a182b4-c41b-4f57-acbe-d26408dac48a req-95d81dc2-b84d-4c4a-8723-30fa89ccf5d2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:57.535435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:54:57.553328 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-54a182b4-c41b-4f57-acbe-d26408dac48a req-95d81dc2-b84d-4c4a-8723-30fa89ccf5d2 service nova] Creating event network-vif-deleted:31e7e5c9-0f71-486b-bf77-b2d75e18669d for instance 10572fbb-bca8-4993-af60-0eebe01e9633 on n-h1-852084-10 Sep 08 13:54:57.560216 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-54a182b4-c41b-4f57-acbe-d26408dac48a req-95d81dc2-b84d-4c4a-8723-30fa89ccf5d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064669 Sep 08 13:54:57.562589 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3281/6694] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:54:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:54:58.233761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-86985c17-ec93-4b49-917b-56642965cafc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:58.235257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-86985c17-ec93-4b49-917b-56642965cafc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:58.245977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86985c17-ec93-4b49-917b-56642965cafc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:58.247022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86985c17-ec93-4b49-917b-56642965cafc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:58.247936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86985c17-ec93-4b49-917b-56642965cafc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:58.249342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86985c17-ec93-4b49-917b-56642965cafc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:58.250332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86985c17-ec93-4b49-917b-56642965cafc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:58.251181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86985c17-ec93-4b49-917b-56642965cafc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:58.369612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-86985c17-ec93-4b49-917b-56642965cafc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:58.382888 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-86985c17-ec93-4b49-917b-56642965cafc tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1368 microversion: 2.1 time: 0.158039 Sep 08 13:54:58.384289 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3414/6695] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:58 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:54:59.426294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d4fc401c-78bf-4cf5-a45c-ba7fc95998be tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:54:59.427258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d4fc401c-78bf-4cf5-a45c-ba7fc95998be tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:54:59.440687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4fc401c-78bf-4cf5-a45c-ba7fc95998be tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:59.441340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4fc401c-78bf-4cf5-a45c-ba7fc95998be tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:59.442265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4fc401c-78bf-4cf5-a45c-ba7fc95998be tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:59.443292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4fc401c-78bf-4cf5-a45c-ba7fc95998be tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:54:59.444155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4fc401c-78bf-4cf5-a45c-ba7fc95998be tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:54:59.444913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d4fc401c-78bf-4cf5-a45c-ba7fc95998be tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:54:59.552770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d4fc401c-78bf-4cf5-a45c-ba7fc95998be tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:54:59.574336 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d4fc401c-78bf-4cf5-a45c-ba7fc95998be tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1368 microversion: 2.1 time: 0.156669 Sep 08 13:54:59.575685 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3282/6696] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:54:59 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:00.617802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-de043f9d-30cc-4901-9be5-422b17f23e28 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:00.618924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-de043f9d-30cc-4901-9be5-422b17f23e28 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:00.624190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:00.633732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de043f9d-30cc-4901-9be5-422b17f23e28 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:00.634544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de043f9d-30cc-4901-9be5-422b17f23e28 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:00.635373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de043f9d-30cc-4901-9be5-422b17f23e28 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:00.636631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de043f9d-30cc-4901-9be5-422b17f23e28 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:00.637201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de043f9d-30cc-4901-9be5-422b17f23e28 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:00.637673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-de043f9d-30cc-4901-9be5-422b17f23e28 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:00.735465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-de043f9d-30cc-4901-9be5-422b17f23e28 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:00.753926 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-de043f9d-30cc-4901-9be5-422b17f23e28 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1368 microversion: 2.1 time: 0.143610 Sep 08 13:55:00.754986 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3415/6697] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:00 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1368 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:01.793864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-be3c7767-10b2-4ede-99a2-71e123e4d715 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:01.795024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-be3c7767-10b2-4ede-99a2-71e123e4d715 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:01.800325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:01.810468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be3c7767-10b2-4ede-99a2-71e123e4d715 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:01.810960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be3c7767-10b2-4ede-99a2-71e123e4d715 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:01.811622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be3c7767-10b2-4ede-99a2-71e123e4d715 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:01.812598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be3c7767-10b2-4ede-99a2-71e123e4d715 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:01.813202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be3c7767-10b2-4ede-99a2-71e123e4d715 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:01.813767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be3c7767-10b2-4ede-99a2-71e123e4d715 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:01.926610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-be3c7767-10b2-4ede-99a2-71e123e4d715 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:01.942118 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-be3c7767-10b2-4ede-99a2-71e123e4d715 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1368 microversion: 2.1 time: 0.156151 Sep 08 13:55:01.944776 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3283/6698] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:01 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:02.978275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ede44d59-c3c7-4708-8257-2aa13e76006e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:02.979284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ede44d59-c3c7-4708-8257-2aa13e76006e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:02.992750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ede44d59-c3c7-4708-8257-2aa13e76006e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:02.993288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ede44d59-c3c7-4708-8257-2aa13e76006e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:02.994000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ede44d59-c3c7-4708-8257-2aa13e76006e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:02.994930 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ede44d59-c3c7-4708-8257-2aa13e76006e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:02.995812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ede44d59-c3c7-4708-8257-2aa13e76006e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:02.996362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ede44d59-c3c7-4708-8257-2aa13e76006e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:03.114017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ede44d59-c3c7-4708-8257-2aa13e76006e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '660a56a892a645f3949629bc47b7ce94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f58eb220bff4de78f77ff67eeb4b95c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:03.133708 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ede44d59-c3c7-4708-8257-2aa13e76006e tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 200 len: 1368 microversion: 2.1 time: 0.162790 Sep 08 13:55:03.134247 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3416/6699] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:02 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:04.171611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-16744dae-39d6-4582-930c-3f2d1ae484cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:04.172359 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-16744dae-39d6-4582-930c-3f2d1ae484cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:04.182330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16744dae-39d6-4582-930c-3f2d1ae484cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:04.183476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16744dae-39d6-4582-930c-3f2d1ae484cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:04.184148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16744dae-39d6-4582-930c-3f2d1ae484cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:04.184925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16744dae-39d6-4582-930c-3f2d1ae484cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:04.185561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16744dae-39d6-4582-930c-3f2d1ae484cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:04.185954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-16744dae-39d6-4582-930c-3f2d1ae484cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:04.209418 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-16744dae-39d6-4582-930c-3f2d1ae484cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-16744dae-39d6-4582-930c-3f2d1ae484cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 HTTP/1.1 Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '10572fbb-bca8-4993-af60-0eebe01e9633'} Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:04.211642 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:04.220491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:04.220491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:04.220491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:04.220491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:55:04.220491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:55:04.220491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:04.220491 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:04.220491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-16744dae-39d6-4582-930c-3f2d1ae484cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:55:04.220491 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-16744dae-39d6-4582-930c-3f2d1ae484cb tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 404 len: 111 microversion: 2.1 time: 0.046606 Sep 08 13:55:04.220491 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3284/6700] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:04 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:55:04.296929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a8022f8c-dcb0-446d-a15c-803d082df7f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:04.299639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a8022f8c-dcb0-446d-a15c-803d082df7f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:04.306744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8022f8c-dcb0-446d-a15c-803d082df7f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:04.307303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8022f8c-dcb0-446d-a15c-803d082df7f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:04.308155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8022f8c-dcb0-446d-a15c-803d082df7f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:04.308845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8022f8c-dcb0-446d-a15c-803d082df7f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:04.309324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8022f8c-dcb0-446d-a15c-803d082df7f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:04.309783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a8022f8c-dcb0-446d-a15c-803d082df7f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:04.326260 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-a8022f8c-dcb0-446d-a15c-803d082df7f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a8022f8c-dcb0-446d-a15c-803d082df7f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633/os-volume_attachments HTTP/1.1 Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'server_id': '10572fbb-bca8-4993-af60-0eebe01e9633'} Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:55:04.328345 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a8022f8c-dcb0-446d-a15c-803d082df7f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a8022f8c-dcb0-446d-a15c-803d082df7f2 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038356 Sep 08 13:55:04.336525 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3417/6701] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:55:04 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:55:09.029128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-611d2eb0-1aae-4968-9083-3298e4c5793a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:09.029939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-611d2eb0-1aae-4968-9083-3298e4c5793a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:09.040845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-611d2eb0-1aae-4968-9083-3298e4c5793a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.040845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-611d2eb0-1aae-4968-9083-3298e4c5793a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.040845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-611d2eb0-1aae-4968-9083-3298e4c5793a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.041480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-611d2eb0-1aae-4968-9083-3298e4c5793a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.041646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-611d2eb0-1aae-4968-9083-3298e4c5793a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.042104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-611d2eb0-1aae-4968-9083-3298e4c5793a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.065872 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-611d2eb0-1aae-4968-9083-3298e4c5793a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-611d2eb0-1aae-4968-9083-3298e4c5793a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 HTTP/1.1 Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '10572fbb-bca8-4993-af60-0eebe01e9633'} Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:55:09.068220 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-611d2eb0-1aae-4968-9083-3298e4c5793a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-611d2eb0-1aae-4968-9083-3298e4c5793a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "DELETE /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 404 len: 111 microversion: 2.1 time: 0.047937 Sep 08 13:55:09.077831 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3285/6702] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:55:09 2022] DELETE /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:55:09.090772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d1475542-6fdb-42d0-9e60-841d8033a6e5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:09.091865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d1475542-6fdb-42d0-9e60-841d8033a6e5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 10572fbb-bca8-4993-af60-0eebe01e9633] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:09.104036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1475542-6fdb-42d0-9e60-841d8033a6e5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.104928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1475542-6fdb-42d0-9e60-841d8033a6e5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.105757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1475542-6fdb-42d0-9e60-841d8033a6e5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.106843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1475542-6fdb-42d0-9e60-841d8033a6e5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.107396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1475542-6fdb-42d0-9e60-841d8033a6e5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.108144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d1475542-6fdb-42d0-9e60-841d8033a6e5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.136008 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-d1475542-6fdb-42d0-9e60-841d8033a6e5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d1475542-6fdb-42d0-9e60-841d8033a6e5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 HTTP/1.1 Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '10572fbb-bca8-4993-af60-0eebe01e9633'} Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.139203 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.151824 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.151824 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.151824 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.151824 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:55:09.151824 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:55:09.151824 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. Sep 08 13:55:09.151824 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.151824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d1475542-6fdb-42d0-9e60-841d8033a6e5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance 10572fbb-bca8-4993-af60-0eebe01e9633 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:55:09.151824 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d1475542-6fdb-42d0-9e60-841d8033a6e5 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633" status: 404 len: 111 microversion: 2.1 time: 0.059450 Sep 08 13:55:09.151824 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3418/6703] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:09 2022] GET /compute/v2.1/servers/10572fbb-bca8-4993-af60-0eebe01e9633 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:55:09.158294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-233b420a-cf1c-4f38-b795-5bdd1f6d14c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:09.159216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-233b420a-cf1c-4f38-b795-5bdd1f6d14c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:09.170328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-233b420a-cf1c-4f38-b795-5bdd1f6d14c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.171160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-233b420a-cf1c-4f38-b795-5bdd1f6d14c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.171900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-233b420a-cf1c-4f38-b795-5bdd1f6d14c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.173134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-233b420a-cf1c-4f38-b795-5bdd1f6d14c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.173919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-233b420a-cf1c-4f38-b795-5bdd1f6d14c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.174779 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-233b420a-cf1c-4f38-b795-5bdd1f6d14c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.213718 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-233b420a-cf1c-4f38-b795-5bdd1f6d14c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-233b420a-cf1c-4f38-b795-5bdd1f6d14c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 HTTP/1.1 Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'd2429d89-36fb-4a98-81e9-6f04bf206199'} Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:55:09.214735 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-233b420a-cf1c-4f38-b795-5bdd1f6d14c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-233b420a-cf1c-4f38-b795-5bdd1f6d14c7 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 404 len: 111 microversion: 2.1 time: 0.066478 Sep 08 13:55:09.221162 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3286/6704] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:55:09 2022] DELETE /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:55:09.240651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33a0010a-ee61-4ac9-8e1b-802f60cc3aed tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:09.241581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-33a0010a-ee61-4ac9-8e1b-802f60cc3aed tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: d2429d89-36fb-4a98-81e9-6f04bf206199] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:09.251504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33a0010a-ee61-4ac9-8e1b-802f60cc3aed tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.252320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33a0010a-ee61-4ac9-8e1b-802f60cc3aed tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.252935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33a0010a-ee61-4ac9-8e1b-802f60cc3aed tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.254307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33a0010a-ee61-4ac9-8e1b-802f60cc3aed tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.254801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33a0010a-ee61-4ac9-8e1b-802f60cc3aed tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.255970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-33a0010a-ee61-4ac9-8e1b-802f60cc3aed tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.285560 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-33a0010a-ee61-4ac9-8e1b-802f60cc3aed tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33a0010a-ee61-4ac9-8e1b-802f60cc3aed tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 HTTP/1.1 Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'd2429d89-36fb-4a98-81e9-6f04bf206199'} Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.291850 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.297017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.297017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.297017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.297017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:55:09.297017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:55:09.297017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. Sep 08 13:55:09.297017 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.297017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-33a0010a-ee61-4ac9-8e1b-802f60cc3aed tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance d2429d89-36fb-4a98-81e9-6f04bf206199 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:55:09.297017 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-33a0010a-ee61-4ac9-8e1b-802f60cc3aed tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199" status: 404 len: 111 microversion: 2.1 time: 0.061777 Sep 08 13:55:09.297017 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3419/6705] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:09 2022] GET /compute/v2.1/servers/d2429d89-36fb-4a98-81e9-6f04bf206199 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:55:09.306346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1031276e-ba2d-4096-8534-764305ff127a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:09.307863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1031276e-ba2d-4096-8534-764305ff127a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:09.320239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1031276e-ba2d-4096-8534-764305ff127a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.321235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1031276e-ba2d-4096-8534-764305ff127a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.321982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1031276e-ba2d-4096-8534-764305ff127a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.322862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1031276e-ba2d-4096-8534-764305ff127a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.323367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1031276e-ba2d-4096-8534-764305ff127a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.323806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1031276e-ba2d-4096-8534-764305ff127a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.341091 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1031276e-ba2d-4096-8534-764305ff127a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1031276e-ba2d-4096-8534-764305ff127a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be HTTP/1.1 Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '1f4b07b4-5711-4b49-a9d9-f5c4923447be'} Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:55:09.343858 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1031276e-ba2d-4096-8534-764305ff127a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1031276e-ba2d-4096-8534-764305ff127a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "DELETE /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 404 len: 111 microversion: 2.1 time: 0.044393 Sep 08 13:55:09.352992 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3287/6706] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:55:09 2022] DELETE /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:55:09.359845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e7f5d80f-93f6-49be-80d5-85cbe436caa3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:09.361092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e7f5d80f-93f6-49be-80d5-85cbe436caa3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 1f4b07b4-5711-4b49-a9d9-f5c4923447be] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:09.368735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7f5d80f-93f6-49be-80d5-85cbe436caa3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.369390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7f5d80f-93f6-49be-80d5-85cbe436caa3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.369958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7f5d80f-93f6-49be-80d5-85cbe436caa3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.371023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7f5d80f-93f6-49be-80d5-85cbe436caa3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.371655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7f5d80f-93f6-49be-80d5-85cbe436caa3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.372222 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7f5d80f-93f6-49be-80d5-85cbe436caa3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.395198 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e7f5d80f-93f6-49be-80d5-85cbe436caa3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e7f5d80f-93f6-49be-80d5-85cbe436caa3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be HTTP/1.1 Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '1f4b07b4-5711-4b49-a9d9-f5c4923447be'} Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.397093 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.408005 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.408005 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.408005 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.408005 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:55:09.408005 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:55:09.408005 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. Sep 08 13:55:09.408005 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.408005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e7f5d80f-93f6-49be-80d5-85cbe436caa3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance 1f4b07b4-5711-4b49-a9d9-f5c4923447be could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:55:09.408005 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e7f5d80f-93f6-49be-80d5-85cbe436caa3 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be" status: 404 len: 111 microversion: 2.1 time: 0.044839 Sep 08 13:55:09.408005 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3420/6707] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:09 2022] GET /compute/v2.1/servers/1f4b07b4-5711-4b49-a9d9-f5c4923447be => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:55:09.415584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-45fe611c-1f2c-4437-b676-49b28fb7def9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:09.416474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-45fe611c-1f2c-4437-b676-49b28fb7def9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:09.427183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45fe611c-1f2c-4437-b676-49b28fb7def9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.428056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45fe611c-1f2c-4437-b676-49b28fb7def9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.428784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45fe611c-1f2c-4437-b676-49b28fb7def9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.429970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45fe611c-1f2c-4437-b676-49b28fb7def9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.430765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45fe611c-1f2c-4437-b676-49b28fb7def9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.431501 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45fe611c-1f2c-4437-b676-49b28fb7def9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.456855 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-45fe611c-1f2c-4437-b676-49b28fb7def9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-45fe611c-1f2c-4437-b676-49b28fb7def9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 HTTP/1.1 Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '802f7eab-898e-44d1-b478-582d5e149a51'} Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:55:09.460036 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-45fe611c-1f2c-4437-b676-49b28fb7def9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-45fe611c-1f2c-4437-b676-49b28fb7def9 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "DELETE /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 404 len: 111 microversion: 2.1 time: 0.054681 Sep 08 13:55:09.469354 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3288/6708] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:55:09 2022] DELETE /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:55:09.475949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2b026e83-8073-431c-8261-942f7beb839a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:09.477584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2b026e83-8073-431c-8261-942f7beb839a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [instance: 802f7eab-898e-44d1-b478-582d5e149a51] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:09.484434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b026e83-8073-431c-8261-942f7beb839a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.485110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b026e83-8073-431c-8261-942f7beb839a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.485797 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b026e83-8073-431c-8261-942f7beb839a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.486652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b026e83-8073-431c-8261-942f7beb839a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:09.487583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b026e83-8073-431c-8261-942f7beb839a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:09.488698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b026e83-8073-431c-8261-942f7beb839a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:09.516780 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-2b026e83-8073-431c-8261-942f7beb839a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] HTTP exception thrown: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2b026e83-8073-431c-8261-942f7beb839a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Request method failure captured: Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 HTTP/1.1 Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfLRshPrhLbDD1beFTaWBP8RJE75qztyRi_s_UX03jvVT748qNmRKb23IBOsAEYhfmP3iW_VkQh7o16I32Cz7nGQvmeBwA_xWtd2BcEv63pLyuc0wXlY-i2ozN5vq1HANfEbIwz52C3-Ea981xfcefuF_2iRddxWttb-5yU6M_HG9Qw Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/3f58eb220bff4de78f77ff67eeb4b95c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 3f58eb220bff4de78f77ff67eeb4b95c Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServerActionsTestJSON-1514411141 Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 660a56a892a645f3949629bc47b7ce94 Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServerActionsTestJSON-1514411141-project Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '802f7eab-898e-44d1-b478-582d5e149a51'} Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:55:09.518386 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.527354 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:55:09.527354 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:55:09.527354 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:55:09.527354 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:55:09.527354 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:55:09.527354 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. Sep 08 13:55:09.527354 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:55:09.527354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2b026e83-8073-431c-8261-942f7beb839a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Returning 404 to user: Instance 802f7eab-898e-44d1-b478-582d5e149a51 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:55:09.527354 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2b026e83-8073-431c-8261-942f7beb839a tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51" status: 404 len: 111 microversion: 2.1 time: 0.050260 Sep 08 13:55:09.527354 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3421/6709] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:09 2022] GET /compute/v2.1/servers/802f7eab-898e-44d1-b478-582d5e149a51 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:55:09.534721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dcc6ae6e-de34-43a4-93f1-c8d12ddb4393 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] Calling method '.version_select at 0x7fdb39c9faf0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:09.542633 n-d-852084-10 devstack@n-api.service[128971]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dcc6ae6e-de34-43a4-93f1-c8d12ddb4393 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [465e5682-9808-4c84-8359-29c44eefc59a] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 13:55:10.554365 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [None req-dcc6ae6e-de34-43a4-93f1-c8d12ddb4393 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] [465e5682-9808-4c84-8359-29c44eefc59a] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 49320. Sep 08 13:55:10.590914 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dcc6ae6e-de34-43a4-93f1-c8d12ddb4393 tempest-ServerActionsTestJSON-1514411141 tempest-ServerActionsTestJSON-1514411141-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-783440952" status: 202 len: 0 microversion: 2.1 time: 1.064077 Sep 08 13:55:10.592198 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3289/6710] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Sep 8 13:55:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-783440952 => generated 0 bytes in 1067 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:55:25.573747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=13 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:25.575375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=37 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:25.777216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1733319587", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "d6fee518-f80b-43f3-87db-dddfc6d1af5e"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:25.862461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] validate_networks() for [('d6fee518-f80b-43f3-87db-dddfc6d1af5e', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:55:26.513363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:55:26.513828 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:55:26.514315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:55:26.514735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:55:26.515156 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:55:26.527374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:26.527837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:26.528268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:26.529018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:26.529479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:26.529916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:26.550207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Getting quotas for project a51955830ea340128e0a449b9d4e9cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:55:26.556714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Getting quotas for user 9c58a4cd069544c982b61fd92326b9b2 and project a51955830ea340128e0a449b9d4e9cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:55:26.577602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:55:26.580679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:55:26.652838 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b684e6a5-2fd7-493a-9958-332b36827cda tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.081037 Sep 08 13:55:26.664011 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3422/6711] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:55:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:55:26.669701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=23 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:26.672207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:26.674058 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:55:26.674621 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 13:55:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 (ip 10.222.0.78) !!! Sep 08 13:55:26.694840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-773f1d10-929d-46cb-87d4-aea17ea15058 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:26.696289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-773f1d10-929d-46cb-87d4-aea17ea15058 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:26.792290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-773f1d10-929d-46cb-87d4-aea17ea15058 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:26.801592 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-773f1d10-929d-46cb-87d4-aea17ea15058 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1217 microversion: 2.1 time: 0.135139 Sep 08 13:55:26.802589 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3290/6712] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:26 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1217 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:27.846605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-102bfb8b-8424-426b-9a64-28d0a01a96dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:27.848668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-102bfb8b-8424-426b-9a64-28d0a01a96dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:27.946757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-102bfb8b-8424-426b-9a64-28d0a01a96dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:27.957839 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-102bfb8b-8424-426b-9a64-28d0a01a96dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1217 microversion: 2.1 time: 0.118294 Sep 08 13:55:27.958825 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3423/6713] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:27 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:29.007566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7cb75812-76f8-4c06-9ee5-395e5c3b5434 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:29.010335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7cb75812-76f8-4c06-9ee5-395e5c3b5434 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:29.159164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7cb75812-76f8-4c06-9ee5-395e5c3b5434 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:29.176821 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7cb75812-76f8-4c06-9ee5-395e5c3b5434 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1217 microversion: 2.1 time: 0.177488 Sep 08 13:55:29.178096 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3291/6714] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:28 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:30.214824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cadf81de-c41e-49c5-9dbd-e9fa4457ab07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:30.216072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cadf81de-c41e-49c5-9dbd-e9fa4457ab07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:30.292664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cadf81de-c41e-49c5-9dbd-e9fa4457ab07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:30.301595 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cadf81de-c41e-49c5-9dbd-e9fa4457ab07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1217 microversion: 2.1 time: 0.097073 Sep 08 13:55:30.302197 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3424/6715] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:30 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1217 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:31.334196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2b2fcbf-1dda-40ff-a6ee-f4f631553c1c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:31.335371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2b2fcbf-1dda-40ff-a6ee-f4f631553c1c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:31.346881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2b2fcbf-1dda-40ff-a6ee-f4f631553c1c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:31.347692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2b2fcbf-1dda-40ff-a6ee-f4f631553c1c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:31.348191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2b2fcbf-1dda-40ff-a6ee-f4f631553c1c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:31.349007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2b2fcbf-1dda-40ff-a6ee-f4f631553c1c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:31.349553 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2b2fcbf-1dda-40ff-a6ee-f4f631553c1c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:31.350011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2b2fcbf-1dda-40ff-a6ee-f4f631553c1c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:31.442830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f2b2fcbf-1dda-40ff-a6ee-f4f631553c1c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:31.458017 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2b2fcbf-1dda-40ff-a6ee-f4f631553c1c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1221 microversion: 2.1 time: 0.131047 Sep 08 13:55:31.459111 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3292/6716] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:31 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1221 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:32.496614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4ab12edd-2bff-4f44-a008-1b7826e55938 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:32.497578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4ab12edd-2bff-4f44-a008-1b7826e55938 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:32.506637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ab12edd-2bff-4f44-a008-1b7826e55938 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:32.507295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ab12edd-2bff-4f44-a008-1b7826e55938 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:32.507803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ab12edd-2bff-4f44-a008-1b7826e55938 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:32.508719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ab12edd-2bff-4f44-a008-1b7826e55938 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:32.509286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ab12edd-2bff-4f44-a008-1b7826e55938 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:32.509870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4ab12edd-2bff-4f44-a008-1b7826e55938 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:32.641850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4ab12edd-2bff-4f44-a008-1b7826e55938 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:32.653436 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4ab12edd-2bff-4f44-a008-1b7826e55938 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1269 microversion: 2.1 time: 0.161888 Sep 08 13:55:32.654382 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3425/6717] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:32 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:33.697322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e1568029-8160-4bfd-b867-4770b370f418 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:33.699813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e1568029-8160-4bfd-b867-4770b370f418 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:33.713291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1568029-8160-4bfd-b867-4770b370f418 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:33.714363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1568029-8160-4bfd-b867-4770b370f418 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:33.714966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1568029-8160-4bfd-b867-4770b370f418 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:33.716264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1568029-8160-4bfd-b867-4770b370f418 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:33.717222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1568029-8160-4bfd-b867-4770b370f418 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:33.718072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1568029-8160-4bfd-b867-4770b370f418 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:34.147046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e1568029-8160-4bfd-b867-4770b370f418 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:34.162191 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e1568029-8160-4bfd-b867-4770b370f418 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1317 microversion: 2.1 time: 0.472397 Sep 08 13:55:34.179272 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3293/6718] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:33 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1317 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:35.208230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c73120f3-8db4-48a4-893e-241eff5cd74e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:35.209684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c73120f3-8db4-48a4-893e-241eff5cd74e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:35.223280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c73120f3-8db4-48a4-893e-241eff5cd74e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:35.224227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c73120f3-8db4-48a4-893e-241eff5cd74e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:35.225095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c73120f3-8db4-48a4-893e-241eff5cd74e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:35.226439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c73120f3-8db4-48a4-893e-241eff5cd74e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:35.227612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c73120f3-8db4-48a4-893e-241eff5cd74e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:35.228392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c73120f3-8db4-48a4-893e-241eff5cd74e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:35.451004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-110ede4f-0a78-4d53-8afe-053e2d6e392a req-f3b90b16-7047-4392-8e87-ecbf24b97a52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79d825d1-c81f-42a1-90bf-20f8f3eae8b3", "tag": "e4ba609d-f205-47b7-848b-b8ba69609528"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:35.467618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-110ede4f-0a78-4d53-8afe-053e2d6e392a req-f3b90b16-7047-4392-8e87-ecbf24b97a52 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:35.468282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-110ede4f-0a78-4d53-8afe-053e2d6e392a req-f3b90b16-7047-4392-8e87-ecbf24b97a52 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:35.469010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-110ede4f-0a78-4d53-8afe-053e2d6e392a req-f3b90b16-7047-4392-8e87-ecbf24b97a52 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:35.491342 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-110ede4f-0a78-4d53-8afe-053e2d6e392a req-f3b90b16-7047-4392-8e87-ecbf24b97a52 service nova] Creating event network-changed:e4ba609d-f205-47b7-848b-b8ba69609528 for instance 79d825d1-c81f-42a1-90bf-20f8f3eae8b3 on n-h2-852084-10 Sep 08 13:55:35.501462 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-110ede4f-0a78-4d53-8afe-053e2d6e392a req-f3b90b16-7047-4392-8e87-ecbf24b97a52 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057284 Sep 08 13:55:35.504545 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3294/6719] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:55:35.649330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c73120f3-8db4-48a4-893e-241eff5cd74e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:35.664050 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c73120f3-8db4-48a4-893e-241eff5cd74e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1317 microversion: 2.1 time: 0.463520 Sep 08 13:55:35.679269 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3426/6720] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:35 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1317 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:36.711583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bf87c8b9-3ede-47e4-97af-15859fffa9dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:36.712456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bf87c8b9-3ede-47e4-97af-15859fffa9dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:36.725351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf87c8b9-3ede-47e4-97af-15859fffa9dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:36.726207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf87c8b9-3ede-47e4-97af-15859fffa9dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:36.727474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf87c8b9-3ede-47e4-97af-15859fffa9dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:36.728018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf87c8b9-3ede-47e4-97af-15859fffa9dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:36.728793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf87c8b9-3ede-47e4-97af-15859fffa9dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:36.729533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf87c8b9-3ede-47e4-97af-15859fffa9dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:36.954984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bf87c8b9-3ede-47e4-97af-15859fffa9dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:36.969887 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bf87c8b9-3ede-47e4-97af-15859fffa9dc tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1317 microversion: 2.1 time: 0.265127 Sep 08 13:55:36.970990 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3295/6721] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:36 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:38.007114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7f6b8435-3189-4ff6-be2a-dc1f48f1b15b tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:38.008150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7f6b8435-3189-4ff6-be2a-dc1f48f1b15b tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:38.012976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:38.022569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f6b8435-3189-4ff6-be2a-dc1f48f1b15b tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:38.023625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f6b8435-3189-4ff6-be2a-dc1f48f1b15b tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:38.024339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f6b8435-3189-4ff6-be2a-dc1f48f1b15b tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:38.025595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f6b8435-3189-4ff6-be2a-dc1f48f1b15b tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:38.026417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f6b8435-3189-4ff6-be2a-dc1f48f1b15b tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:38.027170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7f6b8435-3189-4ff6-be2a-dc1f48f1b15b tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:38.259874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7f6b8435-3189-4ff6-be2a-dc1f48f1b15b tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:38.275991 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7f6b8435-3189-4ff6-be2a-dc1f48f1b15b tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1317 microversion: 2.1 time: 0.274925 Sep 08 13:55:38.277044 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3427/6722] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:37 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:39.313617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9c4eafe6-89c9-4ae4-b56e-431c5797d850 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:39.315418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9c4eafe6-89c9-4ae4-b56e-431c5797d850 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:39.320547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:39.329669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c4eafe6-89c9-4ae4-b56e-431c5797d850 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:39.330981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c4eafe6-89c9-4ae4-b56e-431c5797d850 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:39.331530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c4eafe6-89c9-4ae4-b56e-431c5797d850 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:39.332833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c4eafe6-89c9-4ae4-b56e-431c5797d850 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:39.333661 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c4eafe6-89c9-4ae4-b56e-431c5797d850 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:39.334446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c4eafe6-89c9-4ae4-b56e-431c5797d850 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:39.587908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9c4eafe6-89c9-4ae4-b56e-431c5797d850 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:39.604939 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9c4eafe6-89c9-4ae4-b56e-431c5797d850 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1317 microversion: 2.1 time: 0.297667 Sep 08 13:55:39.606963 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3296/6723] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:39 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1317 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:40.659260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-653601ae-4639-48ad-8719-69b4a185b811 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:40.660353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-653601ae-4639-48ad-8719-69b4a185b811 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:40.665155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=10 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:40.672674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-653601ae-4639-48ad-8719-69b4a185b811 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:40.673302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-653601ae-4639-48ad-8719-69b4a185b811 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:40.673812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-653601ae-4639-48ad-8719-69b4a185b811 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:40.675435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-653601ae-4639-48ad-8719-69b4a185b811 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:40.676331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-653601ae-4639-48ad-8719-69b4a185b811 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:40.677138 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-653601ae-4639-48ad-8719-69b4a185b811 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:40.919518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-653601ae-4639-48ad-8719-69b4a185b811 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:40.933904 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-653601ae-4639-48ad-8719-69b4a185b811 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1317 microversion: 2.1 time: 0.280697 Sep 08 13:55:40.934817 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3428/6724] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:40 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:41.332026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-49496db1-d4ce-4e73-8cf8-dac07aafe51e req-90d624e3-edd0-4841-ba73-47076f95b6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d825d1-c81f-42a1-90bf-20f8f3eae8b3", "name": "network-vif-plugged", "status": "completed", "tag": "e4ba609d-f205-47b7-848b-b8ba69609528"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:41.352472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-49496db1-d4ce-4e73-8cf8-dac07aafe51e req-90d624e3-edd0-4841-ba73-47076f95b6da service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:41.354419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-49496db1-d4ce-4e73-8cf8-dac07aafe51e req-90d624e3-edd0-4841-ba73-47076f95b6da service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:41.354419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-49496db1-d4ce-4e73-8cf8-dac07aafe51e req-90d624e3-edd0-4841-ba73-47076f95b6da service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:41.376619 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-49496db1-d4ce-4e73-8cf8-dac07aafe51e req-90d624e3-edd0-4841-ba73-47076f95b6da service nova] Creating event network-vif-plugged:e4ba609d-f205-47b7-848b-b8ba69609528 for instance 79d825d1-c81f-42a1-90bf-20f8f3eae8b3 on n-h2-852084-10 Sep 08 13:55:41.384755 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-49496db1-d4ce-4e73-8cf8-dac07aafe51e req-90d624e3-edd0-4841-ba73-47076f95b6da service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059916 Sep 08 13:55:41.385771 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3297/6725] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:55:41.972503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e5d7850-ae85-4156-95f7-3c1a746d36a9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:41.973741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6e5d7850-ae85-4156-95f7-3c1a746d36a9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:41.983924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e5d7850-ae85-4156-95f7-3c1a746d36a9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:41.984839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e5d7850-ae85-4156-95f7-3c1a746d36a9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:41.985457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e5d7850-ae85-4156-95f7-3c1a746d36a9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:41.987149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e5d7850-ae85-4156-95f7-3c1a746d36a9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:41.987793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e5d7850-ae85-4156-95f7-3c1a746d36a9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:41.988376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e5d7850-ae85-4156-95f7-3c1a746d36a9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:42.207425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6e5d7850-ae85-4156-95f7-3c1a746d36a9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:42.219042 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6e5d7850-ae85-4156-95f7-3c1a746d36a9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1317 microversion: 2.1 time: 0.252748 Sep 08 13:55:42.219804 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3429/6726] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:41 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1317 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:43.253164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4d599d9f-8a3d-4f22-a457-708c9ed4f262 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:43.254513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4d599d9f-8a3d-4f22-a457-708c9ed4f262 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:43.266772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d599d9f-8a3d-4f22-a457-708c9ed4f262 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:43.267716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d599d9f-8a3d-4f22-a457-708c9ed4f262 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:43.268486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d599d9f-8a3d-4f22-a457-708c9ed4f262 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:43.269776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d599d9f-8a3d-4f22-a457-708c9ed4f262 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:43.270822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d599d9f-8a3d-4f22-a457-708c9ed4f262 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:43.271613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4d599d9f-8a3d-4f22-a457-708c9ed4f262 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:43.514045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4d599d9f-8a3d-4f22-a457-708c9ed4f262 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:43.529910 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4d599d9f-8a3d-4f22-a457-708c9ed4f262 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1507 microversion: 2.1 time: 0.285587 Sep 08 13:55:43.531048 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3298/6727] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:43 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1507 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:43.655626 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 13:55:43.656778 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 13:55:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.78) !!! Sep 08 13:55:43.677656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2086149971", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "d6fee518-f80b-43f3-87db-dddfc6d1af5e"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:43.770700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] validate_networks() for [('d6fee518-f80b-43f3-87db-dddfc6d1af5e', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:55:44.470335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:55:44.470927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:55:44.471859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:55:44.472631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:55:44.473432 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:55:44.489031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:44.489806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:44.490333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:44.491456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:44.492261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:44.492946 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:44.524983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Getting quotas for project a51955830ea340128e0a449b9d4e9cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:55:44.535443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Getting quotas for user 9c58a4cd069544c982b61fd92326b9b2 and project a51955830ea340128e0a449b9d4e9cc9. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:55:44.562301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:55:44.567373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:55:44.644177 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b37ad5d2-aa8e-4214-8bfd-d1d9915d727a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.991364 Sep 08 13:55:44.644804 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3430/6728] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:55:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:55:44.661845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b7d21d1b-a4b7-470a-ba46-d505a011dbe0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:44.663054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b7d21d1b-a4b7-470a-ba46-d505a011dbe0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:44.751096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b7d21d1b-a4b7-470a-ba46-d505a011dbe0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:44.767637 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b7d21d1b-a4b7-470a-ba46-d505a011dbe0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1217 microversion: 2.1 time: 0.112549 Sep 08 13:55:44.768635 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3299/6729] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:44 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1217 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:45.825953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-631ff9d3-8340-4eb9-b296-8570697ea586 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:45.827076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-631ff9d3-8340-4eb9-b296-8570697ea586 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:45.840714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-631ff9d3-8340-4eb9-b296-8570697ea586 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:45.841346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-631ff9d3-8340-4eb9-b296-8570697ea586 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:45.842122 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-631ff9d3-8340-4eb9-b296-8570697ea586 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:45.843511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-631ff9d3-8340-4eb9-b296-8570697ea586 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:45.844461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-631ff9d3-8340-4eb9-b296-8570697ea586 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:45.845399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-631ff9d3-8340-4eb9-b296-8570697ea586 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:45.959645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-631ff9d3-8340-4eb9-b296-8570697ea586 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:45.969746 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-631ff9d3-8340-4eb9-b296-8570697ea586 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1269 microversion: 2.1 time: 0.163665 Sep 08 13:55:45.970565 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3431/6730] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:45 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:47.002158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9fcae906-e4be-436f-99e7-3cd1ca47ac8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:47.004533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9fcae906-e4be-436f-99e7-3cd1ca47ac8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:47.016663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fcae906-e4be-436f-99e7-3cd1ca47ac8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:47.017400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fcae906-e4be-436f-99e7-3cd1ca47ac8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:47.017953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fcae906-e4be-436f-99e7-3cd1ca47ac8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:47.018851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fcae906-e4be-436f-99e7-3cd1ca47ac8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:47.019589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fcae906-e4be-436f-99e7-3cd1ca47ac8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:47.020123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9fcae906-e4be-436f-99e7-3cd1ca47ac8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:47.132983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9fcae906-e4be-436f-99e7-3cd1ca47ac8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:47.145249 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9fcae906-e4be-436f-99e7-3cd1ca47ac8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1275 microversion: 2.1 time: 0.154191 Sep 08 13:55:47.146261 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3300/6731] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:46 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1275 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:48.176663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-92c90cbd-ce52-4844-895a-f6bfef825896 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:48.178354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-92c90cbd-ce52-4844-895a-f6bfef825896 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:48.189642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92c90cbd-ce52-4844-895a-f6bfef825896 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:48.190166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92c90cbd-ce52-4844-895a-f6bfef825896 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:48.190628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92c90cbd-ce52-4844-895a-f6bfef825896 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:48.191492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92c90cbd-ce52-4844-895a-f6bfef825896 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:48.191874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92c90cbd-ce52-4844-895a-f6bfef825896 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:48.192321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-92c90cbd-ce52-4844-895a-f6bfef825896 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:48.378041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-92c90cbd-ce52-4844-895a-f6bfef825896 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:48.387929 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-92c90cbd-ce52-4844-895a-f6bfef825896 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1317 microversion: 2.1 time: 0.218311 Sep 08 13:55:48.388539 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3432/6732] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:48 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1317 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:48.492483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-6ac6ca3c-a692-40c7-9e6d-fc95388df870 req-83d38665-bf5c-4f22-aa6a-2193fd170f6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9432775a-b4c9-442d-954f-3ecc078ff3f1", "tag": "d51a0bd9-bc48-4aed-a0ec-4fa87286c7a5"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:48.512641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6ac6ca3c-a692-40c7-9e6d-fc95388df870 req-83d38665-bf5c-4f22-aa6a-2193fd170f6b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:48.513813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6ac6ca3c-a692-40c7-9e6d-fc95388df870 req-83d38665-bf5c-4f22-aa6a-2193fd170f6b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:48.514270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6ac6ca3c-a692-40c7-9e6d-fc95388df870 req-83d38665-bf5c-4f22-aa6a-2193fd170f6b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:48.530249 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-6ac6ca3c-a692-40c7-9e6d-fc95388df870 req-83d38665-bf5c-4f22-aa6a-2193fd170f6b service nova] Creating event network-changed:d51a0bd9-bc48-4aed-a0ec-4fa87286c7a5 for instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 on n-h1-852084-10 Sep 08 13:55:48.537090 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-6ac6ca3c-a692-40c7-9e6d-fc95388df870 req-83d38665-bf5c-4f22-aa6a-2193fd170f6b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051143 Sep 08 13:55:48.537732 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3301/6733] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:55:49.429287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8afe6e51-8e3d-473c-9521-94df7ef3dd29 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:49.430238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8afe6e51-8e3d-473c-9521-94df7ef3dd29 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:49.439241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8afe6e51-8e3d-473c-9521-94df7ef3dd29 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:49.439901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8afe6e51-8e3d-473c-9521-94df7ef3dd29 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:49.440445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8afe6e51-8e3d-473c-9521-94df7ef3dd29 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:49.441316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8afe6e51-8e3d-473c-9521-94df7ef3dd29 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:49.441794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8afe6e51-8e3d-473c-9521-94df7ef3dd29 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:49.442327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8afe6e51-8e3d-473c-9521-94df7ef3dd29 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:49.618786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8afe6e51-8e3d-473c-9521-94df7ef3dd29 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:49.628134 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8afe6e51-8e3d-473c-9521-94df7ef3dd29 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1317 microversion: 2.1 time: 0.203377 Sep 08 13:55:49.628857 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3433/6734] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:49 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:50.660067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a75f47ed-a0fd-45c8-990a-62f54bf23df6 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:50.661318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a75f47ed-a0fd-45c8-990a-62f54bf23df6 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:50.672353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a75f47ed-a0fd-45c8-990a-62f54bf23df6 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:50.673297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a75f47ed-a0fd-45c8-990a-62f54bf23df6 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:50.674065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a75f47ed-a0fd-45c8-990a-62f54bf23df6 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:50.675448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a75f47ed-a0fd-45c8-990a-62f54bf23df6 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:50.675883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a75f47ed-a0fd-45c8-990a-62f54bf23df6 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:50.676603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a75f47ed-a0fd-45c8-990a-62f54bf23df6 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:50.866416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a75f47ed-a0fd-45c8-990a-62f54bf23df6 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:50.880221 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a75f47ed-a0fd-45c8-990a-62f54bf23df6 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1317 microversion: 2.1 time: 0.229201 Sep 08 13:55:50.881348 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3302/6735] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:50 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:51.909171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-93ccde12-58ef-4c00-bd88-6faf0eec6508 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:51.909976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-93ccde12-58ef-4c00-bd88-6faf0eec6508 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:51.917724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ccde12-58ef-4c00-bd88-6faf0eec6508 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:51.918236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ccde12-58ef-4c00-bd88-6faf0eec6508 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:51.918690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ccde12-58ef-4c00-bd88-6faf0eec6508 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:51.919473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ccde12-58ef-4c00-bd88-6faf0eec6508 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:51.919949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ccde12-58ef-4c00-bd88-6faf0eec6508 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:51.920397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-93ccde12-58ef-4c00-bd88-6faf0eec6508 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:52.085407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-93ccde12-58ef-4c00-bd88-6faf0eec6508 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:52.105872 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-93ccde12-58ef-4c00-bd88-6faf0eec6508 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1317 microversion: 2.1 time: 0.201564 Sep 08 13:55:52.106819 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3434/6736] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:51 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1317 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:53.136316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-de317158-212e-438b-a5bb-ae0096cf36a5 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:53.136316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-de317158-212e-438b-a5bb-ae0096cf36a5 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:53.146046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de317158-212e-438b-a5bb-ae0096cf36a5 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:53.146568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de317158-212e-438b-a5bb-ae0096cf36a5 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:53.147204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de317158-212e-438b-a5bb-ae0096cf36a5 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:53.147989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de317158-212e-438b-a5bb-ae0096cf36a5 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:53.148585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de317158-212e-438b-a5bb-ae0096cf36a5 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:53.149042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-de317158-212e-438b-a5bb-ae0096cf36a5 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:53.374609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-de317158-212e-438b-a5bb-ae0096cf36a5 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:53.385825 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-de317158-212e-438b-a5bb-ae0096cf36a5 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1317 microversion: 2.1 time: 0.256263 Sep 08 13:55:53.386886 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3303/6737] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:53 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1317 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:54.427552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a6ee5ef8-a825-497c-b490-cd831f3e6616 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:54.429915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a6ee5ef8-a825-497c-b490-cd831f3e6616 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:54.442430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6ee5ef8-a825-497c-b490-cd831f3e6616 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:54.443053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6ee5ef8-a825-497c-b490-cd831f3e6616 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:54.443700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6ee5ef8-a825-497c-b490-cd831f3e6616 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:54.444665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6ee5ef8-a825-497c-b490-cd831f3e6616 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:54.445430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6ee5ef8-a825-497c-b490-cd831f3e6616 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:54.446200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a6ee5ef8-a825-497c-b490-cd831f3e6616 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:54.514931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:54.549521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:54.681016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a6ee5ef8-a825-497c-b490-cd831f3e6616 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:54.692703 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a6ee5ef8-a825-497c-b490-cd831f3e6616 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1317 microversion: 2.1 time: 0.271455 Sep 08 13:55:54.693843 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3435/6738] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:54 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1317 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:55.016951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-60b0229b-e6f8-42fc-b6f1-77242e0f05d5 req-e4c64003-07b0-4272-bc7f-cf9cdbbba280 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9432775a-b4c9-442d-954f-3ecc078ff3f1", "name": "network-vif-plugged", "status": "completed", "tag": "d51a0bd9-bc48-4aed-a0ec-4fa87286c7a5"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:55.022974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:55.036266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-60b0229b-e6f8-42fc-b6f1-77242e0f05d5 req-e4c64003-07b0-4272-bc7f-cf9cdbbba280 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:55.037168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-60b0229b-e6f8-42fc-b6f1-77242e0f05d5 req-e4c64003-07b0-4272-bc7f-cf9cdbbba280 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:55.038308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-60b0229b-e6f8-42fc-b6f1-77242e0f05d5 req-e4c64003-07b0-4272-bc7f-cf9cdbbba280 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:55.057270 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-60b0229b-e6f8-42fc-b6f1-77242e0f05d5 req-e4c64003-07b0-4272-bc7f-cf9cdbbba280 service nova] Creating event network-vif-plugged:d51a0bd9-bc48-4aed-a0ec-4fa87286c7a5 for instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 on n-h1-852084-10 Sep 08 13:55:55.064656 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-60b0229b-e6f8-42fc-b6f1-77242e0f05d5 req-e4c64003-07b0-4272-bc7f-cf9cdbbba280 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050580 Sep 08 13:55:55.065669 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3304/6739] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:55:55.724374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b6823392-4019-4438-84b5-532d4d8bee07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:55.725658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b6823392-4019-4438-84b5-532d4d8bee07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:55.730168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:55.747456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6823392-4019-4438-84b5-532d4d8bee07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:55.748405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6823392-4019-4438-84b5-532d4d8bee07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:55.749226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6823392-4019-4438-84b5-532d4d8bee07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:55.751435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6823392-4019-4438-84b5-532d4d8bee07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:55.752587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6823392-4019-4438-84b5-532d4d8bee07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:55.756695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b6823392-4019-4438-84b5-532d4d8bee07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:55.770239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=65 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:55.977395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b6823392-4019-4438-84b5-532d4d8bee07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:55.990048 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b6823392-4019-4438-84b5-532d4d8bee07 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1317 microversion: 2.1 time: 0.274059 Sep 08 13:55:55.991338 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3436/6740] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:55 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1317 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:57.025037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7c253682-01a7-484f-acb0-01a7a6c917ab tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:57.026082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7c253682-01a7-484f-acb0-01a7a6c917ab tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:57.029562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=37 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:57.036876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c253682-01a7-484f-acb0-01a7a6c917ab tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:57.037453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c253682-01a7-484f-acb0-01a7a6c917ab tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:57.037945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c253682-01a7-484f-acb0-01a7a6c917ab tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:57.038741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c253682-01a7-484f-acb0-01a7a6c917ab tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:57.039294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c253682-01a7-484f-acb0-01a7a6c917ab tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:57.039781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7c253682-01a7-484f-acb0-01a7a6c917ab tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:57.042843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=57 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:55:57.268669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7c253682-01a7-484f-acb0-01a7a6c917ab tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:57.284353 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7c253682-01a7-484f-acb0-01a7a6c917ab tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1506 microversion: 2.1 time: 0.263892 Sep 08 13:55:57.285318 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3305/6741] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:57 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:57.324365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-adea5cc6-97b5-489f-b73e-d0f79bb5616f tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:57.325189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-adea5cc6-97b5-489f-b73e-d0f79bb5616f tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:57.336693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-adea5cc6-97b5-489f-b73e-d0f79bb5616f tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:57.337364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-adea5cc6-97b5-489f-b73e-d0f79bb5616f tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:57.338059 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-adea5cc6-97b5-489f-b73e-d0f79bb5616f tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:57.339000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-adea5cc6-97b5-489f-b73e-d0f79bb5616f tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:57.339636 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-adea5cc6-97b5-489f-b73e-d0f79bb5616f tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:57.340236 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-adea5cc6-97b5-489f-b73e-d0f79bb5616f tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:57.380836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-adea5cc6-97b5-489f-b73e-d0f79bb5616f tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:55:57.488403 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-adea5cc6-97b5-489f-b73e-d0f79bb5616f tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 204 len: 0 microversion: 2.1 time: 0.170798 Sep 08 13:55:57.489114 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3437/6742] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:55:57 2022] DELETE /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:55:57.501970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5adc1562-4b7d-4ec3-9b72-686c5c93c423 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:57.503341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5adc1562-4b7d-4ec3-9b72-686c5c93c423 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:57.512797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5adc1562-4b7d-4ec3-9b72-686c5c93c423 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:57.513955 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5adc1562-4b7d-4ec3-9b72-686c5c93c423 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:57.516229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5adc1562-4b7d-4ec3-9b72-686c5c93c423 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:57.518064 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5adc1562-4b7d-4ec3-9b72-686c5c93c423 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:57.518798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5adc1562-4b7d-4ec3-9b72-686c5c93c423 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:57.519554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5adc1562-4b7d-4ec3-9b72-686c5c93c423 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:57.723442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5adc1562-4b7d-4ec3-9b72-686c5c93c423 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:57.732462 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5adc1562-4b7d-4ec3-9b72-686c5c93c423 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1512 microversion: 2.1 time: 0.237487 Sep 08 13:55:57.733424 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3306/6743] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:57 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:55:58.763681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e9c3376-996e-4755-bea4-8238254f1b9c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:55:58.764920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9e9c3376-996e-4755-bea4-8238254f1b9c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:55:58.777637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e9c3376-996e-4755-bea4-8238254f1b9c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:58.778466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e9c3376-996e-4755-bea4-8238254f1b9c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:58.779264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e9c3376-996e-4755-bea4-8238254f1b9c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:58.780522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e9c3376-996e-4755-bea4-8238254f1b9c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:58.781302 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e9c3376-996e-4755-bea4-8238254f1b9c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:58.782607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e9c3376-996e-4755-bea4-8238254f1b9c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:59.002885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9e9c3376-996e-4755-bea4-8238254f1b9c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:55:59.022338 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e9c3376-996e-4755-bea4-8238254f1b9c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1512 microversion: 2.1 time: 0.266073 Sep 08 13:55:59.023388 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3438/6744] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:55:58 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:55:59.548365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-ff28743a-6084-44d1-94d7-61aa4a98d791 req-b986cfdd-8a7e-4ed3-9ba3-04473732aace service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9432775a-b4c9-442d-954f-3ecc078ff3f1", "name": "network-vif-deleted", "tag": "d51a0bd9-bc48-4aed-a0ec-4fa87286c7a5"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:55:59.568040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ff28743a-6084-44d1-94d7-61aa4a98d791 req-b986cfdd-8a7e-4ed3-9ba3-04473732aace service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:55:59.568773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ff28743a-6084-44d1-94d7-61aa4a98d791 req-b986cfdd-8a7e-4ed3-9ba3-04473732aace service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:55:59.569437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ff28743a-6084-44d1-94d7-61aa4a98d791 req-b986cfdd-8a7e-4ed3-9ba3-04473732aace service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:55:59.603710 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-ff28743a-6084-44d1-94d7-61aa4a98d791 req-b986cfdd-8a7e-4ed3-9ba3-04473732aace service nova] Creating event network-vif-deleted:d51a0bd9-bc48-4aed-a0ec-4fa87286c7a5 for instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 on n-h1-852084-10 Sep 08 13:55:59.610879 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-ff28743a-6084-44d1-94d7-61aa4a98d791 req-b986cfdd-8a7e-4ed3-9ba3-04473732aace service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070035 Sep 08 13:55:59.615008 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3307/6745] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:56:00.064296 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:00.065185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:00.076363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:00.077180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:00.077886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:00.079581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:00.080371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:00.081132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:00.139103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:00.139796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:00.140439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:00.141505 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lazy-loading 'fault' on Instance uuid 9432775a-b4c9-442d-954f-3ecc078ff3f1 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:56:00.197043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:00.213049 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1789789d-aca8-4115-9553-da82a9e4f520 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 200 len: 1307 microversion: 2.1 time: 0.155046 Sep 08 13:56:00.214019 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3439/6746] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:00 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 1307 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:01.259405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b4949dd-32ba-437d-9ccc-d83754e84ec0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:01.260776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6b4949dd-32ba-437d-9ccc-d83754e84ec0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:01.274130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b4949dd-32ba-437d-9ccc-d83754e84ec0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:01.275297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b4949dd-32ba-437d-9ccc-d83754e84ec0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:01.276073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b4949dd-32ba-437d-9ccc-d83754e84ec0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:01.277416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b4949dd-32ba-437d-9ccc-d83754e84ec0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:01.278235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b4949dd-32ba-437d-9ccc-d83754e84ec0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:01.278774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6b4949dd-32ba-437d-9ccc-d83754e84ec0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:01.298658 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-6b4949dd-32ba-437d-9ccc-d83754e84ec0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] HTTP exception thrown: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b4949dd-32ba-437d-9ccc-d83754e84ec0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Request method failure captured: Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 HTTP/1.1 Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfRNtNMqad41oA3jVLcPKabbk6SQtj6FHfHsh4P4CBYe5xwAD_ioutX-5XsVN3vkn03Dw_oaMMkLyB7-FXSuKsodseWtqBMj2YfeQ5YI-FQ5Z6bneDBnFaTZjD_dooAvpTcd2hDKkK-9h_GOsOMUR6vn26miDUhxqnnkvZe4VHOmacg Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9c58a4cd069544c982b61fd92326b9b2 Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '9432775a-b4c9-442d-954f-3ecc078ff3f1'} Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:01.300991 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:01.310214 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:01.310214 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:01.310214 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:01.310214 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:56:01.310214 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:56:01.310214 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:01.310214 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:01.310214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6b4949dd-32ba-437d-9ccc-d83754e84ec0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Returning 404 to user: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:56:01.310214 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6b4949dd-32ba-437d-9ccc-d83754e84ec0 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 404 len: 111 microversion: 2.1 time: 0.053470 Sep 08 13:56:01.310214 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3308/6747] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:01 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:56:01.315594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5ca30391-f9ef-4558-8771-4c20f9fc8293 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:01.316288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5ca30391-f9ef-4558-8771-4c20f9fc8293 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:01.325337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ca30391-f9ef-4558-8771-4c20f9fc8293 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:01.325910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ca30391-f9ef-4558-8771-4c20f9fc8293 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:01.326415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ca30391-f9ef-4558-8771-4c20f9fc8293 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:01.327309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ca30391-f9ef-4558-8771-4c20f9fc8293 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:01.327892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ca30391-f9ef-4558-8771-4c20f9fc8293 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:01.328535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5ca30391-f9ef-4558-8771-4c20f9fc8293 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:01.510333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5ca30391-f9ef-4558-8771-4c20f9fc8293 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:01.521135 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5ca30391-f9ef-4558-8771-4c20f9fc8293 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1507 microversion: 2.1 time: 0.210490 Sep 08 13:56:01.524674 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3440/6748] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:01 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1507 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:01.551627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e17c3170-ef5b-4469-9a69-f7d2eb67dc9e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:01.555944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e17c3170-ef5b-4469-9a69-f7d2eb67dc9e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 0a87b44d-63ca-4b17-8559-c00f25d98d0e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:01.566198 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-e17c3170-ef5b-4469-9a69-f7d2eb67dc9e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] HTTP exception thrown: Instance 0a87b44d-63ca-4b17-8559-c00f25d98d0e could not be found. Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e17c3170-ef5b-4469-9a69-f7d2eb67dc9e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Request method failure captured: Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/0a87b44d-63ca-4b17-8559-c00f25d98d0e/action HTTP/1.1 Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 32 Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfRNtNMqad41oA3jVLcPKabbk6SQtj6FHfHsh4P4CBYe5xwAD_ioutX-5XsVN3vkn03Dw_oaMMkLyB7-FXSuKsodseWtqBMj2YfeQ5YI-FQ5Z6bneDBnFaTZjD_dooAvpTcd2hDKkK-9h_GOsOMUR6vn26miDUhxqnnkvZe4VHOmacg Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9c58a4cd069544c982b61fd92326b9b2 Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: {"resize": {"flavorRef": "452"}} Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 0a87b44d-63ca-4b17-8559-c00f25d98d0e could not be found. Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '0a87b44d-63ca-4b17-8559-c00f25d98d0e', 'body': {'resize': {'flavorRef': '452'}}} Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a87b44d-63ca-4b17-8559-c00f25d98d0e could not be found. Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:56:01.569204 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a87b44d-63ca-4b17-8559-c00f25d98d0e could not be found. Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a87b44d-63ca-4b17-8559-c00f25d98d0e could not be found. Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e17c3170-ef5b-4469-9a69-f7d2eb67dc9e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Returning 404 to user: Instance 0a87b44d-63ca-4b17-8559-c00f25d98d0e could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e17c3170-ef5b-4469-9a69-f7d2eb67dc9e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "POST /compute/v2.1/servers/0a87b44d-63ca-4b17-8559-c00f25d98d0e/action" status: 404 len: 111 microversion: 2.1 time: 0.027641 Sep 08 13:56:01.577179 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3309/6749] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:56:01 2022] POST /compute/v2.1/servers/0a87b44d-63ca-4b17-8559-c00f25d98d0e/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:56:01.584608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9ee443ea-cb40-4687-895a-4b8e8071936a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:01.585417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9ee443ea-cb40-4687-895a-4b8e8071936a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:01.593248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ee443ea-cb40-4687-895a-4b8e8071936a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:01.593975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ee443ea-cb40-4687-895a-4b8e8071936a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:01.594534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ee443ea-cb40-4687-895a-4b8e8071936a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:01.595578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ee443ea-cb40-4687-895a-4b8e8071936a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:01.596140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ee443ea-cb40-4687-895a-4b8e8071936a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:01.596820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9ee443ea-cb40-4687-895a-4b8e8071936a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:01.805478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9ee443ea-cb40-4687-895a-4b8e8071936a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:01.815073 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9ee443ea-cb40-4687-895a-4b8e8071936a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1507 microversion: 2.1 time: 0.234869 Sep 08 13:56:01.815809 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3441/6750] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:01 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1507 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:01.846101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b874fb35-3206-459f-b615-6f8df1b18939 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:01.847285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b874fb35-3206-459f-b615-6f8df1b18939 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:01.856325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b874fb35-3206-459f-b615-6f8df1b18939 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:01.856849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b874fb35-3206-459f-b615-6f8df1b18939 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:01.857375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b874fb35-3206-459f-b615-6f8df1b18939 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:01.858110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b874fb35-3206-459f-b615-6f8df1b18939 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:01.858572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b874fb35-3206-459f-b615-6f8df1b18939 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:01.859018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b874fb35-3206-459f-b615-6f8df1b18939 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:02.058437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b874fb35-3206-459f-b615-6f8df1b18939 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:02.067536 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b874fb35-3206-459f-b615-6f8df1b18939 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1507 microversion: 2.1 time: 0.226700 Sep 08 13:56:02.068137 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3310/6751] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:01 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1507 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:56:02.096058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "449ed9bf-236e-40e4-9593-ba8a19cf0183"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:02.100347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:02.106982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:02.107512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:02.107959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:02.108674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:02.109648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:02.110192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:02.151015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:02.160386 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] HTTP exception thrown: Flavor 449ed9bf-236e-40e4-9593-ba8a19cf0183 could not be found. Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Request method failure captured: Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: request: POST /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3/action HTTP/1.1 Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 65 Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfRNtNMqad41oA3jVLcPKabbk6SQtj6FHfHsh4P4CBYe5xwAD_ioutX-5XsVN3vkn03Dw_oaMMkLyB7-FXSuKsodseWtqBMj2YfeQ5YI-FQ5Z6bneDBnFaTZjD_dooAvpTcd2hDKkK-9h_GOsOMUR6vn26miDUhxqnnkvZe4VHOmacg Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 9c58a4cd069544c982b61fd92326b9b2 Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: {"resize": {"flavorRef": "449ed9bf-236e-40e4-9593-ba8a19cf0183"}} Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: exception: Flavor 449ed9bf-236e-40e4-9593-ba8a19cf0183 could not be found. Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '79d825d1-c81f-42a1-90bf-20f8f3eae8b3', 'body': {'resize': {'flavorRef': '449ed9bf-236e-40e4-9593-ba8a19cf0183'}}} Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:56:02.164878 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 449ed9bf-236e-40e4-9593-ba8a19cf0183 could not be found. Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 449ed9bf-236e-40e4-9593-ba8a19cf0183 could not be found. Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 449ed9bf-236e-40e4-9593-ba8a19cf0183 could not be found. Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Returning 400 to user: Flavor 449ed9bf-236e-40e4-9593-ba8a19cf0183 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-014c0490-44dc-42ab-8f64-f839929f6c32 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "POST /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3/action" status: 400 len: 107 microversion: 2.1 time: 0.079925 Sep 08 13:56:02.174445 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3442/6752] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:56:02 2022] POST /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3/action => generated 107 bytes in 82 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:56:02.183833 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62f82648-c1fd-414b-b81c-1acbc795f06a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:02.185115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-62f82648-c1fd-414b-b81c-1acbc795f06a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:02.195063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62f82648-c1fd-414b-b81c-1acbc795f06a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:02.195989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62f82648-c1fd-414b-b81c-1acbc795f06a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:02.197379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62f82648-c1fd-414b-b81c-1acbc795f06a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:02.197683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62f82648-c1fd-414b-b81c-1acbc795f06a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:02.198366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62f82648-c1fd-414b-b81c-1acbc795f06a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:02.199074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62f82648-c1fd-414b-b81c-1acbc795f06a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:02.392443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-62f82648-c1fd-414b-b81c-1acbc795f06a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:02.407147 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62f82648-c1fd-414b-b81c-1acbc795f06a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1507 microversion: 2.1 time: 0.230754 Sep 08 13:56:02.408282 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3311/6753] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:02 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:02.445050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e1ea4711-dbe8-4bda-83e9-77d0a251876c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:02.446718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e1ea4711-dbe8-4bda-83e9-77d0a251876c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:02.457373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ea4711-dbe8-4bda-83e9-77d0a251876c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:02.458273 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ea4711-dbe8-4bda-83e9-77d0a251876c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:02.458952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ea4711-dbe8-4bda-83e9-77d0a251876c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:02.460025 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ea4711-dbe8-4bda-83e9-77d0a251876c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:02.460793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ea4711-dbe8-4bda-83e9-77d0a251876c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:02.461583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e1ea4711-dbe8-4bda-83e9-77d0a251876c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:02.668380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e1ea4711-dbe8-4bda-83e9-77d0a251876c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:02.677735 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e1ea4711-dbe8-4bda-83e9-77d0a251876c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1507 microversion: 2.1 time: 0.239919 Sep 08 13:56:02.678370 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3443/6754] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:02 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:02.705384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71ffe729-056f-44c7-90e3-45e2f827a33d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71ffe729-056f-44c7-90e3-45e2f827a33d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Request method failure captured: Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: request: POST /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3/action HTTP/1.1 Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 29 Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfRNtNMqad41oA3jVLcPKabbk6SQtj6FHfHsh4P4CBYe5xwAD_ioutX-5XsVN3vkn03Dw_oaMMkLyB7-FXSuKsodseWtqBMj2YfeQ5YI-FQ5Z6bneDBnFaTZjD_dooAvpTcd2hDKkK-9h_GOsOMUR6vn26miDUhxqnnkvZe4VHOmacg Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9c58a4cd069544c982b61fd92326b9b2 Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: {"resize": {"flavorRef": ""}} Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '79d825d1-c81f-42a1-90bf-20f8f3eae8b3', 'body': {'resize': {'flavorRef': ''}}} Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise error Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi On instance['resize']: Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi '' Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:02.709471 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:02.718335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:02.718335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:02.718335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:02.718335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:02.718335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 08 13:56:02.718335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 08 13:56:02.718335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Sep 08 13:56:02.718335 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:02.718335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-71ffe729-056f-44c7-90e3-45e2f827a33d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:56:02.718335 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-71ffe729-056f-44c7-90e3-45e2f827a33d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "POST /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3/action" status: 400 len: 113 microversion: 2.1 time: 0.010593 Sep 08 13:56:02.718335 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3312/6755] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 13:56:02 2022] POST /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3/action => generated 113 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 08 13:56:02.723659 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a81fbaf2-ab3f-4d25-aadd-3ac371e7e87d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:02.724529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a81fbaf2-ab3f-4d25-aadd-3ac371e7e87d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:02.736626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a81fbaf2-ab3f-4d25-aadd-3ac371e7e87d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:02.737325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a81fbaf2-ab3f-4d25-aadd-3ac371e7e87d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:02.738009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a81fbaf2-ab3f-4d25-aadd-3ac371e7e87d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:02.738963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a81fbaf2-ab3f-4d25-aadd-3ac371e7e87d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:02.739779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a81fbaf2-ab3f-4d25-aadd-3ac371e7e87d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:02.740548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a81fbaf2-ab3f-4d25-aadd-3ac371e7e87d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:02.922105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a81fbaf2-ab3f-4d25-aadd-3ac371e7e87d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:02.937992 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a81fbaf2-ab3f-4d25-aadd-3ac371e7e87d tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1507 microversion: 2.1 time: 0.219465 Sep 08 13:56:02.938735 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3444/6756] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:02 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1507 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:02.980978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-725eb10c-0052-4829-87c7-5904c81169f9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:02.981513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-725eb10c-0052-4829-87c7-5904c81169f9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:02.992163 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-725eb10c-0052-4829-87c7-5904c81169f9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:02.993045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-725eb10c-0052-4829-87c7-5904c81169f9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:02.993849 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-725eb10c-0052-4829-87c7-5904c81169f9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:02.995393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-725eb10c-0052-4829-87c7-5904c81169f9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:02.996216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-725eb10c-0052-4829-87c7-5904c81169f9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:02.997013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-725eb10c-0052-4829-87c7-5904c81169f9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:03.017433 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-725eb10c-0052-4829-87c7-5904c81169f9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] HTTP exception thrown: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-725eb10c-0052-4829-87c7-5904c81169f9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Request method failure captured: Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 HTTP/1.1 Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfRNtNMqad41oA3jVLcPKabbk6SQtj6FHfHsh4P4CBYe5xwAD_ioutX-5XsVN3vkn03Dw_oaMMkLyB7-FXSuKsodseWtqBMj2YfeQ5YI-FQ5Z6bneDBnFaTZjD_dooAvpTcd2hDKkK-9h_GOsOMUR6vn26miDUhxqnnkvZe4VHOmacg Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 9c58a4cd069544c982b61fd92326b9b2 Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '9432775a-b4c9-442d-954f-3ecc078ff3f1'} Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:56:03.020894 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-725eb10c-0052-4829-87c7-5904c81169f9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Returning 404 to user: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-725eb10c-0052-4829-87c7-5904c81169f9 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 404 len: 111 microversion: 2.1 time: 0.047195 Sep 08 13:56:03.029333 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3313/6757] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:56:02 2022] DELETE /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:56:03.035646 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-11e27d64-81b5-457a-8fa6-22b49502c97c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:03.036255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-11e27d64-81b5-457a-8fa6-22b49502c97c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 9432775a-b4c9-442d-954f-3ecc078ff3f1] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:03.043860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11e27d64-81b5-457a-8fa6-22b49502c97c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:03.044497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11e27d64-81b5-457a-8fa6-22b49502c97c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:03.044996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11e27d64-81b5-457a-8fa6-22b49502c97c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:03.045821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11e27d64-81b5-457a-8fa6-22b49502c97c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:03.046344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11e27d64-81b5-457a-8fa6-22b49502c97c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:03.047551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-11e27d64-81b5-457a-8fa6-22b49502c97c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:03.064227 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-11e27d64-81b5-457a-8fa6-22b49502c97c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] HTTP exception thrown: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-11e27d64-81b5-457a-8fa6-22b49502c97c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Request method failure captured: Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 HTTP/1.1 Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfRNtNMqad41oA3jVLcPKabbk6SQtj6FHfHsh4P4CBYe5xwAD_ioutX-5XsVN3vkn03Dw_oaMMkLyB7-FXSuKsodseWtqBMj2YfeQ5YI-FQ5Z6bneDBnFaTZjD_dooAvpTcd2hDKkK-9h_GOsOMUR6vn26miDUhxqnnkvZe4VHOmacg Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 9c58a4cd069544c982b61fd92326b9b2 Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '9432775a-b4c9-442d-954f-3ecc078ff3f1'} Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:03.065847 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:03.072046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:03.072046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:03.072046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:03.072046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:56:03.072046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:56:03.072046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. Sep 08 13:56:03.072046 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:03.072046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-11e27d64-81b5-457a-8fa6-22b49502c97c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Returning 404 to user: Instance 9432775a-b4c9-442d-954f-3ecc078ff3f1 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:56:03.072046 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-11e27d64-81b5-457a-8fa6-22b49502c97c tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1" status: 404 len: 111 microversion: 2.1 time: 0.037613 Sep 08 13:56:03.072046 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3445/6758] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:03 2022] GET /compute/v2.1/servers/9432775a-b4c9-442d-954f-3ecc078ff3f1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:56:03.083117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6d18183c-b632-4eb8-89c1-269355eb6e85 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:03.083936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6d18183c-b632-4eb8-89c1-269355eb6e85 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:03.094353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d18183c-b632-4eb8-89c1-269355eb6e85 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:03.095056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d18183c-b632-4eb8-89c1-269355eb6e85 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:03.095739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d18183c-b632-4eb8-89c1-269355eb6e85 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:03.096953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d18183c-b632-4eb8-89c1-269355eb6e85 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:03.097711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d18183c-b632-4eb8-89c1-269355eb6e85 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:03.098395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d18183c-b632-4eb8-89c1-269355eb6e85 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:03.142454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6d18183c-b632-4eb8-89c1-269355eb6e85 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:56:03.254460 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6d18183c-b632-4eb8-89c1-269355eb6e85 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "DELETE /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 204 len: 0 microversion: 2.1 time: 0.178672 Sep 08 13:56:03.255509 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3314/6759] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:56:03 2022] DELETE /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:56:03.270132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b1c2c884-b13d-4dba-89c0-d814ba997689 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:03.270863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b1c2c884-b13d-4dba-89c0-d814ba997689 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:03.278218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1c2c884-b13d-4dba-89c0-d814ba997689 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:03.278781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1c2c884-b13d-4dba-89c0-d814ba997689 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:03.279255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1c2c884-b13d-4dba-89c0-d814ba997689 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:03.280212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1c2c884-b13d-4dba-89c0-d814ba997689 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:03.281495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1c2c884-b13d-4dba-89c0-d814ba997689 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:03.282005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b1c2c884-b13d-4dba-89c0-d814ba997689 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:03.449148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b1c2c884-b13d-4dba-89c0-d814ba997689 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:03.459552 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b1c2c884-b13d-4dba-89c0-d814ba997689 tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1513 microversion: 2.1 time: 0.197190 Sep 08 13:56:03.460320 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3446/6760] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:03 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:04.495162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-98371ce6-48d9-4837-a8da-3e2af4fafd8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:04.496332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-98371ce6-48d9-4837-a8da-3e2af4fafd8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:04.506781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98371ce6-48d9-4837-a8da-3e2af4fafd8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:04.507715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98371ce6-48d9-4837-a8da-3e2af4fafd8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:04.508524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98371ce6-48d9-4837-a8da-3e2af4fafd8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:04.509810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98371ce6-48d9-4837-a8da-3e2af4fafd8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:04.510660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98371ce6-48d9-4837-a8da-3e2af4fafd8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:04.511468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-98371ce6-48d9-4837-a8da-3e2af4fafd8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:04.706903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-98371ce6-48d9-4837-a8da-3e2af4fafd8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:04.721378 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-98371ce6-48d9-4837-a8da-3e2af4fafd8e tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1513 microversion: 2.1 time: 0.232124 Sep 08 13:56:04.722474 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3315/6761] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:04 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1513 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:05.649940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-5c89d6bb-5c0a-4ec6-83cb-ee24c8480142 req-df86584c-ba54-4bfa-8694-9982d9d030f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79d825d1-c81f-42a1-90bf-20f8f3eae8b3", "name": "network-vif-deleted", "tag": "e4ba609d-f205-47b7-848b-b8ba69609528"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:05.666261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5c89d6bb-5c0a-4ec6-83cb-ee24c8480142 req-df86584c-ba54-4bfa-8694-9982d9d030f2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:05.667864 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5c89d6bb-5c0a-4ec6-83cb-ee24c8480142 req-df86584c-ba54-4bfa-8694-9982d9d030f2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:05.668639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5c89d6bb-5c0a-4ec6-83cb-ee24c8480142 req-df86584c-ba54-4bfa-8694-9982d9d030f2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:05.695336 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-5c89d6bb-5c0a-4ec6-83cb-ee24c8480142 req-df86584c-ba54-4bfa-8694-9982d9d030f2 service nova] Creating event network-vif-deleted:e4ba609d-f205-47b7-848b-b8ba69609528 for instance 79d825d1-c81f-42a1-90bf-20f8f3eae8b3 on n-h2-852084-10 Sep 08 13:56:05.704187 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-5c89d6bb-5c0a-4ec6-83cb-ee24c8480142 req-df86584c-ba54-4bfa-8694-9982d9d030f2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058205 Sep 08 13:56:05.706545 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3447/6762] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:05.762980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:05.764082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:05.776805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:05.778055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:05.778607 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:05.779979 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:05.781179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:05.781966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:05.835356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:05.835877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:05.836591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:05.837320 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lazy-loading 'fault' on Instance uuid 79d825d1-c81f-42a1-90bf-20f8f3eae8b3 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:56:05.910480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c58a4cd069544c982b61fd92326b9b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a51955830ea340128e0a449b9d4e9cc9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:05.927959 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-523da845-326b-4526-8cfd-47c2157dfbad tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 200 len: 1307 microversion: 2.1 time: 0.169946 Sep 08 13:56:05.933657 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3316/6763] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:05 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 1307 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:06.967767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dcf6772b-82df-4c03-ae0f-7e5b46ea9a8a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:06.969099 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dcf6772b-82df-4c03-ae0f-7e5b46ea9a8a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] [instance: 79d825d1-c81f-42a1-90bf-20f8f3eae8b3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:06.976975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcf6772b-82df-4c03-ae0f-7e5b46ea9a8a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:06.977543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcf6772b-82df-4c03-ae0f-7e5b46ea9a8a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:06.978064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcf6772b-82df-4c03-ae0f-7e5b46ea9a8a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:06.978862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcf6772b-82df-4c03-ae0f-7e5b46ea9a8a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:06.979369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcf6772b-82df-4c03-ae0f-7e5b46ea9a8a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:06.979851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dcf6772b-82df-4c03-ae0f-7e5b46ea9a8a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:06.998712 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-dcf6772b-82df-4c03-ae0f-7e5b46ea9a8a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] HTTP exception thrown: Instance 79d825d1-c81f-42a1-90bf-20f8f3eae8b3 could not be found. Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dcf6772b-82df-4c03-ae0f-7e5b46ea9a8a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Request method failure captured: Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 HTTP/1.1 Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfRNtNMqad41oA3jVLcPKabbk6SQtj6FHfHsh4P4CBYe5xwAD_ioutX-5XsVN3vkn03Dw_oaMMkLyB7-FXSuKsodseWtqBMj2YfeQ5YI-FQ5Z6bneDBnFaTZjD_dooAvpTcd2hDKkK-9h_GOsOMUR6vn26miDUhxqnnkvZe4VHOmacg Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a51955830ea340128e0a449b9d4e9cc9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: a51955830ea340128e0a449b9d4e9cc9 Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1254229112 Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 9c58a4cd069544c982b61fd92326b9b2 Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-ServersNegativeTestJSON-1254229112-project Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 79d825d1-c81f-42a1-90bf-20f8f3eae8b3 could not be found. Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '79d825d1-c81f-42a1-90bf-20f8f3eae8b3'} Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79d825d1-c81f-42a1-90bf-20f8f3eae8b3 could not be found. Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79d825d1-c81f-42a1-90bf-20f8f3eae8b3 could not be found. Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:56:07.001339 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:07.006248 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:56:07.006248 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:56:07.006248 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:56:07.006248 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:56:07.006248 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:56:07.006248 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79d825d1-c81f-42a1-90bf-20f8f3eae8b3 could not be found. Sep 08 13:56:07.006248 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:56:07.006248 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dcf6772b-82df-4c03-ae0f-7e5b46ea9a8a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] Returning 404 to user: Instance 79d825d1-c81f-42a1-90bf-20f8f3eae8b3 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:56:07.006248 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dcf6772b-82df-4c03-ae0f-7e5b46ea9a8a tempest-ServersNegativeTestJSON-1254229112 tempest-ServersNegativeTestJSON-1254229112-project] 10.222.0.78 "GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3" status: 404 len: 111 microversion: 2.1 time: 0.043246 Sep 08 13:56:07.006248 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3448/6764] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:06 2022] GET /compute/v2.1/servers/79d825d1-c81f-42a1-90bf-20f8f3eae8b3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:56:52.853561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:52.854188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:53.191548 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1055d9aa-b154-4484-9efc-c4e4768d7571 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Action: 'create', calling method: .version_select at 0x7fdb39f6e790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-501827073", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs7HmMAJH6UjqBilYemEwgcg0FCkYWhlWTWOO1au0nokDy6gTeF2/C7N51BWd+V1a509+97GHv1lBB6zwLcjlgot0PA9jKqYSQcOJAz0sw3ZYmqLin+HxJ60CiSujYPuA=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:53.213832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-1055d9aa-b154-4484-9efc-c4e4768d7571 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Getting quotas for project 2777eb38f6d04e3fa15f25023ca4ef6d. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:56:53.221065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-1055d9aa-b154-4484-9efc-c4e4768d7571 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Getting quotas for user 7f3fd079afe44180933a5a6723e0d1b3 and project 2777eb38f6d04e3fa15f25023ca4ef6d. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:56:53.262279 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1055d9aa-b154-4484-9efc-c4e4768d7571 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.414506 Sep 08 13:56:53.263427 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3317/6765] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:56:52 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:53.321112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1942652194", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-501827073", "networks": [{"uuid": "845e58f3-8975-4913-ba96-b80104e8bcc0"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:53.333383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:53.334072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:56:53.604473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] validate_networks() for [('845e58f3-8975-4913-ba96-b80104e8bcc0', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:56:54.164970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:56:54.165414 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:56:54.165908 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:56:54.166337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:56:54.167303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:56:54.184401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:54.186714 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:54.187651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:54.188360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:54.188851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:54.189298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:54.220973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Getting quotas for project 2777eb38f6d04e3fa15f25023ca4ef6d. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:56:54.228634 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Getting quotas for user 7f3fd079afe44180933a5a6723e0d1b3 and project 2777eb38f6d04e3fa15f25023ca4ef6d. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:56:54.246125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:56:54.249095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:56:54.328978 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fbacaa0e-cfd3-42b7-a085-b64f42ea9e6c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.012708 Sep 08 13:56:54.330360 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3449/6766] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:56:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:56:54.347287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-88486884-5411-41d7-ace8-5f05c7cef9fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:54.348153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-88486884-5411-41d7-ace8-5f05c7cef9fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:54.624558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-88486884-5411-41d7-ace8-5f05c7cef9fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:54.634130 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-88486884-5411-41d7-ace8-5f05c7cef9fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1262 microversion: 2.1 time: 0.295866 Sep 08 13:56:54.634712 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3318/6767] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:54 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1262 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:55.662079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ebfa5a52-93a8-4fea-9991-d47cd1724116 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:55.663148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ebfa5a52-93a8-4fea-9991-d47cd1724116 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:55.674381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebfa5a52-93a8-4fea-9991-d47cd1724116 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:55.675790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebfa5a52-93a8-4fea-9991-d47cd1724116 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:55.676509 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebfa5a52-93a8-4fea-9991-d47cd1724116 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:55.677741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebfa5a52-93a8-4fea-9991-d47cd1724116 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:55.678351 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebfa5a52-93a8-4fea-9991-d47cd1724116 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:55.679022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ebfa5a52-93a8-4fea-9991-d47cd1724116 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:55.778717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ebfa5a52-93a8-4fea-9991-d47cd1724116 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:55.791810 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ebfa5a52-93a8-4fea-9991-d47cd1724116 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1314 microversion: 2.1 time: 0.136030 Sep 08 13:56:55.793232 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3450/6768] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:55 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:56.827574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-250c5bc2-9657-47b2-9e0b-5d102f09fb3f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:56.830071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-250c5bc2-9657-47b2-9e0b-5d102f09fb3f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:56.863645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-250c5bc2-9657-47b2-9e0b-5d102f09fb3f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:56.865073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-250c5bc2-9657-47b2-9e0b-5d102f09fb3f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:56.866781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-250c5bc2-9657-47b2-9e0b-5d102f09fb3f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:56.868349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-250c5bc2-9657-47b2-9e0b-5d102f09fb3f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:56.869698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-250c5bc2-9657-47b2-9e0b-5d102f09fb3f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:56.871412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-250c5bc2-9657-47b2-9e0b-5d102f09fb3f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:57.276828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-250c5bc2-9657-47b2-9e0b-5d102f09fb3f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:57.297013 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-250c5bc2-9657-47b2-9e0b-5d102f09fb3f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1362 microversion: 2.1 time: 0.474208 Sep 08 13:56:57.312295 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3319/6769] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:56 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1362 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:58.342456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5faa7f98-8ab8-4bbb-9340-b4438e1f439e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:58.343402 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5faa7f98-8ab8-4bbb-9340-b4438e1f439e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:58.357701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5faa7f98-8ab8-4bbb-9340-b4438e1f439e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:58.372572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5faa7f98-8ab8-4bbb-9340-b4438e1f439e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:58.374139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5faa7f98-8ab8-4bbb-9340-b4438e1f439e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:58.375836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5faa7f98-8ab8-4bbb-9340-b4438e1f439e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:58.377630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5faa7f98-8ab8-4bbb-9340-b4438e1f439e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:58.378805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5faa7f98-8ab8-4bbb-9340-b4438e1f439e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:58.720682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5faa7f98-8ab8-4bbb-9340-b4438e1f439e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:56:58.733608 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5faa7f98-8ab8-4bbb-9340-b4438e1f439e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1362 microversion: 2.1 time: 0.396304 Sep 08 13:56:58.734715 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3451/6770] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:58 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:56:59.028250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-84091a60-78a7-4be8-b688-4345d1b020a5 req-1ac1c97c-8cef-40d9-abd3-c2ae8a2fc7a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54dc310d-ee5b-44e5-a08c-a9f31f8c8860", "tag": "19d9a226-40a6-4190-ba89-39d3b30799da"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:56:59.041086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-84091a60-78a7-4be8-b688-4345d1b020a5 req-1ac1c97c-8cef-40d9-abd3-c2ae8a2fc7a7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:59.041732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-84091a60-78a7-4be8-b688-4345d1b020a5 req-1ac1c97c-8cef-40d9-abd3-c2ae8a2fc7a7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:59.042231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-84091a60-78a7-4be8-b688-4345d1b020a5 req-1ac1c97c-8cef-40d9-abd3-c2ae8a2fc7a7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:59.064216 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-84091a60-78a7-4be8-b688-4345d1b020a5 req-1ac1c97c-8cef-40d9-abd3-c2ae8a2fc7a7 service nova] Creating event network-changed:19d9a226-40a6-4190-ba89-39d3b30799da for instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 on n-h2-852084-10 Sep 08 13:56:59.073632 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-84091a60-78a7-4be8-b688-4345d1b020a5 req-1ac1c97c-8cef-40d9-abd3-c2ae8a2fc7a7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200023 Sep 08 13:56:59.074763 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3320/6771] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:56:59.773240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2b2f2da7-1289-48d3-b207-06742bdafd37 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:56:59.774037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2b2f2da7-1289-48d3-b207-06742bdafd37 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:56:59.782826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b2f2da7-1289-48d3-b207-06742bdafd37 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:59.783371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b2f2da7-1289-48d3-b207-06742bdafd37 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:59.783822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b2f2da7-1289-48d3-b207-06742bdafd37 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:56:59.784555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b2f2da7-1289-48d3-b207-06742bdafd37 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:56:59.785023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b2f2da7-1289-48d3-b207-06742bdafd37 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:56:59.785462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b2f2da7-1289-48d3-b207-06742bdafd37 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:00.002679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2b2f2da7-1289-48d3-b207-06742bdafd37 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:00.018164 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2b2f2da7-1289-48d3-b207-06742bdafd37 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1362 microversion: 2.1 time: 0.248912 Sep 08 13:57:00.019080 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3452/6772] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:56:59 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:01.053233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9f4aa128-58a5-4976-9e18-b8158f22941a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:01.054448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9f4aa128-58a5-4976-9e18-b8158f22941a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:01.069094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f4aa128-58a5-4976-9e18-b8158f22941a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:01.070103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f4aa128-58a5-4976-9e18-b8158f22941a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:01.071037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f4aa128-58a5-4976-9e18-b8158f22941a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:01.072630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f4aa128-58a5-4976-9e18-b8158f22941a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:01.073723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f4aa128-58a5-4976-9e18-b8158f22941a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:01.074455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f4aa128-58a5-4976-9e18-b8158f22941a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:01.288813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9f4aa128-58a5-4976-9e18-b8158f22941a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:01.300581 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9f4aa128-58a5-4976-9e18-b8158f22941a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1362 microversion: 2.1 time: 0.258639 Sep 08 13:57:01.301221 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3321/6773] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:01 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1362 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:02.325492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-131d45db-b022-4a80-bd89-d388bc6e84d1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:02.326142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-131d45db-b022-4a80-bd89-d388bc6e84d1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:02.333967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-131d45db-b022-4a80-bd89-d388bc6e84d1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:02.334770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-131d45db-b022-4a80-bd89-d388bc6e84d1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:02.335219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-131d45db-b022-4a80-bd89-d388bc6e84d1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:02.335966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-131d45db-b022-4a80-bd89-d388bc6e84d1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:02.336430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-131d45db-b022-4a80-bd89-d388bc6e84d1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:02.336868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-131d45db-b022-4a80-bd89-d388bc6e84d1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:02.488246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-131d45db-b022-4a80-bd89-d388bc6e84d1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:02.504673 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-131d45db-b022-4a80-bd89-d388bc6e84d1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1362 microversion: 2.1 time: 0.183202 Sep 08 13:57:02.505282 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3453/6774] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:02 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:03.530093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-527f587a-c0d2-46ce-9498-9aa6e9d62194 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:03.530992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-527f587a-c0d2-46ce-9498-9aa6e9d62194 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:03.538671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-527f587a-c0d2-46ce-9498-9aa6e9d62194 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:03.539160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-527f587a-c0d2-46ce-9498-9aa6e9d62194 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:03.539744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-527f587a-c0d2-46ce-9498-9aa6e9d62194 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:03.540451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-527f587a-c0d2-46ce-9498-9aa6e9d62194 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:03.540941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-527f587a-c0d2-46ce-9498-9aa6e9d62194 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:03.541438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-527f587a-c0d2-46ce-9498-9aa6e9d62194 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:03.727516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-527f587a-c0d2-46ce-9498-9aa6e9d62194 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:03.740405 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-527f587a-c0d2-46ce-9498-9aa6e9d62194 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1362 microversion: 2.1 time: 0.214835 Sep 08 13:57:03.741150 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3322/6775] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:03 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1362 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:04.771947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e35f0e3f-6179-4ead-a5aa-882de66d3066 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:04.773711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e35f0e3f-6179-4ead-a5aa-882de66d3066 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:04.779424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:04.780793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:04.794676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e35f0e3f-6179-4ead-a5aa-882de66d3066 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:04.795662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e35f0e3f-6179-4ead-a5aa-882de66d3066 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:04.796522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e35f0e3f-6179-4ead-a5aa-882de66d3066 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:04.797975 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e35f0e3f-6179-4ead-a5aa-882de66d3066 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:04.798920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e35f0e3f-6179-4ead-a5aa-882de66d3066 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:04.800415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e35f0e3f-6179-4ead-a5aa-882de66d3066 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:05.012069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e35f0e3f-6179-4ead-a5aa-882de66d3066 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:05.025966 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e35f0e3f-6179-4ead-a5aa-882de66d3066 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1362 microversion: 2.1 time: 0.260481 Sep 08 13:57:05.027027 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3454/6776] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:04 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1362 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:05.724603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0f04d75e-c617-4a67-a31e-4a84b2752544 req-3d330de1-dbce-4bef-b0f1-a7998755b92e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54dc310d-ee5b-44e5-a08c-a9f31f8c8860", "name": "network-vif-plugged", "status": "completed", "tag": "19d9a226-40a6-4190-ba89-39d3b30799da"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:05.734513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:05.744206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0f04d75e-c617-4a67-a31e-4a84b2752544 req-3d330de1-dbce-4bef-b0f1-a7998755b92e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:05.744882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0f04d75e-c617-4a67-a31e-4a84b2752544 req-3d330de1-dbce-4bef-b0f1-a7998755b92e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:05.745559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0f04d75e-c617-4a67-a31e-4a84b2752544 req-3d330de1-dbce-4bef-b0f1-a7998755b92e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:05.766098 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0f04d75e-c617-4a67-a31e-4a84b2752544 req-3d330de1-dbce-4bef-b0f1-a7998755b92e service nova] Creating event network-vif-plugged:19d9a226-40a6-4190-ba89-39d3b30799da for instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 on n-h2-852084-10 Sep 08 13:57:05.776580 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0f04d75e-c617-4a67-a31e-4a84b2752544 req-3d330de1-dbce-4bef-b0f1-a7998755b92e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057744 Sep 08 13:57:05.779294 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3323/6777] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:06.060260 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7a2e1bc2-ae36-4fc3-a82b-938fe837c1f5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:06.061125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7a2e1bc2-ae36-4fc3-a82b-938fe837c1f5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:06.071540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a2e1bc2-ae36-4fc3-a82b-938fe837c1f5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:06.073104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a2e1bc2-ae36-4fc3-a82b-938fe837c1f5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:06.074290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a2e1bc2-ae36-4fc3-a82b-938fe837c1f5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:06.077900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a2e1bc2-ae36-4fc3-a82b-938fe837c1f5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:06.078698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a2e1bc2-ae36-4fc3-a82b-938fe837c1f5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:06.079364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a2e1bc2-ae36-4fc3-a82b-938fe837c1f5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:06.271586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7a2e1bc2-ae36-4fc3-a82b-938fe837c1f5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:06.282521 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7a2e1bc2-ae36-4fc3-a82b-938fe837c1f5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1362 microversion: 2.1 time: 0.226807 Sep 08 13:57:06.283165 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3455/6778] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:06 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:07.309171 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1353cb19-f39c-4554-83b2-9a07a4034d9d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:07.309882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1353cb19-f39c-4554-83b2-9a07a4034d9d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:07.319550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1353cb19-f39c-4554-83b2-9a07a4034d9d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:07.320093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1353cb19-f39c-4554-83b2-9a07a4034d9d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:07.320590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1353cb19-f39c-4554-83b2-9a07a4034d9d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:07.321343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1353cb19-f39c-4554-83b2-9a07a4034d9d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:07.321862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1353cb19-f39c-4554-83b2-9a07a4034d9d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:07.322322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1353cb19-f39c-4554-83b2-9a07a4034d9d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:07.500421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1353cb19-f39c-4554-83b2-9a07a4034d9d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:07.511613 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1353cb19-f39c-4554-83b2-9a07a4034d9d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1555 microversion: 2.1 time: 0.206830 Sep 08 13:57:07.512231 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3324/6779] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:07 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1555 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:07.537690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7c0211b2-1a01-43a3-8ed5-c45e27d0fe86 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:07.538352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7c0211b2-1a01-43a3-8ed5-c45e27d0fe86 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:07.548889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c0211b2-1a01-43a3-8ed5-c45e27d0fe86 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:07.549577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c0211b2-1a01-43a3-8ed5-c45e27d0fe86 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:07.550597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c0211b2-1a01-43a3-8ed5-c45e27d0fe86 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:07.551541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c0211b2-1a01-43a3-8ed5-c45e27d0fe86 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:07.552169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c0211b2-1a01-43a3-8ed5-c45e27d0fe86 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:07.552851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c0211b2-1a01-43a3-8ed5-c45e27d0fe86 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:07.721437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7c0211b2-1a01-43a3-8ed5-c45e27d0fe86 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:07.730356 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7c0211b2-1a01-43a3-8ed5-c45e27d0fe86 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1555 microversion: 2.1 time: 0.196761 Sep 08 13:57:07.731029 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3456/6780] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:07 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1555 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:09.611654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-90fabb20-0aef-4c8d-82f5-f8684bf66933 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7834f0a-0890-4cb7-98ac-632c76c0ed59"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:09.614116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-90fabb20-0aef-4c8d-82f5-f8684bf66933 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:09.622132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90fabb20-0aef-4c8d-82f5-f8684bf66933 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:09.622634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90fabb20-0aef-4c8d-82f5-f8684bf66933 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:09.623076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90fabb20-0aef-4c8d-82f5-f8684bf66933 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:09.623836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90fabb20-0aef-4c8d-82f5-f8684bf66933 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:09.624306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90fabb20-0aef-4c8d-82f5-f8684bf66933 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:09.624744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-90fabb20-0aef-4c8d-82f5-f8684bf66933 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:09.914278 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-90fabb20-0aef-4c8d-82f5-f8684bf66933 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "POST /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.306317 Sep 08 13:57:09.914921 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3325/6781] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:57:09 2022] POST /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:21.992816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ad20be46-cfde-48ef-928e-150fbaea59a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:21.993512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ad20be46-cfde-48ef-928e-150fbaea59a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:21.997014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:21.997014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=44 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:22.006516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad20be46-cfde-48ef-928e-150fbaea59a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:22.007457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad20be46-cfde-48ef-928e-150fbaea59a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:22.008826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad20be46-cfde-48ef-928e-150fbaea59a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:22.010088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad20be46-cfde-48ef-928e-150fbaea59a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:22.010596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad20be46-cfde-48ef-928e-150fbaea59a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:22.011079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ad20be46-cfde-48ef-928e-150fbaea59a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:22.109674 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-ad20be46-cfde-48ef-928e-150fbaea59a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lazy-loading 'services' on Instance uuid 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:57:22.201189 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ad20be46-cfde-48ef-928e-150fbaea59a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "DELETE /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments/c7834f0a-0890-4cb7-98ac-632c76c0ed59" status: 202 len: 0 microversion: 2.1 time: 0.212623 Sep 08 13:57:22.202191 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3457/6782] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:57:21 2022] DELETE /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments/c7834f0a-0890-4cb7-98ac-632c76c0ed59 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:57:22.216216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1ad47f69-e0c4-4852-82d6-9669067424e0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:22.220577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1ad47f69-e0c4-4852-82d6-9669067424e0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:22.225079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:22.226254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:22.237582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ad47f69-e0c4-4852-82d6-9669067424e0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:22.237582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ad47f69-e0c4-4852-82d6-9669067424e0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:22.237582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ad47f69-e0c4-4852-82d6-9669067424e0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:22.238636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ad47f69-e0c4-4852-82d6-9669067424e0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:22.239179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ad47f69-e0c4-4852-82d6-9669067424e0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:22.239681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ad47f69-e0c4-4852-82d6-9669067424e0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:22.297375 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1ad47f69-e0c4-4852-82d6-9669067424e0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089862 Sep 08 13:57:22.298145 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3326/6783] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:57:22 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:23.320614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a536963c-f3d9-4cf7-92d4-d7eef5fea160 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:23.323214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a536963c-f3d9-4cf7-92d4-d7eef5fea160 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:23.331339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a536963c-f3d9-4cf7-92d4-d7eef5fea160 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:23.331837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a536963c-f3d9-4cf7-92d4-d7eef5fea160 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:23.332409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a536963c-f3d9-4cf7-92d4-d7eef5fea160 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:23.333214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a536963c-f3d9-4cf7-92d4-d7eef5fea160 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:23.333654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a536963c-f3d9-4cf7-92d4-d7eef5fea160 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:23.334072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a536963c-f3d9-4cf7-92d4-d7eef5fea160 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:23.378773 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a536963c-f3d9-4cf7-92d4-d7eef5fea160 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067698 Sep 08 13:57:23.383338 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3458/6784] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:57:23 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:24.396717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ad28d22c-5113-4ffa-b7f1-07a53f7f0260 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:24.400100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ad28d22c-5113-4ffa-b7f1-07a53f7f0260 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:24.408972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad28d22c-5113-4ffa-b7f1-07a53f7f0260 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:24.409594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad28d22c-5113-4ffa-b7f1-07a53f7f0260 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:24.409857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad28d22c-5113-4ffa-b7f1-07a53f7f0260 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:24.410547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad28d22c-5113-4ffa-b7f1-07a53f7f0260 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:24.410997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad28d22c-5113-4ffa-b7f1-07a53f7f0260 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:24.411457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ad28d22c-5113-4ffa-b7f1-07a53f7f0260 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:24.452891 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ad28d22c-5113-4ffa-b7f1-07a53f7f0260 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060700 Sep 08 13:57:24.454236 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3327/6785] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:57:24 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:25.472276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7c96e6ee-5fc3-442b-8a68-7cbc40cde512 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:25.474902 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7c96e6ee-5fc3-442b-8a68-7cbc40cde512 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:25.484670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c96e6ee-5fc3-442b-8a68-7cbc40cde512 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:25.485158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c96e6ee-5fc3-442b-8a68-7cbc40cde512 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:25.485624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c96e6ee-5fc3-442b-8a68-7cbc40cde512 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:25.486406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c96e6ee-5fc3-442b-8a68-7cbc40cde512 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:25.486952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c96e6ee-5fc3-442b-8a68-7cbc40cde512 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:25.487443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7c96e6ee-5fc3-442b-8a68-7cbc40cde512 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:25.557366 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7c96e6ee-5fc3-442b-8a68-7cbc40cde512 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091547 Sep 08 13:57:25.558262 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3459/6786] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:57:25 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:26.579878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1182d020-ec51-4a4b-b2cc-c50f6dcab181 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:26.583814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1182d020-ec51-4a4b-b2cc-c50f6dcab181 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:26.597301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1182d020-ec51-4a4b-b2cc-c50f6dcab181 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:26.598219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1182d020-ec51-4a4b-b2cc-c50f6dcab181 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:26.599044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1182d020-ec51-4a4b-b2cc-c50f6dcab181 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:26.600387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1182d020-ec51-4a4b-b2cc-c50f6dcab181 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:26.601832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1182d020-ec51-4a4b-b2cc-c50f6dcab181 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:26.602659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1182d020-ec51-4a4b-b2cc-c50f6dcab181 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:26.649214 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1182d020-ec51-4a4b-b2cc-c50f6dcab181 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077237 Sep 08 13:57:26.649804 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3328/6787] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:57:26 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:27.665234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fa4aed14-686d-4ae7-b1d3-26d99b1b1648 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:27.668162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fa4aed14-686d-4ae7-b1d3-26d99b1b1648 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:27.676822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa4aed14-686d-4ae7-b1d3-26d99b1b1648 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:27.677326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa4aed14-686d-4ae7-b1d3-26d99b1b1648 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:27.677776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa4aed14-686d-4ae7-b1d3-26d99b1b1648 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:27.678488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa4aed14-686d-4ae7-b1d3-26d99b1b1648 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:27.678953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa4aed14-686d-4ae7-b1d3-26d99b1b1648 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:27.679473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fa4aed14-686d-4ae7-b1d3-26d99b1b1648 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:27.718234 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fa4aed14-686d-4ae7-b1d3-26d99b1b1648 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059412 Sep 08 13:57:27.718853 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3460/6788] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:57:27 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:57:27.730101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-94ab94a2-4296-4578-96e8-4d9bc90b3995 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:27.730700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-94ab94a2-4296-4578-96e8-4d9bc90b3995 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:27.737681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ab94a2-4296-4578-96e8-4d9bc90b3995 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:27.738184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ab94a2-4296-4578-96e8-4d9bc90b3995 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:27.738604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ab94a2-4296-4578-96e8-4d9bc90b3995 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:27.739338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ab94a2-4296-4578-96e8-4d9bc90b3995 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:27.739792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ab94a2-4296-4578-96e8-4d9bc90b3995 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:27.740211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ab94a2-4296-4578-96e8-4d9bc90b3995 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:27.825631 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-94ab94a2-4296-4578-96e8-4d9bc90b3995 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] HTTP exception thrown: Instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 is not attached to volume c7834f0a-0890-4cb7-98ac-632c76c0ed59 Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-94ab94a2-4296-4578-96e8-4d9bc90b3995 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Request method failure captured: Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments/c7834f0a-0890-4cb7-98ac-632c76c0ed59 HTTP/1.1 Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfSdozlC-XxF40Wwr4DW3-67ukj4HQrgvp0tS_YdwieAMm0Enfz5Ha0s1a1nRkHx06nlWEjCKwXcQkGZ9vBTqGfaA4zY0g1UdOgNeYjvPR66e7Hpg0UZ_T-ajN1TOo6KVRMAOVogkkhlqtIetH6Ba1qFJm2vQFdEfWNSr1MFujp-2Tw Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 2777eb38f6d04e3fa15f25023ca4ef6d Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 2777eb38f6d04e3fa15f25023ca4ef6d Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestEncryptedCinderVolumes-505658567-project Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 7f3fd079afe44180933a5a6723e0d1b3 Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestEncryptedCinderVolumes-505658567-project Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 is not attached to volume c7834f0a-0890-4cb7-98ac-632c76c0ed59 Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'server_id': '54dc310d-ee5b-44e5-a08c-a9f31f8c8860', 'id': 'c7834f0a-0890-4cb7-98ac-632c76c0ed59'} Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id c7834f0a-0890-4cb7-98ac-632c76c0ed59. Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 is not attached to volume c7834f0a-0890-4cb7-98ac-632c76c0ed59 Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:57:27.835729 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:57:27.844210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:57:27.844210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:57:27.844210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 is not attached to volume c7834f0a-0890-4cb7-98ac-632c76c0ed59 Sep 08 13:57:27.844210 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:57:27.844210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-94ab94a2-4296-4578-96e8-4d9bc90b3995 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Returning 404 to user: Instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 is not attached to volume c7834f0a-0890-4cb7-98ac-632c76c0ed59 {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:57:27.844210 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-94ab94a2-4296-4578-96e8-4d9bc90b3995 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "DELETE /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments/c7834f0a-0890-4cb7-98ac-632c76c0ed59" status: 404 len: 154 microversion: 2.1 time: 0.111414 Sep 08 13:57:27.844210 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3329/6789] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:57:27 2022] DELETE /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860/os-volume_attachments/c7834f0a-0890-4cb7-98ac-632c76c0ed59 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:57:31.282939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-35543fa6-16c0-4384-be55-08312a73ecad tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:31.283700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-35543fa6-16c0-4384-be55-08312a73ecad tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:31.291931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35543fa6-16c0-4384-be55-08312a73ecad tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:31.292435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35543fa6-16c0-4384-be55-08312a73ecad tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:31.292890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35543fa6-16c0-4384-be55-08312a73ecad tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:31.293653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35543fa6-16c0-4384-be55-08312a73ecad tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:31.294163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35543fa6-16c0-4384-be55-08312a73ecad tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:31.294623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35543fa6-16c0-4384-be55-08312a73ecad tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:31.327959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-35543fa6-16c0-4384-be55-08312a73ecad tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:57:31.427191 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-35543fa6-16c0-4384-be55-08312a73ecad tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "DELETE /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 204 len: 0 microversion: 2.1 time: 0.148915 Sep 08 13:57:31.431291 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3461/6790] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:57:31 2022] DELETE /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 13:57:31.441496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e54fe7a-b4c3-4e4d-9c76-8bfd1e01502c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:31.442743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6e54fe7a-b4c3-4e4d-9c76-8bfd1e01502c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:31.451807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e54fe7a-b4c3-4e4d-9c76-8bfd1e01502c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:31.452297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e54fe7a-b4c3-4e4d-9c76-8bfd1e01502c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:31.452739 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e54fe7a-b4c3-4e4d-9c76-8bfd1e01502c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:31.453460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e54fe7a-b4c3-4e4d-9c76-8bfd1e01502c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:31.453921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e54fe7a-b4c3-4e4d-9c76-8bfd1e01502c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:31.454343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e54fe7a-b4c3-4e4d-9c76-8bfd1e01502c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:31.610532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6e54fe7a-b4c3-4e4d-9c76-8bfd1e01502c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:31.626130 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e54fe7a-b4c3-4e4d-9c76-8bfd1e01502c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1561 microversion: 2.1 time: 0.191345 Sep 08 13:57:31.627537 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3330/6791] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:31 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1561 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:32.662823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-113b01f9-8343-4d5a-95d1-615d50acb1d9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:32.663729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-113b01f9-8343-4d5a-95d1-615d50acb1d9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:32.671794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-113b01f9-8343-4d5a-95d1-615d50acb1d9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:32.672303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-113b01f9-8343-4d5a-95d1-615d50acb1d9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:32.672753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-113b01f9-8343-4d5a-95d1-615d50acb1d9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:32.673738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-113b01f9-8343-4d5a-95d1-615d50acb1d9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:32.674212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-113b01f9-8343-4d5a-95d1-615d50acb1d9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:32.674658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-113b01f9-8343-4d5a-95d1-615d50acb1d9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:32.834703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-113b01f9-8343-4d5a-95d1-615d50acb1d9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:32.845173 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-113b01f9-8343-4d5a-95d1-615d50acb1d9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1561 microversion: 2.1 time: 0.186737 Sep 08 13:57:32.846192 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3462/6792] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:32 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1561 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:33.718863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-6a33cf52-4297-4909-bb5a-9a9c0c2103a7 req-dec62a52-52ef-4a57-b058-2a8b3d52daee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54dc310d-ee5b-44e5-a08c-a9f31f8c8860", "name": "network-vif-deleted", "tag": "19d9a226-40a6-4190-ba89-39d3b30799da"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:33.733770 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6a33cf52-4297-4909-bb5a-9a9c0c2103a7 req-dec62a52-52ef-4a57-b058-2a8b3d52daee service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:33.734282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6a33cf52-4297-4909-bb5a-9a9c0c2103a7 req-dec62a52-52ef-4a57-b058-2a8b3d52daee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:33.735078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6a33cf52-4297-4909-bb5a-9a9c0c2103a7 req-dec62a52-52ef-4a57-b058-2a8b3d52daee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:33.760798 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-6a33cf52-4297-4909-bb5a-9a9c0c2103a7 req-dec62a52-52ef-4a57-b058-2a8b3d52daee service nova] Creating event network-vif-deleted:19d9a226-40a6-4190-ba89-39d3b30799da for instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 on n-h2-852084-10 Sep 08 13:57:33.768287 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-6a33cf52-4297-4909-bb5a-9a9c0c2103a7 req-dec62a52-52ef-4a57-b058-2a8b3d52daee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053915 Sep 08 13:57:33.769649 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3331/6793] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:33.874462 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:33.875401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:33.884161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:33.884741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:33.885206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:33.886037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:33.886522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:33.887049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:33.931293 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:33.931968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:33.932421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:33.933471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lazy-loading 'fault' on Instance uuid 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:57:33.981264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:33.993017 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ab98dc21-e6dc-4cc4-8fd4-7b4f9d6f3b5c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 200 len: 1352 microversion: 2.1 time: 0.122796 Sep 08 13:57:33.993890 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3463/6794] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:33 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 1352 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:35.027869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1f366f0e-2e2b-40b1-96a3-bc31d12d353f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:35.028915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1f366f0e-2e2b-40b1-96a3-bc31d12d353f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 54dc310d-ee5b-44e5-a08c-a9f31f8c8860] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:35.037575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f366f0e-2e2b-40b1-96a3-bc31d12d353f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:35.038248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f366f0e-2e2b-40b1-96a3-bc31d12d353f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:35.038615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f366f0e-2e2b-40b1-96a3-bc31d12d353f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:35.039460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f366f0e-2e2b-40b1-96a3-bc31d12d353f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:35.040169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f366f0e-2e2b-40b1-96a3-bc31d12d353f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:35.040827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1f366f0e-2e2b-40b1-96a3-bc31d12d353f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:35.062189 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-1f366f0e-2e2b-40b1-96a3-bc31d12d353f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] HTTP exception thrown: Instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 could not be found. Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1f366f0e-2e2b-40b1-96a3-bc31d12d353f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Request method failure captured: Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 HTTP/1.1 Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfSdozlC-XxF40Wwr4DW3-67ukj4HQrgvp0tS_YdwieAMm0Enfz5Ha0s1a1nRkHx06nlWEjCKwXcQkGZ9vBTqGfaA4zY0g1UdOgNeYjvPR66e7Hpg0UZ_T-ajN1TOo6KVRMAOVogkkhlqtIetH6Ba1qFJm2vQFdEfWNSr1MFujp-2Tw Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 2777eb38f6d04e3fa15f25023ca4ef6d Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 2777eb38f6d04e3fa15f25023ca4ef6d Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestEncryptedCinderVolumes-505658567-project Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 7f3fd079afe44180933a5a6723e0d1b3 Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestEncryptedCinderVolumes-505658567-project Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 could not be found. Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '54dc310d-ee5b-44e5-a08c-a9f31f8c8860'} Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 could not be found. Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 could not be found. Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:57:35.064291 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:57:35.072845 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:57:35.072845 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:57:35.072845 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:57:35.072845 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:57:35.072845 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:57:35.072845 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 could not be found. Sep 08 13:57:35.072845 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 13:57:35.072845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1f366f0e-2e2b-40b1-96a3-bc31d12d353f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Returning 404 to user: Instance 54dc310d-ee5b-44e5-a08c-a9f31f8c8860 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:57:35.072845 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1f366f0e-2e2b-40b1-96a3-bc31d12d353f tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860" status: 404 len: 111 microversion: 2.1 time: 0.044996 Sep 08 13:57:35.072845 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3332/6795] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:35 2022] GET /compute/v2.1/servers/54dc310d-ee5b-44e5-a08c-a9f31f8c8860 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:57:35.079978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b414aa8f-e43e-4e97-9398-379df3e0d197 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '.version_select at 0x7fdb37363ee0>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:35.118860 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b414aa8f-e43e-4e97-9398-379df3e0d197 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-501827073" status: 202 len: 0 microversion: 2.1 time: 0.045147 Sep 08 13:57:35.119704 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3464/6796] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:57:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-501827073 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:57:35.149316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-324aaa43-fbd2-4ba6-baff-0c1a7f665a4c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Action: 'create', calling method: .version_select at 0x7fdb3b086280>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-872987699", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrCkXsP3AfC36dBOytKNJn9o4d7Rwo/LyPDPQhYZRwsLeXCNZ+H90ZARSLg+LnwFVkazQ6O034sQbyGTenUVhCah88Sl9MlA/sENVbeRlHyFSw18gFKeypi7UUPJfSo6w=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:35.169602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-324aaa43-fbd2-4ba6-baff-0c1a7f665a4c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Getting quotas for project 2777eb38f6d04e3fa15f25023ca4ef6d. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:57:35.181361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-324aaa43-fbd2-4ba6-baff-0c1a7f665a4c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Getting quotas for user 7f3fd079afe44180933a5a6723e0d1b3 and project 2777eb38f6d04e3fa15f25023ca4ef6d. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:57:35.223818 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-324aaa43-fbd2-4ba6-baff-0c1a7f665a4c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.079105 Sep 08 13:57:35.226684 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3333/6797] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:57:35 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:35.313146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1502348804", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-872987699", "networks": [{"uuid": "845e58f3-8975-4913-ba96-b80104e8bcc0"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:35.412474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] validate_networks() for [('845e58f3-8975-4913-ba96-b80104e8bcc0', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:57:35.941523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:57:35.942098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:57:35.942596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:57:35.943030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:57:35.943501 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:57:35.953354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:35.954142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:35.955134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:35.955366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:35.955843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:35.956286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:35.982560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Getting quotas for project 2777eb38f6d04e3fa15f25023ca4ef6d. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:57:35.990739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Getting quotas for user 7f3fd079afe44180933a5a6723e0d1b3 and project 2777eb38f6d04e3fa15f25023ca4ef6d. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:57:36.007973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:57:36.010356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:57:36.073259 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7a418f9e-a481-4b35-8cf3-50231a7c6828 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.776503 Sep 08 13:57:36.073998 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3465/6798] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:57:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:57:36.090254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-09a1de88-f22c-417e-a8aa-3ecf566729b4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:36.094777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-09a1de88-f22c-417e-a8aa-3ecf566729b4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:36.169808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-09a1de88-f22c-417e-a8aa-3ecf566729b4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:36.179209 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-09a1de88-f22c-417e-a8aa-3ecf566729b4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1262 microversion: 2.1 time: 0.096166 Sep 08 13:57:36.180176 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3334/6799] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:36 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1262 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:37.214749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6eec0f22-5c35-4cd3-afb4-a0f64cff44f8 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:37.215666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6eec0f22-5c35-4cd3-afb4-a0f64cff44f8 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:37.226104 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6eec0f22-5c35-4cd3-afb4-a0f64cff44f8 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:37.226997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6eec0f22-5c35-4cd3-afb4-a0f64cff44f8 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:37.227694 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6eec0f22-5c35-4cd3-afb4-a0f64cff44f8 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:37.228955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6eec0f22-5c35-4cd3-afb4-a0f64cff44f8 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:37.229654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6eec0f22-5c35-4cd3-afb4-a0f64cff44f8 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:37.230378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6eec0f22-5c35-4cd3-afb4-a0f64cff44f8 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:37.327805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6eec0f22-5c35-4cd3-afb4-a0f64cff44f8 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:37.341437 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6eec0f22-5c35-4cd3-afb4-a0f64cff44f8 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1314 microversion: 2.1 time: 0.134035 Sep 08 13:57:37.342592 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3466/6800] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:37 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1314 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:38.380335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-75bd8040-0abd-422a-9e4e-c9194295f248 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:38.382774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-75bd8040-0abd-422a-9e4e-c9194295f248 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:38.398615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75bd8040-0abd-422a-9e4e-c9194295f248 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:38.399187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75bd8040-0abd-422a-9e4e-c9194295f248 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:38.399666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75bd8040-0abd-422a-9e4e-c9194295f248 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:38.400533 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75bd8040-0abd-422a-9e4e-c9194295f248 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:38.400991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75bd8040-0abd-422a-9e4e-c9194295f248 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:38.401474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-75bd8040-0abd-422a-9e4e-c9194295f248 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:38.670264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-75bd8040-0abd-422a-9e4e-c9194295f248 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:38.685470 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-75bd8040-0abd-422a-9e4e-c9194295f248 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1362 microversion: 2.1 time: 0.310092 Sep 08 13:57:38.686857 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3335/6801] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:38 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:39.433687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-8a15b23a-441d-41db-9374-f4a1673dc1c3 req-e52b78ad-269a-4cb9-9977-41d2d9ac5504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c7c8efa-8ed1-4094-ad07-e7fc3f312e71", "tag": "cbc14819-f06d-479c-b6d6-c7122e3610aa"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:39.448146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8a15b23a-441d-41db-9374-f4a1673dc1c3 req-e52b78ad-269a-4cb9-9977-41d2d9ac5504 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:39.448872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8a15b23a-441d-41db-9374-f4a1673dc1c3 req-e52b78ad-269a-4cb9-9977-41d2d9ac5504 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:39.449400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8a15b23a-441d-41db-9374-f4a1673dc1c3 req-e52b78ad-269a-4cb9-9977-41d2d9ac5504 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:39.464730 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-8a15b23a-441d-41db-9374-f4a1673dc1c3 req-e52b78ad-269a-4cb9-9977-41d2d9ac5504 service nova] Creating event network-changed:cbc14819-f06d-479c-b6d6-c7122e3610aa for instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 on n-h2-852084-10 Sep 08 13:57:39.469945 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-8a15b23a-441d-41db-9374-f4a1673dc1c3 req-e52b78ad-269a-4cb9-9977-41d2d9ac5504 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041533 Sep 08 13:57:39.470576 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3467/6802] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:57:39.721210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c7bbfdb1-735b-446e-9e10-cb77cc4105d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:39.722454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c7bbfdb1-735b-446e-9e10-cb77cc4105d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:39.734850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7bbfdb1-735b-446e-9e10-cb77cc4105d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:39.735750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7bbfdb1-735b-446e-9e10-cb77cc4105d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:39.736530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7bbfdb1-735b-446e-9e10-cb77cc4105d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:39.737751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7bbfdb1-735b-446e-9e10-cb77cc4105d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:39.738929 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7bbfdb1-735b-446e-9e10-cb77cc4105d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:39.739350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c7bbfdb1-735b-446e-9e10-cb77cc4105d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:40.117005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c7bbfdb1-735b-446e-9e10-cb77cc4105d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:40.127341 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c7bbfdb1-735b-446e-9e10-cb77cc4105d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1362 microversion: 2.1 time: 0.413860 Sep 08 13:57:40.128437 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3336/6803] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:39 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1362 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:41.168286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-83e39ef0-5207-4ec9-b5d9-3ff8aad19d3a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:41.169258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-83e39ef0-5207-4ec9-b5d9-3ff8aad19d3a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:41.182097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83e39ef0-5207-4ec9-b5d9-3ff8aad19d3a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:41.184594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83e39ef0-5207-4ec9-b5d9-3ff8aad19d3a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:41.185353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83e39ef0-5207-4ec9-b5d9-3ff8aad19d3a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:41.186382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83e39ef0-5207-4ec9-b5d9-3ff8aad19d3a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:41.186886 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83e39ef0-5207-4ec9-b5d9-3ff8aad19d3a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:41.187367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83e39ef0-5207-4ec9-b5d9-3ff8aad19d3a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:41.492399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83e39ef0-5207-4ec9-b5d9-3ff8aad19d3a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:41.503325 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-83e39ef0-5207-4ec9-b5d9-3ff8aad19d3a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1362 microversion: 2.1 time: 0.341778 Sep 08 13:57:41.504203 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3468/6804] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:41 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:42.531202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-28d06b00-6c47-4410-b240-b5d04fc04f73 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:42.533601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-28d06b00-6c47-4410-b240-b5d04fc04f73 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:42.546900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28d06b00-6c47-4410-b240-b5d04fc04f73 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.547797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28d06b00-6c47-4410-b240-b5d04fc04f73 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.548840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28d06b00-6c47-4410-b240-b5d04fc04f73 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.550139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28d06b00-6c47-4410-b240-b5d04fc04f73 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:42.550990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28d06b00-6c47-4410-b240-b5d04fc04f73 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:42.551819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28d06b00-6c47-4410-b240-b5d04fc04f73 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:42.763638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-28d06b00-6c47-4410-b240-b5d04fc04f73 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:42.776278 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-28d06b00-6c47-4410-b240-b5d04fc04f73 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1362 microversion: 2.1 time: 0.250383 Sep 08 13:57:42.777475 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3337/6805] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:42 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:43.813263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-35f4875f-71e7-4d06-a7bd-594261fdc27c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:43.814053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-35f4875f-71e7-4d06-a7bd-594261fdc27c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:43.822826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35f4875f-71e7-4d06-a7bd-594261fdc27c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:43.823470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35f4875f-71e7-4d06-a7bd-594261fdc27c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:43.823990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35f4875f-71e7-4d06-a7bd-594261fdc27c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:43.824809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35f4875f-71e7-4d06-a7bd-594261fdc27c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:43.825356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35f4875f-71e7-4d06-a7bd-594261fdc27c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:43.826044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-35f4875f-71e7-4d06-a7bd-594261fdc27c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:44.053935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-35f4875f-71e7-4d06-a7bd-594261fdc27c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:44.063883 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-35f4875f-71e7-4d06-a7bd-594261fdc27c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1362 microversion: 2.1 time: 0.255552 Sep 08 13:57:44.065009 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3469/6806] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:43 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:57:45.092487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-706fdd0a-eb10-4d70-99d1-387eab23ca4d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:45.093680 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-706fdd0a-eb10-4d70-99d1-387eab23ca4d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:45.106494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-706fdd0a-eb10-4d70-99d1-387eab23ca4d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:45.107423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-706fdd0a-eb10-4d70-99d1-387eab23ca4d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:45.108151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-706fdd0a-eb10-4d70-99d1-387eab23ca4d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:45.109044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-706fdd0a-eb10-4d70-99d1-387eab23ca4d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:45.109804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-706fdd0a-eb10-4d70-99d1-387eab23ca4d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:45.110335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-706fdd0a-eb10-4d70-99d1-387eab23ca4d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:45.308136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-706fdd0a-eb10-4d70-99d1-387eab23ca4d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:45.322011 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-706fdd0a-eb10-4d70-99d1-387eab23ca4d tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1362 microversion: 2.1 time: 0.235948 Sep 08 13:57:45.322982 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3338/6807] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:45 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1362 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:45.885943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-002d5638-30ff-466f-a3bf-48ae81279069 req-e840aba1-c45e-4a41-a61a-de34d37d505a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7c8efa-8ed1-4094-ad07-e7fc3f312e71", "name": "network-vif-plugged", "status": "completed", "tag": "cbc14819-f06d-479c-b6d6-c7122e3610aa"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:45.903166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-002d5638-30ff-466f-a3bf-48ae81279069 req-e840aba1-c45e-4a41-a61a-de34d37d505a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:45.904151 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-002d5638-30ff-466f-a3bf-48ae81279069 req-e840aba1-c45e-4a41-a61a-de34d37d505a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:45.904695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-002d5638-30ff-466f-a3bf-48ae81279069 req-e840aba1-c45e-4a41-a61a-de34d37d505a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:45.928219 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-002d5638-30ff-466f-a3bf-48ae81279069 req-e840aba1-c45e-4a41-a61a-de34d37d505a service nova] Creating event network-vif-plugged:cbc14819-f06d-479c-b6d6-c7122e3610aa for instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 on n-h2-852084-10 Sep 08 13:57:45.938934 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-002d5638-30ff-466f-a3bf-48ae81279069 req-e840aba1-c45e-4a41-a61a-de34d37d505a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059427 Sep 08 13:57:45.940440 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3470/6808] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:57:46.351149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-671b2c0f-0837-4105-9262-fc5213b4adf6 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:46.352256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-671b2c0f-0837-4105-9262-fc5213b4adf6 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:46.356354 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:46.362312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-671b2c0f-0837-4105-9262-fc5213b4adf6 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:46.362828 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-671b2c0f-0837-4105-9262-fc5213b4adf6 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:46.363335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-671b2c0f-0837-4105-9262-fc5213b4adf6 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:46.364051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-671b2c0f-0837-4105-9262-fc5213b4adf6 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:46.364582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-671b2c0f-0837-4105-9262-fc5213b4adf6 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:46.365589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-671b2c0f-0837-4105-9262-fc5213b4adf6 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:46.518665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-671b2c0f-0837-4105-9262-fc5213b4adf6 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:46.531061 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-671b2c0f-0837-4105-9262-fc5213b4adf6 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1362 microversion: 2.1 time: 0.184617 Sep 08 13:57:46.532083 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3339/6809] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:46 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:47.556952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:47.558003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:47.563424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dda89698-a808-40ce-90ce-90937eeddaa7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:47.564163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dda89698-a808-40ce-90ce-90937eeddaa7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:47.576851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dda89698-a808-40ce-90ce-90937eeddaa7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:47.577780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dda89698-a808-40ce-90ce-90937eeddaa7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:47.578592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dda89698-a808-40ce-90ce-90937eeddaa7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:47.580011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dda89698-a808-40ce-90ce-90937eeddaa7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:47.580890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dda89698-a808-40ce-90ce-90937eeddaa7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:47.581693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dda89698-a808-40ce-90ce-90937eeddaa7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:47.776955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dda89698-a808-40ce-90ce-90937eeddaa7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:47.785545 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dda89698-a808-40ce-90ce-90937eeddaa7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1554 microversion: 2.1 time: 0.229585 Sep 08 13:57:47.786242 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3471/6810] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:47 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:47.810052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-746ce897-2e67-4f61-b121-d99b64c36fea tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:57:47.810624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-746ce897-2e67-4f61-b121-d99b64c36fea tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:47.818155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-746ce897-2e67-4f61-b121-d99b64c36fea tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:47.818704 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-746ce897-2e67-4f61-b121-d99b64c36fea tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:47.819492 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-746ce897-2e67-4f61-b121-d99b64c36fea tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:47.820168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-746ce897-2e67-4f61-b121-d99b64c36fea tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:47.820693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-746ce897-2e67-4f61-b121-d99b64c36fea tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:47.821169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-746ce897-2e67-4f61-b121-d99b64c36fea tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:48.007622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-746ce897-2e67-4f61-b121-d99b64c36fea tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:57:48.019492 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-746ce897-2e67-4f61-b121-d99b64c36fea tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1554 microversion: 2.1 time: 0.213124 Sep 08 13:57:48.020508 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3340/6811] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:57:47 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1554 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:57:50.832895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-abc0a4d7-c160-4589-afe3-40181bbccacf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7792cfb0-4b82-4d61-be14-bb7fb6acdaec"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:57:50.837666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-abc0a4d7-c160-4589-afe3-40181bbccacf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:57:50.850288 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abc0a4d7-c160-4589-afe3-40181bbccacf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:50.851429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abc0a4d7-c160-4589-afe3-40181bbccacf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:50.852095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abc0a4d7-c160-4589-afe3-40181bbccacf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:50.853171 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abc0a4d7-c160-4589-afe3-40181bbccacf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:57:50.853967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abc0a4d7-c160-4589-afe3-40181bbccacf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:57:50.854730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-abc0a4d7-c160-4589-afe3-40181bbccacf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:57:51.188800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:57:51.214564 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-abc0a4d7-c160-4589-afe3-40181bbccacf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "POST /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.389340 Sep 08 13:57:51.215290 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3472/6812] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:57:50 2022] POST /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:03.334254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:03.335130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=70 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:03.341156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-56e0d2ee-8b74-4047-b5e0-308a504c2c4a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:03.341744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-56e0d2ee-8b74-4047-b5e0-308a504c2c4a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:03.352650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56e0d2ee-8b74-4047-b5e0-308a504c2c4a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:03.353422 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56e0d2ee-8b74-4047-b5e0-308a504c2c4a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:03.353871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56e0d2ee-8b74-4047-b5e0-308a504c2c4a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:03.354799 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56e0d2ee-8b74-4047-b5e0-308a504c2c4a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:03.355487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56e0d2ee-8b74-4047-b5e0-308a504c2c4a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:03.355971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56e0d2ee-8b74-4047-b5e0-308a504c2c4a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:03.462615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-56e0d2ee-8b74-4047-b5e0-308a504c2c4a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lazy-loading 'services' on Instance uuid 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:03.543615 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-56e0d2ee-8b74-4047-b5e0-308a504c2c4a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments/7792cfb0-4b82-4d61-be14-bb7fb6acdaec" status: 202 len: 0 microversion: 2.1 time: 0.211127 Sep 08 13:58:03.544244 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3341/6813] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:58:03 2022] DELETE /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments/7792cfb0-4b82-4d61-be14-bb7fb6acdaec => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:58:03.552665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:03.553568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:03.558579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-01d83502-9526-4310-b480-b23453c2b1f1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:03.561212 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-01d83502-9526-4310-b480-b23453c2b1f1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:03.575991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01d83502-9526-4310-b480-b23453c2b1f1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:03.577417 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01d83502-9526-4310-b480-b23453c2b1f1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:03.578282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01d83502-9526-4310-b480-b23453c2b1f1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:03.579639 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01d83502-9526-4310-b480-b23453c2b1f1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:03.580540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01d83502-9526-4310-b480-b23453c2b1f1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:03.581352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-01d83502-9526-4310-b480-b23453c2b1f1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:03.644494 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-01d83502-9526-4310-b480-b23453c2b1f1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094170 Sep 08 13:58:03.645283 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3473/6814] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:03 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:04.660892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-61d40e87-00e2-448b-a267-8de31f7108f4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:04.663286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-61d40e87-00e2-448b-a267-8de31f7108f4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:04.673257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61d40e87-00e2-448b-a267-8de31f7108f4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:04.674137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61d40e87-00e2-448b-a267-8de31f7108f4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:04.674573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61d40e87-00e2-448b-a267-8de31f7108f4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:04.675484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61d40e87-00e2-448b-a267-8de31f7108f4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:04.676625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61d40e87-00e2-448b-a267-8de31f7108f4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:04.677331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-61d40e87-00e2-448b-a267-8de31f7108f4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:04.715918 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-61d40e87-00e2-448b-a267-8de31f7108f4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061548 Sep 08 13:58:04.716508 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3342/6815] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:04 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:05.731158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3c823a3a-9a85-477a-99aa-0743d93e6082 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:05.733601 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3c823a3a-9a85-477a-99aa-0743d93e6082 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:05.742913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c823a3a-9a85-477a-99aa-0743d93e6082 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:05.743656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c823a3a-9a85-477a-99aa-0743d93e6082 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:05.744268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c823a3a-9a85-477a-99aa-0743d93e6082 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:05.745170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c823a3a-9a85-477a-99aa-0743d93e6082 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:05.746389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c823a3a-9a85-477a-99aa-0743d93e6082 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:05.747124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3c823a3a-9a85-477a-99aa-0743d93e6082 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:05.802668 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3c823a3a-9a85-477a-99aa-0743d93e6082 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075488 Sep 08 13:58:05.805034 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3474/6816] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:05 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:06.819327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-41bb2ef3-8fa5-439e-b35b-712af5ce3b59 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:06.821580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-41bb2ef3-8fa5-439e-b35b-712af5ce3b59 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:06.836305 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41bb2ef3-8fa5-439e-b35b-712af5ce3b59 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:06.836831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41bb2ef3-8fa5-439e-b35b-712af5ce3b59 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:06.837231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41bb2ef3-8fa5-439e-b35b-712af5ce3b59 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:06.837935 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41bb2ef3-8fa5-439e-b35b-712af5ce3b59 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:06.838385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41bb2ef3-8fa5-439e-b35b-712af5ce3b59 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:06.839072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41bb2ef3-8fa5-439e-b35b-712af5ce3b59 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:06.887827 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-41bb2ef3-8fa5-439e-b35b-712af5ce3b59 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072703 Sep 08 13:58:06.888887 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3343/6817] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:06 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:58:07.910114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5e82363a-2418-4312-b12a-0f8c6d1160ae tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:07.916606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5e82363a-2418-4312-b12a-0f8c6d1160ae tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:07.928784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e82363a-2418-4312-b12a-0f8c6d1160ae tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:07.929325 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e82363a-2418-4312-b12a-0f8c6d1160ae tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:07.929808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e82363a-2418-4312-b12a-0f8c6d1160ae tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:07.930580 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e82363a-2418-4312-b12a-0f8c6d1160ae tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:07.931054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e82363a-2418-4312-b12a-0f8c6d1160ae tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:07.931526 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5e82363a-2418-4312-b12a-0f8c6d1160ae tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:07.995679 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5e82363a-2418-4312-b12a-0f8c6d1160ae tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094605 Sep 08 13:58:07.996712 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3475/6818] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:07 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:09.017773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f5a0b6e-a694-4903-b8a3-9dcc009a6edf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:09.020025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f5a0b6e-a694-4903-b8a3-9dcc009a6edf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:09.027560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f5a0b6e-a694-4903-b8a3-9dcc009a6edf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:09.028050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f5a0b6e-a694-4903-b8a3-9dcc009a6edf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:09.028481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f5a0b6e-a694-4903-b8a3-9dcc009a6edf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:09.029183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f5a0b6e-a694-4903-b8a3-9dcc009a6edf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:09.029634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f5a0b6e-a694-4903-b8a3-9dcc009a6edf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:09.030055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f5a0b6e-a694-4903-b8a3-9dcc009a6edf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:09.064744 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f5a0b6e-a694-4903-b8a3-9dcc009a6edf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056647 Sep 08 13:58:09.065361 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3344/6819] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:09 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:58:09.082895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd6012b6-b26d-4753-8843-94a63ea81fdf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:09.083760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dd6012b6-b26d-4753-8843-94a63ea81fdf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:09.092763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6012b6-b26d-4753-8843-94a63ea81fdf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:09.093278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6012b6-b26d-4753-8843-94a63ea81fdf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:09.093742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6012b6-b26d-4753-8843-94a63ea81fdf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:09.094470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6012b6-b26d-4753-8843-94a63ea81fdf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:09.095078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6012b6-b26d-4753-8843-94a63ea81fdf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:09.095425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dd6012b6-b26d-4753-8843-94a63ea81fdf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:09.195554 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-dd6012b6-b26d-4753-8843-94a63ea81fdf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] HTTP exception thrown: Instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 is not attached to volume 7792cfb0-4b82-4d61-be14-bb7fb6acdaec Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd6012b6-b26d-4753-8843-94a63ea81fdf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Request method failure captured: Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments/7792cfb0-4b82-4d61-be14-bb7fb6acdaec HTTP/1.1 Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfSdozlC-XxF40Wwr4DW3-67ukj4HQrgvp0tS_YdwieAMm0Enfz5Ha0s1a1nRkHx06nlWEjCKwXcQkGZ9vBTqGfaA4zY0g1UdOgNeYjvPR66e7Hpg0UZ_T-ajN1TOo6KVRMAOVogkkhlqtIetH6Ba1qFJm2vQFdEfWNSr1MFujp-2Tw Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 2777eb38f6d04e3fa15f25023ca4ef6d Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 2777eb38f6d04e3fa15f25023ca4ef6d Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestEncryptedCinderVolumes-505658567-project Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7f3fd079afe44180933a5a6723e0d1b3 Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestEncryptedCinderVolumes-505658567-project Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 is not attached to volume 7792cfb0-4b82-4d61-be14-bb7fb6acdaec Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'server_id': '9c7c8efa-8ed1-4094-ad07-e7fc3f312e71', 'id': '7792cfb0-4b82-4d61-be14-bb7fb6acdaec'} Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7792cfb0-4b82-4d61-be14-bb7fb6acdaec. Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 is not attached to volume 7792cfb0-4b82-4d61-be14-bb7fb6acdaec Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:09.197605 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:09.206394 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:58:09.206394 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:58:09.206394 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 is not attached to volume 7792cfb0-4b82-4d61-be14-bb7fb6acdaec Sep 08 13:58:09.206394 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:09.206394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dd6012b6-b26d-4753-8843-94a63ea81fdf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Returning 404 to user: Instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 is not attached to volume 7792cfb0-4b82-4d61-be14-bb7fb6acdaec {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:58:09.206394 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dd6012b6-b26d-4753-8843-94a63ea81fdf tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments/7792cfb0-4b82-4d61-be14-bb7fb6acdaec" status: 404 len: 154 microversion: 2.1 time: 0.123674 Sep 08 13:58:09.206394 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3476/6820] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:58:09 2022] DELETE /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71/os-volume_attachments/7792cfb0-4b82-4d61-be14-bb7fb6acdaec => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 13:58:12.707016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6e7d0378-6249-4bb1-ba8b-023e94722abb tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:12.707654 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6e7d0378-6249-4bb1-ba8b-023e94722abb tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:12.716556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e7d0378-6249-4bb1-ba8b-023e94722abb tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:12.717374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e7d0378-6249-4bb1-ba8b-023e94722abb tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:12.717971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e7d0378-6249-4bb1-ba8b-023e94722abb tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:12.719169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e7d0378-6249-4bb1-ba8b-023e94722abb tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:12.720008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e7d0378-6249-4bb1-ba8b-023e94722abb tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:12.720867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6e7d0378-6249-4bb1-ba8b-023e94722abb tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:12.761858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6e7d0378-6249-4bb1-ba8b-023e94722abb tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:58:12.877772 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6e7d0378-6249-4bb1-ba8b-023e94722abb tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 204 len: 0 microversion: 2.1 time: 0.174985 Sep 08 13:58:12.879837 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3345/6821] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:58:12 2022] DELETE /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:58:12.889916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f337ca17-3867-4430-83e3-fe96ad9589ff tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:12.891843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f337ca17-3867-4430-83e3-fe96ad9589ff tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:12.905782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f337ca17-3867-4430-83e3-fe96ad9589ff tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:12.906647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f337ca17-3867-4430-83e3-fe96ad9589ff tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:12.907484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f337ca17-3867-4430-83e3-fe96ad9589ff tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:12.908746 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f337ca17-3867-4430-83e3-fe96ad9589ff tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:12.910208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f337ca17-3867-4430-83e3-fe96ad9589ff tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:12.910835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f337ca17-3867-4430-83e3-fe96ad9589ff tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:13.117668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f337ca17-3867-4430-83e3-fe96ad9589ff tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:13.133384 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f337ca17-3867-4430-83e3-fe96ad9589ff tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1560 microversion: 2.1 time: 0.247534 Sep 08 13:58:13.134242 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3477/6822] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:12 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1560 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:14.159911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5d7bb230-47fa-4990-ae62-b8e0e4704189 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:14.161138 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5d7bb230-47fa-4990-ae62-b8e0e4704189 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:14.170702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d7bb230-47fa-4990-ae62-b8e0e4704189 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:14.171772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d7bb230-47fa-4990-ae62-b8e0e4704189 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:14.172384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d7bb230-47fa-4990-ae62-b8e0e4704189 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:14.173344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d7bb230-47fa-4990-ae62-b8e0e4704189 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:14.174049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d7bb230-47fa-4990-ae62-b8e0e4704189 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:14.174688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5d7bb230-47fa-4990-ae62-b8e0e4704189 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:14.358846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5d7bb230-47fa-4990-ae62-b8e0e4704189 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:14.373913 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5d7bb230-47fa-4990-ae62-b8e0e4704189 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1560 microversion: 2.1 time: 0.219125 Sep 08 13:58:14.374813 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3346/6823] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:14 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:15.090996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-2f5f473e-1389-42ee-a763-6dd4fbce6d36 req-f8158920-7501-4cf0-9114-b95f2d34e49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c7c8efa-8ed1-4094-ad07-e7fc3f312e71", "name": "network-vif-deleted", "tag": "cbc14819-f06d-479c-b6d6-c7122e3610aa"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:15.108309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2f5f473e-1389-42ee-a763-6dd4fbce6d36 req-f8158920-7501-4cf0-9114-b95f2d34e49b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:15.109445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2f5f473e-1389-42ee-a763-6dd4fbce6d36 req-f8158920-7501-4cf0-9114-b95f2d34e49b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:15.110554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-2f5f473e-1389-42ee-a763-6dd4fbce6d36 req-f8158920-7501-4cf0-9114-b95f2d34e49b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:15.132624 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-2f5f473e-1389-42ee-a763-6dd4fbce6d36 req-f8158920-7501-4cf0-9114-b95f2d34e49b service nova] Creating event network-vif-deleted:cbc14819-f06d-479c-b6d6-c7122e3610aa for instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 on n-h2-852084-10 Sep 08 13:58:15.141318 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-2f5f473e-1389-42ee-a763-6dd4fbce6d36 req-f8158920-7501-4cf0-9114-b95f2d34e49b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055231 Sep 08 13:58:15.141953 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3478/6824] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:58:15.406095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:15.406784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:15.418085 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:15.418990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:15.419831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:15.421170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:15.422269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:15.423065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:15.475020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:15.476178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:15.477030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:15.478019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lazy-loading 'fault' on Instance uuid 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:15.534004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:15.549272 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ebfb1183-a35e-4204-92b4-9b4e42cbc5b1 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 200 len: 1352 microversion: 2.1 time: 0.147070 Sep 08 13:58:15.551589 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3347/6825] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:15 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 1352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:16.580339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f7f6cdb8-f4a2-4481-82b1-0f4f7430f805 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:16.582020 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f7f6cdb8-f4a2-4481-82b1-0f4f7430f805 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:16.590333 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f6cdb8-f4a2-4481-82b1-0f4f7430f805 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:16.590798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f6cdb8-f4a2-4481-82b1-0f4f7430f805 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:16.591299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f6cdb8-f4a2-4481-82b1-0f4f7430f805 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:16.592030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f6cdb8-f4a2-4481-82b1-0f4f7430f805 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:16.592506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f6cdb8-f4a2-4481-82b1-0f4f7430f805 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:16.592941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f7f6cdb8-f4a2-4481-82b1-0f4f7430f805 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:16.607474 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-f7f6cdb8-f4a2-4481-82b1-0f4f7430f805 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] HTTP exception thrown: Instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 could not be found. Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f7f6cdb8-f4a2-4481-82b1-0f4f7430f805 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Request method failure captured: Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 HTTP/1.1 Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfSdozlC-XxF40Wwr4DW3-67ukj4HQrgvp0tS_YdwieAMm0Enfz5Ha0s1a1nRkHx06nlWEjCKwXcQkGZ9vBTqGfaA4zY0g1UdOgNeYjvPR66e7Hpg0UZ_T-ajN1TOo6KVRMAOVogkkhlqtIetH6Ba1qFJm2vQFdEfWNSr1MFujp-2Tw Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 2777eb38f6d04e3fa15f25023ca4ef6d Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 2777eb38f6d04e3fa15f25023ca4ef6d Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestEncryptedCinderVolumes-505658567-project Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7f3fd079afe44180933a5a6723e0d1b3 Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestEncryptedCinderVolumes-505658567-project Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 could not be found. Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '9c7c8efa-8ed1-4094-ad07-e7fc3f312e71'} Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 could not be found. Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 could not be found. Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:16.609170 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:16.618490 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:16.618490 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:16.618490 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:16.618490 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:58:16.618490 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:58:16.618490 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 could not be found. Sep 08 13:58:16.618490 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:16.618490 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f7f6cdb8-f4a2-4481-82b1-0f4f7430f805 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Returning 404 to user: Instance 9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:58:16.618490 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f7f6cdb8-f4a2-4481-82b1-0f4f7430f805 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71" status: 404 len: 111 microversion: 2.1 time: 0.035913 Sep 08 13:58:16.618490 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3479/6826] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:16 2022] GET /compute/v2.1/servers/9c7c8efa-8ed1-4094-ad07-e7fc3f312e71 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:58:16.620755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bb4b1c85-e533-4214-a186-04b1a0cc1736 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '.version_select at 0x7fdb39bf0550>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:16.647123 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bb4b1c85-e533-4214-a186-04b1a0cc1736 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-872987699" status: 202 len: 0 microversion: 2.1 time: 0.030916 Sep 08 13:58:16.647840 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3348/6827] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:58:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-872987699 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:58:16.673544 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f0133e72-593c-4b18-82bd-577be1c9236c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Action: 'create', calling method: .version_select at 0x7fdb35cd9430>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-976676042", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGHN1OqO429RWIBKL9C2cKOxfro7T4hlj1W8EsqPb3F4gzm6mopQIVj7VymiW3+j+LPclZCJDxFdjdQqoMhwBYTxRSaQfXWpwQgzvWeuAG1E+GLbM8bLShdgR7iW0aQXVA=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:16.703140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f0133e72-593c-4b18-82bd-577be1c9236c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Getting quotas for project 2777eb38f6d04e3fa15f25023ca4ef6d. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:58:16.709218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-f0133e72-593c-4b18-82bd-577be1c9236c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Getting quotas for user 7f3fd079afe44180933a5a6723e0d1b3 and project 2777eb38f6d04e3fa15f25023ca4ef6d. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:58:16.745812 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f0133e72-593c-4b18-82bd-577be1c9236c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.076045 Sep 08 13:58:16.747373 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3480/6828] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:58:16 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:16.827612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1435893169", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-976676042", "networks": [{"uuid": "845e58f3-8975-4913-ba96-b80104e8bcc0"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:16.906865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] validate_networks() for [('845e58f3-8975-4913-ba96-b80104e8bcc0', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:58:17.457572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:58:17.457994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:58:17.458463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:58:17.458865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:58:17.459296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:58:17.468772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:17.469342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:17.469988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:17.470760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:17.471284 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:17.472383 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:17.491812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Getting quotas for project 2777eb38f6d04e3fa15f25023ca4ef6d. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:58:17.498570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Getting quotas for user 7f3fd079afe44180933a5a6723e0d1b3 and project 2777eb38f6d04e3fa15f25023ca4ef6d. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:58:17.514344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:58:17.516861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:58:17.571008 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-94ef88c9-b781-49ff-b202-3c8630b9c8d4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.750318 Sep 08 13:58:17.571743 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3349/6829] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:58:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:58:17.586008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fb7bb3cb-28ae-45ba-8eeb-aeb07e7ac273 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:17.586686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fb7bb3cb-28ae-45ba-8eeb-aeb07e7ac273 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:17.652055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fb7bb3cb-28ae-45ba-8eeb-aeb07e7ac273 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:17.664737 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fb7bb3cb-28ae-45ba-8eeb-aeb07e7ac273 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1262 microversion: 2.1 time: 0.082304 Sep 08 13:58:17.665855 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3481/6830] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:17 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:18.708731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1aed7747-9c4f-46fa-821b-ba9efba2286b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:18.709771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1aed7747-9c4f-46fa-821b-ba9efba2286b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:18.722070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1aed7747-9c4f-46fa-821b-ba9efba2286b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:18.722924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1aed7747-9c4f-46fa-821b-ba9efba2286b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:18.723744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1aed7747-9c4f-46fa-821b-ba9efba2286b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:18.724966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1aed7747-9c4f-46fa-821b-ba9efba2286b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:18.725759 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1aed7747-9c4f-46fa-821b-ba9efba2286b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:18.726518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1aed7747-9c4f-46fa-821b-ba9efba2286b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:18.825110 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1aed7747-9c4f-46fa-821b-ba9efba2286b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:18.838196 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1aed7747-9c4f-46fa-821b-ba9efba2286b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1314 microversion: 2.1 time: 0.136910 Sep 08 13:58:18.838994 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3350/6831] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:18 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1314 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:19.868420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a47410ee-fb3c-4ed7-8bd0-25bd0cca6252 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:19.869554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a47410ee-fb3c-4ed7-8bd0-25bd0cca6252 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:19.879312 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a47410ee-fb3c-4ed7-8bd0-25bd0cca6252 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:19.880085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a47410ee-fb3c-4ed7-8bd0-25bd0cca6252 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:19.880760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a47410ee-fb3c-4ed7-8bd0-25bd0cca6252 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:19.881626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a47410ee-fb3c-4ed7-8bd0-25bd0cca6252 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:19.882240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a47410ee-fb3c-4ed7-8bd0-25bd0cca6252 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:19.882832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a47410ee-fb3c-4ed7-8bd0-25bd0cca6252 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:20.268940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a47410ee-fb3c-4ed7-8bd0-25bd0cca6252 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:20.280670 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a47410ee-fb3c-4ed7-8bd0-25bd0cca6252 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1362 microversion: 2.1 time: 0.418643 Sep 08 13:58:20.281538 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3482/6832] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:19 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1362 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:20.811639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-11ef47fc-36c7-4dd2-b831-7b519eb5a48f req-0124b6ad-08ae-4293-aca6-8d5f620485ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47b11013-e429-4803-b166-a81175ccd514", "tag": "d0e7683f-ce1f-4856-b9a8-03fa0fb3dccf"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:20.828732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-11ef47fc-36c7-4dd2-b831-7b519eb5a48f req-0124b6ad-08ae-4293-aca6-8d5f620485ed service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:20.829327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-11ef47fc-36c7-4dd2-b831-7b519eb5a48f req-0124b6ad-08ae-4293-aca6-8d5f620485ed service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:20.829908 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-11ef47fc-36c7-4dd2-b831-7b519eb5a48f req-0124b6ad-08ae-4293-aca6-8d5f620485ed service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:20.850963 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-11ef47fc-36c7-4dd2-b831-7b519eb5a48f req-0124b6ad-08ae-4293-aca6-8d5f620485ed service nova] Creating event network-changed:d0e7683f-ce1f-4856-b9a8-03fa0fb3dccf for instance 47b11013-e429-4803-b166-a81175ccd514 on n-h2-852084-10 Sep 08 13:58:20.858129 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-11ef47fc-36c7-4dd2-b831-7b519eb5a48f req-0124b6ad-08ae-4293-aca6-8d5f620485ed service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054085 Sep 08 13:58:20.859521 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3351/6833] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:21.319531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cc953abb-a7fa-4bc3-8327-1081895dba9a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:21.320712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cc953abb-a7fa-4bc3-8327-1081895dba9a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:21.329522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc953abb-a7fa-4bc3-8327-1081895dba9a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:21.330197 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc953abb-a7fa-4bc3-8327-1081895dba9a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:21.330710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc953abb-a7fa-4bc3-8327-1081895dba9a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:21.331574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc953abb-a7fa-4bc3-8327-1081895dba9a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:21.332380 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc953abb-a7fa-4bc3-8327-1081895dba9a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:21.333112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cc953abb-a7fa-4bc3-8327-1081895dba9a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:21.519643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cc953abb-a7fa-4bc3-8327-1081895dba9a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:21.529193 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cc953abb-a7fa-4bc3-8327-1081895dba9a tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1362 microversion: 2.1 time: 0.218034 Sep 08 13:58:21.529902 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3483/6834] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:21 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1362 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:22.561123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e93b01ff-b2d0-4a00-8b8d-7594a5790d10 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:22.562385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e93b01ff-b2d0-4a00-8b8d-7594a5790d10 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:22.574686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e93b01ff-b2d0-4a00-8b8d-7594a5790d10 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:22.575636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e93b01ff-b2d0-4a00-8b8d-7594a5790d10 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:22.576401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e93b01ff-b2d0-4a00-8b8d-7594a5790d10 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:22.577565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e93b01ff-b2d0-4a00-8b8d-7594a5790d10 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:22.578388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e93b01ff-b2d0-4a00-8b8d-7594a5790d10 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:22.579086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e93b01ff-b2d0-4a00-8b8d-7594a5790d10 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:22.851068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e93b01ff-b2d0-4a00-8b8d-7594a5790d10 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:22.863658 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e93b01ff-b2d0-4a00-8b8d-7594a5790d10 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1362 microversion: 2.1 time: 0.311529 Sep 08 13:58:22.864266 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3352/6835] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:22 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1362 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:23.901802 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bbfdc41e-1eed-4bd9-9455-3fa272467aac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:23.902825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bbfdc41e-1eed-4bd9-9455-3fa272467aac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:23.914470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbfdc41e-1eed-4bd9-9455-3fa272467aac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:23.915394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbfdc41e-1eed-4bd9-9455-3fa272467aac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:23.916239 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbfdc41e-1eed-4bd9-9455-3fa272467aac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:23.917736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbfdc41e-1eed-4bd9-9455-3fa272467aac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:23.919079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbfdc41e-1eed-4bd9-9455-3fa272467aac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:23.920058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbfdc41e-1eed-4bd9-9455-3fa272467aac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:24.117929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bbfdc41e-1eed-4bd9-9455-3fa272467aac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:24.133982 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bbfdc41e-1eed-4bd9-9455-3fa272467aac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1362 microversion: 2.1 time: 0.240346 Sep 08 13:58:24.135105 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3484/6836] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:23 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:25.176912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8de3eda7-5608-43e0-97e5-c23f7fd51621 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:25.177727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8de3eda7-5608-43e0-97e5-c23f7fd51621 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:25.185928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8de3eda7-5608-43e0-97e5-c23f7fd51621 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:25.186539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8de3eda7-5608-43e0-97e5-c23f7fd51621 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:25.187052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8de3eda7-5608-43e0-97e5-c23f7fd51621 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:25.187904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8de3eda7-5608-43e0-97e5-c23f7fd51621 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:25.188529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8de3eda7-5608-43e0-97e5-c23f7fd51621 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:25.189040 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8de3eda7-5608-43e0-97e5-c23f7fd51621 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:25.365627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8de3eda7-5608-43e0-97e5-c23f7fd51621 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:25.382239 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8de3eda7-5608-43e0-97e5-c23f7fd51621 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1362 microversion: 2.1 time: 0.210662 Sep 08 13:58:25.382874 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3353/6837] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:25 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:26.137988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a8fb31cc-9736-483b-a882-b1150fcd3bb1 req-606e7e37-03e3-4d39-a814-9f64e9434c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b11013-e429-4803-b166-a81175ccd514", "name": "network-vif-plugged", "status": "completed", "tag": "d0e7683f-ce1f-4856-b9a8-03fa0fb3dccf"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:26.153987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a8fb31cc-9736-483b-a882-b1150fcd3bb1 req-606e7e37-03e3-4d39-a814-9f64e9434c7f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:26.154892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a8fb31cc-9736-483b-a882-b1150fcd3bb1 req-606e7e37-03e3-4d39-a814-9f64e9434c7f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:26.155655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a8fb31cc-9736-483b-a882-b1150fcd3bb1 req-606e7e37-03e3-4d39-a814-9f64e9434c7f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:26.177579 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a8fb31cc-9736-483b-a882-b1150fcd3bb1 req-606e7e37-03e3-4d39-a814-9f64e9434c7f service nova] Creating event network-vif-plugged:d0e7683f-ce1f-4856-b9a8-03fa0fb3dccf for instance 47b11013-e429-4803-b166-a81175ccd514 on n-h2-852084-10 Sep 08 13:58:26.184579 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a8fb31cc-9736-483b-a882-b1150fcd3bb1 req-606e7e37-03e3-4d39-a814-9f64e9434c7f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149184 Sep 08 13:58:26.185735 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3485/6838] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:58:26.413377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b1b650cf-a361-4ac8-b471-31a88090557e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:26.414275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b1b650cf-a361-4ac8-b471-31a88090557e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:26.425504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b1b650cf-a361-4ac8-b471-31a88090557e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:26.426016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b1b650cf-a361-4ac8-b471-31a88090557e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:26.426462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b1b650cf-a361-4ac8-b471-31a88090557e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:26.427183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b1b650cf-a361-4ac8-b471-31a88090557e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:26.427668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b1b650cf-a361-4ac8-b471-31a88090557e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:26.428111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b1b650cf-a361-4ac8-b471-31a88090557e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:26.617649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b1b650cf-a361-4ac8-b471-31a88090557e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:26.630426 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b1b650cf-a361-4ac8-b471-31a88090557e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1362 microversion: 2.1 time: 0.224281 Sep 08 13:58:26.631021 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3354/6839] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:26 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:27.657362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f480aee0-1d1a-41a6-942e-37e08bc4c8a5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:27.658257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f480aee0-1d1a-41a6-942e-37e08bc4c8a5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:27.660215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:27.666356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f480aee0-1d1a-41a6-942e-37e08bc4c8a5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:27.666861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f480aee0-1d1a-41a6-942e-37e08bc4c8a5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:27.667353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f480aee0-1d1a-41a6-942e-37e08bc4c8a5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:27.668077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f480aee0-1d1a-41a6-942e-37e08bc4c8a5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:27.668538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f480aee0-1d1a-41a6-942e-37e08bc4c8a5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:27.668983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f480aee0-1d1a-41a6-942e-37e08bc4c8a5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:27.838132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f480aee0-1d1a-41a6-942e-37e08bc4c8a5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:27.847365 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f480aee0-1d1a-41a6-942e-37e08bc4c8a5 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1555 microversion: 2.1 time: 0.195212 Sep 08 13:58:27.847922 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3486/6840] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:27 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1555 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:27.873309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bafb31c1-4f27-479e-8e27-310baf40794c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:27.874207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bafb31c1-4f27-479e-8e27-310baf40794c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:27.876944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:27.877679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:27.883921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bafb31c1-4f27-479e-8e27-310baf40794c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:27.884419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bafb31c1-4f27-479e-8e27-310baf40794c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:27.884859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bafb31c1-4f27-479e-8e27-310baf40794c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:27.885575 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bafb31c1-4f27-479e-8e27-310baf40794c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:27.886044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bafb31c1-4f27-479e-8e27-310baf40794c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:27.886468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bafb31c1-4f27-479e-8e27-310baf40794c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:28.098328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bafb31c1-4f27-479e-8e27-310baf40794c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:28.112166 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bafb31c1-4f27-479e-8e27-310baf40794c tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1555 microversion: 2.1 time: 0.242073 Sep 08 13:58:28.112956 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3355/6841] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:27 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1555 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:58:30.965452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-70ffadc0-279f-405c-8bb9-f60d9a7a04d7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd973703-4120-4827-8f0a-19df45b5556d"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:30.969525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-70ffadc0-279f-405c-8bb9-f60d9a7a04d7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:30.981465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70ffadc0-279f-405c-8bb9-f60d9a7a04d7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:30.982374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70ffadc0-279f-405c-8bb9-f60d9a7a04d7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:30.983334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70ffadc0-279f-405c-8bb9-f60d9a7a04d7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:30.984549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70ffadc0-279f-405c-8bb9-f60d9a7a04d7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:30.985240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70ffadc0-279f-405c-8bb9-f60d9a7a04d7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:30.985964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-70ffadc0-279f-405c-8bb9-f60d9a7a04d7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:31.367669 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-70ffadc0-279f-405c-8bb9-f60d9a7a04d7 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "POST /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406763 Sep 08 13:58:31.368737 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3487/6842] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:58:30 2022] POST /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments => generated 194 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:43.444707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-21f2f975-eb0d-470c-bd7a-e31d77e5a6af tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:43.445957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-21f2f975-eb0d-470c-bd7a-e31d77e5a6af tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:43.448586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:43.449384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:43.456966 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21f2f975-eb0d-470c-bd7a-e31d77e5a6af tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:43.457630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21f2f975-eb0d-470c-bd7a-e31d77e5a6af tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:43.458195 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21f2f975-eb0d-470c-bd7a-e31d77e5a6af tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:43.458984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21f2f975-eb0d-470c-bd7a-e31d77e5a6af tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:43.459846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21f2f975-eb0d-470c-bd7a-e31d77e5a6af tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:43.460345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-21f2f975-eb0d-470c-bd7a-e31d77e5a6af tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:43.568556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-21f2f975-eb0d-470c-bd7a-e31d77e5a6af tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lazy-loading 'services' on Instance uuid 47b11013-e429-4803-b166-a81175ccd514 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:43.671044 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-21f2f975-eb0d-470c-bd7a-e31d77e5a6af tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "DELETE /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments/bd973703-4120-4827-8f0a-19df45b5556d" status: 202 len: 0 microversion: 2.1 time: 0.232327 Sep 08 13:58:43.672088 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3356/6843] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:58:43 2022] DELETE /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments/bd973703-4120-4827-8f0a-19df45b5556d => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:58:43.694815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:43.702301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:58:43.709243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e075ff78-1951-4ed4-9d2c-93792d96b980 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:43.712871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e075ff78-1951-4ed4-9d2c-93792d96b980 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:43.723927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e075ff78-1951-4ed4-9d2c-93792d96b980 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:43.724968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e075ff78-1951-4ed4-9d2c-93792d96b980 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:43.729444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e075ff78-1951-4ed4-9d2c-93792d96b980 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:43.729444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e075ff78-1951-4ed4-9d2c-93792d96b980 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:43.729444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e075ff78-1951-4ed4-9d2c-93792d96b980 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:43.729444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e075ff78-1951-4ed4-9d2c-93792d96b980 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:43.777479 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e075ff78-1951-4ed4-9d2c-93792d96b980 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087453 Sep 08 13:58:43.778126 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3488/6844] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:43 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:44.798049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-602db64a-9633-4532-ae46-0d270c2fd92b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:44.801348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-602db64a-9633-4532-ae46-0d270c2fd92b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:44.812118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-602db64a-9633-4532-ae46-0d270c2fd92b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:44.812627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-602db64a-9633-4532-ae46-0d270c2fd92b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:44.813297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-602db64a-9633-4532-ae46-0d270c2fd92b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:44.814139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-602db64a-9633-4532-ae46-0d270c2fd92b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:44.814653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-602db64a-9633-4532-ae46-0d270c2fd92b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:44.815082 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-602db64a-9633-4532-ae46-0d270c2fd92b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:44.883709 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-602db64a-9633-4532-ae46-0d270c2fd92b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095555 Sep 08 13:58:44.884871 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3357/6845] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:44 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:45.899597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-18a80931-0a42-44f7-b31d-c98c8d057256 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:45.901185 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-18a80931-0a42-44f7-b31d-c98c8d057256 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:45.910909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18a80931-0a42-44f7-b31d-c98c8d057256 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:45.911713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18a80931-0a42-44f7-b31d-c98c8d057256 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:45.912385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18a80931-0a42-44f7-b31d-c98c8d057256 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:45.914493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18a80931-0a42-44f7-b31d-c98c8d057256 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:45.914493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18a80931-0a42-44f7-b31d-c98c8d057256 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:45.915082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-18a80931-0a42-44f7-b31d-c98c8d057256 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:45.979386 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-18a80931-0a42-44f7-b31d-c98c8d057256 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084540 Sep 08 13:58:45.980210 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3489/6846] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:45 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:46.994157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-65843ea6-1333-4339-92a6-b89682ff1740 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:46.996457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-65843ea6-1333-4339-92a6-b89682ff1740 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:47.005698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65843ea6-1333-4339-92a6-b89682ff1740 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:47.006197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65843ea6-1333-4339-92a6-b89682ff1740 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:47.006835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65843ea6-1333-4339-92a6-b89682ff1740 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:47.007583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65843ea6-1333-4339-92a6-b89682ff1740 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:47.008051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65843ea6-1333-4339-92a6-b89682ff1740 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:47.008474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-65843ea6-1333-4339-92a6-b89682ff1740 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:47.045647 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-65843ea6-1333-4339-92a6-b89682ff1740 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055698 Sep 08 13:58:47.046569 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3358/6847] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:46 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:48.064091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8f1100b4-6864-4998-8536-95e2d983b5ac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:48.066473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8f1100b4-6864-4998-8536-95e2d983b5ac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:48.074542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f1100b4-6864-4998-8536-95e2d983b5ac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:48.075057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f1100b4-6864-4998-8536-95e2d983b5ac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:48.075562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f1100b4-6864-4998-8536-95e2d983b5ac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:48.076308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f1100b4-6864-4998-8536-95e2d983b5ac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:48.076787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f1100b4-6864-4998-8536-95e2d983b5ac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:48.077234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8f1100b4-6864-4998-8536-95e2d983b5ac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:48.115212 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8f1100b4-6864-4998-8536-95e2d983b5ac tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059762 Sep 08 13:58:48.115847 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3490/6848] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:48 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:49.134729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2ed4e106-6426-4f40-999b-daeb6af943a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:49.136911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2ed4e106-6426-4f40-999b-daeb6af943a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:49.144450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ed4e106-6426-4f40-999b-daeb6af943a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.144954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ed4e106-6426-4f40-999b-daeb6af943a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.145389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ed4e106-6426-4f40-999b-daeb6af943a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.146106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ed4e106-6426-4f40-999b-daeb6af943a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.146604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ed4e106-6426-4f40-999b-daeb6af943a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.147027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ed4e106-6426-4f40-999b-daeb6af943a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.183258 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2ed4e106-6426-4f40-999b-daeb6af943a9 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055915 Sep 08 13:58:49.183913 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3359/6849] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 13:58:49 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 13:58:49.195976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3cc39184-0a4b-4e9b-be33-0656a5a379e4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:49.196586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3cc39184-0a4b-4e9b-be33-0656a5a379e4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:49.204518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cc39184-0a4b-4e9b-be33-0656a5a379e4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.204938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cc39184-0a4b-4e9b-be33-0656a5a379e4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.205419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cc39184-0a4b-4e9b-be33-0656a5a379e4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.206158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cc39184-0a4b-4e9b-be33-0656a5a379e4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:49.206637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cc39184-0a4b-4e9b-be33-0656a5a379e4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:49.207129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3cc39184-0a4b-4e9b-be33-0656a5a379e4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:49.311456 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-3cc39184-0a4b-4e9b-be33-0656a5a379e4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] HTTP exception thrown: Instance 47b11013-e429-4803-b166-a81175ccd514 is not attached to volume bd973703-4120-4827-8f0a-19df45b5556d Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3cc39184-0a4b-4e9b-be33-0656a5a379e4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Request method failure captured: Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments/bd973703-4120-4827-8f0a-19df45b5556d HTTP/1.1 Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfSdozlC-XxF40Wwr4DW3-67ukj4HQrgvp0tS_YdwieAMm0Enfz5Ha0s1a1nRkHx06nlWEjCKwXcQkGZ9vBTqGfaA4zY0g1UdOgNeYjvPR66e7Hpg0UZ_T-ajN1TOo6KVRMAOVogkkhlqtIetH6Ba1qFJm2vQFdEfWNSr1MFujp-2Tw Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 2777eb38f6d04e3fa15f25023ca4ef6d Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 2777eb38f6d04e3fa15f25023ca4ef6d Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestEncryptedCinderVolumes-505658567-project Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7f3fd079afe44180933a5a6723e0d1b3 Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestEncryptedCinderVolumes-505658567-project Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 47b11013-e429-4803-b166-a81175ccd514 is not attached to volume bd973703-4120-4827-8f0a-19df45b5556d Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'server_id': '47b11013-e429-4803-b166-a81175ccd514', 'id': 'bd973703-4120-4827-8f0a-19df45b5556d'} Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bd973703-4120-4827-8f0a-19df45b5556d. Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b11013-e429-4803-b166-a81175ccd514 is not attached to volume bd973703-4120-4827-8f0a-19df45b5556d Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:49.313651 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:49.323063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:58:49.323063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:58:49.323063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b11013-e429-4803-b166-a81175ccd514 is not attached to volume bd973703-4120-4827-8f0a-19df45b5556d Sep 08 13:58:49.323063 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:49.323063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3cc39184-0a4b-4e9b-be33-0656a5a379e4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Returning 404 to user: Instance 47b11013-e429-4803-b166-a81175ccd514 is not attached to volume bd973703-4120-4827-8f0a-19df45b5556d {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:58:49.323063 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3cc39184-0a4b-4e9b-be33-0656a5a379e4 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "DELETE /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments/bd973703-4120-4827-8f0a-19df45b5556d" status: 404 len: 154 microversion: 2.1 time: 0.124688 Sep 08 13:58:49.323063 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3491/6850] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 13:58:49 2022] DELETE /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514/os-volume_attachments/bd973703-4120-4827-8f0a-19df45b5556d => generated 154 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:58:52.787379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9e051301-b4fe-4ed4-897a-022929cd588b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:52.788025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9e051301-b4fe-4ed4-897a-022929cd588b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:52.796100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e051301-b4fe-4ed4-897a-022929cd588b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:52.796598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e051301-b4fe-4ed4-897a-022929cd588b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:52.797073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e051301-b4fe-4ed4-897a-022929cd588b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:52.797790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e051301-b4fe-4ed4-897a-022929cd588b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:52.798298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e051301-b4fe-4ed4-897a-022929cd588b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:52.798695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e051301-b4fe-4ed4-897a-022929cd588b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:52.828593 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9e051301-b4fe-4ed4-897a-022929cd588b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 13:58:52.936516 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9e051301-b4fe-4ed4-897a-022929cd588b tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "DELETE /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 204 len: 0 microversion: 2.1 time: 0.152451 Sep 08 13:58:52.941922 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3360/6851] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 13:58:52 2022] DELETE /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 13:58:52.950253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-36e24c37-3583-4c79-b519-6314c4ee12a0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:52.953889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-36e24c37-3583-4c79-b519-6314c4ee12a0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:52.964027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36e24c37-3583-4c79-b519-6314c4ee12a0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:52.964635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36e24c37-3583-4c79-b519-6314c4ee12a0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:52.965216 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36e24c37-3583-4c79-b519-6314c4ee12a0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:52.966332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36e24c37-3583-4c79-b519-6314c4ee12a0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:52.966870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36e24c37-3583-4c79-b519-6314c4ee12a0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:52.967429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36e24c37-3583-4c79-b519-6314c4ee12a0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:53.176643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-36e24c37-3583-4c79-b519-6314c4ee12a0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:53.192280 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-36e24c37-3583-4c79-b519-6314c4ee12a0 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1561 microversion: 2.1 time: 0.247610 Sep 08 13:58:53.196438 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3492/6852] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:52 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1561 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:54.226182 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3d86f15f-b806-4321-9f8b-bb236c8688fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:54.226916 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3d86f15f-b806-4321-9f8b-bb236c8688fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:54.237010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d86f15f-b806-4321-9f8b-bb236c8688fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.238217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d86f15f-b806-4321-9f8b-bb236c8688fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.239034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d86f15f-b806-4321-9f8b-bb236c8688fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.240371 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d86f15f-b806-4321-9f8b-bb236c8688fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:54.241221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d86f15f-b806-4321-9f8b-bb236c8688fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:54.242027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3d86f15f-b806-4321-9f8b-bb236c8688fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:54.410113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3d86f15f-b806-4321-9f8b-bb236c8688fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:54.420744 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3d86f15f-b806-4321-9f8b-bb236c8688fc tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1561 microversion: 2.1 time: 0.200432 Sep 08 13:58:54.421369 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3361/6853] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:54 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1561 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:55.054555 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-f87b6013-92e6-45a4-8172-1fe71fdee330 req-cf2c2c9a-8743-4658-9803-456fca4253f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47b11013-e429-4803-b166-a81175ccd514", "name": "network-vif-deleted", "tag": "d0e7683f-ce1f-4856-b9a8-03fa0fb3dccf"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:58:55.067933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f87b6013-92e6-45a4-8172-1fe71fdee330 req-cf2c2c9a-8743-4658-9803-456fca4253f1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:55.068444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f87b6013-92e6-45a4-8172-1fe71fdee330 req-cf2c2c9a-8743-4658-9803-456fca4253f1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:55.068905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-f87b6013-92e6-45a4-8172-1fe71fdee330 req-cf2c2c9a-8743-4658-9803-456fca4253f1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:55.084549 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-f87b6013-92e6-45a4-8172-1fe71fdee330 req-cf2c2c9a-8743-4658-9803-456fca4253f1 service nova] Creating event network-vif-deleted:d0e7683f-ce1f-4856-b9a8-03fa0fb3dccf for instance 47b11013-e429-4803-b166-a81175ccd514 on n-h2-852084-10 Sep 08 13:58:55.091719 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-f87b6013-92e6-45a4-8172-1fe71fdee330 req-cf2c2c9a-8743-4658-9803-456fca4253f1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040650 Sep 08 13:58:55.092467 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3493/6854] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:58:55.449902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:55.450873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:55.459797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:55.460322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:55.460832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:55.462025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:55.462477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:55.463106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:55.506024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:55.506449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:55.506888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:55.507365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lazy-loading 'fault' on Instance uuid 47b11013-e429-4803-b166-a81175ccd514 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 13:58:55.561860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3fd079afe44180933a5a6723e0d1b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2777eb38f6d04e3fa15f25023ca4ef6d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:58:55.573039 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bbd69eff-f63c-429a-9afa-0584c98cf41e tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 200 len: 1352 microversion: 2.1 time: 0.128834 Sep 08 13:58:55.573995 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3362/6855] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:55 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 1352 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:58:56.604058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-45899296-7a29-41e4-9ee0-7382e8baa413 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:56.604781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-45899296-7a29-41e4-9ee0-7382e8baa413 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] [instance: 47b11013-e429-4803-b166-a81175ccd514] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:58:56.611982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45899296-7a29-41e4-9ee0-7382e8baa413 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:56.612484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45899296-7a29-41e4-9ee0-7382e8baa413 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:56.612935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45899296-7a29-41e4-9ee0-7382e8baa413 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:56.613645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45899296-7a29-41e4-9ee0-7382e8baa413 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:58:56.614115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45899296-7a29-41e4-9ee0-7382e8baa413 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:58:56.614553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-45899296-7a29-41e4-9ee0-7382e8baa413 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:58:56.628979 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-45899296-7a29-41e4-9ee0-7382e8baa413 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] HTTP exception thrown: Instance 47b11013-e429-4803-b166-a81175ccd514 could not be found. Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-45899296-7a29-41e4-9ee0-7382e8baa413 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Request method failure captured: Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 HTTP/1.1 Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfSdozlC-XxF40Wwr4DW3-67ukj4HQrgvp0tS_YdwieAMm0Enfz5Ha0s1a1nRkHx06nlWEjCKwXcQkGZ9vBTqGfaA4zY0g1UdOgNeYjvPR66e7Hpg0UZ_T-ajN1TOo6KVRMAOVogkkhlqtIetH6Ba1qFJm2vQFdEfWNSr1MFujp-2Tw Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 2777eb38f6d04e3fa15f25023ca4ef6d Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/2777eb38f6d04e3fa15f25023ca4ef6d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 2777eb38f6d04e3fa15f25023ca4ef6d Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-505658567 Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestEncryptedCinderVolumes-505658567-project Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 7f3fd079afe44180933a5a6723e0d1b3 Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestEncryptedCinderVolumes-505658567-project Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 47b11013-e429-4803-b166-a81175ccd514 could not be found. Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '47b11013-e429-4803-b166-a81175ccd514'} Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47b11013-e429-4803-b166-a81175ccd514 could not be found. Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47b11013-e429-4803-b166-a81175ccd514 could not be found. Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 13:58:56.630676 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:56.635604 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 13:58:56.635604 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 13:58:56.635604 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 13:58:56.635604 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 13:58:56.635604 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 13:58:56.635604 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47b11013-e429-4803-b166-a81175ccd514 could not be found. Sep 08 13:58:56.635604 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 13:58:56.635604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-45899296-7a29-41e4-9ee0-7382e8baa413 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Returning 404 to user: Instance 47b11013-e429-4803-b166-a81175ccd514 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 13:58:56.635604 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-45899296-7a29-41e4-9ee0-7382e8baa413 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514" status: 404 len: 111 microversion: 2.1 time: 0.033425 Sep 08 13:58:56.635604 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3494/6856] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:58:56 2022] GET /compute/v2.1/servers/47b11013-e429-4803-b166-a81175ccd514 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 13:58:56.642694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6fe5f6a7-c618-48ae-b457-768d72007c70 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] Calling method '.version_select at 0x7fdb39c2e670>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:58:56.663684 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6fe5f6a7-c618-48ae-b457-768d72007c70 tempest-TestEncryptedCinderVolumes-505658567 tempest-TestEncryptedCinderVolumes-505658567-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-976676042" status: 202 len: 0 microversion: 2.1 time: 0.024930 Sep 08 13:58:56.664278 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3363/6857] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Sep 8 13:58:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-976676042 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 13:59:29.859066 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-922eb423-7346-4461-9a5d-0592c9323438 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Action: 'create', calling method: .version_select at 0x7fdb35b990d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1027001739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCeZRiGH98ipaYnH9tpQ2GErTQwv17xn1hzxh5tN4k9sIJRogXFvNx1GoBjrSMGPQgs3FQt+8viMjRyk4nn7e0Yw7tJ1wIMxI4uqenrpzfAV1+mYej0tmC4dwZYQTKMGQ=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:29.865675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=14 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:29.866367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=34 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:29.880055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-922eb423-7346-4461-9a5d-0592c9323438 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Getting quotas for project 5a165e9dcc2c4669b1dc7e3a77436e05. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:59:29.885699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-922eb423-7346-4461-9a5d-0592c9323438 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Getting quotas for user 101a3737eb8547fe965f3421fe07678b and project 5a165e9dcc2c4669b1dc7e3a77436e05. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:59:29.927167 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-922eb423-7346-4461-9a5d-0592c9323438 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.072594 Sep 08 13:59:29.928692 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3495/6858] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 13:59:29 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 13:59:29.987902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:29.988873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:29.993798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1664377757", "imageRef": "5e4065ab-f650-42bb-86f8-f1b2939cfd6f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1027001739", "networks": [{"uuid": "29019394-7a63-42d2-8821-96733842d056"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:30.062158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] validate_networks() for [('29019394-7a63-42d2-8821-96733842d056', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 13:59:30.491764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 13:59:30.492791 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 13:59:30.493556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 13:59:30.494230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 13:59:30.494875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 13:59:30.508959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:30.509827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:30.510609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:30.511990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:30.513315 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:30.514079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:30.535463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Getting quotas for project 5a165e9dcc2c4669b1dc7e3a77436e05. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 13:59:30.541119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Getting quotas for user 101a3737eb8547fe965f3421fe07678b and project 5a165e9dcc2c4669b1dc7e3a77436e05. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 13:59:30.555212 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 13:59:30.557540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5e4065ab-f650-42bb-86f8-f1b2939cfd6f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 13:59:30.625921 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6f0b0654-4b39-49ce-ab27-a2f107f14ff2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640114 Sep 08 13:59:30.626714 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3364/6859] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 13:59:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 13:59:30.640790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3fddfeb6-ddd6-45cf-aee3-2a5acf76c79b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:30.641521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3fddfeb6-ddd6-45cf-aee3-2a5acf76c79b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:30.727586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3fddfeb6-ddd6-45cf-aee3-2a5acf76c79b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:30.738819 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3fddfeb6-ddd6-45cf-aee3-2a5acf76c79b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1259 microversion: 2.1 time: 0.103641 Sep 08 13:59:30.739451 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3496/6860] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:30 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1259 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:31.765113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7b01ea26-660d-4f4d-9501-a67d098ea477 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:31.765835 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7b01ea26-660d-4f4d-9501-a67d098ea477 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:31.773873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b01ea26-660d-4f4d-9501-a67d098ea477 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:31.774401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b01ea26-660d-4f4d-9501-a67d098ea477 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:31.774895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b01ea26-660d-4f4d-9501-a67d098ea477 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:31.775673 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b01ea26-660d-4f4d-9501-a67d098ea477 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:31.776216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b01ea26-660d-4f4d-9501-a67d098ea477 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:31.776681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7b01ea26-660d-4f4d-9501-a67d098ea477 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:31.851483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7b01ea26-660d-4f4d-9501-a67d098ea477 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:31.864704 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7b01ea26-660d-4f4d-9501-a67d098ea477 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1311 microversion: 2.1 time: 0.104357 Sep 08 13:59:31.865568 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3365/6861] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:31 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1311 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:32.892524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1e99c3f5-f13f-4864-8a03-9822b2481d0c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:32.894077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1e99c3f5-f13f-4864-8a03-9822b2481d0c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:32.924794 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e99c3f5-f13f-4864-8a03-9822b2481d0c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:32.930959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e99c3f5-f13f-4864-8a03-9822b2481d0c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:32.935252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e99c3f5-f13f-4864-8a03-9822b2481d0c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:32.936320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e99c3f5-f13f-4864-8a03-9822b2481d0c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:32.937139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e99c3f5-f13f-4864-8a03-9822b2481d0c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:32.937758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1e99c3f5-f13f-4864-8a03-9822b2481d0c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:33.027718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1e99c3f5-f13f-4864-8a03-9822b2481d0c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:33.048969 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1e99c3f5-f13f-4864-8a03-9822b2481d0c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1317 microversion: 2.1 time: 0.158863 Sep 08 13:59:33.061121 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3497/6862] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:32 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1317 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:34.088162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2d75bb12-09bd-4d46-aa77-ffaaf1f73ce2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:34.089641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2d75bb12-09bd-4d46-aa77-ffaaf1f73ce2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:34.097936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d75bb12-09bd-4d46-aa77-ffaaf1f73ce2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:34.098583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d75bb12-09bd-4d46-aa77-ffaaf1f73ce2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:34.099052 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d75bb12-09bd-4d46-aa77-ffaaf1f73ce2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:34.099846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d75bb12-09bd-4d46-aa77-ffaaf1f73ce2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:34.100298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d75bb12-09bd-4d46-aa77-ffaaf1f73ce2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:34.100992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2d75bb12-09bd-4d46-aa77-ffaaf1f73ce2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:34.309400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2d75bb12-09bd-4d46-aa77-ffaaf1f73ce2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:34.325381 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2d75bb12-09bd-4d46-aa77-ffaaf1f73ce2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1359 microversion: 2.1 time: 0.240997 Sep 08 13:59:34.327746 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3366/6863] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:34 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:35.366120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4fd43dc1-3d05-4559-8902-906b1c6ded24 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:35.366849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4fd43dc1-3d05-4559-8902-906b1c6ded24 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:35.378814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fd43dc1-3d05-4559-8902-906b1c6ded24 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:35.379459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fd43dc1-3d05-4559-8902-906b1c6ded24 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:35.380124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fd43dc1-3d05-4559-8902-906b1c6ded24 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:35.381015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fd43dc1-3d05-4559-8902-906b1c6ded24 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:35.381995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fd43dc1-3d05-4559-8902-906b1c6ded24 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:35.382530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4fd43dc1-3d05-4559-8902-906b1c6ded24 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:35.572590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4fd43dc1-3d05-4559-8902-906b1c6ded24 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:35.583113 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4fd43dc1-3d05-4559-8902-906b1c6ded24 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1359 microversion: 2.1 time: 0.222852 Sep 08 13:59:35.584090 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3498/6864] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:35 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:59:36.611562 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cedfe900-0f36-4099-b83b-b904362de8d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:36.612433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cedfe900-0f36-4099-b83b-b904362de8d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:36.624287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cedfe900-0f36-4099-b83b-b904362de8d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:36.625803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cedfe900-0f36-4099-b83b-b904362de8d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:36.626906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cedfe900-0f36-4099-b83b-b904362de8d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:36.627976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cedfe900-0f36-4099-b83b-b904362de8d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:36.628487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cedfe900-0f36-4099-b83b-b904362de8d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:36.629223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cedfe900-0f36-4099-b83b-b904362de8d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:36.846231 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cedfe900-0f36-4099-b83b-b904362de8d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:36.860943 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cedfe900-0f36-4099-b83b-b904362de8d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1359 microversion: 2.1 time: 0.255648 Sep 08 13:59:36.861942 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3367/6865] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:36 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:59:37.892571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-edb817fb-4b8e-48d9-9f58-81019a803ab3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:37.893653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-edb817fb-4b8e-48d9-9f58-81019a803ab3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:37.905145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edb817fb-4b8e-48d9-9f58-81019a803ab3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:37.906588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edb817fb-4b8e-48d9-9f58-81019a803ab3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:37.907141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edb817fb-4b8e-48d9-9f58-81019a803ab3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:37.908446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edb817fb-4b8e-48d9-9f58-81019a803ab3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:37.913966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edb817fb-4b8e-48d9-9f58-81019a803ab3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:37.913966 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edb817fb-4b8e-48d9-9f58-81019a803ab3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:38.120909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-edb817fb-4b8e-48d9-9f58-81019a803ab3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:38.138059 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-edb817fb-4b8e-48d9-9f58-81019a803ab3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1359 microversion: 2.1 time: 0.252430 Sep 08 13:59:38.138957 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3499/6866] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:37 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:39.167300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1ef405d0-7bcc-47bf-9cc9-91012893eae9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:39.168427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1ef405d0-7bcc-47bf-9cc9-91012893eae9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:39.175735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ef405d0-7bcc-47bf-9cc9-91012893eae9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:39.176229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ef405d0-7bcc-47bf-9cc9-91012893eae9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:39.176674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ef405d0-7bcc-47bf-9cc9-91012893eae9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:39.177389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ef405d0-7bcc-47bf-9cc9-91012893eae9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:39.177848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ef405d0-7bcc-47bf-9cc9-91012893eae9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:39.178279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1ef405d0-7bcc-47bf-9cc9-91012893eae9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:39.814078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1ef405d0-7bcc-47bf-9cc9-91012893eae9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:39.835735 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1ef405d0-7bcc-47bf-9cc9-91012893eae9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1359 microversion: 2.1 time: 0.672243 Sep 08 13:59:39.839332 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3368/6867] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:39 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1359 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:40.862716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-60c917b7-48a8-447d-ba93-8bac49e0c494 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:40.863444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-60c917b7-48a8-447d-ba93-8bac49e0c494 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:40.866461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:40.875017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60c917b7-48a8-447d-ba93-8bac49e0c494 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:40.875661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60c917b7-48a8-447d-ba93-8bac49e0c494 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:40.876199 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60c917b7-48a8-447d-ba93-8bac49e0c494 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:40.877011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60c917b7-48a8-447d-ba93-8bac49e0c494 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:40.877582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60c917b7-48a8-447d-ba93-8bac49e0c494 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:40.878087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-60c917b7-48a8-447d-ba93-8bac49e0c494 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:41.102723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-60c917b7-48a8-447d-ba93-8bac49e0c494 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:41.113389 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-60c917b7-48a8-447d-ba93-8bac49e0c494 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1359 microversion: 2.1 time: 0.255397 Sep 08 13:59:41.114138 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3500/6868] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:40 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1359 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:59:41.538267 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:41.540338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 13:59:41.796454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3ed07f84-9051-4ef9-82ed-83106cf4bc64 req-7ca5d37a-d740-455a-b193-1e2c1e236deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef36c649-d519-4c74-b157-9f93f2702647", "tag": "907dde94-fbf3-411a-8467-1fd39617764f"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:41.806364 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3ed07f84-9051-4ef9-82ed-83106cf4bc64 req-7ca5d37a-d740-455a-b193-1e2c1e236deb service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:41.806853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3ed07f84-9051-4ef9-82ed-83106cf4bc64 req-7ca5d37a-d740-455a-b193-1e2c1e236deb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:41.807310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3ed07f84-9051-4ef9-82ed-83106cf4bc64 req-7ca5d37a-d740-455a-b193-1e2c1e236deb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:41.820570 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3ed07f84-9051-4ef9-82ed-83106cf4bc64 req-7ca5d37a-d740-455a-b193-1e2c1e236deb service nova] Creating event network-changed:907dde94-fbf3-411a-8467-1fd39617764f for instance ef36c649-d519-4c74-b157-9f93f2702647 on n-h1-852084-10 Sep 08 13:59:41.827854 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3ed07f84-9051-4ef9-82ed-83106cf4bc64 req-7ca5d37a-d740-455a-b193-1e2c1e236deb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.299543 Sep 08 13:59:41.829962 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3369/6869] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:59:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:42.151030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fd97aa99-de44-434a-a782-eb4335c55364 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:42.152219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fd97aa99-de44-434a-a782-eb4335c55364 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:42.162985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd97aa99-de44-434a-a782-eb4335c55364 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:42.163679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd97aa99-de44-434a-a782-eb4335c55364 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:42.164383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd97aa99-de44-434a-a782-eb4335c55364 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:42.164998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd97aa99-de44-434a-a782-eb4335c55364 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:42.165475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd97aa99-de44-434a-a782-eb4335c55364 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:42.165918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fd97aa99-de44-434a-a782-eb4335c55364 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:42.315516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fd97aa99-de44-434a-a782-eb4335c55364 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:42.323882 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fd97aa99-de44-434a-a782-eb4335c55364 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1359 microversion: 2.1 time: 0.179352 Sep 08 13:59:42.325097 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3501/6870] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:42 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:59:43.352658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-56b66782-1e17-4fb9-b552-ce171cafb085 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:43.353664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-56b66782-1e17-4fb9-b552-ce171cafb085 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:43.363095 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56b66782-1e17-4fb9-b552-ce171cafb085 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:43.363785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56b66782-1e17-4fb9-b552-ce171cafb085 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:43.364340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56b66782-1e17-4fb9-b552-ce171cafb085 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:43.365187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56b66782-1e17-4fb9-b552-ce171cafb085 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:43.365755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56b66782-1e17-4fb9-b552-ce171cafb085 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:43.366291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56b66782-1e17-4fb9-b552-ce171cafb085 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:43.544851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-56b66782-1e17-4fb9-b552-ce171cafb085 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:43.554046 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-56b66782-1e17-4fb9-b552-ce171cafb085 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1359 microversion: 2.1 time: 0.206979 Sep 08 13:59:43.554737 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3370/6871] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:43 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:44.583986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0840daaa-b576-4652-8645-7f86dfa0ca32 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:44.584559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0840daaa-b576-4652-8645-7f86dfa0ca32 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:44.592002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0840daaa-b576-4652-8645-7f86dfa0ca32 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:44.592476 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0840daaa-b576-4652-8645-7f86dfa0ca32 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:44.592929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0840daaa-b576-4652-8645-7f86dfa0ca32 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:44.593657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0840daaa-b576-4652-8645-7f86dfa0ca32 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:44.594194 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0840daaa-b576-4652-8645-7f86dfa0ca32 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:44.594565 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0840daaa-b576-4652-8645-7f86dfa0ca32 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:44.764647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0840daaa-b576-4652-8645-7f86dfa0ca32 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:44.773643 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0840daaa-b576-4652-8645-7f86dfa0ca32 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1359 microversion: 2.1 time: 0.193923 Sep 08 13:59:44.774377 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3502/6872] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:44 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 13:59:45.800045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-88ae639e-5190-4436-8394-cc546304a4d4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:45.800741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-88ae639e-5190-4436-8394-cc546304a4d4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:45.808591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88ae639e-5190-4436-8394-cc546304a4d4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:45.809621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88ae639e-5190-4436-8394-cc546304a4d4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:45.810127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88ae639e-5190-4436-8394-cc546304a4d4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:45.810844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88ae639e-5190-4436-8394-cc546304a4d4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:45.812003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88ae639e-5190-4436-8394-cc546304a4d4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:45.812003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-88ae639e-5190-4436-8394-cc546304a4d4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:45.980038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-88ae639e-5190-4436-8394-cc546304a4d4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:45.990787 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-88ae639e-5190-4436-8394-cc546304a4d4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1359 microversion: 2.1 time: 0.196115 Sep 08 13:59:45.993179 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3371/6873] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:45 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:46.038431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b8e4da1a-8b08-43a8-a0e2-a4c3750ccacc req-d425d917-55cf-4801-ab43-11b903025dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef36c649-d519-4c74-b157-9f93f2702647", "name": "network-vif-plugged", "status": "completed", "tag": "907dde94-fbf3-411a-8467-1fd39617764f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:46.054936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b8e4da1a-8b08-43a8-a0e2-a4c3750ccacc req-d425d917-55cf-4801-ab43-11b903025dbb service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:46.055838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b8e4da1a-8b08-43a8-a0e2-a4c3750ccacc req-d425d917-55cf-4801-ab43-11b903025dbb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:46.056838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b8e4da1a-8b08-43a8-a0e2-a4c3750ccacc req-d425d917-55cf-4801-ab43-11b903025dbb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:46.080062 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b8e4da1a-8b08-43a8-a0e2-a4c3750ccacc req-d425d917-55cf-4801-ab43-11b903025dbb service nova] Creating event network-vif-plugged:907dde94-fbf3-411a-8467-1fd39617764f for instance ef36c649-d519-4c74-b157-9f93f2702647 on n-h1-852084-10 Sep 08 13:59:46.090465 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b8e4da1a-8b08-43a8-a0e2-a4c3750ccacc req-d425d917-55cf-4801-ab43-11b903025dbb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055464 Sep 08 13:59:46.091554 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3503/6874] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 13:59:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:47.017128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bf908da6-cab1-4495-b0f0-1fe95333176b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:47.017128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bf908da6-cab1-4495-b0f0-1fe95333176b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:47.024230 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf908da6-cab1-4495-b0f0-1fe95333176b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:47.024718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf908da6-cab1-4495-b0f0-1fe95333176b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:47.025253 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf908da6-cab1-4495-b0f0-1fe95333176b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:47.025873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf908da6-cab1-4495-b0f0-1fe95333176b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:47.026329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf908da6-cab1-4495-b0f0-1fe95333176b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:47.026758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bf908da6-cab1-4495-b0f0-1fe95333176b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:47.184857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bf908da6-cab1-4495-b0f0-1fe95333176b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:47.194920 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bf908da6-cab1-4495-b0f0-1fe95333176b tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1359 microversion: 2.1 time: 0.183107 Sep 08 13:59:47.195722 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3372/6875] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:47 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:48.220842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-00394079-6c6a-4833-9bde-7b5c0d5175ee tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:48.221630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-00394079-6c6a-4833-9bde-7b5c0d5175ee tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:48.229524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00394079-6c6a-4833-9bde-7b5c0d5175ee tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:48.230055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00394079-6c6a-4833-9bde-7b5c0d5175ee tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:48.230560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00394079-6c6a-4833-9bde-7b5c0d5175ee tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:48.231330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00394079-6c6a-4833-9bde-7b5c0d5175ee tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:48.231806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00394079-6c6a-4833-9bde-7b5c0d5175ee tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:48.232253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-00394079-6c6a-4833-9bde-7b5c0d5175ee tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:48.395691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-00394079-6c6a-4833-9bde-7b5c0d5175ee tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:48.403921 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-00394079-6c6a-4833-9bde-7b5c0d5175ee tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1550 microversion: 2.1 time: 0.187797 Sep 08 13:59:48.404513 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3504/6876] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:48 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1550 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:48.427725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-be17b9af-33ac-417a-8394-a1eadc05625c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:48.428451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-be17b9af-33ac-417a-8394-a1eadc05625c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:48.436263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be17b9af-33ac-417a-8394-a1eadc05625c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:48.436794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be17b9af-33ac-417a-8394-a1eadc05625c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:48.437239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be17b9af-33ac-417a-8394-a1eadc05625c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:48.437973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be17b9af-33ac-417a-8394-a1eadc05625c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:48.438433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be17b9af-33ac-417a-8394-a1eadc05625c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:48.438890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-be17b9af-33ac-417a-8394-a1eadc05625c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:48.599188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-be17b9af-33ac-417a-8394-a1eadc05625c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:48.607898 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-be17b9af-33ac-417a-8394-a1eadc05625c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1550 microversion: 2.1 time: 0.184344 Sep 08 13:59:48.608483 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3373/6877] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:48 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1550 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:48.630474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e275fee6-0c54-4524-a21b-0eff89d16850 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:48.635651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e275fee6-0c54-4524-a21b-0eff89d16850 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:48.636480 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e275fee6-0c54-4524-a21b-0eff89d16850 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Searching by: {'deleted': False, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 13:59:48.642650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e275fee6-0c54-4524-a21b-0eff89d16850 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:48.643159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e275fee6-0c54-4524-a21b-0eff89d16850 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:48.643710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e275fee6-0c54-4524-a21b-0eff89d16850 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:48.644447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e275fee6-0c54-4524-a21b-0eff89d16850 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:48.644926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e275fee6-0c54-4524-a21b-0eff89d16850 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:48.645366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e275fee6-0c54-4524-a21b-0eff89d16850 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:48.672130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-e275fee6-0c54-4524-a21b-0eff89d16850 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 13:59:48.704830 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e275fee6-0c54-4524-a21b-0eff89d16850 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.078099 Sep 08 13:59:48.705480 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3505/6878] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 13:59:48 2022] GET /compute/v2.1/servers => generated 343 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 13:59:48.717638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9a912bb5-2fba-4dfe-8b83-8025721ffab5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 13:59:48.718259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9a912bb5-2fba-4dfe-8b83-8025721ffab5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:48.725495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a912bb5-2fba-4dfe-8b83-8025721ffab5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:48.725989 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a912bb5-2fba-4dfe-8b83-8025721ffab5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:48.726424 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a912bb5-2fba-4dfe-8b83-8025721ffab5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:48.727368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a912bb5-2fba-4dfe-8b83-8025721ffab5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:48.728341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a912bb5-2fba-4dfe-8b83-8025721ffab5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:48.728341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9a912bb5-2fba-4dfe-8b83-8025721ffab5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:48.902558 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9a912bb5-2fba-4dfe-8b83-8025721ffab5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 13:59:48.911498 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9a912bb5-2fba-4dfe-8b83-8025721ffab5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1550 microversion: 2.1 time: 0.197815 Sep 08 13:59:48.912095 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3374/6879] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 13:59:48 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1550 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 13:59:50.692677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-190737fa-ae41-491c-8a54-87d62db0ed13 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3590fe8b-7142-47e3-80d4-e71286613d4c"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 13:59:50.696619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-190737fa-ae41-491c-8a54-87d62db0ed13 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 13:59:50.706468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-190737fa-ae41-491c-8a54-87d62db0ed13 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:50.707075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-190737fa-ae41-491c-8a54-87d62db0ed13 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:50.707772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-190737fa-ae41-491c-8a54-87d62db0ed13 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:50.708920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-190737fa-ae41-491c-8a54-87d62db0ed13 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 13:59:50.709616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-190737fa-ae41-491c-8a54-87d62db0ed13 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 13:59:50.710266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-190737fa-ae41-491c-8a54-87d62db0ed13 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 13:59:51.018424 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-190737fa-ae41-491c-8a54-87d62db0ed13 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "POST /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.331762 Sep 08 13:59:51.019136 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3506/6880] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 13:59:50 2022] POST /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:05.721590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54643b5a-8c69-4ba9-ba55-da524bfd92d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:05.722208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54643b5a-8c69-4ba9-ba55-da524bfd92d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:05.724902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:05.725988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=58 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:05.731303 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54643b5a-8c69-4ba9-ba55-da524bfd92d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:05.731803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54643b5a-8c69-4ba9-ba55-da524bfd92d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:05.732245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54643b5a-8c69-4ba9-ba55-da524bfd92d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:05.732954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54643b5a-8c69-4ba9-ba55-da524bfd92d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:05.733413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54643b5a-8c69-4ba9-ba55-da524bfd92d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:05.733836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54643b5a-8c69-4ba9-ba55-da524bfd92d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:05.884524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54643b5a-8c69-4ba9-ba55-da524bfd92d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:05.893518 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54643b5a-8c69-4ba9-ba55-da524bfd92d9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1596 microversion: 2.1 time: 0.175957 Sep 08 14:00:05.894107 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3375/6881] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:05 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1596 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:00:08.064867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:08.066173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:08.067110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:00:08.076669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-152d8f54-f37d-4fc1-991e-d83792635ee8 req-6d3807b1-d458-4d54-aed2-83ce19235fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef36c649-d519-4c74-b157-9f93f2702647", "tag": "907dde94-fbf3-411a-8467-1fd39617764f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:08.097806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-152d8f54-f37d-4fc1-991e-d83792635ee8 req-6d3807b1-d458-4d54-aed2-83ce19235fb2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:08.099079 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-152d8f54-f37d-4fc1-991e-d83792635ee8 req-6d3807b1-d458-4d54-aed2-83ce19235fb2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:08.100266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-152d8f54-f37d-4fc1-991e-d83792635ee8 req-6d3807b1-d458-4d54-aed2-83ce19235fb2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:08.120447 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-152d8f54-f37d-4fc1-991e-d83792635ee8 req-6d3807b1-d458-4d54-aed2-83ce19235fb2 service nova] Creating event network-changed:907dde94-fbf3-411a-8467-1fd39617764f for instance ef36c649-d519-4c74-b157-9f93f2702647 on n-h1-852084-10 Sep 08 14:00:08.130832 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-152d8f54-f37d-4fc1-991e-d83792635ee8 req-6d3807b1-d458-4d54-aed2-83ce19235fb2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067479 Sep 08 14:00:08.132773 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3507/6882] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:09.729308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-309fc7b9-5bab-4f87-9ea4-6af07ff7f5c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1793498785"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:09.730706 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-309fc7b9-5bab-4f87-9ea4-6af07ff7f5c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:09.740812 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-309fc7b9-5bab-4f87-9ea4-6af07ff7f5c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:09.741309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-309fc7b9-5bab-4f87-9ea4-6af07ff7f5c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:09.741766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-309fc7b9-5bab-4f87-9ea4-6af07ff7f5c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:09.742474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-309fc7b9-5bab-4f87-9ea4-6af07ff7f5c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:09.743140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-309fc7b9-5bab-4f87-9ea4-6af07ff7f5c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:09.744621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-309fc7b9-5bab-4f87-9ea4-6af07ff7f5c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:09.929880 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.network.security_group_api [None req-309fc7b9-5bab-4f87-9ea4-6af07ff7f5c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Adding security group a833ba05-a2d3-4d2a-b0f1-4182efcbddae to port 907dde94-fbf3-411a-8467-1fd39617764f Sep 08 14:00:10.468304 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-309fc7b9-5bab-4f87-9ea4-6af07ff7f5c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "POST /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/action" status: 202 len: 0 microversion: 2.1 time: 0.747398 Sep 08 14:00:10.470097 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3376/6883] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:00:09 2022] POST /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/action => generated 0 bytes in 751 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:00:10.491722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2f9470dd-7697-4dd2-a47c-bd5b2a9d0f48 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:00:10.494401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2f9470dd-7697-4dd2-a47c-bd5b2a9d0f48 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:00:10.498445 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-d037cd4b-fe3e-4a30-aa21-194863f2a65d req-6c317a1b-78db-44c7-98ce-8080c9505f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef36c649-d519-4c74-b157-9f93f2702647", "tag": "907dde94-fbf3-411a-8467-1fd39617764f"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:00:10.508353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f9470dd-7697-4dd2-a47c-bd5b2a9d0f48 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.509920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f9470dd-7697-4dd2-a47c-bd5b2a9d0f48 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.511284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f9470dd-7697-4dd2-a47c-bd5b2a9d0f48 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.512835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f9470dd-7697-4dd2-a47c-bd5b2a9d0f48 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.514148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f9470dd-7697-4dd2-a47c-bd5b2a9d0f48 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.515762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2f9470dd-7697-4dd2-a47c-bd5b2a9d0f48 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.534477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d037cd4b-fe3e-4a30-aa21-194863f2a65d req-6c317a1b-78db-44c7-98ce-8080c9505f12 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:00:10.535123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d037cd4b-fe3e-4a30-aa21-194863f2a65d req-6c317a1b-78db-44c7-98ce-8080c9505f12 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:00:10.536714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d037cd4b-fe3e-4a30-aa21-194863f2a65d req-6c317a1b-78db-44c7-98ce-8080c9505f12 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:00:10.573439 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d037cd4b-fe3e-4a30-aa21-194863f2a65d req-6c317a1b-78db-44c7-98ce-8080c9505f12 service nova] Creating event network-changed:907dde94-fbf3-411a-8467-1fd39617764f for instance ef36c649-d519-4c74-b157-9f93f2702647 on n-h1-852084-10 Sep 08 14:00:10.595613 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-d037cd4b-fe3e-4a30-aa21-194863f2a65d req-6c317a1b-78db-44c7-98ce-8080c9505f12 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108819 Sep 08 14:00:10.596662 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3377/6884] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:00:10.818648 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2f9470dd-7697-4dd2-a47c-bd5b2a9d0f48 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:00:10.836563 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2f9470dd-7697-4dd2-a47c-bd5b2a9d0f48 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1762 microversion: 2.1 time: 0.356279 Sep 08 14:00:10.838630 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3508/6885] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:00:10 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1762 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:01:48.285045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:48.285896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=12 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:48.287352 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 14:01:48.287509 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 14:01:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/action (ip 10.222.0.78) !!! Sep 08 14:01:48.294568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5877c905-12fd-4616-b28f-fb21b89f7bfa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:01:48.297134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5877c905-12fd-4616-b28f-fb21b89f7bfa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:48.306592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5877c905-12fd-4616-b28f-fb21b89f7bfa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:48.307087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5877c905-12fd-4616-b28f-fb21b89f7bfa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:48.307564 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5877c905-12fd-4616-b28f-fb21b89f7bfa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:48.308308 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5877c905-12fd-4616-b28f-fb21b89f7bfa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:48.308775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5877c905-12fd-4616-b28f-fb21b89f7bfa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:48.309202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5877c905-12fd-4616-b28f-fb21b89f7bfa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:48.392909 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5877c905-12fd-4616-b28f-fb21b89f7bfa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "POST /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/action" status: 202 len: 0 microversion: 2.1 time: 0.110027 Sep 08 14:01:48.394390 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3378/6886] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:01:48 2022] POST /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:01:48.401753 n-d-852084-10 devstack@n-api.service[128970]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ae07885-1976-4f24-8283-d63c7056ab9e] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 14:01:48.402742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:48.403547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:01:48.405301 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 14:01:48.405503 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 14:01:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 (ip 10.222.0.78) !!! Sep 08 14:01:48.407301 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:01:48.407718 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 14:01:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 (ip 10.222.0.78) !!! Sep 08 14:01:48.414429 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b3c4ff41-f8da-4828-acad-3ae0012a8344 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:48.415095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b3c4ff41-f8da-4828-acad-3ae0012a8344 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:48.430791 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3c4ff41-f8da-4828-acad-3ae0012a8344 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:48.431332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3c4ff41-f8da-4828-acad-3ae0012a8344 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:48.431790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3c4ff41-f8da-4828-acad-3ae0012a8344 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:48.432608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3c4ff41-f8da-4828-acad-3ae0012a8344 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:48.433358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3c4ff41-f8da-4828-acad-3ae0012a8344 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:48.433808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3c4ff41-f8da-4828-acad-3ae0012a8344 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:48.602623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b3c4ff41-f8da-4828-acad-3ae0012a8344 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:48.611616 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b3c4ff41-f8da-4828-acad-3ae0012a8344 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1764 microversion: 2.1 time: 0.211934 Sep 08 14:01:48.612752 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3509/6887] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:48 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1764 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:01:49.637822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1b339e83-6356-496b-bc66-e1e4f53efeff tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:01:49.638534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1b339e83-6356-496b-bc66-e1e4f53efeff tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:01:49.646539 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b339e83-6356-496b-bc66-e1e4f53efeff tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:49.647074 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b339e83-6356-496b-bc66-e1e4f53efeff tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:49.647530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b339e83-6356-496b-bc66-e1e4f53efeff tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:49.648599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b339e83-6356-496b-bc66-e1e4f53efeff tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:01:49.649065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b339e83-6356-496b-bc66-e1e4f53efeff tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:01:49.649490 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1b339e83-6356-496b-bc66-e1e4f53efeff tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:01:49.805866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1b339e83-6356-496b-bc66-e1e4f53efeff tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:01:49.814768 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1b339e83-6356-496b-bc66-e1e4f53efeff tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1762 microversion: 2.1 time: 0.182158 Sep 08 14:01:49.815890 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3379/6888] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:01:49 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1762 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:10.793372 n-d-852084-10 devstack@n-api.service[128970]: ERROR oslo.messaging._drivers.impl_rabbit [-] [254344fe-6b9d-45f5-91d6-e802ace055bf] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 14:03:10.794772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:10.795567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:10.800340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-930b9d04-eb31-4c51-aabd-022cb010ae62 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1793498785"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:10.800896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-930b9d04-eb31-4c51-aabd-022cb010ae62 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:10.809357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-930b9d04-eb31-4c51-aabd-022cb010ae62 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:10.810420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-930b9d04-eb31-4c51-aabd-022cb010ae62 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:10.810887 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-930b9d04-eb31-4c51-aabd-022cb010ae62 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:10.811638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-930b9d04-eb31-4c51-aabd-022cb010ae62 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:10.812114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-930b9d04-eb31-4c51-aabd-022cb010ae62 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:10.812558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-930b9d04-eb31-4c51-aabd-022cb010ae62 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:10.816034 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ae07885-1976-4f24-8283-d63c7056ab9e] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 50678. Sep 08 14:03:11.066405 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.network.security_group_api [None req-930b9d04-eb31-4c51-aabd-022cb010ae62 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Removing security group a833ba05-a2d3-4d2a-b0f1-4182efcbddae from port 907dde94-fbf3-411a-8467-1fd39617764f Sep 08 14:03:11.428422 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-930b9d04-eb31-4c51-aabd-022cb010ae62 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "POST /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/action" status: 202 len: 0 microversion: 2.1 time: 0.636625 Sep 08 14:03:11.429735 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3510/6889] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:03:10 2022] POST /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/action => generated 0 bytes in 639 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:03:11.448269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:11.449806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:11.601229 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-27dbfebf-7738-485e-9a51-bfcfb0e93414 req-395cc3cd-1584-4d01-a66d-e006073d08e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef36c649-d519-4c74-b157-9f93f2702647", "tag": "907dde94-fbf3-411a-8467-1fd39617764f"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:11.613532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-27dbfebf-7738-485e-9a51-bfcfb0e93414 req-395cc3cd-1584-4d01-a66d-e006073d08e3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:11.614297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-27dbfebf-7738-485e-9a51-bfcfb0e93414 req-395cc3cd-1584-4d01-a66d-e006073d08e3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:11.614924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-27dbfebf-7738-485e-9a51-bfcfb0e93414 req-395cc3cd-1584-4d01-a66d-e006073d08e3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:11.634616 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-27dbfebf-7738-485e-9a51-bfcfb0e93414 req-395cc3cd-1584-4d01-a66d-e006073d08e3 service nova] Creating event network-changed:907dde94-fbf3-411a-8467-1fd39617764f for instance ef36c649-d519-4c74-b157-9f93f2702647 on n-h1-852084-10 Sep 08 14:03:11.642085 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-27dbfebf-7738-485e-9a51-bfcfb0e93414 req-395cc3cd-1584-4d01-a66d-e006073d08e3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.205290 Sep 08 14:03:11.643335 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3380/6890] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:13.236376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-54d402a6-4930-46b3-a174-adddc78082b6 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:13.237062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-54d402a6-4930-46b3-a174-adddc78082b6 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:13.248024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d402a6-4930-46b3-a174-adddc78082b6 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.248638 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d402a6-4930-46b3-a174-adddc78082b6 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.249354 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d402a6-4930-46b3-a174-adddc78082b6 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.250319 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d402a6-4930-46b3-a174-adddc78082b6 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.250987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d402a6-4930-46b3-a174-adddc78082b6 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.251764 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54d402a6-4930-46b3-a174-adddc78082b6 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.276825 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] [254344fe-6b9d-45f5-91d6-e802ace055bf] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 50706. Sep 08 14:03:13.377272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-54d402a6-4930-46b3-a174-adddc78082b6 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lazy-loading 'services' on Instance uuid ef36c649-d519-4c74-b157-9f93f2702647 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:03:13.482542 n-d-852084-10 devstack@n-api.service[128970]: ERROR oslo.messaging._drivers.impl_rabbit [None req-54d402a6-4930-46b3-a174-adddc78082b6 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [65376541-d75a-480f-84ca-1d97a8a2bff6] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 14:03:13.662225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-faa3617d-cde6-4a52-b33d-8384c34f9f30 req-4f2c655f-c514-4969-aea4-ac8bcf5eee7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef36c649-d519-4c74-b157-9f93f2702647", "tag": "907dde94-fbf3-411a-8467-1fd39617764f"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:13.674289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-faa3617d-cde6-4a52-b33d-8384c34f9f30 req-4f2c655f-c514-4969-aea4-ac8bcf5eee7a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:13.674774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-faa3617d-cde6-4a52-b33d-8384c34f9f30 req-4f2c655f-c514-4969-aea4-ac8bcf5eee7a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:13.675210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-faa3617d-cde6-4a52-b33d-8384c34f9f30 req-4f2c655f-c514-4969-aea4-ac8bcf5eee7a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:13.690101 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-faa3617d-cde6-4a52-b33d-8384c34f9f30 req-4f2c655f-c514-4969-aea4-ac8bcf5eee7a service nova] Creating event network-changed:907dde94-fbf3-411a-8467-1fd39617764f for instance ef36c649-d519-4c74-b157-9f93f2702647 on n-h1-852084-10 Sep 08 14:03:13.696976 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-faa3617d-cde6-4a52-b33d-8384c34f9f30 req-4f2c655f-c514-4969-aea4-ac8bcf5eee7a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039585 Sep 08 14:03:13.698154 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3381/6891] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:14.492450 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [None req-54d402a6-4930-46b3-a174-adddc78082b6 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [65376541-d75a-480f-84ca-1d97a8a2bff6] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 50714. Sep 08 14:03:14.496726 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-54d402a6-4930-46b3-a174-adddc78082b6 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments/3590fe8b-7142-47e3-80d4-e71286613d4c" status: 202 len: 0 microversion: 2.1 time: 1.268039 Sep 08 14:03:14.498266 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3511/6892] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 14:03:13 2022] DELETE /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments/3590fe8b-7142-47e3-80d4-e71286613d4c => generated 0 bytes in 1271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:03:14.510009 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f4bb0eea-e6fc-453b-9cf1-65c892444694 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:14.512648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f4bb0eea-e6fc-453b-9cf1-65c892444694 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:14.520394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4bb0eea-e6fc-453b-9cf1-65c892444694 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.520983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4bb0eea-e6fc-453b-9cf1-65c892444694 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.521467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4bb0eea-e6fc-453b-9cf1-65c892444694 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.522551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4bb0eea-e6fc-453b-9cf1-65c892444694 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:14.523265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4bb0eea-e6fc-453b-9cf1-65c892444694 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:14.523536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f4bb0eea-e6fc-453b-9cf1-65c892444694 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:14.579647 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f4bb0eea-e6fc-453b-9cf1-65c892444694 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074701 Sep 08 14:03:14.580499 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3382/6893] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:03:14 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:15.597346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-39ad759c-639b-45e3-a610-556e75a8a02e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:15.600250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-39ad759c-639b-45e3-a610-556e75a8a02e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:15.609836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39ad759c-639b-45e3-a610-556e75a8a02e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:15.610357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39ad759c-639b-45e3-a610-556e75a8a02e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:15.610821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39ad759c-639b-45e3-a610-556e75a8a02e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:15.611612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39ad759c-639b-45e3-a610-556e75a8a02e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:15.612092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39ad759c-639b-45e3-a610-556e75a8a02e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:15.612574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39ad759c-639b-45e3-a610-556e75a8a02e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:15.654510 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-39ad759c-639b-45e3-a610-556e75a8a02e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062870 Sep 08 14:03:15.655064 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3512/6894] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:03:15 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:16.673268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d56601e2-a117-46a4-a8f9-8c06ded5a626 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:16.677451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d56601e2-a117-46a4-a8f9-8c06ded5a626 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:16.691763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d56601e2-a117-46a4-a8f9-8c06ded5a626 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.692651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d56601e2-a117-46a4-a8f9-8c06ded5a626 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.693451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d56601e2-a117-46a4-a8f9-8c06ded5a626 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.694675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d56601e2-a117-46a4-a8f9-8c06ded5a626 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:16.695290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d56601e2-a117-46a4-a8f9-8c06ded5a626 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:16.696048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d56601e2-a117-46a4-a8f9-8c06ded5a626 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:16.738973 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d56601e2-a117-46a4-a8f9-8c06ded5a626 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073346 Sep 08 14:03:16.739863 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3383/6895] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:03:16 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:17.755942 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-71ec92bd-121f-4c4d-8f0b-5b5e4f26a5a0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:17.758898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-71ec92bd-121f-4c4d-8f0b-5b5e4f26a5a0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:17.767860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71ec92bd-121f-4c4d-8f0b-5b5e4f26a5a0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.768376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71ec92bd-121f-4c4d-8f0b-5b5e4f26a5a0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.768833 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71ec92bd-121f-4c4d-8f0b-5b5e4f26a5a0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.769615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71ec92bd-121f-4c4d-8f0b-5b5e4f26a5a0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:17.770091 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71ec92bd-121f-4c4d-8f0b-5b5e4f26a5a0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:17.770540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-71ec92bd-121f-4c4d-8f0b-5b5e4f26a5a0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:17.813742 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-71ec92bd-121f-4c4d-8f0b-5b5e4f26a5a0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062220 Sep 08 14:03:17.814568 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3513/6896] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:03:17 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:18.832412 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c239c5b5-dcca-4b14-b022-314063234005 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:18.836160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c239c5b5-dcca-4b14-b022-314063234005 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:18.849148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c239c5b5-dcca-4b14-b022-314063234005 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:18.849974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c239c5b5-dcca-4b14-b022-314063234005 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:18.850731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c239c5b5-dcca-4b14-b022-314063234005 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:18.852246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c239c5b5-dcca-4b14-b022-314063234005 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:18.853079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c239c5b5-dcca-4b14-b022-314063234005 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:18.853853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c239c5b5-dcca-4b14-b022-314063234005 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:18.913888 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c239c5b5-dcca-4b14-b022-314063234005 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089853 Sep 08 14:03:18.914645 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3384/6897] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:03:18 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:19.930531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be99f8a8-c0fc-48e6-ae5e-97800ff129e8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:19.933654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-be99f8a8-c0fc-48e6-ae5e-97800ff129e8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:19.944968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be99f8a8-c0fc-48e6-ae5e-97800ff129e8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:19.945928 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be99f8a8-c0fc-48e6-ae5e-97800ff129e8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:19.946742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be99f8a8-c0fc-48e6-ae5e-97800ff129e8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:19.948129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be99f8a8-c0fc-48e6-ae5e-97800ff129e8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:19.948991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be99f8a8-c0fc-48e6-ae5e-97800ff129e8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:19.950278 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be99f8a8-c0fc-48e6-ae5e-97800ff129e8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:20.021408 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-be99f8a8-c0fc-48e6-ae5e-97800ff129e8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095482 Sep 08 14:03:20.022671 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3514/6898] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:03:19 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:03:21.041732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-dc4968b2-d041-4b4e-8c78-e7d779b1fbcf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:21.043997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-dc4968b2-d041-4b4e-8c78-e7d779b1fbcf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:21.052135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc4968b2-d041-4b4e-8c78-e7d779b1fbcf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:21.052635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc4968b2-d041-4b4e-8c78-e7d779b1fbcf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:21.053077 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc4968b2-d041-4b4e-8c78-e7d779b1fbcf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:21.053794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc4968b2-d041-4b4e-8c78-e7d779b1fbcf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:21.054257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc4968b2-d041-4b4e-8c78-e7d779b1fbcf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:21.054686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-dc4968b2-d041-4b4e-8c78-e7d779b1fbcf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:21.097156 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-dc4968b2-d041-4b4e-8c78-e7d779b1fbcf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061930 Sep 08 14:03:21.097775 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3385/6899] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:03:21 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:03:21.109693 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52b7ba9e-b437-4c68-b48b-a48d01bb38c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:21.110292 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-52b7ba9e-b437-4c68-b48b-a48d01bb38c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:21.118376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52b7ba9e-b437-4c68-b48b-a48d01bb38c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:21.118921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52b7ba9e-b437-4c68-b48b-a48d01bb38c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:21.119411 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52b7ba9e-b437-4c68-b48b-a48d01bb38c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:21.120158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52b7ba9e-b437-4c68-b48b-a48d01bb38c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:21.120644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52b7ba9e-b437-4c68-b48b-a48d01bb38c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:21.121092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52b7ba9e-b437-4c68-b48b-a48d01bb38c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:21.223080 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-52b7ba9e-b437-4c68-b48b-a48d01bb38c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] HTTP exception thrown: Instance ef36c649-d519-4c74-b157-9f93f2702647 is not attached to volume 3590fe8b-7142-47e3-80d4-e71286613d4c Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52b7ba9e-b437-4c68-b48b-a48d01bb38c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Request method failure captured: Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: request: DELETE /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments/3590fe8b-7142-47e3-80d4-e71286613d4c HTTP/1.1 Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfUwXgH6hdN5O2ng04ryRr5-I_0ACIPd3fWEEXE4wE0TNrCZrqepdbkeN88TW97cTkWWbmuJHjQeGUcogwBkOWQr5_C7Ay-Dw0f-gyewsoPfKi10ibLw64BkYcuAj59PvlzqKvYN_22mBGYUsv9ecmnm8-B5hR67Wn8JdjmGpFyzCs8 Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 5a165e9dcc2c4669b1dc7e3a77436e05 Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestMinimumBasicScenario-1449230949 Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestMinimumBasicScenario-1449230949 Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 5a165e9dcc2c4669b1dc7e3a77436e05 Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1449230949 Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestMinimumBasicScenario-1449230949-project Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 101a3737eb8547fe965f3421fe07678b Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestMinimumBasicScenario-1449230949-project Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance ef36c649-d519-4c74-b157-9f93f2702647 is not attached to volume 3590fe8b-7142-47e3-80d4-e71286613d4c Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'server_id': 'ef36c649-d519-4c74-b157-9f93f2702647', 'id': '3590fe8b-7142-47e3-80d4-e71286613d4c'} Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3590fe8b-7142-47e3-80d4-e71286613d4c. Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef36c649-d519-4c74-b157-9f93f2702647 is not attached to volume 3590fe8b-7142-47e3-80d4-e71286613d4c Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:21.224952 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:21.232786 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:03:21.232786 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:03:21.232786 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef36c649-d519-4c74-b157-9f93f2702647 is not attached to volume 3590fe8b-7142-47e3-80d4-e71286613d4c Sep 08 14:03:21.232786 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:03:21.232786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52b7ba9e-b437-4c68-b48b-a48d01bb38c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Returning 404 to user: Instance ef36c649-d519-4c74-b157-9f93f2702647 is not attached to volume 3590fe8b-7142-47e3-80d4-e71286613d4c {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:03:21.232786 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-52b7ba9e-b437-4c68-b48b-a48d01bb38c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments/3590fe8b-7142-47e3-80d4-e71286613d4c" status: 404 len: 154 microversion: 2.1 time: 0.121615 Sep 08 14:03:21.232786 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3515/6900] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 14:03:21 2022] DELETE /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647/os-volume_attachments/3590fe8b-7142-47e3-80d4-e71286613d4c => generated 154 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:03:25.736834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8ec126b7-fd41-41fb-95a7-870d0a851b74 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:25.737651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8ec126b7-fd41-41fb-95a7-870d0a851b74 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:25.746664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ec126b7-fd41-41fb-95a7-870d0a851b74 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.747395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ec126b7-fd41-41fb-95a7-870d0a851b74 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.748066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ec126b7-fd41-41fb-95a7-870d0a851b74 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.749023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ec126b7-fd41-41fb-95a7-870d0a851b74 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.749651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ec126b7-fd41-41fb-95a7-870d0a851b74 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.750198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8ec126b7-fd41-41fb-95a7-870d0a851b74 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.788055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8ec126b7-fd41-41fb-95a7-870d0a851b74 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:03:25.904164 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8ec126b7-fd41-41fb-95a7-870d0a851b74 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 204 len: 0 microversion: 2.1 time: 0.170844 Sep 08 14:03:25.911362 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3386/6901] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 14:03:25 2022] DELETE /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 08 14:03:25.916993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-74205f94-3f4b-4daa-b7d9-4ae8d736b6ad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:25.918574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-74205f94-3f4b-4daa-b7d9-4ae8d736b6ad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:25.928155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74205f94-3f4b-4daa-b7d9-4ae8d736b6ad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.929049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74205f94-3f4b-4daa-b7d9-4ae8d736b6ad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.929914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74205f94-3f4b-4daa-b7d9-4ae8d736b6ad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:25.930950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74205f94-3f4b-4daa-b7d9-4ae8d736b6ad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:25.931847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74205f94-3f4b-4daa-b7d9-4ae8d736b6ad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:25.932603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74205f94-3f4b-4daa-b7d9-4ae8d736b6ad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:26.136879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-74205f94-3f4b-4daa-b7d9-4ae8d736b6ad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:26.160176 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-74205f94-3f4b-4daa-b7d9-4ae8d736b6ad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1556 microversion: 2.1 time: 0.247442 Sep 08 14:03:26.164282 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3516/6902] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:25 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1556 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:27.197831 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d5c37e6d-40ff-4096-8dbf-258468532130 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:27.200387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d5c37e6d-40ff-4096-8dbf-258468532130 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:27.213362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5c37e6d-40ff-4096-8dbf-258468532130 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:27.214246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5c37e6d-40ff-4096-8dbf-258468532130 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:27.215108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5c37e6d-40ff-4096-8dbf-258468532130 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:27.217353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5c37e6d-40ff-4096-8dbf-258468532130 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:27.217353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5c37e6d-40ff-4096-8dbf-258468532130 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:27.217353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d5c37e6d-40ff-4096-8dbf-258468532130 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:27.461566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d5c37e6d-40ff-4096-8dbf-258468532130 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:27.471606 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d5c37e6d-40ff-4096-8dbf-258468532130 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1556 microversion: 2.1 time: 0.281557 Sep 08 14:03:27.472204 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3387/6903] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:27 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1556 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:28.508872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-013c9069-86b2-4d01-b4a2-89d270a0bd11 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:28.511699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-013c9069-86b2-4d01-b4a2-89d270a0bd11 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:28.524329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013c9069-86b2-4d01-b4a2-89d270a0bd11 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:28.525112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013c9069-86b2-4d01-b4a2-89d270a0bd11 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:28.525687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013c9069-86b2-4d01-b4a2-89d270a0bd11 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:28.526660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013c9069-86b2-4d01-b4a2-89d270a0bd11 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:28.527665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013c9069-86b2-4d01-b4a2-89d270a0bd11 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:28.528142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-013c9069-86b2-4d01-b4a2-89d270a0bd11 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:28.605819 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-50300243-a2bf-4ddb-9423-af4167fa8889 req-fda2208f-3afe-4aab-a9da-59e9d5e4172c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef36c649-d519-4c74-b157-9f93f2702647", "name": "network-vif-deleted", "tag": "907dde94-fbf3-411a-8467-1fd39617764f"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:28.612392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-013c9069-86b2-4d01-b4a2-89d270a0bd11 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:28.622150 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-013c9069-86b2-4d01-b4a2-89d270a0bd11 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 200 len: 1514 microversion: 2.1 time: 0.126228 Sep 08 14:03:28.622525 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:03:28.622525 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 14:03:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Sep 08 14:03:28.622868 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3517/6904] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:28 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 1514 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:28.638221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-50300243-a2bf-4ddb-9423-af4167fa8889 req-fda2208f-3afe-4aab-a9da-59e9d5e4172c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:28.639002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-50300243-a2bf-4ddb-9423-af4167fa8889 req-fda2208f-3afe-4aab-a9da-59e9d5e4172c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:28.639713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-50300243-a2bf-4ddb-9423-af4167fa8889 req-fda2208f-3afe-4aab-a9da-59e9d5e4172c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:28.656078 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-50300243-a2bf-4ddb-9423-af4167fa8889 req-fda2208f-3afe-4aab-a9da-59e9d5e4172c service nova] Creating event network-vif-deleted:907dde94-fbf3-411a-8467-1fd39617764f for instance ef36c649-d519-4c74-b157-9f93f2702647 on n-h1-852084-10 Sep 08 14:03:28.662498 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-50300243-a2bf-4ddb-9423-af4167fa8889 req-fda2208f-3afe-4aab-a9da-59e9d5e4172c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067763 Sep 08 14:03:28.663362 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3388/6905] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:29.663567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e7815e2d-9d0f-4722-a98b-3158301465a1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:29.664240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e7815e2d-9d0f-4722-a98b-3158301465a1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: ef36c649-d519-4c74-b157-9f93f2702647] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:29.672751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7815e2d-9d0f-4722-a98b-3158301465a1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:29.673272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7815e2d-9d0f-4722-a98b-3158301465a1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:29.673824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7815e2d-9d0f-4722-a98b-3158301465a1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:29.674578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7815e2d-9d0f-4722-a98b-3158301465a1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:29.675063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7815e2d-9d0f-4722-a98b-3158301465a1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:29.675560 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e7815e2d-9d0f-4722-a98b-3158301465a1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:29.695289 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-e7815e2d-9d0f-4722-a98b-3158301465a1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] HTTP exception thrown: Instance ef36c649-d519-4c74-b157-9f93f2702647 could not be found. Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e7815e2d-9d0f-4722-a98b-3158301465a1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Request method failure captured: Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 HTTP/1.1 Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfUwXgH6hdN5O2ng04ryRr5-I_0ACIPd3fWEEXE4wE0TNrCZrqepdbkeN88TW97cTkWWbmuJHjQeGUcogwBkOWQr5_C7Ay-Dw0f-gyewsoPfKi10ibLw64BkYcuAj59PvlzqKvYN_22mBGYUsv9ecmnm8-B5hR67Wn8JdjmGpFyzCs8 Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 5a165e9dcc2c4669b1dc7e3a77436e05 Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestMinimumBasicScenario-1449230949 Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestMinimumBasicScenario-1449230949 Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 5a165e9dcc2c4669b1dc7e3a77436e05 Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1449230949 Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestMinimumBasicScenario-1449230949-project Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 101a3737eb8547fe965f3421fe07678b Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestMinimumBasicScenario-1449230949-project Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance ef36c649-d519-4c74-b157-9f93f2702647 could not be found. Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'ef36c649-d519-4c74-b157-9f93f2702647'} Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef36c649-d519-4c74-b157-9f93f2702647 could not be found. Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef36c649-d519-4c74-b157-9f93f2702647 could not be found. Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:03:29.697407 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:03:29.707561 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:03:29.707561 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:03:29.707561 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:03:29.707561 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:03:29.707561 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:03:29.707561 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef36c649-d519-4c74-b157-9f93f2702647 could not be found. Sep 08 14:03:29.707561 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:03:29.707561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e7815e2d-9d0f-4722-a98b-3158301465a1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Returning 404 to user: Instance ef36c649-d519-4c74-b157-9f93f2702647 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:03:29.707561 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e7815e2d-9d0f-4722-a98b-3158301465a1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647" status: 404 len: 111 microversion: 2.1 time: 0.044237 Sep 08 14:03:29.707561 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3518/6906] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:29 2022] GET /compute/v2.1/servers/ef36c649-d519-4c74-b157-9f93f2702647 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:03:29.715358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d00d7c80-b664-43ad-99a7-fa32e9dbb2eb tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '.version_select at 0x7fdb39c62820>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:29.744352 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d00d7c80-b664-43ad-99a7-fa32e9dbb2eb tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1027001739" status: 202 len: 0 microversion: 2.1 time: 0.035987 Sep 08 14:03:29.744982 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3389/6907] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Sep 8 14:03:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1027001739 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:03:41.092062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b2060d21-5c75-44e3-ac0a-d9cd559ecb1f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Action: 'create', calling method: .version_select at 0x7fdb3702a5e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-950172754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFt5WrYAizu3kqZ81S+T8j+sKH4orapYOs1SlJuie/LV8OqPDAZYaHvoOC7R11CIX75B+kEWOpKHI05y7Xt2Tib6cT5gqyhJwHPEKEs3DatG1fn4fUo5hqZn28w/ub6XA=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:41.099182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=18 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:41.099878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:41.118276 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b2060d21-5c75-44e3-ac0a-d9cd559ecb1f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Getting quotas for project 5a165e9dcc2c4669b1dc7e3a77436e05. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:03:41.125986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-b2060d21-5c75-44e3-ac0a-d9cd559ecb1f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Getting quotas for user 101a3737eb8547fe965f3421fe07678b and project 5a165e9dcc2c4669b1dc7e3a77436e05. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:03:41.163446 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b2060d21-5c75-44e3-ac0a-d9cd559ecb1f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.077673 Sep 08 14:03:41.164111 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3519/6908] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 14:03:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:41.224961 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-724456390", "imageRef": "6f4fbcf2-c9ae-4a17-a99f-d6aca633117a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-950172754", "networks": [{"uuid": "29019394-7a63-42d2-8821-96733842d056"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:41.237396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:41.238051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:41.285609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] validate_networks() for [('29019394-7a63-42d2-8821-96733842d056', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:03:41.821557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:03:41.821976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:03:41.822450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:03:41.822854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:03:41.823805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:03:41.833600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:41.834092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:41.834526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:41.835279 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:41.835853 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:41.836275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:41.855524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Getting quotas for project 5a165e9dcc2c4669b1dc7e3a77436e05. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:03:41.861361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Getting quotas for user 101a3737eb8547fe965f3421fe07678b and project 5a165e9dcc2c4669b1dc7e3a77436e05. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:03:41.875580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:03:41.877872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6f4fbcf2-c9ae-4a17-a99f-d6aca633117a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:03:41.936369 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-85f74f8f-c8c4-42b0-adb2-945169703658 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716358 Sep 08 14:03:41.938780 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3390/6909] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 14:03:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:03:41.948575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-717d5b53-6b5d-41a0-8dba-0452cf63ca31 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:41.949224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-717d5b53-6b5d-41a0-8dba-0452cf63ca31 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:42.017553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-717d5b53-6b5d-41a0-8dba-0452cf63ca31 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:42.029954 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-717d5b53-6b5d-41a0-8dba-0452cf63ca31 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1257 microversion: 2.1 time: 0.085063 Sep 08 14:03:42.031029 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3520/6910] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:41 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1257 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:43.057100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f93c7c6-90a5-4e50-a243-3b8ad7a7b4c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:43.058208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f93c7c6-90a5-4e50-a243-3b8ad7a7b4c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:43.071054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f93c7c6-90a5-4e50-a243-3b8ad7a7b4c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:43.071750 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f93c7c6-90a5-4e50-a243-3b8ad7a7b4c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:43.072273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f93c7c6-90a5-4e50-a243-3b8ad7a7b4c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:43.074960 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f93c7c6-90a5-4e50-a243-3b8ad7a7b4c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:43.075927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f93c7c6-90a5-4e50-a243-3b8ad7a7b4c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:43.076613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f93c7c6-90a5-4e50-a243-3b8ad7a7b4c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:43.206015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f93c7c6-90a5-4e50-a243-3b8ad7a7b4c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:43.218094 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f93c7c6-90a5-4e50-a243-3b8ad7a7b4c0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1309 microversion: 2.1 time: 0.165609 Sep 08 14:03:43.220223 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3391/6911] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:43 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1309 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:03:44.272294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5a61c4fa-d2b9-4e6d-a4c7-b257e31e0a7d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:44.275391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5a61c4fa-d2b9-4e6d-a4c7-b257e31e0a7d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:44.290587 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a61c4fa-d2b9-4e6d-a4c7-b257e31e0a7d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.292140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a61c4fa-d2b9-4e6d-a4c7-b257e31e0a7d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.296283 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a61c4fa-d2b9-4e6d-a4c7-b257e31e0a7d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:44.298339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a61c4fa-d2b9-4e6d-a4c7-b257e31e0a7d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:44.299570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a61c4fa-d2b9-4e6d-a4c7-b257e31e0a7d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:44.300530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a61c4fa-d2b9-4e6d-a4c7-b257e31e0a7d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:45.004290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5a61c4fa-d2b9-4e6d-a4c7-b257e31e0a7d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:45.028848 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5a61c4fa-d2b9-4e6d-a4c7-b257e31e0a7d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1357 microversion: 2.1 time: 0.776372 Sep 08 14:03:45.059735 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3521/6912] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:44 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1357 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:46.108775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-33fd406c-2982-4e93-aec3-918dd991c7c3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:46.114561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33fd406c-2982-4e93-aec3-918dd991c7c3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:46.141778 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33fd406c-2982-4e93-aec3-918dd991c7c3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:46.148467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33fd406c-2982-4e93-aec3-918dd991c7c3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:46.150068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33fd406c-2982-4e93-aec3-918dd991c7c3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:46.152179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33fd406c-2982-4e93-aec3-918dd991c7c3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:46.153584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33fd406c-2982-4e93-aec3-918dd991c7c3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:46.155112 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33fd406c-2982-4e93-aec3-918dd991c7c3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:46.643185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-33fd406c-2982-4e93-aec3-918dd991c7c3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:46.663182 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-33fd406c-2982-4e93-aec3-918dd991c7c3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1357 microversion: 2.1 time: 0.565873 Sep 08 14:03:46.665114 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3392/6913] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:46 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1357 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:47.035842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-8197396a-381b-4378-bb57-278f271e6200 req-dc03aaa3-b863-4ab0-8863-c2c0900e5ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46", "tag": "5c020883-05f5-4c92-80b3-36f0a59e2877"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:47.059718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8197396a-381b-4378-bb57-278f271e6200 req-dc03aaa3-b863-4ab0-8863-c2c0900e5ce4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.061162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8197396a-381b-4378-bb57-278f271e6200 req-dc03aaa3-b863-4ab0-8863-c2c0900e5ce4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.062350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-8197396a-381b-4378-bb57-278f271e6200 req-dc03aaa3-b863-4ab0-8863-c2c0900e5ce4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.095004 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-8197396a-381b-4378-bb57-278f271e6200 req-dc03aaa3-b863-4ab0-8863-c2c0900e5ce4 service nova] Creating event network-changed:5c020883-05f5-4c92-80b3-36f0a59e2877 for instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 on n-h2-852084-10 Sep 08 14:03:47.104389 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-8197396a-381b-4378-bb57-278f271e6200 req-dc03aaa3-b863-4ab0-8863-c2c0900e5ce4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077608 Sep 08 14:03:47.106180 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3522/6914] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:47.713036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1a80b0c2-f4f3-4b2b-a693-533006fb7f94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:47.715603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1a80b0c2-f4f3-4b2b-a693-533006fb7f94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:47.727913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a80b0c2-f4f3-4b2b-a693-533006fb7f94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.728992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a80b0c2-f4f3-4b2b-a693-533006fb7f94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.729689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a80b0c2-f4f3-4b2b-a693-533006fb7f94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.731469 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a80b0c2-f4f3-4b2b-a693-533006fb7f94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:47.732565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a80b0c2-f4f3-4b2b-a693-533006fb7f94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:47.733650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a80b0c2-f4f3-4b2b-a693-533006fb7f94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:47.984289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1a80b0c2-f4f3-4b2b-a693-533006fb7f94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:47.999796 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1a80b0c2-f4f3-4b2b-a693-533006fb7f94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1357 microversion: 2.1 time: 0.298495 Sep 08 14:03:48.000889 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3393/6915] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:47 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1357 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:49.049632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-69aadb1b-e2a1-4fd5-879e-e4c3cae167eb tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:49.050585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-69aadb1b-e2a1-4fd5-879e-e4c3cae167eb tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:49.064130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69aadb1b-e2a1-4fd5-879e-e4c3cae167eb tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:49.065268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69aadb1b-e2a1-4fd5-879e-e4c3cae167eb tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:49.066231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69aadb1b-e2a1-4fd5-879e-e4c3cae167eb tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:49.068073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69aadb1b-e2a1-4fd5-879e-e4c3cae167eb tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:49.071304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69aadb1b-e2a1-4fd5-879e-e4c3cae167eb tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:49.071304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-69aadb1b-e2a1-4fd5-879e-e4c3cae167eb tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:49.308309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-69aadb1b-e2a1-4fd5-879e-e4c3cae167eb tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:49.321452 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-69aadb1b-e2a1-4fd5-879e-e4c3cae167eb tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1357 microversion: 2.1 time: 0.279569 Sep 08 14:03:49.322595 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3523/6916] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:49 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1357 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:50.350093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a79dfa45-8d92-41c5-a230-e63677997981 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:50.351072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a79dfa45-8d92-41c5-a230-e63677997981 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:50.360695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a79dfa45-8d92-41c5-a230-e63677997981 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.360993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a79dfa45-8d92-41c5-a230-e63677997981 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.361665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a79dfa45-8d92-41c5-a230-e63677997981 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.362884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a79dfa45-8d92-41c5-a230-e63677997981 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:50.363702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a79dfa45-8d92-41c5-a230-e63677997981 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:50.364448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a79dfa45-8d92-41c5-a230-e63677997981 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:50.579446 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a79dfa45-8d92-41c5-a230-e63677997981 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:50.591353 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a79dfa45-8d92-41c5-a230-e63677997981 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1357 microversion: 2.1 time: 0.247430 Sep 08 14:03:50.592290 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3394/6917] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:50 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:51.629612 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dc16a805-3d02-4872-b157-da1dc776ca7a tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:51.630458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dc16a805-3d02-4872-b157-da1dc776ca7a tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:51.639265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc16a805-3d02-4872-b157-da1dc776ca7a tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:51.639512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc16a805-3d02-4872-b157-da1dc776ca7a tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:51.640252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc16a805-3d02-4872-b157-da1dc776ca7a tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:51.641121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc16a805-3d02-4872-b157-da1dc776ca7a tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:51.641643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc16a805-3d02-4872-b157-da1dc776ca7a tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:51.642150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dc16a805-3d02-4872-b157-da1dc776ca7a tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:51.863891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dc16a805-3d02-4872-b157-da1dc776ca7a tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:51.875395 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dc16a805-3d02-4872-b157-da1dc776ca7a tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1357 microversion: 2.1 time: 0.249238 Sep 08 14:03:51.876382 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3524/6918] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:51 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1357 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:52.912045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7f916e89-4c0b-466d-96dd-cdae4fd844ca tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:52.912716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7f916e89-4c0b-466d-96dd-cdae4fd844ca tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:52.915990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:52.917004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:52.925783 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f916e89-4c0b-466d-96dd-cdae4fd844ca tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:52.926692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f916e89-4c0b-466d-96dd-cdae4fd844ca tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:52.927526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f916e89-4c0b-466d-96dd-cdae4fd844ca tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:52.928892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f916e89-4c0b-466d-96dd-cdae4fd844ca tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:52.929734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f916e89-4c0b-466d-96dd-cdae4fd844ca tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:52.930423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7f916e89-4c0b-466d-96dd-cdae4fd844ca tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:53.095681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7f916e89-4c0b-466d-96dd-cdae4fd844ca tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:53.110223 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7f916e89-4c0b-466d-96dd-cdae4fd844ca tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1357 microversion: 2.1 time: 0.202110 Sep 08 14:03:53.111353 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3395/6919] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:52 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1357 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:54.142227 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-42ed1fc2-beec-424e-b8de-9c9f83d90b39 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:54.142968 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-42ed1fc2-beec-424e-b8de-9c9f83d90b39 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:54.145318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:03:54.154009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42ed1fc2-beec-424e-b8de-9c9f83d90b39 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:54.154398 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42ed1fc2-beec-424e-b8de-9c9f83d90b39 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:54.154847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42ed1fc2-beec-424e-b8de-9c9f83d90b39 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:54.155780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42ed1fc2-beec-424e-b8de-9c9f83d90b39 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:54.156410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42ed1fc2-beec-424e-b8de-9c9f83d90b39 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:54.156852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-42ed1fc2-beec-424e-b8de-9c9f83d90b39 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:54.374246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-42ed1fc2-beec-424e-b8de-9c9f83d90b39 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:54.383295 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-42ed1fc2-beec-424e-b8de-9c9f83d90b39 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1357 microversion: 2.1 time: 0.245102 Sep 08 14:03:54.384069 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3525/6920] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:54 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1357 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:55.417439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cf10a55c-6727-4673-a44f-d69e5b7140a3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:55.418025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cf10a55c-6727-4673-a44f-d69e5b7140a3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:55.426245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf10a55c-6727-4673-a44f-d69e5b7140a3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:55.427576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf10a55c-6727-4673-a44f-d69e5b7140a3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:55.428201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf10a55c-6727-4673-a44f-d69e5b7140a3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:55.430107 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf10a55c-6727-4673-a44f-d69e5b7140a3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:55.430587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf10a55c-6727-4673-a44f-d69e5b7140a3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:55.431015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cf10a55c-6727-4673-a44f-d69e5b7140a3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:55.589066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cf10a55c-6727-4673-a44f-d69e5b7140a3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:55.596874 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cf10a55c-6727-4673-a44f-d69e5b7140a3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1357 microversion: 2.1 time: 0.186483 Sep 08 14:03:55.597452 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3396/6921] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:55 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:56.620845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6aa0a880-0980-4966-ada6-7f9c2b0cc3b4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:56.621789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6aa0a880-0980-4966-ada6-7f9c2b0cc3b4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:56.628760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6aa0a880-0980-4966-ada6-7f9c2b0cc3b4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:56.629265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6aa0a880-0980-4966-ada6-7f9c2b0cc3b4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:56.629717 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6aa0a880-0980-4966-ada6-7f9c2b0cc3b4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:56.630440 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6aa0a880-0980-4966-ada6-7f9c2b0cc3b4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:56.630906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6aa0a880-0980-4966-ada6-7f9c2b0cc3b4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:56.631378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6aa0a880-0980-4966-ada6-7f9c2b0cc3b4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:56.777294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6aa0a880-0980-4966-ada6-7f9c2b0cc3b4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:56.785792 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6aa0a880-0980-4966-ada6-7f9c2b0cc3b4 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1357 microversion: 2.1 time: 0.169000 Sep 08 14:03:56.786496 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3526/6922] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:56 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:57.810536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d2274e29-47d7-4cf1-b518-7581f2d3120e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:57.811069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d2274e29-47d7-4cf1-b518-7581f2d3120e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:57.820799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2274e29-47d7-4cf1-b518-7581f2d3120e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.821223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2274e29-47d7-4cf1-b518-7581f2d3120e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.821679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2274e29-47d7-4cf1-b518-7581f2d3120e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.822961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2274e29-47d7-4cf1-b518-7581f2d3120e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.823626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2274e29-47d7-4cf1-b518-7581f2d3120e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.824264 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d2274e29-47d7-4cf1-b518-7581f2d3120e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.874788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-8284c498-fb94-429f-8abb-11dcc8e5e805 req-e9f1b86a-491f-45ea-85f2-57535a1ed05f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46", "name": "network-vif-plugged", "status": "completed", "tag": "5c020883-05f5-4c92-80b3-36f0a59e2877"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:03:57.885297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8284c498-fb94-429f-8abb-11dcc8e5e805 req-e9f1b86a-491f-45ea-85f2-57535a1ed05f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:57.885580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8284c498-fb94-429f-8abb-11dcc8e5e805 req-e9f1b86a-491f-45ea-85f2-57535a1ed05f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:57.886192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-8284c498-fb94-429f-8abb-11dcc8e5e805 req-e9f1b86a-491f-45ea-85f2-57535a1ed05f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:57.898725 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-8284c498-fb94-429f-8abb-11dcc8e5e805 req-e9f1b86a-491f-45ea-85f2-57535a1ed05f service nova] Creating event network-vif-plugged:5c020883-05f5-4c92-80b3-36f0a59e2877 for instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 on n-h2-852084-10 Sep 08 14:03:57.904933 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-8284c498-fb94-429f-8abb-11dcc8e5e805 req-e9f1b86a-491f-45ea-85f2-57535a1ed05f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109306 Sep 08 14:03:57.905463 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3397/6923] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:03:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:03:57.983859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d2274e29-47d7-4cf1-b518-7581f2d3120e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:57.992286 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d2274e29-47d7-4cf1-b518-7581f2d3120e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1357 microversion: 2.1 time: 0.186455 Sep 08 14:03:57.993101 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3527/6924] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:57 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1357 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:03:59.021473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-101e0b8c-e26c-4622-a77f-f7349acd9636 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:03:59.022325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-101e0b8c-e26c-4622-a77f-f7349acd9636 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:03:59.032536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-101e0b8c-e26c-4622-a77f-f7349acd9636 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:59.033448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-101e0b8c-e26c-4622-a77f-f7349acd9636 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:59.033990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-101e0b8c-e26c-4622-a77f-f7349acd9636 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:59.035198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-101e0b8c-e26c-4622-a77f-f7349acd9636 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:03:59.035983 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-101e0b8c-e26c-4622-a77f-f7349acd9636 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:03:59.036630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-101e0b8c-e26c-4622-a77f-f7349acd9636 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:03:59.288061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-101e0b8c-e26c-4622-a77f-f7349acd9636 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:03:59.300499 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-101e0b8c-e26c-4622-a77f-f7349acd9636 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1357 microversion: 2.1 time: 0.286737 Sep 08 14:03:59.301604 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3398/6925] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:03:59 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1357 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:00.340401 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3291ea68-4486-4ef4-8605-f2fa0b7703f2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:00.341052 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3291ea68-4486-4ef4-8605-f2fa0b7703f2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:00.347200 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3291ea68-4486-4ef4-8605-f2fa0b7703f2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.347738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3291ea68-4486-4ef4-8605-f2fa0b7703f2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.348180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3291ea68-4486-4ef4-8605-f2fa0b7703f2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.348904 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3291ea68-4486-4ef4-8605-f2fa0b7703f2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.349413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3291ea68-4486-4ef4-8605-f2fa0b7703f2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.349847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3291ea68-4486-4ef4-8605-f2fa0b7703f2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.497895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3291ea68-4486-4ef4-8605-f2fa0b7703f2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:00.507903 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3291ea68-4486-4ef4-8605-f2fa0b7703f2 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1548 microversion: 2.1 time: 0.172562 Sep 08 14:04:00.508502 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3528/6926] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:00 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:00.531058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8fdde4ce-65df-4dc6-87cc-abcdcc53efb3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:00.531707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8fdde4ce-65df-4dc6-87cc-abcdcc53efb3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:00.539027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fdde4ce-65df-4dc6-87cc-abcdcc53efb3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.539551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fdde4ce-65df-4dc6-87cc-abcdcc53efb3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.540003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fdde4ce-65df-4dc6-87cc-abcdcc53efb3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.540707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fdde4ce-65df-4dc6-87cc-abcdcc53efb3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.541194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fdde4ce-65df-4dc6-87cc-abcdcc53efb3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.541627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8fdde4ce-65df-4dc6-87cc-abcdcc53efb3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.693993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8fdde4ce-65df-4dc6-87cc-abcdcc53efb3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:00.705823 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8fdde4ce-65df-4dc6-87cc-abcdcc53efb3 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1548 microversion: 2.1 time: 0.178359 Sep 08 14:04:00.706689 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3399/6927] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:00 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:00.730704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5099ed63-8084-45c9-a605-176863d016ce tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:00.735563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5099ed63-8084-45c9-a605-176863d016ce tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:00.736381 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5099ed63-8084-45c9-a605-176863d016ce tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Searching by: {'deleted': False, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05'} {{(pid=128970) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 08 14:04:00.742731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5099ed63-8084-45c9-a605-176863d016ce tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.743344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5099ed63-8084-45c9-a605-176863d016ce tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.744491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5099ed63-8084-45c9-a605-176863d016ce tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.744848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5099ed63-8084-45c9-a605-176863d016ce tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.745332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5099ed63-8084-45c9-a605-176863d016ce tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.745766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5099ed63-8084-45c9-a605-176863d016ce tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.772666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.multi_cell_list [None req-5099ed63-8084-45c9-a605-176863d016ce tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128970) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 08 14:04:00.805820 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5099ed63-8084-45c9-a605-176863d016ce tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.079287 Sep 08 14:04:00.806421 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3529/6928] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Sep 8 14:04:00 2022] GET /compute/v2.1/servers => generated 342 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:00.819721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2525e731-4a71-4e40-a4f5-efc75e8c1b94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:00.820358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2525e731-4a71-4e40-a4f5-efc75e8c1b94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:00.828016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2525e731-4a71-4e40-a4f5-efc75e8c1b94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.828515 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2525e731-4a71-4e40-a4f5-efc75e8c1b94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.828982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2525e731-4a71-4e40-a4f5-efc75e8c1b94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.829728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2525e731-4a71-4e40-a4f5-efc75e8c1b94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:00.830142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2525e731-4a71-4e40-a4f5-efc75e8c1b94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:00.830610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2525e731-4a71-4e40-a4f5-efc75e8c1b94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:00.998238 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2525e731-4a71-4e40-a4f5-efc75e8c1b94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:01.007995 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2525e731-4a71-4e40-a4f5-efc75e8c1b94 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1548 microversion: 2.1 time: 0.192151 Sep 08 14:04:01.008591 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3400/6929] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:00 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1548 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:02.615652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3bdb09d8-377b-4faa-bdb0-a5b936795e99 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f138217c-9a38-4ac9-8081-afd91c4a01ae"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:02.618111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3bdb09d8-377b-4faa-bdb0-a5b936795e99 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:02.626730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bdb09d8-377b-4faa-bdb0-a5b936795e99 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:02.627284 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bdb09d8-377b-4faa-bdb0-a5b936795e99 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:02.627703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bdb09d8-377b-4faa-bdb0-a5b936795e99 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:02.628712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bdb09d8-377b-4faa-bdb0-a5b936795e99 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:02.629217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bdb09d8-377b-4faa-bdb0-a5b936795e99 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:02.629631 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3bdb09d8-377b-4faa-bdb0-a5b936795e99 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:02.913580 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3bdb09d8-377b-4faa-bdb0-a5b936795e99 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "POST /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.301573 Sep 08 14:04:02.914247 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3530/6930] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Sep 8 14:04:02 2022] POST /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:04:14.991641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8a83a128-a83b-4148-901b-4ef94407fdaf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:14.992865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8a83a128-a83b-4148-901b-4ef94407fdaf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:14.997032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:14.997296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=58 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:15.004097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a83a128-a83b-4148-901b-4ef94407fdaf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:15.004589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a83a128-a83b-4148-901b-4ef94407fdaf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:15.005020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a83a128-a83b-4148-901b-4ef94407fdaf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:15.005732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a83a128-a83b-4148-901b-4ef94407fdaf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:15.006191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a83a128-a83b-4148-901b-4ef94407fdaf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:15.006616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8a83a128-a83b-4148-901b-4ef94407fdaf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:15.163937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8a83a128-a83b-4148-901b-4ef94407fdaf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:15.179595 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8a83a128-a83b-4148-901b-4ef94407fdaf tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1594 microversion: 2.1 time: 0.193103 Sep 08 14:04:15.180482 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3401/6931] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:14 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1594 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:17.418876 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-a28fe548-84be-43c1-adc2-b0898a5085b4 req-11e166a1-e5fd-49d5-a399-f930db9d9c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46", "tag": "5c020883-05f5-4c92-80b3-36f0a59e2877"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:17.427858 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:17.428736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:17.429530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:17.436984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a28fe548-84be-43c1-adc2-b0898a5085b4 req-11e166a1-e5fd-49d5-a399-f930db9d9c15 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:17.437884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a28fe548-84be-43c1-adc2-b0898a5085b4 req-11e166a1-e5fd-49d5-a399-f930db9d9c15 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:17.438671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-a28fe548-84be-43c1-adc2-b0898a5085b4 req-11e166a1-e5fd-49d5-a399-f930db9d9c15 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:17.459612 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-a28fe548-84be-43c1-adc2-b0898a5085b4 req-11e166a1-e5fd-49d5-a399-f930db9d9c15 service nova] Creating event network-changed:5c020883-05f5-4c92-80b3-36f0a59e2877 for instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 on n-h2-852084-10 Sep 08 14:04:17.468644 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-a28fe548-84be-43c1-adc2-b0898a5085b4 req-11e166a1-e5fd-49d5-a399-f930db9d9c15 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053961 Sep 08 14:04:17.469407 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3531/6932] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:19.281101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a42e7e47-eb90-4918-8f16-eded058e0f7f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1496450439"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:19.282277 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a42e7e47-eb90-4918-8f16-eded058e0f7f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:19.295697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a42e7e47-eb90-4918-8f16-eded058e0f7f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.296636 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a42e7e47-eb90-4918-8f16-eded058e0f7f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.297528 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a42e7e47-eb90-4918-8f16-eded058e0f7f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.298813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a42e7e47-eb90-4918-8f16-eded058e0f7f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:19.299792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a42e7e47-eb90-4918-8f16-eded058e0f7f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:19.300669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a42e7e47-eb90-4918-8f16-eded058e0f7f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:19.485267 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.network.security_group_api [None req-a42e7e47-eb90-4918-8f16-eded058e0f7f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Adding security group 49232604-c969-4bd9-acd8-0bb32faf305d to port 5c020883-05f5-4c92-80b3-36f0a59e2877 Sep 08 14:04:19.962166 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a42e7e47-eb90-4918-8f16-eded058e0f7f tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "POST /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/action" status: 202 len: 0 microversion: 2.1 time: 0.688250 Sep 08 14:04:19.963978 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3402/6933] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:04:19 2022] POST /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:04:19.985850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0aefa3e3-f56f-4659-9dda-1489eff21229 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:19.987937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0aefa3e3-f56f-4659-9dda-1489eff21229 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:19.996013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2450c3ed-e019-4c72-a36f-b9bc0a38d280 req-5a940074-bdbf-4e42-ad6a-c7e96645df86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46", "tag": "5c020883-05f5-4c92-80b3-36f0a59e2877"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:19.999935 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0aefa3e3-f56f-4659-9dda-1489eff21229 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.001593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0aefa3e3-f56f-4659-9dda-1489eff21229 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.002622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0aefa3e3-f56f-4659-9dda-1489eff21229 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.004498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0aefa3e3-f56f-4659-9dda-1489eff21229 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.005665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0aefa3e3-f56f-4659-9dda-1489eff21229 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.006561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0aefa3e3-f56f-4659-9dda-1489eff21229 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.021912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2450c3ed-e019-4c72-a36f-b9bc0a38d280 req-5a940074-bdbf-4e42-ad6a-c7e96645df86 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:20.022807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2450c3ed-e019-4c72-a36f-b9bc0a38d280 req-5a940074-bdbf-4e42-ad6a-c7e96645df86 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:20.023620 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2450c3ed-e019-4c72-a36f-b9bc0a38d280 req-5a940074-bdbf-4e42-ad6a-c7e96645df86 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:20.050694 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2450c3ed-e019-4c72-a36f-b9bc0a38d280 req-5a940074-bdbf-4e42-ad6a-c7e96645df86 service nova] Creating event network-changed:5c020883-05f5-4c92-80b3-36f0a59e2877 for instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 on n-h2-852084-10 Sep 08 14:04:20.066546 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2450c3ed-e019-4c72-a36f-b9bc0a38d280 req-5a940074-bdbf-4e42-ad6a-c7e96645df86 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079086 Sep 08 14:04:20.068493 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3403/6934] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:04:20.449446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0aefa3e3-f56f-4659-9dda-1489eff21229 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:20.467027 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0aefa3e3-f56f-4659-9dda-1489eff21229 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1760 microversion: 2.1 time: 0.494803 Sep 08 14:04:20.467629 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3532/6935] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:19 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1760 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:34.577470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:34.578735 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=12 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:34.585111 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c3aa969e-550d-4482-8a09-35a693ae0e33 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:04:34.587617 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c3aa969e-550d-4482-8a09-35a693ae0e33 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:34.595723 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3aa969e-550d-4482-8a09-35a693ae0e33 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:34.596228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3aa969e-550d-4482-8a09-35a693ae0e33 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:34.596696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3aa969e-550d-4482-8a09-35a693ae0e33 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:34.597573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3aa969e-550d-4482-8a09-35a693ae0e33 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:34.598076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3aa969e-550d-4482-8a09-35a693ae0e33 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:34.598561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c3aa969e-550d-4482-8a09-35a693ae0e33 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:34.697524 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c3aa969e-550d-4482-8a09-35a693ae0e33 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "POST /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/action" status: 202 len: 0 microversion: 2.1 time: 0.123800 Sep 08 14:04:34.698921 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3404/6936] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:04:34 2022] POST /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:04:34.709640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0afe9ec7-bd96-4526-bd36-bee9eee4cd30 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:34.710394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0afe9ec7-bd96-4526-bd36-bee9eee4cd30 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:34.714155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:34.714962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:04:34.720523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0afe9ec7-bd96-4526-bd36-bee9eee4cd30 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:34.721146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0afe9ec7-bd96-4526-bd36-bee9eee4cd30 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:34.721913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0afe9ec7-bd96-4526-bd36-bee9eee4cd30 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:34.722846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0afe9ec7-bd96-4526-bd36-bee9eee4cd30 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:34.723664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0afe9ec7-bd96-4526-bd36-bee9eee4cd30 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:34.724042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0afe9ec7-bd96-4526-bd36-bee9eee4cd30 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:34.986370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0afe9ec7-bd96-4526-bd36-bee9eee4cd30 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:34.996449 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0afe9ec7-bd96-4526-bd36-bee9eee4cd30 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1752 microversion: 2.1 time: 0.291569 Sep 08 14:04:34.997204 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3533/6937] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:34 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1752 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:36.024658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3b0d2ab5-3ec1-4b00-acdb-7d55a2ad189c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:36.025479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3b0d2ab5-3ec1-4b00-acdb-7d55a2ad189c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:36.032623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b0d2ab5-3ec1-4b00-acdb-7d55a2ad189c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:36.033206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b0d2ab5-3ec1-4b00-acdb-7d55a2ad189c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:36.033561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b0d2ab5-3ec1-4b00-acdb-7d55a2ad189c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:36.034557 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b0d2ab5-3ec1-4b00-acdb-7d55a2ad189c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:36.035014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b0d2ab5-3ec1-4b00-acdb-7d55a2ad189c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:36.035474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3b0d2ab5-3ec1-4b00-acdb-7d55a2ad189c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:36.228378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3b0d2ab5-3ec1-4b00-acdb-7d55a2ad189c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:36.237982 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3b0d2ab5-3ec1-4b00-acdb-7d55a2ad189c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.219477 Sep 08 14:04:36.238700 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3405/6938] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:36 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:37.265027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0911d487-0d0d-4269-b8b9-640f84b25010 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:37.265817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0911d487-0d0d-4269-b8b9-640f84b25010 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:37.276817 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0911d487-0d0d-4269-b8b9-640f84b25010 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:37.277712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0911d487-0d0d-4269-b8b9-640f84b25010 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:37.278496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0911d487-0d0d-4269-b8b9-640f84b25010 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:37.279786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0911d487-0d0d-4269-b8b9-640f84b25010 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:37.280497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0911d487-0d0d-4269-b8b9-640f84b25010 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:37.281195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0911d487-0d0d-4269-b8b9-640f84b25010 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:37.462253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0911d487-0d0d-4269-b8b9-640f84b25010 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:37.473191 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0911d487-0d0d-4269-b8b9-640f84b25010 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.212599 Sep 08 14:04:37.473768 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3534/6939] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:37 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:38.502871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9868cb41-fb6b-42e5-8a94-3e29a489cbcd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:38.503958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9868cb41-fb6b-42e5-8a94-3e29a489cbcd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:38.513108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9868cb41-fb6b-42e5-8a94-3e29a489cbcd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:38.513634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9868cb41-fb6b-42e5-8a94-3e29a489cbcd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:38.514153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9868cb41-fb6b-42e5-8a94-3e29a489cbcd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:38.514985 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9868cb41-fb6b-42e5-8a94-3e29a489cbcd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:38.515638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9868cb41-fb6b-42e5-8a94-3e29a489cbcd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:38.516147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9868cb41-fb6b-42e5-8a94-3e29a489cbcd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:38.732792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9868cb41-fb6b-42e5-8a94-3e29a489cbcd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:38.744584 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9868cb41-fb6b-42e5-8a94-3e29a489cbcd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.249033 Sep 08 14:04:38.745279 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3406/6940] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:38 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:39.770279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8522c81e-0219-44f3-acda-488c88e9207c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:39.770279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8522c81e-0219-44f3-acda-488c88e9207c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:39.778933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8522c81e-0219-44f3-acda-488c88e9207c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:39.779514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8522c81e-0219-44f3-acda-488c88e9207c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:39.779961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8522c81e-0219-44f3-acda-488c88e9207c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:39.780685 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8522c81e-0219-44f3-acda-488c88e9207c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:39.781155 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8522c81e-0219-44f3-acda-488c88e9207c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:39.781627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8522c81e-0219-44f3-acda-488c88e9207c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:39.988997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8522c81e-0219-44f3-acda-488c88e9207c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:40.002391 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8522c81e-0219-44f3-acda-488c88e9207c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.236159 Sep 08 14:04:40.003547 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3535/6941] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:39 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:41.027153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-12fbfea2-3d92-4c66-a5dc-d19e3194ca6e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:41.028060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-12fbfea2-3d92-4c66-a5dc-d19e3194ca6e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:41.035194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12fbfea2-3d92-4c66-a5dc-d19e3194ca6e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:41.035722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12fbfea2-3d92-4c66-a5dc-d19e3194ca6e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:41.036167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12fbfea2-3d92-4c66-a5dc-d19e3194ca6e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:41.036964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12fbfea2-3d92-4c66-a5dc-d19e3194ca6e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:41.037441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12fbfea2-3d92-4c66-a5dc-d19e3194ca6e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:41.038118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12fbfea2-3d92-4c66-a5dc-d19e3194ca6e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:41.212754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-12fbfea2-3d92-4c66-a5dc-d19e3194ca6e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:41.222321 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-12fbfea2-3d92-4c66-a5dc-d19e3194ca6e tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.199449 Sep 08 14:04:41.231285 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3407/6942] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:41 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:42.251071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1be6a530-542d-4c39-bd17-dca032c170fc tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:42.251767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1be6a530-542d-4c39-bd17-dca032c170fc tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:42.259569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1be6a530-542d-4c39-bd17-dca032c170fc tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:42.260088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1be6a530-542d-4c39-bd17-dca032c170fc tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:42.260534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1be6a530-542d-4c39-bd17-dca032c170fc tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:42.261289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1be6a530-542d-4c39-bd17-dca032c170fc tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:42.261783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1be6a530-542d-4c39-bd17-dca032c170fc tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:42.262525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1be6a530-542d-4c39-bd17-dca032c170fc tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:42.470245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1be6a530-542d-4c39-bd17-dca032c170fc tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:42.479166 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1be6a530-542d-4c39-bd17-dca032c170fc tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.233762 Sep 08 14:04:42.479951 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3536/6943] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:42 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:43.504286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9ae6ba05-f614-422a-b3f8-b3159a837bad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:43.505083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9ae6ba05-f614-422a-b3f8-b3159a837bad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:43.513516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ae6ba05-f614-422a-b3f8-b3159a837bad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:43.514001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ae6ba05-f614-422a-b3f8-b3159a837bad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:43.514435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ae6ba05-f614-422a-b3f8-b3159a837bad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:43.515140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ae6ba05-f614-422a-b3f8-b3159a837bad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:43.515643 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ae6ba05-f614-422a-b3f8-b3159a837bad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:43.516067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9ae6ba05-f614-422a-b3f8-b3159a837bad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:43.710599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9ae6ba05-f614-422a-b3f8-b3159a837bad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:43.722670 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9ae6ba05-f614-422a-b3f8-b3159a837bad tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.222640 Sep 08 14:04:43.723499 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3408/6944] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:43 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:44.748853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-624f484d-1b8b-4921-83e2-87dc7b5a4e40 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:44.749635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-624f484d-1b8b-4921-83e2-87dc7b5a4e40 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:44.768412 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-624f484d-1b8b-4921-83e2-87dc7b5a4e40 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:44.768933 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-624f484d-1b8b-4921-83e2-87dc7b5a4e40 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:44.769410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-624f484d-1b8b-4921-83e2-87dc7b5a4e40 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:44.770195 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-624f484d-1b8b-4921-83e2-87dc7b5a4e40 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:44.770678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-624f484d-1b8b-4921-83e2-87dc7b5a4e40 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:44.771320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-624f484d-1b8b-4921-83e2-87dc7b5a4e40 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:44.987503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-624f484d-1b8b-4921-83e2-87dc7b5a4e40 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:44.997054 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-624f484d-1b8b-4921-83e2-87dc7b5a4e40 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.252481 Sep 08 14:04:44.998006 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3537/6945] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:44 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:46.025418 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-58eb8fda-e734-46d9-be61-84d56ba6f6be tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:46.026275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-58eb8fda-e734-46d9-be61-84d56ba6f6be tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:46.034367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58eb8fda-e734-46d9-be61-84d56ba6f6be tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:46.034881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58eb8fda-e734-46d9-be61-84d56ba6f6be tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:46.035370 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58eb8fda-e734-46d9-be61-84d56ba6f6be tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:46.036133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58eb8fda-e734-46d9-be61-84d56ba6f6be tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:46.036605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58eb8fda-e734-46d9-be61-84d56ba6f6be tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:46.037043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-58eb8fda-e734-46d9-be61-84d56ba6f6be tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:46.264099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-58eb8fda-e734-46d9-be61-84d56ba6f6be tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:46.289457 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-58eb8fda-e734-46d9-be61-84d56ba6f6be tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.270501 Sep 08 14:04:46.290546 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3409/6946] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:46 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:47.338383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fe594f07-34ba-48cf-abb9-fb56137def6d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:47.339134 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fe594f07-34ba-48cf-abb9-fb56137def6d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:47.346597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe594f07-34ba-48cf-abb9-fb56137def6d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.347111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe594f07-34ba-48cf-abb9-fb56137def6d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.347695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe594f07-34ba-48cf-abb9-fb56137def6d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.348430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe594f07-34ba-48cf-abb9-fb56137def6d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:47.348896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe594f07-34ba-48cf-abb9-fb56137def6d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:47.349334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe594f07-34ba-48cf-abb9-fb56137def6d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:47.518829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fe594f07-34ba-48cf-abb9-fb56137def6d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:47.527458 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fe594f07-34ba-48cf-abb9-fb56137def6d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.192979 Sep 08 14:04:47.528094 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3538/6947] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:47 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:48.551988 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d108dc4f-fa8b-4131-bf1d-a62eaa277a84 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:48.552629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d108dc4f-fa8b-4131-bf1d-a62eaa277a84 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:48.559387 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d108dc4f-fa8b-4131-bf1d-a62eaa277a84 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:48.559880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d108dc4f-fa8b-4131-bf1d-a62eaa277a84 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:48.560324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d108dc4f-fa8b-4131-bf1d-a62eaa277a84 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:48.561036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d108dc4f-fa8b-4131-bf1d-a62eaa277a84 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:48.561493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d108dc4f-fa8b-4131-bf1d-a62eaa277a84 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:48.561945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d108dc4f-fa8b-4131-bf1d-a62eaa277a84 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:48.725091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d108dc4f-fa8b-4131-bf1d-a62eaa277a84 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:48.734046 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d108dc4f-fa8b-4131-bf1d-a62eaa277a84 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.185952 Sep 08 14:04:48.734649 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3410/6948] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:48 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:04:49.759538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f2576db1-7004-40f7-8a9d-907b8d5bf3f1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:49.760179 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f2576db1-7004-40f7-8a9d-907b8d5bf3f1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:49.768471 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2576db1-7004-40f7-8a9d-907b8d5bf3f1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:49.769017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2576db1-7004-40f7-8a9d-907b8d5bf3f1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:49.769532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2576db1-7004-40f7-8a9d-907b8d5bf3f1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:49.770198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2576db1-7004-40f7-8a9d-907b8d5bf3f1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:49.770675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2576db1-7004-40f7-8a9d-907b8d5bf3f1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:49.771118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2576db1-7004-40f7-8a9d-907b8d5bf3f1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:49.946998 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f2576db1-7004-40f7-8a9d-907b8d5bf3f1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:49.956535 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f2576db1-7004-40f7-8a9d-907b8d5bf3f1 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.201886 Sep 08 14:04:49.957176 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3539/6949] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:49 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:50.982468 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-44d7edb2-f294-45d1-86f0-29d6027b93fa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:50.983091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-44d7edb2-f294-45d1-86f0-29d6027b93fa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:50.990900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44d7edb2-f294-45d1-86f0-29d6027b93fa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:50.991429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44d7edb2-f294-45d1-86f0-29d6027b93fa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:50.991872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44d7edb2-f294-45d1-86f0-29d6027b93fa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:50.992684 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44d7edb2-f294-45d1-86f0-29d6027b93fa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:50.993301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44d7edb2-f294-45d1-86f0-29d6027b93fa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:50.993826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-44d7edb2-f294-45d1-86f0-29d6027b93fa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:51.159749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-44d7edb2-f294-45d1-86f0-29d6027b93fa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:51.169059 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-44d7edb2-f294-45d1-86f0-29d6027b93fa tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1757 microversion: 2.1 time: 0.190354 Sep 08 14:04:51.169860 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3411/6950] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:50 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:04:52.193585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0c1ec8d9-3577-42d9-a0a0-268830f5eae7 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:04:52.194857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0c1ec8d9-3577-42d9-a0a0-268830f5eae7 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:04:52.202085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c1ec8d9-3577-42d9-a0a0-268830f5eae7 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:52.202590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c1ec8d9-3577-42d9-a0a0-268830f5eae7 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:52.203044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c1ec8d9-3577-42d9-a0a0-268830f5eae7 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:52.203793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c1ec8d9-3577-42d9-a0a0-268830f5eae7 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:04:52.204263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c1ec8d9-3577-42d9-a0a0-268830f5eae7 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:04:52.204705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c1ec8d9-3577-42d9-a0a0-268830f5eae7 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:04:52.352598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0c1ec8d9-3577-42d9-a0a0-268830f5eae7 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:04:52.363108 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0c1ec8d9-3577-42d9-a0a0-268830f5eae7 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1760 microversion: 2.1 time: 0.173610 Sep 08 14:04:52.364061 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3540/6951] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:04:52 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1760 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:24.401774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-67a50eae-8b5b-44c3-bbb0-98f5e49825cd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1496450439"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:24.402406 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-67a50eae-8b5b-44c3-bbb0-98f5e49825cd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:24.405187 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=16 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:24.405874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:24.414527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67a50eae-8b5b-44c3-bbb0-98f5e49825cd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.415043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67a50eae-8b5b-44c3-bbb0-98f5e49825cd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.415483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67a50eae-8b5b-44c3-bbb0-98f5e49825cd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.416201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67a50eae-8b5b-44c3-bbb0-98f5e49825cd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.416645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67a50eae-8b5b-44c3-bbb0-98f5e49825cd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.417184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-67a50eae-8b5b-44c3-bbb0-98f5e49825cd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.556322 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.network.security_group_api [None req-67a50eae-8b5b-44c3-bbb0-98f5e49825cd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Removing security group 49232604-c969-4bd9-acd8-0bb32faf305d from port 5c020883-05f5-4c92-80b3-36f0a59e2877 Sep 08 14:05:24.896447 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-67a50eae-8b5b-44c3-bbb0-98f5e49825cd tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "POST /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/action" status: 202 len: 0 microversion: 2.1 time: 0.498792 Sep 08 14:05:24.897380 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3412/6952] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:05:24 2022] POST /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:24.906341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-abe9dd59-58cc-4b06-b72f-91d52f95f625 req-1858866a-495b-4581-b5be-31c90d4411e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46", "tag": "5c020883-05f5-4c92-80b3-36f0a59e2877"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:24.912295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=16 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:24.912992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=48 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:24.915250 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:05:24.915560 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 14:05:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Sep 08 14:05:24.925724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-abe9dd59-58cc-4b06-b72f-91d52f95f625 req-1858866a-495b-4581-b5be-31c90d4411e6 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:24.926237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-abe9dd59-58cc-4b06-b72f-91d52f95f625 req-1858866a-495b-4581-b5be-31c90d4411e6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:24.927286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-abe9dd59-58cc-4b06-b72f-91d52f95f625 req-1858866a-495b-4581-b5be-31c90d4411e6 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:24.944205 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-abe9dd59-58cc-4b06-b72f-91d52f95f625 req-1858866a-495b-4581-b5be-31c90d4411e6 service nova] Creating event network-changed:5c020883-05f5-4c92-80b3-36f0a59e2877 for instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 on n-h2-852084-10 Sep 08 14:05:24.951038 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-abe9dd59-58cc-4b06-b72f-91d52f95f625 req-1858866a-495b-4581-b5be-31c90d4411e6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048839 Sep 08 14:05:24.953834 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3541/6953] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:26.667066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9c5a7987-a338-48fe-966b-adea35a01552 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:26.667644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9c5a7987-a338-48fe-966b-adea35a01552 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:26.673693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c5a7987-a338-48fe-966b-adea35a01552 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.674184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c5a7987-a338-48fe-966b-adea35a01552 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.674628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c5a7987-a338-48fe-966b-adea35a01552 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.675355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c5a7987-a338-48fe-966b-adea35a01552 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.675818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c5a7987-a338-48fe-966b-adea35a01552 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.676249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9c5a7987-a338-48fe-966b-adea35a01552 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.763473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-9c5a7987-a338-48fe-966b-adea35a01552 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lazy-loading 'services' on Instance uuid 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:05:26.840217 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9c5a7987-a338-48fe-966b-adea35a01552 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments/f138217c-9a38-4ac9-8081-afd91c4a01ae" status: 202 len: 0 microversion: 2.1 time: 0.177740 Sep 08 14:05:26.840925 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3413/6954] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 14:05:26 2022] DELETE /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments/f138217c-9a38-4ac9-8081-afd91c4a01ae => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:26.851621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-eb803f2b-3d43-40d0-aa49-d749e5cc9c8d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:26.854039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-eb803f2b-3d43-40d0-aa49-d749e5cc9c8d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:26.861640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb803f2b-3d43-40d0-aa49-d749e5cc9c8d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.862481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb803f2b-3d43-40d0-aa49-d749e5cc9c8d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.863124 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb803f2b-3d43-40d0-aa49-d749e5cc9c8d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.864668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb803f2b-3d43-40d0-aa49-d749e5cc9c8d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.865242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb803f2b-3d43-40d0-aa49-d749e5cc9c8d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.865680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-eb803f2b-3d43-40d0-aa49-d749e5cc9c8d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.904253 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-eb803f2b-3d43-40d0-aa49-d749e5cc9c8d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058440 Sep 08 14:05:26.905172 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3542/6955] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:26 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:26.969947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0bb422b8-9b1d-4fc6-b0a5-78fb840866a1 req-b9ac2828-d907-40d2-b19f-8e37aabe58f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46", "tag": "5c020883-05f5-4c92-80b3-36f0a59e2877"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:26.980839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0bb422b8-9b1d-4fc6-b0a5-78fb840866a1 req-b9ac2828-d907-40d2-b19f-8e37aabe58f9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:26.981332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0bb422b8-9b1d-4fc6-b0a5-78fb840866a1 req-b9ac2828-d907-40d2-b19f-8e37aabe58f9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:26.981766 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0bb422b8-9b1d-4fc6-b0a5-78fb840866a1 req-b9ac2828-d907-40d2-b19f-8e37aabe58f9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:26.993715 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0bb422b8-9b1d-4fc6-b0a5-78fb840866a1 req-b9ac2828-d907-40d2-b19f-8e37aabe58f9 service nova] Creating event network-changed:5c020883-05f5-4c92-80b3-36f0a59e2877 for instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 on n-h2-852084-10 Sep 08 14:05:26.998543 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0bb422b8-9b1d-4fc6-b0a5-78fb840866a1 req-b9ac2828-d907-40d2-b19f-8e37aabe58f9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032627 Sep 08 14:05:26.999143 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3414/6956] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:05:27.918523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f14d7d5a-c5d7-490e-bb1a-33cf98ebeed8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:27.920830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f14d7d5a-c5d7-490e-bb1a-33cf98ebeed8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:27.927994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f14d7d5a-c5d7-490e-bb1a-33cf98ebeed8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:27.928496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f14d7d5a-c5d7-490e-bb1a-33cf98ebeed8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:27.928954 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f14d7d5a-c5d7-490e-bb1a-33cf98ebeed8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:27.929679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f14d7d5a-c5d7-490e-bb1a-33cf98ebeed8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:27.930383 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f14d7d5a-c5d7-490e-bb1a-33cf98ebeed8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:27.930919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f14d7d5a-c5d7-490e-bb1a-33cf98ebeed8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:27.964892 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f14d7d5a-c5d7-490e-bb1a-33cf98ebeed8 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050406 Sep 08 14:05:27.965508 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3543/6957] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:27 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:28.979644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-221a7701-8239-4ea8-9d43-dd996ac1fd47 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:28.982007 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-221a7701-8239-4ea8-9d43-dd996ac1fd47 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:28.988656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-221a7701-8239-4ea8-9d43-dd996ac1fd47 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:28.989189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-221a7701-8239-4ea8-9d43-dd996ac1fd47 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:28.989635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-221a7701-8239-4ea8-9d43-dd996ac1fd47 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:28.990353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-221a7701-8239-4ea8-9d43-dd996ac1fd47 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:28.990805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-221a7701-8239-4ea8-9d43-dd996ac1fd47 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:28.991250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-221a7701-8239-4ea8-9d43-dd996ac1fd47 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:29.033140 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-221a7701-8239-4ea8-9d43-dd996ac1fd47 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059066 Sep 08 14:05:29.033958 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3415/6958] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:28 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:30.046732 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e70ac9ee-c27a-409f-9c41-6614b924377c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:30.049077 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e70ac9ee-c27a-409f-9c41-6614b924377c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:30.057303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e70ac9ee-c27a-409f-9c41-6614b924377c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:30.057757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e70ac9ee-c27a-409f-9c41-6614b924377c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:30.058214 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e70ac9ee-c27a-409f-9c41-6614b924377c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:30.058962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e70ac9ee-c27a-409f-9c41-6614b924377c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:30.059483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e70ac9ee-c27a-409f-9c41-6614b924377c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:30.059938 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e70ac9ee-c27a-409f-9c41-6614b924377c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:30.093840 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e70ac9ee-c27a-409f-9c41-6614b924377c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051379 Sep 08 14:05:30.094489 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3544/6959] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:30 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:31.107208 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4f2b9119-4e66-4ed8-82c4-4c669257d0ed tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:31.109594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4f2b9119-4e66-4ed8-82c4-4c669257d0ed tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:31.117083 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f2b9119-4e66-4ed8-82c4-4c669257d0ed tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:31.117659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f2b9119-4e66-4ed8-82c4-4c669257d0ed tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:31.118168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f2b9119-4e66-4ed8-82c4-4c669257d0ed tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:31.118941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f2b9119-4e66-4ed8-82c4-4c669257d0ed tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:31.119498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f2b9119-4e66-4ed8-82c4-4c669257d0ed tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:31.119927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4f2b9119-4e66-4ed8-82c4-4c669257d0ed tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:31.153493 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4f2b9119-4e66-4ed8-82c4-4c669257d0ed tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050366 Sep 08 14:05:31.154085 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3416/6960] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:31 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:32.166763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-68f35fdc-8356-4383-8f10-bc4cf68cffc0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:32.169158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-68f35fdc-8356-4383-8f10-bc4cf68cffc0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:32.176499 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68f35fdc-8356-4383-8f10-bc4cf68cffc0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:32.177007 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68f35fdc-8356-4383-8f10-bc4cf68cffc0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:32.177472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68f35fdc-8356-4383-8f10-bc4cf68cffc0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:32.178233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68f35fdc-8356-4383-8f10-bc4cf68cffc0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:32.178706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68f35fdc-8356-4383-8f10-bc4cf68cffc0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:32.179150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-68f35fdc-8356-4383-8f10-bc4cf68cffc0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:32.213320 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-68f35fdc-8356-4383-8f10-bc4cf68cffc0 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050523 Sep 08 14:05:32.216225 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3545/6961] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Sep 8 14:05:32 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 08 14:05:32.225228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff276373-093a-4a14-98e6-95df3734aef9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:32.225805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ff276373-093a-4a14-98e6-95df3734aef9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:32.232775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff276373-093a-4a14-98e6-95df3734aef9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:32.233262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff276373-093a-4a14-98e6-95df3734aef9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:32.233697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff276373-093a-4a14-98e6-95df3734aef9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:32.234394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff276373-093a-4a14-98e6-95df3734aef9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:32.234843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff276373-093a-4a14-98e6-95df3734aef9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:32.235285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ff276373-093a-4a14-98e6-95df3734aef9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:32.320899 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-ff276373-093a-4a14-98e6-95df3734aef9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] HTTP exception thrown: Instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 is not attached to volume f138217c-9a38-4ac9-8081-afd91c4a01ae Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff276373-093a-4a14-98e6-95df3734aef9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Request method failure captured: Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: request: DELETE /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments/f138217c-9a38-4ac9-8081-afd91c4a01ae HTTP/1.1 Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfUwXgH6hdN5O2ng04ryRr5-I_0ACIPd3fWEEXE4wE0TNrCZrqepdbkeN88TW97cTkWWbmuJHjQeGUcogwBkOWQr5_C7Ay-Dw0f-gyewsoPfKi10ibLw64BkYcuAj59PvlzqKvYN_22mBGYUsv9ecmnm8-B5hR67Wn8JdjmGpFyzCs8 Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 5a165e9dcc2c4669b1dc7e3a77436e05 Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestMinimumBasicScenario-1449230949 Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestMinimumBasicScenario-1449230949 Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 5a165e9dcc2c4669b1dc7e3a77436e05 Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1449230949 Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestMinimumBasicScenario-1449230949-project Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 101a3737eb8547fe965f3421fe07678b Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestMinimumBasicScenario-1449230949-project Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 is not attached to volume f138217c-9a38-4ac9-8081-afd91c4a01ae Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'server_id': '8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46', 'id': 'f138217c-9a38-4ac9-8081-afd91c4a01ae'} Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f138217c-9a38-4ac9-8081-afd91c4a01ae. Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 is not attached to volume f138217c-9a38-4ac9-8081-afd91c4a01ae Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:32.322618 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:32.327124 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:32.327124 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:32.327124 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 is not attached to volume f138217c-9a38-4ac9-8081-afd91c4a01ae Sep 08 14:05:32.327124 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:05:32.327124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ff276373-093a-4a14-98e6-95df3734aef9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Returning 404 to user: Instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 is not attached to volume f138217c-9a38-4ac9-8081-afd91c4a01ae {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:32.327124 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ff276373-093a-4a14-98e6-95df3734aef9 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments/f138217c-9a38-4ac9-8081-afd91c4a01ae" status: 404 len: 154 microversion: 2.1 time: 0.103138 Sep 08 14:05:32.327124 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3417/6962] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Sep 8 14:05:32 2022] DELETE /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46/os-volume_attachments/f138217c-9a38-4ac9-8081-afd91c4a01ae => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:35.626189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6f26786f-d876-44cc-9ce2-f090ca9efc5d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:35.627004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f26786f-d876-44cc-9ce2-f090ca9efc5d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:35.634057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f26786f-d876-44cc-9ce2-f090ca9efc5d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.635842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f26786f-d876-44cc-9ce2-f090ca9efc5d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.636326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f26786f-d876-44cc-9ce2-f090ca9efc5d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.637626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f26786f-d876-44cc-9ce2-f090ca9efc5d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.637626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f26786f-d876-44cc-9ce2-f090ca9efc5d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.638041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6f26786f-d876-44cc-9ce2-f090ca9efc5d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.670798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6f26786f-d876-44cc-9ce2-f090ca9efc5d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:05:35.772945 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6f26786f-d876-44cc-9ce2-f090ca9efc5d tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 204 len: 0 microversion: 2.1 time: 0.151668 Sep 08 14:05:35.774018 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3546/6963] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 14:05:35 2022] DELETE /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:05:35.783081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6d22d645-57af-485f-abaf-32676f543892 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:35.784340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6d22d645-57af-485f-abaf-32676f543892 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:35.791603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d22d645-57af-485f-abaf-32676f543892 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.792380 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d22d645-57af-485f-abaf-32676f543892 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.792827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d22d645-57af-485f-abaf-32676f543892 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.793597 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d22d645-57af-485f-abaf-32676f543892 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:35.794199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d22d645-57af-485f-abaf-32676f543892 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:35.795068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d22d645-57af-485f-abaf-32676f543892 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:35.937827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6d22d645-57af-485f-abaf-32676f543892 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:35.948370 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6d22d645-57af-485f-abaf-32676f543892 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1554 microversion: 2.1 time: 0.169652 Sep 08 14:05:35.949074 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3418/6964] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:35 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:36.972901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5bf68d32-594b-48a0-905c-5819ed18c021 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:36.974161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5bf68d32-594b-48a0-905c-5819ed18c021 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:36.983070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bf68d32-594b-48a0-905c-5819ed18c021 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:36.983640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bf68d32-594b-48a0-905c-5819ed18c021 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:36.984102 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bf68d32-594b-48a0-905c-5819ed18c021 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:36.984840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bf68d32-594b-48a0-905c-5819ed18c021 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:36.985316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bf68d32-594b-48a0-905c-5819ed18c021 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:36.985758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5bf68d32-594b-48a0-905c-5819ed18c021 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:37.124570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5bf68d32-594b-48a0-905c-5819ed18c021 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:37.133293 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5bf68d32-594b-48a0-905c-5819ed18c021 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1554 microversion: 2.1 time: 0.164766 Sep 08 14:05:37.133884 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3547/6965] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:36 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:05:38.158139 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-69848ce4-03c8-4c91-9724-8033ba1b8e7c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:38.158843 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-69848ce4-03c8-4c91-9724-8033ba1b8e7c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:38.172974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69848ce4-03c8-4c91-9724-8033ba1b8e7c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.173523 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69848ce4-03c8-4c91-9724-8033ba1b8e7c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.174011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69848ce4-03c8-4c91-9724-8033ba1b8e7c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.174683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69848ce4-03c8-4c91-9724-8033ba1b8e7c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.175146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69848ce4-03c8-4c91-9724-8033ba1b8e7c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.175624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-69848ce4-03c8-4c91-9724-8033ba1b8e7c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.251169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-69848ce4-03c8-4c91-9724-8033ba1b8e7c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '101a3737eb8547fe965f3421fe07678b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a165e9dcc2c4669b1dc7e3a77436e05', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:38.260680 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-69848ce4-03c8-4c91-9724-8033ba1b8e7c tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 200 len: 1512 microversion: 2.1 time: 0.106587 Sep 08 14:05:38.267562 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3419/6966] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:38 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 1512 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:38.281795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c491de8a-e8ed-44d9-ba48-a80c566ab9fc req-2a08a2fc-3963-4e0d-8a99-b4f550cd683d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46", "name": "network-vif-deleted", "tag": "5c020883-05f5-4c92-80b3-36f0a59e2877"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:38.291082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c491de8a-e8ed-44d9-ba48-a80c566ab9fc req-2a08a2fc-3963-4e0d-8a99-b4f550cd683d service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:38.291625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c491de8a-e8ed-44d9-ba48-a80c566ab9fc req-2a08a2fc-3963-4e0d-8a99-b4f550cd683d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:38.292067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c491de8a-e8ed-44d9-ba48-a80c566ab9fc req-2a08a2fc-3963-4e0d-8a99-b4f550cd683d service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:38.303960 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c491de8a-e8ed-44d9-ba48-a80c566ab9fc req-2a08a2fc-3963-4e0d-8a99-b4f550cd683d service nova] Creating event network-vif-deleted:5c020883-05f5-4c92-80b3-36f0a59e2877 for instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 on n-h2-852084-10 Sep 08 14:05:38.311529 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c491de8a-e8ed-44d9-ba48-a80c566ab9fc req-2a08a2fc-3963-4e0d-8a99-b4f550cd683d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101821 Sep 08 14:05:38.312332 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3548/6967] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:39.286438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e76eeb9-89e3-4821-9385-4f41d01d86b5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:39.287096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8e76eeb9-89e3-4821-9385-4f41d01d86b5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] [instance: 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:39.294161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e76eeb9-89e3-4821-9385-4f41d01d86b5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.294650 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e76eeb9-89e3-4821-9385-4f41d01d86b5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.295123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e76eeb9-89e3-4821-9385-4f41d01d86b5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.295816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e76eeb9-89e3-4821-9385-4f41d01d86b5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:39.296268 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e76eeb9-89e3-4821-9385-4f41d01d86b5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:39.296696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8e76eeb9-89e3-4821-9385-4f41d01d86b5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:39.310711 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-8e76eeb9-89e3-4821-9385-4f41d01d86b5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] HTTP exception thrown: Instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 could not be found. Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e76eeb9-89e3-4821-9385-4f41d01d86b5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Request method failure captured: Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 HTTP/1.1 Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfUwXgH6hdN5O2ng04ryRr5-I_0ACIPd3fWEEXE4wE0TNrCZrqepdbkeN88TW97cTkWWbmuJHjQeGUcogwBkOWQr5_C7Ay-Dw0f-gyewsoPfKi10ibLw64BkYcuAj59PvlzqKvYN_22mBGYUsv9ecmnm8-B5hR67Wn8JdjmGpFyzCs8 Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 5a165e9dcc2c4669b1dc7e3a77436e05 Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestMinimumBasicScenario-1449230949 Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/5a165e9dcc2c4669b1dc7e3a77436e05"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestMinimumBasicScenario-1449230949 Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 5a165e9dcc2c4669b1dc7e3a77436e05 Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1449230949 Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestMinimumBasicScenario-1449230949-project Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 101a3737eb8547fe965f3421fe07678b Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestMinimumBasicScenario-1449230949-project Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 could not be found. Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46'} Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 could not be found. Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 could not be found. Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:05:39.312349 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:05:39.317273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:05:39.317273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:05:39.317273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:05:39.317273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:05:39.317273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:05:39.317273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 could not be found. Sep 08 14:05:39.317273 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:05:39.317273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8e76eeb9-89e3-4821-9385-4f41d01d86b5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Returning 404 to user: Instance 8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:05:39.317273 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8e76eeb9-89e3-4821-9385-4f41d01d86b5 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46" status: 404 len: 111 microversion: 2.1 time: 0.032334 Sep 08 14:05:39.317273 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3420/6968] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:39 2022] GET /compute/v2.1/servers/8c4d23dd-4e04-4f04-9df1-dc68b7cc4c46 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:05:39.325272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-af0381f4-3e89-4d4e-85ea-ccd530e3db00 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] Calling method '.version_select at 0x7fdb3f12af70>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:39.345037 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-af0381f4-3e89-4d4e-85ea-ccd530e3db00 tempest-TestMinimumBasicScenario-1449230949 tempest-TestMinimumBasicScenario-1449230949-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-950172754" status: 202 len: 0 microversion: 2.1 time: 0.025776 Sep 08 14:05:39.345636 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3549/6969] 10.222.0.78 () {58 vars in 1269 bytes} [Thu Sep 8 14:05:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-950172754 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:05:49.587536 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=18 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:49.588282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:49.777433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-343e0692-5d7b-476f-acff-745e8fca7191 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'create', calling method: .version_select at 0x7fdb39ecc430>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1281261730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNTyp14+SRgtqTis/w2ze8qCj2ruzO+Y5jCQiNXXcAoNDn+DB5lh/CfTq4ZVW1uf4Na6w8Wo0BACbbLbXz06uAoozNRA8P0rb7CWX12pNHHQw8HEZd/Hkaf050eJ8RVNKw=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:49.794173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-343e0692-5d7b-476f-acff-745e8fca7191 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:05:49.804290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-343e0692-5d7b-476f-acff-745e8fca7191 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for user 16e1a1b184b04cbfb940462f00a39f88 and project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:05:49.818834 n-d-852084-10 devstack@n-api.service[128971]: ERROR oslo.messaging._drivers.impl_rabbit [None req-343e0692-5d7b-476f-acff-745e8fca7191 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [465e5682-9808-4c84-8359-29c44eefc59a] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 14:05:50.826473 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [None req-343e0692-5d7b-476f-acff-745e8fca7191 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [465e5682-9808-4c84-8359-29c44eefc59a] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 51268. Sep 08 14:05:50.842970 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-343e0692-5d7b-476f-acff-745e8fca7191 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.260803 Sep 08 14:05:50.843491 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3421/6970] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 14:05:49 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:05:57.181905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:57.182734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:05:57.187285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-806573132", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "f4e334fd-79a8-4f55-9054-9764c8949f94"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1281261730", "security_groups": [{"name": "tempest-secgroup-smoke-1209147766"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:05:57.335591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] validate_networks() for [('f4e334fd-79a8-4f55-9054-9764c8949f94', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:05:58.010812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:05:58.011788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:05:58.012836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:05:58.014322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:05:58.014322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:05:58.042040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:58.042952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:58.043586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:58.045160 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:58.046300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:58.047570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:58.092989 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:05:58.109530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for user 16e1a1b184b04cbfb940462f00a39f88 and project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:05:58.135486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:05:58.139568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:05:58.200101 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c9bf5d24-8803-4a44-8e4e-a2aa916ca96c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.020535 Sep 08 14:05:58.202643 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3550/6971] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 14:05:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 08 14:05:58.224606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-23965336-5862-434d-aa6e-2307afaf6a4f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:58.225600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-23965336-5862-434d-aa6e-2307afaf6a4f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:58.330521 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-23965336-5862-434d-aa6e-2307afaf6a4f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:58.342175 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-23965336-5862-434d-aa6e-2307afaf6a4f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1266 microversion: 2.1 time: 0.125579 Sep 08 14:05:58.343375 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3422/6972] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:58 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:05:59.392270 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e35ddff6-e76d-4c3d-9167-af0ffb20bc43 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:05:59.393230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e35ddff6-e76d-4c3d-9167-af0ffb20bc43 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:05:59.412686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e35ddff6-e76d-4c3d-9167-af0ffb20bc43 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:59.413934 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e35ddff6-e76d-4c3d-9167-af0ffb20bc43 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:59.415016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e35ddff6-e76d-4c3d-9167-af0ffb20bc43 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:59.416608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e35ddff6-e76d-4c3d-9167-af0ffb20bc43 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:05:59.420008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e35ddff6-e76d-4c3d-9167-af0ffb20bc43 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:05:59.421252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e35ddff6-e76d-4c3d-9167-af0ffb20bc43 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:05:59.519298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e35ddff6-e76d-4c3d-9167-af0ffb20bc43 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:05:59.535049 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e35ddff6-e76d-4c3d-9167-af0ffb20bc43 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1262 microversion: 2.1 time: 0.150946 Sep 08 14:05:59.536977 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3551/6973] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:05:59 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:00.571373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ae19a66-22e4-4294-8aa8-761a92144960 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:00.572000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ae19a66-22e4-4294-8aa8-761a92144960 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:00.580243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ae19a66-22e4-4294-8aa8-761a92144960 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:00.581570 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ae19a66-22e4-4294-8aa8-761a92144960 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:00.582216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ae19a66-22e4-4294-8aa8-761a92144960 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:00.583021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ae19a66-22e4-4294-8aa8-761a92144960 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:00.583507 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ae19a66-22e4-4294-8aa8-761a92144960 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:00.584126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ae19a66-22e4-4294-8aa8-761a92144960 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:00.651463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ae19a66-22e4-4294-8aa8-761a92144960 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:00.660714 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ae19a66-22e4-4294-8aa8-761a92144960 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1324 microversion: 2.1 time: 0.093792 Sep 08 14:06:00.661594 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3423/6974] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:00 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1324 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:01.583035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-6a9907b8-88a4-45bb-9acb-ad20e8faeac6 req-6493a2b6-8efc-49b1-b954-a0478e88e943 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7e39e0-f21d-470c-859a-1ea943b6b9b2", "tag": "bf79cb8d-1b30-457d-82c1-cfa18758ecc7"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:01.599730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6a9907b8-88a4-45bb-9acb-ad20e8faeac6 req-6493a2b6-8efc-49b1-b954-a0478e88e943 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:01.601042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6a9907b8-88a4-45bb-9acb-ad20e8faeac6 req-6493a2b6-8efc-49b1-b954-a0478e88e943 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:01.602097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6a9907b8-88a4-45bb-9acb-ad20e8faeac6 req-6493a2b6-8efc-49b1-b954-a0478e88e943 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:01.625615 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-6a9907b8-88a4-45bb-9acb-ad20e8faeac6 req-6493a2b6-8efc-49b1-b954-a0478e88e943 service nova] Creating event network-changed:bf79cb8d-1b30-457d-82c1-cfa18758ecc7 for instance aa7e39e0-f21d-470c-859a-1ea943b6b9b2 on n-h2-852084-10 Sep 08 14:06:01.632031 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-6a9907b8-88a4-45bb-9acb-ad20e8faeac6 req-6493a2b6-8efc-49b1-b954-a0478e88e943 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064652 Sep 08 14:06:01.632896 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3552/6975] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:01.685599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7774c57a-dde0-49d7-a358-f18e0759e72b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:01.686869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7774c57a-dde0-49d7-a358-f18e0759e72b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:01.694084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7774c57a-dde0-49d7-a358-f18e0759e72b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:01.694577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7774c57a-dde0-49d7-a358-f18e0759e72b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:01.695011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7774c57a-dde0-49d7-a358-f18e0759e72b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:01.695826 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7774c57a-dde0-49d7-a358-f18e0759e72b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:01.696465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7774c57a-dde0-49d7-a358-f18e0759e72b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:01.697091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7774c57a-dde0-49d7-a358-f18e0759e72b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:01.859489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7774c57a-dde0-49d7-a358-f18e0759e72b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:01.868341 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7774c57a-dde0-49d7-a358-f18e0759e72b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1392 microversion: 2.1 time: 0.186547 Sep 08 14:06:01.868856 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3424/6976] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:01 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1392 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:02.894632 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a4ee2f1a-8400-44aa-be5e-4d0dd50b3643 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:02.896159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a4ee2f1a-8400-44aa-be5e-4d0dd50b3643 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:02.907735 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4ee2f1a-8400-44aa-be5e-4d0dd50b3643 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.908644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4ee2f1a-8400-44aa-be5e-4d0dd50b3643 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.909469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4ee2f1a-8400-44aa-be5e-4d0dd50b3643 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:02.910800 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4ee2f1a-8400-44aa-be5e-4d0dd50b3643 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:02.911624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4ee2f1a-8400-44aa-be5e-4d0dd50b3643 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:02.912444 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a4ee2f1a-8400-44aa-be5e-4d0dd50b3643 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:03.091691 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a4ee2f1a-8400-44aa-be5e-4d0dd50b3643 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:03.100020 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a4ee2f1a-8400-44aa-be5e-4d0dd50b3643 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1392 microversion: 2.1 time: 0.211686 Sep 08 14:06:03.100651 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3553/6977] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:02 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1392 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:04.125551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-707bf217-7466-4a6b-a7cc-73345ef47c4a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:04.126166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-707bf217-7466-4a6b-a7cc-73345ef47c4a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:04.133503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707bf217-7466-4a6b-a7cc-73345ef47c4a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:04.134018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707bf217-7466-4a6b-a7cc-73345ef47c4a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:04.134447 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707bf217-7466-4a6b-a7cc-73345ef47c4a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:04.135150 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707bf217-7466-4a6b-a7cc-73345ef47c4a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:04.135638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707bf217-7466-4a6b-a7cc-73345ef47c4a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:04.136068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-707bf217-7466-4a6b-a7cc-73345ef47c4a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:04.277598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-707bf217-7466-4a6b-a7cc-73345ef47c4a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:04.287181 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-707bf217-7466-4a6b-a7cc-73345ef47c4a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1392 microversion: 2.1 time: 0.164957 Sep 08 14:06:04.287351 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3425/6978] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:04 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1392 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:05.314851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-80b184c0-40e7-4cb2-809f-73ca0cfc5d08 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:05.315641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-80b184c0-40e7-4cb2-809f-73ca0cfc5d08 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:05.322881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80b184c0-40e7-4cb2-809f-73ca0cfc5d08 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:05.323422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80b184c0-40e7-4cb2-809f-73ca0cfc5d08 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:05.323880 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80b184c0-40e7-4cb2-809f-73ca0cfc5d08 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:05.324591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80b184c0-40e7-4cb2-809f-73ca0cfc5d08 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:05.325062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80b184c0-40e7-4cb2-809f-73ca0cfc5d08 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:05.325507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-80b184c0-40e7-4cb2-809f-73ca0cfc5d08 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:05.484009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-80b184c0-40e7-4cb2-809f-73ca0cfc5d08 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:05.492101 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-80b184c0-40e7-4cb2-809f-73ca0cfc5d08 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1392 microversion: 2.1 time: 0.181089 Sep 08 14:06:05.492664 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3554/6979] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:05 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1392 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:06.414836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-7f11b1d9-6608-472d-ae6b-70d09667e194 req-5f88388a-6108-4a5f-8bd7-5fe60f651293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7e39e0-f21d-470c-859a-1ea943b6b9b2", "name": "network-vif-plugged", "status": "completed", "tag": "bf79cb8d-1b30-457d-82c1-cfa18758ecc7"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:06.425667 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7f11b1d9-6608-472d-ae6b-70d09667e194 req-5f88388a-6108-4a5f-8bd7-5fe60f651293 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.426149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7f11b1d9-6608-472d-ae6b-70d09667e194 req-5f88388a-6108-4a5f-8bd7-5fe60f651293 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.426583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-7f11b1d9-6608-472d-ae6b-70d09667e194 req-5f88388a-6108-4a5f-8bd7-5fe60f651293 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.439408 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-7f11b1d9-6608-472d-ae6b-70d09667e194 req-5f88388a-6108-4a5f-8bd7-5fe60f651293 service nova] Creating event network-vif-plugged:bf79cb8d-1b30-457d-82c1-cfa18758ecc7 for instance aa7e39e0-f21d-470c-859a-1ea943b6b9b2 on n-h2-852084-10 Sep 08 14:06:06.445232 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-7f11b1d9-6608-472d-ae6b-70d09667e194 req-5f88388a-6108-4a5f-8bd7-5fe60f651293 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035101 Sep 08 14:06:06.445847 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3426/6980] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:06:06.514299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1df61f35-aff9-476a-98ec-faa7067314ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:06.515003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1df61f35-aff9-476a-98ec-faa7067314ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:06.522720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1df61f35-aff9-476a-98ec-faa7067314ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.523247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1df61f35-aff9-476a-98ec-faa7067314ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.523710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1df61f35-aff9-476a-98ec-faa7067314ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.524430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1df61f35-aff9-476a-98ec-faa7067314ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:06.524932 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1df61f35-aff9-476a-98ec-faa7067314ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:06.525378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1df61f35-aff9-476a-98ec-faa7067314ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:06.665835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1df61f35-aff9-476a-98ec-faa7067314ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:06.673853 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1df61f35-aff9-476a-98ec-faa7067314ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1392 microversion: 2.1 time: 0.163522 Sep 08 14:06:06.674968 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3555/6981] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:06 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:07.700508 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-196d0bbc-492b-4967-9c24-50fecc0d1dee tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:07.702857 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-196d0bbc-492b-4967-9c24-50fecc0d1dee tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:07.711546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-196d0bbc-492b-4967-9c24-50fecc0d1dee tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:07.712450 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-196d0bbc-492b-4967-9c24-50fecc0d1dee tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:07.713345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-196d0bbc-492b-4967-9c24-50fecc0d1dee tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:07.714264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-196d0bbc-492b-4967-9c24-50fecc0d1dee tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:07.715031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-196d0bbc-492b-4967-9c24-50fecc0d1dee tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:07.715814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-196d0bbc-492b-4967-9c24-50fecc0d1dee tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:07.874621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-196d0bbc-492b-4967-9c24-50fecc0d1dee tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:07.883281 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-196d0bbc-492b-4967-9c24-50fecc0d1dee tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1392 microversion: 2.1 time: 0.189336 Sep 08 14:06:07.883879 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3427/6982] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:07 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1392 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:08.907277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44c54948-fb6c-4f8a-8079-3643cdc60a9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:08.907999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-44c54948-fb6c-4f8a-8079-3643cdc60a9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:08.911258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:08.911958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:08.918796 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44c54948-fb6c-4f8a-8079-3643cdc60a9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:08.919329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44c54948-fb6c-4f8a-8079-3643cdc60a9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:08.919780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44c54948-fb6c-4f8a-8079-3643cdc60a9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:08.920500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44c54948-fb6c-4f8a-8079-3643cdc60a9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:08.920970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44c54948-fb6c-4f8a-8079-3643cdc60a9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:08.921405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44c54948-fb6c-4f8a-8079-3643cdc60a9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:09.415779 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-44c54948-fb6c-4f8a-8079-3643cdc60a9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:09.423984 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44c54948-fb6c-4f8a-8079-3643cdc60a9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1564 microversion: 2.1 time: 0.520995 Sep 08 14:06:09.424507 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3556/6983] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:08 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1564 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:06:09.449319 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a2a6510c-a187-46fc-80c2-b3a9e0c72c0d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:09.449939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a2a6510c-a187-46fc-80c2-b3a9e0c72c0d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:09.452117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:09.458990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2a6510c-a187-46fc-80c2-b3a9e0c72c0d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:09.459518 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2a6510c-a187-46fc-80c2-b3a9e0c72c0d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:09.459958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2a6510c-a187-46fc-80c2-b3a9e0c72c0d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:09.460663 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2a6510c-a187-46fc-80c2-b3a9e0c72c0d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:09.461119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2a6510c-a187-46fc-80c2-b3a9e0c72c0d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:09.461547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2a6510c-a187-46fc-80c2-b3a9e0c72c0d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:09.618936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a2a6510c-a187-46fc-80c2-b3a9e0c72c0d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:09.628063 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a2a6510c-a187-46fc-80c2-b3a9e0c72c0d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1564 microversion: 2.1 time: 0.182551 Sep 08 14:06:09.628690 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3428/6984] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:09 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:11.495929 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0b15f563-4e6c-47ae-bc6b-931beeead2b0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:11.497196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0b15f563-4e6c-47ae-bc6b-931beeead2b0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:11.498797 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-01c59db3-cebe-446a-afa5-5844cfabe7be req-2d741bd3-ad22-4ddc-bd4e-fb6e5c388edb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7e39e0-f21d-470c-859a-1ea943b6b9b2", "tag": "bf79cb8d-1b30-457d-82c1-cfa18758ecc7"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:11.504549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b15f563-4e6c-47ae-bc6b-931beeead2b0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.505341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b15f563-4e6c-47ae-bc6b-931beeead2b0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.505960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b15f563-4e6c-47ae-bc6b-931beeead2b0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.506894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b15f563-4e6c-47ae-bc6b-931beeead2b0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.507559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b15f563-4e6c-47ae-bc6b-931beeead2b0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.508167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0b15f563-4e6c-47ae-bc6b-931beeead2b0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.512098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-01c59db3-cebe-446a-afa5-5844cfabe7be req-2d741bd3-ad22-4ddc-bd4e-fb6e5c388edb service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:11.512658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-01c59db3-cebe-446a-afa5-5844cfabe7be req-2d741bd3-ad22-4ddc-bd4e-fb6e5c388edb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:11.513092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-01c59db3-cebe-446a-afa5-5844cfabe7be req-2d741bd3-ad22-4ddc-bd4e-fb6e5c388edb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:11.530053 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-01c59db3-cebe-446a-afa5-5844cfabe7be req-2d741bd3-ad22-4ddc-bd4e-fb6e5c388edb service nova] Creating event network-changed:bf79cb8d-1b30-457d-82c1-cfa18758ecc7 for instance aa7e39e0-f21d-470c-859a-1ea943b6b9b2 on n-h2-852084-10 Sep 08 14:06:11.536771 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-01c59db3-cebe-446a-afa5-5844cfabe7be req-2d741bd3-ad22-4ddc-bd4e-fb6e5c388edb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042098 Sep 08 14:06:11.537905 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3429/6985] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:06:11.665348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0b15f563-4e6c-47ae-bc6b-931beeead2b0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:11.673746 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0b15f563-4e6c-47ae-bc6b-931beeead2b0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1564 microversion: 2.1 time: 0.181718 Sep 08 14:06:11.675171 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3557/6986] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:11 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:32.974957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:32.976858 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=34 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:32.985435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cbbe2fa7-4644-4389-a273-db2d3c1d2a3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:32.989786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cbbe2fa7-4644-4389-a273-db2d3c1d2a3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:33.004491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbbe2fa7-4644-4389-a273-db2d3c1d2a3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.004491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbbe2fa7-4644-4389-a273-db2d3c1d2a3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.004491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbbe2fa7-4644-4389-a273-db2d3c1d2a3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.006366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbbe2fa7-4644-4389-a273-db2d3c1d2a3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:33.006366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbbe2fa7-4644-4389-a273-db2d3c1d2a3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:33.006789 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cbbe2fa7-4644-4389-a273-db2d3c1d2a3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:33.078630 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cbbe2fa7-4644-4389-a273-db2d3c1d2a3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2/action" status: 200 len: 24570 microversion: 2.1 time: 0.106579 Sep 08 14:06:33.079594 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3430/6987] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:06:32 2022] POST /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2/action => generated 24570 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:06:44.029939 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-850a7b1b-875f-4427-a66c-f80e644c734a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:44.030856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-850a7b1b-875f-4427-a66c-f80e644c734a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:44.034274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:44.035340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=40 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:44.042543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-850a7b1b-875f-4427-a66c-f80e644c734a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:44.043074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-850a7b1b-875f-4427-a66c-f80e644c734a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:44.043923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-850a7b1b-875f-4427-a66c-f80e644c734a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:44.044709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-850a7b1b-875f-4427-a66c-f80e644c734a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:44.045204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-850a7b1b-875f-4427-a66c-f80e644c734a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:44.045651 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-850a7b1b-875f-4427-a66c-f80e644c734a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:44.151666 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-850a7b1b-875f-4427-a66c-f80e644c734a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2/action" status: 202 len: 0 microversion: 2.1 time: 0.128056 Sep 08 14:06:44.154729 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3558/6988] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:06:44 2022] POST /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:06:44.165946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01c7c7e5-7101-4c7f-9ebd-1e28d788ef83 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:44.166951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-01c7c7e5-7101-4c7f-9ebd-1e28d788ef83 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:44.171184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:44.172378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=4 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:06:44.183590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01c7c7e5-7101-4c7f-9ebd-1e28d788ef83 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:44.184252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01c7c7e5-7101-4c7f-9ebd-1e28d788ef83 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:44.184834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01c7c7e5-7101-4c7f-9ebd-1e28d788ef83 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:44.185814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01c7c7e5-7101-4c7f-9ebd-1e28d788ef83 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:44.186701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01c7c7e5-7101-4c7f-9ebd-1e28d788ef83 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:44.187398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01c7c7e5-7101-4c7f-9ebd-1e28d788ef83 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:44.363479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-01c7c7e5-7101-4c7f-9ebd-1e28d788ef83 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:44.374040 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-01c7c7e5-7101-4c7f-9ebd-1e28d788ef83 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1688 microversion: 2.1 time: 0.213201 Sep 08 14:06:44.375134 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3431/6989] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:44 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1688 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:45.415516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5356e28b-adec-49a5-aaad-888df20f4275 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:45.416326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5356e28b-adec-49a5-aaad-888df20f4275 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:45.423661 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5356e28b-adec-49a5-aaad-888df20f4275 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:45.425119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5356e28b-adec-49a5-aaad-888df20f4275 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:45.425119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5356e28b-adec-49a5-aaad-888df20f4275 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:45.425547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5356e28b-adec-49a5-aaad-888df20f4275 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:45.425815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5356e28b-adec-49a5-aaad-888df20f4275 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:45.426262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5356e28b-adec-49a5-aaad-888df20f4275 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:45.606405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5356e28b-adec-49a5-aaad-888df20f4275 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:45.616342 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5356e28b-adec-49a5-aaad-888df20f4275 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1668 microversion: 2.1 time: 0.206282 Sep 08 14:06:45.617095 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3559/6990] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:45 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1668 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:46.749949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ea6abde7-e90a-43de-b4d0-6339eb7b2b82 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:46.753682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ea6abde7-e90a-43de-b4d0-6339eb7b2b82 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:46.762223 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea6abde7-e90a-43de-b4d0-6339eb7b2b82 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:46.762712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea6abde7-e90a-43de-b4d0-6339eb7b2b82 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:46.763148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea6abde7-e90a-43de-b4d0-6339eb7b2b82 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:46.763877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea6abde7-e90a-43de-b4d0-6339eb7b2b82 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:46.764328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea6abde7-e90a-43de-b4d0-6339eb7b2b82 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:46.764749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea6abde7-e90a-43de-b4d0-6339eb7b2b82 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:46.823345 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ea6abde7-e90a-43de-b4d0-6339eb7b2b82 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2/action" status: 200 len: 32635 microversion: 2.1 time: 0.077450 Sep 08 14:06:46.824040 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3432/6991] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:06:46 2022] POST /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2/action => generated 32635 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:06:46.836605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9425f88e-57fd-469c-b9ad-55cd1d855f13 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:46.837390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9425f88e-57fd-469c-b9ad-55cd1d855f13 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:46.845949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9425f88e-57fd-469c-b9ad-55cd1d855f13 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:46.846745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9425f88e-57fd-469c-b9ad-55cd1d855f13 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:46.847268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9425f88e-57fd-469c-b9ad-55cd1d855f13 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:46.848016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9425f88e-57fd-469c-b9ad-55cd1d855f13 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:46.848483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9425f88e-57fd-469c-b9ad-55cd1d855f13 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:46.848924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9425f88e-57fd-469c-b9ad-55cd1d855f13 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:46.935566 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9425f88e-57fd-469c-b9ad-55cd1d855f13 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2/action" status: 202 len: 0 microversion: 2.1 time: 0.102743 Sep 08 14:06:46.936237 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3560/6992] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:06:46 2022] POST /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2/action => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:06:46.951269 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d7de422c-d474-4f28-a388-74811ede7c33 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:46.953958 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d7de422c-d474-4f28-a388-74811ede7c33 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:46.972808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7de422c-d474-4f28-a388-74811ede7c33 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:46.973768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7de422c-d474-4f28-a388-74811ede7c33 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:46.974545 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7de422c-d474-4f28-a388-74811ede7c33 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:46.975699 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7de422c-d474-4f28-a388-74811ede7c33 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:46.976261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7de422c-d474-4f28-a388-74811ede7c33 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:46.976758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7de422c-d474-4f28-a388-74811ede7c33 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:47.192583 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d7de422c-d474-4f28-a388-74811ede7c33 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:47.207926 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d7de422c-d474-4f28-a388-74811ede7c33 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1675 microversion: 2.1 time: 0.263206 Sep 08 14:06:47.208904 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3433/6993] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:46 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1675 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:48.236295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fe17cb46-195a-4393-a46d-62a08051dafa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:48.237035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fe17cb46-195a-4393-a46d-62a08051dafa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:48.245358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe17cb46-195a-4393-a46d-62a08051dafa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:48.246345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe17cb46-195a-4393-a46d-62a08051dafa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:48.246497 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe17cb46-195a-4393-a46d-62a08051dafa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:48.247253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe17cb46-195a-4393-a46d-62a08051dafa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:48.247741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe17cb46-195a-4393-a46d-62a08051dafa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:48.248191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe17cb46-195a-4393-a46d-62a08051dafa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:48.397291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fe17cb46-195a-4393-a46d-62a08051dafa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:48.405680 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fe17cb46-195a-4393-a46d-62a08051dafa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1683 microversion: 2.1 time: 0.175423 Sep 08 14:06:48.406642 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3561/6994] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:48 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:48.525270 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8b40e532-40dd-4b99-8333-230fa1526387 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:48.527635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8b40e532-40dd-4b99-8333-230fa1526387 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:48.535396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b40e532-40dd-4b99-8333-230fa1526387 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:48.535893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b40e532-40dd-4b99-8333-230fa1526387 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:48.536347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b40e532-40dd-4b99-8333-230fa1526387 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:48.537062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b40e532-40dd-4b99-8333-230fa1526387 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:48.537525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b40e532-40dd-4b99-8333-230fa1526387 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:48.537993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8b40e532-40dd-4b99-8333-230fa1526387 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:48.598628 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8b40e532-40dd-4b99-8333-230fa1526387 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2/action" status: 200 len: 38438 microversion: 2.1 time: 0.077310 Sep 08 14:06:48.599361 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3434/6995] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:06:48 2022] POST /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2/action => generated 38438 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:06:49.812516 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-989515ba-885c-4871-9f46-71b9e6feb4bc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:49.813114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-989515ba-885c-4871-9f46-71b9e6feb4bc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:49.816018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e0ac7795-fae8-448e-b128-c871bfa76bd6 req-9265a3b7-2255-4d31-a5cc-01f781150fde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa7e39e0-f21d-470c-859a-1ea943b6b9b2", "tag": "bf79cb8d-1b30-457d-82c1-cfa18758ecc7"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:49.820655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-989515ba-885c-4871-9f46-71b9e6feb4bc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:49.821175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-989515ba-885c-4871-9f46-71b9e6feb4bc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:49.821635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-989515ba-885c-4871-9f46-71b9e6feb4bc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:49.822373 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-989515ba-885c-4871-9f46-71b9e6feb4bc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:49.822850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-989515ba-885c-4871-9f46-71b9e6feb4bc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:49.823332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-989515ba-885c-4871-9f46-71b9e6feb4bc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:49.839294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e0ac7795-fae8-448e-b128-c871bfa76bd6 req-9265a3b7-2255-4d31-a5cc-01f781150fde service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:49.840256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e0ac7795-fae8-448e-b128-c871bfa76bd6 req-9265a3b7-2255-4d31-a5cc-01f781150fde service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:49.841401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e0ac7795-fae8-448e-b128-c871bfa76bd6 req-9265a3b7-2255-4d31-a5cc-01f781150fde service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:49.853461 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-989515ba-885c-4871-9f46-71b9e6feb4bc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:06:49.856942 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e0ac7795-fae8-448e-b128-c871bfa76bd6 req-9265a3b7-2255-4d31-a5cc-01f781150fde service nova] Creating event network-changed:bf79cb8d-1b30-457d-82c1-cfa18758ecc7 for instance aa7e39e0-f21d-470c-859a-1ea943b6b9b2 on n-h2-852084-10 Sep 08 14:06:49.865067 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e0ac7795-fae8-448e-b128-c871bfa76bd6 req-9265a3b7-2255-4d31-a5cc-01f781150fde service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055304 Sep 08 14:06:49.866210 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3435/6996] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:49.972203 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-989515ba-885c-4871-9f46-71b9e6feb4bc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "DELETE /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 204 len: 0 microversion: 2.1 time: 0.164135 Sep 08 14:06:49.973752 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3562/6997] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 14:06:49 2022] DELETE /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:06:49.988864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-64064027-0210-40d0-bb26-9f220e5d8fb6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:49.991059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-64064027-0210-40d0-bb26-9f220e5d8fb6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:50.004917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64064027-0210-40d0-bb26-9f220e5d8fb6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:50.006236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64064027-0210-40d0-bb26-9f220e5d8fb6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:50.007337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64064027-0210-40d0-bb26-9f220e5d8fb6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:50.009091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64064027-0210-40d0-bb26-9f220e5d8fb6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:50.009824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64064027-0210-40d0-bb26-9f220e5d8fb6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:50.010870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-64064027-0210-40d0-bb26-9f220e5d8fb6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:50.239476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-64064027-0210-40d0-bb26-9f220e5d8fb6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:50.257367 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-64064027-0210-40d0-bb26-9f220e5d8fb6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1689 microversion: 2.1 time: 0.277824 Sep 08 14:06:50.258535 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3436/6998] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:49 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1689 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:51.300823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f19fc12b-13de-477f-a7d1-8ba95ea9c054 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:51.301851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f19fc12b-13de-477f-a7d1-8ba95ea9c054 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:51.314341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f19fc12b-13de-477f-a7d1-8ba95ea9c054 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:51.315315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f19fc12b-13de-477f-a7d1-8ba95ea9c054 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:51.316436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f19fc12b-13de-477f-a7d1-8ba95ea9c054 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:51.317821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f19fc12b-13de-477f-a7d1-8ba95ea9c054 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:51.318721 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f19fc12b-13de-477f-a7d1-8ba95ea9c054 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:51.319602 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f19fc12b-13de-477f-a7d1-8ba95ea9c054 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:51.627775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f19fc12b-13de-477f-a7d1-8ba95ea9c054 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:51.643781 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f19fc12b-13de-477f-a7d1-8ba95ea9c054 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1689 microversion: 2.1 time: 0.347514 Sep 08 14:06:51.662738 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3563/6999] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:51 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1689 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:52.187865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-27036346-3dc7-4212-b491-d8ca534c50ee req-46395675-8faa-4f23-ba2d-a895ad009a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa7e39e0-f21d-470c-859a-1ea943b6b9b2", "name": "network-vif-deleted", "tag": "bf79cb8d-1b30-457d-82c1-cfa18758ecc7"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:52.199489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-27036346-3dc7-4212-b491-d8ca534c50ee req-46395675-8faa-4f23-ba2d-a895ad009a9e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:52.200318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-27036346-3dc7-4212-b491-d8ca534c50ee req-46395675-8faa-4f23-ba2d-a895ad009a9e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:52.201010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-27036346-3dc7-4212-b491-d8ca534c50ee req-46395675-8faa-4f23-ba2d-a895ad009a9e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:52.214471 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-27036346-3dc7-4212-b491-d8ca534c50ee req-46395675-8faa-4f23-ba2d-a895ad009a9e service nova] Creating event network-vif-deleted:bf79cb8d-1b30-457d-82c1-cfa18758ecc7 for instance aa7e39e0-f21d-470c-859a-1ea943b6b9b2 on n-h2-852084-10 Sep 08 14:06:52.220890 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-27036346-3dc7-4212-b491-d8ca534c50ee req-46395675-8faa-4f23-ba2d-a895ad009a9e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036349 Sep 08 14:06:52.221656 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3437/7000] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:06:52.687167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:52.687915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:52.698393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:52.699253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:52.700397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:52.702013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:52.702926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:52.704281 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:52.774175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:52.774992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:52.775868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:52.776743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lazy-loading 'fault' on Instance uuid aa7e39e0-f21d-470c-859a-1ea943b6b9b2 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:06:52.832960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:06:52.850114 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-acca0b3a-1327-43dc-bea6-a097a2dee12a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 200 len: 1356 microversion: 2.1 time: 0.169642 Sep 08 14:06:52.850726 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3564/7001] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:52 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 1356 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:06:53.877148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-853e68d0-c359-4aa9-8018-4cc46ff5b0cb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:53.877867 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-853e68d0-c359-4aa9-8018-4cc46ff5b0cb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: aa7e39e0-f21d-470c-859a-1ea943b6b9b2] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:06:53.884475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-853e68d0-c359-4aa9-8018-4cc46ff5b0cb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:53.884973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-853e68d0-c359-4aa9-8018-4cc46ff5b0cb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:53.885415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-853e68d0-c359-4aa9-8018-4cc46ff5b0cb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:53.886128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-853e68d0-c359-4aa9-8018-4cc46ff5b0cb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:06:53.886582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-853e68d0-c359-4aa9-8018-4cc46ff5b0cb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:06:53.887018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-853e68d0-c359-4aa9-8018-4cc46ff5b0cb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:06:53.902198 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-853e68d0-c359-4aa9-8018-4cc46ff5b0cb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] HTTP exception thrown: Instance aa7e39e0-f21d-470c-859a-1ea943b6b9b2 could not be found. Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-853e68d0-c359-4aa9-8018-4cc46ff5b0cb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Request method failure captured: Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 HTTP/1.1 Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfa8rEsclKqB3fGtEoDqf7MMBfOXuK9c8rBoj1w1ZQCY0tDJN3D51PNiQQ5SM8QjooN6eu0hg2opbsQtSReY76kx7kqXGXOA1lWnEjSaSiSz2NklHX-m5XIynq2v07KieXN2ZMFKPTiMgnRrAcFsfQt87Z0aVZMdxADsYgFfKmfBKOU Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0dc08700af5b40cc911c75f91b2b0f7a Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0dc08700af5b40cc911c75f91b2b0f7a Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestNetworkAdvancedServerOps-1112243692-project Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 16e1a1b184b04cbfb940462f00a39f88 Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1112243692-project Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance aa7e39e0-f21d-470c-859a-1ea943b6b9b2 could not be found. Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'aa7e39e0-f21d-470c-859a-1ea943b6b9b2'} Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa7e39e0-f21d-470c-859a-1ea943b6b9b2 could not be found. Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa7e39e0-f21d-470c-859a-1ea943b6b9b2 could not be found. Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:06:53.904093 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:06:53.912830 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:06:53.912830 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:06:53.912830 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:06:53.912830 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:06:53.912830 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:06:53.912830 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:06:53.912830 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa7e39e0-f21d-470c-859a-1ea943b6b9b2 could not be found. Sep 08 14:06:53.912830 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:06:53.912830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-853e68d0-c359-4aa9-8018-4cc46ff5b0cb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Returning 404 to user: Instance aa7e39e0-f21d-470c-859a-1ea943b6b9b2 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:06:53.912830 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-853e68d0-c359-4aa9-8018-4cc46ff5b0cb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2" status: 404 len: 111 microversion: 2.1 time: 0.034042 Sep 08 14:06:53.912830 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3438/7002] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:06:53 2022] GET /compute/v2.1/servers/aa7e39e0-f21d-470c-859a-1ea943b6b9b2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 08 14:06:57.893818 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a30d792b-ad91-4c00-b79a-41fac9117dad tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '.version_select at 0x7fdb36ff5b80>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:06:57.928003 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a30d792b-ad91-4c00-b79a-41fac9117dad tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1281261730" status: 202 len: 0 microversion: 2.1 time: 0.040458 Sep 08 14:06:57.928202 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3565/7003] 10.222.0.78 () {58 vars in 1284 bytes} [Thu Sep 8 14:06:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1281261730 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:06:57.961026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2fcfee28-d315-460b-8cd7-c1b8afd195ab tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'create', calling method: .version_select at 0x7fdb39c52160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-347168889", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDAVYEQuFTRt63WpK55TjTCyV1I5PZc1wuE7G8ZAh2le1VCP/tCLeo3tbmvGG0gYMz5G5SfSUIXyAugZjXLYsT08QVk+tdwfH3iJp+Z9vAwDdmS6XebyzUi4XbliG7ysdQ=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:06:57.981075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-2fcfee28-d315-460b-8cd7-c1b8afd195ab tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:06:57.989581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-2fcfee28-d315-460b-8cd7-c1b8afd195ab tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for user 16e1a1b184b04cbfb940462f00a39f88 and project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:06:58.022076 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2fcfee28-d315-460b-8cd7-c1b8afd195ab tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.065149 Sep 08 14:06:58.022891 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3439/7004] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 14:06:57 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:04.711410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:04.719053 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1697737598", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "add36343-9ac8-4b79-bdaf-fbe4974c7a6d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-347168889", "security_groups": [{"name": "tempest-secgroup-smoke-1990164763"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:04.883552 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] validate_networks() for [('add36343-9ac8-4b79-bdaf-fbe4974c7a6d', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:07:05.365749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:07:05.366190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:07:05.366680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:07:05.367106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:07:05.367564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:07:05.377621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:05.378114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:05.378557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:05.379321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:05.380021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:05.380459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:05.399046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:07:05.404700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for user 16e1a1b184b04cbfb940462f00a39f88 and project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:07:05.418649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:07:05.421569 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:07:05.494460 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-58905104-76c4-450b-b818-ba59a5a931be tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.785957 Sep 08 14:07:05.496480 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3566/7005] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 14:07:04 2022] POST /compute/v2.1/servers => generated 406 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:07:05.509705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-25dfccb7-945c-4b02-86ed-b7d16094bffb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:05.510503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-25dfccb7-945c-4b02-86ed-b7d16094bffb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:05.513411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=32 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:05.516344 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:07:05.516613 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 14:07:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 (ip 10.222.0.78) !!! Sep 08 14:07:05.584032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-25dfccb7-945c-4b02-86ed-b7d16094bffb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:05.595952 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-25dfccb7-945c-4b02-86ed-b7d16094bffb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1266 microversion: 2.1 time: 0.090666 Sep 08 14:07:05.596905 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3440/7006] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:05 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:06.622344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-84681180-558e-44ff-8950-6ecc3951b9dd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:06.622795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-84681180-558e-44ff-8950-6ecc3951b9dd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:06.631709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84681180-558e-44ff-8950-6ecc3951b9dd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:06.632603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84681180-558e-44ff-8950-6ecc3951b9dd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:06.633266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84681180-558e-44ff-8950-6ecc3951b9dd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:06.634016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84681180-558e-44ff-8950-6ecc3951b9dd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:06.634699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84681180-558e-44ff-8950-6ecc3951b9dd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:06.635392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-84681180-558e-44ff-8950-6ecc3951b9dd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:06.713680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-84681180-558e-44ff-8950-6ecc3951b9dd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:06.723638 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-84681180-558e-44ff-8950-6ecc3951b9dd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1326 microversion: 2.1 time: 0.105919 Sep 08 14:07:06.725069 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3567/7007] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:06 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1326 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:07.760569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0c6c984a-2215-4012-9555-68d4d08d0417 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:07.762087 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0c6c984a-2215-4012-9555-68d4d08d0417 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:07.775774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c6c984a-2215-4012-9555-68d4d08d0417 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:07.777201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c6c984a-2215-4012-9555-68d4d08d0417 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:07.778317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c6c984a-2215-4012-9555-68d4d08d0417 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:07.781168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c6c984a-2215-4012-9555-68d4d08d0417 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:07.785796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c6c984a-2215-4012-9555-68d4d08d0417 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:07.787352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0c6c984a-2215-4012-9555-68d4d08d0417 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:08.033420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0c6c984a-2215-4012-9555-68d4d08d0417 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:08.041843 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0c6c984a-2215-4012-9555-68d4d08d0417 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1392 microversion: 2.1 time: 0.292532 Sep 08 14:07:08.042924 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3441/7008] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:07 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1392 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:08.703186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c6ad1aca-94f8-4b0e-a0e7-cb66f0dfa56f req-0e11ce23-4349-4191-bcdf-5ded3ce9d7de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c923591c-5c9b-429f-803a-33740ad921a3", "tag": "a07854b2-66df-42c1-9375-8d5c33ebb732"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:08.716362 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c6ad1aca-94f8-4b0e-a0e7-cb66f0dfa56f req-0e11ce23-4349-4191-bcdf-5ded3ce9d7de service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:08.716872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c6ad1aca-94f8-4b0e-a0e7-cb66f0dfa56f req-0e11ce23-4349-4191-bcdf-5ded3ce9d7de service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:08.717502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c6ad1aca-94f8-4b0e-a0e7-cb66f0dfa56f req-0e11ce23-4349-4191-bcdf-5ded3ce9d7de service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:08.742221 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c6ad1aca-94f8-4b0e-a0e7-cb66f0dfa56f req-0e11ce23-4349-4191-bcdf-5ded3ce9d7de service nova] Creating event network-changed:a07854b2-66df-42c1-9375-8d5c33ebb732 for instance c923591c-5c9b-429f-803a-33740ad921a3 on n-h1-852084-10 Sep 08 14:07:08.747823 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c6ad1aca-94f8-4b0e-a0e7-cb66f0dfa56f req-0e11ce23-4349-4191-bcdf-5ded3ce9d7de service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048478 Sep 08 14:07:08.748739 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3568/7009] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:09.086530 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0e79beb-d141-4977-a701-c946c7432694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:09.087604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0e79beb-d141-4977-a701-c946c7432694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:09.099272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0e79beb-d141-4977-a701-c946c7432694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:09.099882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0e79beb-d141-4977-a701-c946c7432694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:09.100495 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0e79beb-d141-4977-a701-c946c7432694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:09.101239 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0e79beb-d141-4977-a701-c946c7432694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:09.101792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0e79beb-d141-4977-a701-c946c7432694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:09.102306 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0e79beb-d141-4977-a701-c946c7432694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:09.260151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0e79beb-d141-4977-a701-c946c7432694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:09.275322 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0e79beb-d141-4977-a701-c946c7432694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1392 microversion: 2.1 time: 0.196335 Sep 08 14:07:09.276363 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3442/7010] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:09 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1392 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:10.303309 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9581e3d-887f-480f-899e-0722a18e5ca1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:10.304028 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a9581e3d-887f-480f-899e-0722a18e5ca1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:10.312337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9581e3d-887f-480f-899e-0722a18e5ca1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:10.312837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9581e3d-887f-480f-899e-0722a18e5ca1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:10.313315 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9581e3d-887f-480f-899e-0722a18e5ca1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:10.314095 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9581e3d-887f-480f-899e-0722a18e5ca1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:10.314493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9581e3d-887f-480f-899e-0722a18e5ca1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:10.314927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9581e3d-887f-480f-899e-0722a18e5ca1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:10.454927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9581e3d-887f-480f-899e-0722a18e5ca1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:10.463338 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a9581e3d-887f-480f-899e-0722a18e5ca1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1392 microversion: 2.1 time: 0.165136 Sep 08 14:07:10.463933 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3569/7011] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:10 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:11.486623 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7876ac75-f1b0-43b6-9e19-e0d65f1341e7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:11.487149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7876ac75-f1b0-43b6-9e19-e0d65f1341e7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:11.494351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7876ac75-f1b0-43b6-9e19-e0d65f1341e7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:11.494879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7876ac75-f1b0-43b6-9e19-e0d65f1341e7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:11.495388 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7876ac75-f1b0-43b6-9e19-e0d65f1341e7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:11.496084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7876ac75-f1b0-43b6-9e19-e0d65f1341e7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:11.496540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7876ac75-f1b0-43b6-9e19-e0d65f1341e7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:11.496971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7876ac75-f1b0-43b6-9e19-e0d65f1341e7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:11.648322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7876ac75-f1b0-43b6-9e19-e0d65f1341e7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:11.657241 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7876ac75-f1b0-43b6-9e19-e0d65f1341e7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1392 microversion: 2.1 time: 0.174719 Sep 08 14:07:11.657834 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3443/7012] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:11 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1392 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:07:12.681547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a98cb66e-d1d9-4ba4-a469-ac02b08caddc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:12.682348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a98cb66e-d1d9-4ba4-a469-ac02b08caddc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:12.689723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a98cb66e-d1d9-4ba4-a469-ac02b08caddc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:12.690233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a98cb66e-d1d9-4ba4-a469-ac02b08caddc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:12.690774 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a98cb66e-d1d9-4ba4-a469-ac02b08caddc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:12.691595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a98cb66e-d1d9-4ba4-a469-ac02b08caddc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:12.692061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a98cb66e-d1d9-4ba4-a469-ac02b08caddc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:12.692621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a98cb66e-d1d9-4ba4-a469-ac02b08caddc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:12.841770 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a98cb66e-d1d9-4ba4-a469-ac02b08caddc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:12.863112 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a98cb66e-d1d9-4ba4-a469-ac02b08caddc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1392 microversion: 2.1 time: 0.185516 Sep 08 14:07:12.863767 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3570/7013] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:12 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1392 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:13.896568 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3e21117b-90be-4b8d-bd35-c4368911ef2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:13.897298 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3e21117b-90be-4b8d-bd35-c4368911ef2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:13.907695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e21117b-90be-4b8d-bd35-c4368911ef2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:13.908203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e21117b-90be-4b8d-bd35-c4368911ef2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:13.908764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e21117b-90be-4b8d-bd35-c4368911ef2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:13.910845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e21117b-90be-4b8d-bd35-c4368911ef2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:13.911868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e21117b-90be-4b8d-bd35-c4368911ef2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:13.912318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3e21117b-90be-4b8d-bd35-c4368911ef2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:13.988591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-78634fea-9ff1-4695-9b6d-b08d282ce54c req-7a6fa99e-1f2b-408b-a3c1-a2c785487b5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c923591c-5c9b-429f-803a-33740ad921a3", "name": "network-vif-plugged", "status": "completed", "tag": "a07854b2-66df-42c1-9375-8d5c33ebb732"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:14.003793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-78634fea-9ff1-4695-9b6d-b08d282ce54c req-7a6fa99e-1f2b-408b-a3c1-a2c785487b5e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:14.006733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-78634fea-9ff1-4695-9b6d-b08d282ce54c req-7a6fa99e-1f2b-408b-a3c1-a2c785487b5e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:14.006733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-78634fea-9ff1-4695-9b6d-b08d282ce54c req-7a6fa99e-1f2b-408b-a3c1-a2c785487b5e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:14.019389 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-78634fea-9ff1-4695-9b6d-b08d282ce54c req-7a6fa99e-1f2b-408b-a3c1-a2c785487b5e service nova] Creating event network-vif-plugged:a07854b2-66df-42c1-9375-8d5c33ebb732 for instance c923591c-5c9b-429f-803a-33740ad921a3 on n-h1-852084-10 Sep 08 14:07:14.025043 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-78634fea-9ff1-4695-9b6d-b08d282ce54c req-7a6fa99e-1f2b-408b-a3c1-a2c785487b5e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041651 Sep 08 14:07:14.026162 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3571/7014] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:07:14.103002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3e21117b-90be-4b8d-bd35-c4368911ef2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:14.112940 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3e21117b-90be-4b8d-bd35-c4368911ef2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1392 microversion: 2.1 time: 0.222868 Sep 08 14:07:14.113808 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3444/7015] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:13 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1392 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:15.149734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e2c6065b-1658-4f01-b9de-d8ac621672e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:15.150496 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e2c6065b-1658-4f01-b9de-d8ac621672e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:15.153410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:15.160148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2c6065b-1658-4f01-b9de-d8ac621672e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:15.160660 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2c6065b-1658-4f01-b9de-d8ac621672e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:15.161118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2c6065b-1658-4f01-b9de-d8ac621672e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:15.161849 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2c6065b-1658-4f01-b9de-d8ac621672e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:15.162324 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2c6065b-1658-4f01-b9de-d8ac621672e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:15.162766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e2c6065b-1658-4f01-b9de-d8ac621672e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:15.311295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e2c6065b-1658-4f01-b9de-d8ac621672e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:15.321510 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e2c6065b-1658-4f01-b9de-d8ac621672e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1392 microversion: 2.1 time: 0.176085 Sep 08 14:07:15.322119 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3572/7016] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:15 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1392 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:16.425993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-273e194b-1010-4fe4-a71a-c36b9ed6d0c8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:16.426601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-273e194b-1010-4fe4-a71a-c36b9ed6d0c8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:16.429272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:16.429926 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:16.435781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-273e194b-1010-4fe4-a71a-c36b9ed6d0c8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:16.436891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-273e194b-1010-4fe4-a71a-c36b9ed6d0c8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:16.437328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-273e194b-1010-4fe4-a71a-c36b9ed6d0c8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:16.438024 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-273e194b-1010-4fe4-a71a-c36b9ed6d0c8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:16.438474 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-273e194b-1010-4fe4-a71a-c36b9ed6d0c8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:16.438897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-273e194b-1010-4fe4-a71a-c36b9ed6d0c8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:16.573962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-273e194b-1010-4fe4-a71a-c36b9ed6d0c8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:16.582120 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-273e194b-1010-4fe4-a71a-c36b9ed6d0c8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1564 microversion: 2.1 time: 0.160027 Sep 08 14:07:16.582715 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3445/7017] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:16 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:16.604847 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c123fea2-f667-4eef-ad25-87bac1cc1819 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:16.605502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c123fea2-f667-4eef-ad25-87bac1cc1819 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:16.607478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:16.608855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:16.618013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c123fea2-f667-4eef-ad25-87bac1cc1819 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:16.618535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c123fea2-f667-4eef-ad25-87bac1cc1819 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:16.619015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c123fea2-f667-4eef-ad25-87bac1cc1819 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:16.619971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c123fea2-f667-4eef-ad25-87bac1cc1819 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:16.620484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c123fea2-f667-4eef-ad25-87bac1cc1819 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:16.620948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c123fea2-f667-4eef-ad25-87bac1cc1819 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:16.761622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c123fea2-f667-4eef-ad25-87bac1cc1819 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:16.769652 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c123fea2-f667-4eef-ad25-87bac1cc1819 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1564 microversion: 2.1 time: 0.168747 Sep 08 14:07:16.770239 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3573/7018] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:16 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1564 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:18.450175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fe2dd2c9-87d3-4e1d-9074-27d18192df9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:18.450913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fe2dd2c9-87d3-4e1d-9074-27d18192df9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:18.456845 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b4d544b1-c579-440f-b448-c56e80a0548d req-104bd292-e397-4905-b8e0-1a7c354d0dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c923591c-5c9b-429f-803a-33740ad921a3", "tag": "a07854b2-66df-42c1-9375-8d5c33ebb732"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:18.465800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe2dd2c9-87d3-4e1d-9074-27d18192df9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:18.466286 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe2dd2c9-87d3-4e1d-9074-27d18192df9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:18.466730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe2dd2c9-87d3-4e1d-9074-27d18192df9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:18.467470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe2dd2c9-87d3-4e1d-9074-27d18192df9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:18.467934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe2dd2c9-87d3-4e1d-9074-27d18192df9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:18.468363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fe2dd2c9-87d3-4e1d-9074-27d18192df9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:18.481074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b4d544b1-c579-440f-b448-c56e80a0548d req-104bd292-e397-4905-b8e0-1a7c354d0dd3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:18.481819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b4d544b1-c579-440f-b448-c56e80a0548d req-104bd292-e397-4905-b8e0-1a7c354d0dd3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:18.482450 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b4d544b1-c579-440f-b448-c56e80a0548d req-104bd292-e397-4905-b8e0-1a7c354d0dd3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:18.496500 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b4d544b1-c579-440f-b448-c56e80a0548d req-104bd292-e397-4905-b8e0-1a7c354d0dd3 service nova] Creating event network-changed:a07854b2-66df-42c1-9375-8d5c33ebb732 for instance c923591c-5c9b-429f-803a-33740ad921a3 on n-h1-852084-10 Sep 08 14:07:18.502283 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b4d544b1-c579-440f-b448-c56e80a0548d req-104bd292-e397-4905-b8e0-1a7c354d0dd3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049079 Sep 08 14:07:18.503198 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3574/7019] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:07:18.616382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fe2dd2c9-87d3-4e1d-9074-27d18192df9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:18.626934 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fe2dd2c9-87d3-4e1d-9074-27d18192df9d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1564 microversion: 2.1 time: 0.180673 Sep 08 14:07:18.627892 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3446/7020] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:18 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1564 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:43.892921 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=5 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:43.893843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=38 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:43.898700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8b8091b9-7f6d-4d3c-88e8-53102376ab8a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:43.901076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8b8091b9-7f6d-4d3c-88e8-53102376ab8a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:43.909242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b8091b9-7f6d-4d3c-88e8-53102376ab8a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:43.909755 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b8091b9-7f6d-4d3c-88e8-53102376ab8a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:43.910206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b8091b9-7f6d-4d3c-88e8-53102376ab8a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:43.910971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b8091b9-7f6d-4d3c-88e8-53102376ab8a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:43.911474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b8091b9-7f6d-4d3c-88e8-53102376ab8a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:43.911922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8b8091b9-7f6d-4d3c-88e8-53102376ab8a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:43.978698 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8b8091b9-7f6d-4d3c-88e8-53102376ab8a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3/action" status: 200 len: 24572 microversion: 2.1 time: 0.087613 Sep 08 14:07:43.980527 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3575/7021] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:07:43 2022] POST /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3/action => generated 24572 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:07:55.036560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d639f43d-169b-467b-8792-2116e415a726 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:07:55.038872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d639f43d-169b-467b-8792-2116e415a726 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:55.041199 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:55.041913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=36 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:55.049091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d639f43d-169b-467b-8792-2116e415a726 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.049589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d639f43d-169b-467b-8792-2116e415a726 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.050031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d639f43d-169b-467b-8792-2116e415a726 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.050746 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d639f43d-169b-467b-8792-2116e415a726 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.051203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d639f43d-169b-467b-8792-2116e415a726 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.051656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d639f43d-169b-467b-8792-2116e415a726 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.137128 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d639f43d-169b-467b-8792-2116e415a726 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3/action" status: 202 len: 0 microversion: 2.1 time: 0.105196 Sep 08 14:07:55.138454 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3447/7022] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:07:55 2022] POST /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:07:55.148985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0f682d42-82eb-48c5-a63c-47aaee3ae900 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:55.150135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0f682d42-82eb-48c5-a63c-47aaee3ae900 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:55.154069 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:55.154766 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:07:55.162395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f682d42-82eb-48c5-a63c-47aaee3ae900 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.162911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f682d42-82eb-48c5-a63c-47aaee3ae900 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.163404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f682d42-82eb-48c5-a63c-47aaee3ae900 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.164146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f682d42-82eb-48c5-a63c-47aaee3ae900 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:55.164623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f682d42-82eb-48c5-a63c-47aaee3ae900 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:55.165071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f682d42-82eb-48c5-a63c-47aaee3ae900 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:55.318641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0f682d42-82eb-48c5-a63c-47aaee3ae900 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:55.330872 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0f682d42-82eb-48c5-a63c-47aaee3ae900 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1675 microversion: 2.1 time: 0.187266 Sep 08 14:07:55.331511 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3576/7023] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:55 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:56.367946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e07efed2-e5b0-4838-882f-dca4af0890f0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:56.368604 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e07efed2-e5b0-4838-882f-dca4af0890f0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:56.375899 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e07efed2-e5b0-4838-882f-dca4af0890f0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:56.376421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e07efed2-e5b0-4838-882f-dca4af0890f0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:56.376862 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e07efed2-e5b0-4838-882f-dca4af0890f0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:56.377569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e07efed2-e5b0-4838-882f-dca4af0890f0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:56.378027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e07efed2-e5b0-4838-882f-dca4af0890f0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:56.378454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e07efed2-e5b0-4838-882f-dca4af0890f0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:56.515785 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e07efed2-e5b0-4838-882f-dca4af0890f0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:56.524556 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e07efed2-e5b0-4838-882f-dca4af0890f0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.162107 Sep 08 14:07:56.525136 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3448/7024] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:56 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:57.550051 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9f76ece0-bca8-4ffc-86b5-3f77c7bd3577 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:57.550630 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9f76ece0-bca8-4ffc-86b5-3f77c7bd3577 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:57.558586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f76ece0-bca8-4ffc-86b5-3f77c7bd3577 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:57.559084 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f76ece0-bca8-4ffc-86b5-3f77c7bd3577 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:57.559570 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f76ece0-bca8-4ffc-86b5-3f77c7bd3577 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:57.560279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f76ece0-bca8-4ffc-86b5-3f77c7bd3577 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:57.560741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f76ece0-bca8-4ffc-86b5-3f77c7bd3577 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:57.561182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9f76ece0-bca8-4ffc-86b5-3f77c7bd3577 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:57.707956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9f76ece0-bca8-4ffc-86b5-3f77c7bd3577 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:57.716825 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9f76ece0-bca8-4ffc-86b5-3f77c7bd3577 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.170821 Sep 08 14:07:57.717404 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3577/7025] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:57 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:58.741834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36a7f104-5fc5-4bca-98fc-45597e1187e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:58.742458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-36a7f104-5fc5-4bca-98fc-45597e1187e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:58.750225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36a7f104-5fc5-4bca-98fc-45597e1187e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.750748 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36a7f104-5fc5-4bca-98fc-45597e1187e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.751193 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36a7f104-5fc5-4bca-98fc-45597e1187e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.751948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36a7f104-5fc5-4bca-98fc-45597e1187e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:58.752409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36a7f104-5fc5-4bca-98fc-45597e1187e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:58.752841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-36a7f104-5fc5-4bca-98fc-45597e1187e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:58.906317 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-36a7f104-5fc5-4bca-98fc-45597e1187e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:07:58.915413 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36a7f104-5fc5-4bca-98fc-45597e1187e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.177216 Sep 08 14:07:58.916297 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3449/7026] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:58 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:07:59.940295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-89deca5b-ee4b-458c-bde3-ce04e43abafe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:07:59.940958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-89deca5b-ee4b-458c-bde3-ce04e43abafe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:07:59.948218 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89deca5b-ee4b-458c-bde3-ce04e43abafe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:59.948729 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89deca5b-ee4b-458c-bde3-ce04e43abafe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:59.949196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89deca5b-ee4b-458c-bde3-ce04e43abafe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:07:59.950015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89deca5b-ee4b-458c-bde3-ce04e43abafe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:07:59.950495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89deca5b-ee4b-458c-bde3-ce04e43abafe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:07:59.950941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-89deca5b-ee4b-458c-bde3-ce04e43abafe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:00.092784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-89deca5b-ee4b-458c-bde3-ce04e43abafe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:00.100826 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-89deca5b-ee4b-458c-bde3-ce04e43abafe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.164467 Sep 08 14:08:00.101483 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3578/7027] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:07:59 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:01.135409 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f0925148-6f6b-44d7-95c6-1e44d65529ae tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:01.136032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f0925148-6f6b-44d7-95c6-1e44d65529ae tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:01.143169 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0925148-6f6b-44d7-95c6-1e44d65529ae tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:01.143690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0925148-6f6b-44d7-95c6-1e44d65529ae tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:01.144131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0925148-6f6b-44d7-95c6-1e44d65529ae tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:01.144848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0925148-6f6b-44d7-95c6-1e44d65529ae tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:01.145304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0925148-6f6b-44d7-95c6-1e44d65529ae tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:01.145734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f0925148-6f6b-44d7-95c6-1e44d65529ae tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:01.309038 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f0925148-6f6b-44d7-95c6-1e44d65529ae tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:01.317143 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f0925148-6f6b-44d7-95c6-1e44d65529ae tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.187400 Sep 08 14:08:01.317733 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3450/7028] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:01 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:02.343038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2d7364f9-34ea-4582-ac13-855cabb7cbf4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:02.343832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2d7364f9-34ea-4582-ac13-855cabb7cbf4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:02.351518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d7364f9-34ea-4582-ac13-855cabb7cbf4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:02.352034 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d7364f9-34ea-4582-ac13-855cabb7cbf4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:02.352498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d7364f9-34ea-4582-ac13-855cabb7cbf4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:02.353231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d7364f9-34ea-4582-ac13-855cabb7cbf4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:02.353706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d7364f9-34ea-4582-ac13-855cabb7cbf4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:02.354423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d7364f9-34ea-4582-ac13-855cabb7cbf4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:02.522011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2d7364f9-34ea-4582-ac13-855cabb7cbf4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:02.536637 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2d7364f9-34ea-4582-ac13-855cabb7cbf4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.198020 Sep 08 14:08:02.537719 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3579/7029] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:02 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:03.575892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-96c7c4e0-fa10-4efe-aa97-13083f0d85af tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:03.576627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-96c7c4e0-fa10-4efe-aa97-13083f0d85af tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:03.583742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96c7c4e0-fa10-4efe-aa97-13083f0d85af tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:03.584234 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96c7c4e0-fa10-4efe-aa97-13083f0d85af tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:03.584679 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96c7c4e0-fa10-4efe-aa97-13083f0d85af tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:03.585392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96c7c4e0-fa10-4efe-aa97-13083f0d85af tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:03.585881 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96c7c4e0-fa10-4efe-aa97-13083f0d85af tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:03.586260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-96c7c4e0-fa10-4efe-aa97-13083f0d85af tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:03.738055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-96c7c4e0-fa10-4efe-aa97-13083f0d85af tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:03.747926 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-96c7c4e0-fa10-4efe-aa97-13083f0d85af tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.177207 Sep 08 14:08:03.748519 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3451/7030] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:03 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:04.772129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-83bbc471-14ac-4bd1-a7a4-a9f45411abf6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:04.772758 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-83bbc471-14ac-4bd1-a7a4-a9f45411abf6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:04.779918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83bbc471-14ac-4bd1-a7a4-a9f45411abf6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:04.780689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83bbc471-14ac-4bd1-a7a4-a9f45411abf6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:04.781149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83bbc471-14ac-4bd1-a7a4-a9f45411abf6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:04.781882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83bbc471-14ac-4bd1-a7a4-a9f45411abf6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:04.782353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83bbc471-14ac-4bd1-a7a4-a9f45411abf6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:04.782804 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83bbc471-14ac-4bd1-a7a4-a9f45411abf6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:04.925041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83bbc471-14ac-4bd1-a7a4-a9f45411abf6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:04.933066 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-83bbc471-14ac-4bd1-a7a4-a9f45411abf6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.164915 Sep 08 14:08:04.934137 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3580/7031] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:04 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:05.957600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-40412db4-232d-4b64-82ef-b10ea6fbeb61 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:05.958220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-40412db4-232d-4b64-82ef-b10ea6fbeb61 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:05.965283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40412db4-232d-4b64-82ef-b10ea6fbeb61 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:05.965852 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40412db4-232d-4b64-82ef-b10ea6fbeb61 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:05.966297 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40412db4-232d-4b64-82ef-b10ea6fbeb61 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:05.967006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40412db4-232d-4b64-82ef-b10ea6fbeb61 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:05.967489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40412db4-232d-4b64-82ef-b10ea6fbeb61 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:05.967948 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-40412db4-232d-4b64-82ef-b10ea6fbeb61 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:06.114301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-40412db4-232d-4b64-82ef-b10ea6fbeb61 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:06.123024 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-40412db4-232d-4b64-82ef-b10ea6fbeb61 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.169307 Sep 08 14:08:06.123658 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3452/7032] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:05 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:07.147265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2e80f05a-0fd5-4208-88ba-0c523d2c1fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:07.148192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2e80f05a-0fd5-4208-88ba-0c523d2c1fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:07.156777 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e80f05a-0fd5-4208-88ba-0c523d2c1fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:07.157287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e80f05a-0fd5-4208-88ba-0c523d2c1fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:07.157749 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e80f05a-0fd5-4208-88ba-0c523d2c1fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:07.158477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e80f05a-0fd5-4208-88ba-0c523d2c1fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:07.158951 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e80f05a-0fd5-4208-88ba-0c523d2c1fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:07.159448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2e80f05a-0fd5-4208-88ba-0c523d2c1fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:07.310927 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2e80f05a-0fd5-4208-88ba-0c523d2c1fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:07.319133 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2e80f05a-0fd5-4208-88ba-0c523d2c1fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.176059 Sep 08 14:08:07.319751 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3581/7033] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:07 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:08.342534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-246e5cdb-4aaf-49a9-9458-9034858a8db3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:08.343185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-246e5cdb-4aaf-49a9-9458-9034858a8db3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:08.350722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-246e5cdb-4aaf-49a9-9458-9034858a8db3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:08.351216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-246e5cdb-4aaf-49a9-9458-9034858a8db3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:08.351715 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-246e5cdb-4aaf-49a9-9458-9034858a8db3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:08.352428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-246e5cdb-4aaf-49a9-9458-9034858a8db3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:08.352884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-246e5cdb-4aaf-49a9-9458-9034858a8db3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:08.353313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-246e5cdb-4aaf-49a9-9458-9034858a8db3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:08.497628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-246e5cdb-4aaf-49a9-9458-9034858a8db3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:08.505698 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-246e5cdb-4aaf-49a9-9458-9034858a8db3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.167188 Sep 08 14:08:08.506286 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3453/7034] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:08 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:09.529513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e386e5c6-7240-48e0-aa54-271282ecaf5e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:09.530329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e386e5c6-7240-48e0-aa54-271282ecaf5e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:09.537532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e386e5c6-7240-48e0-aa54-271282ecaf5e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:09.538040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e386e5c6-7240-48e0-aa54-271282ecaf5e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:09.538498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e386e5c6-7240-48e0-aa54-271282ecaf5e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:09.539213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e386e5c6-7240-48e0-aa54-271282ecaf5e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:09.539707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e386e5c6-7240-48e0-aa54-271282ecaf5e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:09.540148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e386e5c6-7240-48e0-aa54-271282ecaf5e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:09.678557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e386e5c6-7240-48e0-aa54-271282ecaf5e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:09.687643 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e386e5c6-7240-48e0-aa54-271282ecaf5e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.162193 Sep 08 14:08:09.688350 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3582/7035] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:09 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:10.712475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d42a09a4-db7c-43dc-bb8e-f96235ad00c5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:10.713228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d42a09a4-db7c-43dc-bb8e-f96235ad00c5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:10.720760 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d42a09a4-db7c-43dc-bb8e-f96235ad00c5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:10.721251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d42a09a4-db7c-43dc-bb8e-f96235ad00c5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:10.721732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d42a09a4-db7c-43dc-bb8e-f96235ad00c5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:10.722476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d42a09a4-db7c-43dc-bb8e-f96235ad00c5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:10.723014 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d42a09a4-db7c-43dc-bb8e-f96235ad00c5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:10.723726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d42a09a4-db7c-43dc-bb8e-f96235ad00c5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:10.862613 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d42a09a4-db7c-43dc-bb8e-f96235ad00c5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:10.870612 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d42a09a4-db7c-43dc-bb8e-f96235ad00c5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.162655 Sep 08 14:08:10.871502 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3454/7036] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:10 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:11.898811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c8151a9c-10c2-4ea4-aa9d-df687cbee598 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:11.899528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c8151a9c-10c2-4ea4-aa9d-df687cbee598 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:11.906854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8151a9c-10c2-4ea4-aa9d-df687cbee598 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.907389 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8151a9c-10c2-4ea4-aa9d-df687cbee598 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.907846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8151a9c-10c2-4ea4-aa9d-df687cbee598 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:11.908571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8151a9c-10c2-4ea4-aa9d-df687cbee598 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:11.909198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8151a9c-10c2-4ea4-aa9d-df687cbee598 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:11.909706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c8151a9c-10c2-4ea4-aa9d-df687cbee598 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:12.141745 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c8151a9c-10c2-4ea4-aa9d-df687cbee598 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:12.149777 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c8151a9c-10c2-4ea4-aa9d-df687cbee598 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1680 microversion: 2.1 time: 0.254929 Sep 08 14:08:12.150379 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3583/7037] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:11 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:13.175393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1a109a5c-1ad4-4e6d-b897-4e3a68034962 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:13.175993 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1a109a5c-1ad4-4e6d-b897-4e3a68034962 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:13.183822 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a109a5c-1ad4-4e6d-b897-4e3a68034962 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:13.184341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a109a5c-1ad4-4e6d-b897-4e3a68034962 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:13.184777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a109a5c-1ad4-4e6d-b897-4e3a68034962 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:13.185520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a109a5c-1ad4-4e6d-b897-4e3a68034962 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:13.185971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a109a5c-1ad4-4e6d-b897-4e3a68034962 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:13.186394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1a109a5c-1ad4-4e6d-b897-4e3a68034962 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:13.325176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1a109a5c-1ad4-4e6d-b897-4e3a68034962 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:13.333435 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1a109a5c-1ad4-4e6d-b897-4e3a68034962 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1683 microversion: 2.1 time: 0.161979 Sep 08 14:08:13.334033 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3455/7038] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:13 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:39.539790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5d8994f8-8821-42f6-b682-1abcc1d363e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:39.542534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5d8994f8-8821-42f6-b682-1abcc1d363e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:39.545465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=16 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:39.546147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=48 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:39.551985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d8994f8-8821-42f6-b682-1abcc1d363e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:39.552491 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d8994f8-8821-42f6-b682-1abcc1d363e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:39.552949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d8994f8-8821-42f6-b682-1abcc1d363e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:39.553747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d8994f8-8821-42f6-b682-1abcc1d363e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:39.554174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d8994f8-8821-42f6-b682-1abcc1d363e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:39.554619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5d8994f8-8821-42f6-b682-1abcc1d363e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:39.625781 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5d8994f8-8821-42f6-b682-1abcc1d363e1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3/action" status: 200 len: 69114 microversion: 2.1 time: 0.089872 Sep 08 14:08:39.626477 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3584/7039] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:08:39 2022] POST /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3/action => generated 69114 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:08:47.095906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2b4d1dc-a0f0-4053-ae9d-62f5964e31e9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:47.096598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2b4d1dc-a0f0-4053-ae9d-62f5964e31e9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:47.099478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=18 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:47.100440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:08:47.109714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2b4d1dc-a0f0-4053-ae9d-62f5964e31e9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:47.110609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2b4d1dc-a0f0-4053-ae9d-62f5964e31e9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:47.111191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2b4d1dc-a0f0-4053-ae9d-62f5964e31e9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:47.112028 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2b4d1dc-a0f0-4053-ae9d-62f5964e31e9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:47.112563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2b4d1dc-a0f0-4053-ae9d-62f5964e31e9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:47.113703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2b4d1dc-a0f0-4053-ae9d-62f5964e31e9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:47.146991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2b4d1dc-a0f0-4053-ae9d-62f5964e31e9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:08:47.179760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-469924fd-f771-42a0-98e2-519ebfdbbbeb req-c69b2d97-0110-4c16-8af2-121ebb1162b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c923591c-5c9b-429f-803a-33740ad921a3", "tag": "a07854b2-66df-42c1-9375-8d5c33ebb732"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:47.192341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-469924fd-f771-42a0-98e2-519ebfdbbbeb req-c69b2d97-0110-4c16-8af2-121ebb1162b4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:47.192874 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-469924fd-f771-42a0-98e2-519ebfdbbbeb req-c69b2d97-0110-4c16-8af2-121ebb1162b4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:47.193322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-469924fd-f771-42a0-98e2-519ebfdbbbeb req-c69b2d97-0110-4c16-8af2-121ebb1162b4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:47.205343 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-469924fd-f771-42a0-98e2-519ebfdbbbeb req-c69b2d97-0110-4c16-8af2-121ebb1162b4 service nova] Creating event network-changed:a07854b2-66df-42c1-9375-8d5c33ebb732 for instance c923591c-5c9b-429f-803a-33740ad921a3 on n-h1-852084-10 Sep 08 14:08:47.210591 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-469924fd-f771-42a0-98e2-519ebfdbbbeb req-c69b2d97-0110-4c16-8af2-121ebb1162b4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116069 Sep 08 14:08:47.211626 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3585/7040] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:47.247459 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2b4d1dc-a0f0-4053-ae9d-62f5964e31e9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 204 len: 0 microversion: 2.1 time: 0.155313 Sep 08 14:08:47.251606 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3456/7041] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 14:08:47 2022] DELETE /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:08:47.258869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dfc247d6-40c1-4ac9-92b8-13b0a394b572 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:47.259782 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dfc247d6-40c1-4ac9-92b8-13b0a394b572 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:47.266436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfc247d6-40c1-4ac9-92b8-13b0a394b572 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:47.267024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfc247d6-40c1-4ac9-92b8-13b0a394b572 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:47.267786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfc247d6-40c1-4ac9-92b8-13b0a394b572 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:47.268578 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfc247d6-40c1-4ac9-92b8-13b0a394b572 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:47.269136 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfc247d6-40c1-4ac9-92b8-13b0a394b572 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:47.269644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfc247d6-40c1-4ac9-92b8-13b0a394b572 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:47.440592 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dfc247d6-40c1-4ac9-92b8-13b0a394b572 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:47.449281 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dfc247d6-40c1-4ac9-92b8-13b0a394b572 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1689 microversion: 2.1 time: 0.195662 Sep 08 14:08:47.449875 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3586/7042] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:47 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1689 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:08:48.475603 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6c6902c1-e89a-4512-852f-85a78d2abf44 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:48.476299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6c6902c1-e89a-4512-852f-85a78d2abf44 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:48.482945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c6902c1-e89a-4512-852f-85a78d2abf44 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:48.483467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c6902c1-e89a-4512-852f-85a78d2abf44 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:48.483914 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c6902c1-e89a-4512-852f-85a78d2abf44 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:48.484651 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c6902c1-e89a-4512-852f-85a78d2abf44 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:48.485116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c6902c1-e89a-4512-852f-85a78d2abf44 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:48.485547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6c6902c1-e89a-4512-852f-85a78d2abf44 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:48.688969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6c6902c1-e89a-4512-852f-85a78d2abf44 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:48.697801 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6c6902c1-e89a-4512-852f-85a78d2abf44 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1689 microversion: 2.1 time: 0.226508 Sep 08 14:08:48.698652 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3457/7043] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:48 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1689 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:49.483392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-462e6e75-c5d8-4ad2-9141-66892eb62ce8 req-e08af77e-e52f-4315-8d9f-5972dda13af8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c923591c-5c9b-429f-803a-33740ad921a3", "name": "network-vif-deleted", "tag": "a07854b2-66df-42c1-9375-8d5c33ebb732"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:49.497559 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-462e6e75-c5d8-4ad2-9141-66892eb62ce8 req-e08af77e-e52f-4315-8d9f-5972dda13af8 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:49.498118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-462e6e75-c5d8-4ad2-9141-66892eb62ce8 req-e08af77e-e52f-4315-8d9f-5972dda13af8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:49.498577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-462e6e75-c5d8-4ad2-9141-66892eb62ce8 req-e08af77e-e52f-4315-8d9f-5972dda13af8 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:49.516071 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-462e6e75-c5d8-4ad2-9141-66892eb62ce8 req-e08af77e-e52f-4315-8d9f-5972dda13af8 service nova] Creating event network-vif-deleted:a07854b2-66df-42c1-9375-8d5c33ebb732 for instance c923591c-5c9b-429f-803a-33740ad921a3 on n-h1-852084-10 Sep 08 14:08:49.523173 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-462e6e75-c5d8-4ad2-9141-66892eb62ce8 req-e08af77e-e52f-4315-8d9f-5972dda13af8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043150 Sep 08 14:08:49.523826 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3587/7044] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:08:49.722454 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:49.723072 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:49.730273 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:49.730767 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:49.731347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:49.732043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:49.732506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:49.732933 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:49.767666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:49.768176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:49.768624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:49.769113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lazy-loading 'fault' on Instance uuid c923591c-5c9b-429f-803a-33740ad921a3 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:08:49.812892 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:08:49.821766 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6d05482d-d321-4567-9c36-4604bc2a29a2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 200 len: 1356 microversion: 2.1 time: 0.103371 Sep 08 14:08:49.823016 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3458/7045] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:49 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 1356 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:08:50.846231 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-513fcf51-3702-4aad-9600-e760e5a364d0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:50.846985 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-513fcf51-3702-4aad-9600-e760e5a364d0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: c923591c-5c9b-429f-803a-33740ad921a3] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:08:50.855060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-513fcf51-3702-4aad-9600-e760e5a364d0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:50.855591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-513fcf51-3702-4aad-9600-e760e5a364d0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:50.856045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-513fcf51-3702-4aad-9600-e760e5a364d0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:50.856762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-513fcf51-3702-4aad-9600-e760e5a364d0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:08:50.857250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-513fcf51-3702-4aad-9600-e760e5a364d0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:08:50.857692 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-513fcf51-3702-4aad-9600-e760e5a364d0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:08:50.872082 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-513fcf51-3702-4aad-9600-e760e5a364d0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] HTTP exception thrown: Instance c923591c-5c9b-429f-803a-33740ad921a3 could not be found. Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-513fcf51-3702-4aad-9600-e760e5a364d0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Request method failure captured: Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 HTTP/1.1 Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfa8rEsclKqB3fGtEoDqf7MMBfOXuK9c8rBoj1w1ZQCY0tDJN3D51PNiQQ5SM8QjooN6eu0hg2opbsQtSReY76kx7kqXGXOA1lWnEjSaSiSz2NklHX-m5XIynq2v07KieXN2ZMFKPTiMgnRrAcFsfQt87Z0aVZMdxADsYgFfKmfBKOU Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0dc08700af5b40cc911c75f91b2b0f7a Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0dc08700af5b40cc911c75f91b2b0f7a Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestNetworkAdvancedServerOps-1112243692-project Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 16e1a1b184b04cbfb940462f00a39f88 Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1112243692-project Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance c923591c-5c9b-429f-803a-33740ad921a3 could not be found. Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'c923591c-5c9b-429f-803a-33740ad921a3'} Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c923591c-5c9b-429f-803a-33740ad921a3 could not be found. Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c923591c-5c9b-429f-803a-33740ad921a3 could not be found. Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:08:50.873762 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:08:50.878372 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:08:50.878372 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:08:50.878372 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:08:50.878372 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:08:50.878372 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:08:50.878372 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:08:50.878372 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c923591c-5c9b-429f-803a-33740ad921a3 could not be found. Sep 08 14:08:50.878372 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:08:50.878372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-513fcf51-3702-4aad-9600-e760e5a364d0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Returning 404 to user: Instance c923591c-5c9b-429f-803a-33740ad921a3 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:08:50.878372 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-513fcf51-3702-4aad-9600-e760e5a364d0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3" status: 404 len: 111 microversion: 2.1 time: 0.033335 Sep 08 14:08:50.878372 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3588/7046] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:08:50 2022] GET /compute/v2.1/servers/c923591c-5c9b-429f-803a-33740ad921a3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:08:54.017034 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b43de33f-4935-40ac-a678-eee8e9793fa3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '.version_select at 0x7fdb3a0440d0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:08:54.039745 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b43de33f-4935-40ac-a678-eee8e9793fa3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-347168889" status: 202 len: 0 microversion: 2.1 time: 0.026565 Sep 08 14:08:54.040553 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3459/7047] 10.222.0.78 () {58 vars in 1281 bytes} [Thu Sep 8 14:08:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-347168889 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:08:54.074492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e027d43-1e78-48f1-a498-e68ca747e8e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'create', calling method: .version_select at 0x7fdb36be8b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1160968399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBr25wXG1SwjPwLzLF9aePc5fwCiIliBneSrK5Pz2y8ST8lHTQz58jnJst8uP2zqhHu1WXnSMVV71JVz5G80l4W8w6UtPeMHVf8gESSriaehpt5fIBdDhEqkUwfjASuBmw=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:08:54.092100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-9e027d43-1e78-48f1-a498-e68ca747e8e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:08:54.098531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-9e027d43-1e78-48f1-a498-e68ca747e8e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for user 16e1a1b184b04cbfb940462f00a39f88 and project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:08:54.127175 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e027d43-1e78-48f1-a498-e68ca747e8e5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.058226 Sep 08 14:08:54.127813 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3589/7048] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 14:08:54 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:00.413936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:00.421722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1415460847", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "3f842fbe-d61c-4e8a-8b91-fa0a94868a7d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1160968399", "security_groups": [{"name": "tempest-secgroup-smoke-2021995873"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:00.551190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] validate_networks() for [('3f842fbe-d61c-4e8a-8b91-fa0a94868a7d', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:09:01.120601 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:09:01.122203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:09:01.122941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:09:01.123629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:09:01.124439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:09:01.138214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:01.139432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:01.140134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:01.141543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:01.142460 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:01.143155 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:01.168210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:09:01.185565 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for user 16e1a1b184b04cbfb940462f00a39f88 and project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:09:01.200969 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:09:01.203653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:09:01.256036 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f6ffbc60-f597-46c7-ba1c-5a1c934ab380 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.846367 Sep 08 14:09:01.256973 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3460/7049] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 14:09:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:09:01.270771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-08e34f27-4012-4b45-8a8d-01fc774dbd5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:01.272083 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-08e34f27-4012-4b45-8a8d-01fc774dbd5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:01.276500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=16 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:01.337683 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-08e34f27-4012-4b45-8a8d-01fc774dbd5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:01.346363 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-08e34f27-4012-4b45-8a8d-01fc774dbd5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1267 microversion: 2.1 time: 0.080990 Sep 08 14:09:01.347461 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3590/7050] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:01 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:02.371116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c8655252-ae39-429b-ba6f-72e2343ec5fc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:02.371902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c8655252-ae39-429b-ba6f-72e2343ec5fc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:02.439002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c8655252-ae39-429b-ba6f-72e2343ec5fc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:02.448534 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c8655252-ae39-429b-ba6f-72e2343ec5fc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1267 microversion: 2.1 time: 0.082044 Sep 08 14:09:02.449132 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3461/7051] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:02 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1267 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:03.472078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-58d9bbf7-ea98-4e1e-8d12-f69ba0d91655 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:03.474655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58d9bbf7-ea98-4e1e-8d12-f69ba0d91655 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:03.540742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-58d9bbf7-ea98-4e1e-8d12-f69ba0d91655 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:03.552136 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-58d9bbf7-ea98-4e1e-8d12-f69ba0d91655 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1267 microversion: 2.1 time: 0.083697 Sep 08 14:09:03.552822 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3591/7052] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:03 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:04.578517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-25b726c8-ee03-4512-b15a-df16966f4fa7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:04.579058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-25b726c8-ee03-4512-b15a-df16966f4fa7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:04.635449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-25b726c8-ee03-4512-b15a-df16966f4fa7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:04.643012 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-25b726c8-ee03-4512-b15a-df16966f4fa7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1267 microversion: 2.1 time: 0.068560 Sep 08 14:09:04.643643 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3462/7053] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:04 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1267 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:05.667868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-085ebaf8-a2fb-40b6-80a9-5d3598618398 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:05.668434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-085ebaf8-a2fb-40b6-80a9-5d3598618398 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:05.675702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-085ebaf8-a2fb-40b6-80a9-5d3598618398 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:05.676205 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-085ebaf8-a2fb-40b6-80a9-5d3598618398 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:05.676652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-085ebaf8-a2fb-40b6-80a9-5d3598618398 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:05.677393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-085ebaf8-a2fb-40b6-80a9-5d3598618398 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:05.677854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-085ebaf8-a2fb-40b6-80a9-5d3598618398 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:05.678291 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-085ebaf8-a2fb-40b6-80a9-5d3598618398 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:05.741943 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-085ebaf8-a2fb-40b6-80a9-5d3598618398 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:05.749688 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-085ebaf8-a2fb-40b6-80a9-5d3598618398 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1271 microversion: 2.1 time: 0.085852 Sep 08 14:09:05.750264 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3592/7054] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:05 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1271 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:06.773537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-54ee4b8d-0e89-4569-ac28-d66a79de9b15 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:06.774179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-54ee4b8d-0e89-4569-ac28-d66a79de9b15 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:06.782956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54ee4b8d-0e89-4569-ac28-d66a79de9b15 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:06.783481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54ee4b8d-0e89-4569-ac28-d66a79de9b15 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:06.783918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54ee4b8d-0e89-4569-ac28-d66a79de9b15 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:06.784622 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54ee4b8d-0e89-4569-ac28-d66a79de9b15 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:06.785221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54ee4b8d-0e89-4569-ac28-d66a79de9b15 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:06.785658 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-54ee4b8d-0e89-4569-ac28-d66a79de9b15 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:06.862340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-54ee4b8d-0e89-4569-ac28-d66a79de9b15 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:06.871356 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-54ee4b8d-0e89-4569-ac28-d66a79de9b15 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1325 microversion: 2.1 time: 0.102252 Sep 08 14:09:06.878969 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3463/7055] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:06 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1325 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:07.876093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-97282b8f-38df-4a14-86d1-999e1dafb8d7 req-3c311e98-ecf3-41ab-8c82-f7a9ee5b4d1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c03a52b-cab3-4500-ba87-3d53de4c288e", "tag": "3f0c636f-5afa-4a45-9e7c-6dff936c6b2f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:07.888230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97282b8f-38df-4a14-86d1-999e1dafb8d7 req-3c311e98-ecf3-41ab-8c82-f7a9ee5b4d1e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:07.888718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97282b8f-38df-4a14-86d1-999e1dafb8d7 req-3c311e98-ecf3-41ab-8c82-f7a9ee5b4d1e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:07.889192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97282b8f-38df-4a14-86d1-999e1dafb8d7 req-3c311e98-ecf3-41ab-8c82-f7a9ee5b4d1e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:07.897794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9e50acb8-4941-4536-9bd8-b32952508f2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:07.899000 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9e50acb8-4941-4536-9bd8-b32952508f2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:07.908885 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-97282b8f-38df-4a14-86d1-999e1dafb8d7 req-3c311e98-ecf3-41ab-8c82-f7a9ee5b4d1e service nova] Creating event network-changed:3f0c636f-5afa-4a45-9e7c-6dff936c6b2f for instance 6c03a52b-cab3-4500-ba87-3d53de4c288e on n-h2-852084-10 Sep 08 14:09:07.909727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e50acb8-4941-4536-9bd8-b32952508f2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:07.910456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e50acb8-4941-4536-9bd8-b32952508f2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:07.911066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e50acb8-4941-4536-9bd8-b32952508f2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:07.912384 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e50acb8-4941-4536-9bd8-b32952508f2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:07.912861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e50acb8-4941-4536-9bd8-b32952508f2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:07.913411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9e50acb8-4941-4536-9bd8-b32952508f2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:07.914751 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-97282b8f-38df-4a14-86d1-999e1dafb8d7 req-3c311e98-ecf3-41ab-8c82-f7a9ee5b4d1e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042055 Sep 08 14:09:07.915727 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3593/7056] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:08.153361 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9e50acb8-4941-4536-9bd8-b32952508f2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:08.161942 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9e50acb8-4941-4536-9bd8-b32952508f2e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1393 microversion: 2.1 time: 0.269009 Sep 08 14:09:08.162871 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3464/7057] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:07 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1393 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:09.188076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-060accf7-ed90-4546-8314-68be7514ef84 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:09.188832 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-060accf7-ed90-4546-8314-68be7514ef84 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:09.195326 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-060accf7-ed90-4546-8314-68be7514ef84 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:09.195830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-060accf7-ed90-4546-8314-68be7514ef84 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:09.196852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-060accf7-ed90-4546-8314-68be7514ef84 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:09.197585 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-060accf7-ed90-4546-8314-68be7514ef84 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:09.198058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-060accf7-ed90-4546-8314-68be7514ef84 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:09.198508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-060accf7-ed90-4546-8314-68be7514ef84 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:09.337352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-060accf7-ed90-4546-8314-68be7514ef84 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:09.345241 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-060accf7-ed90-4546-8314-68be7514ef84 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1393 microversion: 2.1 time: 0.162631 Sep 08 14:09:09.345846 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3594/7058] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:09 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:10.369191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a29a6ced-7af9-4235-a120-a2342037f4d9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:10.369808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a29a6ced-7af9-4235-a120-a2342037f4d9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:10.376775 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a29a6ced-7af9-4235-a120-a2342037f4d9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:10.377263 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a29a6ced-7af9-4235-a120-a2342037f4d9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:10.377701 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a29a6ced-7af9-4235-a120-a2342037f4d9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:10.378402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a29a6ced-7af9-4235-a120-a2342037f4d9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:10.378982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a29a6ced-7af9-4235-a120-a2342037f4d9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:10.379430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a29a6ced-7af9-4235-a120-a2342037f4d9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:10.518549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a29a6ced-7af9-4235-a120-a2342037f4d9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:10.527045 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a29a6ced-7af9-4235-a120-a2342037f4d9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1393 microversion: 2.1 time: 0.161852 Sep 08 14:09:10.527663 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3465/7059] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:10 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1393 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:11.551598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f6eebd2f-eff3-4d4d-b2b9-fca624dd0b70 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:11.552243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f6eebd2f-eff3-4d4d-b2b9-fca624dd0b70 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:11.554995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:11.561561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6eebd2f-eff3-4d4d-b2b9-fca624dd0b70 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:11.562106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6eebd2f-eff3-4d4d-b2b9-fca624dd0b70 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:11.562564 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6eebd2f-eff3-4d4d-b2b9-fca624dd0b70 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:11.563320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6eebd2f-eff3-4d4d-b2b9-fca624dd0b70 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:11.563793 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6eebd2f-eff3-4d4d-b2b9-fca624dd0b70 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:11.564242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f6eebd2f-eff3-4d4d-b2b9-fca624dd0b70 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:11.713760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f6eebd2f-eff3-4d4d-b2b9-fca624dd0b70 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:11.722106 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f6eebd2f-eff3-4d4d-b2b9-fca624dd0b70 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1393 microversion: 2.1 time: 0.174401 Sep 08 14:09:11.722891 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3595/7060] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:11 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1393 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:09:12.747859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-50d5e114-b391-4aee-b651-5c8edf41263f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:12.748703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-50d5e114-b391-4aee-b651-5c8edf41263f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:12.751296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:12.757847 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50d5e114-b391-4aee-b651-5c8edf41263f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:12.758342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50d5e114-b391-4aee-b651-5c8edf41263f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:12.758793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50d5e114-b391-4aee-b651-5c8edf41263f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:12.759540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50d5e114-b391-4aee-b651-5c8edf41263f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:12.760001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50d5e114-b391-4aee-b651-5c8edf41263f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:12.760431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-50d5e114-b391-4aee-b651-5c8edf41263f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:12.902644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-50d5e114-b391-4aee-b651-5c8edf41263f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:12.917108 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-50d5e114-b391-4aee-b651-5c8edf41263f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1393 microversion: 2.1 time: 0.174924 Sep 08 14:09:12.918101 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3466/7061] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:12 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1393 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:13.323097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-4f8895dc-2cb9-49c5-8852-7695da120c67 req-6a277c10-20c1-4f6f-a1ec-bf257add5117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c03a52b-cab3-4500-ba87-3d53de4c288e", "name": "network-vif-plugged", "status": "completed", "tag": "3f0c636f-5afa-4a45-9e7c-6dff936c6b2f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:13.333738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4f8895dc-2cb9-49c5-8852-7695da120c67 req-6a277c10-20c1-4f6f-a1ec-bf257add5117 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:13.334242 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4f8895dc-2cb9-49c5-8852-7695da120c67 req-6a277c10-20c1-4f6f-a1ec-bf257add5117 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:13.334727 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4f8895dc-2cb9-49c5-8852-7695da120c67 req-6a277c10-20c1-4f6f-a1ec-bf257add5117 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:13.346497 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-4f8895dc-2cb9-49c5-8852-7695da120c67 req-6a277c10-20c1-4f6f-a1ec-bf257add5117 service nova] Creating event network-vif-plugged:3f0c636f-5afa-4a45-9e7c-6dff936c6b2f for instance 6c03a52b-cab3-4500-ba87-3d53de4c288e on n-h2-852084-10 Sep 08 14:09:13.353074 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-4f8895dc-2cb9-49c5-8852-7695da120c67 req-6a277c10-20c1-4f6f-a1ec-bf257add5117 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094831 Sep 08 14:09:13.353734 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3596/7062] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:13.954573 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a125c8a3-a8e4-4cfb-b815-e9ec43279ca0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:13.955257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a125c8a3-a8e4-4cfb-b815-e9ec43279ca0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:13.963376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a125c8a3-a8e4-4cfb-b815-e9ec43279ca0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:13.963878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a125c8a3-a8e4-4cfb-b815-e9ec43279ca0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:13.964307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a125c8a3-a8e4-4cfb-b815-e9ec43279ca0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:13.965022 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a125c8a3-a8e4-4cfb-b815-e9ec43279ca0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:13.965472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a125c8a3-a8e4-4cfb-b815-e9ec43279ca0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:13.965891 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a125c8a3-a8e4-4cfb-b815-e9ec43279ca0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:14.109824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a125c8a3-a8e4-4cfb-b815-e9ec43279ca0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:14.117853 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a125c8a3-a8e4-4cfb-b815-e9ec43279ca0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1393 microversion: 2.1 time: 0.167287 Sep 08 14:09:14.118526 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3467/7063] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:13 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:09:15.138730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=8 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:15.144364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c919d15a-84cf-43b8-833c-41d12c191662 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:15.145107 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c919d15a-84cf-43b8-833c-41d12c191662 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:15.151811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c919d15a-84cf-43b8-833c-41d12c191662 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:15.152327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c919d15a-84cf-43b8-833c-41d12c191662 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:15.152785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c919d15a-84cf-43b8-833c-41d12c191662 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:15.153502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c919d15a-84cf-43b8-833c-41d12c191662 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:15.153977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c919d15a-84cf-43b8-833c-41d12c191662 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:15.154686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c919d15a-84cf-43b8-833c-41d12c191662 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:15.306984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c919d15a-84cf-43b8-833c-41d12c191662 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:15.314885 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c919d15a-84cf-43b8-833c-41d12c191662 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1566 microversion: 2.1 time: 0.177113 Sep 08 14:09:15.315489 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3597/7064] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:15 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1566 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:15.338697 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b1cb6f86-1a34-4ef9-b5e1-8f25da4a2009 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:15.339363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b1cb6f86-1a34-4ef9-b5e1-8f25da4a2009 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:15.341219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=10 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:15.353999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b1cb6f86-1a34-4ef9-b5e1-8f25da4a2009 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:15.354510 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b1cb6f86-1a34-4ef9-b5e1-8f25da4a2009 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:15.354962 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b1cb6f86-1a34-4ef9-b5e1-8f25da4a2009 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:15.355725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b1cb6f86-1a34-4ef9-b5e1-8f25da4a2009 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:15.356265 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b1cb6f86-1a34-4ef9-b5e1-8f25da4a2009 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:15.356624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b1cb6f86-1a34-4ef9-b5e1-8f25da4a2009 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:15.493065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b1cb6f86-1a34-4ef9-b5e1-8f25da4a2009 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:15.501170 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b1cb6f86-1a34-4ef9-b5e1-8f25da4a2009 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1566 microversion: 2.1 time: 0.166404 Sep 08 14:09:15.501747 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3468/7065] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:15 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1566 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:17.178254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e70e940e-6b6e-41ed-8917-ac184b75c448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:17.179687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e70e940e-6b6e-41ed-8917-ac184b75c448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:17.182161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-847b4c54-b9eb-4406-ac65-075d6423d635 req-d423a4cd-8e8b-42b4-91bf-86ee32705fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c03a52b-cab3-4500-ba87-3d53de4c288e", "tag": "3f0c636f-5afa-4a45-9e7c-6dff936c6b2f"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:17.188873 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e70e940e-6b6e-41ed-8917-ac184b75c448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:17.189349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:17.189698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e70e940e-6b6e-41ed-8917-ac184b75c448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:17.190400 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e70e940e-6b6e-41ed-8917-ac184b75c448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:17.191453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e70e940e-6b6e-41ed-8917-ac184b75c448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:17.192003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e70e940e-6b6e-41ed-8917-ac184b75c448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:17.192682 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e70e940e-6b6e-41ed-8917-ac184b75c448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:17.194075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-847b4c54-b9eb-4406-ac65-075d6423d635 req-d423a4cd-8e8b-42b4-91bf-86ee32705fef service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:17.194556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-847b4c54-b9eb-4406-ac65-075d6423d635 req-d423a4cd-8e8b-42b4-91bf-86ee32705fef service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:17.195197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-847b4c54-b9eb-4406-ac65-075d6423d635 req-d423a4cd-8e8b-42b4-91bf-86ee32705fef service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:17.208910 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-847b4c54-b9eb-4406-ac65-075d6423d635 req-d423a4cd-8e8b-42b4-91bf-86ee32705fef service nova] Creating event network-changed:3f0c636f-5afa-4a45-9e7c-6dff936c6b2f for instance 6c03a52b-cab3-4500-ba87-3d53de4c288e on n-h2-852084-10 Sep 08 14:09:17.214597 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-847b4c54-b9eb-4406-ac65-075d6423d635 req-d423a4cd-8e8b-42b4-91bf-86ee32705fef service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037277 Sep 08 14:09:17.215213 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3469/7066] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:09:17.422081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e70e940e-6b6e-41ed-8917-ac184b75c448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:17.430628 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e70e940e-6b6e-41ed-8917-ac184b75c448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1566 microversion: 2.1 time: 0.256254 Sep 08 14:09:17.439281 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3598/7067] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:17 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1566 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:40.725690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=40 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:40.730235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-22bbff18-2485-4d8c-a6af-3edbfe7f35ba tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:40.732590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-22bbff18-2485-4d8c-a6af-3edbfe7f35ba tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:40.740596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22bbff18-2485-4d8c-a6af-3edbfe7f35ba tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:40.741097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22bbff18-2485-4d8c-a6af-3edbfe7f35ba tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:40.742136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22bbff18-2485-4d8c-a6af-3edbfe7f35ba tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:40.742836 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22bbff18-2485-4d8c-a6af-3edbfe7f35ba tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:40.743323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22bbff18-2485-4d8c-a6af-3edbfe7f35ba tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:40.743758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-22bbff18-2485-4d8c-a6af-3edbfe7f35ba tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:40.798744 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-22bbff18-2485-4d8c-a6af-3edbfe7f35ba tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e/action" status: 200 len: 24571 microversion: 2.1 time: 0.075002 Sep 08 14:09:40.799523 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3470/7068] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:09:40 2022] POST /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e/action => generated 24571 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:09:47.233895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:09:47.236300 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:47.238561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=7 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:47.239244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=34 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:09:47.246230 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:47.246736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:47.247187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:47.247919 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:47.248384 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:47.248821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:47.292010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:47.298252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Old instance type m1.heat2, new instance type m1.heat {{(pid=128970) resize /opt/stack/nova/nova/compute/api.py:4220}} Sep 08 14:09:47.306032 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:09:47.306467 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:09:47.306949 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:09:47.307406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:09:47.307835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:09:47.374197 n-d-852084-10 devstack@n-api.service[128970]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [018e4039-7a6a-4e6b-93ca-34465946a0bf] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 14:09:48.381314 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [018e4039-7a6a-4e6b-93ca-34465946a0bf] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 51768. Sep 08 14:09:48.385258 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b8c22f42-193b-4463-85ab-0024e892437f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e/action" status: 202 len: 0 microversion: 2.1 time: 1.155667 Sep 08 14:09:48.386133 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3599/7069] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:09:47 2022] POST /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e/action => generated 0 bytes in 1157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:09:48.394722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f2e0db94-1343-48c8-97f9-0ae22b724720 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:48.395513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f2e0db94-1343-48c8-97f9-0ae22b724720 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:48.404369 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2e0db94-1343-48c8-97f9-0ae22b724720 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:48.404868 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2e0db94-1343-48c8-97f9-0ae22b724720 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:48.405318 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2e0db94-1343-48c8-97f9-0ae22b724720 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:48.406069 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2e0db94-1343-48c8-97f9-0ae22b724720 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:48.406497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2e0db94-1343-48c8-97f9-0ae22b724720 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:48.406968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f2e0db94-1343-48c8-97f9-0ae22b724720 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:48.594377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f2e0db94-1343-48c8-97f9-0ae22b724720 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:48.603473 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f2e0db94-1343-48c8-97f9-0ae22b724720 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1694 microversion: 2.1 time: 0.212946 Sep 08 14:09:48.604252 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3471/7070] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:48 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1694 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:49.631006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-58afeb64-0ea9-4c54-b6b3-1c48bdf1e72c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:49.631722 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-58afeb64-0ea9-4c54-b6b3-1c48bdf1e72c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:49.642419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58afeb64-0ea9-4c54-b6b3-1c48bdf1e72c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:49.642855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58afeb64-0ea9-4c54-b6b3-1c48bdf1e72c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:49.643346 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58afeb64-0ea9-4c54-b6b3-1c48bdf1e72c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:49.644073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58afeb64-0ea9-4c54-b6b3-1c48bdf1e72c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:49.644549 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58afeb64-0ea9-4c54-b6b3-1c48bdf1e72c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:49.645056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-58afeb64-0ea9-4c54-b6b3-1c48bdf1e72c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:49.786866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-58afeb64-0ea9-4c54-b6b3-1c48bdf1e72c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:49.803251 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-58afeb64-0ea9-4c54-b6b3-1c48bdf1e72c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1694 microversion: 2.1 time: 0.177912 Sep 08 14:09:49.803910 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3600/7071] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:49 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:50.829365 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d6551189-9db6-4c6c-8ce0-381a20ea4a5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:50.830401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d6551189-9db6-4c6c-8ce0-381a20ea4a5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:50.838717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6551189-9db6-4c6c-8ce0-381a20ea4a5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:50.839242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6551189-9db6-4c6c-8ce0-381a20ea4a5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:50.839705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6551189-9db6-4c6c-8ce0-381a20ea4a5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:50.840416 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6551189-9db6-4c6c-8ce0-381a20ea4a5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:50.840875 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6551189-9db6-4c6c-8ce0-381a20ea4a5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:50.841307 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d6551189-9db6-4c6c-8ce0-381a20ea4a5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:50.985792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d6551189-9db6-4c6c-8ce0-381a20ea4a5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:50.994997 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d6551189-9db6-4c6c-8ce0-381a20ea4a5c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1699 microversion: 2.1 time: 0.170784 Sep 08 14:09:50.995634 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3472/7072] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:50 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1699 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:52.020413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-62937d9e-da62-4e21-8584-91338d7d4802 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:52.021035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-62937d9e-da62-4e21-8584-91338d7d4802 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:52.030784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62937d9e-da62-4e21-8584-91338d7d4802 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:52.031409 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62937d9e-da62-4e21-8584-91338d7d4802 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:52.031863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62937d9e-da62-4e21-8584-91338d7d4802 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:52.032597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62937d9e-da62-4e21-8584-91338d7d4802 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:52.033073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62937d9e-da62-4e21-8584-91338d7d4802 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:52.033761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62937d9e-da62-4e21-8584-91338d7d4802 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:52.173150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-62937d9e-da62-4e21-8584-91338d7d4802 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:52.182111 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-62937d9e-da62-4e21-8584-91338d7d4802 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1699 microversion: 2.1 time: 0.165483 Sep 08 14:09:52.182717 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3601/7073] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:52 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1699 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:53.207137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9358a76f-6c29-443c-845b-6cc9a863e7df tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:53.207781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9358a76f-6c29-443c-845b-6cc9a863e7df tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:53.214747 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9358a76f-6c29-443c-845b-6cc9a863e7df tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:53.215251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9358a76f-6c29-443c-845b-6cc9a863e7df tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:53.215698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9358a76f-6c29-443c-845b-6cc9a863e7df tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:53.216395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9358a76f-6c29-443c-845b-6cc9a863e7df tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:53.216850 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9358a76f-6c29-443c-845b-6cc9a863e7df tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:53.217278 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9358a76f-6c29-443c-845b-6cc9a863e7df tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:53.353337 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9358a76f-6c29-443c-845b-6cc9a863e7df tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:53.361380 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9358a76f-6c29-443c-845b-6cc9a863e7df tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1699 microversion: 2.1 time: 0.158833 Sep 08 14:09:53.361967 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3473/7074] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:53 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:54.385725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-155f5811-4ff0-4be3-b8c9-960d38ae7bc1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:54.386345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-155f5811-4ff0-4be3-b8c9-960d38ae7bc1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:54.393465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-155f5811-4ff0-4be3-b8c9-960d38ae7bc1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:54.393973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-155f5811-4ff0-4be3-b8c9-960d38ae7bc1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:54.394434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-155f5811-4ff0-4be3-b8c9-960d38ae7bc1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:54.395154 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-155f5811-4ff0-4be3-b8c9-960d38ae7bc1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:54.395662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-155f5811-4ff0-4be3-b8c9-960d38ae7bc1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:54.396112 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-155f5811-4ff0-4be3-b8c9-960d38ae7bc1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:54.538447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-155f5811-4ff0-4be3-b8c9-960d38ae7bc1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:54.546540 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-155f5811-4ff0-4be3-b8c9-960d38ae7bc1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1699 microversion: 2.1 time: 0.165709 Sep 08 14:09:54.547132 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3602/7075] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:54 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1699 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:55.570714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6a967ffb-1b62-4805-a8c2-57c14311a6b7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:55.571355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6a967ffb-1b62-4805-a8c2-57c14311a6b7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:55.578225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a967ffb-1b62-4805-a8c2-57c14311a6b7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:55.578708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a967ffb-1b62-4805-a8c2-57c14311a6b7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:55.579149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a967ffb-1b62-4805-a8c2-57c14311a6b7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:55.579864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a967ffb-1b62-4805-a8c2-57c14311a6b7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:55.580525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a967ffb-1b62-4805-a8c2-57c14311a6b7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:55.581071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6a967ffb-1b62-4805-a8c2-57c14311a6b7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:55.716301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6a967ffb-1b62-4805-a8c2-57c14311a6b7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:55.724725 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6a967ffb-1b62-4805-a8c2-57c14311a6b7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1699 microversion: 2.1 time: 0.158520 Sep 08 14:09:55.726022 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3474/7076] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:55 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1699 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:56.749009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9df138f-3a2a-42c1-b175-5cd19ece5c40 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:56.749645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a9df138f-3a2a-42c1-b175-5cd19ece5c40 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:56.756709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9df138f-3a2a-42c1-b175-5cd19ece5c40 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:56.757217 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9df138f-3a2a-42c1-b175-5cd19ece5c40 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:56.757675 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9df138f-3a2a-42c1-b175-5cd19ece5c40 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:56.758397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9df138f-3a2a-42c1-b175-5cd19ece5c40 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:56.758869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9df138f-3a2a-42c1-b175-5cd19ece5c40 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:56.759345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9df138f-3a2a-42c1-b175-5cd19ece5c40 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:56.909162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9df138f-3a2a-42c1-b175-5cd19ece5c40 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:56.917583 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a9df138f-3a2a-42c1-b175-5cd19ece5c40 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1699 microversion: 2.1 time: 0.172544 Sep 08 14:09:56.918177 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3603/7077] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:56 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1699 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:57.942051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-73b8af71-d1ca-4da0-8234-a58082db5693 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:57.942677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-73b8af71-d1ca-4da0-8234-a58082db5693 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:57.949763 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73b8af71-d1ca-4da0-8234-a58082db5693 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:57.950259 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73b8af71-d1ca-4da0-8234-a58082db5693 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:57.950700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73b8af71-d1ca-4da0-8234-a58082db5693 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:57.951494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73b8af71-d1ca-4da0-8234-a58082db5693 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:57.951902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73b8af71-d1ca-4da0-8234-a58082db5693 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:57.952335 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-73b8af71-d1ca-4da0-8234-a58082db5693 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:58.106400 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-73b8af71-d1ca-4da0-8234-a58082db5693 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:58.115002 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-73b8af71-d1ca-4da0-8234-a58082db5693 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1699 microversion: 2.1 time: 0.177033 Sep 08 14:09:58.115628 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3475/7078] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:57 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1699 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:09:59.140436 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-deac3ab2-f139-4b6b-ba0d-683edd2a85fd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:09:59.141071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-deac3ab2-f139-4b6b-ba0d-683edd2a85fd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:09:59.148922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-deac3ab2-f139-4b6b-ba0d-683edd2a85fd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:59.149435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-deac3ab2-f139-4b6b-ba0d-683edd2a85fd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:59.149895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-deac3ab2-f139-4b6b-ba0d-683edd2a85fd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:59.150640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-deac3ab2-f139-4b6b-ba0d-683edd2a85fd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:09:59.151120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-deac3ab2-f139-4b6b-ba0d-683edd2a85fd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:09:59.151595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-deac3ab2-f139-4b6b-ba0d-683edd2a85fd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:09:59.292819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-deac3ab2-f139-4b6b-ba0d-683edd2a85fd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:09:59.300590 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-deac3ab2-f139-4b6b-ba0d-683edd2a85fd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1699 microversion: 2.1 time: 0.164327 Sep 08 14:09:59.301180 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3604/7079] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:09:59 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1699 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:00.324889 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0f41b3ea-26c1-4cb7-85ec-8cab22a44bb7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:00.325537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0f41b3ea-26c1-4cb7-85ec-8cab22a44bb7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:00.332884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f41b3ea-26c1-4cb7-85ec-8cab22a44bb7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:00.333397 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f41b3ea-26c1-4cb7-85ec-8cab22a44bb7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:00.333824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f41b3ea-26c1-4cb7-85ec-8cab22a44bb7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:00.335198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f41b3ea-26c1-4cb7-85ec-8cab22a44bb7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:00.335649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f41b3ea-26c1-4cb7-85ec-8cab22a44bb7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:00.336130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0f41b3ea-26c1-4cb7-85ec-8cab22a44bb7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:00.472742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0f41b3ea-26c1-4cb7-85ec-8cab22a44bb7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:00.480794 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0f41b3ea-26c1-4cb7-85ec-8cab22a44bb7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1699 microversion: 2.1 time: 0.159930 Sep 08 14:10:00.481373 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3476/7080] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:00 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:01.504704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-39e33877-578b-47b8-8499-aede56de4103 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:01.505334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-39e33877-578b-47b8-8499-aede56de4103 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:01.516635 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39e33877-578b-47b8-8499-aede56de4103 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:01.517150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39e33877-578b-47b8-8499-aede56de4103 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:01.517615 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39e33877-578b-47b8-8499-aede56de4103 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:01.518342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39e33877-578b-47b8-8499-aede56de4103 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:01.518850 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39e33877-578b-47b8-8499-aede56de4103 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:01.519367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-39e33877-578b-47b8-8499-aede56de4103 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:01.653140 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-39e33877-578b-47b8-8499-aede56de4103 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:01.661315 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-39e33877-578b-47b8-8499-aede56de4103 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1699 microversion: 2.1 time: 0.160659 Sep 08 14:10:01.661899 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3605/7081] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:01 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1699 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:10:02.686035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8759bf9b-864a-485a-9b49-d88915c42889 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:02.686874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8759bf9b-864a-485a-9b49-d88915c42889 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:02.694915 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8759bf9b-864a-485a-9b49-d88915c42889 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:02.695443 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8759bf9b-864a-485a-9b49-d88915c42889 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:02.695878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8759bf9b-864a-485a-9b49-d88915c42889 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:02.696599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8759bf9b-864a-485a-9b49-d88915c42889 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:02.697057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8759bf9b-864a-485a-9b49-d88915c42889 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:02.697689 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8759bf9b-864a-485a-9b49-d88915c42889 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:02.925421 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8759bf9b-864a-485a-9b49-d88915c42889 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:02.934182 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8759bf9b-864a-485a-9b49-d88915c42889 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1698 microversion: 2.1 time: 0.252376 Sep 08 14:10:02.934782 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3477/7082] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:02 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1698 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:03.218119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-11ea8d50-91e5-44c4-831f-20bb3547a8ed req-8319add3-a1e1-4b45-958a-051016a8de23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c03a52b-cab3-4500-ba87-3d53de4c288e", "name": "network-vif-unplugged", "status": "completed", "tag": "3f0c636f-5afa-4a45-9e7c-6dff936c6b2f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:03.230187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-11ea8d50-91e5-44c4-831f-20bb3547a8ed req-8319add3-a1e1-4b45-958a-051016a8de23 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:03.230775 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-11ea8d50-91e5-44c4-831f-20bb3547a8ed req-8319add3-a1e1-4b45-958a-051016a8de23 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:03.231250 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-11ea8d50-91e5-44c4-831f-20bb3547a8ed req-8319add3-a1e1-4b45-958a-051016a8de23 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:03.244286 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-11ea8d50-91e5-44c4-831f-20bb3547a8ed req-8319add3-a1e1-4b45-958a-051016a8de23 service nova] Creating event network-vif-unplugged:3f0c636f-5afa-4a45-9e7c-6dff936c6b2f for instance 6c03a52b-cab3-4500-ba87-3d53de4c288e on n-h1-852084-10 Sep 08 14:10:03.250141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [req-11ea8d50-91e5-44c4-831f-20bb3547a8ed req-8319add3-a1e1-4b45-958a-051016a8de23 service nova] Instance 6c03a52b-cab3-4500-ba87-3d53de4c288e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128970) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 14:10:03.261297 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-11ea8d50-91e5-44c4-831f-20bb3547a8ed req-8319add3-a1e1-4b45-958a-051016a8de23 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046834 Sep 08 14:10:03.261901 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3606/7083] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:10:03.958006 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-07dc68d2-ea54-49ec-9e26-3d37065274d7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:03.958628 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-07dc68d2-ea54-49ec-9e26-3d37065274d7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:03.966126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07dc68d2-ea54-49ec-9e26-3d37065274d7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:03.966716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07dc68d2-ea54-49ec-9e26-3d37065274d7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:03.967076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07dc68d2-ea54-49ec-9e26-3d37065274d7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:03.968285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07dc68d2-ea54-49ec-9e26-3d37065274d7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:03.968816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07dc68d2-ea54-49ec-9e26-3d37065274d7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:03.969188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-07dc68d2-ea54-49ec-9e26-3d37065274d7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:04.194121 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-07dc68d2-ea54-49ec-9e26-3d37065274d7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:04.202104 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-07dc68d2-ea54-49ec-9e26-3d37065274d7 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1698 microversion: 2.1 time: 0.248023 Sep 08 14:10:04.202898 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3478/7084] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:03 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1698 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:05.228488 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2d5c457e-9f9d-49b6-b8e4-40b6bda5e7b9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:05.229219 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2d5c457e-9f9d-49b6-b8e4-40b6bda5e7b9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:05.235733 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d5c457e-9f9d-49b6-b8e4-40b6bda5e7b9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:05.236244 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d5c457e-9f9d-49b6-b8e4-40b6bda5e7b9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:05.236698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d5c457e-9f9d-49b6-b8e4-40b6bda5e7b9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:05.237423 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d5c457e-9f9d-49b6-b8e4-40b6bda5e7b9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:05.237895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d5c457e-9f9d-49b6-b8e4-40b6bda5e7b9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:05.238344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2d5c457e-9f9d-49b6-b8e4-40b6bda5e7b9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:05.318201 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-616f3307-5a4b-4414-bb24-9c0ac68a4968 req-ab655d03-df2d-495b-b481-740112f37bdf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c03a52b-cab3-4500-ba87-3d53de4c288e", "tag": "3f0c636f-5afa-4a45-9e7c-6dff936c6b2f"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:05.328719 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-616f3307-5a4b-4414-bb24-9c0ac68a4968 req-ab655d03-df2d-495b-b481-740112f37bdf service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:05.329203 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-616f3307-5a4b-4414-bb24-9c0ac68a4968 req-ab655d03-df2d-495b-b481-740112f37bdf service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:05.329894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-616f3307-5a4b-4414-bb24-9c0ac68a4968 req-ab655d03-df2d-495b-b481-740112f37bdf service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:05.343581 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-616f3307-5a4b-4414-bb24-9c0ac68a4968 req-ab655d03-df2d-495b-b481-740112f37bdf service nova] Creating event network-changed:3f0c636f-5afa-4a45-9e7c-6dff936c6b2f for instance 6c03a52b-cab3-4500-ba87-3d53de4c288e on n-h1-852084-10 Sep 08 14:10:05.359782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [req-616f3307-5a4b-4414-bb24-9c0ac68a4968 req-ab655d03-df2d-495b-b481-740112f37bdf service nova] Instance 6c03a52b-cab3-4500-ba87-3d53de4c288e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-852084-10', 'n-h2-852084-10'} {{(pid=128971) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Sep 08 14:10:05.373161 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-616f3307-5a4b-4414-bb24-9c0ac68a4968 req-ab655d03-df2d-495b-b481-740112f37bdf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061142 Sep 08 14:10:05.373974 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3479/7085] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:10:05.393838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2d5c457e-9f9d-49b6-b8e4-40b6bda5e7b9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:05.402873 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2d5c457e-9f9d-49b6-b8e4-40b6bda5e7b9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1696 microversion: 2.1 time: 0.180413 Sep 08 14:10:05.403533 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3607/7086] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:05 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1696 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:06.428720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-fc5ce146-25c0-4b1b-a8d6-e166df3a719b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:06.429599 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-fc5ce146-25c0-4b1b-a8d6-e166df3a719b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:06.438431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc5ce146-25c0-4b1b-a8d6-e166df3a719b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:06.440225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc5ce146-25c0-4b1b-a8d6-e166df3a719b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:06.440225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc5ce146-25c0-4b1b-a8d6-e166df3a719b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:06.440225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc5ce146-25c0-4b1b-a8d6-e166df3a719b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:06.440653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc5ce146-25c0-4b1b-a8d6-e166df3a719b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:06.441008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-fc5ce146-25c0-4b1b-a8d6-e166df3a719b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:06.590996 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-fc5ce146-25c0-4b1b-a8d6-e166df3a719b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:06.599460 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-fc5ce146-25c0-4b1b-a8d6-e166df3a719b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1693 microversion: 2.1 time: 0.175859 Sep 08 14:10:06.600045 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3480/7087] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:06 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1693 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:10:06.622447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4b60721e-0d30-46fb-91cd-f5fe00bea9cc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:06.623044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4b60721e-0d30-46fb-91cd-f5fe00bea9cc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:06.630316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b60721e-0d30-46fb-91cd-f5fe00bea9cc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:06.631493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b60721e-0d30-46fb-91cd-f5fe00bea9cc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:06.631806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b60721e-0d30-46fb-91cd-f5fe00bea9cc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:06.632540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b60721e-0d30-46fb-91cd-f5fe00bea9cc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:06.633018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b60721e-0d30-46fb-91cd-f5fe00bea9cc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:06.633464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4b60721e-0d30-46fb-91cd-f5fe00bea9cc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:06.697772 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4b60721e-0d30-46fb-91cd-f5fe00bea9cc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e/action" status: 204 len: 0 microversion: 2.1 time: 0.078819 Sep 08 14:10:06.698399 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3608/7088] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:10:06 2022] POST /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e/action => generated 0 bytes in 81 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:10:06.707870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-efa244a9-c92e-42c0-91e1-bd9c444f272f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:06.708784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-efa244a9-c92e-42c0-91e1-bd9c444f272f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:06.721362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efa244a9-c92e-42c0-91e1-bd9c444f272f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:06.722030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efa244a9-c92e-42c0-91e1-bd9c444f272f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:06.723727 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efa244a9-c92e-42c0-91e1-bd9c444f272f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:06.724458 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efa244a9-c92e-42c0-91e1-bd9c444f272f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:06.725453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efa244a9-c92e-42c0-91e1-bd9c444f272f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:06.725880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-efa244a9-c92e-42c0-91e1-bd9c444f272f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:06.968413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-efa244a9-c92e-42c0-91e1-bd9c444f272f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:06.977711 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-efa244a9-c92e-42c0-91e1-bd9c444f272f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1693 microversion: 2.1 time: 0.274849 Sep 08 14:10:06.978294 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3481/7089] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:06 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1693 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:07.002965 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0229669f-0d40-4850-8311-d4d059a16601 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:07.003808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0229669f-0d40-4850-8311-d4d059a16601 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:07.010844 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0229669f-0d40-4850-8311-d4d059a16601 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:07.011396 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0229669f-0d40-4850-8311-d4d059a16601 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:07.011861 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0229669f-0d40-4850-8311-d4d059a16601 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:07.012594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0229669f-0d40-4850-8311-d4d059a16601 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:07.013073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0229669f-0d40-4850-8311-d4d059a16601 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:07.013523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0229669f-0d40-4850-8311-d4d059a16601 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:07.258963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0229669f-0d40-4850-8311-d4d059a16601 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:07.267565 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0229669f-0d40-4850-8311-d4d059a16601 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1693 microversion: 2.1 time: 0.268984 Sep 08 14:10:07.268113 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3609/7090] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:06 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1693 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:10:08.291888 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d23afa8d-64e6-4ae2-9bfd-d476ee1ed14b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:08.292505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d23afa8d-64e6-4ae2-9bfd-d476ee1ed14b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:08.299529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d23afa8d-64e6-4ae2-9bfd-d476ee1ed14b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:08.300019 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d23afa8d-64e6-4ae2-9bfd-d476ee1ed14b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:08.300455 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d23afa8d-64e6-4ae2-9bfd-d476ee1ed14b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:08.301149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d23afa8d-64e6-4ae2-9bfd-d476ee1ed14b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:08.301635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d23afa8d-64e6-4ae2-9bfd-d476ee1ed14b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:08.302066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d23afa8d-64e6-4ae2-9bfd-d476ee1ed14b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:08.440245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d23afa8d-64e6-4ae2-9bfd-d476ee1ed14b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:08.448266 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d23afa8d-64e6-4ae2-9bfd-d476ee1ed14b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1685 microversion: 2.1 time: 0.161008 Sep 08 14:10:08.448847 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3482/7091] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:08 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1685 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:10.782969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-12feb350-bb94-4b69-b842-6cc37da9921c req-64951b9f-2752-4ba0-ba0c-af3ca5381268 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c03a52b-cab3-4500-ba87-3d53de4c288e", "name": "network-vif-plugged", "status": "completed", "tag": "3f0c636f-5afa-4a45-9e7c-6dff936c6b2f"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:10.796068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-12feb350-bb94-4b69-b842-6cc37da9921c req-64951b9f-2752-4ba0-ba0c-af3ca5381268 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:10.796567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-12feb350-bb94-4b69-b842-6cc37da9921c req-64951b9f-2752-4ba0-ba0c-af3ca5381268 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:10.797009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-12feb350-bb94-4b69-b842-6cc37da9921c req-64951b9f-2752-4ba0-ba0c-af3ca5381268 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:10.810104 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-12feb350-bb94-4b69-b842-6cc37da9921c req-64951b9f-2752-4ba0-ba0c-af3ca5381268 service nova] Creating event network-vif-plugged:3f0c636f-5afa-4a45-9e7c-6dff936c6b2f for instance 6c03a52b-cab3-4500-ba87-3d53de4c288e on n-h1-852084-10 Sep 08 14:10:10.815921 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-12feb350-bb94-4b69-b842-6cc37da9921c req-64951b9f-2752-4ba0-ba0c-af3ca5381268 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036586 Sep 08 14:10:10.816350 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3610/7092] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:34.655827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-db56ba8c-2688-49f9-8f3a-177688e7af0f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:34.658066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-db56ba8c-2688-49f9-8f3a-177688e7af0f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:34.660410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=27 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:34.661291 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=74 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:34.669483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db56ba8c-2688-49f9-8f3a-177688e7af0f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:34.670001 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db56ba8c-2688-49f9-8f3a-177688e7af0f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:34.670423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db56ba8c-2688-49f9-8f3a-177688e7af0f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:34.671132 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db56ba8c-2688-49f9-8f3a-177688e7af0f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:34.671610 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db56ba8c-2688-49f9-8f3a-177688e7af0f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:34.672042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-db56ba8c-2688-49f9-8f3a-177688e7af0f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:34.733438 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-db56ba8c-2688-49f9-8f3a-177688e7af0f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e/action" status: 200 len: 24535 microversion: 2.1 time: 0.082068 Sep 08 14:10:34.734157 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3483/7093] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:10:34 2022] POST /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e/action => generated 24535 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:10:41.821371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f75a9d02-9353-4da6-b700-7b4b88feb922 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:41.821978 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f75a9d02-9353-4da6-b700-7b4b88feb922 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:41.825595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=28 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:41.826355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:41.835679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f75a9d02-9353-4da6-b700-7b4b88feb922 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:41.836519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f75a9d02-9353-4da6-b700-7b4b88feb922 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:41.837035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f75a9d02-9353-4da6-b700-7b4b88feb922 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:41.837820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f75a9d02-9353-4da6-b700-7b4b88feb922 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:41.838358 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f75a9d02-9353-4da6-b700-7b4b88feb922 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:41.838863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f75a9d02-9353-4da6-b700-7b4b88feb922 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:41.869665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f75a9d02-9353-4da6-b700-7b4b88feb922 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:10:41.885287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-ad18d3ac-b4c1-4c32-ade9-4ebc921ca819 req-13349611-6258-472d-8f17-ca286f0a54a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6c03a52b-cab3-4500-ba87-3d53de4c288e", "tag": "3f0c636f-5afa-4a45-9e7c-6dff936c6b2f"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:41.896206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ad18d3ac-b4c1-4c32-ade9-4ebc921ca819 req-13349611-6258-472d-8f17-ca286f0a54a7 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:41.896973 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ad18d3ac-b4c1-4c32-ade9-4ebc921ca819 req-13349611-6258-472d-8f17-ca286f0a54a7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:41.897592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ad18d3ac-b4c1-4c32-ade9-4ebc921ca819 req-13349611-6258-472d-8f17-ca286f0a54a7 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:41.908706 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-ad18d3ac-b4c1-4c32-ade9-4ebc921ca819 req-13349611-6258-472d-8f17-ca286f0a54a7 service nova] Creating event network-changed:3f0c636f-5afa-4a45-9e7c-6dff936c6b2f for instance 6c03a52b-cab3-4500-ba87-3d53de4c288e on n-h1-852084-10 Sep 08 14:10:41.914660 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-ad18d3ac-b4c1-4c32-ade9-4ebc921ca819 req-13349611-6258-472d-8f17-ca286f0a54a7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093836 Sep 08 14:10:41.915741 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3484/7094] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:41.956998 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f75a9d02-9353-4da6-b700-7b4b88feb922 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "DELETE /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 204 len: 0 microversion: 2.1 time: 0.139455 Sep 08 14:10:41.957986 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3611/7095] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 14:10:41 2022] DELETE /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:10:41.968140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-15298f1e-6b51-4f2b-86f2-cd1601946151 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:41.968140 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-15298f1e-6b51-4f2b-86f2-cd1601946151 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:41.976091 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15298f1e-6b51-4f2b-86f2-cd1601946151 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:41.976695 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15298f1e-6b51-4f2b-86f2-cd1601946151 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:41.977200 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15298f1e-6b51-4f2b-86f2-cd1601946151 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:41.977977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15298f1e-6b51-4f2b-86f2-cd1601946151 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:41.978653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15298f1e-6b51-4f2b-86f2-cd1601946151 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:41.979207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-15298f1e-6b51-4f2b-86f2-cd1601946151 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:42.130978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-15298f1e-6b51-4f2b-86f2-cd1601946151 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:42.139920 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-15298f1e-6b51-4f2b-86f2-cd1601946151 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1691 microversion: 2.1 time: 0.177500 Sep 08 14:10:42.140532 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3485/7096] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:41 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:43.166009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4da67bdd-f3a8-49ec-b2eb-4220ff5c0049 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:43.166658 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4da67bdd-f3a8-49ec-b2eb-4220ff5c0049 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:43.174456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4da67bdd-f3a8-49ec-b2eb-4220ff5c0049 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:43.174991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4da67bdd-f3a8-49ec-b2eb-4220ff5c0049 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:43.175483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4da67bdd-f3a8-49ec-b2eb-4220ff5c0049 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:43.176819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4da67bdd-f3a8-49ec-b2eb-4220ff5c0049 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:43.177478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4da67bdd-f3a8-49ec-b2eb-4220ff5c0049 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:43.177918 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4da67bdd-f3a8-49ec-b2eb-4220ff5c0049 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:43.392702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4da67bdd-f3a8-49ec-b2eb-4220ff5c0049 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:43.401487 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4da67bdd-f3a8-49ec-b2eb-4220ff5c0049 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 200 len: 1691 microversion: 2.1 time: 0.239900 Sep 08 14:10:43.402442 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3612/7097] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:43 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 1691 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:43.997293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-f83ad303-0137-44f6-adb9-bddcf533eced req-db3dbe12-c2bf-459b-9bd1-e24331270dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6c03a52b-cab3-4500-ba87-3d53de4c288e", "name": "network-vif-deleted", "tag": "3f0c636f-5afa-4a45-9e7c-6dff936c6b2f"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:44.011088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f83ad303-0137-44f6-adb9-bddcf533eced req-db3dbe12-c2bf-459b-9bd1-e24331270dae service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:44.011894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f83ad303-0137-44f6-adb9-bddcf533eced req-db3dbe12-c2bf-459b-9bd1-e24331270dae service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:44.012682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-f83ad303-0137-44f6-adb9-bddcf533eced req-db3dbe12-c2bf-459b-9bd1-e24331270dae service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:44.030394 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-f83ad303-0137-44f6-adb9-bddcf533eced req-db3dbe12-c2bf-459b-9bd1-e24331270dae service nova] Creating event network-vif-deleted:3f0c636f-5afa-4a45-9e7c-6dff936c6b2f for instance 6c03a52b-cab3-4500-ba87-3d53de4c288e on n-h1-852084-10 Sep 08 14:10:44.037367 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-f83ad303-0137-44f6-adb9-bddcf533eced req-db3dbe12-c2bf-459b-9bd1-e24331270dae service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043774 Sep 08 14:10:44.038264 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3486/7098] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:44.426948 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca42ad0d-f4ee-45bf-abd5-5918673be7c3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:44.427642 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ca42ad0d-f4ee-45bf-abd5-5918673be7c3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 6c03a52b-cab3-4500-ba87-3d53de4c288e] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:44.434719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca42ad0d-f4ee-45bf-abd5-5918673be7c3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:44.435254 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca42ad0d-f4ee-45bf-abd5-5918673be7c3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:44.435925 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca42ad0d-f4ee-45bf-abd5-5918673be7c3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:44.436653 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca42ad0d-f4ee-45bf-abd5-5918673be7c3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:44.437130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca42ad0d-f4ee-45bf-abd5-5918673be7c3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:44.437572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ca42ad0d-f4ee-45bf-abd5-5918673be7c3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:44.455085 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-ca42ad0d-f4ee-45bf-abd5-5918673be7c3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] HTTP exception thrown: Instance 6c03a52b-cab3-4500-ba87-3d53de4c288e could not be found. Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca42ad0d-f4ee-45bf-abd5-5918673be7c3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Request method failure captured: Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e HTTP/1.1 Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfa8rEsclKqB3fGtEoDqf7MMBfOXuK9c8rBoj1w1ZQCY0tDJN3D51PNiQQ5SM8QjooN6eu0hg2opbsQtSReY76kx7kqXGXOA1lWnEjSaSiSz2NklHX-m5XIynq2v07KieXN2ZMFKPTiMgnRrAcFsfQt87Z0aVZMdxADsYgFfKmfBKOU Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 0dc08700af5b40cc911c75f91b2b0f7a Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 0dc08700af5b40cc911c75f91b2b0f7a Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestNetworkAdvancedServerOps-1112243692-project Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: 16e1a1b184b04cbfb940462f00a39f88 Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1112243692-project Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance 6c03a52b-cab3-4500-ba87-3d53de4c288e could not be found. Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': '6c03a52b-cab3-4500-ba87-3d53de4c288e'} Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6c03a52b-cab3-4500-ba87-3d53de4c288e could not be found. Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6c03a52b-cab3-4500-ba87-3d53de4c288e could not be found. Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:10:44.456816 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:10:44.462395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:10:44.462395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:10:44.462395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:10:44.462395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:10:44.462395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:10:44.462395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:10:44.462395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6c03a52b-cab3-4500-ba87-3d53de4c288e could not be found. Sep 08 14:10:44.462395 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:10:44.462395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ca42ad0d-f4ee-45bf-abd5-5918673be7c3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Returning 404 to user: Instance 6c03a52b-cab3-4500-ba87-3d53de4c288e could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:10:44.462395 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ca42ad0d-f4ee-45bf-abd5-5918673be7c3 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e" status: 404 len: 111 microversion: 2.1 time: 0.035961 Sep 08 14:10:44.462395 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3613/7099] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:44 2022] GET /compute/v2.1/servers/6c03a52b-cab3-4500-ba87-3d53de4c288e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:10:47.960941 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5dcbcaff-2722-4791-b418-de00b08f510c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '.version_select at 0x7fdb3ad33790>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:47.983470 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5dcbcaff-2722-4791-b418-de00b08f510c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1160968399" status: 202 len: 0 microversion: 2.1 time: 0.028645 Sep 08 14:10:47.984040 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3487/7100] 10.222.0.78 () {58 vars in 1284 bytes} [Thu Sep 8 14:10:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1160968399 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:10:48.012795 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a7d1e511-e240-48f9-96f4-5cb053b84ea0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'create', calling method: .version_select at 0x7fdb373a93a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1316093335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSb+DDqUdN7PEK4c2I47MtFewwNRDOL+UvVz6FztAaW0XBAcAITxM1Vn0554CWQjEyCcUAfrIIx2zPwiuZiqBd4P7XjfsGsiJMFVA1yCwOiDYFmNLCCjfjgUblczufqUg=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:48.030563 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a7d1e511-e240-48f9-96f4-5cb053b84ea0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:10:48.037952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-a7d1e511-e240-48f9-96f4-5cb053b84ea0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for user 16e1a1b184b04cbfb940462f00a39f88 and project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:10:48.068188 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a7d1e511-e240-48f9-96f4-5cb053b84ea0 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.060186 Sep 08 14:10:48.068809 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3614/7101] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 14:10:48 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:53.555366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1604882915", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "02f95980-cedb-4cdf-bc89-4d9cdaa028fc"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1316093335", "security_groups": [{"name": "tempest-secgroup-smoke-1541670976"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:53.712887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] validate_networks() for [('02f95980-cedb-4cdf-bc89-4d9cdaa028fc', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:10:54.019694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=14 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:54.176136 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:10:54.176641 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:10:54.177190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:10:54.177605 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:10:54.178058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:10:54.187154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:54.187694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:54.188141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:54.188879 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:54.189339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:54.189772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:54.209271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:10:54.216609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for user 16e1a1b184b04cbfb940462f00a39f88 and project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:10:54.237609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:10:54.241903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:10:54.308416 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c4590ae6-577b-4296-a68f-51092b5f8296 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.758440 Sep 08 14:10:54.311548 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3488/7102] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 14:10:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:10:54.323074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8bd49e60-8b4c-4505-917c-bcb01eefcbe5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:54.324870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8bd49e60-8b4c-4505-917c-bcb01eefcbe5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:54.401502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8bd49e60-8b4c-4505-917c-bcb01eefcbe5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:54.413912 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8bd49e60-8b4c-4505-917c-bcb01eefcbe5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1267 microversion: 2.1 time: 0.097686 Sep 08 14:10:54.414691 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3615/7103] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:54 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:55.439717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cddfb620-f65a-491f-a7da-046722ce0a69 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:55.440920 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cddfb620-f65a-491f-a7da-046722ce0a69 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:55.452519 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cddfb620-f65a-491f-a7da-046722ce0a69 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:55.453294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cddfb620-f65a-491f-a7da-046722ce0a69 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:55.453946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cddfb620-f65a-491f-a7da-046722ce0a69 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:55.454902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cddfb620-f65a-491f-a7da-046722ce0a69 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:55.455559 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cddfb620-f65a-491f-a7da-046722ce0a69 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:55.456154 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cddfb620-f65a-491f-a7da-046722ce0a69 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:55.566987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-cddfb620-f65a-491f-a7da-046722ce0a69 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:55.576301 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cddfb620-f65a-491f-a7da-046722ce0a69 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1337 microversion: 2.1 time: 0.141924 Sep 08 14:10:55.577010 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3489/7104] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:55 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1337 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:56.598540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:10:56.604163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bb368193-ead4-4260-b03b-cfad339aa60e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:56.604991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bb368193-ead4-4260-b03b-cfad339aa60e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:56.615586 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb368193-ead4-4260-b03b-cfad339aa60e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:56.616405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb368193-ead4-4260-b03b-cfad339aa60e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:56.616859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb368193-ead4-4260-b03b-cfad339aa60e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:56.617581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb368193-ead4-4260-b03b-cfad339aa60e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:56.618224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb368193-ead4-4260-b03b-cfad339aa60e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:56.618738 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bb368193-ead4-4260-b03b-cfad339aa60e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:56.910314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bb368193-ead4-4260-b03b-cfad339aa60e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:56.923541 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bb368193-ead4-4260-b03b-cfad339aa60e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1393 microversion: 2.1 time: 0.326077 Sep 08 14:10:56.924467 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3616/7105] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:56 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1393 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:57.125141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e209a25e-de7f-4099-8d69-d484f145544a req-08301ab7-01c9-4adf-bcbd-5af6c2cf7158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adba6efc-2b2e-4940-bd57-3dc5e9ea35d6", "tag": "94055785-1b56-43a4-ab19-684116f415af"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:10:57.139439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e209a25e-de7f-4099-8d69-d484f145544a req-08301ab7-01c9-4adf-bcbd-5af6c2cf7158 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:57.140026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e209a25e-de7f-4099-8d69-d484f145544a req-08301ab7-01c9-4adf-bcbd-5af6c2cf7158 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:57.140745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e209a25e-de7f-4099-8d69-d484f145544a req-08301ab7-01c9-4adf-bcbd-5af6c2cf7158 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:57.155603 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e209a25e-de7f-4099-8d69-d484f145544a req-08301ab7-01c9-4adf-bcbd-5af6c2cf7158 service nova] Creating event network-changed:94055785-1b56-43a4-ab19-684116f415af for instance adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 on n-h2-852084-10 Sep 08 14:10:57.162640 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e209a25e-de7f-4099-8d69-d484f145544a req-08301ab7-01c9-4adf-bcbd-5af6c2cf7158 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041479 Sep 08 14:10:57.163289 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3490/7106] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:10:57.966996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8e913142-ada2-42aa-b184-e36be0f95712 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:57.967760 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8e913142-ada2-42aa-b184-e36be0f95712 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:57.978799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e913142-ada2-42aa-b184-e36be0f95712 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:57.979338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e913142-ada2-42aa-b184-e36be0f95712 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:57.979891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e913142-ada2-42aa-b184-e36be0f95712 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:57.980688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e913142-ada2-42aa-b184-e36be0f95712 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:57.981166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e913142-ada2-42aa-b184-e36be0f95712 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:57.981611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8e913142-ada2-42aa-b184-e36be0f95712 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:58.132969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-8e913142-ada2-42aa-b184-e36be0f95712 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:58.141674 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8e913142-ada2-42aa-b184-e36be0f95712 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1393 microversion: 2.1 time: 0.181639 Sep 08 14:10:58.142277 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3617/7107] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:57 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1393 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:10:59.167864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0281f49c-f8de-43a1-ad85-f997104e178a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:10:59.168588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0281f49c-f8de-43a1-ad85-f997104e178a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:10:59.176749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0281f49c-f8de-43a1-ad85-f997104e178a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:59.177264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0281f49c-f8de-43a1-ad85-f997104e178a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:59.177710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0281f49c-f8de-43a1-ad85-f997104e178a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:59.178438 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0281f49c-f8de-43a1-ad85-f997104e178a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:10:59.178910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0281f49c-f8de-43a1-ad85-f997104e178a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:10:59.179372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0281f49c-f8de-43a1-ad85-f997104e178a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:10:59.322027 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0281f49c-f8de-43a1-ad85-f997104e178a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:10:59.329931 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0281f49c-f8de-43a1-ad85-f997104e178a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1393 microversion: 2.1 time: 0.167647 Sep 08 14:10:59.330501 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3491/7108] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:10:59 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:00.353535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-be6688a8-df30-4bb9-8a80-b13f4b2b0a3a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:00.354196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-be6688a8-df30-4bb9-8a80-b13f4b2b0a3a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:00.361259 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be6688a8-df30-4bb9-8a80-b13f4b2b0a3a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:00.361759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be6688a8-df30-4bb9-8a80-b13f4b2b0a3a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:00.362207 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be6688a8-df30-4bb9-8a80-b13f4b2b0a3a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:00.362964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be6688a8-df30-4bb9-8a80-b13f4b2b0a3a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:00.363455 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be6688a8-df30-4bb9-8a80-b13f4b2b0a3a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:00.363923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-be6688a8-df30-4bb9-8a80-b13f4b2b0a3a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:00.510637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-be6688a8-df30-4bb9-8a80-b13f4b2b0a3a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:00.518590 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-be6688a8-df30-4bb9-8a80-b13f4b2b0a3a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1393 microversion: 2.1 time: 0.168920 Sep 08 14:11:00.519843 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3618/7109] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:00 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1393 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:01.542816 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b7f7f255-b861-4dde-be33-074720e532fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:01.543484 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b7f7f255-b861-4dde-be33-074720e532fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:01.551185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7f7f255-b861-4dde-be33-074720e532fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:01.551716 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7f7f255-b861-4dde-be33-074720e532fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:01.552191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7f7f255-b861-4dde-be33-074720e532fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:01.552896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7f7f255-b861-4dde-be33-074720e532fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:01.553356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7f7f255-b861-4dde-be33-074720e532fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:01.553787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b7f7f255-b861-4dde-be33-074720e532fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:01.833477 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-3fa0a478-1a83-4217-a6bc-090a88ef2e13 req-bef28769-dc68-45c2-9a16-35e45e9b7dbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adba6efc-2b2e-4940-bd57-3dc5e9ea35d6", "name": "network-vif-plugged", "status": "completed", "tag": "94055785-1b56-43a4-ab19-684116f415af"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:01.844912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3fa0a478-1a83-4217-a6bc-090a88ef2e13 req-bef28769-dc68-45c2-9a16-35e45e9b7dbb service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:01.845465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3fa0a478-1a83-4217-a6bc-090a88ef2e13 req-bef28769-dc68-45c2-9a16-35e45e9b7dbb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:01.845911 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-3fa0a478-1a83-4217-a6bc-090a88ef2e13 req-bef28769-dc68-45c2-9a16-35e45e9b7dbb service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:01.859336 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-3fa0a478-1a83-4217-a6bc-090a88ef2e13 req-bef28769-dc68-45c2-9a16-35e45e9b7dbb service nova] Creating event network-vif-plugged:94055785-1b56-43a4-ab19-684116f415af for instance adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 on n-h2-852084-10 Sep 08 14:11:01.865414 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-3fa0a478-1a83-4217-a6bc-090a88ef2e13 req-bef28769-dc68-45c2-9a16-35e45e9b7dbb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036053 Sep 08 14:11:01.866141 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3619/7110] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:11:02.046131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b7f7f255-b861-4dde-be33-074720e532fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:02.060951 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b7f7f255-b861-4dde-be33-074720e532fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1393 microversion: 2.1 time: 0.521662 Sep 08 14:11:02.060951 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3492/7111] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:01 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1393 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:03.085606 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9564e566-42cd-4e43-8dc0-986c3621de59 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:03.086366 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9564e566-42cd-4e43-8dc0-986c3621de59 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:03.093752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9564e566-42cd-4e43-8dc0-986c3621de59 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:03.094252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9564e566-42cd-4e43-8dc0-986c3621de59 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:03.094701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9564e566-42cd-4e43-8dc0-986c3621de59 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:03.095486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9564e566-42cd-4e43-8dc0-986c3621de59 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:03.095952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9564e566-42cd-4e43-8dc0-986c3621de59 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:03.096395 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9564e566-42cd-4e43-8dc0-986c3621de59 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:03.237369 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9564e566-42cd-4e43-8dc0-986c3621de59 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:03.246080 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9564e566-42cd-4e43-8dc0-986c3621de59 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1393 microversion: 2.1 time: 0.164738 Sep 08 14:11:03.246677 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3620/7112] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:03 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1393 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:04.269550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-41923b91-c806-48b6-a8ac-fae9e4358215 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:04.270159 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-41923b91-c806-48b6-a8ac-fae9e4358215 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:04.273079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:04.273758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:04.279470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41923b91-c806-48b6-a8ac-fae9e4358215 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:04.280197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41923b91-c806-48b6-a8ac-fae9e4358215 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:04.280638 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41923b91-c806-48b6-a8ac-fae9e4358215 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:04.281344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41923b91-c806-48b6-a8ac-fae9e4358215 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:04.281798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41923b91-c806-48b6-a8ac-fae9e4358215 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:04.282216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41923b91-c806-48b6-a8ac-fae9e4358215 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:04.421031 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-41923b91-c806-48b6-a8ac-fae9e4358215 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:04.428916 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-41923b91-c806-48b6-a8ac-fae9e4358215 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1565 microversion: 2.1 time: 0.163986 Sep 08 14:11:04.429525 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3493/7113] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:04 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:04.452836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-309b73fb-ef4b-4ab1-8778-370add3fdb57 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:04.453742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-309b73fb-ef4b-4ab1-8778-370add3fdb57 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:04.457484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:04.462972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-309b73fb-ef4b-4ab1-8778-370add3fdb57 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:04.463836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-309b73fb-ef4b-4ab1-8778-370add3fdb57 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:04.464251 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-309b73fb-ef4b-4ab1-8778-370add3fdb57 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:04.465000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-309b73fb-ef4b-4ab1-8778-370add3fdb57 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:04.465464 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-309b73fb-ef4b-4ab1-8778-370add3fdb57 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:04.465912 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-309b73fb-ef4b-4ab1-8778-370add3fdb57 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:04.610073 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-309b73fb-ef4b-4ab1-8778-370add3fdb57 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:04.618282 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-309b73fb-ef4b-4ab1-8778-370add3fdb57 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1565 microversion: 2.1 time: 0.169810 Sep 08 14:11:04.618955 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3621/7114] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:04 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1565 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:06.315710 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-04606ea6-90d0-41c2-bef0-d12919c48acd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:06.316493 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-04606ea6-90d0-41c2-bef0-d12919c48acd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:06.317899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-5a5b6eaf-c05b-4080-b4b4-027a8fb6429c req-fdad0b44-4cd1-4203-9d74-7ef972bb9b1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adba6efc-2b2e-4940-bd57-3dc5e9ea35d6", "tag": "94055785-1b56-43a4-ab19-684116f415af"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:06.319448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:06.325368 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04606ea6-90d0-41c2-bef0-d12919c48acd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:06.326185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04606ea6-90d0-41c2-bef0-d12919c48acd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:06.326880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04606ea6-90d0-41c2-bef0-d12919c48acd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:06.328055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04606ea6-90d0-41c2-bef0-d12919c48acd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:06.328616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04606ea6-90d0-41c2-bef0-d12919c48acd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:06.329266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-04606ea6-90d0-41c2-bef0-d12919c48acd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:06.330093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5a5b6eaf-c05b-4080-b4b4-027a8fb6429c req-fdad0b44-4cd1-4203-9d74-7ef972bb9b1f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:06.330751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5a5b6eaf-c05b-4080-b4b4-027a8fb6429c req-fdad0b44-4cd1-4203-9d74-7ef972bb9b1f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:06.331907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-5a5b6eaf-c05b-4080-b4b4-027a8fb6429c req-fdad0b44-4cd1-4203-9d74-7ef972bb9b1f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:06.344701 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-5a5b6eaf-c05b-4080-b4b4-027a8fb6429c req-fdad0b44-4cd1-4203-9d74-7ef972bb9b1f service nova] Creating event network-changed:94055785-1b56-43a4-ab19-684116f415af for instance adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 on n-h2-852084-10 Sep 08 14:11:06.350766 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-5a5b6eaf-c05b-4080-b4b4-027a8fb6429c req-fdad0b44-4cd1-4203-9d74-7ef972bb9b1f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036412 Sep 08 14:11:06.351612 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3622/7115] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:11:06.575323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-04606ea6-90d0-41c2-bef0-d12919c48acd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:06.585449 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-04606ea6-90d0-41c2-bef0-d12919c48acd tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1565 microversion: 2.1 time: 0.273844 Sep 08 14:11:06.586789 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3494/7116] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:06 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1565 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:27.895070 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:27.896422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=34 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:27.901210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2490b6f8-6d5a-4f8d-9353-45b3d3a231f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:27.903834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2490b6f8-6d5a-4f8d-9353-45b3d3a231f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:27.913105 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2490b6f8-6d5a-4f8d-9353-45b3d3a231f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:27.913969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2490b6f8-6d5a-4f8d-9353-45b3d3a231f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:27.914557 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2490b6f8-6d5a-4f8d-9353-45b3d3a231f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:27.915295 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2490b6f8-6d5a-4f8d-9353-45b3d3a231f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:27.916005 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2490b6f8-6d5a-4f8d-9353-45b3d3a231f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:27.916783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2490b6f8-6d5a-4f8d-9353-45b3d3a231f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:27.979271 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2490b6f8-6d5a-4f8d-9353-45b3d3a231f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6/action" status: 200 len: 24568 microversion: 2.1 time: 0.086199 Sep 08 14:11:27.979979 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3623/7117] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:11:27 2022] POST /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6/action => generated 24568 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:11:38.957976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a329e8d2-12f8-41bd-b638-2030c6bed4f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:38.960151 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:38.960808 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=34 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:38.967476 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a329e8d2-12f8-41bd-b638-2030c6bed4f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:38.967975 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a329e8d2-12f8-41bd-b638-2030c6bed4f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:38.968420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a329e8d2-12f8-41bd-b638-2030c6bed4f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:38.992256 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a329e8d2-12f8-41bd-b638-2030c6bed4f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Going to try to stop instance {{(pid=128971) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 08 14:11:39.039400 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a329e8d2-12f8-41bd-b638-2030c6bed4f9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6/action" status: 202 len: 0 microversion: 2.1 time: 0.086297 Sep 08 14:11:39.040013 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3495/7118] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:11:38 2022] POST /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:11:39.049896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b3f92979-f783-4c88-aee5-db8460bdb448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:39.050765 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b3f92979-f783-4c88-aee5-db8460bdb448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:39.054338 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:39.055189 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:11:39.063196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3f92979-f783-4c88-aee5-db8460bdb448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:39.063750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3f92979-f783-4c88-aee5-db8460bdb448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:39.064781 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3f92979-f783-4c88-aee5-db8460bdb448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:39.065700 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3f92979-f783-4c88-aee5-db8460bdb448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:39.066367 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3f92979-f783-4c88-aee5-db8460bdb448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:39.066778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b3f92979-f783-4c88-aee5-db8460bdb448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:39.213303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b3f92979-f783-4c88-aee5-db8460bdb448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:39.221816 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b3f92979-f783-4c88-aee5-db8460bdb448 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1694 microversion: 2.1 time: 0.177043 Sep 08 14:11:39.222404 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3624/7119] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:39 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:40.249021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1076bb12-b0b7-4ade-99a5-8e7ce15cb724 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:40.249754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1076bb12-b0b7-4ade-99a5-8e7ce15cb724 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:40.256580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1076bb12-b0b7-4ade-99a5-8e7ce15cb724 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:40.257066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1076bb12-b0b7-4ade-99a5-8e7ce15cb724 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:40.257502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1076bb12-b0b7-4ade-99a5-8e7ce15cb724 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:40.258196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1076bb12-b0b7-4ade-99a5-8e7ce15cb724 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:40.258652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1076bb12-b0b7-4ade-99a5-8e7ce15cb724 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:40.259073 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1076bb12-b0b7-4ade-99a5-8e7ce15cb724 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:40.396134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1076bb12-b0b7-4ade-99a5-8e7ce15cb724 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:40.404613 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1076bb12-b0b7-4ade-99a5-8e7ce15cb724 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1694 microversion: 2.1 time: 0.161085 Sep 08 14:11:40.405209 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3496/7120] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:40 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1694 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:41.428378 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-da64f91d-8b25-4165-b6b4-010e8a7229d4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:41.429013 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-da64f91d-8b25-4165-b6b4-010e8a7229d4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:41.435884 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da64f91d-8b25-4165-b6b4-010e8a7229d4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:41.436403 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da64f91d-8b25-4165-b6b4-010e8a7229d4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:41.436893 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da64f91d-8b25-4165-b6b4-010e8a7229d4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:41.437562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da64f91d-8b25-4165-b6b4-010e8a7229d4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:41.438036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da64f91d-8b25-4165-b6b4-010e8a7229d4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:41.438484 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-da64f91d-8b25-4165-b6b4-010e8a7229d4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:41.578903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-da64f91d-8b25-4165-b6b4-010e8a7229d4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:41.587990 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-da64f91d-8b25-4165-b6b4-010e8a7229d4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1694 microversion: 2.1 time: 0.163550 Sep 08 14:11:41.588793 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3625/7121] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:41 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1694 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:42.613394 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-279b3c17-9499-4eb2-956b-b885cfc153cf tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:42.614025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-279b3c17-9499-4eb2-956b-b885cfc153cf tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:42.620964 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-279b3c17-9499-4eb2-956b-b885cfc153cf tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:42.621478 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-279b3c17-9499-4eb2-956b-b885cfc153cf tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:42.621982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-279b3c17-9499-4eb2-956b-b885cfc153cf tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:42.624005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-279b3c17-9499-4eb2-956b-b885cfc153cf tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:42.624005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-279b3c17-9499-4eb2-956b-b885cfc153cf tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:42.624005 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-279b3c17-9499-4eb2-956b-b885cfc153cf tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:42.773794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-279b3c17-9499-4eb2-956b-b885cfc153cf tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:42.787454 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-279b3c17-9499-4eb2-956b-b885cfc153cf tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1694 microversion: 2.1 time: 0.178524 Sep 08 14:11:42.788053 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3497/7122] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:42 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:43.811316 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c1617f85-8974-4277-b4e6-e2c8415bd011 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:43.811953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c1617f85-8974-4277-b4e6-e2c8415bd011 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:43.819769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1617f85-8974-4277-b4e6-e2c8415bd011 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:43.820307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1617f85-8974-4277-b4e6-e2c8415bd011 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:43.820837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1617f85-8974-4277-b4e6-e2c8415bd011 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:43.821598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1617f85-8974-4277-b4e6-e2c8415bd011 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:43.821984 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1617f85-8974-4277-b4e6-e2c8415bd011 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:43.822426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c1617f85-8974-4277-b4e6-e2c8415bd011 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:43.969279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c1617f85-8974-4277-b4e6-e2c8415bd011 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:43.980264 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c1617f85-8974-4277-b4e6-e2c8415bd011 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1694 microversion: 2.1 time: 0.172462 Sep 08 14:11:43.980945 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3626/7123] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:43 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1694 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:45.005540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c6a2c4a4-db42-4dec-9445-3e9962172b6a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:45.006467 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c6a2c4a4-db42-4dec-9445-3e9962172b6a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:45.014569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6a2c4a4-db42-4dec-9445-3e9962172b6a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:45.015157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6a2c4a4-db42-4dec-9445-3e9962172b6a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:45.015676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6a2c4a4-db42-4dec-9445-3e9962172b6a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:45.016395 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6a2c4a4-db42-4dec-9445-3e9962172b6a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:45.017355 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6a2c4a4-db42-4dec-9445-3e9962172b6a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:45.017873 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c6a2c4a4-db42-4dec-9445-3e9962172b6a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:45.158793 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c6a2c4a4-db42-4dec-9445-3e9962172b6a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:45.167560 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c6a2c4a4-db42-4dec-9445-3e9962172b6a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1694 microversion: 2.1 time: 0.165942 Sep 08 14:11:45.167560 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3498/7124] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:44 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1694 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:46.191169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fe71d768-510b-4949-88a9-cb7788064f7b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:46.191830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fe71d768-510b-4949-88a9-cb7788064f7b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:46.199147 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe71d768-510b-4949-88a9-cb7788064f7b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:46.199684 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe71d768-510b-4949-88a9-cb7788064f7b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:46.200142 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe71d768-510b-4949-88a9-cb7788064f7b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:46.200895 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe71d768-510b-4949-88a9-cb7788064f7b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:46.201356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe71d768-510b-4949-88a9-cb7788064f7b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:46.201798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fe71d768-510b-4949-88a9-cb7788064f7b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:46.337706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fe71d768-510b-4949-88a9-cb7788064f7b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:46.346354 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fe71d768-510b-4949-88a9-cb7788064f7b tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1694 microversion: 2.1 time: 0.159729 Sep 08 14:11:46.346960 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3627/7125] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:46 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:47.370226 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-5e9ff584-f29a-4de4-8e75-c99b4fcbd570 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:47.370798 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-5e9ff584-f29a-4de4-8e75-c99b4fcbd570 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:47.377913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e9ff584-f29a-4de4-8e75-c99b4fcbd570 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:47.378410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e9ff584-f29a-4de4-8e75-c99b4fcbd570 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:47.378863 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e9ff584-f29a-4de4-8e75-c99b4fcbd570 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:47.379615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e9ff584-f29a-4de4-8e75-c99b4fcbd570 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:47.380065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e9ff584-f29a-4de4-8e75-c99b4fcbd570 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:47.380504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-5e9ff584-f29a-4de4-8e75-c99b4fcbd570 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:47.517645 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-5e9ff584-f29a-4de4-8e75-c99b4fcbd570 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:47.525626 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-5e9ff584-f29a-4de4-8e75-c99b4fcbd570 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1694 microversion: 2.1 time: 0.159456 Sep 08 14:11:47.526206 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3499/7126] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:47 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1694 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:48.549940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-464d0792-a6a6-4be2-b9ca-a79c09c04ab8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:48.550562 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-464d0792-a6a6-4be2-b9ca-a79c09c04ab8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:48.557663 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-464d0792-a6a6-4be2-b9ca-a79c09c04ab8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:48.558162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-464d0792-a6a6-4be2-b9ca-a79c09c04ab8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:48.558616 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-464d0792-a6a6-4be2-b9ca-a79c09c04ab8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:48.559363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-464d0792-a6a6-4be2-b9ca-a79c09c04ab8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:48.559839 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-464d0792-a6a6-4be2-b9ca-a79c09c04ab8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:48.560277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-464d0792-a6a6-4be2-b9ca-a79c09c04ab8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:48.700472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-464d0792-a6a6-4be2-b9ca-a79c09c04ab8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:48.709167 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-464d0792-a6a6-4be2-b9ca-a79c09c04ab8 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1694 microversion: 2.1 time: 0.163099 Sep 08 14:11:48.709766 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3628/7127] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:48 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1694 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:49.733398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62e17762-f0cc-4ca1-ace8-cf81d00704a4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:49.734197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-62e17762-f0cc-4ca1-ace8-cf81d00704a4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:49.740866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e17762-f0cc-4ca1-ace8-cf81d00704a4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:49.741352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e17762-f0cc-4ca1-ace8-cf81d00704a4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:49.742050 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e17762-f0cc-4ca1-ace8-cf81d00704a4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:49.742800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e17762-f0cc-4ca1-ace8-cf81d00704a4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:49.742994 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e17762-f0cc-4ca1-ace8-cf81d00704a4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:49.743392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62e17762-f0cc-4ca1-ace8-cf81d00704a4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:49.880144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-62e17762-f0cc-4ca1-ace8-cf81d00704a4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:49.888005 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62e17762-f0cc-4ca1-ace8-cf81d00704a4 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1671 microversion: 2.1 time: 0.158918 Sep 08 14:11:49.888586 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3500/7128] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:49 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:50.983603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-df693f50-ddf3-4ae3-92c4-a0e84d3e3823 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:50.986421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-df693f50-ddf3-4ae3-92c4-a0e84d3e3823 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:50.993474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df693f50-ddf3-4ae3-92c4-a0e84d3e3823 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:50.993973 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df693f50-ddf3-4ae3-92c4-a0e84d3e3823 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:50.994426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df693f50-ddf3-4ae3-92c4-a0e84d3e3823 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:50.995130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df693f50-ddf3-4ae3-92c4-a0e84d3e3823 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:50.995626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df693f50-ddf3-4ae3-92c4-a0e84d3e3823 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:50.996064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-df693f50-ddf3-4ae3-92c4-a0e84d3e3823 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:51.048209 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-df693f50-ddf3-4ae3-92c4-a0e84d3e3823 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6/action" status: 200 len: 38433 microversion: 2.1 time: 0.068280 Sep 08 14:11:51.048929 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3629/7129] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:11:50 2022] POST /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6/action => generated 38433 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:11:51.061240 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7da05edb-a6da-40ac-a930-a2d6d1ff25e2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:11:51.068479 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7da05edb-a6da-40ac-a930-a2d6d1ff25e2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:51.069844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7da05edb-a6da-40ac-a930-a2d6d1ff25e2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:51.069844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7da05edb-a6da-40ac-a930-a2d6d1ff25e2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:51.095817 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7da05edb-a6da-40ac-a930-a2d6d1ff25e2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Going to try to start instance {{(pid=128971) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 08 14:11:51.139099 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7da05edb-a6da-40ac-a930-a2d6d1ff25e2 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6/action" status: 202 len: 0 microversion: 2.1 time: 0.081799 Sep 08 14:11:51.139844 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3501/7130] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:11:51 2022] POST /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:11:51.154321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d430be1a-637b-43bc-a122-b9ea7f8850a5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:51.155689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d430be1a-637b-43bc-a122-b9ea7f8850a5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:51.171583 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d430be1a-637b-43bc-a122-b9ea7f8850a5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:51.172322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d430be1a-637b-43bc-a122-b9ea7f8850a5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:51.172956 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d430be1a-637b-43bc-a122-b9ea7f8850a5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:51.173815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d430be1a-637b-43bc-a122-b9ea7f8850a5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:51.174424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d430be1a-637b-43bc-a122-b9ea7f8850a5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:51.174922 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d430be1a-637b-43bc-a122-b9ea7f8850a5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:51.406420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d430be1a-637b-43bc-a122-b9ea7f8850a5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:51.414757 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d430be1a-637b-43bc-a122-b9ea7f8850a5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1680 microversion: 2.1 time: 0.268761 Sep 08 14:11:51.415368 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3630/7131] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:51 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1680 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:11:52.441375 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bda11e77-e181-4e2b-902f-4d4fda18fa79 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:52.442076 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bda11e77-e181-4e2b-902f-4d4fda18fa79 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:52.448377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bda11e77-e181-4e2b-902f-4d4fda18fa79 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:52.448864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bda11e77-e181-4e2b-902f-4d4fda18fa79 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:52.449301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bda11e77-e181-4e2b-902f-4d4fda18fa79 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:52.450003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bda11e77-e181-4e2b-902f-4d4fda18fa79 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:52.450457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bda11e77-e181-4e2b-902f-4d4fda18fa79 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:52.450874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bda11e77-e181-4e2b-902f-4d4fda18fa79 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:52.590428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bda11e77-e181-4e2b-902f-4d4fda18fa79 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:52.599055 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bda11e77-e181-4e2b-902f-4d4fda18fa79 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1680 microversion: 2.1 time: 0.163174 Sep 08 14:11:52.601575 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3502/7132] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:52 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:11:53.625168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a920064e-dcec-477c-9e46-e59bed280551 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:11:53.625803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a920064e-dcec-477c-9e46-e59bed280551 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:11:53.633364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a920064e-dcec-477c-9e46-e59bed280551 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:53.633867 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a920064e-dcec-477c-9e46-e59bed280551 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:53.634321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a920064e-dcec-477c-9e46-e59bed280551 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:53.635036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a920064e-dcec-477c-9e46-e59bed280551 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:11:53.635535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a920064e-dcec-477c-9e46-e59bed280551 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:11:53.635980 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a920064e-dcec-477c-9e46-e59bed280551 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:11:53.779301 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a920064e-dcec-477c-9e46-e59bed280551 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:11:53.787330 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a920064e-dcec-477c-9e46-e59bed280551 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1684 microversion: 2.1 time: 0.166209 Sep 08 14:11:53.787915 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3631/7133] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:11:53 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1684 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:17.984196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2dd7632a-7df5-48b4-90e0-2f4cc3be9dde tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:17.987051 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2dd7632a-7df5-48b4-90e0-2f4cc3be9dde tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:17.990058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=16 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:17.990737 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:17.997917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2dd7632a-7df5-48b4-90e0-2f4cc3be9dde tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:17.998413 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2dd7632a-7df5-48b4-90e0-2f4cc3be9dde tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:17.998856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2dd7632a-7df5-48b4-90e0-2f4cc3be9dde tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:17.999598 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2dd7632a-7df5-48b4-90e0-2f4cc3be9dde tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:18.000060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2dd7632a-7df5-48b4-90e0-2f4cc3be9dde tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:18.000488 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2dd7632a-7df5-48b4-90e0-2f4cc3be9dde tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:18.065215 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2dd7632a-7df5-48b4-90e0-2f4cc3be9dde tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6/action" status: 200 len: 62995 microversion: 2.1 time: 0.084772 Sep 08 14:12:18.066115 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3503/7134] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:12:17 2022] POST /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6/action => generated 62995 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:12:25.491588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-08527031-c8b4-404b-b289-459b872f9508 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:25.492363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-cf90e474-d665-4539-a5f3-d152acf09d14 req-54f8fbaf-43fe-44b3-8c31-ee84238f3bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adba6efc-2b2e-4940-bd57-3dc5e9ea35d6", "tag": "94055785-1b56-43a4-ab19-684116f415af"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:25.493840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-08527031-c8b4-404b-b289-459b872f9508 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:25.500955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=16 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:25.502561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=46 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:25.511814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cf90e474-d665-4539-a5f3-d152acf09d14 req-54f8fbaf-43fe-44b3-8c31-ee84238f3bf0 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:25.513232 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cf90e474-d665-4539-a5f3-d152acf09d14 req-54f8fbaf-43fe-44b3-8c31-ee84238f3bf0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:25.514025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-cf90e474-d665-4539-a5f3-d152acf09d14 req-54f8fbaf-43fe-44b3-8c31-ee84238f3bf0 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:25.514180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08527031-c8b4-404b-b289-459b872f9508 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:25.514879 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08527031-c8b4-404b-b289-459b872f9508 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:25.516318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08527031-c8b4-404b-b289-459b872f9508 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:25.518356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08527031-c8b4-404b-b289-459b872f9508 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:25.519348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08527031-c8b4-404b-b289-459b872f9508 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:25.520243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-08527031-c8b4-404b-b289-459b872f9508 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:25.537368 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-cf90e474-d665-4539-a5f3-d152acf09d14 req-54f8fbaf-43fe-44b3-8c31-ee84238f3bf0 service nova] Creating event network-changed:94055785-1b56-43a4-ab19-684116f415af for instance adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 on n-h2-852084-10 Sep 08 14:12:25.552092 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-cf90e474-d665-4539-a5f3-d152acf09d14 req-54f8fbaf-43fe-44b3-8c31-ee84238f3bf0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064052 Sep 08 14:12:25.553793 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3504/7135] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:12:25.570542 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-08527031-c8b4-404b-b289-459b872f9508 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:12:25.699118 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-08527031-c8b4-404b-b289-459b872f9508 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "DELETE /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 204 len: 0 microversion: 2.1 time: 0.215015 Sep 08 14:12:25.705056 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3632/7136] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 14:12:25 2022] DELETE /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:12:25.714874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3580cbf7-2408-4925-bad6-1c9e880be14a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:25.716070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3580cbf7-2408-4925-bad6-1c9e880be14a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:25.725103 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3580cbf7-2408-4925-bad6-1c9e880be14a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:25.726260 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3580cbf7-2408-4925-bad6-1c9e880be14a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:25.726930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3580cbf7-2408-4925-bad6-1c9e880be14a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:25.727886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3580cbf7-2408-4925-bad6-1c9e880be14a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:25.728591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3580cbf7-2408-4925-bad6-1c9e880be14a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:25.729543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3580cbf7-2408-4925-bad6-1c9e880be14a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:25.910630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3580cbf7-2408-4925-bad6-1c9e880be14a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:25.924633 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3580cbf7-2408-4925-bad6-1c9e880be14a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1690 microversion: 2.1 time: 0.217012 Sep 08 14:12:25.925610 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3505/7137] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:25 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1690 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:26.966967 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-74abfd33-1caa-4245-b10c-ee32123a0df9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:26.967724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-74abfd33-1caa-4245-b10c-ee32123a0df9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:26.974990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74abfd33-1caa-4245-b10c-ee32123a0df9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:26.975524 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74abfd33-1caa-4245-b10c-ee32123a0df9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:26.976082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74abfd33-1caa-4245-b10c-ee32123a0df9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:26.976810 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74abfd33-1caa-4245-b10c-ee32123a0df9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:26.977279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74abfd33-1caa-4245-b10c-ee32123a0df9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:26.977723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74abfd33-1caa-4245-b10c-ee32123a0df9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:27.180445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-74abfd33-1caa-4245-b10c-ee32123a0df9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:27.193865 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-74abfd33-1caa-4245-b10c-ee32123a0df9 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1690 microversion: 2.1 time: 0.234785 Sep 08 14:12:27.194547 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3633/7138] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:26 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1690 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:27.795525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-5a96feb8-0821-420e-b982-1881866c52fa req-15b07f07-88c6-4a7b-9b49-a5d8922b21cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adba6efc-2b2e-4940-bd57-3dc5e9ea35d6", "name": "network-vif-deleted", "tag": "94055785-1b56-43a4-ab19-684116f415af"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:27.813621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5a96feb8-0821-420e-b982-1881866c52fa req-15b07f07-88c6-4a7b-9b49-a5d8922b21cc service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:27.814702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5a96feb8-0821-420e-b982-1881866c52fa req-15b07f07-88c6-4a7b-9b49-a5d8922b21cc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:27.815540 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5a96feb8-0821-420e-b982-1881866c52fa req-15b07f07-88c6-4a7b-9b49-a5d8922b21cc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:27.840586 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-5a96feb8-0821-420e-b982-1881866c52fa req-15b07f07-88c6-4a7b-9b49-a5d8922b21cc service nova] Creating event network-vif-deleted:94055785-1b56-43a4-ab19-684116f415af for instance adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 on n-h2-852084-10 Sep 08 14:12:27.850967 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-5a96feb8-0821-420e-b982-1881866c52fa req-15b07f07-88c6-4a7b-9b49-a5d8922b21cc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059295 Sep 08 14:12:27.853314 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3506/7139] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:28.220360 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:28.221289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:28.234871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:28.235443 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:28.235906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:28.236656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:28.237130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:28.237686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:28.290422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:28.291279 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:28.292033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:28.292787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lazy-loading 'fault' on Instance uuid adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:12:28.358820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:28.370342 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-732c437a-9eda-4861-bab9-93605b94a7fe tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 200 len: 1357 microversion: 2.1 time: 0.154181 Sep 08 14:12:28.371003 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3634/7140] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:28 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:29.409033 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6821a087-47dc-47a4-a188-2b7f74f24a36 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:29.409742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6821a087-47dc-47a4-a188-2b7f74f24a36 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: adba6efc-2b2e-4940-bd57-3dc5e9ea35d6] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:29.417502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6821a087-47dc-47a4-a188-2b7f74f24a36 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:29.417991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6821a087-47dc-47a4-a188-2b7f74f24a36 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:29.418427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6821a087-47dc-47a4-a188-2b7f74f24a36 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:29.419165 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6821a087-47dc-47a4-a188-2b7f74f24a36 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:29.419642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6821a087-47dc-47a4-a188-2b7f74f24a36 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:29.420066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6821a087-47dc-47a4-a188-2b7f74f24a36 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:29.440800 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-6821a087-47dc-47a4-a188-2b7f74f24a36 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] HTTP exception thrown: Instance adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 could not be found. Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6821a087-47dc-47a4-a188-2b7f74f24a36 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Request method failure captured: Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 HTTP/1.1 Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfa8rEsclKqB3fGtEoDqf7MMBfOXuK9c8rBoj1w1ZQCY0tDJN3D51PNiQQ5SM8QjooN6eu0hg2opbsQtSReY76kx7kqXGXOA1lWnEjSaSiSz2NklHX-m5XIynq2v07KieXN2ZMFKPTiMgnRrAcFsfQt87Z0aVZMdxADsYgFfKmfBKOU Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0dc08700af5b40cc911c75f91b2b0f7a Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0dc08700af5b40cc911c75f91b2b0f7a Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestNetworkAdvancedServerOps-1112243692-project Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 16e1a1b184b04cbfb940462f00a39f88 Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1112243692-project Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 could not be found. Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'adba6efc-2b2e-4940-bd57-3dc5e9ea35d6'} Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 could not be found. Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 could not be found. Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:12:29.442554 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:12:29.449591 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:12:29.449591 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:12:29.449591 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:12:29.449591 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:12:29.449591 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:12:29.449591 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:12:29.449591 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 could not be found. Sep 08 14:12:29.449591 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:12:29.449591 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6821a087-47dc-47a4-a188-2b7f74f24a36 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Returning 404 to user: Instance adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:12:29.449591 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6821a087-47dc-47a4-a188-2b7f74f24a36 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6" status: 404 len: 111 microversion: 2.1 time: 0.039421 Sep 08 14:12:29.449591 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3507/7141] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:29 2022] GET /compute/v2.1/servers/adba6efc-2b2e-4940-bd57-3dc5e9ea35d6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:12:33.322780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-615bb703-05bd-47e3-a991-50cf8be79fd5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '.version_select at 0x7fdb35a37700>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:33.362370 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-615bb703-05bd-47e3-a991-50cf8be79fd5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1316093335" status: 202 len: 0 microversion: 2.1 time: 0.047982 Sep 08 14:12:33.369860 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3635/7142] 10.222.0.78 () {58 vars in 1284 bytes} [Thu Sep 8 14:12:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1316093335 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:12:33.412026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-36bf4756-a2b8-45cb-ac48-f4cd45639bf5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'create', calling method: .version_select at 0x7fdb3f124820>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1749400815", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGx0q3NCyf6++55QOqFeu5HTdmBLA8cA0PhUbrDLzcMLtILUgAVSDLs7BwFVBResogqxuTufe7VG/6qv1MaN0JmA75SrxSXO3J8i/KtkemJ6BSRaJvfA8ywTKzqAqUKh9Q=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:33.439360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-36bf4756-a2b8-45cb-ac48-f4cd45639bf5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:12:33.450630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-36bf4756-a2b8-45cb-ac48-f4cd45639bf5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for user 16e1a1b184b04cbfb940462f00a39f88 and project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:12:33.494859 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-36bf4756-a2b8-45cb-ac48-f4cd45639bf5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.086457 Sep 08 14:12:33.496585 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3508/7143] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 14:12:33 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:41.561862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-962716189", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "networks": [{"uuid": "9b2d50b1-2497-4275-aba0-3b06d116dd40"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1749400815", "security_groups": [{"name": "tempest-secgroup-smoke-1779341744"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:41.583345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:41.730449 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] validate_networks() for [('9b2d50b1-2497-4275-aba0-3b06d116dd40', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:12:42.501633 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:12:42.502323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:12:42.503000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:12:42.503690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:12:42.504448 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:12:42.515513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:42.516036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:42.516502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:42.517277 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:42.517752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:42.518609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:42.540238 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:12:42.547033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Getting quotas for user 16e1a1b184b04cbfb940462f00a39f88 and project 0dc08700af5b40cc911c75f91b2b0f7a. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:12:42.564534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:12:42.567556 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:12:42.619821 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0d52b2ef-4d1f-4d8c-b232-c7b9ed5f829d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.062241 Sep 08 14:12:42.620692 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3636/7144] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 14:12:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:12:42.631148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=16 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:42.636336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-20dd6943-edb1-43ce-84e8-92b66759e94d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:42.637220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-20dd6943-edb1-43ce-84e8-92b66759e94d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:42.710063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-20dd6943-edb1-43ce-84e8-92b66759e94d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:42.723780 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-20dd6943-edb1-43ce-84e8-92b66759e94d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1266 microversion: 2.1 time: 0.094334 Sep 08 14:12:42.724948 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3509/7145] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:42 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:43.754482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-10ef68ce-f1cc-4d49-afe7-e977af906372 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:43.756751 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-10ef68ce-f1cc-4d49-afe7-e977af906372 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:43.877180 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-10ef68ce-f1cc-4d49-afe7-e977af906372 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:43.896146 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-10ef68ce-f1cc-4d49-afe7-e977af906372 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1266 microversion: 2.1 time: 0.149485 Sep 08 14:12:43.904041 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3637/7146] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:43 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:44.935842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-43b47dc4-84e0-4e89-b754-1085b0b8aa00 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:44.937340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-43b47dc4-84e0-4e89-b754-1085b0b8aa00 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:45.019351 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-43b47dc4-84e0-4e89-b754-1085b0b8aa00 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:45.028294 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-43b47dc4-84e0-4e89-b754-1085b0b8aa00 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1266 microversion: 2.1 time: 0.098192 Sep 08 14:12:45.028805 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3510/7147] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:44 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:46.053824 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ede2a6c7-7d14-44a5-8b49-799c3d335db6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:46.054669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ede2a6c7-7d14-44a5-8b49-799c3d335db6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:46.134838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ede2a6c7-7d14-44a5-8b49-799c3d335db6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:46.143093 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ede2a6c7-7d14-44a5-8b49-799c3d335db6 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1266 microversion: 2.1 time: 0.093956 Sep 08 14:12:46.143750 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3638/7148] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:46 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:47.168504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3dd931c0-4317-470e-93d9-ef111398fdfa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:47.169123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3dd931c0-4317-470e-93d9-ef111398fdfa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:47.176795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dd931c0-4317-470e-93d9-ef111398fdfa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:47.177296 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dd931c0-4317-470e-93d9-ef111398fdfa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:47.177740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dd931c0-4317-470e-93d9-ef111398fdfa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:47.178462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dd931c0-4317-470e-93d9-ef111398fdfa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:47.178924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dd931c0-4317-470e-93d9-ef111398fdfa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:47.179393 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3dd931c0-4317-470e-93d9-ef111398fdfa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:47.245576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3dd931c0-4317-470e-93d9-ef111398fdfa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:47.253582 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3dd931c0-4317-470e-93d9-ef111398fdfa tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1270 microversion: 2.1 time: 0.090078 Sep 08 14:12:47.254179 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3511/7149] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:47 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:48.280399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3b8fea3f-4e7b-4334-b9dd-c804f4653ca5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:48.281125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3b8fea3f-4e7b-4334-b9dd-c804f4653ca5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:48.288854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b8fea3f-4e7b-4334-b9dd-c804f4653ca5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:48.289364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b8fea3f-4e7b-4334-b9dd-c804f4653ca5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:48.289826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b8fea3f-4e7b-4334-b9dd-c804f4653ca5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:48.290554 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b8fea3f-4e7b-4334-b9dd-c804f4653ca5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:48.291029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b8fea3f-4e7b-4334-b9dd-c804f4653ca5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:48.291507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3b8fea3f-4e7b-4334-b9dd-c804f4653ca5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:48.361472 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3b8fea3f-4e7b-4334-b9dd-c804f4653ca5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:48.370054 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3b8fea3f-4e7b-4334-b9dd-c804f4653ca5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1324 microversion: 2.1 time: 0.095038 Sep 08 14:12:48.370938 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3639/7150] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:48 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1324 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:49.394917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-76aab7de-3278-4504-a5bf-8b558bfed0fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:49.395634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-76aab7de-3278-4504-a5bf-8b558bfed0fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:49.397851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:49.406129 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76aab7de-3278-4504-a5bf-8b558bfed0fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:49.406813 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76aab7de-3278-4504-a5bf-8b558bfed0fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:49.407861 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76aab7de-3278-4504-a5bf-8b558bfed0fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:49.408708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76aab7de-3278-4504-a5bf-8b558bfed0fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:49.409765 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76aab7de-3278-4504-a5bf-8b558bfed0fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:49.410322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-76aab7de-3278-4504-a5bf-8b558bfed0fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:49.564923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-76aab7de-3278-4504-a5bf-8b558bfed0fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:49.569645 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-202eb7ed-0837-4808-8b50-40e23de1f217 req-4d4d973e-7bf4-492a-ad78-0f96dafe27b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d40597-9b46-442c-9d35-0359b8108e41", "tag": "2a87454f-af0e-46eb-b9a7-4265a075230c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:49.573870 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-76aab7de-3278-4504-a5bf-8b558bfed0fb tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1392 microversion: 2.1 time: 0.182716 Sep 08 14:12:49.587815 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3512/7151] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:49 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1392 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:12:49.594768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-202eb7ed-0837-4808-8b50-40e23de1f217 req-4d4d973e-7bf4-492a-ad78-0f96dafe27b1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:49.595282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-202eb7ed-0837-4808-8b50-40e23de1f217 req-4d4d973e-7bf4-492a-ad78-0f96dafe27b1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:49.595906 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-202eb7ed-0837-4808-8b50-40e23de1f217 req-4d4d973e-7bf4-492a-ad78-0f96dafe27b1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:49.609525 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-202eb7ed-0837-4808-8b50-40e23de1f217 req-4d4d973e-7bf4-492a-ad78-0f96dafe27b1 service nova] Creating event network-changed:2a87454f-af0e-46eb-b9a7-4265a075230c for instance 11d40597-9b46-442c-9d35-0359b8108e41 on n-h2-852084-10 Sep 08 14:12:49.614990 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-202eb7ed-0837-4808-8b50-40e23de1f217 req-4d4d973e-7bf4-492a-ad78-0f96dafe27b1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053800 Sep 08 14:12:49.615656 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3640/7152] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:50.598560 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-45d64888-5f0d-4b7c-a793-d97ea36e378f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:50.599687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-45d64888-5f0d-4b7c-a793-d97ea36e378f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:50.606841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45d64888-5f0d-4b7c-a793-d97ea36e378f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:50.607374 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45d64888-5f0d-4b7c-a793-d97ea36e378f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:50.608436 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45d64888-5f0d-4b7c-a793-d97ea36e378f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:50.609158 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45d64888-5f0d-4b7c-a793-d97ea36e378f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:50.609624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45d64888-5f0d-4b7c-a793-d97ea36e378f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:50.610058 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-45d64888-5f0d-4b7c-a793-d97ea36e378f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:50.742258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-45d64888-5f0d-4b7c-a793-d97ea36e378f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:50.750104 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-45d64888-5f0d-4b7c-a793-d97ea36e378f tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1392 microversion: 2.1 time: 0.155470 Sep 08 14:12:50.750682 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3513/7153] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:50 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:51.773829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e31ef633-379f-4452-9470-f624518e4d1a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:51.774605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e31ef633-379f-4452-9470-f624518e4d1a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:51.782478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e31ef633-379f-4452-9470-f624518e4d1a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:51.782988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e31ef633-379f-4452-9470-f624518e4d1a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:51.783482 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e31ef633-379f-4452-9470-f624518e4d1a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:51.784201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e31ef633-379f-4452-9470-f624518e4d1a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:51.784712 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e31ef633-379f-4452-9470-f624518e4d1a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:51.785157 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e31ef633-379f-4452-9470-f624518e4d1a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:51.923076 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e31ef633-379f-4452-9470-f624518e4d1a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:51.931064 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e31ef633-379f-4452-9470-f624518e4d1a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1392 microversion: 2.1 time: 0.162489 Sep 08 14:12:51.931725 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3641/7154] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:51 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:52.957429 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-09fed805-699f-404f-9453-2840f5f84fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:52.958030 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-09fed805-699f-404f-9453-2840f5f84fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:52.965114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09fed805-699f-404f-9453-2840f5f84fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:52.965612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09fed805-699f-404f-9453-2840f5f84fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:52.966045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09fed805-699f-404f-9453-2840f5f84fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:52.966743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09fed805-699f-404f-9453-2840f5f84fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:52.967886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09fed805-699f-404f-9453-2840f5f84fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:52.968312 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-09fed805-699f-404f-9453-2840f5f84fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:53.115954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-09fed805-699f-404f-9453-2840f5f84fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:53.124754 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-09fed805-699f-404f-9453-2840f5f84fa1 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1392 microversion: 2.1 time: 0.171213 Sep 08 14:12:53.125352 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3514/7155] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:52 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1392 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:54.147812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2b0a6fe6-4fbf-49b5-8d1c-f1c037344d76 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:54.148447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2b0a6fe6-4fbf-49b5-8d1c-f1c037344d76 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:54.150393 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:54.157386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b0a6fe6-4fbf-49b5-8d1c-f1c037344d76 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:54.157883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b0a6fe6-4fbf-49b5-8d1c-f1c037344d76 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:54.158334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b0a6fe6-4fbf-49b5-8d1c-f1c037344d76 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:54.159035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b0a6fe6-4fbf-49b5-8d1c-f1c037344d76 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:54.159540 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b0a6fe6-4fbf-49b5-8d1c-f1c037344d76 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:54.159977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2b0a6fe6-4fbf-49b5-8d1c-f1c037344d76 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:54.304962 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2b0a6fe6-4fbf-49b5-8d1c-f1c037344d76 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:54.313844 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2b0a6fe6-4fbf-49b5-8d1c-f1c037344d76 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1392 microversion: 2.1 time: 0.169770 Sep 08 14:12:54.314469 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3642/7156] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:54 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:54.421547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-1f96cb2a-2f1b-4ce9-a05e-126776878e31 req-d4a96367-e049-4c84-ad99-63bcd2a7403b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d40597-9b46-442c-9d35-0359b8108e41", "name": "network-vif-plugged", "status": "completed", "tag": "2a87454f-af0e-46eb-b9a7-4265a075230c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:54.433105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1f96cb2a-2f1b-4ce9-a05e-126776878e31 req-d4a96367-e049-4c84-ad99-63bcd2a7403b service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:54.433580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1f96cb2a-2f1b-4ce9-a05e-126776878e31 req-d4a96367-e049-4c84-ad99-63bcd2a7403b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:54.434026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-1f96cb2a-2f1b-4ce9-a05e-126776878e31 req-d4a96367-e049-4c84-ad99-63bcd2a7403b service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:54.447191 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-1f96cb2a-2f1b-4ce9-a05e-126776878e31 req-d4a96367-e049-4c84-ad99-63bcd2a7403b service nova] Creating event network-vif-plugged:2a87454f-af0e-46eb-b9a7-4265a075230c for instance 11d40597-9b46-442c-9d35-0359b8108e41 on n-h2-852084-10 Sep 08 14:12:54.453296 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-1f96cb2a-2f1b-4ce9-a05e-126776878e31 req-d4a96367-e049-4c84-ad99-63bcd2a7403b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035266 Sep 08 14:12:54.453620 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3515/7157] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:12:55.338846 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-7be6b979-bc2c-434e-826c-73e39835548e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:55.339437 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-7be6b979-bc2c-434e-826c-73e39835548e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:55.346361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7be6b979-bc2c-434e-826c-73e39835548e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:55.346870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7be6b979-bc2c-434e-826c-73e39835548e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:55.347397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7be6b979-bc2c-434e-826c-73e39835548e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:55.348080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7be6b979-bc2c-434e-826c-73e39835548e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:55.348553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7be6b979-bc2c-434e-826c-73e39835548e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:55.348997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-7be6b979-bc2c-434e-826c-73e39835548e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:55.494359 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-7be6b979-bc2c-434e-826c-73e39835548e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:55.503259 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-7be6b979-bc2c-434e-826c-73e39835548e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1392 microversion: 2.1 time: 0.168395 Sep 08 14:12:55.503884 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3643/7158] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:55 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:56.523494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:56.528981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4e31b4c3-868b-44cc-8225-653dadb0e0db tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:56.530683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4e31b4c3-868b-44cc-8225-653dadb0e0db tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:56.537480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e31b4c3-868b-44cc-8225-653dadb0e0db tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:56.537972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e31b4c3-868b-44cc-8225-653dadb0e0db tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:56.538417 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e31b4c3-868b-44cc-8225-653dadb0e0db tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:56.539123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e31b4c3-868b-44cc-8225-653dadb0e0db tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:56.539614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e31b4c3-868b-44cc-8225-653dadb0e0db tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:56.540042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4e31b4c3-868b-44cc-8225-653dadb0e0db tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:56.684502 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4e31b4c3-868b-44cc-8225-653dadb0e0db tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:56.693065 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4e31b4c3-868b-44cc-8225-653dadb0e0db tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1565 microversion: 2.1 time: 0.170655 Sep 08 14:12:56.693663 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3516/7159] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:56 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:56.716687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f2bca070-184a-4fa8-82e5-7d2aead7ca2a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:56.717860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f2bca070-184a-4fa8-82e5-7d2aead7ca2a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:56.719772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=10 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:56.721356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:12:56.727184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2bca070-184a-4fa8-82e5-7d2aead7ca2a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:56.727719 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2bca070-184a-4fa8-82e5-7d2aead7ca2a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:56.728173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2bca070-184a-4fa8-82e5-7d2aead7ca2a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:56.728889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2bca070-184a-4fa8-82e5-7d2aead7ca2a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:56.729363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2bca070-184a-4fa8-82e5-7d2aead7ca2a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:56.729808 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f2bca070-184a-4fa8-82e5-7d2aead7ca2a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:56.867868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-f2bca070-184a-4fa8-82e5-7d2aead7ca2a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:56.876747 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f2bca070-184a-4fa8-82e5-7d2aead7ca2a tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1565 microversion: 2.1 time: 0.163898 Sep 08 14:12:56.877350 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3644/7160] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:56 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1565 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:12:58.846300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-38e939e4-91d3-4c79-8318-c4b1981318ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:12:58.847017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-38e939e4-91d3-4c79-8318-c4b1981318ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:12:58.848969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-201791c8-3234-477a-8e4d-8f0db3ce715c req-1f4f275d-5d84-4cb5-874e-74eff42d024a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d40597-9b46-442c-9d35-0359b8108e41", "tag": "2a87454f-af0e-46eb-b9a7-4265a075230c"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:12:58.854943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38e939e4-91d3-4c79-8318-c4b1981318ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:58.855981 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38e939e4-91d3-4c79-8318-c4b1981318ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:58.856675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38e939e4-91d3-4c79-8318-c4b1981318ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:58.857512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38e939e4-91d3-4c79-8318-c4b1981318ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:58.858116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38e939e4-91d3-4c79-8318-c4b1981318ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:58.858655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-38e939e4-91d3-4c79-8318-c4b1981318ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:58.863085 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-201791c8-3234-477a-8e4d-8f0db3ce715c req-1f4f275d-5d84-4cb5-874e-74eff42d024a service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:12:58.863898 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-201791c8-3234-477a-8e4d-8f0db3ce715c req-1f4f275d-5d84-4cb5-874e-74eff42d024a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:12:58.864322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-201791c8-3234-477a-8e4d-8f0db3ce715c req-1f4f275d-5d84-4cb5-874e-74eff42d024a service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:12:58.881699 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-201791c8-3234-477a-8e4d-8f0db3ce715c req-1f4f275d-5d84-4cb5-874e-74eff42d024a service nova] Creating event network-changed:2a87454f-af0e-46eb-b9a7-4265a075230c for instance 11d40597-9b46-442c-9d35-0359b8108e41 on n-h2-852084-10 Sep 08 14:12:58.890061 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-201791c8-3234-477a-8e4d-8f0db3ce715c req-1f4f275d-5d84-4cb5-874e-74eff42d024a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044266 Sep 08 14:12:58.890915 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3645/7161] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:12:59.083512 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-38e939e4-91d3-4c79-8318-c4b1981318ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:12:59.108507 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-38e939e4-91d3-4c79-8318-c4b1981318ce tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1565 microversion: 2.1 time: 0.265472 Sep 08 14:12:59.110291 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3517/7162] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:12:58 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1565 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:20.396100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:20.396869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=36 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:20.401458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-f0d12d77-b936-43b3-91c0-c5a9adb97e3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:20.404470 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-f0d12d77-b936-43b3-91c0-c5a9adb97e3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:20.411551 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0d12d77-b936-43b3-91c0-c5a9adb97e3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:20.412094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0d12d77-b936-43b3-91c0-c5a9adb97e3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:20.412590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0d12d77-b936-43b3-91c0-c5a9adb97e3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:20.413348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0d12d77-b936-43b3-91c0-c5a9adb97e3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:20.413896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0d12d77-b936-43b3-91c0-c5a9adb97e3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:20.414332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-f0d12d77-b936-43b3-91c0-c5a9adb97e3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:20.473240 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-f0d12d77-b936-43b3-91c0-c5a9adb97e3d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41/action" status: 200 len: 24574 microversion: 2.1 time: 0.078946 Sep 08 14:13:20.473905 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3646/7163] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:13:20 2022] POST /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41/action => generated 24574 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:13:31.536806 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d691806f-5d51-4528-94be-b4b4c8c56020 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:31.537389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d691806f-5d51-4528-94be-b4b4c8c56020 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:31.539656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=11 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:31.540414 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=38 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:31.546802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d691806f-5d51-4528-94be-b4b4c8c56020 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:31.547261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d691806f-5d51-4528-94be-b4b4c8c56020 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:31.547709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d691806f-5d51-4528-94be-b4b4c8c56020 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:31.548611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d691806f-5d51-4528-94be-b4b4c8c56020 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:31.549220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d691806f-5d51-4528-94be-b4b4c8c56020 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:31.549656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d691806f-5d51-4528-94be-b4b4c8c56020 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:31.573045 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-d691806f-5d51-4528-94be-b4b4c8c56020 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lazy-loading 'flavor' on Instance uuid 11d40597-9b46-442c-9d35-0359b8108e41 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:13:31.647188 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d691806f-5d51-4528-94be-b4b4c8c56020 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41/action" status: 202 len: 0 microversion: 2.1 time: 0.114761 Sep 08 14:13:31.647870 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3518/7164] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:13:31 2022] POST /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:13:31.659668 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ac8dd8d0-c0a5-44b0-acb5-b5c3364b1d8e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:31.661736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ac8dd8d0-c0a5-44b0-acb5-b5c3364b1d8e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:31.666640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:31.667394 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:31.675033 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac8dd8d0-c0a5-44b0-acb5-b5c3364b1d8e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:31.675848 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac8dd8d0-c0a5-44b0-acb5-b5c3364b1d8e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:31.676307 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac8dd8d0-c0a5-44b0-acb5-b5c3364b1d8e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:31.677253 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac8dd8d0-c0a5-44b0-acb5-b5c3364b1d8e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:31.677730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac8dd8d0-c0a5-44b0-acb5-b5c3364b1d8e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:31.678174 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ac8dd8d0-c0a5-44b0-acb5-b5c3364b1d8e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:31.924950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ac8dd8d0-c0a5-44b0-acb5-b5c3364b1d8e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:31.933437 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ac8dd8d0-c0a5-44b0-acb5-b5c3364b1d8e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1692 microversion: 2.1 time: 0.279124 Sep 08 14:13:31.934494 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3647/7165] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:31 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1692 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:32.961222 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c5ea2de0-94eb-42f6-9491-f4e606406931 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:32.961927 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c5ea2de0-94eb-42f6-9491-f4e606406931 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:32.970425 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5ea2de0-94eb-42f6-9491-f4e606406931 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:32.970921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5ea2de0-94eb-42f6-9491-f4e606406931 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:32.971392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5ea2de0-94eb-42f6-9491-f4e606406931 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:32.972360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5ea2de0-94eb-42f6-9491-f4e606406931 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:32.972823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5ea2de0-94eb-42f6-9491-f4e606406931 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:32.973254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c5ea2de0-94eb-42f6-9491-f4e606406931 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:33.118250 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c5ea2de0-94eb-42f6-9491-f4e606406931 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:33.126561 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c5ea2de0-94eb-42f6-9491-f4e606406931 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1675 microversion: 2.1 time: 0.169575 Sep 08 14:13:33.127161 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3519/7166] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:32 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:34.229372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d5694de0-6726-476d-8b40-8adc4de75cfc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:34.232604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d5694de0-6726-476d-8b40-8adc4de75cfc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:34.242204 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5694de0-6726-476d-8b40-8adc4de75cfc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:34.243088 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5694de0-6726-476d-8b40-8adc4de75cfc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:34.243923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5694de0-6726-476d-8b40-8adc4de75cfc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:34.245187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5694de0-6726-476d-8b40-8adc4de75cfc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:34.246016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5694de0-6726-476d-8b40-8adc4de75cfc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:34.246859 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-d5694de0-6726-476d-8b40-8adc4de75cfc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:34.303479 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d5694de0-6726-476d-8b40-8adc4de75cfc tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41/action" status: 200 len: 38422 microversion: 2.1 time: 0.078846 Sep 08 14:13:34.304427 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3648/7167] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:13:34 2022] POST /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41/action => generated 38422 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:13:34.317378 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-01570428-7058-4ad7-9dd3-c67385e9bc02 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:34.318004 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-01570428-7058-4ad7-9dd3-c67385e9bc02 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:34.325428 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01570428-7058-4ad7-9dd3-c67385e9bc02 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:34.325928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01570428-7058-4ad7-9dd3-c67385e9bc02 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:34.326372 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01570428-7058-4ad7-9dd3-c67385e9bc02 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:34.327081 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01570428-7058-4ad7-9dd3-c67385e9bc02 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:34.327578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01570428-7058-4ad7-9dd3-c67385e9bc02 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:34.328011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-01570428-7058-4ad7-9dd3-c67385e9bc02 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:34.406313 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-01570428-7058-4ad7-9dd3-c67385e9bc02 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41/action" status: 202 len: 0 microversion: 2.1 time: 0.093091 Sep 08 14:13:34.410230 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3520/7168] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:13:34 2022] POST /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:13:34.416330 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0174c3a5-0fd2-4b30-9969-28721894b9b5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:34.417334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0174c3a5-0fd2-4b30-9969-28721894b9b5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:34.425045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0174c3a5-0fd2-4b30-9969-28721894b9b5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:34.425584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0174c3a5-0fd2-4b30-9969-28721894b9b5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:34.426019 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0174c3a5-0fd2-4b30-9969-28721894b9b5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:34.426716 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0174c3a5-0fd2-4b30-9969-28721894b9b5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:34.427196 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0174c3a5-0fd2-4b30-9969-28721894b9b5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:34.427662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0174c3a5-0fd2-4b30-9969-28721894b9b5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:34.575415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0174c3a5-0fd2-4b30-9969-28721894b9b5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:34.583682 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0174c3a5-0fd2-4b30-9969-28721894b9b5 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1681 microversion: 2.1 time: 0.171739 Sep 08 14:13:34.584364 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3649/7169] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:34 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:35.610274 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c16678cf-20c8-4b70-a838-2dc2e8fcda5d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:35.611017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c16678cf-20c8-4b70-a838-2dc2e8fcda5d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:35.617410 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c16678cf-20c8-4b70-a838-2dc2e8fcda5d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:35.617906 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c16678cf-20c8-4b70-a838-2dc2e8fcda5d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:35.618347 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c16678cf-20c8-4b70-a838-2dc2e8fcda5d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:35.619048 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c16678cf-20c8-4b70-a838-2dc2e8fcda5d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:35.619534 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c16678cf-20c8-4b70-a838-2dc2e8fcda5d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:35.619967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c16678cf-20c8-4b70-a838-2dc2e8fcda5d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:35.768434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c16678cf-20c8-4b70-a838-2dc2e8fcda5d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:35.776971 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c16678cf-20c8-4b70-a838-2dc2e8fcda5d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1681 microversion: 2.1 time: 0.172518 Sep 08 14:13:35.778368 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3521/7170] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:35 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:36.802190 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5540a5e7-699b-4b0e-abd6-02916abd7375 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:36.802920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5540a5e7-699b-4b0e-abd6-02916abd7375 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:36.811983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5540a5e7-699b-4b0e-abd6-02916abd7375 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:36.812492 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5540a5e7-699b-4b0e-abd6-02916abd7375 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:36.812953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5540a5e7-699b-4b0e-abd6-02916abd7375 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:36.813669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5540a5e7-699b-4b0e-abd6-02916abd7375 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:36.814144 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5540a5e7-699b-4b0e-abd6-02916abd7375 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:36.814589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5540a5e7-699b-4b0e-abd6-02916abd7375 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:36.953713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5540a5e7-699b-4b0e-abd6-02916abd7375 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:36.962100 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5540a5e7-699b-4b0e-abd6-02916abd7375 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1684 microversion: 2.1 time: 0.163969 Sep 08 14:13:36.962695 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3650/7171] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:36 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:37.066609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-cc0a2f40-de1f-4a07-a3a0-6e8037c41694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:37.068871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-cc0a2f40-de1f-4a07-a3a0-6e8037c41694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:37.075740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc0a2f40-de1f-4a07-a3a0-6e8037c41694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:37.076219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc0a2f40-de1f-4a07-a3a0-6e8037c41694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:37.076657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc0a2f40-de1f-4a07-a3a0-6e8037c41694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:37.077344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc0a2f40-de1f-4a07-a3a0-6e8037c41694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:37.077802 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc0a2f40-de1f-4a07-a3a0-6e8037c41694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:37.078224 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-cc0a2f40-de1f-4a07-a3a0-6e8037c41694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:37.124070 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-cc0a2f40-de1f-4a07-a3a0-6e8037c41694 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "POST /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41/action" status: 200 len: 38422 microversion: 2.1 time: 0.061251 Sep 08 14:13:37.124750 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3522/7172] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:13:37 2022] POST /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41/action => generated 38422 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 08 14:13:38.139421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a37b0995-8af6-456e-90bd-0edf45b2bb7e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:38.140536 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a37b0995-8af6-456e-90bd-0edf45b2bb7e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:38.144974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-5f2bfbed-4420-41ab-b101-c3cba587a146 req-9d3944ce-8abe-4dbb-92f0-8e4d143de2c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11d40597-9b46-442c-9d35-0359b8108e41", "tag": "2a87454f-af0e-46eb-b9a7-4265a075230c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:38.148787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a37b0995-8af6-456e-90bd-0edf45b2bb7e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:38.149970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a37b0995-8af6-456e-90bd-0edf45b2bb7e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:38.149970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a37b0995-8af6-456e-90bd-0edf45b2bb7e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:38.150605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a37b0995-8af6-456e-90bd-0edf45b2bb7e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:38.151595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a37b0995-8af6-456e-90bd-0edf45b2bb7e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:38.153061 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a37b0995-8af6-456e-90bd-0edf45b2bb7e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:38.157211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5f2bfbed-4420-41ab-b101-c3cba587a146 req-9d3944ce-8abe-4dbb-92f0-8e4d143de2c2 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:38.157686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5f2bfbed-4420-41ab-b101-c3cba587a146 req-9d3944ce-8abe-4dbb-92f0-8e4d143de2c2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:38.158349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5f2bfbed-4420-41ab-b101-c3cba587a146 req-9d3944ce-8abe-4dbb-92f0-8e4d143de2c2 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:38.171164 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-5f2bfbed-4420-41ab-b101-c3cba587a146 req-9d3944ce-8abe-4dbb-92f0-8e4d143de2c2 service nova] Creating event network-changed:2a87454f-af0e-46eb-b9a7-4265a075230c for instance 11d40597-9b46-442c-9d35-0359b8108e41 on n-h2-852084-10 Sep 08 14:13:38.176313 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-5f2bfbed-4420-41ab-b101-c3cba587a146 req-9d3944ce-8abe-4dbb-92f0-8e4d143de2c2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037026 Sep 08 14:13:38.177264 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3523/7173] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:13:38.184280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a37b0995-8af6-456e-90bd-0edf45b2bb7e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:13:38.275832 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a37b0995-8af6-456e-90bd-0edf45b2bb7e tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "DELETE /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 204 len: 0 microversion: 2.1 time: 0.140561 Sep 08 14:13:38.276770 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3651/7174] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 14:13:38 2022] DELETE /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:13:38.291134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9090e3cc-639b-4eb8-ae24-9b10213ab22d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:38.292118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9090e3cc-639b-4eb8-ae24-9b10213ab22d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:38.299391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9090e3cc-639b-4eb8-ae24-9b10213ab22d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:38.299864 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9090e3cc-639b-4eb8-ae24-9b10213ab22d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:38.300440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9090e3cc-639b-4eb8-ae24-9b10213ab22d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:38.301211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9090e3cc-639b-4eb8-ae24-9b10213ab22d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:38.301900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9090e3cc-639b-4eb8-ae24-9b10213ab22d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:38.302398 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9090e3cc-639b-4eb8-ae24-9b10213ab22d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:38.458834 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9090e3cc-639b-4eb8-ae24-9b10213ab22d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:38.467529 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9090e3cc-639b-4eb8-ae24-9b10213ab22d tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1690 microversion: 2.1 time: 0.181911 Sep 08 14:13:38.468148 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3524/7175] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:38 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:39.492637 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-cf758b86-8c2e-4359-abfb-c96a8cf3583c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:39.493361 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-cf758b86-8c2e-4359-abfb-c96a8cf3583c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:39.500786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf758b86-8c2e-4359-abfb-c96a8cf3583c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:39.501287 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf758b86-8c2e-4359-abfb-c96a8cf3583c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:39.501739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf758b86-8c2e-4359-abfb-c96a8cf3583c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:39.502446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf758b86-8c2e-4359-abfb-c96a8cf3583c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:39.502910 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf758b86-8c2e-4359-abfb-c96a8cf3583c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:39.503420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-cf758b86-8c2e-4359-abfb-c96a8cf3583c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:39.648647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-cf758b86-8c2e-4359-abfb-c96a8cf3583c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:39.658082 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-cf758b86-8c2e-4359-abfb-c96a8cf3583c tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1690 microversion: 2.1 time: 0.169656 Sep 08 14:13:39.658770 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3652/7176] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:39 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:40.374865 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-6a5af51d-f854-4daf-adb4-495752ded3db req-adf4ec15-d460-4f82-8dab-781e77afadbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11d40597-9b46-442c-9d35-0359b8108e41", "name": "network-vif-deleted", "tag": "2a87454f-af0e-46eb-b9a7-4265a075230c"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:40.387437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6a5af51d-f854-4daf-adb4-495752ded3db req-adf4ec15-d460-4f82-8dab-781e77afadbc service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:40.387971 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6a5af51d-f854-4daf-adb4-495752ded3db req-adf4ec15-d460-4f82-8dab-781e77afadbc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:40.388434 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6a5af51d-f854-4daf-adb4-495752ded3db req-adf4ec15-d460-4f82-8dab-781e77afadbc service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:40.404219 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-6a5af51d-f854-4daf-adb4-495752ded3db req-adf4ec15-d460-4f82-8dab-781e77afadbc service nova] Creating event network-vif-deleted:2a87454f-af0e-46eb-b9a7-4265a075230c for instance 11d40597-9b46-442c-9d35-0359b8108e41 on n-h2-852084-10 Sep 08 14:13:40.409944 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-6a5af51d-f854-4daf-adb4-495752ded3db req-adf4ec15-d460-4f82-8dab-781e77afadbc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039108 Sep 08 14:13:40.410657 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3525/7177] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:13:40.684589 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:40.686018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:40.693654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:40.694487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:40.697041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:40.697041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:40.697041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:40.697041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:40.735419 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:40.735931 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:40.736385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:40.736852 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lazy-loading 'fault' on Instance uuid 11d40597-9b46-442c-9d35-0359b8108e41 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:13:40.782869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '16e1a1b184b04cbfb940462f00a39f88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0dc08700af5b40cc911c75f91b2b0f7a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:40.790970 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b59296d0-545a-4bac-8ef1-8ab719ea3684 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 200 len: 1356 microversion: 2.1 time: 0.110684 Sep 08 14:13:40.791595 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3653/7178] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:40 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 1356 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:13:41.815953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d7e24cca-652b-42e8-baf0-aa5a7c1a6681 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:41.816660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d7e24cca-652b-42e8-baf0-aa5a7c1a6681 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] [instance: 11d40597-9b46-442c-9d35-0359b8108e41] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:41.823216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7e24cca-652b-42e8-baf0-aa5a7c1a6681 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:41.823733 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7e24cca-652b-42e8-baf0-aa5a7c1a6681 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:41.824176 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7e24cca-652b-42e8-baf0-aa5a7c1a6681 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:41.824878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7e24cca-652b-42e8-baf0-aa5a7c1a6681 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:41.825336 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7e24cca-652b-42e8-baf0-aa5a7c1a6681 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:41.825764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d7e24cca-652b-42e8-baf0-aa5a7c1a6681 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:41.841182 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-d7e24cca-652b-42e8-baf0-aa5a7c1a6681 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] HTTP exception thrown: Instance 11d40597-9b46-442c-9d35-0359b8108e41 could not be found. Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d7e24cca-652b-42e8-baf0-aa5a7c1a6681 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Request method failure captured: Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 HTTP/1.1 Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfa8rEsclKqB3fGtEoDqf7MMBfOXuK9c8rBoj1w1ZQCY0tDJN3D51PNiQQ5SM8QjooN6eu0hg2opbsQtSReY76kx7kqXGXOA1lWnEjSaSiSz2NklHX-m5XIynq2v07KieXN2ZMFKPTiMgnRrAcFsfQt87Z0aVZMdxADsYgFfKmfBKOU Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 0dc08700af5b40cc911c75f91b2b0f7a Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0dc08700af5b40cc911c75f91b2b0f7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 0dc08700af5b40cc911c75f91b2b0f7a Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1112243692 Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestNetworkAdvancedServerOps-1112243692-project Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: 16e1a1b184b04cbfb940462f00a39f88 Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1112243692-project Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance 11d40597-9b46-442c-9d35-0359b8108e41 could not be found. Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': '11d40597-9b46-442c-9d35-0359b8108e41'} Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11d40597-9b46-442c-9d35-0359b8108e41 could not be found. Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11d40597-9b46-442c-9d35-0359b8108e41 could not be found. Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:13:41.842919 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:13:41.848152 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:13:41.848152 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:13:41.848152 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:13:41.848152 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:13:41.848152 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:13:41.848152 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:13:41.848152 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11d40597-9b46-442c-9d35-0359b8108e41 could not be found. Sep 08 14:13:41.848152 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:13:41.848152 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d7e24cca-652b-42e8-baf0-aa5a7c1a6681 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Returning 404 to user: Instance 11d40597-9b46-442c-9d35-0359b8108e41 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:13:41.848152 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d7e24cca-652b-42e8-baf0-aa5a7c1a6681 tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41" status: 404 len: 111 microversion: 2.1 time: 0.033782 Sep 08 14:13:41.848152 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3526/7179] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:41 2022] GET /compute/v2.1/servers/11d40597-9b46-442c-9d35-0359b8108e41 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:13:45.290039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6d1705f9-fd78-49fb-a23c-2d870a6c5aca tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] Calling method '.version_select at 0x7fdb37046d30>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:45.312683 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6d1705f9-fd78-49fb-a23c-2d870a6c5aca tempest-TestNetworkAdvancedServerOps-1112243692 tempest-TestNetworkAdvancedServerOps-1112243692-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1749400815" status: 202 len: 0 microversion: 2.1 time: 0.026477 Sep 08 14:13:45.318292 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3654/7180] 10.222.0.78 () {58 vars in 1284 bytes} [Thu Sep 8 14:13:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1749400815 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:13:57.133486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=18 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:57.134348 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:57.356990 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ce2501f1-1aee-462c-be98-66956bb1661e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Action: 'create', calling method: .version_select at 0x7fdb3f1b1700>, body: {"keypair": {"name": "tempest-TestShelveInstance-654983967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKTZaJQJ0vHrptgd/Plqd2/M6CsZLUZ+6xtK18/hAY1gWUkAZzC9Sq/2c9nsC4V1uPohyyxGAVR13RqSQORxORmOrc9/kiYwbJSmUvDWSQej9cSc422P23UtNb80NDwQA=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:57.378219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ce2501f1-1aee-462c-be98-66956bb1661e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Getting quotas for project 7fc4a9585e9d42a5967157bd8f1ecdbf. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:13:57.384156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-ce2501f1-1aee-462c-be98-66956bb1661e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Getting quotas for user b173d117bd5c4130b4d1d093a61b0047 and project 7fc4a9585e9d42a5967157bd8f1ecdbf. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:13:57.413477 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ce2501f1-1aee-462c-be98-66956bb1661e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.286370 Sep 08 14:13:57.414092 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3527/7181] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 14:13:57 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:13:58.614687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:58.615676 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:13:58.620466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-452226546", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-654983967", "security_groups": [{"name": "tempest-secgroup-smoke-1304811708"}], "networks": [{"uuid": "b69607d0-45d2-4a6f-8f46-077ee3757755"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:13:58.761493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] validate_networks() for [('b69607d0-45d2-4a6f-8f46-077ee3757755', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:13:59.186057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:13:59.186495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:13:59.186982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:13:59.187452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:13:59.187883 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:13:59.198057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:59.198650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:59.199109 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:59.199963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:13:59.200441 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:13:59.200878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:13:59.221357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Getting quotas for project 7fc4a9585e9d42a5967157bd8f1ecdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:13:59.226741 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Getting quotas for user b173d117bd5c4130b4d1d093a61b0047 and project 7fc4a9585e9d42a5967157bd8f1ecdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:13:59.240518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:13:59.242869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:13:59.294728 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4337e189-1c97-4a49-9bbf-10d743c4e233 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.682051 Sep 08 14:13:59.295762 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3655/7182] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 14:13:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:13:59.304622 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:13:59.305355 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 14:13:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af (ip 10.222.0.78) !!! Sep 08 14:13:59.311959 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-51453946-4aef-4a8b-a5a7-38c6167395c8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:13:59.312580 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-51453946-4aef-4a8b-a5a7-38c6167395c8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:13:59.516730 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-51453946-4aef-4a8b-a5a7-38c6167395c8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:13:59.524344 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-51453946-4aef-4a8b-a5a7-38c6167395c8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1245 microversion: 2.1 time: 0.220989 Sep 08 14:13:59.525206 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3528/7183] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:13:59 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1245 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:00.550597 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6fa225d2-80d5-491f-881d-edfa9c2c8dad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:00.551854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6fa225d2-80d5-491f-881d-edfa9c2c8dad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:00.619622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6fa225d2-80d5-491f-881d-edfa9c2c8dad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:00.628340 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6fa225d2-80d5-491f-881d-edfa9c2c8dad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1245 microversion: 2.1 time: 0.082403 Sep 08 14:14:00.628946 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3656/7184] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:00 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:01.652550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-76c148a7-4026-42ec-b087-adbaa7fad13f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:01.653210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-76c148a7-4026-42ec-b087-adbaa7fad13f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:01.721615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-76c148a7-4026-42ec-b087-adbaa7fad13f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:01.733174 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-76c148a7-4026-42ec-b087-adbaa7fad13f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1245 microversion: 2.1 time: 0.084320 Sep 08 14:14:01.733908 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3529/7185] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:01 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:02.757666 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4d423684-dc34-47b6-865b-c43aba6712bb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:02.758223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4d423684-dc34-47b6-865b-c43aba6712bb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:02.813687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4d423684-dc34-47b6-865b-c43aba6712bb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:02.821809 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4d423684-dc34-47b6-865b-c43aba6712bb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1245 microversion: 2.1 time: 0.068223 Sep 08 14:14:02.822384 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3657/7186] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:02 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:03.845642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-79aa8b63-8bf2-49a2-9df8-09d325c9cdf1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:03.846211 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-79aa8b63-8bf2-49a2-9df8-09d325c9cdf1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:03.853840 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79aa8b63-8bf2-49a2-9df8-09d325c9cdf1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:03.854326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79aa8b63-8bf2-49a2-9df8-09d325c9cdf1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:03.855349 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79aa8b63-8bf2-49a2-9df8-09d325c9cdf1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:03.856046 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79aa8b63-8bf2-49a2-9df8-09d325c9cdf1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:03.856524 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79aa8b63-8bf2-49a2-9df8-09d325c9cdf1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:03.856951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-79aa8b63-8bf2-49a2-9df8-09d325c9cdf1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:03.920427 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-79aa8b63-8bf2-49a2-9df8-09d325c9cdf1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:03.928091 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-79aa8b63-8bf2-49a2-9df8-09d325c9cdf1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1249 microversion: 2.1 time: 0.086462 Sep 08 14:14:03.928670 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3530/7187] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:03 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1249 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:14:04.952588 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0e32d2d7-eb38-42af-a992-d67ce0a664c3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:04.953878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0e32d2d7-eb38-42af-a992-d67ce0a664c3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:04.960458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e32d2d7-eb38-42af-a992-d67ce0a664c3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:04.960958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e32d2d7-eb38-42af-a992-d67ce0a664c3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:04.961408 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e32d2d7-eb38-42af-a992-d67ce0a664c3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:04.962121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e32d2d7-eb38-42af-a992-d67ce0a664c3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:04.962593 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e32d2d7-eb38-42af-a992-d67ce0a664c3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:04.963241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0e32d2d7-eb38-42af-a992-d67ce0a664c3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:05.036780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0e32d2d7-eb38-42af-a992-d67ce0a664c3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:05.044876 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0e32d2d7-eb38-42af-a992-d67ce0a664c3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1303 microversion: 2.1 time: 0.096737 Sep 08 14:14:05.052152 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3658/7188] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:04 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:14:06.069918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-113c283c-5a85-466d-b3d2-25996cca153b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:06.070585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-113c283c-5a85-466d-b3d2-25996cca153b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:06.077529 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-113c283c-5a85-466d-b3d2-25996cca153b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:06.078017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-113c283c-5a85-466d-b3d2-25996cca153b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:06.078457 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-113c283c-5a85-466d-b3d2-25996cca153b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:06.079156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-113c283c-5a85-466d-b3d2-25996cca153b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:06.079688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-113c283c-5a85-466d-b3d2-25996cca153b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:06.080115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-113c283c-5a85-466d-b3d2-25996cca153b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:06.203987 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-857f414d-a519-4833-bd8a-53de95596e12 req-c1e99b4b-adca-48af-9d79-ab4dd0e582d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e15c30-1629-431d-bd98-781c4661e8af", "tag": "ba8a99d9-7ca7-4141-bce0-4be4df2536c9"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:14:06.215581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-857f414d-a519-4833-bd8a-53de95596e12 req-c1e99b4b-adca-48af-9d79-ab4dd0e582d9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:06.216093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-857f414d-a519-4833-bd8a-53de95596e12 req-c1e99b4b-adca-48af-9d79-ab4dd0e582d9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:06.216545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-857f414d-a519-4833-bd8a-53de95596e12 req-c1e99b4b-adca-48af-9d79-ab4dd0e582d9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:06.227411 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-857f414d-a519-4833-bd8a-53de95596e12 req-c1e99b4b-adca-48af-9d79-ab4dd0e582d9 service nova] Creating event network-changed:ba8a99d9-7ca7-4141-bce0-4be4df2536c9 for instance f7e15c30-1629-431d-bd98-781c4661e8af on n-h2-852084-10 Sep 08 14:14:06.233023 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-857f414d-a519-4833-bd8a-53de95596e12 req-c1e99b4b-adca-48af-9d79-ab4dd0e582d9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108755 Sep 08 14:14:06.233643 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3659/7189] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:14:06.366511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-113c283c-5a85-466d-b3d2-25996cca153b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:06.374820 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-113c283c-5a85-466d-b3d2-25996cca153b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1371 microversion: 2.1 time: 0.309033 Sep 08 14:14:06.375553 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3531/7190] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:06 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1371 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:07.399286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-83184f84-4be8-44ef-8856-e7e488cd72fe tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:07.400012 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-83184f84-4be8-44ef-8856-e7e488cd72fe tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:07.406757 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83184f84-4be8-44ef-8856-e7e488cd72fe tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:07.407274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83184f84-4be8-44ef-8856-e7e488cd72fe tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:07.407730 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83184f84-4be8-44ef-8856-e7e488cd72fe tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:07.408466 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83184f84-4be8-44ef-8856-e7e488cd72fe tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:07.408936 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83184f84-4be8-44ef-8856-e7e488cd72fe tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:07.409371 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-83184f84-4be8-44ef-8856-e7e488cd72fe tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:07.632514 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-83184f84-4be8-44ef-8856-e7e488cd72fe tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:07.654190 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-83184f84-4be8-44ef-8856-e7e488cd72fe tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1371 microversion: 2.1 time: 0.257463 Sep 08 14:14:07.659434 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3660/7191] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:07 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1371 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:08.679108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-33b714d2-e10c-41fe-bf95-7aa83a9bbda9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:08.679758 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-33b714d2-e10c-41fe-bf95-7aa83a9bbda9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:08.687505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b714d2-e10c-41fe-bf95-7aa83a9bbda9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:08.688002 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b714d2-e10c-41fe-bf95-7aa83a9bbda9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:08.688442 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b714d2-e10c-41fe-bf95-7aa83a9bbda9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:08.689153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b714d2-e10c-41fe-bf95-7aa83a9bbda9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:08.689611 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b714d2-e10c-41fe-bf95-7aa83a9bbda9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:08.690036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-33b714d2-e10c-41fe-bf95-7aa83a9bbda9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:08.826883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-33b714d2-e10c-41fe-bf95-7aa83a9bbda9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:08.834851 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-33b714d2-e10c-41fe-bf95-7aa83a9bbda9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1371 microversion: 2.1 time: 0.160000 Sep 08 14:14:08.835479 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3532/7192] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:08 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:09.859483 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6e85bdb2-b1b8-4204-9a65-51273fdc63c6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:09.860164 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6e85bdb2-b1b8-4204-9a65-51273fdc63c6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:09.862803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:09.868649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e85bdb2-b1b8-4204-9a65-51273fdc63c6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:09.869159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e85bdb2-b1b8-4204-9a65-51273fdc63c6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:09.869614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e85bdb2-b1b8-4204-9a65-51273fdc63c6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:09.870961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e85bdb2-b1b8-4204-9a65-51273fdc63c6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:09.871473 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e85bdb2-b1b8-4204-9a65-51273fdc63c6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:09.871914 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6e85bdb2-b1b8-4204-9a65-51273fdc63c6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:10.018114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6e85bdb2-b1b8-4204-9a65-51273fdc63c6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:10.027459 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6e85bdb2-b1b8-4204-9a65-51273fdc63c6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1371 microversion: 2.1 time: 0.171594 Sep 08 14:14:10.028051 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3661/7193] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:09 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:11.051486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d498f677-98c0-4599-bf59-568eb209bbf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:11.052156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d498f677-98c0-4599-bf59-568eb209bbf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:11.059396 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d498f677-98c0-4599-bf59-568eb209bbf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:11.059890 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d498f677-98c0-4599-bf59-568eb209bbf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:11.060329 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d498f677-98c0-4599-bf59-568eb209bbf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:11.061037 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d498f677-98c0-4599-bf59-568eb209bbf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:11.061498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d498f677-98c0-4599-bf59-568eb209bbf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:11.061918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d498f677-98c0-4599-bf59-568eb209bbf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:11.201289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d498f677-98c0-4599-bf59-568eb209bbf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:11.209070 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d498f677-98c0-4599-bf59-568eb209bbf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1371 microversion: 2.1 time: 0.161590 Sep 08 14:14:11.209647 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3533/7194] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:11 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:12.233439 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4f2e895f-7eb2-4881-b0a0-9d47fcbc771c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:12.234078 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4f2e895f-7eb2-4881-b0a0-9d47fcbc771c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:12.241348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f2e895f-7eb2-4881-b0a0-9d47fcbc771c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:12.241856 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f2e895f-7eb2-4881-b0a0-9d47fcbc771c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:12.242311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f2e895f-7eb2-4881-b0a0-9d47fcbc771c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:12.243040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f2e895f-7eb2-4881-b0a0-9d47fcbc771c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:12.243545 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f2e895f-7eb2-4881-b0a0-9d47fcbc771c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:12.243990 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4f2e895f-7eb2-4881-b0a0-9d47fcbc771c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:12.382926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4f2e895f-7eb2-4881-b0a0-9d47fcbc771c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:12.390716 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4f2e895f-7eb2-4881-b0a0-9d47fcbc771c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1371 microversion: 2.1 time: 0.161892 Sep 08 14:14:12.391396 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3662/7195] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:12 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:12.884666 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-430d1f87-05e9-46f7-9d37-a81753245666 req-aa601e5e-dfc9-4e9c-b71c-b6b2edc2ad9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e15c30-1629-431d-bd98-781c4661e8af", "name": "network-vif-plugged", "status": "completed", "tag": "ba8a99d9-7ca7-4141-bce0-4be4df2536c9"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:14:12.890678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=8 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:12.898096 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-430d1f87-05e9-46f7-9d37-a81753245666 req-aa601e5e-dfc9-4e9c-b71c-b6b2edc2ad9f service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:12.898584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-430d1f87-05e9-46f7-9d37-a81753245666 req-aa601e5e-dfc9-4e9c-b71c-b6b2edc2ad9f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:12.899029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-430d1f87-05e9-46f7-9d37-a81753245666 req-aa601e5e-dfc9-4e9c-b71c-b6b2edc2ad9f service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:12.911816 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-430d1f87-05e9-46f7-9d37-a81753245666 req-aa601e5e-dfc9-4e9c-b71c-b6b2edc2ad9f service nova] Creating event network-vif-plugged:ba8a99d9-7ca7-4141-bce0-4be4df2536c9 for instance f7e15c30-1629-431d-bd98-781c4661e8af on n-h2-852084-10 Sep 08 14:14:12.916937 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-430d1f87-05e9-46f7-9d37-a81753245666 req-aa601e5e-dfc9-4e9c-b71c-b6b2edc2ad9f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036077 Sep 08 14:14:12.917614 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3534/7196] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:14:13.414203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-44353746-09ed-4cf6-956c-369a085fac86 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:13.414837 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-44353746-09ed-4cf6-956c-369a085fac86 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:13.417573 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=10 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:14:13.423553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44353746-09ed-4cf6-956c-369a085fac86 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:13.424064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44353746-09ed-4cf6-956c-369a085fac86 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:13.424857 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44353746-09ed-4cf6-956c-369a085fac86 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:13.425582 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44353746-09ed-4cf6-956c-369a085fac86 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:13.426057 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44353746-09ed-4cf6-956c-369a085fac86 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:13.426521 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-44353746-09ed-4cf6-956c-369a085fac86 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:13.557799 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-44353746-09ed-4cf6-956c-369a085fac86 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:13.565503 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-44353746-09ed-4cf6-956c-369a085fac86 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1371 microversion: 2.1 time: 0.155366 Sep 08 14:14:13.566071 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3663/7197] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:13 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:14.591060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9d646dbd-de77-49f8-bf2f-78f4924ff832 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:14.591795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9d646dbd-de77-49f8-bf2f-78f4924ff832 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:14.598209 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d646dbd-de77-49f8-bf2f-78f4924ff832 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:14.598702 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d646dbd-de77-49f8-bf2f-78f4924ff832 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:14.599141 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d646dbd-de77-49f8-bf2f-78f4924ff832 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:14.599871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d646dbd-de77-49f8-bf2f-78f4924ff832 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:14.600323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d646dbd-de77-49f8-bf2f-78f4924ff832 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:14.600818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9d646dbd-de77-49f8-bf2f-78f4924ff832 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:14.742218 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9d646dbd-de77-49f8-bf2f-78f4924ff832 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:14.750794 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9d646dbd-de77-49f8-bf2f-78f4924ff832 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1555 microversion: 2.1 time: 0.165613 Sep 08 14:14:14.751388 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3535/7198] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:14 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:14.773725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c6f307f4-7328-4b56-972c-8f1d58f304ff tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:14:14.774363 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c6f307f4-7328-4b56-972c-8f1d58f304ff tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:14:14.781532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6f307f4-7328-4b56-972c-8f1d58f304ff tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:14.782045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6f307f4-7328-4b56-972c-8f1d58f304ff tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:14.782500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6f307f4-7328-4b56-972c-8f1d58f304ff tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:14.783208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6f307f4-7328-4b56-972c-8f1d58f304ff tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:14.783702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6f307f4-7328-4b56-972c-8f1d58f304ff tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:14.784146 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c6f307f4-7328-4b56-972c-8f1d58f304ff tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:14.921240 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c6f307f4-7328-4b56-972c-8f1d58f304ff tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:14:14.929239 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c6f307f4-7328-4b56-972c-8f1d58f304ff tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1555 microversion: 2.1 time: 0.159484 Sep 08 14:14:14.929833 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3664/7199] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:14:14 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:14:16.633235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-597724f1-9895-4357-89df-0a9d7a965bcf req-04f73672-8c1c-4d67-be89-78b78dea969e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e15c30-1629-431d-bd98-781c4661e8af", "tag": "ba8a99d9-7ca7-4141-bce0-4be4df2536c9"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:14:16.644353 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-597724f1-9895-4357-89df-0a9d7a965bcf req-04f73672-8c1c-4d67-be89-78b78dea969e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:14:16.644930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-597724f1-9895-4357-89df-0a9d7a965bcf req-04f73672-8c1c-4d67-be89-78b78dea969e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:14:16.645440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-597724f1-9895-4357-89df-0a9d7a965bcf req-04f73672-8c1c-4d67-be89-78b78dea969e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:14:16.658107 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-597724f1-9895-4357-89df-0a9d7a965bcf req-04f73672-8c1c-4d67-be89-78b78dea969e service nova] Creating event network-changed:ba8a99d9-7ca7-4141-bce0-4be4df2536c9 for instance f7e15c30-1629-431d-bd98-781c4661e8af on n-h2-852084-10 Sep 08 14:14:16.663332 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-597724f1-9895-4357-89df-0a9d7a965bcf req-04f73672-8c1c-4d67-be89-78b78dea969e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034919 Sep 08 14:14:16.664080 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3536/7200] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:16:14.255131 n-d-852084-10 devstack@n-api.service[128970]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ae07885-1976-4f24-8283-d63c7056ab9e] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 14:16:14.256126 n-d-852084-10 devstack@n-api.service[128970]: ERROR oslo.messaging._drivers.impl_rabbit [-] [254344fe-6b9d-45f5-91d6-e802ace055bf] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 14:16:14.256992 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:14.257785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=40 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:14.259384 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:16:14.259542 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 14:16:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af/action (ip 10.222.0.78) !!! Sep 08 14:16:14.262671 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 08 14:16:14.269087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c9b06abb-0e7c-4035-8d60-f95335ff3455 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:16:14.269640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c9b06abb-0e7c-4035-8d60-f95335ff3455 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:14.280662 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9b06abb-0e7c-4035-8d60-f95335ff3455 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:14.281166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9b06abb-0e7c-4035-8d60-f95335ff3455 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:14.281621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9b06abb-0e7c-4035-8d60-f95335ff3455 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:14.282334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9b06abb-0e7c-4035-8d60-f95335ff3455 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:14.282806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9b06abb-0e7c-4035-8d60-f95335ff3455 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:14.283280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9b06abb-0e7c-4035-8d60-f95335ff3455 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:14.310610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-c9b06abb-0e7c-4035-8d60-f95335ff3455 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lazy-loading 'flavor' on Instance uuid f7e15c30-1629-431d-bd98-781c4661e8af {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:16:14.503922 n-d-852084-10 devstack@n-api.service[128970]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c9b06abb-0e7c-4035-8d60-f95335ff3455 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [65376541-d75a-480f-84ca-1d97a8a2bff6] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 14:16:15.266510 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] [254344fe-6b9d-45f5-91d6-e802ace055bf] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 52472. Sep 08 14:16:15.267165 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ae07885-1976-4f24-8283-d63c7056ab9e] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 52470. Sep 08 14:16:15.512631 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [None req-c9b06abb-0e7c-4035-8d60-f95335ff3455 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [65376541-d75a-480f-84ca-1d97a8a2bff6] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 52474. Sep 08 14:16:15.516193 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c9b06abb-0e7c-4035-8d60-f95335ff3455 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "POST /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af/action" status: 202 len: 0 microversion: 2.1 time: 1.262959 Sep 08 14:16:15.516815 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3665/7201] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:16:14 2022] POST /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af/action => generated 0 bytes in 1264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:16:15.523591 n-d-852084-10 devstack@n-api.service[128971]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4073da4f-db71-4c3c-9e1b-d9f532b78424] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 08 14:16:15.524464 n-d-852084-10 devstack@n-api.service[128971]: ERROR oslo.messaging._drivers.impl_rabbit [-] [31769cf6-754f-4e53-871b-651183d82573] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 14:16:15.525124 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:15.525949 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=34 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:15.528081 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 08 14:16:15.534249 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1e2f9853-f7cf-4df7-95c1-09e6f1728ba7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:15.535099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1e2f9853-f7cf-4df7-95c1-09e6f1728ba7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:15.543977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e2f9853-f7cf-4df7-95c1-09e6f1728ba7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:15.544506 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e2f9853-f7cf-4df7-95c1-09e6f1728ba7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:15.545044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e2f9853-f7cf-4df7-95c1-09e6f1728ba7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:15.545786 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e2f9853-f7cf-4df7-95c1-09e6f1728ba7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:15.546248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e2f9853-f7cf-4df7-95c1-09e6f1728ba7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:15.546682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1e2f9853-f7cf-4df7-95c1-09e6f1728ba7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:15.686440 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1e2f9853-f7cf-4df7-95c1-09e6f1728ba7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:15.695722 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1e2f9853-f7cf-4df7-95c1-09e6f1728ba7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1680 microversion: 2.1 time: 0.173980 Sep 08 14:16:15.696422 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3537/7202] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:15 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:16.721065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-dfd5b088-5f40-40fb-8520-cbac7dfe9421 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:16.722819 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-dfd5b088-5f40-40fb-8520-cbac7dfe9421 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:16.729392 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfd5b088-5f40-40fb-8520-cbac7dfe9421 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:16.729890 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfd5b088-5f40-40fb-8520-cbac7dfe9421 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:16.730344 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfd5b088-5f40-40fb-8520-cbac7dfe9421 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:16.731050 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfd5b088-5f40-40fb-8520-cbac7dfe9421 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:16.731550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfd5b088-5f40-40fb-8520-cbac7dfe9421 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:16.731993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-dfd5b088-5f40-40fb-8520-cbac7dfe9421 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:16.869655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-dfd5b088-5f40-40fb-8520-cbac7dfe9421 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:16.877980 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-dfd5b088-5f40-40fb-8520-cbac7dfe9421 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1680 microversion: 2.1 time: 0.162233 Sep 08 14:16:16.878887 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3666/7203] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:16 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:16:17.904954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9f717599-6679-466f-bd3d-02083d9ff1c4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:17.905596 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9f717599-6679-466f-bd3d-02083d9ff1c4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:17.920723 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] [31769cf6-754f-4e53-871b-651183d82573] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 52486. Sep 08 14:16:17.922683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f717599-6679-466f-bd3d-02083d9ff1c4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:17.923168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f717599-6679-466f-bd3d-02083d9ff1c4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:17.923639 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f717599-6679-466f-bd3d-02083d9ff1c4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:17.924324 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f717599-6679-466f-bd3d-02083d9ff1c4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:17.924773 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f717599-6679-466f-bd3d-02083d9ff1c4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:17.925202 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9f717599-6679-466f-bd3d-02083d9ff1c4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:17.932609 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] [4073da4f-db71-4c3c-9e1b-d9f532b78424] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 52484. Sep 08 14:16:18.064177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9f717599-6679-466f-bd3d-02083d9ff1c4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:18.072341 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9f717599-6679-466f-bd3d-02083d9ff1c4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1680 microversion: 2.1 time: 0.171657 Sep 08 14:16:18.072947 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3538/7204] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:17 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1680 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:19.096385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-74fd79c0-1cdd-424c-86a0-10d94edf6baf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:19.096997 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-74fd79c0-1cdd-424c-86a0-10d94edf6baf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:19.105045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74fd79c0-1cdd-424c-86a0-10d94edf6baf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:19.105724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74fd79c0-1cdd-424c-86a0-10d94edf6baf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:19.106127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74fd79c0-1cdd-424c-86a0-10d94edf6baf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:19.107016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74fd79c0-1cdd-424c-86a0-10d94edf6baf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:19.107511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74fd79c0-1cdd-424c-86a0-10d94edf6baf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:19.107961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-74fd79c0-1cdd-424c-86a0-10d94edf6baf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:19.241686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-74fd79c0-1cdd-424c-86a0-10d94edf6baf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:19.249943 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-74fd79c0-1cdd-424c-86a0-10d94edf6baf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1680 microversion: 2.1 time: 0.157576 Sep 08 14:16:19.250566 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3667/7205] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:19 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:20.274147 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3ead97f4-b616-4de0-b0f1-b2be0a02070f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:20.274794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3ead97f4-b616-4de0-b0f1-b2be0a02070f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:20.282688 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ead97f4-b616-4de0-b0f1-b2be0a02070f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:20.283192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ead97f4-b616-4de0-b0f1-b2be0a02070f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:20.283674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ead97f4-b616-4de0-b0f1-b2be0a02070f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:20.284471 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ead97f4-b616-4de0-b0f1-b2be0a02070f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:20.285023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ead97f4-b616-4de0-b0f1-b2be0a02070f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:20.285513 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3ead97f4-b616-4de0-b0f1-b2be0a02070f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:20.425065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3ead97f4-b616-4de0-b0f1-b2be0a02070f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:20.432838 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3ead97f4-b616-4de0-b0f1-b2be0a02070f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1680 microversion: 2.1 time: 0.163327 Sep 08 14:16:20.433420 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3539/7206] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:20 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:21.456695 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-084e96a8-918e-4e51-a2f0-973be6f1d257 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:21.457317 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-084e96a8-918e-4e51-a2f0-973be6f1d257 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:21.464899 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-084e96a8-918e-4e51-a2f0-973be6f1d257 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:21.465406 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-084e96a8-918e-4e51-a2f0-973be6f1d257 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:21.465862 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-084e96a8-918e-4e51-a2f0-973be6f1d257 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:21.466584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-084e96a8-918e-4e51-a2f0-973be6f1d257 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:21.467055 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-084e96a8-918e-4e51-a2f0-973be6f1d257 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:21.467532 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-084e96a8-918e-4e51-a2f0-973be6f1d257 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:21.626121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-084e96a8-918e-4e51-a2f0-973be6f1d257 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:21.634168 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-084e96a8-918e-4e51-a2f0-973be6f1d257 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1680 microversion: 2.1 time: 0.181427 Sep 08 14:16:21.634762 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3668/7207] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:21 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1680 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:22.658346 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-369be939-f95a-43ae-aad1-c0b9897dccd2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:22.658945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-369be939-f95a-43ae-aad1-c0b9897dccd2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:22.666669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-369be939-f95a-43ae-aad1-c0b9897dccd2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:22.667166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-369be939-f95a-43ae-aad1-c0b9897dccd2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:22.667616 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-369be939-f95a-43ae-aad1-c0b9897dccd2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:22.668554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-369be939-f95a-43ae-aad1-c0b9897dccd2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:22.669092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-369be939-f95a-43ae-aad1-c0b9897dccd2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:22.669500 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-369be939-f95a-43ae-aad1-c0b9897dccd2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:22.812904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-369be939-f95a-43ae-aad1-c0b9897dccd2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:22.821142 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-369be939-f95a-43ae-aad1-c0b9897dccd2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1680 microversion: 2.1 time: 0.166818 Sep 08 14:16:22.821731 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3540/7208] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:22 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:23.847167 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3a96d662-82a6-4ebb-b526-576d8d1875f6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:23.847763 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3a96d662-82a6-4ebb-b526-576d8d1875f6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:23.855290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a96d662-82a6-4ebb-b526-576d8d1875f6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:23.855790 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a96d662-82a6-4ebb-b526-576d8d1875f6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:23.856243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a96d662-82a6-4ebb-b526-576d8d1875f6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:23.856952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a96d662-82a6-4ebb-b526-576d8d1875f6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:23.857416 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a96d662-82a6-4ebb-b526-576d8d1875f6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:23.857851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-3a96d662-82a6-4ebb-b526-576d8d1875f6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:23.994688 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3a96d662-82a6-4ebb-b526-576d8d1875f6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:24.002513 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3a96d662-82a6-4ebb-b526-576d8d1875f6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1680 microversion: 2.1 time: 0.160648 Sep 08 14:16:24.003096 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3669/7209] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:23 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:25.028190 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e1d247fa-aa85-49d9-a397-e2023c91c8f8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:25.029143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e1d247fa-aa85-49d9-a397-e2023c91c8f8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:25.042130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1d247fa-aa85-49d9-a397-e2023c91c8f8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:25.043016 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1d247fa-aa85-49d9-a397-e2023c91c8f8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:25.043795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1d247fa-aa85-49d9-a397-e2023c91c8f8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:25.045068 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1d247fa-aa85-49d9-a397-e2023c91c8f8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:25.045925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1d247fa-aa85-49d9-a397-e2023c91c8f8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:25.046498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e1d247fa-aa85-49d9-a397-e2023c91c8f8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:25.182522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e1d247fa-aa85-49d9-a397-e2023c91c8f8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:25.190311 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e1d247fa-aa85-49d9-a397-e2023c91c8f8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1680 microversion: 2.1 time: 0.167189 Sep 08 14:16:25.190880 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3541/7210] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:25 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:26.214826 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-668706a5-7d40-4cda-ab50-322fae2cb535 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:26.215512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-668706a5-7d40-4cda-ab50-322fae2cb535 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:26.223037 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-668706a5-7d40-4cda-ab50-322fae2cb535 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:26.223571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-668706a5-7d40-4cda-ab50-322fae2cb535 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:26.224058 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-668706a5-7d40-4cda-ab50-322fae2cb535 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:26.224778 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-668706a5-7d40-4cda-ab50-322fae2cb535 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:26.225241 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-668706a5-7d40-4cda-ab50-322fae2cb535 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:26.226274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-668706a5-7d40-4cda-ab50-322fae2cb535 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:26.369944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-668706a5-7d40-4cda-ab50-322fae2cb535 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:26.377742 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-668706a5-7d40-4cda-ab50-322fae2cb535 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1701 microversion: 2.1 time: 0.167431 Sep 08 14:16:26.378317 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3670/7211] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:26 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1701 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:27.402276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e3232917-46e5-4422-be19-044e5b99f315 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:27.402932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e3232917-46e5-4422-be19-044e5b99f315 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:27.410243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e3232917-46e5-4422-be19-044e5b99f315 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:27.410734 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e3232917-46e5-4422-be19-044e5b99f315 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:27.411178 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e3232917-46e5-4422-be19-044e5b99f315 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:27.411917 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e3232917-46e5-4422-be19-044e5b99f315 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:27.412382 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e3232917-46e5-4422-be19-044e5b99f315 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:27.412804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e3232917-46e5-4422-be19-044e5b99f315 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:27.558671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e3232917-46e5-4422-be19-044e5b99f315 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:27.566988 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e3232917-46e5-4422-be19-044e5b99f315 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1701 microversion: 2.1 time: 0.168904 Sep 08 14:16:27.568180 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3542/7212] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:27 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1701 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:28.590923 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e6275b0f-f6c5-407a-b485-b6b19c713ff8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:28.592761 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e6275b0f-f6c5-407a-b485-b6b19c713ff8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:28.600623 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6275b0f-f6c5-407a-b485-b6b19c713ff8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:28.601508 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6275b0f-f6c5-407a-b485-b6b19c713ff8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:28.602290 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6275b0f-f6c5-407a-b485-b6b19c713ff8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:28.602952 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6275b0f-f6c5-407a-b485-b6b19c713ff8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:28.603458 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6275b0f-f6c5-407a-b485-b6b19c713ff8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:28.604096 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e6275b0f-f6c5-407a-b485-b6b19c713ff8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:28.811008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e6275b0f-f6c5-407a-b485-b6b19c713ff8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:28.832735 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e6275b0f-f6c5-407a-b485-b6b19c713ff8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1696 microversion: 2.1 time: 0.245119 Sep 08 14:16:28.834414 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3671/7213] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:28 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1696 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:29.858804 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ae655de5-832c-4c0f-90b1-8f9c207ef1d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:29.860266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ae655de5-832c-4c0f-90b1-8f9c207ef1d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:29.869063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae655de5-832c-4c0f-90b1-8f9c207ef1d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:29.869648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae655de5-832c-4c0f-90b1-8f9c207ef1d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:29.870310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae655de5-832c-4c0f-90b1-8f9c207ef1d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:29.871245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae655de5-832c-4c0f-90b1-8f9c207ef1d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:29.871830 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae655de5-832c-4c0f-90b1-8f9c207ef1d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:29.872547 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ae655de5-832c-4c0f-90b1-8f9c207ef1d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:30.396980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ae655de5-832c-4c0f-90b1-8f9c207ef1d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:30.406476 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ae655de5-832c-4c0f-90b1-8f9c207ef1d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1696 microversion: 2.1 time: 0.552095 Sep 08 14:16:30.407723 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3543/7214] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:29 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1696 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:31.433982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-12095def-4c74-40e7-964d-20a2913ab4b7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:31.434600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-12095def-4c74-40e7-964d-20a2913ab4b7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:31.447294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12095def-4c74-40e7-964d-20a2913ab4b7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:31.447722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12095def-4c74-40e7-964d-20a2913ab4b7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:31.448175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12095def-4c74-40e7-964d-20a2913ab4b7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:31.449177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12095def-4c74-40e7-964d-20a2913ab4b7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:31.450020 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12095def-4c74-40e7-964d-20a2913ab4b7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:31.464600 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-66d45d73-22e0-4e00-96e6-34a388fce325 req-3e4a18f8-d0fb-4684-a96d-318fe11a02ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e15c30-1629-431d-bd98-781c4661e8af", "name": "network-vif-plugged", "status": "completed", "tag": "ba8a99d9-7ca7-4141-bce0-4be4df2536c9"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:16:31.468937 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-12095def-4c74-40e7-964d-20a2913ab4b7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:31.480347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-66d45d73-22e0-4e00-96e6-34a388fce325 req-3e4a18f8-d0fb-4684-a96d-318fe11a02ec service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:31.480855 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-66d45d73-22e0-4e00-96e6-34a388fce325 req-3e4a18f8-d0fb-4684-a96d-318fe11a02ec service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:31.481502 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-66d45d73-22e0-4e00-96e6-34a388fce325 req-3e4a18f8-d0fb-4684-a96d-318fe11a02ec service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:31.495940 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-66d45d73-22e0-4e00-96e6-34a388fce325 req-3e4a18f8-d0fb-4684-a96d-318fe11a02ec service nova] Creating event network-vif-plugged:ba8a99d9-7ca7-4141-bce0-4be4df2536c9 for instance f7e15c30-1629-431d-bd98-781c4661e8af on n-h2-852084-10 Sep 08 14:16:31.508759 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-66d45d73-22e0-4e00-96e6-34a388fce325 req-3e4a18f8-d0fb-4684-a96d-318fe11a02ec service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135366 Sep 08 14:16:31.509840 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3672/7215] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:16:31.668060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-12095def-4c74-40e7-964d-20a2913ab4b7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:31.677045 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-12095def-4c74-40e7-964d-20a2913ab4b7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1696 microversion: 2.1 time: 0.247274 Sep 08 14:16:31.678304 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3544/7216] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:31 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1696 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:32.703678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0c8cf2b0-7c1f-4ab0-8657-81e32d4a85fa tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:32.705961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0c8cf2b0-7c1f-4ab0-8657-81e32d4a85fa tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:32.715465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c8cf2b0-7c1f-4ab0-8657-81e32d4a85fa tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:32.716404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c8cf2b0-7c1f-4ab0-8657-81e32d4a85fa tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:32.717094 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c8cf2b0-7c1f-4ab0-8657-81e32d4a85fa tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:32.718092 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c8cf2b0-7c1f-4ab0-8657-81e32d4a85fa tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:32.718983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c8cf2b0-7c1f-4ab0-8657-81e32d4a85fa tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:32.720082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0c8cf2b0-7c1f-4ab0-8657-81e32d4a85fa tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:32.897008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0c8cf2b0-7c1f-4ab0-8657-81e32d4a85fa tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:32.905585 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0c8cf2b0-7c1f-4ab0-8657-81e32d4a85fa tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1696 microversion: 2.1 time: 0.207057 Sep 08 14:16:32.906501 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3673/7217] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:32 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1696 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:33.936084 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-85aac7cf-cc0a-4948-9511-9e2d2b459040 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:33.936934 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-85aac7cf-cc0a-4948-9511-9e2d2b459040 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:33.945086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85aac7cf-cc0a-4948-9511-9e2d2b459040 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:33.945897 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85aac7cf-cc0a-4948-9511-9e2d2b459040 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:33.946576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85aac7cf-cc0a-4948-9511-9e2d2b459040 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:33.947430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85aac7cf-cc0a-4948-9511-9e2d2b459040 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:33.948115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85aac7cf-cc0a-4948-9511-9e2d2b459040 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:33.948563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-85aac7cf-cc0a-4948-9511-9e2d2b459040 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:34.150912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-85aac7cf-cc0a-4948-9511-9e2d2b459040 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:34.160525 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-85aac7cf-cc0a-4948-9511-9e2d2b459040 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1696 microversion: 2.1 time: 0.228949 Sep 08 14:16:34.163269 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3545/7218] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:33 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1696 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:35.204574 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fbbf1709-0647-4bd1-9189-94ce49cf9d92 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:35.206672 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fbbf1709-0647-4bd1-9189-94ce49cf9d92 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:35.221097 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbbf1709-0647-4bd1-9189-94ce49cf9d92 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:35.222621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbbf1709-0647-4bd1-9189-94ce49cf9d92 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:35.224303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbbf1709-0647-4bd1-9189-94ce49cf9d92 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:35.225535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbbf1709-0647-4bd1-9189-94ce49cf9d92 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:35.226170 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbbf1709-0647-4bd1-9189-94ce49cf9d92 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:35.226752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fbbf1709-0647-4bd1-9189-94ce49cf9d92 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:35.452986 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fbbf1709-0647-4bd1-9189-94ce49cf9d92 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:35.463306 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fbbf1709-0647-4bd1-9189-94ce49cf9d92 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1696 microversion: 2.1 time: 0.266061 Sep 08 14:16:35.464106 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3674/7219] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:35 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1696 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:36.499118 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-828f9351-a6dc-4bd2-b9ab-588458d15e02 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:36.500206 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-828f9351-a6dc-4bd2-b9ab-588458d15e02 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:36.515855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-828f9351-a6dc-4bd2-b9ab-588458d15e02 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:36.520913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-828f9351-a6dc-4bd2-b9ab-588458d15e02 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:36.522681 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-828f9351-a6dc-4bd2-b9ab-588458d15e02 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:36.524459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-828f9351-a6dc-4bd2-b9ab-588458d15e02 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:36.525584 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-828f9351-a6dc-4bd2-b9ab-588458d15e02 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:36.526177 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-828f9351-a6dc-4bd2-b9ab-588458d15e02 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:36.714741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-828f9351-a6dc-4bd2-b9ab-588458d15e02 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:36.726775 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-828f9351-a6dc-4bd2-b9ab-588458d15e02 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1696 microversion: 2.1 time: 0.240331 Sep 08 14:16:36.727504 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3546/7220] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:36 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1696 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:37.753456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-14968987-7ec8-4727-a9a3-62bd87f7211a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:37.754798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-14968987-7ec8-4727-a9a3-62bd87f7211a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:37.762996 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14968987-7ec8-4727-a9a3-62bd87f7211a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:37.763768 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14968987-7ec8-4727-a9a3-62bd87f7211a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:37.764198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14968987-7ec8-4727-a9a3-62bd87f7211a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:37.764982 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14968987-7ec8-4727-a9a3-62bd87f7211a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:37.765474 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14968987-7ec8-4727-a9a3-62bd87f7211a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:37.765917 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-14968987-7ec8-4727-a9a3-62bd87f7211a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:37.943267 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-14968987-7ec8-4727-a9a3-62bd87f7211a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:37.955206 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-14968987-7ec8-4727-a9a3-62bd87f7211a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1696 microversion: 2.1 time: 0.205584 Sep 08 14:16:37.955206 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3675/7221] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:37 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1696 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:38.990876 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-773b2927-680f-4c33-a22c-02ecc551b2e4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:38.991669 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-773b2927-680f-4c33-a22c-02ecc551b2e4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:39.000120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-773b2927-680f-4c33-a22c-02ecc551b2e4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:39.000627 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-773b2927-680f-4c33-a22c-02ecc551b2e4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:39.001067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-773b2927-680f-4c33-a22c-02ecc551b2e4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:39.001807 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-773b2927-680f-4c33-a22c-02ecc551b2e4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:39.002271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-773b2927-680f-4c33-a22c-02ecc551b2e4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:39.002711 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-773b2927-680f-4c33-a22c-02ecc551b2e4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:39.264693 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-773b2927-680f-4c33-a22c-02ecc551b2e4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:39.274439 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-773b2927-680f-4c33-a22c-02ecc551b2e4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1678 microversion: 2.1 time: 0.288844 Sep 08 14:16:39.275051 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3547/7222] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:38 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1678 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:40.298974 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c9c8e4b5-41e9-41f7-807b-9f8aee883572 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:40.299724 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c9c8e4b5-41e9-41f7-807b-9f8aee883572 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:40.307621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9c8e4b5-41e9-41f7-807b-9f8aee883572 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:40.308127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9c8e4b5-41e9-41f7-807b-9f8aee883572 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:40.308581 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9c8e4b5-41e9-41f7-807b-9f8aee883572 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:40.309299 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9c8e4b5-41e9-41f7-807b-9f8aee883572 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:40.309771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9c8e4b5-41e9-41f7-807b-9f8aee883572 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:40.310237 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c9c8e4b5-41e9-41f7-807b-9f8aee883572 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:40.449860 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c9c8e4b5-41e9-41f7-807b-9f8aee883572 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:40.458123 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c9c8e4b5-41e9-41f7-807b-9f8aee883572 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1678 microversion: 2.1 time: 0.163089 Sep 08 14:16:40.458731 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3676/7223] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:40 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:16:41.482127 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f7fd1d93-0d1a-40ef-8ad2-a5661dba25a8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:41.482795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f7fd1d93-0d1a-40ef-8ad2-a5661dba25a8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:41.490325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7fd1d93-0d1a-40ef-8ad2-a5661dba25a8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:41.490870 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7fd1d93-0d1a-40ef-8ad2-a5661dba25a8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:41.491352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7fd1d93-0d1a-40ef-8ad2-a5661dba25a8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:41.492054 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7fd1d93-0d1a-40ef-8ad2-a5661dba25a8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:41.492516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7fd1d93-0d1a-40ef-8ad2-a5661dba25a8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:41.492943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7fd1d93-0d1a-40ef-8ad2-a5661dba25a8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:41.636635 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f7fd1d93-0d1a-40ef-8ad2-a5661dba25a8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:41.644474 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f7fd1d93-0d1a-40ef-8ad2-a5661dba25a8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1621 microversion: 2.1 time: 0.166453 Sep 08 14:16:41.645042 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3548/7224] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:41 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1621 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:41.666944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-86ec4f21-bfe4-4ceb-87c1-943be95c7af9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:16:41.667579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-86ec4f21-bfe4-4ceb-87c1-943be95c7af9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:41.674320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86ec4f21-bfe4-4ceb-87c1-943be95c7af9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:41.674812 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86ec4f21-bfe4-4ceb-87c1-943be95c7af9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:41.675286 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86ec4f21-bfe4-4ceb-87c1-943be95c7af9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:41.676015 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86ec4f21-bfe4-4ceb-87c1-943be95c7af9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:41.676999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86ec4f21-bfe4-4ceb-87c1-943be95c7af9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:41.677430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-86ec4f21-bfe4-4ceb-87c1-943be95c7af9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:41.726894 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-86ec4f21-bfe4-4ceb-87c1-943be95c7af9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128970) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 14:16:41.798761 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-86ec4f21-bfe4-4ceb-87c1-943be95c7af9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "POST /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af/action" status: 202 len: 0 microversion: 2.1 time: 0.135680 Sep 08 14:16:41.799420 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3677/7225] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:16:41 2022] POST /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:16:41.808294 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b4d4362d-d72d-4c64-86b5-452976fe0031 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:41.809010 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-b4d4362d-d72d-4c64-86b5-452976fe0031 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:41.815157 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4d4362d-d72d-4c64-86b5-452976fe0031 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:41.815674 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4d4362d-d72d-4c64-86b5-452976fe0031 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:41.816113 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4d4362d-d72d-4c64-86b5-452976fe0031 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:41.817435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4d4362d-d72d-4c64-86b5-452976fe0031 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:41.817902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4d4362d-d72d-4c64-86b5-452976fe0031 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:41.818328 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-b4d4362d-d72d-4c64-86b5-452976fe0031 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:41.965251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-b4d4362d-d72d-4c64-86b5-452976fe0031 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:41.974304 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b4d4362d-d72d-4c64-86b5-452976fe0031 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1629 microversion: 2.1 time: 0.170001 Sep 08 14:16:41.974910 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3549/7226] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:41 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1629 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:43.003456 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9638607f-35d6-4d3f-9246-81e7c68df102 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:43.004265 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9638607f-35d6-4d3f-9246-81e7c68df102 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:43.010390 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9638607f-35d6-4d3f-9246-81e7c68df102 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:43.010900 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9638607f-35d6-4d3f-9246-81e7c68df102 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:43.011386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9638607f-35d6-4d3f-9246-81e7c68df102 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:43.012103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9638607f-35d6-4d3f-9246-81e7c68df102 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:43.012577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9638607f-35d6-4d3f-9246-81e7c68df102 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:43.013027 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9638607f-35d6-4d3f-9246-81e7c68df102 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:43.156991 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9638607f-35d6-4d3f-9246-81e7c68df102 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:43.167075 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9638607f-35d6-4d3f-9246-81e7c68df102 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.168527 Sep 08 14:16:43.167724 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3678/7227] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:42 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:43.409722 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-6b69b5bf-60ca-4e58-bb0a-254b84f91abd req-2c91562f-3808-433e-85a1-b417efe6ddb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e15c30-1629-431d-bd98-781c4661e8af", "name": "network-vif-unplugged", "status": "completed", "tag": "ba8a99d9-7ca7-4141-bce0-4be4df2536c9"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:16:43.428606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6b69b5bf-60ca-4e58-bb0a-254b84f91abd req-2c91562f-3808-433e-85a1-b417efe6ddb1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:43.430781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6b69b5bf-60ca-4e58-bb0a-254b84f91abd req-2c91562f-3808-433e-85a1-b417efe6ddb1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:43.431360 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-6b69b5bf-60ca-4e58-bb0a-254b84f91abd req-2c91562f-3808-433e-85a1-b417efe6ddb1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:43.445708 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-6b69b5bf-60ca-4e58-bb0a-254b84f91abd req-2c91562f-3808-433e-85a1-b417efe6ddb1 service nova] Creating event network-vif-unplugged:ba8a99d9-7ca7-4141-bce0-4be4df2536c9 for instance f7e15c30-1629-431d-bd98-781c4661e8af on n-h1-852084-10 Sep 08 14:16:43.452723 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-6b69b5bf-60ca-4e58-bb0a-254b84f91abd req-2c91562f-3808-433e-85a1-b417efe6ddb1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047199 Sep 08 14:16:43.454398 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3550/7228] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:16:44.194652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bca2373d-c6a3-433a-917c-010e1cafffaf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:44.195356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bca2373d-c6a3-433a-917c-010e1cafffaf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:44.202644 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bca2373d-c6a3-433a-917c-010e1cafffaf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:44.203187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bca2373d-c6a3-433a-917c-010e1cafffaf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:44.203830 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bca2373d-c6a3-433a-917c-010e1cafffaf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:44.204701 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bca2373d-c6a3-433a-917c-010e1cafffaf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:44.205306 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bca2373d-c6a3-433a-917c-010e1cafffaf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:44.205624 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bca2373d-c6a3-433a-917c-010e1cafffaf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:44.211035 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:44.232225 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9366dcbd-557f-40e7-b51f-253b8ec1ca26 req-16996bad-b47c-4778-9f43-3818a8d61f59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e15c30-1629-431d-bd98-781c4661e8af", "tag": "ba8a99d9-7ca7-4141-bce0-4be4df2536c9"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:16:44.245600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9366dcbd-557f-40e7-b51f-253b8ec1ca26 req-16996bad-b47c-4778-9f43-3818a8d61f59 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:44.246561 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9366dcbd-557f-40e7-b51f-253b8ec1ca26 req-16996bad-b47c-4778-9f43-3818a8d61f59 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:44.247060 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9366dcbd-557f-40e7-b51f-253b8ec1ca26 req-16996bad-b47c-4778-9f43-3818a8d61f59 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:44.260643 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9366dcbd-557f-40e7-b51f-253b8ec1ca26 req-16996bad-b47c-4778-9f43-3818a8d61f59 service nova] Creating event network-changed:ba8a99d9-7ca7-4141-bce0-4be4df2536c9 for instance f7e15c30-1629-431d-bd98-781c4661e8af on n-h1-852084-10 Sep 08 14:16:44.268641 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9366dcbd-557f-40e7-b51f-253b8ec1ca26 req-16996bad-b47c-4778-9f43-3818a8d61f59 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042731 Sep 08 14:16:44.269265 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3551/7229] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:16:44.381723 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bca2373d-c6a3-433a-917c-010e1cafffaf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:44.390210 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bca2373d-c6a3-433a-917c-010e1cafffaf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.200564 Sep 08 14:16:44.390821 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3679/7230] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:44 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:45.416379 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ac04c607-9b73-4cae-ac2d-849bd9c66e12 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:45.417086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ac04c607-9b73-4cae-ac2d-849bd9c66e12 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:45.423609 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac04c607-9b73-4cae-ac2d-849bd9c66e12 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:45.424098 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac04c607-9b73-4cae-ac2d-849bd9c66e12 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:45.424543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac04c607-9b73-4cae-ac2d-849bd9c66e12 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:45.425235 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac04c607-9b73-4cae-ac2d-849bd9c66e12 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:45.425720 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac04c607-9b73-4cae-ac2d-849bd9c66e12 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:45.426653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ac04c607-9b73-4cae-ac2d-849bd9c66e12 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:45.631338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ac04c607-9b73-4cae-ac2d-849bd9c66e12 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:45.633944 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=87 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:45.641719 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ac04c607-9b73-4cae-ac2d-849bd9c66e12 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.231162 Sep 08 14:16:45.642589 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3552/7231] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:45 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:46.687971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2eddc6cc-d418-4953-84dc-e895cc7408ad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:46.689258 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2eddc6cc-d418-4953-84dc-e895cc7408ad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:46.694039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:46.704017 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2eddc6cc-d418-4953-84dc-e895cc7408ad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:46.704538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2eddc6cc-d418-4953-84dc-e895cc7408ad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:46.705098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2eddc6cc-d418-4953-84dc-e895cc7408ad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:46.705891 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2eddc6cc-d418-4953-84dc-e895cc7408ad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:46.706368 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2eddc6cc-d418-4953-84dc-e895cc7408ad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:46.706809 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2eddc6cc-d418-4953-84dc-e895cc7408ad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:46.870475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2eddc6cc-d418-4953-84dc-e895cc7408ad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:46.881093 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2eddc6cc-d418-4953-84dc-e895cc7408ad tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.205078 Sep 08 14:16:46.883391 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3680/7232] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:46 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:47.907587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0ac0f22a-ae9d-4f48-9ddc-38dd92ada7d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:47.908133 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0ac0f22a-ae9d-4f48-9ddc-38dd92ada7d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:47.911097 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=33 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:16:47.917210 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ac0f22a-ae9d-4f48-9ddc-38dd92ada7d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:47.917707 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ac0f22a-ae9d-4f48-9ddc-38dd92ada7d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:47.918146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ac0f22a-ae9d-4f48-9ddc-38dd92ada7d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:47.918856 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ac0f22a-ae9d-4f48-9ddc-38dd92ada7d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:47.919350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ac0f22a-ae9d-4f48-9ddc-38dd92ada7d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:47.919780 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0ac0f22a-ae9d-4f48-9ddc-38dd92ada7d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:48.079945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0ac0f22a-ae9d-4f48-9ddc-38dd92ada7d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:48.088752 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0ac0f22a-ae9d-4f48-9ddc-38dd92ada7d5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.185204 Sep 08 14:16:48.089352 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3553/7233] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:47 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:49.114971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-b2b5641b-e1b2-4ca8-8637-467ceb567577 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:49.115640 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-b2b5641b-e1b2-4ca8-8637-467ceb567577 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:49.122703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2b5641b-e1b2-4ca8-8637-467ceb567577 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:49.123198 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2b5641b-e1b2-4ca8-8637-467ceb567577 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:49.123670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2b5641b-e1b2-4ca8-8637-467ceb567577 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:49.124365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2b5641b-e1b2-4ca8-8637-467ceb567577 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:49.124829 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2b5641b-e1b2-4ca8-8637-467ceb567577 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:49.125261 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-b2b5641b-e1b2-4ca8-8637-467ceb567577 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:49.276567 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-b2b5641b-e1b2-4ca8-8637-467ceb567577 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:49.284908 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-b2b5641b-e1b2-4ca8-8637-467ceb567577 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.174691 Sep 08 14:16:49.285766 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3681/7234] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:49 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:50.310198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-262589a9-ee6f-4dd8-9aa4-dd85611bc1cf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:50.310883 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-262589a9-ee6f-4dd8-9aa4-dd85611bc1cf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:50.319550 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-262589a9-ee6f-4dd8-9aa4-dd85611bc1cf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:50.320065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-262589a9-ee6f-4dd8-9aa4-dd85611bc1cf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:50.320505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-262589a9-ee6f-4dd8-9aa4-dd85611bc1cf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:50.321844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-262589a9-ee6f-4dd8-9aa4-dd85611bc1cf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:50.321844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-262589a9-ee6f-4dd8-9aa4-dd85611bc1cf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:50.322173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-262589a9-ee6f-4dd8-9aa4-dd85611bc1cf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:50.479997 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-262589a9-ee6f-4dd8-9aa4-dd85611bc1cf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:50.489832 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-262589a9-ee6f-4dd8-9aa4-dd85611bc1cf tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.183694 Sep 08 14:16:50.491018 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3554/7235] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:50 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:51.517428 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5579a8b3-6caf-4a2a-8a7f-324ec33e6e0c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:51.518459 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5579a8b3-6caf-4a2a-8a7f-324ec33e6e0c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:51.527452 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5579a8b3-6caf-4a2a-8a7f-324ec33e6e0c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:51.527977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5579a8b3-6caf-4a2a-8a7f-324ec33e6e0c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:51.528425 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5579a8b3-6caf-4a2a-8a7f-324ec33e6e0c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:51.529211 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5579a8b3-6caf-4a2a-8a7f-324ec33e6e0c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:51.529679 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5579a8b3-6caf-4a2a-8a7f-324ec33e6e0c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:51.530116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5579a8b3-6caf-4a2a-8a7f-324ec33e6e0c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:51.734021 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5579a8b3-6caf-4a2a-8a7f-324ec33e6e0c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:51.743508 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5579a8b3-6caf-4a2a-8a7f-324ec33e6e0c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.229974 Sep 08 14:16:51.744156 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3682/7236] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:51 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:52.768299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-7159296b-251b-43ae-9da2-5a3f6503f58f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:52.769025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-7159296b-251b-43ae-9da2-5a3f6503f58f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:52.779070 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7159296b-251b-43ae-9da2-5a3f6503f58f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:52.779653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7159296b-251b-43ae-9da2-5a3f6503f58f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:52.780101 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7159296b-251b-43ae-9da2-5a3f6503f58f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:52.780839 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7159296b-251b-43ae-9da2-5a3f6503f58f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:52.781300 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7159296b-251b-43ae-9da2-5a3f6503f58f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:52.781731 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-7159296b-251b-43ae-9da2-5a3f6503f58f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:52.936115 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-7159296b-251b-43ae-9da2-5a3f6503f58f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:52.947050 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-7159296b-251b-43ae-9da2-5a3f6503f58f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.182646 Sep 08 14:16:52.947771 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3555/7237] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:52 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:16:53.971853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2536e043-7132-40e8-991d-d262bba527af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:53.972507 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2536e043-7132-40e8-991d-d262bba527af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:53.980835 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2536e043-7132-40e8-991d-d262bba527af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:53.981345 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2536e043-7132-40e8-991d-d262bba527af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:53.981805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2536e043-7132-40e8-991d-d262bba527af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:53.982681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2536e043-7132-40e8-991d-d262bba527af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:53.983158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2536e043-7132-40e8-991d-d262bba527af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:53.983629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2536e043-7132-40e8-991d-d262bba527af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:54.152941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2536e043-7132-40e8-991d-d262bba527af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:54.161103 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2536e043-7132-40e8-991d-d262bba527af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.193172 Sep 08 14:16:54.161936 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3683/7238] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:53 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:55.184682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-49c3d1a8-785d-4b46-a7d9-92f1984d19d1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:55.185283 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-49c3d1a8-785d-4b46-a7d9-92f1984d19d1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:55.192255 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49c3d1a8-785d-4b46-a7d9-92f1984d19d1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:55.192740 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49c3d1a8-785d-4b46-a7d9-92f1984d19d1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:55.193175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49c3d1a8-785d-4b46-a7d9-92f1984d19d1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:55.193880 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49c3d1a8-785d-4b46-a7d9-92f1984d19d1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:55.194316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49c3d1a8-785d-4b46-a7d9-92f1984d19d1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:55.194752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-49c3d1a8-785d-4b46-a7d9-92f1984d19d1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:55.325381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-49c3d1a8-785d-4b46-a7d9-92f1984d19d1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:55.333622 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-49c3d1a8-785d-4b46-a7d9-92f1984d19d1 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.152919 Sep 08 14:16:55.334196 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3556/7239] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:55 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:56.357677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-94052b08-89c8-4134-b5cd-d2acc602ac0b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:56.358311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-94052b08-89c8-4134-b5cd-d2acc602ac0b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:56.365314 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94052b08-89c8-4134-b5cd-d2acc602ac0b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:56.365752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94052b08-89c8-4134-b5cd-d2acc602ac0b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:56.366202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94052b08-89c8-4134-b5cd-d2acc602ac0b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:56.366901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94052b08-89c8-4134-b5cd-d2acc602ac0b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:56.367405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94052b08-89c8-4134-b5cd-d2acc602ac0b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:56.367843 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-94052b08-89c8-4134-b5cd-d2acc602ac0b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:56.501426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-94052b08-89c8-4134-b5cd-d2acc602ac0b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:56.509804 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-94052b08-89c8-4134-b5cd-d2acc602ac0b tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.156056 Sep 08 14:16:56.510364 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3684/7240] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:56 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:57.534125 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-56604ae2-ece2-4af8-adf1-ecb43f125bbc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:57.534749 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-56604ae2-ece2-4af8-adf1-ecb43f125bbc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:57.541708 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56604ae2-ece2-4af8-adf1-ecb43f125bbc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:57.542196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56604ae2-ece2-4af8-adf1-ecb43f125bbc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:57.542642 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56604ae2-ece2-4af8-adf1-ecb43f125bbc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:57.543363 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56604ae2-ece2-4af8-adf1-ecb43f125bbc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:57.543827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56604ae2-ece2-4af8-adf1-ecb43f125bbc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:57.544257 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-56604ae2-ece2-4af8-adf1-ecb43f125bbc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:57.674191 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-56604ae2-ece2-4af8-adf1-ecb43f125bbc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:57.682736 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-56604ae2-ece2-4af8-adf1-ecb43f125bbc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.152509 Sep 08 14:16:57.683365 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3557/7241] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:57 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:58.707420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-211c51f9-f3bb-4d8b-be00-4dff78de0d7d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:58.708062 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-211c51f9-f3bb-4d8b-be00-4dff78de0d7d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:58.715215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211c51f9-f3bb-4d8b-be00-4dff78de0d7d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:58.715762 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211c51f9-f3bb-4d8b-be00-4dff78de0d7d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:58.716224 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211c51f9-f3bb-4d8b-be00-4dff78de0d7d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:58.716950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211c51f9-f3bb-4d8b-be00-4dff78de0d7d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:58.717426 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211c51f9-f3bb-4d8b-be00-4dff78de0d7d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:58.717871 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-211c51f9-f3bb-4d8b-be00-4dff78de0d7d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:58.863498 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-211c51f9-f3bb-4d8b-be00-4dff78de0d7d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:16:58.875372 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-211c51f9-f3bb-4d8b-be00-4dff78de0d7d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.171967 Sep 08 14:16:58.875973 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3685/7242] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:58 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:16:59.900475 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ca070cb2-44a3-4294-bbdb-6317400737f4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:16:59.901021 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ca070cb2-44a3-4294-bbdb-6317400737f4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:16:59.908520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca070cb2-44a3-4294-bbdb-6317400737f4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:59.909003 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca070cb2-44a3-4294-bbdb-6317400737f4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:59.910057 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca070cb2-44a3-4294-bbdb-6317400737f4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:16:59.910254 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca070cb2-44a3-4294-bbdb-6317400737f4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:16:59.910571 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca070cb2-44a3-4294-bbdb-6317400737f4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:16:59.910995 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca070cb2-44a3-4294-bbdb-6317400737f4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:17:00.052149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ca070cb2-44a3-4294-bbdb-6317400737f4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:17:00.056970 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ca070cb2-44a3-4294-bbdb-6317400737f4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.160461 Sep 08 14:17:00.057588 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3558/7243] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:16:59 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:17:00.743357 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-1e6133a9-d000-4c7a-b8d1-e1db09d43086 req-303f395a-d4d3-4b8d-8fbd-3127ddcd36c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e15c30-1629-431d-bd98-781c4661e8af", "name": "network-vif-plugged", "status": "completed", "tag": "ba8a99d9-7ca7-4141-bce0-4be4df2536c9"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:17:00.753969 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1e6133a9-d000-4c7a-b8d1-e1db09d43086 req-303f395a-d4d3-4b8d-8fbd-3127ddcd36c3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:17:00.754525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1e6133a9-d000-4c7a-b8d1-e1db09d43086 req-303f395a-d4d3-4b8d-8fbd-3127ddcd36c3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:17:00.754979 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-1e6133a9-d000-4c7a-b8d1-e1db09d43086 req-303f395a-d4d3-4b8d-8fbd-3127ddcd36c3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:17:00.766400 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-1e6133a9-d000-4c7a-b8d1-e1db09d43086 req-303f395a-d4d3-4b8d-8fbd-3127ddcd36c3 service nova] Creating event network-vif-plugged:ba8a99d9-7ca7-4141-bce0-4be4df2536c9 for instance f7e15c30-1629-431d-bd98-781c4661e8af on n-h1-852084-10 Sep 08 14:17:00.771639 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-1e6133a9-d000-4c7a-b8d1-e1db09d43086 req-303f395a-d4d3-4b8d-8fbd-3127ddcd36c3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033074 Sep 08 14:17:00.772418 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3686/7244] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:17:01.082448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-62258f96-0c7a-4822-bc81-fd4fd27a9e57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:17:01.083067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-62258f96-0c7a-4822-bc81-fd4fd27a9e57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:17:01.090185 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62258f96-0c7a-4822-bc81-fd4fd27a9e57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:17:01.090676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62258f96-0c7a-4822-bc81-fd4fd27a9e57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:17:01.091119 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62258f96-0c7a-4822-bc81-fd4fd27a9e57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:17:01.091874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62258f96-0c7a-4822-bc81-fd4fd27a9e57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:17:01.092331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62258f96-0c7a-4822-bc81-fd4fd27a9e57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:17:01.092757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-62258f96-0c7a-4822-bc81-fd4fd27a9e57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:17:01.228652 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-62258f96-0c7a-4822-bc81-fd4fd27a9e57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:17:01.236458 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-62258f96-0c7a-4822-bc81-fd4fd27a9e57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.159228 Sep 08 14:17:01.237035 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3559/7245] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:17:01 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:17:02.262022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-36e5f0bb-cc24-492e-bfb4-5a9f7eafcbe3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:17:02.262786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-36e5f0bb-cc24-492e-bfb4-5a9f7eafcbe3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:17:02.270882 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36e5f0bb-cc24-492e-bfb4-5a9f7eafcbe3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:17:02.271529 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36e5f0bb-cc24-492e-bfb4-5a9f7eafcbe3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:17:02.271988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36e5f0bb-cc24-492e-bfb4-5a9f7eafcbe3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:17:02.272868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36e5f0bb-cc24-492e-bfb4-5a9f7eafcbe3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:17:02.273268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36e5f0bb-cc24-492e-bfb4-5a9f7eafcbe3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:17:02.273707 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-36e5f0bb-cc24-492e-bfb4-5a9f7eafcbe3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:17:02.415971 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-36e5f0bb-cc24-492e-bfb4-5a9f7eafcbe3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:17:02.424232 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-36e5f0bb-cc24-492e-bfb4-5a9f7eafcbe3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1687 microversion: 2.1 time: 0.167347 Sep 08 14:17:02.424818 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3687/7246] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:17:02 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:17:03.448301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-1c232803-dc42-4307-a43e-d3e490bad99d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:17:03.448911 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-1c232803-dc42-4307-a43e-d3e490bad99d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:17:03.455912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c232803-dc42-4307-a43e-d3e490bad99d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:17:03.456399 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c232803-dc42-4307-a43e-d3e490bad99d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:17:03.456838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c232803-dc42-4307-a43e-d3e490bad99d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:17:03.457586 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c232803-dc42-4307-a43e-d3e490bad99d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:17:03.458023 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c232803-dc42-4307-a43e-d3e490bad99d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:17:03.458453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-1c232803-dc42-4307-a43e-d3e490bad99d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:17:03.592228 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-1c232803-dc42-4307-a43e-d3e490bad99d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:17:03.600161 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-1c232803-dc42-4307-a43e-d3e490bad99d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1674 microversion: 2.1 time: 0.155854 Sep 08 14:17:03.600743 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3560/7247] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:17:03 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:17.361774 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=15 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:17.364364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=15 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:17.364925 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=49 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:17.366165 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:18:17.366477 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 14:18:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Sep 08 14:18:17.369422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=48 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:17.374699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c23e2001-da41-4117-b6a8-10349192e8c0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:17.375210 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c23e2001-da41-4117-b6a8-10349192e8c0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:17.382430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-d726e3a6-5fe1-415e-b364-6864761c1419 req-118c61c6-c78d-4d18-ad2f-7ca67b448ef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e15c30-1629-431d-bd98-781c4661e8af", "tag": "ba8a99d9-7ca7-4141-bce0-4be4df2536c9"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:18:17.385541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c23e2001-da41-4117-b6a8-10349192e8c0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:17.386116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c23e2001-da41-4117-b6a8-10349192e8c0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:17.386665 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c23e2001-da41-4117-b6a8-10349192e8c0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:17.387486 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c23e2001-da41-4117-b6a8-10349192e8c0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:17.388023 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c23e2001-da41-4117-b6a8-10349192e8c0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:17.388530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c23e2001-da41-4117-b6a8-10349192e8c0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:17.394549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d726e3a6-5fe1-415e-b364-6864761c1419 req-118c61c6-c78d-4d18-ad2f-7ca67b448ef1 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:17.395086 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d726e3a6-5fe1-415e-b364-6864761c1419 req-118c61c6-c78d-4d18-ad2f-7ca67b448ef1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:17.395567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-d726e3a6-5fe1-415e-b364-6864761c1419 req-118c61c6-c78d-4d18-ad2f-7ca67b448ef1 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:17.411201 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-d726e3a6-5fe1-415e-b364-6864761c1419 req-118c61c6-c78d-4d18-ad2f-7ca67b448ef1 service nova] Creating event network-changed:ba8a99d9-7ca7-4141-bce0-4be4df2536c9 for instance f7e15c30-1629-431d-bd98-781c4661e8af on n-h1-852084-10 Sep 08 14:18:17.416587 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-d726e3a6-5fe1-415e-b364-6864761c1419 req-118c61c6-c78d-4d18-ad2f-7ca67b448ef1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056501 Sep 08 14:18:17.417230 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3561/7248] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:18:17.422784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c23e2001-da41-4117-b6a8-10349192e8c0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:18:17.515939 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c23e2001-da41-4117-b6a8-10349192e8c0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 204 len: 0 microversion: 2.1 time: 0.157531 Sep 08 14:18:17.517486 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3688/7249] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 14:18:17 2022] DELETE /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:18:17.526698 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bc42083a-1de3-4e22-8d09-0b77d098124a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:17.527824 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bc42083a-1de3-4e22-8d09-0b77d098124a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:17.534511 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc42083a-1de3-4e22-8d09-0b77d098124a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:17.535018 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc42083a-1de3-4e22-8d09-0b77d098124a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:17.535494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc42083a-1de3-4e22-8d09-0b77d098124a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:17.536215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc42083a-1de3-4e22-8d09-0b77d098124a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:17.536676 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc42083a-1de3-4e22-8d09-0b77d098124a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:17.537301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc42083a-1de3-4e22-8d09-0b77d098124a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:17.718675 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bc42083a-1de3-4e22-8d09-0b77d098124a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:17.727905 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bc42083a-1de3-4e22-8d09-0b77d098124a tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1680 microversion: 2.1 time: 0.205582 Sep 08 14:18:17.728539 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3562/7250] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:17 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:18.753690 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-0f248b57-3559-474b-81f7-0ed4fc410c4d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:18.754422 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-0f248b57-3559-474b-81f7-0ed4fc410c4d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:18.761608 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f248b57-3559-474b-81f7-0ed4fc410c4d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:18.762114 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f248b57-3559-474b-81f7-0ed4fc410c4d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:18.762566 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f248b57-3559-474b-81f7-0ed4fc410c4d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:18.763313 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f248b57-3559-474b-81f7-0ed4fc410c4d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:18.763786 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f248b57-3559-474b-81f7-0ed4fc410c4d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:18.764228 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-0f248b57-3559-474b-81f7-0ed4fc410c4d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:18.975598 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-0f248b57-3559-474b-81f7-0ed4fc410c4d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:18.984212 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-0f248b57-3559-474b-81f7-0ed4fc410c4d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 200 len: 1680 microversion: 2.1 time: 0.235249 Sep 08 14:18:18.985173 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3689/7251] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:18 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 1680 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:19.435910 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-0a3054aa-07c1-4ae6-b1ed-28d12613c335 req-0f6c52fc-e6b6-4bfc-8543-5078f6829222 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e15c30-1629-431d-bd98-781c4661e8af", "name": "network-vif-deleted", "tag": "ba8a99d9-7ca7-4141-bce0-4be4df2536c9"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:18:19.446035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0a3054aa-07c1-4ae6-b1ed-28d12613c335 req-0f6c52fc-e6b6-4bfc-8543-5078f6829222 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:19.446520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0a3054aa-07c1-4ae6-b1ed-28d12613c335 req-0f6c52fc-e6b6-4bfc-8543-5078f6829222 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:19.446972 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-0a3054aa-07c1-4ae6-b1ed-28d12613c335 req-0f6c52fc-e6b6-4bfc-8543-5078f6829222 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:19.459006 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-0a3054aa-07c1-4ae6-b1ed-28d12613c335 req-0f6c52fc-e6b6-4bfc-8543-5078f6829222 service nova] Creating event network-vif-deleted:ba8a99d9-7ca7-4141-bce0-4be4df2536c9 for instance f7e15c30-1629-431d-bd98-781c4661e8af on n-h1-852084-10 Sep 08 14:18:19.464829 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-0a3054aa-07c1-4ae6-b1ed-28d12613c335 req-0f6c52fc-e6b6-4bfc-8543-5078f6829222 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032595 Sep 08 14:18:19.465512 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3563/7252] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:18:20.009072 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9a98d5c3-b5c1-46ce-9c9b-ad9964b2d400 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:20.009736 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9a98d5c3-b5c1-46ce-9c9b-ad9964b2d400 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: f7e15c30-1629-431d-bd98-781c4661e8af] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:20.017375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a98d5c3-b5c1-46ce-9c9b-ad9964b2d400 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:20.017924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a98d5c3-b5c1-46ce-9c9b-ad9964b2d400 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:20.018577 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a98d5c3-b5c1-46ce-9c9b-ad9964b2d400 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:20.019356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a98d5c3-b5c1-46ce-9c9b-ad9964b2d400 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:20.019913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a98d5c3-b5c1-46ce-9c9b-ad9964b2d400 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:20.020364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9a98d5c3-b5c1-46ce-9c9b-ad9964b2d400 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:20.038590 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-9a98d5c3-b5c1-46ce-9c9b-ad9964b2d400 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] HTTP exception thrown: Instance f7e15c30-1629-431d-bd98-781c4661e8af could not be found. Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9a98d5c3-b5c1-46ce-9c9b-ad9964b2d400 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Request method failure captured: Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af HTTP/1.1 Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfifqZhPOOzhKqYOLmKyiKrcqhFxnwHO50Ukju3zkoKgtPU2Lyb865qQL2TrC01Eg0D0XHtscoOWWYJWYpyCaZ9lB-RhKW03SuNun6XuaLwHgtuwuOiOWHs7rFN1lUkOUl0G8a1vfvtjm2ISU8KXSVHC1OSCG-q9817cLQqDOtOlvH4 Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: 7fc4a9585e9d42a5967157bd8f1ecdbf Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestShelveInstance-1964707081 Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7fc4a9585e9d42a5967157bd8f1ecdbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7fc4a9585e9d42a5967157bd8f1ecdbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7fc4a9585e9d42a5967157bd8f1ecdbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7fc4a9585e9d42a5967157bd8f1ecdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestShelveInstance-1964707081 Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: 7fc4a9585e9d42a5967157bd8f1ecdbf Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestShelveInstance-1964707081 Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestShelveInstance-1964707081-project Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: b173d117bd5c4130b4d1d093a61b0047 Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestShelveInstance-1964707081-project Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance f7e15c30-1629-431d-bd98-781c4661e8af could not be found. Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'f7e15c30-1629-431d-bd98-781c4661e8af'} Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e15c30-1629-431d-bd98-781c4661e8af could not be found. Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e15c30-1629-431d-bd98-781c4661e8af could not be found. Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:18:20.040342 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:18:20.046202 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:18:20.046202 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:18:20.046202 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:18:20.046202 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:18:20.046202 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:18:20.046202 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e15c30-1629-431d-bd98-781c4661e8af could not be found. Sep 08 14:18:20.046202 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:18:20.046202 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9a98d5c3-b5c1-46ce-9c9b-ad9964b2d400 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Returning 404 to user: Instance f7e15c30-1629-431d-bd98-781c4661e8af could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:18:20.046202 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9a98d5c3-b5c1-46ce-9c9b-ad9964b2d400 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af" status: 404 len: 111 microversion: 2.1 time: 0.036796 Sep 08 14:18:20.046202 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3690/7253] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:20 2022] GET /compute/v2.1/servers/f7e15c30-1629-431d-bd98-781c4661e8af => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:18:20.209341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-b89241ae-285a-433e-b18d-fd1dbaf22ca4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '.version_select at 0x7fdb3f1a49d0>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:20.237291 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-b89241ae-285a-433e-b18d-fd1dbaf22ca4 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-654983967" status: 202 len: 0 microversion: 2.1 time: 0.031896 Sep 08 14:18:20.238285 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3564/7254] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Sep 8 14:18:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-654983967 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:18:20.265605 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2133c050-94ff-4fa6-b1a0-85a997f08879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Action: 'create', calling method: .version_select at 0x7fdb247e08b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1357341014", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDsSoyUC4Gg8p4v/QOvA0RTdiHQi67wMTshx+nAKVrm7PjTLL41X/Zyxm7VYZIXA4zHPlS751FRmdIcDTpWFJwvTnIn/SgoKIzDWX8Rj+zKelUxxzQVSzMLFaz5QTxodg=="}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:18:20.281999 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-2133c050-94ff-4fa6-b1a0-85a997f08879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Getting quotas for project 7fc4a9585e9d42a5967157bd8f1ecdbf. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:18:20.287257 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-2133c050-94ff-4fa6-b1a0-85a997f08879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Getting quotas for user b173d117bd5c4130b4d1d093a61b0047 and project 7fc4a9585e9d42a5967157bd8f1ecdbf. Resources: {'key_pairs'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:18:20.326809 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2133c050-94ff-4fa6-b1a0-85a997f08879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.065187 Sep 08 14:18:20.327453 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3691/7255] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 14:18:20 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:18:37.973577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=10 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:37.974332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:37.978700 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1379117832", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1357341014", "security_groups": [{"name": "tempest-secgroup-smoke-482482831"}], "networks": [{"uuid": "b69607d0-45d2-4a6f-8f46-077ee3757755"}], "block_device_mapping_v2": [{"uuid": "fea3e500-8c7e-4b60-ab3d-c7bd924737fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:18:38.102261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] validate_networks() for [('b69607d0-45d2-4a6f-8f46-077ee3757755', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:18:38.850183 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:18:38.850612 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:18:38.853625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:18:38.853625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:18:38.853625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:18:38.864217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:38.864714 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:38.865161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:38.865900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:38.866362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:38.866795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:38.884977 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Getting quotas for project 7fc4a9585e9d42a5967157bd8f1ecdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:18:38.890646 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Getting quotas for user b173d117bd5c4130b4d1d093a61b0047 and project 7fc4a9585e9d42a5967157bd8f1ecdbf. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:18:38.950242 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:18:38.952717 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fea3e500-8c7e-4b60-ab3d-c7bd924737fc',volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:18:39.100362 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e7501d6a-10e9-46bb-988c-b1db2a52ba25 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.129315 Sep 08 14:18:39.101320 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3565/7256] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 14:18:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:18:39.111175 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:39.112308 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:39.113045 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:39.118510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fd274e2d-90a4-48bd-9950-76df798a0b51 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:39.119090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fd274e2d-90a4-48bd-9950-76df798a0b51 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:39.244152 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fd274e2d-90a4-48bd-9950-76df798a0b51 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:39.251351 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fd274e2d-90a4-48bd-9950-76df798a0b51 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1089 microversion: 2.1 time: 0.142583 Sep 08 14:18:39.251934 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3692/7257] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:39 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1089 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:40.274505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-10339744-8860-434c-b4a2-322653c18ab5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:40.275144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-10339744-8860-434c-b4a2-322653c18ab5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:40.331049 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-10339744-8860-434c-b4a2-322653c18ab5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:40.342033 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-10339744-8860-434c-b4a2-322653c18ab5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1089 microversion: 2.1 time: 0.072300 Sep 08 14:18:40.342608 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3566/7258] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:40 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:41.365328 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-d0e938f3-fcfc-499d-a9c7-2289f5b520d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:41.365970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-d0e938f3-fcfc-499d-a9c7-2289f5b520d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:41.426958 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-d0e938f3-fcfc-499d-a9c7-2289f5b520d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:41.433977 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-d0e938f3-fcfc-499d-a9c7-2289f5b520d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1089 microversion: 2.1 time: 0.073152 Sep 08 14:18:41.434564 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3693/7259] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:41 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:42.457754 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-65d76679-70ef-49c7-97ac-6beafa041be6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:42.458486 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-65d76679-70ef-49c7-97ac-6beafa041be6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:42.513251 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-65d76679-70ef-49c7-97ac-6beafa041be6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:42.522851 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-65d76679-70ef-49c7-97ac-6beafa041be6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1089 microversion: 2.1 time: 0.069081 Sep 08 14:18:42.523500 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3567/7260] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:42 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1089 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:43.546446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a3115a33-da75-4812-85cb-4eee3adc9a62 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:43.547075 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a3115a33-da75-4812-85cb-4eee3adc9a62 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:43.555356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3115a33-da75-4812-85cb-4eee3adc9a62 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:43.555865 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3115a33-da75-4812-85cb-4eee3adc9a62 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:43.556318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3115a33-da75-4812-85cb-4eee3adc9a62 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:43.557063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3115a33-da75-4812-85cb-4eee3adc9a62 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:43.557538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3115a33-da75-4812-85cb-4eee3adc9a62 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:43.557994 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a3115a33-da75-4812-85cb-4eee3adc9a62 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:43.627119 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a3115a33-da75-4812-85cb-4eee3adc9a62 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:43.644819 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a3115a33-da75-4812-85cb-4eee3adc9a62 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1139 microversion: 2.1 time: 0.102440 Sep 08 14:18:43.660846 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3694/7261] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:43 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1139 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:44.669832 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2ee916e4-9b5a-4e2b-b85c-8f123b0e015e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:44.670485 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2ee916e4-9b5a-4e2b-b85c-8f123b0e015e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:44.680145 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ee916e4-9b5a-4e2b-b85c-8f123b0e015e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:44.680844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ee916e4-9b5a-4e2b-b85c-8f123b0e015e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:44.686805 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ee916e4-9b5a-4e2b-b85c-8f123b0e015e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:44.688356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ee916e4-9b5a-4e2b-b85c-8f123b0e015e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:44.689105 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ee916e4-9b5a-4e2b-b85c-8f123b0e015e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:44.689800 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ee916e4-9b5a-4e2b-b85c-8f123b0e015e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:44.781928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2ee916e4-9b5a-4e2b-b85c-8f123b0e015e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:44.794248 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2ee916e4-9b5a-4e2b-b85c-8f123b0e015e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1205 microversion: 2.1 time: 0.128555 Sep 08 14:18:44.805749 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3568/7262] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:44 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1205 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:45.748787 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-bfca5d46-7dbc-424d-899e-393ba525e041 req-0bd7b2a1-fe90-41c3-b818-4582566e8565 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae043457-4c08-4a7f-b6f5-d3ba24b04e03", "tag": "ac930d47-eef9-4e33-bc23-a8f20828c302"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:18:45.761150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bfca5d46-7dbc-424d-899e-393ba525e041 req-0bd7b2a1-fe90-41c3-b818-4582566e8565 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:45.761649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bfca5d46-7dbc-424d-899e-393ba525e041 req-0bd7b2a1-fe90-41c3-b818-4582566e8565 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:45.762297 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-bfca5d46-7dbc-424d-899e-393ba525e041 req-0bd7b2a1-fe90-41c3-b818-4582566e8565 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:45.775538 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-bfca5d46-7dbc-424d-899e-393ba525e041 req-0bd7b2a1-fe90-41c3-b818-4582566e8565 service nova] Creating event network-changed:ac930d47-eef9-4e33-bc23-a8f20828c302 for instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 on n-h2-852084-10 Sep 08 14:18:45.782346 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-bfca5d46-7dbc-424d-899e-393ba525e041 req-0bd7b2a1-fe90-41c3-b818-4582566e8565 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037816 Sep 08 14:18:45.783632 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3695/7263] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:18:45.821043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-8d4e66fd-6676-4455-affc-6ae5f9036737 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:45.822589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-8d4e66fd-6676-4455-affc-6ae5f9036737 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:45.837796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d4e66fd-6676-4455-affc-6ae5f9036737 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:45.839160 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d4e66fd-6676-4455-affc-6ae5f9036737 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:45.840043 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d4e66fd-6676-4455-affc-6ae5f9036737 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:45.843556 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d4e66fd-6676-4455-affc-6ae5f9036737 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:45.844878 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d4e66fd-6676-4455-affc-6ae5f9036737 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:45.845869 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-8d4e66fd-6676-4455-affc-6ae5f9036737 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:46.132126 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-8d4e66fd-6676-4455-affc-6ae5f9036737 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:46.149412 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-8d4e66fd-6676-4455-affc-6ae5f9036737 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1272 microversion: 2.1 time: 0.332169 Sep 08 14:18:46.151580 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3569/7264] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:45 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1272 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:47.176132 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9142e49e-6794-4a1c-9426-003c412baceb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:47.176754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9142e49e-6794-4a1c-9426-003c412baceb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:47.183311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9142e49e-6794-4a1c-9426-003c412baceb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:47.183813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9142e49e-6794-4a1c-9426-003c412baceb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:47.184256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9142e49e-6794-4a1c-9426-003c412baceb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:47.185118 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9142e49e-6794-4a1c-9426-003c412baceb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:47.185434 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9142e49e-6794-4a1c-9426-003c412baceb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:47.185869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9142e49e-6794-4a1c-9426-003c412baceb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:47.325654 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9142e49e-6794-4a1c-9426-003c412baceb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:47.334307 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9142e49e-6794-4a1c-9426-003c412baceb tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1272 microversion: 2.1 time: 0.163935 Sep 08 14:18:47.334890 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3696/7265] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:47 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:18:48.357725 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ea26029e-0714-4414-980f-120d524a8638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:48.358385 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ea26029e-0714-4414-980f-120d524a8638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:48.365325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea26029e-0714-4414-980f-120d524a8638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:48.365854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea26029e-0714-4414-980f-120d524a8638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:48.366331 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea26029e-0714-4414-980f-120d524a8638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:48.367134 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea26029e-0714-4414-980f-120d524a8638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:48.367657 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea26029e-0714-4414-980f-120d524a8638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:48.368117 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ea26029e-0714-4414-980f-120d524a8638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:48.506968 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ea26029e-0714-4414-980f-120d524a8638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:48.518610 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ea26029e-0714-4414-980f-120d524a8638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1272 microversion: 2.1 time: 0.164858 Sep 08 14:18:48.519407 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3570/7266] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:48 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1272 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:49.542689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1d628e8e-a9cf-43d0-b3cf-79924eb09556 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:49.543387 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1d628e8e-a9cf-43d0-b3cf-79924eb09556 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:49.550337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d628e8e-a9cf-43d0-b3cf-79924eb09556 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:49.550838 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d628e8e-a9cf-43d0-b3cf-79924eb09556 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:49.551329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d628e8e-a9cf-43d0-b3cf-79924eb09556 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:49.552056 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d628e8e-a9cf-43d0-b3cf-79924eb09556 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:49.552522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d628e8e-a9cf-43d0-b3cf-79924eb09556 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:49.552959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1d628e8e-a9cf-43d0-b3cf-79924eb09556 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:49.689656 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1d628e8e-a9cf-43d0-b3cf-79924eb09556 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:49.697670 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1d628e8e-a9cf-43d0-b3cf-79924eb09556 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1260 microversion: 2.1 time: 0.158867 Sep 08 14:18:49.698266 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3697/7267] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:49 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:50.722649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2ec61b78-a1f1-4055-aa27-d3d9570efdb3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:50.723340 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2ec61b78-a1f1-4055-aa27-d3d9570efdb3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:50.725316 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:50.732219 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ec61b78-a1f1-4055-aa27-d3d9570efdb3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:50.732744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ec61b78-a1f1-4055-aa27-d3d9570efdb3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:50.733188 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ec61b78-a1f1-4055-aa27-d3d9570efdb3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:50.733953 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ec61b78-a1f1-4055-aa27-d3d9570efdb3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:50.734423 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ec61b78-a1f1-4055-aa27-d3d9570efdb3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:50.734882 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2ec61b78-a1f1-4055-aa27-d3d9570efdb3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:50.870164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2ec61b78-a1f1-4055-aa27-d3d9570efdb3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:50.878029 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2ec61b78-a1f1-4055-aa27-d3d9570efdb3 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1260 microversion: 2.1 time: 0.160159 Sep 08 14:18:50.878613 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3571/7268] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:50 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:51.901820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fc79b3ec-55ae-4dd8-804b-7068162a38fc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:51.902391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fc79b3ec-55ae-4dd8-804b-7068162a38fc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:51.905523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=4 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:51.911158 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc79b3ec-55ae-4dd8-804b-7068162a38fc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:51.911720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc79b3ec-55ae-4dd8-804b-7068162a38fc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:51.912168 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc79b3ec-55ae-4dd8-804b-7068162a38fc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:51.912872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc79b3ec-55ae-4dd8-804b-7068162a38fc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:51.913337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc79b3ec-55ae-4dd8-804b-7068162a38fc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:51.913772 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fc79b3ec-55ae-4dd8-804b-7068162a38fc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:52.044068 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fc79b3ec-55ae-4dd8-804b-7068162a38fc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:52.052289 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fc79b3ec-55ae-4dd8-804b-7068162a38fc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1260 microversion: 2.1 time: 0.154676 Sep 08 14:18:52.052870 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3698/7269] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:51 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:53.075841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9155737e-6201-4f74-9c91-42aae76d883f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:53.076462 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9155737e-6201-4f74-9c91-42aae76d883f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:53.079629 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=10 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:18:53.085648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9155737e-6201-4f74-9c91-42aae76d883f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:53.086144 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9155737e-6201-4f74-9c91-42aae76d883f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:53.086587 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9155737e-6201-4f74-9c91-42aae76d883f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:53.087314 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9155737e-6201-4f74-9c91-42aae76d883f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:53.087777 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9155737e-6201-4f74-9c91-42aae76d883f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:53.088236 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9155737e-6201-4f74-9c91-42aae76d883f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:53.223894 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9155737e-6201-4f74-9c91-42aae76d883f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:53.231922 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9155737e-6201-4f74-9c91-42aae76d883f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1260 microversion: 2.1 time: 0.160075 Sep 08 14:18:53.232506 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3572/7270] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:53 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:54.255561 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a654488e-33b4-4ad7-8f51-c7a22179fa91 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:54.256223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a654488e-33b4-4ad7-8f51-c7a22179fa91 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:54.263842 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a654488e-33b4-4ad7-8f51-c7a22179fa91 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:54.264352 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a654488e-33b4-4ad7-8f51-c7a22179fa91 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:54.265445 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a654488e-33b4-4ad7-8f51-c7a22179fa91 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:54.266161 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a654488e-33b4-4ad7-8f51-c7a22179fa91 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:54.266643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a654488e-33b4-4ad7-8f51-c7a22179fa91 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:54.267087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a654488e-33b4-4ad7-8f51-c7a22179fa91 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:54.401493 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a654488e-33b4-4ad7-8f51-c7a22179fa91 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:54.409292 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a654488e-33b4-4ad7-8f51-c7a22179fa91 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1260 microversion: 2.1 time: 0.157784 Sep 08 14:18:54.409882 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3699/7271] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:54 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:55.432671 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d018f5f7-b8f9-4c56-994a-68709dd603c5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:55.433326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d018f5f7-b8f9-4c56-994a-68709dd603c5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:55.440913 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d018f5f7-b8f9-4c56-994a-68709dd603c5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:55.441401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d018f5f7-b8f9-4c56-994a-68709dd603c5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:55.441841 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d018f5f7-b8f9-4c56-994a-68709dd603c5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:55.442815 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d018f5f7-b8f9-4c56-994a-68709dd603c5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:55.443326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d018f5f7-b8f9-4c56-994a-68709dd603c5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:55.443741 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d018f5f7-b8f9-4c56-994a-68709dd603c5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:55.580213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d018f5f7-b8f9-4c56-994a-68709dd603c5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:55.588078 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d018f5f7-b8f9-4c56-994a-68709dd603c5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1260 microversion: 2.1 time: 0.159354 Sep 08 14:18:55.588653 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3573/7272] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:55 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:56.612208 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-81e150d1-171e-4fbf-8ec2-3e3eaae291ab tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:56.612868 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-81e150d1-171e-4fbf-8ec2-3e3eaae291ab tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:56.619964 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81e150d1-171e-4fbf-8ec2-3e3eaae291ab tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:56.620468 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81e150d1-171e-4fbf-8ec2-3e3eaae291ab tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:56.620920 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81e150d1-171e-4fbf-8ec2-3e3eaae291ab tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:56.621627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81e150d1-171e-4fbf-8ec2-3e3eaae291ab tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:56.622098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81e150d1-171e-4fbf-8ec2-3e3eaae291ab tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:56.622541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-81e150d1-171e-4fbf-8ec2-3e3eaae291ab tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:56.760504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-81e150d1-171e-4fbf-8ec2-3e3eaae291ab tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:56.768354 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-81e150d1-171e-4fbf-8ec2-3e3eaae291ab tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1260 microversion: 2.1 time: 0.160705 Sep 08 14:18:56.768937 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3700/7273] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:56 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:57.856504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2e276b8e-4e26-42c5-bfeb-37b0f87685af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:57.857213 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2e276b8e-4e26-42c5-bfeb-37b0f87685af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:57.863904 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e276b8e-4e26-42c5-bfeb-37b0f87685af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:57.864405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e276b8e-4e26-42c5-bfeb-37b0f87685af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:57.864886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e276b8e-4e26-42c5-bfeb-37b0f87685af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:57.865736 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e276b8e-4e26-42c5-bfeb-37b0f87685af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:57.866246 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e276b8e-4e26-42c5-bfeb-37b0f87685af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:57.866728 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2e276b8e-4e26-42c5-bfeb-37b0f87685af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:58.013276 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2e276b8e-4e26-42c5-bfeb-37b0f87685af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:58.022834 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2e276b8e-4e26-42c5-bfeb-37b0f87685af tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1260 microversion: 2.1 time: 0.225009 Sep 08 14:18:58.023494 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3574/7274] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:57 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1260 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:18:59.046038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-21eedab5-3021-4ff1-ace2-42a65c92e0fd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:18:59.046671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-21eedab5-3021-4ff1-ace2-42a65c92e0fd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:18:59.053814 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21eedab5-3021-4ff1-ace2-42a65c92e0fd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:59.054322 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21eedab5-3021-4ff1-ace2-42a65c92e0fd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:59.054780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21eedab5-3021-4ff1-ace2-42a65c92e0fd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:59.055522 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21eedab5-3021-4ff1-ace2-42a65c92e0fd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:18:59.056004 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21eedab5-3021-4ff1-ace2-42a65c92e0fd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:18:59.056451 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-21eedab5-3021-4ff1-ace2-42a65c92e0fd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:18:59.205913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-21eedab5-3021-4ff1-ace2-42a65c92e0fd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:18:59.214299 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-21eedab5-3021-4ff1-ace2-42a65c92e0fd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1260 microversion: 2.1 time: 0.172084 Sep 08 14:18:59.214904 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3701/7275] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:18:59 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:19:00.068326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-111ddc03-2911-4ec4-98f9-32b7a0f48c90 req-a0644411-d2ea-4d4c-9555-c057e1de2bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae043457-4c08-4a7f-b6f5-d3ba24b04e03", "name": "network-vif-plugged", "status": "completed", "tag": "ac930d47-eef9-4e33-bc23-a8f20828c302"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:19:00.078950 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-111ddc03-2911-4ec4-98f9-32b7a0f48c90 req-a0644411-d2ea-4d4c-9555-c057e1de2bdd service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:19:00.079581 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-111ddc03-2911-4ec4-98f9-32b7a0f48c90 req-a0644411-d2ea-4d4c-9555-c057e1de2bdd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:19:00.080067 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-111ddc03-2911-4ec4-98f9-32b7a0f48c90 req-a0644411-d2ea-4d4c-9555-c057e1de2bdd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:19:00.091985 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-111ddc03-2911-4ec4-98f9-32b7a0f48c90 req-a0644411-d2ea-4d4c-9555-c057e1de2bdd service nova] Creating event network-vif-plugged:ac930d47-eef9-4e33-bc23-a8f20828c302 for instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 on n-h2-852084-10 Sep 08 14:19:00.097069 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-111ddc03-2911-4ec4-98f9-32b7a0f48c90 req-a0644411-d2ea-4d4c-9555-c057e1de2bdd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033500 Sep 08 14:19:00.097725 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3575/7276] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:19:00.238162 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-febf2943-aa8c-4cc8-8596-0ee94c837879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:19:00.238798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-febf2943-aa8c-4cc8-8596-0ee94c837879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:19:00.245825 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-febf2943-aa8c-4cc8-8596-0ee94c837879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:19:00.246332 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-febf2943-aa8c-4cc8-8596-0ee94c837879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:19:00.246788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-febf2943-aa8c-4cc8-8596-0ee94c837879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:19:00.247575 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-febf2943-aa8c-4cc8-8596-0ee94c837879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:19:00.248042 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-febf2943-aa8c-4cc8-8596-0ee94c837879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:19:00.248485 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-febf2943-aa8c-4cc8-8596-0ee94c837879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:19:00.386321 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-febf2943-aa8c-4cc8-8596-0ee94c837879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:19:00.394175 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-febf2943-aa8c-4cc8-8596-0ee94c837879 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1260 microversion: 2.1 time: 0.160043 Sep 08 14:19:00.394749 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3702/7277] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:19:00 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:19:01.419044 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-0538d080-8fb9-4249-b749-ff6e6b89e654 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:19:01.419776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-0538d080-8fb9-4249-b749-ff6e6b89e654 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:19:01.426532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0538d080-8fb9-4249-b749-ff6e6b89e654 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:19:01.427017 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0538d080-8fb9-4249-b749-ff6e6b89e654 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:19:01.427477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0538d080-8fb9-4249-b749-ff6e6b89e654 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:19:01.428173 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0538d080-8fb9-4249-b749-ff6e6b89e654 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:19:01.428630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0538d080-8fb9-4249-b749-ff6e6b89e654 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:19:01.429056 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-0538d080-8fb9-4249-b749-ff6e6b89e654 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:19:01.626015 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-0538d080-8fb9-4249-b749-ff6e6b89e654 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:19:01.634146 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-0538d080-8fb9-4249-b749-ff6e6b89e654 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1444 microversion: 2.1 time: 0.220404 Sep 08 14:19:01.634748 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3576/7278] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:19:01 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1444 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:19:01.658188 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-c656b9fa-27e1-40a6-b723-9472bdec0637 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:19:01.658901 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-c656b9fa-27e1-40a6-b723-9472bdec0637 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:19:01.666039 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c656b9fa-27e1-40a6-b723-9472bdec0637 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:19:01.666548 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c656b9fa-27e1-40a6-b723-9472bdec0637 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:19:01.667003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c656b9fa-27e1-40a6-b723-9472bdec0637 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:19:01.667744 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c656b9fa-27e1-40a6-b723-9472bdec0637 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:19:01.668223 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c656b9fa-27e1-40a6-b723-9472bdec0637 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:19:01.668670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-c656b9fa-27e1-40a6-b723-9472bdec0637 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:19:01.803534 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-c656b9fa-27e1-40a6-b723-9472bdec0637 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:19:01.811827 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-c656b9fa-27e1-40a6-b723-9472bdec0637 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1444 microversion: 2.1 time: 0.157529 Sep 08 14:19:01.812405 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3703/7279] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:19:01 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1444 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:19:03.738304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-9ef70d83-db0d-4844-822d-c1794de60cfc req-e39a402f-c01d-4bff-9467-cc1f64b3bfbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae043457-4c08-4a7f-b6f5-d3ba24b04e03", "tag": "ac930d47-eef9-4e33-bc23-a8f20828c302"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:19:03.749062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9ef70d83-db0d-4844-822d-c1794de60cfc req-e39a402f-c01d-4bff-9467-cc1f64b3bfbe service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:19:03.749551 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9ef70d83-db0d-4844-822d-c1794de60cfc req-e39a402f-c01d-4bff-9467-cc1f64b3bfbe service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:19:03.749992 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-9ef70d83-db0d-4844-822d-c1794de60cfc req-e39a402f-c01d-4bff-9467-cc1f64b3bfbe service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:19:03.761534 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-9ef70d83-db0d-4844-822d-c1794de60cfc req-e39a402f-c01d-4bff-9467-cc1f64b3bfbe service nova] Creating event network-changed:ac930d47-eef9-4e33-bc23-a8f20828c302 for instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 on n-h2-852084-10 Sep 08 14:19:03.766623 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-9ef70d83-db0d-4844-822d-c1794de60cfc req-e39a402f-c01d-4bff-9467-cc1f64b3bfbe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032177 Sep 08 14:19:03.767264 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3577/7280] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:21:00.044678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=28 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:00.045475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=56 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:00.046517 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:21:00.046517 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 14:21:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03/action (ip 10.222.0.78) !!! Sep 08 14:21:00.052029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-126bf790-4801-4468-bf83-2a152bdfc086 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:21:00.052621 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-126bf790-4801-4468-bf83-2a152bdfc086 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:00.062011 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-126bf790-4801-4468-bf83-2a152bdfc086 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:00.062519 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-126bf790-4801-4468-bf83-2a152bdfc086 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:00.062983 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-126bf790-4801-4468-bf83-2a152bdfc086 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:00.063754 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-126bf790-4801-4468-bf83-2a152bdfc086 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:00.064339 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-126bf790-4801-4468-bf83-2a152bdfc086 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:00.064657 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-126bf790-4801-4468-bf83-2a152bdfc086 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:00.090453 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.objects.instance [None req-126bf790-4801-4468-bf83-2a152bdfc086 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lazy-loading 'flavor' on Instance uuid ae043457-4c08-4a7f-b6f5-d3ba24b04e03 {{(pid=128970) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:21:00.169463 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-126bf790-4801-4468-bf83-2a152bdfc086 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "POST /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03/action" status: 202 len: 0 microversion: 2.1 time: 0.126471 Sep 08 14:21:00.170252 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3704/7281] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:21:00 2022] POST /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 08 14:21:00.179219 n-d-852084-10 devstack@n-api.service[128971]: ERROR oslo.messaging._drivers.impl_rabbit [-] [31769cf6-754f-4e53-871b-651183d82573] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 08 14:21:00.181140 n-d-852084-10 devstack@n-api.service[128971]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4073da4f-db71-4c3c-9e1b-d9f532b78424] AMQP server on 10.222.0.78:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 08 14:21:00.182801 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:00.183670 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=54 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:00.184797 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 08 14:21:00.184934 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 14:21:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 (ip 10.222.0.78) !!! Sep 08 14:21:00.192563 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-695d6d9f-5c06-493b-9405-4ff5abc2156d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:00.193295 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-695d6d9f-5c06-493b-9405-4ff5abc2156d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:00.205614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-695d6d9f-5c06-493b-9405-4ff5abc2156d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:00.206282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-695d6d9f-5c06-493b-9405-4ff5abc2156d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:00.206930 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-695d6d9f-5c06-493b-9405-4ff5abc2156d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:00.207848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-695d6d9f-5c06-493b-9405-4ff5abc2156d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:00.208795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-695d6d9f-5c06-493b-9405-4ff5abc2156d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:00.209871 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-695d6d9f-5c06-493b-9405-4ff5abc2156d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:00.374606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-695d6d9f-5c06-493b-9405-4ff5abc2156d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:00.386496 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-695d6d9f-5c06-493b-9405-4ff5abc2156d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.211360 Sep 08 14:21:00.387111 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3578/7282] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:00 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:01.412233 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fdc1bd42-778b-4146-ab0d-5237a4f42a57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:01.413009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fdc1bd42-778b-4146-ab0d-5237a4f42a57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:01.422877 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdc1bd42-778b-4146-ab0d-5237a4f42a57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:01.423647 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdc1bd42-778b-4146-ab0d-5237a4f42a57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:01.424115 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdc1bd42-778b-4146-ab0d-5237a4f42a57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:01.424853 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdc1bd42-778b-4146-ab0d-5237a4f42a57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:01.425335 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdc1bd42-778b-4146-ab0d-5237a4f42a57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:01.425785 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fdc1bd42-778b-4146-ab0d-5237a4f42a57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:01.578006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fdc1bd42-778b-4146-ab0d-5237a4f42a57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:01.586478 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fdc1bd42-778b-4146-ab0d-5237a4f42a57 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.179539 Sep 08 14:21:01.587105 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3705/7283] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:01 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:02.610768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3973dae5-0de6-4d34-85ea-7b4db0cd5518 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:02.611444 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3973dae5-0de6-4d34-85ea-7b4db0cd5518 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:02.620947 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3973dae5-0de6-4d34-85ea-7b4db0cd5518 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:02.621437 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3973dae5-0de6-4d34-85ea-7b4db0cd5518 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:02.621902 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3973dae5-0de6-4d34-85ea-7b4db0cd5518 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:02.622602 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3973dae5-0de6-4d34-85ea-7b4db0cd5518 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:02.623047 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3973dae5-0de6-4d34-85ea-7b4db0cd5518 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:02.623496 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3973dae5-0de6-4d34-85ea-7b4db0cd5518 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:02.631312 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] [31769cf6-754f-4e53-871b-651183d82573] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 53040. Sep 08 14:21:02.640900 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] [4073da4f-db71-4c3c-9e1b-d9f532b78424] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 53042. Sep 08 14:21:02.756810 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3973dae5-0de6-4d34-85ea-7b4db0cd5518 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:02.764730 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3973dae5-0de6-4d34-85ea-7b4db0cd5518 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.157932 Sep 08 14:21:02.765354 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3579/7284] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:02 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:03.787941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-edc38b86-705e-4ec7-b670-4f7ee6d31a75 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:03.788610 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-edc38b86-705e-4ec7-b670-4f7ee6d31a75 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:03.796318 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edc38b86-705e-4ec7-b670-4f7ee6d31a75 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:03.796823 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edc38b86-705e-4ec7-b670-4f7ee6d31a75 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:03.797282 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edc38b86-705e-4ec7-b670-4f7ee6d31a75 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:03.797993 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edc38b86-705e-4ec7-b670-4f7ee6d31a75 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:03.798465 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edc38b86-705e-4ec7-b670-4f7ee6d31a75 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:03.798940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-edc38b86-705e-4ec7-b670-4f7ee6d31a75 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:03.937525 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-edc38b86-705e-4ec7-b670-4f7ee6d31a75 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:03.945764 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-edc38b86-705e-4ec7-b670-4f7ee6d31a75 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.161689 Sep 08 14:21:03.946364 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3706/7285] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:03 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:04.969818 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ca2e5697-09b8-4587-9e89-c055ddb3c6d2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:04.970517 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ca2e5697-09b8-4587-9e89-c055ddb3c6d2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:04.977887 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca2e5697-09b8-4587-9e89-c055ddb3c6d2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:04.978377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca2e5697-09b8-4587-9e89-c055ddb3c6d2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:04.978820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca2e5697-09b8-4587-9e89-c055ddb3c6d2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:04.979555 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca2e5697-09b8-4587-9e89-c055ddb3c6d2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:04.980013 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca2e5697-09b8-4587-9e89-c055ddb3c6d2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:04.980439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ca2e5697-09b8-4587-9e89-c055ddb3c6d2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:05.141325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ca2e5697-09b8-4587-9e89-c055ddb3c6d2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:05.149698 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ca2e5697-09b8-4587-9e89-c055ddb3c6d2 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.184006 Sep 08 14:21:05.151149 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3580/7286] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:04 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:06.174481 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-fcf6f526-bf1c-4a17-834d-5c0b2471006e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:06.175280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-fcf6f526-bf1c-4a17-834d-5c0b2471006e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:06.185413 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcf6f526-bf1c-4a17-834d-5c0b2471006e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:06.185926 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcf6f526-bf1c-4a17-834d-5c0b2471006e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:06.186420 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcf6f526-bf1c-4a17-834d-5c0b2471006e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:06.189750 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcf6f526-bf1c-4a17-834d-5c0b2471006e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:06.190255 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcf6f526-bf1c-4a17-834d-5c0b2471006e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:06.190706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-fcf6f526-bf1c-4a17-834d-5c0b2471006e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:06.333285 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-fcf6f526-bf1c-4a17-834d-5c0b2471006e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:06.342487 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-fcf6f526-bf1c-4a17-834d-5c0b2471006e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.172003 Sep 08 14:21:06.343094 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3707/7287] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:06 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:07.368036 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c4f37a93-0b1f-491a-854d-60dfb0833c82 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:07.368696 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c4f37a93-0b1f-491a-854d-60dfb0833c82 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:07.376094 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4f37a93-0b1f-491a-854d-60dfb0833c82 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:07.376594 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4f37a93-0b1f-491a-854d-60dfb0833c82 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:07.377092 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4f37a93-0b1f-491a-854d-60dfb0833c82 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:07.377877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4f37a93-0b1f-491a-854d-60dfb0833c82 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:07.378341 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4f37a93-0b1f-491a-854d-60dfb0833c82 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:07.378772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c4f37a93-0b1f-491a-854d-60dfb0833c82 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:07.539100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c4f37a93-0b1f-491a-854d-60dfb0833c82 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:07.547311 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c4f37a93-0b1f-491a-854d-60dfb0833c82 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.183255 Sep 08 14:21:07.547909 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3581/7288] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:07 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:08.572710 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-54abb204-e09b-463f-9a60-5ebfd5be34a0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:08.573759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-54abb204-e09b-463f-9a60-5ebfd5be34a0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:08.581614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54abb204-e09b-463f-9a60-5ebfd5be34a0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:08.582130 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54abb204-e09b-463f-9a60-5ebfd5be34a0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:08.582590 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54abb204-e09b-463f-9a60-5ebfd5be34a0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:08.583430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54abb204-e09b-463f-9a60-5ebfd5be34a0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:08.583915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54abb204-e09b-463f-9a60-5ebfd5be34a0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:08.584365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-54abb204-e09b-463f-9a60-5ebfd5be34a0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:08.754924 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-54abb204-e09b-463f-9a60-5ebfd5be34a0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:08.764988 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-54abb204-e09b-463f-9a60-5ebfd5be34a0 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.196942 Sep 08 14:21:08.765633 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3708/7289] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:08 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:09.790063 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c23a1da5-92db-4c99-9967-748410980bf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:09.790898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c23a1da5-92db-4c99-9967-748410980bf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:09.798682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c23a1da5-92db-4c99-9967-748410980bf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:09.799179 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c23a1da5-92db-4c99-9967-748410980bf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:09.799649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c23a1da5-92db-4c99-9967-748410980bf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:09.800367 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c23a1da5-92db-4c99-9967-748410980bf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:09.800896 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c23a1da5-92db-4c99-9967-748410980bf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:09.801330 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c23a1da5-92db-4c99-9967-748410980bf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:09.950198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-c23a1da5-92db-4c99-9967-748410980bf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:09.958475 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c23a1da5-92db-4c99-9967-748410980bf7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.172395 Sep 08 14:21:09.959061 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3582/7290] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:09 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:10.983103 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-640a00b0-74f8-4c38-92f5-c664facba5cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:10.983789 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-640a00b0-74f8-4c38-92f5-c664facba5cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:10.991024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-640a00b0-74f8-4c38-92f5-c664facba5cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:10.991558 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-640a00b0-74f8-4c38-92f5-c664facba5cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:10.992010 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-640a00b0-74f8-4c38-92f5-c664facba5cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:10.992726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-640a00b0-74f8-4c38-92f5-c664facba5cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:10.993192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-640a00b0-74f8-4c38-92f5-c664facba5cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:10.993629 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-640a00b0-74f8-4c38-92f5-c664facba5cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:11.142706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-640a00b0-74f8-4c38-92f5-c664facba5cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:11.152034 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-640a00b0-74f8-4c38-92f5-c664facba5cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.172702 Sep 08 14:21:11.152673 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3709/7291] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:10 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:21:12.178344 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-92c3b510-f5f8-4a3c-a1d9-6ef4ae341c4e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:12.178999 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-92c3b510-f5f8-4a3c-a1d9-6ef4ae341c4e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:12.186039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92c3b510-f5f8-4a3c-a1d9-6ef4ae341c4e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:12.186541 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92c3b510-f5f8-4a3c-a1d9-6ef4ae341c4e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:12.186987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92c3b510-f5f8-4a3c-a1d9-6ef4ae341c4e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:12.187752 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92c3b510-f5f8-4a3c-a1d9-6ef4ae341c4e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:12.188215 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92c3b510-f5f8-4a3c-a1d9-6ef4ae341c4e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:12.188649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-92c3b510-f5f8-4a3c-a1d9-6ef4ae341c4e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:12.326293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-92c3b510-f5f8-4a3c-a1d9-6ef4ae341c4e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:12.334614 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-92c3b510-f5f8-4a3c-a1d9-6ef4ae341c4e tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.161826 Sep 08 14:21:12.335214 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3583/7292] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:12 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:13.360353 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ed02abc0-4aa4-4a60-a4c9-10bf7be5264f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:13.361024 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ed02abc0-4aa4-4a60-a4c9-10bf7be5264f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:13.368670 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed02abc0-4aa4-4a60-a4c9-10bf7be5264f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:13.369539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed02abc0-4aa4-4a60-a4c9-10bf7be5264f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:13.369972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed02abc0-4aa4-4a60-a4c9-10bf7be5264f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:13.370713 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed02abc0-4aa4-4a60-a4c9-10bf7be5264f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:13.371178 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed02abc0-4aa4-4a60-a4c9-10bf7be5264f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:13.371655 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ed02abc0-4aa4-4a60-a4c9-10bf7be5264f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:13.523187 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ed02abc0-4aa4-4a60-a4c9-10bf7be5264f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:13.533193 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ed02abc0-4aa4-4a60-a4c9-10bf7be5264f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.177752 Sep 08 14:21:13.533868 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3710/7293] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:13 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:14.556453 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a2b9a690-d801-455b-b535-67964c9e19d8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:14.557066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a2b9a690-d801-455b-b535-67964c9e19d8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:14.565287 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2b9a690-d801-455b-b535-67964c9e19d8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:14.566029 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2b9a690-d801-455b-b535-67964c9e19d8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:14.566592 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2b9a690-d801-455b-b535-67964c9e19d8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:14.567505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2b9a690-d801-455b-b535-67964c9e19d8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:14.568243 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2b9a690-d801-455b-b535-67964c9e19d8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:14.568895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a2b9a690-d801-455b-b535-67964c9e19d8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:14.754820 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a2b9a690-d801-455b-b535-67964c9e19d8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:14.763492 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a2b9a690-d801-455b-b535-67964c9e19d8 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1570 microversion: 2.1 time: 0.211015 Sep 08 14:21:14.764073 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3584/7294] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:14 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1570 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:14.786834 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-469ae052-bd16-4754-9232-ba8b64e28b7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:21:14.787487 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-469ae052-bd16-4754-9232-ba8b64e28b7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:14.794513 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-469ae052-bd16-4754-9232-ba8b64e28b7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:14.795022 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-469ae052-bd16-4754-9232-ba8b64e28b7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:14.795515 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-469ae052-bd16-4754-9232-ba8b64e28b7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:14.796234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-469ae052-bd16-4754-9232-ba8b64e28b7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:14.796704 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-469ae052-bd16-4754-9232-ba8b64e28b7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:14.797148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-469ae052-bd16-4754-9232-ba8b64e28b7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:14.830553 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-469ae052-bd16-4754-9232-ba8b64e28b7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128970) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 08 14:21:14.897936 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-469ae052-bd16-4754-9232-ba8b64e28b7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "POST /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03/action" status: 202 len: 0 microversion: 2.1 time: 0.115019 Sep 08 14:21:14.898590 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3711/7295] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:21:14 2022] POST /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:21:14.907713 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e815af68-3534-4ee4-ab95-7bb6d94cf8bd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:14.908343 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e815af68-3534-4ee4-ab95-7bb6d94cf8bd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:14.914433 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e815af68-3534-4ee4-ab95-7bb6d94cf8bd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:14.914921 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e815af68-3534-4ee4-ab95-7bb6d94cf8bd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:14.915827 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e815af68-3534-4ee4-ab95-7bb6d94cf8bd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:14.916166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e815af68-3534-4ee4-ab95-7bb6d94cf8bd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:14.916632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e815af68-3534-4ee4-ab95-7bb6d94cf8bd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:14.917062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e815af68-3534-4ee4-ab95-7bb6d94cf8bd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:15.076784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e815af68-3534-4ee4-ab95-7bb6d94cf8bd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:15.084536 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e815af68-3534-4ee4-ab95-7bb6d94cf8bd tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1518 microversion: 2.1 time: 0.180742 Sep 08 14:21:15.085164 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3585/7296] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:14 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:16.109720 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-22fd4bad-d465-449d-a542-e0ce22d13030 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:16.110399 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-22fd4bad-d465-449d-a542-e0ce22d13030 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:16.116531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22fd4bad-d465-449d-a542-e0ce22d13030 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:16.117029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22fd4bad-d465-449d-a542-e0ce22d13030 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:16.117479 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22fd4bad-d465-449d-a542-e0ce22d13030 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:16.118186 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22fd4bad-d465-449d-a542-e0ce22d13030 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:16.118680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22fd4bad-d465-449d-a542-e0ce22d13030 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:16.119117 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-22fd4bad-d465-449d-a542-e0ce22d13030 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:16.256699 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-22fd4bad-d465-449d-a542-e0ce22d13030 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:16.265369 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-22fd4bad-d465-449d-a542-e0ce22d13030 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1520 microversion: 2.1 time: 0.160435 Sep 08 14:21:16.265954 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3712/7297] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:16 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:16.799703 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-877a2294-6be4-4652-a794-dac860706474 req-04b30782-6551-4fe2-9229-0530c9db1ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae043457-4c08-4a7f-b6f5-d3ba24b04e03", "name": "network-vif-unplugged", "status": "completed", "tag": "ac930d47-eef9-4e33-bc23-a8f20828c302"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:21:16.814659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-877a2294-6be4-4652-a794-dac860706474 req-04b30782-6551-4fe2-9229-0530c9db1ab4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:16.815149 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-877a2294-6be4-4652-a794-dac860706474 req-04b30782-6551-4fe2-9229-0530c9db1ab4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:16.815872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-877a2294-6be4-4652-a794-dac860706474 req-04b30782-6551-4fe2-9229-0530c9db1ab4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:16.829108 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.compute.server_external_events [req-877a2294-6be4-4652-a794-dac860706474 req-04b30782-6551-4fe2-9229-0530c9db1ab4 service nova] Unable to find a host for instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03. Dropping event network-vif-unplugged {{(pid=128971) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 08 14:21:16.830028 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-877a2294-6be4-4652-a794-dac860706474 req-04b30782-6551-4fe2-9229-0530c9db1ab4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.034584 Sep 08 14:21:16.830638 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3586/7298] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 36 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 08 14:21:17.290494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e670eefc-3596-4352-bd7c-3e62c7d45736 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:17.291046 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e670eefc-3596-4352-bd7c-3e62c7d45736 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:17.298038 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e670eefc-3596-4352-bd7c-3e62c7d45736 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:17.298541 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e670eefc-3596-4352-bd7c-3e62c7d45736 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:17.298995 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e670eefc-3596-4352-bd7c-3e62c7d45736 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:17.299739 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e670eefc-3596-4352-bd7c-3e62c7d45736 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:17.300206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e670eefc-3596-4352-bd7c-3e62c7d45736 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:17.300641 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e670eefc-3596-4352-bd7c-3e62c7d45736 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:17.440266 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e670eefc-3596-4352-bd7c-3e62c7d45736 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:17.449738 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e670eefc-3596-4352-bd7c-3e62c7d45736 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1520 microversion: 2.1 time: 0.163399 Sep 08 14:21:17.450551 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3713/7299] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:17 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:18.473877 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-004ce4fc-1f76-48d5-bf78-57d6f9a37fd7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:18.474497 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-004ce4fc-1f76-48d5-bf78-57d6f9a37fd7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:18.482494 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-004ce4fc-1f76-48d5-bf78-57d6f9a37fd7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:18.482984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-004ce4fc-1f76-48d5-bf78-57d6f9a37fd7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:18.483461 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-004ce4fc-1f76-48d5-bf78-57d6f9a37fd7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:18.484168 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-004ce4fc-1f76-48d5-bf78-57d6f9a37fd7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:18.484626 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-004ce4fc-1f76-48d5-bf78-57d6f9a37fd7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:18.485061 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-004ce4fc-1f76-48d5-bf78-57d6f9a37fd7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:18.644498 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-004ce4fc-1f76-48d5-bf78-57d6f9a37fd7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:18.653456 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-004ce4fc-1f76-48d5-bf78-57d6f9a37fd7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1520 microversion: 2.1 time: 0.183382 Sep 08 14:21:18.653995 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3587/7300] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:18 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:19.678350 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5a3696c2-aab5-4b64-afe4-87952dba4c97 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:19.678903 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5a3696c2-aab5-4b64-afe4-87952dba4c97 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:19.686506 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a3696c2-aab5-4b64-afe4-87952dba4c97 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:19.687014 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a3696c2-aab5-4b64-afe4-87952dba4c97 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:19.687500 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a3696c2-aab5-4b64-afe4-87952dba4c97 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:19.688221 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a3696c2-aab5-4b64-afe4-87952dba4c97 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:19.688687 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a3696c2-aab5-4b64-afe4-87952dba4c97 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:19.689126 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5a3696c2-aab5-4b64-afe4-87952dba4c97 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:19.827788 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5a3696c2-aab5-4b64-afe4-87952dba4c97 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:19.835794 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5a3696c2-aab5-4b64-afe4-87952dba4c97 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1520 microversion: 2.1 time: 0.161493 Sep 08 14:21:19.836381 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3714/7301] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:19 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:20.860100 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aa03db19-7692-4fc1-9f04-9b86c2656b13 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:20.860721 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-aa03db19-7692-4fc1-9f04-9b86c2656b13 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:20.867376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa03db19-7692-4fc1-9f04-9b86c2656b13 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:20.868137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa03db19-7692-4fc1-9f04-9b86c2656b13 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:20.868322 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa03db19-7692-4fc1-9f04-9b86c2656b13 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:20.869809 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa03db19-7692-4fc1-9f04-9b86c2656b13 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:20.870174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa03db19-7692-4fc1-9f04-9b86c2656b13 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:20.870600 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aa03db19-7692-4fc1-9f04-9b86c2656b13 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:21.079572 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-aa03db19-7692-4fc1-9f04-9b86c2656b13 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:21.088065 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-aa03db19-7692-4fc1-9f04-9b86c2656b13 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1576 microversion: 2.1 time: 0.231877 Sep 08 14:21:21.088660 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3588/7302] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:20 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1576 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:21.851030 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-b8103706-da2c-4669-9030-3124941e5ad9 req-788a421c-8ccb-42de-b2a1-fe09b9593725 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae043457-4c08-4a7f-b6f5-d3ba24b04e03", "tag": "ac930d47-eef9-4e33-bc23-a8f20828c302"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:21:21.861753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b8103706-da2c-4669-9030-3124941e5ad9 req-788a421c-8ccb-42de-b2a1-fe09b9593725 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:21.862247 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b8103706-da2c-4669-9030-3124941e5ad9 req-788a421c-8ccb-42de-b2a1-fe09b9593725 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:21.862725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-b8103706-da2c-4669-9030-3124941e5ad9 req-788a421c-8ccb-42de-b2a1-fe09b9593725 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:21.875721 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-b8103706-da2c-4669-9030-3124941e5ad9 req-788a421c-8ccb-42de-b2a1-fe09b9593725 service nova] Creating event network-changed:ac930d47-eef9-4e33-bc23-a8f20828c302 for instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 on n-h1-852084-10 Sep 08 14:21:21.881060 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-b8103706-da2c-4669-9030-3124941e5ad9 req-788a421c-8ccb-42de-b2a1-fe09b9593725 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110644 Sep 08 14:21:21.881727 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3715/7303] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:21:22.111546 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-beac8821-d99b-4758-ad14-0c3302f370a6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:22.112166 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-beac8821-d99b-4758-ad14-0c3302f370a6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:22.119358 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-beac8821-d99b-4758-ad14-0c3302f370a6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:22.119782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-beac8821-d99b-4758-ad14-0c3302f370a6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:22.120432 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-beac8821-d99b-4758-ad14-0c3302f370a6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:22.121532 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-beac8821-d99b-4758-ad14-0c3302f370a6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:22.122164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-beac8821-d99b-4758-ad14-0c3302f370a6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:22.122665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-beac8821-d99b-4758-ad14-0c3302f370a6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:22.351838 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-beac8821-d99b-4758-ad14-0c3302f370a6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:22.360216 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-beac8821-d99b-4758-ad14-0c3302f370a6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1576 microversion: 2.1 time: 0.252687 Sep 08 14:21:22.360808 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3589/7304] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:22 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1576 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:23.385743 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9e4eadd3-4d4e-41e6-ab53-88c352f0071c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:23.386511 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9e4eadd3-4d4e-41e6-ab53-88c352f0071c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:23.393003 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e4eadd3-4d4e-41e6-ab53-88c352f0071c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:23.393512 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e4eadd3-4d4e-41e6-ab53-88c352f0071c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:23.393970 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e4eadd3-4d4e-41e6-ab53-88c352f0071c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:23.394698 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e4eadd3-4d4e-41e6-ab53-88c352f0071c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:23.395173 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e4eadd3-4d4e-41e6-ab53-88c352f0071c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:23.395649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9e4eadd3-4d4e-41e6-ab53-88c352f0071c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:23.645798 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9e4eadd3-4d4e-41e6-ab53-88c352f0071c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:23.654406 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9e4eadd3-4d4e-41e6-ab53-88c352f0071c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1576 microversion: 2.1 time: 0.273896 Sep 08 14:21:23.655446 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3716/7305] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:23 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1576 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:24.678362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-462b0f8a-e020-4b47-875d-bf1f7d67ec65 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:24.678918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-462b0f8a-e020-4b47-875d-bf1f7d67ec65 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:24.686952 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-462b0f8a-e020-4b47-875d-bf1f7d67ec65 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:24.687480 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-462b0f8a-e020-4b47-875d-bf1f7d67ec65 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:24.687924 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-462b0f8a-e020-4b47-875d-bf1f7d67ec65 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:24.688633 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-462b0f8a-e020-4b47-875d-bf1f7d67ec65 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:24.689093 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-462b0f8a-e020-4b47-875d-bf1f7d67ec65 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:24.689525 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-462b0f8a-e020-4b47-875d-bf1f7d67ec65 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:24.826099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-462b0f8a-e020-4b47-875d-bf1f7d67ec65 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:24.834321 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-462b0f8a-e020-4b47-875d-bf1f7d67ec65 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1576 microversion: 2.1 time: 0.160268 Sep 08 14:21:24.834902 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3590/7306] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:24 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:25.859960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-9b33b302-ed79-471f-a14e-fe8b59c2c53d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:25.860609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-9b33b302-ed79-471f-a14e-fe8b59c2c53d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:25.867988 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b33b302-ed79-471f-a14e-fe8b59c2c53d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:25.869081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b33b302-ed79-471f-a14e-fe8b59c2c53d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:25.869708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b33b302-ed79-471f-a14e-fe8b59c2c53d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:25.870495 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b33b302-ed79-471f-a14e-fe8b59c2c53d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:25.870963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b33b302-ed79-471f-a14e-fe8b59c2c53d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:25.871427 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-9b33b302-ed79-471f-a14e-fe8b59c2c53d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:26.002331 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-9b33b302-ed79-471f-a14e-fe8b59c2c53d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:26.017628 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-9b33b302-ed79-471f-a14e-fe8b59c2c53d tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1576 microversion: 2.1 time: 0.162370 Sep 08 14:21:26.019621 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3717/7307] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:25 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:27.044686 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3c2f5804-aa2c-470f-b4d7-a5b74e4484f9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:27.045321 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3c2f5804-aa2c-470f-b4d7-a5b74e4484f9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:27.052574 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c2f5804-aa2c-470f-b4d7-a5b74e4484f9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:27.053079 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c2f5804-aa2c-470f-b4d7-a5b74e4484f9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:27.053527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c2f5804-aa2c-470f-b4d7-a5b74e4484f9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:27.054245 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c2f5804-aa2c-470f-b4d7-a5b74e4484f9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:27.054709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c2f5804-aa2c-470f-b4d7-a5b74e4484f9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:27.055146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3c2f5804-aa2c-470f-b4d7-a5b74e4484f9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:27.192614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3c2f5804-aa2c-470f-b4d7-a5b74e4484f9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:27.200633 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3c2f5804-aa2c-470f-b4d7-a5b74e4484f9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1576 microversion: 2.1 time: 0.160606 Sep 08 14:21:27.201206 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3591/7308] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:27 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:28.224327 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-52344bfe-efc4-483b-9930-15959c286443 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:28.224961 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-52344bfe-efc4-483b-9930-15959c286443 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:28.232002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52344bfe-efc4-483b-9930-15959c286443 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:28.232504 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52344bfe-efc4-483b-9930-15959c286443 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:28.232959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52344bfe-efc4-483b-9930-15959c286443 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:28.233667 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52344bfe-efc4-483b-9930-15959c286443 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:28.234135 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52344bfe-efc4-483b-9930-15959c286443 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:28.234572 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-52344bfe-efc4-483b-9930-15959c286443 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:28.239262 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:28.372478 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-52344bfe-efc4-483b-9930-15959c286443 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:28.380493 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-52344bfe-efc4-483b-9930-15959c286443 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1576 microversion: 2.1 time: 0.160067 Sep 08 14:21:28.381075 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3718/7309] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:28 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:29.404782 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6cb2b4a8-e994-46ac-8308-196dbd059638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:29.405459 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6cb2b4a8-e994-46ac-8308-196dbd059638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:29.412848 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6cb2b4a8-e994-46ac-8308-196dbd059638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:29.413338 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6cb2b4a8-e994-46ac-8308-196dbd059638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:29.413788 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6cb2b4a8-e994-46ac-8308-196dbd059638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:29.414520 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6cb2b4a8-e994-46ac-8308-196dbd059638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:29.414984 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6cb2b4a8-e994-46ac-8308-196dbd059638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:29.415449 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6cb2b4a8-e994-46ac-8308-196dbd059638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:29.564665 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6cb2b4a8-e994-46ac-8308-196dbd059638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:29.573777 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6cb2b4a8-e994-46ac-8308-196dbd059638 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1576 microversion: 2.1 time: 0.173120 Sep 08 14:21:29.574401 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3592/7310] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:29 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1576 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:30.598098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-88f26fd2-a984-4728-be21-d24ef741b735 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:30.598752 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-88f26fd2-a984-4728-be21-d24ef741b735 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:30.601543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:30.607981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88f26fd2-a984-4728-be21-d24ef741b735 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:30.608596 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88f26fd2-a984-4728-be21-d24ef741b735 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:30.608944 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88f26fd2-a984-4728-be21-d24ef741b735 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:30.609669 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88f26fd2-a984-4728-be21-d24ef741b735 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:30.610139 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88f26fd2-a984-4728-be21-d24ef741b735 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:30.610603 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-88f26fd2-a984-4728-be21-d24ef741b735 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:30.749805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-88f26fd2-a984-4728-be21-d24ef741b735 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:30.757605 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-88f26fd2-a984-4728-be21-d24ef741b735 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1576 microversion: 2.1 time: 0.163972 Sep 08 14:21:30.758178 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3719/7311] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:30 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:21:31.781970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-9be0b6f7-540b-46da-a93a-ad38f0abb8de tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:31.782589 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-9be0b6f7-540b-46da-a93a-ad38f0abb8de tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:31.785261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=31 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:31.790951 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9be0b6f7-540b-46da-a93a-ad38f0abb8de tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:31.791481 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9be0b6f7-540b-46da-a93a-ad38f0abb8de tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:31.791923 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9be0b6f7-540b-46da-a93a-ad38f0abb8de tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:31.792655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9be0b6f7-540b-46da-a93a-ad38f0abb8de tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:31.793123 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9be0b6f7-540b-46da-a93a-ad38f0abb8de tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:31.793554 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-9be0b6f7-540b-46da-a93a-ad38f0abb8de tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:31.797672 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=87 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:21:31.933216 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-9be0b6f7-540b-46da-a93a-ad38f0abb8de tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:31.941653 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-9be0b6f7-540b-46da-a93a-ad38f0abb8de tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1576 microversion: 2.1 time: 0.163913 Sep 08 14:21:31.942440 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3593/7312] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:31 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:32.192101 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7e38a933-025f-4343-aaea-3b5dd1012833 req-d526e55f-9427-4072-b941-3e26b215c9ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae043457-4c08-4a7f-b6f5-d3ba24b04e03", "name": "network-vif-plugged", "status": "completed", "tag": "ac930d47-eef9-4e33-bc23-a8f20828c302"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:21:32.203000 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7e38a933-025f-4343-aaea-3b5dd1012833 req-d526e55f-9427-4072-b941-3e26b215c9ee service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:32.203523 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7e38a933-025f-4343-aaea-3b5dd1012833 req-d526e55f-9427-4072-b941-3e26b215c9ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:32.203963 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7e38a933-025f-4343-aaea-3b5dd1012833 req-d526e55f-9427-4072-b941-3e26b215c9ee service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:32.216111 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7e38a933-025f-4343-aaea-3b5dd1012833 req-d526e55f-9427-4072-b941-3e26b215c9ee service nova] Creating event network-vif-plugged:ac930d47-eef9-4e33-bc23-a8f20828c302 for instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 on n-h1-852084-10 Sep 08 14:21:32.221100 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7e38a933-025f-4343-aaea-3b5dd1012833 req-d526e55f-9427-4072-b941-3e26b215c9ee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084524 Sep 08 14:21:32.221692 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3720/7313] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:21:32.966978 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e139498b-2bd9-4623-89f4-3ae91c368f34 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:32.967630 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e139498b-2bd9-4623-89f4-3ae91c368f34 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:32.974266 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e139498b-2bd9-4623-89f4-3ae91c368f34 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:32.974756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e139498b-2bd9-4623-89f4-3ae91c368f34 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:32.975198 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e139498b-2bd9-4623-89f4-3ae91c368f34 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:32.975932 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e139498b-2bd9-4623-89f4-3ae91c368f34 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:32.976392 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e139498b-2bd9-4623-89f4-3ae91c368f34 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:32.976823 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e139498b-2bd9-4623-89f4-3ae91c368f34 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:33.112153 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e139498b-2bd9-4623-89f4-3ae91c368f34 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:33.120068 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e139498b-2bd9-4623-89f4-3ae91c368f34 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1576 microversion: 2.1 time: 0.157018 Sep 08 14:21:33.120654 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3594/7314] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:32 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:21:34.144329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e164a481-0f1c-458c-b766-faa2d33e8d94 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:21:34.145041 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e164a481-0f1c-458c-b766-faa2d33e8d94 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:21:34.152206 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e164a481-0f1c-458c-b766-faa2d33e8d94 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:34.152702 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e164a481-0f1c-458c-b766-faa2d33e8d94 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:34.153145 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e164a481-0f1c-458c-b766-faa2d33e8d94 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:34.153840 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e164a481-0f1c-458c-b766-faa2d33e8d94 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:21:34.154304 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e164a481-0f1c-458c-b766-faa2d33e8d94 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:21:34.154759 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e164a481-0f1c-458c-b766-faa2d33e8d94 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:21:34.291410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e164a481-0f1c-458c-b766-faa2d33e8d94 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:21:34.299511 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e164a481-0f1c-458c-b766-faa2d33e8d94 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1563 microversion: 2.1 time: 0.160179 Sep 08 14:21:34.300096 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3721/7315] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:21:34 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1563 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:22:50.917203 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=5 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:50.918065 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=18 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:50.922851 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-28a90889-c43c-4b67-a801-45eff61a43cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:22:50.923505 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-28a90889-c43c-4b67-a801-45eff61a43cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:22:50.926682 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:50.928138 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:22:50.928304 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 14:22:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Sep 08 14:22:50.934643 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-c12d242a-53d4-4378-a5a9-0d3ef6c9f279 req-c8beeec6-da48-4ac3-b2fa-3d996cec92fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae043457-4c08-4a7f-b6f5-d3ba24b04e03", "tag": "ac930d47-eef9-4e33-bc23-a8f20828c302"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:22:50.937184 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=11 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:22:50.938336 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:22:50.938472 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 14:22:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 (ip 10.222.0.78) !!! Sep 08 14:22:50.939663 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:22:50.939792 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 14:22:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 (ip 10.222.0.78) !!! Sep 08 14:22:50.951381 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28a90889-c43c-4b67-a801-45eff61a43cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:50.951886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28a90889-c43c-4b67-a801-45eff61a43cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:50.952376 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28a90889-c43c-4b67-a801-45eff61a43cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:50.953116 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28a90889-c43c-4b67-a801-45eff61a43cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:50.953576 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28a90889-c43c-4b67-a801-45eff61a43cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:50.954008 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-28a90889-c43c-4b67-a801-45eff61a43cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:50.963320 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c12d242a-53d4-4378-a5a9-0d3ef6c9f279 req-c8beeec6-da48-4ac3-b2fa-3d996cec92fd service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:50.963866 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c12d242a-53d4-4378-a5a9-0d3ef6c9f279 req-c8beeec6-da48-4ac3-b2fa-3d996cec92fd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:50.964348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-c12d242a-53d4-4378-a5a9-0d3ef6c9f279 req-c8beeec6-da48-4ac3-b2fa-3d996cec92fd service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:50.981437 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-c12d242a-53d4-4378-a5a9-0d3ef6c9f279 req-c8beeec6-da48-4ac3-b2fa-3d996cec92fd service nova] Creating event network-changed:ac930d47-eef9-4e33-bc23-a8f20828c302 for instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 on n-h1-852084-10 Sep 08 14:22:50.988310 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-c12d242a-53d4-4378-a5a9-0d3ef6c9f279 req-c8beeec6-da48-4ac3-b2fa-3d996cec92fd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073203 Sep 08 14:22:50.988953 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3722/7316] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:22:51.000356 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-28a90889-c43c-4b67-a801-45eff61a43cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:22:51.104872 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-28a90889-c43c-4b67-a801-45eff61a43cc tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 204 len: 0 microversion: 2.1 time: 0.192490 Sep 08 14:22:51.105784 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3595/7317] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 14:22:50 2022] DELETE /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:22:51.118192 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-2abb1cd6-54a1-49f5-9344-1551de2a89b9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:22:51.119410 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-2abb1cd6-54a1-49f5-9344-1551de2a89b9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:22:51.130355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2abb1cd6-54a1-49f5-9344-1551de2a89b9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:51.131110 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2abb1cd6-54a1-49f5-9344-1551de2a89b9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:51.132181 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2abb1cd6-54a1-49f5-9344-1551de2a89b9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:51.133018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2abb1cd6-54a1-49f5-9344-1551de2a89b9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:51.133747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2abb1cd6-54a1-49f5-9344-1551de2a89b9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:51.134364 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-2abb1cd6-54a1-49f5-9344-1551de2a89b9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:51.270628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-2abb1cd6-54a1-49f5-9344-1551de2a89b9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:22:51.279664 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-2abb1cd6-54a1-49f5-9344-1551de2a89b9 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.167142 Sep 08 14:22:51.280335 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3723/7318] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:22:51 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:22:52.304487 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-bc628e6d-e36c-4831-8efb-a55e573cbf7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:22:52.305233 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-bc628e6d-e36c-4831-8efb-a55e573cbf7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:22:52.312726 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc628e6d-e36c-4831-8efb-a55e573cbf7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:52.313214 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc628e6d-e36c-4831-8efb-a55e573cbf7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:52.313655 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc628e6d-e36c-4831-8efb-a55e573cbf7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:52.314366 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc628e6d-e36c-4831-8efb-a55e573cbf7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:52.314821 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc628e6d-e36c-4831-8efb-a55e573cbf7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:52.315264 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-bc628e6d-e36c-4831-8efb-a55e573cbf7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:52.517170 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-bc628e6d-e36c-4831-8efb-a55e573cbf7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:22:52.524013 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-bc628e6d-e36c-4831-8efb-a55e573cbf7f tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1569 microversion: 2.1 time: 0.223957 Sep 08 14:22:52.524595 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3596/7319] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:22:52 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1569 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:22:53.200074 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-91d2b77d-2868-438d-92d7-4b5340ea2548 req-81de5d6b-d3dd-4fb9-afe9-a96417938cf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae043457-4c08-4a7f-b6f5-d3ba24b04e03", "name": "network-vif-deleted", "tag": "ac930d47-eef9-4e33-bc23-a8f20828c302"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:22:53.211594 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-91d2b77d-2868-438d-92d7-4b5340ea2548 req-81de5d6b-d3dd-4fb9-afe9-a96417938cf3 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:53.212127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-91d2b77d-2868-438d-92d7-4b5340ea2548 req-81de5d6b-d3dd-4fb9-afe9-a96417938cf3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:53.213111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-91d2b77d-2868-438d-92d7-4b5340ea2548 req-81de5d6b-d3dd-4fb9-afe9-a96417938cf3 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:53.224402 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-91d2b77d-2868-438d-92d7-4b5340ea2548 req-81de5d6b-d3dd-4fb9-afe9-a96417938cf3 service nova] Creating event network-vif-deleted:ac930d47-eef9-4e33-bc23-a8f20828c302 for instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 on n-h1-852084-10 Sep 08 14:22:53.229561 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-91d2b77d-2868-438d-92d7-4b5340ea2548 req-81de5d6b-d3dd-4fb9-afe9-a96417938cf3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107290 Sep 08 14:22:53.230308 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3724/7320] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:22:53.553764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e79c7662-38b1-43ac-9701-7346f80a4322 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:22:53.554615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e79c7662-38b1-43ac-9701-7346f80a4322 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:22:53.562694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e79c7662-38b1-43ac-9701-7346f80a4322 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:53.562694 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e79c7662-38b1-43ac-9701-7346f80a4322 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:53.563035 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e79c7662-38b1-43ac-9701-7346f80a4322 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:53.563729 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e79c7662-38b1-43ac-9701-7346f80a4322 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:53.564156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e79c7662-38b1-43ac-9701-7346f80a4322 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:53.564585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e79c7662-38b1-43ac-9701-7346f80a4322 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:53.631537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e79c7662-38b1-43ac-9701-7346f80a4322 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:22:53.639913 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e79c7662-38b1-43ac-9701-7346f80a4322 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1220 microversion: 2.1 time: 0.090909 Sep 08 14:22:53.640434 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3597/7321] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:22:53 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:22:54.664947 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5f43bf30-7769-42ea-a765-70a0e07901e7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:22:54.665677 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5f43bf30-7769-42ea-a765-70a0e07901e7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:22:54.672031 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f43bf30-7769-42ea-a765-70a0e07901e7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:54.672611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f43bf30-7769-42ea-a765-70a0e07901e7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:54.673064 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f43bf30-7769-42ea-a765-70a0e07901e7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:54.673776 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f43bf30-7769-42ea-a765-70a0e07901e7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:54.674245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f43bf30-7769-42ea-a765-70a0e07901e7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:54.674681 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5f43bf30-7769-42ea-a765-70a0e07901e7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:54.745703 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5f43bf30-7769-42ea-a765-70a0e07901e7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:22:54.754202 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5f43bf30-7769-42ea-a765-70a0e07901e7 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1220 microversion: 2.1 time: 0.094953 Sep 08 14:22:54.754832 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3725/7322] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:22:54 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1220 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:22:55.778411 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-192a5c01-d935-4c7a-b63e-5b417a1e76e5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:22:55.779039 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-192a5c01-d935-4c7a-b63e-5b417a1e76e5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:22:55.786790 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-192a5c01-d935-4c7a-b63e-5b417a1e76e5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:55.787310 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-192a5c01-d935-4c7a-b63e-5b417a1e76e5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:55.787756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-192a5c01-d935-4c7a-b63e-5b417a1e76e5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:55.788472 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-192a5c01-d935-4c7a-b63e-5b417a1e76e5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:55.788936 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-192a5c01-d935-4c7a-b63e-5b417a1e76e5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:55.789373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-192a5c01-d935-4c7a-b63e-5b417a1e76e5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:55.858350 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-192a5c01-d935-4c7a-b63e-5b417a1e76e5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:22:55.867437 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-192a5c01-d935-4c7a-b63e-5b417a1e76e5 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1220 microversion: 2.1 time: 0.093331 Sep 08 14:22:55.868032 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3598/7323] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:22:55 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:22:56.895671 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-670e946a-5be3-4ac0-9a86-035bcfd760d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:22:56.897067 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-670e946a-5be3-4ac0-9a86-035bcfd760d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:22:56.905275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-670e946a-5be3-4ac0-9a86-035bcfd760d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:56.906163 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-670e946a-5be3-4ac0-9a86-035bcfd760d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:56.906614 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-670e946a-5be3-4ac0-9a86-035bcfd760d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:56.907611 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-670e946a-5be3-4ac0-9a86-035bcfd760d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:56.908087 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-670e946a-5be3-4ac0-9a86-035bcfd760d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:56.908528 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-670e946a-5be3-4ac0-9a86-035bcfd760d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:56.993397 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-670e946a-5be3-4ac0-9a86-035bcfd760d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b173d117bd5c4130b4d1d093a61b0047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc4a9585e9d42a5967157bd8f1ecdbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:22:57.001728 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-670e946a-5be3-4ac0-9a86-035bcfd760d6 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 200 len: 1220 microversion: 2.1 time: 0.110139 Sep 08 14:22:57.002334 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3726/7324] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:22:56 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 1220 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:22:58.025895 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-553eed77-a423-4f6a-96f9-e37037b9147c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:22:58.027377 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-553eed77-a423-4f6a-96f9-e37037b9147c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] [instance: ae043457-4c08-4a7f-b6f5-d3ba24b04e03] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:22:58.035634 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-553eed77-a423-4f6a-96f9-e37037b9147c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:58.036167 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-553eed77-a423-4f6a-96f9-e37037b9147c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:58.036762 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-553eed77-a423-4f6a-96f9-e37037b9147c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:58.038463 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-553eed77-a423-4f6a-96f9-e37037b9147c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:22:58.039683 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-553eed77-a423-4f6a-96f9-e37037b9147c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:22:58.040477 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-553eed77-a423-4f6a-96f9-e37037b9147c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:22:58.058614 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.wsgi [None req-553eed77-a423-4f6a-96f9-e37037b9147c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] HTTP exception thrown: Instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 could not be found. Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-553eed77-a423-4f6a-96f9-e37037b9147c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Request method failure captured: Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: request: GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 HTTP/1.1 Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: Accept: application/json Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: Accept-Encoding: identity Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: Connection: close Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: Content-Length: 0 Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: Content-Type: application/json Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: Host: 10.222.0.78 Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: Openstack-System-Scope: None Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: User-Agent: python-urllib3/1.26.12 Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Auth-Token: gAAAAABjGfifqZhPOOzhKqYOLmKyiKrcqhFxnwHO50Ukju3zkoKgtPU2Lyb865qQL2TrC01Eg0D0XHtscoOWWYJWYpyCaZ9lB-RhKW03SuNun6XuaLwHgtuwuOiOWHs7rFN1lUkOUl0G8a1vfvtjm2ISU8KXSVHC1OSCG-q9817cLQqDOtOlvH4 Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Id: None Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Domain-Name: None Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Identity-Status: Confirmed Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Is-Admin-Project: True Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Id: default Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Domain-Name: Default Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Id: 7fc4a9585e9d42a5967157bd8f1ecdbf Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Project-Name: tempest-TestShelveInstance-1964707081 Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Role: member,reader Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Roles: member,reader Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7fc4a9585e9d42a5967157bd8f1ecdbf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7fc4a9585e9d42a5967157bd8f1ecdbf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7fc4a9585e9d42a5967157bd8f1ecdbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7fc4a9585e9d42a5967157bd8f1ecdbf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant: tempest-TestShelveInstance-1964707081 Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Id: 7fc4a9585e9d42a5967157bd8f1ecdbf Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-Tenant-Name: tempest-TestShelveInstance-1964707081 Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-User: tempest-TestShelveInstance-1964707081-project Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Id: default Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Domain-Name: Default Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Id: b173d117bd5c4130b4d1d093a61b0047 Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: X-User-Name: tempest-TestShelveInstance-1964707081-project Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: method: > Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: exception: Instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 could not be found. Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: action_args: {'id': 'ae043457-4c08-4a7f-b6f5-d3ba24b04e03'} Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 could not be found. Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 could not be found. Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:22:58.060408 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:22:58.069784 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:22:58.069784 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:22:58.069784 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:22:58.069784 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:22:58.069784 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:22:58.069784 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 could not be found. Sep 08 14:22:58.069784 n-d-852084-10 devstack@n-api.service[128971]: ERROR nova.api.openstack.wsgi Sep 08 14:22:58.069784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-553eed77-a423-4f6a-96f9-e37037b9147c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Returning 404 to user: Instance ae043457-4c08-4a7f-b6f5-d3ba24b04e03 could not be found. {{(pid=128971) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:22:58.069784 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-553eed77-a423-4f6a-96f9-e37037b9147c tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03" status: 404 len: 111 microversion: 2.1 time: 0.040367 Sep 08 14:22:58.069784 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3599/7325] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:22:58 2022] GET /compute/v2.1/servers/ae043457-4c08-4a7f-b6f5-d3ba24b04e03 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:22:58.273469 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a8c6f58d-3970-491b-ac05-7e7e645e3172 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] Calling method '.version_select at 0x7fdb340ccb80>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:22:58.301455 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a8c6f58d-3970-491b-ac05-7e7e645e3172 tempest-TestShelveInstance-1964707081 tempest-TestShelveInstance-1964707081-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1357341014" status: 202 len: 0 microversion: 2.1 time: 0.032985 Sep 08 14:22:58.306349 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3727/7326] 10.222.0.78 () {58 vars in 1254 bytes} [Thu Sep 8 14:22:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1357341014 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 08 14:23:16.532803 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:23:16.534059 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:23:16.710743 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-47ff0076-d9a3-4d7f-b1ae-3bdfbc791917 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Action: 'create', calling method: .version_select at 0x7fdb3a72adc0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-414968858", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPd9ZOslr/YMehBVbX+0OjXkM5ENPhjMMDTyfqmf4rfizWYAl3CRn6j7Qaon3Srp+sEx5nHd8fMGlGTZUrXiuLQqezaskYSMQ5o6qtWOl204/VLu0iH+nZitg4W0vAjBuw=="}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:23:16.728327 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-47ff0076-d9a3-4d7f-b1ae-3bdfbc791917 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Getting quotas for project d99d03ce7f244834bbbb557d84f94462. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:23:16.734042 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-47ff0076-d9a3-4d7f-b1ae-3bdfbc791917 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Getting quotas for user f4ce809338e445ee9a665f52dcf0c35f and project d99d03ce7f244834bbbb557d84f94462. Resources: {'key_pairs'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:23:16.765184 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-47ff0076-d9a3-4d7f-b1ae-3bdfbc791917 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.237514 Sep 08 14:23:16.766115 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3600/7327] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Sep 8 14:23:16 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:23:17.755340 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=22 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:23:17.756106 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:23:17.761337 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-80181311", "imageRef": "f54d39f0-e02f-4735-8a67-b5b40688d75d", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-414968858", "security_groups": [{"name": "tempest-secgroup-smoke-1977906598"}], "networks": [{"uuid": "8cb450b3-a661-422c-8f86-e28bd369f890"}]}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:23:17.876311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.network.neutron [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] validate_networks() for [('8cb450b3-a661-422c-8f86-e28bd369f890', None, None, None, None, None)] {{(pid=128970) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:23:18.718090 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Flavor limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:23:18.718531 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Image limits 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:23:18.719080 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Flavor pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:23:18.719579 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Image pref 0:0:0 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:23:18.720009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.virt.hardware [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128970) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:23:18.731391 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:18.731896 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:18.732347 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:18.733098 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:18.733604 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:18.734043 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:18.752854 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Getting quotas for project d99d03ce7f244834bbbb557d84f94462. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:23:18.759120 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.quota [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Getting quotas for user f4ce809338e445ee9a665f52dcf0c35f and project d99d03ce7f244834bbbb557d84f94462. Resources: {'cores', 'ram', 'instances'} {{(pid=128970) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:23:18.772673 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Going to run 1 instances... {{(pid=128970) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:23:18.775036 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f54d39f0-e02f-4735-8a67-b5b40688d75d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128970) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:23:18.825277 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-252e74f4-c80d-4631-a64e-60cf03ec5e53 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.072607 Sep 08 14:23:18.826557 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3728/7328] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 14:23:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:23:18.839258 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d5ff8312-8a35-4497-a29b-3a890deca55a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:23:18.839885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d5ff8312-8a35-4497-a29b-3a890deca55a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:23:18.900901 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d5ff8312-8a35-4497-a29b-3a890deca55a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:23:18.909759 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d5ff8312-8a35-4497-a29b-3a890deca55a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1246 microversion: 2.1 time: 0.075203 Sep 08 14:23:18.910901 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3601/7329] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:23:18 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1246 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:23:19.937355 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4c4f91d-1900-4f71-a65e-fd095b9c0ebf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:23:19.938209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e4c4f91d-1900-4f71-a65e-fd095b9c0ebf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:23:19.946311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4c4f91d-1900-4f71-a65e-fd095b9c0ebf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:19.946941 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4c4f91d-1900-4f71-a65e-fd095b9c0ebf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:19.947537 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4c4f91d-1900-4f71-a65e-fd095b9c0ebf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:19.948382 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4c4f91d-1900-4f71-a65e-fd095b9c0ebf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:19.948959 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4c4f91d-1900-4f71-a65e-fd095b9c0ebf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:19.949503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4c4f91d-1900-4f71-a65e-fd095b9c0ebf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:20.018628 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e4c4f91d-1900-4f71-a65e-fd095b9c0ebf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:23:20.034209 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e4c4f91d-1900-4f71-a65e-fd095b9c0ebf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1298 microversion: 2.1 time: 0.102947 Sep 08 14:23:20.038151 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3729/7330] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:23:19 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:23:21.058912 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d1abb9b3-e2be-4f62-bfd7-64167f5ed16b tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:23:21.059771 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-d1abb9b3-e2be-4f62-bfd7-64167f5ed16b tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:23:21.067261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1abb9b3-e2be-4f62-bfd7-64167f5ed16b tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:21.067974 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1abb9b3-e2be-4f62-bfd7-64167f5ed16b tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:21.068585 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1abb9b3-e2be-4f62-bfd7-64167f5ed16b tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:21.070128 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1abb9b3-e2be-4f62-bfd7-64167f5ed16b tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:21.070784 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1abb9b3-e2be-4f62-bfd7-64167f5ed16b tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:21.071900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-d1abb9b3-e2be-4f62-bfd7-64167f5ed16b tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:21.293522 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-d1abb9b3-e2be-4f62-bfd7-64167f5ed16b tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:23:21.301769 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d1abb9b3-e2be-4f62-bfd7-64167f5ed16b tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1372 microversion: 2.1 time: 0.246876 Sep 08 14:23:21.302379 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3602/7331] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:23:21 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1372 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:23:21.668060 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7c5f7137-d24a-4992-b519-22c565c72aad req-07a75bb4-20ce-4137-abd2-bc291b8b8712 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4db76c7-a52e-44b2-ab86-66e5bbab5187", "tag": "93ae92f7-8e99-4a3c-994f-def9facb73a8"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:23:21.680872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7c5f7137-d24a-4992-b519-22c565c72aad req-07a75bb4-20ce-4137-abd2-bc291b8b8712 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:21.681372 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7c5f7137-d24a-4992-b519-22c565c72aad req-07a75bb4-20ce-4137-abd2-bc291b8b8712 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:21.681820 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7c5f7137-d24a-4992-b519-22c565c72aad req-07a75bb4-20ce-4137-abd2-bc291b8b8712 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:21.694253 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7c5f7137-d24a-4992-b519-22c565c72aad req-07a75bb4-20ce-4137-abd2-bc291b8b8712 service nova] Creating event network-changed:93ae92f7-8e99-4a3c-994f-def9facb73a8 for instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 on n-h2-852084-10 Sep 08 14:23:21.704834 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7c5f7137-d24a-4992-b519-22c565c72aad req-07a75bb4-20ce-4137-abd2-bc291b8b8712 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040474 Sep 08 14:23:21.706610 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3730/7332] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:23:22.327325 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-a60d8434-730e-4825-95ce-425672ed2e03 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:23:22.327976 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-a60d8434-730e-4825-95ce-425672ed2e03 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:23:22.335644 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a60d8434-730e-4825-95ce-425672ed2e03 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:22.336148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a60d8434-730e-4825-95ce-425672ed2e03 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:22.336588 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a60d8434-730e-4825-95ce-425672ed2e03 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:22.337491 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a60d8434-730e-4825-95ce-425672ed2e03 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:22.337963 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a60d8434-730e-4825-95ce-425672ed2e03 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:22.338402 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-a60d8434-730e-4825-95ce-425672ed2e03 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:22.479290 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-a60d8434-730e-4825-95ce-425672ed2e03 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:23:22.487142 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-a60d8434-730e-4825-95ce-425672ed2e03 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1372 microversion: 2.1 time: 0.163984 Sep 08 14:23:22.487763 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3603/7333] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:23:22 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:23:23.512016 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-4dd6af37-7f73-41ec-9733-91b219ebc4ea tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:23:23.512863 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-4dd6af37-7f73-41ec-9733-91b219ebc4ea tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:23:23.519625 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dd6af37-7f73-41ec-9733-91b219ebc4ea tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:23.520543 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dd6af37-7f73-41ec-9733-91b219ebc4ea tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:23.521008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dd6af37-7f73-41ec-9733-91b219ebc4ea tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:23.521711 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dd6af37-7f73-41ec-9733-91b219ebc4ea tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:23.522183 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dd6af37-7f73-41ec-9733-91b219ebc4ea tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:23.522650 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-4dd6af37-7f73-41ec-9733-91b219ebc4ea tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:23.663622 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-4dd6af37-7f73-41ec-9733-91b219ebc4ea tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:23:23.671357 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-4dd6af37-7f73-41ec-9733-91b219ebc4ea tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1372 microversion: 2.1 time: 0.164438 Sep 08 14:23:23.671931 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3731/7334] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:23:23 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1372 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:23:24.694431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-2f0c400d-9dc8-4318-9e6f-6bf15e811aaf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:23:24.695078 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-2f0c400d-9dc8-4318-9e6f-6bf15e811aaf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:23:24.702197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f0c400d-9dc8-4318-9e6f-6bf15e811aaf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:24.702982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f0c400d-9dc8-4318-9e6f-6bf15e811aaf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:24.703137 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f0c400d-9dc8-4318-9e6f-6bf15e811aaf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:24.703903 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f0c400d-9dc8-4318-9e6f-6bf15e811aaf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:24.704362 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f0c400d-9dc8-4318-9e6f-6bf15e811aaf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:24.704792 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-2f0c400d-9dc8-4318-9e6f-6bf15e811aaf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:24.846690 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-2f0c400d-9dc8-4318-9e6f-6bf15e811aaf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:23:24.854494 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-2f0c400d-9dc8-4318-9e6f-6bf15e811aaf tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1372 microversion: 2.1 time: 0.164012 Sep 08 14:23:24.855076 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3604/7335] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:23:24 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:23:25.877365 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ede9616a-e3f6-4eef-9026-987c4e099a33 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:23:25.878129 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ede9616a-e3f6-4eef-9026-987c4e099a33 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:23:25.884937 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ede9616a-e3f6-4eef-9026-987c4e099a33 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:25.885435 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ede9616a-e3f6-4eef-9026-987c4e099a33 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:25.885881 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ede9616a-e3f6-4eef-9026-987c4e099a33 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:25.886591 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ede9616a-e3f6-4eef-9026-987c4e099a33 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:25.887049 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ede9616a-e3f6-4eef-9026-987c4e099a33 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:25.887518 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ede9616a-e3f6-4eef-9026-987c4e099a33 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:26.028246 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-ede9616a-e3f6-4eef-9026-987c4e099a33 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:23:26.036676 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ede9616a-e3f6-4eef-9026-987c4e099a33 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1372 microversion: 2.1 time: 0.163185 Sep 08 14:23:26.037296 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3732/7336] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:23:25 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:23:27.061872 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-edf399e1-6af1-4e26-97ea-e87d8798f2d4 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:23:27.062845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-edf399e1-6af1-4e26-97ea-e87d8798f2d4 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:23:27.074299 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edf399e1-6af1-4e26-97ea-e87d8798f2d4 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:27.075653 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edf399e1-6af1-4e26-97ea-e87d8798f2d4 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:27.076332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edf399e1-6af1-4e26-97ea-e87d8798f2d4 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:27.077391 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edf399e1-6af1-4e26-97ea-e87d8798f2d4 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:27.078104 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edf399e1-6af1-4e26-97ea-e87d8798f2d4 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:27.078757 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-edf399e1-6af1-4e26-97ea-e87d8798f2d4 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:27.224352 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-edf399e1-6af1-4e26-97ea-e87d8798f2d4 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:23:27.232140 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-edf399e1-6af1-4e26-97ea-e87d8798f2d4 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1372 microversion: 2.1 time: 0.176595 Sep 08 14:23:27.232708 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3605/7337] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:23:27 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:23:27.587753 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-9fee45cf-f3af-4996-945d-f5f547d07289 req-b927c01b-a2cc-449a-8645-ad3a4bd70552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4db76c7-a52e-44b2-ab86-66e5bbab5187", "name": "network-vif-plugged", "status": "completed", "tag": "93ae92f7-8e99-4a3c-994f-def9facb73a8"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:23:27.600374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9fee45cf-f3af-4996-945d-f5f547d07289 req-b927c01b-a2cc-449a-8645-ad3a4bd70552 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:27.600885 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9fee45cf-f3af-4996-945d-f5f547d07289 req-b927c01b-a2cc-449a-8645-ad3a4bd70552 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:27.601678 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-9fee45cf-f3af-4996-945d-f5f547d07289 req-b927c01b-a2cc-449a-8645-ad3a4bd70552 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:27.889717 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-9fee45cf-f3af-4996-945d-f5f547d07289 req-b927c01b-a2cc-449a-8645-ad3a4bd70552 service nova] Creating event network-vif-plugged:93ae92f7-8e99-4a3c-994f-def9facb73a8 for instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 on n-h2-852084-10 Sep 08 14:23:27.895859 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-9fee45cf-f3af-4996-945d-f5f547d07289 req-b927c01b-a2cc-449a-8645-ad3a4bd70552 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.311294 Sep 08 14:23:27.896471 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3733/7338] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:23:28.257718 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-f7aadc57-b287-438d-9d09-ced22b0d3718 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:23:28.258261 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-f7aadc57-b287-438d-9d09-ced22b0d3718 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:23:28.265175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7aadc57-b287-438d-9d09-ced22b0d3718 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:28.265659 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7aadc57-b287-438d-9d09-ced22b0d3718 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:28.266090 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7aadc57-b287-438d-9d09-ced22b0d3718 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:28.266781 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7aadc57-b287-438d-9d09-ced22b0d3718 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:28.267252 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7aadc57-b287-438d-9d09-ced22b0d3718 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:28.267677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-f7aadc57-b287-438d-9d09-ced22b0d3718 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:28.399197 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-f7aadc57-b287-438d-9d09-ced22b0d3718 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:23:28.407150 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-f7aadc57-b287-438d-9d09-ced22b0d3718 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1372 microversion: 2.1 time: 0.154056 Sep 08 14:23:28.407758 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3606/7339] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:23:28 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:23:29.430836 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:23:29.431913 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=6 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:23:29.436430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-6de06b05-2f45-4b3a-89dd-caecdaa5e7c8 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:23:29.437148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-6de06b05-2f45-4b3a-89dd-caecdaa5e7c8 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:23:29.444215 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6de06b05-2f45-4b3a-89dd-caecdaa5e7c8 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:29.444715 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6de06b05-2f45-4b3a-89dd-caecdaa5e7c8 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:29.445166 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6de06b05-2f45-4b3a-89dd-caecdaa5e7c8 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:29.445872 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6de06b05-2f45-4b3a-89dd-caecdaa5e7c8 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:29.446341 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6de06b05-2f45-4b3a-89dd-caecdaa5e7c8 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:29.446780 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-6de06b05-2f45-4b3a-89dd-caecdaa5e7c8 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:29.581334 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-6de06b05-2f45-4b3a-89dd-caecdaa5e7c8 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:23:29.589425 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-6de06b05-2f45-4b3a-89dd-caecdaa5e7c8 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1555 microversion: 2.1 time: 0.160543 Sep 08 14:23:29.589999 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3734/7340] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:23:29 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:23:29.612161 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-e27c30b1-6b4e-4e6c-996f-bfa7bb3b9d07 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:23:29.612709 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-e27c30b1-6b4e-4e6c-996f-bfa7bb3b9d07 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:23:29.615164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:23:29.621606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e27c30b1-6b4e-4e6c-996f-bfa7bb3b9d07 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:29.622143 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e27c30b1-6b4e-4e6c-996f-bfa7bb3b9d07 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:29.622660 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e27c30b1-6b4e-4e6c-996f-bfa7bb3b9d07 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:29.623503 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e27c30b1-6b4e-4e6c-996f-bfa7bb3b9d07 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:29.623991 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e27c30b1-6b4e-4e6c-996f-bfa7bb3b9d07 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:29.624504 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-e27c30b1-6b4e-4e6c-996f-bfa7bb3b9d07 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:29.763567 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-e27c30b1-6b4e-4e6c-996f-bfa7bb3b9d07 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:23:29.772070 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-e27c30b1-6b4e-4e6c-996f-bfa7bb3b9d07 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1555 microversion: 2.1 time: 0.163854 Sep 08 14:23:29.772654 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3607/7341] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:23:29 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:23:31.444815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7dc5ee5a-e060-4061-b0d6-8c2a96474202 req-cca9b924-d02e-407f-865f-7052706f7f72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4db76c7-a52e-44b2-ab86-66e5bbab5187", "tag": "93ae92f7-8e99-4a3c-994f-def9facb73a8"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:23:31.455141 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7dc5ee5a-e060-4061-b0d6-8c2a96474202 req-cca9b924-d02e-407f-865f-7052706f7f72 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:23:31.455756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7dc5ee5a-e060-4061-b0d6-8c2a96474202 req-cca9b924-d02e-407f-865f-7052706f7f72 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:23:31.456275 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7dc5ee5a-e060-4061-b0d6-8c2a96474202 req-cca9b924-d02e-407f-865f-7052706f7f72 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:23:31.468413 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7dc5ee5a-e060-4061-b0d6-8c2a96474202 req-cca9b924-d02e-407f-865f-7052706f7f72 service nova] Creating event network-changed:93ae92f7-8e99-4a3c-994f-def9facb73a8 for instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 on n-h2-852084-10 Sep 08 14:23:31.473658 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7dc5ee5a-e060-4061-b0d6-8c2a96474202 req-cca9b924-d02e-407f-865f-7052706f7f72 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032587 Sep 08 14:23:31.474180 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3735/7342] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:25:27.595749 n-d-852084-10 devstack@n-api.service[128971]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4073da4f-db71-4c3c-9e1b-d9f532b78424] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 14:25:27.596711 n-d-852084-10 devstack@n-api.service[128971]: ERROR oslo.messaging._drivers.impl_rabbit [-] [31769cf6-754f-4e53-871b-651183d82573] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 08 14:25:27.597248 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:25:27.598080 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=36 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:25:27.603874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4af8dcac-cc4c-48a7-b04a-a4f77348d3e3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1602308037"}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:25:27.606194 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4af8dcac-cc4c-48a7-b04a-a4f77348d3e3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:27.614130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4af8dcac-cc4c-48a7-b04a-a4f77348d3e3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:27.614625 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4af8dcac-cc4c-48a7-b04a-a4f77348d3e3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:27.615062 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4af8dcac-cc4c-48a7-b04a-a4f77348d3e3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:27.615814 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4af8dcac-cc4c-48a7-b04a-a4f77348d3e3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:27.616309 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4af8dcac-cc4c-48a7-b04a-a4f77348d3e3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:27.616742 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4af8dcac-cc4c-48a7-b04a-a4f77348d3e3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:27.955357 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4af8dcac-cc4c-48a7-b04a-a4f77348d3e3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "POST /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187/action" status: 202 len: 0 microversion: 2.1 time: 0.361559 Sep 08 14:25:27.956045 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3608/7343] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:25:27 2022] POST /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 14:25:34.325501 n-d-852084-10 devstack@n-api.service[128970]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ae07885-1976-4f24-8283-d63c7056ab9e] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 14:25:34.328373 n-d-852084-10 devstack@n-api.service[128970]: ERROR oslo.messaging._drivers.impl_rabbit [-] [254344fe-6b9d-45f5-91d6-e802ace055bf] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 08 14:25:34.329870 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:25:34.331806 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=32 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:25:34.346385 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7ad33e33-953d-4f36-a29e-7b12f95cebb0 req-b8a85495-3666-4423-a473-be2ae0dff442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4db76c7-a52e-44b2-ab86-66e5bbab5187", "name": "network-vif-plugged", "status": "completed", "tag": "93ae92f7-8e99-4a3c-994f-def9facb73a8"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:25:34.368892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7ad33e33-953d-4f36-a29e-7b12f95cebb0 req-b8a85495-3666-4423-a473-be2ae0dff442 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:34.370245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7ad33e33-953d-4f36-a29e-7b12f95cebb0 req-b8a85495-3666-4423-a473-be2ae0dff442 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:34.371044 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7ad33e33-953d-4f36-a29e-7b12f95cebb0 req-b8a85495-3666-4423-a473-be2ae0dff442 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:34.395175 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7ad33e33-953d-4f36-a29e-7b12f95cebb0 req-b8a85495-3666-4423-a473-be2ae0dff442 service nova] Creating event network-vif-plugged:93ae92f7-8e99-4a3c-994f-def9facb73a8 for instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 on n-h2-852084-10 Sep 08 14:25:34.407155 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7ad33e33-953d-4f36-a29e-7b12f95cebb0 req-b8a85495-3666-4423-a473-be2ae0dff442 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082935 Sep 08 14:25:34.409205 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3736/7344] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:25:41.622489 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:25:41.623285 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:25:41.628624 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-946348985", "imageRef": "a35329d6-6a0c-436c-9ce3-c58b15c13a31", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-414968858", "security_groups": [{"name": "tempest-secgroup-smoke-1977906598"}], "networks": [{"uuid": "8cb450b3-a661-422c-8f86-e28bd369f890"}]}} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:25:41.653611 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] [31769cf6-754f-4e53-871b-651183d82573] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 53544. Sep 08 14:25:41.654325 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] [4073da4f-db71-4c3c-9e1b-d9f532b78424] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 53542. Sep 08 14:25:41.748186 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.network.neutron [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] validate_networks() for [('8cb450b3-a661-422c-8f86-e28bd369f890', None, None, None, None, None)] {{(pid=128971) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 08 14:25:42.208430 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Flavor limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 08 14:25:42.208855 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Image limits 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 08 14:25:42.209323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Flavor pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 08 14:25:42.209724 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Image pref 0:0:0 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 08 14:25:42.210130 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.virt.hardware [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128971) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 08 14:25:42.218970 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:42.219482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:42.219918 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:42.220631 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:42.221106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:42.221527 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:42.238577 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Getting quotas for project d99d03ce7f244834bbbb557d84f94462. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 08 14:25:42.243772 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.quota [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Getting quotas for user f4ce809338e445ee9a665f52dcf0c35f and project d99d03ce7f244834bbbb557d84f94462. Resources: {'cores', 'ram', 'instances'} {{(pid=128971) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 08 14:25:42.256712 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Going to run 1 instances... {{(pid=128971) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 08 14:25:42.259189 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a35329d6-6a0c-436c-9ce3-c58b15c13a31',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128971) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 08 14:25:42.309659 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-c45ac6d4-e821-4cce-a0ad-e4da84817079 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.689302 Sep 08 14:25:42.310317 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3609/7345] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Sep 8 14:25:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 08 14:25:42.324018 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-3bba2239-c273-4190-b9f6-7f92afc548de tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:42.324734 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-3bba2239-c273-4190-b9f6-7f92afc548de tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:42.336342 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] [254344fe-6b9d-45f5-91d6-e802ace055bf] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 53560. Sep 08 14:25:42.338447 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ae07885-1976-4f24-8283-d63c7056ab9e] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 53558. Sep 08 14:25:42.441747 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-3bba2239-c273-4190-b9f6-7f92afc548de tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:42.449573 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-3bba2239-c273-4190-b9f6-7f92afc548de tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1247 microversion: 2.1 time: 0.131144 Sep 08 14:25:42.450144 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3737/7346] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:42 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1247 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:43.482451 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec1fd062-f64a-49fc-aaca-9e64995c1793 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:43.483071 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ec1fd062-f64a-49fc-aaca-9e64995c1793 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:43.492175 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec1fd062-f64a-49fc-aaca-9e64995c1793 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:43.493026 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec1fd062-f64a-49fc-aaca-9e64995c1793 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:43.493796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec1fd062-f64a-49fc-aaca-9e64995c1793 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:43.494606 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec1fd062-f64a-49fc-aaca-9e64995c1793 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:43.495066 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec1fd062-f64a-49fc-aaca-9e64995c1793 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:43.495582 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec1fd062-f64a-49fc-aaca-9e64995c1793 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:43.560590 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ec1fd062-f64a-49fc-aaca-9e64995c1793 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:43.569565 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ec1fd062-f64a-49fc-aaca-9e64995c1793 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1251 microversion: 2.1 time: 0.091800 Sep 08 14:25:43.570157 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3610/7347] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:43 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1251 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:44.594191 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-95bc6e5c-565f-4a27-9038-937bfaad8eed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:44.595159 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-95bc6e5c-565f-4a27-9038-937bfaad8eed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:44.599081 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:25:44.603405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95bc6e5c-565f-4a27-9038-937bfaad8eed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:44.603916 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95bc6e5c-565f-4a27-9038-937bfaad8eed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:44.604374 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95bc6e5c-565f-4a27-9038-937bfaad8eed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:44.605150 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95bc6e5c-565f-4a27-9038-937bfaad8eed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:44.616071 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95bc6e5c-565f-4a27-9038-937bfaad8eed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:44.616538 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-95bc6e5c-565f-4a27-9038-937bfaad8eed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:44.707193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-95bc6e5c-565f-4a27-9038-937bfaad8eed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:44.715163 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-95bc6e5c-565f-4a27-9038-937bfaad8eed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1317 microversion: 2.1 time: 0.125434 Sep 08 14:25:44.715792 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3738/7348] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:44 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1317 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:45.739860 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-3113dfa3-aca0-4db6-a6f0-082ba1a75771 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:45.741192 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-3113dfa3-aca0-4db6-a6f0-082ba1a75771 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:45.750345 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3113dfa3-aca0-4db6-a6f0-082ba1a75771 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:45.750842 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3113dfa3-aca0-4db6-a6f0-082ba1a75771 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:45.751415 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3113dfa3-aca0-4db6-a6f0-082ba1a75771 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:45.752220 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3113dfa3-aca0-4db6-a6f0-082ba1a75771 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:45.752751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3113dfa3-aca0-4db6-a6f0-082ba1a75771 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:45.753272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-3113dfa3-aca0-4db6-a6f0-082ba1a75771 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:45.943419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-3113dfa3-aca0-4db6-a6f0-082ba1a75771 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:45.952082 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-3113dfa3-aca0-4db6-a6f0-082ba1a75771 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1373 microversion: 2.1 time: 0.216264 Sep 08 14:25:45.953612 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3611/7349] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:45 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1373 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:46.292652 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-97f63515-b261-4245-96ca-551d4d6590be req-67f11186-2778-45de-9521-201677655e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4db76c7-a52e-44b2-ab86-66e5bbab5187", "name": "network-vif-unplugged", "status": "completed", "tag": "93ae92f7-8e99-4a3c-994f-def9facb73a8"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:25:46.307323 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97f63515-b261-4245-96ca-551d4d6590be req-67f11186-2778-45de-9521-201677655e9e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:46.309111 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97f63515-b261-4245-96ca-551d4d6590be req-67f11186-2778-45de-9521-201677655e9e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:46.309811 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-97f63515-b261-4245-96ca-551d4d6590be req-67f11186-2778-45de-9521-201677655e9e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:46.325628 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-97f63515-b261-4245-96ca-551d4d6590be req-67f11186-2778-45de-9521-201677655e9e service nova] Creating event network-vif-unplugged:93ae92f7-8e99-4a3c-994f-def9facb73a8 for instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 on n-h2-852084-10 Sep 08 14:25:46.332031 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-97f63515-b261-4245-96ca-551d4d6590be req-67f11186-2778-45de-9521-201677655e9e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043790 Sep 08 14:25:46.335170 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3739/7350] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 08 14:25:46.978866 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-aff3f3a3-c825-45b4-b6ef-127cb9e833ac tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:46.981075 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-aff3f3a3-c825-45b4-b6ef-127cb9e833ac tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:46.991109 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aff3f3a3-c825-45b4-b6ef-127cb9e833ac tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:46.992055 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aff3f3a3-c825-45b4-b6ef-127cb9e833ac tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:46.992615 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aff3f3a3-c825-45b4-b6ef-127cb9e833ac tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:46.993441 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aff3f3a3-c825-45b4-b6ef-127cb9e833ac tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:46.994011 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aff3f3a3-c825-45b4-b6ef-127cb9e833ac tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:46.994549 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-aff3f3a3-c825-45b4-b6ef-127cb9e833ac tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:47.164304 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-aff3f3a3-c825-45b4-b6ef-127cb9e833ac tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:47.174240 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-aff3f3a3-c825-45b4-b6ef-127cb9e833ac tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1373 microversion: 2.1 time: 0.199800 Sep 08 14:25:47.175334 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3612/7351] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:46 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1373 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:48.201550 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-bbbf130c-b48c-4bc5-981f-cbb223979993 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:48.205953 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-bbbf130c-b48c-4bc5-981f-cbb223979993 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:48.214386 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbbf130c-b48c-4bc5-981f-cbb223979993 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:48.214976 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbbf130c-b48c-4bc5-981f-cbb223979993 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:48.215388 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbbf130c-b48c-4bc5-981f-cbb223979993 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:48.216121 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbbf130c-b48c-4bc5-981f-cbb223979993 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:48.216680 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbbf130c-b48c-4bc5-981f-cbb223979993 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:48.217127 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-bbbf130c-b48c-4bc5-981f-cbb223979993 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:48.386404 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-bbbf130c-b48c-4bc5-981f-cbb223979993 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:48.395424 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-bbbf130c-b48c-4bc5-981f-cbb223979993 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1373 microversion: 2.1 time: 0.198826 Sep 08 14:25:48.411256 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3740/7352] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:48 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:49.420401 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-41e97c93-09b6-4324-aaa0-663a08899d09 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:49.421146 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-41e97c93-09b6-4324-aaa0-663a08899d09 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:49.434900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41e97c93-09b6-4324-aaa0-663a08899d09 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:49.435439 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41e97c93-09b6-4324-aaa0-663a08899d09 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:49.435886 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41e97c93-09b6-4324-aaa0-663a08899d09 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:49.436619 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41e97c93-09b6-4324-aaa0-663a08899d09 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:49.437099 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41e97c93-09b6-4324-aaa0-663a08899d09 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:49.437569 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-41e97c93-09b6-4324-aaa0-663a08899d09 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:49.659928 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-41e97c93-09b6-4324-aaa0-663a08899d09 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:49.669266 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-41e97c93-09b6-4324-aaa0-663a08899d09 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1373 microversion: 2.1 time: 0.252614 Sep 08 14:25:49.679868 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3613/7353] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:49 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1373 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:25:50.693193 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-09f4f28c-1fc3-47b2-a1bc-a159bcd053b9 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:50.694029 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-09f4f28c-1fc3-47b2-a1bc-a159bcd053b9 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:50.704520 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09f4f28c-1fc3-47b2-a1bc-a159bcd053b9 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:50.705040 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09f4f28c-1fc3-47b2-a1bc-a159bcd053b9 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:50.705584 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09f4f28c-1fc3-47b2-a1bc-a159bcd053b9 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:50.711252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09f4f28c-1fc3-47b2-a1bc-a159bcd053b9 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:50.711252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09f4f28c-1fc3-47b2-a1bc-a159bcd053b9 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:50.711252 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-09f4f28c-1fc3-47b2-a1bc-a159bcd053b9 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:50.862907 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-09f4f28c-1fc3-47b2-a1bc-a159bcd053b9 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:50.873157 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-09f4f28c-1fc3-47b2-a1bc-a159bcd053b9 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1373 microversion: 2.1 time: 0.183882 Sep 08 14:25:50.885638 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3741/7354] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:50 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1373 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:51.899025 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-4b1257b1-9e04-4a22-b34d-7e9312d812dd tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:51.899845 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-4b1257b1-9e04-4a22-b34d-7e9312d812dd tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:51.908262 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b1257b1-9e04-4a22-b34d-7e9312d812dd tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:51.908764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b1257b1-9e04-4a22-b34d-7e9312d812dd tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:51.909435 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b1257b1-9e04-4a22-b34d-7e9312d812dd tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:51.910289 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b1257b1-9e04-4a22-b34d-7e9312d812dd tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:51.910751 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b1257b1-9e04-4a22-b34d-7e9312d812dd tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:51.911181 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-4b1257b1-9e04-4a22-b34d-7e9312d812dd tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:52.064893 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-4b1257b1-9e04-4a22-b34d-7e9312d812dd tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:52.072810 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-4b1257b1-9e04-4a22-b34d-7e9312d812dd tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1373 microversion: 2.1 time: 0.177770 Sep 08 14:25:52.073389 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3614/7355] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:51 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1373 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:53.097415 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-a9a637cd-4cfa-4353-8a6d-f2fabdf37301 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:53.097950 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-a9a637cd-4cfa-4353-8a6d-f2fabdf37301 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:53.100718 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell0:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:25:53.106311 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9a637cd-4cfa-4353-8a6d-f2fabdf37301 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:53.106813 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9a637cd-4cfa-4353-8a6d-f2fabdf37301 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:53.107289 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9a637cd-4cfa-4353-8a6d-f2fabdf37301 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:53.108006 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9a637cd-4cfa-4353-8a6d-f2fabdf37301 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:53.108475 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9a637cd-4cfa-4353-8a6d-f2fabdf37301 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:53.108940 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-a9a637cd-4cfa-4353-8a6d-f2fabdf37301 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:53.215939 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:25:53.216844 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell0:SELECT=6 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:25:53.223687 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-5ecb6ce3-27c0-47f3-8fbc-9bc6438b2eea req-7a2a26e3-843a-48f4-8ebc-cd4f4482a80e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4", "tag": "149e9159-97ec-433b-8800-05df244f8384"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:25:53.244649 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-a9a637cd-4cfa-4353-8a6d-f2fabdf37301 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:53.246692 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5ecb6ce3-27c0-47f3-8fbc-9bc6438b2eea req-7a2a26e3-843a-48f4-8ebc-cd4f4482a80e service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:53.247465 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5ecb6ce3-27c0-47f3-8fbc-9bc6438b2eea req-7a2a26e3-843a-48f4-8ebc-cd4f4482a80e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:53.248237 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-5ecb6ce3-27c0-47f3-8fbc-9bc6438b2eea req-7a2a26e3-843a-48f4-8ebc-cd4f4482a80e service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:53.257282 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-a9a637cd-4cfa-4353-8a6d-f2fabdf37301 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1373 microversion: 2.1 time: 0.163751 Sep 08 14:25:53.257900 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3742/7356] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:53 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:53.261645 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-5ecb6ce3-27c0-47f3-8fbc-9bc6438b2eea req-7a2a26e3-843a-48f4-8ebc-cd4f4482a80e service nova] Creating event network-changed:149e9159-97ec-433b-8800-05df244f8384 for instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 on n-h1-852084-10 Sep 08 14:25:53.275998 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-5ecb6ce3-27c0-47f3-8fbc-9bc6438b2eea req-7a2a26e3-843a-48f4-8ebc-cd4f4482a80e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059191 Sep 08 14:25:53.275998 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3615/7357] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:25:54.283008 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-64bad112-f86d-432a-9a98-12ac8e894eec tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:54.284232 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-64bad112-f86d-432a-9a98-12ac8e894eec tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:54.292100 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64bad112-f86d-432a-9a98-12ac8e894eec tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:54.292609 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64bad112-f86d-432a-9a98-12ac8e894eec tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:54.293063 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64bad112-f86d-432a-9a98-12ac8e894eec tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:54.293783 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64bad112-f86d-432a-9a98-12ac8e894eec tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:54.294256 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64bad112-f86d-432a-9a98-12ac8e894eec tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:54.294689 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-64bad112-f86d-432a-9a98-12ac8e894eec tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:54.431805 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-64bad112-f86d-432a-9a98-12ac8e894eec tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:54.440129 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-64bad112-f86d-432a-9a98-12ac8e894eec tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1373 microversion: 2.1 time: 0.163798 Sep 08 14:25:54.440710 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3743/7358] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:54 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:55.465114 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-896f8113-5a6c-4920-8b28-5578fa985a58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:55.466207 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-896f8113-5a6c-4920-8b28-5578fa985a58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:55.473483 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-896f8113-5a6c-4920-8b28-5578fa985a58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:55.473982 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-896f8113-5a6c-4920-8b28-5578fa985a58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:55.474419 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-896f8113-5a6c-4920-8b28-5578fa985a58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:55.475162 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-896f8113-5a6c-4920-8b28-5578fa985a58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:55.475678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-896f8113-5a6c-4920-8b28-5578fa985a58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:55.476106 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-896f8113-5a6c-4920-8b28-5578fa985a58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:55.620745 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-896f8113-5a6c-4920-8b28-5578fa985a58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:55.635722 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-896f8113-5a6c-4920-8b28-5578fa985a58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1373 microversion: 2.1 time: 0.175375 Sep 08 14:25:55.636828 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3616/7359] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:55 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1373 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:56.670184 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-5c81d70c-3cd1-452d-bc69-b74109f7dd7a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:56.670815 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-5c81d70c-3cd1-452d-bc69-b74109f7dd7a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:56.678742 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c81d70c-3cd1-452d-bc69-b74109f7dd7a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:56.679274 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c81d70c-3cd1-452d-bc69-b74109f7dd7a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:56.679725 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c81d70c-3cd1-452d-bc69-b74109f7dd7a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:56.680447 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c81d70c-3cd1-452d-bc69-b74109f7dd7a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:56.680915 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c81d70c-3cd1-452d-bc69-b74109f7dd7a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:56.681356 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-5c81d70c-3cd1-452d-bc69-b74109f7dd7a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:56.822082 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-5c81d70c-3cd1-452d-bc69-b74109f7dd7a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:56.830118 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-5c81d70c-3cd1-452d-bc69-b74109f7dd7a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1373 microversion: 2.1 time: 0.163831 Sep 08 14:25:56.830709 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3744/7360] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:56 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1373 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:57.824678 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-ff64bacd-6931-4dda-a208-9450a7aef6ae req-03db60ae-628f-487b-8bf0-8b1d4c1b0672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4", "name": "network-vif-plugged", "status": "completed", "tag": "149e9159-97ec-433b-8800-05df244f8384"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:25:57.836164 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ff64bacd-6931-4dda-a208-9450a7aef6ae req-03db60ae-628f-487b-8bf0-8b1d4c1b0672 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:57.836656 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ff64bacd-6931-4dda-a208-9450a7aef6ae req-03db60ae-628f-487b-8bf0-8b1d4c1b0672 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:57.837088 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-ff64bacd-6931-4dda-a208-9450a7aef6ae req-03db60ae-628f-487b-8bf0-8b1d4c1b0672 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:57.849965 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-ff64bacd-6931-4dda-a208-9450a7aef6ae req-03db60ae-628f-487b-8bf0-8b1d4c1b0672 service nova] Creating event network-vif-plugged:149e9159-97ec-433b-8800-05df244f8384 for instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 on n-h1-852084-10 Sep 08 14:25:57.854201 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-e4208c18-d2f6-4461-8fa8-056ccf29a888 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:57.855530 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-e4208c18-d2f6-4461-8fa8-056ccf29a888 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:57.855673 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-ff64bacd-6931-4dda-a208-9450a7aef6ae req-03db60ae-628f-487b-8bf0-8b1d4c1b0672 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034735 Sep 08 14:25:57.856493 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3617/7361] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:25:57.869169 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4208c18-d2f6-4461-8fa8-056ccf29a888 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:57.870002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4208c18-d2f6-4461-8fa8-056ccf29a888 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:57.870503 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4208c18-d2f6-4461-8fa8-056ccf29a888 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:57.871568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4208c18-d2f6-4461-8fa8-056ccf29a888 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:57.872086 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4208c18-d2f6-4461-8fa8-056ccf29a888 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:57.878767 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-e4208c18-d2f6-4461-8fa8-056ccf29a888 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:58.033376 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-e4208c18-d2f6-4461-8fa8-056ccf29a888 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:58.042233 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-e4208c18-d2f6-4461-8fa8-056ccf29a888 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1373 microversion: 2.1 time: 0.191921 Sep 08 14:25:58.042852 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3745/7362] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:57 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1373 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 08 14:25:59.068614 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-6796223a-a3a7-44ae-ae92-1021092bf096 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:59.069967 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-6796223a-a3a7-44ae-ae92-1021092bf096 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:59.076744 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6796223a-a3a7-44ae-ae92-1021092bf096 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:59.077323 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6796223a-a3a7-44ae-ae92-1021092bf096 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:59.078420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6796223a-a3a7-44ae-ae92-1021092bf096 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:59.079196 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6796223a-a3a7-44ae-ae92-1021092bf096 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:59.079677 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6796223a-a3a7-44ae-ae92-1021092bf096 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:59.080131 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-6796223a-a3a7-44ae-ae92-1021092bf096 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:59.219768 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-6796223a-a3a7-44ae-ae92-1021092bf096 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:59.227808 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-6796223a-a3a7-44ae-ae92-1021092bf096 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1556 microversion: 2.1 time: 0.164540 Sep 08 14:25:59.228401 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3618/7363] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:59 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:25:59.252294 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1fa17872-8c4b-4d3f-b95e-f4a63bd0bd9e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:25:59.253009 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1fa17872-8c4b-4d3f-b95e-f4a63bd0bd9e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:25:59.260607 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1fa17872-8c4b-4d3f-b95e-f4a63bd0bd9e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:59.261226 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1fa17872-8c4b-4d3f-b95e-f4a63bd0bd9e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:59.261769 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1fa17872-8c4b-4d3f-b95e-f4a63bd0bd9e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:59.262664 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1fa17872-8c4b-4d3f-b95e-f4a63bd0bd9e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:25:59.263149 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1fa17872-8c4b-4d3f-b95e-f4a63bd0bd9e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:25:59.263822 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1fa17872-8c4b-4d3f-b95e-f4a63bd0bd9e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:25:59.403093 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1fa17872-8c4b-4d3f-b95e-f4a63bd0bd9e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:25:59.411239 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1fa17872-8c4b-4d3f-b95e-f4a63bd0bd9e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1556 microversion: 2.1 time: 0.164166 Sep 08 14:25:59.411844 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3746/7364] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:25:59 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1556 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:26:01.032885 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-3e24acdb-5e52-4040-acb5-942fa9dde282 req-48104784-fb4a-451e-a696-c62bd6480baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4", "tag": "149e9159-97ec-433b-8800-05df244f8384"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:26:01.044120 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3e24acdb-5e52-4040-acb5-942fa9dde282 req-48104784-fb4a-451e-a696-c62bd6480baf service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:26:01.044621 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3e24acdb-5e52-4040-acb5-942fa9dde282 req-48104784-fb4a-451e-a696-c62bd6480baf service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:26:01.045065 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-3e24acdb-5e52-4040-acb5-942fa9dde282 req-48104784-fb4a-451e-a696-c62bd6480baf service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:26:01.059024 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-3e24acdb-5e52-4040-acb5-942fa9dde282 req-48104784-fb4a-451e-a696-c62bd6480baf service nova] Creating event network-changed:149e9159-97ec-433b-8800-05df244f8384 for instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 on n-h1-852084-10 Sep 08 14:26:01.065009 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-3e24acdb-5e52-4040-acb5-942fa9dde282 req-48104784-fb4a-451e-a696-c62bd6480baf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037047 Sep 08 14:26:01.065801 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3619/7365] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:27:28.083535 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=26 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:27:28.084510 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=50 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:27:28.085762 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:27:28.085950 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 14:27:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4/action (ip 10.222.0.78) !!! Sep 08 14:27:28.087723 n-d-852084-10 devstack@n-api.service[128970]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:27:28.087880 n-d-852084-10 devstack@n-api.service[128970]: Thu Sep 8 14:27:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4/action (ip 10.222.0.78) !!! Sep 08 14:27:28.093731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-938bd01a-d696-4301-aba9-70099a7a639a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1398704133"}} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:27:28.096143 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-938bd01a-d696-4301-aba9-70099a7a639a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:27:28.106213 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-938bd01a-d696-4301-aba9-70099a7a639a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:28.106731 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-938bd01a-d696-4301-aba9-70099a7a639a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:28.107709 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-938bd01a-d696-4301-aba9-70099a7a639a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:28.108421 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-938bd01a-d696-4301-aba9-70099a7a639a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:28.108889 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-938bd01a-d696-4301-aba9-70099a7a639a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:28.109329 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-938bd01a-d696-4301-aba9-70099a7a639a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:28.333894 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-938bd01a-d696-4301-aba9-70099a7a639a tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "POST /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4/action" status: 202 len: 0 microversion: 2.1 time: 0.252155 Sep 08 14:27:28.334483 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3747/7366] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Sep 8 14:27:28 2022] POST /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Sep 08 14:27:32.183956 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:27:32.185431 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=50 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:27:32.186574 n-d-852084-10 devstack@n-api.service[128971]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 08 14:27:32.186886 n-d-852084-10 devstack@n-api.service[128971]: Thu Sep 8 14:27:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Sep 08 14:27:32.270313 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-2a5e20e9-b389-4162-b9cd-aae2369e1073 req-1ca49ad5-bb7f-48e7-a161-33a6e0eca896 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4", "name": "network-vif-plugged", "status": "completed", "tag": "149e9159-97ec-433b-8800-05df244f8384"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:27:32.285732 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2a5e20e9-b389-4162-b9cd-aae2369e1073 req-1ca49ad5-bb7f-48e7-a161-33a6e0eca896 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:32.286326 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2a5e20e9-b389-4162-b9cd-aae2369e1073 req-1ca49ad5-bb7f-48e7-a161-33a6e0eca896 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:32.286664 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-2a5e20e9-b389-4162-b9cd-aae2369e1073 req-1ca49ad5-bb7f-48e7-a161-33a6e0eca896 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:32.300548 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-2a5e20e9-b389-4162-b9cd-aae2369e1073 req-1ca49ad5-bb7f-48e7-a161-33a6e0eca896 service nova] Creating event network-vif-plugged:149e9159-97ec-433b-8800-05df244f8384 for instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 on n-h1-852084-10 Sep 08 14:27:32.306657 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-2a5e20e9-b389-4162-b9cd-aae2369e1073 req-1ca49ad5-bb7f-48e7-a161-33a6e0eca896 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126934 Sep 08 14:27:32.307954 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3620/7367] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:27:42.311539 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_api:SELECT=2 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:27:42.312424 n-d-852084-10 devstack@n-api.service[128970]: DEBUG dbcounter [-] [128970] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128970) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:27:42.313470 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_api:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:27:42.314271 n-d-852084-10 devstack@n-api.service[128971]: DEBUG dbcounter [-] [128971] Writing DB stats nova_cell1:SELECT=2 {{(pid=128971) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 08 14:27:42.317792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-ec387019-40bb-48b0-88e0-96d9457f1bb3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:27:42.318430 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ec387019-40bb-48b0-88e0-96d9457f1bb3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:27:42.326706 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec387019-40bb-48b0-88e0-96d9457f1bb3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:42.327209 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec387019-40bb-48b0-88e0-96d9457f1bb3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:42.327892 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec387019-40bb-48b0-88e0-96d9457f1bb3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:42.328792 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec387019-40bb-48b0-88e0-96d9457f1bb3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:42.329263 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec387019-40bb-48b0-88e0-96d9457f1bb3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:42.329708 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-ec387019-40bb-48b0-88e0-96d9457f1bb3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:42.361116 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-ec387019-40bb-48b0-88e0-96d9457f1bb3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Going to try to terminate instance {{(pid=128970) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:27:42.378756 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-45d47bfb-b137-4656-b05a-011ad0366675 req-b41756a3-a74f-4e25-b3fb-c72e7c912fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4", "tag": "149e9159-97ec-433b-8800-05df244f8384"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:27:42.389755 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-45d47bfb-b137-4656-b05a-011ad0366675 req-b41756a3-a74f-4e25-b3fb-c72e7c912fc4 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:42.390543 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-45d47bfb-b137-4656-b05a-011ad0366675 req-b41756a3-a74f-4e25-b3fb-c72e7c912fc4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:42.391148 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-45d47bfb-b137-4656-b05a-011ad0366675 req-b41756a3-a74f-4e25-b3fb-c72e7c912fc4 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:42.404261 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-45d47bfb-b137-4656-b05a-011ad0366675 req-b41756a3-a74f-4e25-b3fb-c72e7c912fc4 service nova] Creating event network-changed:149e9159-97ec-433b-8800-05df244f8384 for instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 on n-h1-852084-10 Sep 08 14:27:42.410097 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-45d47bfb-b137-4656-b05a-011ad0366675 req-b41756a3-a74f-4e25-b3fb-c72e7c912fc4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098348 Sep 08 14:27:42.411412 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3621/7368] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:27:42.446581 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-ec387019-40bb-48b0-88e0-96d9457f1bb3 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 204 len: 0 microversion: 2.1 time: 0.136920 Sep 08 14:27:42.447957 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3748/7369] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 14:27:42 2022] DELETE /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:27:42.456794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-115c24c9-b93f-421f-a3da-6a68d28a7de6 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:27:42.457649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-115c24c9-b93f-421f-a3da-6a68d28a7de6 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:27:42.464293 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-115c24c9-b93f-421f-a3da-6a68d28a7de6 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:42.465089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-115c24c9-b93f-421f-a3da-6a68d28a7de6 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:42.465764 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-115c24c9-b93f-421f-a3da-6a68d28a7de6 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:42.466796 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-115c24c9-b93f-421f-a3da-6a68d28a7de6 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:42.467632 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-115c24c9-b93f-421f-a3da-6a68d28a7de6 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:42.468282 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-115c24c9-b93f-421f-a3da-6a68d28a7de6 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:42.611898 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-115c24c9-b93f-421f-a3da-6a68d28a7de6 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:27:42.619986 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-115c24c9-b93f-421f-a3da-6a68d28a7de6 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1681 microversion: 2.1 time: 0.167496 Sep 08 14:27:42.620602 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3622/7370] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:27:42 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:27:43.644234 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-1789d7f1-fe54-46d4-adef-fd1292f2ef32 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:27:43.644851 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-1789d7f1-fe54-46d4-adef-fd1292f2ef32 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:27:43.651801 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789d7f1-fe54-46d4-adef-fd1292f2ef32 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:43.652303 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789d7f1-fe54-46d4-adef-fd1292f2ef32 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:43.652756 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789d7f1-fe54-46d4-adef-fd1292f2ef32 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:43.654235 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789d7f1-fe54-46d4-adef-fd1292f2ef32 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:43.654686 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789d7f1-fe54-46d4-adef-fd1292f2ef32 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:43.655125 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-1789d7f1-fe54-46d4-adef-fd1292f2ef32 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:43.867595 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-1789d7f1-fe54-46d4-adef-fd1292f2ef32 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:27:43.882283 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-1789d7f1-fe54-46d4-adef-fd1292f2ef32 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1681 microversion: 2.1 time: 0.241021 Sep 08 14:27:43.882283 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3749/7371] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:27:43 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1681 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:27:44.213516 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [req-e82faa4a-53d3-4816-9a1e-978b332489d5 req-246e01ff-f487-4ec7-99ac-c8f8f13fdaf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4", "name": "network-vif-unplugged", "status": "completed", "tag": "149e9159-97ec-433b-8800-05df244f8384"}]} {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:27:44.229332 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e82faa4a-53d3-4816-9a1e-978b332489d5 req-246e01ff-f487-4ec7-99ac-c8f8f13fdaf9 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:44.230135 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e82faa4a-53d3-4816-9a1e-978b332489d5 req-246e01ff-f487-4ec7-99ac-c8f8f13fdaf9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:44.230795 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [req-e82faa4a-53d3-4816-9a1e-978b332489d5 req-246e01ff-f487-4ec7-99ac-c8f8f13fdaf9 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:44.248143 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.compute.server_external_events [req-e82faa4a-53d3-4816-9a1e-978b332489d5 req-246e01ff-f487-4ec7-99ac-c8f8f13fdaf9 service nova] Creating event network-vif-unplugged:149e9159-97ec-433b-8800-05df244f8384 for instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 on n-h1-852084-10 Sep 08 14:27:44.254000 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [req-e82faa4a-53d3-4816-9a1e-978b332489d5 req-246e01ff-f487-4ec7-99ac-c8f8f13fdaf9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044755 Sep 08 14:27:44.255179 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3623/7372] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:27:44.556148 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-6b99032c-653a-4537-863f-1679ed5ca028 req-e9c68457-fa5e-47d2-9a75-b2b2e5b317ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4", "name": "network-vif-deleted", "tag": "149e9159-97ec-433b-8800-05df244f8384"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:27:44.571784 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6b99032c-653a-4537-863f-1679ed5ca028 req-e9c68457-fa5e-47d2-9a75-b2b2e5b317ae service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:44.572280 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6b99032c-653a-4537-863f-1679ed5ca028 req-e9c68457-fa5e-47d2-9a75-b2b2e5b317ae service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:44.572726 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-6b99032c-653a-4537-863f-1679ed5ca028 req-e9c68457-fa5e-47d2-9a75-b2b2e5b317ae service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:44.586206 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-6b99032c-653a-4537-863f-1679ed5ca028 req-e9c68457-fa5e-47d2-9a75-b2b2e5b317ae service nova] Creating event network-vif-deleted:149e9159-97ec-433b-8800-05df244f8384 for instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 on n-h1-852084-10 Sep 08 14:27:44.592051 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-6b99032c-653a-4537-863f-1679ed5ca028 req-e9c68457-fa5e-47d2-9a75-b2b2e5b317ae service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039803 Sep 08 14:27:44.592774 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3750/7373] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:27:44.905980 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:27:44.906859 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:27:44.913373 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:44.913946 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:44.914389 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:44.915089 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:44.915566 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:44.915987 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:44.951846 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:44.952342 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:44.952776 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:44.953221 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lazy-loading 'fault' on Instance uuid ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:27:45.010482 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:27:45.018353 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-ec63f4cf-8762-4c6f-8d80-f39dc8a994f5 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 200 len: 1337 microversion: 2.1 time: 0.117162 Sep 08 14:27:45.018941 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3624/7374] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:27:44 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 1337 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:27:46.043446 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-62ac02c4-6695-498b-9096-83ec61a5c96c tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:27:46.044803 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-62ac02c4-6695-498b-9096-83ec61a5c96c tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:27:46.051182 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62ac02c4-6695-498b-9096-83ec61a5c96c tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:46.051737 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62ac02c4-6695-498b-9096-83ec61a5c96c tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:46.052272 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62ac02c4-6695-498b-9096-83ec61a5c96c tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:46.052909 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62ac02c4-6695-498b-9096-83ec61a5c96c tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:46.053375 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62ac02c4-6695-498b-9096-83ec61a5c96c tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:46.053821 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-62ac02c4-6695-498b-9096-83ec61a5c96c tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:46.067714 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-62ac02c4-6695-498b-9096-83ec61a5c96c tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] HTTP exception thrown: Instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 could not be found. Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-62ac02c4-6695-498b-9096-83ec61a5c96c tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Request method failure captured: Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 HTTP/1.1 Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfrPzjLXc46ImboqUvcmLwA93hIZ-mKxlfqMFAN9fdAwdOg_BkTpN30eNDS120tq9_0LIRpTlceMkN7hIdMFStFskC33f1FSzihQfoOVABRsOh4q-6KjsxPBfwidZAsjIselhn9GjTEPznPiz_HHUfhgl0hNjwemXiQAhZ8pu5INWQo Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d99d03ce7f244834bbbb557d84f94462 Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestSnapshotPattern-67976113 Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d99d03ce7f244834bbbb557d84f94462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d99d03ce7f244834bbbb557d84f94462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d99d03ce7f244834bbbb557d84f94462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d99d03ce7f244834bbbb557d84f94462"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestSnapshotPattern-67976113 Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d99d03ce7f244834bbbb557d84f94462 Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestSnapshotPattern-67976113 Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestSnapshotPattern-67976113-project Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: f4ce809338e445ee9a665f52dcf0c35f Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestSnapshotPattern-67976113-project Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 could not be found. Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4'} Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 could not be found. Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 could not be found. Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:27:46.069405 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:27:46.075054 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:27:46.075054 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:27:46.075054 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:27:46.075054 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:27:46.075054 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:27:46.075054 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 could not be found. Sep 08 14:27:46.075054 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:27:46.075054 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-62ac02c4-6695-498b-9096-83ec61a5c96c tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Returning 404 to user: Instance ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:27:46.075054 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-62ac02c4-6695-498b-9096-83ec61a5c96c tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4" status: 404 len: 111 microversion: 2.1 time: 0.032592 Sep 08 14:27:46.075054 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3751/7375] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:27:46 2022] GET /compute/v2.1/servers/ca28e6d5-4eea-4a8a-bd83-1b2aa88cf2c4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:27:47.532957 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-70180e06-047c-4b4f-834a-da792b2510ed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:27:47.533537 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-70180e06-047c-4b4f-834a-da792b2510ed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:27:47.541032 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70180e06-047c-4b4f-834a-da792b2510ed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:47.541526 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70180e06-047c-4b4f-834a-da792b2510ed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:47.541977 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-4cdefdde-21ae-4249-b004-94c0251d0370 req-2b1bd2c8-df45-4adc-8889-7bde48e4b844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4db76c7-a52e-44b2-ab86-66e5bbab5187", "tag": "93ae92f7-8e99-4a3c-994f-def9facb73a8"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:27:47.542456 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70180e06-047c-4b4f-834a-da792b2510ed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:47.542945 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70180e06-047c-4b4f-834a-da792b2510ed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:47.543473 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70180e06-047c-4b4f-834a-da792b2510ed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:47.544648 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-70180e06-047c-4b4f-834a-da792b2510ed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:47.553960 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4cdefdde-21ae-4249-b004-94c0251d0370 req-2b1bd2c8-df45-4adc-8889-7bde48e4b844 service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:47.554457 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4cdefdde-21ae-4249-b004-94c0251d0370 req-2b1bd2c8-df45-4adc-8889-7bde48e4b844 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:47.554905 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-4cdefdde-21ae-4249-b004-94c0251d0370 req-2b1bd2c8-df45-4adc-8889-7bde48e4b844 service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:47.566358 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-4cdefdde-21ae-4249-b004-94c0251d0370 req-2b1bd2c8-df45-4adc-8889-7bde48e4b844 service nova] Creating event network-changed:93ae92f7-8e99-4a3c-994f-def9facb73a8 for instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 on n-h2-852084-10 Sep 08 14:27:47.571928 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-4cdefdde-21ae-4249-b004-94c0251d0370 req-2b1bd2c8-df45-4adc-8889-7bde48e4b844 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033514 Sep 08 14:27:47.572774 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3752/7376] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:27:47.575578 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-70180e06-047c-4b4f-834a-da792b2510ed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Going to try to terminate instance {{(pid=128971) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 08 14:27:47.673420 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-70180e06-047c-4b4f-834a-da792b2510ed tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 204 len: 0 microversion: 2.1 time: 0.145070 Sep 08 14:27:47.677537 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3625/7377] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Sep 8 14:27:47 2022] DELETE /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 08 14:27:47.688571 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-233b4dc7-bb47-45d3-96a8-2aaefa85fe58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:27:47.689619 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-233b4dc7-bb47-45d3-96a8-2aaefa85fe58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:27:47.704243 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-233b4dc7-bb47-45d3-96a8-2aaefa85fe58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:47.704955 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-233b4dc7-bb47-45d3-96a8-2aaefa85fe58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:47.705627 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-233b4dc7-bb47-45d3-96a8-2aaefa85fe58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:47.706568 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-233b4dc7-bb47-45d3-96a8-2aaefa85fe58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:47.707370 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-233b4dc7-bb47-45d3-96a8-2aaefa85fe58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:47.708002 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-233b4dc7-bb47-45d3-96a8-2aaefa85fe58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:47.858617 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.policy [None req-233b4dc7-bb47-45d3-96a8-2aaefa85fe58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128970) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:27:47.867341 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-233b4dc7-bb47-45d3-96a8-2aaefa85fe58 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1679 microversion: 2.1 time: 0.188262 Sep 08 14:27:47.868422 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3753/7378] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:27:47 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1679 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:27:48.891156 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-903a13b0-c073-47bd-88d3-8139ddd6be0e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:27:48.891884 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-903a13b0-c073-47bd-88d3-8139ddd6be0e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:27:48.898668 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-903a13b0-c073-47bd-88d3-8139ddd6be0e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:48.899142 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-903a13b0-c073-47bd-88d3-8139ddd6be0e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:48.899649 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-903a13b0-c073-47bd-88d3-8139ddd6be0e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:48.900339 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-903a13b0-c073-47bd-88d3-8139ddd6be0e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:48.900794 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-903a13b0-c073-47bd-88d3-8139ddd6be0e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:48.901217 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-903a13b0-c073-47bd-88d3-8139ddd6be0e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:49.119174 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-903a13b0-c073-47bd-88d3-8139ddd6be0e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:27:49.128149 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-903a13b0-c073-47bd-88d3-8139ddd6be0e tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1679 microversion: 2.1 time: 0.241236 Sep 08 14:27:49.139289 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3626/7379] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:27:48 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1679 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:27:49.710494 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [req-7b667249-52b5-4d49-8406-dd01bedb0130 req-4219ea74-1700-4cf0-a032-122e9fee0f3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4db76c7-a52e-44b2-ab86-66e5bbab5187", "name": "network-vif-deleted", "tag": "93ae92f7-8e99-4a3c-994f-def9facb73a8"}]} {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 08 14:27:49.722547 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7b667249-52b5-4d49-8406-dd01bedb0130 req-4219ea74-1700-4cf0-a032-122e9fee0f3c service nova] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:49.723348 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7b667249-52b5-4d49-8406-dd01bedb0130 req-4219ea74-1700-4cf0-a032-122e9fee0f3c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:49.723981 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [req-7b667249-52b5-4d49-8406-dd01bedb0130 req-4219ea74-1700-4cf0-a032-122e9fee0f3c service nova] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:49.739609 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.compute.server_external_events [req-7b667249-52b5-4d49-8406-dd01bedb0130 req-4219ea74-1700-4cf0-a032-122e9fee0f3c service nova] Creating event network-vif-deleted:93ae92f7-8e99-4a3c-994f-def9facb73a8 for instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 on n-h2-852084-10 Sep 08 14:27:49.744681 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [req-7b667249-52b5-4d49-8406-dd01bedb0130 req-4219ea74-1700-4cf0-a032-122e9fee0f3c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038038 Sep 08 14:27:49.745288 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3754/7380] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Sep 8 14:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 08 14:27:50.152275 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:27:50.152900 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.compute.api [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128971) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:27:50.160787 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:50.161272 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:50.161705 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:50.162405 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:50.162854 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:50.163301 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:50.198448 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:50.198943 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:50.199420 n-d-852084-10 devstack@n-api.service[128971]: DEBUG oslo_concurrency.lockutils [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128971) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:50.199874 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.objects.instance [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lazy-loading 'fault' on Instance uuid f4db76c7-a52e-44b2-ab86-66e5bbab5187 {{(pid=128971) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 08 14:27:50.246292 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.policy [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4ce809338e445ee9a665f52dcf0c35f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd99d03ce7f244834bbbb557d84f94462', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128971) authorize /opt/stack/nova/nova/policy.py:199}} Sep 08 14:27:50.253930 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-00dfe244-a00d-4968-8949-e9907cbb9385 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 200 len: 1336 microversion: 2.1 time: 0.105785 Sep 08 14:27:50.254512 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3627/7381] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:27:50 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 1336 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 08 14:27:51.280878 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8907c7ed-6e1e-4878-8f6f-8b4dd2527536 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '>' {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:27:51.281626 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.compute.api [None req-8907c7ed-6e1e-4878-8f6f-8b4dd2527536 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] [instance: f4db76c7-a52e-44b2-ab86-66e5bbab5187] Fetching instance by UUID {{(pid=128970) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 08 14:27:51.288268 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8907c7ed-6e1e-4878-8f6f-8b4dd2527536 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:51.288771 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8907c7ed-6e1e-4878-8f6f-8b4dd2527536 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:51.289245 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8907c7ed-6e1e-4878-8f6f-8b4dd2527536 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:51.289972 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8907c7ed-6e1e-4878-8f6f-8b4dd2527536 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Acquiring lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 08 14:27:51.290431 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8907c7ed-6e1e-4878-8f6f-8b4dd2527536 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 08 14:27:51.290869 n-d-852084-10 devstack@n-api.service[128970]: DEBUG oslo_concurrency.lockutils [None req-8907c7ed-6e1e-4878-8f6f-8b4dd2527536 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Lock "eae6964b-faf8-466e-9843-5d6b1ae075c6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128970) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 08 14:27:51.306959 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.wsgi [None req-8907c7ed-6e1e-4878-8f6f-8b4dd2527536 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] HTTP exception thrown: Instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 could not be found. Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8907c7ed-6e1e-4878-8f6f-8b4dd2527536 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Request method failure captured: Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: request: GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 HTTP/1.1 Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: Accept: application/json Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: Accept-Encoding: identity Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: Connection: close Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: Content-Length: 0 Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: Content-Type: application/json Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: Host: 10.222.0.78 Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: Openstack-System-Scope: None Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: User-Agent: python-urllib3/1.26.12 Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Auth-Token: gAAAAABjGfrPzjLXc46ImboqUvcmLwA93hIZ-mKxlfqMFAN9fdAwdOg_BkTpN30eNDS120tq9_0LIRpTlceMkN7hIdMFStFskC33f1FSzihQfoOVABRsOh4q-6KjsxPBfwidZAsjIselhn9GjTEPznPiz_HHUfhgl0hNjwemXiQAhZ8pu5INWQo Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Id: None Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Domain-Name: None Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Identity-Status: Confirmed Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Is-Admin-Project: True Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Id: default Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Domain-Name: Default Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Id: d99d03ce7f244834bbbb557d84f94462 Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Project-Name: tempest-TestSnapshotPattern-67976113 Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Role: member,reader Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Roles: member,reader Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_d99d03ce7f244834bbbb557d84f94462"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/d99d03ce7f244834bbbb557d84f94462"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d99d03ce7f244834bbbb557d84f94462"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/d99d03ce7f244834bbbb557d84f94462"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}] Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant: tempest-TestSnapshotPattern-67976113 Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Id: d99d03ce7f244834bbbb557d84f94462 Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-Tenant-Name: tempest-TestSnapshotPattern-67976113 Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-User: tempest-TestSnapshotPattern-67976113-project Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Id: default Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-User-Domain-Name: Default Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-User-Id: f4ce809338e445ee9a665f52dcf0c35f Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: X-User-Name: tempest-TestSnapshotPattern-67976113-project Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: method: > Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: exception: Instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 could not be found. Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: action_args: {'id': 'f4db76c7-a52e-44b2-ab86-66e5bbab5187'} Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: {{(pid=128970) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 could not be found. Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 could not be found. Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 08 14:27:51.308705 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:27:51.314298 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 08 14:27:51.314298 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 08 14:27:51.314298 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 08 14:27:51.314298 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 08 14:27:51.314298 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 08 14:27:51.314298 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 could not be found. Sep 08 14:27:51.314298 n-d-852084-10 devstack@n-api.service[128970]: ERROR nova.api.openstack.wsgi Sep 08 14:27:51.314298 n-d-852084-10 devstack@n-api.service[128970]: DEBUG nova.api.openstack.wsgi [None req-8907c7ed-6e1e-4878-8f6f-8b4dd2527536 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Returning 404 to user: Instance f4db76c7-a52e-44b2-ab86-66e5bbab5187 could not be found. {{(pid=128970) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 08 14:27:51.314298 n-d-852084-10 devstack@n-api.service[128970]: INFO nova.api.openstack.requestlog [None req-8907c7ed-6e1e-4878-8f6f-8b4dd2527536 tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187" status: 404 len: 111 microversion: 2.1 time: 0.035051 Sep 08 14:27:51.314298 n-d-852084-10 devstack@n-api.service[128970]: [pid: 128970|app: 0|req: 3755/7382] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Sep 8 14:27:51 2022] GET /compute/v2.1/servers/f4db76c7-a52e-44b2-ab86-66e5bbab5187 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 08 14:27:51.480954 n-d-852084-10 devstack@n-api.service[128971]: DEBUG nova.api.openstack.wsgi [None req-d4a6528c-fdd0-4ce0-a470-afb120629fce tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] Calling method '.version_select at 0x7fdb3a080160>' {{(pid=128971) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 08 14:27:51.505615 n-d-852084-10 devstack@n-api.service[128971]: INFO nova.api.openstack.requestlog [None req-d4a6528c-fdd0-4ce0-a470-afb120629fce tempest-TestSnapshotPattern-67976113 tempest-TestSnapshotPattern-67976113-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-414968858" status: 202 len: 0 microversion: 2.1 time: 0.028501 Sep 08 14:27:51.506123 n-d-852084-10 devstack@n-api.service[128971]: [pid: 128971|app: 0|req: 3628/7383] 10.222.0.78 () {58 vars in 1254 bytes} [Thu Sep 8 14:27:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-414968858 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)